2024-09-12T16:56:32.320 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T16:56:32.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T16:56:32.423 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902707 branch: wip-rgw-meta-handlers description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7902707' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 6279 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOKenXAO1lWxQBTAMZ7n+gn63GmPvMeWEPSzc5AsUO7oIjZ3fhwVFi6AIOg64ZEaFi63vyQE0BTpNseTOMB2rH4= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCAdb9H9WUMmMJVH0K091MuPyzyqyh5iNuJfAX2Ek3TiwfjZs/Bo9qa9ECMOseE4XpryWheJTK71VVlZUZupCfY= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_15:39:52 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T16:56:32.423 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-12T16:56:32.424 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-12T16:56:32.424 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T16:56:32.426 INFO:teuthology.task.internal:Checking packages... 2024-09-12T16:56:32.448 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-12T16:56:32.448 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T16:56:32.448 INFO:teuthology.packaging:ref: None 2024-09-12T16:56:32.448 INFO:teuthology.packaging:tag: None 2024-09-12T16:56:32.448 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-12T16:56:32.448 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:56:32.449 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-12T16:56:32.605 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:56:32.606 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T16:56:32.613 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T16:56:32.613 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T16:56:32.646 INFO:teuthology.task.internal:Saving configuration 2024-09-12T16:56:32.663 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T16:56:32.669 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T16:56:32.693 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902707', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 16:50:57.357776', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINQV8+6A29SsNb9DdYoRA1mTitxWBCozwxgtla3YIrpO'} 2024-09-12T16:56:32.718 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902707', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 16:50:57.359357', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINn+8DRo1w4h3jsDou9gFRF4+Vwp/w2f9VmMfuSopGkI'} 2024-09-12T16:56:32.718 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T16:56:32.724 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T16:56:32.724 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T16:56:32.724 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T16:56:32.836 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f26b5f0bac0>, signals=[15]) 2024-09-12T16:56:32.836 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T16:56:32.842 INFO:teuthology.task.internal:Opening connections... 2024-09-12T16:56:32.842 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T16:56:32.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:56:32.935 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T16:56:32.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:56:33.018 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T16:56:33.025 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-09-12T16:56:33.031 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-09-12T16:56:33.031 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-09-12T16:56:33.078 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T16:56:33.078 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Ubuntu" 2024-09-12T16:56:33.078 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="22.04" 2024-09-12T16:56:33.078 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T16:56:33.078 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_CODENAME=jammy 2024-09-12T16:56:33.078 INFO:teuthology.orchestra.run.smithi119.stdout:ID=ubuntu 2024-09-12T16:56:33.078 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE=debian 2024-09-12T16:56:33.079 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T16:56:33.079 INFO:teuthology.orchestra.run.smithi119.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T16:56:33.079 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T16:56:33.079 INFO:teuthology.orchestra.run.smithi119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T16:56:33.079 INFO:teuthology.orchestra.run.smithi119.stdout:UBUNTU_CODENAME=jammy 2024-09-12T16:56:33.079 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-09-12T16:56:33.103 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-09-12T16:56:33.108 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-09-12T16:56:33.109 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-09-12T16:56:33.156 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T16:56:33.157 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Ubuntu" 2024-09-12T16:56:33.157 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="22.04" 2024-09-12T16:56:33.157 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T16:56:33.157 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_CODENAME=jammy 2024-09-12T16:56:33.157 INFO:teuthology.orchestra.run.smithi194.stdout:ID=ubuntu 2024-09-12T16:56:33.157 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE=debian 2024-09-12T16:56:33.157 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T16:56:33.157 INFO:teuthology.orchestra.run.smithi194.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T16:56:33.157 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T16:56:33.157 INFO:teuthology.orchestra.run.smithi194.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T16:56:33.157 INFO:teuthology.orchestra.run.smithi194.stdout:UBUNTU_CODENAME=jammy 2024-09-12T16:56:33.158 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-09-12T16:56:33.178 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T16:56:33.188 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T16:56:33.211 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T16:56:33.212 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:56:33.214 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:56:33.219 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T16:56:33.237 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T16:56:33.237 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:56:33.259 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:56:33.276 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T16:56:33.332 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T16:56:33.347 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T16:56:33.347 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T16:56:33.347 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:56:33.348 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:56:33.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:56:33.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:56:33.353 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-09-12T16:56:33.354 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-09-12T16:56:33.401 INFO:teuthology.orchestra.run.smithi194.stdout:5.15.0-56-generic 2024-09-12T16:56:33.402 INFO:teuthology.task.kernel:Running kernel on smithi194: 5.15.0-56-generic 2024-09-12T16:56:33.402 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get clean 2024-09-12T16:56:33.403 INFO:teuthology.orchestra.run.smithi119.stdout:5.15.0-56-generic 2024-09-12T16:56:33.403 INFO:teuthology.task.kernel:Running kernel on smithi119: 5.15.0-56-generic 2024-09-12T16:56:33.403 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get clean 2024-09-12T16:56:33.533 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get update 2024-09-12T16:56:33.543 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2024-09-12T16:56:33.667 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:56:33.673 INFO:teuthology.orchestra.run.smithi194.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T16:56:33.683 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T16:56:33.752 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T16:56:33.781 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:56:33.784 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T16:56:33.861 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T16:56:33.873 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T16:56:33.896 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T16:56:33.975 INFO:teuthology.orchestra.run.smithi194.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T16:56:33.978 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T16:56:33.981 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T16:56:33.985 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T16:56:33.985 INFO:teuthology.orchestra.run.smithi194.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T16:56:33.995 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T16:56:34.000 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T16:56:34.000 INFO:teuthology.orchestra.run.smithi194.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T16:56:34.002 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T16:56:34.003 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T16:56:34.003 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T16:56:34.003 INFO:teuthology.orchestra.run.smithi194.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T16:56:34.003 INFO:teuthology.orchestra.run.smithi194.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T16:56:34.010 INFO:teuthology.orchestra.run.smithi194.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T16:56:34.014 INFO:teuthology.orchestra.run.smithi194.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T16:56:34.016 INFO:teuthology.orchestra.run.smithi194.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T16:56:34.017 INFO:teuthology.orchestra.run.smithi194.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T16:56:34.017 INFO:teuthology.orchestra.run.smithi194.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T16:56:34.024 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T16:56:34.027 INFO:teuthology.orchestra.run.smithi194.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T16:56:34.027 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T16:56:34.027 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T16:56:34.031 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T16:56:34.040 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T16:56:34.041 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T16:56:34.042 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T16:56:34.042 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T16:56:34.042 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T16:56:34.056 INFO:teuthology.orchestra.run.smithi194.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T16:56:34.058 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T16:56:34.076 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T16:56:34.076 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T16:56:34.077 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T16:56:34.077 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T16:56:34.078 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T16:56:34.078 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T16:56:34.078 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T16:56:34.078 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T16:56:34.219 INFO:teuthology.orchestra.run.smithi194.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T16:56:34.225 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T16:56:34.357 INFO:teuthology.orchestra.run.smithi194.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T16:56:34.508 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T16:56:34.551 INFO:teuthology.orchestra.run.smithi194.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T16:56:34.680 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T16:56:34.693 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T16:56:34.693 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T16:56:34.708 INFO:teuthology.orchestra.run.smithi194.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T16:56:34.722 INFO:teuthology.orchestra.run.smithi194.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T16:56:34.723 INFO:teuthology.orchestra.run.smithi194.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T16:56:34.778 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T16:56:34.779 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T16:56:34.787 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T16:56:34.788 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T16:56:34.791 INFO:teuthology.orchestra.run.smithi194.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T16:56:34.792 INFO:teuthology.orchestra.run.smithi194.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T16:56:34.808 INFO:teuthology.orchestra.run.smithi194.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T16:56:34.808 INFO:teuthology.orchestra.run.smithi194.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T16:56:34.811 INFO:teuthology.orchestra.run.smithi119.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T16:56:34.830 INFO:teuthology.orchestra.run.smithi194.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T16:56:34.838 INFO:teuthology.orchestra.run.smithi119.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T16:56:34.844 INFO:teuthology.orchestra.run.smithi119.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T16:56:34.844 INFO:teuthology.orchestra.run.smithi119.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T16:56:34.844 INFO:teuthology.orchestra.run.smithi119.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T16:56:34.861 INFO:teuthology.orchestra.run.smithi194.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T16:56:34.867 INFO:teuthology.orchestra.run.smithi194.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T16:56:34.873 INFO:teuthology.orchestra.run.smithi194.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T16:56:34.873 INFO:teuthology.orchestra.run.smithi194.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T16:56:34.925 INFO:teuthology.orchestra.run.smithi119.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T16:56:34.925 INFO:teuthology.orchestra.run.smithi119.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T16:56:34.943 INFO:teuthology.orchestra.run.smithi194.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T16:56:34.944 INFO:teuthology.orchestra.run.smithi194.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T16:56:34.944 INFO:teuthology.orchestra.run.smithi194.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T16:56:34.945 INFO:teuthology.orchestra.run.smithi194.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T16:56:34.947 INFO:teuthology.orchestra.run.smithi194.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T16:56:34.954 INFO:teuthology.orchestra.run.smithi194.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T16:56:34.954 INFO:teuthology.orchestra.run.smithi194.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T16:56:34.955 INFO:teuthology.orchestra.run.smithi194.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T16:56:35.036 INFO:teuthology.orchestra.run.smithi194.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T16:56:35.036 INFO:teuthology.orchestra.run.smithi194.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T16:56:40.192 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 15.8 MB in 2s (7,440 kB/s) 2024-09-12T16:56:40.214 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 15.8 MB in 2s (7,445 kB/s) 2024-09-12T16:56:41.645 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-09-12T16:56:41.663 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:56:41.681 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-12T16:56:41.700 DEBUG:teuthology.orchestra.run.smithi194:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:56:41.726 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-09-12T16:56:41.766 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-12T16:56:41.935 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2024-09-12T16:56:41.935 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2024-09-12T16:56:41.978 INFO:teuthology.orchestra.run.smithi194.stdout:Building dependency tree... 2024-09-12T16:56:41.978 INFO:teuthology.orchestra.run.smithi194.stdout:Reading state information... 2024-09-12T16:56:42.122 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:56:42.122 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:56:42.122 INFO:teuthology.orchestra.run.smithi119.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:56:42.123 INFO:teuthology.orchestra.run.smithi119.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:56:42.123 INFO:teuthology.orchestra.run.smithi119.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T16:56:42.123 INFO:teuthology.orchestra.run.smithi119.stdout: python2.7-minimal 2024-09-12T16:56:42.123 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:56:42.125 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2024-09-12T16:56:42.125 INFO:teuthology.orchestra.run.smithi119.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:56:42.126 INFO:teuthology.orchestra.run.smithi119.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T16:56:42.126 INFO:teuthology.orchestra.run.smithi119.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T16:56:42.127 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2024-09-12T16:56:42.128 INFO:teuthology.orchestra.run.smithi119.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T16:56:42.128 INFO:teuthology.orchestra.run.smithi119.stdout:Recommended packages: 2024-09-12T16:56:42.128 INFO:teuthology.orchestra.run.smithi119.stdout: thermald 2024-09-12T16:56:42.169 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:56:42.169 INFO:teuthology.orchestra.run.smithi194.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:56:42.169 INFO:teuthology.orchestra.run.smithi194.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:56:42.169 INFO:teuthology.orchestra.run.smithi194.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:56:42.169 INFO:teuthology.orchestra.run.smithi194.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T16:56:42.169 INFO:teuthology.orchestra.run.smithi194.stdout: python2.7-minimal 2024-09-12T16:56:42.170 INFO:teuthology.orchestra.run.smithi194.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:56:42.171 INFO:teuthology.orchestra.run.smithi194.stdout:The following additional packages will be installed: 2024-09-12T16:56:42.172 INFO:teuthology.orchestra.run.smithi194.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:56:42.172 INFO:teuthology.orchestra.run.smithi194.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T16:56:42.172 INFO:teuthology.orchestra.run.smithi194.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T16:56:42.172 INFO:teuthology.orchestra.run.smithi194.stdout:Suggested packages: 2024-09-12T16:56:42.172 INFO:teuthology.orchestra.run.smithi194.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T16:56:42.172 INFO:teuthology.orchestra.run.smithi194.stdout:Recommended packages: 2024-09-12T16:56:42.172 INFO:teuthology.orchestra.run.smithi194.stdout: thermald 2024-09-12T16:56:42.173 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2024-09-12T16:56:42.173 INFO:teuthology.orchestra.run.smithi119.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:56:42.173 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T16:56:42.173 INFO:teuthology.orchestra.run.smithi119.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T16:56:42.173 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages will be upgraded: 2024-09-12T16:56:42.173 INFO:teuthology.orchestra.run.smithi119.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T16:56:42.221 INFO:teuthology.orchestra.run.smithi119.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:56:42.221 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 113 MB of archives. 2024-09-12T16:56:42.221 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T16:56:42.221 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T16:56:42.223 INFO:teuthology.orchestra.run.smithi194.stdout:The following NEW packages will be installed: 2024-09-12T16:56:42.223 INFO:teuthology.orchestra.run.smithi194.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:56:42.223 INFO:teuthology.orchestra.run.smithi194.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T16:56:42.223 INFO:teuthology.orchestra.run.smithi194.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T16:56:42.224 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages will be upgraded: 2024-09-12T16:56:42.225 INFO:teuthology.orchestra.run.smithi194.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T16:56:42.276 INFO:teuthology.orchestra.run.smithi194.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:56:42.276 INFO:teuthology.orchestra.run.smithi194.stdout:Need to get 113 MB of archives. 2024-09-12T16:56:42.276 INFO:teuthology.orchestra.run.smithi194.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T16:56:42.276 INFO:teuthology.orchestra.run.smithi194.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T16:56:42.636 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T16:56:42.694 INFO:teuthology.orchestra.run.smithi194.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T16:56:42.727 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T16:56:42.792 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T16:56:43.551 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T16:56:43.551 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T16:56:43.551 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T16:56:43.563 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T16:56:43.563 INFO:teuthology.orchestra.run.smithi194.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T16:56:43.563 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T16:56:43.672 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T16:56:43.682 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T16:56:43.693 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T16:56:43.782 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T16:56:44.171 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 113 MB in 2s (71.7 MB/s) 2024-09-12T16:56:44.194 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 113 MB in 2s (73.1 MB/s) 2024-09-12T16:56:44.313 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T16:56:44.422 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T16:56:46.346 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T16:56:46.350 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:56:46.380 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T16:56:46.385 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:56:46.428 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:56:46.574 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:56:48.701 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T16:56:48.721 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:56:48.816 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:56:48.956 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T16:56:48.977 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:56:49.059 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:56:49.228 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T16:56:49.249 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:56:49.277 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:56:49.526 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T16:56:49.546 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:56:49.576 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:56:56.018 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:56:56.067 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:56:56.144 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:56:56.168 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:56:56.486 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:56:56.517 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:56:56.597 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:56:56.638 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:56:56.925 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T16:56:56.948 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T16:56:56.949 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T16:56:56.971 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T16:56:56.991 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:56:57.016 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:57:02.689 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T16:57:02.725 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:57:02.764 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:57:03.182 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T16:57:03.220 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:57:03.257 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:57:05.310 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:57:05.458 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:57:05.782 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:57:05.904 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:57:05.949 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:57:06.021 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T16:57:06.074 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:57:06.125 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:57:06.424 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:57:06.571 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:57:06.689 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T16:57:06.793 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:57:07.451 INFO:teuthology.orchestra.run.smithi119.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:57:07.451 INFO:teuthology.orchestra.run.smithi119.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T16:57:07.451 INFO:teuthology.orchestra.run.smithi119.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:57:07.451 INFO:teuthology.orchestra.run.smithi119.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T16:57:07.644 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:57:08.125 INFO:teuthology.orchestra.run.smithi194.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:57:08.125 INFO:teuthology.orchestra.run.smithi194.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T16:57:08.125 INFO:teuthology.orchestra.run.smithi194.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:57:08.125 INFO:teuthology.orchestra.run.smithi194.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T16:57:08.268 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:57:09.053 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:57:10.136 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:57:10.830 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T16:57:10.956 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T16:57:11.057 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:57:11.110 INFO:teuthology.orchestra.run.smithi119.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T16:57:11.110 INFO:teuthology.orchestra.run.smithi119.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:57:11.570 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T16:57:11.696 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T16:57:11.848 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:57:11.912 INFO:teuthology.orchestra.run.smithi194.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T16:57:11.912 INFO:teuthology.orchestra.run.smithi194.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:57:25.944 INFO:teuthology.orchestra.run.smithi119.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T16:57:25.944 INFO:teuthology.orchestra.run.smithi119.stdout:Sourcing file `/etc/default/grub' 2024-09-12T16:57:25.953 INFO:teuthology.orchestra.run.smithi119.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:57:25.980 INFO:teuthology.orchestra.run.smithi119.stdout:Generating grub configuration file ... 2024-09-12T16:57:26.255 INFO:teuthology.orchestra.run.smithi119.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:57:26.277 INFO:teuthology.orchestra.run.smithi119.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:57:26.362 INFO:teuthology.orchestra.run.smithi194.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T16:57:26.362 INFO:teuthology.orchestra.run.smithi194.stdout:Sourcing file `/etc/default/grub' 2024-09-12T16:57:26.383 INFO:teuthology.orchestra.run.smithi194.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:57:26.397 INFO:teuthology.orchestra.run.smithi194.stdout:Generating grub configuration file ... 2024-09-12T16:57:26.610 INFO:teuthology.orchestra.run.smithi119.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:57:26.616 INFO:teuthology.orchestra.run.smithi119.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:57:26.689 INFO:teuthology.orchestra.run.smithi119.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:57:26.695 INFO:teuthology.orchestra.run.smithi119.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:57:26.714 INFO:teuthology.orchestra.run.smithi194.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:57:26.733 INFO:teuthology.orchestra.run.smithi194.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:57:26.850 INFO:teuthology.orchestra.run.smithi119.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:57:26.850 INFO:teuthology.orchestra.run.smithi119.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:57:26.850 INFO:teuthology.orchestra.run.smithi119.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:57:26.894 INFO:teuthology.orchestra.run.smithi119.stdout:done 2024-09-12T16:57:27.058 INFO:teuthology.orchestra.run.smithi194.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:57:27.064 INFO:teuthology.orchestra.run.smithi194.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:57:27.135 INFO:teuthology.orchestra.run.smithi194.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:57:27.141 INFO:teuthology.orchestra.run.smithi194.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:57:27.303 INFO:teuthology.orchestra.run.smithi194.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:57:27.303 INFO:teuthology.orchestra.run.smithi194.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:57:27.303 INFO:teuthology.orchestra.run.smithi194.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:57:27.337 INFO:teuthology.orchestra.run.smithi194.stdout:done 2024-09-12T16:57:27.345 DEBUG:teuthology.orchestra.run.smithi119:> dpkg -s linux-image-generic 2024-09-12T16:57:27.365 INFO:teuthology.orchestra.run.smithi119.stdout:Package: linux-image-generic 2024-09-12T16:57:27.365 INFO:teuthology.orchestra.run.smithi119.stdout:Status: install ok installed 2024-09-12T16:57:27.366 INFO:teuthology.orchestra.run.smithi119.stdout:Priority: optional 2024-09-12T16:57:27.366 INFO:teuthology.orchestra.run.smithi119.stdout:Section: kernel 2024-09-12T16:57:27.366 INFO:teuthology.orchestra.run.smithi119.stdout:Installed-Size: 21 2024-09-12T16:57:27.366 INFO:teuthology.orchestra.run.smithi119.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:57:27.366 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: amd64 2024-09-12T16:57:27.366 INFO:teuthology.orchestra.run.smithi119.stdout:Source: linux-meta 2024-09-12T16:57:27.366 INFO:teuthology.orchestra.run.smithi119.stdout:Version: 5.15.0.119.119 2024-09-12T16:57:27.366 INFO:teuthology.orchestra.run.smithi119.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:57:27.366 INFO:teuthology.orchestra.run.smithi119.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:57:27.366 INFO:teuthology.orchestra.run.smithi119.stdout:Recommends: thermald 2024-09-12T16:57:27.366 INFO:teuthology.orchestra.run.smithi119.stdout:Description: Generic Linux kernel image 2024-09-12T16:57:27.366 INFO:teuthology.orchestra.run.smithi119.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:57:27.366 INFO:teuthology.orchestra.run.smithi119.stdout: available. 2024-09-12T16:57:27.367 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T16:57:27.367 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T16:57:27.367 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T16:57:27.367 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T16:57:27.367 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi119.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T16:57:27.367 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get clean 2024-09-12T16:57:27.539 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2024-09-12T16:57:27.784 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:57:27.793 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T16:57:27.818 DEBUG:teuthology.orchestra.run.smithi194:> dpkg -s linux-image-generic 2024-09-12T16:57:27.841 INFO:teuthology.orchestra.run.smithi194.stdout:Package: linux-image-generic 2024-09-12T16:57:27.841 INFO:teuthology.orchestra.run.smithi194.stdout:Status: install ok installed 2024-09-12T16:57:27.841 INFO:teuthology.orchestra.run.smithi194.stdout:Priority: optional 2024-09-12T16:57:27.841 INFO:teuthology.orchestra.run.smithi194.stdout:Section: kernel 2024-09-12T16:57:27.841 INFO:teuthology.orchestra.run.smithi194.stdout:Installed-Size: 21 2024-09-12T16:57:27.841 INFO:teuthology.orchestra.run.smithi194.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:57:27.842 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: amd64 2024-09-12T16:57:27.842 INFO:teuthology.orchestra.run.smithi194.stdout:Source: linux-meta 2024-09-12T16:57:27.842 INFO:teuthology.orchestra.run.smithi194.stdout:Version: 5.15.0.119.119 2024-09-12T16:57:27.842 INFO:teuthology.orchestra.run.smithi194.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:57:27.842 INFO:teuthology.orchestra.run.smithi194.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:57:27.842 INFO:teuthology.orchestra.run.smithi194.stdout:Recommends: thermald 2024-09-12T16:57:27.842 INFO:teuthology.orchestra.run.smithi194.stdout:Description: Generic Linux kernel image 2024-09-12T16:57:27.842 INFO:teuthology.orchestra.run.smithi194.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:57:27.842 INFO:teuthology.orchestra.run.smithi194.stdout: available. 2024-09-12T16:57:27.842 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T16:57:27.843 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T16:57:27.843 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T16:57:27.843 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T16:57:27.843 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T16:57:27.843 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get clean 2024-09-12T16:57:27.855 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T16:57:27.936 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T16:57:28.059 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get update 2024-09-12T16:57:28.181 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:57:28.189 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T16:57:28.206 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T16:57:28.301 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T16:57:29.221 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-09-12T16:57:29.236 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:57:29.297 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-09-12T16:57:29.505 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2024-09-12T16:57:29.514 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2024-09-12T16:57:29.593 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-12T16:57:29.612 DEBUG:teuthology.orchestra.run.smithi194:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:57:29.676 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-12T16:57:29.708 INFO:teuthology.orchestra.run.smithi119.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T16:57:29.708 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:57:29.708 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:57:29.708 INFO:teuthology.orchestra.run.smithi119.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:57:29.708 INFO:teuthology.orchestra.run.smithi119.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:57:29.708 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T16:57:29.708 INFO:teuthology.orchestra.run.smithi119.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T16:57:29.709 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:57:29.751 INFO:teuthology.orchestra.run.smithi119.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:57:29.753 DEBUG:teuthology.orchestra.run.smithi119:> dpkg -s linux-image-generic 2024-09-12T16:57:29.769 INFO:teuthology.orchestra.run.smithi119.stdout:Package: linux-image-generic 2024-09-12T16:57:29.769 INFO:teuthology.orchestra.run.smithi119.stdout:Status: install ok installed 2024-09-12T16:57:29.769 INFO:teuthology.orchestra.run.smithi119.stdout:Priority: optional 2024-09-12T16:57:29.769 INFO:teuthology.orchestra.run.smithi119.stdout:Section: kernel 2024-09-12T16:57:29.770 INFO:teuthology.orchestra.run.smithi119.stdout:Installed-Size: 21 2024-09-12T16:57:29.770 INFO:teuthology.orchestra.run.smithi119.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:57:29.770 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: amd64 2024-09-12T16:57:29.770 INFO:teuthology.orchestra.run.smithi119.stdout:Source: linux-meta 2024-09-12T16:57:29.770 INFO:teuthology.orchestra.run.smithi119.stdout:Version: 5.15.0.119.119 2024-09-12T16:57:29.770 INFO:teuthology.orchestra.run.smithi119.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:57:29.770 INFO:teuthology.orchestra.run.smithi119.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:57:29.770 INFO:teuthology.orchestra.run.smithi119.stdout:Recommends: thermald 2024-09-12T16:57:29.770 INFO:teuthology.orchestra.run.smithi119.stdout:Description: Generic Linux kernel image 2024-09-12T16:57:29.770 INFO:teuthology.orchestra.run.smithi119.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:57:29.771 INFO:teuthology.orchestra.run.smithi119.stdout: available. 2024-09-12T16:57:29.771 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-09-12T16:57:29.816 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.3FcMqSENai 2024-09-12T16:57:29.816 DEBUG:teuthology.orchestra.run.smithi119:> sudo cp /boot/grub/grub.cfg /tmp/tmp.3FcMqSENai 2024-09-12T16:57:29.874 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.3FcMqSENai 2024-09-12T16:57:29.891 INFO:teuthology.orchestra.run.smithi194.stdout:Building dependency tree... 2024-09-12T16:57:29.891 INFO:teuthology.orchestra.run.smithi194.stdout:Reading state information... 2024-09-12T16:57:29.995 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.3FcMqSENai is 10KB 2024-09-12T16:57:30.008 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.3FcMqSENai 2024-09-12T16:57:30.014 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T16:57:30.068 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T16:57:30.068 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T16:57:30.068 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T16:57:30.082 INFO:teuthology.orchestra.run.smithi194.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T16:57:30.082 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:57:30.083 INFO:teuthology.orchestra.run.smithi194.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:57:30.083 INFO:teuthology.orchestra.run.smithi194.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:57:30.083 INFO:teuthology.orchestra.run.smithi194.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:57:30.083 INFO:teuthology.orchestra.run.smithi194.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T16:57:30.083 INFO:teuthology.orchestra.run.smithi194.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T16:57:30.083 INFO:teuthology.orchestra.run.smithi194.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:57:30.128 INFO:teuthology.orchestra.run.smithi194.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:57:30.130 DEBUG:teuthology.orchestra.run.smithi194:> dpkg -s linux-image-generic 2024-09-12T16:57:30.136 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T16:57:30.137 DEBUG:teuthology.orchestra.run.smithi119:> sudo update-grub 2024-09-12T16:57:30.142 INFO:teuthology.orchestra.run.smithi194.stdout:Package: linux-image-generic 2024-09-12T16:57:30.143 INFO:teuthology.orchestra.run.smithi194.stdout:Status: install ok installed 2024-09-12T16:57:30.143 INFO:teuthology.orchestra.run.smithi194.stdout:Priority: optional 2024-09-12T16:57:30.143 INFO:teuthology.orchestra.run.smithi194.stdout:Section: kernel 2024-09-12T16:57:30.143 INFO:teuthology.orchestra.run.smithi194.stdout:Installed-Size: 21 2024-09-12T16:57:30.143 INFO:teuthology.orchestra.run.smithi194.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:57:30.143 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: amd64 2024-09-12T16:57:30.143 INFO:teuthology.orchestra.run.smithi194.stdout:Source: linux-meta 2024-09-12T16:57:30.143 INFO:teuthology.orchestra.run.smithi194.stdout:Version: 5.15.0.119.119 2024-09-12T16:57:30.143 INFO:teuthology.orchestra.run.smithi194.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:57:30.143 INFO:teuthology.orchestra.run.smithi194.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:57:30.143 INFO:teuthology.orchestra.run.smithi194.stdout:Recommends: thermald 2024-09-12T16:57:30.143 INFO:teuthology.orchestra.run.smithi194.stdout:Description: Generic Linux kernel image 2024-09-12T16:57:30.144 INFO:teuthology.orchestra.run.smithi194.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:57:30.144 INFO:teuthology.orchestra.run.smithi194.stdout: available. 2024-09-12T16:57:30.144 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-09-12T16:57:30.187 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.VV0MDf3MZ1 2024-09-12T16:57:30.187 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub/grub.cfg /tmp/tmp.VV0MDf3MZ1 2024-09-12T16:57:30.239 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.VV0MDf3MZ1 2024-09-12T16:57:30.363 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.VV0MDf3MZ1 is 10KB 2024-09-12T16:57:30.376 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.VV0MDf3MZ1 2024-09-12T16:57:30.382 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T16:57:30.441 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T16:57:30.441 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T16:57:30.441 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T16:57:30.521 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T16:57:30.521 DEBUG:teuthology.orchestra.run.smithi194:> sudo update-grub 2024-09-12T16:57:31.425 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub' 2024-09-12T16:57:31.426 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:57:31.428 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2024-09-12T16:57:31.629 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:57:31.636 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:57:31.868 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:57:31.873 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:57:31.916 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:57:31.922 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:57:31.934 INFO:teuthology.orchestra.run.smithi194.stderr:Sourcing file `/etc/default/grub' 2024-09-12T16:57:31.935 INFO:teuthology.orchestra.run.smithi194.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:57:31.938 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2024-09-12T16:57:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:57:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:57:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:57:32.072 INFO:teuthology.orchestra.run.smithi119.stderr:done 2024-09-12T16:57:32.077 DEBUG:teuthology.orchestra.run.smithi119:> sudo shutdown -r now 2024-09-12T16:57:32.113 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:57:32.119 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:57:32.399 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:57:32.404 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:57:32.445 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:57:32.450 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:57:32.574 INFO:teuthology.orchestra.run.smithi194.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:57:32.574 INFO:teuthology.orchestra.run.smithi194.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:57:32.574 INFO:teuthology.orchestra.run.smithi194.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:57:32.586 INFO:teuthology.orchestra.run.smithi194.stderr:done 2024-09-12T16:57:32.588 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2024-09-12T16:58:02.109 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T16:58:02.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-12T16:58:02.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:58:02.591 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T16:58:02.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-12T16:58:02.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:58:20.605 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-09-12T16:58:21.117 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-12T16:58:29.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-12T16:58:29.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:58:30.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-12T16:58:30.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:58:32.669 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-09-12T16:58:33.181 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-12T16:58:44.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-12T16:58:44.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:58:45.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-12T16:58:45.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:59:03.613 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-12T16:59:16.381 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-09-12T16:59:16.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-12T16:59:16.955 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T16:59:16.955 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-09-12T16:59:17.001 INFO:teuthology.orchestra.run.smithi119.stdout:5.15.0-119-generic 2024-09-12T16:59:17.001 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T16:59:17.001 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T16:59:17.001 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T16:59:18.002 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T16:59:18.003 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T16:59:18.097 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2024-09-12T16:59:18.114 DEBUG:teuthology.parallel:result is None 2024-09-12T16:59:18.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-12T16:59:18.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:59:19.090 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-12T16:59:19.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-12T16:59:19.662 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-12T16:59:19.662 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-09-12T16:59:19.708 INFO:teuthology.orchestra.run.smithi194.stdout:5.15.0-119-generic 2024-09-12T16:59:19.708 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T16:59:19.708 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T16:59:19.708 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T16:59:20.709 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T16:59:20.709 DEBUG:teuthology.orchestra.run.smithi194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T16:59:20.808 INFO:teuthology.orchestra.run.smithi194.stdout:ttyS1 2024-09-12T16:59:20.839 DEBUG:teuthology.parallel:result is None 2024-09-12T16:59:20.839 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T16:59:20.845 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T16:59:20.846 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T16:59:20.848 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T16:59:20.854 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T16:59:20.897 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T16:59:20.946 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T16:59:20.947 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T16:59:20.949 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T16:59:20.972 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T16:59:20.996 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T16:59:20.997 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T16:59:21.006 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T16:59:21.022 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:59:21.027 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:59:21.030 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:59:21.035 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:59:21.037 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T16:59:21.047 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T16:59:21.047 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T16:59:21.078 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T16:59:21.091 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T16:59:21.100 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T16:59:21.100 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T16:59:21.134 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T16:59:21.140 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:59:21.185 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:59:21.233 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T16:59:21.234 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T16:59:21.308 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:59:21.314 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:59:21.361 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T16:59:21.361 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T16:59:21.425 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2024-09-12T16:59:21.427 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-09-12T16:59:21.499 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T16:59:21.507 INFO:teuthology.task.internal:Starting timer... 2024-09-12T16:59:21.507 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T16:59:21.560 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T16:59:21.607 DEBUG:teuthology.task.selinux:Excluding smithi119: OS 'ubuntu' does not support SELinux 2024-09-12T16:59:21.607 DEBUG:teuthology.task.selinux:Excluding smithi194: OS 'ubuntu' does not support SELinux 2024-09-12T16:59:21.607 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T16:59:21.607 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T16:59:21.607 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T16:59:21.608 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T16:59:21.657 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T16:59:21.668 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T16:59:21.669 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi119.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T17:06:48.662 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi119.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2024-09-12T17:06:48.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-12T17:06:48.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:06:48.761 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-09-12T17:06:48.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-12T17:06:48.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-12T17:06:48.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:06:48.926 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-12T17:06:49.005 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-12T17:06:49.005 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T17:06:49.016 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T17:06:49.017 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:06:49.017 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:06:49.020 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:06:49.020 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:06:49.047 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T17:06:49.048 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: Command line: ntpd -gq 2024-09-12T17:06:49.048 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: ---------------------------------------------------- 2024-09-12T17:06:49.048 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T17:06:49.048 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T17:06:49.048 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: corporation. Support and training for ntp-4 are 2024-09-12T17:06:49.048 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: available at https://www.nwtime.org/support 2024-09-12T17:06:49.048 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: ---------------------------------------------------- 2024-09-12T17:06:49.049 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: proto: precision = 0.046 usec (-24) 2024-09-12T17:06:49.049 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: basedate set to 2022-02-04 2024-09-12T17:06:49.049 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: gps base set to 2022-02-06 (week 2196) 2024-09-12T17:06:49.049 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:06:49.049 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:06:49.050 INFO:teuthology.orchestra.run.smithi119.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:06:49.050 INFO:teuthology.orchestra.run.smithi119.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:06:49.051 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T17:06:49.051 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T17:06:49.051 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T17:06:49.051 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: Listen normally on 3 enp3s0f1 172.21.15.119:123 2024-09-12T17:06:49.051 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: Listen normally on 4 lo [::1]:123 2024-09-12T17:06:49.051 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5ef%5]:123 2024-09-12T17:06:49.051 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:49 ntpd[18483]: Listening on routing socket on fd #22 for interface updates 2024-09-12T17:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T17:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: Command line: ntpd -gq 2024-09-12T17:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: ---------------------------------------------------- 2024-09-12T17:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T17:06:49.077 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T17:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: corporation. Support and training for ntp-4 are 2024-09-12T17:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: available at https://www.nwtime.org/support 2024-09-12T17:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: ---------------------------------------------------- 2024-09-12T17:06:49.078 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: proto: precision = 0.044 usec (-24) 2024-09-12T17:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: basedate set to 2022-02-04 2024-09-12T17:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: gps base set to 2022-02-06 (week 2196) 2024-09-12T17:06:49.079 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:06:49.079 INFO:teuthology.orchestra.run.smithi194.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:06:49.079 INFO:teuthology.orchestra.run.smithi194.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:06:49.080 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T17:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T17:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T17:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: Listen normally on 3 enp3s0f1 172.21.15.194:123 2024-09-12T17:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: Listen normally on 4 lo [::1]:123 2024-09-12T17:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ea5%5]:123 2024-09-12T17:06:49.081 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:49 ntpd[18472]: Listening on routing socket on fd #22 for interface updates 2024-09-12T17:06:50.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:50 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:50.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:50 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:50.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:50 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:50.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:50 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:50.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:50 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:50.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:50 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:50.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:50 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:50.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:50 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:51.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:51 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:51.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:51 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:51.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:51 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:51.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:51 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:51.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:51 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:51.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:51 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:52.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:52 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:52.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:52 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:52.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:52 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:52.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:52 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:52.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:52 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:52.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:52 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:52.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:52 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:52.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:52 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:52.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:52 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:52.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:52 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:52.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:52 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:52.050 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:52 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:52.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:52 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:52.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:52 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:52.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:52 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:52.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:52 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:52.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:52 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:52.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:52 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:53.048 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:53 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:53.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:53 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:53.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:53 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:53.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:53 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:53.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:53 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:53.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:53 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:53.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:53 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:53.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:53 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:53.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:53 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:53.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:53 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:53.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:53 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:53.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:53 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:53.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:53 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:53.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:53 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:53.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:53 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:53.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:53 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:53.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:53 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:53.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:53 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:54.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:54 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:54.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:54 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:54.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:54 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:54.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:54 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:54.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:54 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:54.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:54 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:54.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:54 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:54.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:54 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:54.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:54 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:54.050 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:54 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:54.050 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:54 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:54.050 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:54 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:54.050 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:54 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:54.050 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:54 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:54.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:54 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:54.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:54 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:54.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:54 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:54.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:54 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:54.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:54 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:54.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:54 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:55.048 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:55 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:55.048 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:55 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:55.048 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:55 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:55.048 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:55 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:55.048 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:55 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:55.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:55 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:55.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:55 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:55.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:55 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:55.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:55 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:55.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:55 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:55.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:55 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:55.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:55 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:55.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:55 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:55.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:55 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:55.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:55 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:55.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:55 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:55.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:55 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:55.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:55 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:56.048 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:56 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:56.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:56 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:56.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:56 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:56.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:56 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:56.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:56 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:56.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:56 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:56.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:56 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:56.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:56 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:56.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:56 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:56.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:56 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:56.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:56 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:56.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:56 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:56.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:56 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:56.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:56 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:56.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:56 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:56.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:56 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:56.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:56 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:56.078 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:56 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:56.079 INFO:teuthology.orchestra.run.smithi194.stdout:12 Sep 17:06:56 ntpd[18472]: ntpd: time slew -0.000515 s 2024-09-12T17:06:56.079 INFO:teuthology.orchestra.run.smithi194.stdout:ntpd: time slew -0.000515s 2024-09-12T17:06:56.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:56 ntpd[18472]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T17:06:56.079 INFO:teuthology.orchestra.run.smithi194.stderr:12 Sep 17:06:56 ntpd[18472]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T17:06:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:06:56.220 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================== 2024-09-12T17:06:56.220 INFO:teuthology.orchestra.run.smithi194.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:06:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:06:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:06:56.221 INFO:teuthology.orchestra.run.smithi194.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:06:57.048 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:57 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:57.048 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:57 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:57.048 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:57 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:57.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:57 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:57.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:57 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:57.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:57 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:58.048 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:58 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:58.048 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:58 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:58.048 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:58 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:58.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:58 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:58.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:58 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:06:58.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:58 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:06:58.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:58 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:06:58.049 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:58 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:06:58.049 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 17:06:58 ntpd[18483]: ntpd: time slew -0.001815 s 2024-09-12T17:06:58.049 INFO:teuthology.orchestra.run.smithi119.stdout:ntpd: time slew -0.001815s 2024-09-12T17:06:58.050 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:58 ntpd[18483]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T17:06:58.050 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 17:06:58 ntpd[18483]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T17:06:58.100 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:06:58.101 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2024-09-12T17:06:58.101 INFO:teuthology.orchestra.run.smithi119.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:06:58.101 INFO:teuthology.orchestra.run.smithi119.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:06:58.101 INFO:teuthology.orchestra.run.smithi119.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:06:58.101 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:06:58.102 INFO:teuthology.run_tasks:Running task install... 2024-09-12T17:06:58.110 DEBUG:teuthology.task.install:project ceph 2024-09-12T17:06:58.110 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-12T17:06:58.110 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-12T17:06:58.110 INFO:teuthology.task.install:Using flavor: default 2024-09-12T17:06:58.116 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T17:06:58.116 INFO:teuthology.task.install:extra packages: [] 2024-09-12T17:06:58.116 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-key list | grep Ceph 2024-09-12T17:06:58.117 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-key list | grep Ceph 2024-09-12T17:06:58.183 INFO:teuthology.orchestra.run.smithi194.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T17:06:58.201 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T17:06:58.212 INFO:teuthology.orchestra.run.smithi194.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T17:06:58.212 INFO:teuthology.orchestra.run.smithi194.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T17:06:58.213 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T17:06:58.213 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T17:06:58.214 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:06:58.229 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T17:06:58.230 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T17:06:58.230 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T17:06:58.230 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T17:06:58.230 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:06:58.356 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-12T17:06:58.356 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:06:58.371 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-12T17:06:58.371 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:06:58.469 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:06:58.469 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T17:06:58.481 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:06:58.481 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T17:06:58.483 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get update 2024-09-12T17:06:58.495 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2024-09-12T17:06:58.707 INFO:teuthology.orchestra.run.smithi194.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T17:06:58.720 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T17:06:58.729 INFO:teuthology.orchestra.run.smithi194.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-12T17:06:58.742 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-12T17:06:58.752 INFO:teuthology.orchestra.run.smithi194.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T17:06:58.765 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T17:06:58.781 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:06:58.781 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:06:58.782 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T17:06:58.794 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:06:58.795 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:06:58.795 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-12T17:06:58.813 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-12T17:06:58.823 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T17:06:58.853 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:06:58.866 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:06:58.935 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:06:58.948 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:06:59.152 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 28.6 kB in 0s (60.1 kB/s) 2024-09-12T17:06:59.161 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 28.6 kB in 0s (57.4 kB/s) 2024-09-12T17:07:00.106 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-09-12T17:07:00.122 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:07:00.170 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-12T17:07:00.186 DEBUG:teuthology.orchestra.run.smithi194:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:07:00.187 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-09-12T17:07:00.241 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-12T17:07:00.397 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2024-09-12T17:07:00.397 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2024-09-12T17:07:00.430 INFO:teuthology.orchestra.run.smithi194.stdout:Building dependency tree... 2024-09-12T17:07:00.431 INFO:teuthology.orchestra.run.smithi194.stdout:Reading state information... 2024-09-12T17:07:00.590 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:07:00.590 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:07:00.590 INFO:teuthology.orchestra.run.smithi119.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:07:00.590 INFO:teuthology.orchestra.run.smithi119.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:07:00.591 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:07:00.591 INFO:teuthology.orchestra.run.smithi119.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:07:00.591 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:07:00.591 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2024-09-12T17:07:00.591 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T17:07:00.592 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T17:07:00.592 INFO:teuthology.orchestra.run.smithi119.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T17:07:00.592 INFO:teuthology.orchestra.run.smithi119.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T17:07:00.593 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T17:07:00.593 INFO:teuthology.orchestra.run.smithi119.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T17:07:00.593 INFO:teuthology.orchestra.run.smithi119.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T17:07:00.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T17:07:00.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T17:07:00.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:07:00.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:07:00.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:07:00.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:07:00.593 INFO:teuthology.orchestra.run.smithi119.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:07:00.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:07:00.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:07:00.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T17:07:00.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T17:07:00.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T17:07:00.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T17:07:00.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T17:07:00.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T17:07:00.594 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T17:07:00.594 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet zip 2024-09-12T17:07:00.595 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2024-09-12T17:07:00.595 INFO:teuthology.orchestra.run.smithi119.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T17:07:00.595 INFO:teuthology.orchestra.run.smithi119.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T17:07:00.595 INFO:teuthology.orchestra.run.smithi119.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T17:07:00.595 INFO:teuthology.orchestra.run.smithi119.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T17:07:00.595 INFO:teuthology.orchestra.run.smithi119.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T17:07:00.595 INFO:teuthology.orchestra.run.smithi119.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T17:07:00.595 INFO:teuthology.orchestra.run.smithi119.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T17:07:00.595 INFO:teuthology.orchestra.run.smithi119.stdout:Recommended packages: 2024-09-12T17:07:00.595 INFO:teuthology.orchestra.run.smithi119.stdout: btrfs-tools 2024-09-12T17:07:00.614 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:07:00.615 INFO:teuthology.orchestra.run.smithi194.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:07:00.615 INFO:teuthology.orchestra.run.smithi194.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:07:00.615 INFO:teuthology.orchestra.run.smithi194.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:07:00.615 INFO:teuthology.orchestra.run.smithi194.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:07:00.615 INFO:teuthology.orchestra.run.smithi194.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:07:00.616 INFO:teuthology.orchestra.run.smithi194.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:07:00.617 INFO:teuthology.orchestra.run.smithi194.stdout:The following additional packages will be installed: 2024-09-12T17:07:00.617 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T17:07:00.617 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T17:07:00.618 INFO:teuthology.orchestra.run.smithi194.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T17:07:00.618 INFO:teuthology.orchestra.run.smithi194.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T17:07:00.618 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T17:07:00.618 INFO:teuthology.orchestra.run.smithi194.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T17:07:00.618 INFO:teuthology.orchestra.run.smithi194.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T17:07:00.618 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T17:07:00.618 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T17:07:00.618 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:07:00.618 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:07:00.618 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:07:00.618 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:07:00.618 INFO:teuthology.orchestra.run.smithi194.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:07:00.619 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:07:00.619 INFO:teuthology.orchestra.run.smithi194.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:07:00.619 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T17:07:00.619 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T17:07:00.619 INFO:teuthology.orchestra.run.smithi194.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T17:07:00.619 INFO:teuthology.orchestra.run.smithi194.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T17:07:00.619 INFO:teuthology.orchestra.run.smithi194.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T17:07:00.619 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T17:07:00.619 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T17:07:00.619 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet zip 2024-09-12T17:07:00.620 INFO:teuthology.orchestra.run.smithi194.stdout:Suggested packages: 2024-09-12T17:07:00.620 INFO:teuthology.orchestra.run.smithi194.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T17:07:00.620 INFO:teuthology.orchestra.run.smithi194.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T17:07:00.620 INFO:teuthology.orchestra.run.smithi194.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T17:07:00.620 INFO:teuthology.orchestra.run.smithi194.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T17:07:00.620 INFO:teuthology.orchestra.run.smithi194.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T17:07:00.620 INFO:teuthology.orchestra.run.smithi194.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T17:07:00.620 INFO:teuthology.orchestra.run.smithi194.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T17:07:00.620 INFO:teuthology.orchestra.run.smithi194.stdout:Recommended packages: 2024-09-12T17:07:00.620 INFO:teuthology.orchestra.run.smithi194.stdout: btrfs-tools 2024-09-12T17:07:00.698 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2024-09-12T17:07:00.698 INFO:teuthology.orchestra.run.smithi119.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T17:07:00.698 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T17:07:00.698 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T17:07:00.698 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T17:07:00.698 INFO:teuthology.orchestra.run.smithi119.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T17:07:00.698 INFO:teuthology.orchestra.run.smithi119.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T17:07:00.698 INFO:teuthology.orchestra.run.smithi119.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T17:07:00.698 INFO:teuthology.orchestra.run.smithi119.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T17:07:00.698 INFO:teuthology.orchestra.run.smithi119.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T17:07:00.699 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T17:07:00.699 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T17:07:00.699 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:07:00.699 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:07:00.699 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:07:00.699 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:07:00.699 INFO:teuthology.orchestra.run.smithi119.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:07:00.699 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:07:00.699 INFO:teuthology.orchestra.run.smithi119.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:07:00.699 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T17:07:00.699 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T17:07:00.699 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T17:07:00.699 INFO:teuthology.orchestra.run.smithi119.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T17:07:00.700 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T17:07:00.700 INFO:teuthology.orchestra.run.smithi119.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T17:07:00.700 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T17:07:00.700 INFO:teuthology.orchestra.run.smithi119.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T17:07:00.721 INFO:teuthology.orchestra.run.smithi194.stdout:The following NEW packages will be installed: 2024-09-12T17:07:00.721 INFO:teuthology.orchestra.run.smithi194.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T17:07:00.721 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T17:07:00.721 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T17:07:00.723 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T17:07:00.723 INFO:teuthology.orchestra.run.smithi194.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T17:07:00.723 INFO:teuthology.orchestra.run.smithi194.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T17:07:00.723 INFO:teuthology.orchestra.run.smithi194.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T17:07:00.723 INFO:teuthology.orchestra.run.smithi194.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T17:07:00.723 INFO:teuthology.orchestra.run.smithi194.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T17:07:00.723 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T17:07:00.723 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T17:07:00.723 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:07:00.723 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:07:00.723 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:07:00.723 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:07:00.724 INFO:teuthology.orchestra.run.smithi194.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:07:00.724 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:07:00.724 INFO:teuthology.orchestra.run.smithi194.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:07:00.724 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T17:07:00.724 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T17:07:00.724 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T17:07:00.724 INFO:teuthology.orchestra.run.smithi194.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T17:07:00.724 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T17:07:00.724 INFO:teuthology.orchestra.run.smithi194.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T17:07:00.724 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T17:07:00.724 INFO:teuthology.orchestra.run.smithi194.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T17:07:00.757 INFO:teuthology.orchestra.run.smithi119.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:07:00.757 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 243 MB of archives. 2024-09-12T17:07:00.757 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-12T17:07:00.757 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T17:07:00.844 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T17:07:00.847 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T17:07:00.864 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T17:07:00.911 INFO:teuthology.orchestra.run.smithi194.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:07:00.912 INFO:teuthology.orchestra.run.smithi194.stdout:Need to get 243 MB of archives. 2024-09-12T17:07:00.912 INFO:teuthology.orchestra.run.smithi194.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-12T17:07:00.912 INFO:teuthology.orchestra.run.smithi194.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T17:07:00.924 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T17:07:00.929 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T17:07:00.937 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T17:07:00.941 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T17:07:00.941 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T17:07:00.941 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T17:07:00.949 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T17:07:00.951 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T17:07:00.953 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T17:07:00.954 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T17:07:00.962 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T17:07:00.965 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T17:07:00.967 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T17:07:00.968 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T17:07:00.969 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T17:07:00.980 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T17:07:00.981 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T17:07:00.981 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T17:07:00.981 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-12T17:07:00.981 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T17:07:00.982 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T17:07:00.997 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T17:07:00.997 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T17:07:00.998 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T17:07:01.000 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T17:07:01.000 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T17:07:01.014 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T17:07:01.014 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T17:07:01.015 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T17:07:01.015 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T17:07:01.016 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T17:07:01.030 INFO:teuthology.orchestra.run.smithi194.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-12T17:07:01.031 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T17:07:01.032 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T17:07:01.032 INFO:teuthology.orchestra.run.smithi119.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T17:07:01.037 INFO:teuthology.orchestra.run.smithi119.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T17:07:01.037 INFO:teuthology.orchestra.run.smithi119.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T17:07:01.048 INFO:teuthology.orchestra.run.smithi119.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T17:07:01.049 INFO:teuthology.orchestra.run.smithi119.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T17:07:01.050 INFO:teuthology.orchestra.run.smithi119.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T17:07:01.052 INFO:teuthology.orchestra.run.smithi119.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T17:07:01.053 INFO:teuthology.orchestra.run.smithi119.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T17:07:01.071 INFO:teuthology.orchestra.run.smithi119.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T17:07:01.073 INFO:teuthology.orchestra.run.smithi119.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T17:07:01.077 INFO:teuthology.orchestra.run.smithi119.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T17:07:01.078 INFO:teuthology.orchestra.run.smithi119.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T17:07:01.079 INFO:teuthology.orchestra.run.smithi119.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T17:07:01.088 INFO:teuthology.orchestra.run.smithi119.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T17:07:01.161 INFO:teuthology.orchestra.run.smithi119.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T17:07:01.162 INFO:teuthology.orchestra.run.smithi119.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T17:07:01.163 INFO:teuthology.orchestra.run.smithi119.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T17:07:01.164 INFO:teuthology.orchestra.run.smithi119.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T17:07:01.165 INFO:teuthology.orchestra.run.smithi119.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T17:07:01.182 INFO:teuthology.orchestra.run.smithi119.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T17:07:01.184 INFO:teuthology.orchestra.run.smithi119.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T17:07:01.185 INFO:teuthology.orchestra.run.smithi119.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T17:07:01.199 INFO:teuthology.orchestra.run.smithi119.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T17:07:01.199 INFO:teuthology.orchestra.run.smithi119.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T17:07:01.200 INFO:teuthology.orchestra.run.smithi119.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T17:07:01.200 INFO:teuthology.orchestra.run.smithi119.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T17:07:01.201 INFO:teuthology.orchestra.run.smithi119.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T17:07:01.201 INFO:teuthology.orchestra.run.smithi119.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T17:07:01.215 INFO:teuthology.orchestra.run.smithi119.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T17:07:01.215 INFO:teuthology.orchestra.run.smithi119.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T17:07:01.218 INFO:teuthology.orchestra.run.smithi119.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T17:07:01.231 INFO:teuthology.orchestra.run.smithi119.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T17:07:01.233 INFO:teuthology.orchestra.run.smithi119.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T17:07:01.233 INFO:teuthology.orchestra.run.smithi119.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T17:07:01.237 INFO:teuthology.orchestra.run.smithi119.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T17:07:01.239 INFO:teuthology.orchestra.run.smithi119.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T17:07:01.240 INFO:teuthology.orchestra.run.smithi119.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T17:07:01.240 INFO:teuthology.orchestra.run.smithi119.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T17:07:01.248 INFO:teuthology.orchestra.run.smithi119.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T17:07:01.249 INFO:teuthology.orchestra.run.smithi119.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T17:07:01.252 INFO:teuthology.orchestra.run.smithi119.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T17:07:01.265 INFO:teuthology.orchestra.run.smithi119.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T17:07:01.266 INFO:teuthology.orchestra.run.smithi119.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T17:07:01.266 INFO:teuthology.orchestra.run.smithi119.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T17:07:01.268 INFO:teuthology.orchestra.run.smithi119.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T17:07:01.268 INFO:teuthology.orchestra.run.smithi119.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T17:07:01.275 INFO:teuthology.orchestra.run.smithi119.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T17:07:01.275 INFO:teuthology.orchestra.run.smithi119.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T17:07:01.282 INFO:teuthology.orchestra.run.smithi119.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T17:07:01.284 INFO:teuthology.orchestra.run.smithi119.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T17:07:01.285 INFO:teuthology.orchestra.run.smithi119.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T17:07:01.334 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T17:07:01.347 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T17:07:01.428 INFO:teuthology.orchestra.run.smithi194.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T17:07:01.657 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T17:07:01.668 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T17:07:01.698 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T17:07:01.707 INFO:teuthology.orchestra.run.smithi194.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T17:07:01.708 INFO:teuthology.orchestra.run.smithi194.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T17:07:01.709 INFO:teuthology.orchestra.run.smithi194.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T17:07:01.727 INFO:teuthology.orchestra.run.smithi194.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T17:07:01.731 INFO:teuthology.orchestra.run.smithi194.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T17:07:01.735 INFO:teuthology.orchestra.run.smithi194.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T17:07:01.739 INFO:teuthology.orchestra.run.smithi194.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T17:07:01.820 INFO:teuthology.orchestra.run.smithi194.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T17:07:01.824 INFO:teuthology.orchestra.run.smithi194.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T17:07:01.828 INFO:teuthology.orchestra.run.smithi194.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T17:07:01.831 INFO:teuthology.orchestra.run.smithi194.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T17:07:01.832 INFO:teuthology.orchestra.run.smithi194.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T17:07:01.833 INFO:teuthology.orchestra.run.smithi194.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T17:07:01.835 INFO:teuthology.orchestra.run.smithi194.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T17:07:01.835 INFO:teuthology.orchestra.run.smithi194.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T17:07:01.836 INFO:teuthology.orchestra.run.smithi194.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T17:07:01.902 INFO:teuthology.orchestra.run.smithi194.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T17:07:01.918 INFO:teuthology.orchestra.run.smithi194.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T17:07:01.919 INFO:teuthology.orchestra.run.smithi194.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T17:07:01.920 INFO:teuthology.orchestra.run.smithi194.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T17:07:01.925 INFO:teuthology.orchestra.run.smithi194.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T17:07:01.926 INFO:teuthology.orchestra.run.smithi194.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T17:07:01.984 INFO:teuthology.orchestra.run.smithi194.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T17:07:01.985 INFO:teuthology.orchestra.run.smithi194.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T17:07:01.987 INFO:teuthology.orchestra.run.smithi194.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T17:07:01.987 INFO:teuthology.orchestra.run.smithi194.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T17:07:02.065 INFO:teuthology.orchestra.run.smithi194.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T17:07:02.067 INFO:teuthology.orchestra.run.smithi194.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T17:07:02.068 INFO:teuthology.orchestra.run.smithi194.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T17:07:02.069 INFO:teuthology.orchestra.run.smithi194.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T17:07:02.080 INFO:teuthology.orchestra.run.smithi194.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T17:07:02.146 INFO:teuthology.orchestra.run.smithi194.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T17:07:02.147 INFO:teuthology.orchestra.run.smithi194.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T17:07:02.148 INFO:teuthology.orchestra.run.smithi194.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T17:07:02.151 INFO:teuthology.orchestra.run.smithi194.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T17:07:02.154 INFO:teuthology.orchestra.run.smithi194.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T17:07:02.228 INFO:teuthology.orchestra.run.smithi194.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T17:07:02.230 INFO:teuthology.orchestra.run.smithi194.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T17:07:02.231 INFO:teuthology.orchestra.run.smithi194.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T17:07:02.236 INFO:teuthology.orchestra.run.smithi194.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T17:07:02.237 INFO:teuthology.orchestra.run.smithi194.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T17:07:02.309 INFO:teuthology.orchestra.run.smithi194.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T17:07:02.312 INFO:teuthology.orchestra.run.smithi119.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-12T17:07:02.313 INFO:teuthology.orchestra.run.smithi194.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T17:07:02.477 INFO:teuthology.orchestra.run.smithi194.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T17:07:02.479 INFO:teuthology.orchestra.run.smithi194.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T17:07:02.482 INFO:teuthology.orchestra.run.smithi194.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T17:07:02.482 INFO:teuthology.orchestra.run.smithi194.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T17:07:02.485 INFO:teuthology.orchestra.run.smithi194.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T17:07:02.521 INFO:teuthology.orchestra.run.smithi194.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T17:07:02.525 INFO:teuthology.orchestra.run.smithi194.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T17:07:02.525 INFO:teuthology.orchestra.run.smithi194.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T17:07:02.581 INFO:teuthology.orchestra.run.smithi194.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T17:07:02.582 INFO:teuthology.orchestra.run.smithi194.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T17:07:02.644 INFO:teuthology.orchestra.run.smithi194.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T17:07:02.645 INFO:teuthology.orchestra.run.smithi194.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T17:07:02.646 INFO:teuthology.orchestra.run.smithi194.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T17:07:02.647 INFO:teuthology.orchestra.run.smithi194.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T17:07:02.648 INFO:teuthology.orchestra.run.smithi194.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T17:07:02.649 INFO:teuthology.orchestra.run.smithi194.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T17:07:02.656 INFO:teuthology.orchestra.run.smithi194.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T17:07:02.726 INFO:teuthology.orchestra.run.smithi194.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T17:07:02.729 INFO:teuthology.orchestra.run.smithi194.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T17:07:02.731 INFO:teuthology.orchestra.run.smithi194.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T17:07:02.809 INFO:teuthology.orchestra.run.smithi194.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T17:07:02.815 INFO:teuthology.orchestra.run.smithi194.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T17:07:02.818 INFO:teuthology.orchestra.run.smithi194.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T17:07:02.819 INFO:teuthology.orchestra.run.smithi194.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T17:07:02.830 INFO:teuthology.orchestra.run.smithi194.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T17:07:02.831 INFO:teuthology.orchestra.run.smithi194.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T17:07:02.833 INFO:teuthology.orchestra.run.smithi119.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-12T17:07:02.839 INFO:teuthology.orchestra.run.smithi194.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T17:07:02.893 INFO:teuthology.orchestra.run.smithi194.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T17:07:02.895 INFO:teuthology.orchestra.run.smithi194.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T17:07:02.896 INFO:teuthology.orchestra.run.smithi194.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T17:07:02.899 INFO:teuthology.orchestra.run.smithi119.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-12T17:07:02.956 INFO:teuthology.orchestra.run.smithi119.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-12T17:07:02.958 INFO:teuthology.orchestra.run.smithi119.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-12T17:07:02.975 INFO:teuthology.orchestra.run.smithi194.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T17:07:02.977 INFO:teuthology.orchestra.run.smithi194.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T17:07:02.994 INFO:teuthology.orchestra.run.smithi194.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T17:07:02.995 INFO:teuthology.orchestra.run.smithi194.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T17:07:02.995 INFO:teuthology.orchestra.run.smithi194.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T17:07:03.000 INFO:teuthology.orchestra.run.smithi194.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T17:07:03.002 INFO:teuthology.orchestra.run.smithi194.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T17:07:03.007 INFO:teuthology.orchestra.run.smithi119.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-12T17:07:03.012 INFO:teuthology.orchestra.run.smithi119.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-12T17:07:03.066 INFO:teuthology.orchestra.run.smithi119.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-12T17:07:03.274 INFO:teuthology.orchestra.run.smithi194.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-12T17:07:03.773 INFO:teuthology.orchestra.run.smithi119.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-12T17:07:03.802 INFO:teuthology.orchestra.run.smithi119.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-12T17:07:03.819 INFO:teuthology.orchestra.run.smithi119.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-12T17:07:05.245 INFO:teuthology.orchestra.run.smithi194.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-12T17:07:05.623 INFO:teuthology.orchestra.run.smithi194.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-12T17:07:05.794 INFO:teuthology.orchestra.run.smithi119.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-12T17:07:05.806 INFO:teuthology.orchestra.run.smithi194.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-12T17:07:05.807 INFO:teuthology.orchestra.run.smithi194.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-12T17:07:05.911 INFO:teuthology.orchestra.run.smithi194.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-12T17:07:05.921 INFO:teuthology.orchestra.run.smithi194.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-12T17:07:05.983 INFO:teuthology.orchestra.run.smithi119.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-12T17:07:05.988 INFO:teuthology.orchestra.run.smithi119.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-12T17:07:05.991 INFO:teuthology.orchestra.run.smithi119.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-12T17:07:06.037 INFO:teuthology.orchestra.run.smithi194.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-12T17:07:06.046 INFO:teuthology.orchestra.run.smithi119.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-12T17:07:06.405 INFO:teuthology.orchestra.run.smithi119.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-12T17:07:07.894 INFO:teuthology.orchestra.run.smithi119.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-12T17:07:07.895 INFO:teuthology.orchestra.run.smithi119.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-12T17:07:07.911 INFO:teuthology.orchestra.run.smithi119.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-12T17:07:07.978 INFO:teuthology.orchestra.run.smithi119.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-12T17:07:08.027 INFO:teuthology.orchestra.run.smithi119.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-12T17:07:08.030 INFO:teuthology.orchestra.run.smithi119.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-12T17:07:09.349 INFO:teuthology.orchestra.run.smithi194.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-12T17:07:09.389 INFO:teuthology.orchestra.run.smithi194.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-12T17:07:09.522 INFO:teuthology.orchestra.run.smithi194.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-12T17:07:10.773 INFO:teuthology.orchestra.run.smithi119.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-12T17:07:10.885 INFO:teuthology.orchestra.run.smithi119.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-12T17:07:10.885 INFO:teuthology.orchestra.run.smithi119.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-12T17:07:12.034 INFO:teuthology.orchestra.run.smithi119.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-12T17:07:12.117 INFO:teuthology.orchestra.run.smithi119.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-12T17:07:12.118 INFO:teuthology.orchestra.run.smithi119.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-12T17:07:12.455 INFO:teuthology.orchestra.run.smithi119.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-12T17:07:12.874 INFO:teuthology.orchestra.run.smithi194.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-12T17:07:13.022 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 243 MB in 12s (20.7 MB/s) 2024-09-12T17:07:13.165 INFO:teuthology.orchestra.run.smithi194.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-12T17:07:13.166 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T17:07:13.170 INFO:teuthology.orchestra.run.smithi194.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-12T17:07:13.184 INFO:teuthology.orchestra.run.smithi194.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-12T17:07:13.260 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T17:07:13.266 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T17:07:13.270 INFO:teuthology.orchestra.run.smithi194.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-12T17:07:13.348 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:07:13.618 INFO:teuthology.orchestra.run.smithi194.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-12T17:07:13.685 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T17:07:13.711 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T17:07:13.752 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:07:14.063 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T17:07:14.078 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T17:07:14.113 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:07:14.550 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T17:07:14.576 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:07:14.625 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:07:14.718 INFO:teuthology.orchestra.run.smithi194.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-12T17:07:14.719 INFO:teuthology.orchestra.run.smithi194.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-12T17:07:14.736 INFO:teuthology.orchestra.run.smithi194.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-12T17:07:14.824 INFO:teuthology.orchestra.run.smithi194.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-12T17:07:14.849 INFO:teuthology.orchestra.run.smithi194.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-12T17:07:14.852 INFO:teuthology.orchestra.run.smithi194.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-12T17:07:15.037 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T17:07:15.063 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:07:15.103 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:07:15.456 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T17:07:15.482 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:07:15.522 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:07:15.867 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T17:07:15.894 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T17:07:15.934 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:07:16.246 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librados2. 2024-09-12T17:07:16.272 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:16.304 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:16.723 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librbd1. 2024-09-12T17:07:16.750 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:16.790 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:17.040 INFO:teuthology.orchestra.run.smithi194.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-12T17:07:17.171 INFO:teuthology.orchestra.run.smithi194.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-12T17:07:17.171 INFO:teuthology.orchestra.run.smithi194.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-12T17:07:17.459 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T17:07:17.485 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:17.526 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:17.812 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rados. 2024-09-12T17:07:17.838 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:17.878 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:18.140 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T17:07:18.166 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:07:18.206 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:18.425 INFO:teuthology.orchestra.run.smithi194.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-12T17:07:18.428 INFO:teuthology.orchestra.run.smithi194.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-12T17:07:18.429 INFO:teuthology.orchestra.run.smithi194.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-12T17:07:18.441 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T17:07:18.457 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:18.500 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:18.740 INFO:teuthology.orchestra.run.smithi194.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-12T17:07:18.820 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T17:07:18.846 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:07:18.886 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:19.206 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T17:07:19.232 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T17:07:19.273 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:07:19.312 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 243 MB in 18s (13.5 MB/s) 2024-09-12T17:07:19.475 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T17:07:19.550 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T17:07:19.566 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T17:07:19.575 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T17:07:19.581 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T17:07:19.600 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T17:07:19.673 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:07:19.862 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T17:07:19.883 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:19.920 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:19.952 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T17:07:19.977 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T17:07:20.010 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:07:20.281 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T17:07:20.307 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T17:07:20.338 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T17:07:20.347 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:07:20.364 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T17:07:20.404 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:07:20.609 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T17:07:20.624 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T17:07:20.667 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:07:20.866 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T17:07:20.892 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:07:20.928 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T17:07:20.940 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:07:20.944 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T17:07:20.986 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:07:21.294 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T17:07:21.320 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:07:21.323 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package lua5.1. 2024-09-12T17:07:21.353 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T17:07:21.353 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:07:21.389 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:07:21.689 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T17:07:21.709 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package lua-any. 2024-09-12T17:07:21.715 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:07:21.736 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T17:07:21.755 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:07:21.776 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T17:07:21.995 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package zip. 2024-09-12T17:07:22.010 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T17:07:22.045 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T17:07:22.100 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T17:07:22.126 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T17:07:22.166 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:07:22.332 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package unzip. 2024-09-12T17:07:22.358 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T17:07:22.398 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:07:22.460 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librados2. 2024-09-12T17:07:22.487 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:22.527 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:22.794 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package luarocks. 2024-09-12T17:07:22.820 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T17:07:22.860 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:07:22.973 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librbd1. 2024-09-12T17:07:23.000 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:23.040 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:23.302 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librgw2. 2024-09-12T17:07:23.328 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:23.368 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:23.476 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T17:07:23.502 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:23.542 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:23.819 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rados. 2024-09-12T17:07:23.846 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:23.903 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:23.954 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T17:07:23.977 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:24.021 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:24.357 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T17:07:24.384 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T17:07:24.397 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T17:07:24.425 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:07:24.425 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:07:24.464 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:24.717 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T17:07:24.734 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T17:07:24.742 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:24.761 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:24.783 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:24.801 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:25.094 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T17:07:25.120 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:07:25.160 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:25.180 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-common. 2024-09-12T17:07:25.207 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:25.238 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:25.480 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T17:07:25.506 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T17:07:25.555 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:07:25.874 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T17:07:25.900 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T17:07:25.941 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T17:07:26.176 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T17:07:26.192 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:26.226 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:26.513 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T17:07:26.539 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T17:07:26.579 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:07:26.726 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-base. 2024-09-12T17:07:26.753 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:26.802 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:26.873 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T17:07:26.900 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T17:07:26.965 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:07:27.267 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T17:07:27.282 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T17:07:27.326 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:07:27.356 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T17:07:27.371 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T17:07:27.406 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:07:27.620 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua5.1. 2024-09-12T17:07:27.646 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T17:07:27.678 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:07:27.883 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T17:07:27.910 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T17:07:27.950 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:07:27.965 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua-any. 2024-09-12T17:07:27.991 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T17:07:28.032 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T17:07:28.270 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T17:07:28.275 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package zip. 2024-09-12T17:07:28.291 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T17:07:28.296 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T17:07:28.334 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T17:07:28.336 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:07:28.614 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T17:07:28.641 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T17:07:28.654 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package unzip. 2024-09-12T17:07:28.672 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:07:28.679 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T17:07:28.720 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:07:28.967 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T17:07:28.994 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T17:07:29.033 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:07:29.133 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package luarocks. 2024-09-12T17:07:29.158 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T17:07:29.198 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:07:29.337 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T17:07:29.363 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T17:07:29.403 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T17:07:29.540 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librgw2. 2024-09-12T17:07:29.566 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:29.606 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:29.714 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-portend. 2024-09-12T17:07:29.730 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T17:07:29.764 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T17:07:30.059 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T17:07:30.085 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T17:07:30.125 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T17:07:30.233 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T17:07:30.248 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:30.300 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:30.428 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T17:07:30.455 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T17:07:30.495 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:07:30.636 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T17:07:30.662 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T17:07:30.702 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:07:30.849 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T17:07:30.875 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T17:07:30.915 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T17:07:30.988 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T17:07:31.015 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:31.064 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:31.227 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T17:07:31.253 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T17:07:31.293 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T17:07:31.467 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-common. 2024-09-12T17:07:31.494 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:31.533 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:31.537 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T17:07:31.553 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T17:07:31.588 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:07:31.899 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-mako. 2024-09-12T17:07:31.925 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T17:07:31.965 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:07:32.294 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T17:07:32.320 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T17:07:32.360 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:07:32.697 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T17:07:32.723 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T17:07:32.763 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:07:33.016 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webob. 2024-09-12T17:07:33.031 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T17:07:33.066 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:07:33.377 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T17:07:33.403 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T17:07:33.446 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:07:33.538 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-base. 2024-09-12T17:07:33.565 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:33.614 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:33.747 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T17:07:33.773 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T17:07:33.813 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:07:34.151 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T17:07:34.177 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T17:07:34.217 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:07:34.695 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T17:07:34.710 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T17:07:34.744 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:07:34.925 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-paste. 2024-09-12T17:07:34.951 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T17:07:34.991 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:07:35.039 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T17:07:35.066 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T17:07:35.114 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:07:35.311 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T17:07:35.338 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T17:07:35.369 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:07:35.417 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T17:07:35.444 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T17:07:35.483 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:07:35.639 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T17:07:35.666 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T17:07:35.731 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:07:35.769 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T17:07:35.796 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T17:07:35.836 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:07:36.034 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T17:07:36.060 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T17:07:36.101 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T17:07:36.114 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T17:07:36.140 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T17:07:36.180 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T17:07:36.411 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T17:07:36.438 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T17:07:36.478 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:07:36.483 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-portend. 2024-09-12T17:07:36.510 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T17:07:36.549 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T17:07:36.836 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T17:07:36.841 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T17:07:36.862 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T17:07:36.868 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T17:07:36.902 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T17:07:36.908 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T17:07:37.177 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-idna. 2024-09-12T17:07:37.192 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T17:07:37.205 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T17:07:37.227 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:07:37.232 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T17:07:37.271 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:07:37.547 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T17:07:37.573 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T17:07:37.600 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T17:07:37.613 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:07:37.627 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T17:07:37.666 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T17:07:37.978 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T17:07:38.004 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T17:07:38.044 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T17:07:38.067 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-requests. 2024-09-12T17:07:38.093 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T17:07:38.133 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:07:38.347 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T17:07:38.373 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T17:07:38.422 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:07:38.444 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T17:07:38.471 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T17:07:38.510 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:07:38.674 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-mako. 2024-09-12T17:07:38.690 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T17:07:38.724 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:07:38.822 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T17:07:38.838 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:07:38.880 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:39.003 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T17:07:39.029 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T17:07:39.061 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:07:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T17:07:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:39.293 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:39.372 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T17:07:39.398 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T17:07:39.438 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:07:39.590 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T17:07:39.617 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T17:07:39.657 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:07:39.758 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-webob. 2024-09-12T17:07:39.785 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T17:07:39.824 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:07:39.943 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T17:07:39.972 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T17:07:40.009 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T17:07:40.169 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T17:07:40.195 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T17:07:40.238 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:07:40.312 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T17:07:40.339 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:40.370 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:40.530 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T17:07:40.557 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T17:07:40.596 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:07:40.757 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T17:07:40.784 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:40.824 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:40.833 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-paste. 2024-09-12T17:07:40.859 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T17:07:40.899 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:07:41.219 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T17:07:41.234 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T17:07:41.277 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:07:41.419 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T17:07:41.445 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:41.485 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:41.521 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T17:07:41.548 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T17:07:41.579 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:07:41.891 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T17:07:41.918 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T17:07:41.957 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T17:07:42.268 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T17:07:42.295 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T17:07:42.343 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:07:42.522 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph. 2024-09-12T17:07:42.537 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:42.571 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:42.673 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T17:07:42.700 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T17:07:42.739 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T17:07:43.016 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T17:07:43.017 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-idna. 2024-09-12T17:07:43.043 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:43.044 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T17:07:43.083 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:43.083 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:07:43.386 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T17:07:43.413 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T17:07:43.436 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T17:07:43.453 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:07:43.462 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:43.502 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:43.781 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-requests. 2024-09-12T17:07:43.808 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T17:07:43.847 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:07:43.889 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephadm. 2024-09-12T17:07:43.915 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:43.955 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:44.158 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T17:07:44.186 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T17:07:44.225 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:07:44.241 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T17:07:44.269 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T17:07:44.308 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T17:07:44.511 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T17:07:44.538 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:07:44.578 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:44.610 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T17:07:44.625 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:07:44.660 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:07:45.066 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T17:07:45.093 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:45.132 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:45.452 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T17:07:45.478 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T17:07:45.518 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:07:45.599 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-babel. 2024-09-12T17:07:45.626 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:07:45.657 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:07:45.770 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T17:07:45.786 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T17:07:45.829 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T17:07:45.935 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T17:07:45.950 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T17:07:45.985 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:07:46.149 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T17:07:46.175 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:46.215 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:46.296 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T17:07:46.323 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:07:46.354 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:46.610 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T17:07:46.636 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:46.676 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:46.683 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T17:07:46.699 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T17:07:46.733 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T17:07:47.002 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-routes. 2024-09-12T17:07:47.029 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T17:07:47.069 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:07:47.229 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T17:07:47.256 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:47.296 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:47.380 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T17:07:47.407 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:07:47.447 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:48.324 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph. 2024-09-12T17:07:48.351 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:48.391 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:48.727 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T17:07:48.753 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:48.793 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:49.096 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T17:07:49.111 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:49.146 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:49.557 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package cephadm. 2024-09-12T17:07:49.584 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:49.624 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:49.935 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T17:07:49.962 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T17:07:50.118 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T17:07:50.127 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T17:07:50.144 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T17:07:50.185 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:07:50.421 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T17:07:50.447 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:07:50.487 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:07:50.739 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T17:07:50.766 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T17:07:50.813 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:07:51.150 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T17:07:51.166 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T17:07:51.200 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:07:51.450 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-babel. 2024-09-12T17:07:51.477 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:07:51.486 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T17:07:51.514 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T17:07:51.541 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:07:51.553 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:07:51.861 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T17:07:51.888 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T17:07:51.928 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:07:52.253 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T17:07:52.264 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T17:07:52.278 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:07:52.291 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:07:52.330 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:52.405 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:52.667 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T17:07:52.694 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T17:07:52.726 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T17:07:53.011 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-routes. 2024-09-12T17:07:53.038 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T17:07:53.077 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:07:53.514 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T17:07:53.542 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:07:53.580 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:53.618 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T17:07:53.646 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T17:07:53.684 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T17:07:53.987 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T17:07:54.015 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T17:07:54.053 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:07:54.382 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T17:07:54.410 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T17:07:54.449 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:07:54.735 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T17:07:54.763 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T17:07:54.801 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T17:07:55.130 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T17:07:55.158 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T17:07:55.197 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T17:07:55.525 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T17:07:55.553 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T17:07:55.591 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:07:55.903 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T17:07:55.931 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T17:07:55.969 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T17:07:56.289 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T17:07:56.293 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T17:07:56.307 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T17:07:56.317 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T17:07:56.351 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:07:56.355 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:07:56.813 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T17:07:56.840 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T17:07:56.879 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:07:57.078 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T17:07:57.094 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:07:57.136 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:57.216 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T17:07:57.229 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T17:07:57.274 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:07:57.447 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T17:07:57.476 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T17:07:57.514 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:07:57.535 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T17:07:57.562 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T17:07:57.601 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:07:57.809 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T17:07:57.837 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:07:57.867 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:07:58.119 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package jq. 2024-09-12T17:07:58.136 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:07:58.178 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T17:07:58.318 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T17:07:58.334 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:07:58.445 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:58.447 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package socat. 2024-09-12T17:07:58.475 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T17:07:58.514 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:07:58.809 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T17:07:58.825 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T17:07:58.867 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:07:59.240 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-test. 2024-09-12T17:07:59.254 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:07:59.296 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:07:59.367 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T17:07:59.395 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T17:07:59.433 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T17:07:59.669 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T17:07:59.685 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T17:07:59.727 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:08:00.048 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T17:08:00.075 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T17:08:00.114 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:08:00.592 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T17:08:00.620 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T17:08:00.659 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T17:08:00.987 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T17:08:01.015 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T17:08:01.053 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T17:08:01.373 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T17:08:01.401 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T17:08:01.440 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:08:01.576 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T17:08:01.603 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:08:01.642 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:01.743 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T17:08:01.770 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T17:08:01.809 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T17:08:01.946 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T17:08:01.962 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:02.004 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:02.137 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T17:08:02.165 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T17:08:02.204 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:08:02.315 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T17:08:02.343 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T17:08:02.382 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:08:02.686 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T17:08:02.714 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T17:08:02.753 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:08:02.876 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T17:08:02.904 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:08:02.934 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:03.090 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T17:08:03.118 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T17:08:03.157 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:08:03.262 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T17:08:03.289 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T17:08:03.328 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:08:03.554 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package pkg-config. 2024-09-12T17:08:03.582 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T17:08:03.620 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:08:03.656 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T17:08:03.684 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:08:03.722 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:08:03.856 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T17:08:03.884 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T17:08:03.923 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:08:04.000 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package jq. 2024-09-12T17:08:04.028 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:08:04.067 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T17:08:04.286 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package socat. 2024-09-12T17:08:04.313 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T17:08:04.326 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T17:08:04.344 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:08:04.356 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T17:08:04.392 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T17:08:04.647 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T17:08:04.663 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T17:08:04.705 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:08:04.712 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T17:08:04.740 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T17:08:04.778 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T17:08:05.043 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-test. 2024-09-12T17:08:05.071 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:05.090 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T17:08:05.101 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:05.118 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T17:08:05.165 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:08:05.452 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T17:08:05.480 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T17:08:05.518 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T17:08:05.829 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-py. 2024-09-12T17:08:05.857 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T17:08:05.896 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T17:08:06.183 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T17:08:06.211 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T17:08:06.249 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:08:06.670 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T17:08:06.698 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T17:08:06.736 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:08:07.022 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-toml. 2024-09-12T17:08:07.051 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T17:08:07.089 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T17:08:07.280 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T17:08:07.308 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:08:07.346 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:07.409 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T17:08:07.437 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T17:08:07.475 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:08:07.650 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T17:08:07.666 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:07.708 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:07.854 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T17:08:07.882 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T17:08:07.920 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:08:08.011 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T17:08:08.039 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T17:08:08.077 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:08:08.206 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T17:08:08.222 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T17:08:08.264 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:08:08.415 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T17:08:08.443 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T17:08:08.481 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:08:08.852 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T17:08:08.880 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T17:08:08.918 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:08:08.994 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package radosgw. 2024-09-12T17:08:09.022 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:09.060 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:09.332 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package pkg-config. 2024-09-12T17:08:09.360 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T17:08:09.398 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:08:09.668 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T17:08:09.684 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T17:08:09.726 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:08:10.013 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T17:08:10.041 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:10.079 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:10.171 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T17:08:10.199 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T17:08:10.237 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T17:08:10.359 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T17:08:10.523 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T17:08:10.551 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T17:08:10.584 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:08:10.589 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T17:08:10.705 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:08:10.909 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T17:08:10.938 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T17:08:10.976 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:08:10.992 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T17:08:11.287 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T17:08:11.315 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T17:08:11.326 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T17:08:11.353 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T17:08:11.681 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-py. 2024-09-12T17:08:11.709 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T17:08:11.747 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T17:08:11.748 INFO:teuthology.orchestra.run.smithi119.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T17:08:11.821 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:12.059 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T17:08:12.087 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T17:08:12.125 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:08:12.296 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user cephadm....done 2024-09-12T17:08:12.419 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:08:12.538 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T17:08:12.562 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T17:08:12.596 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:08:12.687 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:08:12.840 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-toml. 2024-09-12T17:08:12.856 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T17:08:12.889 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T17:08:12.947 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:08:13.073 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:08:13.218 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T17:08:13.246 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T17:08:13.284 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:08:13.332 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T17:08:13.580 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T17:08:13.583 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:08:13.608 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T17:08:13.637 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:08:13.684 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T17:08:13.864 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T17:08:13.881 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T17:08:13.923 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:08:14.136 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:08:14.496 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T17:08:14.619 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package radosgw. 2024-09-12T17:08:14.647 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:14.676 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:14.748 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T17:08:15.024 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:08:15.267 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:08:15.501 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:08:15.512 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T17:08:15.528 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:15.729 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:15.744 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:08:15.995 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:16.134 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T17:08:16.254 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:08:16.380 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:08:16.392 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:08:16.501 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:08:16.506 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:08:16.641 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:08:16.764 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T17:08:16.892 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:08:17.100 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T17:08:17.247 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T17:08:17.282 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T17:08:17.345 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:08:17.472 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T17:08:17.526 INFO:teuthology.orchestra.run.smithi194.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T17:08:17.595 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:17.839 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:08:17.965 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T17:08:18.077 INFO:teuthology.orchestra.run.smithi194.stdout:Adding system user cephadm....done 2024-09-12T17:08:18.225 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:08:18.233 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:08:18.476 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:08:18.502 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:08:18.760 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T17:08:18.761 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:08:18.862 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:08:18.886 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:08:19.130 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T17:08:19.406 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:08:19.532 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T17:08:19.672 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:08:19.834 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:08:19.933 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:08:20.082 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:08:20.183 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:08:20.185 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T17:08:20.437 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T17:08:20.468 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T17:08:20.704 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:08:20.844 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T17:08:20.972 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:08:21.103 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:08:21.223 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:08:21.488 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:08:21.491 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:08:21.742 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:21.781 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:08:22.060 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:08:22.133 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:08:22.190 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:08:22.345 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:08:22.350 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:08:22.451 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:22.471 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:08:22.713 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:08:22.753 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:08:23.114 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T17:08:23.120 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:08:23.145 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T17:08:23.209 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:08:23.334 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T17:08:23.702 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:08:23.828 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T17:08:24.096 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:08:24.312 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:08:24.338 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:08:24.571 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:08:24.631 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T17:08:24.706 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T17:08:24.757 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:08:24.982 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:08:25.091 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:08:25.201 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:08:25.409 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:08:25.502 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:08:25.660 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:08:25.753 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T17:08:25.778 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:08:25.879 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:08:26.004 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:08:26.130 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:08:26.154 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T17:08:26.432 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:08:26.522 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T17:08:26.683 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T17:08:26.773 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:08:26.917 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T17:08:27.133 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:08:27.168 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:08:27.418 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:08:27.419 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T17:08:27.679 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:08:27.761 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:08:27.805 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T17:08:28.011 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:08:28.081 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:08:28.113 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:28.207 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:08:28.422 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:08:28.491 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:08:28.748 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:08:28.767 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:08:29.018 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:08:29.145 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:08:29.271 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:08:29.361 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T17:08:29.589 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:08:29.715 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:08:29.937 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:08:30.083 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:08:30.196 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:08:30.326 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T17:08:30.331 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T17:08:30.452 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T17:08:30.590 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:08:30.711 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:08:30.725 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:08:30.837 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:08:30.851 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:08:31.152 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:08:31.163 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:08:31.481 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:08:31.712 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T17:08:31.757 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T17:08:31.858 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T17:08:31.971 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:08:32.071 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:08:32.118 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T17:08:32.365 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:08:32.369 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:08:32.607 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T17:08:32.714 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:08:32.867 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T17:08:33.099 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T17:08:33.117 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:08:33.367 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:08:33.369 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T17:08:33.628 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:08:33.695 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:08:33.729 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T17:08:33.821 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:33.947 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:34.005 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:08:34.073 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:08:34.131 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:08:34.401 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:34.423 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:08:34.502 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:34.636 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T17:08:34.741 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:08:34.913 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:34.976 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:08:35.039 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:35.102 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:08:35.165 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:35.211 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:08:35.293 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T17:08:35.366 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:08:35.366 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:08:35.546 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:08:35.672 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:08:35.849 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:35.959 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:36.056 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:08:36.085 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:36.211 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:08:36.291 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T17:08:36.417 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T17:08:36.660 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:08:36.786 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:08:37.112 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:08:37.396 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:08:37.456 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:37.582 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:37.664 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T17:08:37.683 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:37.784 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:37.789 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T17:08:37.885 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:38.041 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T17:08:38.317 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:08:38.420 INFO:teuthology.orchestra.run.smithi119.stdout:Adding group ceph....done 2024-09-12T17:08:38.645 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:08:38.796 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user ceph....done 2024-09-12T17:08:38.964 INFO:teuthology.orchestra.run.smithi119.stdout:Setting system user ceph properties....done 2024-09-12T17:08:38.979 INFO:teuthology.orchestra.run.smithi119.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T17:08:39.021 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T17:08:39.116 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T17:08:39.314 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:08:39.458 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T17:08:39.625 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:08:39.751 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:39.877 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:39.903 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:40.004 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:08:40.029 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:40.339 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:40.448 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:40.505 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:08:40.505 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:08:40.558 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T17:08:40.818 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:40.944 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:40.973 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:41.070 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:41.282 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:08:41.282 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:08:41.289 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T17:08:41.729 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:41.741 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:41.855 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:41.963 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:08:41.963 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:08:41.981 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:42.082 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:08:42.443 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:42.670 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:08:42.670 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:08:43.170 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:43.319 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:43.444 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:08:43.444 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:08:43.445 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:43.571 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:43.697 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:43.848 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:43.922 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:44.039 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:44.174 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:44.359 INFO:teuthology.orchestra.run.smithi194.stdout:Adding group ceph....done 2024-09-12T17:08:44.367 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:08:44.367 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:08:44.727 INFO:teuthology.orchestra.run.smithi194.stdout:Adding system user ceph....done 2024-09-12T17:08:44.903 INFO:teuthology.orchestra.run.smithi194.stdout:Setting system user ceph properties....done 2024-09-12T17:08:44.918 INFO:teuthology.orchestra.run.smithi194.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T17:08:45.051 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:45.061 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T17:08:45.352 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:45.368 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T17:08:45.478 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:45.629 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:45.858 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:45.982 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T17:08:45.985 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:46.091 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T17:08:46.235 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:08:46.454 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:08:46.454 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:08:46.928 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:47.288 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T17:08:47.328 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T17:08:47.763 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:47.975 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:08:47.979 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T17:08:47.995 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:08:47.995 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:08:48.037 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-09-12T17:08:48.246 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2024-09-12T17:08:48.247 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2024-09-12T17:08:48.441 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:08:48.441 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:08:48.441 INFO:teuthology.orchestra.run.smithi119.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:08:48.442 INFO:teuthology.orchestra.run.smithi119.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:08:48.443 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:08:48.443 INFO:teuthology.orchestra.run.smithi119.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:08:48.443 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:08:48.444 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2024-09-12T17:08:48.444 INFO:teuthology.orchestra.run.smithi119.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T17:08:48.444 INFO:teuthology.orchestra.run.smithi119.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T17:08:48.444 INFO:teuthology.orchestra.run.smithi119.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T17:08:48.444 INFO:teuthology.orchestra.run.smithi119.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T17:08:48.445 INFO:teuthology.orchestra.run.smithi119.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T17:08:48.445 INFO:teuthology.orchestra.run.smithi119.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T17:08:48.445 INFO:teuthology.orchestra.run.smithi119.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T17:08:48.445 INFO:teuthology.orchestra.run.smithi119.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T17:08:48.445 INFO:teuthology.orchestra.run.smithi119.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T17:08:48.445 INFO:teuthology.orchestra.run.smithi119.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T17:08:48.445 INFO:teuthology.orchestra.run.smithi119.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T17:08:48.445 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2024-09-12T17:08:48.446 INFO:teuthology.orchestra.run.smithi119.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T17:08:48.446 INFO:teuthology.orchestra.run.smithi119.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T17:08:48.446 INFO:teuthology.orchestra.run.smithi119.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T17:08:48.446 INFO:teuthology.orchestra.run.smithi119.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T17:08:48.446 INFO:teuthology.orchestra.run.smithi119.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T17:08:48.484 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:48.486 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2024-09-12T17:08:48.486 INFO:teuthology.orchestra.run.smithi119.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T17:08:48.486 INFO:teuthology.orchestra.run.smithi119.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T17:08:48.487 INFO:teuthology.orchestra.run.smithi119.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T17:08:48.487 INFO:teuthology.orchestra.run.smithi119.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T17:08:48.487 INFO:teuthology.orchestra.run.smithi119.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T17:08:48.487 INFO:teuthology.orchestra.run.smithi119.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T17:08:48.487 INFO:teuthology.orchestra.run.smithi119.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T17:08:48.487 INFO:teuthology.orchestra.run.smithi119.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T17:08:48.487 INFO:teuthology.orchestra.run.smithi119.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T17:08:48.487 INFO:teuthology.orchestra.run.smithi119.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T17:08:48.488 INFO:teuthology.orchestra.run.smithi119.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T17:08:48.488 INFO:teuthology.orchestra.run.smithi119.stdout: s3cmd 2024-09-12T17:08:48.539 INFO:teuthology.orchestra.run.smithi119.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:08:48.539 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 10.4 MB of archives. 2024-09-12T17:08:48.539 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T17:08:48.539 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T17:08:48.557 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T17:08:48.557 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T17:08:48.560 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T17:08:48.595 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T17:08:48.610 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T17:08:48.612 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T17:08:48.643 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T17:08:48.663 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T17:08:48.664 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T17:08:48.665 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T17:08:48.700 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:08:48.701 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:08:48.711 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T17:08:48.711 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T17:08:48.728 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T17:08:48.729 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T17:08:48.729 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T17:08:48.730 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T17:08:48.730 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T17:08:48.733 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T17:08:48.733 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T17:08:48.739 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T17:08:48.741 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T17:08:48.747 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T17:08:48.748 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T17:08:48.759 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T17:08:48.759 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T17:08:48.760 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T17:08:48.762 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T17:08:48.765 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T17:08:48.766 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T17:08:48.781 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T17:08:48.781 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T17:08:48.798 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T17:08:48.798 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T17:08:48.798 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T17:08:49.183 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:49.237 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 10.4 MB in 0s (34.1 MB/s) 2024-09-12T17:08:49.307 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T17:08:49.381 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T17:08:49.386 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T17:08:49.431 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T17:08:49.465 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:08:49.465 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:08:49.692 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T17:08:49.720 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T17:08:49.759 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T17:08:49.934 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:49.978 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T17:08:50.008 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T17:08:50.045 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T17:08:50.060 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:50.211 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:50.340 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T17:08:50.369 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T17:08:50.417 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T17:08:50.422 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:08:50.422 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:08:50.693 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T17:08:50.721 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T17:08:50.759 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T17:08:50.905 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:51.012 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T17:08:51.028 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T17:08:51.062 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T17:08:51.063 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:51.189 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:51.314 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T17:08:51.332 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:51.343 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T17:08:51.381 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T17:08:51.641 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T17:08:51.658 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T17:08:51.685 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T17:08:51.700 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T17:08:51.794 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T17:08:51.971 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:08:51.994 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T17:08:52.010 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T17:08:52.052 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T17:08:52.280 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T17:08:52.296 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T17:08:52.330 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T17:08:52.582 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libguava-java. 2024-09-12T17:08:52.599 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T17:08:52.641 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T17:08:53.069 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T17:08:53.081 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T17:08:53.085 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T17:08:53.127 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T17:08:53.379 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libguice-java. 2024-09-12T17:08:53.396 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T17:08:53.437 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T17:08:53.709 INFO:teuthology.orchestra.run.smithi194.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:08:53.712 DEBUG:teuthology.orchestra.run.smithi194:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T17:08:53.774 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T17:08:53.791 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T17:08:53.817 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-12T17:08:53.833 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T17:08:54.027 INFO:teuthology.orchestra.run.smithi194.stdout:Building dependency tree... 2024-09-12T17:08:54.028 INFO:teuthology.orchestra.run.smithi194.stdout:Reading state information... 2024-09-12T17:08:54.086 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T17:08:54.114 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T17:08:54.152 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T17:08:54.219 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:08:54.219 INFO:teuthology.orchestra.run.smithi194.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:08:54.220 INFO:teuthology.orchestra.run.smithi194.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:08:54.220 INFO:teuthology.orchestra.run.smithi194.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:08:54.220 INFO:teuthology.orchestra.run.smithi194.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:08:54.220 INFO:teuthology.orchestra.run.smithi194.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:08:54.220 INFO:teuthology.orchestra.run.smithi194.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:08:54.222 INFO:teuthology.orchestra.run.smithi194.stdout:The following additional packages will be installed: 2024-09-12T17:08:54.222 INFO:teuthology.orchestra.run.smithi194.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T17:08:54.222 INFO:teuthology.orchestra.run.smithi194.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T17:08:54.222 INFO:teuthology.orchestra.run.smithi194.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T17:08:54.222 INFO:teuthology.orchestra.run.smithi194.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T17:08:54.222 INFO:teuthology.orchestra.run.smithi194.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T17:08:54.222 INFO:teuthology.orchestra.run.smithi194.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T17:08:54.222 INFO:teuthology.orchestra.run.smithi194.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T17:08:54.222 INFO:teuthology.orchestra.run.smithi194.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T17:08:54.223 INFO:teuthology.orchestra.run.smithi194.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T17:08:54.223 INFO:teuthology.orchestra.run.smithi194.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T17:08:54.223 INFO:teuthology.orchestra.run.smithi194.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T17:08:54.223 INFO:teuthology.orchestra.run.smithi194.stdout:Suggested packages: 2024-09-12T17:08:54.223 INFO:teuthology.orchestra.run.smithi194.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T17:08:54.223 INFO:teuthology.orchestra.run.smithi194.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T17:08:54.223 INFO:teuthology.orchestra.run.smithi194.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T17:08:54.224 INFO:teuthology.orchestra.run.smithi194.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T17:08:54.224 INFO:teuthology.orchestra.run.smithi194.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T17:08:54.262 INFO:teuthology.orchestra.run.smithi194.stdout:The following NEW packages will be installed: 2024-09-12T17:08:54.262 INFO:teuthology.orchestra.run.smithi194.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T17:08:54.262 INFO:teuthology.orchestra.run.smithi194.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T17:08:54.262 INFO:teuthology.orchestra.run.smithi194.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T17:08:54.262 INFO:teuthology.orchestra.run.smithi194.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T17:08:54.262 INFO:teuthology.orchestra.run.smithi194.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T17:08:54.262 INFO:teuthology.orchestra.run.smithi194.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T17:08:54.262 INFO:teuthology.orchestra.run.smithi194.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T17:08:54.262 INFO:teuthology.orchestra.run.smithi194.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T17:08:54.262 INFO:teuthology.orchestra.run.smithi194.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T17:08:54.263 INFO:teuthology.orchestra.run.smithi194.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T17:08:54.263 INFO:teuthology.orchestra.run.smithi194.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T17:08:54.263 INFO:teuthology.orchestra.run.smithi194.stdout: s3cmd 2024-09-12T17:08:54.315 INFO:teuthology.orchestra.run.smithi194.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:08:54.316 INFO:teuthology.orchestra.run.smithi194.stdout:Need to get 10.4 MB of archives. 2024-09-12T17:08:54.316 INFO:teuthology.orchestra.run.smithi194.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T17:08:54.316 INFO:teuthology.orchestra.run.smithi194.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T17:08:54.333 INFO:teuthology.orchestra.run.smithi194.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T17:08:54.334 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T17:08:54.337 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T17:08:54.372 INFO:teuthology.orchestra.run.smithi194.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T17:08:54.387 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T17:08:54.389 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T17:08:54.419 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T17:08:54.429 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T17:08:54.439 INFO:teuthology.orchestra.run.smithi194.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T17:08:54.440 INFO:teuthology.orchestra.run.smithi194.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T17:08:54.441 INFO:teuthology.orchestra.run.smithi194.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T17:08:54.446 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T17:08:54.487 INFO:teuthology.orchestra.run.smithi194.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T17:08:54.487 INFO:teuthology.orchestra.run.smithi194.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T17:08:54.488 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T17:08:54.509 INFO:teuthology.orchestra.run.smithi194.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T17:08:54.509 INFO:teuthology.orchestra.run.smithi194.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T17:08:54.509 INFO:teuthology.orchestra.run.smithi194.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T17:08:54.509 INFO:teuthology.orchestra.run.smithi194.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T17:08:54.510 INFO:teuthology.orchestra.run.smithi194.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T17:08:54.510 INFO:teuthology.orchestra.run.smithi194.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T17:08:54.510 INFO:teuthology.orchestra.run.smithi194.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T17:08:54.516 INFO:teuthology.orchestra.run.smithi194.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T17:08:54.523 INFO:teuthology.orchestra.run.smithi194.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T17:08:54.523 INFO:teuthology.orchestra.run.smithi194.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T17:08:54.535 INFO:teuthology.orchestra.run.smithi194.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T17:08:54.535 INFO:teuthology.orchestra.run.smithi194.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T17:08:54.536 INFO:teuthology.orchestra.run.smithi194.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T17:08:54.537 INFO:teuthology.orchestra.run.smithi194.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T17:08:54.538 INFO:teuthology.orchestra.run.smithi194.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T17:08:54.542 INFO:teuthology.orchestra.run.smithi194.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T17:08:54.544 INFO:teuthology.orchestra.run.smithi194.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T17:08:54.558 INFO:teuthology.orchestra.run.smithi194.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T17:08:54.558 INFO:teuthology.orchestra.run.smithi194.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T17:08:54.575 INFO:teuthology.orchestra.run.smithi194.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T17:08:54.575 INFO:teuthology.orchestra.run.smithi194.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T17:08:54.575 INFO:teuthology.orchestra.run.smithi194.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T17:08:54.732 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T17:08:54.748 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T17:08:54.790 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T17:08:55.007 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 10.4 MB in 0s (34.1 MB/s) 2024-09-12T17:08:55.017 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T17:08:55.034 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T17:08:55.076 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T17:08:55.102 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T17:08:55.160 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T17:08:55.165 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T17:08:55.218 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T17:08:55.455 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T17:08:55.484 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T17:08:55.512 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T17:08:55.521 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T17:08:55.541 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T17:08:55.578 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T17:08:55.774 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T17:08:55.803 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T17:08:55.841 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T17:08:55.864 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T17:08:55.893 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T17:08:55.941 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T17:08:56.161 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T17:08:56.178 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T17:08:56.220 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T17:08:56.275 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T17:08:56.303 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T17:08:56.350 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T17:08:56.439 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T17:08:56.456 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T17:08:56.489 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T17:08:56.644 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T17:08:56.672 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T17:08:56.719 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T17:08:56.741 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T17:08:56.760 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T17:08:56.799 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T17:08:56.980 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T17:08:57.008 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T17:08:57.060 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T17:08:57.077 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T17:08:57.119 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T17:08:57.156 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T17:08:57.396 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T17:08:57.425 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T17:08:57.458 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T17:08:57.463 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T17:08:57.475 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T17:08:57.525 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T17:08:57.690 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T17:08:57.719 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T17:08:57.757 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T17:08:57.836 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T17:08:57.864 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T17:08:57.911 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T17:08:58.034 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T17:08:58.051 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T17:08:58.093 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T17:08:58.222 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T17:08:58.238 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T17:08:58.280 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T17:08:58.363 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T17:08:58.392 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T17:08:58.430 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T17:08:58.524 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T17:08:58.540 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T17:08:58.574 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T17:08:58.708 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T17:08:58.736 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T17:08:58.774 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T17:08:58.819 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libguava-java. 2024-09-12T17:08:58.835 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T17:08:58.880 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T17:08:59.035 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T17:08:59.052 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T17:08:59.094 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T17:08:59.355 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T17:08:59.383 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T17:08:59.421 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T17:08:59.464 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T17:08:59.493 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T17:08:59.531 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T17:08:59.673 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libguice-java. 2024-09-12T17:08:59.701 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T17:08:59.748 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T17:08:59.783 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T17:08:59.799 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T17:08:59.841 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T17:09:00.186 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T17:09:00.202 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T17:09:00.252 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T17:09:00.270 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package maven. 2024-09-12T17:09:00.298 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T17:09:00.336 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T17:09:00.555 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T17:09:00.583 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T17:09:00.629 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T17:09:00.707 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-magic. 2024-09-12T17:09:00.735 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T17:09:00.773 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T17:09:00.915 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T17:09:00.943 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T17:09:00.982 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T17:09:01.076 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package s3cmd. 2024-09-12T17:09:01.104 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T17:09:01.143 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T17:09:01.243 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T17:09:01.271 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T17:09:01.309 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T17:09:01.505 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T17:09:01.562 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T17:09:01.590 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T17:09:01.628 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T17:09:01.631 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T17:09:01.749 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T17:09:01.850 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T17:09:01.914 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T17:09:01.930 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T17:09:01.972 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T17:09:02.034 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T17:09:02.361 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T17:09:02.488 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T17:09:02.613 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T17:09:02.738 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T17:09:02.739 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T17:09:02.767 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T17:09:02.814 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T17:09:02.864 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T17:09:02.990 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T17:09:03.101 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T17:09:03.131 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T17:09:03.159 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T17:09:03.197 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T17:09:03.200 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T17:09:03.310 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T17:09:03.436 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T17:09:03.458 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T17:09:03.474 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T17:09:03.516 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T17:09:03.595 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T17:09:03.752 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T17:09:03.769 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T17:09:03.802 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T17:09:03.846 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T17:09:03.973 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T17:09:04.046 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T17:09:04.063 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T17:09:04.099 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T17:09:04.104 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T17:09:04.216 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T17:09:04.317 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T17:09:04.357 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T17:09:04.373 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T17:09:04.415 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T17:09:04.418 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T17:09:04.536 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T17:09:04.668 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T17:09:04.685 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T17:09:04.726 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T17:09:04.829 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T17:09:04.955 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T17:09:04.978 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T17:09:05.007 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T17:09:05.037 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T17:09:05.081 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T17:09:05.207 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T17:09:05.315 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T17:09:05.333 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T17:09:05.344 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T17:09:05.382 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T17:09:05.434 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T17:09:05.603 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T17:09:05.693 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T17:09:05.721 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T17:09:05.728 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T17:09:05.776 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T17:09:05.854 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T17:09:05.997 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T17:09:06.104 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T17:09:06.132 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T17:09:06.140 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T17:09:06.179 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T17:09:06.266 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T17:09:06.498 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T17:09:06.566 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T17:09:06.570 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:09:06.583 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T17:09:06.625 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T17:09:06.877 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T17:09:06.893 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T17:09:06.935 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T17:09:07.347 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package maven. 2024-09-12T17:09:07.364 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T17:09:07.396 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T17:09:07.708 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-magic. 2024-09-12T17:09:07.736 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T17:09:07.795 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T17:09:07.939 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:09:07.945 DEBUG:teuthology.parallel:result is None 2024-09-12T17:09:08.119 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package s3cmd. 2024-09-12T17:09:08.147 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T17:09:08.186 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T17:09:08.581 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T17:09:08.707 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T17:09:08.833 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T17:09:08.959 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T17:09:09.085 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T17:09:09.211 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T17:09:09.321 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T17:09:09.421 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T17:09:09.539 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T17:09:09.665 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T17:09:09.791 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T17:09:09.917 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T17:09:10.059 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T17:09:10.185 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T17:09:10.311 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T17:09:10.422 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T17:09:10.672 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T17:09:10.798 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T17:09:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T17:09:11.049 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T17:09:11.175 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T17:09:11.310 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T17:09:11.461 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T17:09:11.762 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T17:09:11.871 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T17:09:11.981 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T17:09:12.107 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T17:09:12.241 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T17:09:12.367 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T17:09:12.493 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T17:09:12.627 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T17:09:12.753 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T17:09:12.871 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T17:09:13.115 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T17:09:13.225 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T17:09:13.474 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T17:09:13.546 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:09:14.838 INFO:teuthology.orchestra.run.smithi194.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:09:14.843 DEBUG:teuthology.parallel:result is None 2024-09-12T17:09:14.843 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:09:14.989 DEBUG:teuthology.orchestra.run.smithi119:> dpkg-query -W -f '${Version}' ceph 2024-09-12T17:09:15.009 INFO:teuthology.orchestra.run.smithi119.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:09:15.010 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:09:15.010 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-12T17:09:15.012 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:09:15.156 DEBUG:teuthology.orchestra.run.smithi194:> dpkg-query -W -f '${Version}' ceph 2024-09-12T17:09:15.175 INFO:teuthology.orchestra.run.smithi194.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:09:15.176 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:09:15.176 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-12T17:09:15.178 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T17:09:15.178 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:15.178 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:09:15.193 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:15.193 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:09:15.233 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T17:09:15.234 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:15.234 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:09:15.247 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:09:15.302 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:15.303 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:09:15.315 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:09:15.371 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T17:09:15.371 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:15.371 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:09:15.385 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:09:15.439 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:15.439 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:09:15.452 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:09:15.507 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T17:09:15.507 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:15.507 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:09:15.520 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:09:15.575 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:15.575 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:09:15.588 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:09:15.643 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T17:09:15.727 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T17:09:15.727 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /var/log/ceph 2024-09-12T17:09:15.730 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /var/log/ceph 2024-09-12T17:09:15.743 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T17:09:15.743 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:09:15.784 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:09:15.802 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T17:09:15.802 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:09:15.845 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:09:15.870 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T17:09:15.870 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T17:09:15.871 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902707', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7902707', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6279, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOKenXAO1lWxQBTAMZ7n+gn63GmPvMeWEPSzc5AsUO7oIjZ3fhwVFi6AIOg64ZEaFi63vyQE0BTpNseTOMB2rH4=', 'smithi194.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCAdb9H9WUMmMJVH0K091MuPyzyqyh5iNuJfAX2Ek3TiwfjZs/Bo9qa9ECMOseE4XpryWheJTK71VVlZUZupCfY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_15:39:52', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T17:09:15.871 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:09:15.905 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:09:15.910 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:09:15.952 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:09:15.966 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:15.966 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:09:16.011 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:09:16.012 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2024-09-12T17:09:16.060 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:09:16.060 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:09:16.060 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 873 Links: 1 2024-09-12T17:09:16.060 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:09:16.060 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-12 17:03:21.095417382 +0000 2024-09-12T17:09:16.061 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-12 17:03:20.827419762 +0000 2024-09-12T17:09:16.061 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-12 17:03:20.827419762 +0000 2024-09-12T17:09:16.061 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-09-12T17:09:16.061 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:09:16.114 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-12T17:09:16.114 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-12T17:09:16.114 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000446317 s, 1.1 MB/s 2024-09-12T17:09:16.115 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:09:16.165 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2024-09-12T17:09:16.212 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:09:16.212 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:09:16.212 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-12T17:09:16.212 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:09:16.212 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-12 17:03:21.567413191 +0000 2024-09-12T17:09:16.212 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-12 17:03:21.327415323 +0000 2024-09-12T17:09:16.212 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-12 17:03:21.327415323 +0000 2024-09-12T17:09:16.213 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-09-12T17:09:16.213 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:09:16.266 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-12T17:09:16.266 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-12T17:09:16.266 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000400511 s, 1.3 MB/s 2024-09-12T17:09:16.268 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:09:16.317 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2024-09-12T17:09:16.364 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:09:16.364 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:09:16.364 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-12T17:09:16.364 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:09:16.364 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-12 17:03:22.075408682 +0000 2024-09-12T17:09:16.365 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-12 17:03:21.831410849 +0000 2024-09-12T17:09:16.365 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-12 17:03:21.831410849 +0000 2024-09-12T17:09:16.365 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-09-12T17:09:16.365 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:09:16.418 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-12T17:09:16.418 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-12T17:09:16.418 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.00033379 s, 1.5 MB/s 2024-09-12T17:09:16.420 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:09:16.469 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2024-09-12T17:09:16.516 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:09:16.516 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:09:16.516 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-09-12T17:09:16.516 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:09:16.516 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-12 17:03:22.591404102 +0000 2024-09-12T17:09:16.516 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-12 17:03:22.323406480 +0000 2024-09-12T17:09:16.516 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-12 17:03:22.323406480 +0000 2024-09-12T17:09:16.516 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-09-12T17:09:16.517 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:09:16.570 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-12T17:09:16.570 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-12T17:09:16.570 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000351508 s, 1.5 MB/s 2024-09-12T17:09:16.571 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:09:16.624 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:16.624 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:16.624 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:09:16.630 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:09:16.630 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-09-12T17:09:16.677 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:09:16.677 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:09:16.677 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 877 Links: 1 2024-09-12T17:09:16.677 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:09:16.677 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-12 17:03:20.078644871 +0000 2024-09-12T17:09:16.678 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-12 17:03:19.798647371 +0000 2024-09-12T17:09:16.678 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-12 17:03:19.798647371 +0000 2024-09-12T17:09:16.678 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-09-12T17:09:16.678 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:09:16.732 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-12T17:09:16.733 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-12T17:09:16.733 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000457326 s, 1.1 MB/s 2024-09-12T17:09:16.733 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:09:16.782 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-09-12T17:09:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:09:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:09:16.829 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-09-12T17:09:16.829 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:09:16.829 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-12 17:03:20.554640619 +0000 2024-09-12T17:09:16.829 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-12 17:03:20.310642799 +0000 2024-09-12T17:09:16.829 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-12 17:03:20.310642799 +0000 2024-09-12T17:09:16.829 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-09-12T17:09:16.830 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:09:16.883 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-12T17:09:16.883 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-12T17:09:16.883 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000367845 s, 1.4 MB/s 2024-09-12T17:09:16.884 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:09:16.933 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-09-12T17:09:16.980 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:09:16.980 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:09:16.981 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-09-12T17:09:16.981 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:09:16.981 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-12 17:03:21.022636438 +0000 2024-09-12T17:09:16.981 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-12 17:03:20.754638833 +0000 2024-09-12T17:09:16.981 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-12 17:03:20.754638833 +0000 2024-09-12T17:09:16.981 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-09-12T17:09:16.981 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:09:17.035 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-12T17:09:17.035 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-12T17:09:17.035 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.00042162 s, 1.2 MB/s 2024-09-12T17:09:17.036 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:09:17.086 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-09-12T17:09:17.133 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:09:17.133 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:09:17.133 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-12T17:09:17.133 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:09:17.133 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-12 17:03:21.530631902 +0000 2024-09-12T17:09:17.133 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-12 17:03:21.266634260 +0000 2024-09-12T17:09:17.133 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-12 17:03:21.266634260 +0000 2024-09-12T17:09:17.133 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-09-12T17:09:17.133 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:09:17.186 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-12T17:09:17.187 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-12T17:09:17.187 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000371937 s, 1.4 MB/s 2024-09-12T17:09:17.188 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:09:17.237 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:17.237 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:09:17.237 INFO:tasks.ceph:Generating config... 2024-09-12T17:09:17.239 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T17:09:17.239 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T17:09:17.239 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T17:09:17.239 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T17:09:17.239 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T17:09:17.239 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:09:17.239 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T17:09:17.240 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-12T17:09:17.240 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-12T17:09:17.240 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-12T17:09:17.240 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T17:09:17.240 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T17:09:17.240 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T17:09:17.240 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T17:09:17.240 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T17:09:17.240 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T17:09:17.240 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T17:09:17.240 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T17:09:17.240 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T17:09:17.240 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-12T17:09:17.240 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T17:09:17.240 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T17:09:17.241 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T17:09:17.241 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T17:09:17.241 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T17:09:17.241 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T17:09:17.241 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T17:09:17.241 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-12T17:09:17.241 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T17:09:17.241 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T17:09:17.241 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T17:09:17.241 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T17:09:17.241 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T17:09:17.241 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T17:09:17.241 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T17:09:17.241 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T17:09:17.242 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T17:09:17.242 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T17:09:17.242 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T17:09:17.242 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T17:09:17.242 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T17:09:17.242 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T17:09:17.242 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T17:09:17.242 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-12T17:09:17.242 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T17:09:17.242 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T17:09:17.242 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T17:09:17.242 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T17:09:17.277 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T17:09:17.296 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T17:09:17.373 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:09:17.427 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.119'), ('mon.c', '[v2:172.21.15.119:3301,v1:172.21.15.119:6790]'), ('mon.b', '172.21.15.194')] 2024-09-12T17:09:17.428 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790],172.21.15.194', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T17:09:17.428 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:17.429 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:09:17.476 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.119 --addv c '[v2:172.21.15.119:3301,v1:172.21.15.119:6790]' --add b 172.21.15.194 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:17.562 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:09:17.562 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:09:17.562 INFO:teuthology.orchestra.run.smithi119.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:17.562 INFO:teuthology.orchestra.run.smithi119.stdout:monmaptool: generated fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:09:17.562 INFO:teuthology.orchestra.run.smithi119.stdout:setting min_mon_release = quincy 2024-09-12T17:09:17.562 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 0 2024-09-12T17:09:17.563 INFO:teuthology.orchestra.run.smithi119.stdout:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:09:17.563 INFO:teuthology.orchestra.run.smithi119.stdout:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:09:17.563 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:09:17.563 INFO:teuthology.orchestra.run.smithi119.stdout:min_mon_release 17 (quincy) 2024-09-12T17:09:17.563 INFO:teuthology.orchestra.run.smithi119.stdout:election_strategy: 1 2024-09-12T17:09:17.563 INFO:teuthology.orchestra.run.smithi119.stdout:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:09:17.563 INFO:teuthology.orchestra.run.smithi119.stdout:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:09:17.563 INFO:teuthology.orchestra.run.smithi119.stdout:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:09:17.563 INFO:teuthology.orchestra.run.smithi119.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T17:09:17.564 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:09:17.612 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4b851e18-22ea-4fa8-b208-1609edc12f85... 2024-09-12T17:09:17.613 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:09:17.656 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:09:17.685 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2024-09-12T17:09:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2024-09-12T17:09:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:09:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2024-09-12T17:09:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2024-09-12T17:09:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2024-09-12T17:09:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2024-09-12T17:09:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2024-09-12T17:09:17.685 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2024-09-12T17:09:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2024-09-12T17:09:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:09:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2024-09-12T17:09:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:09:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:09:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2024-09-12T17:09:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2024-09-12T17:09:17.686 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2024-09-12T17:09:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:09:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:09:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2024-09-12T17:09:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:09:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2024-09-12T17:09:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:09:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:09:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2024-09-12T17:09:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:09:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2024-09-12T17:09:17.687 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2024-09-12T17:09:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2024-09-12T17:09:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2024-09-12T17:09:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2024-09-12T17:09:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790],172.21.15.194" 2024-09-12T17:09:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: mon client directed command retry = 5 2024-09-12T17:09:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: ms inject socket failures = 5000 2024-09-12T17:09:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: osd heartbeat grace = 40 2024-09-12T17:09:17.688 INFO:teuthology.orchestra.run.smithi119.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:09:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:09:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:09:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.689 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2024-09-12T17:09:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2024-09-12T17:09:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2024-09-12T17:09:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2024-09-12T17:09:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:09:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2024-09-12T17:09:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2024-09-12T17:09:17.689 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2024-09-12T17:09:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2024-09-12T17:09:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2024-09-12T17:09:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug trim objects = true 2024-09-12T17:09:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2024-09-12T17:09:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2024-09-12T17:09:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:09:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.690 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2024-09-12T17:09:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2024-09-12T17:09:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:09:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2024-09-12T17:09:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2024-09-12T17:09:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2024-09-12T17:09:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: bdev async discard = True 2024-09-12T17:09:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: bdev enable discard = True 2024-09-12T17:09:17.691 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore allocator = bitmap 2024-09-12T17:09:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2024-09-12T17:09:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2024-09-12T17:09:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 1/20 2024-09-12T17:09:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 1/20 2024-09-12T17:09:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-12T17:09:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: debug objclass = 20 2024-09-12T17:09:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2024-09-12T17:09:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 4/10 2024-09-12T17:09:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:09:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2024-09-12T17:09:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:09:17.692 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:09:17.693 INFO:teuthology.orchestra.run.smithi119.stdout: osd fast shutdown = False 2024-09-12T17:09:17.693 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2024-09-12T17:09:17.693 INFO:teuthology.orchestra.run.smithi119.stdout: osd shutdown pgref assert = True 2024-09-12T17:09:17.693 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.693 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2024-09-12T17:09:17.693 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-12T17:09:17.693 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2024-09-12T17:09:17.693 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-09-12T17:09:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-09-12T17:09:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:09:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:09:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2024-09-12T17:09:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.694 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2024-09-12T17:09:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-12T17:09:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-09-12T17:09:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2024-09-12T17:09:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-09-12T17:09:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2024-09-12T17:09:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2024-09-12T17:09:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:09:17.694 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2024-09-12T17:09:17.695 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2024-09-12T17:09:17.695 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:09:17.695 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.695 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:09:17.695 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:09:17.695 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:09:17.695 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.695 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:09:17.695 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:09:17.695 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:09:17.695 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.695 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2024-09-12T17:09:17.696 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:09:17.696 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.696 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:09:17.696 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd crush smoke test = False 2024-09-12T17:09:17.696 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:09:17.696 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2024-09-12T17:09:17.696 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2024-09-12T17:09:17.697 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = True 2024-09-12T17:09:17.697 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2024-09-12T17:09:17.697 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:09:17.697 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:09:17.697 INFO:teuthology.orchestra.run.smithi119.stdout: debug rgw = 20 2024-09-12T17:09:17.697 INFO:teuthology.orchestra.run.smithi119.stdout: debug rgw notification = 20 2024-09-12T17:09:17.697 INFO:teuthology.orchestra.run.smithi119.stdout: rgw bucket counters cache = True 2024-09-12T17:09:17.698 INFO:teuthology.orchestra.run.smithi119.stdout: rgw crypt require ssl = False 2024-09-12T17:09:17.698 INFO:teuthology.orchestra.run.smithi119.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:09:17.698 INFO:teuthology.orchestra.run.smithi119.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:09:17.698 INFO:teuthology.orchestra.run.smithi119.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T17:09:17.698 INFO:teuthology.orchestra.run.smithi119.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T17:09:17.698 INFO:teuthology.orchestra.run.smithi119.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T17:09:17.698 INFO:teuthology.orchestra.run.smithi119.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:09:17.698 INFO:teuthology.orchestra.run.smithi119.stdout: rgw s3 auth use sts = True 2024-09-12T17:09:17.698 INFO:teuthology.orchestra.run.smithi119.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:09:17.698 INFO:teuthology.orchestra.run.smithi119.stdout: rgw torrent flag = True 2024-09-12T17:09:17.698 INFO:teuthology.orchestra.run.smithi119.stdout: rgw user counters cache = True 2024-09-12T17:09:17.698 INFO:teuthology.orchestra.run.smithi119.stdout: setgroup = ceph 2024-09-12T17:09:17.698 INFO:teuthology.orchestra.run.smithi119.stdout: setuser = ceph 2024-09-12T17:09:17.699 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2024-09-12T17:09:17.699 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2024-09-12T17:09:17.699 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2024-09-12T17:09:17.700 INFO:teuthology.orchestra.run.smithi194.stdout:[global] 2024-09-12T17:09:17.700 INFO:teuthology.orchestra.run.smithi194.stdout: chdir = "" 2024-09-12T17:09:17.701 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:09:17.701 INFO:teuthology.orchestra.run.smithi194.stdout: auth supported = cephx 2024-09-12T17:09:17.701 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.701 INFO:teuthology.orchestra.run.smithi194.stdout: filestore xattr use omap = true 2024-09-12T17:09:17.701 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.701 INFO:teuthology.orchestra.run.smithi194.stdout: mon clock drift allowed = 1.000 2024-09-12T17:09:17.701 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.701 INFO:teuthology.orchestra.run.smithi194.stdout: osd crush chooseleaf type = 0 2024-09-12T17:09:17.701 INFO:teuthology.orchestra.run.smithi194.stdout: auth debug = true 2024-09-12T17:09:17.701 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.701 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on old message = true 2024-09-12T17:09:17.701 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on bug = true 2024-09-12T17:09:17.701 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.702 INFO:teuthology.orchestra.run.smithi194.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:09:17.702 INFO:teuthology.orchestra.run.smithi194.stdout: mon pg warn max object skew = 0 2024-09-12T17:09:17.702 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.702 INFO:teuthology.orchestra.run.smithi194.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:09:17.702 INFO:teuthology.orchestra.run.smithi194.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:09:17.702 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.702 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default size = 2 2024-09-12T17:09:17.702 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.702 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow primary affinity = true 2024-09-12T17:09:17.702 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow pg remap = true 2024-09-12T17:09:17.702 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:09:17.702 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:09:17.702 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on no sortbitwise = false 2024-09-12T17:09:17.703 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:09:17.703 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on too few osds = false 2024-09-12T17:09:17.703 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:09:17.703 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:09:17.703 INFO:teuthology.orchestra.run.smithi194.stdout: mon_allow_pool_size_one = true 2024-09-12T17:09:17.703 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.703 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:09:17.703 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.703 INFO:teuthology.orchestra.run.smithi194.stdout: osd default data pool replay window = 5 2024-09-12T17:09:17.703 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.703 INFO:teuthology.orchestra.run.smithi194.stdout: mon allow pool delete = true 2024-09-12T17:09:17.703 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.704 INFO:teuthology.orchestra.run.smithi194.stdout: mon cluster log file level = debug 2024-09-12T17:09:17.704 INFO:teuthology.orchestra.run.smithi194.stdout: debug asserts on shutdown = true 2024-09-12T17:09:17.704 INFO:teuthology.orchestra.run.smithi194.stdout: mon health detail to clog = false 2024-09-12T17:09:17.704 INFO:teuthology.orchestra.run.smithi194.stdout: mon host = "172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790],172.21.15.194" 2024-09-12T17:09:17.704 INFO:teuthology.orchestra.run.smithi194.stdout: mon client directed command retry = 5 2024-09-12T17:09:17.704 INFO:teuthology.orchestra.run.smithi194.stdout: ms inject socket failures = 5000 2024-09-12T17:09:17.704 INFO:teuthology.orchestra.run.smithi194.stdout: osd heartbeat grace = 40 2024-09-12T17:09:17.704 INFO:teuthology.orchestra.run.smithi194.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:09:17.704 INFO:teuthology.orchestra.run.smithi194.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:09:17.705 INFO:teuthology.orchestra.run.smithi194.stdout: fsid = 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:09:17.705 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.705 INFO:teuthology.orchestra.run.smithi194.stdout:[osd] 2024-09-12T17:09:17.705 INFO:teuthology.orchestra.run.smithi194.stdout: osd journal size = 100 2024-09-12T17:09:17.705 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.705 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub load threshold = 5.0 2024-09-12T17:09:17.705 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub max interval = 600 2024-09-12T17:09:17.705 INFO:teuthology.orchestra.run.smithi194.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:09:17.705 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.705 INFO:teuthology.orchestra.run.smithi194.stdout: osd recover clone overlap = true 2024-09-12T17:09:17.705 INFO:teuthology.orchestra.run.smithi194.stdout: osd recovery max chunk = 1048576 2024-09-12T17:09:17.705 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.705 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug shutdown = true 2024-09-12T17:09:17.705 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug op order = true 2024-09-12T17:09:17.706 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug verify stray on activate = true 2024-09-12T17:09:17.706 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug trim objects = true 2024-09-12T17:09:17.706 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.706 INFO:teuthology.orchestra.run.smithi194.stdout: osd open classes on start = true 2024-09-12T17:09:17.706 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug pg log writeout = true 2024-09-12T17:09:17.706 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.706 INFO:teuthology.orchestra.run.smithi194.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:09:17.706 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.706 INFO:teuthology.orchestra.run.smithi194.stdout: osd map max advance = 10 2024-09-12T17:09:17.706 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.706 INFO:teuthology.orchestra.run.smithi194.stdout: journal zero on create = true 2024-09-12T17:09:17.706 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.706 INFO:teuthology.orchestra.run.smithi194.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:09:17.707 INFO:teuthology.orchestra.run.smithi194.stdout: filestore apply finisher threads = 3 2024-09-12T17:09:17.707 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.707 INFO:teuthology.orchestra.run.smithi194.stdout: bdev debug aio = true 2024-09-12T17:09:17.707 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug misdirected ops = true 2024-09-12T17:09:17.707 INFO:teuthology.orchestra.run.smithi194.stdout: bdev async discard = True 2024-09-12T17:09:17.707 INFO:teuthology.orchestra.run.smithi194.stdout: bdev enable discard = True 2024-09-12T17:09:17.707 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore allocator = bitmap 2024-09-12T17:09:17.707 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore block size = 96636764160 2024-09-12T17:09:17.707 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore fsck on mount = True 2024-09-12T17:09:17.707 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluefs = 1/20 2024-09-12T17:09:17.707 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluestore = 1/20 2024-09-12T17:09:17.707 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-12T17:09:17.707 INFO:teuthology.orchestra.run.smithi194.stdout: debug objclass = 20 2024-09-12T17:09:17.708 INFO:teuthology.orchestra.run.smithi194.stdout: debug osd = 20 2024-09-12T17:09:17.708 INFO:teuthology.orchestra.run.smithi194.stdout: debug rocksdb = 4/10 2024-09-12T17:09:17.708 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:09:17.708 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd full ratio = 0.9 2024-09-12T17:09:17.708 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:09:17.708 INFO:teuthology.orchestra.run.smithi194.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:09:17.708 INFO:teuthology.orchestra.run.smithi194.stdout: osd fast shutdown = False 2024-09-12T17:09:17.708 INFO:teuthology.orchestra.run.smithi194.stdout: osd objectstore = bluestore 2024-09-12T17:09:17.708 INFO:teuthology.orchestra.run.smithi194.stdout: osd shutdown pgref assert = True 2024-09-12T17:09:17.708 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.708 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr] 2024-09-12T17:09:17.708 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-12T17:09:17.708 INFO:teuthology.orchestra.run.smithi194.stdout: debug mgr = 20 2024-09-12T17:09:17.709 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-09-12T17:09:17.709 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-09-12T17:09:17.709 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:09:17.709 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:09:17.709 INFO:teuthology.orchestra.run.smithi194.stdout: mgr/telemetry/nag = false 2024-09-12T17:09:17.709 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.709 INFO:teuthology.orchestra.run.smithi194.stdout:[mon] 2024-09-12T17:09:17.709 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-12T17:09:17.709 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-09-12T17:09:17.709 INFO:teuthology.orchestra.run.smithi194.stdout: debug paxos = 20 2024-09-12T17:09:17.709 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-09-12T17:09:17.709 INFO:teuthology.orchestra.run.smithi194.stdout: mon data avail warn = 5 2024-09-12T17:09:17.710 INFO:teuthology.orchestra.run.smithi194.stdout: mon mgr mkfs grace = 240 2024-09-12T17:09:17.710 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:09:17.710 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd reporter subtree level = osd 2024-09-12T17:09:17.710 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd prime pg temp = true 2024-09-12T17:09:17.710 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:09:17.710 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.710 INFO:teuthology.orchestra.run.smithi194.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:09:17.710 INFO:teuthology.orchestra.run.smithi194.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:09:17.710 INFO:teuthology.orchestra.run.smithi194.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:09:17.710 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.710 INFO:teuthology.orchestra.run.smithi194.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:09:17.710 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:09:17.711 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:09:17.711 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.711 INFO:teuthology.orchestra.run.smithi194.stdout: # 1m isn't quite enough 2024-09-12T17:09:17.711 INFO:teuthology.orchestra.run.smithi194.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:09:17.711 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.711 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:09:17.711 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd crush smoke test = False 2024-09-12T17:09:17.711 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-12T17:09:17.711 INFO:teuthology.orchestra.run.smithi194.stdout:[client] 2024-09-12T17:09:17.711 INFO:teuthology.orchestra.run.smithi194.stdout: rgw cache enabled = true 2024-09-12T17:09:17.711 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable ops log = True 2024-09-12T17:09:17.711 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable usage log = true 2024-09-12T17:09:17.711 INFO:teuthology.orchestra.run.smithi194.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:09:17.712 INFO:teuthology.orchestra.run.smithi194.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:09:17.712 INFO:teuthology.orchestra.run.smithi194.stdout: debug rgw = 20 2024-09-12T17:09:17.712 INFO:teuthology.orchestra.run.smithi194.stdout: debug rgw notification = 20 2024-09-12T17:09:17.712 INFO:teuthology.orchestra.run.smithi194.stdout: rgw bucket counters cache = True 2024-09-12T17:09:17.712 INFO:teuthology.orchestra.run.smithi194.stdout: rgw crypt require ssl = False 2024-09-12T17:09:17.712 INFO:teuthology.orchestra.run.smithi194.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:09:17.712 INFO:teuthology.orchestra.run.smithi194.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:09:17.712 INFO:teuthology.orchestra.run.smithi194.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T17:09:17.712 INFO:teuthology.orchestra.run.smithi194.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T17:09:17.712 INFO:teuthology.orchestra.run.smithi194.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T17:09:17.712 INFO:teuthology.orchestra.run.smithi194.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:09:17.712 INFO:teuthology.orchestra.run.smithi194.stdout: rgw s3 auth use sts = True 2024-09-12T17:09:17.712 INFO:teuthology.orchestra.run.smithi194.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:09:17.713 INFO:teuthology.orchestra.run.smithi194.stdout: rgw torrent flag = True 2024-09-12T17:09:17.713 INFO:teuthology.orchestra.run.smithi194.stdout: rgw user counters cache = True 2024-09-12T17:09:17.713 INFO:teuthology.orchestra.run.smithi194.stdout: setgroup = ceph 2024-09-12T17:09:17.713 INFO:teuthology.orchestra.run.smithi194.stdout: setuser = ceph 2024-09-12T17:09:17.713 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.a] 2024-09-12T17:09:17.713 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.c] 2024-09-12T17:09:17.713 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.b] 2024-09-12T17:09:17.713 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T17:09:17.713 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T17:09:17.791 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T17:09:17.791 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:17.791 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T17:09:17.796 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:17.797 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T17:09:17.849 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T17:09:17.850 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:17.850 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:09:17.850 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:09:17.912 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:17.912 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:17.959 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T17:09:17.959 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:17.959 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:09:17.960 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:09:17.983 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:17.983 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:18.030 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T17:09:18.030 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T17:09:18.030 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:09:18.074 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:09:18.076 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:09:18.120 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:09:18.138 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T17:09:18.138 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T17:09:18.138 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T17:09:18.175 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T17:09:18.185 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T17:09:18.221 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T17:09:18.233 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T17:09:18.233 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:09:18.233 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T17:09:18.245 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:18.245 INFO:tasks.ceph:role: osd.0 2024-09-12T17:09:18.245 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T17:09:18.245 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:09:18.311 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:09:18.311 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:09:18.311 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:09:18.311 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:09:18.311 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:09:18.312 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:09:18.312 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:09:18.312 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:09:18.312 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:09:18.312 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:09:18.772 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-09-12T17:09:18.774 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-09-12T17:09:18.774 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T17:09:18.867 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T17:09:18.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:09:18.878 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:09:18.879 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T17:09:18.934 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:18.935 INFO:tasks.ceph:role: osd.1 2024-09-12T17:09:18.935 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T17:09:18.935 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:09:18.998 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:09:18.998 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:09:18.998 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:09:18.998 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:09:18.998 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:09:18.998 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:09:18.998 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:09:18.999 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:09:18.999 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:09:18.999 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:09:19.490 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-09-12T17:09:19.490 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-09-12T17:09:19.491 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T17:09:19.643 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T17:09:19.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:09:19.655 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:09:19.655 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T17:09:19.710 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:19.710 INFO:tasks.ceph:role: osd.2 2024-09-12T17:09:19.710 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T17:09:19.710 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:09:19.771 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:09:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:09:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:09:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:09:19.772 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:09:19.772 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:09:19.772 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:09:19.772 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:09:19.772 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:09:19.772 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:09:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-09-12T17:09:20.252 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-09-12T17:09:20.252 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T17:09:20.373 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T17:09:20.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:09:20.386 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:09:20.386 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T17:09:20.439 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:20.439 INFO:tasks.ceph:role: osd.3 2024-09-12T17:09:20.439 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T17:09:20.439 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:09:20.502 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:09:20.502 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:09:20.502 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:09:20.503 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:09:20.503 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:09:20.503 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:09:20.503 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:09:20.503 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:09:20.503 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:09:20.503 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:09:20.926 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-09-12T17:09:20.928 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-09-12T17:09:20.929 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T17:09:21.016 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T17:09:21.067 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:09:21.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:09:21.068 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:21.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:09:21.175+0000 7febe5ae37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T17:09:21.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:09:21.179+0000 7febe5ae37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T17:09:21.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:09:21.179+0000 7febe5ae37c0 -1 bdev(0x55b9a57e3800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T17:09:21.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:09:21.179+0000 7febe5ae37c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T17:09:24.313 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T17:09:24.327 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:24.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:09:24.407+0000 7fb1d32207c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T17:09:24.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:09:24.407+0000 7fb1d32207c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T17:09:24.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:09:24.407+0000 7fb1d32207c0 -1 bdev(0x555edc4cd800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T17:09:24.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:09:24.407+0000 7fb1d32207c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T17:09:27.557 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T17:09:27.612 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:27.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:09:27.695+0000 7fe3e3cdc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T17:09:27.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:09:27.695+0000 7fe3e3cdc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T17:09:27.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:09:27.695+0000 7fe3e3cdc7c0 -1 bdev(0x563fca9d7800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T17:09:27.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:09:27.695+0000 7fe3e3cdc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T17:09:30.841 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T17:09:30.895 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:30.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:09:30.975+0000 7f40259277c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T17:09:30.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:09:30.979+0000 7f40259277c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T17:09:30.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:09:30.979+0000 7f40259277c0 -1 bdev(0x5644e6b63800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T17:09:30.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:09:30.979+0000 7f40259277c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T17:09:34.118 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T17:09:34.176 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T17:09:34.191 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:34.191 INFO:tasks.ceph:role: osd.4 2024-09-12T17:09:34.191 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T17:09:34.191 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:09:34.252 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:09:34.252 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:09:34.253 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:09:34.253 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:09:34.253 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:09:34.253 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:09:34.253 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:09:34.253 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:09:34.253 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:09:34.253 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:09:34.712 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-12T17:09:34.713 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-12T17:09:34.714 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T17:09:34.801 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T17:09:34.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:09:34.810 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:09:34.811 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T17:09:34.863 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:34.863 INFO:tasks.ceph:role: osd.5 2024-09-12T17:09:34.863 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T17:09:34.863 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:09:34.926 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:09:34.926 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:09:34.926 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:09:34.926 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:09:34.926 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:09:34.926 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:09:34.926 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:09:34.926 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:09:34.926 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:09:34.926 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:09:35.392 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-12T17:09:35.394 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-12T17:09:35.394 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T17:09:35.550 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T17:09:35.561 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:09:35.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:09:35.562 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T17:09:35.616 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:35.616 INFO:tasks.ceph:role: osd.6 2024-09-12T17:09:35.616 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T17:09:35.616 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:09:35.680 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:09:35.680 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:09:35.680 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:09:35.681 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:09:35.681 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:09:35.681 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:09:35.681 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:09:35.681 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:09:35.681 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:09:35.681 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:09:36.167 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-12T17:09:36.169 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-12T17:09:36.169 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T17:09:36.312 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T17:09:36.324 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:09:36.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:09:36.325 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T17:09:36.380 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:36.380 INFO:tasks.ceph:role: osd.7 2024-09-12T17:09:36.380 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T17:09:36.381 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:09:36.443 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:09:36.443 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:09:36.443 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:09:36.443 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:09:36.443 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:09:36.444 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:09:36.444 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:09:36.444 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:09:36.444 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:09:36.444 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:09:36.865 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-12T17:09:36.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-12T17:09:36.867 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T17:09:36.954 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T17:09:36.963 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:09:36.963 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:09:36.964 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:37.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T17:09:37.076+0000 7f3b6c01a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T17:09:37.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T17:09:37.080+0000 7f3b6c01a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T17:09:37.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T17:09:37.080+0000 7f3b6c01a7c0 -1 bdev(0x55792f3b9800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T17:09:37.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T17:09:37.080+0000 7f3b6c01a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T17:09:40.236 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T17:09:40.250 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:40.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T17:09:40.332+0000 7f7df82647c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T17:09:40.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T17:09:40.332+0000 7f7df82647c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T17:09:40.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T17:09:40.332+0000 7f7df82647c0 -1 bdev(0x562f6bfa9800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T17:09:40.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T17:09:40.332+0000 7f7df82647c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T17:09:43.489 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T17:09:43.544 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:43.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T17:09:43.628+0000 7f15e77097c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T17:09:43.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T17:09:43.628+0000 7f15e77097c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T17:09:43.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T17:09:43.628+0000 7f15e77097c0 -1 bdev(0x555990641800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T17:09:43.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T17:09:43.628+0000 7f15e77097c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T17:09:46.765 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T17:09:46.821 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:46.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T17:09:46.900+0000 7ff5f76427c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T17:09:46.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T17:09:46.900+0000 7ff5f76427c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T17:09:46.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T17:09:46.900+0000 7ff5f76427c0 -1 bdev(0x55e718615800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T17:09:46.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-12T17:09:46.900+0000 7ff5f76427c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T17:09:50.047 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T17:09:50.107 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T17:09:50.107 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:50.107 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T17:09:50.121 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:50.122 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T17:09:50.175 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:50.175 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T17:09:50.230 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:50.230 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T17:09:50.284 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:50.284 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T17:09:50.338 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:50.338 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T17:09:50.351 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:50.351 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T17:09:50.403 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:50.404 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T17:09:50.460 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:50.461 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T17:09:50.516 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:50.516 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T17:09:50.571 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:50.571 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T17:09:50.576 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:50.577 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T17:09:50.616 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T17:09:50.617 DEBUG:teuthology.orchestra.run.smithi119:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:09:50.620 DEBUG:teuthology.orchestra.run.smithi194:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:09:50.663 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.y] 2024-09-12T17:09:50.663 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQA+IONmLTN/BBAAwaR7i3H0PHklYnz446ztxw== 2024-09-12T17:09:50.663 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.0] 2024-09-12T17:09:50.663 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBBIONmwWO+ChAAgQNE9z5uNbpAJ5JfKr68uw== 2024-09-12T17:09:50.663 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.1] 2024-09-12T17:09:50.663 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBEIONmdGOLGBAABvKI2b6SkGwo5gE31mYdUg== 2024-09-12T17:09:50.663 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.2] 2024-09-12T17:09:50.663 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBHIONm3RKZKRAAtEzeSWtt1pMI7umKCQDsQA== 2024-09-12T17:09:50.664 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.3] 2024-09-12T17:09:50.664 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBKIONmX110OhAANNtkAkloreFeKKYBgzIn6A== 2024-09-12T17:09:50.664 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.x] 2024-09-12T17:09:50.664 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQA+IONm+Zc/BxAAQoipyfakgsUcU6LUZOaC8A== 2024-09-12T17:09:50.664 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.4] 2024-09-12T17:09:50.664 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBRIONmbY3cBBAA3FSIxoF4pofBXjnZ61f8yg== 2024-09-12T17:09:50.664 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.5] 2024-09-12T17:09:50.664 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBUIONmxWfyExAATLUrPeM5ke4OLbbXyOiPFQ== 2024-09-12T17:09:50.664 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.6] 2024-09-12T17:09:50.664 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBXIONmrHeMJRAAfzfhagZw0b8etumMQRMXtA== 2024-09-12T17:09:50.664 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.7] 2024-09-12T17:09:50.664 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBaIONm8hHdNRAAw8XGE1U6/Sao1GFjiwNT0A== 2024-09-12T17:09:50.665 INFO:teuthology.orchestra.run.smithi119.stdout:[client.0] 2024-09-12T17:09:50.665 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQA+IONmRniMChAA/jjRMfC1f1VKhFplJ+mTKg== 2024-09-12T17:09:50.665 INFO:teuthology.orchestra.run.smithi119.stdout:[client.1] 2024-09-12T17:09:50.665 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQA+IONmO6JNDRAAVDB9hozlLwsgwZXrf+cHDg== 2024-09-12T17:09:50.670 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.y] 2024-09-12T17:09:50.670 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQA+IONmLTN/BBAAwaR7i3H0PHklYnz446ztxw== 2024-09-12T17:09:50.670 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.0] 2024-09-12T17:09:50.670 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBBIONmwWO+ChAAgQNE9z5uNbpAJ5JfKr68uw== 2024-09-12T17:09:50.670 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.1] 2024-09-12T17:09:50.670 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBEIONmdGOLGBAABvKI2b6SkGwo5gE31mYdUg== 2024-09-12T17:09:50.670 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.2] 2024-09-12T17:09:50.670 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBHIONm3RKZKRAAtEzeSWtt1pMI7umKCQDsQA== 2024-09-12T17:09:50.670 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.3] 2024-09-12T17:09:50.670 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBKIONmX110OhAANNtkAkloreFeKKYBgzIn6A== 2024-09-12T17:09:50.671 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.x] 2024-09-12T17:09:50.671 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQA+IONm+Zc/BxAAQoipyfakgsUcU6LUZOaC8A== 2024-09-12T17:09:50.671 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.4] 2024-09-12T17:09:50.671 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBRIONmbY3cBBAA3FSIxoF4pofBXjnZ61f8yg== 2024-09-12T17:09:50.671 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.5] 2024-09-12T17:09:50.671 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBUIONmxWfyExAATLUrPeM5ke4OLbbXyOiPFQ== 2024-09-12T17:09:50.671 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.6] 2024-09-12T17:09:50.671 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBXIONmrHeMJRAAfzfhagZw0b8etumMQRMXtA== 2024-09-12T17:09:50.671 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.7] 2024-09-12T17:09:50.671 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBaIONm8hHdNRAAw8XGE1U6/Sao1GFjiwNT0A== 2024-09-12T17:09:50.671 INFO:teuthology.orchestra.run.smithi194.stdout:[client.0] 2024-09-12T17:09:50.671 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQA+IONmRniMChAA/jjRMfC1f1VKhFplJ+mTKg== 2024-09-12T17:09:50.671 INFO:teuthology.orchestra.run.smithi194.stdout:[client.1] 2024-09-12T17:09:50.672 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQA+IONmO6JNDRAAVDB9hozlLwsgwZXrf+cHDg== 2024-09-12T17:09:50.672 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:09:50.712 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:09:50.761 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:09:50.763 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:09:50.807 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:09:50.924 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:09:50.971 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:09:50.974 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:09:51.066 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:09:51.069 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:09:51.150 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:09:51.157 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:09:51.233 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:09:51.244 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:09:51.316 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:09:51.332 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:09:51.399 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:09:51.416 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:09:51.484 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:09:51.499 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:09:51.571 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:09:51.583 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:09:51.665 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:09:51.667 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:09:51.713 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T17:09:51.713 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T17:09:51.725 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:09:51.817 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T17:09:51.829 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T17:09:51.884 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:09:51.977 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T17:09:51.987 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T17:09:52.001 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:09:52.099 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T17:09:52.111 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:52.113 DEBUG:teuthology.orchestra.run.smithi194:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:52.159 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T17:09:52.160 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T17:09:52.160 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T17:09:52.162 INFO:tasks.ceph.mon.a:Started 2024-09-12T17:09:52.163 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T17:09:52.163 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T17:09:52.165 INFO:tasks.ceph.mon.c:Started 2024-09-12T17:09:52.165 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T17:09:52.166 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T17:09:52.205 INFO:tasks.ceph.mon.b:Started 2024-09-12T17:09:52.205 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T17:09:52.205 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T17:09:52.205 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T17:09:52.208 INFO:tasks.ceph.mgr.y:Started 2024-09-12T17:09:52.208 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T17:09:52.208 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T17:09:52.210 INFO:tasks.ceph.mgr.x:Started 2024-09-12T17:09:52.210 DEBUG:tasks.ceph:set 0 configs 2024-09-12T17:09:52.210 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T17:09:52.211 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T17:09:58.423 INFO:teuthology.orchestra.run.smithi119.stderr:adjusted tunables profile to default 2024-09-12T17:09:58.443 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T17:09:58.443 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T17:09:58.443 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:58.443 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T17:09:58.454 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:58.454 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T17:09:58.509 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:58.510 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T17:09:58.561 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:09:58.562 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T17:09:58.614 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:58.614 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T17:09:58.628 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:58.629 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T17:09:58.683 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:58.684 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T17:09:58.739 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-12T17:09:58.739 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T17:09:58.795 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 3d7e991a-0d17-4cfc-a5a9-b1305c2cab11 0 2024-09-12T17:09:59.064 INFO:teuthology.orchestra.run.smithi194.stdout:0 2024-09-12T17:09:59.082 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new b845ed74-bf2a-4cae-bdb2-2a769a71023e 1 2024-09-12T17:09:59.306 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-12T17:09:59.322 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 3a8139a6-3a4b-4eeb-8540-93575ad1e62d 2 2024-09-12T17:09:59.531 INFO:teuthology.orchestra.run.smithi194.stdout:2 2024-09-12T17:09:59.547 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 3729a87d-2150-4127-a405-1f4ee9689e78 3 2024-09-12T17:09:59.738 INFO:teuthology.orchestra.run.smithi194.stdout:3 2024-09-12T17:09:59.755 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 4cf374e8-5640-4636-bc01-e28318e18ecd 4 2024-09-12T17:09:59.956 INFO:teuthology.orchestra.run.smithi194.stdout:4 2024-09-12T17:09:59.972 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 32b317b4-a8f6-48da-bab4-d5a1607da924 5 2024-09-12T17:10:00.166 INFO:teuthology.orchestra.run.smithi194.stdout:5 2024-09-12T17:10:00.182 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 63603319-1a08-4920-a6b7-1e7b32d7873c 6 2024-09-12T17:10:00.389 INFO:teuthology.orchestra.run.smithi194.stdout:6 2024-09-12T17:10:00.405 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new b652b158-a160-460f-98de-66821bf3621c 7 2024-09-12T17:10:00.609 INFO:teuthology.orchestra.run.smithi194.stdout:7 2024-09-12T17:10:00.625 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T17:10:00.626 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T17:10:00.628 INFO:tasks.ceph.osd.0:Started 2024-09-12T17:10:00.628 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T17:10:00.628 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T17:10:00.630 INFO:tasks.ceph.osd.1:Started 2024-09-12T17:10:00.630 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T17:10:00.631 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T17:10:00.633 INFO:tasks.ceph.osd.2:Started 2024-09-12T17:10:00.633 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T17:10:00.634 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T17:10:00.636 INFO:tasks.ceph.osd.3:Started 2024-09-12T17:10:00.636 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T17:10:00.636 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T17:10:00.638 INFO:tasks.ceph.osd.4:Started 2024-09-12T17:10:00.638 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T17:10:00.638 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T17:10:00.640 INFO:tasks.ceph.osd.5:Started 2024-09-12T17:10:00.640 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T17:10:00.640 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T17:10:00.642 INFO:tasks.ceph.osd.6:Started 2024-09-12T17:10:00.642 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T17:10:00.643 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T17:10:00.644 INFO:tasks.ceph.osd.7:Started 2024-09-12T17:10:00.645 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:00.878 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:10:00.878 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":10,"fsid":"4b851e18-22ea-4fa8-b208-1609edc12f85","created":"2024-09-12T17:09:57.574459+0000","modified":"2024-09-12T17:10:00.608474+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:10:00.608474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3d7e991a-0d17-4cfc-a5a9-b1305c2cab11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b845ed74-bf2a-4cae-bdb2-2a769a71023e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3a8139a6-3a4b-4eeb-8540-93575ad1e62d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3729a87d-2150-4127-a405-1f4ee9689e78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4cf374e8-5640-4636-bc01-e28318e18ecd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"32b317b4-a8f6-48da-bab4-d5a1607da924","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"63603319-1a08-4920-a6b7-1e7b32d7873c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b652b158-a160-460f-98de-66821bf3621c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:00.894 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T17:10:00.895 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T17:10:01.026 INFO:tasks.ceph.mgr.y.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T17:10:01.026 INFO:tasks.ceph.mgr.y.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T17:10:01.026 INFO:tasks.ceph.mgr.y.smithi119.stderr: from numpy import show_config as show_numpy_config 2024-09-12T17:10:01.351 INFO:tasks.ceph.mgr.x.smithi194.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T17:10:01.351 INFO:tasks.ceph.mgr.x.smithi194.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T17:10:01.351 INFO:tasks.ceph.mgr.x.smithi194.stderr: from numpy import show_config as show_numpy_config 2024-09-12T17:10:01.701 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:01.827 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-09-12T17:10:01.827+0000 7f34312037c0 -1 Falling back to public interface 2024-09-12T17:10:01.876 INFO:teuthology.misc.health.smithi119.stdout: 2024-09-12T17:10:01.876 INFO:teuthology.misc.health.smithi119.stdout:{"epoch":10,"fsid":"4b851e18-22ea-4fa8-b208-1609edc12f85","created":"2024-09-12T17:09:57.574459+0000","modified":"2024-09-12T17:10:00.608474+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:10:00.608474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3d7e991a-0d17-4cfc-a5a9-b1305c2cab11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b845ed74-bf2a-4cae-bdb2-2a769a71023e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3a8139a6-3a4b-4eeb-8540-93575ad1e62d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3729a87d-2150-4127-a405-1f4ee9689e78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4cf374e8-5640-4636-bc01-e28318e18ecd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"32b317b4-a8f6-48da-bab4-d5a1607da924","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"63603319-1a08-4920-a6b7-1e7b32d7873c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b652b158-a160-460f-98de-66821bf3621c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:01.891 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:10:02.036 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T17:10:02.035+0000 7f8dce81f7c0 -1 Falling back to public interface 2024-09-12T17:10:02.052 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T17:10:02.051+0000 7f32aa4737c0 -1 Falling back to public interface 2024-09-12T17:10:02.302 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T17:10:02.299+0000 7f0d2ac7a7c0 -1 Falling back to public interface 2024-09-12T17:10:02.501 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T17:10:02.499+0000 7f259e0fc7c0 -1 Falling back to public interface 2024-09-12T17:10:02.531 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-09-12T17:10:02.531+0000 7f1ebd2317c0 -1 Falling back to public interface 2024-09-12T17:10:02.547 INFO:tasks.ceph.osd.0.smithi119.stderr:2024-09-12T17:10:02.547+0000 7fd9222647c0 -1 Falling back to public interface 2024-09-12T17:10:02.547 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-09-12T17:10:02.547+0000 7fb608cd37c0 -1 Falling back to public interface 2024-09-12T17:10:04.249 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-12T17:10:04.247+0000 7f0f75d08640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T17:10:04.249 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-12T17:10:04.247+0000 7f0f75d08640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T17:10:06.127 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T17:10:06.127+0000 7f32aa4737c0 -1 osd.4 0 log_to_monitors true 2024-09-12T17:10:06.161 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-09-12T17:10:06.159+0000 7f34312037c0 -1 osd.3 0 log_to_monitors true 2024-09-12T17:10:06.302 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T17:10:06.299+0000 7f0d2ac7a7c0 -1 osd.5 0 log_to_monitors true 2024-09-12T17:10:06.351 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T17:10:06.351+0000 7f8dce81f7c0 -1 osd.7 0 log_to_monitors true 2024-09-12T17:10:06.603 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-09-12T17:10:06.603+0000 7f1ebd2317c0 -1 osd.2 0 log_to_monitors true 2024-09-12T17:10:06.880 INFO:tasks.ceph.osd.0.smithi119.stderr:2024-09-12T17:10:06.879+0000 7fd9222647c0 -1 osd.0 0 log_to_monitors true 2024-09-12T17:10:06.950 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-09-12T17:10:06.951+0000 7fb608cd37c0 -1 osd.1 0 log_to_monitors true 2024-09-12T17:10:06.993 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T17:10:06.991+0000 7f259e0fc7c0 -1 osd.6 0 log_to_monitors true 2024-09-12T17:10:08.190 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-09-12T17:10:08.187+0000 7f342d9be640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T17:10:08.211 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-09-12T17:10:08.211+0000 7f3424fde640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:08.284 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T17:10:08.283+0000 7f32a641c640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T17:10:08.421 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-12T17:10:08.419+0000 7f329e24e640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:08.698 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:09.039 INFO:teuthology.misc.health.smithi119.stdout: 2024-09-12T17:10:09.039 INFO:teuthology.misc.health.smithi119.stdout:{"epoch":13,"fsid":"4b851e18-22ea-4fa8-b208-1609edc12f85","created":"2024-09-12T17:09:57.574459+0000","modified":"2024-09-12T17:10:08.267317+0000","last_up_change":"2024-09-12T17:10:08.267317+0000","last_in_change":"2024-09-12T17:10:00.608474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3d7e991a-0d17-4cfc-a5a9-b1305c2cab11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b845ed74-bf2a-4cae-bdb2-2a769a71023e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3a8139a6-3a4b-4eeb-8540-93575ad1e62d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3729a87d-2150-4127-a405-1f4ee9689e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6801","nonce":1732749810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6803","nonce":1732749810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6807","nonce":1732749810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6805","nonce":1732749810}]},"public_addr":"172.21.15.119:6801/1732749810","cluster_addr":"172.21.15.119:6803/1732749810","heartbeat_back_addr":"172.21.15.119:6807/1732749810","heartbeat_front_addr":"172.21.15.119:6805/1732749810","state":["exists","up"]},{"osd":4,"uuid":"4cf374e8-5640-4636-bc01-e28318e18ecd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"32b317b4-a8f6-48da-bab4-d5a1607da924","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"63603319-1a08-4920-a6b7-1e7b32d7873c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b652b158-a160-460f-98de-66821bf3621c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:09.058 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-12T17:10:09.950 INFO:tasks.ceph.osd.0.smithi119.stderr:2024-09-12T17:10:09.947+0000 7fd91e20d640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T17:10:09.975 INFO:tasks.ceph.osd.0.smithi119.stderr:2024-09-12T17:10:09.975+0000 7fd91603f640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:09.979 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T17:10:09.979+0000 7f8dcafda640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T17:10:09.991 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-09-12T17:10:09.991+0000 7fb604c7c640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T17:10:10.004 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-12T17:10:10.003+0000 7f8dc25fa640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:10.013 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-09-12T17:10:10.011+0000 7f1eb99ec640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T17:10:10.014 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-09-12T17:10:10.015+0000 7fb5fcaae640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:10.038 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-09-12T17:10:10.039+0000 7f1eb100c640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:10.039 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T17:10:10.035+0000 7f259a0a5640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T17:10:10.051 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T17:10:10.047+0000 7f0d27435640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T17:10:10.064 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-12T17:10:10.063+0000 7f2591ed7640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:10.080 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-12T17:10:10.079+0000 7f0d1ea55640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:15.866 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:16.173 INFO:teuthology.misc.health.smithi119.stdout: 2024-09-12T17:10:16.173 INFO:teuthology.misc.health.smithi119.stdout:{"epoch":18,"fsid":"4b851e18-22ea-4fa8-b208-1609edc12f85","created":"2024-09-12T17:09:57.574459+0000","modified":"2024-09-12T17:10:14.020094+0000","last_up_change":"2024-09-12T17:10:10.996031+0000","last_in_change":"2024-09-12T17:10:00.608474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:10:11.279972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d7e991a-0d17-4cfc-a5a9-b1305c2cab11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":1487028232},{"type":"v1","addr":"172.21.15.119:6820","nonce":1487028232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1487028232},{"type":"v1","addr":"172.21.15.119:6825","nonce":1487028232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1487028232},{"type":"v1","addr":"172.21.15.119:6831","nonce":1487028232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1487028232},{"type":"v1","addr":"172.21.15.119:6829","nonce":1487028232}]},"public_addr":"172.21.15.119:6820/1487028232","cluster_addr":"172.21.15.119:6825/1487028232","heartbeat_back_addr":"172.21.15.119:6831/1487028232","heartbeat_front_addr":"172.21.15.119:6829/1487028232","state":["exists","up"]},{"osd":1,"uuid":"b845ed74-bf2a-4cae-bdb2-2a769a71023e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":4034469375},{"type":"v1","addr":"172.21.15.119:6818","nonce":4034469375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":4034469375},{"type":"v1","addr":"172.21.15.119:6821","nonce":4034469375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4034469375},{"type":"v1","addr":"172.21.15.119:6827","nonce":4034469375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":4034469375},{"type":"v1","addr":"172.21.15.119:6824","nonce":4034469375}]},"public_addr":"172.21.15.119:6818/4034469375","cluster_addr":"172.21.15.119:6821/4034469375","heartbeat_back_addr":"172.21.15.119:6827/4034469375","heartbeat_front_addr":"172.21.15.119:6824/4034469375","state":["exists","up"]},{"osd":2,"uuid":"3a8139a6-3a4b-4eeb-8540-93575ad1e62d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":4281878132},{"type":"v1","addr":"172.21.15.119:6809","nonce":4281878132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":4281878132},{"type":"v1","addr":"172.21.15.119:6811","nonce":4281878132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":4281878132},{"type":"v1","addr":"172.21.15.119:6815","nonce":4281878132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":4281878132},{"type":"v1","addr":"172.21.15.119:6813","nonce":4281878132}]},"public_addr":"172.21.15.119:6809/4281878132","cluster_addr":"172.21.15.119:6811/4281878132","heartbeat_back_addr":"172.21.15.119:6815/4281878132","heartbeat_front_addr":"172.21.15.119:6813/4281878132","state":["exists","up"]},{"osd":3,"uuid":"3729a87d-2150-4127-a405-1f4ee9689e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6801","nonce":1732749810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6803","nonce":1732749810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6807","nonce":1732749810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6805","nonce":1732749810}]},"public_addr":"172.21.15.119:6801/1732749810","cluster_addr":"172.21.15.119:6803/1732749810","heartbeat_back_addr":"172.21.15.119:6807/1732749810","heartbeat_front_addr":"172.21.15.119:6805/1732749810","state":["exists","up"]},{"osd":4,"uuid":"4cf374e8-5640-4636-bc01-e28318e18ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":923639088},{"type":"v1","addr":"172.21.15.194:6809","nonce":923639088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":923639088},{"type":"v1","addr":"172.21.15.194:6811","nonce":923639088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":923639088},{"type":"v1","addr":"172.21.15.194:6815","nonce":923639088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":923639088},{"type":"v1","addr":"172.21.15.194:6813","nonce":923639088}]},"public_addr":"172.21.15.194:6809/923639088","cluster_addr":"172.21.15.194:6811/923639088","heartbeat_back_addr":"172.21.15.194:6815/923639088","heartbeat_front_addr":"172.21.15.194:6813/923639088","state":["exists","up"]},{"osd":5,"uuid":"32b317b4-a8f6-48da-bab4-d5a1607da924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2881805626},{"type":"v1","addr":"172.21.15.194:6817","nonce":2881805626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2881805626},{"type":"v1","addr":"172.21.15.194:6819","nonce":2881805626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2881805626},{"type":"v1","addr":"172.21.15.194:6823","nonce":2881805626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2881805626},{"type":"v1","addr":"172.21.15.194:6821","nonce":2881805626}]},"public_addr":"172.21.15.194:6817/2881805626","cluster_addr":"172.21.15.194:6819/2881805626","heartbeat_back_addr":"172.21.15.194:6823/2881805626","heartbeat_front_addr":"172.21.15.194:6821/2881805626","state":["exists","up"]},{"osd":6,"uuid":"63603319-1a08-4920-a6b7-1e7b32d7873c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":504391855},{"type":"v1","addr":"172.21.15.194:6825","nonce":504391855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":504391855},{"type":"v1","addr":"172.21.15.194:6827","nonce":504391855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":504391855},{"type":"v1","addr":"172.21.15.194:6831","nonce":504391855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":504391855},{"type":"v1","addr":"172.21.15.194:6829","nonce":504391855}]},"public_addr":"172.21.15.194:6825/504391855","cluster_addr":"172.21.15.194:6827/504391855","heartbeat_back_addr":"172.21.15.194:6831/504391855","heartbeat_front_addr":"172.21.15.194:6829/504391855","state":["exists","up"]},{"osd":7,"uuid":"b652b158-a160-460f-98de-66821bf3621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":1379092354},{"type":"v1","addr":"172.21.15.194:6801","nonce":1379092354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":1379092354},{"type":"v1","addr":"172.21.15.194:6803","nonce":1379092354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":1379092354},{"type":"v1","addr":"172.21.15.194:6807","nonce":1379092354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1379092354},{"type":"v1","addr":"172.21.15.194:6805","nonce":1379092354}]},"public_addr":"172.21.15.194:6801/1379092354","cluster_addr":"172.21.15.194:6803/1379092354","heartbeat_back_addr":"172.21.15.194:6807/1379092354","heartbeat_front_addr":"172.21.15.194:6805/1379092354","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.880799+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.957343+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.566412+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.186445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.121241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.272185+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:08.037138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.386867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:16.191 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T17:10:16.191 INFO:tasks.ceph:Creating RBD pool 2024-09-12T17:10:16.191 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T17:10:17.052 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'rbd' created 2024-09-12T17:10:17.079 DEBUG:teuthology.orchestra.run.smithi119:> rbd --cluster ceph pool init rbd 2024-09-12T17:10:17.120 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:17.120 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:20.120 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T17:10:20.121 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T17:10:20.121 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T17:10:20.481 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:10:20.499 INFO:teuthology.orchestra.run.smithi119.stdout:[{"version":9,"timestamp":"2024-09-12T17:10:10.054711+0000","name":"","changes":[{"name":"osd.5/osd_mclock_max_capacity_iops_ssd","new_value":"5317.228285"}]}] 2024-09-12T17:10:20.499 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T17:10:20.499 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T17:10:20.500 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T17:10:20.500 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T17:10:20.853 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:10:20.871 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":6,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4256577502},{"type":"v1","addr":"172.21.15.194:6833","nonce":4256577502}]},"active_addr":"172.21.15.194:6833/4256577502","active_change":"2024-09-12T17:10:03.229978+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":3892471164}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":1083488443}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":3714204622}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":3595132182}]}]} 2024-09-12T17:10:20.875 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T17:10:20.876 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T17:10:20.876 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:21.175 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:10:21.175 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":22,"fsid":"4b851e18-22ea-4fa8-b208-1609edc12f85","created":"2024-09-12T17:09:57.574459+0000","modified":"2024-09-12T17:10:20.076657+0000","last_up_change":"2024-09-12T17:10:10.996031+0000","last_in_change":"2024-09-12T17:10:00.608474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:10:11.279972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:10:16.494714+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d7e991a-0d17-4cfc-a5a9-b1305c2cab11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":1487028232},{"type":"v1","addr":"172.21.15.119:6820","nonce":1487028232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1487028232},{"type":"v1","addr":"172.21.15.119:6825","nonce":1487028232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1487028232},{"type":"v1","addr":"172.21.15.119:6831","nonce":1487028232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1487028232},{"type":"v1","addr":"172.21.15.119:6829","nonce":1487028232}]},"public_addr":"172.21.15.119:6820/1487028232","cluster_addr":"172.21.15.119:6825/1487028232","heartbeat_back_addr":"172.21.15.119:6831/1487028232","heartbeat_front_addr":"172.21.15.119:6829/1487028232","state":["exists","up"]},{"osd":1,"uuid":"b845ed74-bf2a-4cae-bdb2-2a769a71023e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":4034469375},{"type":"v1","addr":"172.21.15.119:6818","nonce":4034469375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":4034469375},{"type":"v1","addr":"172.21.15.119:6821","nonce":4034469375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4034469375},{"type":"v1","addr":"172.21.15.119:6827","nonce":4034469375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":4034469375},{"type":"v1","addr":"172.21.15.119:6824","nonce":4034469375}]},"public_addr":"172.21.15.119:6818/4034469375","cluster_addr":"172.21.15.119:6821/4034469375","heartbeat_back_addr":"172.21.15.119:6827/4034469375","heartbeat_front_addr":"172.21.15.119:6824/4034469375","state":["exists","up"]},{"osd":2,"uuid":"3a8139a6-3a4b-4eeb-8540-93575ad1e62d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":4281878132},{"type":"v1","addr":"172.21.15.119:6809","nonce":4281878132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":4281878132},{"type":"v1","addr":"172.21.15.119:6811","nonce":4281878132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":4281878132},{"type":"v1","addr":"172.21.15.119:6815","nonce":4281878132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":4281878132},{"type":"v1","addr":"172.21.15.119:6813","nonce":4281878132}]},"public_addr":"172.21.15.119:6809/4281878132","cluster_addr":"172.21.15.119:6811/4281878132","heartbeat_back_addr":"172.21.15.119:6815/4281878132","heartbeat_front_addr":"172.21.15.119:6813/4281878132","state":["exists","up"]},{"osd":3,"uuid":"3729a87d-2150-4127-a405-1f4ee9689e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6801","nonce":1732749810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6803","nonce":1732749810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6807","nonce":1732749810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6805","nonce":1732749810}]},"public_addr":"172.21.15.119:6801/1732749810","cluster_addr":"172.21.15.119:6803/1732749810","heartbeat_back_addr":"172.21.15.119:6807/1732749810","heartbeat_front_addr":"172.21.15.119:6805/1732749810","state":["exists","up"]},{"osd":4,"uuid":"4cf374e8-5640-4636-bc01-e28318e18ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":923639088},{"type":"v1","addr":"172.21.15.194:6809","nonce":923639088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":923639088},{"type":"v1","addr":"172.21.15.194:6811","nonce":923639088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":923639088},{"type":"v1","addr":"172.21.15.194:6815","nonce":923639088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":923639088},{"type":"v1","addr":"172.21.15.194:6813","nonce":923639088}]},"public_addr":"172.21.15.194:6809/923639088","cluster_addr":"172.21.15.194:6811/923639088","heartbeat_back_addr":"172.21.15.194:6815/923639088","heartbeat_front_addr":"172.21.15.194:6813/923639088","state":["exists","up"]},{"osd":5,"uuid":"32b317b4-a8f6-48da-bab4-d5a1607da924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2881805626},{"type":"v1","addr":"172.21.15.194:6817","nonce":2881805626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2881805626},{"type":"v1","addr":"172.21.15.194:6819","nonce":2881805626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2881805626},{"type":"v1","addr":"172.21.15.194:6823","nonce":2881805626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2881805626},{"type":"v1","addr":"172.21.15.194:6821","nonce":2881805626}]},"public_addr":"172.21.15.194:6817/2881805626","cluster_addr":"172.21.15.194:6819/2881805626","heartbeat_back_addr":"172.21.15.194:6823/2881805626","heartbeat_front_addr":"172.21.15.194:6821/2881805626","state":["exists","up"]},{"osd":6,"uuid":"63603319-1a08-4920-a6b7-1e7b32d7873c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":504391855},{"type":"v1","addr":"172.21.15.194:6825","nonce":504391855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":504391855},{"type":"v1","addr":"172.21.15.194:6827","nonce":504391855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":504391855},{"type":"v1","addr":"172.21.15.194:6831","nonce":504391855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":504391855},{"type":"v1","addr":"172.21.15.194:6829","nonce":504391855}]},"public_addr":"172.21.15.194:6825/504391855","cluster_addr":"172.21.15.194:6827/504391855","heartbeat_back_addr":"172.21.15.194:6831/504391855","heartbeat_front_addr":"172.21.15.194:6829/504391855","state":["exists","up"]},{"osd":7,"uuid":"b652b158-a160-460f-98de-66821bf3621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":1379092354},{"type":"v1","addr":"172.21.15.194:6801","nonce":1379092354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":1379092354},{"type":"v1","addr":"172.21.15.194:6803","nonce":1379092354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":1379092354},{"type":"v1","addr":"172.21.15.194:6807","nonce":1379092354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1379092354},{"type":"v1","addr":"172.21.15.194:6805","nonce":1379092354}]},"public_addr":"172.21.15.194:6801/1379092354","cluster_addr":"172.21.15.194:6803/1379092354","heartbeat_back_addr":"172.21.15.194:6807/1379092354","heartbeat_front_addr":"172.21.15.194:6805/1379092354","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.880799+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.957343+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.566412+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.186445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.121241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.272185+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:08.037138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.386867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:21.194 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T17:10:21.194 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:21.481 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:10:21.482 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":22,"fsid":"4b851e18-22ea-4fa8-b208-1609edc12f85","created":"2024-09-12T17:09:57.574459+0000","modified":"2024-09-12T17:10:20.076657+0000","last_up_change":"2024-09-12T17:10:10.996031+0000","last_in_change":"2024-09-12T17:10:00.608474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:10:11.279972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:10:16.494714+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d7e991a-0d17-4cfc-a5a9-b1305c2cab11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":1487028232},{"type":"v1","addr":"172.21.15.119:6820","nonce":1487028232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1487028232},{"type":"v1","addr":"172.21.15.119:6825","nonce":1487028232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1487028232},{"type":"v1","addr":"172.21.15.119:6831","nonce":1487028232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1487028232},{"type":"v1","addr":"172.21.15.119:6829","nonce":1487028232}]},"public_addr":"172.21.15.119:6820/1487028232","cluster_addr":"172.21.15.119:6825/1487028232","heartbeat_back_addr":"172.21.15.119:6831/1487028232","heartbeat_front_addr":"172.21.15.119:6829/1487028232","state":["exists","up"]},{"osd":1,"uuid":"b845ed74-bf2a-4cae-bdb2-2a769a71023e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":4034469375},{"type":"v1","addr":"172.21.15.119:6818","nonce":4034469375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":4034469375},{"type":"v1","addr":"172.21.15.119:6821","nonce":4034469375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4034469375},{"type":"v1","addr":"172.21.15.119:6827","nonce":4034469375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":4034469375},{"type":"v1","addr":"172.21.15.119:6824","nonce":4034469375}]},"public_addr":"172.21.15.119:6818/4034469375","cluster_addr":"172.21.15.119:6821/4034469375","heartbeat_back_addr":"172.21.15.119:6827/4034469375","heartbeat_front_addr":"172.21.15.119:6824/4034469375","state":["exists","up"]},{"osd":2,"uuid":"3a8139a6-3a4b-4eeb-8540-93575ad1e62d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":4281878132},{"type":"v1","addr":"172.21.15.119:6809","nonce":4281878132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":4281878132},{"type":"v1","addr":"172.21.15.119:6811","nonce":4281878132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":4281878132},{"type":"v1","addr":"172.21.15.119:6815","nonce":4281878132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":4281878132},{"type":"v1","addr":"172.21.15.119:6813","nonce":4281878132}]},"public_addr":"172.21.15.119:6809/4281878132","cluster_addr":"172.21.15.119:6811/4281878132","heartbeat_back_addr":"172.21.15.119:6815/4281878132","heartbeat_front_addr":"172.21.15.119:6813/4281878132","state":["exists","up"]},{"osd":3,"uuid":"3729a87d-2150-4127-a405-1f4ee9689e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6801","nonce":1732749810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6803","nonce":1732749810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6807","nonce":1732749810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6805","nonce":1732749810}]},"public_addr":"172.21.15.119:6801/1732749810","cluster_addr":"172.21.15.119:6803/1732749810","heartbeat_back_addr":"172.21.15.119:6807/1732749810","heartbeat_front_addr":"172.21.15.119:6805/1732749810","state":["exists","up"]},{"osd":4,"uuid":"4cf374e8-5640-4636-bc01-e28318e18ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":923639088},{"type":"v1","addr":"172.21.15.194:6809","nonce":923639088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":923639088},{"type":"v1","addr":"172.21.15.194:6811","nonce":923639088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":923639088},{"type":"v1","addr":"172.21.15.194:6815","nonce":923639088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":923639088},{"type":"v1","addr":"172.21.15.194:6813","nonce":923639088}]},"public_addr":"172.21.15.194:6809/923639088","cluster_addr":"172.21.15.194:6811/923639088","heartbeat_back_addr":"172.21.15.194:6815/923639088","heartbeat_front_addr":"172.21.15.194:6813/923639088","state":["exists","up"]},{"osd":5,"uuid":"32b317b4-a8f6-48da-bab4-d5a1607da924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2881805626},{"type":"v1","addr":"172.21.15.194:6817","nonce":2881805626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2881805626},{"type":"v1","addr":"172.21.15.194:6819","nonce":2881805626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2881805626},{"type":"v1","addr":"172.21.15.194:6823","nonce":2881805626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2881805626},{"type":"v1","addr":"172.21.15.194:6821","nonce":2881805626}]},"public_addr":"172.21.15.194:6817/2881805626","cluster_addr":"172.21.15.194:6819/2881805626","heartbeat_back_addr":"172.21.15.194:6823/2881805626","heartbeat_front_addr":"172.21.15.194:6821/2881805626","state":["exists","up"]},{"osd":6,"uuid":"63603319-1a08-4920-a6b7-1e7b32d7873c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":504391855},{"type":"v1","addr":"172.21.15.194:6825","nonce":504391855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":504391855},{"type":"v1","addr":"172.21.15.194:6827","nonce":504391855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":504391855},{"type":"v1","addr":"172.21.15.194:6831","nonce":504391855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":504391855},{"type":"v1","addr":"172.21.15.194:6829","nonce":504391855}]},"public_addr":"172.21.15.194:6825/504391855","cluster_addr":"172.21.15.194:6827/504391855","heartbeat_back_addr":"172.21.15.194:6831/504391855","heartbeat_front_addr":"172.21.15.194:6829/504391855","state":["exists","up"]},{"osd":7,"uuid":"b652b158-a160-460f-98de-66821bf3621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":1379092354},{"type":"v1","addr":"172.21.15.194:6801","nonce":1379092354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":1379092354},{"type":"v1","addr":"172.21.15.194:6803","nonce":1379092354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":1379092354},{"type":"v1","addr":"172.21.15.194:6807","nonce":1379092354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1379092354},{"type":"v1","addr":"172.21.15.194:6805","nonce":1379092354}]},"public_addr":"172.21.15.194:6801/1379092354","cluster_addr":"172.21.15.194:6803/1379092354","heartbeat_back_addr":"172.21.15.194:6807/1379092354","heartbeat_front_addr":"172.21.15.194:6805/1379092354","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.880799+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.957343+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.566412+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.186445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.121241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.272185+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:08.037138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.386867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:21.499 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T17:10:21.499 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T17:10:21.500 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T17:10:21.500 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T17:10:21.501 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T17:10:21.501 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T17:10:21.501 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T17:10:21.502 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T17:10:21.753 INFO:teuthology.orchestra.run.smithi119.stdout:64424509445 2024-09-12T17:10:21.754 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:10:21.757 INFO:teuthology.orchestra.run.smithi119.stdout:55834574853 2024-09-12T17:10:21.757 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:10:21.762 INFO:teuthology.orchestra.run.smithi119.stdout:64424509446 2024-09-12T17:10:21.762 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:10:21.768 INFO:teuthology.orchestra.run.smithi119.stdout:64424509445 2024-09-12T17:10:21.769 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:10:21.773 INFO:teuthology.orchestra.run.smithi119.stdout:64424509445 2024-09-12T17:10:21.774 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:10:21.778 INFO:teuthology.orchestra.run.smithi119.stdout:64424509446 2024-09-12T17:10:21.779 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:10:21.780 INFO:teuthology.orchestra.run.smithi119.stdout:60129542150 2024-09-12T17:10:21.781 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:10:21.782 INFO:teuthology.orchestra.run.smithi119.stdout:64424509446 2024-09-12T17:10:21.784 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:10:22.270 INFO:teuthology.orchestra.run.smithi119.stdout:55834574852 2024-09-12T17:10:22.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-09-12T17:10:22.304 INFO:teuthology.orchestra.run.smithi119.stdout:64424509444 2024-09-12T17:10:22.308 INFO:teuthology.orchestra.run.smithi119.stdout:64424509443 2024-09-12T17:10:22.318 INFO:teuthology.orchestra.run.smithi119.stdout:64424509443 2024-09-12T17:10:22.320 INFO:teuthology.orchestra.run.smithi119.stdout:64424509444 2024-09-12T17:10:22.330 INFO:teuthology.orchestra.run.smithi119.stdout:64424509443 2024-09-12T17:10:22.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.0 2024-09-12T17:10:22.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.5 2024-09-12T17:10:22.343 INFO:teuthology.orchestra.run.smithi119.stdout:60129542149 2024-09-12T17:10:22.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.7 2024-09-12T17:10:22.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.6 2024-09-12T17:10:22.356 INFO:teuthology.orchestra.run.smithi119.stdout:64424509444 2024-09-12T17:10:22.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.2 2024-09-12T17:10:22.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.4 2024-09-12T17:10:22.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.1 2024-09-12T17:10:23.297 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:10:23.336 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:10:23.344 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:10:23.349 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:10:23.357 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:10:23.362 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:10:23.366 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:10:23.374 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:10:23.822 INFO:teuthology.orchestra.run.smithi119.stdout:55834574852 2024-09-12T17:10:23.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-09-12T17:10:23.864 INFO:teuthology.orchestra.run.smithi119.stdout:64424509444 2024-09-12T17:10:23.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.0 2024-09-12T17:10:23.898 INFO:teuthology.orchestra.run.smithi119.stdout:64424509443 2024-09-12T17:10:23.915 INFO:teuthology.orchestra.run.smithi119.stdout:60129542149 2024-09-12T17:10:23.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.7 2024-09-12T17:10:23.930 INFO:teuthology.orchestra.run.smithi119.stdout:64424509444 2024-09-12T17:10:23.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.4 2024-09-12T17:10:23.937 INFO:teuthology.orchestra.run.smithi119.stdout:64424509443 2024-09-12T17:10:23.939 INFO:teuthology.orchestra.run.smithi119.stdout:64424509444 2024-09-12T17:10:23.944 INFO:teuthology.orchestra.run.smithi119.stdout:64424509443 2024-09-12T17:10:23.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.1 2024-09-12T17:10:23.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.5 2024-09-12T17:10:23.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.6 2024-09-12T17:10:23.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.2 2024-09-12T17:10:24.850 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:10:24.891 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:10:24.917 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:10:24.935 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:10:24.956 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:10:24.960 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:10:24.963 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:10:24.970 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:10:25.330 INFO:teuthology.orchestra.run.smithi119.stdout:55834574854 2024-09-12T17:10:25.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2024-09-12T17:10:25.354 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:25.377 INFO:teuthology.orchestra.run.smithi119.stdout:64424509446 2024-09-12T17:10:25.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-09-12T17:10:25.395 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:25.453 INFO:teuthology.orchestra.run.smithi119.stdout:60129542150 2024-09-12T17:10:25.477 INFO:teuthology.orchestra.run.smithi119.stdout:64424509445 2024-09-12T17:10:25.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-09-12T17:10:25.478 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:25.491 INFO:teuthology.orchestra.run.smithi119.stdout:64424509445 2024-09-12T17:10:25.499 INFO:teuthology.orchestra.run.smithi119.stdout:64424509445 2024-09-12T17:10:25.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.7 2024-09-12T17:10:25.503 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:25.512 INFO:teuthology.orchestra.run.smithi119.stdout:64424509446 2024-09-12T17:10:25.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.2 2024-09-12T17:10:25.515 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:25.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.5 2024-09-12T17:10:25.521 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:25.526 INFO:teuthology.orchestra.run.smithi119.stdout:64424509446 2024-09-12T17:10:25.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2024-09-12T17:10:25.530 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:25.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-09-12T17:10:25.543 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:25.543 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:10:25.544 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:10:25.859 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:10:25.860 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T17:10:25.877 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T17:10:25.243977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223296,"kb_used_data":2884,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751424,"statfs":{"total":773094113280,"available":772865458176,"internally_reserved":0,"allocated":2953216,"data_stored":1775742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.186830"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.088329+0000","last_change":"2024-09-12T17:10:20.088329+0000","last_active":"2024-09-12T17:10:20.088329+0000","last_peered":"2024-09-12T17:10:20.088329+0000","last_clean":"2024-09-12T17:10:20.088329+0000","last_became_active":"2024-09-12T17:10:18.074669+0000","last_became_peered":"2024-09-12T17:10:18.074669+0000","last_unstale":"2024-09-12T17:10:20.088329+0000","last_undegraded":"2024-09-12T17:10:20.088329+0000","last_fullsized":"2024-09-12T17:10:20.088329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:20.175198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.100539+0000","last_change":"2024-09-12T17:10:20.100539+0000","last_active":"2024-09-12T17:10:20.100539+0000","last_peered":"2024-09-12T17:10:20.100539+0000","last_clean":"2024-09-12T17:10:20.100539+0000","last_became_active":"2024-09-12T17:10:18.073132+0000","last_became_peered":"2024-09-12T17:10:18.073132+0000","last_unstale":"2024-09-12T17:10:20.100539+0000","last_undegraded":"2024-09-12T17:10:20.100539+0000","last_fullsized":"2024-09-12T17:10:20.100539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:05.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001154721,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.397111+0000","last_change":"2024-09-12T17:10:20.397111+0000","last_active":"2024-09-12T17:10:20.397111+0000","last_peered":"2024-09-12T17:10:20.397111+0000","last_clean":"2024-09-12T17:10:20.397111+0000","last_became_active":"2024-09-12T17:10:18.208762+0000","last_became_peered":"2024-09-12T17:10:18.208762+0000","last_unstale":"2024-09-12T17:10:20.397111+0000","last_undegraded":"2024-09-12T17:10:20.397111+0000","last_fullsized":"2024-09-12T17:10:20.397111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:07.303527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091554,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.100416+0000","last_change":"2024-09-12T17:10:20.100416+0000","last_active":"2024-09-12T17:10:20.100416+0000","last_peered":"2024-09-12T17:10:20.100416+0000","last_clean":"2024-09-12T17:10:20.100416+0000","last_became_active":"2024-09-12T17:10:18.209658+0000","last_became_peered":"2024-09-12T17:10:18.209658+0000","last_unstale":"2024-09-12T17:10:20.100416+0000","last_undegraded":"2024-09-12T17:10:20.100416+0000","last_fullsized":"2024-09-12T17:10:20.100416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:28.458806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010531659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.097373+0000","last_change":"2024-09-12T17:10:20.095430+0000","last_active":"2024-09-12T17:10:20.097373+0000","last_peered":"2024-09-12T17:10:20.097373+0000","last_clean":"2024-09-12T17:10:20.097373+0000","last_became_active":"2024-09-12T17:10:18.072719+0000","last_became_peered":"2024-09-12T17:10:18.072719+0000","last_unstale":"2024-09-12T17:10:20.097373+0000","last_undegraded":"2024-09-12T17:10:20.097373+0000","last_fullsized":"2024-09-12T17:10:20.097373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:14.576392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022239349999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.089534+0000","last_change":"2024-09-12T17:10:20.089534+0000","last_active":"2024-09-12T17:10:20.089534+0000","last_peered":"2024-09-12T17:10:20.089534+0000","last_clean":"2024-09-12T17:10:20.089534+0000","last_became_active":"2024-09-12T17:10:18.210168+0000","last_became_peered":"2024-09-12T17:10:18.210168+0000","last_unstale":"2024-09-12T17:10:20.089534+0000","last_undegraded":"2024-09-12T17:10:20.089534+0000","last_fullsized":"2024-09-12T17:10:20.089534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:46.762850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001219171,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.396952+0000","last_change":"2024-09-12T17:10:20.396952+0000","last_active":"2024-09-12T17:10:20.396952+0000","last_peered":"2024-09-12T17:10:20.396952+0000","last_clean":"2024-09-12T17:10:20.396952+0000","last_became_active":"2024-09-12T17:10:18.073016+0000","last_became_peered":"2024-09-12T17:10:18.073016+0000","last_unstale":"2024-09-12T17:10:20.396952+0000","last_undegraded":"2024-09-12T17:10:20.396952+0000","last_fullsized":"2024-09-12T17:10:20.396952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:57.171583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098613699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.094438+0000","last_change":"2024-09-12T17:10:20.094438+0000","last_active":"2024-09-12T17:10:20.094438+0000","last_peered":"2024-09-12T17:10:20.094438+0000","last_clean":"2024-09-12T17:10:20.094438+0000","last_became_active":"2024-09-12T17:10:18.073547+0000","last_became_peered":"2024-09-12T17:10:18.073547+0000","last_unstale":"2024-09-12T17:10:20.094438+0000","last_undegraded":"2024-09-12T17:10:20.094438+0000","last_fullsized":"2024-09-12T17:10:20.094438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:46.358663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010552039999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.395885+0000","last_change":"2024-09-12T17:10:13.025471+0000","last_active":"2024-09-12T17:10:20.395885+0000","last_peered":"2024-09-12T17:10:20.395885+0000","last_clean":"2024-09-12T17:10:20.395885+0000","last_became_active":"2024-09-12T17:10:13.024652+0000","last_became_peered":"2024-09-12T17:10:13.024652+0000","last_unstale":"2024-09-12T17:10:20.395885+0000","last_undegraded":"2024-09-12T17:10:20.395885+0000","last_fullsized":"2024-09-12T17:10:20.395885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:11.999189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:11.999189+0000","last_clean_scrub_stamp":"2024-09-12T17:10:11.999189+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:01.776648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":665468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":75100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":75119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":665468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":69268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:10:25.878 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:10:26.165 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:10:26.166 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T17:10:26.182 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T17:10:25.243977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223296,"kb_used_data":2884,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751424,"statfs":{"total":773094113280,"available":772865458176,"internally_reserved":0,"allocated":2953216,"data_stored":1775742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.186830"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.088329+0000","last_change":"2024-09-12T17:10:20.088329+0000","last_active":"2024-09-12T17:10:20.088329+0000","last_peered":"2024-09-12T17:10:20.088329+0000","last_clean":"2024-09-12T17:10:20.088329+0000","last_became_active":"2024-09-12T17:10:18.074669+0000","last_became_peered":"2024-09-12T17:10:18.074669+0000","last_unstale":"2024-09-12T17:10:20.088329+0000","last_undegraded":"2024-09-12T17:10:20.088329+0000","last_fullsized":"2024-09-12T17:10:20.088329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:20.175198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.100539+0000","last_change":"2024-09-12T17:10:20.100539+0000","last_active":"2024-09-12T17:10:20.100539+0000","last_peered":"2024-09-12T17:10:20.100539+0000","last_clean":"2024-09-12T17:10:20.100539+0000","last_became_active":"2024-09-12T17:10:18.073132+0000","last_became_peered":"2024-09-12T17:10:18.073132+0000","last_unstale":"2024-09-12T17:10:20.100539+0000","last_undegraded":"2024-09-12T17:10:20.100539+0000","last_fullsized":"2024-09-12T17:10:20.100539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:05.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001154721,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.397111+0000","last_change":"2024-09-12T17:10:20.397111+0000","last_active":"2024-09-12T17:10:20.397111+0000","last_peered":"2024-09-12T17:10:20.397111+0000","last_clean":"2024-09-12T17:10:20.397111+0000","last_became_active":"2024-09-12T17:10:18.208762+0000","last_became_peered":"2024-09-12T17:10:18.208762+0000","last_unstale":"2024-09-12T17:10:20.397111+0000","last_undegraded":"2024-09-12T17:10:20.397111+0000","last_fullsized":"2024-09-12T17:10:20.397111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:07.303527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091554,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.100416+0000","last_change":"2024-09-12T17:10:20.100416+0000","last_active":"2024-09-12T17:10:20.100416+0000","last_peered":"2024-09-12T17:10:20.100416+0000","last_clean":"2024-09-12T17:10:20.100416+0000","last_became_active":"2024-09-12T17:10:18.209658+0000","last_became_peered":"2024-09-12T17:10:18.209658+0000","last_unstale":"2024-09-12T17:10:20.100416+0000","last_undegraded":"2024-09-12T17:10:20.100416+0000","last_fullsized":"2024-09-12T17:10:20.100416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:28.458806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010531659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.097373+0000","last_change":"2024-09-12T17:10:20.095430+0000","last_active":"2024-09-12T17:10:20.097373+0000","last_peered":"2024-09-12T17:10:20.097373+0000","last_clean":"2024-09-12T17:10:20.097373+0000","last_became_active":"2024-09-12T17:10:18.072719+0000","last_became_peered":"2024-09-12T17:10:18.072719+0000","last_unstale":"2024-09-12T17:10:20.097373+0000","last_undegraded":"2024-09-12T17:10:20.097373+0000","last_fullsized":"2024-09-12T17:10:20.097373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:14.576392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022239349999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.089534+0000","last_change":"2024-09-12T17:10:20.089534+0000","last_active":"2024-09-12T17:10:20.089534+0000","last_peered":"2024-09-12T17:10:20.089534+0000","last_clean":"2024-09-12T17:10:20.089534+0000","last_became_active":"2024-09-12T17:10:18.210168+0000","last_became_peered":"2024-09-12T17:10:18.210168+0000","last_unstale":"2024-09-12T17:10:20.089534+0000","last_undegraded":"2024-09-12T17:10:20.089534+0000","last_fullsized":"2024-09-12T17:10:20.089534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:46.762850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001219171,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.396952+0000","last_change":"2024-09-12T17:10:20.396952+0000","last_active":"2024-09-12T17:10:20.396952+0000","last_peered":"2024-09-12T17:10:20.396952+0000","last_clean":"2024-09-12T17:10:20.396952+0000","last_became_active":"2024-09-12T17:10:18.073016+0000","last_became_peered":"2024-09-12T17:10:18.073016+0000","last_unstale":"2024-09-12T17:10:20.396952+0000","last_undegraded":"2024-09-12T17:10:20.396952+0000","last_fullsized":"2024-09-12T17:10:20.396952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:57.171583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098613699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.094438+0000","last_change":"2024-09-12T17:10:20.094438+0000","last_active":"2024-09-12T17:10:20.094438+0000","last_peered":"2024-09-12T17:10:20.094438+0000","last_clean":"2024-09-12T17:10:20.094438+0000","last_became_active":"2024-09-12T17:10:18.073547+0000","last_became_peered":"2024-09-12T17:10:18.073547+0000","last_unstale":"2024-09-12T17:10:20.094438+0000","last_undegraded":"2024-09-12T17:10:20.094438+0000","last_fullsized":"2024-09-12T17:10:20.094438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:46.358663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010552039999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:10:20.395885+0000","last_change":"2024-09-12T17:10:13.025471+0000","last_active":"2024-09-12T17:10:20.395885+0000","last_peered":"2024-09-12T17:10:20.395885+0000","last_clean":"2024-09-12T17:10:20.395885+0000","last_became_active":"2024-09-12T17:10:13.024652+0000","last_became_peered":"2024-09-12T17:10:13.024652+0000","last_unstale":"2024-09-12T17:10:20.395885+0000","last_undegraded":"2024-09-12T17:10:20.395885+0000","last_fullsized":"2024-09-12T17:10:20.395885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:11.999189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:11.999189+0000","last_clean_scrub_stamp":"2024-09-12T17:10:11.999189+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:01.776648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":665468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":75100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":75119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":665468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":69268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:10:26.183 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:10:26.183 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T17:10:26.183 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T17:10:26.184 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T17:10:26.499 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:10:26.499 INFO:teuthology.orchestra.run.smithi119.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T17:10:26.516 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T17:10:26.517 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T17:10:26.529 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T17:10:26.562 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-12T17:10:26.562 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T17:10:26.562 INFO:tasks.rgw:Creating data pools 2024-09-12T17:10:26.562 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T17:10:26.562 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-12T17:10:27.275 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T17:10:29.325 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T17:10:29.358 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T17:10:30.327 INFO:teuthology.orchestra.run.smithi119.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T17:10:30.370 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T17:10:31.319 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T17:10:31.350 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T17:10:32.322 INFO:teuthology.orchestra.run.smithi119.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T17:10:32.357 DEBUG:tasks.rgw:Pools created 2024-09-12T17:10:32.357 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T17:10:32.357 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:10:32.357 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:10:32.357 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:10:32.406 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:32.406 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:34.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.417+0000 7f6ff1497640 0 -- 172.21.15.119:0/982642175 >> [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] conn(0x7f6ec40709f0 msgr2=0x7f6ec4072eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:10:34.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.421+0000 7f6ff39919c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:34.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.425+0000 7f6ff1497640 0 -- 172.21.15.119:0/1399615159 >> [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] conn(0x7f6eb8070ae0 msgr2=0x7f6eb8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:10:34.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.425+0000 7f6ff39919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:34.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.425+0000 7f6ff39919c0 20 realm 2024-09-12T17:10:34.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.425+0000 7f6ff39919c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:34.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.425+0000 7f6ff39919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:34.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.425+0000 7f6ff39919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:10:34.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.425+0000 7f6ff39919c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:34.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.425+0000 7f6ff39919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:34.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.425+0000 7f6ff39919c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:34.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.425+0000 7f6ff39919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:10:34.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.425+0000 7f6ff39919c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:34.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.429+0000 7f6ff39919c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:10:34.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.429+0000 7f6ff39919c0 20 searching for the correct realm 2024-09-12T17:10:34.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:10:34.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:10:34.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:10:34.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:10:34.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:10:34.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:10:34.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:34.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:34.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:34.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:10:34.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:10:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 20 zone default found 2024-09-12T17:10:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 4 Realm: () 2024-09-12T17:10:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:10:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:10:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:10:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 20 zonegroup default 2024-09-12T17:10:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.449+0000 7f6ff39919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:34.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:34.453+0000 7f6ff39919c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:36.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:36.389+0000 7f6ff39919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:36.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:36.389+0000 7f6ff39919c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:36.393+0000 7f6ff39919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:36.393+0000 7f6ff39919c0 20 started sync module instance, tier type = 2024-09-12T17:10:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:36.393+0000 7f6ff39919c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:10:38.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.433+0000 7f6ff39919c0 20 add_watcher() i=0 2024-09-12T17:10:38.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.433+0000 7f6ff39919c0 20 add_watcher() i=1 2024-09-12T17:10:38.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.433+0000 7f6ff39919c0 20 add_watcher() i=2 2024-09-12T17:10:38.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.433+0000 7f6ff39919c0 20 add_watcher() i=3 2024-09-12T17:10:38.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.433+0000 7f6ff39919c0 20 add_watcher() i=4 2024-09-12T17:10:38.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.433+0000 7f6ff39919c0 20 add_watcher() i=5 2024-09-12T17:10:38.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.433+0000 7f6ff39919c0 20 add_watcher() i=6 2024-09-12T17:10:38.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 add_watcher() i=7 2024-09-12T17:10:38.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:10:38.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T17:10:38.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T17:10:38.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T17:10:38.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T17:10:38.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T17:10:38.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T17:10:38.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T17:10:38.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T17:10:38.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T17:10:38.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T17:10:38.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T17:10:38.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T17:10:38.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.437+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T17:10:38.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T17:10:38.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T17:10:38.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T17:10:38.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T17:10:38.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T17:10:38.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T17:10:38.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T17:10:38.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T17:10:38.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T17:10:38.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T17:10:38.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T17:10:38.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T17:10:38.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T17:10:38.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.441+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T17:10:38.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T17:10:38.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T17:10:38.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T17:10:38.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T17:10:38.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T17:10:38.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T17:10:38.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T17:10:38.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T17:10:38.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T17:10:38.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T17:10:38.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T17:10:38.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T17:10:38.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T17:10:38.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.445+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T17:10:38.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T17:10:38.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T17:10:38.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T17:10:38.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T17:10:38.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T17:10:38.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T17:10:38.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T17:10:38.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T17:10:38.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T17:10:38.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T17:10:38.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T17:10:38.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T17:10:38.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T17:10:38.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.449+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T17:10:38.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T17:10:38.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T17:10:38.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T17:10:38.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T17:10:38.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T17:10:38.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T17:10:38.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T17:10:38.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T17:10:38.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T17:10:38.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T17:10:38.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T17:10:38.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T17:10:38.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T17:10:38.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.453+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T17:10:38.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T17:10:38.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T17:10:38.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T17:10:38.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T17:10:38.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T17:10:38.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T17:10:38.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T17:10:38.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T17:10:38.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T17:10:38.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T17:10:38.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T17:10:38.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T17:10:38.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T17:10:38.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.457+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T17:10:38.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T17:10:38.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T17:10:38.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T17:10:38.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T17:10:38.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T17:10:38.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T17:10:38.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T17:10:38.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T17:10:38.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T17:10:38.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T17:10:38.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T17:10:38.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.461+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T17:10:38.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T17:10:38.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T17:10:38.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T17:10:38.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T17:10:38.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T17:10:38.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T17:10:38.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T17:10:38.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T17:10:38.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T17:10:38.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T17:10:38.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T17:10:38.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T17:10:38.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T17:10:38.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T17:10:38.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T17:10:38.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T17:10:38.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T17:10:38.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.465+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T17:10:38.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T17:10:38.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T17:10:38.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T17:10:38.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T17:10:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T17:10:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T17:10:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T17:10:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T17:10:38.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T17:10:38.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T17:10:38.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T17:10:38.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T17:10:38.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T17:10:38.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T17:10:38.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T17:10:38.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.469+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T17:10:38.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T17:10:38.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T17:10:38.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T17:10:38.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T17:10:38.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T17:10:38.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T17:10:38.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T17:10:38.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T17:10:38.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T17:10:38.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T17:10:38.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T17:10:38.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T17:10:38.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T17:10:38.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.473+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T17:10:38.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T17:10:38.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T17:10:38.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T17:10:38.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T17:10:38.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T17:10:38.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T17:10:38.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T17:10:38.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T17:10:38.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T17:10:38.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T17:10:38.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T17:10:38.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T17:10:38.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T17:10:38.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.477+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T17:10:38.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T17:10:38.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T17:10:38.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T17:10:38.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T17:10:38.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T17:10:38.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T17:10:38.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T17:10:38.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T17:10:38.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T17:10:38.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T17:10:38.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T17:10:38.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T17:10:38.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T17:10:38.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.481+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T17:10:38.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T17:10:38.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T17:10:38.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T17:10:38.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T17:10:38.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T17:10:38.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T17:10:38.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T17:10:38.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T17:10:38.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T17:10:38.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T17:10:38.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T17:10:38.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.485+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.489+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T17:10:38.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.489+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T17:10:38.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.489+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.489+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T17:10:38.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.489+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T17:10:38.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.489+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.489+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T17:10:38.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.489+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T17:10:38.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.489+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.489+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T17:10:38.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.489+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T17:10:38.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.489+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.489+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T17:10:38.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.489+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T17:10:38.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.489+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T17:10:38.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T17:10:38.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T17:10:38.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T17:10:38.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T17:10:38.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T17:10:38.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T17:10:38.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T17:10:38.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T17:10:38.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T17:10:38.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T17:10:38.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T17:10:38.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.493+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T17:10:38.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T17:10:38.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T17:10:38.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T17:10:38.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T17:10:38.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T17:10:38.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T17:10:38.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T17:10:38.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T17:10:38.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T17:10:38.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T17:10:38.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T17:10:38.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T17:10:38.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T17:10:38.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.497+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T17:10:38.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T17:10:38.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T17:10:38.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T17:10:38.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T17:10:38.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T17:10:38.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T17:10:38.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T17:10:38.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T17:10:38.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T17:10:38.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T17:10:38.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T17:10:38.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.501+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T17:10:38.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T17:10:38.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T17:10:38.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T17:10:38.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T17:10:38.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T17:10:38.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T17:10:38.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T17:10:38.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T17:10:38.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T17:10:38.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T17:10:38.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T17:10:38.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T17:10:38.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T17:10:38.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.505+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T17:10:38.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T17:10:38.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T17:10:38.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T17:10:38.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T17:10:38.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T17:10:38.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T17:10:38.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T17:10:38.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T17:10:38.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T17:10:38.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T17:10:38.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T17:10:38.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.509+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.513+0000 7f6ff39919c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T17:10:38.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.513+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T17:10:38.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.517+0000 7f6ff39919c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:38.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.525+0000 7f6ea37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:10:38.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.525+0000 7f6ff39919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:10:38.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:38.525+0000 7f6ff39919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:10:41.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.409+0000 7f6ff39919c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T17:10:41.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.409+0000 7f6ff39919c0 5 note: GC not initialized 2024-09-12T17:10:41.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.501+0000 7f6ea27e4640 20 reqs_thread_entry: start 2024-09-12T17:10:41.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.501+0000 7f6ff39919c0 20 init_complete bucket index max shards: 11 2024-09-12T17:10:41.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.501+0000 7f6ff39919c0 20 Filter name: none 2024-09-12T17:10:41.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.501+0000 7f6e03fff640 20 reqs_thread_entry: start 2024-09-12T17:10:41.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.549+0000 7f6ea37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:10:41.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.553+0000 7f6ff39919c0 20 remove_watcher() i=0 2024-09-12T17:10:41.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.553+0000 7f6ff39919c0 2 removed watcher, disabling cache 2024-09-12T17:10:41.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.553+0000 7f6ff39919c0 20 remove_watcher() i=1 2024-09-12T17:10:41.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.557+0000 7f6ff39919c0 20 remove_watcher() i=2 2024-09-12T17:10:41.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.565+0000 7f6ff39919c0 20 remove_watcher() i=3 2024-09-12T17:10:41.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.565+0000 7f6ff39919c0 20 remove_watcher() i=4 2024-09-12T17:10:41.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.569+0000 7f6ff39919c0 20 remove_watcher() i=5 2024-09-12T17:10:41.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.569+0000 7f6ff39919c0 20 remove_watcher() i=6 2024-09-12T17:10:41.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.573+0000 7f6ff39919c0 20 remove_watcher() i=7 2024-09-12T17:10:41.594 INFO:teuthology.orchestra.run.smithi119.stdout:[] 2024-09-12T17:10:41.595 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:10:41.595 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:10:41.595 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:10:41.595 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T17:10:41.679 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:41.679 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:41.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.705+0000 7fd5164d39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:10:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.705+0000 7fd5164d39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:10:41.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.709+0000 7fd359ffb640 20 reqs_thread_entry: start 2024-09-12T17:10:41.737 INFO:teuthology.orchestra.run.smithi119.stdout:{"id":"4832a6ae-eda0-431a-85d5-6b1af8837fa3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:10:41.737 DEBUG:tasks.util.rgw: json result: {'id': '4832a6ae-eda0-431a-85d5-6b1af8837fa3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:10:41.737 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:10:41.737 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:10:41.738 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:10:41.814 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:41.814 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:41.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.853+0000 7f031d1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:41.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.853+0000 7f031d1389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:41.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.853+0000 7f031d1389c0 20 realm 2024-09-12T17:10:41.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.853+0000 7f031d1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:41.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.853+0000 7f031d1389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:41.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.853+0000 7f031d1389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:10:41.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.853+0000 7f031d1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:41.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.853+0000 7f031d1389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:41.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.853+0000 7f031d1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:41.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.857+0000 7f031d1389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:10:41.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.857+0000 7f031d1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:41.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.857+0000 7f031d1389c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:10:41.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.857+0000 7f031d1389c0 20 searching for the correct realm 2024-09-12T17:10:41.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:41.861+0000 7f031b43f640 0 -- 172.21.15.119:0/3247836634 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f03100e9020 msgr2=0x7f03100c4a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:10:42.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.077+0000 7f031a43d640 0 -- 172.21.15.119:0/3247836634 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f030c020050 msgr2=0x7f030c044410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:10:42.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.293+0000 7f031d1389c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:10:42.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.293+0000 7f031d1389c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:10:42.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.293+0000 7f031d1389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:10:42.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.293+0000 7f031d1389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:10:42.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.293+0000 7f031d1389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:10:42.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.293+0000 7f031d1389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:10:42.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.293+0000 7f031d1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.293+0000 7f031d1389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:42.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.293+0000 7f031d1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.293+0000 7f031d1389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:10:42.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.293+0000 7f031d1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.297+0000 7f031d1389c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:10:42.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.297+0000 7f031d1389c0 20 zone default found 2024-09-12T17:10:42.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.297+0000 7f031d1389c0 4 Realm: () 2024-09-12T17:10:42.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.297+0000 7f031d1389c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:10:42.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.297+0000 7f031d1389c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:10:42.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.297+0000 7f031d1389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:10:42.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.297+0000 7f031d1389c0 20 zonegroup default 2024-09-12T17:10:42.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.297+0000 7f031d1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.297+0000 7f031d1389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:42.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.297+0000 7f031d1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.297+0000 7f031d1389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:42.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.297+0000 7f031d1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.297+0000 7f031d1389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:42.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.297+0000 7f031d1389c0 20 started sync module instance, tier type = 2024-09-12T17:10:42.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.297+0000 7f031d1389c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:10:42.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.321+0000 7f031d1389c0 20 add_watcher() i=0 2024-09-12T17:10:42.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.321+0000 7f031d1389c0 20 add_watcher() i=1 2024-09-12T17:10:42.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.321+0000 7f031d1389c0 20 add_watcher() i=2 2024-09-12T17:10:42.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.321+0000 7f031d1389c0 20 add_watcher() i=3 2024-09-12T17:10:42.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.321+0000 7f031d1389c0 20 add_watcher() i=4 2024-09-12T17:10:42.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.321+0000 7f031d1389c0 20 add_watcher() i=5 2024-09-12T17:10:42.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.321+0000 7f031d1389c0 20 add_watcher() i=6 2024-09-12T17:10:42.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.325+0000 7f031d1389c0 20 add_watcher() i=7 2024-09-12T17:10:42.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.325+0000 7f031d1389c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:10:42.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.329+0000 7f01d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:10:42.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.329+0000 7f031d1389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:10:42.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.329+0000 7f031d1389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:10:42.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.329+0000 7f031d1389c0 5 note: GC not initialized 2024-09-12T17:10:42.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.329+0000 7f014bfff640 20 reqs_thread_entry: start 2024-09-12T17:10:42.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.333+0000 7f031d1389c0 20 init_complete bucket index max shards: 11 2024-09-12T17:10:42.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.333+0000 7f031d1389c0 20 Filter name: none 2024-09-12T17:10:42.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.333+0000 7f0149ffb640 20 reqs_thread_entry: start 2024-09-12T17:10:42.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.349+0000 7f01d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:10:42.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.357+0000 7f031d1389c0 20 remove_watcher() i=0 2024-09-12T17:10:42.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.357+0000 7f031d1389c0 2 removed watcher, disabling cache 2024-09-12T17:10:42.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.357+0000 7f031d1389c0 20 remove_watcher() i=1 2024-09-12T17:10:42.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.361+0000 7f031d1389c0 20 remove_watcher() i=2 2024-09-12T17:10:42.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.361+0000 7f031d1389c0 20 remove_watcher() i=3 2024-09-12T17:10:42.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.365+0000 7f031d1389c0 20 remove_watcher() i=4 2024-09-12T17:10:42.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.365+0000 7f031d1389c0 20 remove_watcher() i=5 2024-09-12T17:10:42.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.369+0000 7f031d1389c0 20 remove_watcher() i=6 2024-09-12T17:10:42.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.369+0000 7f031d1389c0 20 remove_watcher() i=7 2024-09-12T17:10:42.388 INFO:teuthology.orchestra.run.smithi119.stdout:[] 2024-09-12T17:10:42.388 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:10:42.389 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T17:10:42.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T17:10:42.389 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T17:10:42.474 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:42.474 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:42.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.501+0000 7f20f07ac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:10:42.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.501+0000 7f20f07ac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:10:42.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.505+0000 7f1fb0fe1640 20 reqs_thread_entry: start 2024-09-12T17:10:42.530 INFO:teuthology.orchestra.run.smithi119.stdout:{"id":"4832a6ae-eda0-431a-85d5-6b1af8837fa3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:10:42.530 DEBUG:tasks.util.rgw: json result: {'id': '4832a6ae-eda0-431a-85d5-6b1af8837fa3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:10:42.530 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-12T17:10:42.531 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p /tmp/rgw_datacache 2024-09-12T17:10:42.580 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-12T17:10:42.634 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:10:42.634 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:10:42.635 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:10:42.710 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:42.710 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:42.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.749+0000 7f060f2049c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.753+0000 7f060f2049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:42.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.753+0000 7f060f2049c0 20 realm 2024-09-12T17:10:42.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.753+0000 7f060f2049c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.753+0000 7f060f2049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:42.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.753+0000 7f060f2049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:10:42.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.753+0000 7f060f2049c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.753+0000 7f060f2049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:42.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.753+0000 7f060f2049c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.753+0000 7f060f2049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:10:42.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.753+0000 7f060f2049c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.757+0000 7f060f2049c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:10:42.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.757+0000 7f060f2049c0 20 searching for the correct realm 2024-09-12T17:10:42.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.761+0000 7f060c509640 0 -- 172.21.15.119:0/4169825336 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f05fc0f6e30 msgr2=0x7f05fc117a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:10:42.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.765+0000 7f060c509640 0 -- 172.21.15.119:0/4169825336 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f0604078a10 msgr2=0x7f06040980b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:10:42.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.981+0000 7f060f2049c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:10:42.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.981+0000 7f060f2049c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:10:42.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.981+0000 7f060f2049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:10:42.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.981+0000 7f060f2049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:10:42.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.981+0000 7f060f2049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:10:42.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.981+0000 7f060f2049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:10:42.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.981+0000 7f060f2049c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.981+0000 7f060f2049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:42.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.981+0000 7f060f2049c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.985+0000 7f060f2049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:10:42.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.985+0000 7f060f2049c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.985+0000 7f060f2049c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:10:42.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.985+0000 7f060f2049c0 20 zone default found 2024-09-12T17:10:42.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.985+0000 7f060f2049c0 4 Realm: () 2024-09-12T17:10:42.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.985+0000 7f060f2049c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:10:42.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.985+0000 7f060f2049c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:10:42.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.985+0000 7f060f2049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:10:42.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.985+0000 7f060f2049c0 20 zonegroup default 2024-09-12T17:10:42.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.985+0000 7f060f2049c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.985+0000 7f060f2049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:42.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.985+0000 7f060f2049c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.985+0000 7f060f2049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:42.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.985+0000 7f060f2049c0 20 rados->read ofs=0 len=0 2024-09-12T17:10:42.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.989+0000 7f060f2049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:42.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.989+0000 7f060f2049c0 20 started sync module instance, tier type = 2024-09-12T17:10:42.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:42.989+0000 7f060f2049c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:10:43.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.013+0000 7f060f2049c0 20 add_watcher() i=0 2024-09-12T17:10:43.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.013+0000 7f060f2049c0 20 add_watcher() i=1 2024-09-12T17:10:43.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.013+0000 7f060f2049c0 20 add_watcher() i=2 2024-09-12T17:10:43.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.013+0000 7f060f2049c0 20 add_watcher() i=3 2024-09-12T17:10:43.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.013+0000 7f060f2049c0 20 add_watcher() i=4 2024-09-12T17:10:43.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.013+0000 7f060f2049c0 20 add_watcher() i=5 2024-09-12T17:10:43.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.013+0000 7f060f2049c0 20 add_watcher() i=6 2024-09-12T17:10:43.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.017+0000 7f060f2049c0 20 add_watcher() i=7 2024-09-12T17:10:43.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.017+0000 7f060f2049c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:10:43.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.021+0000 7f04c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:10:43.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.021+0000 7f060f2049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:10:43.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.021+0000 7f060f2049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:10:43.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.021+0000 7f060f2049c0 5 note: GC not initialized 2024-09-12T17:10:43.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.021+0000 7f04c1fe3640 20 reqs_thread_entry: start 2024-09-12T17:10:43.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.021+0000 7f060f2049c0 20 init_complete bucket index max shards: 11 2024-09-12T17:10:43.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.021+0000 7f060f2049c0 20 Filter name: none 2024-09-12T17:10:43.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.021+0000 7f04337fe640 20 reqs_thread_entry: start 2024-09-12T17:10:43.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.041+0000 7f04c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:10:43.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.045+0000 7f060f2049c0 20 remove_watcher() i=0 2024-09-12T17:10:43.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.045+0000 7f060f2049c0 2 removed watcher, disabling cache 2024-09-12T17:10:43.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.049+0000 7f060f2049c0 20 remove_watcher() i=1 2024-09-12T17:10:43.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.049+0000 7f060f2049c0 20 remove_watcher() i=2 2024-09-12T17:10:43.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.053+0000 7f060f2049c0 20 remove_watcher() i=3 2024-09-12T17:10:43.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.053+0000 7f060f2049c0 20 remove_watcher() i=4 2024-09-12T17:10:43.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.057+0000 7f060f2049c0 20 remove_watcher() i=5 2024-09-12T17:10:43.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.057+0000 7f060f2049c0 20 remove_watcher() i=6 2024-09-12T17:10:43.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.057+0000 7f060f2049c0 20 remove_watcher() i=7 2024-09-12T17:10:43.076 INFO:teuthology.orchestra.run.smithi119.stdout:[] 2024-09-12T17:10:43.077 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:10:43.077 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T17:10:43.077 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:10:43.077 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:10:43.077 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T17:10:43.161 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:43.162 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:43.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.185+0000 7ff0592019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:10:43.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.185+0000 7ff0592019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:10:43.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.189+0000 7fef197e2640 20 reqs_thread_entry: start 2024-09-12T17:10:43.214 INFO:teuthology.orchestra.run.smithi119.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T17:10:43.214 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T17:10:43.214 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:10:43.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:10:43.214 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T17:10:43.297 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:43.298 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:43.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.321+0000 7fc88b7499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:10:43.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.321+0000 7fc88b7499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:10:43.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.325+0000 7fc6c77fe640 20 reqs_thread_entry: start 2024-09-12T17:10:43.351 INFO:teuthology.orchestra.run.smithi119.stdout:{"id":"4832a6ae-eda0-431a-85d5-6b1af8837fa3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:10:43.351 DEBUG:tasks.util.rgw: json result: {'id': '4832a6ae-eda0-431a-85d5-6b1af8837fa3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:10:43.351 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T17:10:43.352 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:10:43.352 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:10:43.352 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T17:10:43.435 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:43.435 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:43.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.461+0000 7f97332f99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:10:43.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.461+0000 7f97332f99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:10:43.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.465+0000 7f95eeffd640 20 reqs_thread_entry: start 2024-09-12T17:10:43.487 INFO:teuthology.orchestra.run.smithi119.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T17:10:43.488 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T17:10:43.488 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:10:43.488 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:10:43.488 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T17:10:43.568 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:43.569 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:43.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.593+0000 7fe29a4c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:10:43.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.593+0000 7fe29a4c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:10:43.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:10:43.597+0000 7fe0f5ffb640 20 reqs_thread_entry: start 2024-09-12T17:10:43.624 INFO:teuthology.orchestra.run.smithi119.stdout:{"id":"4832a6ae-eda0-431a-85d5-6b1af8837fa3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:10:43.625 DEBUG:tasks.util.rgw: json result: {'id': '4832a6ae-eda0-431a-85d5-6b1af8837fa3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:10:43.625 INFO:tasks.rgw:Starting rgw... 2024-09-12T17:10:43.625 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-12T17:10:43.625 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T17:10:43.625 DEBUG:teuthology.orchestra.run.smithi119:> sudo echo -n http://smithi119.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T17:10:43.678 INFO:teuthology.orchestra.run.smithi119.stdout:http://smithi119.front.sepia.ceph.com:80 2024-09-12T17:10:43.678 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T17:10:43.730 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-12T17:10:43.731 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T17:10:43.731 DEBUG:teuthology.orchestra.run.smithi119:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T17:10:43.773 INFO:tasks.rgw.client.0:Started 2024-09-12T17:10:43.774 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi119.front.sepia.ceph.com:80/ 2024-09-12T17:10:43.774 DEBUG:teuthology.orchestra.run.smithi119:> curl http://smithi119.front.sepia.ceph.com:80/ 2024-09-12T17:10:43.901 INFO:teuthology.orchestra.run.smithi119.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:10:43.901 INFO:teuthology.orchestra.run.smithi119.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:10:43.905 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:10:43.905 INFO:teuthology.orchestra.run.smithi119.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:10:43.905 INFO:teuthology.orchestra.run.smithi119.stderr:curl: (7) Failed to connect to smithi119.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:10:44.906 DEBUG:teuthology.orchestra.run.smithi119:> curl http://smithi119.front.sepia.ceph.com:80/ 2024-09-12T17:10:44.917 INFO:teuthology.orchestra.run.smithi119.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:10:44.917 INFO:teuthology.orchestra.run.smithi119.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:10:44.917 INFO:teuthology.orchestra.run.smithi119.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:10:44.917 INFO:teuthology.orchestra.run.smithi119.stderr:curl: (7) Failed to connect to smithi119.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:10:44.917 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:10:46.918 DEBUG:teuthology.orchestra.run.smithi119:> curl http://smithi119.front.sepia.ceph.com:80/ 2024-09-12T17:10:46.929 INFO:teuthology.orchestra.run.smithi119.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:10:46.929 INFO:teuthology.orchestra.run.smithi119.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:10:46.929 INFO:teuthology.orchestra.run.smithi119.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:10:46.929 INFO:teuthology.orchestra.run.smithi119.stderr:curl: (7) Failed to connect to smithi119.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:10:46.930 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:10:50.931 DEBUG:teuthology.orchestra.run.smithi119:> curl http://smithi119.front.sepia.ceph.com:80/ 2024-09-12T17:10:50.943 INFO:teuthology.orchestra.run.smithi119.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:10:50.943 INFO:teuthology.orchestra.run.smithi119.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:10:50.945 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:10:50.945 INFO:teuthology.orchestra.run.smithi119.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:10:50.945 INFO:teuthology.orchestra.run.smithi119.stderr:curl: (7) Failed to connect to smithi119.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:10:58.947 DEBUG:teuthology.orchestra.run.smithi119:> curl http://smithi119.front.sepia.ceph.com:80/ 2024-09-12T17:10:58.957 INFO:teuthology.orchestra.run.smithi119.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:10:58.957 INFO:teuthology.orchestra.run.smithi119.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:10:58.959 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:10:58.959 INFO:teuthology.orchestra.run.smithi119.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:10:58.959 INFO:teuthology.orchestra.run.smithi119.stderr:curl: (7) Failed to connect to smithi119.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:11:14.960 DEBUG:teuthology.orchestra.run.smithi119:> curl http://smithi119.front.sepia.ceph.com:80/ 2024-09-12T17:11:14.972 INFO:teuthology.orchestra.run.smithi119.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:11:14.972 INFO:teuthology.orchestra.run.smithi119.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:11:15.403 INFO:teuthology.orchestra.run.smithi119.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 433 0 --:--:-- --:--:-- --:--:-- 434 2024-09-12T17:11:15.404 INFO:teuthology.orchestra.run.smithi119.stdout:anonymous 2024-09-12T17:11:15.405 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T17:11:15.417 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T17:11:15.417 DEBUG:teuthology.orchestra.run.smithi119:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T17:11:18.475 DEBUG:teuthology.orchestra.run.smithi119:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T17:11:19.111 INFO:teuthology.orchestra.run.smithi119.stdout:Collecting tox==3.15.0 2024-09-12T17:11:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T17:11:19.284 INFO:teuthology.orchestra.run.smithi119.stdout: ---------------------------------------- 82.1/82.1 KB 1.0 MB/s eta 0:00:00 2024-09-12T17:11:19.449 INFO:teuthology.orchestra.run.smithi119.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T17:11:19.464 INFO:teuthology.orchestra.run.smithi119.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T17:11:19.567 INFO:teuthology.orchestra.run.smithi119.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T17:11:19.583 INFO:teuthology.orchestra.run.smithi119.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T17:11:19.684 INFO:teuthology.orchestra.run.smithi119.stdout:Collecting six<2,>=1.14.0 2024-09-12T17:11:19.700 INFO:teuthology.orchestra.run.smithi119.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:11:19.834 INFO:teuthology.orchestra.run.smithi119.stdout:Collecting packaging>=14 2024-09-12T17:11:19.849 INFO:teuthology.orchestra.run.smithi119.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T17:11:19.888 INFO:teuthology.orchestra.run.smithi119.stdout: ---------------------------------------- 54.0/54.0 KB 1.3 MB/s eta 0:00:00 2024-09-12T17:11:19.958 INFO:teuthology.orchestra.run.smithi119.stdout:Collecting toml>=0.9.4 2024-09-12T17:11:19.976 INFO:teuthology.orchestra.run.smithi119.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T17:11:20.100 INFO:teuthology.orchestra.run.smithi119.stdout:Collecting py<2,>=1.4.17 2024-09-12T17:11:20.116 INFO:teuthology.orchestra.run.smithi119.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T17:11:20.165 INFO:teuthology.orchestra.run.smithi119.stdout: ---------------------------------------- 98.7/98.7 KB 2.0 MB/s eta 0:00:00 2024-09-12T17:11:20.442 INFO:teuthology.orchestra.run.smithi119.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T17:11:20.456 INFO:teuthology.orchestra.run.smithi119.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T17:11:20.968 INFO:teuthology.orchestra.run.smithi119.stdout: ---------------------------------------- 6.0/6.0 MB 11.8 MB/s eta 0:00:00 2024-09-12T17:11:21.163 INFO:teuthology.orchestra.run.smithi119.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T17:11:21.178 INFO:teuthology.orchestra.run.smithi119.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T17:11:21.288 INFO:teuthology.orchestra.run.smithi119.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T17:11:21.305 INFO:teuthology.orchestra.run.smithi119.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T17:11:21.350 INFO:teuthology.orchestra.run.smithi119.stdout: -------------------------------------- 468.9/468.9 KB 11.2 MB/s eta 0:00:00 2024-09-12T17:11:21.506 INFO:teuthology.orchestra.run.smithi119.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-12T17:11:22.575 INFO:teuthology.orchestra.run.smithi119.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T17:11:22.656 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:11:22.670 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:11:22.671 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:11:22.671 DEBUG:teuthology.orchestra.run.smithi119:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:11:22.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:11:22.677 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:11:22.678 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:11:22.724 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:11:22.724 DEBUG:teuthology.orchestra.run.smithi119:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:11:22.776 INFO:tasks.workunit:timeout=3h 2024-09-12T17:11:22.776 INFO:tasks.workunit:cleanup=True 2024-09-12T17:11:22.777 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:11:22.827 INFO:tasks.workunit.client.0.smithi119.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:12:20.688 INFO:tasks.workunit.client.0.smithi119.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:12:20.689 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:12:20.689 INFO:tasks.workunit.client.0.smithi119.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:12:20.689 INFO:tasks.workunit.client.0.smithi119.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:12:20.689 INFO:tasks.workunit.client.0.smithi119.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:12:20.689 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:12:20.689 INFO:tasks.workunit.client.0.smithi119.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:12:20.689 INFO:tasks.workunit.client.0.smithi119.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:12:20.689 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:12:20.689 INFO:tasks.workunit.client.0.smithi119.stderr: git switch -c 2024-09-12T17:12:20.690 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:12:20.690 INFO:tasks.workunit.client.0.smithi119.stderr:Or undo this operation with: 2024-09-12T17:12:20.690 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:12:20.690 INFO:tasks.workunit.client.0.smithi119.stderr: git switch - 2024-09-12T17:12:20.690 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:12:20.690 INFO:tasks.workunit.client.0.smithi119.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:12:20.690 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:12:20.690 INFO:tasks.workunit.client.0.smithi119.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:12:20.695 DEBUG:teuthology.orchestra.run.smithi119:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:12:20.742 INFO:tasks.workunit.client.0.smithi119.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:12:20.745 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:12:20.745 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:12:21.550 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:12:21.638 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:12:21.688 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:12:21.691 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:12:21.691 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:12:21.740 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:12:21.744 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:12:21.744 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:12:21.789 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-12T17:12:21.790 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-12T17:12:21.791 DEBUG:teuthology.orchestra.run.smithi119:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T17:12:21.841 INFO:tasks.workunit.client.0.smithi119.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T17:12:21.842 INFO:tasks.workunit.client.0.smithi119.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:12:21.842 INFO:tasks.workunit.client.0.smithi119.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:12:24.685 INFO:tasks.workunit.client.0.smithi119.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:12:24.685 INFO:tasks.workunit.client.0.smithi119.stderr:++ deactivate nondestructive 2024-09-12T17:12:24.685 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n '' ']' 2024-09-12T17:12:24.685 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n '' ']' 2024-09-12T17:12:24.685 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:12:24.685 INFO:tasks.workunit.client.0.smithi119.stderr:++ hash -r 2024-09-12T17:12:24.685 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n '' ']' 2024-09-12T17:12:24.685 INFO:tasks.workunit.client.0.smithi119.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:12:24.686 INFO:tasks.workunit.client.0.smithi119.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:12:24.686 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:12:24.686 INFO:tasks.workunit.client.0.smithi119.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:12:24.687 INFO:tasks.workunit.client.0.smithi119.stderr:++ export VIRTUAL_ENV 2024-09-12T17:12:24.687 INFO:tasks.workunit.client.0.smithi119.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:12:24.687 INFO:tasks.workunit.client.0.smithi119.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:12:24.688 INFO:tasks.workunit.client.0.smithi119.stderr:++ export PATH 2024-09-12T17:12:24.688 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n '' ']' 2024-09-12T17:12:24.688 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -z '' ']' 2024-09-12T17:12:24.688 INFO:tasks.workunit.client.0.smithi119.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:12:24.688 INFO:tasks.workunit.client.0.smithi119.stderr:++ PS1='(rgw) ' 2024-09-12T17:12:24.688 INFO:tasks.workunit.client.0.smithi119.stderr:++ export PS1 2024-09-12T17:12:24.688 INFO:tasks.workunit.client.0.smithi119.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T17:12:24.688 INFO:tasks.workunit.client.0.smithi119.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T17:12:24.688 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:12:24.688 INFO:tasks.workunit.client.0.smithi119.stderr:++ hash -r 2024-09-12T17:12:24.689 INFO:tasks.workunit.client.0.smithi119.stderr:+ pip install pip --upgrade 2024-09-12T17:12:25.075 INFO:tasks.workunit.client.0.smithi119.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T17:12:25.336 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting pip 2024-09-12T17:12:25.441 INFO:tasks.workunit.client.0.smithi119.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:12:25.745 INFO:tasks.workunit.client.0.smithi119.stdout: ---------------------------------------- 1.8/1.8 MB 6.1 MB/s eta 0:00:00 2024-09-12T17:12:25.819 INFO:tasks.workunit.client.0.smithi119.stdout:Installing collected packages: pip 2024-09-12T17:12:25.820 INFO:tasks.workunit.client.0.smithi119.stdout: Attempting uninstall: pip 2024-09-12T17:12:25.820 INFO:tasks.workunit.client.0.smithi119.stdout: Found existing installation: pip 22.0.2 2024-09-12T17:12:26.116 INFO:tasks.workunit.client.0.smithi119.stdout: Uninstalling pip-22.0.2: 2024-09-12T17:12:26.122 INFO:tasks.workunit.client.0.smithi119.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T17:12:26.897 INFO:tasks.workunit.client.0.smithi119.stdout:Successfully installed pip-24.2 2024-09-12T17:12:26.964 INFO:tasks.workunit.client.0.smithi119.stderr:+ pip install configobj 2024-09-12T17:12:27.545 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting configobj 2024-09-12T17:12:27.594 INFO:tasks.workunit.client.0.smithi119.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-12T17:12:27.718 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting six (from configobj) 2024-09-12T17:12:27.734 INFO:tasks.workunit.client.0.smithi119.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:12:27.798 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-12T17:12:27.884 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:12:27.965 INFO:tasks.workunit.client.0.smithi119.stdout:Installing collected packages: six, configobj 2024-09-12T17:12:28.131 INFO:tasks.workunit.client.0.smithi119.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-12T17:12:28.550 INFO:tasks.workunit.client.0.smithi119.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-12T17:12:28.590 INFO:tasks.workunit.client.0.smithi119.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-12T17:12:28.590 INFO:tasks.workunit.client.0.smithi119.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-12T17:12:28.591 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:command succeeded 2024-09-12T17:12:28.591 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-12T17:12:28.591 INFO:tasks.workunit.client.0.smithi119.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:12:28.591 INFO:tasks.workunit.client.0.smithi119.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-12T17:12:28.633 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:command succeeded 2024-09-12T17:12:28.633 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:b'tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 38787/valgrind.bin \ntcp6 0 0 :::80 :::* LISTEN 38787/valgrind.bin \n' 2024-09-12T17:12:28.634 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:radosgw port: 80 2024-09-12T17:12:28.634 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-12T17:12:28.634 INFO:tasks.workunit.client.0.smithi119.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-12T17:12:28.670 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:command succeeded 2024-09-12T17:12:28.670 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:b'' 2024-09-12T17:12:28.670 INFO:tasks.workunit.client.0.smithi119.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-12T17:12:29.322 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:command succeeded 2024-09-12T17:12:29.322 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-12T17:12:29.238843Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-12T17:12:29.238808Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-12T17:12:29.322 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:Creating s3cmd config... 2024-09-12T17:12:29.322 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:proto for s3cmd config is http 2024-09-12T17:12:29.322 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:s3cmd config written 2024-09-12T17:12:29.322 INFO:tasks.workunit.client.0.smithi119.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-12T17:12:30.344 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:command succeeded 2024-09-12T17:12:30.345 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-12T17:12:30.345 INFO:tasks.workunit.client.0.smithi119.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-12T17:12:32.914 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:command succeeded 2024-09-12T17:12:32.914 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 2.3 seconds, 3.08 MB/s) [1 of 1]\n" 2024-09-12T17:12:32.914 INFO:tasks.workunit.client.0.smithi119.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-12T17:12:33.750 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:command succeeded 2024-09-12T17:12:33.750 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.7 seconds, 10.65 MB/s)\n" 2024-09-12T17:12:33.750 INFO:tasks.workunit.client.0.smithi119.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-12T17:12:33.919 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:command succeeded 2024-09-12T17:12:33.919 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340228,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "zstd",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4194414\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4194414,\n "len": 3145814\n }\n ]\n },\n "etag": "d51c253dda701e22f55225e6be879cfd",\n "tag": "4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16689471827100552472",\n "manifest": {\n "objs": [],\n "obj_size": 7340228,\n "explicit_objs": false,\n "head_size": 0,\n "max_head_size": 0,\n "prefix": ".ZswnuM0s0MubotyG19_mQQ4Cba_RYnP_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 0,\n "part_size": 0,\n "stripe_max_size": 4194304,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1",\n "bucket_id": "4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4194304,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1",\n "bucket_id": "4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".ZswnuM0s0MubotyG19_mQQ4Cba_RYnP_0",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 0,\n "stripe_ofs": 4194304,\n "ofs": 7340228,\n "stripe_size": 3145924,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1",\n "bucket_id": "4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".ZswnuM0s0MubotyG19_mQQ4Cba_RYnP_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-12T17:12:32.713450Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16689471827100552472",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726161148/ctime:1726161148/gid:1271/gname:ubuntu/md5:d51c253dda701e22f55225e6be879cfd/mode:33204/mtime:1726161148/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-12T17:12:33.919 INFO:tasks.workunit.client.0.smithi119.stderr:DEBUG:root:Cached object name is: .ZswnuM0s0MubotyG19_mQQ4Cba_RYnP_ 2024-09-12T17:12:33.919 INFO:tasks.workunit.client.0.smithi119.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-12T17:12:33.921 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:command succeeded 2024-09-12T17:12:33.921 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:b'0\n' 2024-09-12T17:12:33.921 INFO:tasks.workunit.client.0.smithi119.stderr:DEBUG:root:Check cache dir content: 0 2024-09-12T17:12:33.921 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-12T17:12:33.921 INFO:tasks.workunit.client.0.smithi119.stderr:INFO:root:Completed Datacache tests 2024-09-12T17:12:33.928 INFO:tasks.workunit.client.0.smithi119.stderr:+ deactivate 2024-09-12T17:12:33.928 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T17:12:33.929 INFO:tasks.workunit.client.0.smithi119.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:12:33.929 INFO:tasks.workunit.client.0.smithi119.stderr:+ export PATH 2024-09-12T17:12:33.929 INFO:tasks.workunit.client.0.smithi119.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:12:33.929 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' -n '' ']' 2024-09-12T17:12:33.929 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:12:33.929 INFO:tasks.workunit.client.0.smithi119.stderr:+ hash -r 2024-09-12T17:12:33.929 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' -n '' ']' 2024-09-12T17:12:33.929 INFO:tasks.workunit.client.0.smithi119.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:12:33.929 INFO:tasks.workunit.client.0.smithi119.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:12:33.929 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:12:33.929 INFO:tasks.workunit.client.0.smithi119.stderr:+ unset -f deactivate 2024-09-12T17:12:33.929 INFO:tasks.workunit.client.0.smithi119.stderr:+ echo OK. 2024-09-12T17:12:33.930 INFO:tasks.workunit.client.0.smithi119.stdout:OK. 2024-09-12T17:12:33.931 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:12:33.931 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:12:33.987 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-12T17:12:33.987 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:12:34.317 DEBUG:teuthology.parallel:result is None 2024-09-12T17:12:34.318 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:12:34.331 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:12:34.331 DEBUG:teuthology.orchestra.run.smithi119:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:12:34.394 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:12:34.394 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:12:34.405 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:12:34.405 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:12:34.405 DEBUG:teuthology.orchestra.run.smithi119:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:12:34.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:12:34.441 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:12:34.441 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:12:34.489 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:12:34.489 DEBUG:teuthology.orchestra.run.smithi119:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:12:34.541 INFO:tasks.workunit:timeout=3h 2024-09-12T17:12:34.541 INFO:tasks.workunit:cleanup=True 2024-09-12T17:12:34.542 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:12:34.595 INFO:tasks.workunit.client.0.smithi119.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:13:31.611 INFO:tasks.workunit.client.0.smithi119.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:13:31.612 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:31.612 INFO:tasks.workunit.client.0.smithi119.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:13:31.612 INFO:tasks.workunit.client.0.smithi119.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:13:31.612 INFO:tasks.workunit.client.0.smithi119.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:13:31.612 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:31.612 INFO:tasks.workunit.client.0.smithi119.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:13:31.612 INFO:tasks.workunit.client.0.smithi119.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:13:31.612 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:31.613 INFO:tasks.workunit.client.0.smithi119.stderr: git switch -c 2024-09-12T17:13:31.613 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:31.613 INFO:tasks.workunit.client.0.smithi119.stderr:Or undo this operation with: 2024-09-12T17:13:31.613 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:31.613 INFO:tasks.workunit.client.0.smithi119.stderr: git switch - 2024-09-12T17:13:31.613 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:31.613 INFO:tasks.workunit.client.0.smithi119.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:13:31.613 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:31.613 INFO:tasks.workunit.client.0.smithi119.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:13:31.618 DEBUG:teuthology.orchestra.run.smithi119:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:13:31.669 INFO:tasks.workunit.client.0.smithi119.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:13:31.673 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:13:31.673 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:13:31.729 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:13:31.782 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:13:31.831 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:13:31.832 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:13:31.832 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:13:31.878 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:13:31.882 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:13:31.882 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:13:31.933 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T17:13:31.934 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T17:13:31.935 DEBUG:teuthology.orchestra.run.smithi119:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:13:31.988 INFO:tasks.workunit.client.0.smithi119.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:13:31.990 INFO:tasks.workunit.client.0.smithi119.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:13:31.990 INFO:tasks.workunit.client.0.smithi119.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:13:34.987 INFO:tasks.workunit.client.0.smithi119.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:13:34.988 INFO:tasks.workunit.client.0.smithi119.stderr:++ deactivate nondestructive 2024-09-12T17:13:34.988 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n '' ']' 2024-09-12T17:13:34.988 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n '' ']' 2024-09-12T17:13:34.988 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:13:34.988 INFO:tasks.workunit.client.0.smithi119.stderr:++ hash -r 2024-09-12T17:13:34.988 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n '' ']' 2024-09-12T17:13:34.988 INFO:tasks.workunit.client.0.smithi119.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:13:34.988 INFO:tasks.workunit.client.0.smithi119.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:13:34.988 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:13:34.988 INFO:tasks.workunit.client.0.smithi119.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:13:34.988 INFO:tasks.workunit.client.0.smithi119.stderr:++ export VIRTUAL_ENV 2024-09-12T17:13:34.989 INFO:tasks.workunit.client.0.smithi119.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:13:34.989 INFO:tasks.workunit.client.0.smithi119.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:13:34.989 INFO:tasks.workunit.client.0.smithi119.stderr:++ export PATH 2024-09-12T17:13:34.989 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n '' ']' 2024-09-12T17:13:34.989 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -z '' ']' 2024-09-12T17:13:34.989 INFO:tasks.workunit.client.0.smithi119.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:13:34.989 INFO:tasks.workunit.client.0.smithi119.stderr:++ PS1='(rgw) ' 2024-09-12T17:13:34.989 INFO:tasks.workunit.client.0.smithi119.stderr:++ export PS1 2024-09-12T17:13:34.989 INFO:tasks.workunit.client.0.smithi119.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T17:13:34.989 INFO:tasks.workunit.client.0.smithi119.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T17:13:34.989 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:13:34.989 INFO:tasks.workunit.client.0.smithi119.stderr:++ hash -r 2024-09-12T17:13:34.989 INFO:tasks.workunit.client.0.smithi119.stderr:+ pip install pip --upgrade 2024-09-12T17:13:35.379 INFO:tasks.workunit.client.0.smithi119.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T17:13:35.580 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting pip 2024-09-12T17:13:35.586 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:13:35.620 INFO:tasks.workunit.client.0.smithi119.stdout:Installing collected packages: pip 2024-09-12T17:13:35.620 INFO:tasks.workunit.client.0.smithi119.stdout: Attempting uninstall: pip 2024-09-12T17:13:35.620 INFO:tasks.workunit.client.0.smithi119.stdout: Found existing installation: pip 22.0.2 2024-09-12T17:13:35.880 INFO:tasks.workunit.client.0.smithi119.stdout: Uninstalling pip-22.0.2: 2024-09-12T17:13:35.886 INFO:tasks.workunit.client.0.smithi119.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T17:13:36.912 INFO:tasks.workunit.client.0.smithi119.stdout:Successfully installed pip-24.2 2024-09-12T17:13:36.987 INFO:tasks.workunit.client.0.smithi119.stderr:+ pip install boto3 2024-09-12T17:13:37.962 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting boto3 2024-09-12T17:13:38.005 INFO:tasks.workunit.client.0.smithi119.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:13:38.580 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:13:38.593 INFO:tasks.workunit.client.0.smithi119.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:13:38.729 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:13:38.744 INFO:tasks.workunit.client.0.smithi119.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:13:38.888 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:13:38.904 INFO:tasks.workunit.client.0.smithi119.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:13:39.059 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:13:39.075 INFO:tasks.workunit.client.0.smithi119.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:13:39.285 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:13:39.310 INFO:tasks.workunit.client.0.smithi119.stdout: Downloading urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T17:13:39.546 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:13:39.547 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:13:39.565 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:13:39.665 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:13:39.915 INFO:tasks.workunit.client.0.smithi119.stdout: ---------------------------------------- 12.5/12.5 MB 52.8 MB/s eta 0:00:00 2024-09-12T17:13:39.932 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:13:39.997 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:13:40.073 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:13:40.149 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T17:13:40.220 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:13:40.344 INFO:tasks.workunit.client.0.smithi119.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:13:41.557 INFO:tasks.workunit.client.0.smithi119.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T17:13:41.780 INFO:tasks.workunit.client.0.smithi119.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T17:13:41.933 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T17:13:41.972 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:41.972 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:42.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.011+0000 7fa252eb89c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:42.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.015+0000 7fa252eb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:42.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.015+0000 7fa252eb89c0 20 realm 2024-09-12T17:13:42.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.015+0000 7fa252eb89c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:42.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.015+0000 7fa252eb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:42.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.015+0000 7fa252eb89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:42.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.015+0000 7fa252eb89c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:42.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.015+0000 7fa252eb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:42.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.015+0000 7fa252eb89c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:42.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.015+0000 7fa252eb89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:42.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.015+0000 7fa252eb89c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:42.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.019+0000 7fa252eb89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:42.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.019+0000 7fa252eb89c0 20 searching for the correct realm 2024-09-12T17:13:42.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.023+0000 7fa2509be640 0 -- 172.21.15.119:0/3693958008 >> [v2:172.21.15.119:6800/1732749810,v1:172.21.15.119:6801/1732749810] conn(0x555f12d75a90 msgr2=0x555f12d77f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:42.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.027+0000 7fa2501bd640 0 -- 172.21.15.119:0/3693958008 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fa24006da20 msgr2=0x7fa24007e840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:13:42.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.035+0000 7fa252eb89c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:42.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.035+0000 7fa252eb89c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:42.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.035+0000 7fa252eb89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:42.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.035+0000 7fa252eb89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:42.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.035+0000 7fa252eb89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:42.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.035+0000 7fa252eb89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:42.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.035+0000 7fa252eb89c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:42.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:42.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:42.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:42.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:42.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:42.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 20 zone default found 2024-09-12T17:13:42.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 4 Realm: () 2024-09-12T17:13:42.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:42.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:42.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:42.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 20 zonegroup default 2024-09-12T17:13:42.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:42.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:42.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:42.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:42.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:42.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:42.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 20 started sync module instance, tier type = 2024-09-12T17:13:42.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.039+0000 7fa252eb89c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:42.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.067+0000 7fa252eb89c0 20 add_watcher() i=0 2024-09-12T17:13:42.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.067+0000 7fa252eb89c0 20 add_watcher() i=1 2024-09-12T17:13:42.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.067+0000 7fa252eb89c0 20 add_watcher() i=2 2024-09-12T17:13:42.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.067+0000 7fa252eb89c0 20 add_watcher() i=3 2024-09-12T17:13:42.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.067+0000 7fa252eb89c0 20 add_watcher() i=4 2024-09-12T17:13:42.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.067+0000 7fa252eb89c0 20 add_watcher() i=5 2024-09-12T17:13:42.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.067+0000 7fa252eb89c0 20 add_watcher() i=6 2024-09-12T17:13:42.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.067+0000 7fa252eb89c0 20 add_watcher() i=7 2024-09-12T17:13:42.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.067+0000 7fa252eb89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:42.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.071+0000 7fa106fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:42.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.071+0000 7fa252eb89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:42.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.071+0000 7fa252eb89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:42.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.071+0000 7fa252eb89c0 5 note: GC not initialized 2024-09-12T17:13:42.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.071+0000 7fa105fe3640 20 reqs_thread_entry: start 2024-09-12T17:13:42.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.071+0000 7fa252eb89c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:42.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.071+0000 7fa252eb89c0 20 Filter name: none 2024-09-12T17:13:42.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.071+0000 7fa0777fe640 20 reqs_thread_entry: start 2024-09-12T17:13:42.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.071+0000 7fa252eb89c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T17:13:42.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.071+0000 7fa252eb89c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:42.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.071+0000 7fa252eb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:42.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.071+0000 7fa252eb89c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T17:13:42.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.071+0000 7fa252eb89c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:13:42.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.071+0000 7fa252eb89c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T17:13:42.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.071+0000 7fa252eb89c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:42.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.075+0000 7fa252eb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:42.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.075+0000 7fa252eb89c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T17:13:42.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.075+0000 7fa252eb89c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:13:42.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.075+0000 7fa252eb89c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:13:42.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.075+0000 7fa252eb89c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:13:42.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.075+0000 7fa252eb89c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:13:42.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.075+0000 7fa252eb89c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:13:42.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.075+0000 7fa252eb89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T17:13:42.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.079+0000 7fa127fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 176093659138 cookie 93866826373488 notifier 4716 bl.length()=593 2024-09-12T17:13:42.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.079+0000 7fa127fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:13:42.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.079+0000 7fa127fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:13:42.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.087+0000 7fa252eb89c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:13:42.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.087+0000 7fa252eb89c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:13:42.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.087+0000 7fa252eb89c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T17:13:42.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.087+0000 7fa127fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 176093659136 cookie 93866826365744 notifier 4716 bl.length()=186 2024-09-12T17:13:42.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.087+0000 7fa127fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:13:42.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.087+0000 7fa127fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:13:42.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.091+0000 7fa106fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:42.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.095+0000 7fa252eb89c0 20 remove_watcher() i=0 2024-09-12T17:13:42.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.095+0000 7fa252eb89c0 2 removed watcher, disabling cache 2024-09-12T17:13:42.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.099+0000 7fa252eb89c0 20 remove_watcher() i=1 2024-09-12T17:13:42.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.099+0000 7fa252eb89c0 20 remove_watcher() i=2 2024-09-12T17:13:42.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.103+0000 7fa252eb89c0 20 remove_watcher() i=3 2024-09-12T17:13:42.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.103+0000 7fa252eb89c0 20 remove_watcher() i=4 2024-09-12T17:13:42.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.107+0000 7fa252eb89c0 20 remove_watcher() i=5 2024-09-12T17:13:42.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.107+0000 7fa252eb89c0 20 remove_watcher() i=6 2024-09-12T17:13:42.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:42.107+0000 7fa252eb89c0 20 remove_watcher() i=7 2024-09-12T17:13:44.337 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T17:13:44.337 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:44.338 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:13:44.375 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:44.376 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:44.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.419+0000 7f5c3430a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.423+0000 7f5c3430a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:44.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.423+0000 7f5c3430a9c0 20 realm 2024-09-12T17:13:44.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.423+0000 7f5c3430a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.423+0000 7f5c3430a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:44.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.423+0000 7f5c3430a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:44.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.423+0000 7f5c3430a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.423+0000 7f5c3430a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:44.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.423+0000 7f5c3430a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.423+0000 7f5c3430a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:44.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.423+0000 7f5c3430a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.427+0000 7f5c3430a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:44.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.427+0000 7f5c3430a9c0 20 searching for the correct realm 2024-09-12T17:13:44.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.427+0000 7f5c32611640 0 -- 172.21.15.119:0/1998650695 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f5c280e2940 msgr2=0x7f5c280f23f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:44.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.435+0000 7f5c3160f640 0 -- 172.21.15.119:0/1998650695 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f5c2c034420 msgr2=0x7f5c2c0348a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:44.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.651+0000 7f5c3430a9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:44.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.651+0000 7f5c3430a9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:44.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.651+0000 7f5c3430a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:44.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.651+0000 7f5c3430a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:44.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.651+0000 7f5c3430a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:44.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.651+0000 7f5c3430a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:44.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.651+0000 7f5c3430a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.655+0000 7f5c3430a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:44.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.655+0000 7f5c3430a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.655+0000 7f5c3430a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:44.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.655+0000 7f5c3430a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.658 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.655+0000 7f5c3430a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:44.658 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.655+0000 7f5c3430a9c0 20 zone default found 2024-09-12T17:13:44.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.655+0000 7f5c3430a9c0 4 Realm: () 2024-09-12T17:13:44.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.655+0000 7f5c3430a9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:44.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.655+0000 7f5c3430a9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:44.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.655+0000 7f5c3430a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:44.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.655+0000 7f5c3430a9c0 20 zonegroup default 2024-09-12T17:13:44.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.655+0000 7f5c3430a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.655+0000 7f5c3430a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:44.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.655+0000 7f5c3430a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.660 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.655+0000 7f5c3430a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:44.660 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.655+0000 7f5c3430a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.660 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.659+0000 7f5c3430a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:44.660 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.659+0000 7f5c3430a9c0 20 started sync module instance, tier type = 2024-09-12T17:13:44.660 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.659+0000 7f5c3430a9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:44.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.683+0000 7f5c3430a9c0 20 add_watcher() i=0 2024-09-12T17:13:44.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.683+0000 7f5c3430a9c0 20 add_watcher() i=1 2024-09-12T17:13:44.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.683+0000 7f5c3430a9c0 20 add_watcher() i=2 2024-09-12T17:13:44.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.683+0000 7f5c3430a9c0 20 add_watcher() i=3 2024-09-12T17:13:44.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.683+0000 7f5c3430a9c0 20 add_watcher() i=4 2024-09-12T17:13:44.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.683+0000 7f5c3430a9c0 20 add_watcher() i=5 2024-09-12T17:13:44.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.683+0000 7f5c3430a9c0 20 add_watcher() i=6 2024-09-12T17:13:44.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.687+0000 7f5c3430a9c0 20 add_watcher() i=7 2024-09-12T17:13:44.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.687+0000 7f5c3430a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:44.693 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.691+0000 7f5ae37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:44.694 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.691+0000 7f5c3430a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:44.694 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.691+0000 7f5c3430a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:44.694 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.691+0000 7f5c3430a9c0 5 note: GC not initialized 2024-09-12T17:13:44.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.691+0000 7f5ae27fc640 20 reqs_thread_entry: start 2024-09-12T17:13:44.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.691+0000 7f5c3430a9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:44.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.691+0000 7f5c3430a9c0 20 Filter name: none 2024-09-12T17:13:44.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.691+0000 7f5a53fff640 20 reqs_thread_entry: start 2024-09-12T17:13:44.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.691+0000 7f5c3430a9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:13:44.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.691+0000 7f5c3430a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.695+0000 7f5c3430a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:44.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.695+0000 7f5c3430a9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:13:44.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.695+0000 7f5c3430a9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:13:44.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.695+0000 7f5c3430a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 : miss 2024-09-12T17:13:44.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.695+0000 7f5c3430a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.695+0000 7f5c3430a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:44.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.695+0000 7f5c3430a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 info.flags=0x17 2024-09-12T17:13:44.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.695+0000 7f5c3430a9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 to cache LRU end 2024-09-12T17:13:44.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.695+0000 7f5c3430a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:44.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.695+0000 7f5c3430a9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:13:44.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.695+0000 7f5c3430a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 2024-09-12T17:13:44.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.695+0000 7f5c3430a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:13:44.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.695+0000 7f5c3430a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:44.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.699+0000 7f5c3430a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:13:44.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.699+0000 7f5c3430a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:13:44.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.699+0000 7f5c3430a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:13:44.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.699+0000 7f5c3430a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:44.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.703+0000 7f5c3430a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:13:44.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.703+0000 7f5c3430a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:13:44.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.703+0000 7f5c3430a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:44.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.703+0000 7f5c3430a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:13:44.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.707+0000 7f5c3430a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:44.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.715+0000 7f5ae37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:44.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.719+0000 7f5c3430a9c0 20 remove_watcher() i=0 2024-09-12T17:13:44.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.719+0000 7f5c3430a9c0 2 removed watcher, disabling cache 2024-09-12T17:13:44.726 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.723+0000 7f5c3430a9c0 20 remove_watcher() i=1 2024-09-12T17:13:44.729 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.727+0000 7f5c3430a9c0 20 remove_watcher() i=2 2024-09-12T17:13:44.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.727+0000 7f5c3430a9c0 20 remove_watcher() i=3 2024-09-12T17:13:44.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.731+0000 7f5c3430a9c0 20 remove_watcher() i=4 2024-09-12T17:13:44.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.731+0000 7f5c3430a9c0 20 remove_watcher() i=5 2024-09-12T17:13:44.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.735+0000 7f5c3430a9c0 20 remove_watcher() i=6 2024-09-12T17:13:44.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.735+0000 7f5c3430a9c0 20 remove_watcher() i=7 2024-09-12T17:13:44.755 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:13:44.785 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:44.785 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:44.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.827+0000 7fa2e9dbd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.831+0000 7fa2e9dbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:44.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.831+0000 7fa2e9dbd9c0 20 realm 2024-09-12T17:13:44.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.831+0000 7fa2e9dbd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.831+0000 7fa2e9dbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:44.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.831+0000 7fa2e9dbd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:44.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.831+0000 7fa2e9dbd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.831+0000 7fa2e9dbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:44.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.831+0000 7fa2e9dbd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.831+0000 7fa2e9dbd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:44.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.831+0000 7fa2e9dbd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:44.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.835+0000 7fa2e9dbd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:44.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.835+0000 7fa2e9dbd9c0 20 searching for the correct realm 2024-09-12T17:13:44.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:44.835+0000 7fa2e80c4640 0 -- 172.21.15.119:0/208735517 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fa2dc041b70 msgr2=0x7fa2dc07bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:45.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.051+0000 7fa2e70c2640 0 -- 172.21.15.119:0/208735517 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fa2e0051410 msgr2=0x7fa2e0051890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:45.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.267+0000 7fa2e9dbd9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:45.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:45.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:45.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:45.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:45.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:45.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:45.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:45.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:45.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 20 zone default found 2024-09-12T17:13:45.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 4 Realm: () 2024-09-12T17:13:45.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:45.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:45.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:45.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 20 zonegroup default 2024-09-12T17:13:45.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:45.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.271+0000 7fa2e9dbd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.275+0000 7fa2e9dbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:45.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.275+0000 7fa2e9dbd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.275+0000 7fa2e9dbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:45.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.275+0000 7fa2e9dbd9c0 20 started sync module instance, tier type = 2024-09-12T17:13:45.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.275+0000 7fa2e9dbd9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:45.303 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.299+0000 7fa2e9dbd9c0 20 add_watcher() i=0 2024-09-12T17:13:45.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.299+0000 7fa2e9dbd9c0 20 add_watcher() i=1 2024-09-12T17:13:45.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.299+0000 7fa2e9dbd9c0 20 add_watcher() i=2 2024-09-12T17:13:45.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.299+0000 7fa2e9dbd9c0 20 add_watcher() i=3 2024-09-12T17:13:45.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.299+0000 7fa2e9dbd9c0 20 add_watcher() i=4 2024-09-12T17:13:45.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.299+0000 7fa2e9dbd9c0 20 add_watcher() i=5 2024-09-12T17:13:45.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.299+0000 7fa2e9dbd9c0 20 add_watcher() i=6 2024-09-12T17:13:45.306 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.303+0000 7fa2e9dbd9c0 20 add_watcher() i=7 2024-09-12T17:13:45.306 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.303+0000 7fa2e9dbd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:45.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.307+0000 7fa19dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:45.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.307+0000 7fa2e9dbd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:45.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.307+0000 7fa2e9dbd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:45.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.307+0000 7fa2e9dbd9c0 5 note: GC not initialized 2024-09-12T17:13:45.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.307+0000 7fa19cfe1640 20 reqs_thread_entry: start 2024-09-12T17:13:45.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.307+0000 7fa2e9dbd9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:45.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.307+0000 7fa2e9dbd9c0 20 Filter name: none 2024-09-12T17:13:45.313 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.307+0000 7fa1167fc640 20 reqs_thread_entry: start 2024-09-12T17:13:45.313 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.307+0000 7fa2e9dbd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.313 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.311+0000 7fa2e9dbd9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:45.313 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.311+0000 7fa2e9dbd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.311+0000 7fa2e9dbd9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:45.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.311+0000 7fa2e9dbd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:13:45.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.311+0000 7fa2e9dbd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.311+0000 7fa2e9dbd9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:45.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.311+0000 7fa2e9dbd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.311+0000 7fa2e9dbd9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:45.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.311+0000 7fa2e9dbd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:13:45.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.315+0000 7fa19dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:45.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.319+0000 7fa2e9dbd9c0 20 remove_watcher() i=0 2024-09-12T17:13:45.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.319+0000 7fa2e9dbd9c0 2 removed watcher, disabling cache 2024-09-12T17:13:45.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.323+0000 7fa2e9dbd9c0 20 remove_watcher() i=1 2024-09-12T17:13:45.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.323+0000 7fa2e9dbd9c0 20 remove_watcher() i=2 2024-09-12T17:13:45.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.327+0000 7fa2e9dbd9c0 20 remove_watcher() i=3 2024-09-12T17:13:45.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.331+0000 7fa2e9dbd9c0 20 remove_watcher() i=4 2024-09-12T17:13:45.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.331+0000 7fa2e9dbd9c0 20 remove_watcher() i=5 2024-09-12T17:13:45.336 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.331+0000 7fa2e9dbd9c0 20 remove_watcher() i=6 2024-09-12T17:13:45.337 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.335+0000 7fa2e9dbd9c0 20 remove_watcher() i=7 2024-09-12T17:13:45.352 INFO:tasks.workunit.client.0.smithi119.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 99, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T17:13:45.352 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T17:13:45.352 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:45.352 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:13:45.383 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:45.383 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:45.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.427+0000 7f502b3189c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.427+0000 7f502b3189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:45.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.427+0000 7f502b3189c0 20 realm 2024-09-12T17:13:45.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.427+0000 7f502b3189c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.427+0000 7f502b3189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:45.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.427+0000 7f502b3189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:45.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.427+0000 7f502b3189c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.427+0000 7f502b3189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:45.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.427+0000 7f502b3189c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.431+0000 7f502b3189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:45.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.431+0000 7f502b3189c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.431+0000 7f502b3189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:45.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.431+0000 7f502b3189c0 20 searching for the correct realm 2024-09-12T17:13:45.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.435+0000 7f502861d640 0 -- 172.21.15.119:0/1106097820 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f502001a040 msgr2=0x7f5020035400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:45.446 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.443+0000 7f502861d640 0 -- 172.21.15.119:0/1106097820 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f5018017070 msgr2=0x7f5018039920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:45.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.659+0000 7f502b3189c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:45.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.659+0000 7f502b3189c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:45.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.659+0000 7f502b3189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:45.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.659+0000 7f502b3189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:45.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.659+0000 7f502b3189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:45.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.659+0000 7f502b3189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:45.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.659+0000 7f502b3189c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.663+0000 7f502b3189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:45.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.663+0000 7f502b3189c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.663+0000 7f502b3189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:45.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.663+0000 7f502b3189c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.663+0000 7f502b3189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:45.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.663+0000 7f502b3189c0 20 zone default found 2024-09-12T17:13:45.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.663+0000 7f502b3189c0 4 Realm: () 2024-09-12T17:13:45.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.663+0000 7f502b3189c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:45.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.663+0000 7f502b3189c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:45.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.663+0000 7f502b3189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:45.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.663+0000 7f502b3189c0 20 zonegroup default 2024-09-12T17:13:45.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.663+0000 7f502b3189c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.663+0000 7f502b3189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:45.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.663+0000 7f502b3189c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.667+0000 7f502b3189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:45.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.667+0000 7f502b3189c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.667+0000 7f502b3189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:45.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.667+0000 7f502b3189c0 20 started sync module instance, tier type = 2024-09-12T17:13:45.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.667+0000 7f502b3189c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:45.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.691+0000 7f502b3189c0 20 add_watcher() i=0 2024-09-12T17:13:45.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.691+0000 7f502b3189c0 20 add_watcher() i=1 2024-09-12T17:13:45.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.691+0000 7f502b3189c0 20 add_watcher() i=2 2024-09-12T17:13:45.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.691+0000 7f502b3189c0 20 add_watcher() i=3 2024-09-12T17:13:45.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.691+0000 7f502b3189c0 20 add_watcher() i=4 2024-09-12T17:13:45.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.691+0000 7f502b3189c0 20 add_watcher() i=5 2024-09-12T17:13:45.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.691+0000 7f502b3189c0 20 add_watcher() i=6 2024-09-12T17:13:45.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.695+0000 7f502b3189c0 20 add_watcher() i=7 2024-09-12T17:13:45.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.695+0000 7f502b3189c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:45.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.699+0000 7f4edefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:45.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.699+0000 7f502b3189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:45.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.699+0000 7f502b3189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:45.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.699+0000 7f502b3189c0 5 note: GC not initialized 2024-09-12T17:13:45.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f4eddfe3640 20 reqs_thread_entry: start 2024-09-12T17:13:45.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:45.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 20 Filter name: none 2024-09-12T17:13:45.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f4e4f7fe640 20 reqs_thread_entry: start 2024-09-12T17:13:45.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:13:45.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:45.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:13:45.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:13:45.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 : miss 2024-09-12T17:13:45.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:45.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:45.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 info.flags=0x17 2024-09-12T17:13:45.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 to cache LRU end 2024-09-12T17:13:45.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:45.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:13:45.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 2024-09-12T17:13:45.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:13:45.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:13:45.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.703+0000 7f502b3189c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:45.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.707+0000 7f502b3189c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:13:45.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.707+0000 7f502b3189c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:13:45.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.707+0000 7f502b3189c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:13:45.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.707+0000 7f502b3189c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:13:45.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.707+0000 7f502b3189c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:13:45.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.707+0000 7f502b3189c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:13:45.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.707+0000 7f502b3189c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:13:45.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.707+0000 7f502b3189c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:45.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.711+0000 7f502b3189c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:13:45.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.711+0000 7f502b3189c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:13:45.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.711+0000 7f502b3189c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:13:45.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.711+0000 7f502b3189c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:13:45.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.711+0000 7f502b3189c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:13:45.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.711+0000 7f502b3189c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:45.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.711+0000 7f502b3189c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:13:45.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.711+0000 7f502b3189c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:13:45.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.711+0000 7f502b3189c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:13:45.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.711+0000 7f502b3189c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:45.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.711+0000 7f502b3189c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:13:45.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.711+0000 7f502b3189c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:13:45.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.715+0000 7f4edefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:45.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.719+0000 7f502b3189c0 20 remove_watcher() i=0 2024-09-12T17:13:45.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.719+0000 7f502b3189c0 2 removed watcher, disabling cache 2024-09-12T17:13:45.726 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.723+0000 7f502b3189c0 20 remove_watcher() i=1 2024-09-12T17:13:45.729 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.727+0000 7f502b3189c0 20 remove_watcher() i=2 2024-09-12T17:13:45.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.727+0000 7f502b3189c0 20 remove_watcher() i=3 2024-09-12T17:13:45.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.731+0000 7f502b3189c0 20 remove_watcher() i=4 2024-09-12T17:13:45.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.731+0000 7f502b3189c0 20 remove_watcher() i=5 2024-09-12T17:13:45.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.735+0000 7f502b3189c0 20 remove_watcher() i=6 2024-09-12T17:13:45.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:45.735+0000 7f502b3189c0 20 remove_watcher() i=7 2024-09-12T17:13:45.754 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:13:46.199 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:13:47.821 INFO:tasks.workunit.client.0.smithi119.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:13:48.021 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:13:48.021 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:48.021 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:48.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:47.903+0000 7f1d384849c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:47.903+0000 7f1d384849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:48.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:47.903+0000 7f1d384849c0 20 realm 2024-09-12T17:13:48.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:47.903+0000 7f1d384849c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:47.903+0000 7f1d384849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:48.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:47.903+0000 7f1d384849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:48.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:47.903+0000 7f1d384849c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:47.903+0000 7f1d384849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:48.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:47.903+0000 7f1d384849c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:47.907+0000 7f1d384849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:48.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:47.907+0000 7f1d384849c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:47.907+0000 7f1d384849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:48.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:47.907+0000 7f1d384849c0 20 searching for the correct realm 2024-09-12T17:13:48.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:47.911+0000 7f1d35789640 0 -- 172.21.15.119:0/262269401 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f1d28025040 msgr2=0x7f1d28025930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:48.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:47.919+0000 7f1d35789640 0 -- 172.21.15.119:0/262269401 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f1d3003f040 msgr2=0x7f1d3007d070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:48.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.135+0000 7f1d384849c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:48.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.135+0000 7f1d384849c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:48.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.135+0000 7f1d384849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:48.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.135+0000 7f1d384849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:48.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.135+0000 7f1d384849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:48.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.135+0000 7f1d384849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:48.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.135+0000 7f1d384849c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.135+0000 7f1d384849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:48.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.135+0000 7f1d384849c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.139+0000 7f1d384849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:48.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.139+0000 7f1d384849c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.139+0000 7f1d384849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:48.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.139+0000 7f1d384849c0 20 zone default found 2024-09-12T17:13:48.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.139+0000 7f1d384849c0 4 Realm: () 2024-09-12T17:13:48.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.139+0000 7f1d384849c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:48.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.139+0000 7f1d384849c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:48.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.139+0000 7f1d384849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:48.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.139+0000 7f1d384849c0 20 zonegroup default 2024-09-12T17:13:48.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.139+0000 7f1d384849c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.139+0000 7f1d384849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:48.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.139+0000 7f1d384849c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.144 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.139+0000 7f1d384849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:48.144 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.139+0000 7f1d384849c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.144 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.143+0000 7f1d384849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:48.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.143+0000 7f1d384849c0 20 started sync module instance, tier type = 2024-09-12T17:13:48.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.143+0000 7f1d384849c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:48.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.167+0000 7f1d384849c0 20 add_watcher() i=0 2024-09-12T17:13:48.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.167+0000 7f1d384849c0 20 add_watcher() i=1 2024-09-12T17:13:48.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.167+0000 7f1d384849c0 20 add_watcher() i=2 2024-09-12T17:13:48.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.167+0000 7f1d384849c0 20 add_watcher() i=3 2024-09-12T17:13:48.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.167+0000 7f1d384849c0 20 add_watcher() i=4 2024-09-12T17:13:48.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.167+0000 7f1d384849c0 20 add_watcher() i=5 2024-09-12T17:13:48.171 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.167+0000 7f1d384849c0 20 add_watcher() i=6 2024-09-12T17:13:48.173 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.171+0000 7f1d384849c0 20 add_watcher() i=7 2024-09-12T17:13:48.173 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.171+0000 7f1d384849c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:48.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.175+0000 7f1be77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:48.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.175+0000 7f1d384849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:48.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.175+0000 7f1d384849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:48.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.175+0000 7f1d384849c0 5 note: GC not initialized 2024-09-12T17:13:48.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.175+0000 7f1be67fc640 20 reqs_thread_entry: start 2024-09-12T17:13:48.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.175+0000 7f1d384849c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:48.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.175+0000 7f1d384849c0 20 Filter name: none 2024-09-12T17:13:48.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.175+0000 7f1b57fff640 20 reqs_thread_entry: start 2024-09-12T17:13:48.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.175+0000 7f1d384849c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.179+0000 7f1d384849c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:48.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.179+0000 7f1d384849c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.179+0000 7f1d384849c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:48.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.179+0000 7f1d384849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:13:48.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.179+0000 7f1d384849c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:13:48.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.179+0000 7f1d384849c0 20 INFO: main: starting shard=0 2024-09-12T17:13:48.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.179+0000 7f1d384849c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:13:48.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.179+0000 7f1d384849c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.179+0000 7f1d384849c0 20 INFO: main: starting shard=1 2024-09-12T17:13:48.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.179+0000 7f1d384849c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:48.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.179+0000 7f1d384849c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.179+0000 7f1d384849c0 20 INFO: main: starting shard=2 2024-09-12T17:13:48.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.179+0000 7f1d384849c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:13:48.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.183+0000 7f1d384849c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.183+0000 7f1d384849c0 20 INFO: main: starting shard=3 2024-09-12T17:13:48.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.183+0000 7f1d384849c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:13:48.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.183+0000 7f1d384849c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.183+0000 7f1d384849c0 20 INFO: main: starting shard=4 2024-09-12T17:13:48.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.183+0000 7f1d384849c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:13:48.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.183+0000 7f1d384849c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.183+0000 7f1d384849c0 20 INFO: main: starting shard=5 2024-09-12T17:13:48.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.183+0000 7f1d384849c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:48.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.187+0000 7f1d384849c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.187+0000 7f1d384849c0 20 INFO: main: starting shard=6 2024-09-12T17:13:48.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.187+0000 7f1d384849c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:13:48.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.187+0000 7f1d384849c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.187+0000 7f1d384849c0 20 INFO: main: starting shard=7 2024-09-12T17:13:48.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.187+0000 7f1d384849c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:13:48.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.187+0000 7f1d384849c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.190 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.187+0000 7f1d384849c0 20 INFO: main: starting shard=8 2024-09-12T17:13:48.190 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.187+0000 7f1d384849c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:48.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.187+0000 7f1d384849c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:13:48.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.187+0000 7f1d384849c0 20 INFO: main: starting shard=9 2024-09-12T17:13:48.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.187+0000 7f1d384849c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:13:48.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.187+0000 7f1d384849c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.187+0000 7f1d384849c0 20 INFO: main: starting shard=10 2024-09-12T17:13:48.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.187+0000 7f1d384849c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:48.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.191+0000 7f1d384849c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.191+0000 7f1d384849c0 20 INFO: main: done 2024-09-12T17:13:48.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.191+0000 7f1be77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:48.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.195+0000 7f1d384849c0 20 remove_watcher() i=0 2024-09-12T17:13:48.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.195+0000 7f1d384849c0 2 removed watcher, disabling cache 2024-09-12T17:13:48.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.199+0000 7f1d384849c0 20 remove_watcher() i=1 2024-09-12T17:13:48.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.199+0000 7f1d384849c0 20 remove_watcher() i=2 2024-09-12T17:13:48.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.203+0000 7f1d384849c0 20 remove_watcher() i=3 2024-09-12T17:13:48.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.207+0000 7f1d384849c0 20 remove_watcher() i=4 2024-09-12T17:13:48.212 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.207+0000 7f1d384849c0 20 remove_watcher() i=5 2024-09-12T17:13:48.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.211+0000 7f1d384849c0 20 remove_watcher() i=6 2024-09-12T17:13:48.214 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.211+0000 7f1d384849c0 20 remove_watcher() i=7 2024-09-12T17:13:48.445 INFO:tasks.workunit.client.0.smithi119.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:13:48.446 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:13:48.482 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:48.483 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:48.528 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.523+0000 7fc9459b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.527+0000 7fc9459b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:48.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.527+0000 7fc9459b59c0 20 realm 2024-09-12T17:13:48.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.527+0000 7fc9459b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.527+0000 7fc9459b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:48.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.527+0000 7fc9459b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:48.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.527+0000 7fc9459b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.527+0000 7fc9459b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:48.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.527+0000 7fc9459b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.527+0000 7fc9459b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:48.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.527+0000 7fc9459b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.531+0000 7fc9459b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:48.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.531+0000 7fc9459b59c0 20 searching for the correct realm 2024-09-12T17:13:48.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.535+0000 7fc943cbc640 0 -- 172.21.15.119:0/3678625355 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fc93804c940 msgr2=0x7fc938035400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:48.544 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.543+0000 7fc942cba640 0 -- 172.21.15.119:0/3678625355 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fc9340f5480 msgr2=0x7fc9340f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:48.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.759+0000 7fc9459b59c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:48.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.759+0000 7fc9459b59c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:48.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.759+0000 7fc9459b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:48.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.759+0000 7fc9459b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:48.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.759+0000 7fc9459b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:48.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.759+0000 7fc9459b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:48.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.759+0000 7fc9459b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.763+0000 7fc9459b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:48.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.763+0000 7fc9459b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.763+0000 7fc9459b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:48.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.763+0000 7fc9459b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.763+0000 7fc9459b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:48.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.763+0000 7fc9459b59c0 20 zone default found 2024-09-12T17:13:48.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.763+0000 7fc9459b59c0 4 Realm: () 2024-09-12T17:13:48.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.763+0000 7fc9459b59c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:48.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.763+0000 7fc9459b59c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:48.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.763+0000 7fc9459b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:48.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.763+0000 7fc9459b59c0 20 zonegroup default 2024-09-12T17:13:48.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.763+0000 7fc9459b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.763+0000 7fc9459b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:48.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.763+0000 7fc9459b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.767+0000 7fc9459b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:48.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.767+0000 7fc9459b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.767+0000 7fc9459b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:48.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.767+0000 7fc9459b59c0 20 started sync module instance, tier type = 2024-09-12T17:13:48.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.767+0000 7fc9459b59c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:48.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.787+0000 7fc9459b59c0 20 add_watcher() i=0 2024-09-12T17:13:48.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.787+0000 7fc9459b59c0 20 add_watcher() i=1 2024-09-12T17:13:48.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.787+0000 7fc9459b59c0 20 add_watcher() i=2 2024-09-12T17:13:48.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.787+0000 7fc9459b59c0 20 add_watcher() i=3 2024-09-12T17:13:48.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.787+0000 7fc9459b59c0 20 add_watcher() i=4 2024-09-12T17:13:48.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.787+0000 7fc9459b59c0 20 add_watcher() i=5 2024-09-12T17:13:48.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.787+0000 7fc9459b59c0 20 add_watcher() i=6 2024-09-12T17:13:48.793 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.791+0000 7fc9459b59c0 20 add_watcher() i=7 2024-09-12T17:13:48.793 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.791+0000 7fc9459b59c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:48.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.795+0000 7fc7fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:48.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.795+0000 7fc9459b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:48.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.795+0000 7fc9459b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:48.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.795+0000 7fc9459b59c0 5 note: GC not initialized 2024-09-12T17:13:48.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.795+0000 7fc7f97e2640 20 reqs_thread_entry: start 2024-09-12T17:13:48.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.795+0000 7fc9459b59c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:48.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.795+0000 7fc9459b59c0 20 Filter name: none 2024-09-12T17:13:48.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.795+0000 7fc7f27fc640 20 reqs_thread_entry: start 2024-09-12T17:13:48.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.795+0000 7fc9459b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.799+0000 7fc9459b59c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:48.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.799+0000 7fc9459b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:48.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.799+0000 7fc9459b59c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:48.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.799+0000 7fc9459b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:13:48.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.799+0000 7fc9459b59c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:13:48.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.799+0000 7fc9459b59c0 20 INFO: main: starting shard=0 2024-09-12T17:13:48.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.799+0000 7fc9459b59c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:13:48.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.799+0000 7fc9459b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.799+0000 7fc9459b59c0 20 INFO: main: starting shard=1 2024-09-12T17:13:48.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.799+0000 7fc9459b59c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:48.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.799+0000 7fc9459b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.799+0000 7fc9459b59c0 20 INFO: main: starting shard=2 2024-09-12T17:13:48.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.799+0000 7fc9459b59c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:13:48.805 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.803+0000 7fc9459b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.805 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.803+0000 7fc9459b59c0 20 INFO: main: starting shard=3 2024-09-12T17:13:48.805 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.803+0000 7fc9459b59c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:13:48.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.803+0000 7fc9459b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.803+0000 7fc9459b59c0 20 INFO: main: starting shard=4 2024-09-12T17:13:48.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.803+0000 7fc9459b59c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:13:48.807 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.803+0000 7fc9459b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.807 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.803+0000 7fc9459b59c0 20 INFO: main: starting shard=5 2024-09-12T17:13:48.807 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.803+0000 7fc9459b59c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:48.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.807+0000 7fc9459b59c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:13:48.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.807+0000 7fc9459b59c0 20 INFO: main: starting shard=6 2024-09-12T17:13:48.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.807+0000 7fc9459b59c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:13:48.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.807+0000 7fc9459b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.807+0000 7fc9459b59c0 20 INFO: main: starting shard=7 2024-09-12T17:13:48.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.807+0000 7fc9459b59c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:13:48.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.807+0000 7fc9459b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.807+0000 7fc9459b59c0 20 INFO: main: starting shard=8 2024-09-12T17:13:48.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.807+0000 7fc9459b59c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:48.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.807+0000 7fc9459b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.807+0000 7fc9459b59c0 20 INFO: main: starting shard=9 2024-09-12T17:13:48.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.807+0000 7fc9459b59c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:13:48.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.807+0000 7fc9459b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.807+0000 7fc9459b59c0 20 INFO: main: starting shard=10 2024-09-12T17:13:48.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.807+0000 7fc9459b59c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:48.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.811+0000 7fc9459b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:48.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.811+0000 7fc9459b59c0 20 INFO: main: done 2024-09-12T17:13:48.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.811+0000 7fc7fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:48.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.815+0000 7fc9459b59c0 20 remove_watcher() i=0 2024-09-12T17:13:48.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.815+0000 7fc9459b59c0 2 removed watcher, disabling cache 2024-09-12T17:13:48.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.819+0000 7fc9459b59c0 20 remove_watcher() i=1 2024-09-12T17:13:48.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.823+0000 7fc9459b59c0 20 remove_watcher() i=2 2024-09-12T17:13:48.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.823+0000 7fc9459b59c0 20 remove_watcher() i=3 2024-09-12T17:13:48.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.827+0000 7fc9459b59c0 20 remove_watcher() i=4 2024-09-12T17:13:48.830 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.827+0000 7fc9459b59c0 20 remove_watcher() i=5 2024-09-12T17:13:48.832 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.827+0000 7fc9459b59c0 20 remove_watcher() i=6 2024-09-12T17:13:48.833 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:48.831+0000 7fc9459b59c0 20 remove_watcher() i=7 2024-09-12T17:13:49.005 INFO:tasks.workunit.client.0.smithi119.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:13:49.006 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:13:49.041 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:49.041 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:49.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.087+0000 7ff4f92f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.087+0000 7ff4f92f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:49.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.087+0000 7ff4f92f99c0 20 realm 2024-09-12T17:13:49.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.087+0000 7ff4f92f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.087+0000 7ff4f92f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:49.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.087+0000 7ff4f92f99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:49.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.087+0000 7ff4f92f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.087+0000 7ff4f92f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:49.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.087+0000 7ff4f92f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.087+0000 7ff4f92f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:49.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.087+0000 7ff4f92f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.091+0000 7ff4f92f99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:49.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.091+0000 7ff4f92f99c0 20 searching for the correct realm 2024-09-12T17:13:49.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.091+0000 7ff4f6dff640 0 -- 172.21.15.119:0/369188256 >> [v2:172.21.15.119:6800/1732749810,v1:172.21.15.119:6801/1732749810] conn(0x55bdfeee3690 msgr2=0x55bdfeee5b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:13:49.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.099+0000 7ff4f6dff640 0 -- 172.21.15.119:0/369188256 >> [v2:172.21.15.194:6824/504391855,v1:172.21.15.194:6825/504391855] conn(0x55bdfec9a610 msgr2=0x7ff4f00f6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:49.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.323+0000 7ff4f92f99c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:49.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.323+0000 7ff4f92f99c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:49.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.323+0000 7ff4f92f99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:49.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.323+0000 7ff4f92f99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:49.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.323+0000 7ff4f92f99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:49.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.323+0000 7ff4f92f99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:49.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.323+0000 7ff4f92f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.323+0000 7ff4f92f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:49.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.323+0000 7ff4f92f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.323+0000 7ff4f92f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:49.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.323+0000 7ff4f92f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.327+0000 7ff4f92f99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:49.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.327+0000 7ff4f92f99c0 20 zone default found 2024-09-12T17:13:49.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.327+0000 7ff4f92f99c0 4 Realm: () 2024-09-12T17:13:49.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.327+0000 7ff4f92f99c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:49.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.327+0000 7ff4f92f99c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:49.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.327+0000 7ff4f92f99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:49.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.327+0000 7ff4f92f99c0 20 zonegroup default 2024-09-12T17:13:49.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.327+0000 7ff4f92f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.327+0000 7ff4f92f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:49.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.327+0000 7ff4f92f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.327+0000 7ff4f92f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:49.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.327+0000 7ff4f92f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.327+0000 7ff4f92f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:49.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.327+0000 7ff4f92f99c0 20 started sync module instance, tier type = 2024-09-12T17:13:49.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.327+0000 7ff4f92f99c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:49.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.355+0000 7ff4f92f99c0 20 add_watcher() i=0 2024-09-12T17:13:49.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.355+0000 7ff4f92f99c0 20 add_watcher() i=1 2024-09-12T17:13:49.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.355+0000 7ff4f92f99c0 20 add_watcher() i=2 2024-09-12T17:13:49.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.355+0000 7ff4f92f99c0 20 add_watcher() i=3 2024-09-12T17:13:49.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.355+0000 7ff4f92f99c0 20 add_watcher() i=4 2024-09-12T17:13:49.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.355+0000 7ff4f92f99c0 20 add_watcher() i=5 2024-09-12T17:13:49.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.355+0000 7ff4f92f99c0 20 add_watcher() i=6 2024-09-12T17:13:49.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.359+0000 7ff4f92f99c0 20 add_watcher() i=7 2024-09-12T17:13:49.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.359+0000 7ff4f92f99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:49.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.363+0000 7ff3ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:49.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.363+0000 7ff4f92f99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:49.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.363+0000 7ff4f92f99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:49.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.363+0000 7ff4f92f99c0 5 note: GC not initialized 2024-09-12T17:13:49.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.363+0000 7ff327fff640 20 reqs_thread_entry: start 2024-09-12T17:13:49.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.363+0000 7ff4f92f99c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:49.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.363+0000 7ff4f92f99c0 20 Filter name: none 2024-09-12T17:13:49.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.363+0000 7ff325ffb640 20 reqs_thread_entry: start 2024-09-12T17:13:49.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.363+0000 7ff4f92f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.367+0000 7ff4f92f99c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:49.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.367+0000 7ff4f92f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.369 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.367+0000 7ff4f92f99c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:49.369 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.367+0000 7ff4f92f99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:13:49.369 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.367+0000 7ff4f92f99c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:13:49.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.367+0000 7ff4f92f99c0 20 INFO: main: starting shard=0 2024-09-12T17:13:49.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.367+0000 7ff4f92f99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:13:49.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.367+0000 7ff4f92f99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.367+0000 7ff4f92f99c0 20 INFO: main: starting shard=1 2024-09-12T17:13:49.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.367+0000 7ff4f92f99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:49.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.367+0000 7ff4f92f99c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:13:49.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.367+0000 7ff4f92f99c0 20 INFO: main: starting shard=2 2024-09-12T17:13:49.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.367+0000 7ff4f92f99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:13:49.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.367+0000 7ff4f92f99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.367+0000 7ff4f92f99c0 20 INFO: main: starting shard=3 2024-09-12T17:13:49.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.367+0000 7ff4f92f99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:13:49.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.371+0000 7ff4f92f99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.371+0000 7ff4f92f99c0 20 INFO: main: starting shard=4 2024-09-12T17:13:49.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.371+0000 7ff4f92f99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:13:49.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.371+0000 7ff4f92f99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.371+0000 7ff4f92f99c0 20 INFO: main: starting shard=5 2024-09-12T17:13:49.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.371+0000 7ff4f92f99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:49.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.371+0000 7ff4f92f99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.371+0000 7ff4f92f99c0 20 INFO: main: starting shard=6 2024-09-12T17:13:49.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.371+0000 7ff4f92f99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:13:49.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.371+0000 7ff4f92f99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.371+0000 7ff4f92f99c0 20 INFO: main: starting shard=7 2024-09-12T17:13:49.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.371+0000 7ff4f92f99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:13:49.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.375+0000 7ff4f92f99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.375+0000 7ff4f92f99c0 20 INFO: main: starting shard=8 2024-09-12T17:13:49.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.375+0000 7ff4f92f99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:49.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.375+0000 7ff4f92f99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.375+0000 7ff4f92f99c0 20 INFO: main: starting shard=9 2024-09-12T17:13:49.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.375+0000 7ff4f92f99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:13:49.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.375+0000 7ff4f92f99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.375+0000 7ff4f92f99c0 20 INFO: main: starting shard=10 2024-09-12T17:13:49.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.375+0000 7ff4f92f99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:49.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.375+0000 7ff4f92f99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.375+0000 7ff4f92f99c0 20 INFO: main: done 2024-09-12T17:13:49.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.375+0000 7ff3ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:49.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.383+0000 7ff4f92f99c0 20 remove_watcher() i=0 2024-09-12T17:13:49.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.383+0000 7ff4f92f99c0 2 removed watcher, disabling cache 2024-09-12T17:13:49.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.383+0000 7ff4f92f99c0 20 remove_watcher() i=1 2024-09-12T17:13:49.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.387+0000 7ff4f92f99c0 20 remove_watcher() i=2 2024-09-12T17:13:49.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.391+0000 7ff4f92f99c0 20 remove_watcher() i=3 2024-09-12T17:13:49.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.395+0000 7ff4f92f99c0 20 remove_watcher() i=4 2024-09-12T17:13:49.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.395+0000 7ff4f92f99c0 20 remove_watcher() i=5 2024-09-12T17:13:49.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.399+0000 7ff4f92f99c0 20 remove_watcher() i=6 2024-09-12T17:13:49.402 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.399+0000 7ff4f92f99c0 20 remove_watcher() i=7 2024-09-12T17:13:49.577 INFO:tasks.workunit.client.0.smithi119.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:13:49.578 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:13:49.614 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:49.614 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:49.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.659+0000 7f36ad6fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.659+0000 7f36ad6fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:49.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.659+0000 7f36ad6fd9c0 20 realm 2024-09-12T17:13:49.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.659+0000 7f36ad6fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.659+0000 7f36ad6fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:49.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.659+0000 7f36ad6fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:49.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.659+0000 7f36ad6fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.659+0000 7f36ad6fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:49.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.659+0000 7f36ad6fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.663+0000 7f36ad6fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:49.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.663+0000 7f36ad6fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.663+0000 7f36ad6fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:49.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.663+0000 7f36ad6fd9c0 20 searching for the correct realm 2024-09-12T17:13:49.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.667+0000 7f36aba04640 0 -- 172.21.15.119:0/1258602091 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f36a001a040 msgr2=0x7f36a0062990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:49.678 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.675+0000 7f36aaa02640 0 -- 172.21.15.119:0/1258602091 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f36a40ea720 msgr2=0x7f36a40e0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:49.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:49.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:49.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:49.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:49.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:49.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:49.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:49.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:49.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:49.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 20 zone default found 2024-09-12T17:13:49.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 4 Realm: () 2024-09-12T17:13:49.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:49.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:49.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:49.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 20 zonegroup default 2024-09-12T17:13:49.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.891+0000 7f36ad6fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.895+0000 7f36ad6fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:49.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.895+0000 7f36ad6fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.907 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.895+0000 7f36ad6fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:49.907 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.895+0000 7f36ad6fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.895+0000 7f36ad6fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:49.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.895+0000 7f36ad6fd9c0 20 started sync module instance, tier type = 2024-09-12T17:13:49.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.895+0000 7f36ad6fd9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:49.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.927+0000 7f36ad6fd9c0 20 add_watcher() i=0 2024-09-12T17:13:49.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.927+0000 7f36ad6fd9c0 20 add_watcher() i=1 2024-09-12T17:13:49.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.927+0000 7f36ad6fd9c0 20 add_watcher() i=2 2024-09-12T17:13:49.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.927+0000 7f36ad6fd9c0 20 add_watcher() i=3 2024-09-12T17:13:49.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.927+0000 7f36ad6fd9c0 20 add_watcher() i=4 2024-09-12T17:13:49.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.927+0000 7f36ad6fd9c0 20 add_watcher() i=5 2024-09-12T17:13:49.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.927+0000 7f36ad6fd9c0 20 add_watcher() i=6 2024-09-12T17:13:49.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.931+0000 7f36ad6fd9c0 20 add_watcher() i=7 2024-09-12T17:13:49.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.931+0000 7f36ad6fd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:49.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.935+0000 7f3561fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:49.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.935+0000 7f36ad6fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:49.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.935+0000 7f36ad6fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:49.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.935+0000 7f36ad6fd9c0 5 note: GC not initialized 2024-09-12T17:13:49.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.935+0000 7f3560fe1640 20 reqs_thread_entry: start 2024-09-12T17:13:49.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.935+0000 7f36ad6fd9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:49.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.935+0000 7f36ad6fd9c0 20 Filter name: none 2024-09-12T17:13:49.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.935+0000 7f34da7fc640 20 reqs_thread_entry: start 2024-09-12T17:13:49.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.935+0000 7f36ad6fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.939+0000 7f36ad6fd9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:49.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.939+0000 7f36ad6fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:49.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.939+0000 7f36ad6fd9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:49.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.939+0000 7f36ad6fd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:13:49.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.939+0000 7f36ad6fd9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:13:49.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.939+0000 7f36ad6fd9c0 20 INFO: main: starting shard=0 2024-09-12T17:13:49.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.939+0000 7f36ad6fd9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:13:49.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.939+0000 7f36ad6fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.939+0000 7f36ad6fd9c0 20 INFO: main: starting shard=1 2024-09-12T17:13:49.944 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.939+0000 7f36ad6fd9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:49.944 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.939+0000 7f36ad6fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.944 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.939+0000 7f36ad6fd9c0 20 INFO: main: starting shard=2 2024-09-12T17:13:49.944 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.939+0000 7f36ad6fd9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:13:49.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.943+0000 7f36ad6fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.943+0000 7f36ad6fd9c0 20 INFO: main: starting shard=3 2024-09-12T17:13:49.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.943+0000 7f36ad6fd9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:13:49.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.943+0000 7f36ad6fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.943+0000 7f36ad6fd9c0 20 INFO: main: starting shard=4 2024-09-12T17:13:49.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.943+0000 7f36ad6fd9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:13:49.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.943+0000 7f36ad6fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.943+0000 7f36ad6fd9c0 20 INFO: main: starting shard=5 2024-09-12T17:13:49.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.943+0000 7f36ad6fd9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:49.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.947+0000 7f36ad6fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.947+0000 7f36ad6fd9c0 20 INFO: main: starting shard=6 2024-09-12T17:13:49.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.947+0000 7f36ad6fd9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:13:49.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.947+0000 7f36ad6fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.947+0000 7f36ad6fd9c0 20 INFO: main: starting shard=7 2024-09-12T17:13:49.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.947+0000 7f36ad6fd9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:13:49.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.947+0000 7f36ad6fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.947+0000 7f36ad6fd9c0 20 INFO: main: starting shard=8 2024-09-12T17:13:49.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.947+0000 7f36ad6fd9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:49.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.947+0000 7f36ad6fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.947+0000 7f36ad6fd9c0 20 INFO: main: starting shard=9 2024-09-12T17:13:49.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.947+0000 7f36ad6fd9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:13:49.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.947+0000 7f36ad6fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:49.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.947+0000 7f36ad6fd9c0 20 INFO: main: starting shard=10 2024-09-12T17:13:49.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.947+0000 7f36ad6fd9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:49.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.947+0000 7f36ad6fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:13:49.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.951+0000 7f36ad6fd9c0 20 INFO: main: done 2024-09-12T17:13:49.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.951+0000 7f3561fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:49.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.955+0000 7f36ad6fd9c0 20 remove_watcher() i=0 2024-09-12T17:13:49.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.955+0000 7f36ad6fd9c0 2 removed watcher, disabling cache 2024-09-12T17:13:49.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.959+0000 7f36ad6fd9c0 20 remove_watcher() i=1 2024-09-12T17:13:49.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.959+0000 7f36ad6fd9c0 20 remove_watcher() i=2 2024-09-12T17:13:49.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.963+0000 7f36ad6fd9c0 20 remove_watcher() i=3 2024-09-12T17:13:49.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.963+0000 7f36ad6fd9c0 20 remove_watcher() i=4 2024-09-12T17:13:49.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.967+0000 7f36ad6fd9c0 20 remove_watcher() i=5 2024-09-12T17:13:49.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.967+0000 7f36ad6fd9c0 20 remove_watcher() i=6 2024-09-12T17:13:49.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:49.971+0000 7f36ad6fd9c0 20 remove_watcher() i=7 2024-09-12T17:13:50.029 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:13:50.474 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:13:50.885 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T17:13:50.885 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:50.886 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:13:50.920 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:50.920 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:50.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.959+0000 7fc0d32719c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:50.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.959+0000 7fc0d32719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:50.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.959+0000 7fc0d32719c0 20 realm 2024-09-12T17:13:50.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.959+0000 7fc0d32719c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:50.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.959+0000 7fc0d32719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:50.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.959+0000 7fc0d32719c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:50.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.959+0000 7fc0d32719c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:50.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.959+0000 7fc0d32719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:50.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.959+0000 7fc0d32719c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:50.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.963+0000 7fc0d32719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:50.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.963+0000 7fc0d32719c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:50.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.963+0000 7fc0d32719c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:50.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.963+0000 7fc0d32719c0 20 searching for the correct realm 2024-09-12T17:13:50.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.967+0000 7fc0d0d77640 0 -- 172.21.15.119:0/724088641 >> [v2:172.21.15.119:6816/4034469375,v1:172.21.15.119:6818/4034469375] conn(0x5573bb5b4ed0 msgr2=0x5573bb5b7340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:50.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.975+0000 7fc0cbfff640 0 -- 172.21.15.119:0/724088641 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fc0cc018070 msgr2=0x7fc0cc09f4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:50.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.979+0000 7fc0d32719c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:50.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.979+0000 7fc0d32719c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:50.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.979+0000 7fc0d32719c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:50.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.979+0000 7fc0d32719c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:50.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.979+0000 7fc0d32719c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:50.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.979+0000 7fc0d32719c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:50.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.979+0000 7fc0d32719c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:50.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.979+0000 7fc0d32719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:50.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.979+0000 7fc0d32719c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:50.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:50.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:50.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:50.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 20 zone default found 2024-09-12T17:13:50.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 4 Realm: () 2024-09-12T17:13:50.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:50.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:50.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:50.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 20 zonegroup default 2024-09-12T17:13:50.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:50.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:50.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:50.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:50.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:50.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:50.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 20 started sync module instance, tier type = 2024-09-12T17:13:50.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.983+0000 7fc0d32719c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:51.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.999+0000 7fc0d32719c0 20 add_watcher() i=0 2024-09-12T17:13:51.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.999+0000 7fc0d32719c0 20 add_watcher() i=1 2024-09-12T17:13:51.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.999+0000 7fc0d32719c0 20 add_watcher() i=2 2024-09-12T17:13:51.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.999+0000 7fc0d32719c0 20 add_watcher() i=3 2024-09-12T17:13:51.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.999+0000 7fc0d32719c0 20 add_watcher() i=4 2024-09-12T17:13:51.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.999+0000 7fc0d32719c0 20 add_watcher() i=5 2024-09-12T17:13:51.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.999+0000 7fc0d32719c0 20 add_watcher() i=6 2024-09-12T17:13:51.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.999+0000 7fc0d32719c0 20 add_watcher() i=7 2024-09-12T17:13:51.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:50.999+0000 7fc0d32719c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:51.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fbf877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:51.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:51.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:51.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 5 note: GC not initialized 2024-09-12T17:13:51.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fbf867e4640 20 reqs_thread_entry: start 2024-09-12T17:13:51.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:51.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 20 Filter name: none 2024-09-12T17:13:51.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fbf7f7fe640 20 reqs_thread_entry: start 2024-09-12T17:13:51.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:13:51.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:51.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:51.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:13:51.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:13:51.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 : miss 2024-09-12T17:13:51.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:51.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:51.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 info.flags=0x17 2024-09-12T17:13:51.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 to cache LRU end 2024-09-12T17:13:51.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:51.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:13:51.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 2024-09-12T17:13:51.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:13:51.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:13:51.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.003+0000 7fc0d32719c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:51.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.007+0000 7fc0d32719c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:13:51.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.007+0000 7fc0d32719c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:13:51.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.007+0000 7fc0d32719c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:13:51.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.007+0000 7fc0d32719c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:13:51.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.007+0000 7fc0d32719c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:13:51.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.007+0000 7fc0d32719c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:13:51.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.007+0000 7fc0d32719c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:51.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.011+0000 7fc0d32719c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:13:51.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.011+0000 7fc0d32719c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:13:51.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.011+0000 7fc0d32719c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:13:51.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.011+0000 7fc0d32719c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:13:51.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.011+0000 7fc0d32719c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:51.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.011+0000 7fc0d32719c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:13:51.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.011+0000 7fc0d32719c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:13:51.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.011+0000 7fc0d32719c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:51.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.011+0000 7fc0d32719c0 1 NOTICE: finished shard 1 (1 entries found) 2024-09-12T17:13:51.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.011+0000 7fc0d32719c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T17:13:51.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.011+0000 7fc0d32719c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T17:13:51.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.011+0000 7fc0d32719c0 1 NOTICE: finished shard 10 (1 entries found) 2024-09-12T17:13:51.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.011+0000 7fc0d32719c0 1 NOTICE: finished all shards (4 entries found) 2024-09-12T17:13:51.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.011+0000 7fbf877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:51.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.019+0000 7fc0d32719c0 20 remove_watcher() i=0 2024-09-12T17:13:51.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.019+0000 7fc0d32719c0 2 removed watcher, disabling cache 2024-09-12T17:13:51.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.019+0000 7fc0d32719c0 20 remove_watcher() i=1 2024-09-12T17:13:51.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.023+0000 7fc0d32719c0 20 remove_watcher() i=2 2024-09-12T17:13:51.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.023+0000 7fc0d32719c0 20 remove_watcher() i=3 2024-09-12T17:13:51.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.027+0000 7fc0d32719c0 20 remove_watcher() i=4 2024-09-12T17:13:51.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.027+0000 7fc0d32719c0 20 remove_watcher() i=5 2024-09-12T17:13:51.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.031+0000 7fc0d32719c0 20 remove_watcher() i=6 2024-09-12T17:13:51.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.031+0000 7fc0d32719c0 20 remove_watcher() i=7 2024-09-12T17:13:51.046 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: unlinked entries are not listable 2024-09-12T17:13:51.046 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:51.224 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T17:13:51.224 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:51.442 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T17:13:51.442 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:51.443 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:13:51.482 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:51.482 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:51.528 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.523+0000 7f656918b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:51.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.527+0000 7f656918b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:51.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.527+0000 7f656918b9c0 20 realm 2024-09-12T17:13:51.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.527+0000 7f656918b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:51.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.527+0000 7f656918b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:51.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.527+0000 7f656918b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:51.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.527+0000 7f656918b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:51.531 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.527+0000 7f656918b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:51.531 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.527+0000 7f656918b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:51.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.531+0000 7f656918b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:51.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.531+0000 7f656918b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:51.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.531+0000 7f656918b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:51.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.531+0000 7f656918b9c0 20 searching for the correct realm 2024-09-12T17:13:51.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.535+0000 7f6567492640 0 -- 172.21.15.119:0/728052519 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f655c101ae0 msgr2=0x7f655c0fa400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:51.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.751+0000 7f6566490640 0 -- 172.21.15.119:0/728052519 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f6560008040 msgr2=0x7f6560052470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:51.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.967+0000 7f656918b9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:51.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.967+0000 7f656918b9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:51.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.967+0000 7f656918b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:51.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.967+0000 7f656918b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:51.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.967+0000 7f656918b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:51.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.967+0000 7f656918b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:51.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.967+0000 7f656918b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:51.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.967+0000 7f656918b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:51.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.967+0000 7f656918b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:51.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:51.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:51.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:51.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 20 zone default found 2024-09-12T17:13:51.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 4 Realm: () 2024-09-12T17:13:51.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:51.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:51.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:51.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 20 zonegroup default 2024-09-12T17:13:51.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:51.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:51.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:51.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:51.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:51.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:51.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 20 started sync module instance, tier type = 2024-09-12T17:13:51.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.971+0000 7f656918b9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:52.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.995+0000 7f656918b9c0 20 add_watcher() i=0 2024-09-12T17:13:52.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.995+0000 7f656918b9c0 20 add_watcher() i=1 2024-09-12T17:13:52.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.995+0000 7f656918b9c0 20 add_watcher() i=2 2024-09-12T17:13:52.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.995+0000 7f656918b9c0 20 add_watcher() i=3 2024-09-12T17:13:52.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.995+0000 7f656918b9c0 20 add_watcher() i=4 2024-09-12T17:13:52.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.995+0000 7f656918b9c0 20 add_watcher() i=5 2024-09-12T17:13:52.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.999+0000 7f656918b9c0 20 add_watcher() i=6 2024-09-12T17:13:52.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.999+0000 7f656918b9c0 20 add_watcher() i=7 2024-09-12T17:13:52.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:51.999+0000 7f656918b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:52.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.003+0000 7f641dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:52.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.003+0000 7f656918b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:52.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.003+0000 7f656918b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:52.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.003+0000 7f656918b9c0 5 note: GC not initialized 2024-09-12T17:13:52.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.003+0000 7f641cfe1640 20 reqs_thread_entry: start 2024-09-12T17:13:52.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.003+0000 7f656918b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:52.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.003+0000 7f656918b9c0 20 Filter name: none 2024-09-12T17:13:52.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.003+0000 7f6415ffb640 20 reqs_thread_entry: start 2024-09-12T17:13:52.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.007+0000 7f656918b9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:13:52.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.007+0000 7f656918b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:52.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.007+0000 7f656918b9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:52.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.007+0000 7f656918b9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:13:52.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.007+0000 7f656918b9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:13:52.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.007+0000 7f656918b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 : miss 2024-09-12T17:13:52.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.007+0000 7f656918b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:52.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.007+0000 7f656918b9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:52.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.007+0000 7f656918b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 info.flags=0x17 2024-09-12T17:13:52.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.007+0000 7f656918b9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 to cache LRU end 2024-09-12T17:13:52.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.007+0000 7f656918b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:52.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.007+0000 7f656918b9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:13:52.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.007+0000 7f656918b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 2024-09-12T17:13:52.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.007+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:13:52.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.007+0000 7f656918b9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:13:52.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.007+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:52.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.011+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:13:52.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.011+0000 7f656918b9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:13:52.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.011+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:13:52.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.011+0000 7f656918b9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:13:52.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.011+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:13:52.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.011+0000 7f656918b9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:13:52.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.011+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:52.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.015+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:13:52.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.015+0000 7f656918b9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:13:52.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.015+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:13:52.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.015+0000 7f656918b9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:13:52.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.015+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:52.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.015+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:13:52.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.015+0000 7f656918b9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:13:52.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.015+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:52.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:52.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 get_obj_state: octx=0x55db6cf2c970 obj=check-bucket:e state=0x55db6d1d9f88 s->prefetch_data=0 2024-09-12T17:13:52.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:52.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 get_obj_state: octx=0x55db6cf3e5e0 obj=check-bucket:d state=0x55db6d1dfe78 s->prefetch_data=0 2024-09-12T17:13:52.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:52.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 get_obj_state: octx=0x55db6d1e8930 obj=check-bucket:c state=0x55db6d1db408 s->prefetch_data=0 2024-09-12T17:13:52.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:52.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 get_obj_state: octx=0x55db6d1dab30 obj=check-bucket:f state=0x55db6d1df1a8 s->prefetch_data=0 2024-09-12T17:13:52.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 get_obj_state: setting s->obj_tag to 3b510uu26lo72dbl5c2mueg4q88yez7d 2024-09-12T17:13:52.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 get_obj_state_impl: setting s->olh_tag to 58ibqrzrczkuw7ki4qb1xlml7heorvla 2024-09-12T17:13:52.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=58ibqrzrczkuw7ki4qb1xlml7heorvla 2024-09-12T17:13:52.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 get_obj_state: setting s->obj_tag to ip1brbz06qeda8uwxp0xvgw3uxtkox9y 2024-09-12T17:13:52.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 get_obj_state_impl: setting s->olh_tag to viqc4y9f6bavkinh810suugjlfwouvdk 2024-09-12T17:13:52.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=viqc4y9f6bavkinh810suugjlfwouvdk 2024-09-12T17:13:52.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 get_obj_state: setting s->obj_tag to cksy3af32w7hbek9tdb58ix40upz2tds 2024-09-12T17:13:52.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 get_obj_state_impl: setting s->olh_tag to k2hirwlsdbq2r7azfoyw5ezamkp15sfy 2024-09-12T17:13:52.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=k2hirwlsdbq2r7azfoyw5ezamkp15sfy 2024-09-12T17:13:52.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 get_obj_state: setting s->obj_tag to 4t08652icgor1k50at2kn7g5dbjispf2 2024-09-12T17:13:52.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 get_obj_state_impl: setting s->olh_tag to qfvcypd83ckopj9h5b6eiir8sgfnr3ox 2024-09-12T17:13:52.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.019+0000 7f656918b9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qfvcypd83ckopj9h5b6eiir8sgfnr3ox 2024-09-12T17:13:52.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.023+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:52.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.023+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:52.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:52.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:52.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:52.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:52.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:13:52.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 olh_log_entry: epoch=2 op=3 key=e[mBo3xSOQOnnhJHp-eb2WM5E69jy6qmk] 2024-09-12T17:13:52.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 get_obj_state: octx=0x55db6cf2c970 obj=check-bucket:_:mBo3xSOQOnnhJHp-eb2WM5E69jy6qmk_e state=0x55db6d27d778 s->prefetch_data=0 2024-09-12T17:13:52.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:13:52.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 olh_log_entry: epoch=2 op=3 key=f[wcaWa2kqU2uIetqwiYBqLVVlgZ3-Am.] 2024-09-12T17:13:52.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 get_obj_state: octx=0x55db6d1dab30 obj=check-bucket:_:wcaWa2kqU2uIetqwiYBqLVVlgZ3-Am._f state=0x55db6d28c228 s->prefetch_data=0 2024-09-12T17:13:52.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 10 manifest: total_size = 22 2024-09-12T17:13:52.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10107967193668171488 2024-09-12T17:13:52.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 get_obj_state: octx=0x55db6cf2c970 obj=check-bucket:_:mBo3xSOQOnnhJHp-eb2WM5E69jy6qmk_e state=0x55db6d27d778 s->prefetch_data=0 2024-09-12T17:13:52.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 prepare_atomic_modification: state is not atomic. state=0x55db6d27d778 2024-09-12T17:13:52.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:52.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 10 manifest: total_size = 12 2024-09-12T17:13:52.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15261938600580111286 2024-09-12T17:13:52.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 get_obj_state: octx=0x55db6d1dab30 obj=check-bucket:_:wcaWa2kqU2uIetqwiYBqLVVlgZ3-Am._f state=0x55db6d28c228 s->prefetch_data=0 2024-09-12T17:13:52.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 prepare_atomic_modification: state is not atomic. state=0x55db6d28c228 2024-09-12T17:13:52.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.027+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:52.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.031+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:52.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.031+0000 7f656918b9c0 20 olh_log_entry: epoch=3 op=3 key=c[px4JHDU9Rvij7pK.z4gLZc23KIPwb5P] 2024-09-12T17:13:52.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.031+0000 7f656918b9c0 20 get_obj_state: octx=0x55db6d1e8930 obj=check-bucket:_:px4JHDU9Rvij7pK.z4gLZc23KIPwb5P_c state=0x55db6d296418 s->prefetch_data=0 2024-09-12T17:13:52.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.031+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:52.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.031+0000 7f656918b9c0 10 manifest: total_size = 22 2024-09-12T17:13:52.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.031+0000 7f656918b9c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12310659557357932411 2024-09-12T17:13:52.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.031+0000 7f656918b9c0 20 get_obj_state: octx=0x55db6d1e8930 obj=check-bucket:_:px4JHDU9Rvij7pK.z4gLZc23KIPwb5P_c state=0x55db6d296418 s->prefetch_data=0 2024-09-12T17:13:52.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.031+0000 7f656918b9c0 20 prepare_atomic_modification: state is not atomic. state=0x55db6d296418 2024-09-12T17:13:52.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.031+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:52.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.031+0000 7f656918b9c0 20 olh_log_entry: epoch=3 op=3 key=d[4Bv9jvZofb-S6IvriPnIprgdIbdF8bo] 2024-09-12T17:13:52.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.031+0000 7f656918b9c0 20 get_obj_state: octx=0x55db6cf3e5e0 obj=check-bucket:_:4Bv9jvZofb-S6IvriPnIprgdIbdF8bo_d state=0x55db6d29dcd8 s->prefetch_data=0 2024-09-12T17:13:52.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.035+0000 7f656918b9c0 10 manifest: total_size = 22 2024-09-12T17:13:52.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.035+0000 7f656918b9c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2675196977677700260 2024-09-12T17:13:52.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.035+0000 7f656918b9c0 20 get_obj_state: octx=0x55db6cf3e5e0 obj=check-bucket:_:4Bv9jvZofb-S6IvriPnIprgdIbdF8bo_d state=0x55db6d29dcd8 s->prefetch_data=0 2024-09-12T17:13:52.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.035+0000 7f656918b9c0 20 prepare_atomic_modification: state is not atomic. state=0x55db6d29dcd8 2024-09-12T17:13:52.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.035+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:52.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.035+0000 7f656918b9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:13:52.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.035+0000 7f656918b9c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:13:52.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.035+0000 7f656918b9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:13:52.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.035+0000 7f656918b9c0 5 delete_objs_inline: removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2__shadow:wcaWa2kqU2uIetqwiYBqLVVlgZ3-Am._.eICIw0BaGnZP53Jo7pnNIa5o4tPDC1n_0 2024-09-12T17:13:52.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.035+0000 7f656918b9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:13:52.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.035+0000 7f656918b9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:13:52.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.035+0000 7f656918b9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:13:52.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.035+0000 7f656918b9c0 5 delete_objs_inline: removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2__shadow:mBo3xSOQOnnhJHp-eb2WM5E69jy6qmk_.cnwIKhPZPnZV9nctfd8661pIEv0dr-P_0 2024-09-12T17:13:52.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.035+0000 7f644a7fc640 20 handle_completion(): completion ok for obj=f[wcaWa2kqU2uIetqwiYBqLVVlgZ3-Am.] 2024-09-12T17:13:52.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.039+0000 7f644a7fc640 20 handle_completion(): completion ok for obj=e[mBo3xSOQOnnhJHp-eb2WM5E69jy6qmk] 2024-09-12T17:13:52.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.039+0000 7f656918b9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:13:52.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.039+0000 7f656918b9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:13:52.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.043+0000 7f656918b9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:13:52.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.043+0000 7f656918b9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:13:52.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.043+0000 7f656918b9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:13:52.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.043+0000 7f656918b9c0 5 delete_objs_inline: removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2__shadow:px4JHDU9Rvij7pK.z4gLZc23KIPwb5P_.wNoImaAYegKIwjE1F07cNGWnFCuniMg_0 2024-09-12T17:13:52.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.043+0000 7f656918b9c0 20 get_obj_state: octx=0x55db6d1dab30 obj=check-bucket:f state=0x55db6d1df1a8 s->prefetch_data=0 2024-09-12T17:13:52.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.043+0000 7f656918b9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qfvcypd83ckopj9h5b6eiir8sgfnr3ox 2024-09-12T17:13:52.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.043+0000 7f656918b9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:13:52.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.043+0000 7f656918b9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:13:52.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.043+0000 7f656918b9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:13:52.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.043+0000 7f656918b9c0 5 delete_objs_inline: removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2__shadow:4Bv9jvZofb-S6IvriPnIprgdIbdF8bo_.sKBKEJliOGrg7xJeGpaQhBX3u2Wf_OG_0 2024-09-12T17:13:52.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.047+0000 7f656918b9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:13:52.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.047+0000 7f6449ffb640 20 handle_completion(): completion ok for obj=c[px4JHDU9Rvij7pK.z4gLZc23KIPwb5P] 2024-09-12T17:13:52.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.047+0000 7f656918b9c0 20 get_obj_state: octx=0x55db6cf2c970 obj=check-bucket:e state=0x55db6d1d9f88 s->prefetch_data=0 2024-09-12T17:13:52.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.047+0000 7f656918b9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=58ibqrzrczkuw7ki4qb1xlml7heorvla 2024-09-12T17:13:52.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.051+0000 7f644a7fc640 20 handle_completion(): completion ok for obj=d[4Bv9jvZofb-S6IvriPnIprgdIbdF8bo] 2024-09-12T17:13:52.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.051+0000 7f656918b9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:13:52.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.051+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:52.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.051+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:52.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.051+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:52.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.051+0000 7f656918b9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:13:52.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.055+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:52.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.055+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:52.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.055+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:52.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.055+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:52.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.055+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:52.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.055+0000 7f656918b9c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T17:13:52.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.059+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:52.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.059+0000 7f656918b9c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T17:13:52.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.059+0000 7f656918b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:52.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.059+0000 7f656918b9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:13:52.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.059+0000 7f656918b9c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:13:52.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.059+0000 7f641dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:52.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.067+0000 7f656918b9c0 20 remove_watcher() i=0 2024-09-12T17:13:52.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.067+0000 7f656918b9c0 2 removed watcher, disabling cache 2024-09-12T17:13:52.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.067+0000 7f656918b9c0 20 remove_watcher() i=1 2024-09-12T17:13:52.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.071+0000 7f656918b9c0 20 remove_watcher() i=2 2024-09-12T17:13:52.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.071+0000 7f656918b9c0 20 remove_watcher() i=3 2024-09-12T17:13:52.078 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.075+0000 7f656918b9c0 20 remove_watcher() i=4 2024-09-12T17:13:52.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.079+0000 7f656918b9c0 20 remove_watcher() i=5 2024-09-12T17:13:52.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.079+0000 7f656918b9c0 20 remove_watcher() i=6 2024-09-12T17:13:52.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.079+0000 7f656918b9c0 20 remove_watcher() i=7 2024-09-12T17:13:52.268 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T17:13:52.269 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:52.676 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T17:13:52.677 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:52.677 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:13:52.715 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:52.715 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:52.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.759+0000 7f422c7f29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:52.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.759+0000 7f422c7f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:52.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.759+0000 7f422c7f29c0 20 realm 2024-09-12T17:13:52.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.759+0000 7f422c7f29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:52.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.759+0000 7f422c7f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:52.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.759+0000 7f422c7f29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:52.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.759+0000 7f422c7f29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:52.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.759+0000 7f422c7f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:52.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.759+0000 7f422c7f29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:52.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.763+0000 7f422c7f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:52.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.763+0000 7f422c7f29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:52.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.763+0000 7f422c7f29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:52.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.763+0000 7f422c7f29c0 20 searching for the correct realm 2024-09-12T17:13:52.770 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.767+0000 7f422aaf9640 0 -- 172.21.15.119:0/2903113905 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f422003a070 msgr2=0x7f422002c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:52.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:52.983+0000 7f4229af7640 0 -- 172.21.15.119:0/2903113905 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f42240c9070 msgr2=0x7f42240feb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:53.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:53.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:53.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:53.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:53.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:53.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:53.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:53.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:53.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:53.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:53.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:53.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:53.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 zone default found 2024-09-12T17:13:53.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 4 Realm: () 2024-09-12T17:13:53.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:53.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:53.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:53.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 zonegroup default 2024-09-12T17:13:53.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:53.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:53.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.203+0000 7f422c7f29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:53.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.207+0000 7f422c7f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:53.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.207+0000 7f422c7f29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:53.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.207+0000 7f422c7f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:53.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.207+0000 7f422c7f29c0 20 started sync module instance, tier type = 2024-09-12T17:13:53.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.207+0000 7f422c7f29c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:53.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.227+0000 7f422c7f29c0 20 add_watcher() i=0 2024-09-12T17:13:53.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.227+0000 7f422c7f29c0 20 add_watcher() i=1 2024-09-12T17:13:53.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.227+0000 7f422c7f29c0 20 add_watcher() i=2 2024-09-12T17:13:53.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.227+0000 7f422c7f29c0 20 add_watcher() i=3 2024-09-12T17:13:53.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.227+0000 7f422c7f29c0 20 add_watcher() i=4 2024-09-12T17:13:53.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.227+0000 7f422c7f29c0 20 add_watcher() i=5 2024-09-12T17:13:53.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.227+0000 7f422c7f29c0 20 add_watcher() i=6 2024-09-12T17:13:53.234 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.231+0000 7f422c7f29c0 20 add_watcher() i=7 2024-09-12T17:13:53.234 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.231+0000 7f422c7f29c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:53.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.235+0000 7f40e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:53.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.235+0000 7f422c7f29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:53.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.235+0000 7f422c7f29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:53.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.235+0000 7f422c7f29c0 5 note: GC not initialized 2024-09-12T17:13:53.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.235+0000 7f40db7fe640 20 reqs_thread_entry: start 2024-09-12T17:13:53.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.235+0000 7f422c7f29c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:53.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.235+0000 7f422c7f29c0 20 Filter name: none 2024-09-12T17:13:53.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.235+0000 7f40d97fa640 20 reqs_thread_entry: start 2024-09-12T17:13:53.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.235+0000 7f422c7f29c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:13:53.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.235+0000 7f422c7f29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:53.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.239+0000 7f422c7f29c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:53.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.239+0000 7f422c7f29c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:13:53.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.239+0000 7f422c7f29c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:13:53.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.239+0000 7f422c7f29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 : miss 2024-09-12T17:13:53.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.239+0000 7f422c7f29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:53.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.239+0000 7f422c7f29c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:53.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.239+0000 7f422c7f29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 info.flags=0x17 2024-09-12T17:13:53.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.239+0000 7f422c7f29c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 to cache LRU end 2024-09-12T17:13:53.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.239+0000 7f422c7f29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:53.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.239+0000 7f422c7f29c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:13:53.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.239+0000 7f422c7f29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 2024-09-12T17:13:53.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.239+0000 7f422c7f29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:13:53.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.239+0000 7f422c7f29c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:13:53.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.239+0000 7f422c7f29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:53.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.239+0000 7f422c7f29c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:13:53.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.239+0000 7f422c7f29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:13:53.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.243+0000 7f422c7f29c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:13:53.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.243+0000 7f422c7f29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:13:53.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.243+0000 7f422c7f29c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:13:53.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.243+0000 7f422c7f29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:13:53.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.243+0000 7f422c7f29c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:13:53.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.243+0000 7f422c7f29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:53.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.243+0000 7f422c7f29c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:13:53.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.243+0000 7f422c7f29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:13:53.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.247+0000 7f422c7f29c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:13:53.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.247+0000 7f422c7f29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:13:53.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.247+0000 7f422c7f29c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:13:53.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.247+0000 7f422c7f29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:53.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.247+0000 7f422c7f29c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:13:53.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.247+0000 7f422c7f29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:13:53.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.247+0000 7f422c7f29c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:13:53.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.247+0000 7f422c7f29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:53.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.247+0000 7f422c7f29c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:13:53.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.247+0000 7f422c7f29c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:13:53.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.247+0000 7f40e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:53.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.255+0000 7f422c7f29c0 20 remove_watcher() i=0 2024-09-12T17:13:53.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.255+0000 7f422c7f29c0 2 removed watcher, disabling cache 2024-09-12T17:13:53.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.255+0000 7f422c7f29c0 20 remove_watcher() i=1 2024-09-12T17:13:53.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.259+0000 7f422c7f29c0 20 remove_watcher() i=2 2024-09-12T17:13:53.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.263+0000 7f422c7f29c0 20 remove_watcher() i=3 2024-09-12T17:13:53.267 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.263+0000 7f422c7f29c0 20 remove_watcher() i=4 2024-09-12T17:13:53.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.267+0000 7f422c7f29c0 20 remove_watcher() i=5 2024-09-12T17:13:53.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.267+0000 7f422c7f29c0 20 remove_watcher() i=6 2024-09-12T17:13:53.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.271+0000 7f422c7f29c0 20 remove_watcher() i=7 2024-09-12T17:13:53.762 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:13:53.796 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:53.796 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:53.843 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.838+0000 7f6297ba69c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:53.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.842+0000 7f6297ba69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:53.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.842+0000 7f6297ba69c0 20 realm 2024-09-12T17:13:53.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.842+0000 7f6297ba69c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:53.846 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.842+0000 7f6297ba69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:53.846 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.842+0000 7f6297ba69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:53.846 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.842+0000 7f6297ba69c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:53.846 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.842+0000 7f6297ba69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:53.846 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.842+0000 7f6297ba69c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:53.848 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.842+0000 7f6297ba69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:53.848 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.842+0000 7f6297ba69c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:53.850 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.846+0000 7f6297ba69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:53.850 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.846+0000 7f6297ba69c0 20 searching for the correct realm 2024-09-12T17:13:53.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:53.846+0000 7f6294eab640 0 -- 172.21.15.119:0/1723809727 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f6288033420 msgr2=0x7f6288033880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:54.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.062+0000 7f6295ead640 0 -- 172.21.15.119:0/1723809727 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f628c06a040 msgr2=0x7f628c062680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:54.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:54.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:54.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:54.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:54.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:54.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:54.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:54.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:54.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 20 zone default found 2024-09-12T17:13:54.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 4 Realm: () 2024-09-12T17:13:54.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:54.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:54.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:54.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 20 zonegroup default 2024-09-12T17:13:54.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.078+0000 7f6297ba69c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.082+0000 7f6297ba69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.082+0000 7f6297ba69c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.082+0000 7f6297ba69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.082+0000 7f6297ba69c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.082+0000 7f6297ba69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.082+0000 7f6297ba69c0 20 started sync module instance, tier type = 2024-09-12T17:13:54.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.082+0000 7f6297ba69c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:54.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.106+0000 7f6297ba69c0 20 add_watcher() i=0 2024-09-12T17:13:54.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.106+0000 7f6297ba69c0 20 add_watcher() i=1 2024-09-12T17:13:54.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.106+0000 7f6297ba69c0 20 add_watcher() i=2 2024-09-12T17:13:54.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.106+0000 7f6297ba69c0 20 add_watcher() i=3 2024-09-12T17:13:54.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.106+0000 7f6297ba69c0 20 add_watcher() i=4 2024-09-12T17:13:54.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.106+0000 7f6297ba69c0 20 add_watcher() i=5 2024-09-12T17:13:54.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.106+0000 7f6297ba69c0 20 add_watcher() i=6 2024-09-12T17:13:54.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.106+0000 7f6297ba69c0 20 add_watcher() i=7 2024-09-12T17:13:54.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.106+0000 7f6297ba69c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:54.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.110+0000 7f614b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:54.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.110+0000 7f6297ba69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:54.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.110+0000 7f6297ba69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:54.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.114+0000 7f6297ba69c0 5 note: GC not initialized 2024-09-12T17:13:54.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.114+0000 7f614a7e4640 20 reqs_thread_entry: start 2024-09-12T17:13:54.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.114+0000 7f6297ba69c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:54.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.114+0000 7f6297ba69c0 20 Filter name: none 2024-09-12T17:13:54.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.114+0000 7f60bbfff640 20 reqs_thread_entry: start 2024-09-12T17:13:54.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.114+0000 7f6297ba69c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.114+0000 7f6297ba69c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:54.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.114+0000 7f6297ba69c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.114+0000 7f6297ba69c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:54.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.114+0000 7f6297ba69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:13:54.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.114+0000 7f6297ba69c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:13:54.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.114+0000 7f6297ba69c0 20 INFO: main: starting shard=0 2024-09-12T17:13:54.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.114+0000 7f6297ba69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:13:54.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.118+0000 7f6297ba69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.118+0000 7f6297ba69c0 20 INFO: main: starting shard=1 2024-09-12T17:13:54.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.118+0000 7f6297ba69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:54.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.118+0000 7f6297ba69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.118+0000 7f6297ba69c0 20 INFO: main: starting shard=2 2024-09-12T17:13:54.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.118+0000 7f6297ba69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:13:54.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.118+0000 7f6297ba69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.118+0000 7f6297ba69c0 20 INFO: main: starting shard=3 2024-09-12T17:13:54.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.118+0000 7f6297ba69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:13:54.124 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.118+0000 7f6297ba69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.124 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.118+0000 7f6297ba69c0 20 INFO: main: starting shard=4 2024-09-12T17:13:54.124 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.118+0000 7f6297ba69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:13:54.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.122+0000 7f6297ba69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.122+0000 7f6297ba69c0 20 INFO: main: starting shard=5 2024-09-12T17:13:54.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.122+0000 7f6297ba69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:54.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.122+0000 7f6297ba69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.122+0000 7f6297ba69c0 20 INFO: main: starting shard=6 2024-09-12T17:13:54.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.122+0000 7f6297ba69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:13:54.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.122+0000 7f6297ba69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.122+0000 7f6297ba69c0 20 INFO: main: starting shard=7 2024-09-12T17:13:54.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.122+0000 7f6297ba69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:13:54.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.126+0000 7f6297ba69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.126+0000 7f6297ba69c0 20 INFO: main: starting shard=8 2024-09-12T17:13:54.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.126+0000 7f6297ba69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:54.130 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.126+0000 7f6297ba69c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:13:54.130 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.126+0000 7f6297ba69c0 20 INFO: main: starting shard=9 2024-09-12T17:13:54.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.126+0000 7f6297ba69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:13:54.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.126+0000 7f6297ba69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.126+0000 7f6297ba69c0 20 INFO: main: starting shard=10 2024-09-12T17:13:54.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.126+0000 7f6297ba69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:54.132 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.130+0000 7f6297ba69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.132 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.130+0000 7f6297ba69c0 20 INFO: main: done 2024-09-12T17:13:54.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.130+0000 7f614b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:54.139 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.134+0000 7f6297ba69c0 20 remove_watcher() i=0 2024-09-12T17:13:54.139 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.134+0000 7f6297ba69c0 2 removed watcher, disabling cache 2024-09-12T17:13:54.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.138+0000 7f6297ba69c0 20 remove_watcher() i=1 2024-09-12T17:13:54.144 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.142+0000 7f6297ba69c0 20 remove_watcher() i=2 2024-09-12T17:13:54.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.142+0000 7f6297ba69c0 20 remove_watcher() i=3 2024-09-12T17:13:54.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.146+0000 7f6297ba69c0 20 remove_watcher() i=4 2024-09-12T17:13:54.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.146+0000 7f6297ba69c0 20 remove_watcher() i=5 2024-09-12T17:13:54.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.150+0000 7f6297ba69c0 20 remove_watcher() i=6 2024-09-12T17:13:54.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.150+0000 7f6297ba69c0 20 remove_watcher() i=7 2024-09-12T17:13:54.178 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:13:54.211 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:54.211 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:54.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.254+0000 7f425502f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.254+0000 7f425502f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.254+0000 7f425502f9c0 20 realm 2024-09-12T17:13:54.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.254+0000 7f425502f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.254+0000 7f425502f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.254+0000 7f425502f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:54.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.254+0000 7f425502f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.254+0000 7f425502f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.254+0000 7f425502f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.258+0000 7f425502f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:54.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.258+0000 7f425502f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.263 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.258+0000 7f425502f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:54.263 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.258+0000 7f425502f9c0 20 searching for the correct realm 2024-09-12T17:13:54.267 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.262+0000 7f4253336640 0 -- 172.21.15.119:0/3976075388 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x5602964dc510 msgr2=0x5602964de900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:54.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.270+0000 7f4252334640 0 -- 172.21.15.119:0/3976075388 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f424c0e2920 msgr2=0x7f424c0c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:13:54.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.486+0000 7f425502f9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:54.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.486+0000 7f425502f9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:54.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.486+0000 7f425502f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:54.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.486+0000 7f425502f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:54.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.486+0000 7f425502f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:54.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.486+0000 7f425502f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:54.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.486+0000 7f425502f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.486+0000 7f425502f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.486+0000 7f425502f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.490+0000 7f425502f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:54.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.490+0000 7f425502f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.490+0000 7f425502f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:54.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.490+0000 7f425502f9c0 20 zone default found 2024-09-12T17:13:54.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.490+0000 7f425502f9c0 4 Realm: () 2024-09-12T17:13:54.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.490+0000 7f425502f9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:54.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.490+0000 7f425502f9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:54.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.490+0000 7f425502f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:54.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.490+0000 7f425502f9c0 20 zonegroup default 2024-09-12T17:13:54.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.490+0000 7f425502f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.490+0000 7f425502f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.490+0000 7f425502f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.490+0000 7f425502f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.490+0000 7f425502f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.494+0000 7f425502f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.494+0000 7f425502f9c0 20 started sync module instance, tier type = 2024-09-12T17:13:54.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.494+0000 7f425502f9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:54.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.518+0000 7f425502f9c0 20 add_watcher() i=0 2024-09-12T17:13:54.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.518+0000 7f425502f9c0 20 add_watcher() i=1 2024-09-12T17:13:54.523 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.518+0000 7f425502f9c0 20 add_watcher() i=2 2024-09-12T17:13:54.523 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.518+0000 7f425502f9c0 20 add_watcher() i=3 2024-09-12T17:13:54.523 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.518+0000 7f425502f9c0 20 add_watcher() i=4 2024-09-12T17:13:54.523 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.518+0000 7f425502f9c0 20 add_watcher() i=5 2024-09-12T17:13:54.523 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.518+0000 7f425502f9c0 20 add_watcher() i=6 2024-09-12T17:13:54.524 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.518+0000 7f425502f9c0 20 add_watcher() i=7 2024-09-12T17:13:54.525 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.518+0000 7f425502f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:54.529 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.526+0000 7f41097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:54.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.526+0000 7f425502f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:54.531 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.526+0000 7f425502f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:54.531 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.526+0000 7f425502f9c0 5 note: GC not initialized 2024-09-12T17:13:54.531 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.526+0000 7f4083fff640 20 reqs_thread_entry: start 2024-09-12T17:13:54.531 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.526+0000 7f425502f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:54.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.526+0000 7f425502f9c0 20 Filter name: none 2024-09-12T17:13:54.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.526+0000 7f4081ffb640 20 reqs_thread_entry: start 2024-09-12T17:13:54.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.526+0000 7f425502f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.530+0000 7f425502f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:54.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.530+0000 7f425502f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.530+0000 7f425502f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:54.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.530+0000 7f425502f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:13:54.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.530+0000 7f425502f9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:13:54.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.530+0000 7f425502f9c0 20 INFO: main: starting shard=0 2024-09-12T17:13:54.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.530+0000 7f425502f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:13:54.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.530+0000 7f425502f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.530+0000 7f425502f9c0 20 INFO: main: starting shard=1 2024-09-12T17:13:54.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.530+0000 7f425502f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:54.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.534+0000 7f425502f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.534+0000 7f425502f9c0 20 INFO: main: starting shard=2 2024-09-12T17:13:54.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.534+0000 7f425502f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:13:54.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.534+0000 7f425502f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.534+0000 7f425502f9c0 20 INFO: main: starting shard=3 2024-09-12T17:13:54.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.534+0000 7f425502f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:13:54.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.534+0000 7f425502f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.534+0000 7f425502f9c0 20 INFO: main: starting shard=4 2024-09-12T17:13:54.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.534+0000 7f425502f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:13:54.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.538+0000 7f425502f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.538+0000 7f425502f9c0 20 INFO: main: starting shard=5 2024-09-12T17:13:54.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.538+0000 7f425502f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:54.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.538+0000 7f425502f9c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:13:54.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.538+0000 7f425502f9c0 20 INFO: main: starting shard=6 2024-09-12T17:13:54.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.538+0000 7f425502f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:13:54.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.538+0000 7f425502f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.538+0000 7f425502f9c0 20 INFO: main: starting shard=7 2024-09-12T17:13:54.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.538+0000 7f425502f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:13:54.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.538+0000 7f425502f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.538+0000 7f425502f9c0 20 INFO: main: starting shard=8 2024-09-12T17:13:54.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.538+0000 7f425502f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:54.544 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.538+0000 7f425502f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.544 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.538+0000 7f425502f9c0 20 INFO: main: starting shard=9 2024-09-12T17:13:54.544 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.538+0000 7f425502f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:13:54.544 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.542+0000 7f425502f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.545 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.542+0000 7f425502f9c0 20 INFO: main: starting shard=10 2024-09-12T17:13:54.545 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.542+0000 7f425502f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:54.545 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.542+0000 7f425502f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:54.545 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.542+0000 7f425502f9c0 20 INFO: main: done 2024-09-12T17:13:54.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.542+0000 7f41097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:54.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.550+0000 7f425502f9c0 20 remove_watcher() i=0 2024-09-12T17:13:54.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.550+0000 7f425502f9c0 2 removed watcher, disabling cache 2024-09-12T17:13:54.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.550+0000 7f425502f9c0 20 remove_watcher() i=1 2024-09-12T17:13:54.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.554+0000 7f425502f9c0 20 remove_watcher() i=2 2024-09-12T17:13:54.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.554+0000 7f425502f9c0 20 remove_watcher() i=3 2024-09-12T17:13:54.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.558+0000 7f425502f9c0 20 remove_watcher() i=4 2024-09-12T17:13:54.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.558+0000 7f425502f9c0 20 remove_watcher() i=5 2024-09-12T17:13:54.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.562+0000 7f425502f9c0 20 remove_watcher() i=6 2024-09-12T17:13:54.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.562+0000 7f425502f9c0 20 remove_watcher() i=7 2024-09-12T17:13:54.583 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T17:13:54.583 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:54.583 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:13:54.613 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:54.613 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:54.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.654+0000 7f2e0b1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.658+0000 7f2e0b1709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.658+0000 7f2e0b1709c0 20 realm 2024-09-12T17:13:54.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.658+0000 7f2e0b1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.658+0000 7f2e0b1709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.658+0000 7f2e0b1709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:54.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.658+0000 7f2e0b1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.658+0000 7f2e0b1709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.658+0000 7f2e0b1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.658+0000 7f2e0b1709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:54.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.658+0000 7f2e0b1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.662+0000 7f2e0b1709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:54.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.662+0000 7f2e0b1709c0 20 searching for the correct realm 2024-09-12T17:13:54.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.662+0000 7f2e09477640 0 -- 172.21.15.119:0/1865657097 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f2df80bf070 msgr2=0x7f2df8118a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:54.882 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:54.878+0000 7f2e08475640 0 -- 172.21.15.119:0/1865657097 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f2e00040c10 msgr2=0x7f2e0004e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:55.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.094+0000 7f2e0b1709c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:55.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.094+0000 7f2e0b1709c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:55.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.094+0000 7f2e0b1709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:55.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.094+0000 7f2e0b1709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:55.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.094+0000 7f2e0b1709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:55.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.094+0000 7f2e0b1709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:55.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.094+0000 7f2e0b1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.098+0000 7f2e0b1709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.098+0000 7f2e0b1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.098+0000 7f2e0b1709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:55.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.098+0000 7f2e0b1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.098+0000 7f2e0b1709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:55.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.098+0000 7f2e0b1709c0 20 zone default found 2024-09-12T17:13:55.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.098+0000 7f2e0b1709c0 4 Realm: () 2024-09-12T17:13:55.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.098+0000 7f2e0b1709c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:55.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.098+0000 7f2e0b1709c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:55.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.098+0000 7f2e0b1709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:55.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.098+0000 7f2e0b1709c0 20 zonegroup default 2024-09-12T17:13:55.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.098+0000 7f2e0b1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.098+0000 7f2e0b1709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.098+0000 7f2e0b1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.102+0000 7f2e0b1709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.102+0000 7f2e0b1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.102+0000 7f2e0b1709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.102+0000 7f2e0b1709c0 20 started sync module instance, tier type = 2024-09-12T17:13:55.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.102+0000 7f2e0b1709c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:55.130 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.126+0000 7f2e0b1709c0 20 add_watcher() i=0 2024-09-12T17:13:55.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.126+0000 7f2e0b1709c0 20 add_watcher() i=1 2024-09-12T17:13:55.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.126+0000 7f2e0b1709c0 20 add_watcher() i=2 2024-09-12T17:13:55.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.126+0000 7f2e0b1709c0 20 add_watcher() i=3 2024-09-12T17:13:55.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.126+0000 7f2e0b1709c0 20 add_watcher() i=4 2024-09-12T17:13:55.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.126+0000 7f2e0b1709c0 20 add_watcher() i=5 2024-09-12T17:13:55.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.126+0000 7f2e0b1709c0 20 add_watcher() i=6 2024-09-12T17:13:55.133 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.130+0000 7f2e0b1709c0 20 add_watcher() i=7 2024-09-12T17:13:55.133 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.130+0000 7f2e0b1709c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:55.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.134+0000 7f2cbefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:55.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.134+0000 7f2e0b1709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:55.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.134+0000 7f2e0b1709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:55.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.134+0000 7f2e0b1709c0 5 note: GC not initialized 2024-09-12T17:13:55.139 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.134+0000 7f2cbdfe3640 20 reqs_thread_entry: start 2024-09-12T17:13:55.139 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.134+0000 7f2e0b1709c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:55.139 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.134+0000 7f2e0b1709c0 20 Filter name: none 2024-09-12T17:13:55.139 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.134+0000 7f2c2f7fe640 20 reqs_thread_entry: start 2024-09-12T17:13:55.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.134+0000 7f2e0b1709c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:13:55.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.134+0000 7f2e0b1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.134+0000 7f2e0b1709c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:55.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.134+0000 7f2e0b1709c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:13:55.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.134+0000 7f2e0b1709c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:13:55.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.134+0000 7f2e0b1709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 : miss 2024-09-12T17:13:55.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.134+0000 7f2e0b1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.138+0000 7f2e0b1709c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:55.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.138+0000 7f2e0b1709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 info.flags=0x17 2024-09-12T17:13:55.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.138+0000 7f2e0b1709c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 to cache LRU end 2024-09-12T17:13:55.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.138+0000 7f2e0b1709c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:55.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.138+0000 7f2e0b1709c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:13:55.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.138+0000 7f2e0b1709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 2024-09-12T17:13:55.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.138+0000 7f2e0b1709c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:13:55.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.138+0000 7f2e0b1709c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:13:55.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.138+0000 7f2e0b1709c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:55.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.138+0000 7f2e0b1709c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:13:55.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.138+0000 7f2e0b1709c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:13:55.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.142+0000 7f2e0b1709c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:13:55.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.142+0000 7f2e0b1709c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:13:55.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.142+0000 7f2e0b1709c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:13:55.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.142+0000 7f2e0b1709c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:13:55.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.142+0000 7f2e0b1709c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:13:55.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.142+0000 7f2e0b1709c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:55.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.142+0000 7f2e0b1709c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T17:13:55.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.142+0000 7f2e0b1709c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:13:55.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.146+0000 7f2e0b1709c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:13:55.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.146+0000 7f2e0b1709c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:13:55.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.146+0000 7f2e0b1709c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:13:55.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.146+0000 7f2e0b1709c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:55.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.146+0000 7f2e0b1709c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T17:13:55.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.146+0000 7f2e0b1709c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:13:55.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.146+0000 7f2e0b1709c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:13:55.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.146+0000 7f2e0b1709c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:55.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.146+0000 7f2e0b1709c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:13:55.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.146+0000 7f2e0b1709c0 1 NOTICE: finished all shards (2 entries found) 2024-09-12T17:13:55.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.150+0000 7f2cbefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:55.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.154+0000 7f2e0b1709c0 20 remove_watcher() i=0 2024-09-12T17:13:55.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.154+0000 7f2e0b1709c0 2 removed watcher, disabling cache 2024-09-12T17:13:55.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.158+0000 7f2e0b1709c0 20 remove_watcher() i=1 2024-09-12T17:13:55.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.158+0000 7f2e0b1709c0 20 remove_watcher() i=2 2024-09-12T17:13:55.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.162+0000 7f2e0b1709c0 20 remove_watcher() i=3 2024-09-12T17:13:55.167 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.162+0000 7f2e0b1709c0 20 remove_watcher() i=4 2024-09-12T17:13:55.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.166+0000 7f2e0b1709c0 20 remove_watcher() i=5 2024-09-12T17:13:55.171 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.166+0000 7f2e0b1709c0 20 remove_watcher() i=6 2024-09-12T17:13:55.172 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.166+0000 7f2e0b1709c0 20 remove_watcher() i=7 2024-09-12T17:13:55.187 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T17:13:55.188 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:55.188 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:13:55.223 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:55.223 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:55.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.266+0000 7f3d1f1d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.270+0000 7f3d1f1d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.270+0000 7f3d1f1d09c0 20 realm 2024-09-12T17:13:55.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.270+0000 7f3d1f1d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.270+0000 7f3d1f1d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.270+0000 7f3d1f1d09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:55.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.270+0000 7f3d1f1d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.270+0000 7f3d1f1d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.270+0000 7f3d1f1d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.270+0000 7f3d1f1d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:55.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.270+0000 7f3d1f1d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.274+0000 7f3d1f1d09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:55.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.274+0000 7f3d1f1d09c0 20 searching for the correct realm 2024-09-12T17:13:55.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.274+0000 7f3d1d4d7640 0 -- 172.21.15.119:0/2329132793 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f3d040dd030 msgr2=0x7f3d041358f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:55.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.490+0000 7f3d1c4d5640 0 -- 172.21.15.119:0/2329132793 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f3d0c008050 msgr2=0x7f3d0c065990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:55.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.706+0000 7f3d1f1d09c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:55.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.706+0000 7f3d1f1d09c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:55.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.706+0000 7f3d1f1d09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:55.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.706+0000 7f3d1f1d09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:55.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.706+0000 7f3d1f1d09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:55.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.706+0000 7f3d1f1d09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:55.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.706+0000 7f3d1f1d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.706+0000 7f3d1f1d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.706+0000 7f3d1f1d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:55.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:55.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 20 zone default found 2024-09-12T17:13:55.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 4 Realm: () 2024-09-12T17:13:55.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:55.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:55.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:55.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 20 zonegroup default 2024-09-12T17:13:55.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 20 started sync module instance, tier type = 2024-09-12T17:13:55.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.710+0000 7f3d1f1d09c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:55.741 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.738+0000 7f3d1f1d09c0 20 add_watcher() i=0 2024-09-12T17:13:55.741 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.738+0000 7f3d1f1d09c0 20 add_watcher() i=1 2024-09-12T17:13:55.741 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.738+0000 7f3d1f1d09c0 20 add_watcher() i=2 2024-09-12T17:13:55.741 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.738+0000 7f3d1f1d09c0 20 add_watcher() i=3 2024-09-12T17:13:55.741 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.738+0000 7f3d1f1d09c0 20 add_watcher() i=4 2024-09-12T17:13:55.741 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.738+0000 7f3d1f1d09c0 20 add_watcher() i=5 2024-09-12T17:13:55.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.738+0000 7f3d1f1d09c0 20 add_watcher() i=6 2024-09-12T17:13:55.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.738+0000 7f3d1f1d09c0 20 add_watcher() i=7 2024-09-12T17:13:55.744 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.738+0000 7f3d1f1d09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:55.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.746+0000 7f3bd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:55.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.746+0000 7f3d1f1d09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:55.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.746+0000 7f3d1f1d09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:55.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.746+0000 7f3d1f1d09c0 5 note: GC not initialized 2024-09-12T17:13:55.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.746+0000 7f3bd27e4640 20 reqs_thread_entry: start 2024-09-12T17:13:55.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.746+0000 7f3d1f1d09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:55.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.746+0000 7f3d1f1d09c0 20 Filter name: none 2024-09-12T17:13:55.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.746+0000 7f3bcb7fe640 20 reqs_thread_entry: start 2024-09-12T17:13:55.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.746+0000 7f3d1f1d09c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:13:55.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.746+0000 7f3d1f1d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.746+0000 7f3d1f1d09c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:55.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.746+0000 7f3d1f1d09c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:13:55.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.746+0000 7f3d1f1d09c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:13:55.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.746+0000 7f3d1f1d09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 : miss 2024-09-12T17:13:55.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.746+0000 7f3d1f1d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.750+0000 7f3d1f1d09c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:55.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.750+0000 7f3d1f1d09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 info.flags=0x17 2024-09-12T17:13:55.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.750+0000 7f3d1f1d09c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 to cache LRU end 2024-09-12T17:13:55.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.750+0000 7f3d1f1d09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:55.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.750+0000 7f3d1f1d09c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:13:55.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.750+0000 7f3d1f1d09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 2024-09-12T17:13:55.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.750+0000 7f3d1f1d09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:13:55.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.750+0000 7f3d1f1d09c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:13:55.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.750+0000 7f3d1f1d09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:55.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.750+0000 7f3d1f1d09c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T17:13:55.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.750+0000 7f3d1f1d09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:13:55.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.754+0000 7f3d1f1d09c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:13:55.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.754+0000 7f3d1f1d09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:13:55.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.754+0000 7f3d1f1d09c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:13:55.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.754+0000 7f3d1f1d09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:13:55.759 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.754+0000 7f3d1f1d09c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:13:55.759 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.754+0000 7f3d1f1d09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:55.761 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.758+0000 7f3d1f1d09c0 20 get_obj_state: octx=0x55d01d176960 obj=check-bucket:d state=0x55d01d429038 s->prefetch_data=0 2024-09-12T17:13:55.761 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.758+0000 7f3d1f1d09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:13:55.761 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.758+0000 7f3d1f1d09c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:13:55.761 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.758+0000 7f3d1f1d09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:13:55.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.758+0000 7f3d1f1d09c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:13:55.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.758+0000 7f3d1f1d09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:55.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.758+0000 7f3d1f1d09c0 20 get_obj_state: octx=0x55d01d1885d0 obj=check-bucket:c state=0x55d01d429b98 s->prefetch_data=0 2024-09-12T17:13:55.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.758+0000 7f3d1f1d09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:13:55.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.758+0000 7f3d1f1d09c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:13:55.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.758+0000 7f3d1f1d09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:55.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.762+0000 7f3d1f1d09c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T17:13:55.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.762+0000 7f3d1f1d09c0 20 get_obj_state: setting s->obj_tag to ip1brbz06qeda8uwxp0xvgw3uxtkox9y 2024-09-12T17:13:55.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.762+0000 7f3d1f1d09c0 20 get_obj_state_impl: setting s->olh_tag to viqc4y9f6bavkinh810suugjlfwouvdk 2024-09-12T17:13:55.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.762+0000 7f3d1f1d09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:55.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.762+0000 7f3d1f1d09c0 20 get_obj_state: setting s->obj_tag to cksy3af32w7hbek9tdb58ix40upz2tds 2024-09-12T17:13:55.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.762+0000 7f3d1f1d09c0 20 get_obj_state_impl: setting s->olh_tag to k2hirwlsdbq2r7azfoyw5ezamkp15sfy 2024-09-12T17:13:55.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.762+0000 7f3d1f1d09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:55.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.762+0000 7f3d1f1d09c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T17:13:55.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.762+0000 7f3d1f1d09c0 20 olh_log_entry: epoch=4 op=3 key=c[LLREQ.C6Vqhuyq4iyXjfM4VUuVugYmt] 2024-09-12T17:13:55.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.762+0000 7f3d1f1d09c0 20 get_obj_state: octx=0x55d01d475ea0 obj=check-bucket:_:LLREQ.C6Vqhuyq4iyXjfM4VUuVugYmt_c state=0x55d01d479928 s->prefetch_data=0 2024-09-12T17:13:55.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.762+0000 7f3d1f1d09c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T17:13:55.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.762+0000 7f3d1f1d09c0 20 olh_log_entry: epoch=4 op=3 key=d[eIU8SPmdER4ek2tQstmV3OnntjxXKzz] 2024-09-12T17:13:55.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.762+0000 7f3d1f1d09c0 20 get_obj_state: octx=0x55d01d455ea0 obj=check-bucket:_:eIU8SPmdER4ek2tQstmV3OnntjxXKzz_d state=0x55d01d479928 s->prefetch_data=0 2024-09-12T17:13:55.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.766+0000 7f3d1f1d09c0 20 get_obj_state: octx=0x55d01d475ea0 obj=check-bucket:c state=0x55d01d426c08 s->prefetch_data=0 2024-09-12T17:13:55.770 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.766+0000 7f3d1f1d09c0 20 get_obj_state: setting s->obj_tag to cksy3af32w7hbek9tdb58ix40upz2tds 2024-09-12T17:13:55.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.766+0000 7f3d1f1d09c0 20 get_obj_state_impl: setting s->olh_tag to k2hirwlsdbq2r7azfoyw5ezamkp15sfy 2024-09-12T17:13:55.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.766+0000 7f3d1f1d09c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=k2hirwlsdbq2r7azfoyw5ezamkp15sfy 2024-09-12T17:13:55.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.766+0000 7f3d1f1d09c0 20 get_obj_state: octx=0x55d01d455ea0 obj=check-bucket:d state=0x55d01d47aef8 s->prefetch_data=0 2024-09-12T17:13:55.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.770+0000 7f3d1f1d09c0 20 get_obj_state: setting s->obj_tag to ip1brbz06qeda8uwxp0xvgw3uxtkox9y 2024-09-12T17:13:55.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.770+0000 7f3d1f1d09c0 20 get_obj_state_impl: setting s->olh_tag to viqc4y9f6bavkinh810suugjlfwouvdk 2024-09-12T17:13:55.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.770+0000 7f3d1f1d09c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=viqc4y9f6bavkinh810suugjlfwouvdk 2024-09-12T17:13:55.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.782+0000 7f3d1f1d09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:55.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.786+0000 7f3d1f1d09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:55.790 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.786+0000 7f3d1f1d09c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:13:55.793 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.790+0000 7f3d1f1d09c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:13:55.793 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.790+0000 7f3d1f1d09c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T17:13:55.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.790+0000 7f3bd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:55.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.798+0000 7f3d1f1d09c0 20 remove_watcher() i=0 2024-09-12T17:13:55.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.798+0000 7f3d1f1d09c0 2 removed watcher, disabling cache 2024-09-12T17:13:55.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.798+0000 7f3d1f1d09c0 20 remove_watcher() i=1 2024-09-12T17:13:55.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.802+0000 7f3d1f1d09c0 20 remove_watcher() i=2 2024-09-12T17:13:55.808 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.802+0000 7f3d1f1d09c0 20 remove_watcher() i=3 2024-09-12T17:13:55.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.806+0000 7f3d1f1d09c0 20 remove_watcher() i=4 2024-09-12T17:13:55.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.810+0000 7f3d1f1d09c0 20 remove_watcher() i=5 2024-09-12T17:13:55.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.810+0000 7f3d1f1d09c0 20 remove_watcher() i=6 2024-09-12T17:13:55.816 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.814+0000 7f3d1f1d09c0 20 remove_watcher() i=7 2024-09-12T17:13:55.838 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:13:55.872 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:55.872 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:55.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.914+0000 7f8e73a4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.914+0000 7f8e73a4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.914+0000 7f8e73a4f9c0 20 realm 2024-09-12T17:13:55.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.914+0000 7f8e73a4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.914+0000 7f8e73a4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.914+0000 7f8e73a4f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:55.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.914+0000 7f8e73a4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.918+0000 7f8e73a4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.922 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.918+0000 7f8e73a4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.918+0000 7f8e73a4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:55.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.918+0000 7f8e73a4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.922+0000 7f8e73a4f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:55.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.922+0000 7f8e73a4f9c0 20 searching for the correct realm 2024-09-12T17:13:55.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:55.922+0000 7f8e70d54640 0 -- 172.21.15.119:0/4141892817 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f8e64010040 msgr2=0x7f8e6405e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:13:56.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.138+0000 7f8e71d56640 0 -- 172.21.15.119:0/4141892817 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f8e68039070 msgr2=0x7f8e68047410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:56.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.154+0000 7f8e73a4f9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:56.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.154+0000 7f8e73a4f9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:56.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.154+0000 7f8e73a4f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:56.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.154+0000 7f8e73a4f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:56.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.154+0000 7f8e73a4f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:56.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.154+0000 7f8e73a4f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:56.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.154+0000 7f8e73a4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.154+0000 7f8e73a4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:56.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.154+0000 7f8e73a4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.158+0000 7f8e73a4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:56.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.158+0000 7f8e73a4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.158+0000 7f8e73a4f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:56.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.158+0000 7f8e73a4f9c0 20 zone default found 2024-09-12T17:13:56.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.158+0000 7f8e73a4f9c0 4 Realm: () 2024-09-12T17:13:56.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.158+0000 7f8e73a4f9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:56.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.158+0000 7f8e73a4f9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:56.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.158+0000 7f8e73a4f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:56.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.158+0000 7f8e73a4f9c0 20 zonegroup default 2024-09-12T17:13:56.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.158+0000 7f8e73a4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.158+0000 7f8e73a4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:56.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.158+0000 7f8e73a4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.158+0000 7f8e73a4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:56.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.158+0000 7f8e73a4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.162+0000 7f8e73a4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:56.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.162+0000 7f8e73a4f9c0 20 started sync module instance, tier type = 2024-09-12T17:13:56.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.162+0000 7f8e73a4f9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:56.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.182+0000 7f8e73a4f9c0 20 add_watcher() i=0 2024-09-12T17:13:56.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.182+0000 7f8e73a4f9c0 20 add_watcher() i=1 2024-09-12T17:13:56.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.182+0000 7f8e73a4f9c0 20 add_watcher() i=2 2024-09-12T17:13:56.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.182+0000 7f8e73a4f9c0 20 add_watcher() i=3 2024-09-12T17:13:56.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.182+0000 7f8e73a4f9c0 20 add_watcher() i=4 2024-09-12T17:13:56.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.186+0000 7f8e73a4f9c0 20 add_watcher() i=5 2024-09-12T17:13:56.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.190+0000 7f8e73a4f9c0 20 add_watcher() i=6 2024-09-12T17:13:56.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.190+0000 7f8e73a4f9c0 20 add_watcher() i=7 2024-09-12T17:13:56.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.190+0000 7f8e73a4f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:56.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.194+0000 7f8d277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:56.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.194+0000 7f8e73a4f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:56.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.194+0000 7f8e73a4f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:56.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.194+0000 7f8e73a4f9c0 5 note: GC not initialized 2024-09-12T17:13:56.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.194+0000 7f8d267e4640 20 reqs_thread_entry: start 2024-09-12T17:13:56.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.194+0000 7f8e73a4f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:56.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.194+0000 7f8e73a4f9c0 20 Filter name: none 2024-09-12T17:13:56.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.194+0000 7f8c97fff640 20 reqs_thread_entry: start 2024-09-12T17:13:56.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.194+0000 7f8e73a4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.194+0000 7f8e73a4f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:56.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.194+0000 7f8e73a4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.198+0000 7f8e73a4f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:56.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.198+0000 7f8e73a4f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:13:56.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.198+0000 7f8e73a4f9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:13:56.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.198+0000 7f8e73a4f9c0 20 INFO: main: starting shard=0 2024-09-12T17:13:56.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.198+0000 7f8e73a4f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:13:56.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.198+0000 7f8e73a4f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.198+0000 7f8e73a4f9c0 20 INFO: main: starting shard=1 2024-09-12T17:13:56.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.198+0000 7f8e73a4f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:56.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.198+0000 7f8e73a4f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.198+0000 7f8e73a4f9c0 20 INFO: main: starting shard=2 2024-09-12T17:13:56.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.198+0000 7f8e73a4f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:13:56.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.198+0000 7f8e73a4f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.198+0000 7f8e73a4f9c0 20 INFO: main: starting shard=3 2024-09-12T17:13:56.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.198+0000 7f8e73a4f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:13:56.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.202+0000 7f8e73a4f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.202+0000 7f8e73a4f9c0 20 INFO: main: starting shard=4 2024-09-12T17:13:56.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.202+0000 7f8e73a4f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:13:56.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.202+0000 7f8e73a4f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.202+0000 7f8e73a4f9c0 20 INFO: main: starting shard=5 2024-09-12T17:13:56.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.202+0000 7f8e73a4f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:56.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.202+0000 7f8e73a4f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.202+0000 7f8e73a4f9c0 20 INFO: main: starting shard=6 2024-09-12T17:13:56.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.202+0000 7f8e73a4f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:13:56.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.206+0000 7f8e73a4f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.206+0000 7f8e73a4f9c0 20 INFO: main: starting shard=7 2024-09-12T17:13:56.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.206+0000 7f8e73a4f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:13:56.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.206+0000 7f8e73a4f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.206+0000 7f8e73a4f9c0 20 INFO: main: starting shard=8 2024-09-12T17:13:56.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.206+0000 7f8e73a4f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:56.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.206+0000 7f8e73a4f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.206+0000 7f8e73a4f9c0 20 INFO: main: starting shard=9 2024-09-12T17:13:56.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.206+0000 7f8e73a4f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:13:56.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.206+0000 7f8e73a4f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.206+0000 7f8e73a4f9c0 20 INFO: main: starting shard=10 2024-09-12T17:13:56.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.206+0000 7f8e73a4f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:56.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.206+0000 7f8e73a4f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.206+0000 7f8e73a4f9c0 20 INFO: main: done 2024-09-12T17:13:56.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.210+0000 7f8d277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:56.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.214+0000 7f8e73a4f9c0 20 remove_watcher() i=0 2024-09-12T17:13:56.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.214+0000 7f8e73a4f9c0 2 removed watcher, disabling cache 2024-09-12T17:13:56.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.218+0000 7f8e73a4f9c0 20 remove_watcher() i=1 2024-09-12T17:13:56.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.218+0000 7f8e73a4f9c0 20 remove_watcher() i=2 2024-09-12T17:13:56.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.222+0000 7f8e73a4f9c0 20 remove_watcher() i=3 2024-09-12T17:13:56.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.222+0000 7f8e73a4f9c0 20 remove_watcher() i=4 2024-09-12T17:13:56.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.226+0000 7f8e73a4f9c0 20 remove_watcher() i=5 2024-09-12T17:13:56.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.226+0000 7f8e73a4f9c0 20 remove_watcher() i=6 2024-09-12T17:13:56.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.230+0000 7f8e73a4f9c0 20 remove_watcher() i=7 2024-09-12T17:13:56.248 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:13:56.278 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:56.278 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:56.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.322+0000 7fbaa23e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.326+0000 7fbaa23e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:56.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.326+0000 7fbaa23e29c0 20 realm 2024-09-12T17:13:56.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.326+0000 7fbaa23e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.326+0000 7fbaa23e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:56.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.326+0000 7fbaa23e29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:56.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.326+0000 7fbaa23e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.326+0000 7fbaa23e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:56.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.326+0000 7fbaa23e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.326+0000 7fbaa23e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:56.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.326+0000 7fbaa23e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.330+0000 7fbaa23e29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:56.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.330+0000 7fbaa23e29c0 20 searching for the correct realm 2024-09-12T17:13:56.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.334+0000 7fba9f6e7640 0 -- 172.21.15.119:0/2450693179 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fba90037b10 msgr2=0x7fba90023950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:56.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.338+0000 7fba9f6e7640 0 -- 172.21.15.119:0/2450693179 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fba980810c0 msgr2=0x7fba9808f220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:56.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.554+0000 7fbaa23e29c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:56.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.554+0000 7fbaa23e29c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:56.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.554+0000 7fbaa23e29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:56.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.554+0000 7fbaa23e29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:56.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.554+0000 7fbaa23e29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:56.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.554+0000 7fbaa23e29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:56.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.554+0000 7fbaa23e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.554+0000 7fbaa23e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:56.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.554+0000 7fbaa23e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.558+0000 7fbaa23e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:56.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.558+0000 7fbaa23e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.558+0000 7fbaa23e29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:56.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.558+0000 7fbaa23e29c0 20 zone default found 2024-09-12T17:13:56.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.558+0000 7fbaa23e29c0 4 Realm: () 2024-09-12T17:13:56.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.558+0000 7fbaa23e29c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:56.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.558+0000 7fbaa23e29c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:56.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.558+0000 7fbaa23e29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:56.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.558+0000 7fbaa23e29c0 20 zonegroup default 2024-09-12T17:13:56.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.558+0000 7fbaa23e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.558+0000 7fbaa23e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:56.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.558+0000 7fbaa23e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.558+0000 7fbaa23e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:56.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.558+0000 7fbaa23e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.562+0000 7fbaa23e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:56.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.562+0000 7fbaa23e29c0 20 started sync module instance, tier type = 2024-09-12T17:13:56.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.562+0000 7fbaa23e29c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:56.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.582+0000 7fbaa23e29c0 20 add_watcher() i=0 2024-09-12T17:13:56.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.582+0000 7fbaa23e29c0 20 add_watcher() i=1 2024-09-12T17:13:56.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.582+0000 7fbaa23e29c0 20 add_watcher() i=2 2024-09-12T17:13:56.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.582+0000 7fbaa23e29c0 20 add_watcher() i=3 2024-09-12T17:13:56.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.582+0000 7fbaa23e29c0 20 add_watcher() i=4 2024-09-12T17:13:56.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.582+0000 7fbaa23e29c0 20 add_watcher() i=5 2024-09-12T17:13:56.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.582+0000 7fbaa23e29c0 20 add_watcher() i=6 2024-09-12T17:13:56.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.586+0000 7fbaa23e29c0 20 add_watcher() i=7 2024-09-12T17:13:56.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.586+0000 7fbaa23e29c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:56.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.590+0000 7fb955fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:56.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.594+0000 7fbaa23e29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:56.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.594+0000 7fbaa23e29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:56.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.594+0000 7fbaa23e29c0 5 note: GC not initialized 2024-09-12T17:13:56.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.594+0000 7fb954fe1640 20 reqs_thread_entry: start 2024-09-12T17:13:56.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.594+0000 7fbaa23e29c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:56.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.594+0000 7fbaa23e29c0 20 Filter name: none 2024-09-12T17:13:56.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.594+0000 7fb8ce7fc640 20 reqs_thread_entry: start 2024-09-12T17:13:56.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.594+0000 7fbaa23e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.594+0000 7fbaa23e29c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:56.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.594+0000 7fbaa23e29c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.594+0000 7fbaa23e29c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:56.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.594+0000 7fbaa23e29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:13:56.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.594+0000 7fbaa23e29c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:13:56.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.594+0000 7fbaa23e29c0 20 INFO: main: starting shard=0 2024-09-12T17:13:56.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.594+0000 7fbaa23e29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:13:56.601 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.598+0000 7fbaa23e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.598+0000 7fbaa23e29c0 20 INFO: main: starting shard=1 2024-09-12T17:13:56.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.598+0000 7fbaa23e29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:56.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.598+0000 7fbaa23e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.598+0000 7fbaa23e29c0 20 INFO: main: starting shard=2 2024-09-12T17:13:56.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.598+0000 7fbaa23e29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:13:56.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.598+0000 7fbaa23e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.598+0000 7fbaa23e29c0 20 INFO: main: starting shard=3 2024-09-12T17:13:56.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.598+0000 7fbaa23e29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:13:56.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.602+0000 7fbaa23e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.602+0000 7fbaa23e29c0 20 INFO: main: starting shard=4 2024-09-12T17:13:56.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.602+0000 7fbaa23e29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:13:56.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.602+0000 7fbaa23e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.602+0000 7fbaa23e29c0 20 INFO: main: starting shard=5 2024-09-12T17:13:56.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.602+0000 7fbaa23e29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:56.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.602+0000 7fbaa23e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.602+0000 7fbaa23e29c0 20 INFO: main: starting shard=6 2024-09-12T17:13:56.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.602+0000 7fbaa23e29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:13:56.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.602+0000 7fbaa23e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.602+0000 7fbaa23e29c0 20 INFO: main: starting shard=7 2024-09-12T17:13:56.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.602+0000 7fbaa23e29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:13:56.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.606+0000 7fbaa23e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.606+0000 7fbaa23e29c0 20 INFO: main: starting shard=8 2024-09-12T17:13:56.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.606+0000 7fbaa23e29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:56.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.606+0000 7fbaa23e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.606+0000 7fbaa23e29c0 20 INFO: main: starting shard=9 2024-09-12T17:13:56.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.606+0000 7fbaa23e29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:13:56.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.606+0000 7fbaa23e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.606+0000 7fbaa23e29c0 20 INFO: main: starting shard=10 2024-09-12T17:13:56.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.606+0000 7fbaa23e29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:56.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.606+0000 7fbaa23e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:56.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.606+0000 7fbaa23e29c0 20 INFO: main: done 2024-09-12T17:13:56.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.606+0000 7fb955fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:56.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.614+0000 7fbaa23e29c0 20 remove_watcher() i=0 2024-09-12T17:13:56.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.614+0000 7fbaa23e29c0 2 removed watcher, disabling cache 2024-09-12T17:13:56.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.614+0000 7fbaa23e29c0 20 remove_watcher() i=1 2024-09-12T17:13:56.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.618+0000 7fbaa23e29c0 20 remove_watcher() i=2 2024-09-12T17:13:56.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.622+0000 7fbaa23e29c0 20 remove_watcher() i=3 2024-09-12T17:13:56.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.622+0000 7fbaa23e29c0 20 remove_watcher() i=4 2024-09-12T17:13:56.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.626+0000 7fbaa23e29c0 20 remove_watcher() i=5 2024-09-12T17:13:56.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.630+0000 7fbaa23e29c0 20 remove_watcher() i=6 2024-09-12T17:13:56.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.630+0000 7fbaa23e29c0 20 remove_watcher() i=7 2024-09-12T17:13:56.657 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T17:13:56.657 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:56.657 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:13:56.690 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:56.690 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:56.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.734+0000 7fa2dfe2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.738+0000 7fa2dfe2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:56.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.738+0000 7fa2dfe2e9c0 20 realm 2024-09-12T17:13:56.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.738+0000 7fa2dfe2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.738+0000 7fa2dfe2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:56.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.738+0000 7fa2dfe2e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:56.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.738+0000 7fa2dfe2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.738+0000 7fa2dfe2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:56.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.738+0000 7fa2dfe2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.738+0000 7fa2dfe2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:56.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.738+0000 7fa2dfe2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:56.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.742+0000 7fa2dfe2e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:56.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.742+0000 7fa2dfe2e9c0 20 searching for the correct realm 2024-09-12T17:13:56.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.746+0000 7fa2de135640 0 -- 172.21.15.119:0/1944255642 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fa2d401a040 msgr2=0x7fa2d407e190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:56.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:56.962+0000 7fa2dd133640 0 -- 172.21.15.119:0/1944255642 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fa2d8068120 msgr2=0x7fa2d8065940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:57.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.178+0000 7fa2dfe2e9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:13:57.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.178+0000 7fa2dfe2e9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:13:57.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.178+0000 7fa2dfe2e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:57.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.178+0000 7fa2dfe2e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:57.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.178+0000 7fa2dfe2e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:57.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.178+0000 7fa2dfe2e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:57.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.178+0000 7fa2dfe2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:57.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.182+0000 7fa2dfe2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:57.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.182+0000 7fa2dfe2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:57.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.182+0000 7fa2dfe2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:57.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.182+0000 7fa2dfe2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:57.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.182+0000 7fa2dfe2e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:57.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.182+0000 7fa2dfe2e9c0 20 zone default found 2024-09-12T17:13:57.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.182+0000 7fa2dfe2e9c0 4 Realm: () 2024-09-12T17:13:57.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.182+0000 7fa2dfe2e9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:13:57.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.182+0000 7fa2dfe2e9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:13:57.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.182+0000 7fa2dfe2e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:57.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.182+0000 7fa2dfe2e9c0 20 zonegroup default 2024-09-12T17:13:57.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.182+0000 7fa2dfe2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:57.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.182+0000 7fa2dfe2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:57.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.182+0000 7fa2dfe2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:57.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.186+0000 7fa2dfe2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:57.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.186+0000 7fa2dfe2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:57.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.186+0000 7fa2dfe2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:57.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.186+0000 7fa2dfe2e9c0 20 started sync module instance, tier type = 2024-09-12T17:13:57.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.186+0000 7fa2dfe2e9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:13:57.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.210+0000 7fa2dfe2e9c0 20 add_watcher() i=0 2024-09-12T17:13:57.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.210+0000 7fa2dfe2e9c0 20 add_watcher() i=1 2024-09-12T17:13:57.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.210+0000 7fa2dfe2e9c0 20 add_watcher() i=2 2024-09-12T17:13:57.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.210+0000 7fa2dfe2e9c0 20 add_watcher() i=3 2024-09-12T17:13:57.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.210+0000 7fa2dfe2e9c0 20 add_watcher() i=4 2024-09-12T17:13:57.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.210+0000 7fa2dfe2e9c0 20 add_watcher() i=5 2024-09-12T17:13:57.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.214+0000 7fa2dfe2e9c0 20 add_watcher() i=6 2024-09-12T17:13:57.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.214+0000 7fa2dfe2e9c0 20 add_watcher() i=7 2024-09-12T17:13:57.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.214+0000 7fa2dfe2e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:57.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.218+0000 7fa18f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:57.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.218+0000 7fa2dfe2e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:57.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.218+0000 7fa2dfe2e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:57.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.218+0000 7fa2dfe2e9c0 5 note: GC not initialized 2024-09-12T17:13:57.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa18e7fc640 20 reqs_thread_entry: start 2024-09-12T17:13:57.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa2dfe2e9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:57.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa2dfe2e9c0 20 Filter name: none 2024-09-12T17:13:57.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa0fffff640 20 reqs_thread_entry: start 2024-09-12T17:13:57.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa2dfe2e9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:13:57.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa2dfe2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:57.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa2dfe2e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:57.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa2dfe2e9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:13:57.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa2dfe2e9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:13:57.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa2dfe2e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 : miss 2024-09-12T17:13:57.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa2dfe2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:57.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa2dfe2e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:57.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa2dfe2e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 info.flags=0x17 2024-09-12T17:13:57.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa2dfe2e9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 to cache LRU end 2024-09-12T17:13:57.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa2dfe2e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:57.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa2dfe2e9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:13:57.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa2dfe2e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 2024-09-12T17:13:57.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.222+0000 7fa2dfe2e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:13:57.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.226+0000 7fa2dfe2e9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:13:57.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.226+0000 7fa2dfe2e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:13:57.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.226+0000 7fa2dfe2e9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:13:57.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.226+0000 7fa2dfe2e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:13:57.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.226+0000 7fa2dfe2e9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:13:57.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.226+0000 7fa2dfe2e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:13:57.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.226+0000 7fa2dfe2e9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:13:57.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.226+0000 7fa2dfe2e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:13:57.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.230+0000 7fa2dfe2e9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:13:57.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.230+0000 7fa2dfe2e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:13:57.234 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.230+0000 7fa2dfe2e9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:13:57.234 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.230+0000 7fa2dfe2e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:13:57.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.230+0000 7fa2dfe2e9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:13:57.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.230+0000 7fa2dfe2e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:13:57.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.230+0000 7fa2dfe2e9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:13:57.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.230+0000 7fa2dfe2e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:13:57.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.234+0000 7fa2dfe2e9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:13:57.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.234+0000 7fa2dfe2e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:13:57.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.234+0000 7fa2dfe2e9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:13:57.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.234+0000 7fa2dfe2e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:13:57.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.234+0000 7fa2dfe2e9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:13:57.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.234+0000 7fa2dfe2e9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:13:57.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.234+0000 7fa18f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:57.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.242+0000 7fa2dfe2e9c0 20 remove_watcher() i=0 2024-09-12T17:13:57.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.242+0000 7fa2dfe2e9c0 2 removed watcher, disabling cache 2024-09-12T17:13:57.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.242+0000 7fa2dfe2e9c0 20 remove_watcher() i=1 2024-09-12T17:13:57.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.246+0000 7fa2dfe2e9c0 20 remove_watcher() i=2 2024-09-12T17:13:57.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.250+0000 7fa2dfe2e9c0 20 remove_watcher() i=3 2024-09-12T17:13:57.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.250+0000 7fa2dfe2e9c0 20 remove_watcher() i=4 2024-09-12T17:13:57.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.254+0000 7fa2dfe2e9c0 20 remove_watcher() i=5 2024-09-12T17:13:57.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.254+0000 7fa2dfe2e9c0 20 remove_watcher() i=6 2024-09-12T17:13:57.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:13:57.254+0000 7fa2dfe2e9c0 20 remove_watcher() i=7 2024-09-12T17:13:57.277 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T17:13:57.277 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:57.452 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T17:13:57.453 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:13:59.431 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:13:59.888 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:14:01.501 INFO:tasks.workunit.client.0.smithi119.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:14:01.502 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:14:01.537 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:01.537 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:01.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.582+0000 7f7e10c5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.582+0000 7f7e10c5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.582+0000 7f7e10c5a9c0 20 realm 2024-09-12T17:14:01.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.582+0000 7f7e10c5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.582+0000 7f7e10c5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.582+0000 7f7e10c5a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:01.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.582+0000 7f7e10c5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.582+0000 7f7e10c5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.582+0000 7f7e10c5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.582+0000 7f7e10c5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:01.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.586+0000 7f7e10c5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.586+0000 7f7e10c5a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:01.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.586+0000 7f7e10c5a9c0 20 searching for the correct realm 2024-09-12T17:14:01.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.586+0000 7f7e0df5f640 0 -- 172.21.15.119:0/4235565594 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f7e000ff490 msgr2=0x7f7e00134050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:01.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.594+0000 7f7e0df5f640 0 -- 172.21.15.119:0/4235565594 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f7cd807e7d0 msgr2=0x7f7cd8080c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:14:01.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.606+0000 7f7e10c5a9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:14:01.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.606+0000 7f7e10c5a9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:14:01.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.606+0000 7f7e10c5a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:01.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.606+0000 7f7e10c5a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:01.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.606+0000 7f7e10c5a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:01.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.606+0000 7f7e10c5a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:01.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.606+0000 7f7e10c5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:01.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:01.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 20 zone default found 2024-09-12T17:14:01.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 4 Realm: () 2024-09-12T17:14:01.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:14:01.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:14:01.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:01.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 20 zonegroup default 2024-09-12T17:14:01.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 20 started sync module instance, tier type = 2024-09-12T17:14:01.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.610+0000 7f7e10c5a9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:14:01.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.630+0000 7f7e10c5a9c0 20 add_watcher() i=0 2024-09-12T17:14:01.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.630+0000 7f7e10c5a9c0 20 add_watcher() i=1 2024-09-12T17:14:01.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.630+0000 7f7e10c5a9c0 20 add_watcher() i=2 2024-09-12T17:14:01.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.630+0000 7f7e10c5a9c0 20 add_watcher() i=3 2024-09-12T17:14:01.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.630+0000 7f7e10c5a9c0 20 add_watcher() i=4 2024-09-12T17:14:01.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.630+0000 7f7e10c5a9c0 20 add_watcher() i=5 2024-09-12T17:14:01.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.630+0000 7f7e10c5a9c0 20 add_watcher() i=6 2024-09-12T17:14:01.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.630+0000 7f7e10c5a9c0 20 add_watcher() i=7 2024-09-12T17:14:01.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.630+0000 7f7e10c5a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:01.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.630+0000 7f7cc4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:01.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:01.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:01.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 5 note: GC not initialized 2024-09-12T17:14:01.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7c3f7fe640 20 reqs_thread_entry: start 2024-09-12T17:14:01.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:14:01.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 Filter name: none 2024-09-12T17:14:01.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7c3d7fa640 20 reqs_thread_entry: start 2024-09-12T17:14:01.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:01.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:01.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:01.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:14:01.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 INFO: main: starting shard=0 2024-09-12T17:14:01.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:14:01.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:01.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 INFO: main: starting shard=1 2024-09-12T17:14:01.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:14:01.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:01.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 INFO: main: starting shard=2 2024-09-12T17:14:01.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.634+0000 7f7e10c5a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:14:01.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.638+0000 7f7e10c5a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:01.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.638+0000 7f7e10c5a9c0 20 INFO: main: starting shard=3 2024-09-12T17:14:01.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.638+0000 7f7e10c5a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:14:01.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.638+0000 7f7e10c5a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:01.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.638+0000 7f7e10c5a9c0 20 INFO: main: starting shard=4 2024-09-12T17:14:01.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.638+0000 7f7e10c5a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:14:01.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.638+0000 7f7e10c5a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:01.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.638+0000 7f7e10c5a9c0 20 INFO: main: starting shard=5 2024-09-12T17:14:01.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.638+0000 7f7e10c5a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:14:01.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.638+0000 7f7e10c5a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:01.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.638+0000 7f7e10c5a9c0 20 INFO: main: starting shard=6 2024-09-12T17:14:01.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.638+0000 7f7e10c5a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:14:01.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.642+0000 7f7e10c5a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:01.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.642+0000 7f7e10c5a9c0 20 INFO: main: starting shard=7 2024-09-12T17:14:01.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.642+0000 7f7e10c5a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:14:01.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.642+0000 7f7e10c5a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:01.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.642+0000 7f7e10c5a9c0 20 INFO: main: starting shard=8 2024-09-12T17:14:01.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.642+0000 7f7e10c5a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:14:01.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.642+0000 7f7e10c5a9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:14:01.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.642+0000 7f7e10c5a9c0 20 INFO: main: starting shard=9 2024-09-12T17:14:01.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.642+0000 7f7e10c5a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:14:01.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.642+0000 7f7e10c5a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:01.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.642+0000 7f7e10c5a9c0 20 INFO: main: starting shard=10 2024-09-12T17:14:01.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.642+0000 7f7e10c5a9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:14:01.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.642+0000 7f7e10c5a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:01.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.642+0000 7f7e10c5a9c0 20 INFO: main: done 2024-09-12T17:14:01.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.642+0000 7f7cc4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:01.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.650+0000 7f7e10c5a9c0 20 remove_watcher() i=0 2024-09-12T17:14:01.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.650+0000 7f7e10c5a9c0 2 removed watcher, disabling cache 2024-09-12T17:14:01.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.650+0000 7f7e10c5a9c0 20 remove_watcher() i=1 2024-09-12T17:14:01.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.654+0000 7f7e10c5a9c0 20 remove_watcher() i=2 2024-09-12T17:14:01.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.654+0000 7f7e10c5a9c0 20 remove_watcher() i=3 2024-09-12T17:14:01.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.658+0000 7f7e10c5a9c0 20 remove_watcher() i=4 2024-09-12T17:14:01.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.658+0000 7f7e10c5a9c0 20 remove_watcher() i=5 2024-09-12T17:14:01.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.658+0000 7f7e10c5a9c0 20 remove_watcher() i=6 2024-09-12T17:14:01.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.662+0000 7f7e10c5a9c0 20 remove_watcher() i=7 2024-09-12T17:14:01.813 INFO:tasks.workunit.client.0.smithi119.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:14:01.814 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:14:01.848 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:01.849 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:01.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.890+0000 7f828954e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.890+0000 7f828954e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.890+0000 7f828954e9c0 20 realm 2024-09-12T17:14:01.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.890+0000 7f828954e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.890+0000 7f828954e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.890+0000 7f828954e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:01.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.890+0000 7f828954e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.890+0000 7f828954e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.890+0000 7f828954e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.894+0000 7f828954e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:01.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.894+0000 7f828954e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.894+0000 7f828954e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:01.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.894+0000 7f828954e9c0 20 searching for the correct realm 2024-09-12T17:14:01.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:01.894+0000 7f8286853640 0 -- 172.21.15.119:0/2467701244 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f827c03c060 msgr2=0x7f827c064970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:14:02.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.114+0000 7f8287855640 0 -- 172.21.15.119:0/2467701244 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f8278019070 msgr2=0x7f827805f1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:02.133 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:14:02.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:14:02.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:02.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:02.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:02.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:02.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:02.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:02.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 zone default found 2024-09-12T17:14:02.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 4 Realm: () 2024-09-12T17:14:02.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:14:02.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:14:02.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:02.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 zonegroup default 2024-09-12T17:14:02.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.130+0000 7f828954e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.134+0000 7f828954e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.134+0000 7f828954e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.134+0000 7f828954e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.134+0000 7f828954e9c0 20 started sync module instance, tier type = 2024-09-12T17:14:02.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.134+0000 7f828954e9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:14:02.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.154+0000 7f828954e9c0 20 add_watcher() i=0 2024-09-12T17:14:02.159 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.154+0000 7f828954e9c0 20 add_watcher() i=1 2024-09-12T17:14:02.159 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.154+0000 7f828954e9c0 20 add_watcher() i=2 2024-09-12T17:14:02.159 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.154+0000 7f828954e9c0 20 add_watcher() i=3 2024-09-12T17:14:02.159 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.154+0000 7f828954e9c0 20 add_watcher() i=4 2024-09-12T17:14:02.159 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.154+0000 7f828954e9c0 20 add_watcher() i=5 2024-09-12T17:14:02.159 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.154+0000 7f828954e9c0 20 add_watcher() i=6 2024-09-12T17:14:02.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.158+0000 7f828954e9c0 20 add_watcher() i=7 2024-09-12T17:14:02.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.158+0000 7f828954e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:02.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.158+0000 7f813e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:02.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.162+0000 7f828954e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:02.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.162+0000 7f828954e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:02.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.162+0000 7f828954e9c0 5 note: GC not initialized 2024-09-12T17:14:02.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.162+0000 7f813d7e2640 20 reqs_thread_entry: start 2024-09-12T17:14:02.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.162+0000 7f828954e9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:14:02.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.162+0000 7f828954e9c0 20 Filter name: none 2024-09-12T17:14:02.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.162+0000 7f81367fc640 20 reqs_thread_entry: start 2024-09-12T17:14:02.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.162+0000 7f828954e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.167 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.162+0000 7f828954e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:02.167 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.162+0000 7f828954e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:02.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:02.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:14:02.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 INFO: main: starting shard=0 2024-09-12T17:14:02.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:14:02.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 INFO: main: starting shard=1 2024-09-12T17:14:02.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:14:02.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 INFO: main: starting shard=2 2024-09-12T17:14:02.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:14:02.171 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.171 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 INFO: main: starting shard=3 2024-09-12T17:14:02.171 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:14:02.172 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.172 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 INFO: main: starting shard=4 2024-09-12T17:14:02.172 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.166+0000 7f828954e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:14:02.173 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.170+0000 7f828954e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.173 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.170+0000 7f828954e9c0 20 INFO: main: starting shard=5 2024-09-12T17:14:02.173 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.170+0000 7f828954e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:14:02.174 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.170+0000 7f828954e9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:14:02.174 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.170+0000 7f828954e9c0 20 INFO: main: starting shard=6 2024-09-12T17:14:02.174 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.170+0000 7f828954e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:14:02.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.170+0000 7f828954e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.170+0000 7f828954e9c0 20 INFO: main: starting shard=7 2024-09-12T17:14:02.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.170+0000 7f828954e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:14:02.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.170+0000 7f828954e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.170+0000 7f828954e9c0 20 INFO: main: starting shard=8 2024-09-12T17:14:02.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.170+0000 7f828954e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:14:02.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.174+0000 7f828954e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.174+0000 7f828954e9c0 20 INFO: main: starting shard=9 2024-09-12T17:14:02.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.174+0000 7f828954e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:14:02.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.174+0000 7f828954e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.174+0000 7f828954e9c0 20 INFO: main: starting shard=10 2024-09-12T17:14:02.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.174+0000 7f828954e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:14:02.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.174+0000 7f828954e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.174+0000 7f828954e9c0 20 INFO: main: done 2024-09-12T17:14:02.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.174+0000 7f813e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:02.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.182+0000 7f828954e9c0 20 remove_watcher() i=0 2024-09-12T17:14:02.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.182+0000 7f828954e9c0 2 removed watcher, disabling cache 2024-09-12T17:14:02.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.182+0000 7f828954e9c0 20 remove_watcher() i=1 2024-09-12T17:14:02.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.186+0000 7f828954e9c0 20 remove_watcher() i=2 2024-09-12T17:14:02.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.186+0000 7f828954e9c0 20 remove_watcher() i=3 2024-09-12T17:14:02.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.190+0000 7f828954e9c0 20 remove_watcher() i=4 2024-09-12T17:14:02.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.190+0000 7f828954e9c0 20 remove_watcher() i=5 2024-09-12T17:14:02.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.194+0000 7f828954e9c0 20 remove_watcher() i=6 2024-09-12T17:14:02.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.194+0000 7f828954e9c0 20 remove_watcher() i=7 2024-09-12T17:14:02.461 INFO:tasks.workunit.client.0.smithi119.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:14:02.462 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:14:02.498 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:02.498 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:02.545 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.542+0000 7f72279789c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.542+0000 7f72279789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.542+0000 7f72279789c0 20 realm 2024-09-12T17:14:02.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.542+0000 7f72279789c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.542+0000 7f72279789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.542+0000 7f72279789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:02.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.542+0000 7f72279789c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.542+0000 7f72279789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.542+0000 7f72279789c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.546+0000 7f72279789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:02.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.546+0000 7f72279789c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.546+0000 7f72279789c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:02.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.546+0000 7f72279789c0 20 searching for the correct realm 2024-09-12T17:14:02.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.550+0000 7f7225c7f640 0 -- 172.21.15.119:0/2720271763 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f721c11c0d0 msgr2=0x7f721c007730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:02.770 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.766+0000 7f7224c7d640 0 -- 172.21.15.119:0/2720271763 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f722002e040 msgr2=0x7f7220024930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:14:02.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.982+0000 7f72279789c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:14:02.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.982+0000 7f72279789c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:14:02.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.982+0000 7f72279789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:02.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.982+0000 7f72279789c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:02.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.982+0000 7f72279789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:02.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.982+0000 7f72279789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:02.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.982+0000 7f72279789c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.986+0000 7f72279789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.986+0000 7f72279789c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.986+0000 7f72279789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:02.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.986+0000 7f72279789c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.986+0000 7f72279789c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:02.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.986+0000 7f72279789c0 20 zone default found 2024-09-12T17:14:02.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.986+0000 7f72279789c0 4 Realm: () 2024-09-12T17:14:02.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.986+0000 7f72279789c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:14:02.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.986+0000 7f72279789c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:14:02.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.986+0000 7f72279789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:02.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.986+0000 7f72279789c0 20 zonegroup default 2024-09-12T17:14:02.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.986+0000 7f72279789c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.986+0000 7f72279789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.986+0000 7f72279789c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.990+0000 7f72279789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.993 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.990+0000 7f72279789c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.993 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.990+0000 7f72279789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.993 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.990+0000 7f72279789c0 20 started sync module instance, tier type = 2024-09-12T17:14:02.993 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:02.990+0000 7f72279789c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:14:03.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.014+0000 7f72279789c0 20 add_watcher() i=0 2024-09-12T17:14:03.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.014+0000 7f72279789c0 20 add_watcher() i=1 2024-09-12T17:14:03.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.014+0000 7f72279789c0 20 add_watcher() i=2 2024-09-12T17:14:03.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.014+0000 7f72279789c0 20 add_watcher() i=3 2024-09-12T17:14:03.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.014+0000 7f72279789c0 20 add_watcher() i=4 2024-09-12T17:14:03.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.014+0000 7f72279789c0 20 add_watcher() i=5 2024-09-12T17:14:03.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.014+0000 7f72279789c0 20 add_watcher() i=6 2024-09-12T17:14:03.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.014+0000 7f72279789c0 20 add_watcher() i=7 2024-09-12T17:14:03.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.014+0000 7f72279789c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:03.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.018+0000 7f70db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:03.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.018+0000 7f72279789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:03.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.018+0000 7f72279789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:03.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.018+0000 7f72279789c0 5 note: GC not initialized 2024-09-12T17:14:03.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.022+0000 7f70da7e4640 20 reqs_thread_entry: start 2024-09-12T17:14:03.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.022+0000 7f72279789c0 20 init_complete bucket index max shards: 11 2024-09-12T17:14:03.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.022+0000 7f72279789c0 20 Filter name: none 2024-09-12T17:14:03.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.022+0000 7f704bfff640 20 reqs_thread_entry: start 2024-09-12T17:14:03.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.022+0000 7f72279789c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.022+0000 7f72279789c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:03.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.022+0000 7f72279789c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.022+0000 7f72279789c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:03.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.022+0000 7f72279789c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:03.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.022+0000 7f72279789c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:14:03.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.022+0000 7f72279789c0 20 INFO: main: starting shard=0 2024-09-12T17:14:03.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.022+0000 7f72279789c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:14:03.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.022+0000 7f72279789c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.022+0000 7f72279789c0 20 INFO: main: starting shard=1 2024-09-12T17:14:03.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.022+0000 7f72279789c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:14:03.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.026+0000 7f72279789c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:14:03.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.026+0000 7f72279789c0 20 INFO: main: starting shard=2 2024-09-12T17:14:03.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.026+0000 7f72279789c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:14:03.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.026+0000 7f72279789c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.026+0000 7f72279789c0 20 INFO: main: starting shard=3 2024-09-12T17:14:03.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.026+0000 7f72279789c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:14:03.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.026+0000 7f72279789c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.026+0000 7f72279789c0 20 INFO: main: starting shard=4 2024-09-12T17:14:03.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.026+0000 7f72279789c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:14:03.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.026+0000 7f72279789c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.026+0000 7f72279789c0 20 INFO: main: starting shard=5 2024-09-12T17:14:03.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.026+0000 7f72279789c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:14:03.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.030+0000 7f72279789c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.030+0000 7f72279789c0 20 INFO: main: starting shard=6 2024-09-12T17:14:03.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.030+0000 7f72279789c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:14:03.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.030+0000 7f72279789c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.030+0000 7f72279789c0 20 INFO: main: starting shard=7 2024-09-12T17:14:03.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.030+0000 7f72279789c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:14:03.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.030+0000 7f72279789c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.030+0000 7f72279789c0 20 INFO: main: starting shard=8 2024-09-12T17:14:03.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.030+0000 7f72279789c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:14:03.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.030+0000 7f72279789c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.030+0000 7f72279789c0 20 INFO: main: starting shard=9 2024-09-12T17:14:03.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.030+0000 7f72279789c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:14:03.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.030+0000 7f72279789c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.030+0000 7f72279789c0 20 INFO: main: starting shard=10 2024-09-12T17:14:03.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.030+0000 7f72279789c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:14:03.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.034+0000 7f72279789c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.034+0000 7f72279789c0 20 INFO: main: done 2024-09-12T17:14:03.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.034+0000 7f70db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:03.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.038+0000 7f72279789c0 20 remove_watcher() i=0 2024-09-12T17:14:03.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.038+0000 7f72279789c0 2 removed watcher, disabling cache 2024-09-12T17:14:03.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.042+0000 7f72279789c0 20 remove_watcher() i=1 2024-09-12T17:14:03.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.046+0000 7f72279789c0 20 remove_watcher() i=2 2024-09-12T17:14:03.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.046+0000 7f72279789c0 20 remove_watcher() i=3 2024-09-12T17:14:03.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.050+0000 7f72279789c0 20 remove_watcher() i=4 2024-09-12T17:14:03.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.050+0000 7f72279789c0 20 remove_watcher() i=5 2024-09-12T17:14:03.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.054+0000 7f72279789c0 20 remove_watcher() i=6 2024-09-12T17:14:03.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.054+0000 7f72279789c0 20 remove_watcher() i=7 2024-09-12T17:14:03.297 INFO:tasks.workunit.client.0.smithi119.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:14:03.298 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:14:03.334 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:03.334 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:03.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.378+0000 7f41eb0329c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.378+0000 7f41eb0329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.378+0000 7f41eb0329c0 20 realm 2024-09-12T17:14:03.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.378+0000 7f41eb0329c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.378+0000 7f41eb0329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.378+0000 7f41eb0329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:03.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.378+0000 7f41eb0329c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.378+0000 7f41eb0329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.378+0000 7f41eb0329c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.382+0000 7f41eb0329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:03.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.382+0000 7f41eb0329c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.382+0000 7f41eb0329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:03.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.382+0000 7f41eb0329c0 20 searching for the correct realm 2024-09-12T17:14:03.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.386+0000 7f41e9339640 0 -- 172.21.15.119:0/2182900143 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f41dc063520 msgr2=0x7f41dc065040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:14:03.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.602+0000 7f41e8337640 0 -- 172.21.15.119:0/2182900143 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f41e00ff140 msgr2=0x7f41e0106990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:03.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.818+0000 7f41eb0329c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:14:03.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.818+0000 7f41eb0329c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:14:03.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.818+0000 7f41eb0329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:03.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.818+0000 7f41eb0329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:03.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.818+0000 7f41eb0329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:03.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.818+0000 7f41eb0329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:03.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.818+0000 7f41eb0329c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.822+0000 7f41eb0329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.822+0000 7f41eb0329c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.822+0000 7f41eb0329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:03.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.822+0000 7f41eb0329c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.822+0000 7f41eb0329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:03.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.822+0000 7f41eb0329c0 20 zone default found 2024-09-12T17:14:03.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.822+0000 7f41eb0329c0 4 Realm: () 2024-09-12T17:14:03.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.822+0000 7f41eb0329c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:14:03.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.822+0000 7f41eb0329c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:14:03.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.822+0000 7f41eb0329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:03.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.822+0000 7f41eb0329c0 20 zonegroup default 2024-09-12T17:14:03.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.822+0000 7f41eb0329c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.822+0000 7f41eb0329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.822+0000 7f41eb0329c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.822+0000 7f41eb0329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.822+0000 7f41eb0329c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.826+0000 7f41eb0329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.826+0000 7f41eb0329c0 20 started sync module instance, tier type = 2024-09-12T17:14:03.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.826+0000 7f41eb0329c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:14:03.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.846+0000 7f41eb0329c0 20 add_watcher() i=0 2024-09-12T17:14:03.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.846+0000 7f41eb0329c0 20 add_watcher() i=1 2024-09-12T17:14:03.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.846+0000 7f41eb0329c0 20 add_watcher() i=2 2024-09-12T17:14:03.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.846+0000 7f41eb0329c0 20 add_watcher() i=3 2024-09-12T17:14:03.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.846+0000 7f41eb0329c0 20 add_watcher() i=4 2024-09-12T17:14:03.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.846+0000 7f41eb0329c0 20 add_watcher() i=5 2024-09-12T17:14:03.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.846+0000 7f41eb0329c0 20 add_watcher() i=6 2024-09-12T17:14:03.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.850+0000 7f41eb0329c0 20 add_watcher() i=7 2024-09-12T17:14:03.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.850+0000 7f41eb0329c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:03.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.854+0000 7f409efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:03.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.854+0000 7f41eb0329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:03.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.854+0000 7f41eb0329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:03.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.854+0000 7f41eb0329c0 5 note: GC not initialized 2024-09-12T17:14:03.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.854+0000 7f409dfe3640 20 reqs_thread_entry: start 2024-09-12T17:14:03.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.854+0000 7f41eb0329c0 20 init_complete bucket index max shards: 11 2024-09-12T17:14:03.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.854+0000 7f41eb0329c0 20 Filter name: none 2024-09-12T17:14:03.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.854+0000 7f400f7fe640 20 reqs_thread_entry: start 2024-09-12T17:14:03.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.854+0000 7f41eb0329c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.858+0000 7f41eb0329c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:03.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.858+0000 7f41eb0329c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.858+0000 7f41eb0329c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:03.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.858+0000 7f41eb0329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:03.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.858+0000 7f41eb0329c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:14:03.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.858+0000 7f41eb0329c0 20 INFO: main: starting shard=0 2024-09-12T17:14:03.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.858+0000 7f41eb0329c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:14:03.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.858+0000 7f41eb0329c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.858+0000 7f41eb0329c0 20 INFO: main: starting shard=1 2024-09-12T17:14:03.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.858+0000 7f41eb0329c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:14:03.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.862+0000 7f41eb0329c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.862+0000 7f41eb0329c0 20 INFO: main: starting shard=2 2024-09-12T17:14:03.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.862+0000 7f41eb0329c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:14:03.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.862+0000 7f41eb0329c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.862+0000 7f41eb0329c0 20 INFO: main: starting shard=3 2024-09-12T17:14:03.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.862+0000 7f41eb0329c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:14:03.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.862+0000 7f41eb0329c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.862+0000 7f41eb0329c0 20 INFO: main: starting shard=4 2024-09-12T17:14:03.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.862+0000 7f41eb0329c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:14:03.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.862+0000 7f41eb0329c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.862+0000 7f41eb0329c0 20 INFO: main: starting shard=5 2024-09-12T17:14:03.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.862+0000 7f41eb0329c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:14:03.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.866+0000 7f41eb0329c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.866+0000 7f41eb0329c0 20 INFO: main: starting shard=6 2024-09-12T17:14:03.870 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.866+0000 7f41eb0329c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:14:03.870 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.866+0000 7f41eb0329c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.870 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.866+0000 7f41eb0329c0 20 INFO: main: starting shard=7 2024-09-12T17:14:03.870 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.866+0000 7f41eb0329c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:14:03.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.866+0000 7f41eb0329c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.866+0000 7f41eb0329c0 20 INFO: main: starting shard=8 2024-09-12T17:14:03.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.866+0000 7f41eb0329c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:14:03.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.866+0000 7f41eb0329c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.866+0000 7f41eb0329c0 20 INFO: main: starting shard=9 2024-09-12T17:14:03.872 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.866+0000 7f41eb0329c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:14:03.872 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.870+0000 7f41eb0329c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.872 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.870+0000 7f41eb0329c0 20 INFO: main: starting shard=10 2024-09-12T17:14:03.872 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.870+0000 7f41eb0329c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:14:03.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.870+0000 7f41eb0329c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:14:03.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.870+0000 7f41eb0329c0 20 INFO: main: done 2024-09-12T17:14:03.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.870+0000 7f409efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:03.880 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.874+0000 7f41eb0329c0 20 remove_watcher() i=0 2024-09-12T17:14:03.880 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.874+0000 7f41eb0329c0 2 removed watcher, disabling cache 2024-09-12T17:14:03.882 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.878+0000 7f41eb0329c0 20 remove_watcher() i=1 2024-09-12T17:14:03.884 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.882+0000 7f41eb0329c0 20 remove_watcher() i=2 2024-09-12T17:14:03.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.882+0000 7f41eb0329c0 20 remove_watcher() i=3 2024-09-12T17:14:03.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.886+0000 7f41eb0329c0 20 remove_watcher() i=4 2024-09-12T17:14:03.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.886+0000 7f41eb0329c0 20 remove_watcher() i=5 2024-09-12T17:14:03.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.886+0000 7f41eb0329c0 20 remove_watcher() i=6 2024-09-12T17:14:03.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:03.890+0000 7f41eb0329c0 20 remove_watcher() i=7 2024-09-12T17:14:03.970 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:14:04.402 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:14:04.806 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:14:04.836 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:04.836 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:04.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:04.874+0000 7f40f59b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:04.874+0000 7f40f59b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:04.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:04.874+0000 7f40f59b99c0 20 realm 2024-09-12T17:14:04.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:04.874+0000 7f40f59b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:04.874+0000 7f40f59b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:04.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:04.874+0000 7f40f59b99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:04.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:04.874+0000 7f40f59b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:04.874+0000 7f40f59b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:04.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:04.874+0000 7f40f59b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.880 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:04.878+0000 7f40f59b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:04.880 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:04.878+0000 7f40f59b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.882 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:04.878+0000 7f40f59b99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:04.882 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:04.878+0000 7f40f59b99c0 20 searching for the correct realm 2024-09-12T17:14:04.886 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:04.882+0000 7f40f2cbe640 0 -- 172.21.15.119:0/1041139548 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f40e4025070 msgr2=0x7f40e40763e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:04.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:04.886+0000 7f40f2cbe640 0 -- 172.21.15.119:0/1041139548 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f40ec06c4f0 msgr2=0x7f40ec0880d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:05.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.102+0000 7f40f59b99c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:14:05.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.102+0000 7f40f59b99c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:14:05.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.102+0000 7f40f59b99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:05.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.102+0000 7f40f59b99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:05.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.102+0000 7f40f59b99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:05.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.102+0000 7f40f59b99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:05.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.102+0000 7f40f59b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.102+0000 7f40f59b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:05.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.102+0000 7f40f59b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.102+0000 7f40f59b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:05.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.102+0000 7f40f59b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.106+0000 7f40f59b99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:05.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.106+0000 7f40f59b99c0 20 zone default found 2024-09-12T17:14:05.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.106+0000 7f40f59b99c0 4 Realm: () 2024-09-12T17:14:05.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.106+0000 7f40f59b99c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:14:05.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.106+0000 7f40f59b99c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:14:05.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.106+0000 7f40f59b99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:05.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.106+0000 7f40f59b99c0 20 zonegroup default 2024-09-12T17:14:05.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.106+0000 7f40f59b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.106+0000 7f40f59b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:05.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.106+0000 7f40f59b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.106+0000 7f40f59b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:05.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.106+0000 7f40f59b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.106+0000 7f40f59b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:05.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.106+0000 7f40f59b99c0 20 started sync module instance, tier type = 2024-09-12T17:14:05.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.106+0000 7f40f59b99c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:14:05.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.130+0000 7f40f59b99c0 20 add_watcher() i=0 2024-09-12T17:14:05.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.130+0000 7f40f59b99c0 20 add_watcher() i=1 2024-09-12T17:14:05.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.130+0000 7f40f59b99c0 20 add_watcher() i=2 2024-09-12T17:14:05.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.130+0000 7f40f59b99c0 20 add_watcher() i=3 2024-09-12T17:14:05.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.130+0000 7f40f59b99c0 20 add_watcher() i=4 2024-09-12T17:14:05.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.130+0000 7f40f59b99c0 20 add_watcher() i=5 2024-09-12T17:14:05.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.130+0000 7f40f59b99c0 20 add_watcher() i=6 2024-09-12T17:14:05.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.130+0000 7f40f59b99c0 20 add_watcher() i=7 2024-09-12T17:14:05.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.130+0000 7f40f59b99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:05.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.134+0000 7f3fa9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:05.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:05.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:05.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 5 note: GC not initialized 2024-09-12T17:14:05.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f3fa8fe1640 20 reqs_thread_entry: start 2024-09-12T17:14:05.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 20 init_complete bucket index max shards: 11 2024-09-12T17:14:05.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 20 Filter name: none 2024-09-12T17:14:05.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f3f227fc640 20 reqs_thread_entry: start 2024-09-12T17:14:05.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:14:05.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:05.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:14:05.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:14:05.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 : miss 2024-09-12T17:14:05.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.144 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:05.144 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 info.flags=0x17 2024-09-12T17:14:05.144 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 to cache LRU end 2024-09-12T17:14:05.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:14:05.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:14:05.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 2024-09-12T17:14:05.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.138+0000 7f40f59b99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:14:05.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.142+0000 7f40f59b99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:14:05.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.142+0000 7f40f59b99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:14:05.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.142+0000 7f40f59b99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:14:05.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.146+0000 7f40f59b99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:14:05.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.146+0000 7f40f59b99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:14:05.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.146+0000 7f40f59b99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:14:05.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.150+0000 7f40f59b99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:14:05.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.150+0000 7f40f59b99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:14:05.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.150+0000 7f40f59b99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:14:05.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.150+0000 7f40f59b99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:14:05.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.158+0000 7f3fa9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:05.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.166+0000 7f40f59b99c0 20 remove_watcher() i=0 2024-09-12T17:14:05.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.166+0000 7f40f59b99c0 2 removed watcher, disabling cache 2024-09-12T17:14:05.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.166+0000 7f40f59b99c0 20 remove_watcher() i=1 2024-09-12T17:14:05.172 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.170+0000 7f40f59b99c0 20 remove_watcher() i=2 2024-09-12T17:14:05.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.170+0000 7f40f59b99c0 20 remove_watcher() i=3 2024-09-12T17:14:05.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.174+0000 7f40f59b99c0 20 remove_watcher() i=4 2024-09-12T17:14:05.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.174+0000 7f40f59b99c0 20 remove_watcher() i=5 2024-09-12T17:14:05.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.174+0000 7f40f59b99c0 20 remove_watcher() i=6 2024-09-12T17:14:05.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.178+0000 7f40f59b99c0 20 remove_watcher() i=7 2024-09-12T17:14:05.194 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:14:05.227 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:05.227 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:05.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.266+0000 7f0e997e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.266+0000 7f0e997e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:05.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.266+0000 7f0e997e19c0 20 realm 2024-09-12T17:14:05.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.266+0000 7f0e997e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.266+0000 7f0e997e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:05.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.266+0000 7f0e997e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:05.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.266+0000 7f0e997e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.266+0000 7f0e997e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:05.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.266+0000 7f0e997e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.270+0000 7f0e997e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:05.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.270+0000 7f0e997e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.270+0000 7f0e997e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:05.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.270+0000 7f0e997e19c0 20 searching for the correct realm 2024-09-12T17:14:05.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.274+0000 7f0e97ae8640 0 -- 172.21.15.119:0/417924596 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f0e8c0e0070 msgr2=0x7f0e8c0e20b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:05.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.490+0000 7f0e96ae6640 0 -- 172.21.15.119:0/417924596 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f0e9005ab40 msgr2=0x7f0e90075a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:14:05.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.706+0000 7f0e997e19c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:14:05.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.706+0000 7f0e997e19c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:14:05.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.706+0000 7f0e997e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:05.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.706+0000 7f0e997e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:05.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.706+0000 7f0e997e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:05.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.706+0000 7f0e997e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:05.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.706+0000 7f0e997e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.706+0000 7f0e997e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:05.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.706+0000 7f0e997e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:05.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:05.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 20 zone default found 2024-09-12T17:14:05.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 4 Realm: () 2024-09-12T17:14:05.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:14:05.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:14:05.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:05.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 20 zonegroup default 2024-09-12T17:14:05.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:05.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:05.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:05.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 20 started sync module instance, tier type = 2024-09-12T17:14:05.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.710+0000 7f0e997e19c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:14:05.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.734+0000 7f0e997e19c0 20 add_watcher() i=0 2024-09-12T17:14:05.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.734+0000 7f0e997e19c0 20 add_watcher() i=1 2024-09-12T17:14:05.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.734+0000 7f0e997e19c0 20 add_watcher() i=2 2024-09-12T17:14:05.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.734+0000 7f0e997e19c0 20 add_watcher() i=3 2024-09-12T17:14:05.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.734+0000 7f0e997e19c0 20 add_watcher() i=4 2024-09-12T17:14:05.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.734+0000 7f0e997e19c0 20 add_watcher() i=5 2024-09-12T17:14:05.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.734+0000 7f0e997e19c0 20 add_watcher() i=6 2024-09-12T17:14:05.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.734+0000 7f0e997e19c0 20 add_watcher() i=7 2024-09-12T17:14:05.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.734+0000 7f0e997e19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:05.744 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.738+0000 7f0d4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:05.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.742+0000 7f0e997e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:05.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.742+0000 7f0e997e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:05.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.742+0000 7f0e997e19c0 5 note: GC not initialized 2024-09-12T17:14:05.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.742+0000 7f0d4cfe1640 20 reqs_thread_entry: start 2024-09-12T17:14:05.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.742+0000 7f0e997e19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:14:05.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.742+0000 7f0e997e19c0 20 Filter name: none 2024-09-12T17:14:05.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.742+0000 7f0cc67fc640 20 reqs_thread_entry: start 2024-09-12T17:14:05.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.742+0000 7f0e997e19c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:14:05.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.742+0000 7f0e997e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.742+0000 7f0e997e19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:05.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.742+0000 7f0e997e19c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:14:05.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.742+0000 7f0e997e19c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:14:05.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.742+0000 7f0e997e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 : miss 2024-09-12T17:14:05.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.742+0000 7f0e997e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:05.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.746+0000 7f0e997e19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:05.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.746+0000 7f0e997e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 info.flags=0x17 2024-09-12T17:14:05.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.746+0000 7f0e997e19c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 to cache LRU end 2024-09-12T17:14:05.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.746+0000 7f0e997e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:14:05.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.746+0000 7f0e997e19c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:14:05.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.746+0000 7f0e997e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2 2024-09-12T17:14:05.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.746+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.0 2024-09-12T17:14:05.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.746+0000 7f0e997e19c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:14:05.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.746+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:14:05.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.746+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.2 2024-09-12T17:14:05.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.746+0000 7f0e997e19c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:14:05.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.746+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.3 2024-09-12T17:14:05.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.750+0000 7f0e997e19c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:14:05.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.750+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.4 2024-09-12T17:14:05.753 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.750+0000 7f0e997e19c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:14:05.753 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.750+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:14:05.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.750+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.6 2024-09-12T17:14:05.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.750+0000 7f0e997e19c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:14:05.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.750+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.7 2024-09-12T17:14:05.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.754+0000 7f0e997e19c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:14:05.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.754+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:14:05.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.754+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.9 2024-09-12T17:14:05.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.754+0000 7f0e997e19c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:14:05.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.754+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:14:05.759 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.754+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:14:05.759 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.754+0000 7f0e997e19c0 20 get_obj_state: octx=0x556864ded970 obj=check-bucket:e state=0x5568650a1598 s->prefetch_data=0 2024-09-12T17:14:05.759 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.754+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:14:05.760 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.754+0000 7f0e997e19c0 20 get_obj_state: octx=0x556864dff5e0 obj=check-bucket:d state=0x5568650a4108 s->prefetch_data=0 2024-09-12T17:14:05.760 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.758+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:14:05.761 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.758+0000 7f0e997e19c0 20 get_obj_state: octx=0x556865099970 obj=check-bucket:c state=0x55686509af28 s->prefetch_data=0 2024-09-12T17:14:05.761 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.758+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:14:05.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.758+0000 7f0e997e19c0 20 get_obj_state: octx=0x55686509a330 obj=check-bucket:f state=0x55686509c188 s->prefetch_data=0 2024-09-12T17:14:05.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.758+0000 7f0e997e19c0 20 get_obj_state: setting s->obj_tag to nua8mee3u2g03p4azn3j8df4flvadr47 2024-09-12T17:14:05.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.758+0000 7f0e997e19c0 20 get_obj_state_impl: setting s->olh_tag to v6eeviaf3rl4izxi9boezbhperi08a4t 2024-09-12T17:14:05.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.758+0000 7f0e997e19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=v6eeviaf3rl4izxi9boezbhperi08a4t 2024-09-12T17:14:05.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.758+0000 7f0e997e19c0 20 get_obj_state: setting s->obj_tag to zwmraqud60xgkdxzc70gl6nlxn1pio1q 2024-09-12T17:14:05.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.758+0000 7f0e997e19c0 20 get_obj_state_impl: setting s->olh_tag to pgpablwf2z6et2bdlkc30dea14240spr 2024-09-12T17:14:05.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.758+0000 7f0e997e19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pgpablwf2z6et2bdlkc30dea14240spr 2024-09-12T17:14:05.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.758+0000 7f0e997e19c0 20 get_obj_state: setting s->obj_tag to 6wuv5zxjlhliwi60vtamrws4h5s0fsie 2024-09-12T17:14:05.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.758+0000 7f0e997e19c0 20 get_obj_state_impl: setting s->olh_tag to 0e7ahlbfmm2xx13f7k7ar25uh4365aw3 2024-09-12T17:14:05.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.758+0000 7f0e997e19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0e7ahlbfmm2xx13f7k7ar25uh4365aw3 2024-09-12T17:14:05.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.758+0000 7f0e997e19c0 20 get_obj_state: setting s->obj_tag to 9sqxulwzwn8oiim8rvsr7829um7osokb 2024-09-12T17:14:05.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.758+0000 7f0e997e19c0 20 get_obj_state_impl: setting s->olh_tag to 7x7bb2o6xcndwmj92xlirf504jyklyl5 2024-09-12T17:14:05.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.758+0000 7f0e997e19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7x7bb2o6xcndwmj92xlirf504jyklyl5 2024-09-12T17:14:05.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.762+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:14:05.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.762+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:14:05.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.762+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:14:05.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.762+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:14:05.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:14:05.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:14:05.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 olh_log_entry: epoch=2 op=3 key=f[9RhS2z7NdR55Vej.mx6BFNk7CGUbMF6] 2024-09-12T17:14:05.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 get_obj_state: octx=0x55686509a330 obj=check-bucket:_:9RhS2z7NdR55Vej.mx6BFNk7CGUbMF6_f state=0x556865146e98 s->prefetch_data=0 2024-09-12T17:14:05.770 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:14:05.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:14:05.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 10 manifest: total_size = 12 2024-09-12T17:14:05.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11401963836189349015 2024-09-12T17:14:05.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 get_obj_state: octx=0x55686509a330 obj=check-bucket:_:9RhS2z7NdR55Vej.mx6BFNk7CGUbMF6_f state=0x556865146e98 s->prefetch_data=0 2024-09-12T17:14:05.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 prepare_atomic_modification: state is not atomic. state=0x556865146e98 2024-09-12T17:14:05.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:14:05.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:14:05.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:14:05.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 olh_log_entry: epoch=2 op=3 key=e[QNLuqbsbzekbTm13dU5HxocQr5-HWW4] 2024-09-12T17:14:05.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 get_obj_state: octx=0x556864ded970 obj=check-bucket:_:QNLuqbsbzekbTm13dU5HxocQr5-HWW4_e state=0x55686514cab8 s->prefetch_data=0 2024-09-12T17:14:05.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 olh_log_entry: epoch=3 op=3 key=c[TkiG3sCCsNTFd-1miQ4-Q5eULGz-sEW] 2024-09-12T17:14:05.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 get_obj_state: octx=0x556865099970 obj=check-bucket:_:TkiG3sCCsNTFd-1miQ4-Q5eULGz-sEW_c state=0x556865151e68 s->prefetch_data=0 2024-09-12T17:14:05.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 olh_log_entry: epoch=3 op=3 key=d[lfsgcQrTJCBBWkeZE40ij-aoeD5NiDL] 2024-09-12T17:14:05.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 get_obj_state: octx=0x556864dff5e0 obj=check-bucket:_:lfsgcQrTJCBBWkeZE40ij-aoeD5NiDL_d state=0x5568651577e8 s->prefetch_data=0 2024-09-12T17:14:05.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 10 manifest: total_size = 11 2024-09-12T17:14:05.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17556973518114526273 2024-09-12T17:14:05.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 get_obj_state: octx=0x556865099970 obj=check-bucket:_:TkiG3sCCsNTFd-1miQ4-Q5eULGz-sEW_c state=0x556865151e68 s->prefetch_data=0 2024-09-12T17:14:05.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 prepare_atomic_modification: state is not atomic. state=0x556865151e68 2024-09-12T17:14:05.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:14:05.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 10 manifest: total_size = 22 2024-09-12T17:14:05.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2863074978303245001 2024-09-12T17:14:05.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 get_obj_state: octx=0x556864ded970 obj=check-bucket:_:QNLuqbsbzekbTm13dU5HxocQr5-HWW4_e state=0x55686514cab8 s->prefetch_data=0 2024-09-12T17:14:05.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 prepare_atomic_modification: state is not atomic. state=0x55686514cab8 2024-09-12T17:14:05.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:14:05.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 10 manifest: total_size = 11 2024-09-12T17:14:05.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12022721541246819203 2024-09-12T17:14:05.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 get_obj_state: octx=0x556864dff5e0 obj=check-bucket:_:lfsgcQrTJCBBWkeZE40ij-aoeD5NiDL_d state=0x5568651577e8 s->prefetch_data=0 2024-09-12T17:14:05.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 prepare_atomic_modification: state is not atomic. state=0x5568651577e8 2024-09-12T17:14:05.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.766+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:14:05.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.770+0000 7f0e997e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:14:05.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.770+0000 7f0e997e19c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:14:05.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.770+0000 7f0e997e19c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:14:05.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.770+0000 7f0e997e19c0 5 delete_objs_inline: removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2__shadow:9RhS2z7NdR55Vej.mx6BFNk7CGUbMF6_.NOx3hqyczcfBjGLfI-K9gnAV09rd7cv_0 2024-09-12T17:14:05.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.774+0000 7f0e997e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:14:05.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.774+0000 7f0e997e19c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:14:05.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.774+0000 7f0e997e19c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:14:05.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.774+0000 7f0e997e19c0 5 delete_objs_inline: removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2__shadow:TkiG3sCCsNTFd-1miQ4-Q5eULGz-sEW_.J8VtEcZuoYbshRh-BamcuQfPaaxX0jV_0 2024-09-12T17:14:05.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.774+0000 7f0d7a7fc640 20 handle_completion(): completion ok for obj=f[9RhS2z7NdR55Vej.mx6BFNk7CGUbMF6] 2024-09-12T17:14:05.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.774+0000 7f0d7affd640 20 handle_completion(): completion ok for obj=c[TkiG3sCCsNTFd-1miQ4-Q5eULGz-sEW] 2024-09-12T17:14:05.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.778+0000 7f0e997e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:14:05.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.778+0000 7f0e997e19c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:14:05.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.778+0000 7f0e997e19c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:14:05.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.778+0000 7f0e997e19c0 5 delete_objs_inline: removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2__shadow:QNLuqbsbzekbTm13dU5HxocQr5-HWW4_.zkn8xMd3Rr0R6Rs4AvGNsWVGaplZjZS_0 2024-09-12T17:14:05.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.778+0000 7f0e997e19c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:14:05.782 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.778+0000 7f0e997e19c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:14:05.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.778+0000 7f0e997e19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:14:05.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.778+0000 7f0e997e19c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:14:05.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.778+0000 7f0e997e19c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:14:05.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.778+0000 7f0e997e19c0 5 delete_objs_inline: removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2__shadow:lfsgcQrTJCBBWkeZE40ij-aoeD5NiDL_.Eif8c8j3nWgfHlyIOcvEAwLzVN262Aw_0 2024-09-12T17:14:05.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.778+0000 7f0e997e19c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:14:05.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.778+0000 7f0d7affd640 20 handle_completion(): completion ok for obj=e[QNLuqbsbzekbTm13dU5HxocQr5-HWW4] 2024-09-12T17:14:05.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.782+0000 7f0e997e19c0 20 get_obj_state: octx=0x55686509a330 obj=check-bucket:f state=0x55686509c188 s->prefetch_data=0 2024-09-12T17:14:05.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.782+0000 7f0e997e19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7x7bb2o6xcndwmj92xlirf504jyklyl5 2024-09-12T17:14:05.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.782+0000 7f0e997e19c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:14:05.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.782+0000 7f0e997e19c0 20 get_obj_state: octx=0x556864ded970 obj=check-bucket:e state=0x5568650a1598 s->prefetch_data=0 2024-09-12T17:14:05.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.782+0000 7f0e997e19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=v6eeviaf3rl4izxi9boezbhperi08a4t 2024-09-12T17:14:05.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.782+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:14:05.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.782+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:14:05.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.782+0000 7f0d7affd640 20 handle_completion(): completion ok for obj=d[lfsgcQrTJCBBWkeZE40ij-aoeD5NiDL] 2024-09-12T17:14:05.790 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.786+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.8 2024-09-12T17:14:05.790 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.786+0000 7f0e997e19c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:14:05.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.790+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:14:05.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.790+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:14:05.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.790+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:14:05.797 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.794+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:14:05.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.794+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.10 2024-09-12T17:14:05.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.794+0000 7f0e997e19c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T17:14:05.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.794+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.5 2024-09-12T17:14:05.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.794+0000 7f0e997e19c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:14:05.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.794+0000 7f0e997e19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2.1 2024-09-12T17:14:05.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.794+0000 7f0e997e19c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T17:14:05.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.794+0000 7f0e997e19c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:14:05.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.798+0000 7f0d4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:05.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.802+0000 7f0e997e19c0 20 remove_watcher() i=0 2024-09-12T17:14:05.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.802+0000 7f0e997e19c0 2 removed watcher, disabling cache 2024-09-12T17:14:05.808 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.806+0000 7f0e997e19c0 20 remove_watcher() i=1 2024-09-12T17:14:05.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.806+0000 7f0e997e19c0 20 remove_watcher() i=2 2024-09-12T17:14:05.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.810+0000 7f0e997e19c0 20 remove_watcher() i=3 2024-09-12T17:14:05.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.810+0000 7f0e997e19c0 20 remove_watcher() i=4 2024-09-12T17:14:05.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.814+0000 7f0e997e19c0 20 remove_watcher() i=5 2024-09-12T17:14:05.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.814+0000 7f0e997e19c0 20 remove_watcher() i=6 2024-09-12T17:14:05.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:05.818+0000 7f0e997e19c0 20 remove_watcher() i=7 2024-09-12T17:14:06.398 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:14:06.431 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:06.431 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:06.478 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:06.474+0000 7f5240db39c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:06.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:06.474+0000 7f5240db39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:06.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:06.474+0000 7f5240db39c0 20 realm 2024-09-12T17:14:06.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:06.474+0000 7f5240db39c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:06.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:06.474+0000 7f5240db39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:06.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:06.474+0000 7f5240db39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:06.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:06.474+0000 7f5240db39c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:06.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:06.478+0000 7f5240db39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:06.481 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:06.478+0000 7f5240db39c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:06.482 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:06.478+0000 7f5240db39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:06.482 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:06.478+0000 7f5240db39c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:06.483 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:06.478+0000 7f5240db39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:06.483 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:06.478+0000 7f5240db39c0 20 searching for the correct realm 2024-09-12T17:14:06.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:06.482+0000 7f523f0ba640 0 -- 172.21.15.119:0/1270957508 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x5561ab0cbe10 msgr2=0x5561ab0ce200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:06.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:06.490+0000 7f5237fff640 0 -- 172.21.15.119:0/1270957508 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f5238088870 msgr2=0x7f523805c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:07.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.110+0000 7f5240db39c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:14:07.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.110+0000 7f5240db39c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:14:07.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.110+0000 7f5240db39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:07.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.110+0000 7f5240db39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:07.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.110+0000 7f5240db39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:07.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.110+0000 7f5240db39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:07.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.110+0000 7f5240db39c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.114+0000 7f5240db39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.114+0000 7f5240db39c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.114+0000 7f5240db39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:07.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.114+0000 7f5240db39c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.114+0000 7f5240db39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:07.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.114+0000 7f5240db39c0 20 zone default found 2024-09-12T17:14:07.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.114+0000 7f5240db39c0 4 Realm: () 2024-09-12T17:14:07.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.114+0000 7f5240db39c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:14:07.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.114+0000 7f5240db39c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:14:07.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.114+0000 7f5240db39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:07.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.114+0000 7f5240db39c0 20 zonegroup default 2024-09-12T17:14:07.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.114+0000 7f5240db39c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.114+0000 7f5240db39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.114+0000 7f5240db39c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.118+0000 7f5240db39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.118+0000 7f5240db39c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.118+0000 7f5240db39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.118+0000 7f5240db39c0 20 started sync module instance, tier type = 2024-09-12T17:14:07.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.118+0000 7f5240db39c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:14:07.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.142+0000 7f5240db39c0 20 add_watcher() i=0 2024-09-12T17:14:07.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.142+0000 7f5240db39c0 20 add_watcher() i=1 2024-09-12T17:14:07.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.142+0000 7f5240db39c0 20 add_watcher() i=2 2024-09-12T17:14:07.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.142+0000 7f5240db39c0 20 add_watcher() i=3 2024-09-12T17:14:07.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.142+0000 7f5240db39c0 20 add_watcher() i=4 2024-09-12T17:14:07.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.142+0000 7f5240db39c0 20 add_watcher() i=5 2024-09-12T17:14:07.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.142+0000 7f5240db39c0 20 add_watcher() i=6 2024-09-12T17:14:07.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.142+0000 7f5240db39c0 20 add_watcher() i=7 2024-09-12T17:14:07.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.142+0000 7f5240db39c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:07.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.146+0000 7f50f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:07.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.150+0000 7f5240db39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:07.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.150+0000 7f5240db39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:07.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.150+0000 7f5240db39c0 5 note: GC not initialized 2024-09-12T17:14:07.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.150+0000 7f506ffff640 20 reqs_thread_entry: start 2024-09-12T17:14:07.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.150+0000 7f5240db39c0 20 init_complete bucket index max shards: 11 2024-09-12T17:14:07.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.150+0000 7f5240db39c0 20 Filter name: none 2024-09-12T17:14:07.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.150+0000 7f506dffb640 20 reqs_thread_entry: start 2024-09-12T17:14:07.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.150+0000 7f5240db39c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.150+0000 7f5240db39c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:07.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.150+0000 7f5240db39c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.150+0000 7f5240db39c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:07.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.150+0000 7f5240db39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:07.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.150+0000 7f5240db39c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.154+0000 7f5240db39c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:07.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.154+0000 7f5240db39c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.154+0000 7f5240db39c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:07.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.154+0000 7f5240db39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:07.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.158+0000 7f50f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:07.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.162+0000 7f5240db39c0 20 remove_watcher() i=0 2024-09-12T17:14:07.167 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.162+0000 7f5240db39c0 2 removed watcher, disabling cache 2024-09-12T17:14:07.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.166+0000 7f5240db39c0 20 remove_watcher() i=1 2024-09-12T17:14:07.172 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.166+0000 7f5240db39c0 20 remove_watcher() i=2 2024-09-12T17:14:07.173 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.170+0000 7f5240db39c0 20 remove_watcher() i=3 2024-09-12T17:14:07.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.170+0000 7f5240db39c0 20 remove_watcher() i=4 2024-09-12T17:14:07.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.174+0000 7f5240db39c0 20 remove_watcher() i=5 2024-09-12T17:14:07.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.174+0000 7f5240db39c0 20 remove_watcher() i=6 2024-09-12T17:14:07.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:14:07.174+0000 7f5240db39c0 20 remove_watcher() i=7 2024-09-12T17:14:07.197 INFO:tasks.workunit.client.0.smithi119.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:14:07.197 INFO:tasks.workunit.client.0.smithi119.stderr:Deleting bucket check-bucket 2024-09-12T17:14:07.820 INFO:tasks.workunit.client.0.smithi119.stderr:Completed bucket check tests 2024-09-12T17:14:07.879 INFO:tasks.workunit.client.0.smithi119.stdout:connected to http://localhost:80 2024-09-12T17:14:07.916 INFO:tasks.workunit.client.0.smithi119.stderr:+ deactivate 2024-09-12T17:14:07.916 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T17:14:07.916 INFO:tasks.workunit.client.0.smithi119.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:14:07.916 INFO:tasks.workunit.client.0.smithi119.stderr:+ export PATH 2024-09-12T17:14:07.917 INFO:tasks.workunit.client.0.smithi119.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:14:07.917 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' -n '' ']' 2024-09-12T17:14:07.917 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:14:07.917 INFO:tasks.workunit.client.0.smithi119.stderr:+ hash -r 2024-09-12T17:14:07.917 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' -n '' ']' 2024-09-12T17:14:07.917 INFO:tasks.workunit.client.0.smithi119.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:14:07.917 INFO:tasks.workunit.client.0.smithi119.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:14:07.917 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:14:07.917 INFO:tasks.workunit.client.0.smithi119.stderr:+ unset -f deactivate 2024-09-12T17:14:07.917 INFO:tasks.workunit.client.0.smithi119.stderr:+ echo OK. 2024-09-12T17:14:07.918 INFO:tasks.workunit.client.0.smithi119.stdout:OK. 2024-09-12T17:14:07.918 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:14:07.919 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:14:07.973 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T17:14:07.973 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:14:08.394 DEBUG:teuthology.parallel:result is None 2024-09-12T17:14:08.394 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:14:08.407 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:14:08.407 DEBUG:teuthology.orchestra.run.smithi119:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:14:08.453 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:14:08.453 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:14:08.464 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:14:08.464 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:14:08.464 DEBUG:teuthology.orchestra.run.smithi119:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:14:08.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:14:08.501 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:14:08.501 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:14:08.549 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:14:08.550 DEBUG:teuthology.orchestra.run.smithi119:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:14:08.597 INFO:tasks.workunit:timeout=3h 2024-09-12T17:14:08.597 INFO:tasks.workunit:cleanup=True 2024-09-12T17:14:08.598 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:14:08.647 INFO:tasks.workunit.client.0.smithi119.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:15:06.427 INFO:tasks.workunit.client.0.smithi119.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:15:06.427 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:15:06.427 INFO:tasks.workunit.client.0.smithi119.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:15:06.428 INFO:tasks.workunit.client.0.smithi119.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:15:06.428 INFO:tasks.workunit.client.0.smithi119.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:15:06.428 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:15:06.428 INFO:tasks.workunit.client.0.smithi119.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:15:06.428 INFO:tasks.workunit.client.0.smithi119.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:15:06.428 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:15:06.428 INFO:tasks.workunit.client.0.smithi119.stderr: git switch -c 2024-09-12T17:15:06.428 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:15:06.428 INFO:tasks.workunit.client.0.smithi119.stderr:Or undo this operation with: 2024-09-12T17:15:06.428 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:15:06.428 INFO:tasks.workunit.client.0.smithi119.stderr: git switch - 2024-09-12T17:15:06.428 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:15:06.428 INFO:tasks.workunit.client.0.smithi119.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:15:06.429 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:15:06.429 INFO:tasks.workunit.client.0.smithi119.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:15:06.434 DEBUG:teuthology.orchestra.run.smithi119:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:15:06.482 INFO:tasks.workunit.client.0.smithi119.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:15:06.485 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:15:06.485 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:15:06.545 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:15:06.600 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:15:06.640 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:15:06.641 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:15:06.641 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:15:06.684 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:15:06.687 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:15:06.688 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:15:06.732 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T17:15:06.733 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T17:15:06.734 DEBUG:teuthology.orchestra.run.smithi119:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T17:15:06.801 INFO:tasks.workunit.client.0.smithi119.stdout:Running main() from gmock_main.cc 2024-09-12T17:15:06.802 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:15:06.802 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:15:06.802 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 11 tests from ClsLock 2024-09-12T17:15:06.802 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T17:15:08.610 INFO:tasks.workunit.client.0.smithi119.stdout:lock: mylock 2024-09-12T17:15:08.666 INFO:tasks.workunit.client.0.smithi119.stdout: lock_type: exclusive 2024-09-12T17:15:08.666 INFO:tasks.workunit.client.0.smithi119.stdout: tag: 2024-09-12T17:15:08.666 INFO:tasks.workunit.client.0.smithi119.stdout: lockers: 2024-09-12T17:15:08.666 INFO:tasks.workunit.client.0.smithi119.stdout: client.5078 expiration=2024-09-12T17:17:08.603616+0000 addr=v1:172.21.15.119:0/2674862450 cookie= 2024-09-12T17:15:08.667 INFO:tasks.workunit.client.0.smithi119.stdout:lock: mylock 2024-09-12T17:15:08.667 INFO:tasks.workunit.client.0.smithi119.stdout: lock_type: shared 2024-09-12T17:15:08.667 INFO:tasks.workunit.client.0.smithi119.stdout: tag: 2024-09-12T17:15:08.667 INFO:tasks.workunit.client.0.smithi119.stdout: lockers: 2024-09-12T17:15:08.667 INFO:tasks.workunit.client.0.smithi119.stdout: client.5078 expiration=2024-09-12T17:17:08.617490+0000 addr=v1:172.21.15.119:0/2674862450 cookie= 2024-09-12T17:15:08.667 INFO:tasks.workunit.client.0.smithi119.stdout: client.5081 expiration=0.000000 addr=v1:172.21.15.119:0/659652132 cookie= 2024-09-12T17:15:08.668 INFO:tasks.workunit.client.0.smithi119.stdout:lock: mylock 2024-09-12T17:15:08.668 INFO:tasks.workunit.client.0.smithi119.stdout: lock_type: shared 2024-09-12T17:15:08.668 INFO:tasks.workunit.client.0.smithi119.stdout: tag: 2024-09-12T17:15:08.668 INFO:tasks.workunit.client.0.smithi119.stdout: lockers: 2024-09-12T17:15:08.668 INFO:tasks.workunit.client.0.smithi119.stdout: client.5081 expiration=0.000000 addr=v1:172.21.15.119:0/659652132 cookie= 2024-09-12T17:15:09.567 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] ClsLock.TestMultiLocking (2765 ms) 2024-09-12T17:15:09.567 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T17:15:12.028 INFO:tasks.workunit.client.0.smithi119.stdout:lock: mylock 2024-09-12T17:15:12.028 INFO:tasks.workunit.client.0.smithi119.stdout: lock_type: shared 2024-09-12T17:15:12.028 INFO:tasks.workunit.client.0.smithi119.stdout: tag: 2024-09-12T17:15:12.028 INFO:tasks.workunit.client.0.smithi119.stdout: lockers: 2024-09-12T17:15:12.028 INFO:tasks.workunit.client.0.smithi119.stdout: client.5238 expiration=0.000000 addr=v1:172.21.15.119:0/1452023259 cookie= 2024-09-12T17:15:12.034 INFO:tasks.workunit.client.0.smithi119.stdout:lock: mylock 2024-09-12T17:15:12.034 INFO:tasks.workunit.client.0.smithi119.stdout: lock_type: exclusive 2024-09-12T17:15:12.034 INFO:tasks.workunit.client.0.smithi119.stdout: tag: new_tag 2024-09-12T17:15:12.034 INFO:tasks.workunit.client.0.smithi119.stdout: lockers: 2024-09-12T17:15:12.034 INFO:tasks.workunit.client.0.smithi119.stdout: client.5087 expiration=0.000000 addr=v1:172.21.15.119:0/4218653704 cookie= 2024-09-12T17:15:12.576 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] ClsLock.TestMeta (3010 ms) 2024-09-12T17:15:12.577 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T17:15:14.661 INFO:tasks.workunit.client.0.smithi119.stdout:lock: mylock 2024-09-12T17:15:14.662 INFO:tasks.workunit.client.0.smithi119.stdout: lock_type: exclusive 2024-09-12T17:15:14.662 INFO:tasks.workunit.client.0.smithi119.stdout: tag: 2024-09-12T17:15:14.662 INFO:tasks.workunit.client.0.smithi119.stdout: lockers: 2024-09-12T17:15:14.666 INFO:tasks.workunit.client.0.smithi119.stdout:lock: mylock 2024-09-12T17:15:14.666 INFO:tasks.workunit.client.0.smithi119.stdout: lock_type: shared 2024-09-12T17:15:14.666 INFO:tasks.workunit.client.0.smithi119.stdout: tag: 2024-09-12T17:15:14.666 INFO:tasks.workunit.client.0.smithi119.stdout: lockers: 2024-09-12T17:15:14.666 INFO:tasks.workunit.client.0.smithi119.stdout: client.5244 expiration=0.000000 addr=v1:172.21.15.119:0/1690902186 cookie= 2024-09-12T17:15:14.666 INFO:tasks.workunit.client.0.smithi119.stdout: client.5244 expiration=0.000000 addr=v1:172.21.15.119:0/1690902186 cookie=new cookie 2024-09-12T17:15:15.621 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] ClsLock.TestCookie (3045 ms) 2024-09-12T17:15:15.622 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T17:15:18.656 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] ClsLock.TestMultipleLocks (3035 ms) 2024-09-12T17:15:18.657 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T17:15:26.719 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] ClsLock.TestLockDuration (8062 ms) 2024-09-12T17:15:26.719 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T17:15:29.756 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] ClsLock.TestAssertLocked (3037 ms) 2024-09-12T17:15:29.756 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T17:15:32.759 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] ClsLock.TestSetCookie (3004 ms) 2024-09-12T17:15:32.760 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T17:15:53.868 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] ClsLock.TestRenew (21107 ms) 2024-09-12T17:15:53.869 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T17:15:59.972 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6106 ms) 2024-09-12T17:15:59.972 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T17:16:07.073 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7101 ms) 2024-09-12T17:16:07.073 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T17:16:15.104 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8031 ms) 2024-09-12T17:16:15.104 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 11 tests from ClsLock (68303 ms total) 2024-09-12T17:16:15.104 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:16:15.104 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:16:15.104 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 11 tests from 1 test suite ran. (68303 ms total) 2024-09-12T17:16:15.104 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 11 tests. 2024-09-12T17:16:15.112 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:16:15.112 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:16:15.168 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T17:16:15.169 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T17:16:15.170 DEBUG:teuthology.orchestra.run.smithi119:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T17:16:15.235 INFO:tasks.workunit.client.0.smithi119.stdout:Running main() from gmock_main.cc 2024-09-12T17:16:15.235 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:16:15.235 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:16:15.235 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 4 tests from cls_log 2024-09-12T17:16:15.235 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T17:16:18.167 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_log.test_log_add_same_time (2926 ms) 2024-09-12T17:16:18.168 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T17:16:21.200 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_log.test_log_add_different_time (3034 ms) 2024-09-12T17:16:21.200 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T17:16:24.239 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_log.trim_by_time (3043 ms) 2024-09-12T17:16:24.239 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T17:16:27.285 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_log.trim_by_marker (3046 ms) 2024-09-12T17:16:27.285 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 4 tests from cls_log (12050 ms total) 2024-09-12T17:16:27.285 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:16:27.286 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:16:27.286 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 4 tests from 1 test suite ran. (12051 ms total) 2024-09-12T17:16:27.286 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 4 tests. 2024-09-12T17:16:27.293 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:16:27.293 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:16:27.348 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T17:16:27.349 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T17:16:27.349 DEBUG:teuthology.orchestra.run.smithi119:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T17:16:27.413 INFO:tasks.workunit.client.0.smithi119.stdout:Running main() from gmock_main.cc 2024-09-12T17:16:27.414 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:16:27.414 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:16:27.414 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 10 tests from cls_refcount 2024-09-12T17:16:27.414 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T17:16:30.335 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_refcount.test_implicit (2918 ms) 2024-09-12T17:16:30.335 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T17:16:33.374 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3042 ms) 2024-09-12T17:16:33.374 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T17:16:42.454 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_refcount.test_put_snap (9080 ms) 2024-09-12T17:16:42.454 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T17:16:45.469 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_refcount.test_explicit (3015 ms) 2024-09-12T17:16:45.469 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_refcount.set 2024-09-12T17:16:48.523 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_refcount.set (3050 ms) 2024-09-12T17:16:48.523 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T17:16:55.568 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_refcount.test_implicit_ec (7050 ms) 2024-09-12T17:16:55.568 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T17:17:02.629 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7060 ms) 2024-09-12T17:17:02.629 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T17:17:15.745 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_refcount.test_put_snap_ec (13116 ms) 2024-09-12T17:17:15.745 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T17:17:22.819 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_refcount.test_explicit_ec (7075 ms) 2024-09-12T17:17:22.819 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T17:17:29.849 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_refcount.set_ec (7030 ms) 2024-09-12T17:17:29.849 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 10 tests from cls_refcount (62436 ms total) 2024-09-12T17:17:29.849 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:17:29.849 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:17:29.850 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 10 tests from 1 test suite ran. (62436 ms total) 2024-09-12T17:17:29.850 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 10 tests. 2024-09-12T17:17:29.855 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:17:29.855 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:17:29.916 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T17:17:29.917 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T17:17:29.918 DEBUG:teuthology.orchestra.run.smithi119:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T17:17:29.982 INFO:tasks.workunit.client.0.smithi119.stdout:Running main() from gmock_main.cc 2024-09-12T17:17:29.982 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-12T17:17:29.982 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:17:29.982 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 18 tests from cls_rgw 2024-09-12T17:17:31.879 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T17:17:31.948 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.index_basic (69 ms) 2024-09-12T17:17:31.948 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T17:17:32.023 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (75 ms) 2024-09-12T17:17:32.023 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T17:17:32.137 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.index_remove_object (114 ms) 2024-09-12T17:17:32.137 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T17:17:34.626 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.index_suggest (2489 ms) 2024-09-12T17:17:34.626 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T17:17:34.641 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.index_suggest_complete (15 ms) 2024-09-12T17:17:34.641 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T17:17:34.697 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.index_list (56 ms) 2024-09-12T17:17:34.697 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T17:18:17.277 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.index_list_delimited (42580 ms) 2024-09-12T17:18:17.277 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T17:18:17.460 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.bi_list (183 ms) 2024-09-12T17:18:17.460 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T17:18:17.486 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.gc_set (27 ms) 2024-09-12T17:18:17.486 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T17:18:17.512 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.gc_list (26 ms) 2024-09-12T17:18:17.512 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T17:18:25.436 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.gc_defer (7922 ms) 2024-09-12T17:18:25.436 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T17:18:25.669 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.usage_basic (234 ms) 2024-09-12T17:18:25.669 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T17:18:25.671 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.usage_clear_no_obj (3 ms) 2024-09-12T17:18:25.671 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T17:18:25.955 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.usage_clear (284 ms) 2024-09-12T17:18:25.956 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T17:18:26.074 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.bi_log_trim (119 ms) 2024-09-12T17:18:26.074 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T17:18:26.113 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.index_racing_removes (39 ms) 2024-09-12T17:18:26.113 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T17:18:26.148 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.reshardlog_list (34 ms) 2024-09-12T17:18:26.148 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T17:18:26.171 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw.reshardlog_num (22 ms) 2024-09-12T17:18:26.461 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 18 tests from cls_rgw (54292 ms total) 2024-09-12T17:18:26.461 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:18:26.461 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:18:26.461 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 18 tests from 1 test suite ran. (56479 ms total) 2024-09-12T17:18:26.461 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 18 tests. 2024-09-12T17:18:26.469 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:18:26.469 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:18:26.524 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T17:18:26.525 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T17:18:26.525 DEBUG:teuthology.orchestra.run.smithi119:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T17:18:26.586 INFO:tasks.workunit.client.0.smithi119.stdout:Running main() from gmock_main.cc 2024-09-12T17:18:26.586 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:18:26.586 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:18:26.586 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T17:18:26.586 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T17:18:28.481 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw_gc.init (1892 ms) 2024-09-12T17:18:28.481 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T17:18:28.510 INFO:tasks.workunit.client.0.smithi119.stderr:[ ] list info tag = chain-0 2024-09-12T17:18:28.511 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (32 ms) 2024-09-12T17:18:28.511 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T17:18:28.523 INFO:tasks.workunit.client.0.smithi119.stderr:[ ] next_marker is: = 0/4263 2024-09-12T17:18:28.524 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (13 ms) 2024-09-12T17:18:28.524 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T17:18:28.539 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (16 ms) 2024-09-12T17:18:28.539 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T17:18:29.142 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (602 ms) 2024-09-12T17:18:29.142 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T17:18:29.161 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (20 ms) 2024-09-12T17:18:29.161 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T17:18:29.180 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (19 ms) 2024-09-12T17:18:29.180 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T17:18:29.196 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (16 ms) 2024-09-12T17:18:29.196 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T17:18:29.492 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw_gc.finalize (289 ms) 2024-09-12T17:18:29.492 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 9 tests from cls_rgw_gc (2899 ms total) 2024-09-12T17:18:29.492 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:18:29.492 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:18:29.492 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 9 tests from 1 test suite ran. (2899 ms total) 2024-09-12T17:18:29.492 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 9 tests. 2024-09-12T17:18:29.493 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:18:29.493 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:18:29.547 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T17:18:29.548 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T17:18:29.549 DEBUG:teuthology.orchestra.run.smithi119:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T17:18:29.623 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:18:29.624 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:18:29.624 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T17:18:29.624 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:18:31.539 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T17:18:31.539 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T17:18:31.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.566+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=2YQC87GU2H8W type=del size=1821291 2024-09-12T17:18:31.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.570+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~F6CZO3XENONK.0 size=1048576 2024-09-12T17:18:31.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.574+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~F6CZO3XENONK.1 size=985865 2024-09-12T17:18:31.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.574+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=F6CZO3XENONK tag=VWJGQA76TWFR type=write size=3083017 2024-09-12T17:18:31.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.578+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~RFK3BEIXF7G8.0 size=909660 2024-09-12T17:18:31.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.578+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=RFK3BEIXF7G8 tag=PYS287X01M6R type=write size=1958236 2024-09-12T17:18:31.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.578+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=59ZLCVBEGRTQ type=del size=2861325 2024-09-12T17:18:31.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.582+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=DIYGO2IXSCBD type=del size=3536465 2024-09-12T17:18:31.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.586+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~OBAKX6LJ1YIK.0 size=1048576 2024-09-12T17:18:31.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.586+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~OBAKX6LJ1YIK.1 size=895084 2024-09-12T17:18:31.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.586+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=OBAKX6LJ1YIK tag=6AH01DDK7Z6B type=write size=2992236 2024-09-12T17:18:31.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.590+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=0E841PO6GWND type=del size=291128 2024-09-12T17:18:31.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.590+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=4Z9LIFL0A4I1 type=del size=700110 2024-09-12T17:18:31.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.594+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=KEDFFB052A1W type=del size=4161513 2024-09-12T17:18:31.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.594+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=B72LGXUBELLS type=del size=1517249 2024-09-12T17:18:31.601 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.598+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~QUU1W3XL6PTP.0 size=755488 2024-09-12T17:18:31.601 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.598+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=QUU1W3XL6PTP tag=RX4TFU53RS9J type=write size=1804064 2024-09-12T17:18:31.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.602+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~122TNGUU3627.0 size=1048576 2024-09-12T17:18:31.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.606+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~122TNGUU3627.1 size=1048576 2024-09-12T17:18:31.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.606+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~122TNGUU3627.2 size=601803 2024-09-12T17:18:31.609 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.606+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=122TNGUU3627 tag=BLGCMXU6EF22 type=write size=3747531 2024-09-12T17:18:31.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.610+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=M3XLLHI4BR5J type=del size=554766 2024-09-12T17:18:31.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.610+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=1HE0POZVGBCE type=del size=3392695 2024-09-12T17:18:31.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.614+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=B9JV2XVLZZWJ type=del size=2890876 2024-09-12T17:18:31.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.622+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=OJMJ3SKMPJTM type=del size=180554 2024-09-12T17:18:31.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.626+0000 7f96641d38c0 1 < canceled operation key=ZKDOIH5SH6K0 tag=2YQC87GU2H8W type=del size=1821291 2024-09-12T17:18:31.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.630+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~WZ5OP6RXHXFW.0 size=1048576 2024-09-12T17:18:31.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.630+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~WZ5OP6RXHXFW.1 size=1048576 2024-09-12T17:18:31.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.634+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~WZ5OP6RXHXFW.2 size=175882 2024-09-12T17:18:31.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.634+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=WZ5OP6RXHXFW tag=LIW4FTDTUEB2 type=write size=3321610 2024-09-12T17:18:31.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.634+0000 7f96641d38c0 1 < canceled part key=_multipart_H3LV5G117KOW.2~F6CZO3XENONK.0 size=1048576 2024-09-12T17:18:31.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.634+0000 7f96641d38c0 1 < canceled part key=_multipart_H3LV5G117KOW.2~F6CZO3XENONK.1 size=985865 2024-09-12T17:18:31.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.638+0000 7f96641d38c0 1 < canceled multipart upload key=H3LV5G117KOW upload=F6CZO3XENONK tag=VWJGQA76TWFR type=write size=3083017 2024-09-12T17:18:31.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.638+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=VDRDEKT2PA3T type=del size=1595495 2024-09-12T17:18:31.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.642+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~RFK3BEIXF7G8.0 size=909660 2024-09-12T17:18:31.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.646+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=RFK3BEIXF7G8 tag=PYS287X01M6R type=write size=1958236 2024-09-12T17:18:31.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.650+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=EAN6HXH1WAEJ type=del size=3604482 2024-09-12T17:18:31.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.654+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=59ZLCVBEGRTQ type=del 2024-09-12T17:18:31.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.654+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=04ZFYMV6RWBX type=del size=3065504 2024-09-12T17:18:31.660 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.658+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=DIYGO2IXSCBD type=del 2024-09-12T17:18:31.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.662+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~HRV1MR5F05AJ.0 size=109863 2024-09-12T17:18:31.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.662+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=HRV1MR5F05AJ tag=H9X34FDGNZYY type=write size=1158439 2024-09-12T17:18:31.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.666+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~OBAKX6LJ1YIK.0 size=1048576 2024-09-12T17:18:31.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.666+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~OBAKX6LJ1YIK.1 size=895084 2024-09-12T17:18:31.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.670+0000 7f96641d38c0 1 < completed multipart upload key=HRU241T0FUEZ upload=OBAKX6LJ1YIK tag=6AH01DDK7Z6B type=write size=2992236 2024-09-12T17:18:31.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.674+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~DUMRJZDDQ33L.0 size=1048576 2024-09-12T17:18:31.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.678+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~DUMRJZDDQ33L.1 size=1048576 2024-09-12T17:18:31.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.678+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~DUMRJZDDQ33L.2 size=806044 2024-09-12T17:18:31.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.678+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=DUMRJZDDQ33L tag=OCTY83U39NCV type=write size=3951772 2024-09-12T17:18:31.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.682+0000 7f96641d38c0 1 < suggested remove operation key=EFORFJYOM45R tag=0E841PO6GWND type=del 2024-09-12T17:18:31.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.686+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=3NVIYZI013NN type=del size=699376 2024-09-12T17:18:31.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.690+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=4Z9LIFL0A4I1 type=del 2024-09-12T17:18:31.693 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.690+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=25BZN7J2ZSUD type=del size=2080855 2024-09-12T17:18:31.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.694+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=KEDFFB052A1W type=del 2024-09-12T17:18:31.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.694+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=VAOBRFTO0WLR type=write size=479193 2024-09-12T17:18:31.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.698+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=B72LGXUBELLS type=del 2024-09-12T17:18:31.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.702+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=ULDM7S4Y7E3K type=del size=1000988 2024-09-12T17:18:31.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.706+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~QUU1W3XL6PTP.0 size=755488 2024-09-12T17:18:31.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.706+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=QUU1W3XL6PTP tag=RX4TFU53RS9J type=write size=1804064 2024-09-12T17:18:31.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.710+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=HL5JNPWSLMAB type=del size=2238917 2024-09-12T17:18:31.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.710+0000 7f96641d38c0 1 < canceled part key=_multipart_NG327LT02T1F.2~122TNGUU3627.0 size=1048576 2024-09-12T17:18:31.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.714+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~122TNGUU3627.1 size=1048576 2024-09-12T17:18:31.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.714+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~122TNGUU3627.2 size=601803 2024-09-12T17:18:31.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.718+0000 7f96641d38c0 1 < canceled multipart upload key=NG327LT02T1F upload=122TNGUU3627 tag=BLGCMXU6EF22 type=write size=3747531 2024-09-12T17:18:31.721 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.718+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=QUPDT6N78MFW type=del size=496554 2024-09-12T17:18:31.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.722+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=M3XLLHI4BR5J type=del 2024-09-12T17:18:31.726 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.726+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=D5Y7AKV2H4KH type=del size=77888 2024-09-12T17:18:31.728 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.726+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=1HE0POZVGBCE type=del 2024-09-12T17:18:31.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.730+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~34GEOHFBQF3W.0 size=1048576 2024-09-12T17:18:31.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.734+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~34GEOHFBQF3W.1 size=1048576 2024-09-12T17:18:31.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.734+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~34GEOHFBQF3W.2 size=981065 2024-09-12T17:18:31.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.734+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=34GEOHFBQF3W tag=1T9XI03K7VPO type=write size=4126793 2024-09-12T17:18:31.741 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.738+0000 7f96641d38c0 1 < suggested update operation key=6BH7SI911MMP tag=B9JV2XVLZZWJ type=del size=2890876 2024-09-12T17:18:31.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.742+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=EGIQ73CX9816 type=del size=1560496 2024-09-12T17:18:31.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.746+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=OJMJ3SKMPJTM type=del 2024-09-12T17:18:31.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.750+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~HL1H91GKFWCD.0 size=1048576 2024-09-12T17:18:31.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.750+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~HL1H91GKFWCD.1 size=1007292 2024-09-12T17:18:31.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.750+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=HL1H91GKFWCD tag=9WIS5N2AHY2R type=write size=3104444 2024-09-12T17:18:31.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.754+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~WZ5OP6RXHXFW.0 size=1048576 2024-09-12T17:18:31.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.754+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~WZ5OP6RXHXFW.1 size=1048576 2024-09-12T17:18:31.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.754+0000 7f96641d38c0 1 < canceled part key=_multipart_MOQXP4AXMTCK.2~WZ5OP6RXHXFW.2 size=175882 2024-09-12T17:18:31.761 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.758+0000 7f96641d38c0 1 < canceled multipart upload key=MOQXP4AXMTCK upload=WZ5OP6RXHXFW tag=LIW4FTDTUEB2 type=write size=3321610 2024-09-12T17:18:31.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.762+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=11IRUGK070RL type=del size=1775214 2024-09-12T17:18:31.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.762+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=VDRDEKT2PA3T type=del 2024-09-12T17:18:31.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.766+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=UOOMUS068COQ type=del size=1381797 2024-09-12T17:18:31.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.770+0000 7f96641d38c0 1 < suggested update operation key=NGA3P9RZJYWT tag=EAN6HXH1WAEJ type=del size=3604482 2024-09-12T17:18:31.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.774+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~92QTBJGS3EIQ.0 size=1048576 2024-09-12T17:18:31.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.778+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~92QTBJGS3EIQ.1 size=1048576 2024-09-12T17:18:31.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.778+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~92QTBJGS3EIQ.2 size=965453 2024-09-12T17:18:31.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.778+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=92QTBJGS3EIQ tag=3RDD57N8AGI1 type=write size=4111181 2024-09-12T17:18:31.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.782+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=04ZFYMV6RWBX type=del 2024-09-12T17:18:31.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.782+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=0BTBN7EGLYBG type=del size=2824347 2024-09-12T17:18:31.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.786+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~HRV1MR5F05AJ.0 size=109863 2024-09-12T17:18:31.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.790+0000 7f96641d38c0 1 < completed multipart upload key=0X2HHMHJUJNL upload=HRV1MR5F05AJ tag=H9X34FDGNZYY type=write size=1158439 2024-09-12T17:18:31.793 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.790+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=UW25KFFEWX2Q type=write size=322789 2024-09-12T17:18:31.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.794+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~DUMRJZDDQ33L.0 size=1048576 2024-09-12T17:18:31.797 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.794+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~DUMRJZDDQ33L.1 size=1048576 2024-09-12T17:18:31.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.798+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~DUMRJZDDQ33L.2 size=806044 2024-09-12T17:18:31.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.802+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=DUMRJZDDQ33L tag=OCTY83U39NCV type=write size=3951772 2024-09-12T17:18:31.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.806+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=6I5ZI2NCRL07 type=del size=3919867 2024-09-12T17:18:31.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.806+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=3NVIYZI013NN type=del 2024-09-12T17:18:31.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.810+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=FG3HUAUL16ZY type=del size=2069760 2024-09-12T17:18:31.818 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.818+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=25BZN7J2ZSUD type=del 2024-09-12T17:18:31.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.822+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~40W8ANDAMZRY.0 size=1048576 2024-09-12T17:18:31.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.826+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~40W8ANDAMZRY.1 size=663357 2024-09-12T17:18:31.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.826+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=40W8ANDAMZRY tag=43FGXBI1QY7S type=write size=2760509 2024-09-12T17:18:31.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.826+0000 7f96641d38c0 1 < canceled operation key=LK3F25OHR7AO tag=VAOBRFTO0WLR type=write size=479193 2024-09-12T17:18:31.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.834+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~7I7CK528ZYMH.0 size=668208 2024-09-12T17:18:31.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.834+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=7I7CK528ZYMH tag=B3C2U23YVZHR type=write size=1716784 2024-09-12T17:18:31.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.834+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=ULDM7S4Y7E3K type=del 2024-09-12T17:18:31.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.838+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~MUYBZ5CDYSTL.0 size=272481 2024-09-12T17:18:31.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.838+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=MUYBZ5CDYSTL tag=6ADK1HSU9H1I type=write size=1321057 2024-09-12T17:18:31.846 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.846+0000 7f96641d38c0 1 < suggested remove operation key=NGA3P9RZJYWT tag=HL5JNPWSLMAB type=del 2024-09-12T17:18:31.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.850+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~3ULNQW59CORY.0 size=1048576 2024-09-12T17:18:31.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.850+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~3ULNQW59CORY.1 size=64731 2024-09-12T17:18:31.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.850+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=3ULNQW59CORY tag=4FKYC52MFHCQ type=write size=2161883 2024-09-12T17:18:31.856 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.854+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=QUPDT6N78MFW type=del 2024-09-12T17:18:31.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.858+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=W6BCLWCYTPZV type=write size=668136 2024-09-12T17:18:31.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.858+0000 7f96641d38c0 1 < canceled operation key=XDL9O7TEMBYF tag=D5Y7AKV2H4KH type=del size=77888 2024-09-12T17:18:31.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.862+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=USU6LLIOA2NC type=del size=2375396 2024-09-12T17:18:31.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.862+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~34GEOHFBQF3W.0 size=1048576 2024-09-12T17:18:31.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.866+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~34GEOHFBQF3W.1 size=1048576 2024-09-12T17:18:31.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.866+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~34GEOHFBQF3W.2 size=981065 2024-09-12T17:18:31.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.870+0000 7f96641d38c0 1 < completed multipart upload key=EFORFJYOM45R upload=34GEOHFBQF3W tag=1T9XI03K7VPO type=write size=4126793 2024-09-12T17:18:31.876 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.874+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=9RJKFWOYUQ6N type=del size=2385080 2024-09-12T17:18:31.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.878+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=EGIQ73CX9816 type=del 2024-09-12T17:18:31.880 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.878+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=6FFV62AQS8SA type=del size=2320117 2024-09-12T17:18:31.883 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.882+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~HL1H91GKFWCD.0 size=1048576 2024-09-12T17:18:31.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.882+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~HL1H91GKFWCD.1 size=1007292 2024-09-12T17:18:31.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.886+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=HL1H91GKFWCD tag=9WIS5N2AHY2R type=write size=3104444 2024-09-12T17:18:31.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.890+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=MB4FJF12QWW5 type=write size=64855 2024-09-12T17:18:31.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.894+0000 7f96641d38c0 1 < completed delete operation key=KXJYJ9VX7YVW tag=11IRUGK070RL type=del 2024-09-12T17:18:31.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.898+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~QUCRB1QXCGLN.0 size=1048576 2024-09-12T17:18:31.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.898+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~QUCRB1QXCGLN.1 size=710123 2024-09-12T17:18:31.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.898+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=QUCRB1QXCGLN tag=VBWLFS0ZCNVH type=write size=2807275 2024-09-12T17:18:31.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.902+0000 7f96641d38c0 1 < canceled operation key=5ZZI4F92J7BO tag=UOOMUS068COQ type=del size=1381797 2024-09-12T17:18:31.907 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.906+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~M3XQKDIXH4O8.0 size=1048576 2024-09-12T17:18:31.909 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.906+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~M3XQKDIXH4O8.1 size=1048576 2024-09-12T17:18:31.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.910+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~M3XQKDIXH4O8.2 size=407008 2024-09-12T17:18:31.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.910+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=M3XQKDIXH4O8 tag=1LG1WJC3RTCE type=write size=3552736 2024-09-12T17:18:31.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.910+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~92QTBJGS3EIQ.0 size=1048576 2024-09-12T17:18:31.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.914+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~92QTBJGS3EIQ.1 size=1048576 2024-09-12T17:18:31.917 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.914+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~92QTBJGS3EIQ.2 size=965453 2024-09-12T17:18:31.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.918+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=92QTBJGS3EIQ tag=3RDD57N8AGI1 type=write size=4111181 2024-09-12T17:18:31.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.922+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=ZOX1Z6FTCN9U type=del size=2119264 2024-09-12T17:18:31.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.922+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=0BTBN7EGLYBG type=del 2024-09-12T17:18:31.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.926+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=RTWHIC2TX3WO type=del size=305443 2024-09-12T17:18:31.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.930+0000 7f96641d38c0 1 < completed write operation key=UBYUSW4C2V19 tag=UW25KFFEWX2Q type=write size=322789 2024-09-12T17:18:31.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.930+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=DS9TP1TSW8DX type=write size=698100 2024-09-12T17:18:31.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.934+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=6I5ZI2NCRL07 type=del 2024-09-12T17:18:31.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.938+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~HTS09TOF1JAA.0 size=1048576 2024-09-12T17:18:31.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.938+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~HTS09TOF1JAA.1 size=1048576 2024-09-12T17:18:31.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.942+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~HTS09TOF1JAA.2 size=270974 2024-09-12T17:18:31.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.942+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=HTS09TOF1JAA tag=ZWR45ZSFTSQL type=write size=3416702 2024-09-12T17:18:31.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.942+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=FG3HUAUL16ZY type=del 2024-09-12T17:18:31.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.946+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=TAPMBQ2DLJR5 type=del size=1495849 2024-09-12T17:18:31.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.950+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~40W8ANDAMZRY.0 size=1048576 2024-09-12T17:18:31.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.950+0000 7f96641d38c0 1 < canceled part key=_multipart_ZKDOIH5SH6K0.2~40W8ANDAMZRY.1 size=663357 2024-09-12T17:18:31.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.954+0000 7f96641d38c0 1 < canceled multipart upload key=ZKDOIH5SH6K0 upload=40W8ANDAMZRY tag=43FGXBI1QY7S type=write size=2760509 2024-09-12T17:18:31.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.958+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~3ARZMA9DXJNY.0 size=1048576 2024-09-12T17:18:31.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.958+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~3ARZMA9DXJNY.1 size=966110 2024-09-12T17:18:31.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.958+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=3ARZMA9DXJNY tag=GFGRY4VSXWPT type=write size=3063262 2024-09-12T17:18:31.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.962+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~7I7CK528ZYMH.0 size=668208 2024-09-12T17:18:31.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.966+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=7I7CK528ZYMH tag=B3C2U23YVZHR type=write size=1716784 2024-09-12T17:18:31.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.970+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=35222F2LJY0X type=del size=3192308 2024-09-12T17:18:31.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.970+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~MUYBZ5CDYSTL.0 size=272481 2024-09-12T17:18:31.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.974+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=MUYBZ5CDYSTL tag=6ADK1HSU9H1I type=write size=1321057 2024-09-12T17:18:31.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.978+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~0GEMTBYH6HBW.0 size=1048576 2024-09-12T17:18:31.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.982+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~0GEMTBYH6HBW.1 size=1048576 2024-09-12T17:18:31.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.982+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~0GEMTBYH6HBW.2 size=964347 2024-09-12T17:18:31.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.982+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=0GEMTBYH6HBW tag=4L6D0CVO9G5O type=write size=4110075 2024-09-12T17:18:31.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.986+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~3ULNQW59CORY.0 size=1048576 2024-09-12T17:18:31.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.986+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~3ULNQW59CORY.1 size=64731 2024-09-12T17:18:31.993 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.990+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=3ULNQW59CORY tag=4FKYC52MFHCQ type=write size=2161883 2024-09-12T17:18:31.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.994+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=55I24S5TZYIT type=del size=2777075 2024-09-12T17:18:31.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:31.998+0000 7f96641d38c0 1 < suggested remove operation key=NR82RUK97NQA tag=W6BCLWCYTPZV type=write 2024-09-12T17:18:32.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.002+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~WEK7LOSB9ZVS.0 size=257828 2024-09-12T17:18:32.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.002+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=WEK7LOSB9ZVS tag=10HGWZ494D2Z type=write size=1306404 2024-09-12T17:18:32.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.006+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=USU6LLIOA2NC type=del 2024-09-12T17:18:32.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.010+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=YR4P0JZZRG3J type=del size=1374436 2024-09-12T17:18:32.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.010+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=9RJKFWOYUQ6N type=del 2024-09-12T17:18:32.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.014+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=DBWS6LWB1DZF type=del size=1883071 2024-09-12T17:18:32.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.018+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=6FFV62AQS8SA type=del 2024-09-12T17:18:32.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.022+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~GVTURA72GUOO.0 size=1048576 2024-09-12T17:18:32.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.026+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~GVTURA72GUOO.1 size=1048576 2024-09-12T17:18:32.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.026+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~GVTURA72GUOO.2 size=441389 2024-09-12T17:18:32.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.026+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=GVTURA72GUOO tag=U77BA3BWXS1K type=write size=3587117 2024-09-12T17:18:32.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.030+0000 7f96641d38c0 -1 < failed to complete operation key=NR82RUK97NQA tag=MB4FJF12QWW5 type=write size=64855: (22) Invalid argument 2024-09-12T17:18:32.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.034+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=94ULZKO2DS1P type=del size=4180833 2024-09-12T17:18:32.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.034+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~QUCRB1QXCGLN.0 size=1048576 2024-09-12T17:18:32.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.038+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~QUCRB1QXCGLN.1 size=710123 2024-09-12T17:18:32.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.042+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=QUCRB1QXCGLN tag=VBWLFS0ZCNVH type=write size=2807275 2024-09-12T17:18:32.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.046+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~TR18CR8DMWEC.0 size=456903 2024-09-12T17:18:32.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.046+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=TR18CR8DMWEC tag=BN1I5SQBBK6C type=write size=1505479 2024-09-12T17:18:32.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.050+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~M3XQKDIXH4O8.0 size=1048576 2024-09-12T17:18:32.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.050+0000 7f96641d38c0 1 < canceled part key=_multipart_0X2HHMHJUJNL.2~M3XQKDIXH4O8.1 size=1048576 2024-09-12T17:18:32.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.050+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~M3XQKDIXH4O8.2 size=407008 2024-09-12T17:18:32.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.054+0000 7f96641d38c0 1 < canceled multipart upload key=0X2HHMHJUJNL upload=M3XQKDIXH4O8 tag=1LG1WJC3RTCE type=write size=3552736 2024-09-12T17:18:32.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.058+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=PRUITVELOAFQ type=write size=608399 2024-09-12T17:18:32.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.062+0000 7f96641d38c0 1 < suggested update operation key=ZKDOIH5SH6K0 tag=ZOX1Z6FTCN9U type=del size=2119264 2024-09-12T17:18:32.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.066+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~DT1APO1QMT5Z.0 size=472578 2024-09-12T17:18:32.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.066+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=DT1APO1QMT5Z tag=S02SM16A8XMB type=write size=1521154 2024-09-12T17:18:32.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.070+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=RTWHIC2TX3WO type=del 2024-09-12T17:18:32.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.074+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~KCTD5XL753B2.0 size=1048576 2024-09-12T17:18:32.078 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.078+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~KCTD5XL753B2.1 size=392834 2024-09-12T17:18:32.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.078+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=KCTD5XL753B2 tag=3362RUWDGTHU type=write size=2489986 2024-09-12T17:18:32.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.078+0000 7f96641d38c0 -1 < no bi entry to suggest for operation key=NR82RUK97NQA tag=DS9TP1TSW8DX type=write size=698100: (2) No such file or directory 2024-09-12T17:18:32.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.082+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=7MEL53ONGQSW type=del size=2213767 2024-09-12T17:18:32.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.082+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~HTS09TOF1JAA.0 size=1048576 2024-09-12T17:18:32.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.086+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~HTS09TOF1JAA.1 size=1048576 2024-09-12T17:18:32.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.086+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~HTS09TOF1JAA.2 size=270974 2024-09-12T17:18:32.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.094+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=HTS09TOF1JAA tag=ZWR45ZSFTSQL type=write size=3416702 2024-09-12T17:18:32.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.098+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~BDF8XX3YKN0Q.0 size=1048576 2024-09-12T17:18:32.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.098+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~BDF8XX3YKN0Q.1 size=579415 2024-09-12T17:18:32.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.098+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=BDF8XX3YKN0Q tag=KEUTABNIV3WC type=write size=2676567 2024-09-12T17:18:32.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.102+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=TAPMBQ2DLJR5 type=del 2024-09-12T17:18:32.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.106+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=XHWCZN409BFV type=write size=863239 2024-09-12T17:18:32.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.106+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~3ARZMA9DXJNY.0 size=1048576 2024-09-12T17:18:32.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.110+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~3ARZMA9DXJNY.1 size=966110 2024-09-12T17:18:32.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.114+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=3ARZMA9DXJNY tag=GFGRY4VSXWPT type=write size=3063262 2024-09-12T17:18:32.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.118+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~9QDIQ14OL01P.0 size=926314 2024-09-12T17:18:32.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.118+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=9QDIQ14OL01P tag=D82TTSN1JJFW type=write size=1974890 2024-09-12T17:18:32.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.126+0000 7f96641d38c0 1 < suggested update operation key=XTVZIXTEES2O tag=35222F2LJY0X type=del size=3192308 2024-09-12T17:18:32.130 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.130+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=Y7YP259E0W7U type=del size=1784509 2024-09-12T17:18:32.133 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.130+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~0GEMTBYH6HBW.0 size=1048576 2024-09-12T17:18:32.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.134+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~0GEMTBYH6HBW.1 size=1048576 2024-09-12T17:18:32.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.134+0000 7f96641d38c0 1 < canceled part key=_multipart_L9HUVE5A5NGT.2~0GEMTBYH6HBW.2 size=964347 2024-09-12T17:18:32.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.138+0000 7f96641d38c0 1 < canceled multipart upload key=L9HUVE5A5NGT upload=0GEMTBYH6HBW tag=4L6D0CVO9G5O type=write size=4110075 2024-09-12T17:18:32.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.142+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~M3IHWZCNG5JD.0 size=1048576 2024-09-12T17:18:32.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.146+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~M3IHWZCNG5JD.1 size=1048576 2024-09-12T17:18:32.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.146+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~M3IHWZCNG5JD.2 size=705969 2024-09-12T17:18:32.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.146+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=M3IHWZCNG5JD tag=ND68OA7RDGKW type=write size=3851697 2024-09-12T17:18:32.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.150+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=55I24S5TZYIT type=del 2024-09-12T17:18:32.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.154+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=ZECUTD1GFXLN type=write size=805352 2024-09-12T17:18:32.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.154+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~WEK7LOSB9ZVS.0 size=257828 2024-09-12T17:18:32.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.158+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=WEK7LOSB9ZVS tag=10HGWZ494D2Z type=write size=1306404 2024-09-12T17:18:32.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.162+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~RRD71I0KTQ7H.0 size=730212 2024-09-12T17:18:32.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.162+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=RRD71I0KTQ7H tag=LMEY3ATCNNPS type=write size=1778788 2024-09-12T17:18:32.167 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.166+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=YR4P0JZZRG3J type=del 2024-09-12T17:18:32.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.166+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=LAU1U4NU8AJ1 type=del size=3020468 2024-09-12T17:18:32.172 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.170+0000 7f96641d38c0 -1 < failed to complete operation key=XTVZIXTEES2O tag=DBWS6LWB1DZF type=del size=1883071: (22) Invalid argument 2024-09-12T17:18:32.174 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.174+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=JPJHCQ5W19BT type=del size=1916746 2024-09-12T17:18:32.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.174+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~GVTURA72GUOO.0 size=1048576 2024-09-12T17:18:32.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.178+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~GVTURA72GUOO.1 size=1048576 2024-09-12T17:18:32.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.178+0000 7f96641d38c0 1 < canceled part key=_multipart_3H8R2MJGR4SY.2~GVTURA72GUOO.2 size=441389 2024-09-12T17:18:32.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.182+0000 7f96641d38c0 1 < canceled multipart upload key=3H8R2MJGR4SY upload=GVTURA72GUOO tag=U77BA3BWXS1K type=write size=3587117 2024-09-12T17:18:32.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.182+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=6066TU68RHN7 type=write size=834953 2024-09-12T17:18:32.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.186+0000 7f96641d38c0 1 < suggested remove operation key=8TU2VZOHL1ZZ tag=94ULZKO2DS1P type=del 2024-09-12T17:18:32.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.190+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~LJW7J10OBPGT.0 size=1048576 2024-09-12T17:18:32.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.194+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~LJW7J10OBPGT.1 size=852288 2024-09-12T17:18:32.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.194+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=LJW7J10OBPGT tag=UYXA9LED0S2I type=write size=2949440 2024-09-12T17:18:32.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.198+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~TR18CR8DMWEC.0 size=456903 2024-09-12T17:18:32.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.202+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=TR18CR8DMWEC tag=BN1I5SQBBK6C type=write size=1505479 2024-09-12T17:18:32.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.202+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=Q4NV5OBZU7NJ type=del size=1960133 2024-09-12T17:18:32.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.210+0000 7f96641d38c0 1 < suggested update operation key=0X2HHMHJUJNL tag=PRUITVELOAFQ type=write size=608399 2024-09-12T17:18:32.212 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.210+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=XRAJK6TTBQ5F type=del size=1856921 2024-09-12T17:18:32.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.214+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~DT1APO1QMT5Z.0 size=472578 2024-09-12T17:18:32.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.218+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=DT1APO1QMT5Z tag=S02SM16A8XMB type=write size=1521154 2024-09-12T17:18:32.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.226+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~NCDQXLXE28AL.0 size=1048576 2024-09-12T17:18:32.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.230+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~NCDQXLXE28AL.1 size=1048576 2024-09-12T17:18:32.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.230+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~NCDQXLXE28AL.2 size=1022666 2024-09-12T17:18:32.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.230+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=NCDQXLXE28AL tag=9U8P3G167JM3 type=write size=4168394 2024-09-12T17:18:32.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.234+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~KCTD5XL753B2.0 size=1048576 2024-09-12T17:18:32.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.238+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~KCTD5XL753B2.1 size=392834 2024-09-12T17:18:32.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.242+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=KCTD5XL753B2 tag=3362RUWDGTHU type=write size=2489986 2024-09-12T17:18:32.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.246+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=MEF707KJ62WT type=del size=3319340 2024-09-12T17:18:32.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.246+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=7MEL53ONGQSW type=del 2024-09-12T17:18:32.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.250+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=Y6HZEDXUZ5SY type=del size=855231 2024-09-12T17:18:32.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.254+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~BDF8XX3YKN0Q.0 size=1048576 2024-09-12T17:18:32.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.254+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~BDF8XX3YKN0Q.1 size=579415 2024-09-12T17:18:32.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.262+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=BDF8XX3YKN0Q tag=KEUTABNIV3WC type=write size=2676567 2024-09-12T17:18:32.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.262+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=TJC2EFUMP9J5 type=del size=198468 2024-09-12T17:18:32.268 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.266+0000 7f96641d38c0 1 < completed write operation key=ZKDOIH5SH6K0 tag=XHWCZN409BFV type=write size=863239 2024-09-12T17:18:32.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.270+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=Z1XOZ7EVPZNH type=write size=819427 2024-09-12T17:18:32.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.274+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~9QDIQ14OL01P.0 size=926314 2024-09-12T17:18:32.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.278+0000 7f96641d38c0 1 < completed multipart upload key=HRU241T0FUEZ upload=9QDIQ14OL01P tag=D82TTSN1JJFW type=write size=1974890 2024-09-12T17:18:32.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.282+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=AC68DTDCQY5R type=del size=3287655 2024-09-12T17:18:32.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.286+0000 7f96641d38c0 1 < suggested remove operation key=NG327LT02T1F tag=Y7YP259E0W7U type=del 2024-09-12T17:18:32.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.290+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=0UFS3Y9QW99Q type=del size=30962 2024-09-12T17:18:32.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.294+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~M3IHWZCNG5JD.0 size=1048576 2024-09-12T17:18:32.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.298+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~M3IHWZCNG5JD.1 size=1048576 2024-09-12T17:18:32.303 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.302+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~M3IHWZCNG5JD.2 size=705969 2024-09-12T17:18:32.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.306+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=M3IHWZCNG5JD tag=ND68OA7RDGKW type=write size=3851697 2024-09-12T17:18:32.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.310+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=RTPYADLF4YIZ type=del size=1240169 2024-09-12T17:18:32.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.314+0000 7f96641d38c0 1 < completed write operation key=L9HUVE5A5NGT tag=ZECUTD1GFXLN type=write size=805352 2024-09-12T17:18:32.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.314+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=FYZFML5766BI type=write size=978676 2024-09-12T17:18:32.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.318+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~RRD71I0KTQ7H.0 size=730212 2024-09-12T17:18:32.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.322+0000 7f96641d38c0 1 < completed multipart upload key=3SLNHJT3A1K1 upload=RRD71I0KTQ7H tag=LMEY3ATCNNPS type=write size=1778788 2024-09-12T17:18:32.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.326+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=CKXF67BSQ2NX type=del size=193435 2024-09-12T17:18:32.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.330+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=LAU1U4NU8AJ1 type=del 2024-09-12T17:18:32.336 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.334+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~QYY189N0RDOO.0 size=1048576 2024-09-12T17:18:32.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.338+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~QYY189N0RDOO.1 size=449712 2024-09-12T17:18:32.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.338+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=QYY189N0RDOO tag=TVURTGA7NZMK type=write size=2546864 2024-09-12T17:18:32.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.338+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=JPJHCQ5W19BT type=del 2024-09-12T17:18:32.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.342+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=XHXH9NGUBNTD type=del size=888547 2024-09-12T17:18:32.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.346+0000 7f96641d38c0 -1 < failed to complete operation key=8TU2VZOHL1ZZ tag=6066TU68RHN7 type=write size=834953: (22) Invalid argument 2024-09-12T17:18:32.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.350+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~IRHIF028XRN2.0 size=179052 2024-09-12T17:18:32.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.350+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=IRHIF028XRN2 tag=1X8JE93E9Y2M type=write size=1227628 2024-09-12T17:18:32.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.354+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~LJW7J10OBPGT.0 size=1048576 2024-09-12T17:18:32.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.354+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~LJW7J10OBPGT.1 size=852288 2024-09-12T17:18:32.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.362+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=LJW7J10OBPGT tag=UYXA9LED0S2I type=write size=2949440 2024-09-12T17:18:32.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.366+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~Z650NMU0AFDV.0 size=1048576 2024-09-12T17:18:32.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.370+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~Z650NMU0AFDV.1 size=204218 2024-09-12T17:18:32.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.370+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=Z650NMU0AFDV tag=OT6S50G4O13U type=write size=2301370 2024-09-12T17:18:32.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.374+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=Q4NV5OBZU7NJ type=del 2024-09-12T17:18:32.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.378+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~6YSM6MQEDPO0.0 size=177305 2024-09-12T17:18:32.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.378+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=6YSM6MQEDPO0 tag=0YZSKGUYZOYH type=write size=1225881 2024-09-12T17:18:32.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.382+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=XRAJK6TTBQ5F type=del 2024-09-12T17:18:32.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.382+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=4VFAC2CV3CZK type=del size=1879240 2024-09-12T17:18:32.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.386+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~NCDQXLXE28AL.0 size=1048576 2024-09-12T17:18:32.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.386+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~NCDQXLXE28AL.1 size=1048576 2024-09-12T17:18:32.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.390+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~NCDQXLXE28AL.2 size=1022666 2024-09-12T17:18:32.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.394+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=NCDQXLXE28AL tag=9U8P3G167JM3 type=write size=4168394 2024-09-12T17:18:32.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.398+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~GREKVBELD27M.0 size=1048576 2024-09-12T17:18:32.402 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.402+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~GREKVBELD27M.1 size=359024 2024-09-12T17:18:32.402 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.402+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=GREKVBELD27M tag=J5OZOAPHZ1GN type=write size=2456176 2024-09-12T17:18:32.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.402+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=MEF707KJ62WT type=del 2024-09-12T17:18:32.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.406+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=WJCP6JJ026X7 type=del size=2354016 2024-09-12T17:18:32.409 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.406+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=Y6HZEDXUZ5SY type=del 2024-09-12T17:18:32.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.410+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=ILJ8DC3R709K type=del size=2870281 2024-09-12T17:18:32.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.414+0000 7f96641d38c0 1 < canceled operation key=DHODPSZ7Z0D4 tag=TJC2EFUMP9J5 type=del size=198468 2024-09-12T17:18:32.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.414+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=LO1HQ7BRHOAI type=del size=4032361 2024-09-12T17:18:32.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.418+0000 7f96641d38c0 1 < completed write operation key=GKJJDBNXC6QH tag=Z1XOZ7EVPZNH type=write size=819427 2024-09-12T17:18:32.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.418+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=U35U371BUMUL type=del size=1456576 2024-09-12T17:18:32.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.426+0000 7f96641d38c0 1 < suggested remove operation key=0X2HHMHJUJNL tag=AC68DTDCQY5R type=del 2024-09-12T17:18:32.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.426+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=HDPC12FU1MQB type=del size=1425783 2024-09-12T17:18:32.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.430+0000 7f96641d38c0 1 < canceled operation key=NG327LT02T1F tag=0UFS3Y9QW99Q type=del size=30962 2024-09-12T17:18:32.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.430+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=ZAGFX8PB7BL9 type=del size=2281676 2024-09-12T17:18:32.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.434+0000 7f96641d38c0 1 < canceled operation key=EFORFJYOM45R tag=RTPYADLF4YIZ type=del size=1240169 2024-09-12T17:18:32.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.438+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=P6L97JXYXA26 type=del size=3429277 2024-09-12T17:18:32.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.438+0000 7f96641d38c0 1 < completed write operation key=XTVZIXTEES2O tag=FYZFML5766BI type=write size=978676 2024-09-12T17:18:32.445 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.442+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~X47XHGLD4X8J.0 size=1048576 2024-09-12T17:18:32.447 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.446+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~X47XHGLD4X8J.1 size=1048576 2024-09-12T17:18:32.449 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.446+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~X47XHGLD4X8J.2 size=639618 2024-09-12T17:18:32.449 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.446+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=X47XHGLD4X8J tag=2TEXCJWNWVPY type=write size=3785346 2024-09-12T17:18:32.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.450+0000 7f96641d38c0 1 < completed delete operation key=KXJYJ9VX7YVW tag=CKXF67BSQ2NX type=del 2024-09-12T17:18:32.456 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.454+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~25VZWR6VQV17.0 size=252406 2024-09-12T17:18:32.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.454+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=25VZWR6VQV17 tag=L6LEC6EWBIZN type=write size=1300982 2024-09-12T17:18:32.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.458+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~QYY189N0RDOO.0 size=1048576 2024-09-12T17:18:32.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.458+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~QYY189N0RDOO.1 size=449712 2024-09-12T17:18:32.465 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.462+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=QYY189N0RDOO tag=TVURTGA7NZMK type=write size=2546864 2024-09-12T17:18:32.468 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.466+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=J5KB5R9Z34Z4 type=write size=841124 2024-09-12T17:18:32.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.470+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=XHXH9NGUBNTD type=del 2024-09-12T17:18:32.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.470+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=9OV7AW0QL1WR type=del size=1385250 2024-09-12T17:18:32.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.474+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~IRHIF028XRN2.0 size=179052 2024-09-12T17:18:32.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.478+0000 7f96641d38c0 1 < completed multipart upload key=0X2HHMHJUJNL upload=IRHIF028XRN2 tag=1X8JE93E9Y2M type=write size=1227628 2024-09-12T17:18:32.483 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.482+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=SO9KLCYK3XXC type=del size=3066503 2024-09-12T17:18:32.485 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.482+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~Z650NMU0AFDV.0 size=1048576 2024-09-12T17:18:32.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.486+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~Z650NMU0AFDV.1 size=204218 2024-09-12T17:18:32.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.490+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=Z650NMU0AFDV tag=OT6S50G4O13U type=write size=2301370 2024-09-12T17:18:32.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.494+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~QS2EIW52NJHH.0 size=1048576 2024-09-12T17:18:32.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.498+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~QS2EIW52NJHH.1 size=396705 2024-09-12T17:18:32.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.498+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=QS2EIW52NJHH tag=REATBP8PHPVJ type=write size=2493857 2024-09-12T17:18:32.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.498+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~6YSM6MQEDPO0.0 size=177305 2024-09-12T17:18:32.505 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.502+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=6YSM6MQEDPO0 tag=0YZSKGUYZOYH type=write size=1225881 2024-09-12T17:18:32.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.506+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=AUO5C64ZL21O type=del size=30226 2024-09-12T17:18:32.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.510+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=4VFAC2CV3CZK type=del 2024-09-12T17:18:32.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.510+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=99SLB74XLM1F type=del size=924823 2024-09-12T17:18:32.515 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.514+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~GREKVBELD27M.0 size=1048576 2024-09-12T17:18:32.517 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.514+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~GREKVBELD27M.1 size=359024 2024-09-12T17:18:32.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.518+0000 7f96641d38c0 1 < completed multipart upload key=XDL9O7TEMBYF upload=GREKVBELD27M tag=J5OZOAPHZ1GN type=write size=2456176 2024-09-12T17:18:32.526 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.526+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~18PSFNEYQF49.0 size=1048576 2024-09-12T17:18:32.527 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.526+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~18PSFNEYQF49.1 size=1048576 2024-09-12T17:18:32.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.530+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~18PSFNEYQF49.2 size=859127 2024-09-12T17:18:32.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.530+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=18PSFNEYQF49 tag=62WLJVQ88A5C type=write size=4004855 2024-09-12T17:18:32.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.534+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=WJCP6JJ026X7 type=del 2024-09-12T17:18:32.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.542+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=WN0CTK95C6FR type=del size=1340487 2024-09-12T17:18:32.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.546+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=ILJ8DC3R709K type=del 2024-09-12T17:18:32.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.546+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=UTM6IGF8ZDC4 type=del size=3339074 2024-09-12T17:18:32.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.550+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=LO1HQ7BRHOAI type=del 2024-09-12T17:18:32.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.550+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=NKDNMBJOPHIF type=del size=3151042 2024-09-12T17:18:32.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.554+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=U35U371BUMUL type=del 2024-09-12T17:18:32.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.558+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~KG8PD35EM3R2.0 size=1048576 2024-09-12T17:18:32.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.558+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~KG8PD35EM3R2.1 size=1048576 2024-09-12T17:18:32.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.562+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~KG8PD35EM3R2.2 size=772062 2024-09-12T17:18:32.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.562+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=KG8PD35EM3R2 tag=CR3CRH6KIV51 type=write size=3917790 2024-09-12T17:18:32.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.562+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=HDPC12FU1MQB type=del 2024-09-12T17:18:32.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.566+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~JPD7X19JV3QE.0 size=1048576 2024-09-12T17:18:32.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.566+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~JPD7X19JV3QE.1 size=1048576 2024-09-12T17:18:32.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.570+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~JPD7X19JV3QE.2 size=495881 2024-09-12T17:18:32.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.570+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=JPD7X19JV3QE tag=GUOWXBU9451V type=write size=3641609 2024-09-12T17:18:32.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.570+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=ZAGFX8PB7BL9 type=del 2024-09-12T17:18:32.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.574+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=4ZUCJ2R87U6C type=del size=2562662 2024-09-12T17:18:32.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.574+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=P6L97JXYXA26 type=del 2024-09-12T17:18:32.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.578+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~XHTNEX3DXLFM.0 size=266607 2024-09-12T17:18:32.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.578+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=XHTNEX3DXLFM tag=6SAZ3MT2IEQO type=write size=1315183 2024-09-12T17:18:32.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.578+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~X47XHGLD4X8J.0 size=1048576 2024-09-12T17:18:32.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.582+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~X47XHGLD4X8J.1 size=1048576 2024-09-12T17:18:32.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.582+0000 7f96641d38c0 1 < canceled part key=_multipart_9CBFWXFX7O3N.2~X47XHGLD4X8J.2 size=639618 2024-09-12T17:18:32.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.586+0000 7f96641d38c0 1 < canceled multipart upload key=9CBFWXFX7O3N upload=X47XHGLD4X8J tag=2TEXCJWNWVPY type=write size=3785346 2024-09-12T17:18:32.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.586+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=M6XHSJVM5TAN type=write size=96653 2024-09-12T17:18:32.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.590+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~25VZWR6VQV17.0 size=252406 2024-09-12T17:18:32.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.590+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=25VZWR6VQV17 tag=L6LEC6EWBIZN type=write size=1300982 2024-09-12T17:18:32.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.594+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~3EZ74TXJKTHH.0 size=1048576 2024-09-12T17:18:32.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.598+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~3EZ74TXJKTHH.1 size=1048576 2024-09-12T17:18:32.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.598+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~3EZ74TXJKTHH.2 size=228093 2024-09-12T17:18:32.601 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.598+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=3EZ74TXJKTHH tag=S38UOM2YIMGV type=write size=3373821 2024-09-12T17:18:32.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.602+0000 7f96641d38c0 1 < completed write operation key=8TU2VZOHL1ZZ tag=J5KB5R9Z34Z4 type=write size=841124 2024-09-12T17:18:32.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.602+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=NTXINZ0EHY51 type=del size=710379 2024-09-12T17:18:32.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.606+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=9OV7AW0QL1WR type=del 2024-09-12T17:18:32.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.606+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=0ORQSFM1MCNA type=del size=2389693 2024-09-12T17:18:32.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.610+0000 7f96641d38c0 1 < canceled operation key=NGA3P9RZJYWT tag=SO9KLCYK3XXC type=del size=3066503 2024-09-12T17:18:32.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.614+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~J856M849QJ3S.0 size=1048576 2024-09-12T17:18:32.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.614+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~J856M849QJ3S.1 size=383565 2024-09-12T17:18:32.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.614+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=J856M849QJ3S tag=K8RL10DLDP1X type=write size=2480717 2024-09-12T17:18:32.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.614+0000 7f96641d38c0 1 < canceled part key=_multipart_XTVZIXTEES2O.2~QS2EIW52NJHH.0 size=1048576 2024-09-12T17:18:32.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.614+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~QS2EIW52NJHH.1 size=396705 2024-09-12T17:18:32.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.618+0000 7f96641d38c0 1 < canceled multipart upload key=XTVZIXTEES2O upload=QS2EIW52NJHH tag=REATBP8PHPVJ type=write size=2493857 2024-09-12T17:18:32.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.622+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~RZ1BXOKWT4TO.0 size=1048576 2024-09-12T17:18:32.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.622+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~RZ1BXOKWT4TO.1 size=961841 2024-09-12T17:18:32.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.622+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=RZ1BXOKWT4TO tag=NJT3E5LW8TT3 type=write size=3058993 2024-09-12T17:18:32.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.626+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=AUO5C64ZL21O type=del 2024-09-12T17:18:32.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.630+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=6R8VE8KQ424S type=write size=412132 2024-09-12T17:18:32.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.630+0000 7f96641d38c0 1 < suggested remove operation key=3SLNHJT3A1K1 tag=99SLB74XLM1F type=del 2024-09-12T17:18:32.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.634+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~MZD5IE2OP90C.0 size=1048576 2024-09-12T17:18:32.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.638+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~MZD5IE2OP90C.1 size=774434 2024-09-12T17:18:32.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.638+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=MZD5IE2OP90C tag=GLK6M1IKWGOI type=write size=2871586 2024-09-12T17:18:32.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.638+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~18PSFNEYQF49.0 size=1048576 2024-09-12T17:18:32.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.638+0000 7f96641d38c0 1 < canceled part key=_multipart_XDL9O7TEMBYF.2~18PSFNEYQF49.1 size=1048576 2024-09-12T17:18:32.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.642+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~18PSFNEYQF49.2 size=859127 2024-09-12T17:18:32.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.646+0000 7f96641d38c0 1 < canceled multipart upload key=XDL9O7TEMBYF upload=18PSFNEYQF49 tag=62WLJVQ88A5C type=write size=4004855 2024-09-12T17:18:32.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.650+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~3DH1BQYF8I9B.0 size=1048576 2024-09-12T17:18:32.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.650+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~3DH1BQYF8I9B.1 size=561544 2024-09-12T17:18:32.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.650+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=3DH1BQYF8I9B tag=BATZH3G2WZG0 type=write size=2658696 2024-09-12T17:18:32.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.650+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=WN0CTK95C6FR type=del 2024-09-12T17:18:32.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.654+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=VKTZCN133X2O type=del size=2077737 2024-09-12T17:18:32.658 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.654+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=UTM6IGF8ZDC4 type=del 2024-09-12T17:18:32.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.658+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~8ZP27O7PSCZR.0 size=1048576 2024-09-12T17:18:32.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.662+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~8ZP27O7PSCZR.1 size=283639 2024-09-12T17:18:32.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.662+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=8ZP27O7PSCZR tag=TGZOVDGQ7BBE type=write size=2380791 2024-09-12T17:18:32.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.662+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=NKDNMBJOPHIF type=del 2024-09-12T17:18:32.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.666+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=C452VQEGCDHW type=del size=1128344 2024-09-12T17:18:32.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.666+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~KG8PD35EM3R2.0 size=1048576 2024-09-12T17:18:32.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.670+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~KG8PD35EM3R2.1 size=1048576 2024-09-12T17:18:32.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.670+0000 7f96641d38c0 1 < canceled part key=_multipart_3SLNHJT3A1K1.2~KG8PD35EM3R2.2 size=772062 2024-09-12T17:18:32.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.674+0000 7f96641d38c0 1 < canceled multipart upload key=3SLNHJT3A1K1 upload=KG8PD35EM3R2 tag=CR3CRH6KIV51 type=write size=3917790 2024-09-12T17:18:32.676 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.674+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=5EK045SKQFWR type=del size=2080154 2024-09-12T17:18:32.678 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.678+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~JPD7X19JV3QE.0 size=1048576 2024-09-12T17:18:32.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.678+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~JPD7X19JV3QE.1 size=1048576 2024-09-12T17:18:32.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.682+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~JPD7X19JV3QE.2 size=495881 2024-09-12T17:18:32.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.686+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=JPD7X19JV3QE tag=GUOWXBU9451V type=write size=3641609 2024-09-12T17:18:32.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.686+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=9C868VCEGCVC type=del size=640226 2024-09-12T17:18:32.691 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.690+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=4ZUCJ2R87U6C type=del 2024-09-12T17:18:32.693 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.690+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=GPO2Z50P7658 type=del size=571998 2024-09-12T17:18:32.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.694+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~XHTNEX3DXLFM.0 size=266607 2024-09-12T17:18:32.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.698+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=XHTNEX3DXLFM tag=6SAZ3MT2IEQO type=write size=1315183 2024-09-12T17:18:32.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.702+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=QK99KNTQD0MI type=del size=1523953 2024-09-12T17:18:32.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.706+0000 7f96641d38c0 1 < completed write operation key=NG327LT02T1F tag=M6XHSJVM5TAN type=write size=96653 2024-09-12T17:18:32.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.710+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~P2E2DLRTF1IO.0 size=1048576 2024-09-12T17:18:32.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.710+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~P2E2DLRTF1IO.1 size=1048576 2024-09-12T17:18:32.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.714+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~P2E2DLRTF1IO.2 size=790123 2024-09-12T17:18:32.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.714+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=P2E2DLRTF1IO tag=19BO8CNQTATE type=write size=3935851 2024-09-12T17:18:32.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.718+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~3EZ74TXJKTHH.0 size=1048576 2024-09-12T17:18:32.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.722+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~3EZ74TXJKTHH.1 size=1048576 2024-09-12T17:18:32.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.722+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~3EZ74TXJKTHH.2 size=228093 2024-09-12T17:18:32.728 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.726+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=3EZ74TXJKTHH tag=S38UOM2YIMGV type=write size=3373821 2024-09-12T17:18:32.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.730+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~OFOL462Y3WRA.0 size=1048576 2024-09-12T17:18:32.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.734+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~OFOL462Y3WRA.1 size=344616 2024-09-12T17:18:32.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.734+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=OFOL462Y3WRA tag=Q2R8UWJZUQ74 type=write size=2441768 2024-09-12T17:18:32.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.738+0000 7f96641d38c0 1 < suggested remove operation key=5ZZI4F92J7BO tag=NTXINZ0EHY51 type=del 2024-09-12T17:18:32.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.742+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=3UM5QO9FOU1Q type=del size=699041 2024-09-12T17:18:32.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.742+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=0ORQSFM1MCNA type=del 2024-09-12T17:18:32.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.746+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=KCNCUS2RCC2F type=del size=1577376 2024-09-12T17:18:32.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.750+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~J856M849QJ3S.0 size=1048576 2024-09-12T17:18:32.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.750+0000 7f96641d38c0 1 < canceled part key=_multipart_HRU241T0FUEZ.2~J856M849QJ3S.1 size=383565 2024-09-12T17:18:32.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.754+0000 7f96641d38c0 1 < canceled multipart upload key=HRU241T0FUEZ upload=J856M849QJ3S tag=K8RL10DLDP1X type=write size=2480717 2024-09-12T17:18:32.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.758+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~Q7GSG9V7OTKU.0 size=1048576 2024-09-12T17:18:32.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.762+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~Q7GSG9V7OTKU.1 size=53823 2024-09-12T17:18:32.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.762+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=Q7GSG9V7OTKU tag=P3Y9WA3WL1MY type=write size=2150975 2024-09-12T17:18:32.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.766+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~RZ1BXOKWT4TO.0 size=1048576 2024-09-12T17:18:32.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.766+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~RZ1BXOKWT4TO.1 size=961841 2024-09-12T17:18:32.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.770+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=RZ1BXOKWT4TO tag=NJT3E5LW8TT3 type=write size=3058993 2024-09-12T17:18:32.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.774+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~HRT6P8KY9F7T.0 size=1048576 2024-09-12T17:18:32.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.778+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~HRT6P8KY9F7T.1 size=478004 2024-09-12T17:18:32.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.778+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=HRT6P8KY9F7T tag=3G5P9QO6BHPD type=write size=2575156 2024-09-12T17:18:32.782 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.782+0000 7f96641d38c0 1 < completed write operation key=G7CWVD9C2H2J tag=6R8VE8KQ424S type=write size=412132 2024-09-12T17:18:32.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.782+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=VLR18BOVGI6L type=del size=399052 2024-09-12T17:18:32.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.786+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~MZD5IE2OP90C.0 size=1048576 2024-09-12T17:18:32.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.786+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~MZD5IE2OP90C.1 size=774434 2024-09-12T17:18:32.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.794+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=MZD5IE2OP90C tag=GLK6M1IKWGOI type=write size=2871586 2024-09-12T17:18:32.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.798+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~6WI9U839CBYZ.0 size=888618 2024-09-12T17:18:32.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.798+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=6WI9U839CBYZ tag=9HLPGTOC8W9A type=write size=1937194 2024-09-12T17:18:32.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.798+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~3DH1BQYF8I9B.0 size=1048576 2024-09-12T17:18:32.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.802+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~3DH1BQYF8I9B.1 size=561544 2024-09-12T17:18:32.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.806+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=3DH1BQYF8I9B tag=BATZH3G2WZG0 type=write size=2658696 2024-09-12T17:18:32.808 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.806+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=4MM2QH5ONV8S type=del size=2117410 2024-09-12T17:18:32.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.810+0000 7f96641d38c0 1 < suggested update operation key=RSVQJS9F1FR7 tag=VKTZCN133X2O type=del size=2077737 2024-09-12T17:18:32.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.814+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~BNNRRHZGW6XA.0 size=1048576 2024-09-12T17:18:32.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.818+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~BNNRRHZGW6XA.1 size=359451 2024-09-12T17:18:32.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.818+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=BNNRRHZGW6XA tag=MF8KR89EYYYP type=write size=2456603 2024-09-12T17:18:32.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.822+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~8ZP27O7PSCZR.0 size=1048576 2024-09-12T17:18:32.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.822+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~8ZP27O7PSCZR.1 size=283639 2024-09-12T17:18:32.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.826+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=8ZP27O7PSCZR tag=TGZOVDGQ7BBE type=write size=2380791 2024-09-12T17:18:32.832 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.830+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=WMTB7A3MSE90 type=del size=1467022 2024-09-12T17:18:32.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.834+0000 7f96641d38c0 1 < canceled operation key=9CBFWXFX7O3N tag=C452VQEGCDHW type=del size=1128344 2024-09-12T17:18:32.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.834+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=MJNM3DTKKQQM type=del size=400142 2024-09-12T17:18:32.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.842+0000 7f96641d38c0 1 < suggested remove operation key=KXJYJ9VX7YVW tag=5EK045SKQFWR type=del 2024-09-12T17:18:32.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.842+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=SGSVDPXHI354 type=del size=2911866 2024-09-12T17:18:32.847 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.846+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=9C868VCEGCVC type=del 2024-09-12T17:18:32.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.850+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~4AT5128B4MXY.0 size=309857 2024-09-12T17:18:32.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.850+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=4AT5128B4MXY tag=X9Q0H4QOSK58 type=write size=1358433 2024-09-12T17:18:32.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.854+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=GPO2Z50P7658 type=del 2024-09-12T17:18:32.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.858+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=J92PDFN2MDY8 type=del size=2660470 2024-09-12T17:18:32.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.858+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=QK99KNTQD0MI type=del 2024-09-12T17:18:32.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.862+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=ICBWRJCI0URM type=del size=3745612 2024-09-12T17:18:32.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.866+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~P2E2DLRTF1IO.0 size=1048576 2024-09-12T17:18:32.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.866+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~P2E2DLRTF1IO.1 size=1048576 2024-09-12T17:18:32.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.870+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~P2E2DLRTF1IO.2 size=790123 2024-09-12T17:18:32.876 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.874+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=P2E2DLRTF1IO tag=19BO8CNQTATE type=write size=3935851 2024-09-12T17:18:32.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.878+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=4UJ3NGCHDUC4 type=write size=407065 2024-09-12T17:18:32.882 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.878+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~OFOL462Y3WRA.0 size=1048576 2024-09-12T17:18:32.884 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.882+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~OFOL462Y3WRA.1 size=344616 2024-09-12T17:18:32.888 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.886+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=OFOL462Y3WRA tag=Q2R8UWJZUQ74 type=write size=2441768 2024-09-12T17:18:32.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.890+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~GKFIDVQ0QHW8.0 size=1048576 2024-09-12T17:18:32.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.894+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~GKFIDVQ0QHW8.1 size=1048576 2024-09-12T17:18:32.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.894+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~GKFIDVQ0QHW8.2 size=172452 2024-09-12T17:18:32.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.894+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=GKFIDVQ0QHW8 tag=2U2LZWLSXJE1 type=write size=3318180 2024-09-12T17:18:32.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.898+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=3UM5QO9FOU1Q type=del 2024-09-12T17:18:32.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.902+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~VZKRXB2VVCO1.0 size=1048576 2024-09-12T17:18:32.905 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.902+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~VZKRXB2VVCO1.1 size=1048576 2024-09-12T17:18:32.907 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.906+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~VZKRXB2VVCO1.2 size=291356 2024-09-12T17:18:32.907 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.906+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=VZKRXB2VVCO1 tag=2YD6QCY78ILI type=write size=3437084 2024-09-12T17:18:32.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.910+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=KCNCUS2RCC2F type=del 2024-09-12T17:18:32.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.910+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=P64GE4QDK0SJ type=del size=1575449 2024-09-12T17:18:32.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.914+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~Q7GSG9V7OTKU.0 size=1048576 2024-09-12T17:18:32.917 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.914+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~Q7GSG9V7OTKU.1 size=53823 2024-09-12T17:18:32.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.918+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=Q7GSG9V7OTKU tag=P3Y9WA3WL1MY type=write size=2150975 2024-09-12T17:18:32.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.922+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=5KOSIBARYC7N type=del size=2485257 2024-09-12T17:18:32.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.926+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~HRT6P8KY9F7T.0 size=1048576 2024-09-12T17:18:32.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.926+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~HRT6P8KY9F7T.1 size=478004 2024-09-12T17:18:32.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.930+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=HRT6P8KY9F7T tag=3G5P9QO6BHPD type=write size=2575156 2024-09-12T17:18:32.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.934+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~5JA3FQZCYYHG.0 size=1048576 2024-09-12T17:18:32.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.938+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~5JA3FQZCYYHG.1 size=525159 2024-09-12T17:18:32.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.938+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=5JA3FQZCYYHG tag=32BZIL3D30M9 type=write size=2622311 2024-09-12T17:18:32.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.938+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=VLR18BOVGI6L type=del 2024-09-12T17:18:32.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.942+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~0XP4KU5ERJBP.0 size=676461 2024-09-12T17:18:32.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.942+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=0XP4KU5ERJBP tag=66PJ94J0FEX0 type=write size=1725037 2024-09-12T17:18:32.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.946+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~6WI9U839CBYZ.0 size=888618 2024-09-12T17:18:32.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.950+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=6WI9U839CBYZ tag=9HLPGTOC8W9A type=write size=1937194 2024-09-12T17:18:32.958 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.954+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~QEGOHQN0X7TY.0 size=1048576 2024-09-12T17:18:32.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.958+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~QEGOHQN0X7TY.1 size=956934 2024-09-12T17:18:32.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.958+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=QEGOHQN0X7TY tag=2M06JYQ5AHRW type=write size=3054086 2024-09-12T17:18:32.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.962+0000 7f96641d38c0 1 < suggested update operation key=2TN3M8NKV9LN tag=4MM2QH5ONV8S type=del size=2117410 2024-09-12T17:18:32.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.966+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=UDAHFXHDVMQ1 type=del size=3050753 2024-09-12T17:18:32.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.970+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~BNNRRHZGW6XA.0 size=1048576 2024-09-12T17:18:32.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.970+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~BNNRRHZGW6XA.1 size=359451 2024-09-12T17:18:32.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.974+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=BNNRRHZGW6XA tag=MF8KR89EYYYP type=write size=2456603 2024-09-12T17:18:32.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.978+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=0T1J0DKLS88N type=del size=2295606 2024-09-12T17:18:32.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.978+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=WMTB7A3MSE90 type=del 2024-09-12T17:18:32.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.982+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=S9BZ0MFWWBUJ type=write size=494092 2024-09-12T17:18:32.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.986+0000 7f96641d38c0 1 < canceled operation key=H3LV5G117KOW tag=MJNM3DTKKQQM type=del size=400142 2024-09-12T17:18:32.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.986+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=68NIC2OT202P type=del size=2822331 2024-09-12T17:18:32.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.994+0000 7f96641d38c0 1 < suggested remove operation key=3H8R2MJGR4SY tag=SGSVDPXHI354 type=del 2024-09-12T17:18:33.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:32.998+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~4CWWYBEJL78A.0 size=1048576 2024-09-12T17:18:33.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.002+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~4CWWYBEJL78A.1 size=1048576 2024-09-12T17:18:33.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.002+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~4CWWYBEJL78A.2 size=636722 2024-09-12T17:18:33.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.002+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=4CWWYBEJL78A tag=VP2JXSX3VPIO type=write size=3782450 2024-09-12T17:18:33.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.002+0000 7f96641d38c0 1 < canceled part key=_multipart_NR82RUK97NQA.2~4AT5128B4MXY.0 size=309857 2024-09-12T17:18:33.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.010+0000 7f96641d38c0 1 < canceled multipart upload key=NR82RUK97NQA upload=4AT5128B4MXY tag=X9Q0H4QOSK58 type=write size=1358433 2024-09-12T17:18:33.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.014+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~4B2NBNBSQRMD.0 size=1048576 2024-09-12T17:18:33.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.014+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~4B2NBNBSQRMD.1 size=1013738 2024-09-12T17:18:33.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.014+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=4B2NBNBSQRMD tag=CALDOL459ICE type=write size=3110890 2024-09-12T17:18:33.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.018+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=J92PDFN2MDY8 type=del 2024-09-12T17:18:33.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.018+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=C9XNMLDOR3CI type=del size=2847234 2024-09-12T17:18:33.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.022+0000 7f96641d38c0 -1 < failed to complete operation key=3H8R2MJGR4SY tag=ICBWRJCI0URM type=del size=3745612: (22) Invalid argument 2024-09-12T17:18:33.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.026+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~JWOQ3WCNR6PE.0 size=888325 2024-09-12T17:18:33.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.026+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=JWOQ3WCNR6PE tag=0I0J9UEAHEIA type=write size=1936901 2024-09-12T17:18:33.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.034+0000 7f96641d38c0 1 < suggested update operation key=W40P2E1H5VT9 tag=4UJ3NGCHDUC4 type=write size=407065 2024-09-12T17:18:33.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.038+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~9N3T21PFVQLC.0 size=1048576 2024-09-12T17:18:33.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.042+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~9N3T21PFVQLC.1 size=1048576 2024-09-12T17:18:33.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.042+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~9N3T21PFVQLC.2 size=248058 2024-09-12T17:18:33.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.042+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=9N3T21PFVQLC tag=BOCXPB5EKD6T type=write size=3393786 2024-09-12T17:18:33.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.046+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~GKFIDVQ0QHW8.0 size=1048576 2024-09-12T17:18:33.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.046+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~GKFIDVQ0QHW8.1 size=1048576 2024-09-12T17:18:33.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.050+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~GKFIDVQ0QHW8.2 size=172452 2024-09-12T17:18:33.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.054+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=GKFIDVQ0QHW8 tag=2U2LZWLSXJE1 type=write size=3318180 2024-09-12T17:18:33.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.054+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=O6DX2MA23H8Y type=del size=1184654 2024-09-12T17:18:33.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.058+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~VZKRXB2VVCO1.0 size=1048576 2024-09-12T17:18:33.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.058+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~VZKRXB2VVCO1.1 size=1048576 2024-09-12T17:18:33.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.062+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~VZKRXB2VVCO1.2 size=291356 2024-09-12T17:18:33.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.066+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=VZKRXB2VVCO1 tag=2YD6QCY78ILI type=write size=3437084 2024-09-12T17:18:33.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.070+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~AGOMMBZ2CHFP.0 size=1048576 2024-09-12T17:18:33.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.070+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~AGOMMBZ2CHFP.1 size=313785 2024-09-12T17:18:33.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.070+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=AGOMMBZ2CHFP tag=VRCOZEFAFK2B type=write size=2410937 2024-09-12T17:18:33.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.074+0000 7f96641d38c0 -1 < failed to complete operation key=3H8R2MJGR4SY tag=P64GE4QDK0SJ type=del size=1575449: (22) Invalid argument 2024-09-12T17:18:33.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.078+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~UW2ZK24UOY3Z.0 size=1048576 2024-09-12T17:18:33.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.082+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~UW2ZK24UOY3Z.1 size=780835 2024-09-12T17:18:33.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.082+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=UW2ZK24UOY3Z tag=OENAM6H2VDH3 type=write size=2877987 2024-09-12T17:18:33.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.082+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=5KOSIBARYC7N type=del 2024-09-12T17:18:33.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.090+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~FWFI1KUY94M1.0 size=1026138 2024-09-12T17:18:33.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.090+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=FWFI1KUY94M1 tag=KSCZY4KSGJ79 type=write size=2074714 2024-09-12T17:18:33.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.090+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~5JA3FQZCYYHG.0 size=1048576 2024-09-12T17:18:33.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.094+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~5JA3FQZCYYHG.1 size=525159 2024-09-12T17:18:33.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.102+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=5JA3FQZCYYHG tag=32BZIL3D30M9 type=write size=2622311 2024-09-12T17:18:33.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.106+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~D5S9CKWR42WG.0 size=1048576 2024-09-12T17:18:33.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.106+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~D5S9CKWR42WG.1 size=1048576 2024-09-12T17:18:33.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.110+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~D5S9CKWR42WG.2 size=44930 2024-09-12T17:18:33.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.110+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=D5S9CKWR42WG tag=CC6I6OEW7B36 type=write size=3190658 2024-09-12T17:18:33.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.114+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~0XP4KU5ERJBP.0 size=676461 2024-09-12T17:18:33.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.118+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=0XP4KU5ERJBP tag=66PJ94J0FEX0 type=write size=1725037 2024-09-12T17:18:33.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.122+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=FA238J3ROYUL type=del size=249557 2024-09-12T17:18:33.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.122+0000 7f96641d38c0 1 < canceled part key=_multipart_2TN3M8NKV9LN.2~QEGOHQN0X7TY.0 size=1048576 2024-09-12T17:18:33.126 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.122+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~QEGOHQN0X7TY.1 size=956934 2024-09-12T17:18:33.130 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.130+0000 7f96641d38c0 1 < canceled multipart upload key=2TN3M8NKV9LN upload=QEGOHQN0X7TY tag=2M06JYQ5AHRW type=write size=3054086 2024-09-12T17:18:33.133 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.130+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=5KUCEUOB86FT type=write size=689910 2024-09-12T17:18:33.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.138+0000 7f96641d38c0 1 < suggested update operation key=XTVZIXTEES2O tag=UDAHFXHDVMQ1 type=del size=3050753 2024-09-12T17:18:33.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.138+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=RSTFCJFYS83K type=del size=1557970 2024-09-12T17:18:33.144 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.142+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=0T1J0DKLS88N type=del 2024-09-12T17:18:33.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.146+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~4LOG6XXM84OJ.0 size=585868 2024-09-12T17:18:33.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.146+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=4LOG6XXM84OJ tag=01OW2169FEOA type=write size=1634444 2024-09-12T17:18:33.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.150+0000 7f96641d38c0 1 < completed write operation key=L9HUVE5A5NGT tag=S9BZ0MFWWBUJ type=write size=494092 2024-09-12T17:18:33.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.154+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=WTC8EZK5N2WM type=write size=179364 2024-09-12T17:18:33.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.158+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=68NIC2OT202P type=del 2024-09-12T17:18:33.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.158+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=DEMWUY7NGD7T type=del size=3598118 2024-09-12T17:18:33.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.162+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~4CWWYBEJL78A.0 size=1048576 2024-09-12T17:18:33.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.166+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~4CWWYBEJL78A.1 size=1048576 2024-09-12T17:18:33.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.166+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~4CWWYBEJL78A.2 size=636722 2024-09-12T17:18:33.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.170+0000 7f96641d38c0 1 < completed multipart upload key=NGA3P9RZJYWT upload=4CWWYBEJL78A tag=VP2JXSX3VPIO type=write size=3782450 2024-09-12T17:18:33.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.178+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~03UU5BS71OFU.0 size=1048576 2024-09-12T17:18:33.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.178+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~03UU5BS71OFU.1 size=1048576 2024-09-12T17:18:33.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.182+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~03UU5BS71OFU.2 size=756559 2024-09-12T17:18:33.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.182+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=03UU5BS71OFU tag=0ND4Q1I4U03N type=write size=3902287 2024-09-12T17:18:33.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.182+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~4B2NBNBSQRMD.0 size=1048576 2024-09-12T17:18:33.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.186+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~4B2NBNBSQRMD.1 size=1013738 2024-09-12T17:18:33.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.190+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=4B2NBNBSQRMD tag=CALDOL459ICE type=write size=3110890 2024-09-12T17:18:33.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.194+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=M38FXIQDKXIQ type=del size=2587769 2024-09-12T17:18:33.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.198+0000 7f96641d38c0 1 < suggested update operation key=GKJJDBNXC6QH tag=C9XNMLDOR3CI type=del size=2847234 2024-09-12T17:18:33.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.202+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=ILERUCS0563W type=del size=3696570 2024-09-12T17:18:33.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.206+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~JWOQ3WCNR6PE.0 size=888325 2024-09-12T17:18:33.212 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.210+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=JWOQ3WCNR6PE tag=0I0J9UEAHEIA type=write size=1936901 2024-09-12T17:18:33.215 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.214+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=TVOHC7NUGBBM type=del size=580065 2024-09-12T17:18:33.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.218+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~9N3T21PFVQLC.0 size=1048576 2024-09-12T17:18:33.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.218+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~9N3T21PFVQLC.1 size=1048576 2024-09-12T17:18:33.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.222+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~9N3T21PFVQLC.2 size=248058 2024-09-12T17:18:33.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.226+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=9N3T21PFVQLC tag=BOCXPB5EKD6T type=write size=3393786 2024-09-12T17:18:33.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.230+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=0RSPDZKH12ZL type=del size=2909111 2024-09-12T17:18:33.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.234+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=O6DX2MA23H8Y type=del 2024-09-12T17:18:33.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.234+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=02E8N9A29N1I type=del size=3470372 2024-09-12T17:18:33.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.238+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~AGOMMBZ2CHFP.0 size=1048576 2024-09-12T17:18:33.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.242+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~AGOMMBZ2CHFP.1 size=313785 2024-09-12T17:18:33.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.250+0000 7f96641d38c0 1 < completed multipart upload key=47QQRTJKM4DB upload=AGOMMBZ2CHFP tag=VRCOZEFAFK2B type=write size=2410937 2024-09-12T17:18:33.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.254+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~TIGKYOXUSAEI.0 size=1048576 2024-09-12T17:18:33.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.258+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~TIGKYOXUSAEI.1 size=1048576 2024-09-12T17:18:33.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.258+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~TIGKYOXUSAEI.2 size=195212 2024-09-12T17:18:33.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.258+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=TIGKYOXUSAEI tag=9CTWAMD4F8XK type=write size=3340940 2024-09-12T17:18:33.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.262+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~UW2ZK24UOY3Z.0 size=1048576 2024-09-12T17:18:33.267 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.266+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~UW2ZK24UOY3Z.1 size=780835 2024-09-12T17:18:33.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.270+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=UW2ZK24UOY3Z tag=OENAM6H2VDH3 type=write size=2877987 2024-09-12T17:18:33.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.274+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=TS1YD0OYGCLF type=del size=2550718 2024-09-12T17:18:33.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.274+0000 7f96641d38c0 1 < canceled part key=_multipart_37YXLWPZGA9J.2~FWFI1KUY94M1.0 size=1026138 2024-09-12T17:18:33.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.278+0000 7f96641d38c0 1 < canceled multipart upload key=37YXLWPZGA9J upload=FWFI1KUY94M1 tag=KSCZY4KSGJ79 type=write size=2074714 2024-09-12T17:18:33.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.286+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~4A71MKV5HMFD.0 size=626646 2024-09-12T17:18:33.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.286+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=4A71MKV5HMFD tag=221W79NQO73S type=write size=1675222 2024-09-12T17:18:33.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.290+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~D5S9CKWR42WG.0 size=1048576 2024-09-12T17:18:33.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.290+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~D5S9CKWR42WG.1 size=1048576 2024-09-12T17:18:33.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.294+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~D5S9CKWR42WG.2 size=44930 2024-09-12T17:18:33.300 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.298+0000 7f96641d38c0 1 < completed multipart upload key=NGA3P9RZJYWT upload=D5S9CKWR42WG tag=CC6I6OEW7B36 type=write size=3190658 2024-09-12T17:18:33.306 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.306+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~1AZY7O2F2XUL.0 size=1048576 2024-09-12T17:18:33.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.306+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~1AZY7O2F2XUL.1 size=37756 2024-09-12T17:18:33.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.306+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=1AZY7O2F2XUL tag=Y1DZQSMJYH2D type=write size=2134908 2024-09-12T17:18:33.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.310+0000 7f96641d38c0 1 < canceled operation key=3SLNHJT3A1K1 tag=FA238J3ROYUL type=del size=249557 2024-09-12T17:18:33.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.318+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~1LTY84TTXEMW.0 size=573629 2024-09-12T17:18:33.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.318+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=1LTY84TTXEMW tag=H53N0NZ9RUII type=write size=1622205 2024-09-12T17:18:33.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.318+0000 7f96641d38c0 1 < completed write operation key=6BH7SI911MMP tag=5KUCEUOB86FT type=write size=689910 2024-09-12T17:18:33.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.326+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~ZFPB5JT4G8LB.0 size=138898 2024-09-12T17:18:33.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.326+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=ZFPB5JT4G8LB tag=YEX4OS86TMSJ type=write size=1187474 2024-09-12T17:18:33.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.330+0000 7f96641d38c0 1 < canceled operation key=8TU2VZOHL1ZZ tag=RSTFCJFYS83K type=del size=1557970 2024-09-12T17:18:33.336 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.334+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~GDYNYZPWMIEJ.0 size=1048576 2024-09-12T17:18:33.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.338+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~GDYNYZPWMIEJ.1 size=1048576 2024-09-12T17:18:33.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.338+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~GDYNYZPWMIEJ.2 size=688736 2024-09-12T17:18:33.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.338+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=GDYNYZPWMIEJ tag=WSHG6LI3LT96 type=write size=3834464 2024-09-12T17:18:33.342 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.342+0000 7f96641d38c0 1 < canceled part key=_multipart_IR9JQ4MAEH0P.2~4LOG6XXM84OJ.0 size=585868 2024-09-12T17:18:33.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.346+0000 7f96641d38c0 1 < canceled multipart upload key=IR9JQ4MAEH0P upload=4LOG6XXM84OJ tag=01OW2169FEOA type=write size=1634444 2024-09-12T17:18:33.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.350+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=FJPG3W76JVFR type=del size=3236392 2024-09-12T17:18:33.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.354+0000 7f96641d38c0 1 < suggested remove operation key=G7CWVD9C2H2J tag=WTC8EZK5N2WM type=write 2024-09-12T17:18:33.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.358+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=IQ6WAI9JA0ZR type=del size=3586643 2024-09-12T17:18:33.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.362+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=DEMWUY7NGD7T type=del 2024-09-12T17:18:33.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.366+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=X4OTPKC04PN3 type=del size=2877840 2024-09-12T17:18:33.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.370+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~03UU5BS71OFU.0 size=1048576 2024-09-12T17:18:33.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.370+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~03UU5BS71OFU.1 size=1048576 2024-09-12T17:18:33.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.374+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~03UU5BS71OFU.2 size=756559 2024-09-12T17:18:33.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.382+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=03UU5BS71OFU tag=0ND4Q1I4U03N type=write size=3902287 2024-09-12T17:18:33.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.382+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=C9Y5I6MAK4U8 type=del size=3410147 2024-09-12T17:18:33.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.390+0000 7f96641d38c0 1 < suggested update operation key=47QQRTJKM4DB tag=M38FXIQDKXIQ type=del size=2587769 2024-09-12T17:18:33.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.398+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~7F9V9ZYX5J3G.0 size=127902 2024-09-12T17:18:33.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.398+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=7F9V9ZYX5J3G tag=NAVKJZ25NP7L type=write size=1176478 2024-09-12T17:18:33.402 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.402+0000 7f96641d38c0 1 < canceled operation key=RSVQJS9F1FR7 tag=ILERUCS0563W type=del size=3696570 2024-09-12T17:18:33.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.402+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=H450IE1I6LQ4 type=del size=3199179 2024-09-12T17:18:33.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.406+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=TVOHC7NUGBBM type=del 2024-09-12T17:18:33.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.410+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=K0C3H5594P0W type=del size=680870 2024-09-12T17:18:33.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.414+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=0RSPDZKH12ZL type=del 2024-09-12T17:18:33.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.418+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~BVZZMJ71EK9D.0 size=1048576 2024-09-12T17:18:33.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.422+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~BVZZMJ71EK9D.1 size=826174 2024-09-12T17:18:33.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.422+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=BVZZMJ71EK9D tag=5DWM0TEH9TGB type=write size=2923326 2024-09-12T17:18:33.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.430+0000 7f96641d38c0 1 < suggested update operation key=6BH7SI911MMP tag=02E8N9A29N1I type=del size=3470372 2024-09-12T17:18:33.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.430+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=AV1GQM3D6O6V type=del size=2085515 2024-09-12T17:18:33.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.434+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~TIGKYOXUSAEI.0 size=1048576 2024-09-12T17:18:33.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.438+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~TIGKYOXUSAEI.1 size=1048576 2024-09-12T17:18:33.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.438+0000 7f96641d38c0 1 < canceled part key=_multipart_37YXLWPZGA9J.2~TIGKYOXUSAEI.2 size=195212 2024-09-12T17:18:33.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.442+0000 7f96641d38c0 1 < canceled multipart upload key=37YXLWPZGA9J upload=TIGKYOXUSAEI tag=9CTWAMD4F8XK type=write size=3340940 2024-09-12T17:18:33.449 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.446+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~KF4C4JHB36EC.0 size=1048576 2024-09-12T17:18:33.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.450+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~KF4C4JHB36EC.1 size=1048576 2024-09-12T17:18:33.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.454+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~KF4C4JHB36EC.2 size=56088 2024-09-12T17:18:33.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.454+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=KF4C4JHB36EC tag=5ALK6Z2MVM4V type=write size=3201816 2024-09-12T17:18:33.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.454+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=TS1YD0OYGCLF type=del 2024-09-12T17:18:33.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.462+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~H1FA66N95FKF.0 size=932569 2024-09-12T17:18:33.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.462+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=H1FA66N95FKF tag=DADUIYD3TIQ5 type=write size=1981145 2024-09-12T17:18:33.465 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.462+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~4A71MKV5HMFD.0 size=626646 2024-09-12T17:18:33.470 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.470+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=4A71MKV5HMFD tag=221W79NQO73S type=write size=1675222 2024-09-12T17:18:33.477 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.474+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~B5SHSE12P3TB.0 size=1048576 2024-09-12T17:18:33.479 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.478+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~B5SHSE12P3TB.1 size=841134 2024-09-12T17:18:33.479 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.478+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=B5SHSE12P3TB tag=G14R3SWJ164R type=write size=2938286 2024-09-12T17:18:33.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.478+0000 7f96641d38c0 1 < canceled part key=_multipart_3SLNHJT3A1K1.2~1AZY7O2F2XUL.0 size=1048576 2024-09-12T17:18:33.483 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.482+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~1AZY7O2F2XUL.1 size=37756 2024-09-12T17:18:33.489 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.486+0000 7f96641d38c0 1 < canceled multipart upload key=3SLNHJT3A1K1 upload=1AZY7O2F2XUL tag=Y1DZQSMJYH2D type=write size=2134908 2024-09-12T17:18:33.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.490+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=CR8SIK78HGCP type=del size=1445805 2024-09-12T17:18:33.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.494+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~1LTY84TTXEMW.0 size=573629 2024-09-12T17:18:33.502 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.502+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=1LTY84TTXEMW tag=H53N0NZ9RUII type=write size=1622205 2024-09-12T17:18:33.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.506+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~PKWHDL4Q9D65.0 size=840331 2024-09-12T17:18:33.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.506+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=PKWHDL4Q9D65 tag=JUN6PGQWMIHN type=write size=1888907 2024-09-12T17:18:33.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.510+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~ZFPB5JT4G8LB.0 size=138898 2024-09-12T17:18:33.517 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.514+0000 7f96641d38c0 1 < completed multipart upload key=0X2HHMHJUJNL upload=ZFPB5JT4G8LB tag=YEX4OS86TMSJ type=write size=1187474 2024-09-12T17:18:33.520 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.518+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=ZDT3VABCSWGX type=write size=970363 2024-09-12T17:18:33.524 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.522+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~GDYNYZPWMIEJ.0 size=1048576 2024-09-12T17:18:33.526 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.526+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~GDYNYZPWMIEJ.1 size=1048576 2024-09-12T17:18:33.529 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.526+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~GDYNYZPWMIEJ.2 size=688736 2024-09-12T17:18:33.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.534+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=GDYNYZPWMIEJ tag=WSHG6LI3LT96 type=write size=3834464 2024-09-12T17:18:33.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.538+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=AGB276IQ6090 type=del size=3435087 2024-09-12T17:18:33.545 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.542+0000 7f96641d38c0 -1 < failed to complete operation key=47QQRTJKM4DB tag=FJPG3W76JVFR type=del size=3236392: (22) Invalid argument 2024-09-12T17:18:33.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.550+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=6GXS3W3LEJP5 type=write size=816272 2024-09-12T17:18:33.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.550+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=IQ6WAI9JA0ZR type=del 2024-09-12T17:18:33.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.554+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~6CVQ9OHIOG7E.0 size=1048576 2024-09-12T17:18:33.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.558+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~6CVQ9OHIOG7E.1 size=1048576 2024-09-12T17:18:33.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.558+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~6CVQ9OHIOG7E.2 size=368433 2024-09-12T17:18:33.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.558+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=6CVQ9OHIOG7E tag=MVM737X9CFJN type=write size=3514161 2024-09-12T17:18:33.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.562+0000 7f96641d38c0 -1 < failed to complete operation key=6BH7SI911MMP tag=X4OTPKC04PN3 type=del size=2877840: (22) Invalid argument 2024-09-12T17:18:33.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.566+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~JA0NOFNUF9Z8.0 size=1048576 2024-09-12T17:18:33.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.570+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~JA0NOFNUF9Z8.1 size=266867 2024-09-12T17:18:33.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.570+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=JA0NOFNUF9Z8 tag=RBOS4K9BLXUC type=write size=2364019 2024-09-12T17:18:33.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.570+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=C9Y5I6MAK4U8 type=del 2024-09-12T17:18:33.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.574+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=4JHMJE2HTPIB type=del size=1822035 2024-09-12T17:18:33.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.578+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~7F9V9ZYX5J3G.0 size=127902 2024-09-12T17:18:33.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.582+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=7F9V9ZYX5J3G tag=NAVKJZ25NP7L type=write size=1176478 2024-09-12T17:18:33.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.586+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=2KOX092UZXV4 type=del size=188822 2024-09-12T17:18:33.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.590+0000 7f96641d38c0 1 < suggested update operation key=NG327LT02T1F tag=H450IE1I6LQ4 type=del size=3199179 2024-09-12T17:18:33.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.590+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=5EY0D1HJOSXH type=del size=740457 2024-09-12T17:18:33.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.598+0000 7f96641d38c0 1 < suggested remove operation key=RSVQJS9F1FR7 tag=K0C3H5594P0W type=del 2024-09-12T17:18:33.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.598+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=0R8FF1OR483S type=write size=630324 2024-09-12T17:18:33.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.602+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~BVZZMJ71EK9D.0 size=1048576 2024-09-12T17:18:33.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.606+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~BVZZMJ71EK9D.1 size=826174 2024-09-12T17:18:33.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.610+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=BVZZMJ71EK9D tag=5DWM0TEH9TGB type=write size=2923326 2024-09-12T17:18:33.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.614+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=24RQNCOWT7A8 type=del size=1231823 2024-09-12T17:18:33.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.618+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=AV1GQM3D6O6V type=del 2024-09-12T17:18:33.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.618+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=H9QT4HKATW7Z type=write size=917041 2024-09-12T17:18:33.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.622+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~KF4C4JHB36EC.0 size=1048576 2024-09-12T17:18:33.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.622+0000 7f96641d38c0 1 < canceled part key=_multipart_3SLNHJT3A1K1.2~KF4C4JHB36EC.1 size=1048576 2024-09-12T17:18:33.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.622+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~KF4C4JHB36EC.2 size=56088 2024-09-12T17:18:33.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.630+0000 7f96641d38c0 1 < canceled multipart upload key=3SLNHJT3A1K1 upload=KF4C4JHB36EC tag=5ALK6Z2MVM4V type=write size=3201816 2024-09-12T17:18:33.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.630+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=YW14QRI9VYC6 type=del size=480444 2024-09-12T17:18:33.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.634+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~H1FA66N95FKF.0 size=932569 2024-09-12T17:18:33.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.638+0000 7f96641d38c0 1 < completed multipart upload key=NGA3P9RZJYWT upload=H1FA66N95FKF tag=DADUIYD3TIQ5 type=write size=1981145 2024-09-12T17:18:33.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.642+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=VJTU2EN8J3P8 type=del size=1533771 2024-09-12T17:18:33.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.646+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~B5SHSE12P3TB.0 size=1048576 2024-09-12T17:18:33.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.646+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~B5SHSE12P3TB.1 size=841134 2024-09-12T17:18:33.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.650+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=B5SHSE12P3TB tag=G14R3SWJ164R type=write size=2938286 2024-09-12T17:18:33.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.654+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=SK8UWVCGTRJW type=del size=568620 2024-09-12T17:18:33.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.658+0000 7f96641d38c0 1 < canceled operation key=G7CWVD9C2H2J tag=CR8SIK78HGCP type=del size=1445805 2024-09-12T17:18:33.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.658+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=SZ2N9TU9WOYP type=del size=3072573 2024-09-12T17:18:33.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.662+0000 7f96641d38c0 1 < canceled part key=_multipart_H3LV5G117KOW.2~PKWHDL4Q9D65.0 size=840331 2024-09-12T17:18:33.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.666+0000 7f96641d38c0 1 < canceled multipart upload key=H3LV5G117KOW upload=PKWHDL4Q9D65 tag=JUN6PGQWMIHN type=write size=1888907 2024-09-12T17:18:33.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.666+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=3DJ2YVFSHXRX type=del size=1213920 2024-09-12T17:18:33.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.670+0000 7f96641d38c0 1 < completed write operation key=NR82RUK97NQA tag=ZDT3VABCSWGX type=write size=970363 2024-09-12T17:18:33.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.674+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~HHPI570ZI1BF.0 size=1048576 2024-09-12T17:18:33.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.678+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~HHPI570ZI1BF.1 size=1048576 2024-09-12T17:18:33.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.678+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~HHPI570ZI1BF.2 size=607710 2024-09-12T17:18:33.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.678+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=HHPI570ZI1BF tag=ZYDZCCON4C60 type=write size=3753438 2024-09-12T17:18:33.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.682+0000 7f96641d38c0 1 < canceled operation key=HRU241T0FUEZ tag=AGB276IQ6090 type=del size=3435087 2024-09-12T17:18:33.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.686+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=MFM1WA20OONR type=del size=3284870 2024-09-12T17:18:33.691 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.690+0000 7f96641d38c0 1 < canceled operation key=W40P2E1H5VT9 tag=6GXS3W3LEJP5 type=write size=816272 2024-09-12T17:18:33.694 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.694+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=5C8THT6F1W1A type=del size=2516177 2024-09-12T17:18:33.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.694+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~6CVQ9OHIOG7E.0 size=1048576 2024-09-12T17:18:33.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.698+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~6CVQ9OHIOG7E.1 size=1048576 2024-09-12T17:18:33.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.702+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~6CVQ9OHIOG7E.2 size=368433 2024-09-12T17:18:33.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.706+0000 7f96641d38c0 1 < completed multipart upload key=EFORFJYOM45R upload=6CVQ9OHIOG7E tag=MVM737X9CFJN type=write size=3514161 2024-09-12T17:18:33.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.710+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=VFTIF3BUH7KN type=del size=2582220 2024-09-12T17:18:33.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.710+0000 7f96641d38c0 1 < canceled part key=_multipart_UBYUSW4C2V19.2~JA0NOFNUF9Z8.0 size=1048576 2024-09-12T17:18:33.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.714+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~JA0NOFNUF9Z8.1 size=266867 2024-09-12T17:18:33.720 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.718+0000 7f96641d38c0 1 < canceled multipart upload key=UBYUSW4C2V19 upload=JA0NOFNUF9Z8 tag=RBOS4K9BLXUC type=write size=2364019 2024-09-12T17:18:33.723 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.722+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=SVDBX8QMJWLP type=del size=2338837 2024-09-12T17:18:33.726 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.726+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=4JHMJE2HTPIB type=del 2024-09-12T17:18:33.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.730+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~DZ6AVD9ZUZDQ.0 size=1048576 2024-09-12T17:18:33.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.734+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~DZ6AVD9ZUZDQ.1 size=1048576 2024-09-12T17:18:33.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.734+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~DZ6AVD9ZUZDQ.2 size=307119 2024-09-12T17:18:33.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.734+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=DZ6AVD9ZUZDQ tag=5780TTHSSTBG type=write size=3452847 2024-09-12T17:18:33.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.738+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=2KOX092UZXV4 type=del 2024-09-12T17:18:33.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.742+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=KNE9Q5JGZ6MO type=del size=4075762 2024-09-12T17:18:33.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.746+0000 7f96641d38c0 1 < canceled operation key=6BH7SI911MMP tag=5EY0D1HJOSXH type=del size=740457 2024-09-12T17:18:33.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.746+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=8343NXBRPUFP type=del size=1813436 2024-09-12T17:18:33.753 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.750+0000 7f96641d38c0 1 < completed write operation key=NR82RUK97NQA tag=0R8FF1OR483S type=write size=630324 2024-09-12T17:18:33.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.754+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=Y1ZG4VU3F06G type=del size=4193464 2024-09-12T17:18:33.759 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.758+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=24RQNCOWT7A8 type=del 2024-09-12T17:18:33.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.762+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~S7AM8NCX9BCC.0 size=819224 2024-09-12T17:18:33.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.762+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=S7AM8NCX9BCC tag=649EQ8I0NWCR type=write size=1867800 2024-09-12T17:18:33.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.766+0000 7f96641d38c0 1 < completed write operation key=3SLNHJT3A1K1 tag=H9QT4HKATW7Z type=write size=917041 2024-09-12T17:18:33.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.770+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~FF4TMMWHN2PL.0 size=1048576 2024-09-12T17:18:33.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.774+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~FF4TMMWHN2PL.1 size=775768 2024-09-12T17:18:33.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.774+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=FF4TMMWHN2PL tag=WNY21DG0P6FG type=write size=2872920 2024-09-12T17:18:33.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.778+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=YW14QRI9VYC6 type=del 2024-09-12T17:18:33.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.778+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=M0OGIJKCQC97 type=write size=5381 2024-09-12T17:18:33.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.782+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=VJTU2EN8J3P8 type=del 2024-09-12T17:18:33.790 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.786+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~334VAF05V933.0 size=1048576 2024-09-12T17:18:33.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.790+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~334VAF05V933.1 size=290448 2024-09-12T17:18:33.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.790+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=334VAF05V933 tag=3Z579TE7WEQ7 type=write size=2387600 2024-09-12T17:18:33.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.794+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=SK8UWVCGTRJW type=del 2024-09-12T17:18:33.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.798+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=Q0MMD2QZ8AF6 type=del size=2983962 2024-09-12T17:18:33.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.798+0000 7f96641d38c0 1 < completed delete operation key=5ZZI4F92J7BO tag=SZ2N9TU9WOYP type=del 2024-09-12T17:18:33.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.802+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=Z1XN3ZZD30E2 type=del size=752135 2024-09-12T17:18:33.807 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.806+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=3DJ2YVFSHXRX type=del 2024-09-12T17:18:33.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.810+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=YNO9VRTAG2BW type=del size=2239072 2024-09-12T17:18:33.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.810+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~HHPI570ZI1BF.0 size=1048576 2024-09-12T17:18:33.816 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.814+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~HHPI570ZI1BF.1 size=1048576 2024-09-12T17:18:33.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.818+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~HHPI570ZI1BF.2 size=607710 2024-09-12T17:18:33.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.826+0000 7f96641d38c0 1 < completed multipart upload key=EFORFJYOM45R upload=HHPI570ZI1BF tag=ZYDZCCON4C60 type=write size=3753438 2024-09-12T17:18:33.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.830+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=LIY2U2JWG6GZ type=del size=2113089 2024-09-12T17:18:33.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.834+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=MFM1WA20OONR type=del 2024-09-12T17:18:33.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.838+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~UBI8KPXCHHCY.0 size=40446 2024-09-12T17:18:33.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.838+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=UBI8KPXCHHCY tag=117NHK1V1FPT type=write size=1089022 2024-09-12T17:18:33.846 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.846+0000 7f96641d38c0 1 < suggested remove operation key=8TU2VZOHL1ZZ tag=5C8THT6F1W1A type=del 2024-09-12T17:18:33.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.850+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~LKF97MH8VBJW.0 size=1048576 2024-09-12T17:18:33.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.850+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~LKF97MH8VBJW.1 size=1048576 2024-09-12T17:18:33.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.854+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~LKF97MH8VBJW.2 size=442052 2024-09-12T17:18:33.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.854+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=LKF97MH8VBJW tag=XBNGC4VZFO5N type=write size=3587780 2024-09-12T17:18:33.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.858+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=VFTIF3BUH7KN type=del 2024-09-12T17:18:33.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.858+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=5BWICUI6Y7ZJ type=del size=996133 2024-09-12T17:18:33.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.862+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=SVDBX8QMJWLP type=del 2024-09-12T17:18:33.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.866+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=WKHA5W2LDFDU type=write size=1036046 2024-09-12T17:18:33.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.866+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~DZ6AVD9ZUZDQ.0 size=1048576 2024-09-12T17:18:33.872 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.870+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~DZ6AVD9ZUZDQ.1 size=1048576 2024-09-12T17:18:33.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.874+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~DZ6AVD9ZUZDQ.2 size=307119 2024-09-12T17:18:33.880 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.878+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=DZ6AVD9ZUZDQ tag=5780TTHSSTBG type=write size=3452847 2024-09-12T17:18:33.883 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.882+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=Y3LK1N5SV6VY type=write size=800362 2024-09-12T17:18:33.886 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.886+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=KNE9Q5JGZ6MO type=del 2024-09-12T17:18:33.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.890+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=DWVYBED83BTZ type=write size=764448 2024-09-12T17:18:33.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.894+0000 7f96641d38c0 1 < suggested remove operation key=LK3F25OHR7AO tag=8343NXBRPUFP type=del 2024-09-12T17:18:33.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.898+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=T9IRHBSJCXHL type=del size=1471425 2024-09-12T17:18:33.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.902+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=Y1ZG4VU3F06G type=del 2024-09-12T17:18:33.907 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.906+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=J3NMXGF4M3RA type=del size=2236719 2024-09-12T17:18:33.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.910+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~S7AM8NCX9BCC.0 size=819224 2024-09-12T17:18:33.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.914+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=S7AM8NCX9BCC tag=649EQ8I0NWCR type=write size=1867800 2024-09-12T17:18:33.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.918+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=S3KU3JSO0ECB type=del size=1818711 2024-09-12T17:18:33.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.922+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~FF4TMMWHN2PL.0 size=1048576 2024-09-12T17:18:33.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.926+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~FF4TMMWHN2PL.1 size=775768 2024-09-12T17:18:33.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.930+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=FF4TMMWHN2PL tag=WNY21DG0P6FG type=write size=2872920 2024-09-12T17:18:33.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.934+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=92N2U5FPHLJP type=del size=859986 2024-09-12T17:18:33.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.938+0000 7f96641d38c0 1 < completed write operation key=KXJYJ9VX7YVW tag=M0OGIJKCQC97 type=write size=5381 2024-09-12T17:18:33.942 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.942+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=NVM52KVQF4IF type=del size=3322644 2024-09-12T17:18:33.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.946+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~334VAF05V933.0 size=1048576 2024-09-12T17:18:33.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.946+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~334VAF05V933.1 size=290448 2024-09-12T17:18:33.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.950+0000 7f96641d38c0 1 < completed multipart upload key=EFORFJYOM45R upload=334VAF05V933 tag=3Z579TE7WEQ7 type=write size=2387600 2024-09-12T17:18:33.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.958+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~49IVO077PWZP.0 size=1048576 2024-09-12T17:18:33.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.962+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~49IVO077PWZP.1 size=1048576 2024-09-12T17:18:33.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.962+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~49IVO077PWZP.2 size=145698 2024-09-12T17:18:33.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.962+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=49IVO077PWZP tag=2K7DF45AD6UD type=write size=3291426 2024-09-12T17:18:33.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.966+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=Q0MMD2QZ8AF6 type=del 2024-09-12T17:18:33.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.970+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=HRCNGSQ7PI96 type=del size=3031192 2024-09-12T17:18:33.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.974+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=Z1XN3ZZD30E2 type=del 2024-09-12T17:18:33.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.978+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=ELYM5DPF20PJ type=write size=568546 2024-09-12T17:18:33.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.982+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=YNO9VRTAG2BW type=del 2024-09-12T17:18:33.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.986+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=ME6NEH4O1GV0 type=del size=267544 2024-09-12T17:18:33.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.986+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=LIY2U2JWG6GZ type=del 2024-09-12T17:18:33.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.994+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~RBK1X1O0A36O.0 size=1048576 2024-09-12T17:18:33.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.994+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~RBK1X1O0A36O.1 size=442735 2024-09-12T17:18:33.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.994+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=RBK1X1O0A36O tag=X5L07HLVVA37 type=write size=2539887 2024-09-12T17:18:34.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:33.998+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~UBI8KPXCHHCY.0 size=40446 2024-09-12T17:18:34.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.002+0000 7f96641d38c0 1 < completed multipart upload key=XDL9O7TEMBYF upload=UBI8KPXCHHCY tag=117NHK1V1FPT type=write size=1089022 2024-09-12T17:18:34.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.010+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~FX1UJZ3TFWKG.0 size=290303 2024-09-12T17:18:34.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.010+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=FX1UJZ3TFWKG tag=T811GJ2LC7BN type=write size=1338879 2024-09-12T17:18:34.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.014+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~LKF97MH8VBJW.0 size=1048576 2024-09-12T17:18:34.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.014+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~LKF97MH8VBJW.1 size=1048576 2024-09-12T17:18:34.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.018+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~LKF97MH8VBJW.2 size=442052 2024-09-12T17:18:34.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.022+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=LKF97MH8VBJW tag=XBNGC4VZFO5N type=write size=3587780 2024-09-12T17:18:34.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.026+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=BOYZ7RW4EBNQ type=del size=1569251 2024-09-12T17:18:34.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.030+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=5BWICUI6Y7ZJ type=del 2024-09-12T17:18:34.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.034+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=MRE69RWLEYTC type=del size=594317 2024-09-12T17:18:34.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.038+0000 7f96641d38c0 1 < completed write operation key=MOQXP4AXMTCK tag=WKHA5W2LDFDU type=write size=1036046 2024-09-12T17:18:34.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.038+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=RMKXSR0HJ4OQ type=del size=1978646 2024-09-12T17:18:34.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.046+0000 7f96641d38c0 1 < suggested update operation key=6BH7SI911MMP tag=Y3LK1N5SV6VY type=write size=800362 2024-09-12T17:18:34.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.054+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~ECOMBH4CJP11.0 size=967673 2024-09-12T17:18:34.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.054+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=ECOMBH4CJP11 tag=OHU5DU4ZZN71 type=write size=2016249 2024-09-12T17:18:34.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.058+0000 7f96641d38c0 1 < completed write operation key=H3LV5G117KOW tag=DWVYBED83BTZ type=write size=764448 2024-09-12T17:18:34.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.062+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~LGI3ZWY3ULIS.0 size=1048576 2024-09-12T17:18:34.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.066+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~LGI3ZWY3ULIS.1 size=1048576 2024-09-12T17:18:34.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.070+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~LGI3ZWY3ULIS.2 size=7880 2024-09-12T17:18:34.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.070+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=LGI3ZWY3ULIS tag=CHWBESRLSP5M type=write size=3153608 2024-09-12T17:18:34.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.074+0000 7f96641d38c0 1 < suggested update operation key=L9HUVE5A5NGT tag=T9IRHBSJCXHL type=del size=1471425 2024-09-12T17:18:34.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.078+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=04AVTFI3KKST type=del size=1166378 2024-09-12T17:18:34.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.082+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=J3NMXGF4M3RA type=del 2024-09-12T17:18:34.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.086+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=RTX6JGHKZCTE type=del size=418562 2024-09-12T17:18:34.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.090+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=S3KU3JSO0ECB type=del 2024-09-12T17:18:34.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.094+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=EUZT9GSQFYYM type=del size=3316519 2024-09-12T17:18:34.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.098+0000 7f96641d38c0 -1 < failed to complete operation key=6BH7SI911MMP tag=92N2U5FPHLJP type=del size=859986: (22) Invalid argument 2024-09-12T17:18:34.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.102+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=KNK954WEP563 type=del size=4012148 2024-09-12T17:18:34.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.106+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=NVM52KVQF4IF type=del 2024-09-12T17:18:34.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.106+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=AKIRO2CWONDW type=del size=151514 2024-09-12T17:18:34.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.110+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~49IVO077PWZP.0 size=1048576 2024-09-12T17:18:34.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.114+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~49IVO077PWZP.1 size=1048576 2024-09-12T17:18:34.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.118+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~49IVO077PWZP.2 size=145698 2024-09-12T17:18:34.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.122+0000 7f96641d38c0 1 < completed multipart upload key=3SLNHJT3A1K1 upload=49IVO077PWZP tag=2K7DF45AD6UD type=write size=3291426 2024-09-12T17:18:34.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.126+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~S6BBC3KAZ8KE.0 size=159943 2024-09-12T17:18:34.130 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.126+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=S6BBC3KAZ8KE tag=OH4Q83A8P1US type=write size=1208519 2024-09-12T17:18:34.139 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.138+0000 7f96641d38c0 1 < suggested update operation key=LK3F25OHR7AO tag=HRCNGSQ7PI96 type=del size=3031192 2024-09-12T17:18:34.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.142+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=1VYFWLY58UUK type=del size=1116722 2024-09-12T17:18:34.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.146+0000 7f96641d38c0 -1 < failed to complete operation key=6BH7SI911MMP tag=ELYM5DPF20PJ type=write size=568546: (22) Invalid argument 2024-09-12T17:18:34.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.150+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=84QOIS3DRWC0 type=del size=2734868 2024-09-12T17:18:34.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.154+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=ME6NEH4O1GV0 type=del 2024-09-12T17:18:34.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.154+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=E16E0ZEFZS5Z type=del size=2506112 2024-09-12T17:18:34.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.158+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~RBK1X1O0A36O.0 size=1048576 2024-09-12T17:18:34.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.162+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~RBK1X1O0A36O.1 size=442735 2024-09-12T17:18:34.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.166+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=RBK1X1O0A36O tag=X5L07HLVVA37 type=write size=2539887 2024-09-12T17:18:34.173 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.170+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=Y2ETTVP0AU83 type=del size=1811403 2024-09-12T17:18:34.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.174+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~FX1UJZ3TFWKG.0 size=290303 2024-09-12T17:18:34.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.182+0000 7f96641d38c0 1 < completed multipart upload key=HRU241T0FUEZ upload=FX1UJZ3TFWKG tag=T811GJ2LC7BN type=write size=1338879 2024-09-12T17:18:34.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.182+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=KPAWWRFYJ5F7 type=del size=2873598 2024-09-12T17:18:34.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.186+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=BOYZ7RW4EBNQ type=del 2024-09-12T17:18:34.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.190+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=DXMN95OWKRDL type=del size=2441309 2024-09-12T17:18:34.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.194+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=MRE69RWLEYTC type=del 2024-09-12T17:18:34.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.202+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~22BURQQTS2XZ.0 size=890331 2024-09-12T17:18:34.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.202+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=22BURQQTS2XZ tag=1KN9N6T9JDVW type=write size=1938907 2024-09-12T17:18:34.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.206+0000 7f96641d38c0 1 < suggested remove operation key=DHODPSZ7Z0D4 tag=RMKXSR0HJ4OQ type=del 2024-09-12T17:18:34.212 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.210+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=C3PK8SO8H667 type=write size=396756 2024-09-12T17:18:34.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.214+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~ECOMBH4CJP11.0 size=967673 2024-09-12T17:18:34.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.218+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=ECOMBH4CJP11 tag=OHU5DU4ZZN71 type=write size=2016249 2024-09-12T17:18:34.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.226+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~128B7ND1QW75.0 size=1048576 2024-09-12T17:18:34.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.230+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~128B7ND1QW75.1 size=1048576 2024-09-12T17:18:34.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.230+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~128B7ND1QW75.2 size=301169 2024-09-12T17:18:34.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.230+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=128B7ND1QW75 tag=7AS6F953TOQ1 type=write size=3446897 2024-09-12T17:18:34.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.230+0000 7f96641d38c0 1 < canceled part key=_multipart_IR9JQ4MAEH0P.2~LGI3ZWY3ULIS.0 size=1048576 2024-09-12T17:18:34.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.234+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~LGI3ZWY3ULIS.1 size=1048576 2024-09-12T17:18:34.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.238+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~LGI3ZWY3ULIS.2 size=7880 2024-09-12T17:18:34.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.242+0000 7f96641d38c0 1 < canceled multipart upload key=IR9JQ4MAEH0P upload=LGI3ZWY3ULIS tag=CHWBESRLSP5M type=write size=3153608 2024-09-12T17:18:34.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.250+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~4M4QB1PW5QWE.0 size=575993 2024-09-12T17:18:34.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.250+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=4M4QB1PW5QWE tag=RPSC1FV9RNQQ type=write size=1624569 2024-09-12T17:18:34.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.254+0000 7f96641d38c0 1 < canceled operation key=3SLNHJT3A1K1 tag=04AVTFI3KKST type=del size=1166378 2024-09-12T17:18:34.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.258+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=M4WP0T2484MS type=del size=1399445 2024-09-12T17:18:34.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.258+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=RTX6JGHKZCTE type=del 2024-09-12T17:18:34.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.262+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=OW0E1B3QF0D5 type=write size=931115 2024-09-12T17:18:34.268 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.266+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=EUZT9GSQFYYM type=del 2024-09-12T17:18:34.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.270+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=QL21ZOQM7LJG type=del size=572054 2024-09-12T17:18:34.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.274+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=KNK954WEP563 type=del 2024-09-12T17:18:34.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.278+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=YR35B31Y56UE type=del size=684023 2024-09-12T17:18:34.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.278+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=AKIRO2CWONDW type=del 2024-09-12T17:18:34.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.286+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~WVEBJ5JIO3QH.0 size=1048576 2024-09-12T17:18:34.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.286+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~WVEBJ5JIO3QH.1 size=739782 2024-09-12T17:18:34.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.286+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=WVEBJ5JIO3QH tag=691FFNK3WS7X type=write size=2836934 2024-09-12T17:18:34.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.290+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~S6BBC3KAZ8KE.0 size=159943 2024-09-12T17:18:34.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.298+0000 7f96641d38c0 1 < completed multipart upload key=XDL9O7TEMBYF upload=S6BBC3KAZ8KE tag=OH4Q83A8P1US type=write size=1208519 2024-09-12T17:18:34.301 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.298+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=USDL3BA88O55 type=del size=2163408 2024-09-12T17:18:34.305 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.302+0000 7f96641d38c0 1 < canceled operation key=NG327LT02T1F tag=1VYFWLY58UUK type=del size=1116722 2024-09-12T17:18:34.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.306+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=WEZ10F03S6ES type=del size=2259236 2024-09-12T17:18:34.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.310+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=84QOIS3DRWC0 type=del 2024-09-12T17:18:34.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.314+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~IKRIJ5MLNWJN.0 size=666764 2024-09-12T17:18:34.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.314+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=IKRIJ5MLNWJN tag=B2P1RM24ZA3S type=write size=1715340 2024-09-12T17:18:34.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.322+0000 7f96641d38c0 1 < suggested update operation key=H3J23KLT1VUT tag=E16E0ZEFZS5Z type=del size=2506112 2024-09-12T17:18:34.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.330+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~WWJC33I6BX05.0 size=1048576 2024-09-12T17:18:34.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.334+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~WWJC33I6BX05.1 size=490885 2024-09-12T17:18:34.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.334+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=WWJC33I6BX05 tag=GSAVV5YOWVAZ type=write size=2588037 2024-09-12T17:18:34.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.338+0000 7f96641d38c0 1 < suggested remove operation key=NGA3P9RZJYWT tag=Y2ETTVP0AU83 type=del 2024-09-12T17:18:34.345 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.342+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=TM3PERG201SP type=del size=668911 2024-09-12T17:18:34.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.350+0000 7f96641d38c0 1 < suggested update operation key=3SLNHJT3A1K1 tag=KPAWWRFYJ5F7 type=del size=2873598 2024-09-12T17:18:34.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.354+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=YIPP6P91DXIS type=del size=3926436 2024-09-12T17:18:34.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.358+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=DXMN95OWKRDL type=del 2024-09-12T17:18:34.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.362+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=TE1A7RH1AKXI type=del size=374071 2024-09-12T17:18:34.363 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.362+0000 7f96641d38c0 1 < canceled part key=_multipart_3H8R2MJGR4SY.2~22BURQQTS2XZ.0 size=890331 2024-09-12T17:18:34.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.366+0000 7f96641d38c0 1 < canceled multipart upload key=3H8R2MJGR4SY upload=22BURQQTS2XZ tag=1KN9N6T9JDVW type=write size=1938907 2024-09-12T17:18:34.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.374+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~8HL5NVNHU0MF.0 size=1048576 2024-09-12T17:18:34.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.374+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~8HL5NVNHU0MF.1 size=1048576 2024-09-12T17:18:34.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.378+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~8HL5NVNHU0MF.2 size=535247 2024-09-12T17:18:34.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.378+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=8HL5NVNHU0MF tag=K534OIHL92QR type=write size=3680975 2024-09-12T17:18:34.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.378+0000 7f96641d38c0 -1 < no bi entry to suggest for operation key=NGA3P9RZJYWT tag=C3PK8SO8H667 type=write size=396756: (2) No such file or directory 2024-09-12T17:18:34.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.382+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=HDILWVMQ7KQ7 type=del size=837064 2024-09-12T17:18:34.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.386+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~128B7ND1QW75.0 size=1048576 2024-09-12T17:18:34.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.386+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~128B7ND1QW75.1 size=1048576 2024-09-12T17:18:34.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.390+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~128B7ND1QW75.2 size=301169 2024-09-12T17:18:34.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.394+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=128B7ND1QW75 tag=7AS6F953TOQ1 type=write size=3446897 2024-09-12T17:18:34.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.398+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=32SWXQSO3OF6 type=del size=653435 2024-09-12T17:18:34.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.398+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~4M4QB1PW5QWE.0 size=575993 2024-09-12T17:18:34.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.402+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=4M4QB1PW5QWE tag=RPSC1FV9RNQQ type=write size=1624569 2024-09-12T17:18:34.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.406+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=R94OTLD9O6IZ type=write size=531321 2024-09-12T17:18:34.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.410+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=M4WP0T2484MS type=del 2024-09-12T17:18:34.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.414+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~6MN413GKGUNI.0 size=714859 2024-09-12T17:18:34.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.414+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=6MN413GKGUNI tag=MI5F5BEE29TD type=write size=1763435 2024-09-12T17:18:34.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.418+0000 7f96641d38c0 1 < completed write operation key=8TU2VZOHL1ZZ tag=OW0E1B3QF0D5 type=write size=931115 2024-09-12T17:18:34.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.422+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=LPRF0PRH5U7Y type=del size=1028126 2024-09-12T17:18:34.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.422+0000 7f96641d38c0 -1 < failed to complete operation key=H3J23KLT1VUT tag=QL21ZOQM7LJG type=del size=572054: (22) Invalid argument 2024-09-12T17:18:34.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.426+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=8T76YJONV3I2 type=write size=48110 2024-09-12T17:18:34.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.430+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=YR35B31Y56UE type=del 2024-09-12T17:18:34.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.430+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=VF3WE8CH1F05 type=write size=385677 2024-09-12T17:18:34.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.434+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~WVEBJ5JIO3QH.0 size=1048576 2024-09-12T17:18:34.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.438+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~WVEBJ5JIO3QH.1 size=739782 2024-09-12T17:18:34.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.442+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=WVEBJ5JIO3QH tag=691FFNK3WS7X type=write size=2836934 2024-09-12T17:18:34.447 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.446+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=267AW7TQ27LM type=write size=469551 2024-09-12T17:18:34.449 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.446+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=USDL3BA88O55 type=del 2024-09-12T17:18:34.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.454+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~HIU5ZPUMHPDP.0 size=1048576 2024-09-12T17:18:34.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.454+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~HIU5ZPUMHPDP.1 size=430346 2024-09-12T17:18:34.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.454+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=HIU5ZPUMHPDP tag=VP3DFBNA2JCJ type=write size=2527498 2024-09-12T17:18:34.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.458+0000 7f96641d38c0 1 < suggested update operation key=EFORFJYOM45R tag=WEZ10F03S6ES type=del size=2259236 2024-09-12T17:18:34.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.462+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=SB7287K8OK0T type=del size=2917076 2024-09-12T17:18:34.466 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.466+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~IKRIJ5MLNWJN.0 size=666764 2024-09-12T17:18:34.470 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.470+0000 7f96641d38c0 1 < completed multipart upload key=37YXLWPZGA9J upload=IKRIJ5MLNWJN tag=B2P1RM24ZA3S type=write size=1715340 2024-09-12T17:18:34.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.470+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=OQOF2D1LI2AR type=write size=911061 2024-09-12T17:18:34.475 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.474+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~WWJC33I6BX05.0 size=1048576 2024-09-12T17:18:34.478 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.474+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~WWJC33I6BX05.1 size=490885 2024-09-12T17:18:34.482 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.478+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=WWJC33I6BX05 tag=GSAVV5YOWVAZ type=write size=2588037 2024-09-12T17:18:34.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.486+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~5JY0IOB8RN2N.0 size=1048576 2024-09-12T17:18:34.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.486+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~5JY0IOB8RN2N.1 size=1048576 2024-09-12T17:18:34.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.490+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~5JY0IOB8RN2N.2 size=1006914 2024-09-12T17:18:34.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.490+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=5JY0IOB8RN2N tag=1O1R4V4CCEWE type=write size=4152642 2024-09-12T17:18:34.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.490+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=TM3PERG201SP type=del 2024-09-12T17:18:34.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.494+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~TCNVUG8AQU90.0 size=1048576 2024-09-12T17:18:34.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.498+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~TCNVUG8AQU90.1 size=529552 2024-09-12T17:18:34.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.498+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=TCNVUG8AQU90 tag=7ZFUAYIXQMFK type=write size=2626704 2024-09-12T17:18:34.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.502+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=YIPP6P91DXIS type=del 2024-09-12T17:18:34.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.506+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=54IAZLCG6QUY type=del size=2660116 2024-09-12T17:18:34.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.510+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=TE1A7RH1AKXI type=del 2024-09-12T17:18:34.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.514+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=LAEVEGKYTIUN type=del size=1894331 2024-09-12T17:18:34.517 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.514+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~8HL5NVNHU0MF.0 size=1048576 2024-09-12T17:18:34.520 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.518+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~8HL5NVNHU0MF.1 size=1048576 2024-09-12T17:18:34.523 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.522+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~8HL5NVNHU0MF.2 size=535247 2024-09-12T17:18:34.528 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.526+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=8HL5NVNHU0MF tag=K534OIHL92QR type=write size=3680975 2024-09-12T17:18:34.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.534+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~3016WKT3EG1C.0 size=1048576 2024-09-12T17:18:34.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.538+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~3016WKT3EG1C.1 size=102594 2024-09-12T17:18:34.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.538+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=3016WKT3EG1C tag=DU6U90OLDI3V type=write size=2199746 2024-09-12T17:18:34.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.542+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=HDILWVMQ7KQ7 type=del 2024-09-12T17:18:34.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.546+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~IBA4PJ9XZDFV.0 size=660599 2024-09-12T17:18:34.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.546+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=IBA4PJ9XZDFV tag=RUO1N5ABQ11G type=write size=1709175 2024-09-12T17:18:34.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.550+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=32SWXQSO3OF6 type=del 2024-09-12T17:18:34.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.554+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=JV0NCC0QNBJQ type=del size=1608761 2024-09-12T17:18:34.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.554+0000 7f96641d38c0 1 < completed write operation key=8TU2VZOHL1ZZ tag=R94OTLD9O6IZ type=write size=531321 2024-09-12T17:18:34.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.558+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=DZ88OLRNNO3E type=del size=678406 2024-09-12T17:18:34.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.562+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~6MN413GKGUNI.0 size=714859 2024-09-12T17:18:34.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.566+0000 7f96641d38c0 1 < completed multipart upload key=G7CWVD9C2H2J upload=6MN413GKGUNI tag=MI5F5BEE29TD type=write size=1763435 2024-09-12T17:18:34.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.570+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=RIGRAHTNX3HJ type=write size=504720 2024-09-12T17:18:34.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.574+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=LPRF0PRH5U7Y type=del 2024-09-12T17:18:34.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.578+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~HWEW1M2SMJZC.0 size=391682 2024-09-12T17:18:34.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.578+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=HWEW1M2SMJZC tag=6UK78QO8V6H4 type=write size=1440258 2024-09-12T17:18:34.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.582+0000 7f96641d38c0 1 < completed write operation key=0X2HHMHJUJNL tag=8T76YJONV3I2 type=write size=48110 2024-09-12T17:18:34.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.586+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=TRSPSJ7TAQXH type=write size=45431 2024-09-12T17:18:34.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.586+0000 7f96641d38c0 1 < completed write operation key=3SLNHJT3A1K1 tag=VF3WE8CH1F05 type=write size=385677 2024-09-12T17:18:34.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.590+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=8XA3N7H20YP9 type=del size=1483561 2024-09-12T17:18:34.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.598+0000 7f96641d38c0 1 < suggested update operation key=H3LV5G117KOW tag=267AW7TQ27LM type=write size=469551 2024-09-12T17:18:34.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.602+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=VHV8XGXXI51D type=write size=610283 2024-09-12T17:18:34.609 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.606+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~HIU5ZPUMHPDP.0 size=1048576 2024-09-12T17:18:34.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.606+0000 7f96641d38c0 1 < canceled part key=_multipart_EFORFJYOM45R.2~HIU5ZPUMHPDP.1 size=430346 2024-09-12T17:18:34.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.610+0000 7f96641d38c0 1 < canceled multipart upload key=EFORFJYOM45R upload=HIU5ZPUMHPDP tag=VP3DFBNA2JCJ type=write size=2527498 2024-09-12T17:18:34.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.614+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~CNJLSWEABTEW.0 size=1048576 2024-09-12T17:18:34.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.618+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~CNJLSWEABTEW.1 size=601917 2024-09-12T17:18:34.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.618+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=CNJLSWEABTEW tag=EAYE49K7ZWKL type=write size=2699069 2024-09-12T17:18:34.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.622+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=SB7287K8OK0T type=del 2024-09-12T17:18:34.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.626+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=KZBXO6HICUZY type=del size=3170660 2024-09-12T17:18:34.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.630+0000 7f96641d38c0 1 < completed write operation key=L9HUVE5A5NGT tag=OQOF2D1LI2AR type=write size=911061 2024-09-12T17:18:34.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.630+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=1I04WJDYUTCX type=del size=1799864 2024-09-12T17:18:34.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.634+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~5JY0IOB8RN2N.0 size=1048576 2024-09-12T17:18:34.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.638+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~5JY0IOB8RN2N.1 size=1048576 2024-09-12T17:18:34.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.638+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~5JY0IOB8RN2N.2 size=1006914 2024-09-12T17:18:34.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.646+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=5JY0IOB8RN2N tag=1O1R4V4CCEWE type=write size=4152642 2024-09-12T17:18:34.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.646+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=KRGNEPRR9YM5 type=del size=1615072 2024-09-12T17:18:34.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.650+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~TCNVUG8AQU90.0 size=1048576 2024-09-12T17:18:34.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.654+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~TCNVUG8AQU90.1 size=529552 2024-09-12T17:18:34.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.658+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=TCNVUG8AQU90 tag=7ZFUAYIXQMFK type=write size=2626704 2024-09-12T17:18:34.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.662+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~119RYQC9M8WQ.0 size=1048576 2024-09-12T17:18:34.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.666+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~119RYQC9M8WQ.1 size=1048576 2024-09-12T17:18:34.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.666+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~119RYQC9M8WQ.2 size=991316 2024-09-12T17:18:34.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.666+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=119RYQC9M8WQ tag=VK5OH1DNBSIJ type=write size=4137044 2024-09-12T17:18:34.675 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.674+0000 7f96641d38c0 1 < suggested update operation key=NR82RUK97NQA tag=54IAZLCG6QUY type=del size=2660116 2024-09-12T17:18:34.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.678+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~L0JRR4QJGDW0.0 size=1048576 2024-09-12T17:18:34.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.682+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~L0JRR4QJGDW0.1 size=1048576 2024-09-12T17:18:34.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.686+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~L0JRR4QJGDW0.2 size=725084 2024-09-12T17:18:34.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.686+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=L0JRR4QJGDW0 tag=JWEKBG3TWD3A type=write size=3870812 2024-09-12T17:18:34.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.686+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=LAEVEGKYTIUN type=del 2024-09-12T17:18:34.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.694+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~IX6L1TBMKN8M.0 size=1048576 2024-09-12T17:18:34.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.694+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~IX6L1TBMKN8M.1 size=825571 2024-09-12T17:18:34.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.694+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=IX6L1TBMKN8M tag=AL1Q8BHDD7Q7 type=write size=2922723 2024-09-12T17:18:34.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.698+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~3016WKT3EG1C.0 size=1048576 2024-09-12T17:18:34.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.702+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~3016WKT3EG1C.1 size=102594 2024-09-12T17:18:34.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.706+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=3016WKT3EG1C tag=DU6U90OLDI3V type=write size=2199746 2024-09-12T17:18:34.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.710+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=9YUOPYXQIEGK type=del size=3183169 2024-09-12T17:18:34.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.714+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~IBA4PJ9XZDFV.0 size=660599 2024-09-12T17:18:34.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.718+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=IBA4PJ9XZDFV tag=RUO1N5ABQ11G type=write size=1709175 2024-09-12T17:18:34.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.722+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=QPVL2P7GRY8F type=del size=272615 2024-09-12T17:18:34.728 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.726+0000 7f96641d38c0 1 < suggested remove operation key=NR82RUK97NQA tag=JV0NCC0QNBJQ type=del 2024-09-12T17:18:34.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.730+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~Q4BCZB2ZASCG.0 size=1048576 2024-09-12T17:18:34.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.730+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~Q4BCZB2ZASCG.1 size=1048576 2024-09-12T17:18:34.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.734+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~Q4BCZB2ZASCG.2 size=1023503 2024-09-12T17:18:34.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.734+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=Q4BCZB2ZASCG tag=T93IPA4AVM7M type=write size=4169231 2024-09-12T17:18:34.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.738+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=DZ88OLRNNO3E type=del 2024-09-12T17:18:34.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.738+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=PKKHLIB91B6T type=write size=615617 2024-09-12T17:18:34.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.742+0000 7f96641d38c0 1 < canceled operation key=XTVZIXTEES2O tag=RIGRAHTNX3HJ type=write size=504720 2024-09-12T17:18:34.744 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.742+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=0W8A6NGG1IGQ type=del size=4186583 2024-09-12T17:18:34.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.746+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~HWEW1M2SMJZC.0 size=391682 2024-09-12T17:18:34.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.750+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=HWEW1M2SMJZC tag=6UK78QO8V6H4 type=write size=1440258 2024-09-12T17:18:34.753 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.750+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=ZE5G8KRBML9B type=del size=828113 2024-09-12T17:18:34.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.754+0000 7f96641d38c0 1 < completed write operation key=UBYUSW4C2V19 tag=TRSPSJ7TAQXH type=write size=45431 2024-09-12T17:18:34.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.758+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=0BMQ86IN9KA9 type=del size=41030 2024-09-12T17:18:34.761 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.758+0000 7f96641d38c0 1 < canceled operation key=2TN3M8NKV9LN tag=8XA3N7H20YP9 type=del size=1483561 2024-09-12T17:18:34.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.762+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=MYS2V8WJ3V64 type=write size=53992 2024-09-12T17:18:34.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.766+0000 7f96641d38c0 1 < completed write operation key=L9HUVE5A5NGT tag=VHV8XGXXI51D type=write size=610283 2024-09-12T17:18:34.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.766+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=XEPZ12IAYQEF type=del size=1624122 2024-09-12T17:18:34.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.770+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~CNJLSWEABTEW.0 size=1048576 2024-09-12T17:18:34.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.770+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~CNJLSWEABTEW.1 size=601917 2024-09-12T17:18:34.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.774+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=CNJLSWEABTEW tag=EAYE49K7ZWKL type=write size=2699069 2024-09-12T17:18:34.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.778+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=0VZR1QZZ9RY9 type=del size=3034163 2024-09-12T17:18:34.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.782+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=KZBXO6HICUZY type=del 2024-09-12T17:18:34.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.786+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~KE7XBBF0Y3JU.0 size=457079 2024-09-12T17:18:34.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.786+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=KE7XBBF0Y3JU tag=54RU8JKPRMU6 type=write size=1505655 2024-09-12T17:18:34.790 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.790+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=1I04WJDYUTCX type=del 2024-09-12T17:18:34.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.790+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=X3SZRKA0Y6S8 type=del size=2904737 2024-09-12T17:18:34.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.794+0000 7f96641d38c0 -1 < failed to complete operation key=NR82RUK97NQA tag=KRGNEPRR9YM5 type=del size=1615072: (22) Invalid argument 2024-09-12T17:18:34.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.798+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~XKTDMQIAYSRR.0 size=1048576 2024-09-12T17:18:34.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.798+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~XKTDMQIAYSRR.1 size=1048576 2024-09-12T17:18:34.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.802+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~XKTDMQIAYSRR.2 size=861247 2024-09-12T17:18:34.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.802+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=XKTDMQIAYSRR tag=DS3169OJSYZL type=write size=4006975 2024-09-12T17:18:34.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.806+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~119RYQC9M8WQ.0 size=1048576 2024-09-12T17:18:34.807 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.806+0000 7f96641d38c0 1 < canceled part key=_multipart_NR82RUK97NQA.2~119RYQC9M8WQ.1 size=1048576 2024-09-12T17:18:34.807 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.806+0000 7f96641d38c0 1 < canceled part key=_multipart_NR82RUK97NQA.2~119RYQC9M8WQ.2 size=991316 2024-09-12T17:18:34.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.810+0000 7f96641d38c0 1 < canceled multipart upload key=NR82RUK97NQA upload=119RYQC9M8WQ tag=VK5OH1DNBSIJ type=write size=4137044 2024-09-12T17:18:34.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.810+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=LG8PNAR3ADQ6 type=del size=379152 2024-09-12T17:18:34.816 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.814+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~L0JRR4QJGDW0.0 size=1048576 2024-09-12T17:18:34.818 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.818+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~L0JRR4QJGDW0.1 size=1048576 2024-09-12T17:18:34.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.818+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~L0JRR4QJGDW0.2 size=725084 2024-09-12T17:18:34.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.822+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=L0JRR4QJGDW0 tag=JWEKBG3TWD3A type=write size=3870812 2024-09-12T17:18:34.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.830+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~MXA7WKQP3449.0 size=1048576 2024-09-12T17:18:34.833 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.830+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~MXA7WKQP3449.1 size=1048576 2024-09-12T17:18:34.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.834+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~MXA7WKQP3449.2 size=223561 2024-09-12T17:18:34.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.834+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=MXA7WKQP3449 tag=20EUQKHHF1BG type=write size=3369289 2024-09-12T17:18:34.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.834+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~IX6L1TBMKN8M.0 size=1048576 2024-09-12T17:18:34.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.834+0000 7f96641d38c0 1 < canceled part key=_multipart_GKJJDBNXC6QH.2~IX6L1TBMKN8M.1 size=825571 2024-09-12T17:18:34.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.842+0000 7f96641d38c0 1 < canceled multipart upload key=GKJJDBNXC6QH upload=IX6L1TBMKN8M tag=AL1Q8BHDD7Q7 type=write size=2922723 2024-09-12T17:18:34.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.842+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=O4DFQIXAPRKD type=del size=4039257 2024-09-12T17:18:34.848 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.846+0000 7f96641d38c0 1 < canceled operation key=0X2HHMHJUJNL tag=9YUOPYXQIEGK type=del size=3183169 2024-09-12T17:18:34.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.850+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=RSP09L8UDJ33 type=del size=1949049 2024-09-12T17:18:34.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.854+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=QPVL2P7GRY8F type=del 2024-09-12T17:18:34.856 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.854+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=K126TB74QUXP type=del size=305821 2024-09-12T17:18:34.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.854+0000 7f96641d38c0 1 < canceled part key=_multipart_G7CWVD9C2H2J.2~Q4BCZB2ZASCG.0 size=1048576 2024-09-12T17:18:34.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.858+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~Q4BCZB2ZASCG.1 size=1048576 2024-09-12T17:18:34.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.858+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~Q4BCZB2ZASCG.2 size=1023503 2024-09-12T17:18:34.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.866+0000 7f96641d38c0 1 < canceled multipart upload key=G7CWVD9C2H2J upload=Q4BCZB2ZASCG tag=T93IPA4AVM7M type=write size=4169231 2024-09-12T17:18:34.872 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.870+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~K0WMZMPVRGBY.0 size=1048576 2024-09-12T17:18:34.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.874+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~K0WMZMPVRGBY.1 size=1048576 2024-09-12T17:18:34.876 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.874+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~K0WMZMPVRGBY.2 size=700051 2024-09-12T17:18:34.876 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.874+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=K0WMZMPVRGBY tag=KEKGX2QXLX5U type=write size=3845779 2024-09-12T17:18:34.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.878+0000 7f96641d38c0 1 < completed write operation key=9CBFWXFX7O3N tag=PKKHLIB91B6T type=write size=615617 2024-09-12T17:18:34.882 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.882+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=HLGBNO59048E type=write size=941561 2024-09-12T17:18:34.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.882+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=0W8A6NGG1IGQ type=del 2024-09-12T17:18:34.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.890+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~UVKINPY78EO3.0 size=79737 2024-09-12T17:18:34.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.890+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=UVKINPY78EO3 tag=B6J0P7PD2R4G type=write size=1128313 2024-09-12T17:18:34.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.890+0000 7f96641d38c0 1 < completed delete operation key=5ZZI4F92J7BO tag=ZE5G8KRBML9B type=del 2024-09-12T17:18:34.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.898+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~CD1TL7XAGT6Z.0 size=1048576 2024-09-12T17:18:34.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.898+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~CD1TL7XAGT6Z.1 size=585405 2024-09-12T17:18:34.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.898+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=CD1TL7XAGT6Z tag=EUI27MX955DB type=write size=2682557 2024-09-12T17:18:34.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.906+0000 7f96641d38c0 1 < suggested remove operation key=ZKDOIH5SH6K0 tag=0BMQ86IN9KA9 type=del 2024-09-12T17:18:34.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.910+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~334VXSEM2TDM.0 size=1048576 2024-09-12T17:18:34.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.910+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~334VXSEM2TDM.1 size=1048576 2024-09-12T17:18:34.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.914+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~334VXSEM2TDM.2 size=312603 2024-09-12T17:18:34.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.914+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=334VXSEM2TDM tag=61X73Q07B90A type=write size=3458331 2024-09-12T17:18:34.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.918+0000 7f96641d38c0 1 < completed write operation key=MOQXP4AXMTCK tag=MYS2V8WJ3V64 type=write size=53992 2024-09-12T17:18:34.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.918+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=REOSTBSHRBIP type=del size=1203382 2024-09-12T17:18:34.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.922+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=XEPZ12IAYQEF type=del 2024-09-12T17:18:34.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.926+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=R5YFJ2EIHGXX type=write size=881868 2024-09-12T17:18:34.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.926+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=0VZR1QZZ9RY9 type=del 2024-09-12T17:18:34.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.934+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~FTFI158B3ZVG.0 size=1048576 2024-09-12T17:18:34.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.934+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~FTFI158B3ZVG.1 size=55001 2024-09-12T17:18:34.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.934+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=FTFI158B3ZVG tag=96TF8V556T9V type=write size=2152153 2024-09-12T17:18:34.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.934+0000 7f96641d38c0 1 < canceled part key=_multipart_KXJYJ9VX7YVW.2~KE7XBBF0Y3JU.0 size=457079 2024-09-12T17:18:34.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.938+0000 7f96641d38c0 1 < canceled multipart upload key=KXJYJ9VX7YVW upload=KE7XBBF0Y3JU tag=54RU8JKPRMU6 type=write size=1505655 2024-09-12T17:18:34.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.946+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~0M067FUBP1V3.0 size=1048576 2024-09-12T17:18:34.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.946+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~0M067FUBP1V3.1 size=1048576 2024-09-12T17:18:34.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.950+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~0M067FUBP1V3.2 size=785667 2024-09-12T17:18:34.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.950+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=0M067FUBP1V3 tag=SS69C0H3XZR4 type=write size=3931395 2024-09-12T17:18:34.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.950+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=X3SZRKA0Y6S8 type=del 2024-09-12T17:18:34.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.954+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=T1H70FPW82EE type=write size=1030713 2024-09-12T17:18:34.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.954+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~XKTDMQIAYSRR.0 size=1048576 2024-09-12T17:18:34.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.958+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~XKTDMQIAYSRR.1 size=1048576 2024-09-12T17:18:34.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.962+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~XKTDMQIAYSRR.2 size=861247 2024-09-12T17:18:34.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.966+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=XKTDMQIAYSRR tag=DS3169OJSYZL type=write size=4006975 2024-09-12T17:18:34.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.970+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=XUU01J52NMTB type=del size=2391269 2024-09-12T17:18:34.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.974+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=LG8PNAR3ADQ6 type=del 2024-09-12T17:18:34.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.974+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=M2S91S3KFFJ7 type=del size=3070674 2024-09-12T17:18:34.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.978+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~MXA7WKQP3449.0 size=1048576 2024-09-12T17:18:34.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.978+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~MXA7WKQP3449.1 size=1048576 2024-09-12T17:18:34.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.978+0000 7f96641d38c0 1 < canceled part key=_multipart_L9HUVE5A5NGT.2~MXA7WKQP3449.2 size=223561 2024-09-12T17:18:34.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.982+0000 7f96641d38c0 1 < canceled multipart upload key=L9HUVE5A5NGT upload=MXA7WKQP3449 tag=20EUQKHHF1BG type=write size=3369289 2024-09-12T17:18:34.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.986+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=Q936FU3E0Y6G type=write size=541076 2024-09-12T17:18:34.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.990+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=O4DFQIXAPRKD type=del 2024-09-12T17:18:34.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.994+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~ARRNEPMXSBS0.0 size=1048576 2024-09-12T17:18:34.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.994+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~ARRNEPMXSBS0.1 size=830046 2024-09-12T17:18:34.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.994+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=ARRNEPMXSBS0 tag=ER1S961WOW7Y type=write size=2927198 2024-09-12T17:18:34.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:34.998+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=RSP09L8UDJ33 type=del 2024-09-12T17:18:35.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.002+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=G6DX0HZ19D1L type=write size=756829 2024-09-12T17:18:35.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.002+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=K126TB74QUXP type=del 2024-09-12T17:18:35.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.006+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=4FOJO9DH3HE3 type=del size=3711734 2024-09-12T17:18:35.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.010+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~K0WMZMPVRGBY.0 size=1048576 2024-09-12T17:18:35.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.010+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~K0WMZMPVRGBY.1 size=1048576 2024-09-12T17:18:35.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.014+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~K0WMZMPVRGBY.2 size=700051 2024-09-12T17:18:35.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.018+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=K0WMZMPVRGBY tag=KEKGX2QXLX5U type=write size=3845779 2024-09-12T17:18:35.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.022+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=A2ODOPAWGPEN type=del size=3315045 2024-09-12T17:18:35.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.022+0000 7f96641d38c0 1 < completed write operation key=LK3F25OHR7AO tag=HLGBNO59048E type=write size=941561 2024-09-12T17:18:35.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.026+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=VZL61YSR5V8M type=del size=379230 2024-09-12T17:18:35.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.030+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~UVKINPY78EO3.0 size=79737 2024-09-12T17:18:35.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.034+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=UVKINPY78EO3 tag=B6J0P7PD2R4G type=write size=1128313 2024-09-12T17:18:35.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.038+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=WB70NZXCVL67 type=del size=881195 2024-09-12T17:18:35.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.038+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~CD1TL7XAGT6Z.0 size=1048576 2024-09-12T17:18:35.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.038+0000 7f96641d38c0 1 < canceled part key=_multipart_6BH7SI911MMP.2~CD1TL7XAGT6Z.1 size=585405 2024-09-12T17:18:35.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.046+0000 7f96641d38c0 1 < canceled multipart upload key=6BH7SI911MMP upload=CD1TL7XAGT6Z tag=EUI27MX955DB type=write size=2682557 2024-09-12T17:18:35.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.050+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~2INVM7LAA98S.0 size=718751 2024-09-12T17:18:35.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.050+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=2INVM7LAA98S tag=WHTI52D0E3EK type=write size=1767327 2024-09-12T17:18:35.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.054+0000 7f96641d38c0 1 < canceled part key=_multipart_ZKDOIH5SH6K0.2~334VXSEM2TDM.0 size=1048576 2024-09-12T17:18:35.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.054+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~334VXSEM2TDM.1 size=1048576 2024-09-12T17:18:35.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.058+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~334VXSEM2TDM.2 size=312603 2024-09-12T17:18:35.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.062+0000 7f96641d38c0 1 < canceled multipart upload key=ZKDOIH5SH6K0 upload=334VXSEM2TDM tag=61X73Q07B90A type=write size=3458331 2024-09-12T17:18:35.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.062+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=JBICMMUEDW54 type=del size=2340070 2024-09-12T17:18:35.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.066+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=REOSTBSHRBIP type=del 2024-09-12T17:18:35.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.070+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=TNJBMS6UGQ5O type=del size=1638929 2024-09-12T17:18:35.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.074+0000 7f96641d38c0 1 < completed write operation key=XTVZIXTEES2O tag=R5YFJ2EIHGXX type=write size=881868 2024-09-12T17:18:35.078 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.078+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=L1QISM6FKAMF type=del size=1869981 2024-09-12T17:18:35.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.078+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~FTFI158B3ZVG.0 size=1048576 2024-09-12T17:18:35.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.082+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~FTFI158B3ZVG.1 size=55001 2024-09-12T17:18:35.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.086+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=FTFI158B3ZVG tag=96TF8V556T9V type=write size=2152153 2024-09-12T17:18:35.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.090+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=43U3G0TE5P2C type=del size=961226 2024-09-12T17:18:35.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.090+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~0M067FUBP1V3.0 size=1048576 2024-09-12T17:18:35.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.094+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~0M067FUBP1V3.1 size=1048576 2024-09-12T17:18:35.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.094+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~0M067FUBP1V3.2 size=785667 2024-09-12T17:18:35.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.102+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=0M067FUBP1V3 tag=SS69C0H3XZR4 type=write size=3931395 2024-09-12T17:18:35.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.106+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~SR56AKHYWC2R.0 size=1048576 2024-09-12T17:18:35.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.110+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~SR56AKHYWC2R.1 size=894075 2024-09-12T17:18:35.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.110+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=SR56AKHYWC2R tag=F73QB6DQ0I6P type=write size=2991227 2024-09-12T17:18:35.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.110+0000 7f96641d38c0 1 < completed write operation key=BDI9YFZCT5YY tag=T1H70FPW82EE type=write size=1030713 2024-09-12T17:18:35.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.118+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~X2D43FSXU0HJ.0 size=707183 2024-09-12T17:18:35.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.118+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=X2D43FSXU0HJ tag=FLZHO5524VNE type=write size=1755759 2024-09-12T17:18:35.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.122+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=XUU01J52NMTB type=del 2024-09-12T17:18:35.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.122+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=ZQLBEV46LOCY type=del size=3183710 2024-09-12T17:18:35.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.126+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=M2S91S3KFFJ7 type=del 2024-09-12T17:18:35.133 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.130+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~3C8TRH5BPZTL.0 size=1048576 2024-09-12T17:18:35.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.134+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~3C8TRH5BPZTL.1 size=1048576 2024-09-12T17:18:35.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.138+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~3C8TRH5BPZTL.2 size=518717 2024-09-12T17:18:35.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.138+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=3C8TRH5BPZTL tag=B3KGFEQL1YUF type=write size=3664445 2024-09-12T17:18:35.144 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.142+0000 7f96641d38c0 1 < suggested update operation key=3SLNHJT3A1K1 tag=Q936FU3E0Y6G type=write size=541076 2024-09-12T17:18:35.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.146+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=9Q1TSG7YATF5 type=del size=3541936 2024-09-12T17:18:35.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.150+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~ARRNEPMXSBS0.0 size=1048576 2024-09-12T17:18:35.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.150+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~ARRNEPMXSBS0.1 size=830046 2024-09-12T17:18:35.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.154+0000 7f96641d38c0 1 < completed multipart upload key=3SLNHJT3A1K1 upload=ARRNEPMXSBS0 tag=ER1S961WOW7Y type=write size=2927198 2024-09-12T17:18:35.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.158+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=7EJI3SBSDU0C type=del size=2501826 2024-09-12T17:18:35.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.162+0000 7f96641d38c0 1 < completed write operation key=G7CWVD9C2H2J tag=G6DX0HZ19D1L type=write size=756829 2024-09-12T17:18:35.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.166+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~LDTDHP6RTHS1.0 size=1048576 2024-09-12T17:18:35.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.170+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~LDTDHP6RTHS1.1 size=1029851 2024-09-12T17:18:35.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.170+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=LDTDHP6RTHS1 tag=NBJYWDC6YRQG type=write size=3127003 2024-09-12T17:18:35.173 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.170+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=4FOJO9DH3HE3 type=del 2024-09-12T17:18:35.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.174+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=82AP6RLAKXVL type=del size=3530197 2024-09-12T17:18:35.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.182+0000 7f96641d38c0 1 < suggested remove operation key=6BH7SI911MMP tag=A2ODOPAWGPEN type=del 2024-09-12T17:18:35.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.182+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=83PZ93G64V1Q type=del size=350114 2024-09-12T17:18:35.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.190+0000 7f96641d38c0 1 < suggested remove operation key=H3J23KLT1VUT tag=VZL61YSR5V8M type=del 2024-09-12T17:18:35.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.194+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=RPTGJ024HJM0 type=del size=2741866 2024-09-12T17:18:35.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.194+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=WB70NZXCVL67 type=del 2024-09-12T17:18:35.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.198+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=D2DKM2QIS020 type=del size=1493783 2024-09-12T17:18:35.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.198+0000 7f96641d38c0 1 < canceled part key=_multipart_NR82RUK97NQA.2~2INVM7LAA98S.0 size=718751 2024-09-12T17:18:35.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.202+0000 7f96641d38c0 1 < canceled multipart upload key=NR82RUK97NQA upload=2INVM7LAA98S tag=WHTI52D0E3EK type=write size=1767327 2024-09-12T17:18:35.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.206+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=MKD1ASUBF4S7 type=del size=1622012 2024-09-12T17:18:35.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.206+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=JBICMMUEDW54 type=del 2024-09-12T17:18:35.212 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.210+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=HHW0ERFJNZ2P type=write size=772183 2024-09-12T17:18:35.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.214+0000 7f96641d38c0 1 < suggested update operation key=RSVQJS9F1FR7 tag=TNJBMS6UGQ5O type=del size=1638929 2024-09-12T17:18:35.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.222+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~2VMD7KOMMT6S.0 size=614714 2024-09-12T17:18:35.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.222+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=2VMD7KOMMT6S tag=LYZJ1M5MYAJ9 type=write size=1663290 2024-09-12T17:18:35.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.222+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=L1QISM6FKAMF type=del 2024-09-12T17:18:35.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.230+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~LXAJ030R2UAU.0 size=1048576 2024-09-12T17:18:35.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.234+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~LXAJ030R2UAU.1 size=128149 2024-09-12T17:18:35.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.234+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=LXAJ030R2UAU tag=4W692JLF6U9W type=write size=2225301 2024-09-12T17:18:35.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.238+0000 7f96641d38c0 -1 < failed to complete operation key=3SLNHJT3A1K1 tag=43U3G0TE5P2C type=del size=961226: (22) Invalid argument 2024-09-12T17:18:35.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.238+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=7K4CIS4YY1X1 type=del size=2865994 2024-09-12T17:18:35.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.242+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~SR56AKHYWC2R.0 size=1048576 2024-09-12T17:18:35.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.242+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~SR56AKHYWC2R.1 size=894075 2024-09-12T17:18:35.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.250+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=SR56AKHYWC2R tag=F73QB6DQ0I6P type=write size=2991227 2024-09-12T17:18:35.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.250+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=PT6VMLM7UPZ5 type=del size=3127817 2024-09-12T17:18:35.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.254+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~X2D43FSXU0HJ.0 size=707183 2024-09-12T17:18:35.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.258+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=X2D43FSXU0HJ tag=FLZHO5524VNE type=write size=1755759 2024-09-12T17:18:35.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.262+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=QE3ZLQZFTHBB type=del size=3957757 2024-09-12T17:18:35.270 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.270+0000 7f96641d38c0 1 < suggested update operation key=ZKDOIH5SH6K0 tag=ZQLBEV46LOCY type=del size=3183710 2024-09-12T17:18:35.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.274+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~B6NMQBPXLVLJ.0 size=1048576 2024-09-12T17:18:35.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.274+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~B6NMQBPXLVLJ.1 size=622686 2024-09-12T17:18:35.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.274+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=B6NMQBPXLVLJ tag=P6SBT2PBCKGK type=write size=2719838 2024-09-12T17:18:35.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.278+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~3C8TRH5BPZTL.0 size=1048576 2024-09-12T17:18:35.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.282+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~3C8TRH5BPZTL.1 size=1048576 2024-09-12T17:18:35.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.282+0000 7f96641d38c0 1 < canceled part key=_multipart_GKJJDBNXC6QH.2~3C8TRH5BPZTL.2 size=518717 2024-09-12T17:18:35.288 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.286+0000 7f96641d38c0 1 < canceled multipart upload key=GKJJDBNXC6QH upload=3C8TRH5BPZTL tag=B3KGFEQL1YUF type=write size=3664445 2024-09-12T17:18:35.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.290+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~HNA1LVUER3GW.0 size=1048576 2024-09-12T17:18:35.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.294+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~HNA1LVUER3GW.1 size=550375 2024-09-12T17:18:35.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.294+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=HNA1LVUER3GW tag=70UWWJLBLFMF type=write size=2647527 2024-09-12T17:18:35.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.294+0000 7f96641d38c0 -1 < no bi entry to suggest for operation key=H3J23KLT1VUT tag=9Q1TSG7YATF5 type=del size=3541936: (2) No such file or directory 2024-09-12T17:18:35.299 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.298+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=K0SICUUR5ISC type=del size=4176600 2024-09-12T17:18:35.301 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.298+0000 7f96641d38c0 -1 < failed to complete operation key=RSVQJS9F1FR7 tag=7EJI3SBSDU0C type=del size=2501826: (22) Invalid argument 2024-09-12T17:18:35.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.302+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=D08YJBKP9VM4 type=write size=66254 2024-09-12T17:18:35.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.306+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~LDTDHP6RTHS1.0 size=1048576 2024-09-12T17:18:35.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.306+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~LDTDHP6RTHS1.1 size=1029851 2024-09-12T17:18:35.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.314+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=LDTDHP6RTHS1 tag=NBJYWDC6YRQG type=write size=3127003 2024-09-12T17:18:35.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.318+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=MFDYBG0IOHKN type=del size=3380961 2024-09-12T17:18:35.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.318+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=82AP6RLAKXVL type=del 2024-09-12T17:18:35.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.326+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~R88HX0ODGLR0.0 size=1048576 2024-09-12T17:18:35.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.326+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~R88HX0ODGLR0.1 size=28020 2024-09-12T17:18:35.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.326+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=R88HX0ODGLR0 tag=J7U9NQF84HJF type=write size=2125172 2024-09-12T17:18:35.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.334+0000 7f96641d38c0 1 < suggested update operation key=DHODPSZ7Z0D4 tag=83PZ93G64V1Q type=del size=350114 2024-09-12T17:18:35.337 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.334+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=N5KF4ENNTP47 type=del size=3228384 2024-09-12T17:18:35.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.342+0000 7f96641d38c0 1 < suggested update operation key=BDI9YFZCT5YY tag=RPTGJ024HJM0 type=del size=2741866 2024-09-12T17:18:35.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.346+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~5YJG3C2AMZ7T.0 size=1048576 2024-09-12T17:18:35.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.350+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~5YJG3C2AMZ7T.1 size=1048576 2024-09-12T17:18:35.353 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.350+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~5YJG3C2AMZ7T.2 size=998266 2024-09-12T17:18:35.353 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.350+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=5YJG3C2AMZ7T tag=Q7H5891LAB0Z type=write size=4143994 2024-09-12T17:18:35.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.354+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=D2DKM2QIS020 type=del 2024-09-12T17:18:35.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.358+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=VG4JEDHO062D type=del size=2776660 2024-09-12T17:18:35.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.358+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=MKD1ASUBF4S7 type=del 2024-09-12T17:18:35.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.362+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=S8S3GTZSPW7R type=del size=2942237 2024-09-12T17:18:35.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.366+0000 7f96641d38c0 1 < completed write operation key=UBYUSW4C2V19 tag=HHW0ERFJNZ2P type=write size=772183 2024-09-12T17:18:35.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.370+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~O6J55F7QE9KI.0 size=942854 2024-09-12T17:18:35.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.370+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=O6J55F7QE9KI tag=TSK8Y4NHDE3C type=write size=1991430 2024-09-12T17:18:35.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.374+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~2VMD7KOMMT6S.0 size=614714 2024-09-12T17:18:35.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.378+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=2VMD7KOMMT6S tag=LYZJ1M5MYAJ9 type=write size=1663290 2024-09-12T17:18:35.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.378+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=R6TK7MO09OLP type=write size=480584 2024-09-12T17:18:35.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.382+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~LXAJ030R2UAU.0 size=1048576 2024-09-12T17:18:35.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.382+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~LXAJ030R2UAU.1 size=128149 2024-09-12T17:18:35.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.390+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=LXAJ030R2UAU tag=4W692JLF6U9W type=write size=2225301 2024-09-12T17:18:35.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.390+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=5ZE0OYKJOSUW type=del size=2001908 2024-09-12T17:18:35.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.394+0000 7f96641d38c0 1 < suggested update operation key=NGA3P9RZJYWT tag=7K4CIS4YY1X1 type=del size=2865994 2024-09-12T17:18:35.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.398+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=U6X8GL0771XU type=del size=683216 2024-09-12T17:18:35.402 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.402+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=PT6VMLM7UPZ5 type=del 2024-09-12T17:18:35.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.402+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=TCLCYAA5LY1L type=write size=538872 2024-09-12T17:18:35.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.406+0000 7f96641d38c0 1 < canceled operation key=KXJYJ9VX7YVW tag=QE3ZLQZFTHBB type=del size=3957757 2024-09-12T17:18:35.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.410+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~P6QTBLI803OS.0 size=1048576 2024-09-12T17:18:35.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.414+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~P6QTBLI803OS.1 size=648159 2024-09-12T17:18:35.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.414+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=P6QTBLI803OS tag=E8B329SOZ4LI type=write size=2745311 2024-09-12T17:18:35.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.418+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~B6NMQBPXLVLJ.0 size=1048576 2024-09-12T17:18:35.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.418+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~B6NMQBPXLVLJ.1 size=622686 2024-09-12T17:18:35.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.422+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=B6NMQBPXLVLJ tag=P6SBT2PBCKGK type=write size=2719838 2024-09-12T17:18:35.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.430+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~1U6NZCRSJVUP.0 size=1048576 2024-09-12T17:18:35.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.430+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~1U6NZCRSJVUP.1 size=360050 2024-09-12T17:18:35.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.430+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=1U6NZCRSJVUP tag=MZ43MBVNOCOZ type=write size=2457202 2024-09-12T17:18:35.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.430+0000 7f96641d38c0 1 < canceled part key=_multipart_3SLNHJT3A1K1.2~HNA1LVUER3GW.0 size=1048576 2024-09-12T17:18:35.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.434+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~HNA1LVUER3GW.1 size=550375 2024-09-12T17:18:35.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.438+0000 7f96641d38c0 1 < canceled multipart upload key=3SLNHJT3A1K1 upload=HNA1LVUER3GW tag=70UWWJLBLFMF type=write size=2647527 2024-09-12T17:18:35.442 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.442+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=UTQ8MHKOCEEN type=del size=3248460 2024-09-12T17:18:35.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.442+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=K0SICUUR5ISC type=del 2024-09-12T17:18:35.449 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.446+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~CQEG82FGHBST.0 size=1048576 2024-09-12T17:18:35.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.450+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~CQEG82FGHBST.1 size=830375 2024-09-12T17:18:35.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.450+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=CQEG82FGHBST tag=Q0JYXAZ2GQU0 type=write size=2927527 2024-09-12T17:18:35.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.454+0000 7f96641d38c0 1 < completed write operation key=H3LV5G117KOW tag=D08YJBKP9VM4 type=write size=66254 2024-09-12T17:18:35.458 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.458+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~V4EWO8M3VZ4T.0 size=1048576 2024-09-12T17:18:35.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.458+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~V4EWO8M3VZ4T.1 size=1048576 2024-09-12T17:18:35.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.462+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~V4EWO8M3VZ4T.2 size=194480 2024-09-12T17:18:35.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.462+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=V4EWO8M3VZ4T tag=L7UTAFDVH2H9 type=write size=3340208 2024-09-12T17:18:35.465 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.462+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=MFDYBG0IOHKN type=del 2024-09-12T17:18:35.468 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.466+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=HZFUP4A3H9R2 type=del size=2709672 2024-09-12T17:18:35.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.470+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~R88HX0ODGLR0.0 size=1048576 2024-09-12T17:18:35.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.470+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~R88HX0ODGLR0.1 size=28020 2024-09-12T17:18:35.479 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.478+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=R88HX0ODGLR0 tag=J7U9NQF84HJF type=write size=2125172 2024-09-12T17:18:35.484 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.482+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~ZQW2GEESUGDH.0 size=1048576 2024-09-12T17:18:35.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.482+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~ZQW2GEESUGDH.1 size=633459 2024-09-12T17:18:35.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.482+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=ZQW2GEESUGDH tag=FHW39N6TNOD8 type=write size=2730611 2024-09-12T17:18:35.489 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.486+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=N5KF4ENNTP47 type=del 2024-09-12T17:18:35.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.494+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=0I6U2MAKSD9B type=write size=387533 2024-09-12T17:18:35.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.494+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~5YJG3C2AMZ7T.0 size=1048576 2024-09-12T17:18:35.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.494+0000 7f96641d38c0 1 < canceled part key=_multipart_UBYUSW4C2V19.2~5YJG3C2AMZ7T.1 size=1048576 2024-09-12T17:18:35.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.498+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~5YJG3C2AMZ7T.2 size=998266 2024-09-12T17:18:35.505 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.502+0000 7f96641d38c0 1 < canceled multipart upload key=UBYUSW4C2V19 upload=5YJG3C2AMZ7T tag=Q7H5891LAB0Z type=write size=4143994 2024-09-12T17:18:35.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.510+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~4NMG6Y4N1DG3.0 size=14140 2024-09-12T17:18:35.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.510+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=4NMG6Y4N1DG3 tag=6272J2RQ8FF3 type=write size=1062716 2024-09-12T17:18:35.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.510+0000 7f96641d38c0 1 < canceled operation key=3SLNHJT3A1K1 tag=VG4JEDHO062D type=del size=2776660 2024-09-12T17:18:35.518 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.518+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~3BILRRRDNLJK.0 size=1048576 2024-09-12T17:18:35.520 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.518+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~3BILRRRDNLJK.1 size=1048576 2024-09-12T17:18:35.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.522+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~3BILRRRDNLJK.2 size=663381 2024-09-12T17:18:35.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.522+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=3BILRRRDNLJK tag=6BH9S1XFS1AD type=write size=3809109 2024-09-12T17:18:35.525 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.522+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=S8S3GTZSPW7R type=del 2024-09-12T17:18:35.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.526+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~VY35DNMNHAXU.0 size=1048576 2024-09-12T17:18:35.531 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.530+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~VY35DNMNHAXU.1 size=704418 2024-09-12T17:18:35.531 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.530+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=VY35DNMNHAXU tag=HUCUS03LZQJ2 type=write size=2801570 2024-09-12T17:18:35.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.534+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~O6J55F7QE9KI.0 size=942854 2024-09-12T17:18:35.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.538+0000 7f96641d38c0 1 < completed multipart upload key=2TN3M8NKV9LN upload=O6J55F7QE9KI tag=TSK8Y4NHDE3C type=write size=1991430 2024-09-12T17:18:35.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.542+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=FFYOROQOPNZ7 type=del size=3019211 2024-09-12T17:18:35.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.542+0000 7f96641d38c0 1 < completed write operation key=G7CWVD9C2H2J tag=R6TK7MO09OLP type=write size=480584 2024-09-12T17:18:35.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.546+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=SQ6PZUPQYQHJ type=del size=1280762 2024-09-12T17:18:35.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.554+0000 7f96641d38c0 1 < suggested update operation key=H3LV5G117KOW tag=5ZE0OYKJOSUW type=del size=2001908 2024-09-12T17:18:35.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.558+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~T1PXFNVLHHHY.0 size=1043424 2024-09-12T17:18:35.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.558+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=T1PXFNVLHHHY tag=GS083AOK281T type=write size=2092000 2024-09-12T17:18:35.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.562+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=U6X8GL0771XU type=del 2024-09-12T17:18:35.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.566+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=OZVFU4QEBZRP type=write size=314830 2024-09-12T17:18:35.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.566+0000 7f96641d38c0 1 < canceled operation key=RSVQJS9F1FR7 tag=TCLCYAA5LY1L type=write size=538872 2024-09-12T17:18:35.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.570+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=EYPO3FXOQSPK type=write size=242201 2024-09-12T17:18:35.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.570+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~P6QTBLI803OS.0 size=1048576 2024-09-12T17:18:35.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.574+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~P6QTBLI803OS.1 size=648159 2024-09-12T17:18:35.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.578+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=P6QTBLI803OS tag=E8B329SOZ4LI type=write size=2745311 2024-09-12T17:18:35.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.582+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~BDADLTUTGBQ1.0 size=1048576 2024-09-12T17:18:35.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.586+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~BDADLTUTGBQ1.1 size=238176 2024-09-12T17:18:35.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.586+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=BDADLTUTGBQ1 tag=S7LJ0OQ6L630 type=write size=2335328 2024-09-12T17:18:35.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.590+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~1U6NZCRSJVUP.0 size=1048576 2024-09-12T17:18:35.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.590+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~1U6NZCRSJVUP.1 size=360050 2024-09-12T17:18:35.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.594+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=1U6NZCRSJVUP tag=MZ43MBVNOCOZ type=write size=2457202 2024-09-12T17:18:35.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.598+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=BC8PAIV67EDD type=del size=1445852 2024-09-12T17:18:35.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.602+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=UTQ8MHKOCEEN type=del 2024-09-12T17:18:35.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.602+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=PCAE8HJKP4I5 type=del size=4134183 2024-09-12T17:18:35.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.606+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~CQEG82FGHBST.0 size=1048576 2024-09-12T17:18:35.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.606+0000 7f96641d38c0 1 < canceled part key=_multipart_LK3F25OHR7AO.2~CQEG82FGHBST.1 size=830375 2024-09-12T17:18:35.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.610+0000 7f96641d38c0 1 < canceled multipart upload key=LK3F25OHR7AO upload=CQEG82FGHBST tag=Q0JYXAZ2GQU0 type=write size=2927527 2024-09-12T17:18:35.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.614+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~LJS86SUU0G62.0 size=1048576 2024-09-12T17:18:35.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.618+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~LJS86SUU0G62.1 size=1048576 2024-09-12T17:18:35.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.618+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~LJS86SUU0G62.2 size=149335 2024-09-12T17:18:35.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.618+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=LJS86SUU0G62 tag=A0IDWBW6MTGE type=write size=3295063 2024-09-12T17:18:35.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.622+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~V4EWO8M3VZ4T.0 size=1048576 2024-09-12T17:18:35.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.622+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~V4EWO8M3VZ4T.1 size=1048576 2024-09-12T17:18:35.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.622+0000 7f96641d38c0 1 < canceled part key=_multipart_XTVZIXTEES2O.2~V4EWO8M3VZ4T.2 size=194480 2024-09-12T17:18:35.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.630+0000 7f96641d38c0 1 < canceled multipart upload key=XTVZIXTEES2O upload=V4EWO8M3VZ4T tag=L7UTAFDVH2H9 type=write size=3340208 2024-09-12T17:18:35.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.634+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~63X38N23HLQL.0 size=110089 2024-09-12T17:18:35.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.634+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=63X38N23HLQL tag=T2WT9DIX89E9 type=write size=1158665 2024-09-12T17:18:35.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.634+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=HZFUP4A3H9R2 type=del 2024-09-12T17:18:35.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.638+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~VZ38N6U76E2H.0 size=1048576 2024-09-12T17:18:35.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.642+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~VZ38N6U76E2H.1 size=663515 2024-09-12T17:18:35.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.642+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=VZ38N6U76E2H tag=UR1HMDVVAMJR type=write size=2760667 2024-09-12T17:18:35.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.642+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~ZQW2GEESUGDH.0 size=1048576 2024-09-12T17:18:35.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.642+0000 7f96641d38c0 1 < canceled part key=_multipart_GKJJDBNXC6QH.2~ZQW2GEESUGDH.1 size=633459 2024-09-12T17:18:35.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.646+0000 7f96641d38c0 1 < canceled multipart upload key=GKJJDBNXC6QH upload=ZQW2GEESUGDH tag=FHW39N6TNOD8 type=write size=2730611 2024-09-12T17:18:35.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.650+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=UAS7ZGSQ9918 type=del size=1313936 2024-09-12T17:18:35.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.654+0000 7f96641d38c0 1 < completed write operation key=LK3F25OHR7AO tag=0I6U2MAKSD9B type=write size=387533 2024-09-12T17:18:35.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.658+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~G3TPULW5Y1FX.0 size=347293 2024-09-12T17:18:35.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.658+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=G3TPULW5Y1FX tag=AGXJMOXJN5BN type=write size=1395869 2024-09-12T17:18:35.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.662+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~4NMG6Y4N1DG3.0 size=14140 2024-09-12T17:18:35.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.670+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=4NMG6Y4N1DG3 tag=6272J2RQ8FF3 type=write size=1062716 2024-09-12T17:18:35.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.674+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=P20E858J8W06 type=del size=3672917 2024-09-12T17:18:35.675 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.674+0000 7f96641d38c0 1 < canceled part key=_multipart_NGA3P9RZJYWT.2~3BILRRRDNLJK.0 size=1048576 2024-09-12T17:18:35.678 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.678+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~3BILRRRDNLJK.1 size=1048576 2024-09-12T17:18:35.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.678+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~3BILRRRDNLJK.2 size=663381 2024-09-12T17:18:35.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.686+0000 7f96641d38c0 1 < canceled multipart upload key=NGA3P9RZJYWT upload=3BILRRRDNLJK tag=6BH9S1XFS1AD type=write size=3809109 2024-09-12T17:18:35.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.690+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=NB2Q8O1GMPHO type=write size=170610 2024-09-12T17:18:35.694 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.690+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~VY35DNMNHAXU.0 size=1048576 2024-09-12T17:18:35.694 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.690+0000 7f96641d38c0 1 < canceled part key=_multipart_DHODPSZ7Z0D4.2~VY35DNMNHAXU.1 size=704418 2024-09-12T17:18:35.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.698+0000 7f96641d38c0 1 < canceled multipart upload key=DHODPSZ7Z0D4 upload=VY35DNMNHAXU tag=HUCUS03LZQJ2 type=write size=2801570 2024-09-12T17:18:35.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.702+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~IAR3Z6JLPR57.0 size=963921 2024-09-12T17:18:35.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.702+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=IAR3Z6JLPR57 tag=RT7NZFNUSSQT type=write size=2012497 2024-09-12T17:18:35.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.706+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=FFYOROQOPNZ7 type=del 2024-09-12T17:18:35.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.710+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=2MY58YWZP2UJ type=del size=360717 2024-09-12T17:18:35.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.710+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=SQ6PZUPQYQHJ type=del 2024-09-12T17:18:35.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.714+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=8CSD32Y6LO2E type=del size=2463530 2024-09-12T17:18:35.720 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.718+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~T1PXFNVLHHHY.0 size=1043424 2024-09-12T17:18:35.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.722+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=T1PXFNVLHHHY tag=GS083AOK281T type=write size=2092000 2024-09-12T17:18:35.728 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.726+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=GIEHQU34EMFY type=write size=518277 2024-09-12T17:18:35.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.730+0000 7f96641d38c0 1 < completed write operation key=IR9JQ4MAEH0P tag=OZVFU4QEBZRP type=write size=314830 2024-09-12T17:18:35.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.730+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=ZLC38J0110WJ type=del size=1911341 2024-09-12T17:18:35.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.734+0000 7f96641d38c0 1 < completed write operation key=XTVZIXTEES2O tag=EYPO3FXOQSPK type=write size=242201 2024-09-12T17:18:35.744 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.742+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~745O2LMY86R3.0 size=1048576 2024-09-12T17:18:35.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.746+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~745O2LMY86R3.1 size=480016 2024-09-12T17:18:35.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.746+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=745O2LMY86R3 tag=32KGQP258R5T type=write size=2577168 2024-09-12T17:18:35.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.746+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~BDADLTUTGBQ1.0 size=1048576 2024-09-12T17:18:35.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.750+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~BDADLTUTGBQ1.1 size=238176 2024-09-12T17:18:35.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.754+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=BDADLTUTGBQ1 tag=S7LJ0OQ6L630 type=write size=2335328 2024-09-12T17:18:35.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.762+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=E8F8O6AB8KLL type=del size=50319 2024-09-12T17:18:35.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.766+0000 7f96641d38c0 1 < suggested remove operation key=KXJYJ9VX7YVW tag=BC8PAIV67EDD type=del 2024-09-12T17:18:35.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.770+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~C3MYW3VF4YYN.0 size=1048576 2024-09-12T17:18:35.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.774+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~C3MYW3VF4YYN.1 size=301522 2024-09-12T17:18:35.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.774+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=C3MYW3VF4YYN tag=TURRJ03NOA74 type=write size=2398674 2024-09-12T17:18:35.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.778+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=PCAE8HJKP4I5 type=del 2024-09-12T17:18:35.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.778+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=6XEPN0IH984B type=del size=1558109 2024-09-12T17:18:35.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.782+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~LJS86SUU0G62.0 size=1048576 2024-09-12T17:18:35.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.786+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~LJS86SUU0G62.1 size=1048576 2024-09-12T17:18:35.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.786+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~LJS86SUU0G62.2 size=149335 2024-09-12T17:18:35.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.794+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=LJS86SUU0G62 tag=A0IDWBW6MTGE type=write size=3295063 2024-09-12T17:18:35.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.794+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=L5HN9XT6QFZ1 type=del size=3354204 2024-09-12T17:18:35.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.798+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~63X38N23HLQL.0 size=110089 2024-09-12T17:18:35.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.806+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=63X38N23HLQL tag=T2WT9DIX89E9 type=write size=1158665 2024-09-12T17:18:35.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.806+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=1MWX31DIF386 type=del size=3908791 2024-09-12T17:18:35.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.810+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~VZ38N6U76E2H.0 size=1048576 2024-09-12T17:18:35.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.814+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~VZ38N6U76E2H.1 size=663515 2024-09-12T17:18:35.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.818+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=VZ38N6U76E2H tag=UR1HMDVVAMJR type=write size=2760667 2024-09-12T17:18:35.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.822+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=C54AGQ9QA03I type=write size=888520 2024-09-12T17:18:35.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.826+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=UAS7ZGSQ9918 type=del 2024-09-12T17:18:35.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.826+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=ZQR4WLNZAZWD type=del size=3929500 2024-09-12T17:18:35.832 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.830+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~G3TPULW5Y1FX.0 size=347293 2024-09-12T17:18:35.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.834+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=G3TPULW5Y1FX tag=AGXJMOXJN5BN type=write size=1395869 2024-09-12T17:18:35.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.838+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~OCDZ8IKMRT6R.0 size=466578 2024-09-12T17:18:35.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.838+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=OCDZ8IKMRT6R tag=P4RI2JCQOBJ1 type=write size=1515154 2024-09-12T17:18:35.844 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.842+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=P20E858J8W06 type=del 2024-09-12T17:18:35.848 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.846+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=LWT573NCL3Q1 type=del size=75849 2024-09-12T17:18:35.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.850+0000 7f96641d38c0 1 < completed write operation key=LK3F25OHR7AO tag=NB2Q8O1GMPHO type=write size=170610 2024-09-12T17:18:35.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.850+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=VFWLOXWY1THC type=write size=326944 2024-09-12T17:18:35.856 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.854+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~IAR3Z6JLPR57.0 size=963921 2024-09-12T17:18:35.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.858+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=IAR3Z6JLPR57 tag=RT7NZFNUSSQT type=write size=2012497 2024-09-12T17:18:35.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.862+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=TM7CJW8GZE8D type=del size=318225 2024-09-12T17:18:35.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.866+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=2MY58YWZP2UJ type=del 2024-09-12T17:18:35.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.870+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=A9TKY7K2LJGA type=del size=3409204 2024-09-12T17:18:35.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.874+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=8CSD32Y6LO2E type=del 2024-09-12T17:18:35.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.874+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=2XZGDLZB0SYP type=del size=2904228 2024-09-12T17:18:35.881 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.878+0000 7f96641d38c0 1 < completed write operation key=G7CWVD9C2H2J tag=GIEHQU34EMFY type=write size=518277 2024-09-12T17:18:35.883 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.882+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=6JIX46O01WXC type=del size=3862828 2024-09-12T17:18:35.886 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.886+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=ZLC38J0110WJ type=del 2024-09-12T17:18:35.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.890+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~CORSX5MQBX9M.0 size=1048576 2024-09-12T17:18:35.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.894+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~CORSX5MQBX9M.1 size=1048576 2024-09-12T17:18:35.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.894+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~CORSX5MQBX9M.2 size=994399 2024-09-12T17:18:35.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.894+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=CORSX5MQBX9M tag=P2I86H087CWP type=write size=4140127 2024-09-12T17:18:35.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.898+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~745O2LMY86R3.0 size=1048576 2024-09-12T17:18:35.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.902+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~745O2LMY86R3.1 size=480016 2024-09-12T17:18:35.907 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.906+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=745O2LMY86R3 tag=32KGQP258R5T type=write size=2577168 2024-09-12T17:18:35.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.910+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=E3GXXVMO1RNN type=del size=2221224 2024-09-12T17:18:35.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.914+0000 7f96641d38c0 1 < suggested remove operation key=47QQRTJKM4DB tag=E8F8O6AB8KLL type=del 2024-09-12T17:18:35.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.918+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=5U8O23HWYKVK type=del size=3657052 2024-09-12T17:18:35.922 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.922+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~C3MYW3VF4YYN.0 size=1048576 2024-09-12T17:18:35.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.922+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~C3MYW3VF4YYN.1 size=301522 2024-09-12T17:18:35.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.926+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=C3MYW3VF4YYN tag=TURRJ03NOA74 type=write size=2398674 2024-09-12T17:18:35.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.930+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=25RLBBV0HKXQ type=del size=804905 2024-09-12T17:18:35.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.934+0000 7f96641d38c0 1 < canceled operation key=KXJYJ9VX7YVW tag=6XEPN0IH984B type=del size=1558109 2024-09-12T17:18:35.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.938+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~5US4EK7TK931.0 size=202778 2024-09-12T17:18:35.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.938+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=5US4EK7TK931 tag=5RG3L6QXV92J type=write size=1251354 2024-09-12T17:18:35.944 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.942+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=L5HN9XT6QFZ1 type=del 2024-09-12T17:18:35.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.946+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~DZBHF4BC2LKT.0 size=1048576 2024-09-12T17:18:35.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.950+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~DZBHF4BC2LKT.1 size=28473 2024-09-12T17:18:35.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.950+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=DZBHF4BC2LKT tag=6PJ0I5WHJ0QK type=write size=2125625 2024-09-12T17:18:35.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.954+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=1MWX31DIF386 type=del 2024-09-12T17:18:35.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.958+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~U0G08Y3R49HK.0 size=1048576 2024-09-12T17:18:35.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.962+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~U0G08Y3R49HK.1 size=918802 2024-09-12T17:18:35.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.962+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=U0G08Y3R49HK tag=ZRQV9DS5HSGY type=write size=3015954 2024-09-12T17:18:35.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.962+0000 7f96641d38c0 1 < completed write operation key=DHODPSZ7Z0D4 tag=C54AGQ9QA03I type=write size=888520 2024-09-12T17:18:35.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.970+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~FCBBNKGJJFF0.0 size=1048576 2024-09-12T17:18:35.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.970+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~FCBBNKGJJFF0.1 size=215894 2024-09-12T17:18:35.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.970+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=FCBBNKGJJFF0 tag=0DM6W9M9DLFR type=write size=2313046 2024-09-12T17:18:35.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.974+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=ZQR4WLNZAZWD type=del 2024-09-12T17:18:35.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.978+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=92OM1QOHD026 type=write size=927310 2024-09-12T17:18:35.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.982+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~OCDZ8IKMRT6R.0 size=466578 2024-09-12T17:18:35.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.986+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=OCDZ8IKMRT6R tag=P4RI2JCQOBJ1 type=write size=1515154 2024-09-12T17:18:35.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.990+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=8CK8UB29O94X type=del size=3568300 2024-09-12T17:18:35.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.994+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=LWT573NCL3Q1 type=del 2024-09-12T17:18:35.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:35.998+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=OEWBHBCUW5YP type=write size=841698 2024-09-12T17:18:36.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.002+0000 7f96641d38c0 1 < suggested update operation key=G7CWVD9C2H2J tag=VFWLOXWY1THC type=write size=326944 2024-09-12T17:18:36.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.006+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=BOCJ9W59EVFO type=del size=758236 2024-09-12T17:18:36.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.010+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=TM7CJW8GZE8D type=del 2024-09-12T17:18:36.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.014+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=3NXQ41TA53JG type=del size=1722339 2024-09-12T17:18:36.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.018+0000 7f96641d38c0 1 < suggested update operation key=XDL9O7TEMBYF tag=A9TKY7K2LJGA type=del size=3409204 2024-09-12T17:18:36.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.022+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=7GAGJ2Q8VNCC type=write size=536998 2024-09-12T17:18:36.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.026+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=2XZGDLZB0SYP type=del 2024-09-12T17:18:36.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.026+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=EADA3GOLAS73 type=del size=2158483 2024-09-12T17:18:36.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.030+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=6JIX46O01WXC type=del 2024-09-12T17:18:36.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.038+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~M5RLAVUD5HEI.0 size=713594 2024-09-12T17:18:36.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.038+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=M5RLAVUD5HEI tag=MO0PG6S25N90 type=write size=1762170 2024-09-12T17:18:36.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.038+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~CORSX5MQBX9M.0 size=1048576 2024-09-12T17:18:36.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.042+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~CORSX5MQBX9M.1 size=1048576 2024-09-12T17:18:36.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.046+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~CORSX5MQBX9M.2 size=994399 2024-09-12T17:18:36.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.054+0000 7f96641d38c0 1 < completed multipart upload key=2TN3M8NKV9LN upload=CORSX5MQBX9M tag=P2I86H087CWP type=write size=4140127 2024-09-12T17:18:36.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.054+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=JSUOQ79VCDYT type=del size=2595416 2024-09-12T17:18:36.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.058+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=E3GXXVMO1RNN type=del 2024-09-12T17:18:36.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.062+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=LDHFS293D8J3 type=del size=1616352 2024-09-12T17:18:36.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.066+0000 7f96641d38c0 1 < suggested remove operation key=IR9JQ4MAEH0P tag=5U8O23HWYKVK type=del 2024-09-12T17:18:36.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.070+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=XQG4MO6T6AB9 type=del size=2939643 2024-09-12T17:18:36.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.074+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=25RLBBV0HKXQ type=del 2024-09-12T17:18:36.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.078+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=ENMVIWBCG3WV type=del size=3326269 2024-09-12T17:18:36.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.082+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~5US4EK7TK931.0 size=202778 2024-09-12T17:18:36.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.086+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=5US4EK7TK931 tag=5RG3L6QXV92J type=write size=1251354 2024-09-12T17:18:36.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.094+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~B02WB1X8STHI.0 size=1048576 2024-09-12T17:18:36.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.094+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~B02WB1X8STHI.1 size=1048576 2024-09-12T17:18:36.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.098+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~B02WB1X8STHI.2 size=1010185 2024-09-12T17:18:36.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.098+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=B02WB1X8STHI tag=99C1LT5MWI94 type=write size=4155913 2024-09-12T17:18:36.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.102+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~DZBHF4BC2LKT.0 size=1048576 2024-09-12T17:18:36.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.102+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~DZBHF4BC2LKT.1 size=28473 2024-09-12T17:18:36.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.106+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=DZBHF4BC2LKT tag=6PJ0I5WHJ0QK type=write size=2125625 2024-09-12T17:18:36.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.110+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=2YMF0BDWCYSX type=del size=1520556 2024-09-12T17:18:36.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.114+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~U0G08Y3R49HK.0 size=1048576 2024-09-12T17:18:36.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.114+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~U0G08Y3R49HK.1 size=918802 2024-09-12T17:18:36.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.118+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=U0G08Y3R49HK tag=ZRQV9DS5HSGY type=write size=3015954 2024-09-12T17:18:36.124 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.122+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=6AC7H0ZX8RYR type=write size=150057 2024-09-12T17:18:36.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.126+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~FCBBNKGJJFF0.0 size=1048576 2024-09-12T17:18:36.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.126+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~FCBBNKGJJFF0.1 size=215894 2024-09-12T17:18:36.133 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.130+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=FCBBNKGJJFF0 tag=0DM6W9M9DLFR type=write size=2313046 2024-09-12T17:18:36.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.134+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=WH1DSY65QUCC type=del size=3600154 2024-09-12T17:18:36.139 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.138+0000 7f96641d38c0 1 < canceled operation key=MOQXP4AXMTCK tag=92OM1QOHD026 type=write size=927310 2024-09-12T17:18:36.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.142+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=2YFBYBWNV0EL type=del size=598302 2024-09-12T17:18:36.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.142+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=8CK8UB29O94X type=del 2024-09-12T17:18:36.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.146+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=F8ZN78P1XP4N type=write size=1035215 2024-09-12T17:18:36.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.150+0000 7f96641d38c0 1 < suggested update operation key=NR82RUK97NQA tag=OEWBHBCUW5YP type=write size=841698 2024-09-12T17:18:36.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.158+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~QFPMSNRODEK9.0 size=762154 2024-09-12T17:18:36.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.158+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=QFPMSNRODEK9 tag=1I4ZSMFAFEN1 type=write size=1810730 2024-09-12T17:18:36.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.158+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=BOCJ9W59EVFO type=del 2024-09-12T17:18:36.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.162+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=YP56FIGY34CD type=write size=379146 2024-09-12T17:18:36.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.166+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=3NXQ41TA53JG type=del 2024-09-12T17:18:36.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.166+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=DLZAZLQ165LC type=del size=1263125 2024-09-12T17:18:36.172 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.170+0000 7f96641d38c0 1 < completed write operation key=37YXLWPZGA9J tag=7GAGJ2Q8VNCC type=write size=536998 2024-09-12T17:18:36.174 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.174+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=E1TK3DEHFPQ9 type=del size=1026233 2024-09-12T17:18:36.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.178+0000 7f96641d38c0 1 < suggested update operation key=GKJJDBNXC6QH tag=EADA3GOLAS73 type=del size=2158483 2024-09-12T17:18:36.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.182+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~OU19XKKC3I6O.0 size=1048576 2024-09-12T17:18:36.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.186+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~OU19XKKC3I6O.1 size=1048576 2024-09-12T17:18:36.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.186+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~OU19XKKC3I6O.2 size=498510 2024-09-12T17:18:36.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.186+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=OU19XKKC3I6O tag=Y5WHM2PPRE9W type=write size=3644238 2024-09-12T17:18:36.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.190+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~M5RLAVUD5HEI.0 size=713594 2024-09-12T17:18:36.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.194+0000 7f96641d38c0 1 < completed multipart upload key=47QQRTJKM4DB upload=M5RLAVUD5HEI tag=MO0PG6S25N90 type=write size=1762170 2024-09-12T17:18:36.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.198+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=CN8ND67U92V2 type=del size=2731364 2024-09-12T17:18:36.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.198+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=JSUOQ79VCDYT type=del 2024-09-12T17:18:36.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.202+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=I0KYJ1UIQ4AA type=del size=3007878 2024-09-12T17:18:36.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.206+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=LDHFS293D8J3 type=del 2024-09-12T17:18:36.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.206+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=R1RBNIKUY9PC type=del size=1164988 2024-09-12T17:18:36.214 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.214+0000 7f96641d38c0 1 < suggested update operation key=GKJJDBNXC6QH tag=XQG4MO6T6AB9 type=del size=2939643 2024-09-12T17:18:36.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.218+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~GYUZ9D7FR8YK.0 size=1048576 2024-09-12T17:18:36.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.218+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~GYUZ9D7FR8YK.1 size=1048576 2024-09-12T17:18:36.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.222+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~GYUZ9D7FR8YK.2 size=300846 2024-09-12T17:18:36.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.222+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=GYUZ9D7FR8YK tag=YVP19ITKYADT type=write size=3446574 2024-09-12T17:18:36.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.226+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=ENMVIWBCG3WV type=del 2024-09-12T17:18:36.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.226+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=M82UXBRF99FX type=del size=4020764 2024-09-12T17:18:36.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.230+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~B02WB1X8STHI.0 size=1048576 2024-09-12T17:18:36.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.230+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~B02WB1X8STHI.1 size=1048576 2024-09-12T17:18:36.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.230+0000 7f96641d38c0 1 < canceled part key=_multipart_0X2HHMHJUJNL.2~B02WB1X8STHI.2 size=1010185 2024-09-12T17:18:36.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.234+0000 7f96641d38c0 1 < canceled multipart upload key=0X2HHMHJUJNL upload=B02WB1X8STHI tag=99C1LT5MWI94 type=write size=4155913 2024-09-12T17:18:36.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.242+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~X1VL509VMDTC.0 size=1048576 2024-09-12T17:18:36.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.242+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~X1VL509VMDTC.1 size=1048576 2024-09-12T17:18:36.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.242+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~X1VL509VMDTC.2 size=616325 2024-09-12T17:18:36.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.242+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=X1VL509VMDTC tag=0HJ2K9QFIV5J type=write size=3762053 2024-09-12T17:18:36.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.246+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=2YMF0BDWCYSX type=del 2024-09-12T17:18:36.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.250+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=F2NO0ZPLOBRZ type=del size=3954074 2024-09-12T17:18:36.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.250+0000 7f96641d38c0 1 < completed write operation key=2TN3M8NKV9LN tag=6AC7H0ZX8RYR type=write size=150057 2024-09-12T17:18:36.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.254+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=LUWXU52K1R1R type=write size=757337 2024-09-12T17:18:36.259 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.258+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=WH1DSY65QUCC type=del 2024-09-12T17:18:36.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.262+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=HN73V9YC8QXF type=write size=340602 2024-09-12T17:18:36.268 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.266+0000 7f96641d38c0 1 < suggested update operation key=XTVZIXTEES2O tag=2YFBYBWNV0EL type=del size=598302 2024-09-12T17:18:36.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.270+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=VM3WQE92BP3P type=del size=1206094 2024-09-12T17:18:36.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.274+0000 7f96641d38c0 -1 < failed to complete operation key=NR82RUK97NQA tag=F8ZN78P1XP4N type=write size=1035215: (22) Invalid argument 2024-09-12T17:18:36.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.278+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=06CNKVYZMWVH type=del size=820542 2024-09-12T17:18:36.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.278+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~QFPMSNRODEK9.0 size=762154 2024-09-12T17:18:36.286 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.286+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=QFPMSNRODEK9 tag=1I4ZSMFAFEN1 type=write size=1810730 2024-09-12T17:18:36.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.286+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=GV169DJQVK29 type=write size=298046 2024-09-12T17:18:36.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.290+0000 7f96641d38c0 1 < completed write operation key=6BH7SI911MMP tag=YP56FIGY34CD type=write size=379146 2024-09-12T17:18:36.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.294+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=VMF59TVFA5EH type=del size=909413 2024-09-12T17:18:36.297 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.294+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=DLZAZLQ165LC type=del 2024-09-12T17:18:36.300 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.298+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=3VXZ0AWO39R4 type=del size=3349992 2024-09-12T17:18:36.302 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.302+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=E1TK3DEHFPQ9 type=del 2024-09-12T17:18:36.305 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.302+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=3DAB803DPWL2 type=del size=1748671 2024-09-12T17:18:36.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.306+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~OU19XKKC3I6O.0 size=1048576 2024-09-12T17:18:36.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.310+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~OU19XKKC3I6O.1 size=1048576 2024-09-12T17:18:36.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.314+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~OU19XKKC3I6O.2 size=498510 2024-09-12T17:18:36.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.318+0000 7f96641d38c0 1 < completed multipart upload key=XDL9O7TEMBYF upload=OU19XKKC3I6O tag=Y5WHM2PPRE9W type=write size=3644238 2024-09-12T17:18:36.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.322+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~YEILKOCI25RE.0 size=1048576 2024-09-12T17:18:36.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.322+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~YEILKOCI25RE.1 size=1048576 2024-09-12T17:18:36.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.326+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~YEILKOCI25RE.2 size=465129 2024-09-12T17:18:36.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.326+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=YEILKOCI25RE tag=6C6UHBL4EM4O type=write size=3610857 2024-09-12T17:18:36.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.326+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=CN8ND67U92V2 type=del 2024-09-12T17:18:36.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.330+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~1QV89MA186TF.0 size=1048576 2024-09-12T17:18:36.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.334+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~1QV89MA186TF.1 size=1048576 2024-09-12T17:18:36.337 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.334+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~1QV89MA186TF.2 size=459396 2024-09-12T17:18:36.337 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.334+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=1QV89MA186TF tag=8582DTGKLV4W type=write size=3605124 2024-09-12T17:18:36.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.338+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=I0KYJ1UIQ4AA type=del 2024-09-12T17:18:36.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.342+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=PDNZAKGMD05I type=del size=2757642 2024-09-12T17:18:36.345 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.342+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=R1RBNIKUY9PC type=del 2024-09-12T17:18:36.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.346+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=WVTRVK6PSFNO type=del size=1433881 2024-09-12T17:18:36.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.350+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~GYUZ9D7FR8YK.0 size=1048576 2024-09-12T17:18:36.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.350+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~GYUZ9D7FR8YK.1 size=1048576 2024-09-12T17:18:36.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.354+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~GYUZ9D7FR8YK.2 size=300846 2024-09-12T17:18:36.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.358+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=GYUZ9D7FR8YK tag=YVP19ITKYADT type=write size=3446574 2024-09-12T17:18:36.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.362+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~Q5XJFN2SEJ89.0 size=1048576 2024-09-12T17:18:36.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.366+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~Q5XJFN2SEJ89.1 size=476732 2024-09-12T17:18:36.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.366+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=Q5XJFN2SEJ89 tag=WKY6LM0Q9VNV type=write size=2573884 2024-09-12T17:18:36.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.366+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=M82UXBRF99FX type=del 2024-09-12T17:18:36.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.374+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~2EWISXS5L6J9.0 size=556035 2024-09-12T17:18:36.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.374+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=2EWISXS5L6J9 tag=P4NJLGIWOO5N type=write size=1604611 2024-09-12T17:18:36.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.374+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~X1VL509VMDTC.0 size=1048576 2024-09-12T17:18:36.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.378+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~X1VL509VMDTC.1 size=1048576 2024-09-12T17:18:36.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.382+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~X1VL509VMDTC.2 size=616325 2024-09-12T17:18:36.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.386+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=X1VL509VMDTC tag=0HJ2K9QFIV5J type=write size=3762053 2024-09-12T17:18:36.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.394+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~4WZI92QJTOCI.0 size=1048576 2024-09-12T17:18:36.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.394+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~4WZI92QJTOCI.1 size=1048576 2024-09-12T17:18:36.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.398+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~4WZI92QJTOCI.2 size=585239 2024-09-12T17:18:36.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.398+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=4WZI92QJTOCI tag=6ET51HVG08M5 type=write size=3730967 2024-09-12T17:18:36.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.406+0000 7f96641d38c0 1 < suggested update operation key=W40P2E1H5VT9 tag=F2NO0ZPLOBRZ type=del size=3954074 2024-09-12T17:18:36.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.410+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~K5S3XFC2LB5V.0 size=1048576 2024-09-12T17:18:36.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.410+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~K5S3XFC2LB5V.1 size=1048576 2024-09-12T17:18:36.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.414+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~K5S3XFC2LB5V.2 size=716140 2024-09-12T17:18:36.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.414+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=K5S3XFC2LB5V tag=0053J3FYXUCC type=write size=3861868 2024-09-12T17:18:36.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.418+0000 7f96641d38c0 1 < completed write operation key=L9HUVE5A5NGT tag=LUWXU52K1R1R type=write size=757337 2024-09-12T17:18:36.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.422+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~GQWAOBFX8X8O.0 size=1048576 2024-09-12T17:18:36.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.426+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~GQWAOBFX8X8O.1 size=920646 2024-09-12T17:18:36.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.426+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=GQWAOBFX8X8O tag=D8GNUJ61VYJ8 type=write size=3017798 2024-09-12T17:18:36.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.426+0000 7f96641d38c0 1 < completed write operation key=ZKDOIH5SH6K0 tag=HN73V9YC8QXF type=write size=340602 2024-09-12T17:18:36.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.434+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~GE1GCBIQFSPW.0 size=934175 2024-09-12T17:18:36.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.434+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=GE1GCBIQFSPW tag=2996XIEPG3YD type=write size=1982751 2024-09-12T17:18:36.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.434+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=VM3WQE92BP3P type=del 2024-09-12T17:18:36.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.438+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=Z2FV6EKA1UUU type=write size=905995 2024-09-12T17:18:36.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.442+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=06CNKVYZMWVH type=del 2024-09-12T17:18:36.446 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.446+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=9F7ULKTR38XB type=del size=14011 2024-09-12T17:18:36.449 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.446+0000 7f96641d38c0 1 < canceled operation key=HRU241T0FUEZ tag=GV169DJQVK29 type=write size=298046 2024-09-12T17:18:36.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.450+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=34LON40MM3WQ type=del size=1371092 2024-09-12T17:18:36.456 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.454+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=VMF59TVFA5EH type=del 2024-09-12T17:18:36.458 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.458+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=8RBMFX00TN08 type=del size=2294972 2024-09-12T17:18:36.465 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.462+0000 7f96641d38c0 1 < suggested remove operation key=W40P2E1H5VT9 tag=3VXZ0AWO39R4 type=del 2024-09-12T17:18:36.470 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.470+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~UZN713BQLMDI.0 size=1048576 2024-09-12T17:18:36.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.470+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~UZN713BQLMDI.1 size=1048576 2024-09-12T17:18:36.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.474+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~UZN713BQLMDI.2 size=715283 2024-09-12T17:18:36.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.474+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=UZN713BQLMDI tag=5IU3U21P01VC type=write size=3861011 2024-09-12T17:18:36.481 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.478+0000 7f96641d38c0 1 < suggested remove operation key=3H8R2MJGR4SY tag=3DAB803DPWL2 type=del 2024-09-12T17:18:36.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.486+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~66JOC2KSG5E4.0 size=1048576 2024-09-12T17:18:36.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.490+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~66JOC2KSG5E4.1 size=1048576 2024-09-12T17:18:36.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.490+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~66JOC2KSG5E4.2 size=576362 2024-09-12T17:18:36.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.490+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=66JOC2KSG5E4 tag=B2BOA0TAOVB7 type=write size=3722090 2024-09-12T17:18:36.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.494+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~YEILKOCI25RE.0 size=1048576 2024-09-12T17:18:36.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.498+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~YEILKOCI25RE.1 size=1048576 2024-09-12T17:18:36.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.498+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~YEILKOCI25RE.2 size=465129 2024-09-12T17:18:36.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.506+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=YEILKOCI25RE tag=6C6UHBL4EM4O type=write size=3610857 2024-09-12T17:18:36.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.510+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=SHJRP7ODQB8X type=del size=3363193 2024-09-12T17:18:36.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.510+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~1QV89MA186TF.0 size=1048576 2024-09-12T17:18:36.516 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.514+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~1QV89MA186TF.1 size=1048576 2024-09-12T17:18:36.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.518+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~1QV89MA186TF.2 size=459396 2024-09-12T17:18:36.524 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.522+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=1QV89MA186TF tag=8582DTGKLV4W type=write size=3605124 2024-09-12T17:18:36.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.530+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~AOSJD9Z6A1G2.0 size=1048576 2024-09-12T17:18:36.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.530+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~AOSJD9Z6A1G2.1 size=176340 2024-09-12T17:18:36.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.530+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=AOSJD9Z6A1G2 tag=8VGX1Q3K55I6 type=write size=2273492 2024-09-12T17:18:36.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.534+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=PDNZAKGMD05I type=del 2024-09-12T17:18:36.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.538+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=Q1FE8VUENQDK type=write size=227516 2024-09-12T17:18:36.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.542+0000 7f96641d38c0 -1 < failed to complete operation key=W40P2E1H5VT9 tag=WVTRVK6PSFNO type=del size=1433881: (22) Invalid argument 2024-09-12T17:18:36.545 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.542+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=DJ4XJJDU5450 type=del size=1264146 2024-09-12T17:18:36.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.546+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~Q5XJFN2SEJ89.0 size=1048576 2024-09-12T17:18:36.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.546+0000 7f96641d38c0 1 < canceled part key=_multipart_UBYUSW4C2V19.2~Q5XJFN2SEJ89.1 size=476732 2024-09-12T17:18:36.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.550+0000 7f96641d38c0 1 < canceled multipart upload key=UBYUSW4C2V19 upload=Q5XJFN2SEJ89 tag=WKY6LM0Q9VNV type=write size=2573884 2024-09-12T17:18:36.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.558+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~3BOJPAJ08DCC.0 size=1048576 2024-09-12T17:18:36.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.558+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~3BOJPAJ08DCC.1 size=702822 2024-09-12T17:18:36.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.558+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=3BOJPAJ08DCC tag=80SOMSIHCBJV type=write size=2799974 2024-09-12T17:18:36.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.562+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~2EWISXS5L6J9.0 size=556035 2024-09-12T17:18:36.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.566+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=2EWISXS5L6J9 tag=P4NJLGIWOO5N type=write size=1604611 2024-09-12T17:18:36.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.570+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~WTDSRI7JX1VX.0 size=1048576 2024-09-12T17:18:36.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.574+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~WTDSRI7JX1VX.1 size=1048576 2024-09-12T17:18:36.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.574+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~WTDSRI7JX1VX.2 size=965822 2024-09-12T17:18:36.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.574+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=WTDSRI7JX1VX tag=0PETXT2H25HP type=write size=4111550 2024-09-12T17:18:36.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.582+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~4WZI92QJTOCI.0 size=1048576 2024-09-12T17:18:36.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.582+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~4WZI92QJTOCI.1 size=1048576 2024-09-12T17:18:36.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.586+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~4WZI92QJTOCI.2 size=585239 2024-09-12T17:18:36.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.590+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=4WZI92QJTOCI tag=6ET51HVG08M5 type=write size=3730967 2024-09-12T17:18:36.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.598+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~USDMFHTLZOT1.0 size=1048576 2024-09-12T17:18:36.601 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.598+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~USDMFHTLZOT1.1 size=129048 2024-09-12T17:18:36.601 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.598+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=USDMFHTLZOT1 tag=OXIVIYAVL59H type=write size=2226200 2024-09-12T17:18:36.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.602+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~K5S3XFC2LB5V.0 size=1048576 2024-09-12T17:18:36.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.606+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~K5S3XFC2LB5V.1 size=1048576 2024-09-12T17:18:36.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.606+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~K5S3XFC2LB5V.2 size=716140 2024-09-12T17:18:36.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.614+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=K5S3XFC2LB5V tag=0053J3FYXUCC type=write size=3861868 2024-09-12T17:18:36.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.618+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~AM1FMTXQC30F.0 size=1048576 2024-09-12T17:18:36.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.622+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~AM1FMTXQC30F.1 size=1048576 2024-09-12T17:18:36.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.622+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~AM1FMTXQC30F.2 size=94784 2024-09-12T17:18:36.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.622+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=AM1FMTXQC30F tag=QJB98ZV8OGZI type=write size=3240512 2024-09-12T17:18:36.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.626+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~GQWAOBFX8X8O.0 size=1048576 2024-09-12T17:18:36.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.626+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~GQWAOBFX8X8O.1 size=920646 2024-09-12T17:18:36.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.634+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=GQWAOBFX8X8O tag=D8GNUJ61VYJ8 type=write size=3017798 2024-09-12T17:18:36.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.634+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=UDKJLKHIDES5 type=write size=598042 2024-09-12T17:18:36.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.638+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~GE1GCBIQFSPW.0 size=934175 2024-09-12T17:18:36.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.642+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=GE1GCBIQFSPW tag=2996XIEPG3YD type=write size=1982751 2024-09-12T17:18:36.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.646+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~J9WRXYRD6MUU.0 size=1048576 2024-09-12T17:18:36.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.650+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~J9WRXYRD6MUU.1 size=450628 2024-09-12T17:18:36.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.650+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=J9WRXYRD6MUU tag=V9GH9XV8CMOA type=write size=2547780 2024-09-12T17:18:36.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.654+0000 7f96641d38c0 1 < suggested remove operation key=ZKDOIH5SH6K0 tag=Z2FV6EKA1UUU type=write 2024-09-12T17:18:36.658 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.658+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=LUUWK221X6J9 type=write size=568339 2024-09-12T17:18:36.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.658+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=9F7ULKTR38XB type=del 2024-09-12T17:18:36.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.662+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=J0JVDUYJACL6 type=del size=1709515 2024-09-12T17:18:36.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.666+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=34LON40MM3WQ type=del 2024-09-12T17:18:36.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.666+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=FJHRXUGEBO09 type=write size=130162 2024-09-12T17:18:36.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.670+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=8RBMFX00TN08 type=del 2024-09-12T17:18:36.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.674+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=HRP96GN63JQN type=del size=3277027 2024-09-12T17:18:36.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.674+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~UZN713BQLMDI.0 size=1048576 2024-09-12T17:18:36.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.678+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~UZN713BQLMDI.1 size=1048576 2024-09-12T17:18:36.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.682+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~UZN713BQLMDI.2 size=715283 2024-09-12T17:18:36.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.686+0000 7f96641d38c0 1 < completed multipart upload key=37YXLWPZGA9J upload=UZN713BQLMDI tag=5IU3U21P01VC type=write size=3861011 2024-09-12T17:18:36.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.690+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=XWPG1L7P5R7X type=del size=2419861 2024-09-12T17:18:36.693 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.690+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~66JOC2KSG5E4.0 size=1048576 2024-09-12T17:18:36.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.694+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~66JOC2KSG5E4.1 size=1048576 2024-09-12T17:18:36.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.698+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~66JOC2KSG5E4.2 size=576362 2024-09-12T17:18:36.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.702+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=66JOC2KSG5E4 tag=B2BOA0TAOVB7 type=write size=3722090 2024-09-12T17:18:36.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.706+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=ZRP3AW06ZM3B type=del size=2121570 2024-09-12T17:18:36.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.710+0000 7f96641d38c0 -1 < failed to complete operation key=ZKDOIH5SH6K0 tag=SHJRP7ODQB8X type=del size=3363193: (22) Invalid argument 2024-09-12T17:18:36.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.710+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=UN52ZHM5OZ27 type=write size=906081 2024-09-12T17:18:36.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.714+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~AOSJD9Z6A1G2.0 size=1048576 2024-09-12T17:18:36.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.718+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~AOSJD9Z6A1G2.1 size=176340 2024-09-12T17:18:36.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.722+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=AOSJD9Z6A1G2 tag=8VGX1Q3K55I6 type=write size=2273492 2024-09-12T17:18:36.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.730+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~W3GGQPA3KY99.0 size=1048576 2024-09-12T17:18:36.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.730+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~W3GGQPA3KY99.1 size=162334 2024-09-12T17:18:36.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.730+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=W3GGQPA3KY99 tag=HVBATHS383WR type=write size=2259486 2024-09-12T17:18:36.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.734+0000 7f96641d38c0 1 < completed write operation key=UBYUSW4C2V19 tag=Q1FE8VUENQDK type=write size=227516 2024-09-12T17:18:36.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.738+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=0L49FZ2L6UPL type=del size=3321900 2024-09-12T17:18:36.744 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.742+0000 7f96641d38c0 1 < suggested update operation key=NG327LT02T1F tag=DJ4XJJDU5450 type=del size=1264146 2024-09-12T17:18:36.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.746+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=LTAXDZH3JXH8 type=del size=2454819 2024-09-12T17:18:36.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.750+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~3BOJPAJ08DCC.0 size=1048576 2024-09-12T17:18:36.753 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.750+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~3BOJPAJ08DCC.1 size=702822 2024-09-12T17:18:36.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.754+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=3BOJPAJ08DCC tag=80SOMSIHCBJV type=write size=2799974 2024-09-12T17:18:36.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.762+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~H89CG8H4H0HA.0 size=613921 2024-09-12T17:18:36.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.762+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=H89CG8H4H0HA tag=I0JZXV6JOFQP type=write size=1662497 2024-09-12T17:18:36.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.766+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~WTDSRI7JX1VX.0 size=1048576 2024-09-12T17:18:36.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.766+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~WTDSRI7JX1VX.1 size=1048576 2024-09-12T17:18:36.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.770+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~WTDSRI7JX1VX.2 size=965822 2024-09-12T17:18:36.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.774+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=WTDSRI7JX1VX tag=0PETXT2H25HP type=write size=4111550 2024-09-12T17:18:36.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.778+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=JWG8NIOOTSBR type=del size=1979516 2024-09-12T17:18:36.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.778+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~USDMFHTLZOT1.0 size=1048576 2024-09-12T17:18:36.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.782+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~USDMFHTLZOT1.1 size=129048 2024-09-12T17:18:36.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.786+0000 7f96641d38c0 1 < completed multipart upload key=2TN3M8NKV9LN upload=USDMFHTLZOT1 tag=OXIVIYAVL59H type=write size=2226200 2024-09-12T17:18:36.793 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.790+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=C8LAEEKNQO5K type=del size=107072 2024-09-12T17:18:36.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.794+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~AM1FMTXQC30F.0 size=1048576 2024-09-12T17:18:36.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.798+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~AM1FMTXQC30F.1 size=1048576 2024-09-12T17:18:36.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.798+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~AM1FMTXQC30F.2 size=94784 2024-09-12T17:18:36.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.806+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=AM1FMTXQC30F tag=QJB98ZV8OGZI type=write size=3240512 2024-09-12T17:18:36.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.806+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=C10Z6MC4B598 type=del size=451035 2024-09-12T17:18:36.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.810+0000 7f96641d38c0 1 < completed write operation key=8TU2VZOHL1ZZ tag=UDKJLKHIDES5 type=write size=598042 2024-09-12T17:18:36.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.814+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=OWCX4MQOL8IJ type=del size=1779273 2024-09-12T17:18:36.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.818+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~J9WRXYRD6MUU.0 size=1048576 2024-09-12T17:18:36.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.822+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~J9WRXYRD6MUU.1 size=450628 2024-09-12T17:18:36.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.826+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=J9WRXYRD6MUU tag=V9GH9XV8CMOA type=write size=2547780 2024-09-12T17:18:36.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.830+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=T5RYKMD7VB9A type=del size=3008671 2024-09-12T17:18:36.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.834+0000 7f96641d38c0 1 < completed write operation key=3SLNHJT3A1K1 tag=LUUWK221X6J9 type=write size=568339 2024-09-12T17:18:36.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.834+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=1ZWRYIMYLGQC type=del size=416812 2024-09-12T17:18:36.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.838+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=J0JVDUYJACL6 type=del 2024-09-12T17:18:36.844 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.842+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=2YVPAY8CK3UK type=del size=1989174 2024-09-12T17:18:36.850 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.850+0000 7f96641d38c0 1 < suggested remove operation key=UBYUSW4C2V19 tag=FJHRXUGEBO09 type=write 2024-09-12T17:18:36.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.854+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=LGDJZPGZP3SP type=del size=2815872 2024-09-12T17:18:36.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.858+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=HRP96GN63JQN type=del 2024-09-12T17:18:36.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.866+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~0R16BKL9CFKJ.0 size=1048576 2024-09-12T17:18:36.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.866+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~0R16BKL9CFKJ.1 size=1048576 2024-09-12T17:18:36.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.870+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~0R16BKL9CFKJ.2 size=662888 2024-09-12T17:18:36.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.870+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=0R16BKL9CFKJ tag=U1HCLXYEUP8D type=write size=3808616 2024-09-12T17:18:36.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.874+0000 7f96641d38c0 -1 < failed to complete operation key=NG327LT02T1F tag=XWPG1L7P5R7X type=del size=2419861: (22) Invalid argument 2024-09-12T17:18:36.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.878+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=QTQR0QXDEQVU type=del size=470299 2024-09-12T17:18:36.882 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.882+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=ZRP3AW06ZM3B type=del 2024-09-12T17:18:36.886 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.882+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=UKL8G9J1AYCG type=del size=3814216 2024-09-12T17:18:36.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.886+0000 7f96641d38c0 1 < canceled operation key=RSVQJS9F1FR7 tag=UN52ZHM5OZ27 type=write size=906081 2024-09-12T17:18:36.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.890+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=I95UZQON2SQ3 type=del size=531506 2024-09-12T17:18:36.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.894+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~W3GGQPA3KY99.0 size=1048576 2024-09-12T17:18:36.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.894+0000 7f96641d38c0 1 < canceled part key=_multipart_XTVZIXTEES2O.2~W3GGQPA3KY99.1 size=162334 2024-09-12T17:18:36.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.898+0000 7f96641d38c0 1 < canceled multipart upload key=XTVZIXTEES2O upload=W3GGQPA3KY99 tag=HVBATHS383WR type=write size=2259486 2024-09-12T17:18:36.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.902+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=JGVAECEA3KGM type=del size=1005170 2024-09-12T17:18:36.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.906+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=0L49FZ2L6UPL type=del 2024-09-12T17:18:36.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.910+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=8JRDFH3S3GRQ type=del size=823456 2024-09-12T17:18:36.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.918+0000 7f96641d38c0 1 < suggested remove operation key=NG327LT02T1F tag=LTAXDZH3JXH8 type=del 2024-09-12T17:18:36.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.918+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=TK796CT2JFGV type=del size=3051857 2024-09-12T17:18:36.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.922+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~H89CG8H4H0HA.0 size=613921 2024-09-12T17:18:36.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.930+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=H89CG8H4H0HA tag=I0JZXV6JOFQP type=write size=1662497 2024-09-12T17:18:36.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.930+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=JWCTQTAAQFPM type=del size=662794 2024-09-12T17:18:36.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.934+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=JWG8NIOOTSBR type=del 2024-09-12T17:18:36.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.938+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=02NO8JK1RG6W type=del size=1197357 2024-09-12T17:18:36.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.942+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=C8LAEEKNQO5K type=del 2024-09-12T17:18:36.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.946+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~E8N0ZCPNQ8TK.0 size=1048576 2024-09-12T17:18:36.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.950+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~E8N0ZCPNQ8TK.1 size=1048576 2024-09-12T17:18:36.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.950+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~E8N0ZCPNQ8TK.2 size=1011681 2024-09-12T17:18:36.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.950+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=E8N0ZCPNQ8TK tag=GB647T196PHG type=write size=4157409 2024-09-12T17:18:36.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.954+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=C10Z6MC4B598 type=del 2024-09-12T17:18:36.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.958+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=E0JLA7US7FU8 type=del size=980383 2024-09-12T17:18:36.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.962+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=OWCX4MQOL8IJ type=del 2024-09-12T17:18:36.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.966+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=Y72A3A4O45FY type=del size=1134637 2024-09-12T17:18:36.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.970+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=T5RYKMD7VB9A type=del 2024-09-12T17:18:36.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.970+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=BQWYE8KZ5DD1 type=del size=3815797 2024-09-12T17:18:36.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.974+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=1ZWRYIMYLGQC type=del 2024-09-12T17:18:36.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.978+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=B5WSWJ8CLECM type=del size=3779406 2024-09-12T17:18:36.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.982+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=2YVPAY8CK3UK type=del 2024-09-12T17:18:36.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.986+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=F4UWH8JP4N2G type=del size=1617723 2024-09-12T17:18:36.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.990+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=LGDJZPGZP3SP type=del 2024-09-12T17:18:36.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.994+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~8TV70EF93KGT.0 size=47866 2024-09-12T17:18:36.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.994+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=8TV70EF93KGT tag=Y6RIRVW4WBF8 type=write size=1096442 2024-09-12T17:18:36.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:36.998+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~0R16BKL9CFKJ.0 size=1048576 2024-09-12T17:18:37.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.002+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~0R16BKL9CFKJ.1 size=1048576 2024-09-12T17:18:37.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.002+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~0R16BKL9CFKJ.2 size=662888 2024-09-12T17:18:37.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.010+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=0R16BKL9CFKJ tag=U1HCLXYEUP8D type=write size=3808616 2024-09-12T17:18:37.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.014+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~O88E30UY0QJ6.0 size=1048576 2024-09-12T17:18:37.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.018+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~O88E30UY0QJ6.1 size=162034 2024-09-12T17:18:37.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.018+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=O88E30UY0QJ6 tag=H6VNF334XC33 type=write size=2259186 2024-09-12T17:18:37.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.026+0000 7f96641d38c0 1 < suggested update operation key=37YXLWPZGA9J tag=QTQR0QXDEQVU type=del size=470299 2024-09-12T17:18:37.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.030+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=DW35AV9ZEJC1 type=write size=898611 2024-09-12T17:18:37.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.034+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=UKL8G9J1AYCG type=del 2024-09-12T17:18:37.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.034+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=FT9X9SWHKM3B type=write size=772865 2024-09-12T17:18:37.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.038+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=I95UZQON2SQ3 type=del 2024-09-12T17:18:37.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.042+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=19LC14I8IOOA type=del size=623237 2024-09-12T17:18:37.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.046+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=JGVAECEA3KGM type=del 2024-09-12T17:18:37.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.050+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=XV1BZPPWTWA2 type=del size=1392745 2024-09-12T17:18:37.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.054+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=8JRDFH3S3GRQ type=del 2024-09-12T17:18:37.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.058+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~TTK3KY1AW721.0 size=240388 2024-09-12T17:18:37.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.058+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=TTK3KY1AW721 tag=NFTHJ9XYVGUH type=write size=1288964 2024-09-12T17:18:37.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.062+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=TK796CT2JFGV type=del 2024-09-12T17:18:37.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.066+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=OD35IPSDV4CR type=del size=2585059 2024-09-12T17:18:37.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.070+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=JWCTQTAAQFPM type=del 2024-09-12T17:18:37.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.078+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~S2PSI93CXNQ9.0 size=1048576 2024-09-12T17:18:37.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.082+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~S2PSI93CXNQ9.1 size=1048576 2024-09-12T17:18:37.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.082+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~S2PSI93CXNQ9.2 size=605759 2024-09-12T17:18:37.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.082+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=S2PSI93CXNQ9 tag=OOQ0QUVOHTLT type=write size=3751487 2024-09-12T17:18:37.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.090+0000 7f96641d38c0 1 < suggested remove operation key=NG327LT02T1F tag=02NO8JK1RG6W type=del 2024-09-12T17:18:37.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.094+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=5KYM8X7AA11I type=del size=183064 2024-09-12T17:18:37.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.098+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~E8N0ZCPNQ8TK.0 size=1048576 2024-09-12T17:18:37.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.098+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~E8N0ZCPNQ8TK.1 size=1048576 2024-09-12T17:18:37.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.102+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~E8N0ZCPNQ8TK.2 size=1011681 2024-09-12T17:18:37.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.106+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=E8N0ZCPNQ8TK tag=GB647T196PHG type=write size=4157409 2024-09-12T17:18:37.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.114+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~EODMNNMANOWI.0 size=1048576 2024-09-12T17:18:37.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.118+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~EODMNNMANOWI.1 size=780372 2024-09-12T17:18:37.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.118+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=EODMNNMANOWI tag=L92YG8P7YM35 type=write size=2877524 2024-09-12T17:18:37.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.118+0000 7f96641d38c0 1 < canceled operation key=MOQXP4AXMTCK tag=E0JLA7US7FU8 type=del size=980383 2024-09-12T17:18:37.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.126+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~ZIKS3GXEF4J7.0 size=1048576 2024-09-12T17:18:37.130 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.130+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~ZIKS3GXEF4J7.1 size=404863 2024-09-12T17:18:37.130 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.130+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=ZIKS3GXEF4J7 tag=HKYY95VGNBDC type=write size=2502015 2024-09-12T17:18:37.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.134+0000 7f96641d38c0 1 < suggested remove operation key=LK3F25OHR7AO tag=Y72A3A4O45FY type=del 2024-09-12T17:18:37.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.142+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~I1GX461WZ6C2.0 size=566750 2024-09-12T17:18:37.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.142+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=I1GX461WZ6C2 tag=M7U5KGUT3YP8 type=write size=1615326 2024-09-12T17:18:37.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.146+0000 7f96641d38c0 1 < suggested update operation key=BDI9YFZCT5YY tag=BQWYE8KZ5DD1 type=del size=3815797 2024-09-12T17:18:37.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.150+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=TUEF1UJ75BRQ type=del size=1455871 2024-09-12T17:18:37.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.154+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=B5WSWJ8CLECM type=del 2024-09-12T17:18:37.159 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.158+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=CX2TQ7U782FL type=del size=4002639 2024-09-12T17:18:37.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.162+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=F4UWH8JP4N2G type=del 2024-09-12T17:18:37.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.166+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~4LQSB05KQGNF.0 size=1048576 2024-09-12T17:18:37.172 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.170+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~4LQSB05KQGNF.1 size=1048576 2024-09-12T17:18:37.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.174+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~4LQSB05KQGNF.2 size=237331 2024-09-12T17:18:37.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.174+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=4LQSB05KQGNF tag=YJYCQGQW8MV6 type=write size=3383059 2024-09-12T17:18:37.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.178+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~8TV70EF93KGT.0 size=47866 2024-09-12T17:18:37.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.186+0000 7f96641d38c0 1 < completed multipart upload key=47QQRTJKM4DB upload=8TV70EF93KGT tag=Y6RIRVW4WBF8 type=write size=1096442 2024-09-12T17:18:37.190 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.190+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=X8N4HTL6MSFM type=del size=1877032 2024-09-12T17:18:37.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.190+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~O88E30UY0QJ6.0 size=1048576 2024-09-12T17:18:37.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.194+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~O88E30UY0QJ6.1 size=162034 2024-09-12T17:18:37.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.202+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=O88E30UY0QJ6 tag=H6VNF334XC33 type=write size=2259186 2024-09-12T17:18:37.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.206+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~3N6FTT9SH4JS.0 size=1048576 2024-09-12T17:18:37.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.210+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~3N6FTT9SH4JS.1 size=392054 2024-09-12T17:18:37.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.210+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=3N6FTT9SH4JS tag=M3XO289C9BB2 type=write size=2489206 2024-09-12T17:18:37.214 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.214+0000 7f96641d38c0 -1 < failed to complete operation key=BDI9YFZCT5YY tag=DW35AV9ZEJC1 type=write size=898611: (22) Invalid argument 2024-09-12T17:18:37.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.218+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~9QRNZK0XR2B0.0 size=208007 2024-09-12T17:18:37.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.218+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=9QRNZK0XR2B0 tag=0B7MJH0U37I9 type=write size=1256583 2024-09-12T17:18:37.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.222+0000 7f96641d38c0 1 < completed write operation key=2TN3M8NKV9LN tag=FT9X9SWHKM3B type=write size=772865 2024-09-12T17:18:37.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.226+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=SXGJK7QEJNUW type=del size=2103365 2024-09-12T17:18:37.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.230+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=19LC14I8IOOA type=del 2024-09-12T17:18:37.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.230+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=P06HA79TTSE4 type=del size=1047851 2024-09-12T17:18:37.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.234+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=XV1BZPPWTWA2 type=del 2024-09-12T17:18:37.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.238+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=CV7TX8JPJLOI type=del size=2690532 2024-09-12T17:18:37.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.242+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~TTK3KY1AW721.0 size=240388 2024-09-12T17:18:37.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.246+0000 7f96641d38c0 1 < completed multipart upload key=XDL9O7TEMBYF upload=TTK3KY1AW721 tag=NFTHJ9XYVGUH type=write size=1288964 2024-09-12T17:18:37.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.254+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~GQMFGNEHWRXV.0 size=1048576 2024-09-12T17:18:37.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.258+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~GQMFGNEHWRXV.1 size=1048576 2024-09-12T17:18:37.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.258+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~GQMFGNEHWRXV.2 size=925888 2024-09-12T17:18:37.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.258+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=GQMFGNEHWRXV tag=FYJFI5NFY97W type=write size=4071616 2024-09-12T17:18:37.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.262+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=OD35IPSDV4CR type=del 2024-09-12T17:18:37.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.266+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=1NOBGM015CAU type=del size=753593 2024-09-12T17:18:37.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.270+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~S2PSI93CXNQ9.0 size=1048576 2024-09-12T17:18:37.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.274+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~S2PSI93CXNQ9.1 size=1048576 2024-09-12T17:18:37.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.274+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~S2PSI93CXNQ9.2 size=605759 2024-09-12T17:18:37.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.282+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=S2PSI93CXNQ9 tag=OOQ0QUVOHTLT type=write size=3751487 2024-09-12T17:18:37.286 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.286+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=QYSGE3SZWAYE type=del size=2883 2024-09-12T17:18:37.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.286+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=5KYM8X7AA11I type=del 2024-09-12T17:18:37.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.294+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~Y2EWGF9P2A2O.0 size=1048576 2024-09-12T17:18:37.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.298+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~Y2EWGF9P2A2O.1 size=766457 2024-09-12T17:18:37.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.298+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=Y2EWGF9P2A2O tag=FDL4SRRUGFYE type=write size=2863609 2024-09-12T17:18:37.301 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.298+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~EODMNNMANOWI.0 size=1048576 2024-09-12T17:18:37.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.302+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~EODMNNMANOWI.1 size=780372 2024-09-12T17:18:37.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.310+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=EODMNNMANOWI tag=L92YG8P7YM35 type=write size=2877524 2024-09-12T17:18:37.313 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.310+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=NS2GOTUV3XWE type=del size=1800870 2024-09-12T17:18:37.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.314+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~ZIKS3GXEF4J7.0 size=1048576 2024-09-12T17:18:37.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.318+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~ZIKS3GXEF4J7.1 size=404863 2024-09-12T17:18:37.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.326+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=ZIKS3GXEF4J7 tag=HKYY95VGNBDC type=write size=2502015 2024-09-12T17:18:37.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.326+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=RF4AC793PO4K type=del size=2821058 2024-09-12T17:18:37.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.330+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~I1GX461WZ6C2.0 size=566750 2024-09-12T17:18:37.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.338+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=I1GX461WZ6C2 tag=M7U5KGUT3YP8 type=write size=1615326 2024-09-12T17:18:37.345 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.342+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~NZZ3JYEA3W7P.0 size=230475 2024-09-12T17:18:37.345 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.342+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=NZZ3JYEA3W7P tag=NKUKW4SF9WY1 type=write size=1279051 2024-09-12T17:18:37.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.350+0000 7f96641d38c0 1 < suggested remove operation key=DHODPSZ7Z0D4 tag=TUEF1UJ75BRQ type=del 2024-09-12T17:18:37.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.354+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=DKZ7BRR5K10S type=del size=3935615 2024-09-12T17:18:37.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.358+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=CX2TQ7U782FL type=del 2024-09-12T17:18:37.363 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.362+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=HBTVHWJSKJS2 type=write size=663085 2024-09-12T17:18:37.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.366+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~4LQSB05KQGNF.0 size=1048576 2024-09-12T17:18:37.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.370+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~4LQSB05KQGNF.1 size=1048576 2024-09-12T17:18:37.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.370+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~4LQSB05KQGNF.2 size=237331 2024-09-12T17:18:37.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.378+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=4LQSB05KQGNF tag=YJYCQGQW8MV6 type=write size=3383059 2024-09-12T17:18:37.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.382+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=YQ606SZPWNKO type=del size=1813565 2024-09-12T17:18:37.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.386+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=X8N4HTL6MSFM type=del 2024-09-12T17:18:37.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.390+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=3KU9FOYHXCUW type=write size=390383 2024-09-12T17:18:37.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.390+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~3N6FTT9SH4JS.0 size=1048576 2024-09-12T17:18:37.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.394+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~3N6FTT9SH4JS.1 size=392054 2024-09-12T17:18:37.402 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.402+0000 7f96641d38c0 1 < completed multipart upload key=37YXLWPZGA9J upload=3N6FTT9SH4JS tag=M3XO289C9BB2 type=write size=2489206 2024-09-12T17:18:37.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.402+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=OFPYYMS8KM66 type=del size=885941 2024-09-12T17:18:37.409 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.406+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~9QRNZK0XR2B0.0 size=208007 2024-09-12T17:18:37.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.414+0000 7f96641d38c0 1 < completed multipart upload key=3SLNHJT3A1K1 upload=9QRNZK0XR2B0 tag=0B7MJH0U37I9 type=write size=1256583 2024-09-12T17:18:37.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.418+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~0T88BO00G35J.0 size=1048576 2024-09-12T17:18:37.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.422+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~0T88BO00G35J.1 size=1008085 2024-09-12T17:18:37.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.422+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=0T88BO00G35J tag=AQO0LIFQJXTL type=write size=3105237 2024-09-12T17:18:37.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.426+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=SXGJK7QEJNUW type=del 2024-09-12T17:18:37.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.430+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~J2DOXAXFDJLE.0 size=1048576 2024-09-12T17:18:37.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.434+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~J2DOXAXFDJLE.1 size=1048576 2024-09-12T17:18:37.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.438+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~J2DOXAXFDJLE.2 size=911329 2024-09-12T17:18:37.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.438+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=J2DOXAXFDJLE tag=CL191OGY8HYY type=write size=4057057 2024-09-12T17:18:37.446 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.442+0000 7f96641d38c0 1 < suggested remove operation key=37YXLWPZGA9J tag=P06HA79TTSE4 type=del 2024-09-12T17:18:37.449 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.446+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=04APMMWD1RP9 type=write size=108180 2024-09-12T17:18:37.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.450+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=CV7TX8JPJLOI type=del 2024-09-12T17:18:37.456 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.454+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=Q8HCRK5I54MW type=del size=309470 2024-09-12T17:18:37.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.458+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~GQMFGNEHWRXV.0 size=1048576 2024-09-12T17:18:37.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.462+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~GQMFGNEHWRXV.1 size=1048576 2024-09-12T17:18:37.465 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.462+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~GQMFGNEHWRXV.2 size=925888 2024-09-12T17:18:37.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.470+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=GQMFGNEHWRXV tag=FYJFI5NFY97W type=write size=4071616 2024-09-12T17:18:37.475 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.474+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=ZO7FZFOHJMB3 type=del size=2873757 2024-09-12T17:18:37.478 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.478+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=1NOBGM015CAU type=del 2024-09-12T17:18:37.482 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.482+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=L4V3MCO63RRX type=del size=8579 2024-09-12T17:18:37.485 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.482+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=QYSGE3SZWAYE type=del 2024-09-12T17:18:37.489 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.486+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=227WU24II63V type=del size=1880166 2024-09-12T17:18:37.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.490+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~Y2EWGF9P2A2O.0 size=1048576 2024-09-12T17:18:37.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.490+0000 7f96641d38c0 1 < canceled part key=_multipart_NG327LT02T1F.2~Y2EWGF9P2A2O.1 size=766457 2024-09-12T17:18:37.502 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.502+0000 7f96641d38c0 1 < canceled multipart upload key=NG327LT02T1F upload=Y2EWGF9P2A2O tag=FDL4SRRUGFYE type=write size=2863609 2024-09-12T17:18:37.506 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.506+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=33VIPJGGVPOI type=del size=3744702 2024-09-12T17:18:37.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.510+0000 7f96641d38c0 1 < canceled operation key=3H8R2MJGR4SY tag=NS2GOTUV3XWE type=del size=1800870 2024-09-12T17:18:37.516 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.514+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~8CKPJAEY88N2.0 size=1048576 2024-09-12T17:18:37.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.518+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~8CKPJAEY88N2.1 size=1048576 2024-09-12T17:18:37.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.522+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~8CKPJAEY88N2.2 size=415924 2024-09-12T17:18:37.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.522+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=8CKPJAEY88N2 tag=SYUG9341YUTA type=write size=3561652 2024-09-12T17:18:37.525 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.522+0000 7f96641d38c0 1 < canceled operation key=GKJJDBNXC6QH tag=RF4AC793PO4K type=del size=2821058 2024-09-12T17:18:37.529 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.526+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=U426G5OU4KKX type=del size=605926 2024-09-12T17:18:37.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.530+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~NZZ3JYEA3W7P.0 size=230475 2024-09-12T17:18:37.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.538+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=NZZ3JYEA3W7P tag=NKUKW4SF9WY1 type=write size=1279051 2024-09-12T17:18:37.545 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.542+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~UIYQ19V1RW5N.0 size=1048576 2024-09-12T17:18:37.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.546+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~UIYQ19V1RW5N.1 size=1048576 2024-09-12T17:18:37.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.550+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~UIYQ19V1RW5N.2 size=903640 2024-09-12T17:18:37.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.550+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=UIYQ19V1RW5N tag=PLBE4H4EUH1K type=write size=4049368 2024-09-12T17:18:37.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.554+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=DKZ7BRR5K10S type=del 2024-09-12T17:18:37.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.558+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~PKM9E6PVA6B4.0 size=355982 2024-09-12T17:18:37.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.558+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=PKM9E6PVA6B4 tag=48JYS3NKDP97 type=write size=1404558 2024-09-12T17:18:37.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.558+0000 7f96641d38c0 -1 < no bi entry to suggest for operation key=37YXLWPZGA9J tag=HBTVHWJSKJS2 type=write size=663085: (2) No such file or directory 2024-09-12T17:18:37.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.566+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~OB9M12FPI1EH.0 size=316125 2024-09-12T17:18:37.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.566+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=OB9M12FPI1EH tag=751K7OAGXZOB type=write size=1364701 2024-09-12T17:18:37.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.566+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=YQ606SZPWNKO type=del 2024-09-12T17:18:37.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.574+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~NAZ1LLFM7ZUX.0 size=1048576 2024-09-12T17:18:37.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.574+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~NAZ1LLFM7ZUX.1 size=513149 2024-09-12T17:18:37.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.574+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=NAZ1LLFM7ZUX tag=OXTSM6LHHIC3 type=write size=2610301 2024-09-12T17:18:37.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.578+0000 7f96641d38c0 1 < completed write operation key=HRU241T0FUEZ tag=3KU9FOYHXCUW type=write size=390383 2024-09-12T17:18:37.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.582+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=FP4WWO9EL2EC type=del size=2824283 2024-09-12T17:18:37.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.586+0000 7f96641d38c0 1 < canceled operation key=LK3F25OHR7AO tag=OFPYYMS8KM66 type=del size=885941 2024-09-12T17:18:37.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.594+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~487TEDJ0J445.0 size=440591 2024-09-12T17:18:37.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.594+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=487TEDJ0J445 tag=CZEI4XLQW2FA type=write size=1489167 2024-09-12T17:18:37.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.598+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~0T88BO00G35J.0 size=1048576 2024-09-12T17:18:37.601 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.598+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~0T88BO00G35J.1 size=1008085 2024-09-12T17:18:37.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.606+0000 7f96641d38c0 1 < completed multipart upload key=0X2HHMHJUJNL upload=0T88BO00G35J tag=AQO0LIFQJXTL type=write size=3105237 2024-09-12T17:18:37.609 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.606+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=CJ5IO79LNRUK type=del size=164846 2024-09-12T17:18:37.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.610+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~J2DOXAXFDJLE.0 size=1048576 2024-09-12T17:18:37.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.614+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~J2DOXAXFDJLE.1 size=1048576 2024-09-12T17:18:37.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.614+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~J2DOXAXFDJLE.2 size=911329 2024-09-12T17:18:37.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.622+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=J2DOXAXFDJLE tag=CL191OGY8HYY type=write size=4057057 2024-09-12T17:18:37.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.622+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=ABTF0FJPHH4V type=del size=1827160 2024-09-12T17:18:37.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.626+0000 7f96641d38c0 1 < completed write operation key=W40P2E1H5VT9 tag=04APMMWD1RP9 type=write size=108180 2024-09-12T17:18:37.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.630+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~BYLOVU2LMUUU.0 size=1048576 2024-09-12T17:18:37.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.634+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~BYLOVU2LMUUU.1 size=1048576 2024-09-12T17:18:37.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.638+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~BYLOVU2LMUUU.2 size=948637 2024-09-12T17:18:37.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.638+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=BYLOVU2LMUUU tag=4J26V50FYULU type=write size=4094365 2024-09-12T17:18:37.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.638+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=Q8HCRK5I54MW type=del 2024-09-12T17:18:37.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.642+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=QS1GUG2GG807 type=del size=3315749 2024-09-12T17:18:37.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.646+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=ZO7FZFOHJMB3 type=del 2024-09-12T17:18:37.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.650+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~KD8GM0EV7M08.0 size=1048576 2024-09-12T17:18:37.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.654+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~KD8GM0EV7M08.1 size=1032477 2024-09-12T17:18:37.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.654+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=KD8GM0EV7M08 tag=FHUCV78ZRNJV type=write size=3129629 2024-09-12T17:18:37.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.658+0000 7f96641d38c0 1 < suggested remove operation key=DHODPSZ7Z0D4 tag=L4V3MCO63RRX type=del 2024-09-12T17:18:37.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.666+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~LUG9HNCV6E64.0 size=1048576 2024-09-12T17:18:37.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.666+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~LUG9HNCV6E64.1 size=969108 2024-09-12T17:18:37.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.666+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=LUG9HNCV6E64 tag=5ZE259VZSO05 type=write size=3066260 2024-09-12T17:18:37.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.670+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=227WU24II63V type=del 2024-09-12T17:18:37.676 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.674+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=U6P7AIIQQFP6 type=del size=700501 2024-09-12T17:18:37.678 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.678+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=33VIPJGGVPOI type=del 2024-09-12T17:18:37.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.678+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=IXLW87DEQR46 type=del size=272455 2024-09-12T17:18:37.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.682+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~8CKPJAEY88N2.0 size=1048576 2024-09-12T17:18:37.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.686+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~8CKPJAEY88N2.1 size=1048576 2024-09-12T17:18:37.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.690+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~8CKPJAEY88N2.2 size=415924 2024-09-12T17:18:37.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.694+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=8CKPJAEY88N2 tag=SYUG9341YUTA type=write size=3561652 2024-09-12T17:18:37.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.698+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~6OEXPTE12IY2.0 size=575121 2024-09-12T17:18:37.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.698+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=6OEXPTE12IY2 tag=E5GJN6ISAWE1 type=write size=1623697 2024-09-12T17:18:37.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.702+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=U426G5OU4KKX type=del 2024-09-12T17:18:37.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.706+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=EPDRYO6JG0LK type=del size=4105042 2024-09-12T17:18:37.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.710+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~UIYQ19V1RW5N.0 size=1048576 2024-09-12T17:18:37.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.714+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~UIYQ19V1RW5N.1 size=1048576 2024-09-12T17:18:37.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.714+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~UIYQ19V1RW5N.2 size=903640 2024-09-12T17:18:37.723 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.722+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=UIYQ19V1RW5N tag=PLBE4H4EUH1K type=write size=4049368 2024-09-12T17:18:37.726 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.726+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=GMNGJEZYN169 type=del size=678942 2024-09-12T17:18:37.729 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.726+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~PKM9E6PVA6B4.0 size=355982 2024-09-12T17:18:37.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.734+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=PKM9E6PVA6B4 tag=48JYS3NKDP97 type=write size=1404558 2024-09-12T17:18:37.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.738+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~SW9FRQCJQJ68.0 size=1048576 2024-09-12T17:18:37.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.742+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~SW9FRQCJQJ68.1 size=1048576 2024-09-12T17:18:37.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.742+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~SW9FRQCJQJ68.2 size=771500 2024-09-12T17:18:37.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.742+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=SW9FRQCJQJ68 tag=ADH2EB6FNBAF type=write size=3917228 2024-09-12T17:18:37.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.746+0000 7f96641d38c0 1 < canceled part key=_multipart_NGA3P9RZJYWT.2~OB9M12FPI1EH.0 size=316125 2024-09-12T17:18:37.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.750+0000 7f96641d38c0 1 < canceled multipart upload key=NGA3P9RZJYWT upload=OB9M12FPI1EH tag=751K7OAGXZOB type=write size=1364701 2024-09-12T17:18:37.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.754+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~2540I17JDK0B.0 size=719806 2024-09-12T17:18:37.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.754+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=2540I17JDK0B tag=ZXH1KH8L2P62 type=write size=1768382 2024-09-12T17:18:37.761 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.758+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~NAZ1LLFM7ZUX.0 size=1048576 2024-09-12T17:18:37.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.762+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~NAZ1LLFM7ZUX.1 size=513149 2024-09-12T17:18:37.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.766+0000 7f96641d38c0 1 < completed multipart upload key=HRU241T0FUEZ upload=NAZ1LLFM7ZUX tag=OXTSM6LHHIC3 type=write size=2610301 2024-09-12T17:18:37.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.770+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=SWOEOP3X0I6Z type=del size=3135144 2024-09-12T17:18:37.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.778+0000 7f96641d38c0 1 < suggested remove operation key=NG327LT02T1F tag=FP4WWO9EL2EC type=del 2024-09-12T17:18:37.782 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.782+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=PLPSDTHN1NB5 type=write size=209926 2024-09-12T17:18:37.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.786+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~487TEDJ0J445.0 size=440591 2024-09-12T17:18:37.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.790+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=487TEDJ0J445 tag=CZEI4XLQW2FA type=write size=1489167 2024-09-12T17:18:37.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.794+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=YG2W00XNWG5R type=write size=649877 2024-09-12T17:18:37.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.798+0000 7f96641d38c0 1 < canceled operation key=BDI9YFZCT5YY tag=CJ5IO79LNRUK type=del size=164846 2024-09-12T17:18:37.808 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.806+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~N6ZY1ZLOU3S2.0 size=494579 2024-09-12T17:18:37.808 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.806+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=N6ZY1ZLOU3S2 tag=F0EKO991ANTH type=write size=1543155 2024-09-12T17:18:37.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.810+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=ABTF0FJPHH4V type=del 2024-09-12T17:18:37.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.814+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=QGF5VF74IG57 type=write size=985050 2024-09-12T17:18:37.818 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.818+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~BYLOVU2LMUUU.0 size=1048576 2024-09-12T17:18:37.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.818+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~BYLOVU2LMUUU.1 size=1048576 2024-09-12T17:18:37.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.822+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~BYLOVU2LMUUU.2 size=948637 2024-09-12T17:18:37.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.826+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=BYLOVU2LMUUU tag=4J26V50FYULU type=write size=4094365 2024-09-12T17:18:37.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.834+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~5QZO1JL2335G.0 size=1048576 2024-09-12T17:18:37.839 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.838+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~5QZO1JL2335G.1 size=846175 2024-09-12T17:18:37.839 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.838+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=5QZO1JL2335G tag=UDZ2JJO89VNM type=write size=2943327 2024-09-12T17:18:37.846 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.846+0000 7f96641d38c0 1 < suggested update operation key=3H8R2MJGR4SY tag=QS1GUG2GG807 type=del size=3315749 2024-09-12T17:18:37.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.850+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~4DD8BHQX8QN2.0 size=1048576 2024-09-12T17:18:37.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.854+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~4DD8BHQX8QN2.1 size=950506 2024-09-12T17:18:37.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.854+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=4DD8BHQX8QN2 tag=SU5QKRVIVDIG type=write size=3047658 2024-09-12T17:18:37.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.854+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~KD8GM0EV7M08.0 size=1048576 2024-09-12T17:18:37.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.858+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~KD8GM0EV7M08.1 size=1032477 2024-09-12T17:18:37.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.862+0000 7f96641d38c0 1 < completed multipart upload key=0X2HHMHJUJNL upload=KD8GM0EV7M08 tag=FHUCV78ZRNJV type=write size=3129629 2024-09-12T17:18:37.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.866+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=HCQ7SYSB12VU type=del size=831853 2024-09-12T17:18:37.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.870+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~LUG9HNCV6E64.0 size=1048576 2024-09-12T17:18:37.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.870+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~LUG9HNCV6E64.1 size=969108 2024-09-12T17:18:37.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.878+0000 7f96641d38c0 1 < completed multipart upload key=G7CWVD9C2H2J upload=LUG9HNCV6E64 tag=5ZE259VZSO05 type=write size=3066260 2024-09-12T17:18:37.882 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.882+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=KYI0W583RP7V type=del size=654638 2024-09-12T17:18:37.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.882+0000 7f96641d38c0 1 < canceled operation key=9CBFWXFX7O3N tag=U6P7AIIQQFP6 type=del size=700501 2024-09-12T17:18:37.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.890+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~9LH158YABGR2.0 size=319097 2024-09-12T17:18:37.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.890+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=9LH158YABGR2 tag=O2FDC7FE7V42 type=write size=1367673 2024-09-12T17:18:37.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.894+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=IXLW87DEQR46 type=del 2024-09-12T17:18:37.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.894+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=EO1XN8GEX8AW type=del size=2838049 2024-09-12T17:18:37.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.898+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~6OEXPTE12IY2.0 size=575121 2024-09-12T17:18:37.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.902+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=6OEXPTE12IY2 tag=E5GJN6ISAWE1 type=write size=1623697 2024-09-12T17:18:37.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.910+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~M4Y6T2WUL0J8.0 size=310290 2024-09-12T17:18:37.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.910+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=M4Y6T2WUL0J8 tag=UHAGCX4WF4P8 type=write size=1358866 2024-09-12T17:18:37.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.910+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=EPDRYO6JG0LK type=del 2024-09-12T17:18:37.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.914+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=VLQBN28Z724N type=del size=237523 2024-09-12T17:18:37.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.918+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=GMNGJEZYN169 type=del 2024-09-12T17:18:37.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.922+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=1HGY18ARJPNO type=del size=3253342 2024-09-12T17:18:37.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.922+0000 7f96641d38c0 1 < canceled part key=_multipart_RSVQJS9F1FR7.2~SW9FRQCJQJ68.0 size=1048576 2024-09-12T17:18:37.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.926+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~SW9FRQCJQJ68.1 size=1048576 2024-09-12T17:18:37.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.926+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~SW9FRQCJQJ68.2 size=771500 2024-09-12T17:18:37.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.934+0000 7f96641d38c0 1 < canceled multipart upload key=RSVQJS9F1FR7 upload=SW9FRQCJQJ68 tag=ADH2EB6FNBAF type=write size=3917228 2024-09-12T17:18:37.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.938+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~TBL1G20RTA9Q.0 size=1048576 2024-09-12T17:18:37.942 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.942+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~TBL1G20RTA9Q.1 size=1048576 2024-09-12T17:18:37.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.942+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~TBL1G20RTA9Q.2 size=682722 2024-09-12T17:18:37.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.942+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=TBL1G20RTA9Q tag=MPRI61C0KNMS type=write size=3828450 2024-09-12T17:18:37.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.942+0000 7f96641d38c0 1 < canceled part key=_multipart_GKJJDBNXC6QH.2~2540I17JDK0B.0 size=719806 2024-09-12T17:18:37.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.950+0000 7f96641d38c0 1 < canceled multipart upload key=GKJJDBNXC6QH upload=2540I17JDK0B tag=ZXH1KH8L2P62 type=write size=1768382 2024-09-12T17:18:37.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.954+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~6BLN6ZZZOOJI.0 size=582407 2024-09-12T17:18:37.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.954+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=6BLN6ZZZOOJI tag=EIY2FJOGPKWR type=write size=1630983 2024-09-12T17:18:37.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.958+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=SWOEOP3X0I6Z type=del 2024-09-12T17:18:37.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.962+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=IHR9D32UF4TT type=del size=2327686 2024-09-12T17:18:37.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.962+0000 7f96641d38c0 1 < canceled operation key=DHODPSZ7Z0D4 tag=PLPSDTHN1NB5 type=write size=209926 2024-09-12T17:18:37.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.966+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=7FAHWBRS0F31 type=del size=2279654 2024-09-12T17:18:37.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.970+0000 7f96641d38c0 1 < completed write operation key=H3J23KLT1VUT tag=YG2W00XNWG5R type=write size=649877 2024-09-12T17:18:37.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.974+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=7Q06TJ9NQZMP type=write size=426180 2024-09-12T17:18:37.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.978+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~N6ZY1ZLOU3S2.0 size=494579 2024-09-12T17:18:37.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.982+0000 7f96641d38c0 1 < completed multipart upload key=37YXLWPZGA9J upload=N6ZY1ZLOU3S2 tag=F0EKO991ANTH type=write size=1543155 2024-09-12T17:18:37.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.986+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=7KR0CVX4683I type=del size=1048187 2024-09-12T17:18:37.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.990+0000 7f96641d38c0 1 < completed write operation key=XDL9O7TEMBYF tag=QGF5VF74IG57 type=write size=985050 2024-09-12T17:18:37.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.994+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~HXO4G7LW8OUX.0 size=800955 2024-09-12T17:18:37.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.994+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=HXO4G7LW8OUX tag=RMYJDYO7XDSK type=write size=1849531 2024-09-12T17:18:37.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:37.998+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~5QZO1JL2335G.0 size=1048576 2024-09-12T17:18:38.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.002+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~5QZO1JL2335G.1 size=846175 2024-09-12T17:18:38.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.006+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=5QZO1JL2335G tag=UDZ2JJO89VNM type=write size=2943327 2024-09-12T17:18:38.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.010+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=B7MUYU1RRC98 type=del size=2450836 2024-09-12T17:18:38.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.014+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~4DD8BHQX8QN2.0 size=1048576 2024-09-12T17:18:38.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.018+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~4DD8BHQX8QN2.1 size=950506 2024-09-12T17:18:38.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.022+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=4DD8BHQX8QN2 tag=SU5QKRVIVDIG type=write size=3047658 2024-09-12T17:18:38.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.026+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~AP0XVC5117CA.0 size=35551 2024-09-12T17:18:38.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.026+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=AP0XVC5117CA tag=8EDB73350T02 type=write size=1084127 2024-09-12T17:18:38.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.030+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=HCQ7SYSB12VU type=del 2024-09-12T17:18:38.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.038+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~W1YYNGQ5APXI.0 size=1048576 2024-09-12T17:18:38.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.038+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~W1YYNGQ5APXI.1 size=148859 2024-09-12T17:18:38.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.038+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=W1YYNGQ5APXI tag=A77IDZL1CYOU type=write size=2246011 2024-09-12T17:18:38.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.042+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=KYI0W583RP7V type=del 2024-09-12T17:18:38.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.046+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=V39A35DNNDY7 type=del size=589591 2024-09-12T17:18:38.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.050+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~9LH158YABGR2.0 size=319097 2024-09-12T17:18:38.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.054+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=9LH158YABGR2 tag=O2FDC7FE7V42 type=write size=1367673 2024-09-12T17:18:38.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.058+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=SQ1FAVZ04717 type=del size=1784266 2024-09-12T17:18:38.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.062+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=EO1XN8GEX8AW type=del 2024-09-12T17:18:38.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.066+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=N6FAXEEMBBMZ type=del size=3268662 2024-09-12T17:18:38.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.070+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~M4Y6T2WUL0J8.0 size=310290 2024-09-12T17:18:38.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.074+0000 7f96641d38c0 1 < completed multipart upload key=G7CWVD9C2H2J upload=M4Y6T2WUL0J8 tag=UHAGCX4WF4P8 type=write size=1358866 2024-09-12T17:18:38.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.078+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~D59LG0IHOJ5C.0 size=1048576 2024-09-12T17:18:38.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.082+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~D59LG0IHOJ5C.1 size=119536 2024-09-12T17:18:38.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.082+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=D59LG0IHOJ5C tag=FDIBC5GDLPB8 type=write size=2216688 2024-09-12T17:18:38.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.090+0000 7f96641d38c0 1 < suggested update operation key=DHODPSZ7Z0D4 tag=VLQBN28Z724N type=del size=237523 2024-09-12T17:18:38.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.090+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=GKO5C6P355L8 type=del size=4047205 2024-09-12T17:18:38.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.094+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=1HGY18ARJPNO type=del 2024-09-12T17:18:38.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.106+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~X0WB7SN1OO9S.0 size=1048576 2024-09-12T17:18:38.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.106+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~X0WB7SN1OO9S.1 size=1048576 2024-09-12T17:18:38.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.110+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~X0WB7SN1OO9S.2 size=412698 2024-09-12T17:18:38.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.110+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=X0WB7SN1OO9S tag=I6F459G6V4XA type=write size=3558426 2024-09-12T17:18:38.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.114+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~TBL1G20RTA9Q.0 size=1048576 2024-09-12T17:18:38.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.114+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~TBL1G20RTA9Q.1 size=1048576 2024-09-12T17:18:38.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.118+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~TBL1G20RTA9Q.2 size=682722 2024-09-12T17:18:38.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.122+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=TBL1G20RTA9Q tag=MPRI61C0KNMS type=write size=3828450 2024-09-12T17:18:38.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.126+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=AG9BMMA4KR05 type=write size=654062 2024-09-12T17:18:38.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.130+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~6BLN6ZZZOOJI.0 size=582407 2024-09-12T17:18:38.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.134+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=6BLN6ZZZOOJI tag=EIY2FJOGPKWR type=write size=1630983 2024-09-12T17:18:38.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.138+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=LMY9P1QJ6VG2 type=del size=970245 2024-09-12T17:18:38.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.146+0000 7f96641d38c0 1 < suggested remove operation key=NGA3P9RZJYWT tag=IHR9D32UF4TT type=del 2024-09-12T17:18:38.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.150+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~C1EGBATDAQKI.0 size=372125 2024-09-12T17:18:38.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.150+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=C1EGBATDAQKI tag=U64PY678ABG2 type=write size=1420701 2024-09-12T17:18:38.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.154+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=7FAHWBRS0F31 type=del 2024-09-12T17:18:38.159 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.158+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=ZKDB8FAOQX48 type=del size=1928042 2024-09-12T17:18:38.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.162+0000 7f96641d38c0 1 < completed write operation key=KXJYJ9VX7YVW tag=7Q06TJ9NQZMP type=write size=426180 2024-09-12T17:18:38.167 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.166+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=U9T6LGTXJ4CT type=write size=530061 2024-09-12T17:18:38.171 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.170+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=7KR0CVX4683I type=del 2024-09-12T17:18:38.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.174+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=KSPJBOVJ3N3Y type=del size=468754 2024-09-12T17:18:38.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.178+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~HXO4G7LW8OUX.0 size=800955 2024-09-12T17:18:38.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.182+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=HXO4G7LW8OUX tag=RMYJDYO7XDSK type=write size=1849531 2024-09-12T17:18:38.190 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.190+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~K2SFER2WI1OR.0 size=1048576 2024-09-12T17:18:38.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.190+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~K2SFER2WI1OR.1 size=1048576 2024-09-12T17:18:38.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.194+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~K2SFER2WI1OR.2 size=979421 2024-09-12T17:18:38.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.194+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=K2SFER2WI1OR tag=F5N2KJR2Z4TT type=write size=4125149 2024-09-12T17:18:38.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.198+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=B7MUYU1RRC98 type=del 2024-09-12T17:18:38.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.198+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=07IAH4A1IX3A type=del size=2483014 2024-09-12T17:18:38.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.202+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~AP0XVC5117CA.0 size=35551 2024-09-12T17:18:38.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.210+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=AP0XVC5117CA tag=8EDB73350T02 type=write size=1084127 2024-09-12T17:18:38.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.214+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~NUCR6EGYA15S.0 size=1048576 2024-09-12T17:18:38.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.218+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~NUCR6EGYA15S.1 size=662289 2024-09-12T17:18:38.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.218+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=NUCR6EGYA15S tag=DVBSBTV94Q8B type=write size=2759441 2024-09-12T17:18:38.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.222+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~W1YYNGQ5APXI.0 size=1048576 2024-09-12T17:18:38.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.222+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~W1YYNGQ5APXI.1 size=148859 2024-09-12T17:18:38.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.230+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=W1YYNGQ5APXI tag=A77IDZL1CYOU type=write size=2246011 2024-09-12T17:18:38.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.234+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=DDZMEBK5YECK type=del size=1882336 2024-09-12T17:18:38.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.238+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=V39A35DNNDY7 type=del 2024-09-12T17:18:38.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.246+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~U9W6W3QDMW7U.0 size=1048576 2024-09-12T17:18:38.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.246+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~U9W6W3QDMW7U.1 size=1024606 2024-09-12T17:18:38.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.246+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=U9W6W3QDMW7U tag=ZZQGZQGV9Y1H type=write size=3121758 2024-09-12T17:18:38.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.250+0000 7f96641d38c0 1 < completed delete operation key=KXJYJ9VX7YVW tag=SQ1FAVZ04717 type=del 2024-09-12T17:18:38.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.254+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=8NWYT237MBAO type=del size=51026 2024-09-12T17:18:38.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.258+0000 7f96641d38c0 1 < canceled operation key=XTVZIXTEES2O tag=N6FAXEEMBBMZ type=del size=3268662 2024-09-12T17:18:38.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.262+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=1HEP0N5578S1 type=del size=372869 2024-09-12T17:18:38.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.266+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~D59LG0IHOJ5C.0 size=1048576 2024-09-12T17:18:38.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.270+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~D59LG0IHOJ5C.1 size=119536 2024-09-12T17:18:38.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.278+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=D59LG0IHOJ5C tag=FDIBC5GDLPB8 type=write size=2216688 2024-09-12T17:18:38.284 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.282+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=I8HD3N68MV3L type=write size=460601 2024-09-12T17:18:38.288 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.286+0000 7f96641d38c0 1 < canceled operation key=NG327LT02T1F tag=GKO5C6P355L8 type=del size=4047205 2024-09-12T17:18:38.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.294+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~WACNODMYMO3F.0 size=1048576 2024-09-12T17:18:38.299 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.298+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~WACNODMYMO3F.1 size=200516 2024-09-12T17:18:38.299 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.298+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=WACNODMYMO3F tag=H3ARA496GZ6H type=write size=2297668 2024-09-12T17:18:38.299 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.298+0000 7f96641d38c0 1 < canceled part key=_multipart_MOQXP4AXMTCK.2~X0WB7SN1OO9S.0 size=1048576 2024-09-12T17:18:38.303 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.302+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~X0WB7SN1OO9S.1 size=1048576 2024-09-12T17:18:38.303 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.302+0000 7f96641d38c0 1 < canceled part key=_multipart_MOQXP4AXMTCK.2~X0WB7SN1OO9S.2 size=412698 2024-09-12T17:18:38.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.306+0000 7f96641d38c0 1 < canceled multipart upload key=MOQXP4AXMTCK upload=X0WB7SN1OO9S tag=I6F459G6V4XA type=write size=3558426 2024-09-12T17:18:38.313 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.310+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=2FAB0HWFPUGN type=del size=2085888 2024-09-12T17:18:38.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.318+0000 7f96641d38c0 1 < canceled operation key=8TU2VZOHL1ZZ tag=AG9BMMA4KR05 type=write size=654062 2024-09-12T17:18:38.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.322+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~POL84M5MCT5Y.0 size=1048576 2024-09-12T17:18:38.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.326+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~POL84M5MCT5Y.1 size=139895 2024-09-12T17:18:38.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.326+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=POL84M5MCT5Y tag=581K05R80M0O type=write size=2237047 2024-09-12T17:18:38.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.326+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=LMY9P1QJ6VG2 type=del 2024-09-12T17:18:38.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.334+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~SBC1POEGF05G.0 size=1048576 2024-09-12T17:18:38.337 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.334+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~SBC1POEGF05G.1 size=747130 2024-09-12T17:18:38.337 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.334+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=SBC1POEGF05G tag=R5D83JE5E00R type=write size=2844282 2024-09-12T17:18:38.337 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.334+0000 7f96641d38c0 1 < canceled part key=_multipart_NG327LT02T1F.2~C1EGBATDAQKI.0 size=372125 2024-09-12T17:18:38.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.338+0000 7f96641d38c0 1 < canceled multipart upload key=NG327LT02T1F upload=C1EGBATDAQKI tag=U64PY678ABG2 type=write size=1420701 2024-09-12T17:18:38.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.342+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=130ADNC3VCED type=del size=1141262 2024-09-12T17:18:38.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.346+0000 7f96641d38c0 1 < suggested remove operation key=UBYUSW4C2V19 tag=ZKDB8FAOQX48 type=del 2024-09-12T17:18:38.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.350+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=GZSBPNW419ZW type=del size=4154444 2024-09-12T17:18:38.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.354+0000 7f96641d38c0 1 < completed write operation key=DHODPSZ7Z0D4 tag=U9T6LGTXJ4CT type=write size=530061 2024-09-12T17:18:38.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.358+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~UV8BQQ7UYTB1.0 size=1048576 2024-09-12T17:18:38.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.358+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~UV8BQQ7UYTB1.1 size=358270 2024-09-12T17:18:38.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.358+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=UV8BQQ7UYTB1 tag=IJV9FACN2RXP type=write size=2455422 2024-09-12T17:18:38.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.362+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=KSPJBOVJ3N3Y type=del 2024-09-12T17:18:38.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.366+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=5QL3EJZTCJT8 type=del size=3828537 2024-09-12T17:18:38.369 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.366+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~K2SFER2WI1OR.0 size=1048576 2024-09-12T17:18:38.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.370+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~K2SFER2WI1OR.1 size=1048576 2024-09-12T17:18:38.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.374+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~K2SFER2WI1OR.2 size=979421 2024-09-12T17:18:38.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.378+0000 7f96641d38c0 1 < completed multipart upload key=G7CWVD9C2H2J upload=K2SFER2WI1OR tag=F5N2KJR2Z4TT type=write size=4125149 2024-09-12T17:18:38.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.382+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~M3RPYRUTY3MC.0 size=1048576 2024-09-12T17:18:38.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.382+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~M3RPYRUTY3MC.1 size=1048576 2024-09-12T17:18:38.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.386+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~M3RPYRUTY3MC.2 size=828750 2024-09-12T17:18:38.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.386+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=M3RPYRUTY3MC tag=IAI5DJZ8ITXN type=write size=3974478 2024-09-12T17:18:38.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.390+0000 7f96641d38c0 1 < canceled operation key=GKJJDBNXC6QH tag=07IAH4A1IX3A type=del size=2483014 2024-09-12T17:18:38.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.394+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=OYS60I1COQ0P type=write size=220860 2024-09-12T17:18:38.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.394+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~NUCR6EGYA15S.0 size=1048576 2024-09-12T17:18:38.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.398+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~NUCR6EGYA15S.1 size=662289 2024-09-12T17:18:38.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.402+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=NUCR6EGYA15S tag=DVBSBTV94Q8B type=write size=2759441 2024-09-12T17:18:38.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.410+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~P51U1I9102GG.0 size=1048576 2024-09-12T17:18:38.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.414+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~P51U1I9102GG.1 size=683591 2024-09-12T17:18:38.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.414+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=P51U1I9102GG tag=BB3LRUN5DOTN type=write size=2780743 2024-09-12T17:18:38.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.418+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=DDZMEBK5YECK type=del 2024-09-12T17:18:38.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.418+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=TG6FG29U11P8 type=del size=2360062 2024-09-12T17:18:38.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.422+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~U9W6W3QDMW7U.0 size=1048576 2024-09-12T17:18:38.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.426+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~U9W6W3QDMW7U.1 size=1024606 2024-09-12T17:18:38.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.430+0000 7f96641d38c0 1 < completed multipart upload key=0X2HHMHJUJNL upload=U9W6W3QDMW7U tag=ZZQGZQGV9Y1H type=write size=3121758 2024-09-12T17:18:38.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.434+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=B9N8YEA9MK7M type=write size=11150 2024-09-12T17:18:38.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.434+0000 7f96641d38c0 1 < completed delete operation key=KXJYJ9VX7YVW tag=8NWYT237MBAO type=del 2024-09-12T17:18:38.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.442+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~ZYNI2UVS1E5Y.0 size=236708 2024-09-12T17:18:38.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.442+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=ZYNI2UVS1E5Y tag=BBMF4MJ8NBQ6 type=write size=1285284 2024-09-12T17:18:38.450 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.450+0000 7f96641d38c0 1 < suggested remove operation key=6BH7SI911MMP tag=1HEP0N5578S1 type=del 2024-09-12T17:18:38.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.454+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~SGOACXI7CR5U.0 size=1048576 2024-09-12T17:18:38.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.454+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~SGOACXI7CR5U.1 size=959683 2024-09-12T17:18:38.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.454+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=SGOACXI7CR5U tag=YY4RYNFCQ1V3 type=write size=3056835 2024-09-12T17:18:38.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.462+0000 7f96641d38c0 1 < suggested update operation key=LK3F25OHR7AO tag=I8HD3N68MV3L type=write size=460601 2024-09-12T17:18:38.465 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.462+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=Y11W4TL4XXPF type=del size=1626562 2024-09-12T17:18:38.466 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.466+0000 7f96641d38c0 1 < canceled part key=_multipart_KXJYJ9VX7YVW.2~WACNODMYMO3F.0 size=1048576 2024-09-12T17:18:38.468 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.466+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~WACNODMYMO3F.1 size=200516 2024-09-12T17:18:38.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.470+0000 7f96641d38c0 1 < canceled multipart upload key=KXJYJ9VX7YVW upload=WACNODMYMO3F tag=H3ARA496GZ6H type=write size=2297668 2024-09-12T17:18:38.477 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.474+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=HFCO5LNGOFMO type=del size=1503444 2024-09-12T17:18:38.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.478+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=2FAB0HWFPUGN type=del 2024-09-12T17:18:38.483 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.482+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=QAGCYHKBSN6Z type=del size=554532 2024-09-12T17:18:38.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.486+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~POL84M5MCT5Y.0 size=1048576 2024-09-12T17:18:38.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.486+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~POL84M5MCT5Y.1 size=139895 2024-09-12T17:18:38.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.494+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=POL84M5MCT5Y tag=581K05R80M0O type=write size=2237047 2024-09-12T17:18:38.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.498+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~PKUVRRT2XYE8.0 size=1048576 2024-09-12T17:18:38.502 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.502+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~PKUVRRT2XYE8.1 size=636924 2024-09-12T17:18:38.502 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.502+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=PKUVRRT2XYE8 tag=JQ5ESK86PXWG type=write size=2734076 2024-09-12T17:18:38.506 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.502+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~SBC1POEGF05G.0 size=1048576 2024-09-12T17:18:38.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.506+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~SBC1POEGF05G.1 size=747130 2024-09-12T17:18:38.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.510+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=SBC1POEGF05G tag=R5D83JE5E00R type=write size=2844282 2024-09-12T17:18:38.518 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.518+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~O3OGYYJEMK4D.0 size=1048576 2024-09-12T17:18:38.520 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.518+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~O3OGYYJEMK4D.1 size=1048576 2024-09-12T17:18:38.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.522+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~O3OGYYJEMK4D.2 size=81045 2024-09-12T17:18:38.523 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.522+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=O3OGYYJEMK4D tag=Q3373TUP9WOS type=write size=3226773 2024-09-12T17:18:38.526 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.526+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=130ADNC3VCED type=del 2024-09-12T17:18:38.529 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.526+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=K5HS7982Y4K0 type=write size=959670 2024-09-12T17:18:38.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.530+0000 7f96641d38c0 -1 < failed to complete operation key=LK3F25OHR7AO tag=GZSBPNW419ZW type=del size=4154444: (22) Invalid argument 2024-09-12T17:18:38.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.534+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~6STEMHPADWN8.0 size=1048576 2024-09-12T17:18:38.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.538+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~6STEMHPADWN8.1 size=784966 2024-09-12T17:18:38.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.538+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=6STEMHPADWN8 tag=2CJCMC9LSVX3 type=write size=2882118 2024-09-12T17:18:38.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.542+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~UV8BQQ7UYTB1.0 size=1048576 2024-09-12T17:18:38.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.546+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~UV8BQQ7UYTB1.1 size=358270 2024-09-12T17:18:38.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.550+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=UV8BQQ7UYTB1 tag=IJV9FACN2RXP type=write size=2455422 2024-09-12T17:18:38.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.554+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~4518L7CPLMWH.0 size=752199 2024-09-12T17:18:38.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.554+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=4518L7CPLMWH tag=71G13FJYVBUT type=write size=1800775 2024-09-12T17:18:38.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.554+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=5QL3EJZTCJT8 type=del 2024-09-12T17:18:38.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.558+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=ZDLMKCPAUMXI type=del size=3336911 2024-09-12T17:18:38.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.562+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~M3RPYRUTY3MC.0 size=1048576 2024-09-12T17:18:38.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.562+0000 7f96641d38c0 1 < canceled part key=_multipart_47QQRTJKM4DB.2~M3RPYRUTY3MC.1 size=1048576 2024-09-12T17:18:38.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.562+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~M3RPYRUTY3MC.2 size=828750 2024-09-12T17:18:38.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.566+0000 7f96641d38c0 1 < canceled multipart upload key=47QQRTJKM4DB upload=M3RPYRUTY3MC tag=IAI5DJZ8ITXN type=write size=3974478 2024-09-12T17:18:38.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.570+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=81W0R0CR43RU type=write size=549270 2024-09-12T17:18:38.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.574+0000 7f96641d38c0 1 < completed write operation key=XDL9O7TEMBYF tag=OYS60I1COQ0P type=write size=220860 2024-09-12T17:18:38.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.578+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=M5JJURLJPI41 type=write size=103617 2024-09-12T17:18:38.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.582+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~P51U1I9102GG.0 size=1048576 2024-09-12T17:18:38.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.582+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~P51U1I9102GG.1 size=683591 2024-09-12T17:18:38.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.586+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=P51U1I9102GG tag=BB3LRUN5DOTN type=write size=2780743 2024-09-12T17:18:38.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.590+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=R7E1E6TYIO6M type=write size=753118 2024-09-12T17:18:38.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.594+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=TG6FG29U11P8 type=del 2024-09-12T17:18:38.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.594+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=RT4BPUG0S25X type=del size=3566262 2024-09-12T17:18:38.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.598+0000 7f96641d38c0 1 < completed write operation key=37YXLWPZGA9J tag=B9N8YEA9MK7M type=write size=11150 2024-09-12T17:18:38.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.606+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~W5TM50HBI5QC.0 size=1048576 2024-09-12T17:18:38.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.606+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~W5TM50HBI5QC.1 size=1048576 2024-09-12T17:18:38.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.610+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~W5TM50HBI5QC.2 size=727104 2024-09-12T17:18:38.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.610+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=W5TM50HBI5QC tag=5CPMR0GZC740 type=write size=3872832 2024-09-12T17:18:38.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.610+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~ZYNI2UVS1E5Y.0 size=236708 2024-09-12T17:18:38.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.618+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=ZYNI2UVS1E5Y tag=BBMF4MJ8NBQ6 type=write size=1285284 2024-09-12T17:18:38.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.622+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~P3Y7V7HIIXNB.0 size=1048576 2024-09-12T17:18:38.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.622+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~P3Y7V7HIIXNB.1 size=908696 2024-09-12T17:18:38.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.622+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=P3Y7V7HIIXNB tag=JWKUK6SVIMS7 type=write size=3005848 2024-09-12T17:18:38.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.626+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~SGOACXI7CR5U.0 size=1048576 2024-09-12T17:18:38.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.626+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~SGOACXI7CR5U.1 size=959683 2024-09-12T17:18:38.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.630+0000 7f96641d38c0 1 < completed multipart upload key=NGA3P9RZJYWT upload=SGOACXI7CR5U tag=YY4RYNFCQ1V3 type=write size=3056835 2024-09-12T17:18:38.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.638+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~EHJBX93OOGE5.0 size=1048576 2024-09-12T17:18:38.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.638+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~EHJBX93OOGE5.1 size=1048576 2024-09-12T17:18:38.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.642+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~EHJBX93OOGE5.2 size=983319 2024-09-12T17:18:38.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.642+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=EHJBX93OOGE5 tag=YLOCERJMXONV type=write size=4129047 2024-09-12T17:18:38.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.646+0000 7f96641d38c0 1 < suggested update operation key=NG327LT02T1F tag=Y11W4TL4XXPF type=del size=1626562 2024-09-12T17:18:38.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.650+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=DWZ0ESC4CNQD type=del size=2844718 2024-09-12T17:18:38.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.650+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=HFCO5LNGOFMO type=del 2024-09-12T17:18:38.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.654+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=CTI740JSXR7G type=del size=1428374 2024-09-12T17:18:38.658 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.658+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=QAGCYHKBSN6Z type=del 2024-09-12T17:18:38.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.662+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~C9HL8N05DH6B.0 size=1048576 2024-09-12T17:18:38.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.662+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~C9HL8N05DH6B.1 size=1048576 2024-09-12T17:18:38.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.666+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~C9HL8N05DH6B.2 size=587891 2024-09-12T17:18:38.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.666+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=C9HL8N05DH6B tag=5UNVOGVYUNKL type=write size=3733619 2024-09-12T17:18:38.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.670+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~PKUVRRT2XYE8.0 size=1048576 2024-09-12T17:18:38.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.670+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~PKUVRRT2XYE8.1 size=636924 2024-09-12T17:18:38.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.678+0000 7f96641d38c0 1 < completed multipart upload key=G7CWVD9C2H2J upload=PKUVRRT2XYE8 tag=JQ5ESK86PXWG type=write size=2734076 2024-09-12T17:18:38.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.682+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=BDVRRWW7G316 type=del size=3788720 2024-09-12T17:18:38.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.686+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~O3OGYYJEMK4D.0 size=1048576 2024-09-12T17:18:38.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.686+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~O3OGYYJEMK4D.1 size=1048576 2024-09-12T17:18:38.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.690+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~O3OGYYJEMK4D.2 size=81045 2024-09-12T17:18:38.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.694+0000 7f96641d38c0 1 < completed multipart upload key=2TN3M8NKV9LN upload=O3OGYYJEMK4D tag=Q3373TUP9WOS type=write size=3226773 2024-09-12T17:18:38.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.698+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~QBK03HG5YC3S.0 size=1048576 2024-09-12T17:18:38.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.702+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~QBK03HG5YC3S.1 size=114196 2024-09-12T17:18:38.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.702+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=QBK03HG5YC3S tag=F2NQ3SJLLRO6 type=write size=2211348 2024-09-12T17:18:38.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.706+0000 7f96641d38c0 1 < completed write operation key=EFORFJYOM45R tag=K5HS7982Y4K0 type=write size=959670 2024-09-12T17:18:38.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.710+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~3AGVUS1U87EJ.0 size=1048576 2024-09-12T17:18:38.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.710+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~3AGVUS1U87EJ.1 size=1048576 2024-09-12T17:18:38.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.714+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~3AGVUS1U87EJ.2 size=113621 2024-09-12T17:18:38.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.714+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=3AGVUS1U87EJ tag=TK4492BTBBY4 type=write size=3259349 2024-09-12T17:18:38.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.714+0000 7f96641d38c0 1 < canceled part key=_multipart_2TN3M8NKV9LN.2~6STEMHPADWN8.0 size=1048576 2024-09-12T17:18:38.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.714+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~6STEMHPADWN8.1 size=784966 2024-09-12T17:18:38.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.722+0000 7f96641d38c0 1 < canceled multipart upload key=2TN3M8NKV9LN upload=6STEMHPADWN8 tag=2CJCMC9LSVX3 type=write size=2882118 2024-09-12T17:18:38.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.722+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=QWPSO15VY6MK type=del size=3087460 2024-09-12T17:18:38.727 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.726+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~4518L7CPLMWH.0 size=752199 2024-09-12T17:18:38.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.730+0000 7f96641d38c0 1 < completed multipart upload key=XDL9O7TEMBYF upload=4518L7CPLMWH tag=71G13FJYVBUT type=write size=1800775 2024-09-12T17:18:38.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.734+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~M9XOUKYXPE3Y.0 size=1048576 2024-09-12T17:18:38.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.738+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~M9XOUKYXPE3Y.1 size=1048576 2024-09-12T17:18:38.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.738+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~M9XOUKYXPE3Y.2 size=82793 2024-09-12T17:18:38.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.738+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=M9XOUKYXPE3Y tag=8KMGI3XWY9VF type=write size=3228521 2024-09-12T17:18:38.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.742+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=ZDLMKCPAUMXI type=del 2024-09-12T17:18:38.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.742+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=BAGYJPLUFJQ2 type=write size=96053 2024-09-12T17:18:38.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.746+0000 7f96641d38c0 1 < suggested update operation key=XTVZIXTEES2O tag=81W0R0CR43RU type=write size=549270 2024-09-12T17:18:38.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.754+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~4CIH28BBHERU.0 size=1048576 2024-09-12T17:18:38.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.754+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~4CIH28BBHERU.1 size=1048576 2024-09-12T17:18:38.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.758+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~4CIH28BBHERU.2 size=189159 2024-09-12T17:18:38.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.758+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=4CIH28BBHERU tag=HZPD1QG2MNF2 type=write size=3334887 2024-09-12T17:18:38.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.762+0000 7f96641d38c0 1 < suggested update operation key=ZKDOIH5SH6K0 tag=M5JJURLJPI41 type=write size=103617 2024-09-12T17:18:38.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.762+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=9F1KG2APORN5 type=del size=2697545 2024-09-12T17:18:38.770 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.770+0000 7f96641d38c0 1 < suggested remove operation key=H3LV5G117KOW tag=R7E1E6TYIO6M type=write 2024-09-12T17:18:38.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.774+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~LMRFAGHQCK45.0 size=1048576 2024-09-12T17:18:38.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.774+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~LMRFAGHQCK45.1 size=1048576 2024-09-12T17:18:38.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.778+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~LMRFAGHQCK45.2 size=562853 2024-09-12T17:18:38.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.778+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=LMRFAGHQCK45 tag=X7WTDJAMPKIL type=write size=3708581 2024-09-12T17:18:38.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.778+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=RT4BPUG0S25X type=del 2024-09-12T17:18:38.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.782+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~8FX3WSCYDHH7.0 size=908811 2024-09-12T17:18:38.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.782+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=8FX3WSCYDHH7 tag=RHRSW8QZDWMT type=write size=1957387 2024-09-12T17:18:38.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.786+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~W5TM50HBI5QC.0 size=1048576 2024-09-12T17:18:38.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.786+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~W5TM50HBI5QC.1 size=1048576 2024-09-12T17:18:38.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.790+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~W5TM50HBI5QC.2 size=727104 2024-09-12T17:18:38.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.794+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=W5TM50HBI5QC tag=5CPMR0GZC740 type=write size=3872832 2024-09-12T17:18:38.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.798+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~1SYPEPTHIGSO.0 size=1048576 2024-09-12T17:18:38.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.802+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~1SYPEPTHIGSO.1 size=502368 2024-09-12T17:18:38.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.802+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=1SYPEPTHIGSO tag=VO911N3W9S0J type=write size=2599520 2024-09-12T17:18:38.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.802+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~P3Y7V7HIIXNB.0 size=1048576 2024-09-12T17:18:38.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.806+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~P3Y7V7HIIXNB.1 size=908696 2024-09-12T17:18:38.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.810+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=P3Y7V7HIIXNB tag=JWKUK6SVIMS7 type=write size=3005848 2024-09-12T17:18:38.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.814+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~QAKVTQH10QGA.0 size=1048576 2024-09-12T17:18:38.816 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.814+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~QAKVTQH10QGA.1 size=1048576 2024-09-12T17:18:38.818 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.818+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~QAKVTQH10QGA.2 size=223807 2024-09-12T17:18:38.818 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.818+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=QAKVTQH10QGA tag=4NUY8R5SHO59 type=write size=3369535 2024-09-12T17:18:38.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.818+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~EHJBX93OOGE5.0 size=1048576 2024-09-12T17:18:38.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.822+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~EHJBX93OOGE5.1 size=1048576 2024-09-12T17:18:38.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.822+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~EHJBX93OOGE5.2 size=983319 2024-09-12T17:18:38.830 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.830+0000 7f96641d38c0 1 < completed multipart upload key=3SLNHJT3A1K1 upload=EHJBX93OOGE5 tag=YLOCERJMXONV type=write size=4129047 2024-09-12T17:18:38.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.834+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~3SPLE0H8D2RO.0 size=1048576 2024-09-12T17:18:38.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.834+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~3SPLE0H8D2RO.1 size=1048576 2024-09-12T17:18:38.839 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.838+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~3SPLE0H8D2RO.2 size=117547 2024-09-12T17:18:38.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.838+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=3SPLE0H8D2RO tag=0OE0SDG25ZJJ type=write size=3263275 2024-09-12T17:18:38.843 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.842+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=DWZ0ESC4CNQD type=del 2024-09-12T17:18:38.846 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.846+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=VQ3V8S7FY2KW type=del size=2278663 2024-09-12T17:18:38.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.846+0000 7f96641d38c0 -1 < failed to complete operation key=XTVZIXTEES2O tag=CTI740JSXR7G type=del size=1428374: (22) Invalid argument 2024-09-12T17:18:38.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.850+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~GORDZ0CE6N4R.0 size=775771 2024-09-12T17:18:38.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.850+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=GORDZ0CE6N4R tag=LXYQXPEPNDWI type=write size=1824347 2024-09-12T17:18:38.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.854+0000 7f96641d38c0 1 < canceled part key=_multipart_RSVQJS9F1FR7.2~C9HL8N05DH6B.0 size=1048576 2024-09-12T17:18:38.856 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.854+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~C9HL8N05DH6B.1 size=1048576 2024-09-12T17:18:38.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.858+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~C9HL8N05DH6B.2 size=587891 2024-09-12T17:18:38.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.862+0000 7f96641d38c0 1 < canceled multipart upload key=RSVQJS9F1FR7 upload=C9HL8N05DH6B tag=5UNVOGVYUNKL type=write size=3733619 2024-09-12T17:18:38.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.862+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=UUPXD71QEQLM type=del size=2539314 2024-09-12T17:18:38.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.866+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=BDVRRWW7G316 type=del 2024-09-12T17:18:38.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.870+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=7RPNI0AUH269 type=del size=361863 2024-09-12T17:18:38.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.874+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~QBK03HG5YC3S.0 size=1048576 2024-09-12T17:18:38.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.874+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~QBK03HG5YC3S.1 size=114196 2024-09-12T17:18:38.882 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.882+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=QBK03HG5YC3S tag=F2NQ3SJLLRO6 type=write size=2211348 2024-09-12T17:18:38.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.886+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~FVC65V35LC13.0 size=722119 2024-09-12T17:18:38.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.886+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=FVC65V35LC13 tag=434D12895VD1 type=write size=1770695 2024-09-12T17:18:38.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.890+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~3AGVUS1U87EJ.0 size=1048576 2024-09-12T17:18:38.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.890+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~3AGVUS1U87EJ.1 size=1048576 2024-09-12T17:18:38.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.894+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~3AGVUS1U87EJ.2 size=113621 2024-09-12T17:18:38.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.898+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=3AGVUS1U87EJ tag=TK4492BTBBY4 type=write size=3259349 2024-09-12T17:18:38.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.902+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=A4EN07IBO58Y type=del size=2722146 2024-09-12T17:18:38.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.906+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=QWPSO15VY6MK type=del 2024-09-12T17:18:38.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.910+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~EYV1NY0Z8N3Y.0 size=25184 2024-09-12T17:18:38.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.910+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=EYV1NY0Z8N3Y tag=2Y45L0R12R9X type=write size=1073760 2024-09-12T17:18:38.914 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.914+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~M9XOUKYXPE3Y.0 size=1048576 2024-09-12T17:18:38.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.914+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~M9XOUKYXPE3Y.1 size=1048576 2024-09-12T17:18:38.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.918+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~M9XOUKYXPE3Y.2 size=82793 2024-09-12T17:18:38.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.922+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=M9XOUKYXPE3Y tag=8KMGI3XWY9VF type=write size=3228521 2024-09-12T17:18:38.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.926+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=BEMMI6AUC76A type=del size=4136797 2024-09-12T17:18:38.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.930+0000 7f96641d38c0 1 < suggested update operation key=NGA3P9RZJYWT tag=BAGYJPLUFJQ2 type=write size=96053 2024-09-12T17:18:38.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.934+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~NFZUE33U3Y8C.0 size=1048576 2024-09-12T17:18:38.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.934+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~NFZUE33U3Y8C.1 size=729939 2024-09-12T17:18:38.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.934+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=NFZUE33U3Y8C tag=D6IYT6DWO4U6 type=write size=2827091 2024-09-12T17:18:38.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.938+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~4CIH28BBHERU.0 size=1048576 2024-09-12T17:18:38.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.938+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~4CIH28BBHERU.1 size=1048576 2024-09-12T17:18:38.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.942+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~4CIH28BBHERU.2 size=189159 2024-09-12T17:18:38.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.946+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=4CIH28BBHERU tag=HZPD1QG2MNF2 type=write size=3334887 2024-09-12T17:18:38.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.946+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=T4TRAK43JMCW type=write size=411337 2024-09-12T17:18:38.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.950+0000 7f96641d38c0 1 < canceled operation key=XTVZIXTEES2O tag=9F1KG2APORN5 type=del size=2697545 2024-09-12T17:18:38.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.950+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=9JH3MNQ2P7OG type=del size=1512869 2024-09-12T17:18:38.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.954+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~LMRFAGHQCK45.0 size=1048576 2024-09-12T17:18:38.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.954+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~LMRFAGHQCK45.1 size=1048576 2024-09-12T17:18:38.958 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.954+0000 7f96641d38c0 1 < canceled part key=_multipart_DHODPSZ7Z0D4.2~LMRFAGHQCK45.2 size=562853 2024-09-12T17:18:38.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.958+0000 7f96641d38c0 1 < canceled multipart upload key=DHODPSZ7Z0D4 upload=LMRFAGHQCK45 tag=X7WTDJAMPKIL type=write size=3708581 2024-09-12T17:18:38.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.962+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=7W5ZNWDUPGLW type=write size=12515 2024-09-12T17:18:38.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.962+0000 7f96641d38c0 1 < canceled part key=_multipart_47QQRTJKM4DB.2~8FX3WSCYDHH7.0 size=908811 2024-09-12T17:18:38.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.966+0000 7f96641d38c0 1 < canceled multipart upload key=47QQRTJKM4DB upload=8FX3WSCYDHH7 tag=RHRSW8QZDWMT type=write size=1957387 2024-09-12T17:18:38.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.970+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=85NW14KPNAYC type=del size=627316 2024-09-12T17:18:38.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.970+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~1SYPEPTHIGSO.0 size=1048576 2024-09-12T17:18:38.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.970+0000 7f96641d38c0 1 < canceled part key=_multipart_XTVZIXTEES2O.2~1SYPEPTHIGSO.1 size=502368 2024-09-12T17:18:38.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.974+0000 7f96641d38c0 1 < canceled multipart upload key=XTVZIXTEES2O upload=1SYPEPTHIGSO tag=VO911N3W9S0J type=write size=2599520 2024-09-12T17:18:38.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.982+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~T831QATLES0M.0 size=1048576 2024-09-12T17:18:38.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.982+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~T831QATLES0M.1 size=1048576 2024-09-12T17:18:38.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.982+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~T831QATLES0M.2 size=3687 2024-09-12T17:18:38.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.982+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=T831QATLES0M tag=W0FBL5320WTX type=write size=3149415 2024-09-12T17:18:38.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.986+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~QAKVTQH10QGA.0 size=1048576 2024-09-12T17:18:38.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.990+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~QAKVTQH10QGA.1 size=1048576 2024-09-12T17:18:38.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.990+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~QAKVTQH10QGA.2 size=223807 2024-09-12T17:18:38.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.994+0000 7f96641d38c0 1 < completed multipart upload key=3SLNHJT3A1K1 upload=QAKVTQH10QGA tag=4NUY8R5SHO59 type=write size=3369535 2024-09-12T17:18:39.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.998+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~N4YLMRD27JQ4.0 size=834199 2024-09-12T17:18:39.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:38.998+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=N4YLMRD27JQ4 tag=0T35J4YLQN8N type=write size=1882775 2024-09-12T17:18:39.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.002+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~3SPLE0H8D2RO.0 size=1048576 2024-09-12T17:18:39.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.006+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~3SPLE0H8D2RO.1 size=1048576 2024-09-12T17:18:39.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.006+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~3SPLE0H8D2RO.2 size=117547 2024-09-12T17:18:39.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.010+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=3SPLE0H8D2RO tag=0OE0SDG25ZJJ type=write size=3263275 2024-09-12T17:18:39.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.018+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~GORRLCGBPOM5.0 size=536735 2024-09-12T17:18:39.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.018+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=GORRLCGBPOM5 tag=GRJ410VZ7MWY type=write size=1585311 2024-09-12T17:18:39.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.018+0000 7f96641d38c0 1 < canceled operation key=ZKDOIH5SH6K0 tag=VQ3V8S7FY2KW type=del size=2278663 2024-09-12T17:18:39.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.022+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=N8BH3UV3WJ2U type=del size=4010261 2024-09-12T17:18:39.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.026+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~GORDZ0CE6N4R.0 size=775771 2024-09-12T17:18:39.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.030+0000 7f96641d38c0 1 < completed multipart upload key=47QQRTJKM4DB upload=GORDZ0CE6N4R tag=LXYQXPEPNDWI type=write size=1824347 2024-09-12T17:18:39.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.034+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=QJPXMGC8AMEJ type=del size=3291420 2024-09-12T17:18:39.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.038+0000 7f96641d38c0 1 < suggested remove operation key=MOQXP4AXMTCK tag=UUPXD71QEQLM type=del 2024-09-12T17:18:39.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.042+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=10DTHGIBVND4 type=del size=1753611 2024-09-12T17:18:39.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.050+0000 7f96641d38c0 1 < suggested update operation key=9CBFWXFX7O3N tag=7RPNI0AUH269 type=del size=361863 2024-09-12T17:18:39.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.054+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=MVYY7AH8RAYO type=del size=394173 2024-09-12T17:18:39.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.054+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~FVC65V35LC13.0 size=722119 2024-09-12T17:18:39.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.062+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=FVC65V35LC13 tag=434D12895VD1 type=write size=1770695 2024-09-12T17:18:39.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.066+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=VF24S7L8WFLX type=del size=2403412 2024-09-12T17:18:39.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.070+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=A4EN07IBO58Y type=del 2024-09-12T17:18:39.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.074+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=K1AO4M1S25CK type=del size=2534036 2024-09-12T17:18:39.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.078+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~EYV1NY0Z8N3Y.0 size=25184 2024-09-12T17:18:39.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.082+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=EYV1NY0Z8N3Y tag=2Y45L0R12R9X type=write size=1073760 2024-09-12T17:18:39.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.090+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~KEXERR4FXOU2.0 size=1048576 2024-09-12T17:18:39.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.090+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~KEXERR4FXOU2.1 size=62831 2024-09-12T17:18:39.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.090+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=KEXERR4FXOU2 tag=519F4KT8TQYW type=write size=2159983 2024-09-12T17:18:39.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.094+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=BEMMI6AUC76A type=del 2024-09-12T17:18:39.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.098+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~FP8ALEYJHF4B.0 size=761763 2024-09-12T17:18:39.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.098+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=FP8ALEYJHF4B tag=RAW9D6GK84V7 type=write size=1810339 2024-09-12T17:18:39.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.098+0000 7f96641d38c0 1 < canceled part key=_multipart_6BH7SI911MMP.2~NFZUE33U3Y8C.0 size=1048576 2024-09-12T17:18:39.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.102+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~NFZUE33U3Y8C.1 size=729939 2024-09-12T17:18:39.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.106+0000 7f96641d38c0 1 < canceled multipart upload key=6BH7SI911MMP upload=NFZUE33U3Y8C tag=D6IYT6DWO4U6 type=write size=2827091 2024-09-12T17:18:39.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.110+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~XP97PCBH4WY0.0 size=488627 2024-09-12T17:18:39.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.110+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=XP97PCBH4WY0 tag=NAMPFDJGZXWE type=write size=1537203 2024-09-12T17:18:39.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.114+0000 7f96641d38c0 1 < completed write operation key=G7CWVD9C2H2J tag=T4TRAK43JMCW type=write size=411337 2024-09-12T17:18:39.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.118+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~N08KWHWJ8S00.0 size=722255 2024-09-12T17:18:39.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.118+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=N08KWHWJ8S00 tag=AZ1FMMPRQQ0P type=write size=1770831 2024-09-12T17:18:39.124 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.122+0000 7f96641d38c0 1 < canceled operation key=5ZZI4F92J7BO tag=9JH3MNQ2P7OG type=del size=1512869 2024-09-12T17:18:39.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.126+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~7TWK2R3M1CM8.0 size=1048576 2024-09-12T17:18:39.132 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.130+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~7TWK2R3M1CM8.1 size=926856 2024-09-12T17:18:39.132 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.130+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=7TWK2R3M1CM8 tag=QYNLCPSKGG4A type=write size=3024008 2024-09-12T17:18:39.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.134+0000 7f96641d38c0 1 < completed write operation key=HRU241T0FUEZ tag=7W5ZNWDUPGLW type=write size=12515 2024-09-12T17:18:39.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.138+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=2WIXDUJ6108X type=del size=777196 2024-09-12T17:18:39.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.142+0000 7f96641d38c0 1 < suggested remove operation key=H3J23KLT1VUT tag=85NW14KPNAYC type=del 2024-09-12T17:18:39.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.146+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~O2RE1SIJH9P1.0 size=697383 2024-09-12T17:18:39.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.146+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=O2RE1SIJH9P1 tag=WYWJ3DJ97SD4 type=write size=1745959 2024-09-12T17:18:39.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.150+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~T831QATLES0M.0 size=1048576 2024-09-12T17:18:39.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.150+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~T831QATLES0M.1 size=1048576 2024-09-12T17:18:39.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.154+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~T831QATLES0M.2 size=3687 2024-09-12T17:18:39.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.158+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=T831QATLES0M tag=W0FBL5320WTX type=write size=3149415 2024-09-12T17:18:39.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.162+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=OCCU67VIR3GO type=del size=1688142 2024-09-12T17:18:39.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.166+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~N4YLMRD27JQ4.0 size=834199 2024-09-12T17:18:39.172 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.170+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=N4YLMRD27JQ4 tag=0T35J4YLQN8N type=write size=1882775 2024-09-12T17:18:39.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.174+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~T6RXX0BS06K3.0 size=1048576 2024-09-12T17:18:39.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.178+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~T6RXX0BS06K3.1 size=1048576 2024-09-12T17:18:39.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.182+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~T6RXX0BS06K3.2 size=550008 2024-09-12T17:18:39.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.182+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=T6RXX0BS06K3 tag=RKGE8AEJ001C type=write size=3695736 2024-09-12T17:18:39.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.182+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~GORRLCGBPOM5.0 size=536735 2024-09-12T17:18:39.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.186+0000 7f96641d38c0 1 < completed multipart upload key=37YXLWPZGA9J upload=GORRLCGBPOM5 tag=GRJ410VZ7MWY type=write size=1585311 2024-09-12T17:18:39.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.190+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=ARX2PP3A6WHM type=del size=3634473 2024-09-12T17:18:39.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.198+0000 7f96641d38c0 1 < suggested remove operation key=2TN3M8NKV9LN tag=N8BH3UV3WJ2U type=del 2024-09-12T17:18:39.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.202+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=8N2NPVSB0MX0 type=write size=106680 2024-09-12T17:18:39.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.206+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=QJPXMGC8AMEJ type=del 2024-09-12T17:18:39.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.210+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=FPM9V81FZQGK type=del size=3391186 2024-09-12T17:18:39.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.210+0000 7f96641d38c0 -1 < no bi entry to suggest for operation key=H3J23KLT1VUT tag=10DTHGIBVND4 type=del size=1753611: (2) No such file or directory 2024-09-12T17:18:39.215 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.214+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=VSTSIN6ONTKH type=del size=2501268 2024-09-12T17:18:39.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.218+0000 7f96641d38c0 1 < suggested remove operation key=XDL9O7TEMBYF tag=MVYY7AH8RAYO type=del 2024-09-12T17:18:39.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.226+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~LMP3EV7POEXO.0 size=1048576 2024-09-12T17:18:39.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.230+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~LMP3EV7POEXO.1 size=478463 2024-09-12T17:18:39.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.230+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=LMP3EV7POEXO tag=XI3N650DG7CV type=write size=2575615 2024-09-12T17:18:39.234 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.234+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=VF24S7L8WFLX type=del 2024-09-12T17:18:39.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.234+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=Z4PJ0PI9OU1N type=del size=2187320 2024-09-12T17:18:39.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.238+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=K1AO4M1S25CK type=del 2024-09-12T17:18:39.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.242+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=UT8E9MIGF48D type=del size=2632792 2024-09-12T17:18:39.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.246+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~KEXERR4FXOU2.0 size=1048576 2024-09-12T17:18:39.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.250+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~KEXERR4FXOU2.1 size=62831 2024-09-12T17:18:39.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.254+0000 7f96641d38c0 1 < completed multipart upload key=3SLNHJT3A1K1 upload=KEXERR4FXOU2 tag=519F4KT8TQYW type=write size=2159983 2024-09-12T17:18:39.259 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.258+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=A168YKKW2QPB type=del size=1334829 2024-09-12T17:18:39.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.262+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~FP8ALEYJHF4B.0 size=761763 2024-09-12T17:18:39.268 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.266+0000 7f96641d38c0 1 < completed multipart upload key=NGA3P9RZJYWT upload=FP8ALEYJHF4B tag=RAW9D6GK84V7 type=write size=1810339 2024-09-12T17:18:39.270 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.270+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=HT1DOETHOVZ0 type=del size=1159978 2024-09-12T17:18:39.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.270+0000 7f96641d38c0 1 < canceled part key=_multipart_5ZZI4F92J7BO.2~XP97PCBH4WY0.0 size=488627 2024-09-12T17:18:39.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.274+0000 7f96641d38c0 1 < canceled multipart upload key=5ZZI4F92J7BO upload=XP97PCBH4WY0 tag=NAMPFDJGZXWE type=write size=1537203 2024-09-12T17:18:39.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.278+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=ZFS6JAX69M86 type=del size=4176469 2024-09-12T17:18:39.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.282+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~N08KWHWJ8S00.0 size=722255 2024-09-12T17:18:39.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.286+0000 7f96641d38c0 1 < completed multipart upload key=G7CWVD9C2H2J upload=N08KWHWJ8S00 tag=AZ1FMMPRQQ0P type=write size=1770831 2024-09-12T17:18:39.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.290+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~X9QVXQNNIQBI.0 size=1048576 2024-09-12T17:18:39.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.294+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~X9QVXQNNIQBI.1 size=931596 2024-09-12T17:18:39.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.294+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=X9QVXQNNIQBI tag=G9ZCTY3IJJ60 type=write size=3028748 2024-09-12T17:18:39.297 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.294+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~7TWK2R3M1CM8.0 size=1048576 2024-09-12T17:18:39.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.294+0000 7f96641d38c0 1 < canceled part key=_multipart_DHODPSZ7Z0D4.2~7TWK2R3M1CM8.1 size=926856 2024-09-12T17:18:39.303 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.302+0000 7f96641d38c0 1 < canceled multipart upload key=DHODPSZ7Z0D4 upload=7TWK2R3M1CM8 tag=QYNLCPSKGG4A type=write size=3024008 2024-09-12T17:18:39.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.306+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=KFH5ST2B5O3O type=del size=3455261 2024-09-12T17:18:39.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.306+0000 7f96641d38c0 1 < completed delete operation key=KXJYJ9VX7YVW tag=2WIXDUJ6108X type=del 2024-09-12T17:18:39.313 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.310+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=9RDGZCE2UOEP type=write size=1035654 2024-09-12T17:18:39.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.314+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~O2RE1SIJH9P1.0 size=697383 2024-09-12T17:18:39.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.318+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=O2RE1SIJH9P1 tag=WYWJ3DJ97SD4 type=write size=1745959 2024-09-12T17:18:39.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.322+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=JIXUO0QFYQWA type=write size=885101 2024-09-12T17:18:39.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.326+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=OCCU67VIR3GO type=del 2024-09-12T17:18:39.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.330+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=69BZBFFVU33C type=del size=2041716 2024-09-12T17:18:39.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.334+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~T6RXX0BS06K3.0 size=1048576 2024-09-12T17:18:39.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.338+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~T6RXX0BS06K3.1 size=1048576 2024-09-12T17:18:39.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.338+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~T6RXX0BS06K3.2 size=550008 2024-09-12T17:18:39.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.346+0000 7f96641d38c0 1 < completed multipart upload key=37YXLWPZGA9J upload=T6RXX0BS06K3 tag=RKGE8AEJ001C type=write size=3695736 2024-09-12T17:18:39.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.350+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=4SSDG2RHCHP3 type=del size=3972822 2024-09-12T17:18:39.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.354+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=ARX2PP3A6WHM type=del 2024-09-12T17:18:39.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.354+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=BSYTXLLRPY1N type=del size=1871966 2024-09-12T17:18:39.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.358+0000 7f96641d38c0 1 < completed write operation key=3SLNHJT3A1K1 tag=8N2NPVSB0MX0 type=write size=106680 2024-09-12T17:18:39.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.366+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~1XSMT9INMRL7.0 size=1048576 2024-09-12T17:18:39.369 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.366+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~1XSMT9INMRL7.1 size=1048576 2024-09-12T17:18:39.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.370+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~1XSMT9INMRL7.2 size=786427 2024-09-12T17:18:39.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.370+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=1XSMT9INMRL7 tag=8ZP1W4I6DL2T type=write size=3932155 2024-09-12T17:18:39.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.374+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=FPM9V81FZQGK type=del 2024-09-12T17:18:39.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.378+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=5IVZD5SWEZTR type=del size=1590807 2024-09-12T17:18:39.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.382+0000 7f96641d38c0 1 < canceled operation key=NGA3P9RZJYWT tag=VSTSIN6ONTKH type=del size=2501268 2024-09-12T17:18:39.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.386+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=91E44IM8QG38 type=del size=1671668 2024-09-12T17:18:39.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.386+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~LMP3EV7POEXO.0 size=1048576 2024-09-12T17:18:39.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.386+0000 7f96641d38c0 1 < canceled part key=_multipart_37YXLWPZGA9J.2~LMP3EV7POEXO.1 size=478463 2024-09-12T17:18:39.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.394+0000 7f96641d38c0 1 < canceled multipart upload key=37YXLWPZGA9J upload=LMP3EV7POEXO tag=XI3N650DG7CV type=write size=2575615 2024-09-12T17:18:39.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.398+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=CZGYBZM5VG09 type=write size=745940 2024-09-12T17:18:39.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.402+0000 7f96641d38c0 1 < suggested remove operation key=6BH7SI911MMP tag=Z4PJ0PI9OU1N type=del 2024-09-12T17:18:39.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.410+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~AJ9MAAM4IOTR.0 size=718200 2024-09-12T17:18:39.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.410+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=AJ9MAAM4IOTR tag=D1AV273GQINU type=write size=1766776 2024-09-12T17:18:39.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.414+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=UT8E9MIGF48D type=del 2024-09-12T17:18:39.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.418+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~2Q0IHZSHIADP.0 size=462831 2024-09-12T17:18:39.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.418+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=2Q0IHZSHIADP tag=XR2JJFXR6927 type=write size=1511407 2024-09-12T17:18:39.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.422+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=A168YKKW2QPB type=del 2024-09-12T17:18:39.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.426+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=OXKVHJOUZK73 type=del size=3412439 2024-09-12T17:18:39.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.434+0000 7f96641d38c0 1 < suggested remove operation key=RSVQJS9F1FR7 tag=HT1DOETHOVZ0 type=del 2024-09-12T17:18:39.442 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.442+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~60P9SHP3L7QG.0 size=618507 2024-09-12T17:18:39.442 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.442+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=60P9SHP3L7QG tag=QCF7143M13Y0 type=write size=1667083 2024-09-12T17:18:39.449 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.446+0000 7f96641d38c0 1 < suggested update operation key=DHODPSZ7Z0D4 tag=ZFS6JAX69M86 type=del size=4176469 2024-09-12T17:18:39.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.454+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~RS2RZLBBLE0W.0 size=930443 2024-09-12T17:18:39.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.454+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=RS2RZLBBLE0W tag=NDGWCZRUTKQR type=write size=1979019 2024-09-12T17:18:39.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.458+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~X9QVXQNNIQBI.0 size=1048576 2024-09-12T17:18:39.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.458+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~X9QVXQNNIQBI.1 size=931596 2024-09-12T17:18:39.467 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.466+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=X9QVXQNNIQBI tag=G9ZCTY3IJJ60 type=write size=3028748 2024-09-12T17:18:39.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.470+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~71WSREVET53Z.0 size=701789 2024-09-12T17:18:39.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.470+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=71WSREVET53Z tag=ZRM1IQTJV7N6 type=write size=1750365 2024-09-12T17:18:39.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.478+0000 7f96641d38c0 1 < suggested update operation key=GKJJDBNXC6QH tag=KFH5ST2B5O3O type=del size=3455261 2024-09-12T17:18:39.489 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.486+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~XZNZ54W7Y3R5.0 size=1048576 2024-09-12T17:18:39.491 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.490+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~XZNZ54W7Y3R5.1 size=993731 2024-09-12T17:18:39.491 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.490+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=XZNZ54W7Y3R5 tag=JMAVCB9F5C8E type=write size=3090883 2024-09-12T17:18:39.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.494+0000 7f96641d38c0 1 < suggested remove operation key=G7CWVD9C2H2J tag=9RDGZCE2UOEP type=write 2024-09-12T17:18:39.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.502+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~DFB8AP6QGG31.0 size=1048576 2024-09-12T17:18:39.506 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.506+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~DFB8AP6QGG31.1 size=1048576 2024-09-12T17:18:39.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.506+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~DFB8AP6QGG31.2 size=42581 2024-09-12T17:18:39.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.506+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=DFB8AP6QGG31 tag=BYXB12ZA4J0Q type=write size=3188309 2024-09-12T17:18:39.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.510+0000 7f96641d38c0 1 < completed write operation key=47QQRTJKM4DB tag=JIXUO0QFYQWA type=write size=885101 2024-09-12T17:18:39.518 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.518+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~DSRL44P5ZTHQ.0 size=958691 2024-09-12T17:18:39.518 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.518+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=DSRL44P5ZTHQ tag=KB1M1JL2O42X type=write size=2007267 2024-09-12T17:18:39.521 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.518+0000 7f96641d38c0 -1 < failed to complete operation key=DHODPSZ7Z0D4 tag=69BZBFFVU33C type=del size=2041716: (22) Invalid argument 2024-09-12T17:18:39.524 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.522+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=P9SAJQFY2JEP type=del size=2526267 2024-09-12T17:18:39.531 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.530+0000 7f96641d38c0 1 < suggested remove operation key=UBYUSW4C2V19 tag=4SSDG2RHCHP3 type=del 2024-09-12T17:18:39.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.534+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~XFMMWVHRY37G.0 size=1048576 2024-09-12T17:18:39.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.538+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~XFMMWVHRY37G.1 size=536258 2024-09-12T17:18:39.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.538+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=XFMMWVHRY37G tag=HR9J9D3XNEWI type=write size=2633410 2024-09-12T17:18:39.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.542+0000 7f96641d38c0 -1 < failed to complete operation key=UBYUSW4C2V19 tag=BSYTXLLRPY1N type=del size=1871966: (22) Invalid argument 2024-09-12T17:18:39.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.546+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=E2AO1YTRK3DR type=del size=2039725 2024-09-12T17:18:39.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.546+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~1XSMT9INMRL7.0 size=1048576 2024-09-12T17:18:39.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.550+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~1XSMT9INMRL7.1 size=1048576 2024-09-12T17:18:39.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.554+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~1XSMT9INMRL7.2 size=786427 2024-09-12T17:18:39.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.558+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=1XSMT9INMRL7 tag=8ZP1W4I6DL2T type=write size=3932155 2024-09-12T17:18:39.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.562+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~H4E12D0O9A6O.0 size=1048576 2024-09-12T17:18:39.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.566+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~H4E12D0O9A6O.1 size=1048576 2024-09-12T17:18:39.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.570+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~H4E12D0O9A6O.2 size=13322 2024-09-12T17:18:39.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.570+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=H4E12D0O9A6O tag=J9DBOGB8PHC9 type=write size=3159050 2024-09-12T17:18:39.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.570+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=5IVZD5SWEZTR type=del 2024-09-12T17:18:39.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.578+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~DWZUJ7CTRQTJ.0 size=1048576 2024-09-12T17:18:39.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.578+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~DWZUJ7CTRQTJ.1 size=180836 2024-09-12T17:18:39.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.578+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=DWZUJ7CTRQTJ tag=YE5EFOKP54N3 type=write size=2277988 2024-09-12T17:18:39.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.582+0000 7f96641d38c0 -1 < no bi entry to suggest for operation key=UBYUSW4C2V19 tag=91E44IM8QG38 type=del size=1671668: (2) No such file or directory 2024-09-12T17:18:39.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.586+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~TCR1S5DE2QEC.0 size=1048576 2024-09-12T17:18:39.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.586+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~TCR1S5DE2QEC.1 size=67197 2024-09-12T17:18:39.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.586+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=TCR1S5DE2QEC tag=D7XCPTRSQWPL type=write size=2164349 2024-09-12T17:18:39.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.590+0000 7f96641d38c0 1 < completed write operation key=BDI9YFZCT5YY tag=CZGYBZM5VG09 type=write size=745940 2024-09-12T17:18:39.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.594+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=LO31K798B4V9 type=del size=2189595 2024-09-12T17:18:39.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.598+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~AJ9MAAM4IOTR.0 size=718200 2024-09-12T17:18:39.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.602+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=AJ9MAAM4IOTR tag=D1AV273GQINU type=write size=1766776 2024-09-12T17:18:39.609 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.606+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~BO42XY2XGQA1.0 size=1048576 2024-09-12T17:18:39.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.610+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~BO42XY2XGQA1.1 size=273235 2024-09-12T17:18:39.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.610+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=BO42XY2XGQA1 tag=7J9693QUB1ZZ type=write size=2370387 2024-09-12T17:18:39.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.610+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~2Q0IHZSHIADP.0 size=462831 2024-09-12T17:18:39.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.618+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=2Q0IHZSHIADP tag=XR2JJFXR6927 type=write size=1511407 2024-09-12T17:18:39.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.618+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=IERWSUWEARXU type=write size=31608 2024-09-12T17:18:39.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.622+0000 7f96641d38c0 -1 < failed to complete operation key=GKJJDBNXC6QH tag=OXKVHJOUZK73 type=del size=3412439: (22) Invalid argument 2024-09-12T17:18:39.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.626+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=4E42EA2LWDIG type=write size=50954 2024-09-12T17:18:39.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.626+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~60P9SHP3L7QG.0 size=618507 2024-09-12T17:18:39.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.630+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=60P9SHP3L7QG tag=QCF7143M13Y0 type=write size=1667083 2024-09-12T17:18:39.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.634+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=MTXSJ3IP8PQY type=del size=2866558 2024-09-12T17:18:39.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.638+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~RS2RZLBBLE0W.0 size=930443 2024-09-12T17:18:39.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.642+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=RS2RZLBBLE0W tag=NDGWCZRUTKQR type=write size=1979019 2024-09-12T17:18:39.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.642+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=DU0YSAN2XFY5 type=del size=4016242 2024-09-12T17:18:39.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.642+0000 7f96641d38c0 1 < canceled part key=_multipart_NR82RUK97NQA.2~71WSREVET53Z.0 size=701789 2024-09-12T17:18:39.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.646+0000 7f96641d38c0 1 < canceled multipart upload key=NR82RUK97NQA upload=71WSREVET53Z tag=ZRM1IQTJV7N6 type=write size=1750365 2024-09-12T17:18:39.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.650+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=JA8WI1LY0O18 type=del size=474767 2024-09-12T17:18:39.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.654+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~XZNZ54W7Y3R5.0 size=1048576 2024-09-12T17:18:39.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.654+0000 7f96641d38c0 1 < canceled part key=_multipart_47QQRTJKM4DB.2~XZNZ54W7Y3R5.1 size=993731 2024-09-12T17:18:39.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.658+0000 7f96641d38c0 1 < canceled multipart upload key=47QQRTJKM4DB upload=XZNZ54W7Y3R5 tag=JMAVCB9F5C8E type=write size=3090883 2024-09-12T17:18:39.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.662+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=P6F562C0F6ET type=write size=199900 2024-09-12T17:18:39.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.662+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~DFB8AP6QGG31.0 size=1048576 2024-09-12T17:18:39.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.666+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~DFB8AP6QGG31.1 size=1048576 2024-09-12T17:18:39.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.666+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~DFB8AP6QGG31.2 size=42581 2024-09-12T17:18:39.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.670+0000 7f96641d38c0 1 < completed multipart upload key=HRU241T0FUEZ upload=DFB8AP6QGG31 tag=BYXB12ZA4J0Q type=write size=3188309 2024-09-12T17:18:39.675 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.674+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=9UQ2HZNRE566 type=write size=157994 2024-09-12T17:18:39.678 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.678+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~DSRL44P5ZTHQ.0 size=958691 2024-09-12T17:18:39.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.682+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=DSRL44P5ZTHQ tag=KB1M1JL2O42X type=write size=2007267 2024-09-12T17:18:39.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.682+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=09JL6V0CQ8EG type=write size=64786 2024-09-12T17:18:39.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.686+0000 7f96641d38c0 1 < canceled operation key=DHODPSZ7Z0D4 tag=P9SAJQFY2JEP type=del size=2526267 2024-09-12T17:18:39.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.690+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=0VIGQ5824QXO type=del size=1811229 2024-09-12T17:18:39.694 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.694+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~XFMMWVHRY37G.0 size=1048576 2024-09-12T17:18:39.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.694+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~XFMMWVHRY37G.1 size=536258 2024-09-12T17:18:39.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.698+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=XFMMWVHRY37G tag=HR9J9D3XNEWI type=write size=2633410 2024-09-12T17:18:39.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.706+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~OV8V455H910K.0 size=1048576 2024-09-12T17:18:39.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.706+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~OV8V455H910K.1 size=881393 2024-09-12T17:18:39.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.706+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=OV8V455H910K tag=C4ARIV1SS1XB type=write size=2978545 2024-09-12T17:18:39.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.710+0000 7f96641d38c0 1 < canceled operation key=RSVQJS9F1FR7 tag=E2AO1YTRK3DR type=del size=2039725 2024-09-12T17:18:39.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.714+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~GCICX6GVZ0YM.0 size=426382 2024-09-12T17:18:39.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.714+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=GCICX6GVZ0YM tag=R22HZRZHHQFG type=write size=1474958 2024-09-12T17:18:39.720 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.718+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~H4E12D0O9A6O.0 size=1048576 2024-09-12T17:18:39.721 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.718+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~H4E12D0O9A6O.1 size=1048576 2024-09-12T17:18:39.723 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.722+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~H4E12D0O9A6O.2 size=13322 2024-09-12T17:18:39.727 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.726+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=H4E12D0O9A6O tag=J9DBOGB8PHC9 type=write size=3159050 2024-09-12T17:18:39.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.730+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=J7XYJ0IE9ZA7 type=write size=97090 2024-09-12T17:18:39.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.730+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~DWZUJ7CTRQTJ.0 size=1048576 2024-09-12T17:18:39.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.734+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~DWZUJ7CTRQTJ.1 size=180836 2024-09-12T17:18:39.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.738+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=DWZUJ7CTRQTJ tag=YE5EFOKP54N3 type=write size=2277988 2024-09-12T17:18:39.744 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.742+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~AFPPI9KZQ5O6.0 size=1048576 2024-09-12T17:18:39.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.746+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~AFPPI9KZQ5O6.1 size=1048576 2024-09-12T17:18:39.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.750+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~AFPPI9KZQ5O6.2 size=554576 2024-09-12T17:18:39.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.750+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=AFPPI9KZQ5O6 tag=OAPSWQ2736YS type=write size=3700304 2024-09-12T17:18:39.753 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.750+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~TCR1S5DE2QEC.0 size=1048576 2024-09-12T17:18:39.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.754+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~TCR1S5DE2QEC.1 size=67197 2024-09-12T17:18:39.759 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.758+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=TCR1S5DE2QEC tag=D7XCPTRSQWPL type=write size=2164349 2024-09-12T17:18:39.761 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.758+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=Z8UN9T0A08B4 type=del size=3077304 2024-09-12T17:18:39.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.762+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=LO31K798B4V9 type=del 2024-09-12T17:18:39.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.766+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=Q684H7EG62Z6 type=del size=560790 2024-09-12T17:18:39.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.766+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~BO42XY2XGQA1.0 size=1048576 2024-09-12T17:18:39.770 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.770+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~BO42XY2XGQA1.1 size=273235 2024-09-12T17:18:39.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.774+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=BO42XY2XGQA1 tag=7J9693QUB1ZZ type=write size=2370387 2024-09-12T17:18:39.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.774+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=W3APRVY6RO1M type=write size=470208 2024-09-12T17:18:39.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.778+0000 7f96641d38c0 1 < completed write operation key=NR82RUK97NQA tag=IERWSUWEARXU type=write size=31608 2024-09-12T17:18:39.782 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.782+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=HBZAT0FQSGA0 type=del size=539819 2024-09-12T17:18:39.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.782+0000 7f96641d38c0 1 < completed write operation key=G7CWVD9C2H2J tag=4E42EA2LWDIG type=write size=50954 2024-09-12T17:18:39.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.786+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=ZW01QQKEF8QW type=del size=3703527 2024-09-12T17:18:39.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.786+0000 7f96641d38c0 1 < completed delete operation key=KXJYJ9VX7YVW tag=MTXSJ3IP8PQY type=del 2024-09-12T17:18:39.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.790+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=J8ZLPTZRXM4O type=del size=331879 2024-09-12T17:18:39.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.794+0000 7f96641d38c0 1 < suggested remove operation key=H3LV5G117KOW tag=DU0YSAN2XFY5 type=del 2024-09-12T17:18:39.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.798+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=WCPVIDT6707T type=del size=2122345 2024-09-12T17:18:39.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.798+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=JA8WI1LY0O18 type=del 2024-09-12T17:18:39.805 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.802+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=CP6TLC85ORI2 type=del size=3693440 2024-09-12T17:18:39.807 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.806+0000 7f96641d38c0 -1 < failed to complete operation key=H3LV5G117KOW tag=P6F562C0F6ET type=write size=199900: (22) Invalid argument 2024-09-12T17:18:39.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.810+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~M62HMRY556NQ.0 size=1048576 2024-09-12T17:18:39.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.814+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~M62HMRY556NQ.1 size=126506 2024-09-12T17:18:39.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.814+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=M62HMRY556NQ tag=HZV22Z4JLA9O type=write size=2223658 2024-09-12T17:18:39.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.814+0000 7f96641d38c0 1 < canceled operation key=HRU241T0FUEZ tag=9UQ2HZNRE566 type=write size=157994 2024-09-12T17:18:39.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.818+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=JEJBLP51E0BR type=del size=1519377 2024-09-12T17:18:39.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.822+0000 7f96641d38c0 1 < completed write operation key=DHODPSZ7Z0D4 tag=09JL6V0CQ8EG type=write size=64786 2024-09-12T17:18:39.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.826+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~LZ21TVRGPTE2.0 size=441120 2024-09-12T17:18:39.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.826+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=LZ21TVRGPTE2 tag=60ZIFQOUJG2Y type=write size=1489696 2024-09-12T17:18:39.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.826+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=0VIGQ5824QXO type=del 2024-09-12T17:18:39.832 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.830+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=ADMQDGO3BVPC type=del size=1799144 2024-09-12T17:18:39.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.834+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~OV8V455H910K.0 size=1048576 2024-09-12T17:18:39.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.834+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~OV8V455H910K.1 size=881393 2024-09-12T17:18:39.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.838+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=OV8V455H910K tag=C4ARIV1SS1XB type=write size=2978545 2024-09-12T17:18:39.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.842+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=X32OZGK6OHRS type=del size=4169980 2024-09-12T17:18:39.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.842+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~GCICX6GVZ0YM.0 size=426382 2024-09-12T17:18:39.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.846+0000 7f96641d38c0 1 < completed multipart upload key=NGA3P9RZJYWT upload=GCICX6GVZ0YM tag=R22HZRZHHQFG type=write size=1474958 2024-09-12T17:18:39.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.850+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=YKXXM9CDSE6F type=del size=2577265 2024-09-12T17:18:39.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.854+0000 7f96641d38c0 1 < suggested update operation key=EFORFJYOM45R tag=J7XYJ0IE9ZA7 type=write size=97090 2024-09-12T17:18:39.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.858+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=KUXKLJ9NS7EU type=del size=648818 2024-09-12T17:18:39.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.858+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~AFPPI9KZQ5O6.0 size=1048576 2024-09-12T17:18:39.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.862+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~AFPPI9KZQ5O6.1 size=1048576 2024-09-12T17:18:39.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.862+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~AFPPI9KZQ5O6.2 size=554576 2024-09-12T17:18:39.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.866+0000 7f96641d38c0 1 < completed multipart upload key=HRU241T0FUEZ upload=AFPPI9KZQ5O6 tag=OAPSWQ2736YS type=write size=3700304 2024-09-12T17:18:39.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.870+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~Q26E5EGENBEA.0 size=1048576 2024-09-12T17:18:39.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.874+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~Q26E5EGENBEA.1 size=664867 2024-09-12T17:18:39.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.874+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=Q26E5EGENBEA tag=WT6MWQCRRQ0E type=write size=2762019 2024-09-12T17:18:39.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.874+0000 7f96641d38c0 1 < canceled operation key=LK3F25OHR7AO tag=Z8UN9T0A08B4 type=del size=3077304 2024-09-12T17:18:39.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.878+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=8T2Z1SYO13GJ type=write size=481383 2024-09-12T17:18:39.884 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.882+0000 7f96641d38c0 1 < suggested update operation key=GKJJDBNXC6QH tag=Q684H7EG62Z6 type=del size=560790 2024-09-12T17:18:39.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.886+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~6D0L1W73UZJ1.0 size=717394 2024-09-12T17:18:39.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.886+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=6D0L1W73UZJ1 tag=5VXRK9V3V81P type=write size=1765970 2024-09-12T17:18:39.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.890+0000 7f96641d38c0 1 < completed write operation key=H3J23KLT1VUT tag=W3APRVY6RO1M type=write size=470208 2024-09-12T17:18:39.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.890+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=3WXYBV49KIVL type=write size=703318 2024-09-12T17:18:39.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.894+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=HBZAT0FQSGA0 type=del 2024-09-12T17:18:39.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.898+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=ZDMD3I3Q4O7Q type=del size=4100903 2024-09-12T17:18:39.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.898+0000 7f96641d38c0 -1 < failed to complete operation key=GKJJDBNXC6QH tag=ZW01QQKEF8QW type=del size=3703527: (22) Invalid argument 2024-09-12T17:18:39.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.906+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~RPG6WDPH16A3.0 size=1048576 2024-09-12T17:18:39.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.906+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~RPG6WDPH16A3.1 size=521479 2024-09-12T17:18:39.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.906+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=RPG6WDPH16A3 tag=JHBO1HVD0FIW type=write size=2618631 2024-09-12T17:18:39.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.910+0000 7f96641d38c0 1 < completed delete operation key=KXJYJ9VX7YVW tag=J8ZLPTZRXM4O type=del 2024-09-12T17:18:39.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.914+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~HV5OTIZND1A0.0 size=1048576 2024-09-12T17:18:39.917 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.914+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~HV5OTIZND1A0.1 size=1048576 2024-09-12T17:18:39.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.918+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~HV5OTIZND1A0.2 size=914663 2024-09-12T17:18:39.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.918+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=HV5OTIZND1A0 tag=FNJR3Q0K3FHG type=write size=4060391 2024-09-12T17:18:39.922 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.922+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=WCPVIDT6707T type=del 2024-09-12T17:18:39.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.926+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~5BY5Z1TCZ54R.0 size=272924 2024-09-12T17:18:39.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.926+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=5BY5Z1TCZ54R tag=8ELSPZ1MQOCC type=write size=1321500 2024-09-12T17:18:39.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.930+0000 7f96641d38c0 1 < canceled operation key=XTVZIXTEES2O tag=CP6TLC85ORI2 type=del size=3693440 2024-09-12T17:18:39.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.930+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=FU4H322GF9NA type=del size=326804 2024-09-12T17:18:39.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.934+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~M62HMRY556NQ.0 size=1048576 2024-09-12T17:18:39.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.938+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~M62HMRY556NQ.1 size=126506 2024-09-12T17:18:39.942 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.942+0000 7f96641d38c0 1 < completed multipart upload key=47QQRTJKM4DB upload=M62HMRY556NQ tag=HZV22Z4JLA9O type=write size=2223658 2024-09-12T17:18:39.944 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.942+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=PBANZQ1N1YVK type=del size=2923139 2024-09-12T17:18:39.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.946+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=JEJBLP51E0BR type=del 2024-09-12T17:18:39.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.946+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=0MF9A9EIBG3O type=del size=2316617 2024-09-12T17:18:39.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.950+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~LZ21TVRGPTE2.0 size=441120 2024-09-12T17:18:39.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.954+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=LZ21TVRGPTE2 tag=60ZIFQOUJG2Y type=write size=1489696 2024-09-12T17:18:39.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.958+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=Z5DA6RTT1BBX type=del size=2226808 2024-09-12T17:18:39.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.962+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=ADMQDGO3BVPC type=del 2024-09-12T17:18:39.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.966+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~B5KJ8AZG59VP.0 size=1048576 2024-09-12T17:18:39.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.966+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~B5KJ8AZG59VP.1 size=43229 2024-09-12T17:18:39.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.966+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=B5KJ8AZG59VP tag=FV4OL4XTMFRE type=write size=2140381 2024-09-12T17:18:39.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.970+0000 7f96641d38c0 1 < completed delete operation key=KXJYJ9VX7YVW tag=X32OZGK6OHRS type=del 2024-09-12T17:18:39.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.974+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=BT20DRVIU693 type=write size=253131 2024-09-12T17:18:39.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.978+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=YKXXM9CDSE6F type=del 2024-09-12T17:18:39.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.978+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=AMIVBZLOMSVK type=del size=3472120 2024-09-12T17:18:39.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.982+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=KUXKLJ9NS7EU type=del 2024-09-12T17:18:39.994 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.994+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~BUKN64VM3YMT.0 size=1048576 2024-09-12T17:18:39.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.994+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~BUKN64VM3YMT.1 size=1048576 2024-09-12T17:18:39.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.998+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~BUKN64VM3YMT.2 size=99507 2024-09-12T17:18:39.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:39.998+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=BUKN64VM3YMT tag=GCBM94TNN4I6 type=write size=3245235 2024-09-12T17:18:40.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.002+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~Q26E5EGENBEA.0 size=1048576 2024-09-12T17:18:40.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.002+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~Q26E5EGENBEA.1 size=664867 2024-09-12T17:18:40.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.006+0000 7f96641d38c0 1 < completed multipart upload key=2TN3M8NKV9LN upload=Q26E5EGENBEA tag=WT6MWQCRRQ0E type=write size=2762019 2024-09-12T17:18:40.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.014+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~GNPPN2A2LR0F.0 size=1048576 2024-09-12T17:18:40.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.014+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~GNPPN2A2LR0F.1 size=1048576 2024-09-12T17:18:40.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.018+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~GNPPN2A2LR0F.2 size=489470 2024-09-12T17:18:40.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.018+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=GNPPN2A2LR0F tag=HDHUFE8GTUBP type=write size=3635198 2024-09-12T17:18:40.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.022+0000 7f96641d38c0 1 < suggested update operation key=NR82RUK97NQA tag=8T2Z1SYO13GJ type=write size=481383 2024-09-12T17:18:40.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.022+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=QCUNZJ22CE34 type=del size=966835 2024-09-12T17:18:40.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.026+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~6D0L1W73UZJ1.0 size=717394 2024-09-12T17:18:40.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.030+0000 7f96641d38c0 1 < completed multipart upload key=0X2HHMHJUJNL upload=6D0L1W73UZJ1 tag=5VXRK9V3V81P type=write size=1765970 2024-09-12T17:18:40.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.034+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=NP820O9SYL0Y type=del size=3167116 2024-09-12T17:18:40.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.038+0000 7f96641d38c0 1 < suggested update operation key=H3LV5G117KOW tag=3WXYBV49KIVL type=write size=703318 2024-09-12T17:18:40.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.042+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=7X4SBIJQ471V type=write size=864474 2024-09-12T17:18:40.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.046+0000 7f96641d38c0 1 < suggested remove operation key=BDI9YFZCT5YY tag=ZDMD3I3Q4O7Q type=del 2024-09-12T17:18:40.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.050+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~3AMAGY4XX4L2.0 size=199167 2024-09-12T17:18:40.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.050+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=3AMAGY4XX4L2 tag=XIDHJAQMRFV8 type=write size=1247743 2024-09-12T17:18:40.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.050+0000 7f96641d38c0 1 < canceled part key=_multipart_NGA3P9RZJYWT.2~RPG6WDPH16A3.0 size=1048576 2024-09-12T17:18:40.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.050+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~RPG6WDPH16A3.1 size=521479 2024-09-12T17:18:40.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.054+0000 7f96641d38c0 1 < canceled multipart upload key=NGA3P9RZJYWT upload=RPG6WDPH16A3 tag=JHBO1HVD0FIW type=write size=2618631 2024-09-12T17:18:40.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.058+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~SIE50AO5FD4W.0 size=1048576 2024-09-12T17:18:40.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.062+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~SIE50AO5FD4W.1 size=1048576 2024-09-12T17:18:40.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.062+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~SIE50AO5FD4W.2 size=650208 2024-09-12T17:18:40.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.062+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=SIE50AO5FD4W tag=KEUCQZQC5GRX type=write size=3795936 2024-09-12T17:18:40.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.066+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~HV5OTIZND1A0.0 size=1048576 2024-09-12T17:18:40.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.066+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~HV5OTIZND1A0.1 size=1048576 2024-09-12T17:18:40.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.070+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~HV5OTIZND1A0.2 size=914663 2024-09-12T17:18:40.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.074+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=HV5OTIZND1A0 tag=FNJR3Q0K3FHG type=write size=4060391 2024-09-12T17:18:40.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.078+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~0J08FV8J0A6O.0 size=1048576 2024-09-12T17:18:40.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.078+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~0J08FV8J0A6O.1 size=560745 2024-09-12T17:18:40.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.078+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=0J08FV8J0A6O tag=2TPBLMF89QN3 type=write size=2657897 2024-09-12T17:18:40.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.082+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~5BY5Z1TCZ54R.0 size=272924 2024-09-12T17:18:40.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.086+0000 7f96641d38c0 1 < completed multipart upload key=37YXLWPZGA9J upload=5BY5Z1TCZ54R tag=8ELSPZ1MQOCC type=write size=1321500 2024-09-12T17:18:40.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.090+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=1VK47ATMPDOT type=del size=1290748 2024-09-12T17:18:40.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.090+0000 7f96641d38c0 1 < canceled operation key=47QQRTJKM4DB tag=FU4H322GF9NA type=del size=326804 2024-09-12T17:18:40.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.094+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=OFGGJIB331I2 type=write size=1011895 2024-09-12T17:18:40.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.098+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=PBANZQ1N1YVK type=del 2024-09-12T17:18:40.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.098+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=WCOPMYYFCSBN type=del size=1063721 2024-09-12T17:18:40.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.106+0000 7f96641d38c0 1 < suggested update operation key=H3J23KLT1VUT tag=0MF9A9EIBG3O type=del size=2316617 2024-09-12T17:18:40.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.106+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=UOPMEQ3GK15E type=del size=3911161 2024-09-12T17:18:40.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.110+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=Z5DA6RTT1BBX type=del 2024-09-12T17:18:40.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.110+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=7AENZQVACFTP type=write size=616996 2024-09-12T17:18:40.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.114+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~B5KJ8AZG59VP.0 size=1048576 2024-09-12T17:18:40.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.118+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~B5KJ8AZG59VP.1 size=43229 2024-09-12T17:18:40.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.122+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=B5KJ8AZG59VP tag=FV4OL4XTMFRE type=write size=2140381 2024-09-12T17:18:40.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.126+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~FPV7RT3549JC.0 size=1048576 2024-09-12T17:18:40.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.126+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~FPV7RT3549JC.1 size=1048576 2024-09-12T17:18:40.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.130+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~FPV7RT3549JC.2 size=881466 2024-09-12T17:18:40.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.130+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=FPV7RT3549JC tag=VFXQLO042OZ3 type=write size=4027194 2024-09-12T17:18:40.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.134+0000 7f96641d38c0 1 < completed write operation key=IR9JQ4MAEH0P tag=BT20DRVIU693 type=write size=253131 2024-09-12T17:18:40.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.134+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=YHREMB3L52EG type=del size=1598928 2024-09-12T17:18:40.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.138+0000 7f96641d38c0 -1 < failed to complete operation key=BDI9YFZCT5YY tag=AMIVBZLOMSVK type=del size=3472120: (22) Invalid argument 2024-09-12T17:18:40.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.138+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=UI3C5RXQB4RR type=del size=3988446 2024-09-12T17:18:40.144 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.142+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~BUKN64VM3YMT.0 size=1048576 2024-09-12T17:18:40.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.146+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~BUKN64VM3YMT.1 size=1048576 2024-09-12T17:18:40.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.146+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~BUKN64VM3YMT.2 size=99507 2024-09-12T17:18:40.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.150+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=BUKN64VM3YMT tag=GCBM94TNN4I6 type=write size=3245235 2024-09-12T17:18:40.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.154+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~ISBKOJRDHKSG.0 size=1048576 2024-09-12T17:18:40.159 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.158+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~ISBKOJRDHKSG.1 size=1048576 2024-09-12T17:18:40.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.158+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~ISBKOJRDHKSG.2 size=859539 2024-09-12T17:18:40.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.158+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=ISBKOJRDHKSG tag=8JXSMZL5BI6H type=write size=4005267 2024-09-12T17:18:40.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.162+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~GNPPN2A2LR0F.0 size=1048576 2024-09-12T17:18:40.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.166+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~GNPPN2A2LR0F.1 size=1048576 2024-09-12T17:18:40.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.166+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~GNPPN2A2LR0F.2 size=489470 2024-09-12T17:18:40.173 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.170+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=GNPPN2A2LR0F tag=HDHUFE8GTUBP type=write size=3635198 2024-09-12T17:18:40.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.178+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~VTTI42LL18FV.0 size=1048576 2024-09-12T17:18:40.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.178+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~VTTI42LL18FV.1 size=123340 2024-09-12T17:18:40.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.178+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=VTTI42LL18FV tag=S2GZFFZ1H2MX type=write size=2220492 2024-09-12T17:18:40.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.182+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=QCUNZJ22CE34 type=del 2024-09-12T17:18:40.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.186+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~4CFA8H0LDHK0.0 size=1048576 2024-09-12T17:18:40.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.186+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~4CFA8H0LDHK0.1 size=1048576 2024-09-12T17:18:40.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.190+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~4CFA8H0LDHK0.2 size=389067 2024-09-12T17:18:40.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.190+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=4CFA8H0LDHK0 tag=AOEXARC4RE8B type=write size=3534795 2024-09-12T17:18:40.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.190+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=NP820O9SYL0Y type=del 2024-09-12T17:18:40.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.194+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=12G24IPQ7T1R type=write size=87053 2024-09-12T17:18:40.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.198+0000 7f96641d38c0 1 < suggested update operation key=GKJJDBNXC6QH tag=7X4SBIJQ471V type=write size=864474 2024-09-12T17:18:40.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.202+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=ZTLL3DIOXDJC type=del size=2344374 2024-09-12T17:18:40.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.202+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~3AMAGY4XX4L2.0 size=199167 2024-09-12T17:18:40.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.206+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=3AMAGY4XX4L2 tag=XIDHJAQMRFV8 type=write size=1247743 2024-09-12T17:18:40.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.210+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~AUD2AELF4Y1W.0 size=725638 2024-09-12T17:18:40.214 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.210+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=AUD2AELF4Y1W tag=GDK2356RGLVP type=write size=1774214 2024-09-12T17:18:40.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.214+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~SIE50AO5FD4W.0 size=1048576 2024-09-12T17:18:40.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.218+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~SIE50AO5FD4W.1 size=1048576 2024-09-12T17:18:40.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.222+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~SIE50AO5FD4W.2 size=650208 2024-09-12T17:18:40.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.226+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=SIE50AO5FD4W tag=KEUCQZQC5GRX type=write size=3795936 2024-09-12T17:18:40.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.226+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=UKZ9SY38AN3C type=del size=1383083 2024-09-12T17:18:40.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.230+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~0J08FV8J0A6O.0 size=1048576 2024-09-12T17:18:40.234 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.234+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~0J08FV8J0A6O.1 size=560745 2024-09-12T17:18:40.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.238+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=0J08FV8J0A6O tag=2TPBLMF89QN3 type=write size=2657897 2024-09-12T17:18:40.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.242+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~P3ROVFX3OEP5.0 size=22065 2024-09-12T17:18:40.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.242+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=P3ROVFX3OEP5 tag=EEGW7G43WYBL type=write size=1070641 2024-09-12T17:18:40.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.242+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=1VK47ATMPDOT type=del 2024-09-12T17:18:40.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.246+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=6IV04L3II0NI type=del size=1136958 2024-09-12T17:18:40.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.250+0000 7f96641d38c0 1 < canceled operation key=8TU2VZOHL1ZZ tag=OFGGJIB331I2 type=write size=1011895 2024-09-12T17:18:40.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.254+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~M0AD3IVLV1EY.0 size=1048576 2024-09-12T17:18:40.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.254+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~M0AD3IVLV1EY.1 size=1048576 2024-09-12T17:18:40.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.258+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~M0AD3IVLV1EY.2 size=52493 2024-09-12T17:18:40.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.258+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=M0AD3IVLV1EY tag=73DGPS0PPAB1 type=write size=3198221 2024-09-12T17:18:40.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.258+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=WCOPMYYFCSBN type=del 2024-09-12T17:18:40.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.262+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~3FKI1A2XNIOT.0 size=1048576 2024-09-12T17:18:40.267 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.266+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~3FKI1A2XNIOT.1 size=866541 2024-09-12T17:18:40.267 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.266+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=3FKI1A2XNIOT tag=Q5O0TCUSOOL2 type=write size=2963693 2024-09-12T17:18:40.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.266+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=UOPMEQ3GK15E type=del 2024-09-12T17:18:40.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.270+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=H7HUY9QNP8L4 type=del size=3992031 2024-09-12T17:18:40.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.274+0000 7f96641d38c0 1 < suggested remove operation key=IR9JQ4MAEH0P tag=7AENZQVACFTP type=write 2024-09-12T17:18:40.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.278+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=GULLQUVD7O1S type=write size=1029509 2024-09-12T17:18:40.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.278+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~FPV7RT3549JC.0 size=1048576 2024-09-12T17:18:40.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.282+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~FPV7RT3549JC.1 size=1048576 2024-09-12T17:18:40.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.282+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~FPV7RT3549JC.2 size=881466 2024-09-12T17:18:40.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.286+0000 7f96641d38c0 1 < completed multipart upload key=47QQRTJKM4DB upload=FPV7RT3549JC tag=VFXQLO042OZ3 type=write size=4027194 2024-09-12T17:18:40.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.294+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~JYG31IOZN407.0 size=249180 2024-09-12T17:18:40.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.294+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=JYG31IOZN407 tag=I8XA885GCCR6 type=write size=1297756 2024-09-12T17:18:40.297 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.294+0000 7f96641d38c0 1 < canceled operation key=KXJYJ9VX7YVW tag=YHREMB3L52EG type=del size=1598928 2024-09-12T17:18:40.302 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.302+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~C67KT588YL93.0 size=1048576 2024-09-12T17:18:40.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.302+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~C67KT588YL93.1 size=509692 2024-09-12T17:18:40.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.302+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=C67KT588YL93 tag=ULYCEAZJPRZO type=write size=2606844 2024-09-12T17:18:40.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.306+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=UI3C5RXQB4RR type=del 2024-09-12T17:18:40.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.310+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~0LD2V36HSAV2.0 size=1048576 2024-09-12T17:18:40.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.314+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~0LD2V36HSAV2.1 size=1048576 2024-09-12T17:18:40.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.314+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~0LD2V36HSAV2.2 size=597903 2024-09-12T17:18:40.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.314+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=0LD2V36HSAV2 tag=2EHRQOV5HJBK type=write size=3743631 2024-09-12T17:18:40.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.318+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~ISBKOJRDHKSG.0 size=1048576 2024-09-12T17:18:40.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.318+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~ISBKOJRDHKSG.1 size=1048576 2024-09-12T17:18:40.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.322+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~ISBKOJRDHKSG.2 size=859539 2024-09-12T17:18:40.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.326+0000 7f96641d38c0 1 < completed multipart upload key=37YXLWPZGA9J upload=ISBKOJRDHKSG tag=8JXSMZL5BI6H type=write size=4005267 2024-09-12T17:18:40.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.330+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~WM45MT6KG90H.0 size=408631 2024-09-12T17:18:40.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.330+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=WM45MT6KG90H tag=9HDIOYWGQ7I7 type=write size=1457207 2024-09-12T17:18:40.336 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.334+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~VTTI42LL18FV.0 size=1048576 2024-09-12T17:18:40.337 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.334+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~VTTI42LL18FV.1 size=123340 2024-09-12T17:18:40.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.338+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=VTTI42LL18FV tag=S2GZFFZ1H2MX type=write size=2220492 2024-09-12T17:18:40.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.342+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=341FEQEZ01S8 type=del size=2145882 2024-09-12T17:18:40.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.342+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~4CFA8H0LDHK0.0 size=1048576 2024-09-12T17:18:40.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.346+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~4CFA8H0LDHK0.1 size=1048576 2024-09-12T17:18:40.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.346+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~4CFA8H0LDHK0.2 size=389067 2024-09-12T17:18:40.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.354+0000 7f96641d38c0 1 < completed multipart upload key=37YXLWPZGA9J upload=4CFA8H0LDHK0 tag=AOEXARC4RE8B type=write size=3534795 2024-09-12T17:18:40.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.354+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=AR5ZF9P1G9YO type=del size=3643469 2024-09-12T17:18:40.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.358+0000 7f96641d38c0 1 < suggested remove operation key=0X2HHMHJUJNL tag=12G24IPQ7T1R type=write 2024-09-12T17:18:40.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.362+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=EKL6CQQ1G0O0 type=write size=494541 2024-09-12T17:18:40.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.366+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=ZTLL3DIOXDJC type=del 2024-09-12T17:18:40.369 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.366+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=7CZC89BMQZPJ type=del size=2987950 2024-09-12T17:18:40.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.370+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~AUD2AELF4Y1W.0 size=725638 2024-09-12T17:18:40.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.374+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=AUD2AELF4Y1W tag=GDK2356RGLVP type=write size=1774214 2024-09-12T17:18:40.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.378+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=RG8X2Y292QIF type=del size=3273832 2024-09-12T17:18:40.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.378+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=UKZ9SY38AN3C type=del 2024-09-12T17:18:40.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.382+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=F96CE41P1LX9 type=del size=3332269 2024-09-12T17:18:40.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.386+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~P3ROVFX3OEP5.0 size=22065 2024-09-12T17:18:40.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.390+0000 7f96641d38c0 1 < completed multipart upload key=XDL9O7TEMBYF upload=P3ROVFX3OEP5 tag=EEGW7G43WYBL type=write size=1070641 2024-09-12T17:18:40.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.394+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~CPZYRWFX702W.0 size=1048576 2024-09-12T17:18:40.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.394+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~CPZYRWFX702W.1 size=174529 2024-09-12T17:18:40.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.394+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=CPZYRWFX702W tag=X2EHDYKSBM1K type=write size=2271681 2024-09-12T17:18:40.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.398+0000 7f96641d38c0 1 < canceled operation key=NGA3P9RZJYWT tag=6IV04L3II0NI type=del size=1136958 2024-09-12T17:18:40.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.398+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=C9SITAB3QSFK type=del size=553694 2024-09-12T17:18:40.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.402+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~M0AD3IVLV1EY.0 size=1048576 2024-09-12T17:18:40.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.402+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~M0AD3IVLV1EY.1 size=1048576 2024-09-12T17:18:40.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.406+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~M0AD3IVLV1EY.2 size=52493 2024-09-12T17:18:40.410 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.410+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=M0AD3IVLV1EY tag=73DGPS0PPAB1 type=write size=3198221 2024-09-12T17:18:40.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.410+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=LPT8RGZU2O4T type=del size=3038288 2024-09-12T17:18:40.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.414+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~3FKI1A2XNIOT.0 size=1048576 2024-09-12T17:18:40.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.414+0000 7f96641d38c0 1 < canceled part key=_multipart_W40P2E1H5VT9.2~3FKI1A2XNIOT.1 size=866541 2024-09-12T17:18:40.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.418+0000 7f96641d38c0 1 < canceled multipart upload key=W40P2E1H5VT9 upload=3FKI1A2XNIOT tag=Q5O0TCUSOOL2 type=write size=2963693 2024-09-12T17:18:40.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.422+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~4454WWA92NNA.0 size=1048576 2024-09-12T17:18:40.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.426+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~4454WWA92NNA.1 size=1048576 2024-09-12T17:18:40.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.426+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~4454WWA92NNA.2 size=858529 2024-09-12T17:18:40.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.426+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=4454WWA92NNA tag=QJOY2X5FC00Z type=write size=4004257 2024-09-12T17:18:40.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.430+0000 7f96641d38c0 1 < suggested update operation key=BDI9YFZCT5YY tag=H7HUY9QNP8L4 type=del size=3992031 2024-09-12T17:18:40.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.438+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~3CZ9W4KZ9WKF.0 size=328671 2024-09-12T17:18:40.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.438+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=3CZ9W4KZ9WKF tag=1AHBEK0V0XIG type=write size=1377247 2024-09-12T17:18:40.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.438+0000 7f96641d38c0 1 < completed write operation key=3SLNHJT3A1K1 tag=GULLQUVD7O1S type=write size=1029509 2024-09-12T17:18:40.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.442+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=0BQ9Z0U9SMTL type=del size=2466643 2024-09-12T17:18:40.445 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.442+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~JYG31IOZN407.0 size=249180 2024-09-12T17:18:40.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.450+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=JYG31IOZN407 tag=I8XA885GCCR6 type=write size=1297756 2024-09-12T17:18:40.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.454+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=09ZPEYUP81PA type=del size=2058743 2024-09-12T17:18:40.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.454+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~C67KT588YL93.0 size=1048576 2024-09-12T17:18:40.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.458+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~C67KT588YL93.1 size=509692 2024-09-12T17:18:40.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.462+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=C67KT588YL93 tag=ULYCEAZJPRZO type=write size=2606844 2024-09-12T17:18:40.465 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.462+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=6UA8H56KRFSF type=del size=697506 2024-09-12T17:18:40.467 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.466+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~0LD2V36HSAV2.0 size=1048576 2024-09-12T17:18:40.469 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.466+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~0LD2V36HSAV2.1 size=1048576 2024-09-12T17:18:40.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.470+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~0LD2V36HSAV2.2 size=597903 2024-09-12T17:18:40.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.474+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=0LD2V36HSAV2 tag=2EHRQOV5HJBK type=write size=3743631 2024-09-12T17:18:40.477 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.474+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=HP19BT2M24BY type=del size=2948152 2024-09-12T17:18:40.479 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.478+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~WM45MT6KG90H.0 size=408631 2024-09-12T17:18:40.483 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.482+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=WM45MT6KG90H tag=9HDIOYWGQ7I7 type=write size=1457207 2024-09-12T17:18:40.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.486+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~6KFR925JM90W.0 size=986571 2024-09-12T17:18:40.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.486+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=6KFR925JM90W tag=7M2OP2VOTS9Z type=write size=2035147 2024-09-12T17:18:40.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.490+0000 7f96641d38c0 1 < suggested update operation key=H3J23KLT1VUT tag=341FEQEZ01S8 type=del size=2145882 2024-09-12T17:18:40.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.494+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~IVWX8KCGZAC6.0 size=176935 2024-09-12T17:18:40.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.494+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=IVWX8KCGZAC6 tag=H1UI57MID07X type=write size=1225511 2024-09-12T17:18:40.502 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.502+0000 7f96641d38c0 1 < suggested update operation key=NG327LT02T1F tag=AR5ZF9P1G9YO type=del size=3643469 2024-09-12T17:18:40.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.506+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~4SWU0L202XYK.0 size=275770 2024-09-12T17:18:40.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.506+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=4SWU0L202XYK tag=VCGL7P87IPPO type=write size=1324346 2024-09-12T17:18:40.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.506+0000 7f96641d38c0 1 < completed write operation key=9CBFWXFX7O3N tag=EKL6CQQ1G0O0 type=write size=494541 2024-09-12T17:18:40.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.514+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~342QM8J30Z7M.0 size=1048576 2024-09-12T17:18:40.515 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.514+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~342QM8J30Z7M.1 size=1048576 2024-09-12T17:18:40.518 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.518+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~342QM8J30Z7M.2 size=812243 2024-09-12T17:18:40.518 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.518+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=342QM8J30Z7M tag=4Z251SIJXMN5 type=write size=3957971 2024-09-12T17:18:40.520 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.518+0000 7f96641d38c0 1 < canceled operation key=EFORFJYOM45R tag=7CZC89BMQZPJ type=del size=2987950 2024-09-12T17:18:40.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.522+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=MGO47J6O2S97 type=write size=322196 2024-09-12T17:18:40.525 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.522+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=RG8X2Y292QIF type=del 2024-09-12T17:18:40.527 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.526+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=M2LDWR2QA67K type=del size=3086716 2024-09-12T17:18:40.529 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.526+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=F96CE41P1LX9 type=del 2024-09-12T17:18:40.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.530+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=BKP2051ALCHH type=del size=2576407 2024-09-12T17:18:40.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.534+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~CPZYRWFX702W.0 size=1048576 2024-09-12T17:18:40.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.534+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~CPZYRWFX702W.1 size=174529 2024-09-12T17:18:40.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.538+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=CPZYRWFX702W tag=X2EHDYKSBM1K type=write size=2271681 2024-09-12T17:18:40.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.542+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~M2TK4ZV7SZZD.0 size=224675 2024-09-12T17:18:40.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.542+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=M2TK4ZV7SZZD tag=A83RLXGX3SBT type=write size=1273251 2024-09-12T17:18:40.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.546+0000 7f96641d38c0 1 < canceled operation key=9CBFWXFX7O3N tag=C9SITAB3QSFK type=del size=553694 2024-09-12T17:18:40.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.550+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~M15UTJDYJFG8.0 size=1048576 2024-09-12T17:18:40.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.554+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~M15UTJDYJFG8.1 size=613820 2024-09-12T17:18:40.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.554+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=M15UTJDYJFG8 tag=2TRZGMZY4U90 type=write size=2710972 2024-09-12T17:18:40.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.554+0000 7f96641d38c0 -1 < failed to complete operation key=NG327LT02T1F tag=LPT8RGZU2O4T type=del size=3038288: (22) Invalid argument 2024-09-12T17:18:40.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.558+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=S3V3LYM9VLMD type=del size=3105303 2024-09-12T17:18:40.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.562+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~4454WWA92NNA.0 size=1048576 2024-09-12T17:18:40.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.562+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~4454WWA92NNA.1 size=1048576 2024-09-12T17:18:40.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.562+0000 7f96641d38c0 1 < canceled part key=_multipart_L9HUVE5A5NGT.2~4454WWA92NNA.2 size=858529 2024-09-12T17:18:40.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.566+0000 7f96641d38c0 1 < canceled multipart upload key=L9HUVE5A5NGT upload=4454WWA92NNA tag=QJOY2X5FC00Z type=write size=4004257 2024-09-12T17:18:40.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.570+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=SWOAIAC1UZAM type=del size=1224776 2024-09-12T17:18:40.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.570+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~3CZ9W4KZ9WKF.0 size=328671 2024-09-12T17:18:40.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.574+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=3CZ9W4KZ9WKF tag=1AHBEK0V0XIG type=write size=1377247 2024-09-12T17:18:40.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.578+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~UJ1QXBDGHQ0C.0 size=924815 2024-09-12T17:18:40.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.578+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=UJ1QXBDGHQ0C tag=KH90A89CMVUX type=write size=1973391 2024-09-12T17:18:40.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.582+0000 7f96641d38c0 1 < suggested update operation key=NG327LT02T1F tag=0BQ9Z0U9SMTL type=del size=2466643 2024-09-12T17:18:40.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.586+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~3ZGO59JING82.0 size=1048576 2024-09-12T17:18:40.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.590+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~3ZGO59JING82.1 size=539750 2024-09-12T17:18:40.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.590+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=3ZGO59JING82 tag=2LQGK5TNFGZ2 type=write size=2636902 2024-09-12T17:18:40.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.590+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=09ZPEYUP81PA type=del 2024-09-12T17:18:40.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.594+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=L8T0J6X83J7V type=del size=247137 2024-09-12T17:18:40.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.594+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=6UA8H56KRFSF type=del 2024-09-12T17:18:40.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.598+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=PYVEH4H64ZFO type=del size=1828256 2024-09-12T17:18:40.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.602+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=HP19BT2M24BY type=del 2024-09-12T17:18:40.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.602+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=BBS44P1QZC31 type=del size=1087166 2024-09-12T17:18:40.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.606+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~6KFR925JM90W.0 size=986571 2024-09-12T17:18:40.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.610+0000 7f96641d38c0 1 < completed multipart upload key=0X2HHMHJUJNL upload=6KFR925JM90W tag=7M2OP2VOTS9Z type=write size=2035147 2024-09-12T17:18:40.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.614+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=J3B0Q02U3C06 type=del size=3288429 2024-09-12T17:18:40.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.614+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~IVWX8KCGZAC6.0 size=176935 2024-09-12T17:18:40.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.618+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=IVWX8KCGZAC6 tag=H1UI57MID07X type=write size=1225511 2024-09-12T17:18:40.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.622+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~R4DHGFMQ9MPY.0 size=1048576 2024-09-12T17:18:40.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.626+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~R4DHGFMQ9MPY.1 size=209930 2024-09-12T17:18:40.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.626+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=R4DHGFMQ9MPY tag=E1QL6WYGS4WL type=write size=2307082 2024-09-12T17:18:40.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.626+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~4SWU0L202XYK.0 size=275770 2024-09-12T17:18:40.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.630+0000 7f96641d38c0 1 < completed multipart upload key=37YXLWPZGA9J upload=4SWU0L202XYK tag=VCGL7P87IPPO type=write size=1324346 2024-09-12T17:18:40.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.634+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~4M0Y469U7IJT.0 size=1048576 2024-09-12T17:18:40.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.638+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~4M0Y469U7IJT.1 size=196556 2024-09-12T17:18:40.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.638+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=4M0Y469U7IJT tag=18NSK40L37I2 type=write size=2293708 2024-09-12T17:18:40.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.642+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~342QM8J30Z7M.0 size=1048576 2024-09-12T17:18:40.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.642+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~342QM8J30Z7M.1 size=1048576 2024-09-12T17:18:40.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.642+0000 7f96641d38c0 1 < canceled part key=_multipart_37YXLWPZGA9J.2~342QM8J30Z7M.2 size=812243 2024-09-12T17:18:40.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.646+0000 7f96641d38c0 1 < canceled multipart upload key=37YXLWPZGA9J upload=342QM8J30Z7M tag=4Z251SIJXMN5 type=write size=3957971 2024-09-12T17:18:40.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.650+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=HSL660BGXEUD type=del size=1483708 2024-09-12T17:18:40.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.650+0000 7f96641d38c0 1 < completed write operation key=3H8R2MJGR4SY tag=MGO47J6O2S97 type=write size=322196 2024-09-12T17:18:40.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.654+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~BVGK9IFJX8ZF.0 size=1048576 2024-09-12T17:18:40.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.658+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~BVGK9IFJX8ZF.1 size=632004 2024-09-12T17:18:40.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.658+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=BVGK9IFJX8ZF tag=Y7TYJV6EMI6X type=write size=2729156 2024-09-12T17:18:40.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.658+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=M2LDWR2QA67K type=del 2024-09-12T17:18:40.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.662+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=V21HF7E9VNWU type=del size=115933 2024-09-12T17:18:40.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.666+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=BKP2051ALCHH type=del 2024-09-12T17:18:40.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.670+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~GO0DOJXKS87T.0 size=786807 2024-09-12T17:18:40.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.670+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=GO0DOJXKS87T tag=7R0QBENVHP4I type=write size=1835383 2024-09-12T17:18:40.675 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.674+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~M2TK4ZV7SZZD.0 size=224675 2024-09-12T17:18:40.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.678+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=M2TK4ZV7SZZD tag=A83RLXGX3SBT type=write size=1273251 2024-09-12T17:18:40.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.682+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=B3KI3SI78TB6 type=del size=2845154 2024-09-12T17:18:40.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.682+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~M15UTJDYJFG8.0 size=1048576 2024-09-12T17:18:40.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.686+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~M15UTJDYJFG8.1 size=613820 2024-09-12T17:18:40.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.690+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=M15UTJDYJFG8 tag=2TRZGMZY4U90 type=write size=2710972 2024-09-12T17:18:40.693 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.690+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=56YI96WTXL5Y type=del size=1554651 2024-09-12T17:18:40.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.694+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=S3V3LYM9VLMD type=del 2024-09-12T17:18:40.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.698+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~IACG4NLDJ0A9.0 size=141792 2024-09-12T17:18:40.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.698+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=IACG4NLDJ0A9 tag=PC7LT9BR8UKE type=write size=1190368 2024-09-12T17:18:40.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.702+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=SWOAIAC1UZAM type=del 2024-09-12T17:18:40.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.706+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~MTK9ZB1BQ462.0 size=1048576 2024-09-12T17:18:40.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.710+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~MTK9ZB1BQ462.1 size=578755 2024-09-12T17:18:40.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.710+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=MTK9ZB1BQ462 tag=7VCI5VCLKRS7 type=write size=2675907 2024-09-12T17:18:40.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.710+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~UJ1QXBDGHQ0C.0 size=924815 2024-09-12T17:18:40.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.714+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=UJ1QXBDGHQ0C tag=KH90A89CMVUX type=write size=1973391 2024-09-12T17:18:40.720 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.718+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~6GZZYWPHNG3K.0 size=1048576 2024-09-12T17:18:40.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.722+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~6GZZYWPHNG3K.1 size=799987 2024-09-12T17:18:40.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.722+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=6GZZYWPHNG3K tag=9IMG8ZP7PUAE type=write size=2897139 2024-09-12T17:18:40.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.722+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~3ZGO59JING82.0 size=1048576 2024-09-12T17:18:40.726 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.726+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~3ZGO59JING82.1 size=539750 2024-09-12T17:18:40.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.730+0000 7f96641d38c0 1 < completed multipart upload key=EFORFJYOM45R upload=3ZGO59JING82 tag=2LQGK5TNFGZ2 type=write size=2636902 2024-09-12T17:18:40.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.734+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~3UC5QJZ1K7T0.0 size=1048576 2024-09-12T17:18:40.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.734+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~3UC5QJZ1K7T0.1 size=947955 2024-09-12T17:18:40.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.734+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=3UC5QJZ1K7T0 tag=M1MNR2K5MT3Y type=write size=3045107 2024-09-12T17:18:40.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.742+0000 7f96641d38c0 1 < suggested remove operation key=37YXLWPZGA9J tag=L8T0J6X83J7V type=del 2024-09-12T17:18:40.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.746+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~2P2CAIKB2FVN.0 size=1048576 2024-09-12T17:18:40.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.746+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~2P2CAIKB2FVN.1 size=1048576 2024-09-12T17:18:40.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.750+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~2P2CAIKB2FVN.2 size=851211 2024-09-12T17:18:40.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.750+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=2P2CAIKB2FVN tag=ZPQK6E15UEX3 type=write size=3996939 2024-09-12T17:18:40.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.750+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=PYVEH4H64ZFO type=del 2024-09-12T17:18:40.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.754+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~9GKD7OB2N50E.0 size=603936 2024-09-12T17:18:40.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.754+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=9GKD7OB2N50E tag=V2TCMR8G4YTX type=write size=1652512 2024-09-12T17:18:40.759 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.758+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=BBS44P1QZC31 type=del 2024-09-12T17:18:40.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.762+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~FDEJVXV6OC5V.0 size=1048576 2024-09-12T17:18:40.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.766+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~FDEJVXV6OC5V.1 size=1048576 2024-09-12T17:18:40.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.766+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~FDEJVXV6OC5V.2 size=626177 2024-09-12T17:18:40.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.766+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=FDEJVXV6OC5V tag=4OBKUZUI1TDZ type=write size=3771905 2024-09-12T17:18:40.770 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.770+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=J3B0Q02U3C06 type=del 2024-09-12T17:18:40.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.770+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=UBTTYDG19HPS type=del size=347996 2024-09-12T17:18:40.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.774+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~R4DHGFMQ9MPY.0 size=1048576 2024-09-12T17:18:40.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.778+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~R4DHGFMQ9MPY.1 size=209930 2024-09-12T17:18:40.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.782+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=R4DHGFMQ9MPY tag=E1QL6WYGS4WL type=write size=2307082 2024-09-12T17:18:40.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.786+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~NGNT4355ZLAB.0 size=329370 2024-09-12T17:18:40.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.786+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=NGNT4355ZLAB tag=4EU6Z50U50L2 type=write size=1377946 2024-09-12T17:18:40.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.790+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~4M0Y469U7IJT.0 size=1048576 2024-09-12T17:18:40.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.794+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~4M0Y469U7IJT.1 size=196556 2024-09-12T17:18:40.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.798+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=4M0Y469U7IJT tag=18NSK40L37I2 type=write size=2293708 2024-09-12T17:18:40.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.802+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~55Q27ZOR5YJS.0 size=1048576 2024-09-12T17:18:40.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.806+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~55Q27ZOR5YJS.1 size=663701 2024-09-12T17:18:40.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.806+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=55Q27ZOR5YJS tag=QGGH75LA5YZA type=write size=2760853 2024-09-12T17:18:40.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.806+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=HSL660BGXEUD type=del 2024-09-12T17:18:40.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.810+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=IZDZMBUVJOAR type=del size=3085878 2024-09-12T17:18:40.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.814+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~BVGK9IFJX8ZF.0 size=1048576 2024-09-12T17:18:40.816 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.814+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~BVGK9IFJX8ZF.1 size=632004 2024-09-12T17:18:40.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.818+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=BVGK9IFJX8ZF tag=Y7TYJV6EMI6X type=write size=2729156 2024-09-12T17:18:40.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.822+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=0VAY5AH2Z66M type=del size=2244200 2024-09-12T17:18:40.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.826+0000 7f96641d38c0 1 < suggested update operation key=8TU2VZOHL1ZZ tag=V21HF7E9VNWU type=del size=115933 2024-09-12T17:18:40.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.830+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=RBDVV3O6TZPB type=del size=660150 2024-09-12T17:18:40.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.834+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~GO0DOJXKS87T.0 size=786807 2024-09-12T17:18:40.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.838+0000 7f96641d38c0 1 < completed multipart upload key=XDL9O7TEMBYF upload=GO0DOJXKS87T tag=7R0QBENVHP4I type=write size=1835383 2024-09-12T17:18:40.843 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.842+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~NPGGNOBFVH1S.0 size=1048576 2024-09-12T17:18:40.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.842+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~NPGGNOBFVH1S.1 size=1006537 2024-09-12T17:18:40.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.842+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=NPGGNOBFVH1S tag=N6TXM5W1ZK41 type=write size=3103689 2024-09-12T17:18:40.848 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.846+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=B3KI3SI78TB6 type=del 2024-09-12T17:18:40.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.850+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=LT5MYDX797CP type=del size=2992072 2024-09-12T17:18:40.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.854+0000 7f96641d38c0 1 < suggested update operation key=EFORFJYOM45R tag=56YI96WTXL5Y type=del size=1554651 2024-09-12T17:18:40.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.862+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~4DIQQ9EO161G.0 size=1048576 2024-09-12T17:18:40.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.862+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~4DIQQ9EO161G.1 size=477784 2024-09-12T17:18:40.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.862+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=4DIQQ9EO161G tag=B6T875RVXHAY type=write size=2574936 2024-09-12T17:18:40.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.866+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~IACG4NLDJ0A9.0 size=141792 2024-09-12T17:18:40.872 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.870+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=IACG4NLDJ0A9 tag=PC7LT9BR8UKE type=write size=1190368 2024-09-12T17:18:40.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.874+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=5AUEPPINQK6M type=del size=3732202 2024-09-12T17:18:40.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.878+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~MTK9ZB1BQ462.0 size=1048576 2024-09-12T17:18:40.881 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.878+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~MTK9ZB1BQ462.1 size=578755 2024-09-12T17:18:40.886 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.886+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=MTK9ZB1BQ462 tag=7VCI5VCLKRS7 type=write size=2675907 2024-09-12T17:18:40.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.890+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=LFXZXDMNH1SU type=del size=3893823 2024-09-12T17:18:40.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.894+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~6GZZYWPHNG3K.0 size=1048576 2024-09-12T17:18:40.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.894+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~6GZZYWPHNG3K.1 size=799987 2024-09-12T17:18:40.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.898+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=6GZZYWPHNG3K tag=9IMG8ZP7PUAE type=write size=2897139 2024-09-12T17:18:40.907 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.906+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~WPU363IJ5RUQ.0 size=918644 2024-09-12T17:18:40.907 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.906+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=WPU363IJ5RUQ tag=RXWMG09NWYIX type=write size=1967220 2024-09-12T17:18:40.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.910+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~3UC5QJZ1K7T0.0 size=1048576 2024-09-12T17:18:40.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.910+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~3UC5QJZ1K7T0.1 size=947955 2024-09-12T17:18:40.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.918+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=3UC5QJZ1K7T0 tag=M1MNR2K5MT3Y type=write size=3045107 2024-09-12T17:18:40.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.922+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=X2TNDKI1JMH5 type=del size=2241427 2024-09-12T17:18:40.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.922+0000 7f96641d38c0 1 < canceled part key=_multipart_LK3F25OHR7AO.2~2P2CAIKB2FVN.0 size=1048576 2024-09-12T17:18:40.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.926+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~2P2CAIKB2FVN.1 size=1048576 2024-09-12T17:18:40.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.930+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~2P2CAIKB2FVN.2 size=851211 2024-09-12T17:18:40.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.934+0000 7f96641d38c0 1 < canceled multipart upload key=LK3F25OHR7AO upload=2P2CAIKB2FVN tag=ZPQK6E15UEX3 type=write size=3996939 2024-09-12T17:18:40.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.938+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~BIUQ6RF9CUU6.0 size=1048576 2024-09-12T17:18:40.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.938+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~BIUQ6RF9CUU6.1 size=1048576 2024-09-12T17:18:40.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.942+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~BIUQ6RF9CUU6.2 size=595581 2024-09-12T17:18:40.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.942+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=BIUQ6RF9CUU6 tag=WVX608FCHZAU type=write size=3741309 2024-09-12T17:18:40.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.942+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~9GKD7OB2N50E.0 size=603936 2024-09-12T17:18:40.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.950+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=9GKD7OB2N50E tag=V2TCMR8G4YTX type=write size=1652512 2024-09-12T17:18:40.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.950+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=68X1IA6M9YB9 type=write size=292383 2024-09-12T17:18:40.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.954+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~FDEJVXV6OC5V.0 size=1048576 2024-09-12T17:18:40.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.954+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~FDEJVXV6OC5V.1 size=1048576 2024-09-12T17:18:40.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.958+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~FDEJVXV6OC5V.2 size=626177 2024-09-12T17:18:40.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.962+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=FDEJVXV6OC5V tag=4OBKUZUI1TDZ type=write size=3771905 2024-09-12T17:18:40.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.966+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~95VP1G69WODZ.0 size=1048576 2024-09-12T17:18:40.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.970+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~95VP1G69WODZ.1 size=1048576 2024-09-12T17:18:40.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.970+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~95VP1G69WODZ.2 size=276008 2024-09-12T17:18:40.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.970+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=95VP1G69WODZ tag=SUUX0QA6NSHG type=write size=3421736 2024-09-12T17:18:40.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.974+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=UBTTYDG19HPS type=del 2024-09-12T17:18:40.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.978+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=X9H7OJUAHVHJ type=del size=1206271 2024-09-12T17:18:40.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.982+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~NGNT4355ZLAB.0 size=329370 2024-09-12T17:18:40.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.986+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=NGNT4355ZLAB tag=4EU6Z50U50L2 type=write size=1377946 2024-09-12T17:18:40.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.986+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=W5LUO8VSGZGG type=del size=3542908 2024-09-12T17:18:40.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.986+0000 7f96641d38c0 1 < canceled part key=_multipart_KXJYJ9VX7YVW.2~55Q27ZOR5YJS.0 size=1048576 2024-09-12T17:18:40.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.990+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~55Q27ZOR5YJS.1 size=663701 2024-09-12T17:18:40.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.994+0000 7f96641d38c0 1 < canceled multipart upload key=KXJYJ9VX7YVW upload=55Q27ZOR5YJS tag=QGGH75LA5YZA type=write size=2760853 2024-09-12T17:18:41.000 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:40.998+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=PU6ON9X09R6W type=del size=1702092 2024-09-12T17:18:41.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.006+0000 7f96641d38c0 1 < suggested update operation key=XDL9O7TEMBYF tag=IZDZMBUVJOAR type=del size=3085878 2024-09-12T17:18:41.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.010+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=Z3X78HUNIDEV type=del size=3404647 2024-09-12T17:18:41.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.014+0000 7f96641d38c0 1 < suggested update operation key=6BH7SI911MMP tag=0VAY5AH2Z66M type=del size=2244200 2024-09-12T17:18:41.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.018+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=B2YWQ33G389M type=del size=1650043 2024-09-12T17:18:41.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.018+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=RBDVV3O6TZPB type=del 2024-09-12T17:18:41.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.026+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~SHPOTBQZA90J.0 size=860732 2024-09-12T17:18:41.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.026+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=SHPOTBQZA90J tag=QO4KU0HGLREN type=write size=1909308 2024-09-12T17:18:41.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.026+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~NPGGNOBFVH1S.0 size=1048576 2024-09-12T17:18:41.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.030+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~NPGGNOBFVH1S.1 size=1006537 2024-09-12T17:18:41.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.034+0000 7f96641d38c0 1 < completed multipart upload key=HRU241T0FUEZ upload=NPGGNOBFVH1S tag=N6TXM5W1ZK41 type=write size=3103689 2024-09-12T17:18:41.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.038+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=CB4X5O8D3Z57 type=del size=3863679 2024-09-12T17:18:41.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.042+0000 7f96641d38c0 -1 < failed to complete operation key=6BH7SI911MMP tag=LT5MYDX797CP type=del size=2992072: (22) Invalid argument 2024-09-12T17:18:41.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.046+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~6S2TKJ8QWJ7K.0 size=670203 2024-09-12T17:18:41.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.046+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=6S2TKJ8QWJ7K tag=WVRFSZ4QFX56 type=write size=1718779 2024-09-12T17:18:41.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.050+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~4DIQQ9EO161G.0 size=1048576 2024-09-12T17:18:41.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.054+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~4DIQQ9EO161G.1 size=477784 2024-09-12T17:18:41.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.058+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=4DIQQ9EO161G tag=B6T875RVXHAY type=write size=2574936 2024-09-12T17:18:41.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.062+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=4TDCUA22E5SE type=write size=521459 2024-09-12T17:18:41.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.066+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=5AUEPPINQK6M type=del 2024-09-12T17:18:41.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.066+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=SQ77Z23P7F5I type=del size=1511647 2024-09-12T17:18:41.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.070+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=LFXZXDMNH1SU type=del 2024-09-12T17:18:41.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.078+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~483HC3HK5YWR.0 size=921705 2024-09-12T17:18:41.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.078+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=483HC3HK5YWR tag=I3HXO8KXWAFJ type=write size=1970281 2024-09-12T17:18:41.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.082+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~WPU363IJ5RUQ.0 size=918644 2024-09-12T17:18:41.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.086+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=WPU363IJ5RUQ tag=RXWMG09NWYIX type=write size=1967220 2024-09-12T17:18:41.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.086+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=4LF040Q9P58Q type=del size=836373 2024-09-12T17:18:41.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.090+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=X2TNDKI1JMH5 type=del 2024-09-12T17:18:41.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.098+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~RZ4969X2FQ43.0 size=1048576 2024-09-12T17:18:41.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.098+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~RZ4969X2FQ43.1 size=1048576 2024-09-12T17:18:41.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.102+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~RZ4969X2FQ43.2 size=1018352 2024-09-12T17:18:41.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.102+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=RZ4969X2FQ43 tag=OT6FS0L6GRSG type=write size=4164080 2024-09-12T17:18:41.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.106+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~BIUQ6RF9CUU6.0 size=1048576 2024-09-12T17:18:41.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.106+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~BIUQ6RF9CUU6.1 size=1048576 2024-09-12T17:18:41.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.110+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~BIUQ6RF9CUU6.2 size=595581 2024-09-12T17:18:41.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.114+0000 7f96641d38c0 1 < completed multipart upload key=0X2HHMHJUJNL upload=BIUQ6RF9CUU6 tag=WVX608FCHZAU type=write size=3741309 2024-09-12T17:18:41.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.118+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=5Q4W35EB1Y2G type=del size=2553963 2024-09-12T17:18:41.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.118+0000 7f96641d38c0 1 < completed write operation key=3H8R2MJGR4SY tag=68X1IA6M9YB9 type=write size=292383 2024-09-12T17:18:41.124 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.122+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=ATTUNC1QJMP4 type=write size=1048073 2024-09-12T17:18:41.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.126+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~95VP1G69WODZ.0 size=1048576 2024-09-12T17:18:41.130 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.130+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~95VP1G69WODZ.1 size=1048576 2024-09-12T17:18:41.132 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.130+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~95VP1G69WODZ.2 size=276008 2024-09-12T17:18:41.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.134+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=95VP1G69WODZ tag=SUUX0QA6NSHG type=write size=3421736 2024-09-12T17:18:41.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.142+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~26L2CAB1DCML.0 size=1048576 2024-09-12T17:18:41.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.142+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~26L2CAB1DCML.1 size=1048576 2024-09-12T17:18:41.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.146+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~26L2CAB1DCML.2 size=6018 2024-09-12T17:18:41.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.146+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=26L2CAB1DCML tag=Y4MHGMW968OB type=write size=3151746 2024-09-12T17:18:41.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.150+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=X9H7OJUAHVHJ type=del 2024-09-12T17:18:41.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.154+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=MDETAOUNV092 type=del size=318457 2024-09-12T17:18:41.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.154+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=W5LUO8VSGZGG type=del 2024-09-12T17:18:41.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.158+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=8EE8V2Y6U9ZX type=write size=993270 2024-09-12T17:18:41.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.162+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=PU6ON9X09R6W type=del 2024-09-12T17:18:41.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.166+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=TFKJTVCVLO6X type=write size=283168 2024-09-12T17:18:41.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.166+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=Z3X78HUNIDEV type=del 2024-09-12T17:18:41.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.174+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~GX0HJDO3Q08Z.0 size=1048576 2024-09-12T17:18:41.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.178+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~GX0HJDO3Q08Z.1 size=1048576 2024-09-12T17:18:41.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.178+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~GX0HJDO3Q08Z.2 size=839339 2024-09-12T17:18:41.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.178+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=GX0HJDO3Q08Z tag=696LGC47XBIR type=write size=3985067 2024-09-12T17:18:41.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.182+0000 7f96641d38c0 1 < completed delete operation key=5ZZI4F92J7BO tag=B2YWQ33G389M type=del 2024-09-12T17:18:41.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.186+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~1F91B6IDWQ2A.0 size=1048576 2024-09-12T17:18:41.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.190+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~1F91B6IDWQ2A.1 size=677439 2024-09-12T17:18:41.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.190+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=1F91B6IDWQ2A tag=2UCMCHB40W8G type=write size=2774591 2024-09-12T17:18:41.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.194+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~SHPOTBQZA90J.0 size=860732 2024-09-12T17:18:41.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.202+0000 7f96641d38c0 1 < completed multipart upload key=EFORFJYOM45R upload=SHPOTBQZA90J tag=QO4KU0HGLREN type=write size=1909308 2024-09-12T17:18:41.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.202+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=HD3FAVY6D2GQ type=del size=3819928 2024-09-12T17:18:41.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.206+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=CB4X5O8D3Z57 type=del 2024-09-12T17:18:41.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.210+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=BHX1XH77Y9QZ type=del size=394966 2024-09-12T17:18:41.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.210+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~6S2TKJ8QWJ7K.0 size=670203 2024-09-12T17:18:41.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.218+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=6S2TKJ8QWJ7K tag=WVRFSZ4QFX56 type=write size=1718779 2024-09-12T17:18:41.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.222+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~WPIBKPA6MMV7.0 size=1048576 2024-09-12T17:18:41.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.222+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~WPIBKPA6MMV7.1 size=1048576 2024-09-12T17:18:41.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.226+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~WPIBKPA6MMV7.2 size=564800 2024-09-12T17:18:41.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.226+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=WPIBKPA6MMV7 tag=AJ3TU9DU92NW type=write size=3710528 2024-09-12T17:18:41.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.230+0000 7f96641d38c0 1 < completed write operation key=BDI9YFZCT5YY tag=4TDCUA22E5SE type=write size=521459 2024-09-12T17:18:41.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.230+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=HHU3TP8ODOSO type=del size=445744 2024-09-12T17:18:41.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.234+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=SQ77Z23P7F5I type=del 2024-09-12T17:18:41.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.238+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=5SESSND58MDF type=del size=2566284 2024-09-12T17:18:41.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.242+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~483HC3HK5YWR.0 size=921705 2024-09-12T17:18:41.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.246+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=483HC3HK5YWR tag=I3HXO8KXWAFJ type=write size=1970281 2024-09-12T17:18:41.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.250+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~6XHRHYEQNMIQ.0 size=1048576 2024-09-12T17:18:41.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.254+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~6XHRHYEQNMIQ.1 size=936560 2024-09-12T17:18:41.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.254+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=6XHRHYEQNMIQ tag=Y2N65876F5DP type=write size=3033712 2024-09-12T17:18:41.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.254+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=4LF040Q9P58Q type=del 2024-09-12T17:18:41.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.258+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=KYJMNB4CKFON type=del size=3477432 2024-09-12T17:18:41.263 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.262+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~RZ4969X2FQ43.0 size=1048576 2024-09-12T17:18:41.266 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.266+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~RZ4969X2FQ43.1 size=1048576 2024-09-12T17:18:41.268 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.266+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~RZ4969X2FQ43.2 size=1018352 2024-09-12T17:18:41.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.270+0000 7f96641d38c0 1 < completed multipart upload key=XDL9O7TEMBYF upload=RZ4969X2FQ43 tag=OT6FS0L6GRSG type=write size=4164080 2024-09-12T17:18:41.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.278+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~KVX2ENU8VQCF.0 size=1048576 2024-09-12T17:18:41.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.278+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~KVX2ENU8VQCF.1 size=1048576 2024-09-12T17:18:41.284 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.282+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~KVX2ENU8VQCF.2 size=387608 2024-09-12T17:18:41.284 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.282+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=KVX2ENU8VQCF tag=K3QGEHAKFZET type=write size=3533336 2024-09-12T17:18:41.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.286+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=5Q4W35EB1Y2G type=del 2024-09-12T17:18:41.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.290+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~9R4K7ROFGZTW.0 size=1048576 2024-09-12T17:18:41.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.294+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~9R4K7ROFGZTW.1 size=1048576 2024-09-12T17:18:41.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.298+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~9R4K7ROFGZTW.2 size=457370 2024-09-12T17:18:41.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.298+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=9R4K7ROFGZTW tag=R1ILH72ZXVOG type=write size=3603098 2024-09-12T17:18:41.301 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.298+0000 7f96641d38c0 1 < completed write operation key=6BH7SI911MMP tag=ATTUNC1QJMP4 type=write size=1048073 2024-09-12T17:18:41.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.302+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=74KZJBI9DJ07 type=del size=2032054 2024-09-12T17:18:41.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.306+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~26L2CAB1DCML.0 size=1048576 2024-09-12T17:18:41.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.310+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~26L2CAB1DCML.1 size=1048576 2024-09-12T17:18:41.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.310+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~26L2CAB1DCML.2 size=6018 2024-09-12T17:18:41.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.314+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=26L2CAB1DCML tag=Y4MHGMW968OB type=write size=3151746 2024-09-12T17:18:41.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.322+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~UEY0GN2PDOHI.0 size=1048576 2024-09-12T17:18:41.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.322+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~UEY0GN2PDOHI.1 size=676048 2024-09-12T17:18:41.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.322+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=UEY0GN2PDOHI tag=L8ZWZJG576GS type=write size=2773200 2024-09-12T17:18:41.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.326+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=MDETAOUNV092 type=del 2024-09-12T17:18:41.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.334+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~U9DXXW6ZXIHQ.0 size=1048576 2024-09-12T17:18:41.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.338+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~U9DXXW6ZXIHQ.1 size=158953 2024-09-12T17:18:41.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.338+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=U9DXXW6ZXIHQ tag=UXBQV7XRUQXM type=write size=2256105 2024-09-12T17:18:41.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.338+0000 7f96641d38c0 1 < completed write operation key=NGA3P9RZJYWT tag=8EE8V2Y6U9ZX type=write size=993270 2024-09-12T17:18:41.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.346+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~1XZTBXOWSK08.0 size=1048576 2024-09-12T17:18:41.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.346+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~1XZTBXOWSK08.1 size=1048576 2024-09-12T17:18:41.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.350+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~1XZTBXOWSK08.2 size=558786 2024-09-12T17:18:41.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.350+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=1XZTBXOWSK08 tag=3QIC1O7BZWJG type=write size=3704514 2024-09-12T17:18:41.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.354+0000 7f96641d38c0 1 < completed write operation key=BDI9YFZCT5YY tag=TFKJTVCVLO6X type=write size=283168 2024-09-12T17:18:41.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.354+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=IEN84I5AJO12 type=del size=358331 2024-09-12T17:18:41.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.354+0000 7f96641d38c0 1 < canceled part key=_multipart_ZKDOIH5SH6K0.2~GX0HJDO3Q08Z.0 size=1048576 2024-09-12T17:18:41.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.354+0000 7f96641d38c0 1 < canceled part key=_multipart_ZKDOIH5SH6K0.2~GX0HJDO3Q08Z.1 size=1048576 2024-09-12T17:18:41.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.358+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~GX0HJDO3Q08Z.2 size=839339 2024-09-12T17:18:41.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.362+0000 7f96641d38c0 1 < canceled multipart upload key=ZKDOIH5SH6K0 upload=GX0HJDO3Q08Z tag=696LGC47XBIR type=write size=3985067 2024-09-12T17:18:41.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.366+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=DSM6WGE6MDRU type=write size=1034665 2024-09-12T17:18:41.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.370+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~1F91B6IDWQ2A.0 size=1048576 2024-09-12T17:18:41.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.374+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~1F91B6IDWQ2A.1 size=677439 2024-09-12T17:18:41.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.378+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=1F91B6IDWQ2A tag=2UCMCHB40W8G type=write size=2774591 2024-09-12T17:18:41.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.382+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=1XHFBO1F39QC type=del size=972740 2024-09-12T17:18:41.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.386+0000 7f96641d38c0 1 < suggested remove operation key=NR82RUK97NQA tag=HD3FAVY6D2GQ type=del 2024-09-12T17:18:41.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.390+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=7H1Z08SVOEWF type=del size=2209548 2024-09-12T17:18:41.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.390+0000 7f96641d38c0 1 < completed delete operation key=5ZZI4F92J7BO tag=BHX1XH77Y9QZ type=del 2024-09-12T17:18:41.399 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.398+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~0TCNG5X94YLE.0 size=1048576 2024-09-12T17:18:41.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.398+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~0TCNG5X94YLE.1 size=1048576 2024-09-12T17:18:41.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.402+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~0TCNG5X94YLE.2 size=682086 2024-09-12T17:18:41.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.402+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=0TCNG5X94YLE tag=NY6W27EQFME8 type=write size=3827814 2024-09-12T17:18:41.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.406+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~WPIBKPA6MMV7.0 size=1048576 2024-09-12T17:18:41.409 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.406+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~WPIBKPA6MMV7.1 size=1048576 2024-09-12T17:18:41.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.410+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~WPIBKPA6MMV7.2 size=564800 2024-09-12T17:18:41.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.414+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=WPIBKPA6MMV7 tag=AJ3TU9DU92NW type=write size=3710528 2024-09-12T17:18:41.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.414+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=C3M3GVR2IYTS type=del size=2465345 2024-09-12T17:18:41.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.418+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=HHU3TP8ODOSO type=del 2024-09-12T17:18:41.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.422+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=KH38MB0EUP1L type=del size=920594 2024-09-12T17:18:41.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.422+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=5SESSND58MDF type=del 2024-09-12T17:18:41.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.426+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~VZT7FYU8TXKN.0 size=1048576 2024-09-12T17:18:41.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.430+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~VZT7FYU8TXKN.1 size=1048576 2024-09-12T17:18:41.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.434+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~VZT7FYU8TXKN.2 size=1042028 2024-09-12T17:18:41.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.434+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=VZT7FYU8TXKN tag=5LCZ0HSJBFVA type=write size=4187756 2024-09-12T17:18:41.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.434+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~6XHRHYEQNMIQ.0 size=1048576 2024-09-12T17:18:41.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.438+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~6XHRHYEQNMIQ.1 size=936560 2024-09-12T17:18:41.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.442+0000 7f96641d38c0 1 < completed multipart upload key=EFORFJYOM45R upload=6XHRHYEQNMIQ tag=Y2N65876F5DP type=write size=3033712 2024-09-12T17:18:41.448 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.446+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~WODW5VXP96K2.0 size=1048576 2024-09-12T17:18:41.450 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.450+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~WODW5VXP96K2.1 size=1048576 2024-09-12T17:18:41.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.450+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~WODW5VXP96K2.2 size=646355 2024-09-12T17:18:41.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.450+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=WODW5VXP96K2 tag=CA69XQ0KYCXA type=write size=3792083 2024-09-12T17:18:41.456 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.454+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=KYJMNB4CKFON type=del 2024-09-12T17:18:41.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.458+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=PEWM8VFOCKRV type=write size=846575 2024-09-12T17:18:41.466 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.466+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~KVX2ENU8VQCF.0 size=1048576 2024-09-12T17:18:41.469 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.466+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~KVX2ENU8VQCF.1 size=1048576 2024-09-12T17:18:41.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.470+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~KVX2ENU8VQCF.2 size=387608 2024-09-12T17:18:41.477 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.474+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=KVX2ENU8VQCF tag=K3QGEHAKFZET type=write size=3533336 2024-09-12T17:18:41.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.478+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=GWFQGKF3FRVW type=del size=1043253 2024-09-12T17:18:41.483 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.482+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~9R4K7ROFGZTW.0 size=1048576 2024-09-12T17:18:41.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.486+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~9R4K7ROFGZTW.1 size=1048576 2024-09-12T17:18:41.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.486+0000 7f96641d38c0 1 < canceled part key=_multipart_37YXLWPZGA9J.2~9R4K7ROFGZTW.2 size=457370 2024-09-12T17:18:41.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.490+0000 7f96641d38c0 1 < canceled multipart upload key=37YXLWPZGA9J upload=9R4K7ROFGZTW tag=R1ILH72ZXVOG type=write size=3603098 2024-09-12T17:18:41.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.494+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~G82YJOOASH5Z.0 size=1048576 2024-09-12T17:18:41.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.494+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~G82YJOOASH5Z.1 size=754209 2024-09-12T17:18:41.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.494+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=G82YJOOASH5Z tag=4GOWRZK7GZLB type=write size=2851361 2024-09-12T17:18:41.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.498+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=74KZJBI9DJ07 type=del 2024-09-12T17:18:41.505 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.502+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~RJB7LF6VPYC2.0 size=1048576 2024-09-12T17:18:41.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.506+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~RJB7LF6VPYC2.1 size=1048576 2024-09-12T17:18:41.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.510+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~RJB7LF6VPYC2.2 size=180972 2024-09-12T17:18:41.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.510+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=RJB7LF6VPYC2 tag=LXKB1UGTR4FR type=write size=3326700 2024-09-12T17:18:41.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.510+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~UEY0GN2PDOHI.0 size=1048576 2024-09-12T17:18:41.515 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.514+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~UEY0GN2PDOHI.1 size=676048 2024-09-12T17:18:41.520 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.518+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=UEY0GN2PDOHI tag=L8ZWZJG576GS type=write size=2773200 2024-09-12T17:18:41.523 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.522+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=BA9F3SMBK9D8 type=del size=3802104 2024-09-12T17:18:41.526 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.526+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~U9DXXW6ZXIHQ.0 size=1048576 2024-09-12T17:18:41.529 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.526+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~U9DXXW6ZXIHQ.1 size=158953 2024-09-12T17:18:41.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.534+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=U9DXXW6ZXIHQ tag=UXBQV7XRUQXM type=write size=2256105 2024-09-12T17:18:41.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.538+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~JML5ZQF04J1V.0 size=1048576 2024-09-12T17:18:41.541 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.538+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~JML5ZQF04J1V.1 size=748695 2024-09-12T17:18:41.541 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.538+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=JML5ZQF04J1V tag=MSU0G6FLJDKQ type=write size=2845847 2024-09-12T17:18:41.544 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.542+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~1XZTBXOWSK08.0 size=1048576 2024-09-12T17:18:41.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.546+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~1XZTBXOWSK08.1 size=1048576 2024-09-12T17:18:41.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.546+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~1XZTBXOWSK08.2 size=558786 2024-09-12T17:18:41.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.554+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=1XZTBXOWSK08 tag=3QIC1O7BZWJG type=write size=3704514 2024-09-12T17:18:41.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.554+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=UIE7WKTKEU8M type=del size=3472454 2024-09-12T17:18:41.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.562+0000 7f96641d38c0 1 < suggested remove operation key=2TN3M8NKV9LN tag=IEN84I5AJO12 type=del 2024-09-12T17:18:41.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.562+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=2AG2J6ZTLOD1 type=del size=2886000 2024-09-12T17:18:41.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.566+0000 7f96641d38c0 1 < completed write operation key=L9HUVE5A5NGT tag=DSM6WGE6MDRU type=write size=1034665 2024-09-12T17:18:41.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.570+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~XDTUE9XW871T.0 size=1041451 2024-09-12T17:18:41.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.570+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=XDTUE9XW871T tag=4I6D1YZNN0E7 type=write size=2090027 2024-09-12T17:18:41.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.574+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=1XHFBO1F39QC type=del 2024-09-12T17:18:41.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.578+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~REBS3EL231PM.0 size=393625 2024-09-12T17:18:41.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.578+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=REBS3EL231PM tag=NGZC4KRN96YS type=write size=1442201 2024-09-12T17:18:41.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.578+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=7H1Z08SVOEWF type=del 2024-09-12T17:18:41.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.582+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=JPGGVVNQXQK7 type=del size=2135614 2024-09-12T17:18:41.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.586+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~0TCNG5X94YLE.0 size=1048576 2024-09-12T17:18:41.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.586+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~0TCNG5X94YLE.1 size=1048576 2024-09-12T17:18:41.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.590+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~0TCNG5X94YLE.2 size=682086 2024-09-12T17:18:41.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.594+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=0TCNG5X94YLE tag=NY6W27EQFME8 type=write size=3827814 2024-09-12T17:18:41.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.598+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~770NZLC609YN.0 size=360311 2024-09-12T17:18:41.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.598+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=770NZLC609YN tag=S6GUEZ3GQ0GY type=write size=1408887 2024-09-12T17:18:41.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.602+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=C3M3GVR2IYTS type=del 2024-09-12T17:18:41.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.606+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=HDK637MRKCHK type=del size=4181415 2024-09-12T17:18:41.609 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.606+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=KH38MB0EUP1L type=del 2024-09-12T17:18:41.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.610+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=PZG523Z9XV1R type=del size=2444719 2024-09-12T17:18:41.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.614+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~VZT7FYU8TXKN.0 size=1048576 2024-09-12T17:18:41.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.614+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~VZT7FYU8TXKN.1 size=1048576 2024-09-12T17:18:41.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.618+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~VZT7FYU8TXKN.2 size=1042028 2024-09-12T17:18:41.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.622+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=VZT7FYU8TXKN tag=5LCZ0HSJBFVA type=write size=4187756 2024-09-12T17:18:41.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.626+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~VH1VD0HI9BGD.0 size=1048576 2024-09-12T17:18:41.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.626+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~VH1VD0HI9BGD.1 size=8921 2024-09-12T17:18:41.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.626+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=VH1VD0HI9BGD tag=9HRWO8IIST7N type=write size=2106073 2024-09-12T17:18:41.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.630+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~WODW5VXP96K2.0 size=1048576 2024-09-12T17:18:41.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.634+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~WODW5VXP96K2.1 size=1048576 2024-09-12T17:18:41.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.634+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~WODW5VXP96K2.2 size=646355 2024-09-12T17:18:41.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.638+0000 7f96641d38c0 1 < completed multipart upload key=0X2HHMHJUJNL upload=WODW5VXP96K2 tag=CA69XQ0KYCXA type=write size=3792083 2024-09-12T17:18:41.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.642+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=BWA6B7MPUPRK type=del size=116183 2024-09-12T17:18:41.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.646+0000 7f96641d38c0 1 < completed write operation key=NR82RUK97NQA tag=PEWM8VFOCKRV type=write size=846575 2024-09-12T17:18:41.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.646+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=E6C1Y85I4KAA type=del size=687628 2024-09-12T17:18:41.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.650+0000 7f96641d38c0 1 < canceled operation key=UBYUSW4C2V19 tag=GWFQGKF3FRVW type=del size=1043253 2024-09-12T17:18:41.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.654+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~79OEREYAPIPE.0 size=1048576 2024-09-12T17:18:41.658 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.658+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~79OEREYAPIPE.1 size=1048576 2024-09-12T17:18:41.660 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.658+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~79OEREYAPIPE.2 size=774710 2024-09-12T17:18:41.660 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.658+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=79OEREYAPIPE tag=J2DTTZY6OQPH type=write size=3920438 2024-09-12T17:18:41.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.662+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~G82YJOOASH5Z.0 size=1048576 2024-09-12T17:18:41.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.662+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~G82YJOOASH5Z.1 size=754209 2024-09-12T17:18:41.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.666+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=G82YJOOASH5Z tag=4GOWRZK7GZLB type=write size=2851361 2024-09-12T17:18:41.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.670+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=C4HJRHPO03OI type=del size=1234763 2024-09-12T17:18:41.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.670+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~RJB7LF6VPYC2.0 size=1048576 2024-09-12T17:18:41.675 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.674+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~RJB7LF6VPYC2.1 size=1048576 2024-09-12T17:18:41.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.674+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~RJB7LF6VPYC2.2 size=180972 2024-09-12T17:18:41.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.678+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=RJB7LF6VPYC2 tag=LXKB1UGTR4FR type=write size=3326700 2024-09-12T17:18:41.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.682+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~ZAHU9LPA2E5U.0 size=1048576 2024-09-12T17:18:41.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.686+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~ZAHU9LPA2E5U.1 size=1048576 2024-09-12T17:18:41.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.686+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~ZAHU9LPA2E5U.2 size=44021 2024-09-12T17:18:41.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.686+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=ZAHU9LPA2E5U tag=7KU58J9ASV56 type=write size=3189749 2024-09-12T17:18:41.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.690+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=BA9F3SMBK9D8 type=del 2024-09-12T17:18:41.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.694+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~HSYT322GL00N.0 size=233451 2024-09-12T17:18:41.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.694+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=HSYT322GL00N tag=1WB1A12UOZAR type=write size=1282027 2024-09-12T17:18:41.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.698+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~JML5ZQF04J1V.0 size=1048576 2024-09-12T17:18:41.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.698+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~JML5ZQF04J1V.1 size=748695 2024-09-12T17:18:41.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.702+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=JML5ZQF04J1V tag=MSU0G6FLJDKQ type=write size=2845847 2024-09-12T17:18:41.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.710+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~6N7TDM7MHEL5.0 size=1048576 2024-09-12T17:18:41.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.714+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~6N7TDM7MHEL5.1 size=461359 2024-09-12T17:18:41.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.714+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=6N7TDM7MHEL5 tag=XC5E1FSDP9WC type=write size=2558511 2024-09-12T17:18:41.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.718+0000 7f96641d38c0 1 < suggested update operation key=GKJJDBNXC6QH tag=UIE7WKTKEU8M type=del size=3472454 2024-09-12T17:18:41.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.722+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=9MJ6ZD2LD93J type=del size=246030 2024-09-12T17:18:41.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.722+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=2AG2J6ZTLOD1 type=del 2024-09-12T17:18:41.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.730+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~XN3C889WRJSH.0 size=1048576 2024-09-12T17:18:41.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.730+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~XN3C889WRJSH.1 size=979986 2024-09-12T17:18:41.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.730+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=XN3C889WRJSH tag=AQC9HLQCTEQ3 type=write size=3077138 2024-09-12T17:18:41.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.734+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~XDTUE9XW871T.0 size=1041451 2024-09-12T17:18:41.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.738+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=XDTUE9XW871T tag=4I6D1YZNN0E7 type=write size=2090027 2024-09-12T17:18:41.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.738+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=HALPXDWLOUDQ type=del size=891070 2024-09-12T17:18:41.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.742+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~REBS3EL231PM.0 size=393625 2024-09-12T17:18:41.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.746+0000 7f96641d38c0 1 < completed multipart upload key=NGA3P9RZJYWT upload=REBS3EL231PM tag=NGZC4KRN96YS type=write size=1442201 2024-09-12T17:18:41.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.750+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~4YIHFXS9G37Z.0 size=1048576 2024-09-12T17:18:41.753 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.750+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~4YIHFXS9G37Z.1 size=265233 2024-09-12T17:18:41.753 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.750+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=4YIHFXS9G37Z tag=10CODIV6915J type=write size=2362385 2024-09-12T17:18:41.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.754+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=JPGGVVNQXQK7 type=del 2024-09-12T17:18:41.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.758+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=2RU3PJI9GV5A type=del size=420308 2024-09-12T17:18:41.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.758+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~770NZLC609YN.0 size=360311 2024-09-12T17:18:41.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.762+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=770NZLC609YN tag=S6GUEZ3GQ0GY type=write size=1408887 2024-09-12T17:18:41.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.766+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=QT495R9FODFK type=write size=130202 2024-09-12T17:18:41.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.770+0000 7f96641d38c0 -1 < failed to complete operation key=GKJJDBNXC6QH tag=HDK637MRKCHK type=del size=4181415: (22) Invalid argument 2024-09-12T17:18:41.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.770+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=ARV1RRPCOS2J type=del size=573611 2024-09-12T17:18:41.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.774+0000 7f96641d38c0 1 < canceled operation key=3H8R2MJGR4SY tag=PZG523Z9XV1R type=del size=2444719 2024-09-12T17:18:41.782 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.782+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~AHTZO4NMTHRT.0 size=1048576 2024-09-12T17:18:41.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.782+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~AHTZO4NMTHRT.1 size=1048576 2024-09-12T17:18:41.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.786+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~AHTZO4NMTHRT.2 size=986892 2024-09-12T17:18:41.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.786+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=AHTZO4NMTHRT tag=BLU24YF8TNHI type=write size=4132620 2024-09-12T17:18:41.790 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.790+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~VH1VD0HI9BGD.0 size=1048576 2024-09-12T17:18:41.793 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.790+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~VH1VD0HI9BGD.1 size=8921 2024-09-12T17:18:41.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.798+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=VH1VD0HI9BGD tag=9HRWO8IIST7N type=write size=2106073 2024-09-12T17:18:41.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.802+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=TZ64GN1ZYEI7 type=del size=2409155 2024-09-12T17:18:41.805 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.802+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=BWA6B7MPUPRK type=del 2024-09-12T17:18:41.808 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.806+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=9NT4V397KJO3 type=del size=3961526 2024-09-12T17:18:41.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.814+0000 7f96641d38c0 1 < suggested remove operation key=UBYUSW4C2V19 tag=E6C1Y85I4KAA type=del 2024-09-12T17:18:41.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.818+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~V3VB8V7UG6SJ.0 size=1048576 2024-09-12T17:18:41.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.822+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~V3VB8V7UG6SJ.1 size=543183 2024-09-12T17:18:41.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.822+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=V3VB8V7UG6SJ tag=R248L37M0Z2X type=write size=2640335 2024-09-12T17:18:41.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.826+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~79OEREYAPIPE.0 size=1048576 2024-09-12T17:18:41.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.826+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~79OEREYAPIPE.1 size=1048576 2024-09-12T17:18:41.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.826+0000 7f96641d38c0 1 < canceled part key=_multipart_BDI9YFZCT5YY.2~79OEREYAPIPE.2 size=774710 2024-09-12T17:18:41.833 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.830+0000 7f96641d38c0 1 < canceled multipart upload key=BDI9YFZCT5YY upload=79OEREYAPIPE tag=J2DTTZY6OQPH type=write size=3920438 2024-09-12T17:18:41.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.834+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=I9D5GLOQBRZQ type=del size=3455367 2024-09-12T17:18:41.839 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.838+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=C4HJRHPO03OI type=del 2024-09-12T17:18:41.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.842+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~N89NUY7LOE6K.0 size=1048576 2024-09-12T17:18:41.847 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.846+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~N89NUY7LOE6K.1 size=908652 2024-09-12T17:18:41.847 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.846+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=N89NUY7LOE6K tag=C82GBQGYMH5K type=write size=3005804 2024-09-12T17:18:41.848 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.846+0000 7f96641d38c0 1 < canceled part key=_multipart_EFORFJYOM45R.2~ZAHU9LPA2E5U.0 size=1048576 2024-09-12T17:18:41.850 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.850+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~ZAHU9LPA2E5U.1 size=1048576 2024-09-12T17:18:41.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.850+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~ZAHU9LPA2E5U.2 size=44021 2024-09-12T17:18:41.856 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.854+0000 7f96641d38c0 1 < canceled multipart upload key=EFORFJYOM45R upload=ZAHU9LPA2E5U tag=7KU58J9ASV56 type=write size=3189749 2024-09-12T17:18:41.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.858+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=T4EUVOP70REP type=del size=3270748 2024-09-12T17:18:41.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.862+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~HSYT322GL00N.0 size=233451 2024-09-12T17:18:41.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.866+0000 7f96641d38c0 1 < completed multipart upload key=HRU241T0FUEZ upload=HSYT322GL00N tag=1WB1A12UOZAR type=write size=1282027 2024-09-12T17:18:41.870 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.870+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~S4WCJ8Q202W0.0 size=1048576 2024-09-12T17:18:41.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.870+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~S4WCJ8Q202W0.1 size=1048576 2024-09-12T17:18:41.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.874+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~S4WCJ8Q202W0.2 size=571921 2024-09-12T17:18:41.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.874+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=S4WCJ8Q202W0 tag=10FQBQY9M9S3 type=write size=3717649 2024-09-12T17:18:41.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.874+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~6N7TDM7MHEL5.0 size=1048576 2024-09-12T17:18:41.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.878+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~6N7TDM7MHEL5.1 size=461359 2024-09-12T17:18:41.884 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.882+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=6N7TDM7MHEL5 tag=XC5E1FSDP9WC type=write size=2558511 2024-09-12T17:18:41.888 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.886+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~R6UL38G68Q5B.0 size=1048576 2024-09-12T17:18:41.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.890+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~R6UL38G68Q5B.1 size=356742 2024-09-12T17:18:41.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.890+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=R6UL38G68Q5B tag=UFLLSXI8U9HQ type=write size=2453894 2024-09-12T17:18:41.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.890+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=9MJ6ZD2LD93J type=del 2024-09-12T17:18:41.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.894+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=GXG6TL7HR73V type=del size=1716374 2024-09-12T17:18:41.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.898+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~XN3C889WRJSH.0 size=1048576 2024-09-12T17:18:41.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.902+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~XN3C889WRJSH.1 size=979986 2024-09-12T17:18:41.907 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.906+0000 7f96641d38c0 1 < completed multipart upload key=47QQRTJKM4DB upload=XN3C889WRJSH tag=AQC9HLQCTEQ3 type=write size=3077138 2024-09-12T17:18:41.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.910+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=5PIKH4C9MJ7L type=write size=765328 2024-09-12T17:18:41.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.910+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=HALPXDWLOUDQ type=del 2024-09-12T17:18:41.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.914+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=SJJUW91MTI58 type=del size=2939288 2024-09-12T17:18:41.917 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.914+0000 7f96641d38c0 1 < canceled part key=_multipart_ZKDOIH5SH6K0.2~4YIHFXS9G37Z.0 size=1048576 2024-09-12T17:18:41.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.918+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~4YIHFXS9G37Z.1 size=265233 2024-09-12T17:18:41.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.922+0000 7f96641d38c0 1 < canceled multipart upload key=ZKDOIH5SH6K0 upload=4YIHFXS9G37Z tag=10CODIV6915J type=write size=2362385 2024-09-12T17:18:41.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.926+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=TH0QWRJQC1TH type=write size=942349 2024-09-12T17:18:41.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.930+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=2RU3PJI9GV5A type=del 2024-09-12T17:18:41.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.934+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~N7R4WEF0S1PW.0 size=1048576 2024-09-12T17:18:41.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.938+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~N7R4WEF0S1PW.1 size=556564 2024-09-12T17:18:41.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.938+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=N7R4WEF0S1PW tag=E1AHUWY49GN5 type=write size=2653716 2024-09-12T17:18:41.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.938+0000 7f96641d38c0 1 < completed write operation key=G7CWVD9C2H2J tag=QT495R9FODFK type=write size=130202 2024-09-12T17:18:41.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.942+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=NSKQ9SG806FJ type=del size=4170124 2024-09-12T17:18:41.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.946+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=ARV1RRPCOS2J type=del 2024-09-12T17:18:41.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.946+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=ZH1YVE9CAUK7 type=write size=346167 2024-09-12T17:18:41.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.950+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~AHTZO4NMTHRT.0 size=1048576 2024-09-12T17:18:41.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.950+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~AHTZO4NMTHRT.1 size=1048576 2024-09-12T17:18:41.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.954+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~AHTZO4NMTHRT.2 size=986892 2024-09-12T17:18:41.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.958+0000 7f96641d38c0 1 < completed multipart upload key=G7CWVD9C2H2J upload=AHTZO4NMTHRT tag=BLU24YF8TNHI type=write size=4132620 2024-09-12T17:18:41.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.962+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=O5X4POEQRL1O type=write size=433406 2024-09-12T17:18:41.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.966+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=TZ64GN1ZYEI7 type=del 2024-09-12T17:18:41.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.970+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=W1JOC1MGL3EE type=del size=2703865 2024-09-12T17:18:41.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.974+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=9NT4V397KJO3 type=del 2024-09-12T17:18:41.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.978+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~MGKGSQMC3L31.0 size=474126 2024-09-12T17:18:41.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.978+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=MGKGSQMC3L31 tag=1MBPIW7DY7UB type=write size=1522702 2024-09-12T17:18:41.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.982+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~V3VB8V7UG6SJ.0 size=1048576 2024-09-12T17:18:41.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.982+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~V3VB8V7UG6SJ.1 size=543183 2024-09-12T17:18:41.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.986+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=V3VB8V7UG6SJ tag=R248L37M0Z2X type=write size=2640335 2024-09-12T17:18:41.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.990+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=RZPOVEC5X8R7 type=del size=1528781 2024-09-12T17:18:41.994 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.994+0000 7f96641d38c0 1 < canceled operation key=9CBFWXFX7O3N tag=I9D5GLOQBRZQ type=del size=3455367 2024-09-12T17:18:41.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.994+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=TQNJN4IMEQJI type=del size=1387145 2024-09-12T17:18:41.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.998+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~N89NUY7LOE6K.0 size=1048576 2024-09-12T17:18:42.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:41.998+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~N89NUY7LOE6K.1 size=908652 2024-09-12T17:18:42.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.002+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=N89NUY7LOE6K tag=C82GBQGYMH5K type=write size=3005804 2024-09-12T17:18:42.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.006+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~V0VIKTOZL2KN.0 size=989146 2024-09-12T17:18:42.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.006+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=V0VIKTOZL2KN tag=7SWCSL441VFX type=write size=2037722 2024-09-12T17:18:42.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.010+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=T4EUVOP70REP type=del 2024-09-12T17:18:42.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.010+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=W28JL5QEQSCW type=del size=1331102 2024-09-12T17:18:42.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.014+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~S4WCJ8Q202W0.0 size=1048576 2024-09-12T17:18:42.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.014+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~S4WCJ8Q202W0.1 size=1048576 2024-09-12T17:18:42.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.018+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~S4WCJ8Q202W0.2 size=571921 2024-09-12T17:18:42.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.022+0000 7f96641d38c0 1 < completed multipart upload key=EFORFJYOM45R upload=S4WCJ8Q202W0 tag=10FQBQY9M9S3 type=write size=3717649 2024-09-12T17:18:42.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.026+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~XYR8QFFEY950.0 size=1048576 2024-09-12T17:18:42.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.030+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~XYR8QFFEY950.1 size=1048576 2024-09-12T17:18:42.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.030+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~XYR8QFFEY950.2 size=146132 2024-09-12T17:18:42.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.030+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=XYR8QFFEY950 tag=61ZYWCJR3NPM type=write size=3291860 2024-09-12T17:18:42.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.030+0000 7f96641d38c0 1 < canceled part key=_multipart_KXJYJ9VX7YVW.2~R6UL38G68Q5B.0 size=1048576 2024-09-12T17:18:42.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.030+0000 7f96641d38c0 1 < canceled part key=_multipart_KXJYJ9VX7YVW.2~R6UL38G68Q5B.1 size=356742 2024-09-12T17:18:42.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.034+0000 7f96641d38c0 1 < canceled multipart upload key=KXJYJ9VX7YVW upload=R6UL38G68Q5B tag=UFLLSXI8U9HQ type=write size=2453894 2024-09-12T17:18:42.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.038+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=DCUJLXXEO8YE type=del size=2107332 2024-09-12T17:18:42.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.038+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=GXG6TL7HR73V type=del 2024-09-12T17:18:42.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.042+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=CKHVLZ9C5RC1 type=del size=4141369 2024-09-12T17:18:42.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.042+0000 7f96641d38c0 1 < completed write operation key=UBYUSW4C2V19 tag=5PIKH4C9MJ7L type=write size=765328 2024-09-12T17:18:42.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.046+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=GI0MYFACNRA9 type=del size=2715090 2024-09-12T17:18:42.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.046+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=SJJUW91MTI58 type=del 2024-09-12T17:18:42.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.050+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=EELEM2MVT7PG type=del size=1012805 2024-09-12T17:18:42.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.054+0000 7f96641d38c0 1 < completed write operation key=UBYUSW4C2V19 tag=TH0QWRJQC1TH type=write size=942349 2024-09-12T17:18:42.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.058+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~Z7GW89EY181A.0 size=1048576 2024-09-12T17:18:42.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.058+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~Z7GW89EY181A.1 size=1048576 2024-09-12T17:18:42.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.062+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~Z7GW89EY181A.2 size=556633 2024-09-12T17:18:42.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.062+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=Z7GW89EY181A tag=DIEADJLYPCTJ type=write size=3702361 2024-09-12T17:18:42.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.062+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~N7R4WEF0S1PW.0 size=1048576 2024-09-12T17:18:42.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.066+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~N7R4WEF0S1PW.1 size=556564 2024-09-12T17:18:42.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.070+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=N7R4WEF0S1PW tag=E1AHUWY49GN5 type=write size=2653716 2024-09-12T17:18:42.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.070+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=SD5JYLE2A1C3 type=del size=1205640 2024-09-12T17:18:42.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.074+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=NSKQ9SG806FJ type=del 2024-09-12T17:18:42.078 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.078+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=UNTU0A4W25SJ type=del size=3871355 2024-09-12T17:18:42.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.078+0000 7f96641d38c0 1 < completed write operation key=NGA3P9RZJYWT tag=ZH1YVE9CAUK7 type=write size=346167 2024-09-12T17:18:42.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.082+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=0A4LV5SM4943 type=del size=1526559 2024-09-12T17:18:42.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.086+0000 7f96641d38c0 1 < suggested update operation key=RSVQJS9F1FR7 tag=O5X4POEQRL1O type=write size=433406 2024-09-12T17:18:42.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.086+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=ZTYWZ42NP2Y4 type=write size=128795 2024-09-12T17:18:42.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.090+0000 7f96641d38c0 1 < canceled operation key=H3LV5G117KOW tag=W1JOC1MGL3EE type=del size=2703865 2024-09-12T17:18:42.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.094+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=0NBP7OMU2JOD type=write size=1043046 2024-09-12T17:18:42.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.098+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~MGKGSQMC3L31.0 size=474126 2024-09-12T17:18:42.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.102+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=MGKGSQMC3L31 tag=1MBPIW7DY7UB type=write size=1522702 2024-09-12T17:18:42.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.106+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=K7OE08DHZMJ7 type=write size=666444 2024-09-12T17:18:42.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.110+0000 7f96641d38c0 1 < suggested remove operation key=5ZZI4F92J7BO tag=RZPOVEC5X8R7 type=del 2024-09-12T17:18:42.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.114+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=9TJO01IET0RB type=write size=60148 2024-09-12T17:18:42.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.118+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=TQNJN4IMEQJI type=del 2024-09-12T17:18:42.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.122+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~D2BVF15IBN2E.0 size=281686 2024-09-12T17:18:42.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.122+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=D2BVF15IBN2E tag=7VO09NWUZTJD type=write size=1330262 2024-09-12T17:18:42.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.122+0000 7f96641d38c0 1 < canceled part key=_multipart_EFORFJYOM45R.2~V0VIKTOZL2KN.0 size=989146 2024-09-12T17:18:42.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.126+0000 7f96641d38c0 1 < canceled multipart upload key=EFORFJYOM45R upload=V0VIKTOZL2KN tag=7SWCSL441VFX type=write size=2037722 2024-09-12T17:18:42.133 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.130+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~JCYO11BH47W3.0 size=1048576 2024-09-12T17:18:42.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.134+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~JCYO11BH47W3.1 size=1048576 2024-09-12T17:18:42.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.134+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~JCYO11BH47W3.2 size=220842 2024-09-12T17:18:42.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.134+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=JCYO11BH47W3 tag=T7KC2WUDXZZ7 type=write size=3366570 2024-09-12T17:18:42.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.138+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=W28JL5QEQSCW type=del 2024-09-12T17:18:42.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.142+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~VWAH9B575E0R.0 size=1048576 2024-09-12T17:18:42.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.146+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~VWAH9B575E0R.1 size=1048576 2024-09-12T17:18:42.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.146+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~VWAH9B575E0R.2 size=959603 2024-09-12T17:18:42.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.146+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=VWAH9B575E0R tag=0GP7WK9ZM8F7 type=write size=4105331 2024-09-12T17:18:42.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.150+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~XYR8QFFEY950.0 size=1048576 2024-09-12T17:18:42.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.154+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~XYR8QFFEY950.1 size=1048576 2024-09-12T17:18:42.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.158+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~XYR8QFFEY950.2 size=146132 2024-09-12T17:18:42.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.162+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=XYR8QFFEY950 tag=61ZYWCJR3NPM type=write size=3291860 2024-09-12T17:18:42.167 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.166+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=5TNX8NQM58HZ type=del size=227748 2024-09-12T17:18:42.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.170+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=DCUJLXXEO8YE type=del 2024-09-12T17:18:42.174 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.174+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=0LYFNP2EZRQ8 type=del size=1592703 2024-09-12T17:18:42.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.174+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=CKHVLZ9C5RC1 type=del 2024-09-12T17:18:42.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.178+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=TMXBEOQW1PJ4 type=write size=126388 2024-09-12T17:18:42.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.182+0000 7f96641d38c0 -1 < failed to complete operation key=5ZZI4F92J7BO tag=GI0MYFACNRA9 type=del size=2715090: (22) Invalid argument 2024-09-12T17:18:42.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.186+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=R51PHQ96Y0CU type=del size=1771214 2024-09-12T17:18:42.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.186+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=EELEM2MVT7PG type=del 2024-09-12T17:18:42.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.194+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~MC9JGKRIWD58.0 size=1048576 2024-09-12T17:18:42.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.194+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~MC9JGKRIWD58.1 size=1048576 2024-09-12T17:18:42.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.198+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~MC9JGKRIWD58.2 size=427701 2024-09-12T17:18:42.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.198+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=MC9JGKRIWD58 tag=UOVGPZPYEMSE type=write size=3573429 2024-09-12T17:18:42.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.202+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~Z7GW89EY181A.0 size=1048576 2024-09-12T17:18:42.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.202+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~Z7GW89EY181A.1 size=1048576 2024-09-12T17:18:42.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.206+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~Z7GW89EY181A.2 size=556633 2024-09-12T17:18:42.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.210+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=Z7GW89EY181A tag=DIEADJLYPCTJ type=write size=3702361 2024-09-12T17:18:42.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.214+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=Q3J27ELCW2FK type=del size=3307325 2024-09-12T17:18:42.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.218+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=SD5JYLE2A1C3 type=del 2024-09-12T17:18:42.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.222+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=HHXGVZ7MEWW6 type=del size=3804816 2024-09-12T17:18:42.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.226+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=UNTU0A4W25SJ type=del 2024-09-12T17:18:42.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.226+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=C9VGLGHENK9N type=del size=471815 2024-09-12T17:18:42.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.230+0000 7f96641d38c0 -1 < failed to complete operation key=5ZZI4F92J7BO tag=0A4LV5SM4943 type=del size=1526559: (22) Invalid argument 2024-09-12T17:18:42.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.234+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=CQZA53IY70Y5 type=del size=2244508 2024-09-12T17:18:42.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.238+0000 7f96641d38c0 1 < completed write operation key=DHODPSZ7Z0D4 tag=ZTYWZ42NP2Y4 type=write size=128795 2024-09-12T17:18:42.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.242+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=X9DK0LVP03SZ type=del size=3969217 2024-09-12T17:18:42.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.242+0000 7f96641d38c0 1 < completed write operation key=DHODPSZ7Z0D4 tag=0NBP7OMU2JOD type=write size=1043046 2024-09-12T17:18:42.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.246+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=QXGGU555MN7A type=del size=3540812 2024-09-12T17:18:42.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.250+0000 7f96641d38c0 1 < completed write operation key=NGA3P9RZJYWT tag=K7OE08DHZMJ7 type=write size=666444 2024-09-12T17:18:42.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.254+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=N8IWOHDE547P type=del size=1526291 2024-09-12T17:18:42.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.258+0000 7f96641d38c0 1 < canceled operation key=HRU241T0FUEZ tag=9TJO01IET0RB type=write size=60148 2024-09-12T17:18:42.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.262+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~D4HSAYJU0B3Z.0 size=1048576 2024-09-12T17:18:42.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.262+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~D4HSAYJU0B3Z.1 size=1048576 2024-09-12T17:18:42.267 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.266+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~D4HSAYJU0B3Z.2 size=460025 2024-09-12T17:18:42.267 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.266+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=D4HSAYJU0B3Z tag=S58OWP235OL5 type=write size=3605753 2024-09-12T17:18:42.270 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.270+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~D2BVF15IBN2E.0 size=281686 2024-09-12T17:18:42.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.274+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=D2BVF15IBN2E tag=7VO09NWUZTJD type=write size=1330262 2024-09-12T17:18:42.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.278+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~0JFUZAJFRQ2G.0 size=1048576 2024-09-12T17:18:42.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.282+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~0JFUZAJFRQ2G.1 size=1048576 2024-09-12T17:18:42.284 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.282+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~0JFUZAJFRQ2G.2 size=382152 2024-09-12T17:18:42.284 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.282+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=0JFUZAJFRQ2G tag=IWGG7KVLL94Z type=write size=3527880 2024-09-12T17:18:42.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.286+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~JCYO11BH47W3.0 size=1048576 2024-09-12T17:18:42.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.286+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~JCYO11BH47W3.1 size=1048576 2024-09-12T17:18:42.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.290+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~JCYO11BH47W3.2 size=220842 2024-09-12T17:18:42.297 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.294+0000 7f96641d38c0 1 < completed multipart upload key=G7CWVD9C2H2J upload=JCYO11BH47W3 tag=T7KC2WUDXZZ7 type=write size=3366570 2024-09-12T17:18:42.300 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.298+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=V5O1ZU9MCIPP type=del size=2956923 2024-09-12T17:18:42.303 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.302+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~VWAH9B575E0R.0 size=1048576 2024-09-12T17:18:42.306 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.306+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~VWAH9B575E0R.1 size=1048576 2024-09-12T17:18:42.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.310+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~VWAH9B575E0R.2 size=959603 2024-09-12T17:18:42.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.314+0000 7f96641d38c0 1 < completed multipart upload key=37YXLWPZGA9J upload=VWAH9B575E0R tag=0GP7WK9ZM8F7 type=write size=4105331 2024-09-12T17:18:42.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.318+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=2HCM1VNAGTKO type=write size=130606 2024-09-12T17:18:42.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.322+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=5TNX8NQM58HZ type=del 2024-09-12T17:18:42.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.322+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=YM5SYI6KQ3ZX type=del size=1541735 2024-09-12T17:18:42.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.326+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=0LYFNP2EZRQ8 type=del 2024-09-12T17:18:42.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.330+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=GAB3Q7KNKPYS type=del size=1038681 2024-09-12T17:18:42.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.334+0000 7f96641d38c0 1 < completed write operation key=BDI9YFZCT5YY tag=TMXBEOQW1PJ4 type=write size=126388 2024-09-12T17:18:42.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.338+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=7AU10EM4RCA1 type=del size=928200 2024-09-12T17:18:42.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.346+0000 7f96641d38c0 1 < suggested update operation key=H3LV5G117KOW tag=R51PHQ96Y0CU type=del size=1771214 2024-09-12T17:18:42.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.354+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=9NM2GTV30YBI type=del size=2989666 2024-09-12T17:18:42.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.354+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~MC9JGKRIWD58.0 size=1048576 2024-09-12T17:18:42.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.358+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~MC9JGKRIWD58.1 size=1048576 2024-09-12T17:18:42.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.358+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~MC9JGKRIWD58.2 size=427701 2024-09-12T17:18:42.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.378+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=MC9JGKRIWD58 tag=UOVGPZPYEMSE type=write size=3573429 2024-09-12T17:18:42.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.382+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=IG3AXSZS490O type=write size=927575 2024-09-12T17:18:42.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.382+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=Q3J27ELCW2FK type=del 2024-09-12T17:18:42.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.386+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~KXNGZ0EXR93C.0 size=1048576 2024-09-12T17:18:42.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.390+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~KXNGZ0EXR93C.1 size=852737 2024-09-12T17:18:42.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.390+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=KXNGZ0EXR93C tag=51MGSDJN95SG type=write size=2949889 2024-09-12T17:18:42.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.394+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=HHXGVZ7MEWW6 type=del 2024-09-12T17:18:42.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.406+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=KF1OWT87DU0M type=write size=102411 2024-09-12T17:18:42.410 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.410+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=C9VGLGHENK9N type=del 2024-09-12T17:18:42.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.410+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=Z3XR7Y00RF00 type=del size=3209493 2024-09-12T17:18:42.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.414+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=CQZA53IY70Y5 type=del 2024-09-12T17:18:42.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.414+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=AGCMKJ0B8HIO type=write size=534408 2024-09-12T17:18:42.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.418+0000 7f96641d38c0 1 < suggested remove operation key=IR9JQ4MAEH0P tag=X9DK0LVP03SZ type=del 2024-09-12T17:18:42.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.422+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=FOISI8VBYMM2 type=write size=614612 2024-09-12T17:18:42.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.422+0000 7f96641d38c0 1 < canceled operation key=ZKDOIH5SH6K0 tag=QXGGU555MN7A type=del size=3540812 2024-09-12T17:18:42.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.426+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~WHXVDN6QTJ32.0 size=295394 2024-09-12T17:18:42.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.426+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=WHXVDN6QTJ32 tag=UWI1RHGVMJZH type=write size=1343970 2024-09-12T17:18:42.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.430+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=N8IWOHDE547P type=del 2024-09-12T17:18:42.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.430+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=9N822XH5Q7DC type=write size=115552 2024-09-12T17:18:42.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.434+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~D4HSAYJU0B3Z.0 size=1048576 2024-09-12T17:18:42.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.434+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~D4HSAYJU0B3Z.1 size=1048576 2024-09-12T17:18:42.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.434+0000 7f96641d38c0 1 < canceled part key=_multipart_W40P2E1H5VT9.2~D4HSAYJU0B3Z.2 size=460025 2024-09-12T17:18:42.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.438+0000 7f96641d38c0 1 < canceled multipart upload key=W40P2E1H5VT9 upload=D4HSAYJU0B3Z tag=S58OWP235OL5 type=write size=3605753 2024-09-12T17:18:42.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.438+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~UUO1U9I19T4G.0 size=1048576 2024-09-12T17:18:42.442 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.442+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~UUO1U9I19T4G.1 size=1048576 2024-09-12T17:18:42.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.442+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~UUO1U9I19T4G.2 size=199093 2024-09-12T17:18:42.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.442+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=UUO1U9I19T4G tag=S3X5Y7RF98MV type=write size=3344821 2024-09-12T17:18:42.446 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.446+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~0JFUZAJFRQ2G.0 size=1048576 2024-09-12T17:18:42.447 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.446+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~0JFUZAJFRQ2G.1 size=1048576 2024-09-12T17:18:42.448 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.446+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~0JFUZAJFRQ2G.2 size=382152 2024-09-12T17:18:42.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.450+0000 7f96641d38c0 1 < completed multipart upload key=HRU241T0FUEZ upload=0JFUZAJFRQ2G tag=IWGG7KVLL94Z type=write size=3527880 2024-09-12T17:18:42.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.454+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~M2J4NYI0D43C.0 size=675148 2024-09-12T17:18:42.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.454+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=M2J4NYI0D43C tag=34K8K0F8GNU5 type=write size=1723724 2024-09-12T17:18:42.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.454+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=V5O1ZU9MCIPP type=del 2024-09-12T17:18:42.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.458+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=8YI9YINQZEZJ type=del size=977108 2024-09-12T17:18:42.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.458+0000 7f96641d38c0 1 < completed write operation key=8TU2VZOHL1ZZ tag=2HCM1VNAGTKO type=write size=130606 2024-09-12T17:18:42.465 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.462+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~YVNK93IOO754.0 size=133809 2024-09-12T17:18:42.465 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.462+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=YVNK93IOO754 tag=2L0SSVN4I8UZ type=write size=1182385 2024-09-12T17:18:42.467 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.466+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=YM5SYI6KQ3ZX type=del 2024-09-12T17:18:42.469 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.466+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=BHXWUYKWNWT0 type=del size=3395827 2024-09-12T17:18:42.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.470+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=GAB3Q7KNKPYS type=del 2024-09-12T17:18:42.475 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.474+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~5R25E1HHTESH.0 size=1048576 2024-09-12T17:18:42.477 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.474+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~5R25E1HHTESH.1 size=1048576 2024-09-12T17:18:42.478 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.478+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~5R25E1HHTESH.2 size=990723 2024-09-12T17:18:42.478 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.478+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=5R25E1HHTESH tag=7MS9QZNGGLBX type=write size=4136451 2024-09-12T17:18:42.481 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.478+0000 7f96641d38c0 1 < completed delete operation key=KXJYJ9VX7YVW tag=7AU10EM4RCA1 type=del 2024-09-12T17:18:42.483 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.482+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=MROPGMQEK7BR type=del size=1572053 2024-09-12T17:18:42.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.486+0000 7f96641d38c0 1 < canceled operation key=RSVQJS9F1FR7 tag=9NM2GTV30YBI type=del size=2989666 2024-09-12T17:18:42.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.494+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~Y5AXQANPX6ZZ.0 size=1013220 2024-09-12T17:18:42.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.494+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=Y5AXQANPX6ZZ tag=PBD5BYHH0MQ1 type=write size=2061796 2024-09-12T17:18:42.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.498+0000 7f96641d38c0 1 < completed write operation key=37YXLWPZGA9J tag=IG3AXSZS490O type=write size=927575 2024-09-12T17:18:42.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.502+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~VWKKDL5EIP3A.0 size=1048576 2024-09-12T17:18:42.505 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.502+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~VWKKDL5EIP3A.1 size=1048576 2024-09-12T17:18:42.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.506+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~VWKKDL5EIP3A.2 size=667885 2024-09-12T17:18:42.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.506+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=VWKKDL5EIP3A tag=5OTHGCE1PGD4 type=write size=3813613 2024-09-12T17:18:42.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.510+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~KXNGZ0EXR93C.0 size=1048576 2024-09-12T17:18:42.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.510+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~KXNGZ0EXR93C.1 size=852737 2024-09-12T17:18:42.517 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.514+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=KXNGZ0EXR93C tag=51MGSDJN95SG type=write size=2949889 2024-09-12T17:18:42.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.522+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~IZOXB5U6RQ78.0 size=1048576 2024-09-12T17:18:42.524 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.522+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~IZOXB5U6RQ78.1 size=1048576 2024-09-12T17:18:42.526 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.526+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~IZOXB5U6RQ78.2 size=1034111 2024-09-12T17:18:42.526 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.526+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=IZOXB5U6RQ78 tag=R7LRTMJ1HR7D type=write size=4179839 2024-09-12T17:18:42.529 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.526+0000 7f96641d38c0 1 < completed write operation key=5ZZI4F92J7BO tag=KF1OWT87DU0M type=write size=102411 2024-09-12T17:18:42.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.534+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~8H68DDSO7AJL.0 size=1048576 2024-09-12T17:18:42.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.534+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~8H68DDSO7AJL.1 size=400588 2024-09-12T17:18:42.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.534+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=8H68DDSO7AJL tag=V0X3TA6Y35QI type=write size=2497740 2024-09-12T17:18:42.541 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.538+0000 7f96641d38c0 1 < suggested update operation key=DHODPSZ7Z0D4 tag=Z3XR7Y00RF00 type=del size=3209493 2024-09-12T17:18:42.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.546+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~TK74J671543O.0 size=80317 2024-09-12T17:18:42.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.546+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=TK74J671543O tag=RMFQN5B5GOPA type=write size=1128893 2024-09-12T17:18:42.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.546+0000 7f96641d38c0 1 < completed write operation key=BDI9YFZCT5YY tag=AGCMKJ0B8HIO type=write size=534408 2024-09-12T17:18:42.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.550+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=J7JVT1QS1WG1 type=del size=1307820 2024-09-12T17:18:42.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.550+0000 7f96641d38c0 1 < completed write operation key=XDL9O7TEMBYF tag=FOISI8VBYMM2 type=write size=614612 2024-09-12T17:18:42.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.558+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~LXSJIHP0JKMF.0 size=1048576 2024-09-12T17:18:42.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.558+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~LXSJIHP0JKMF.1 size=838020 2024-09-12T17:18:42.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.558+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=LXSJIHP0JKMF tag=AD70QTJL5V54 type=write size=2935172 2024-09-12T17:18:42.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.562+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~WHXVDN6QTJ32.0 size=295394 2024-09-12T17:18:42.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.566+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=WHXVDN6QTJ32 tag=UWI1RHGVMJZH type=write size=1343970 2024-09-12T17:18:42.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.570+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=DNZJHPW2BHL4 type=del size=2726385 2024-09-12T17:18:42.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.574+0000 7f96641d38c0 1 < completed write operation key=BDI9YFZCT5YY tag=9N822XH5Q7DC type=write size=115552 2024-09-12T17:18:42.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.578+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~XSAOQ5091MAG.0 size=1048576 2024-09-12T17:18:42.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.578+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~XSAOQ5091MAG.1 size=1048576 2024-09-12T17:18:42.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.582+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~XSAOQ5091MAG.2 size=62937 2024-09-12T17:18:42.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.582+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=XSAOQ5091MAG tag=Z3GM3OTZZ0SJ type=write size=3208665 2024-09-12T17:18:42.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.586+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~UUO1U9I19T4G.0 size=1048576 2024-09-12T17:18:42.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.586+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~UUO1U9I19T4G.1 size=1048576 2024-09-12T17:18:42.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.590+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~UUO1U9I19T4G.2 size=199093 2024-09-12T17:18:42.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.594+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=UUO1U9I19T4G tag=S3X5Y7RF98MV type=write size=3344821 2024-09-12T17:18:42.601 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.602+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~WZLJBUA96XES.0 size=37722 2024-09-12T17:18:42.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.602+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=WZLJBUA96XES tag=SEZ12MPCF8U8 type=write size=1086298 2024-09-12T17:18:42.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.602+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~M2J4NYI0D43C.0 size=675148 2024-09-12T17:18:42.609 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.610+0000 7f96641d38c0 1 < completed multipart upload key=HRU241T0FUEZ upload=M2J4NYI0D43C tag=34K8K0F8GNU5 type=write size=1723724 2024-09-12T17:18:42.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.610+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=C7UTX313UZT4 type=del size=2360249 2024-09-12T17:18:42.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.618+0000 7f96641d38c0 1 < suggested remove operation key=NR82RUK97NQA tag=8YI9YINQZEZJ type=del 2024-09-12T17:18:42.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.622+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~4DCTXVD8Z9XB.0 size=1048576 2024-09-12T17:18:42.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.626+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~4DCTXVD8Z9XB.1 size=303835 2024-09-12T17:18:42.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.626+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=4DCTXVD8Z9XB tag=1D6SUQSA4ODW type=write size=2400987 2024-09-12T17:18:42.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.630+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~YVNK93IOO754.0 size=133809 2024-09-12T17:18:42.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.634+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=YVNK93IOO754 tag=2L0SSVN4I8UZ type=write size=1182385 2024-09-12T17:18:42.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.638+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=RTS8QBLA598A type=write size=536005 2024-09-12T17:18:42.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.642+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=BHXWUYKWNWT0 type=del 2024-09-12T17:18:42.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.646+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=FIIGQE11Q4KJ type=del size=2494361 2024-09-12T17:18:42.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.646+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~5R25E1HHTESH.0 size=1048576 2024-09-12T17:18:42.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.650+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~5R25E1HHTESH.1 size=1048576 2024-09-12T17:18:42.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.654+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~5R25E1HHTESH.2 size=990723 2024-09-12T17:18:42.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.658+0000 7f96641d38c0 1 < completed multipart upload key=NGA3P9RZJYWT upload=5R25E1HHTESH tag=7MS9QZNGGLBX type=write size=4136451 2024-09-12T17:18:42.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.662+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=K1VJO55479WM type=del size=703261 2024-09-12T17:18:42.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.662+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=MROPGMQEK7BR type=del 2024-09-12T17:18:42.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.666+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=EITAU6BWQTQV type=del size=2372338 2024-09-12T17:18:42.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.670+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~Y5AXQANPX6ZZ.0 size=1013220 2024-09-12T17:18:42.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.674+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=Y5AXQANPX6ZZ tag=PBD5BYHH0MQ1 type=write size=2061796 2024-09-12T17:18:42.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.674+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=ZFLHR7260XLX type=write size=259149 2024-09-12T17:18:42.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.678+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~VWKKDL5EIP3A.0 size=1048576 2024-09-12T17:18:42.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.678+0000 7f96641d38c0 1 < canceled part key=_multipart_H3J23KLT1VUT.2~VWKKDL5EIP3A.1 size=1048576 2024-09-12T17:18:42.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.682+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~VWKKDL5EIP3A.2 size=667885 2024-09-12T17:18:42.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.686+0000 7f96641d38c0 1 < canceled multipart upload key=H3J23KLT1VUT upload=VWKKDL5EIP3A tag=5OTHGCE1PGD4 type=write size=3813613 2024-09-12T17:18:42.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.690+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=6V320KFNO1K3 type=del size=2917005 2024-09-12T17:18:42.693 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.690+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~IZOXB5U6RQ78.0 size=1048576 2024-09-12T17:18:42.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.694+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~IZOXB5U6RQ78.1 size=1048576 2024-09-12T17:18:42.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.694+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~IZOXB5U6RQ78.2 size=1034111 2024-09-12T17:18:42.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.702+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=IZOXB5U6RQ78 tag=R7LRTMJ1HR7D type=write size=4179839 2024-09-12T17:18:42.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.702+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=W4CJ3GYCJ9N9 type=del size=3073111 2024-09-12T17:18:42.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.706+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~8H68DDSO7AJL.0 size=1048576 2024-09-12T17:18:42.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.710+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~8H68DDSO7AJL.1 size=400588 2024-09-12T17:18:42.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.714+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=8H68DDSO7AJL tag=V0X3TA6Y35QI type=write size=2497740 2024-09-12T17:18:42.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.718+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=UBS5WAOIZK02 type=write size=23147 2024-09-12T17:18:42.721 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.718+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~TK74J671543O.0 size=80317 2024-09-12T17:18:42.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.722+0000 7f96641d38c0 1 < completed multipart upload key=2TN3M8NKV9LN upload=TK74J671543O tag=RMFQN5B5GOPA type=write size=1128893 2024-09-12T17:18:42.728 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.726+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=MJFDHZOXJC26 type=del size=1521723 2024-09-12T17:18:42.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.730+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=J7JVT1QS1WG1 type=del 2024-09-12T17:18:42.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.734+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=G03NA5BOEHCP type=write size=1030759 2024-09-12T17:18:42.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.734+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~LXSJIHP0JKMF.0 size=1048576 2024-09-12T17:18:42.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.738+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~LXSJIHP0JKMF.1 size=838020 2024-09-12T17:18:42.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.742+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=LXSJIHP0JKMF tag=AD70QTJL5V54 type=write size=2935172 2024-09-12T17:18:42.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.746+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=H2V9C59I2PX2 type=del size=1301969 2024-09-12T17:18:42.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.750+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=DNZJHPW2BHL4 type=del 2024-09-12T17:18:42.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.754+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=HHFJSXGEWOO5 type=del size=3536540 2024-09-12T17:18:42.760 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.758+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~XSAOQ5091MAG.0 size=1048576 2024-09-12T17:18:42.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.762+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~XSAOQ5091MAG.1 size=1048576 2024-09-12T17:18:42.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.762+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~XSAOQ5091MAG.2 size=62937 2024-09-12T17:18:42.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.766+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=XSAOQ5091MAG tag=Z3GM3OTZZ0SJ type=write size=3208665 2024-09-12T17:18:42.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.774+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~GMKED8ZKZBV9.0 size=1048576 2024-09-12T17:18:42.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.774+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~GMKED8ZKZBV9.1 size=1048576 2024-09-12T17:18:42.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.778+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~GMKED8ZKZBV9.2 size=604409 2024-09-12T17:18:42.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.778+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=GMKED8ZKZBV9 tag=EYR23Q9B24O8 type=write size=3750137 2024-09-12T17:18:42.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.782+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~WZLJBUA96XES.0 size=37722 2024-09-12T17:18:42.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.786+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=WZLJBUA96XES tag=SEZ12MPCF8U8 type=write size=1086298 2024-09-12T17:18:42.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.790+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=KTJ0IX7HHK7L type=write size=259901 2024-09-12T17:18:42.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.794+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=C7UTX313UZT4 type=del 2024-09-12T17:18:42.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.798+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~CLJGEWQF72FV.0 size=1048576 2024-09-12T17:18:42.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.802+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~CLJGEWQF72FV.1 size=347197 2024-09-12T17:18:42.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.802+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=CLJGEWQF72FV tag=XS0H0V83DQ6Y type=write size=2444349 2024-09-12T17:18:42.805 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.802+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~4DCTXVD8Z9XB.0 size=1048576 2024-09-12T17:18:42.808 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.806+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~4DCTXVD8Z9XB.1 size=303835 2024-09-12T17:18:42.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.810+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=4DCTXVD8Z9XB tag=1D6SUQSA4ODW type=write size=2400987 2024-09-12T17:18:42.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.814+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~33NIMYF9DGDN.0 size=902447 2024-09-12T17:18:42.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.814+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=33NIMYF9DGDN tag=5XZN8C07JZDE type=write size=1951023 2024-09-12T17:18:42.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.818+0000 7f96641d38c0 1 < completed write operation key=XDL9O7TEMBYF tag=RTS8QBLA598A type=write size=536005 2024-09-12T17:18:42.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.822+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=01R2LG0NDYM6 type=del size=4147819 2024-09-12T17:18:42.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.826+0000 7f96641d38c0 1 < suggested remove operation key=UBYUSW4C2V19 tag=FIIGQE11Q4KJ type=del 2024-09-12T17:18:42.833 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.830+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~LX46F5S60HR1.0 size=1048576 2024-09-12T17:18:42.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.834+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~LX46F5S60HR1.1 size=49610 2024-09-12T17:18:42.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.834+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=LX46F5S60HR1 tag=AZECJ9TFQXKA type=write size=2146762 2024-09-12T17:18:42.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.834+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=K1VJO55479WM type=del 2024-09-12T17:18:42.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.838+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=OAEN97ZQ7MER type=write size=965752 2024-09-12T17:18:42.843 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.842+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=EITAU6BWQTQV type=del 2024-09-12T17:18:42.846 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.846+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=2S3NMW6HNCWN type=del size=104718 2024-09-12T17:18:42.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.850+0000 7f96641d38c0 1 < completed write operation key=W40P2E1H5VT9 tag=ZFLHR7260XLX type=write size=259149 2024-09-12T17:18:42.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.854+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~XK9L6PRO7M1M.0 size=1048576 2024-09-12T17:18:42.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.854+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~XK9L6PRO7M1M.1 size=1048576 2024-09-12T17:18:42.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.858+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~XK9L6PRO7M1M.2 size=316856 2024-09-12T17:18:42.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.858+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=XK9L6PRO7M1M tag=VILJZHE50BRE type=write size=3462584 2024-09-12T17:18:42.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.862+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=6V320KFNO1K3 type=del 2024-09-12T17:18:42.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.866+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~KIN4RD3WMLIZ.0 size=544025 2024-09-12T17:18:42.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.866+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=KIN4RD3WMLIZ tag=1UY0C7ABSFWF type=write size=1592601 2024-09-12T17:18:42.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.874+0000 7f96641d38c0 1 < suggested remove operation key=MOQXP4AXMTCK tag=W4CJ3GYCJ9N9 type=del 2024-09-12T17:18:42.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.878+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=L0BN670UO3YC type=write size=554633 2024-09-12T17:18:42.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.882+0000 7f96641d38c0 1 < suggested update operation key=H3LV5G117KOW tag=UBS5WAOIZK02 type=write size=23147 2024-09-12T17:18:42.888 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.886+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=X7TI9Q9CAWQU type=del size=3963599 2024-09-12T17:18:42.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.890+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=MJFDHZOXJC26 type=del 2024-09-12T17:18:42.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.894+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=3F6U1QGXVS61 type=del size=2551114 2024-09-12T17:18:42.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.898+0000 7f96641d38c0 1 < completed write operation key=NG327LT02T1F tag=G03NA5BOEHCP type=write size=1030759 2024-09-12T17:18:42.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.898+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=MKOPDAT05SJZ type=del size=652987 2024-09-12T17:18:42.905 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.902+0000 7f96641d38c0 -1 < failed to complete operation key=H3LV5G117KOW tag=H2V9C59I2PX2 type=del size=1301969: (22) Invalid argument 2024-09-12T17:18:42.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.906+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=5OTY0DDM6QNC type=del size=213799 2024-09-12T17:18:42.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.910+0000 7f96641d38c0 1 < canceled operation key=6BH7SI911MMP tag=HHFJSXGEWOO5 type=del size=3536540 2024-09-12T17:18:42.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.914+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=MWYEY032JEQW type=write size=978786 2024-09-12T17:18:42.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.918+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~GMKED8ZKZBV9.0 size=1048576 2024-09-12T17:18:42.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.918+0000 7f96641d38c0 1 < canceled part key=_multipart_6BH7SI911MMP.2~GMKED8ZKZBV9.1 size=1048576 2024-09-12T17:18:42.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.918+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~GMKED8ZKZBV9.2 size=604409 2024-09-12T17:18:42.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.922+0000 7f96641d38c0 1 < canceled multipart upload key=6BH7SI911MMP upload=GMKED8ZKZBV9 tag=EYR23Q9B24O8 type=write size=3750137 2024-09-12T17:18:42.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.930+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=KW6CL59ZRKKR type=del size=2858906 2024-09-12T17:18:42.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.930+0000 7f96641d38c0 1 < completed write operation key=L9HUVE5A5NGT tag=KTJ0IX7HHK7L type=write size=259901 2024-09-12T17:18:42.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.934+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=60JDWC0PYOES type=del size=504277 2024-09-12T17:18:42.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.938+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~CLJGEWQF72FV.0 size=1048576 2024-09-12T17:18:42.942 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.942+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~CLJGEWQF72FV.1 size=347197 2024-09-12T17:18:42.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.946+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=CLJGEWQF72FV tag=XS0H0V83DQ6Y type=write size=2444349 2024-09-12T17:18:42.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.950+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=Y10QP704TYBY type=del size=1330143 2024-09-12T17:18:42.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.954+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~33NIMYF9DGDN.0 size=902447 2024-09-12T17:18:42.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.958+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=33NIMYF9DGDN tag=5XZN8C07JZDE type=write size=1951023 2024-09-12T17:18:42.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.962+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=D1LEJQVIE3P4 type=del size=2472555 2024-09-12T17:18:42.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.966+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=01R2LG0NDYM6 type=del 2024-09-12T17:18:42.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.970+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~P3M8HEAPKQBR.0 size=962470 2024-09-12T17:18:42.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.970+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=P3M8HEAPKQBR tag=WY8U7QX9Z5SF type=write size=2011046 2024-09-12T17:18:42.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.974+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~LX46F5S60HR1.0 size=1048576 2024-09-12T17:18:42.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.978+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~LX46F5S60HR1.1 size=49610 2024-09-12T17:18:42.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.982+0000 7f96641d38c0 1 < completed multipart upload key=EFORFJYOM45R upload=LX46F5S60HR1 tag=AZECJ9TFQXKA type=write size=2146762 2024-09-12T17:18:42.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.986+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~84X3VYPKAA56.0 size=1048576 2024-09-12T17:18:42.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.990+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~84X3VYPKAA56.1 size=1048576 2024-09-12T17:18:42.994 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.994+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~84X3VYPKAA56.2 size=535421 2024-09-12T17:18:42.994 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.994+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=84X3VYPKAA56 tag=GDTOVXSP6BSV type=write size=3681149 2024-09-12T17:18:42.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.994+0000 7f96641d38c0 -1 < failed to complete operation key=H3LV5G117KOW tag=OAEN97ZQ7MER type=write size=965752: (22) Invalid argument 2024-09-12T17:18:43.000 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:42.998+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=XF7F9SO38OL6 type=del size=1576417 2024-09-12T17:18:43.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.002+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=2S3NMW6HNCWN type=del 2024-09-12T17:18:43.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.002+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=RX3G3ET20SBR type=del size=917162 2024-09-12T17:18:43.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.006+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~XK9L6PRO7M1M.0 size=1048576 2024-09-12T17:18:43.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.010+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~XK9L6PRO7M1M.1 size=1048576 2024-09-12T17:18:43.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.010+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~XK9L6PRO7M1M.2 size=316856 2024-09-12T17:18:43.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.014+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=XK9L6PRO7M1M tag=VILJZHE50BRE type=write size=3462584 2024-09-12T17:18:43.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.022+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~F45W48OPLHF0.0 size=270828 2024-09-12T17:18:43.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.022+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=F45W48OPLHF0 tag=8MC7S0M87KYB type=write size=1319404 2024-09-12T17:18:43.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.022+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~KIN4RD3WMLIZ.0 size=544025 2024-09-12T17:18:43.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.026+0000 7f96641d38c0 1 < completed multipart upload key=G7CWVD9C2H2J upload=KIN4RD3WMLIZ tag=1UY0C7ABSFWF type=write size=1592601 2024-09-12T17:18:43.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.030+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=F0KWBBASM96M type=write size=233292 2024-09-12T17:18:43.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.034+0000 7f96641d38c0 1 < completed write operation key=L9HUVE5A5NGT tag=L0BN670UO3YC type=write size=554633 2024-09-12T17:18:43.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.038+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=QL0Y8MSNQLGZ type=del size=2246081 2024-09-12T17:18:43.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.042+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=X7TI9Q9CAWQU type=del 2024-09-12T17:18:43.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.046+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=TVETCSEUKCUE type=del size=3866561 2024-09-12T17:18:43.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.050+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=3F6U1QGXVS61 type=del 2024-09-12T17:18:43.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.050+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=2W9YVRWUXFZJ type=del size=54456 2024-09-12T17:18:43.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.054+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=MKOPDAT05SJZ type=del 2024-09-12T17:18:43.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.058+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=FHH6BSJB4UUJ type=del size=675243 2024-09-12T17:18:43.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.058+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=5OTY0DDM6QNC type=del 2024-09-12T17:18:43.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.062+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=233ESCEBVDZ6 type=del size=1778825 2024-09-12T17:18:43.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.066+0000 7f96641d38c0 1 < canceled operation key=BDI9YFZCT5YY tag=MWYEY032JEQW type=write size=978786 2024-09-12T17:18:43.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.066+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=KL3NSAFUU096 type=del size=3109729 2024-09-12T17:18:43.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.070+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=KW6CL59ZRKKR type=del 2024-09-12T17:18:43.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.074+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=P8UCK1G9ERLK type=del size=116100 2024-09-12T17:18:43.078 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.078+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=60JDWC0PYOES type=del 2024-09-12T17:18:43.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.078+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=DCLQI0K6NB19 type=del size=2435629 2024-09-12T17:18:43.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.082+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=Y10QP704TYBY type=del 2024-09-12T17:18:43.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.086+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=6AFWPGGLE3BQ type=write size=581357 2024-09-12T17:18:43.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.090+0000 7f96641d38c0 1 < canceled operation key=9CBFWXFX7O3N tag=D1LEJQVIE3P4 type=del size=2472555 2024-09-12T17:18:43.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.094+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~9CQ4W9WZ132K.0 size=1048576 2024-09-12T17:18:43.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.098+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~9CQ4W9WZ132K.1 size=252600 2024-09-12T17:18:43.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.098+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=9CQ4W9WZ132K tag=LLB7IIU7F0U1 type=write size=2349752 2024-09-12T17:18:43.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.098+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~P3M8HEAPKQBR.0 size=962470 2024-09-12T17:18:43.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.106+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=P3M8HEAPKQBR tag=WY8U7QX9Z5SF type=write size=2011046 2024-09-12T17:18:43.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.110+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=DIEMOQVLMYOS type=del size=4076295 2024-09-12T17:18:43.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.110+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~84X3VYPKAA56.0 size=1048576 2024-09-12T17:18:43.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.114+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~84X3VYPKAA56.1 size=1048576 2024-09-12T17:18:43.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.118+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~84X3VYPKAA56.2 size=535421 2024-09-12T17:18:43.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.122+0000 7f96641d38c0 1 < completed multipart upload key=EFORFJYOM45R upload=84X3VYPKAA56 tag=GDTOVXSP6BSV type=write size=3681149 2024-09-12T17:18:43.126 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.126+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=C7RR0Z7R5H60 type=del size=3597562 2024-09-12T17:18:43.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.126+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=XF7F9SO38OL6 type=del 2024-09-12T17:18:43.132 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.130+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=P9JZ3G389AV4 type=del size=1409599 2024-09-12T17:18:43.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.134+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=RX3G3ET20SBR type=del 2024-09-12T17:18:43.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.138+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=A0F82WHKAN66 type=del size=143544 2024-09-12T17:18:43.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.138+0000 7f96641d38c0 1 < canceled part key=_multipart_RSVQJS9F1FR7.2~F45W48OPLHF0.0 size=270828 2024-09-12T17:18:43.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.142+0000 7f96641d38c0 1 < canceled multipart upload key=RSVQJS9F1FR7 upload=F45W48OPLHF0 tag=8MC7S0M87KYB type=write size=1319404 2024-09-12T17:18:43.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.146+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~PI5XGNG2VX70.0 size=1048576 2024-09-12T17:18:43.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.150+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~PI5XGNG2VX70.1 size=1048576 2024-09-12T17:18:43.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.150+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~PI5XGNG2VX70.2 size=891914 2024-09-12T17:18:43.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.150+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=PI5XGNG2VX70 tag=76MR4SIUDFIO type=write size=4037642 2024-09-12T17:18:43.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.154+0000 7f96641d38c0 1 < completed write operation key=BDI9YFZCT5YY tag=F0KWBBASM96M type=write size=233292 2024-09-12T17:18:43.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.158+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~C26OBP3ZLZIQ.0 size=558977 2024-09-12T17:18:43.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.158+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=C26OBP3ZLZIQ tag=DVC3HHBFADWL type=write size=1607553 2024-09-12T17:18:43.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.162+0000 7f96641d38c0 1 < canceled operation key=NG327LT02T1F tag=QL0Y8MSNQLGZ type=del size=2246081 2024-09-12T17:18:43.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.166+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=6A11JUY7X7L2 type=del size=845396 2024-09-12T17:18:43.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.170+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=TVETCSEUKCUE type=del 2024-09-12T17:18:43.173 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.170+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=MBED642Q10ZV type=del size=46467 2024-09-12T17:18:43.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.174+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=2W9YVRWUXFZJ type=del 2024-09-12T17:18:43.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.178+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~ZYA1IL8Q1USH.0 size=1048576 2024-09-12T17:18:43.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.182+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~ZYA1IL8Q1USH.1 size=3958 2024-09-12T17:18:43.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.182+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=ZYA1IL8Q1USH tag=Y16IS3N7LN3Y type=write size=2101110 2024-09-12T17:18:43.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.182+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=FHH6BSJB4UUJ type=del 2024-09-12T17:18:43.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.186+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~HEZMUCUTZWFC.0 size=1048576 2024-09-12T17:18:43.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.190+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~HEZMUCUTZWFC.1 size=1048576 2024-09-12T17:18:43.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.190+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~HEZMUCUTZWFC.2 size=153343 2024-09-12T17:18:43.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.190+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=HEZMUCUTZWFC tag=YD0GTIBGVDTF type=write size=3299071 2024-09-12T17:18:43.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.194+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=233ESCEBVDZ6 type=del 2024-09-12T17:18:43.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.198+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~PYEMCRELOIG0.0 size=923424 2024-09-12T17:18:43.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.198+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=PYEMCRELOIG0 tag=88VJV3OG1YY6 type=write size=1972000 2024-09-12T17:18:43.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.202+0000 7f96641d38c0 1 < completed delete operation key=5ZZI4F92J7BO tag=KL3NSAFUU096 type=del 2024-09-12T17:18:43.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.206+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~Y55M1Y2TXQRF.0 size=819383 2024-09-12T17:18:43.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.206+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=Y55M1Y2TXQRF tag=37ZJ42F432D4 type=write size=1867959 2024-09-12T17:18:43.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.210+0000 7f96641d38c0 1 < completed delete operation key=5ZZI4F92J7BO tag=P8UCK1G9ERLK type=del 2024-09-12T17:18:43.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.210+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=R12P4637Y583 type=del size=2467460 2024-09-12T17:18:43.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.214+0000 7f96641d38c0 1 < canceled operation key=KXJYJ9VX7YVW tag=DCLQI0K6NB19 type=del size=2435629 2024-09-12T17:18:43.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.218+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=4KH54ZCGE9BN type=del size=514564 2024-09-12T17:18:43.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.218+0000 7f96641d38c0 1 < completed write operation key=HRU241T0FUEZ tag=6AFWPGGLE3BQ type=write size=581357 2024-09-12T17:18:43.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.222+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=ZUEBMZ3ZLJ2G type=del size=519725 2024-09-12T17:18:43.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.226+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~9CQ4W9WZ132K.0 size=1048576 2024-09-12T17:18:43.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.226+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~9CQ4W9WZ132K.1 size=252600 2024-09-12T17:18:43.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.230+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=9CQ4W9WZ132K tag=LLB7IIU7F0U1 type=write size=2349752 2024-09-12T17:18:43.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.234+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=YCBAO6O7S224 type=del size=4035555 2024-09-12T17:18:43.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.238+0000 7f96641d38c0 1 < suggested remove operation key=L9HUVE5A5NGT tag=DIEMOQVLMYOS type=del 2024-09-12T17:18:43.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.242+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=FUE24KKCHK0E type=del size=1930357 2024-09-12T17:18:43.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.246+0000 7f96641d38c0 1 < canceled operation key=37YXLWPZGA9J tag=C7RR0Z7R5H60 type=del size=3597562 2024-09-12T17:18:43.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.250+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=B7KN9CCB9SJJ type=del size=2084312 2024-09-12T17:18:43.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.250+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=P9JZ3G389AV4 type=del 2024-09-12T17:18:43.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.254+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=HZWTX9CG00LV type=del size=3668465 2024-09-12T17:18:43.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.258+0000 7f96641d38c0 1 < suggested update operation key=NG327LT02T1F tag=A0F82WHKAN66 type=del size=143544 2024-09-12T17:18:43.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.262+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=2Y152NDXNNOO type=del size=1881098 2024-09-12T17:18:43.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.262+0000 7f96641d38c0 1 < canceled part key=_multipart_XTVZIXTEES2O.2~PI5XGNG2VX70.0 size=1048576 2024-09-12T17:18:43.268 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.266+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~PI5XGNG2VX70.1 size=1048576 2024-09-12T17:18:43.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.270+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~PI5XGNG2VX70.2 size=891914 2024-09-12T17:18:43.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.274+0000 7f96641d38c0 1 < canceled multipart upload key=XTVZIXTEES2O upload=PI5XGNG2VX70 tag=76MR4SIUDFIO type=write size=4037642 2024-09-12T17:18:43.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.278+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~SWXWK53RIRKP.0 size=1048576 2024-09-12T17:18:43.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.282+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~SWXWK53RIRKP.1 size=1048576 2024-09-12T17:18:43.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.282+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~SWXWK53RIRKP.2 size=431447 2024-09-12T17:18:43.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.282+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=SWXWK53RIRKP tag=87HV1E6X878Q type=write size=3577175 2024-09-12T17:18:43.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.286+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~C26OBP3ZLZIQ.0 size=558977 2024-09-12T17:18:43.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.290+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=C26OBP3ZLZIQ tag=DVC3HHBFADWL type=write size=1607553 2024-09-12T17:18:43.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.294+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=Z58AYT50BFR2 type=del size=787323 2024-09-12T17:18:43.299 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.298+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=6A11JUY7X7L2 type=del 2024-09-12T17:18:43.302 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.302+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=NGIAZ152ISX1 type=del size=3913914 2024-09-12T17:18:43.306 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.306+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=MBED642Q10ZV type=del 2024-09-12T17:18:43.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.306+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=3ZF20XC143G7 type=del size=3986179 2024-09-12T17:18:43.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.314+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~ZYA1IL8Q1USH.0 size=1048576 2024-09-12T17:18:43.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.318+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~ZYA1IL8Q1USH.1 size=3958 2024-09-12T17:18:43.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.322+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=ZYA1IL8Q1USH tag=Y16IS3N7LN3Y type=write size=2101110 2024-09-12T17:18:43.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.326+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=TOJVVWQ5E2ND type=del size=4190780 2024-09-12T17:18:43.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.330+0000 7f96641d38c0 1 < canceled part key=_multipart_3H8R2MJGR4SY.2~HEZMUCUTZWFC.0 size=1048576 2024-09-12T17:18:43.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.330+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~HEZMUCUTZWFC.1 size=1048576 2024-09-12T17:18:43.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.334+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~HEZMUCUTZWFC.2 size=153343 2024-09-12T17:18:43.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.338+0000 7f96641d38c0 1 < canceled multipart upload key=3H8R2MJGR4SY upload=HEZMUCUTZWFC tag=YD0GTIBGVDTF type=write size=3299071 2024-09-12T17:18:43.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.342+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=6JGB6VFE85N6 type=del size=1996124 2024-09-12T17:18:43.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.342+0000 7f96641d38c0 1 < canceled part key=_multipart_BDI9YFZCT5YY.2~PYEMCRELOIG0.0 size=923424 2024-09-12T17:18:43.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.346+0000 7f96641d38c0 1 < canceled multipart upload key=BDI9YFZCT5YY upload=PYEMCRELOIG0 tag=88VJV3OG1YY6 type=write size=1972000 2024-09-12T17:18:43.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.350+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=AZRV8O9MG4RX type=del size=3872869 2024-09-12T17:18:43.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.354+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~Y55M1Y2TXQRF.0 size=819383 2024-09-12T17:18:43.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.358+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=Y55M1Y2TXQRF tag=37ZJ42F432D4 type=write size=1867959 2024-09-12T17:18:43.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.362+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~ZB6AKRJZPME2.0 size=1048576 2024-09-12T17:18:43.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.366+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~ZB6AKRJZPME2.1 size=588471 2024-09-12T17:18:43.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.366+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=ZB6AKRJZPME2 tag=YSP4MG06KGNO type=write size=2685623 2024-09-12T17:18:43.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.370+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=R12P4637Y583 type=del 2024-09-12T17:18:43.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.370+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=X1FAW7KR1ST1 type=del size=3378813 2024-09-12T17:18:43.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.374+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=4KH54ZCGE9BN type=del 2024-09-12T17:18:43.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.378+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=3J0OGR0M17L3 type=del size=3228446 2024-09-12T17:18:43.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.378+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=ZUEBMZ3ZLJ2G type=del 2024-09-12T17:18:43.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.382+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=MZLF3NFMVFNO type=del size=4142170 2024-09-12T17:18:43.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.386+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=YCBAO6O7S224 type=del 2024-09-12T17:18:43.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.390+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~289CEMVYB3NC.0 size=1045119 2024-09-12T17:18:43.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.390+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=289CEMVYB3NC tag=WYZR23SC9Z3U type=write size=2093695 2024-09-12T17:18:43.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.394+0000 7f96641d38c0 1 < suggested remove operation key=BDI9YFZCT5YY tag=FUE24KKCHK0E type=del 2024-09-12T17:18:43.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.398+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=J6GYMF5FNJVV type=del size=3059213 2024-09-12T17:18:43.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.402+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=B7KN9CCB9SJJ type=del 2024-09-12T17:18:43.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.402+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=7LG83J6X5WTR type=del size=682258 2024-09-12T17:18:43.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.406+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=HZWTX9CG00LV type=del 2024-09-12T17:18:43.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.410+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=GTQXPGHZC3NV type=del size=1367604 2024-09-12T17:18:43.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.414+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=2Y152NDXNNOO type=del 2024-09-12T17:18:43.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.414+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=NX0VFIGV93Z3 type=del size=3164355 2024-09-12T17:18:43.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.418+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~SWXWK53RIRKP.0 size=1048576 2024-09-12T17:18:43.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.422+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~SWXWK53RIRKP.1 size=1048576 2024-09-12T17:18:43.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.422+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~SWXWK53RIRKP.2 size=431447 2024-09-12T17:18:43.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.426+0000 7f96641d38c0 1 < completed multipart upload key=G7CWVD9C2H2J upload=SWXWK53RIRKP tag=87HV1E6X878Q type=write size=3577175 2024-09-12T17:18:43.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.434+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~RO220BN0YULI.0 size=1048576 2024-09-12T17:18:43.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.434+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~RO220BN0YULI.1 size=914563 2024-09-12T17:18:43.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.434+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=RO220BN0YULI tag=K7P2DHMG63YP type=write size=3011715 2024-09-12T17:18:43.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.438+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=Z58AYT50BFR2 type=del 2024-09-12T17:18:43.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.442+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=BXB9F7Q1HUIA type=del size=50331 2024-09-12T17:18:43.449 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.446+0000 7f96641d38c0 1 < suggested remove operation key=IR9JQ4MAEH0P tag=NGIAZ152ISX1 type=del 2024-09-12T17:18:43.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.454+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~3VT8PFEMMP1T.0 size=525652 2024-09-12T17:18:43.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.454+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=3VT8PFEMMP1T tag=NHYOY0MKYIAY type=write size=1574228 2024-09-12T17:18:43.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.454+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=3ZF20XC143G7 type=del 2024-09-12T17:18:43.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.462+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~M3NI84PYEKVK.0 size=1048576 2024-09-12T17:18:43.466 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.466+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~M3NI84PYEKVK.1 size=1048576 2024-09-12T17:18:43.468 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.466+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~M3NI84PYEKVK.2 size=675597 2024-09-12T17:18:43.468 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.466+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=M3NI84PYEKVK tag=LNCKLC0O9XHI type=write size=3821325 2024-09-12T17:18:43.472 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.470+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=TOJVVWQ5E2ND type=del 2024-09-12T17:18:43.475 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.474+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=V661PJA049J0 type=del size=2441490 2024-09-12T17:18:43.482 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.482+0000 7f96641d38c0 1 < suggested update operation key=MOQXP4AXMTCK tag=6JGB6VFE85N6 type=del size=1996124 2024-09-12T17:18:43.485 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.482+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=H7I6T40QW42W type=del size=1664578 2024-09-12T17:18:43.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.490+0000 7f96641d38c0 1 < suggested update operation key=DHODPSZ7Z0D4 tag=AZRV8O9MG4RX type=del size=3872869 2024-09-12T17:18:43.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.494+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~SG6U7573NMG2.0 size=1048576 2024-09-12T17:18:43.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.498+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~SG6U7573NMG2.1 size=1048576 2024-09-12T17:18:43.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.498+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~SG6U7573NMG2.2 size=680352 2024-09-12T17:18:43.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.498+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=SG6U7573NMG2 tag=4XTL4RLGOPW5 type=write size=3826080 2024-09-12T17:18:43.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.502+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~ZB6AKRJZPME2.0 size=1048576 2024-09-12T17:18:43.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.506+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~ZB6AKRJZPME2.1 size=588471 2024-09-12T17:18:43.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.510+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=ZB6AKRJZPME2 tag=YSP4MG06KGNO type=write size=2685623 2024-09-12T17:18:43.516 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.514+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=HP9TP6ANNPG1 type=del size=111345 2024-09-12T17:18:43.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.522+0000 7f96641d38c0 1 < suggested remove operation key=XTVZIXTEES2O tag=X1FAW7KR1ST1 type=del 2024-09-12T17:18:43.525 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.522+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=K9WALFQSNVMM type=del size=818805 2024-09-12T17:18:43.528 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.526+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=3J0OGR0M17L3 type=del 2024-09-12T17:18:43.531 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.530+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=1M8SYZZIO0SD type=write size=233499 2024-09-12T17:18:43.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.534+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=MZLF3NFMVFNO type=del 2024-09-12T17:18:43.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.534+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=MSWXX0T5PGIJ type=del size=2575761 2024-09-12T17:18:43.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.538+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~289CEMVYB3NC.0 size=1045119 2024-09-12T17:18:43.545 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.542+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=289CEMVYB3NC tag=WYZR23SC9Z3U type=write size=2093695 2024-09-12T17:18:43.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.546+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=22C1CXKNMA7D type=del size=1204330 2024-09-12T17:18:43.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.550+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=J6GYMF5FNJVV type=del 2024-09-12T17:18:43.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.554+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=D2HHQSQNQQU0 type=del size=3807378 2024-09-12T17:18:43.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.554+0000 7f96641d38c0 -1 < failed to complete operation key=MOQXP4AXMTCK tag=7LG83J6X5WTR type=del size=682258: (22) Invalid argument 2024-09-12T17:18:43.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.562+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~Y17M81GKOH38.0 size=473227 2024-09-12T17:18:43.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.562+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=Y17M81GKOH38 tag=RYO5W1HHRM4H type=write size=1521803 2024-09-12T17:18:43.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.566+0000 7f96641d38c0 1 < suggested update operation key=2TN3M8NKV9LN tag=GTQXPGHZC3NV type=del size=1367604 2024-09-12T17:18:43.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.574+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~TR6MHWWBV6MV.0 size=1048576 2024-09-12T17:18:43.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.574+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~TR6MHWWBV6MV.1 size=647296 2024-09-12T17:18:43.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.574+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=TR6MHWWBV6MV tag=NQQV2066RY8C type=write size=2744448 2024-09-12T17:18:43.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.578+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=NX0VFIGV93Z3 type=del 2024-09-12T17:18:43.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.582+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~9HIUBUI8MROL.0 size=1048576 2024-09-12T17:18:43.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.586+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~9HIUBUI8MROL.1 size=1048576 2024-09-12T17:18:43.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.586+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~9HIUBUI8MROL.2 size=176596 2024-09-12T17:18:43.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.586+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=9HIUBUI8MROL tag=628XCQ2EBP30 type=write size=3322324 2024-09-12T17:18:43.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.590+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~RO220BN0YULI.0 size=1048576 2024-09-12T17:18:43.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.594+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~RO220BN0YULI.1 size=914563 2024-09-12T17:18:43.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.602+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=RO220BN0YULI tag=K7P2DHMG63YP type=write size=3011715 2024-09-12T17:18:43.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.606+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=NA1OLQ4I5KJE type=del size=3886919 2024-09-12T17:18:43.609 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.606+0000 7f96641d38c0 -1 < failed to complete operation key=XTVZIXTEES2O tag=BXB9F7Q1HUIA type=del size=50331: (22) Invalid argument 2024-09-12T17:18:43.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.614+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~8GB00AH432BW.0 size=1048576 2024-09-12T17:18:43.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.614+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~8GB00AH432BW.1 size=989951 2024-09-12T17:18:43.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.614+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=8GB00AH432BW tag=9RN8JGN43LEV type=write size=3087103 2024-09-12T17:18:43.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.618+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~3VT8PFEMMP1T.0 size=525652 2024-09-12T17:18:43.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.626+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=3VT8PFEMMP1T tag=NHYOY0MKYIAY type=write size=1574228 2024-09-12T17:18:43.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.626+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=BQQTLF5YIZIQ type=del size=59333 2024-09-12T17:18:43.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.630+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~M3NI84PYEKVK.0 size=1048576 2024-09-12T17:18:43.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.634+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~M3NI84PYEKVK.1 size=1048576 2024-09-12T17:18:43.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.638+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~M3NI84PYEKVK.2 size=675597 2024-09-12T17:18:43.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.642+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=M3NI84PYEKVK tag=LNCKLC0O9XHI type=write size=3821325 2024-09-12T17:18:43.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.646+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~L8J5LQY198RA.0 size=1048576 2024-09-12T17:18:43.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.650+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~L8J5LQY198RA.1 size=1048576 2024-09-12T17:18:43.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.650+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~L8J5LQY198RA.2 size=742776 2024-09-12T17:18:43.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.650+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=L8J5LQY198RA tag=2OG375FVRDVC type=write size=3888504 2024-09-12T17:18:43.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.658+0000 7f96641d38c0 1 < suggested update operation key=NGA3P9RZJYWT tag=V661PJA049J0 type=del size=2441490 2024-09-12T17:18:43.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.662+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~9QJ74Y7LV6L4.0 size=1048576 2024-09-12T17:18:43.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.666+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~9QJ74Y7LV6L4.1 size=1048576 2024-09-12T17:18:43.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.666+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~9QJ74Y7LV6L4.2 size=688100 2024-09-12T17:18:43.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.666+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=9QJ74Y7LV6L4 tag=6DEZ6JCJ2NHK type=write size=3833828 2024-09-12T17:18:43.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.670+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=H7I6T40QW42W type=del 2024-09-12T17:18:43.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.670+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=B8JVDDKZZHWJ type=del size=1466320 2024-09-12T17:18:43.676 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.674+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~SG6U7573NMG2.0 size=1048576 2024-09-12T17:18:43.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.678+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~SG6U7573NMG2.1 size=1048576 2024-09-12T17:18:43.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.682+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~SG6U7573NMG2.2 size=680352 2024-09-12T17:18:43.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.686+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=SG6U7573NMG2 tag=4XTL4RLGOPW5 type=write size=3826080 2024-09-12T17:18:43.694 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.694+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~DR8IP71GTQ2Z.0 size=728991 2024-09-12T17:18:43.694 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.694+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=DR8IP71GTQ2Z tag=LO97JKFPCGY8 type=write size=1777567 2024-09-12T17:18:43.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.694+0000 7f96641d38c0 -1 < failed to complete operation key=2TN3M8NKV9LN tag=HP9TP6ANNPG1 type=del size=111345: (22) Invalid argument 2024-09-12T17:18:43.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.698+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=BMYFZKPZ8QOV type=del size=532508 2024-09-12T17:18:43.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.702+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=K9WALFQSNVMM type=del 2024-09-12T17:18:43.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.706+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=2Z2XMBT0E0GL type=del size=3394761 2024-09-12T17:18:43.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.710+0000 7f96641d38c0 1 < completed write operation key=UBYUSW4C2V19 tag=1M8SYZZIO0SD type=write size=233499 2024-09-12T17:18:43.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.714+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~8NRLVK2ZB4B3.0 size=1048576 2024-09-12T17:18:43.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.718+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~8NRLVK2ZB4B3.1 size=536580 2024-09-12T17:18:43.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.718+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=8NRLVK2ZB4B3 tag=VET0M10P06GD type=write size=2633732 2024-09-12T17:18:43.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.722+0000 7f96641d38c0 1 < canceled operation key=XDL9O7TEMBYF tag=MSWXX0T5PGIJ type=del size=2575761 2024-09-12T17:18:43.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.722+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=FX4N6EI49KWU type=write size=355751 2024-09-12T17:18:43.729 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.726+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=22C1CXKNMA7D type=del 2024-09-12T17:18:43.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.730+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=MXDZ5D52T3YD type=del size=2730608 2024-09-12T17:18:43.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.734+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=D2HHQSQNQQU0 type=del 2024-09-12T17:18:43.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.738+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=9KS20MJK914X type=del size=4155015 2024-09-12T17:18:43.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.738+0000 7f96641d38c0 1 < canceled part key=_multipart_9CBFWXFX7O3N.2~Y17M81GKOH38.0 size=473227 2024-09-12T17:18:43.744 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.742+0000 7f96641d38c0 1 < canceled multipart upload key=9CBFWXFX7O3N upload=Y17M81GKOH38 tag=RYO5W1HHRM4H type=write size=1521803 2024-09-12T17:18:43.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.750+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~0O6OPGPXSAQA.0 size=1048576 2024-09-12T17:18:43.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.750+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~0O6OPGPXSAQA.1 size=752282 2024-09-12T17:18:43.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.750+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=0O6OPGPXSAQA tag=4EQV3QAQFN7H type=write size=2849434 2024-09-12T17:18:43.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.754+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~TR6MHWWBV6MV.0 size=1048576 2024-09-12T17:18:43.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.754+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~TR6MHWWBV6MV.1 size=647296 2024-09-12T17:18:43.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.762+0000 7f96641d38c0 1 < completed multipart upload key=HRU241T0FUEZ upload=TR6MHWWBV6MV tag=NQQV2066RY8C type=write size=2744448 2024-09-12T17:18:43.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.766+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~TM3ZVMJ3Y3LZ.0 size=1048576 2024-09-12T17:18:43.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.766+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~TM3ZVMJ3Y3LZ.1 size=1048576 2024-09-12T17:18:43.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.770+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~TM3ZVMJ3Y3LZ.2 size=216167 2024-09-12T17:18:43.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.770+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=TM3ZVMJ3Y3LZ tag=L2M5AXPCF9UI type=write size=3361895 2024-09-12T17:18:43.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.774+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~9HIUBUI8MROL.0 size=1048576 2024-09-12T17:18:43.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.774+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~9HIUBUI8MROL.1 size=1048576 2024-09-12T17:18:43.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.774+0000 7f96641d38c0 1 < canceled part key=_multipart_UBYUSW4C2V19.2~9HIUBUI8MROL.2 size=176596 2024-09-12T17:18:43.782 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.782+0000 7f96641d38c0 1 < canceled multipart upload key=UBYUSW4C2V19 upload=9HIUBUI8MROL tag=628XCQ2EBP30 type=write size=3322324 2024-09-12T17:18:43.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.786+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~MWWRBSD675KF.0 size=1048576 2024-09-12T17:18:43.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.786+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~MWWRBSD675KF.1 size=751117 2024-09-12T17:18:43.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.786+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=MWWRBSD675KF tag=Y58HK2ZJ0C0O type=write size=2848269 2024-09-12T17:18:43.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.790+0000 7f96641d38c0 1 < canceled operation key=IR9JQ4MAEH0P tag=NA1OLQ4I5KJE type=del size=3886919 2024-09-12T17:18:43.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.798+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~TXSDYGU89Z8Y.0 size=1048576 2024-09-12T17:18:43.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.798+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~TXSDYGU89Z8Y.1 size=231666 2024-09-12T17:18:43.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.798+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=TXSDYGU89Z8Y tag=9MN1J11UXD42 type=write size=2328818 2024-09-12T17:18:43.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.802+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~8GB00AH432BW.0 size=1048576 2024-09-12T17:18:43.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.806+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~8GB00AH432BW.1 size=989951 2024-09-12T17:18:43.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.810+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=8GB00AH432BW tag=9RN8JGN43LEV type=write size=3087103 2024-09-12T17:18:43.816 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.814+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~UEA7TCGS9UYK.0 size=675760 2024-09-12T17:18:43.816 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.814+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=UEA7TCGS9UYK tag=8750B7X07EJ3 type=write size=1724336 2024-09-12T17:18:43.818 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.818+0000 7f96641d38c0 -1 < failed to complete operation key=NGA3P9RZJYWT tag=BQQTLF5YIZIQ type=del size=59333: (22) Invalid argument 2024-09-12T17:18:43.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.818+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=UH1MNUAZ9AUR type=del size=2820066 2024-09-12T17:18:43.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.822+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~L8J5LQY198RA.0 size=1048576 2024-09-12T17:18:43.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.826+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~L8J5LQY198RA.1 size=1048576 2024-09-12T17:18:43.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.826+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~L8J5LQY198RA.2 size=742776 2024-09-12T17:18:43.832 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.830+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=L8J5LQY198RA tag=2OG375FVRDVC type=write size=3888504 2024-09-12T17:18:43.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.834+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=QCNYHV33VC3P type=del size=132861 2024-09-12T17:18:43.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.834+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~9QJ74Y7LV6L4.0 size=1048576 2024-09-12T17:18:43.839 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.838+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~9QJ74Y7LV6L4.1 size=1048576 2024-09-12T17:18:43.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.838+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~9QJ74Y7LV6L4.2 size=688100 2024-09-12T17:18:43.846 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.846+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=9QJ74Y7LV6L4 tag=6DEZ6JCJ2NHK type=write size=3833828 2024-09-12T17:18:43.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.846+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=DPBIJEHRBD88 type=del size=2543729 2024-09-12T17:18:43.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.850+0000 7f96641d38c0 1 < canceled operation key=RSVQJS9F1FR7 tag=B8JVDDKZZHWJ type=del size=1466320 2024-09-12T17:18:43.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.854+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=32G9CYW2314W type=del size=2752391 2024-09-12T17:18:43.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.854+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~DR8IP71GTQ2Z.0 size=728991 2024-09-12T17:18:43.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.862+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=DR8IP71GTQ2Z tag=LO97JKFPCGY8 type=write size=1777567 2024-09-12T17:18:43.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.866+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~BM2REZ1G1NXL.0 size=1048576 2024-09-12T17:18:43.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.874+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~BM2REZ1G1NXL.1 size=206593 2024-09-12T17:18:43.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.874+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=BM2REZ1G1NXL tag=F2IGFJ6DD10Y type=write size=2303745 2024-09-12T17:18:43.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.874+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=BMYFZKPZ8QOV type=del 2024-09-12T17:18:43.880 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.878+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=Y3SQJ5LRNBSK type=del size=2754731 2024-09-12T17:18:43.884 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.882+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=2Z2XMBT0E0GL type=del 2024-09-12T17:18:43.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.890+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~G0CDBAZ18NE2.0 size=1048576 2024-09-12T17:18:43.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.890+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~G0CDBAZ18NE2.1 size=331688 2024-09-12T17:18:43.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.890+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=G0CDBAZ18NE2 tag=BMRDH3BR1L6V type=write size=2428840 2024-09-12T17:18:43.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.894+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~8NRLVK2ZB4B3.0 size=1048576 2024-09-12T17:18:43.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.894+0000 7f96641d38c0 1 < canceled part key=_multipart_H3LV5G117KOW.2~8NRLVK2ZB4B3.1 size=536580 2024-09-12T17:18:43.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.898+0000 7f96641d38c0 1 < canceled multipart upload key=H3LV5G117KOW upload=8NRLVK2ZB4B3 tag=VET0M10P06GD type=write size=2633732 2024-09-12T17:18:43.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.902+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=9ZLET10PF6Y7 type=del size=1360536 2024-09-12T17:18:43.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.906+0000 7f96641d38c0 1 < suggested update operation key=NG327LT02T1F tag=FX4N6EI49KWU type=write size=355751 2024-09-12T17:18:43.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.910+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=H9QPEAMH1L8G type=del size=3334506 2024-09-12T17:18:43.914 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.914+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=MXDZ5D52T3YD type=del 2024-09-12T17:18:43.917 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.914+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=RSX8JCRGKK84 type=del size=3454244 2024-09-12T17:18:43.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.918+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=9KS20MJK914X type=del 2024-09-12T17:18:43.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.922+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=15F3UZK40TD0 type=del size=1568298 2024-09-12T17:18:43.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.922+0000 7f96641d38c0 1 < canceled part key=_multipart_GKJJDBNXC6QH.2~0O6OPGPXSAQA.0 size=1048576 2024-09-12T17:18:43.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.926+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~0O6OPGPXSAQA.1 size=752282 2024-09-12T17:18:43.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.930+0000 7f96641d38c0 1 < canceled multipart upload key=GKJJDBNXC6QH upload=0O6OPGPXSAQA tag=4EQV3QAQFN7H type=write size=2849434 2024-09-12T17:18:43.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.934+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=2PRHVRJD8RJO type=del size=3270385 2024-09-12T17:18:43.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.938+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~TM3ZVMJ3Y3LZ.0 size=1048576 2024-09-12T17:18:43.942 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.942+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~TM3ZVMJ3Y3LZ.1 size=1048576 2024-09-12T17:18:43.944 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.942+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~TM3ZVMJ3Y3LZ.2 size=216167 2024-09-12T17:18:43.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.950+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=TM3ZVMJ3Y3LZ tag=L2M5AXPCF9UI type=write size=3361895 2024-09-12T17:18:43.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.954+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~06EVC5UVY6DX.0 size=1048576 2024-09-12T17:18:43.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.958+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~06EVC5UVY6DX.1 size=1048576 2024-09-12T17:18:43.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.958+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~06EVC5UVY6DX.2 size=686652 2024-09-12T17:18:43.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.958+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=06EVC5UVY6DX tag=EBC5R3GIBQFF type=write size=3832380 2024-09-12T17:18:43.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.962+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~MWWRBSD675KF.0 size=1048576 2024-09-12T17:18:43.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.966+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~MWWRBSD675KF.1 size=751117 2024-09-12T17:18:43.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.974+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=MWWRBSD675KF tag=Y58HK2ZJ0C0O type=write size=2848269 2024-09-12T17:18:43.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.974+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=TNK7CRFEL1TM type=del size=3526121 2024-09-12T17:18:43.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.978+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~TXSDYGU89Z8Y.0 size=1048576 2024-09-12T17:18:43.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.982+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~TXSDYGU89Z8Y.1 size=231666 2024-09-12T17:18:43.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.986+0000 7f96641d38c0 1 < completed multipart upload key=XDL9O7TEMBYF upload=TXSDYGU89Z8Y tag=9MN1J11UXD42 type=write size=2328818 2024-09-12T17:18:43.993 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.990+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=CVDXTIGKSEU7 type=del size=4125840 2024-09-12T17:18:43.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.994+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~UEA7TCGS9UYK.0 size=675760 2024-09-12T17:18:44.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:43.998+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=UEA7TCGS9UYK tag=8750B7X07EJ3 type=write size=1724336 2024-09-12T17:18:44.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.002+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=L5LXQC8W1GOV type=write size=562983 2024-09-12T17:18:44.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.006+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=UH1MNUAZ9AUR type=del 2024-09-12T17:18:44.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.010+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=QT8DS0UGI0VW type=write size=992657 2024-09-12T17:18:44.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.014+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=QCNYHV33VC3P type=del 2024-09-12T17:18:44.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.018+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=FM9HIZCMMU6E type=del size=3929191 2024-09-12T17:18:44.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.018+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=DPBIJEHRBD88 type=del 2024-09-12T17:18:44.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.026+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~WY6REC9QY24H.0 size=1048576 2024-09-12T17:18:44.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.026+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~WY6REC9QY24H.1 size=369457 2024-09-12T17:18:44.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.026+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=WY6REC9QY24H tag=O8ZEANH6EWLE type=write size=2466609 2024-09-12T17:18:44.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.030+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=32G9CYW2314W type=del 2024-09-12T17:18:44.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.034+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=VAW78WVUM7VX type=del size=2658165 2024-09-12T17:18:44.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.038+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~BM2REZ1G1NXL.0 size=1048576 2024-09-12T17:18:44.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.038+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~BM2REZ1G1NXL.1 size=206593 2024-09-12T17:18:44.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.046+0000 7f96641d38c0 1 < completed multipart upload key=NGA3P9RZJYWT upload=BM2REZ1G1NXL tag=F2IGFJ6DD10Y type=write size=2303745 2024-09-12T17:18:44.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.050+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~PLR9P9XBBL9D.0 size=1048576 2024-09-12T17:18:44.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.054+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~PLR9P9XBBL9D.1 size=1048576 2024-09-12T17:18:44.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.054+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~PLR9P9XBBL9D.2 size=760506 2024-09-12T17:18:44.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.054+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=PLR9P9XBBL9D tag=ZELN4YJ234YL type=write size=3906234 2024-09-12T17:18:44.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.062+0000 7f96641d38c0 1 < suggested update operation key=2TN3M8NKV9LN tag=Y3SQJ5LRNBSK type=del size=2754731 2024-09-12T17:18:44.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.066+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=AYK4HBRKB1QU type=del size=2413157 2024-09-12T17:18:44.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.070+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~G0CDBAZ18NE2.0 size=1048576 2024-09-12T17:18:44.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.070+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~G0CDBAZ18NE2.1 size=331688 2024-09-12T17:18:44.078 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.078+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=G0CDBAZ18NE2 tag=BMRDH3BR1L6V type=write size=2428840 2024-09-12T17:18:44.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.078+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=NDYHDEZRSOJV type=del size=4120674 2024-09-12T17:18:44.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.082+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=9ZLET10PF6Y7 type=del 2024-09-12T17:18:44.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.086+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=O9X79HKQF468 type=del size=2129438 2024-09-12T17:18:44.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.090+0000 7f96641d38c0 1 < suggested remove operation key=2TN3M8NKV9LN tag=H9QPEAMH1L8G type=del 2024-09-12T17:18:44.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.094+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~29162V28NDAO.0 size=1048576 2024-09-12T17:18:44.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.098+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~29162V28NDAO.1 size=1048576 2024-09-12T17:18:44.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.102+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~29162V28NDAO.2 size=1043510 2024-09-12T17:18:44.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.102+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=29162V28NDAO tag=XDELPVOU3GND type=write size=4189238 2024-09-12T17:18:44.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.102+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=RSX8JCRGKK84 type=del 2024-09-12T17:18:44.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.106+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=84UOC1T9RH0A type=del size=3710196 2024-09-12T17:18:44.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.110+0000 7f96641d38c0 1 < canceled operation key=9CBFWXFX7O3N tag=15F3UZK40TD0 type=del size=1568298 2024-09-12T17:18:44.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.118+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~47KDFSZ89H4I.0 size=1048576 2024-09-12T17:18:44.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.118+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~47KDFSZ89H4I.1 size=1048576 2024-09-12T17:18:44.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.122+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~47KDFSZ89H4I.2 size=860901 2024-09-12T17:18:44.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.122+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=47KDFSZ89H4I tag=WK46UQJVFN0U type=write size=4006629 2024-09-12T17:18:44.126 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.126+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=2PRHVRJD8RJO type=del 2024-09-12T17:18:44.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.126+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=65D7HEFC5JZ9 type=write size=923082 2024-09-12T17:18:44.132 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.130+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~06EVC5UVY6DX.0 size=1048576 2024-09-12T17:18:44.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.134+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~06EVC5UVY6DX.1 size=1048576 2024-09-12T17:18:44.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.134+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~06EVC5UVY6DX.2 size=686652 2024-09-12T17:18:44.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.142+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=06EVC5UVY6DX tag=EBC5R3GIBQFF type=write size=3832380 2024-09-12T17:18:44.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.142+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=E44OIX91S8CX type=del size=2619314 2024-09-12T17:18:44.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.146+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=TNK7CRFEL1TM type=del 2024-09-12T17:18:44.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.150+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=E13BSAT6NTYC type=del size=1440401 2024-09-12T17:18:44.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.154+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=CVDXTIGKSEU7 type=del 2024-09-12T17:18:44.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.158+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=HD9FEBJ5V8X5 type=del size=335157 2024-09-12T17:18:44.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.158+0000 7f96641d38c0 1 < completed write operation key=0X2HHMHJUJNL tag=L5LXQC8W1GOV type=write size=562983 2024-09-12T17:18:44.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.162+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=TTMMIYANE39V type=del size=606237 2024-09-12T17:18:44.171 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.170+0000 7f96641d38c0 1 < completed write operation key=BDI9YFZCT5YY tag=QT8DS0UGI0VW type=write size=992657 2024-09-12T17:18:44.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.174+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=8NRGNYEDXZ5G type=write size=556926 2024-09-12T17:18:44.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.182+0000 7f96641d38c0 1 < suggested remove operation key=3SLNHJT3A1K1 tag=FM9HIZCMMU6E type=del 2024-09-12T17:18:44.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.186+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~YI3U2SCLM1EJ.0 size=1048576 2024-09-12T17:18:44.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.190+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~YI3U2SCLM1EJ.1 size=1048576 2024-09-12T17:18:44.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.194+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~YI3U2SCLM1EJ.2 size=816886 2024-09-12T17:18:44.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.194+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=YI3U2SCLM1EJ tag=HKUU1ETQ3JZJ type=write size=3962614 2024-09-12T17:18:44.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.198+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~WY6REC9QY24H.0 size=1048576 2024-09-12T17:18:44.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.198+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~WY6REC9QY24H.1 size=369457 2024-09-12T17:18:44.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.206+0000 7f96641d38c0 1 < completed multipart upload key=37YXLWPZGA9J upload=WY6REC9QY24H tag=O8ZEANH6EWLE type=write size=2466609 2024-09-12T17:18:44.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.210+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=GBJ6U7ZHNT68 type=del size=1951870 2024-09-12T17:18:44.214 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.214+0000 7f96641d38c0 1 < canceled operation key=LK3F25OHR7AO tag=VAW78WVUM7VX type=del size=2658165 2024-09-12T17:18:44.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.218+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=6SZBFW5D2XKT type=del size=4189800 2024-09-12T17:18:44.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.222+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~PLR9P9XBBL9D.0 size=1048576 2024-09-12T17:18:44.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.222+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~PLR9P9XBBL9D.1 size=1048576 2024-09-12T17:18:44.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.226+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~PLR9P9XBBL9D.2 size=760506 2024-09-12T17:18:44.234 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.234+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=PLR9P9XBBL9D tag=ZELN4YJ234YL type=write size=3906234 2024-09-12T17:18:44.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.238+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~IYQ8Y3UM3CFH.0 size=847786 2024-09-12T17:18:44.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.238+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=IYQ8Y3UM3CFH tag=M2AF3M4B70AT type=write size=1896362 2024-09-12T17:18:44.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.242+0000 7f96641d38c0 1 < canceled operation key=47QQRTJKM4DB tag=AYK4HBRKB1QU type=del size=2413157 2024-09-12T17:18:44.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.250+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~1WX6S8NSTQ14.0 size=466199 2024-09-12T17:18:44.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.250+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=1WX6S8NSTQ14 tag=3I99VEN044YW type=write size=1514775 2024-09-12T17:18:44.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.254+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=NDYHDEZRSOJV type=del 2024-09-12T17:18:44.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.258+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~XN344JP7FHN7.0 size=678638 2024-09-12T17:18:44.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.258+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=XN344JP7FHN7 tag=AEQMR3WKHKMF type=write size=1727214 2024-09-12T17:18:44.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.262+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=O9X79HKQF468 type=del 2024-09-12T17:18:44.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.270+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~BKFD40O0E25P.0 size=1048576 2024-09-12T17:18:44.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.274+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~BKFD40O0E25P.1 size=1048576 2024-09-12T17:18:44.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.274+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~BKFD40O0E25P.2 size=71718 2024-09-12T17:18:44.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.274+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=BKFD40O0E25P tag=9C2V1ZO90PFX type=write size=3217446 2024-09-12T17:18:44.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.278+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~29162V28NDAO.0 size=1048576 2024-09-12T17:18:44.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.278+0000 7f96641d38c0 1 < canceled part key=_multipart_H3LV5G117KOW.2~29162V28NDAO.1 size=1048576 2024-09-12T17:18:44.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.282+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~29162V28NDAO.2 size=1043510 2024-09-12T17:18:44.288 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.286+0000 7f96641d38c0 1 < canceled multipart upload key=H3LV5G117KOW upload=29162V28NDAO tag=XDELPVOU3GND type=write size=4189238 2024-09-12T17:18:44.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.290+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=CWTYMNMIK556 type=del size=3980768 2024-09-12T17:18:44.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.298+0000 7f96641d38c0 1 < suggested update operation key=8TU2VZOHL1ZZ tag=84UOC1T9RH0A type=del size=3710196 2024-09-12T17:18:44.301 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.298+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=AYK73CUVB4IM type=write size=403574 2024-09-12T17:18:44.302 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.302+0000 7f96641d38c0 1 < canceled part key=_multipart_8TU2VZOHL1ZZ.2~47KDFSZ89H4I.0 size=1048576 2024-09-12T17:18:44.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.302+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~47KDFSZ89H4I.1 size=1048576 2024-09-12T17:18:44.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.302+0000 7f96641d38c0 1 < canceled part key=_multipart_8TU2VZOHL1ZZ.2~47KDFSZ89H4I.2 size=860901 2024-09-12T17:18:44.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.306+0000 7f96641d38c0 1 < canceled multipart upload key=8TU2VZOHL1ZZ upload=47KDFSZ89H4I tag=WK46UQJVFN0U type=write size=4006629 2024-09-12T17:18:44.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.314+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~MLE6KV9P507Y.0 size=285007 2024-09-12T17:18:44.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.314+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=MLE6KV9P507Y tag=TQ0JJ61O9V6V type=write size=1333583 2024-09-12T17:18:44.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.314+0000 7f96641d38c0 1 < completed write operation key=XDL9O7TEMBYF tag=65D7HEFC5JZ9 type=write size=923082 2024-09-12T17:18:44.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.318+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=1ZTLZCXK7RCT type=del size=4078055 2024-09-12T17:18:44.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.326+0000 7f96641d38c0 1 < suggested remove operation key=0X2HHMHJUJNL tag=E44OIX91S8CX type=del 2024-09-12T17:18:44.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.330+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~7H2VI03SS8Q2.0 size=879896 2024-09-12T17:18:44.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.330+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=7H2VI03SS8Q2 tag=YKC8RLX3G4M3 type=write size=1928472 2024-09-12T17:18:44.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.334+0000 7f96641d38c0 -1 < failed to complete operation key=8TU2VZOHL1ZZ tag=E13BSAT6NTYC type=del size=1440401: (22) Invalid argument 2024-09-12T17:18:44.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.338+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=S47GEIS0MF5D type=del size=1472969 2024-09-12T17:18:44.342 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.342+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=HD9FEBJ5V8X5 type=del 2024-09-12T17:18:44.345 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.342+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=KJ5TP2II217Q type=del size=2167651 2024-09-12T17:18:44.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.346+0000 7f96641d38c0 1 < canceled operation key=G7CWVD9C2H2J tag=TTMMIYANE39V type=del size=606237 2024-09-12T17:18:44.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.354+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~CQQK076H8ZNK.0 size=159120 2024-09-12T17:18:44.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.354+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=CQQK076H8ZNK tag=9NA4TRW01217 type=write size=1207696 2024-09-12T17:18:44.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.358+0000 7f96641d38c0 -1 < failed to complete operation key=0X2HHMHJUJNL tag=8NRGNYEDXZ5G type=write size=556926: (22) Invalid argument 2024-09-12T17:18:44.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.362+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~7JXSO4VYVGQQ.0 size=1048576 2024-09-12T17:18:44.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.370+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~7JXSO4VYVGQQ.1 size=1048576 2024-09-12T17:18:44.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.374+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~7JXSO4VYVGQQ.2 size=702370 2024-09-12T17:18:44.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.374+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=7JXSO4VYVGQQ tag=TYYI8U293QPN type=write size=3848098 2024-09-12T17:18:44.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.378+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~YI3U2SCLM1EJ.0 size=1048576 2024-09-12T17:18:44.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.378+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~YI3U2SCLM1EJ.1 size=1048576 2024-09-12T17:18:44.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.378+0000 7f96641d38c0 1 < canceled part key=_multipart_G7CWVD9C2H2J.2~YI3U2SCLM1EJ.2 size=816886 2024-09-12T17:18:44.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.386+0000 7f96641d38c0 1 < canceled multipart upload key=G7CWVD9C2H2J upload=YI3U2SCLM1EJ tag=HKUU1ETQ3JZJ type=write size=3962614 2024-09-12T17:18:44.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.394+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=EU21DYV1DCXH type=del size=3036049 2024-09-12T17:18:44.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.394+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=GBJ6U7ZHNT68 type=del 2024-09-12T17:18:44.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.398+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~15OG750PJL26.0 size=1048576 2024-09-12T17:18:44.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.402+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~15OG750PJL26.1 size=852573 2024-09-12T17:18:44.402 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.402+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=15OG750PJL26 tag=C1K4ZX2SI0W4 type=write size=2949725 2024-09-12T17:18:44.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.402+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=6SZBFW5D2XKT type=del 2024-09-12T17:18:44.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.402+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=2RUFXANANR6C type=del size=3987782 2024-09-12T17:18:44.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.406+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~IYQ8Y3UM3CFH.0 size=847786 2024-09-12T17:18:44.410 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.410+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=IYQ8Y3UM3CFH tag=M2AF3M4B70AT type=write size=1896362 2024-09-12T17:18:44.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.410+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=ZEMEZOMEEQ1I type=del size=1310775 2024-09-12T17:18:44.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.410+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~1WX6S8NSTQ14.0 size=466199 2024-09-12T17:18:44.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.414+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=1WX6S8NSTQ14 tag=3I99VEN044YW type=write size=1514775 2024-09-12T17:18:44.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.418+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=XXX40IJ68FGW type=del size=2084492 2024-09-12T17:18:44.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.418+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~XN344JP7FHN7.0 size=678638 2024-09-12T17:18:44.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.422+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=XN344JP7FHN7 tag=AEQMR3WKHKMF type=write size=1727214 2024-09-12T17:18:44.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.422+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=MKZAFE0ZH1QQ type=del size=3731859 2024-09-12T17:18:44.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.426+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~BKFD40O0E25P.0 size=1048576 2024-09-12T17:18:44.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.426+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~BKFD40O0E25P.1 size=1048576 2024-09-12T17:18:44.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.430+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~BKFD40O0E25P.2 size=71718 2024-09-12T17:18:44.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.434+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=BKFD40O0E25P tag=9C2V1ZO90PFX type=write size=3217446 2024-09-12T17:18:44.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.434+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=A817GU907EF5 type=del size=828160 2024-09-12T17:18:44.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.438+0000 7f96641d38c0 1 < canceled operation key=LK3F25OHR7AO tag=CWTYMNMIK556 type=del size=3980768 2024-09-12T17:18:44.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.438+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~1BSK0WZA9249.0 size=1048576 2024-09-12T17:18:44.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.442+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~1BSK0WZA9249.1 size=1048576 2024-09-12T17:18:44.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.442+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~1BSK0WZA9249.2 size=626623 2024-09-12T17:18:44.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.442+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=1BSK0WZA9249 tag=XMS28DO1XC42 type=write size=3772351 2024-09-12T17:18:44.446 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.446+0000 7f96641d38c0 1 < completed write operation key=HRU241T0FUEZ tag=AYK73CUVB4IM type=write size=403574 2024-09-12T17:18:44.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.450+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~CMB2REQLUNMJ.0 size=168505 2024-09-12T17:18:44.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.450+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=CMB2REQLUNMJ tag=XXIN180P7I9Z type=write size=1217081 2024-09-12T17:18:44.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.454+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~MLE6KV9P507Y.0 size=285007 2024-09-12T17:18:44.458 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.458+0000 7f96641d38c0 1 < completed multipart upload key=2TN3M8NKV9LN upload=MLE6KV9P507Y tag=TQ0JJ61O9V6V type=write size=1333583 2024-09-12T17:18:44.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.458+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=7M49KDNKJ5SV type=del size=1452927 2024-09-12T17:18:44.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.462+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=1ZTLZCXK7RCT type=del 2024-09-12T17:18:44.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.462+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=YWO0UYJAX80U type=del size=1841842 2024-09-12T17:18:44.465 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.462+0000 7f96641d38c0 1 < canceled part key=_multipart_EFORFJYOM45R.2~7H2VI03SS8Q2.0 size=879896 2024-09-12T17:18:44.468 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.466+0000 7f96641d38c0 1 < canceled multipart upload key=EFORFJYOM45R upload=7H2VI03SS8Q2 tag=YKC8RLX3G4M3 type=write size=1928472 2024-09-12T17:18:44.469 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.470+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=2DXM8GA17ZQQ type=del size=2123895 2024-09-12T17:18:44.472 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.470+0000 7f96641d38c0 1 < canceled operation key=3SLNHJT3A1K1 tag=S47GEIS0MF5D type=del size=1472969 2024-09-12T17:18:44.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.470+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=6F7B3V823HW3 type=write size=449717 2024-09-12T17:18:44.475 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.474+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=KJ5TP2II217Q type=del 2024-09-12T17:18:44.479 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.478+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~ZUA908NLGW4J.0 size=1048576 2024-09-12T17:18:44.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.478+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~ZUA908NLGW4J.1 size=1048576 2024-09-12T17:18:44.482 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.482+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~ZUA908NLGW4J.2 size=847591 2024-09-12T17:18:44.482 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.482+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=ZUA908NLGW4J tag=F21MAH8JJA39 type=write size=3993319 2024-09-12T17:18:44.484 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.482+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~CQQK076H8ZNK.0 size=159120 2024-09-12T17:18:44.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.486+0000 7f96641d38c0 1 < completed multipart upload key=3SLNHJT3A1K1 upload=CQQK076H8ZNK tag=9NA4TRW01217 type=write size=1207696 2024-09-12T17:18:44.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.490+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~NCOMZNVZESRB.0 size=1048576 2024-09-12T17:18:44.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.490+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~NCOMZNVZESRB.1 size=379269 2024-09-12T17:18:44.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.490+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=NCOMZNVZESRB tag=X9KNL7MLXLQD type=write size=2476421 2024-09-12T17:18:44.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.494+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~7JXSO4VYVGQQ.0 size=1048576 2024-09-12T17:18:44.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.494+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~7JXSO4VYVGQQ.1 size=1048576 2024-09-12T17:18:44.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.498+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~7JXSO4VYVGQQ.2 size=702370 2024-09-12T17:18:44.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.498+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=7JXSO4VYVGQQ tag=TYYI8U293QPN type=write size=3848098 2024-09-12T17:18:44.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.502+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=UMT7WZ3ZLSNK type=del size=3333476 2024-09-12T17:18:44.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.502+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=EU21DYV1DCXH type=del 2024-09-12T17:18:44.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.506+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~PD51QMD04FF3.0 size=1048576 2024-09-12T17:18:44.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.506+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~PD51QMD04FF3.1 size=1048576 2024-09-12T17:18:44.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.510+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~PD51QMD04FF3.2 size=594944 2024-09-12T17:18:44.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.510+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=PD51QMD04FF3 tag=LHOV2FNO0TXD type=write size=3740672 2024-09-12T17:18:44.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.510+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~15OG750PJL26.0 size=1048576 2024-09-12T17:18:44.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.514+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~15OG750PJL26.1 size=852573 2024-09-12T17:18:44.517 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.514+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=15OG750PJL26 tag=C1K4ZX2SI0W4 type=write size=2949725 2024-09-12T17:18:44.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.518+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=GEYS6IWAXWG1 type=del size=1319938 2024-09-12T17:18:44.521 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.518+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=2RUFXANANR6C type=del 2024-09-12T17:18:44.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.522+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=81641A8Z4XQM type=del size=855602 2024-09-12T17:18:44.524 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.522+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=ZEMEZOMEEQ1I type=del 2024-09-12T17:18:44.526 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.526+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=7RFAQNVPNY4S type=write size=123295 2024-09-12T17:18:44.528 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.526+0000 7f96641d38c0 1 < canceled operation key=G7CWVD9C2H2J tag=XXX40IJ68FGW type=del size=2084492 2024-09-12T17:18:44.529 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.526+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=DKKE3Y8WXAHS type=del size=1518575 2024-09-12T17:18:44.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.530+0000 7f96641d38c0 1 < suggested update operation key=BDI9YFZCT5YY tag=MKZAFE0ZH1QQ type=del size=3731859 2024-09-12T17:18:44.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.534+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=23DWNYSN4BAD type=write size=591130 2024-09-12T17:18:44.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.534+0000 7f96641d38c0 1 < canceled operation key=XDL9O7TEMBYF tag=A817GU907EF5 type=del size=828160 2024-09-12T17:18:44.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.538+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~QJ9D257EUWUN.0 size=1048576 2024-09-12T17:18:44.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.538+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~QJ9D257EUWUN.1 size=1048576 2024-09-12T17:18:44.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.542+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~QJ9D257EUWUN.2 size=687217 2024-09-12T17:18:44.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.542+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=QJ9D257EUWUN tag=QNHB7HQMSXI4 type=write size=3832945 2024-09-12T17:18:44.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.542+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~1BSK0WZA9249.0 size=1048576 2024-09-12T17:18:44.545 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.542+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~1BSK0WZA9249.1 size=1048576 2024-09-12T17:18:44.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.546+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~1BSK0WZA9249.2 size=626623 2024-09-12T17:18:44.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.546+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=1BSK0WZA9249 tag=XMS28DO1XC42 type=write size=3772351 2024-09-12T17:18:44.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.550+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=44N06A6QB2ZQ type=del size=1157425 2024-09-12T17:18:44.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.550+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~CMB2REQLUNMJ.0 size=168505 2024-09-12T17:18:44.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.554+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=CMB2REQLUNMJ tag=XXIN180P7I9Z type=write size=1217081 2024-09-12T17:18:44.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.554+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=4U2T7Q5VGQ4U type=write size=636581 2024-09-12T17:18:44.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.558+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=7M49KDNKJ5SV type=del 2024-09-12T17:18:44.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.558+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=0U86MC4MI4BJ type=del size=1425051 2024-09-12T17:18:44.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.562+0000 7f96641d38c0 1 < suggested update operation key=XTVZIXTEES2O tag=YWO0UYJAX80U type=del size=1841842 2024-09-12T17:18:44.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.566+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=P2TV508L737C type=del size=1302599 2024-09-12T17:18:44.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.566+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=2DXM8GA17ZQQ type=del 2024-09-12T17:18:44.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.570+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=ITEVWI528F0B type=del size=805254 2024-09-12T17:18:44.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.570+0000 7f96641d38c0 1 < completed write operation key=6BH7SI911MMP tag=6F7B3V823HW3 type=write size=449717 2024-09-12T17:18:44.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.574+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=20L2XI2057I6 type=write size=217095 2024-09-12T17:18:44.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.574+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~ZUA908NLGW4J.0 size=1048576 2024-09-12T17:18:44.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.574+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~ZUA908NLGW4J.1 size=1048576 2024-09-12T17:18:44.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.578+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~ZUA908NLGW4J.2 size=847591 2024-09-12T17:18:44.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.582+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=ZUA908NLGW4J tag=F21MAH8JJA39 type=write size=3993319 2024-09-12T17:18:44.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.582+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=B499I5GTTTC2 type=del size=467171 2024-09-12T17:18:44.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.586+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~NCOMZNVZESRB.0 size=1048576 2024-09-12T17:18:44.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.586+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~NCOMZNVZESRB.1 size=379269 2024-09-12T17:18:44.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.590+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=NCOMZNVZESRB tag=X9KNL7MLXLQD type=write size=2476421 2024-09-12T17:18:44.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.590+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=B8WDKOQVWYOB type=del size=2783764 2024-09-12T17:18:44.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.594+0000 7f96641d38c0 1 < canceled operation key=NR82RUK97NQA tag=UMT7WZ3ZLSNK type=del size=3333476 2024-09-12T17:18:44.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.594+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=8X0PN2OEKFPT type=del size=330699 2024-09-12T17:18:44.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.598+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~PD51QMD04FF3.0 size=1048576 2024-09-12T17:18:44.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.598+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~PD51QMD04FF3.1 size=1048576 2024-09-12T17:18:44.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.602+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~PD51QMD04FF3.2 size=594944 2024-09-12T17:18:44.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.602+0000 7f96641d38c0 1 < completed multipart upload key=NGA3P9RZJYWT upload=PD51QMD04FF3 tag=LHOV2FNO0TXD type=write size=3740672 2024-09-12T17:18:44.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.606+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=RIHCPCHOPZPL type=del size=2312003 2024-09-12T17:18:44.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.606+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=GEYS6IWAXWG1 type=del 2024-09-12T17:18:44.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.610+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=BLVR0X27AR0B type=del size=8950 2024-09-12T17:18:44.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.610+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=81641A8Z4XQM type=del 2024-09-12T17:18:44.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.614+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=E39IQ4B807CU type=del size=924923 2024-09-12T17:18:44.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.614+0000 7f96641d38c0 1 < canceled operation key=NR82RUK97NQA tag=7RFAQNVPNY4S type=write size=123295 2024-09-12T17:18:44.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.618+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=B62ZNR2202ED type=del size=2108829 2024-09-12T17:18:44.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.618+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=DKKE3Y8WXAHS type=del 2024-09-12T17:18:44.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.622+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=YR8Y65PWF75V type=write size=1004122 2024-09-12T17:18:44.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.622+0000 7f96641d38c0 1 < completed write operation key=47QQRTJKM4DB tag=23DWNYSN4BAD type=write size=591130 2024-09-12T17:18:44.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.626+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=6SS2UYA0RCRR type=write size=906474 2024-09-12T17:18:44.631 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.630+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~QJ9D257EUWUN.0 size=1048576 2024-09-12T17:18:44.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.630+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~QJ9D257EUWUN.1 size=1048576 2024-09-12T17:18:44.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.634+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~QJ9D257EUWUN.2 size=687217 2024-09-12T17:18:44.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.634+0000 7f96641d38c0 1 < completed multipart upload key=EFORFJYOM45R upload=QJ9D257EUWUN tag=QNHB7HQMSXI4 type=write size=3832945 2024-09-12T17:18:44.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.638+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~VTDO4DQ09T2I.0 size=1048576 2024-09-12T17:18:44.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.642+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~VTDO4DQ09T2I.1 size=1048576 2024-09-12T17:18:44.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.642+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~VTDO4DQ09T2I.2 size=589658 2024-09-12T17:18:44.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.642+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=VTDO4DQ09T2I tag=716CBH1HVEBN type=write size=3735386 2024-09-12T17:18:44.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.646+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=44N06A6QB2ZQ type=del 2024-09-12T17:18:44.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.650+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~I012CVRHVZ1T.0 size=786950 2024-09-12T17:18:44.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.650+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=I012CVRHVZ1T tag=RLSKHGAMMC9E type=write size=1835526 2024-09-12T17:18:44.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.650+0000 7f96641d38c0 -1 < failed to complete operation key=XTVZIXTEES2O tag=4U2T7Q5VGQ4U type=write size=636581: (22) Invalid argument 2024-09-12T17:18:44.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.654+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~L10ZJ17UBGOW.0 size=1048576 2024-09-12T17:18:44.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.654+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~L10ZJ17UBGOW.1 size=250708 2024-09-12T17:18:44.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.654+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=L10ZJ17UBGOW tag=XN22LXTZFLS7 type=write size=2347860 2024-09-12T17:18:44.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.658+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=0U86MC4MI4BJ type=del 2024-09-12T17:18:44.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.662+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~14O5KHJCC0UQ.0 size=1048576 2024-09-12T17:18:44.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.662+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~14O5KHJCC0UQ.1 size=1048576 2024-09-12T17:18:44.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.666+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~14O5KHJCC0UQ.2 size=929314 2024-09-12T17:18:44.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.666+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=14O5KHJCC0UQ tag=E75L3VXWVW9L type=write size=4075042 2024-09-12T17:18:44.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.670+0000 7f96641d38c0 1 < suggested remove operation key=H3J23KLT1VUT tag=P2TV508L737C type=del 2024-09-12T17:18:44.675 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.674+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~00V1XX40UPU6.0 size=1048576 2024-09-12T17:18:44.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.674+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~00V1XX40UPU6.1 size=1048576 2024-09-12T17:18:44.678 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.678+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~00V1XX40UPU6.2 size=781090 2024-09-12T17:18:44.678 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.678+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=00V1XX40UPU6 tag=3D9PURSITZSQ type=write size=3926818 2024-09-12T17:18:44.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.678+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=ITEVWI528F0B type=del 2024-09-12T17:18:44.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.682+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~KXH4LVJZ8GBB.0 size=1048576 2024-09-12T17:18:44.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.682+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~KXH4LVJZ8GBB.1 size=282396 2024-09-12T17:18:44.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.682+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=KXH4LVJZ8GBB tag=G1OQLBKBOVVL type=write size=2379548 2024-09-12T17:18:44.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.686+0000 7f96641d38c0 1 < completed write operation key=ZKDOIH5SH6K0 tag=20L2XI2057I6 type=write size=217095 2024-09-12T17:18:44.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.686+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=NAMYFYM47ELT type=del size=1065959 2024-09-12T17:18:44.691 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.690+0000 7f96641d38c0 1 < canceled operation key=G7CWVD9C2H2J tag=B499I5GTTTC2 type=del size=467171 2024-09-12T17:18:44.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.694+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~AQK4BQ0LTCTV.0 size=1048576 2024-09-12T17:18:44.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.694+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~AQK4BQ0LTCTV.1 size=1015009 2024-09-12T17:18:44.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.694+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=AQK4BQ0LTCTV tag=WCP6JMT1JZJ0 type=write size=3112161 2024-09-12T17:18:44.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.698+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=B8WDKOQVWYOB type=del 2024-09-12T17:18:44.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.702+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~0135QGCP9CCT.0 size=1048576 2024-09-12T17:18:44.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.702+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~0135QGCP9CCT.1 size=293697 2024-09-12T17:18:44.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.702+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=0135QGCP9CCT tag=NWVWPC8EF6QV type=write size=2390849 2024-09-12T17:18:44.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.706+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=8X0PN2OEKFPT type=del 2024-09-12T17:18:44.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.710+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~U58HIDNCTBL1.0 size=1048576 2024-09-12T17:18:44.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.710+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~U58HIDNCTBL1.1 size=1048576 2024-09-12T17:18:44.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.714+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~U58HIDNCTBL1.2 size=101308 2024-09-12T17:18:44.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.714+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=U58HIDNCTBL1 tag=M709E4MNYCHF type=write size=3247036 2024-09-12T17:18:44.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.714+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=RIHCPCHOPZPL type=del 2024-09-12T17:18:44.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.718+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=O0VWFN25E87A type=del size=2034891 2024-09-12T17:18:44.721 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.718+0000 7f96641d38c0 1 < canceled operation key=ZKDOIH5SH6K0 tag=BLVR0X27AR0B type=del size=8950 2024-09-12T17:18:44.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.722+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~G3E7KT8SH49M.0 size=1048576 2024-09-12T17:18:44.726 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.726+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~G3E7KT8SH49M.1 size=9220 2024-09-12T17:18:44.726 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.726+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=G3E7KT8SH49M tag=8NUXSVHRQHJ6 type=write size=2106372 2024-09-12T17:18:44.728 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.726+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=E39IQ4B807CU type=del 2024-09-12T17:18:44.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.730+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~CK26NGT092ED.0 size=1048576 2024-09-12T17:18:44.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.730+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~CK26NGT092ED.1 size=642176 2024-09-12T17:18:44.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.730+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=CK26NGT092ED tag=L3968XHZFJ06 type=write size=2739328 2024-09-12T17:18:44.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.734+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=B62ZNR2202ED type=del 2024-09-12T17:18:44.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.734+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=1AW1DZL825RK type=del size=504612 2024-09-12T17:18:44.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.738+0000 7f96641d38c0 1 < canceled operation key=H3LV5G117KOW tag=YR8Y65PWF75V type=write size=1004122 2024-09-12T17:18:44.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.742+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~L0GS5ZG47CK5.0 size=1048576 2024-09-12T17:18:44.744 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.742+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~L0GS5ZG47CK5.1 size=1048576 2024-09-12T17:18:44.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.742+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~L0GS5ZG47CK5.2 size=387293 2024-09-12T17:18:44.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.742+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=L0GS5ZG47CK5 tag=5MSO7W301KQS type=write size=3533021 2024-09-12T17:18:44.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.746+0000 7f96641d38c0 1 < completed write operation key=BDI9YFZCT5YY tag=6SS2UYA0RCRR type=write size=906474 2024-09-12T17:18:44.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.746+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=DGSYYI376JRP type=del size=1605108 2024-09-12T17:18:44.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.750+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~VTDO4DQ09T2I.0 size=1048576 2024-09-12T17:18:44.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.750+0000 7f96641d38c0 1 < canceled part key=_multipart_NG327LT02T1F.2~VTDO4DQ09T2I.1 size=1048576 2024-09-12T17:18:44.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.750+0000 7f96641d38c0 1 < canceled part key=_multipart_NG327LT02T1F.2~VTDO4DQ09T2I.2 size=589658 2024-09-12T17:18:44.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.754+0000 7f96641d38c0 1 < canceled multipart upload key=NG327LT02T1F upload=VTDO4DQ09T2I tag=716CBH1HVEBN type=write size=3735386 2024-09-12T17:18:44.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.754+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=8E389UAMJBLO type=del size=2549379 2024-09-12T17:18:44.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.758+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~I012CVRHVZ1T.0 size=786950 2024-09-12T17:18:44.761 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.758+0000 7f96641d38c0 1 < completed multipart upload key=G7CWVD9C2H2J upload=I012CVRHVZ1T tag=RLSKHGAMMC9E type=write size=1835526 2024-09-12T17:18:44.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.762+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~DHACWOCH0QTI.0 size=1048576 2024-09-12T17:18:44.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.766+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~DHACWOCH0QTI.1 size=973750 2024-09-12T17:18:44.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.766+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=DHACWOCH0QTI tag=8S4O3F962LGL type=write size=3070902 2024-09-12T17:18:44.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.766+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~L10ZJ17UBGOW.0 size=1048576 2024-09-12T17:18:44.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.770+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~L10ZJ17UBGOW.1 size=250708 2024-09-12T17:18:44.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.774+0000 7f96641d38c0 1 < completed multipart upload key=3SLNHJT3A1K1 upload=L10ZJ17UBGOW tag=XN22LXTZFLS7 type=write size=2347860 2024-09-12T17:18:44.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.774+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=OB1PIR4J1JYW type=del size=569992 2024-09-12T17:18:44.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.778+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~14O5KHJCC0UQ.0 size=1048576 2024-09-12T17:18:44.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.778+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~14O5KHJCC0UQ.1 size=1048576 2024-09-12T17:18:44.782 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.782+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~14O5KHJCC0UQ.2 size=929314 2024-09-12T17:18:44.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.786+0000 7f96641d38c0 1 < completed multipart upload key=3SLNHJT3A1K1 upload=14O5KHJCC0UQ tag=E75L3VXWVW9L type=write size=4075042 2024-09-12T17:18:44.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.786+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=375JH1QW36NX type=del size=2621233 2024-09-12T17:18:44.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.786+0000 7f96641d38c0 1 < canceled part key=_multipart_EFORFJYOM45R.2~00V1XX40UPU6.0 size=1048576 2024-09-12T17:18:44.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.786+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~00V1XX40UPU6.1 size=1048576 2024-09-12T17:18:44.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.790+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~00V1XX40UPU6.2 size=781090 2024-09-12T17:18:44.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.794+0000 7f96641d38c0 1 < canceled multipart upload key=EFORFJYOM45R upload=00V1XX40UPU6 tag=3D9PURSITZSQ type=write size=3926818 2024-09-12T17:18:44.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.794+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=F89OX1RCZDGX type=del size=971798 2024-09-12T17:18:44.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.798+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~KXH4LVJZ8GBB.0 size=1048576 2024-09-12T17:18:44.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.798+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~KXH4LVJZ8GBB.1 size=282396 2024-09-12T17:18:44.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.802+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=KXH4LVJZ8GBB tag=G1OQLBKBOVVL type=write size=2379548 2024-09-12T17:18:44.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.802+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=E2BTMUK90070 type=del size=1443919 2024-09-12T17:18:44.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.806+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=NAMYFYM47ELT type=del 2024-09-12T17:18:44.808 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.806+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=PHHU9F1BKFQ4 type=del size=3001543 2024-09-12T17:18:44.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.810+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~AQK4BQ0LTCTV.0 size=1048576 2024-09-12T17:18:44.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.814+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~AQK4BQ0LTCTV.1 size=1015009 2024-09-12T17:18:44.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.814+0000 7f96641d38c0 1 < completed multipart upload key=47QQRTJKM4DB upload=AQK4BQ0LTCTV tag=WCP6JMT1JZJ0 type=write size=3112161 2024-09-12T17:18:44.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.818+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~R75XH2GHSLBJ.0 size=464384 2024-09-12T17:18:44.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.818+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=R75XH2GHSLBJ tag=V0KKQKM7O68U type=write size=1512960 2024-09-12T17:18:44.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.822+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~0135QGCP9CCT.0 size=1048576 2024-09-12T17:18:44.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.826+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~0135QGCP9CCT.1 size=293697 2024-09-12T17:18:44.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.826+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=0135QGCP9CCT tag=NWVWPC8EF6QV type=write size=2390849 2024-09-12T17:18:44.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.830+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=433I1VGX23XF type=del size=3677279 2024-09-12T17:18:44.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.834+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~U58HIDNCTBL1.0 size=1048576 2024-09-12T17:18:44.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.834+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~U58HIDNCTBL1.1 size=1048576 2024-09-12T17:18:44.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.838+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~U58HIDNCTBL1.2 size=101308 2024-09-12T17:18:44.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.842+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=U58HIDNCTBL1 tag=M709E4MNYCHF type=write size=3247036 2024-09-12T17:18:44.844 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.842+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=ANDP19R6TDLK type=del size=1543540 2024-09-12T17:18:44.847 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.846+0000 7f96641d38c0 1 < canceled operation key=9CBFWXFX7O3N tag=O0VWFN25E87A type=del size=2034891 2024-09-12T17:18:44.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.850+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~PKBKNZMU6BJG.0 size=1048576 2024-09-12T17:18:44.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.854+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~PKBKNZMU6BJG.1 size=843223 2024-09-12T17:18:44.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.854+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=PKBKNZMU6BJG tag=D9EEV8WU5A2K type=write size=2940375 2024-09-12T17:18:44.856 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.854+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~G3E7KT8SH49M.0 size=1048576 2024-09-12T17:18:44.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.858+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~G3E7KT8SH49M.1 size=9220 2024-09-12T17:18:44.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.858+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=G3E7KT8SH49M tag=8NUXSVHRQHJ6 type=write size=2106372 2024-09-12T17:18:44.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.862+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=RI2FSE1H84GK type=del size=4074643 2024-09-12T17:18:44.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.862+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~CK26NGT092ED.0 size=1048576 2024-09-12T17:18:44.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.866+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~CK26NGT092ED.1 size=642176 2024-09-12T17:18:44.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.870+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=CK26NGT092ED tag=L3968XHZFJ06 type=write size=2739328 2024-09-12T17:18:44.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.870+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=DULEGMI77GRQ type=del size=3369523 2024-09-12T17:18:44.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.874+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=1AW1DZL825RK type=del 2024-09-12T17:18:44.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.874+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=BUW0QG0SBSIC type=del size=2989207 2024-09-12T17:18:44.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.878+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~L0GS5ZG47CK5.0 size=1048576 2024-09-12T17:18:44.881 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.878+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~L0GS5ZG47CK5.1 size=1048576 2024-09-12T17:18:44.883 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.882+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~L0GS5ZG47CK5.2 size=387293 2024-09-12T17:18:44.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.886+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=L0GS5ZG47CK5 tag=5MSO7W301KQS type=write size=3533021 2024-09-12T17:18:44.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.886+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=2PD28CPH31U5 type=del size=2543698 2024-09-12T17:18:44.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.890+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=DGSYYI376JRP type=del 2024-09-12T17:18:44.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.894+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~B5XTO1HOO6XL.0 size=1048576 2024-09-12T17:18:44.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.894+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~B5XTO1HOO6XL.1 size=1048576 2024-09-12T17:18:44.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.898+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~B5XTO1HOO6XL.2 size=325521 2024-09-12T17:18:44.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.898+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=B5XTO1HOO6XL tag=1ZCW1UIEK5F0 type=write size=3471249 2024-09-12T17:18:44.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.902+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=8E389UAMJBLO type=del 2024-09-12T17:18:44.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.902+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=PHBTPR28U26B type=del size=302089 2024-09-12T17:18:44.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.906+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~DHACWOCH0QTI.0 size=1048576 2024-09-12T17:18:44.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.906+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~DHACWOCH0QTI.1 size=973750 2024-09-12T17:18:44.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.910+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=DHACWOCH0QTI tag=8S4O3F962LGL type=write size=3070902 2024-09-12T17:18:44.914 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.914+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=3XMDYV4MLHMQ type=del size=4092701 2024-09-12T17:18:44.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.914+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=OB1PIR4J1JYW type=del 2024-09-12T17:18:44.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.918+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~7GFJGF5ONOQL.0 size=1048576 2024-09-12T17:18:44.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.918+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~7GFJGF5ONOQL.1 size=1048576 2024-09-12T17:18:44.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.922+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~7GFJGF5ONOQL.2 size=20519 2024-09-12T17:18:44.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.922+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=7GFJGF5ONOQL tag=9V51NDNG5JS8 type=write size=3166247 2024-09-12T17:18:44.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.922+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=375JH1QW36NX type=del 2024-09-12T17:18:44.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.926+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=G8BLQ3H8B7Z9 type=del size=3304114 2024-09-12T17:18:44.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.930+0000 7f96641d38c0 1 < canceled operation key=6BH7SI911MMP tag=F89OX1RCZDGX type=del size=971798 2024-09-12T17:18:44.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.930+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=CLQXF7XW2NUI type=write size=544860 2024-09-12T17:18:44.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.934+0000 7f96641d38c0 1 < canceled operation key=3H8R2MJGR4SY tag=E2BTMUK90070 type=del size=1443919 2024-09-12T17:18:44.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.938+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=1JMJX07VC6N5 type=del size=1411708 2024-09-12T17:18:44.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.938+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=PHHU9F1BKFQ4 type=del 2024-09-12T17:18:44.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.942+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~PZ6D88RRRN7F.0 size=1048576 2024-09-12T17:18:44.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.946+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~PZ6D88RRRN7F.1 size=1048576 2024-09-12T17:18:44.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.946+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~PZ6D88RRRN7F.2 size=119882 2024-09-12T17:18:44.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.946+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=PZ6D88RRRN7F tag=1YZQM87MKVW7 type=write size=3265610 2024-09-12T17:18:44.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.946+0000 7f96641d38c0 1 < canceled part key=_multipart_EFORFJYOM45R.2~R75XH2GHSLBJ.0 size=464384 2024-09-12T17:18:44.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.950+0000 7f96641d38c0 1 < canceled multipart upload key=EFORFJYOM45R upload=R75XH2GHSLBJ tag=V0KKQKM7O68U type=write size=1512960 2024-09-12T17:18:44.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.954+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=G14USX8WAXTE type=del size=129243 2024-09-12T17:18:44.958 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.958+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=433I1VGX23XF type=del 2024-09-12T17:18:44.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.958+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=RNQF7M2TXDCZ type=write size=383796 2024-09-12T17:18:44.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.962+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=ANDP19R6TDLK type=del 2024-09-12T17:18:44.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.966+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~8HSHSBC9WRX3.0 size=182734 2024-09-12T17:18:44.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.966+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=8HSHSBC9WRX3 tag=63WQ54IJJMLE type=write size=1231310 2024-09-12T17:18:44.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.970+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~PKBKNZMU6BJG.0 size=1048576 2024-09-12T17:18:44.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.970+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~PKBKNZMU6BJG.1 size=843223 2024-09-12T17:18:44.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.974+0000 7f96641d38c0 1 < completed multipart upload key=37YXLWPZGA9J upload=PKBKNZMU6BJG tag=D9EEV8WU5A2K type=write size=2940375 2024-09-12T17:18:44.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.978+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~736JJ02W0LE0.0 size=1048576 2024-09-12T17:18:44.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.982+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~736JJ02W0LE0.1 size=1048576 2024-09-12T17:18:44.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.982+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~736JJ02W0LE0.2 size=762533 2024-09-12T17:18:44.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.982+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=736JJ02W0LE0 tag=MILSY205E626 type=write size=3908261 2024-09-12T17:18:44.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.990+0000 7f96641d38c0 1 < suggested remove operation key=EFORFJYOM45R tag=RI2FSE1H84GK type=del 2024-09-12T17:18:44.993 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.990+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=45V3NKCTVPJG type=del size=1161112 2024-09-12T17:18:44.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.994+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=DULEGMI77GRQ type=del 2024-09-12T17:18:44.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.998+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=9Y661VJOZUWX type=write size=317643 2024-09-12T17:18:45.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:44.998+0000 7f96641d38c0 1 < completed delete operation key=KXJYJ9VX7YVW tag=BUW0QG0SBSIC type=del 2024-09-12T17:18:45.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.002+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=9NAFHII5JSPX type=del size=437900 2024-09-12T17:18:45.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.006+0000 7f96641d38c0 1 < suggested remove operation key=NR82RUK97NQA tag=2PD28CPH31U5 type=del 2024-09-12T17:18:45.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.010+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=3R8VM6J6KSAL type=del size=1397272 2024-09-12T17:18:45.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.010+0000 7f96641d38c0 1 < canceled part key=_multipart_8TU2VZOHL1ZZ.2~B5XTO1HOO6XL.0 size=1048576 2024-09-12T17:18:45.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.014+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~B5XTO1HOO6XL.1 size=1048576 2024-09-12T17:18:45.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.014+0000 7f96641d38c0 1 < canceled part key=_multipart_8TU2VZOHL1ZZ.2~B5XTO1HOO6XL.2 size=325521 2024-09-12T17:18:45.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.018+0000 7f96641d38c0 1 < canceled multipart upload key=8TU2VZOHL1ZZ upload=B5XTO1HOO6XL tag=1ZCW1UIEK5F0 type=write size=3471249 2024-09-12T17:18:45.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.022+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=6B4AEIIOLJFZ type=del size=3676284 2024-09-12T17:18:45.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.022+0000 7f96641d38c0 1 < completed delete operation key=5ZZI4F92J7BO tag=PHBTPR28U26B type=del 2024-09-12T17:18:45.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.026+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~CQPSG4TTXH37.0 size=1048576 2024-09-12T17:18:45.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.030+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~CQPSG4TTXH37.1 size=896070 2024-09-12T17:18:45.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.030+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=CQPSG4TTXH37 tag=DMYFHHN54NAW type=write size=2993222 2024-09-12T17:18:45.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.034+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=3XMDYV4MLHMQ type=del 2024-09-12T17:18:45.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.038+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=4DM1SMSZ31O3 type=del size=1300746 2024-09-12T17:18:45.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.038+0000 7f96641d38c0 1 < canceled part key=_multipart_NR82RUK97NQA.2~7GFJGF5ONOQL.0 size=1048576 2024-09-12T17:18:45.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.042+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~7GFJGF5ONOQL.1 size=1048576 2024-09-12T17:18:45.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.042+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~7GFJGF5ONOQL.2 size=20519 2024-09-12T17:18:45.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.046+0000 7f96641d38c0 1 < canceled multipart upload key=NR82RUK97NQA upload=7GFJGF5ONOQL tag=9V51NDNG5JS8 type=write size=3166247 2024-09-12T17:18:45.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.050+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=LPS25YJBSWTH type=del size=2933294 2024-09-12T17:18:45.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.050+0000 7f96641d38c0 1 < canceled operation key=0X2HHMHJUJNL tag=G8BLQ3H8B7Z9 type=del size=3304114 2024-09-12T17:18:45.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.054+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~0OC5ACUM0V7V.0 size=1048576 2024-09-12T17:18:45.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.058+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~0OC5ACUM0V7V.1 size=1048576 2024-09-12T17:18:45.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.058+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~0OC5ACUM0V7V.2 size=883978 2024-09-12T17:18:45.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.058+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=0OC5ACUM0V7V tag=NU2ZWOFNPF74 type=write size=4029706 2024-09-12T17:18:45.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.062+0000 7f96641d38c0 1 < completed write operation key=KXJYJ9VX7YVW tag=CLQXF7XW2NUI type=write size=544860 2024-09-12T17:18:45.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.062+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=WGZN2UG7N11I type=write size=58572 2024-09-12T17:18:45.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.066+0000 7f96641d38c0 1 < suggested remove operation key=DHODPSZ7Z0D4 tag=1JMJX07VC6N5 type=del 2024-09-12T17:18:45.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.070+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~Q2WZ239E1K9M.0 size=1048576 2024-09-12T17:18:45.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.074+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~Q2WZ239E1K9M.1 size=230948 2024-09-12T17:18:45.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.074+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=Q2WZ239E1K9M tag=8TLWCXEPWUY5 type=write size=2328100 2024-09-12T17:18:45.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.074+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~PZ6D88RRRN7F.0 size=1048576 2024-09-12T17:18:45.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.078+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~PZ6D88RRRN7F.1 size=1048576 2024-09-12T17:18:45.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.082+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~PZ6D88RRRN7F.2 size=119882 2024-09-12T17:18:45.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.082+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=PZ6D88RRRN7F tag=1YZQM87MKVW7 type=write size=3265610 2024-09-12T17:18:45.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.086+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=CO4WO74P4S7T type=del size=3378869 2024-09-12T17:18:45.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.090+0000 7f96641d38c0 1 < canceled operation key=RSVQJS9F1FR7 tag=G14USX8WAXTE type=del size=129243 2024-09-12T17:18:45.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.090+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=CNI2IEZ3300I type=del size=2891895 2024-09-12T17:18:45.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.094+0000 7f96641d38c0 1 < completed write operation key=XTVZIXTEES2O tag=RNQF7M2TXDCZ type=write size=383796 2024-09-12T17:18:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.098+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~0SLNJULHC26X.0 size=11183 2024-09-12T17:18:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.098+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=0SLNJULHC26X tag=NLPC1ISIBRMG type=write size=1059759 2024-09-12T17:18:45.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.098+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~8HSHSBC9WRX3.0 size=182734 2024-09-12T17:18:45.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.102+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=8HSHSBC9WRX3 tag=63WQ54IJJMLE type=write size=1231310 2024-09-12T17:18:45.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.110+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~8M2VHTP0XKWI.0 size=443482 2024-09-12T17:18:45.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.110+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=8M2VHTP0XKWI tag=K91R0647S73G type=write size=1492058 2024-09-12T17:18:45.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.110+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~736JJ02W0LE0.0 size=1048576 2024-09-12T17:18:45.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.114+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~736JJ02W0LE0.1 size=1048576 2024-09-12T17:18:45.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.114+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~736JJ02W0LE0.2 size=762533 2024-09-12T17:18:45.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.118+0000 7f96641d38c0 1 < completed multipart upload key=0X2HHMHJUJNL upload=736JJ02W0LE0 tag=MILSY205E626 type=write size=3908261 2024-09-12T17:18:45.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.122+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=LM3S9CUILI3R type=del size=1327709 2024-09-12T17:18:45.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.122+0000 7f96641d38c0 -1 < failed to complete operation key=DHODPSZ7Z0D4 tag=45V3NKCTVPJG type=del size=1161112: (22) Invalid argument 2024-09-12T17:18:45.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.126+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~L9ST2WEV4S82.0 size=1048576 2024-09-12T17:18:45.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.130+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~L9ST2WEV4S82.1 size=767486 2024-09-12T17:18:45.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.130+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=L9ST2WEV4S82 tag=R513N1ORNU27 type=write size=2864638 2024-09-12T17:18:45.133 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.130+0000 7f96641d38c0 1 < completed write operation key=LK3F25OHR7AO tag=9Y661VJOZUWX type=write size=317643 2024-09-12T17:18:45.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.138+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~IUJRA1KAAX3J.0 size=483108 2024-09-12T17:18:45.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.138+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=IUJRA1KAAX3J tag=X1R6WP35U24S type=write size=1531684 2024-09-12T17:18:45.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.138+0000 7f96641d38c0 -1 < failed to complete operation key=DHODPSZ7Z0D4 tag=9NAFHII5JSPX type=del size=437900: (22) Invalid argument 2024-09-12T17:18:45.144 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.142+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~07BQ05W8EWUJ.0 size=1048576 2024-09-12T17:18:45.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.146+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~07BQ05W8EWUJ.1 size=1048576 2024-09-12T17:18:45.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.146+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~07BQ05W8EWUJ.2 size=1008560 2024-09-12T17:18:45.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.146+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=07BQ05W8EWUJ tag=BPAQK254RZBQ type=write size=4154288 2024-09-12T17:18:45.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.150+0000 7f96641d38c0 1 < suggested update operation key=EFORFJYOM45R tag=3R8VM6J6KSAL type=del size=1397272 2024-09-12T17:18:45.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.154+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~WR9E26HN22FX.0 size=1048576 2024-09-12T17:18:45.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.158+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~WR9E26HN22FX.1 size=1048576 2024-09-12T17:18:45.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.158+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~WR9E26HN22FX.2 size=535577 2024-09-12T17:18:45.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.158+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=WR9E26HN22FX tag=5CYEV1S05FSO type=write size=3681305 2024-09-12T17:18:45.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.162+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=6B4AEIIOLJFZ type=del 2024-09-12T17:18:45.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.166+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~GIBTOBUJNGPC.0 size=160743 2024-09-12T17:18:45.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.166+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=GIBTOBUJNGPC tag=6956TUWAQBLD type=write size=1209319 2024-09-12T17:18:45.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.166+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~CQPSG4TTXH37.0 size=1048576 2024-09-12T17:18:45.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.170+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~CQPSG4TTXH37.1 size=896070 2024-09-12T17:18:45.173 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.170+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=CQPSG4TTXH37 tag=DMYFHHN54NAW type=write size=2993222 2024-09-12T17:18:45.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.174+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~TGIBW2NCMQBT.0 size=818256 2024-09-12T17:18:45.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.174+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=TGIBW2NCMQBT tag=VYBEEEYCD3FL type=write size=1866832 2024-09-12T17:18:45.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.178+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=4DM1SMSZ31O3 type=del 2024-09-12T17:18:45.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.182+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~XVBZEK2CM3ZP.0 size=337299 2024-09-12T17:18:45.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.182+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=XVBZEK2CM3ZP tag=DJS0XITPOLGS type=write size=1385875 2024-09-12T17:18:45.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.186+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=LPS25YJBSWTH type=del 2024-09-12T17:18:45.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.186+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=CU1HEITU37RZ type=del size=1594179 2024-09-12T17:18:45.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.190+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~0OC5ACUM0V7V.0 size=1048576 2024-09-12T17:18:45.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.190+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~0OC5ACUM0V7V.1 size=1048576 2024-09-12T17:18:45.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.194+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~0OC5ACUM0V7V.2 size=883978 2024-09-12T17:18:45.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.198+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=0OC5ACUM0V7V tag=NU2ZWOFNPF74 type=write size=4029706 2024-09-12T17:18:45.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.202+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=BYKKA1QEWHIA type=del size=3073282 2024-09-12T17:18:45.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.202+0000 7f96641d38c0 1 < completed write operation key=ZKDOIH5SH6K0 tag=WGZN2UG7N11I type=write size=58572 2024-09-12T17:18:45.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.206+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=Q7CN8O0Z9WDS type=del size=1666648 2024-09-12T17:18:45.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.210+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~Q2WZ239E1K9M.0 size=1048576 2024-09-12T17:18:45.212 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.210+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~Q2WZ239E1K9M.1 size=230948 2024-09-12T17:18:45.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.214+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=Q2WZ239E1K9M tag=8TLWCXEPWUY5 type=write size=2328100 2024-09-12T17:18:45.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.218+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=S1DVRC77HM57 type=del size=218512 2024-09-12T17:18:45.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.218+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=CO4WO74P4S7T type=del 2024-09-12T17:18:45.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.222+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~Z51T231A1U7I.0 size=1048576 2024-09-12T17:18:45.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.226+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~Z51T231A1U7I.1 size=1028782 2024-09-12T17:18:45.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.226+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=Z51T231A1U7I tag=Y3BOD1OD9L11 type=write size=3125934 2024-09-12T17:18:45.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.226+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=CNI2IEZ3300I type=del 2024-09-12T17:18:45.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.230+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~RABKC1FRJDE6.0 size=761644 2024-09-12T17:18:45.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.230+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=RABKC1FRJDE6 tag=OWVZJ5WD9LRB type=write size=1810220 2024-09-12T17:18:45.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.234+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~0SLNJULHC26X.0 size=11183 2024-09-12T17:18:45.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.238+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=0SLNJULHC26X tag=NLPC1ISIBRMG type=write size=1059759 2024-09-12T17:18:45.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.238+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=OUIBY21QKHZ6 type=del size=1177853 2024-09-12T17:18:45.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.242+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~8M2VHTP0XKWI.0 size=443482 2024-09-12T17:18:45.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.246+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=8M2VHTP0XKWI tag=K91R0647S73G type=write size=1492058 2024-09-12T17:18:45.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.250+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=SYT0KBCC4KN8 type=del size=3970180 2024-09-12T17:18:45.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.254+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=LM3S9CUILI3R type=del 2024-09-12T17:18:45.259 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.258+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~8JY9Q71NWKB9.0 size=246746 2024-09-12T17:18:45.259 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.258+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=8JY9Q71NWKB9 tag=7NCZSVMFG5MQ type=write size=1295322 2024-09-12T17:18:45.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.262+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~L9ST2WEV4S82.0 size=1048576 2024-09-12T17:18:45.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.262+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~L9ST2WEV4S82.1 size=767486 2024-09-12T17:18:45.268 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.266+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=L9ST2WEV4S82 tag=R513N1ORNU27 type=write size=2864638 2024-09-12T17:18:45.270 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.270+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=0N1EDAG7ARGW type=del size=2493799 2024-09-12T17:18:45.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.270+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~IUJRA1KAAX3J.0 size=483108 2024-09-12T17:18:45.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.274+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=IUJRA1KAAX3J tag=X1R6WP35U24S type=write size=1531684 2024-09-12T17:18:45.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.278+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=P34QBVY8TN7S type=del size=2118779 2024-09-12T17:18:45.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.282+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~07BQ05W8EWUJ.0 size=1048576 2024-09-12T17:18:45.284 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.282+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~07BQ05W8EWUJ.1 size=1048576 2024-09-12T17:18:45.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.286+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~07BQ05W8EWUJ.2 size=1008560 2024-09-12T17:18:45.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.290+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=07BQ05W8EWUJ tag=BPAQK254RZBQ type=write size=4154288 2024-09-12T17:18:45.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.294+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~0TFZMWR2E6RF.0 size=725846 2024-09-12T17:18:45.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.294+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=0TFZMWR2E6RF tag=UOI2RGP5ST5P type=write size=1774422 2024-09-12T17:18:45.297 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.294+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~WR9E26HN22FX.0 size=1048576 2024-09-12T17:18:45.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.298+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~WR9E26HN22FX.1 size=1048576 2024-09-12T17:18:45.299 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.298+0000 7f96641d38c0 1 < canceled part key=_multipart_3H8R2MJGR4SY.2~WR9E26HN22FX.2 size=535577 2024-09-12T17:18:45.303 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.302+0000 7f96641d38c0 1 < canceled multipart upload key=3H8R2MJGR4SY upload=WR9E26HN22FX tag=5CYEV1S05FSO type=write size=3681305 2024-09-12T17:18:45.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.306+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~4IWDKLBR19V6.0 size=1048576 2024-09-12T17:18:45.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.310+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~4IWDKLBR19V6.1 size=978497 2024-09-12T17:18:45.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.310+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=4IWDKLBR19V6 tag=YJQZO03VNO3E type=write size=3075649 2024-09-12T17:18:45.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.310+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~GIBTOBUJNGPC.0 size=160743 2024-09-12T17:18:45.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.314+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=GIBTOBUJNGPC tag=6956TUWAQBLD type=write size=1209319 2024-09-12T17:18:45.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.318+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~PYI6X8CE5HZT.0 size=985360 2024-09-12T17:18:45.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.318+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=PYI6X8CE5HZT tag=22KKH5Z3MAEU type=write size=2033936 2024-09-12T17:18:45.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.322+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~TGIBW2NCMQBT.0 size=818256 2024-09-12T17:18:45.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.326+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=TGIBW2NCMQBT tag=VYBEEEYCD3FL type=write size=1866832 2024-09-12T17:18:45.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.326+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=FZ1YPZMF549S type=write size=428034 2024-09-12T17:18:45.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.330+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~XVBZEK2CM3ZP.0 size=337299 2024-09-12T17:18:45.336 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.334+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=XVBZEK2CM3ZP tag=DJS0XITPOLGS type=write size=1385875 2024-09-12T17:18:45.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.338+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~6HFRKRXREKDR.0 size=1048576 2024-09-12T17:18:45.342 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.342+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~6HFRKRXREKDR.1 size=241424 2024-09-12T17:18:45.342 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.342+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=6HFRKRXREKDR tag=7JZ2CL3R1KYJ type=write size=2338576 2024-09-12T17:18:45.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.342+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=CU1HEITU37RZ type=del 2024-09-12T17:18:45.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.346+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=2IQDA7APKTM7 type=del size=3665187 2024-09-12T17:18:45.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.346+0000 7f96641d38c0 1 < canceled operation key=GKJJDBNXC6QH tag=BYKKA1QEWHIA type=del size=3073282 2024-09-12T17:18:45.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.350+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=TIE5NTOWN5IW type=write size=489023 2024-09-12T17:18:45.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.354+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=Q7CN8O0Z9WDS type=del 2024-09-12T17:18:45.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.354+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=QN6FTWOHJGJK type=write size=228007 2024-09-12T17:18:45.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.358+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=S1DVRC77HM57 type=del 2024-09-12T17:18:45.363 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.362+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~M49USWML8CRB.0 size=1048576 2024-09-12T17:18:45.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.362+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~M49USWML8CRB.1 size=1048576 2024-09-12T17:18:45.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.366+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~M49USWML8CRB.2 size=22519 2024-09-12T17:18:45.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.366+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=M49USWML8CRB tag=FQJFHQUQAHE0 type=write size=3168247 2024-09-12T17:18:45.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.370+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~Z51T231A1U7I.0 size=1048576 2024-09-12T17:18:45.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.370+0000 7f96641d38c0 1 < canceled part key=_multipart_XTVZIXTEES2O.2~Z51T231A1U7I.1 size=1028782 2024-09-12T17:18:45.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.374+0000 7f96641d38c0 1 < canceled multipart upload key=XTVZIXTEES2O upload=Z51T231A1U7I tag=Y3BOD1OD9L11 type=write size=3125934 2024-09-12T17:18:45.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.374+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=1KDWY2Q8V3KF type=del size=860867 2024-09-12T17:18:45.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.378+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~RABKC1FRJDE6.0 size=761644 2024-09-12T17:18:45.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.382+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=RABKC1FRJDE6 tag=OWVZJ5WD9LRB type=write size=1810220 2024-09-12T17:18:45.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.382+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=7S7KNV3W0NXZ type=del size=366292 2024-09-12T17:18:45.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.386+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=OUIBY21QKHZ6 type=del 2024-09-12T17:18:45.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.390+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~ISD0VPTWCM4J.0 size=1048576 2024-09-12T17:18:45.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.394+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~ISD0VPTWCM4J.1 size=1048576 2024-09-12T17:18:45.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.394+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~ISD0VPTWCM4J.2 size=674461 2024-09-12T17:18:45.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.394+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=ISD0VPTWCM4J tag=EVCJ29CPG2VB type=write size=3820189 2024-09-12T17:18:45.399 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.398+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=SYT0KBCC4KN8 type=del 2024-09-12T17:18:45.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.402+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~482I1KL707NX.0 size=428379 2024-09-12T17:18:45.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.402+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=482I1KL707NX tag=7G0GCP61FUA9 type=write size=1476955 2024-09-12T17:18:45.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.406+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~8JY9Q71NWKB9.0 size=246746 2024-09-12T17:18:45.410 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.410+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=8JY9Q71NWKB9 tag=7NCZSVMFG5MQ type=write size=1295322 2024-09-12T17:18:45.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.410+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=M6Z9FARBPMWM type=del size=1795434 2024-09-12T17:18:45.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.414+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=0N1EDAG7ARGW type=del 2024-09-12T17:18:45.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.414+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=TGVOWDEDAM01 type=del size=3908395 2024-09-12T17:18:45.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.418+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=P34QBVY8TN7S type=del 2024-09-12T17:18:45.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.422+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~OCUU8V8QEZYI.0 size=962716 2024-09-12T17:18:45.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.422+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=OCUU8V8QEZYI tag=83TFVH1ILFZJ type=write size=2011292 2024-09-12T17:18:45.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.422+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~0TFZMWR2E6RF.0 size=725846 2024-09-12T17:18:45.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.430+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=0TFZMWR2E6RF tag=UOI2RGP5ST5P type=write size=1774422 2024-09-12T17:18:45.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.430+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=UPIOP638MTFX type=del size=679095 2024-09-12T17:18:45.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.434+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~4IWDKLBR19V6.0 size=1048576 2024-09-12T17:18:45.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.438+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~4IWDKLBR19V6.1 size=978497 2024-09-12T17:18:45.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.442+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=4IWDKLBR19V6 tag=YJQZO03VNO3E type=write size=3075649 2024-09-12T17:18:45.446 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.446+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=B8ZBCBN0UCLK type=write size=78026 2024-09-12T17:18:45.447 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.446+0000 7f96641d38c0 1 < canceled part key=_multipart_5ZZI4F92J7BO.2~PYI6X8CE5HZT.0 size=985360 2024-09-12T17:18:45.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.450+0000 7f96641d38c0 1 < canceled multipart upload key=5ZZI4F92J7BO upload=PYI6X8CE5HZT tag=22KKH5Z3MAEU type=write size=2033936 2024-09-12T17:18:45.458 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.458+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~YXRCK8YCRRYY.0 size=1048576 2024-09-12T17:18:45.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.458+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~YXRCK8YCRRYY.1 size=636229 2024-09-12T17:18:45.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.458+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=YXRCK8YCRRYY tag=WFRRCE7U7B1T type=write size=2733381 2024-09-12T17:18:45.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.462+0000 7f96641d38c0 1 < completed write operation key=H3J23KLT1VUT tag=FZ1YPZMF549S type=write size=428034 2024-09-12T17:18:45.470 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.470+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~4M3TN93LKLOK.0 size=1048576 2024-09-12T17:18:45.472 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.470+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~4M3TN93LKLOK.1 size=1048576 2024-09-12T17:18:45.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.474+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~4M3TN93LKLOK.2 size=49506 2024-09-12T17:18:45.475 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.474+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=4M3TN93LKLOK tag=RUKBLXZVXCGS type=write size=3195234 2024-09-12T17:18:45.478 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.478+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~6HFRKRXREKDR.0 size=1048576 2024-09-12T17:18:45.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.478+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~6HFRKRXREKDR.1 size=241424 2024-09-12T17:18:45.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.490+0000 7f96641d38c0 1 < completed multipart upload key=47QQRTJKM4DB upload=6HFRKRXREKDR tag=7JZ2CL3R1KYJ type=write size=2338576 2024-09-12T17:18:45.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.490+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=IPMYEM8ZNANN type=del size=1621690 2024-09-12T17:18:45.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.494+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=2IQDA7APKTM7 type=del 2024-09-12T17:18:45.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.498+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=S98D5DXZD2ZP type=del size=4026268 2024-09-12T17:18:45.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.506+0000 7f96641d38c0 1 < suggested update operation key=GKJJDBNXC6QH tag=TIE5NTOWN5IW type=write size=489023 2024-09-12T17:18:45.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.510+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=JC50R6ZGII3W type=del size=3206635 2024-09-12T17:18:45.516 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.514+0000 7f96641d38c0 1 < suggested remove operation key=ZKDOIH5SH6K0 tag=QN6FTWOHJGJK type=write 2024-09-12T17:18:45.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.518+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=J1FYEXM1K1D4 type=del size=2968910 2024-09-12T17:18:45.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.522+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~M49USWML8CRB.0 size=1048576 2024-09-12T17:18:45.524 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.522+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~M49USWML8CRB.1 size=1048576 2024-09-12T17:18:45.526 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.526+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~M49USWML8CRB.2 size=22519 2024-09-12T17:18:45.531 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.530+0000 7f96641d38c0 1 < completed multipart upload key=2TN3M8NKV9LN upload=M49USWML8CRB tag=FQJFHQUQAHE0 type=write size=3168247 2024-09-12T17:18:45.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.534+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~8V0M2QADT6CZ.0 size=1048576 2024-09-12T17:18:45.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.538+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~8V0M2QADT6CZ.1 size=100040 2024-09-12T17:18:45.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.538+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=8V0M2QADT6CZ tag=JS6X0WURBNOE type=write size=2197192 2024-09-12T17:18:45.544 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.542+0000 7f96641d38c0 1 < suggested update operation key=KXJYJ9VX7YVW tag=1KDWY2Q8V3KF type=del size=860867 2024-09-12T17:18:45.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.550+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~O500QWT1WWNN.0 size=1048576 2024-09-12T17:18:45.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.550+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~O500QWT1WWNN.1 size=1003657 2024-09-12T17:18:45.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.550+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=O500QWT1WWNN tag=R37HPTR8NZNU type=write size=3100809 2024-09-12T17:18:45.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.554+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=7S7KNV3W0NXZ type=del 2024-09-12T17:18:45.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.558+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=V5K64JE38VJQ type=del size=3645707 2024-09-12T17:18:45.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.558+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~ISD0VPTWCM4J.0 size=1048576 2024-09-12T17:18:45.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.562+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~ISD0VPTWCM4J.1 size=1048576 2024-09-12T17:18:45.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.566+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~ISD0VPTWCM4J.2 size=674461 2024-09-12T17:18:45.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.570+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=ISD0VPTWCM4J tag=EVCJ29CPG2VB type=write size=3820189 2024-09-12T17:18:45.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.574+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=TO3T43SVZ571 type=del size=2304833 2024-09-12T17:18:45.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.578+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~482I1KL707NX.0 size=428379 2024-09-12T17:18:45.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.582+0000 7f96641d38c0 1 < completed multipart upload key=47QQRTJKM4DB upload=482I1KL707NX tag=7G0GCP61FUA9 type=write size=1476955 2024-09-12T17:18:45.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.586+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~IG4XFSQXIHX4.0 size=1048576 2024-09-12T17:18:45.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.590+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~IG4XFSQXIHX4.1 size=1048576 2024-09-12T17:18:45.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.590+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~IG4XFSQXIHX4.2 size=651477 2024-09-12T17:18:45.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.590+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=IG4XFSQXIHX4 tag=LK6236FBKN9Y type=write size=3797205 2024-09-12T17:18:45.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.594+0000 7f96641d38c0 1 < canceled operation key=47QQRTJKM4DB tag=M6Z9FARBPMWM type=del size=1795434 2024-09-12T17:18:45.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.598+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=SY7ON0AKPRYX type=del size=1311084 2024-09-12T17:18:45.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.602+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=TGVOWDEDAM01 type=del 2024-09-12T17:18:45.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.602+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=VWXGS01JYBTV type=del size=4129217 2024-09-12T17:18:45.609 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.606+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~OCUU8V8QEZYI.0 size=962716 2024-09-12T17:18:45.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.610+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=OCUU8V8QEZYI tag=83TFVH1ILFZJ type=write size=2011292 2024-09-12T17:18:45.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.618+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~RQP34OV41AHE.0 size=232957 2024-09-12T17:18:45.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.618+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=RQP34OV41AHE tag=JIRS82WUJ2IR type=write size=1281533 2024-09-12T17:18:45.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.622+0000 7f96641d38c0 1 < suggested remove operation key=G7CWVD9C2H2J tag=UPIOP638MTFX type=del 2024-09-12T17:18:45.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.626+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=ITBPQDSIQ4AO type=del size=205935 2024-09-12T17:18:45.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.630+0000 7f96641d38c0 1 < completed write operation key=RSVQJS9F1FR7 tag=B8ZBCBN0UCLK type=write size=78026 2024-09-12T17:18:45.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.630+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=RXCSE2SW3QVY type=del size=4106787 2024-09-12T17:18:45.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.634+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~YXRCK8YCRRYY.0 size=1048576 2024-09-12T17:18:45.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.638+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~YXRCK8YCRRYY.1 size=636229 2024-09-12T17:18:45.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.642+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=YXRCK8YCRRYY tag=WFRRCE7U7B1T type=write size=2733381 2024-09-12T17:18:45.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.646+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~4NK1FR33DIIX.0 size=1048576 2024-09-12T17:18:45.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.650+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~4NK1FR33DIIX.1 size=1048576 2024-09-12T17:18:45.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.650+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~4NK1FR33DIIX.2 size=278254 2024-09-12T17:18:45.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.650+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=4NK1FR33DIIX tag=IFXWT9TLEBZJ type=write size=3423982 2024-09-12T17:18:45.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.654+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~4M3TN93LKLOK.0 size=1048576 2024-09-12T17:18:45.658 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.658+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~4M3TN93LKLOK.1 size=1048576 2024-09-12T17:18:45.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.658+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~4M3TN93LKLOK.2 size=49506 2024-09-12T17:18:45.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.662+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=4M3TN93LKLOK tag=RUKBLXZVXCGS type=write size=3195234 2024-09-12T17:18:45.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.666+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~7LX77MGOPEWI.0 size=537898 2024-09-12T17:18:45.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.666+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=7LX77MGOPEWI tag=NGKV1USZRUN0 type=write size=1586474 2024-09-12T17:18:45.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.670+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=IPMYEM8ZNANN type=del 2024-09-12T17:18:45.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.674+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=0DDSZCHILF0I type=del size=2774339 2024-09-12T17:18:45.676 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.674+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=S98D5DXZD2ZP type=del 2024-09-12T17:18:45.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.678+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=KPXQ2G09302U type=del size=116299 2024-09-12T17:18:45.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.682+0000 7f96641d38c0 1 < suggested update operation key=BDI9YFZCT5YY tag=JC50R6ZGII3W type=del size=3206635 2024-09-12T17:18:45.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.686+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~6XLSNA6EVT4A.0 size=1048576 2024-09-12T17:18:45.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.690+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~6XLSNA6EVT4A.1 size=163864 2024-09-12T17:18:45.691 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.690+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=6XLSNA6EVT4A tag=UAZCRM195TJX type=write size=2261016 2024-09-12T17:18:45.693 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.690+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=J1FYEXM1K1D4 type=del 2024-09-12T17:18:45.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.694+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=9LILV1YF9G67 type=del size=1696568 2024-09-12T17:18:45.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.694+0000 7f96641d38c0 1 < canceled part key=_multipart_W40P2E1H5VT9.2~8V0M2QADT6CZ.0 size=1048576 2024-09-12T17:18:45.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.698+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~8V0M2QADT6CZ.1 size=100040 2024-09-12T17:18:45.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.702+0000 7f96641d38c0 1 < canceled multipart upload key=W40P2E1H5VT9 upload=8V0M2QADT6CZ tag=JS6X0WURBNOE type=write size=2197192 2024-09-12T17:18:45.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.706+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~YP6I7X9V3WDA.0 size=1048576 2024-09-12T17:18:45.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.706+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~YP6I7X9V3WDA.1 size=805715 2024-09-12T17:18:45.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.706+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=YP6I7X9V3WDA tag=FGHJY2KGPELK type=write size=2902867 2024-09-12T17:18:45.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.710+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~O500QWT1WWNN.0 size=1048576 2024-09-12T17:18:45.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.710+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~O500QWT1WWNN.1 size=1003657 2024-09-12T17:18:45.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.714+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=O500QWT1WWNN tag=R37HPTR8NZNU type=write size=3100809 2024-09-12T17:18:45.720 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.718+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=M8DFGUX7O8CZ type=del size=3417537 2024-09-12T17:18:45.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.722+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=V5K64JE38VJQ type=del 2024-09-12T17:18:45.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.722+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=ARQFUEYXZD69 type=del size=3664465 2024-09-12T17:18:45.729 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.726+0000 7f96641d38c0 1 < suggested update operation key=47QQRTJKM4DB tag=TO3T43SVZ571 type=del size=2304833 2024-09-12T17:18:45.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.730+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=AT72RB6HTCOK type=del size=1669891 2024-09-12T17:18:45.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.734+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~IG4XFSQXIHX4.0 size=1048576 2024-09-12T17:18:45.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.734+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~IG4XFSQXIHX4.1 size=1048576 2024-09-12T17:18:45.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.734+0000 7f96641d38c0 1 < canceled part key=_multipart_W40P2E1H5VT9.2~IG4XFSQXIHX4.2 size=651477 2024-09-12T17:18:45.741 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.738+0000 7f96641d38c0 1 < canceled multipart upload key=W40P2E1H5VT9 upload=IG4XFSQXIHX4 tag=LK6236FBKN9Y type=write size=3797205 2024-09-12T17:18:45.744 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.742+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=01HRO0WENSHT type=del size=1871836 2024-09-12T17:18:45.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.746+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=SY7ON0AKPRYX type=del 2024-09-12T17:18:45.753 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.750+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=C2EXDSX9FSSG type=del size=1144154 2024-09-12T17:18:45.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.754+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=VWXGS01JYBTV type=del 2024-09-12T17:18:45.761 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.758+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~6SCQLX2KCYER.0 size=1048576 2024-09-12T17:18:45.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.762+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~6SCQLX2KCYER.1 size=4068 2024-09-12T17:18:45.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.762+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=6SCQLX2KCYER tag=20JOJAXF57P9 type=write size=2101220 2024-09-12T17:18:45.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.766+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~RQP34OV41AHE.0 size=232957 2024-09-12T17:18:45.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.770+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=RQP34OV41AHE tag=JIRS82WUJ2IR type=write size=1281533 2024-09-12T17:18:45.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.774+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~HM4HO4N1K2MK.0 size=239321 2024-09-12T17:18:45.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.774+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=HM4HO4N1K2MK tag=A4DK2ECE94T5 type=write size=1287897 2024-09-12T17:18:45.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.778+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=ITBPQDSIQ4AO type=del 2024-09-12T17:18:45.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.782+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~RXALHPTSXCVG.0 size=147820 2024-09-12T17:18:45.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.782+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=RXALHPTSXCVG tag=AA93EAQNBCTV type=write size=1196396 2024-09-12T17:18:45.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.786+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=RXCSE2SW3QVY type=del 2024-09-12T17:18:45.793 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.790+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~L3IE5DQXLQQ4.0 size=1048576 2024-09-12T17:18:45.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.794+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~L3IE5DQXLQQ4.1 size=1048576 2024-09-12T17:18:45.797 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.794+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~L3IE5DQXLQQ4.2 size=11267 2024-09-12T17:18:45.797 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.794+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=L3IE5DQXLQQ4 tag=65SCWVXDKHRY type=write size=3156995 2024-09-12T17:18:45.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.798+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~4NK1FR33DIIX.0 size=1048576 2024-09-12T17:18:45.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.802+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~4NK1FR33DIIX.1 size=1048576 2024-09-12T17:18:45.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.802+0000 7f96641d38c0 1 < canceled part key=_multipart_L9HUVE5A5NGT.2~4NK1FR33DIIX.2 size=278254 2024-09-12T17:18:45.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.806+0000 7f96641d38c0 1 < canceled multipart upload key=L9HUVE5A5NGT upload=4NK1FR33DIIX tag=IFXWT9TLEBZJ type=write size=3423982 2024-09-12T17:18:45.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.810+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~OYIIKHO8QTIO.0 size=1048576 2024-09-12T17:18:45.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.810+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~OYIIKHO8QTIO.1 size=334253 2024-09-12T17:18:45.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.810+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=OYIIKHO8QTIO tag=2FXXPXY3MN9N type=write size=2431405 2024-09-12T17:18:45.816 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.814+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~7LX77MGOPEWI.0 size=537898 2024-09-12T17:18:45.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.818+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=7LX77MGOPEWI tag=NGKV1USZRUN0 type=write size=1586474 2024-09-12T17:18:45.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.822+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~U1FE6NBQVPLK.0 size=1048576 2024-09-12T17:18:45.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.826+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~U1FE6NBQVPLK.1 size=1048576 2024-09-12T17:18:45.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.826+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~U1FE6NBQVPLK.2 size=807811 2024-09-12T17:18:45.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.826+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=U1FE6NBQVPLK tag=D73FJT4B9HIL type=write size=3953539 2024-09-12T17:18:45.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.834+0000 7f96641d38c0 1 < suggested remove operation key=XTVZIXTEES2O tag=0DDSZCHILF0I type=del 2024-09-12T17:18:45.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.838+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~RU3PX158RLXK.0 size=224948 2024-09-12T17:18:45.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.838+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=RU3PX158RLXK tag=X1KRJQHZP5SW type=write size=1273524 2024-09-12T17:18:45.846 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.846+0000 7f96641d38c0 1 < suggested update operation key=RSVQJS9F1FR7 tag=KPXQ2G09302U type=del size=116299 2024-09-12T17:18:45.848 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.846+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=5EA4Z3ZI09CO type=del size=1644198 2024-09-12T17:18:45.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.850+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~6XLSNA6EVT4A.0 size=1048576 2024-09-12T17:18:45.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.850+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~6XLSNA6EVT4A.1 size=163864 2024-09-12T17:18:45.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.854+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=6XLSNA6EVT4A tag=UAZCRM195TJX type=write size=2261016 2024-09-12T17:18:45.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.858+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~91YLYKN0IJVY.0 size=1048576 2024-09-12T17:18:45.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.862+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~91YLYKN0IJVY.1 size=345041 2024-09-12T17:18:45.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.862+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=91YLYKN0IJVY tag=20T2DL7HC1GF type=write size=2442193 2024-09-12T17:18:45.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.866+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=9LILV1YF9G67 type=del 2024-09-12T17:18:45.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.870+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~NNA56H3BM2IB.0 size=1048576 2024-09-12T17:18:45.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.874+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~NNA56H3BM2IB.1 size=258603 2024-09-12T17:18:45.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.874+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=NNA56H3BM2IB tag=TLQ2XJTZYN9A type=write size=2355755 2024-09-12T17:18:45.876 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.874+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~YP6I7X9V3WDA.0 size=1048576 2024-09-12T17:18:45.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.878+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~YP6I7X9V3WDA.1 size=805715 2024-09-12T17:18:45.882 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.882+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=YP6I7X9V3WDA tag=FGHJY2KGPELK type=write size=2902867 2024-09-12T17:18:45.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.886+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~C9DGSZUQRPRM.0 size=1048576 2024-09-12T17:18:45.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.886+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~C9DGSZUQRPRM.1 size=575592 2024-09-12T17:18:45.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.886+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=C9DGSZUQRPRM tag=9VU1XELRGVAZ type=write size=2672744 2024-09-12T17:18:45.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.890+0000 7f96641d38c0 1 < canceled operation key=UBYUSW4C2V19 tag=M8DFGUX7O8CZ type=del size=3417537 2024-09-12T17:18:45.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.894+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~DB8NAI60PZYH.0 size=875661 2024-09-12T17:18:45.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.894+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=DB8NAI60PZYH tag=BK0GF4JFYDIC type=write size=1924237 2024-09-12T17:18:45.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.898+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=ARQFUEYXZD69 type=del 2024-09-12T17:18:45.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.902+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=MM4GOTR0NWPY type=write size=276473 2024-09-12T17:18:45.905 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.902+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=AT72RB6HTCOK type=del 2024-09-12T17:18:45.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.906+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=C1XAL3DKD230 type=write size=271628 2024-09-12T17:18:45.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.910+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=01HRO0WENSHT type=del 2024-09-12T17:18:45.914 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.914+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=VU6QR5Q10L5K type=del size=922932 2024-09-12T17:18:45.917 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.914+0000 7f96641d38c0 1 < canceled operation key=DHODPSZ7Z0D4 tag=C2EXDSX9FSSG type=del size=1144154 2024-09-12T17:18:45.922 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.922+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~EN95YBM9UUMB.0 size=1048576 2024-09-12T17:18:45.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.922+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~EN95YBM9UUMB.1 size=86678 2024-09-12T17:18:45.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.922+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=EN95YBM9UUMB tag=M3LXIAT80L9W type=write size=2183830 2024-09-12T17:18:45.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.926+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~6SCQLX2KCYER.0 size=1048576 2024-09-12T17:18:45.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.926+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~6SCQLX2KCYER.1 size=4068 2024-09-12T17:18:45.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.934+0000 7f96641d38c0 1 < completed multipart upload key=3SLNHJT3A1K1 upload=6SCQLX2KCYER tag=20JOJAXF57P9 type=write size=2101220 2024-09-12T17:18:45.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.934+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=M9IO3230DO63 type=del size=308738 2024-09-12T17:18:45.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.938+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~HM4HO4N1K2MK.0 size=239321 2024-09-12T17:18:45.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.942+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=HM4HO4N1K2MK tag=A4DK2ECE94T5 type=write size=1287897 2024-09-12T17:18:45.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.946+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=ZL1FWIYUOKG9 type=del size=1333049 2024-09-12T17:18:45.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.950+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~RXALHPTSXCVG.0 size=147820 2024-09-12T17:18:45.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.954+0000 7f96641d38c0 1 < completed multipart upload key=XDL9O7TEMBYF upload=RXALHPTSXCVG tag=AA93EAQNBCTV type=write size=1196396 2024-09-12T17:18:45.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.958+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=NKB8CULSKFUP type=del size=1719976 2024-09-12T17:18:45.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.962+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~L3IE5DQXLQQ4.0 size=1048576 2024-09-12T17:18:45.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.966+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~L3IE5DQXLQQ4.1 size=1048576 2024-09-12T17:18:45.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.966+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~L3IE5DQXLQQ4.2 size=11267 2024-09-12T17:18:45.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.974+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=L3IE5DQXLQQ4 tag=65SCWVXDKHRY type=write size=3156995 2024-09-12T17:18:45.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.978+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~YR9R9ACU049L.0 size=1048576 2024-09-12T17:18:45.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.982+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~YR9R9ACU049L.1 size=1048576 2024-09-12T17:18:45.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.986+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~YR9R9ACU049L.2 size=407038 2024-09-12T17:18:45.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.986+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=YR9R9ACU049L tag=ZL6K8C9CWK5S type=write size=3552766 2024-09-12T17:18:45.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.986+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~OYIIKHO8QTIO.0 size=1048576 2024-09-12T17:18:45.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.990+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~OYIIKHO8QTIO.1 size=334253 2024-09-12T17:18:45.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.994+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=OYIIKHO8QTIO tag=2FXXPXY3MN9N type=write size=2431405 2024-09-12T17:18:45.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:45.998+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=X31LFTS3RE39 type=write size=252080 2024-09-12T17:18:46.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.002+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~U1FE6NBQVPLK.0 size=1048576 2024-09-12T17:18:46.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.006+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~U1FE6NBQVPLK.1 size=1048576 2024-09-12T17:18:46.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.006+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~U1FE6NBQVPLK.2 size=807811 2024-09-12T17:18:46.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.018+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=U1FE6NBQVPLK tag=D73FJT4B9HIL type=write size=3953539 2024-09-12T17:18:46.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.022+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=TQOZT5K68AP6 type=write size=384529 2024-09-12T17:18:46.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.026+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~RU3PX158RLXK.0 size=224948 2024-09-12T17:18:46.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.030+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=RU3PX158RLXK tag=X1KRJQHZP5SW type=write size=1273524 2024-09-12T17:18:46.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.034+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=16S3QEWBBR9N type=del size=159024 2024-09-12T17:18:46.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.038+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=5EA4Z3ZI09CO type=del 2024-09-12T17:18:46.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.042+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~WUHB2S555D9G.0 size=1048576 2024-09-12T17:18:46.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.046+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~WUHB2S555D9G.1 size=217749 2024-09-12T17:18:46.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.046+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=WUHB2S555D9G tag=HTPU4GYR421T type=write size=2314901 2024-09-12T17:18:46.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.050+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~91YLYKN0IJVY.0 size=1048576 2024-09-12T17:18:46.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.050+0000 7f96641d38c0 1 < canceled part key=_multipart_HRU241T0FUEZ.2~91YLYKN0IJVY.1 size=345041 2024-09-12T17:18:46.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.054+0000 7f96641d38c0 1 < canceled multipart upload key=HRU241T0FUEZ upload=91YLYKN0IJVY tag=20T2DL7HC1GF type=write size=2442193 2024-09-12T17:18:46.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.058+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=6ZVJYH36A822 type=del size=519981 2024-09-12T17:18:46.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.062+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~NNA56H3BM2IB.0 size=1048576 2024-09-12T17:18:46.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.066+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~NNA56H3BM2IB.1 size=258603 2024-09-12T17:18:46.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.070+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=NNA56H3BM2IB tag=TLQ2XJTZYN9A type=write size=2355755 2024-09-12T17:18:46.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.074+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=0RHRBY8YJXDA type=del size=3339926 2024-09-12T17:18:46.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.078+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~C9DGSZUQRPRM.0 size=1048576 2024-09-12T17:18:46.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.082+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~C9DGSZUQRPRM.1 size=575592 2024-09-12T17:18:46.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.086+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=C9DGSZUQRPRM tag=9VU1XELRGVAZ type=write size=2672744 2024-09-12T17:18:46.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.090+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=JV1AFTEAYBD5 type=del size=278552 2024-09-12T17:18:46.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.090+0000 7f96641d38c0 1 < canceled part key=_multipart_G7CWVD9C2H2J.2~DB8NAI60PZYH.0 size=875661 2024-09-12T17:18:46.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.094+0000 7f96641d38c0 1 < canceled multipart upload key=G7CWVD9C2H2J upload=DB8NAI60PZYH tag=BK0GF4JFYDIC type=write size=1924237 2024-09-12T17:18:46.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.098+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=MM742KYPZF2N type=del size=3740913 2024-09-12T17:18:46.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.102+0000 7f96641d38c0 1 < completed write operation key=9CBFWXFX7O3N tag=MM4GOTR0NWPY type=write size=276473 2024-09-12T17:18:46.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.106+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=ZGE1FHDFQB0W type=del size=144169 2024-09-12T17:18:46.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.106+0000 7f96641d38c0 1 < completed write operation key=GKJJDBNXC6QH tag=C1XAL3DKD230 type=write size=271628 2024-09-12T17:18:46.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.110+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=423FDNBGCN3H type=del size=254407 2024-09-12T17:18:46.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.114+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=VU6QR5Q10L5K type=del 2024-09-12T17:18:46.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.118+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=EV0D0X4YMUOR type=del size=1726787 2024-09-12T17:18:46.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.122+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~EN95YBM9UUMB.0 size=1048576 2024-09-12T17:18:46.124 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.122+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~EN95YBM9UUMB.1 size=86678 2024-09-12T17:18:46.130 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.130+0000 7f96641d38c0 1 < completed multipart upload key=3SLNHJT3A1K1 upload=EN95YBM9UUMB tag=M3LXIAT80L9W type=write size=2183830 2024-09-12T17:18:46.132 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.130+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=EKJ2JBMYMRJN type=del size=3348296 2024-09-12T17:18:46.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.134+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=M9IO3230DO63 type=del 2024-09-12T17:18:46.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.138+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=XAWJUWOBPHAM type=del size=2749642 2024-09-12T17:18:46.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.138+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=ZL1FWIYUOKG9 type=del 2024-09-12T17:18:46.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.142+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=CLJIOACLIE59 type=del size=3791840 2024-09-12T17:18:46.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.146+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=NKB8CULSKFUP type=del 2024-09-12T17:18:46.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.150+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=OIX0XOEZ0B68 type=del size=4102674 2024-09-12T17:18:46.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.150+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~YR9R9ACU049L.0 size=1048576 2024-09-12T17:18:46.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.154+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~YR9R9ACU049L.1 size=1048576 2024-09-12T17:18:46.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.154+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~YR9R9ACU049L.2 size=407038 2024-09-12T17:18:46.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.158+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=YR9R9ACU049L tag=ZL6K8C9CWK5S type=write size=3552766 2024-09-12T17:18:46.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.166+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~60FQNYA3JZR9.0 size=1048576 2024-09-12T17:18:46.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.166+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~60FQNYA3JZR9.1 size=226141 2024-09-12T17:18:46.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.166+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=60FQNYA3JZR9 tag=F0454TY6AWLE type=write size=2323293 2024-09-12T17:18:46.172 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.170+0000 7f96641d38c0 1 < completed write operation key=3H8R2MJGR4SY tag=X31LFTS3RE39 type=write size=252080 2024-09-12T17:18:46.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.174+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~VPIN36ZL1VZU.0 size=1048576 2024-09-12T17:18:46.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.178+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~VPIN36ZL1VZU.1 size=1048576 2024-09-12T17:18:46.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.182+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~VPIN36ZL1VZU.2 size=949232 2024-09-12T17:18:46.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.182+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=VPIN36ZL1VZU tag=KW0A2DBOCVT9 type=write size=4094960 2024-09-12T17:18:46.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.182+0000 7f96641d38c0 1 < completed write operation key=ZKDOIH5SH6K0 tag=TQOZT5K68AP6 type=write size=384529 2024-09-12T17:18:46.190 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.190+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~9D1H9FHYTYLX.0 size=1048576 2024-09-12T17:18:46.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.190+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~9D1H9FHYTYLX.1 size=53679 2024-09-12T17:18:46.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.190+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=9D1H9FHYTYLX tag=9Y19JFQUNT63 type=write size=2150831 2024-09-12T17:18:46.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.194+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=16S3QEWBBR9N type=del 2024-09-12T17:18:46.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.198+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=D61DGYHNU23V type=del size=1096447 2024-09-12T17:18:46.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.198+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~WUHB2S555D9G.0 size=1048576 2024-09-12T17:18:46.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.202+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~WUHB2S555D9G.1 size=217749 2024-09-12T17:18:46.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.206+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=WUHB2S555D9G tag=HTPU4GYR421T type=write size=2314901 2024-09-12T17:18:46.215 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.214+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~C2133CKV4LAF.0 size=1048576 2024-09-12T17:18:46.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.218+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~C2133CKV4LAF.1 size=495676 2024-09-12T17:18:46.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.218+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=C2133CKV4LAF tag=JD0GFSB8QALW type=write size=2592828 2024-09-12T17:18:46.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.218+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=6ZVJYH36A822 type=del 2024-09-12T17:18:46.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.222+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=FU8TD6RRCUM2 type=del size=2365194 2024-09-12T17:18:46.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.226+0000 7f96641d38c0 1 < canceled operation key=ZKDOIH5SH6K0 tag=0RHRBY8YJXDA type=del size=3339926 2024-09-12T17:18:46.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.230+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=JEWRPV3O6P2L type=del size=2194493 2024-09-12T17:18:46.234 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.234+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=JV1AFTEAYBD5 type=del 2024-09-12T17:18:46.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.234+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=J33J0EOWN92S type=del size=1360917 2024-09-12T17:18:46.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.238+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=MM742KYPZF2N type=del 2024-09-12T17:18:46.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.246+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~WNUE4GJVS6M1.0 size=1048576 2024-09-12T17:18:46.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.246+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~WNUE4GJVS6M1.1 size=1048576 2024-09-12T17:18:46.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.250+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~WNUE4GJVS6M1.2 size=195007 2024-09-12T17:18:46.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.250+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=WNUE4GJVS6M1 tag=JBE6Y314ZO4B type=write size=3340735 2024-09-12T17:18:46.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.254+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=ZGE1FHDFQB0W type=del 2024-09-12T17:18:46.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.258+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=EDK2074LN9Z4 type=del size=3275001 2024-09-12T17:18:46.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.258+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=423FDNBGCN3H type=del 2024-09-12T17:18:46.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.262+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=CPI06TVPGUFT type=del size=561602 2024-09-12T17:18:46.267 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.266+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=EV0D0X4YMUOR type=del 2024-09-12T17:18:46.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.270+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~YP0ZSG56XZ26.0 size=613931 2024-09-12T17:18:46.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.270+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=YP0ZSG56XZ26 tag=O79HVBHSLGZY type=write size=1662507 2024-09-12T17:18:46.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.274+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=EKJ2JBMYMRJN type=del 2024-09-12T17:18:46.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.278+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~2XTRA2F4F5YR.0 size=1048576 2024-09-12T17:18:46.284 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.282+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~2XTRA2F4F5YR.1 size=377812 2024-09-12T17:18:46.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.282+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=2XTRA2F4F5YR tag=T5QLP80J7CI3 type=write size=2474964 2024-09-12T17:18:46.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.286+0000 7f96641d38c0 1 < canceled operation key=L9HUVE5A5NGT tag=XAWJUWOBPHAM type=del size=2749642 2024-09-12T17:18:46.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.290+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=CMG3W4Y8PRLG type=del size=128147 2024-09-12T17:18:46.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.290+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=CLJIOACLIE59 type=del 2024-09-12T17:18:46.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.294+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=V05LLFNDAN73 type=del size=9422 2024-09-12T17:18:46.300 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.298+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=OIX0XOEZ0B68 type=del 2024-09-12T17:18:46.306 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.302+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~CNGZKVEDRGO7.0 size=909967 2024-09-12T17:18:46.306 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.302+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=CNGZKVEDRGO7 tag=IHAZTMZ7SKVT type=write size=1958543 2024-09-12T17:18:46.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.310+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~60FQNYA3JZR9.0 size=1048576 2024-09-12T17:18:46.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.314+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~60FQNYA3JZR9.1 size=226141 2024-09-12T17:18:46.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.318+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=60FQNYA3JZR9 tag=F0454TY6AWLE type=write size=2323293 2024-09-12T17:18:46.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.326+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~QGC0RUYVD7MK.0 size=841809 2024-09-12T17:18:46.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.326+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=QGC0RUYVD7MK tag=0J2WG0KJRITA type=write size=1890385 2024-09-12T17:18:46.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.326+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~VPIN36ZL1VZU.0 size=1048576 2024-09-12T17:18:46.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.330+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~VPIN36ZL1VZU.1 size=1048576 2024-09-12T17:18:46.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.334+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~VPIN36ZL1VZU.2 size=949232 2024-09-12T17:18:46.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.338+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=VPIN36ZL1VZU tag=KW0A2DBOCVT9 type=write size=4094960 2024-09-12T17:18:46.342 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.342+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=CCLH11RZP4T6 type=write size=942314 2024-09-12T17:18:46.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.346+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~9D1H9FHYTYLX.0 size=1048576 2024-09-12T17:18:46.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.346+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~9D1H9FHYTYLX.1 size=53679 2024-09-12T17:18:46.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.354+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=9D1H9FHYTYLX tag=9Y19JFQUNT63 type=write size=2150831 2024-09-12T17:18:46.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.354+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=V79NQJ2ZB5FE type=del size=2857276 2024-09-12T17:18:46.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.358+0000 7f96641d38c0 1 < canceled operation key=NR82RUK97NQA tag=D61DGYHNU23V type=del size=1096447 2024-09-12T17:18:46.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.366+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~3P8OHXLGADWS.0 size=1048576 2024-09-12T17:18:46.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.370+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~3P8OHXLGADWS.1 size=1048576 2024-09-12T17:18:46.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.370+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~3P8OHXLGADWS.2 size=506366 2024-09-12T17:18:46.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.370+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=3P8OHXLGADWS tag=3DASF4RGHRWK type=write size=3652094 2024-09-12T17:18:46.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.374+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~C2133CKV4LAF.0 size=1048576 2024-09-12T17:18:46.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.374+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~C2133CKV4LAF.1 size=495676 2024-09-12T17:18:46.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.382+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=C2133CKV4LAF tag=JD0GFSB8QALW type=write size=2592828 2024-09-12T17:18:46.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.382+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=9LJBUQIYI0A1 type=del size=3192148 2024-09-12T17:18:46.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.386+0000 7f96641d38c0 1 < suggested remove operation key=DHODPSZ7Z0D4 tag=FU8TD6RRCUM2 type=del 2024-09-12T17:18:46.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.390+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=0ZF1C1PI18FY type=del size=61333 2024-09-12T17:18:46.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.394+0000 7f96641d38c0 1 < suggested remove operation key=HRU241T0FUEZ tag=JEWRPV3O6P2L type=del 2024-09-12T17:18:46.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.398+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=TDFBADPOAOV4 type=del size=3678809 2024-09-12T17:18:46.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.398+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=J33J0EOWN92S type=del 2024-09-12T17:18:46.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.402+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=VXHK7CLNJ68P type=del size=1325477 2024-09-12T17:18:46.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.402+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~WNUE4GJVS6M1.0 size=1048576 2024-09-12T17:18:46.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.406+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~WNUE4GJVS6M1.1 size=1048576 2024-09-12T17:18:46.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.406+0000 7f96641d38c0 1 < canceled part key=_multipart_EFORFJYOM45R.2~WNUE4GJVS6M1.2 size=195007 2024-09-12T17:18:46.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.410+0000 7f96641d38c0 1 < canceled multipart upload key=EFORFJYOM45R upload=WNUE4GJVS6M1 tag=JBE6Y314ZO4B type=write size=3340735 2024-09-12T17:18:46.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.414+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=GDSV9RY1ZN1Y type=del size=3676015 2024-09-12T17:18:46.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.414+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=EDK2074LN9Z4 type=del 2024-09-12T17:18:46.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.418+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=GLBSPA2533DS type=del size=198621 2024-09-12T17:18:46.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.418+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=CPI06TVPGUFT type=del 2024-09-12T17:18:46.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.422+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=3GKA11EV94KI type=del size=117086 2024-09-12T17:18:46.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.422+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~YP0ZSG56XZ26.0 size=613931 2024-09-12T17:18:46.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.426+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=YP0ZSG56XZ26 tag=O79HVBHSLGZY type=write size=1662507 2024-09-12T17:18:46.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.430+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=DTYPEHQPHTVH type=del size=2068850 2024-09-12T17:18:46.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.430+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~2XTRA2F4F5YR.0 size=1048576 2024-09-12T17:18:46.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.434+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~2XTRA2F4F5YR.1 size=377812 2024-09-12T17:18:46.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.438+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=2XTRA2F4F5YR tag=T5QLP80J7CI3 type=write size=2474964 2024-09-12T17:18:46.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.438+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=5ZHUHNKV42VN type=write size=1042665 2024-09-12T17:18:46.442 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.442+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=CMG3W4Y8PRLG type=del 2024-09-12T17:18:46.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.442+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=7VU8FJHWY9DB type=del size=1838523 2024-09-12T17:18:46.447 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.446+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=V05LLFNDAN73 type=del 2024-09-12T17:18:46.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.450+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~FMJ25NEU6R5Y.0 size=257638 2024-09-12T17:18:46.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.450+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=FMJ25NEU6R5Y tag=LM978K1S6IOV type=write size=1306214 2024-09-12T17:18:46.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.454+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~CNGZKVEDRGO7.0 size=909967 2024-09-12T17:18:46.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.458+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=CNGZKVEDRGO7 tag=IHAZTMZ7SKVT type=write size=1958543 2024-09-12T17:18:46.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.458+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=P7WYTB24K9PA type=del size=2660482 2024-09-12T17:18:46.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.462+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~QGC0RUYVD7MK.0 size=841809 2024-09-12T17:18:46.466 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.466+0000 7f96641d38c0 1 < completed multipart upload key=3SLNHJT3A1K1 upload=QGC0RUYVD7MK tag=0J2WG0KJRITA type=write size=1890385 2024-09-12T17:18:46.469 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.466+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=KI1L15RC6ID9 type=del size=2535772 2024-09-12T17:18:46.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.474+0000 7f96641d38c0 1 < suggested remove operation key=LK3F25OHR7AO tag=CCLH11RZP4T6 type=write 2024-09-12T17:18:46.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.474+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=IFS796YK07GM type=del size=2690062 2024-09-12T17:18:46.481 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.478+0000 7f96641d38c0 1 < suggested remove operation key=2TN3M8NKV9LN tag=V79NQJ2ZB5FE type=del 2024-09-12T17:18:46.484 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.482+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=7DKA09GXQ0QG type=del size=1691551 2024-09-12T17:18:46.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.486+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~3P8OHXLGADWS.0 size=1048576 2024-09-12T17:18:46.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.486+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~3P8OHXLGADWS.1 size=1048576 2024-09-12T17:18:46.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.490+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~3P8OHXLGADWS.2 size=506366 2024-09-12T17:18:46.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.494+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=3P8OHXLGADWS tag=3DASF4RGHRWK type=write size=3652094 2024-09-12T17:18:46.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.494+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=7GALGVLMPO5J type=del size=3312162 2024-09-12T17:18:46.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.498+0000 7f96641d38c0 1 < suggested remove operation key=H3LV5G117KOW tag=9LJBUQIYI0A1 type=del 2024-09-12T17:18:46.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.502+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=DNVOFX7IQNEP type=del size=1522489 2024-09-12T17:18:46.506 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.506+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=0ZF1C1PI18FY type=del 2024-09-12T17:18:46.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.506+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=V12HC86XBDIJ type=del size=1098749 2024-09-12T17:18:46.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.514+0000 7f96641d38c0 1 < suggested update operation key=IR9JQ4MAEH0P tag=TDFBADPOAOV4 type=del size=3678809 2024-09-12T17:18:46.516 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.514+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=VXLUWFIO37Z1 type=del size=2733769 2024-09-12T17:18:46.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.518+0000 7f96641d38c0 1 < canceled operation key=DHODPSZ7Z0D4 tag=VXHK7CLNJ68P type=del size=1325477 2024-09-12T17:18:46.521 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.518+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=XAHPXPYQ8HIT type=del size=2457670 2024-09-12T17:18:46.524 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.522+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=GDSV9RY1ZN1Y type=del 2024-09-12T17:18:46.528 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.526+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~KBGCYTPAZPYL.0 size=291835 2024-09-12T17:18:46.528 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.526+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=KBGCYTPAZPYL tag=H0VOEM24HLE4 type=write size=1340411 2024-09-12T17:18:46.531 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.530+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=GLBSPA2533DS type=del 2024-09-12T17:18:46.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.534+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~EAFYDKINUQQT.0 size=1048576 2024-09-12T17:18:46.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.534+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~EAFYDKINUQQT.1 size=1048576 2024-09-12T17:18:46.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.538+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~EAFYDKINUQQT.2 size=782195 2024-09-12T17:18:46.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.538+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=EAFYDKINUQQT tag=08WC69FIAM1Z type=write size=3927923 2024-09-12T17:18:46.541 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.542+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=3GKA11EV94KI type=del 2024-09-12T17:18:46.544 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.542+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=311TZTGQK28Z type=del size=1266849 2024-09-12T17:18:46.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.546+0000 7f96641d38c0 -1 < failed to complete operation key=LK3F25OHR7AO tag=DTYPEHQPHTVH type=del size=2068850: (22) Invalid argument 2024-09-12T17:18:46.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.546+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=3KRPSPKESPMV type=del size=1243891 2024-09-12T17:18:46.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.554+0000 7f96641d38c0 1 < completed write operation key=6BH7SI911MMP tag=5ZHUHNKV42VN type=write size=1042665 2024-09-12T17:18:46.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.558+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~SF6D3F6INLJ1.0 size=222001 2024-09-12T17:18:46.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.558+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=SF6D3F6INLJ1 tag=KSBAV252PLY9 type=write size=1270577 2024-09-12T17:18:46.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.558+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=7VU8FJHWY9DB type=del 2024-09-12T17:18:46.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.562+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=AX1G9D8TXCN2 type=write size=758081 2024-09-12T17:18:46.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.566+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~FMJ25NEU6R5Y.0 size=257638 2024-09-12T17:18:46.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.566+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=FMJ25NEU6R5Y tag=LM978K1S6IOV type=write size=1306214 2024-09-12T17:18:46.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.574+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~U03LUWKP5EH8.0 size=1048576 2024-09-12T17:18:46.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.574+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~U03LUWKP5EH8.1 size=543336 2024-09-12T17:18:46.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.574+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=U03LUWKP5EH8 tag=6KQZOISL1ZHL type=write size=2640488 2024-09-12T17:18:46.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.578+0000 7f96641d38c0 1 < canceled operation key=8TU2VZOHL1ZZ tag=P7WYTB24K9PA type=del size=2660482 2024-09-12T17:18:46.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.578+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=UZXUU42OPD5R type=del size=1307156 2024-09-12T17:18:46.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.582+0000 7f96641d38c0 -1 < failed to complete operation key=2TN3M8NKV9LN tag=KI1L15RC6ID9 type=del size=2535772: (22) Invalid argument 2024-09-12T17:18:46.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.582+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=QUA5V9W8ERYT type=del size=1464133 2024-09-12T17:18:46.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.586+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=IFS796YK07GM type=del 2024-09-12T17:18:46.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.590+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~KXO8VHDPD2SO.0 size=1048576 2024-09-12T17:18:46.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.594+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~KXO8VHDPD2SO.1 size=795174 2024-09-12T17:18:46.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.594+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=KXO8VHDPD2SO tag=RDW2FA4C3VGU type=write size=2892326 2024-09-12T17:18:46.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.598+0000 7f96641d38c0 1 < suggested remove operation key=LK3F25OHR7AO tag=7DKA09GXQ0QG type=del 2024-09-12T17:18:46.601 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.598+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=1ZEF06SWECTI type=write size=1027862 2024-09-12T17:18:46.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.602+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=7GALGVLMPO5J type=del 2024-09-12T17:18:46.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.606+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~UQCPX7VI6W8E.0 size=1048576 2024-09-12T17:18:46.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.610+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~UQCPX7VI6W8E.1 size=1048576 2024-09-12T17:18:46.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.610+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~UQCPX7VI6W8E.2 size=1040002 2024-09-12T17:18:46.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.610+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=UQCPX7VI6W8E tag=7EMULZG7XJJK type=write size=4185730 2024-09-12T17:18:46.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.614+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=DNVOFX7IQNEP type=del 2024-09-12T17:18:46.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.614+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=2AXRDXWLXNSB type=del size=3014005 2024-09-12T17:18:46.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.618+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=V12HC86XBDIJ type=del 2024-09-12T17:18:46.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.622+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~0N5G8422F2MW.0 size=649056 2024-09-12T17:18:46.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.622+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=0N5G8422F2MW tag=19RPHUVP7L07 type=write size=1697632 2024-09-12T17:18:46.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.626+0000 7f96641d38c0 1 < suggested remove operation key=ZKDOIH5SH6K0 tag=VXLUWFIO37Z1 type=del 2024-09-12T17:18:46.631 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.630+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=0IL0ZWBZV0ZF type=del size=668303 2024-09-12T17:18:46.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.630+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=XAHPXPYQ8HIT type=del 2024-09-12T17:18:46.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.634+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=5VEFTKWLR5WM type=del size=1739345 2024-09-12T17:18:46.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.638+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~KBGCYTPAZPYL.0 size=291835 2024-09-12T17:18:46.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.642+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=KBGCYTPAZPYL tag=H0VOEM24HLE4 type=write size=1340411 2024-09-12T17:18:46.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.646+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~6QRITWEAQ2WJ.0 size=884601 2024-09-12T17:18:46.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.646+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=6QRITWEAQ2WJ tag=DS2KKEV824EK type=write size=1933177 2024-09-12T17:18:46.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.646+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~EAFYDKINUQQT.0 size=1048576 2024-09-12T17:18:46.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.650+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~EAFYDKINUQQT.1 size=1048576 2024-09-12T17:18:46.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.650+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~EAFYDKINUQQT.2 size=782195 2024-09-12T17:18:46.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.654+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=EAFYDKINUQQT tag=08WC69FIAM1Z type=write size=3927923 2024-09-12T17:18:46.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.658+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~92IKU2RC8NTS.0 size=1048576 2024-09-12T17:18:46.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.662+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~92IKU2RC8NTS.1 size=942844 2024-09-12T17:18:46.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.662+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=92IKU2RC8NTS tag=DF1KN2HYZ2GI type=write size=3039996 2024-09-12T17:18:46.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.662+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=311TZTGQK28Z type=del 2024-09-12T17:18:46.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.670+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~IW3NQA1HR2B5.0 size=1048576 2024-09-12T17:18:46.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.670+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~IW3NQA1HR2B5.1 size=59782 2024-09-12T17:18:46.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.670+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=IW3NQA1HR2B5 tag=5OVB7AJFQPCS type=write size=2156934 2024-09-12T17:18:46.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.674+0000 7f96641d38c0 1 < suggested update operation key=H3LV5G117KOW tag=3KRPSPKESPMV type=del size=1243891 2024-09-12T17:18:46.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.682+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~0TRETN0C7A2U.0 size=457758 2024-09-12T17:18:46.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.682+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=0TRETN0C7A2U tag=TH1NE4VIMQL6 type=write size=1506334 2024-09-12T17:18:46.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.682+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~SF6D3F6INLJ1.0 size=222001 2024-09-12T17:18:46.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.690+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=SF6D3F6INLJ1 tag=KSBAV252PLY9 type=write size=1270577 2024-09-12T17:18:46.692 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.690+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=TMX1CFME9MLZ type=del size=3095623 2024-09-12T17:18:46.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.698+0000 7f96641d38c0 1 < suggested remove operation key=H3J23KLT1VUT tag=AX1G9D8TXCN2 type=write 2024-09-12T17:18:46.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.698+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=K7KXH0XXIV1Z type=del size=2224449 2024-09-12T17:18:46.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.702+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~U03LUWKP5EH8.0 size=1048576 2024-09-12T17:18:46.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.702+0000 7f96641d38c0 1 < canceled part key=_multipart_XDL9O7TEMBYF.2~U03LUWKP5EH8.1 size=543336 2024-09-12T17:18:46.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.706+0000 7f96641d38c0 1 < canceled multipart upload key=XDL9O7TEMBYF upload=U03LUWKP5EH8 tag=6KQZOISL1ZHL type=write size=2640488 2024-09-12T17:18:46.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.714+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~D1N5S2YBKSSV.0 size=1048576 2024-09-12T17:18:46.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.714+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~D1N5S2YBKSSV.1 size=1048576 2024-09-12T17:18:46.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.718+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~D1N5S2YBKSSV.2 size=532195 2024-09-12T17:18:46.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.718+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=D1N5S2YBKSSV tag=893KAE6IQTKR type=write size=3677923 2024-09-12T17:18:46.720 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.718+0000 7f96641d38c0 1 < canceled operation key=0X2HHMHJUJNL tag=UZXUU42OPD5R type=del size=1307156 2024-09-12T17:18:46.723 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.722+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=TSFDIWX142RS type=write size=545363 2024-09-12T17:18:46.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.722+0000 7f96641d38c0 -1 < failed to complete operation key=ZKDOIH5SH6K0 tag=QUA5V9W8ERYT type=del size=1464133: (22) Invalid argument 2024-09-12T17:18:46.728 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.726+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=K5UZRQH9FWV7 type=del size=689724 2024-09-12T17:18:46.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.730+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~KXO8VHDPD2SO.0 size=1048576 2024-09-12T17:18:46.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.730+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~KXO8VHDPD2SO.1 size=795174 2024-09-12T17:18:46.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.734+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=KXO8VHDPD2SO tag=RDW2FA4C3VGU type=write size=2892326 2024-09-12T17:18:46.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.738+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=0ORTQBM5P789 type=del size=78257 2024-09-12T17:18:46.741 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.738+0000 7f96641d38c0 1 < completed write operation key=W40P2E1H5VT9 tag=1ZEF06SWECTI type=write size=1027862 2024-09-12T17:18:46.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.742+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=7R1MCP7GYH6A type=del size=57899 2024-09-12T17:18:46.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.746+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~UQCPX7VI6W8E.0 size=1048576 2024-09-12T17:18:46.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.746+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~UQCPX7VI6W8E.1 size=1048576 2024-09-12T17:18:46.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.750+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~UQCPX7VI6W8E.2 size=1040002 2024-09-12T17:18:46.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.754+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=UQCPX7VI6W8E tag=7EMULZG7XJJK type=write size=4185730 2024-09-12T17:18:46.760 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.758+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~ZQ71DN9U0K2O.0 size=200037 2024-09-12T17:18:46.760 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.758+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=ZQ71DN9U0K2O tag=E8ZDRDJI8UD7 type=write size=1248613 2024-09-12T17:18:46.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.762+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=2AXRDXWLXNSB type=del 2024-09-12T17:18:46.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.766+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=I139DBSXO2KB type=del size=2825670 2024-09-12T17:18:46.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.770+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~0N5G8422F2MW.0 size=649056 2024-09-12T17:18:46.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.774+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=0N5G8422F2MW tag=19RPHUVP7L07 type=write size=1697632 2024-09-12T17:18:46.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.778+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=DM3TB32YT5VQ type=write size=488939 2024-09-12T17:18:46.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.778+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=0IL0ZWBZV0ZF type=del 2024-09-12T17:18:46.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.782+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=XW0KZ83JOA9Z type=del size=1934254 2024-09-12T17:18:46.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.786+0000 7f96641d38c0 1 < completed delete operation key=KXJYJ9VX7YVW tag=5VEFTKWLR5WM type=del 2024-09-12T17:18:46.790 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.790+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=8QL3SQVQDQPJ type=del size=2522224 2024-09-12T17:18:46.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.790+0000 7f96641d38c0 1 < canceled part key=_multipart_6BH7SI911MMP.2~6QRITWEAQ2WJ.0 size=884601 2024-09-12T17:18:46.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.798+0000 7f96641d38c0 1 < canceled multipart upload key=6BH7SI911MMP upload=6QRITWEAQ2WJ tag=DS2KKEV824EK type=write size=1933177 2024-09-12T17:18:46.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.802+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~VO2KCFNZP4CH.0 size=1048576 2024-09-12T17:18:46.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.806+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~VO2KCFNZP4CH.1 size=190598 2024-09-12T17:18:46.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.806+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=VO2KCFNZP4CH tag=FE2Z7F8TSJSZ type=write size=2287750 2024-09-12T17:18:46.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.806+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~92IKU2RC8NTS.0 size=1048576 2024-09-12T17:18:46.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.810+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~92IKU2RC8NTS.1 size=942844 2024-09-12T17:18:46.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.814+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=92IKU2RC8NTS tag=DF1KN2HYZ2GI type=write size=3039996 2024-09-12T17:18:46.818 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.818+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=11TXBTR62I46 type=del size=4150648 2024-09-12T17:18:46.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.822+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~IW3NQA1HR2B5.0 size=1048576 2024-09-12T17:18:46.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.822+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~IW3NQA1HR2B5.1 size=59782 2024-09-12T17:18:46.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.826+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=IW3NQA1HR2B5 tag=5OVB7AJFQPCS type=write size=2156934 2024-09-12T17:18:46.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.834+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~0B4OSRAA504A.0 size=1048576 2024-09-12T17:18:46.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.834+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~0B4OSRAA504A.1 size=138340 2024-09-12T17:18:46.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.834+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=0B4OSRAA504A tag=V7ES2FLR401S type=write size=2235492 2024-09-12T17:18:46.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.838+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~0TRETN0C7A2U.0 size=457758 2024-09-12T17:18:46.843 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.842+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=0TRETN0C7A2U tag=TH1NE4VIMQL6 type=write size=1506334 2024-09-12T17:18:46.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.846+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~VK75G4EG3494.0 size=38621 2024-09-12T17:18:46.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.846+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=VK75G4EG3494 tag=A0TF0MUHSS8K type=write size=1087197 2024-09-12T17:18:46.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.850+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=TMX1CFME9MLZ type=del 2024-09-12T17:18:46.856 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.854+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=E3OZJOF2MZEH type=write size=841662 2024-09-12T17:18:46.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.858+0000 7f96641d38c0 1 < canceled operation key=NG327LT02T1F tag=K7KXH0XXIV1Z type=del size=2224449 2024-09-12T17:18:46.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.862+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~VKJ1M4G0IW9F.0 size=39709 2024-09-12T17:18:46.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.862+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=VKJ1M4G0IW9F tag=JV12Y3ACDEUU type=write size=1088285 2024-09-12T17:18:46.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.866+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~D1N5S2YBKSSV.0 size=1048576 2024-09-12T17:18:46.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.866+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~D1N5S2YBKSSV.1 size=1048576 2024-09-12T17:18:46.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.870+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~D1N5S2YBKSSV.2 size=532195 2024-09-12T17:18:46.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.874+0000 7f96641d38c0 1 < completed multipart upload key=XDL9O7TEMBYF upload=D1N5S2YBKSSV tag=893KAE6IQTKR type=write size=3677923 2024-09-12T17:18:46.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.878+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=QD9X9YLRNQ1J type=write size=118293 2024-09-12T17:18:46.881 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.878+0000 7f96641d38c0 1 < canceled operation key=NG327LT02T1F tag=TSFDIWX142RS type=write size=545363 2024-09-12T17:18:46.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.882+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~I1C7JHWFKHFY.0 size=1048576 2024-09-12T17:18:46.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.886+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~I1C7JHWFKHFY.1 size=1048576 2024-09-12T17:18:46.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.890+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~I1C7JHWFKHFY.2 size=709672 2024-09-12T17:18:46.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.890+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=I1C7JHWFKHFY tag=UOL6RNV373T0 type=write size=3855400 2024-09-12T17:18:46.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.890+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=K5UZRQH9FWV7 type=del 2024-09-12T17:18:46.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.894+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~AVU9SEAT8KZI.0 size=290636 2024-09-12T17:18:46.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.894+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=AVU9SEAT8KZI tag=01NKNWHMS2NS type=write size=1339212 2024-09-12T17:18:46.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.898+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=0ORTQBM5P789 type=del 2024-09-12T17:18:46.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.902+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=7KWFL5USJEDP type=del size=1101633 2024-09-12T17:18:46.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.906+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=7R1MCP7GYH6A type=del 2024-09-12T17:18:46.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.906+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=BX4IROCFFK35 type=del size=1688331 2024-09-12T17:18:46.909 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.906+0000 7f96641d38c0 1 < canceled part key=_multipart_IR9JQ4MAEH0P.2~ZQ71DN9U0K2O.0 size=200037 2024-09-12T17:18:46.914 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.914+0000 7f96641d38c0 1 < canceled multipart upload key=IR9JQ4MAEH0P upload=ZQ71DN9U0K2O tag=E8ZDRDJI8UD7 type=write size=1248613 2024-09-12T17:18:46.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.918+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~DL2WJPSG72TK.0 size=1048576 2024-09-12T17:18:46.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.918+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~DL2WJPSG72TK.1 size=845905 2024-09-12T17:18:46.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.918+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=DL2WJPSG72TK tag=JV0BQWV0ANKZ type=write size=2943057 2024-09-12T17:18:46.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.922+0000 7f96641d38c0 1 < canceled operation key=RSVQJS9F1FR7 tag=I139DBSXO2KB type=del size=2825670 2024-09-12T17:18:46.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.926+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=WLXRO3G76F83 type=del size=1014021 2024-09-12T17:18:46.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.926+0000 7f96641d38c0 1 < completed write operation key=9CBFWXFX7O3N tag=DM3TB32YT5VQ type=write size=488939 2024-09-12T17:18:46.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.930+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~3LTSKXIRTYHG.0 size=1048576 2024-09-12T17:18:46.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.934+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~3LTSKXIRTYHG.1 size=1048576 2024-09-12T17:18:46.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.938+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~3LTSKXIRTYHG.2 size=1256 2024-09-12T17:18:46.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.938+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=3LTSKXIRTYHG tag=4O4QTPHSTJ2Z type=write size=3146984 2024-09-12T17:18:46.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.938+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=XW0KZ83JOA9Z type=del 2024-09-12T17:18:46.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.942+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=81LUWXMGQSB3 type=del size=1119233 2024-09-12T17:18:46.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.946+0000 7f96641d38c0 1 < suggested update operation key=EFORFJYOM45R tag=8QL3SQVQDQPJ type=del size=2522224 2024-09-12T17:18:46.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.950+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=RUXZEQBRGXPR type=del size=2636814 2024-09-12T17:18:46.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.950+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~VO2KCFNZP4CH.0 size=1048576 2024-09-12T17:18:46.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.954+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~VO2KCFNZP4CH.1 size=190598 2024-09-12T17:18:46.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.958+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=VO2KCFNZP4CH tag=FE2Z7F8TSJSZ type=write size=2287750 2024-09-12T17:18:46.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.962+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=UWNZFCAHHP9J type=del size=2275908 2024-09-12T17:18:46.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.962+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=11TXBTR62I46 type=del 2024-09-12T17:18:46.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.966+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=N8UFKPZR2UIH type=write size=518830 2024-09-12T17:18:46.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.966+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~0B4OSRAA504A.0 size=1048576 2024-09-12T17:18:46.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.966+0000 7f96641d38c0 1 < canceled part key=_multipart_2TN3M8NKV9LN.2~0B4OSRAA504A.1 size=138340 2024-09-12T17:18:46.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.974+0000 7f96641d38c0 1 < canceled multipart upload key=2TN3M8NKV9LN upload=0B4OSRAA504A tag=V7ES2FLR401S type=write size=2235492 2024-09-12T17:18:46.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.978+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~B1SSS24AZBZ5.0 size=1048576 2024-09-12T17:18:46.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.978+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~B1SSS24AZBZ5.1 size=698532 2024-09-12T17:18:46.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.978+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=B1SSS24AZBZ5 tag=0LYDPSC1EJPH type=write size=2795684 2024-09-12T17:18:46.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.982+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~VK75G4EG3494.0 size=38621 2024-09-12T17:18:46.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.986+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=VK75G4EG3494 tag=A0TF0MUHSS8K type=write size=1087197 2024-09-12T17:18:46.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.986+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=LGGSJCBNR1S2 type=del size=195450 2024-09-12T17:18:46.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.990+0000 7f96641d38c0 1 < completed write operation key=NG327LT02T1F tag=E3OZJOF2MZEH type=write size=841662 2024-09-12T17:18:46.994 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.994+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=UIDTYVMDEPCJ type=del size=3727223 2024-09-12T17:18:46.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.994+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~VKJ1M4G0IW9F.0 size=39709 2024-09-12T17:18:47.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:46.998+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=VKJ1M4G0IW9F tag=JV12Y3ACDEUU type=write size=1088285 2024-09-12T17:18:47.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.002+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=2LN5UIB2SDD2 type=del size=2334255 2024-09-12T17:18:47.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.006+0000 7f96641d38c0 1 < completed write operation key=NGA3P9RZJYWT tag=QD9X9YLRNQ1J type=write size=118293 2024-09-12T17:18:47.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.006+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=ZJJTM8EF3FMK type=del size=2797055 2024-09-12T17:18:47.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.010+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~I1C7JHWFKHFY.0 size=1048576 2024-09-12T17:18:47.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.014+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~I1C7JHWFKHFY.1 size=1048576 2024-09-12T17:18:47.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.014+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~I1C7JHWFKHFY.2 size=709672 2024-09-12T17:18:47.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.018+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=I1C7JHWFKHFY tag=UOL6RNV373T0 type=write size=3855400 2024-09-12T17:18:47.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.022+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=M2ULW4GDBCUX type=del size=1581567 2024-09-12T17:18:47.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.026+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~AVU9SEAT8KZI.0 size=290636 2024-09-12T17:18:47.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.030+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=AVU9SEAT8KZI tag=01NKNWHMS2NS type=write size=1339212 2024-09-12T17:18:47.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.034+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=JCOCHYQE57LM type=del size=2322887 2024-09-12T17:18:47.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.038+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=7KWFL5USJEDP type=del 2024-09-12T17:18:47.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.038+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=H6U1M2MU86AM type=del size=1121695 2024-09-12T17:18:47.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.042+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=BX4IROCFFK35 type=del 2024-09-12T17:18:47.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.054+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~7PGSZ1WH98FU.0 size=1048576 2024-09-12T17:18:47.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.054+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~7PGSZ1WH98FU.1 size=1048576 2024-09-12T17:18:47.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.058+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~7PGSZ1WH98FU.2 size=891145 2024-09-12T17:18:47.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.058+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=7PGSZ1WH98FU tag=PVVA0QF0P7D1 type=write size=4036873 2024-09-12T17:18:47.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.062+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~DL2WJPSG72TK.0 size=1048576 2024-09-12T17:18:47.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.062+0000 7f96641d38c0 1 < canceled part key=_multipart_RSVQJS9F1FR7.2~DL2WJPSG72TK.1 size=845905 2024-09-12T17:18:47.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.066+0000 7f96641d38c0 1 < canceled multipart upload key=RSVQJS9F1FR7 upload=DL2WJPSG72TK tag=JV0BQWV0ANKZ type=write size=2943057 2024-09-12T17:18:47.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.070+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=KW7U40PC940O type=del size=400732 2024-09-12T17:18:47.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.074+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=WLXRO3G76F83 type=del 2024-09-12T17:18:47.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.082+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~H6XTZZINIETI.0 size=379363 2024-09-12T17:18:47.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.082+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=H6XTZZINIETI tag=X8NU45A4P06S type=write size=1427939 2024-09-12T17:18:47.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.082+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~3LTSKXIRTYHG.0 size=1048576 2024-09-12T17:18:47.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.086+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~3LTSKXIRTYHG.1 size=1048576 2024-09-12T17:18:47.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.090+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~3LTSKXIRTYHG.2 size=1256 2024-09-12T17:18:47.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.094+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=3LTSKXIRTYHG tag=4O4QTPHSTJ2Z type=write size=3146984 2024-09-12T17:18:47.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.098+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=JBJ5Z12Y77NB type=write size=703254 2024-09-12T17:18:47.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.102+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=81LUWXMGQSB3 type=del 2024-09-12T17:18:47.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.102+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=AJYMKJ2A3I64 type=del size=2792678 2024-09-12T17:18:47.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.106+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=RUXZEQBRGXPR type=del 2024-09-12T17:18:47.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.110+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=8YE9D0Y1P1HP type=del size=3289487 2024-09-12T17:18:47.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.114+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=UWNZFCAHHP9J type=del 2024-09-12T17:18:47.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.118+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~04N8HZ4G538Q.0 size=1048576 2024-09-12T17:18:47.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.122+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~04N8HZ4G538Q.1 size=1048576 2024-09-12T17:18:47.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.122+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~04N8HZ4G538Q.2 size=353438 2024-09-12T17:18:47.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.122+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=04N8HZ4G538Q tag=51XA7548RPDU type=write size=3499166 2024-09-12T17:18:47.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.130+0000 7f96641d38c0 1 < suggested update operation key=UBYUSW4C2V19 tag=N8UFKPZR2UIH type=write size=518830 2024-09-12T17:18:47.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.130+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=WCPWZAT3EG76 type=del size=1685148 2024-09-12T17:18:47.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.134+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~B1SSS24AZBZ5.0 size=1048576 2024-09-12T17:18:47.139 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.138+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~B1SSS24AZBZ5.1 size=698532 2024-09-12T17:18:47.144 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.142+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=B1SSS24AZBZ5 tag=0LYDPSC1EJPH type=write size=2795684 2024-09-12T17:18:47.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.146+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~FOJS05F70WYB.0 size=1048576 2024-09-12T17:18:47.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.150+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~FOJS05F70WYB.1 size=1002892 2024-09-12T17:18:47.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.150+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=FOJS05F70WYB tag=1T23TV2EIK07 type=write size=3100044 2024-09-12T17:18:47.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.154+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=LGGSJCBNR1S2 type=del 2024-09-12T17:18:47.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.158+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=UTWYBKRHKXF3 type=del size=1763775 2024-09-12T17:18:47.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.162+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=UIDTYVMDEPCJ type=del 2024-09-12T17:18:47.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.162+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=YWJMAM39BGPC type=del size=1195333 2024-09-12T17:18:47.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.166+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=2LN5UIB2SDD2 type=del 2024-09-12T17:18:47.172 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.170+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=20GMALGHKCRT type=del size=2273160 2024-09-12T17:18:47.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.174+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=ZJJTM8EF3FMK type=del 2024-09-12T17:18:47.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.178+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~ZO5HAV6X50KZ.0 size=1039938 2024-09-12T17:18:47.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.178+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=ZO5HAV6X50KZ tag=KPWB6HP3HWM8 type=write size=2088514 2024-09-12T17:18:47.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.182+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=M2ULW4GDBCUX type=del 2024-09-12T17:18:47.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.186+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~GCF0EJ9ZBH6N.0 size=1048576 2024-09-12T17:18:47.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.190+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~GCF0EJ9ZBH6N.1 size=1048576 2024-09-12T17:18:47.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.194+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~GCF0EJ9ZBH6N.2 size=460972 2024-09-12T17:18:47.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.194+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=GCF0EJ9ZBH6N tag=2ZGVO9D206BB type=write size=3606700 2024-09-12T17:18:47.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.198+0000 7f96641d38c0 1 < suggested update operation key=ZKDOIH5SH6K0 tag=JCOCHYQE57LM type=del size=2322887 2024-09-12T17:18:47.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.202+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=61IN305F6N3Q type=del size=3571266 2024-09-12T17:18:47.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.206+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=H6U1M2MU86AM type=del 2024-09-12T17:18:47.212 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.210+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~MSDCSGD50T8P.0 size=1048576 2024-09-12T17:18:47.214 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.214+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~MSDCSGD50T8P.1 size=1048576 2024-09-12T17:18:47.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.214+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~MSDCSGD50T8P.2 size=585170 2024-09-12T17:18:47.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.214+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=MSDCSGD50T8P tag=5OO3K14PLPO8 type=write size=3730898 2024-09-12T17:18:47.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.218+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~7PGSZ1WH98FU.0 size=1048576 2024-09-12T17:18:47.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.222+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~7PGSZ1WH98FU.1 size=1048576 2024-09-12T17:18:47.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.222+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~7PGSZ1WH98FU.2 size=891145 2024-09-12T17:18:47.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.230+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=7PGSZ1WH98FU tag=PVVA0QF0P7D1 type=write size=4036873 2024-09-12T17:18:47.234 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.234+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=V96PFYODN0UG type=del size=3732968 2024-09-12T17:18:47.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.238+0000 7f96641d38c0 1 < suggested update operation key=NR82RUK97NQA tag=KW7U40PC940O type=del size=400732 2024-09-12T17:18:47.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.242+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=6X3I22EUNQET type=del size=2503298 2024-09-12T17:18:47.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.246+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~H6XTZZINIETI.0 size=379363 2024-09-12T17:18:47.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.250+0000 7f96641d38c0 1 < completed multipart upload key=EFORFJYOM45R upload=H6XTZZINIETI tag=X8NU45A4P06S type=write size=1427939 2024-09-12T17:18:47.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.254+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~WHB8YZNVQRG9.0 size=1048576 2024-09-12T17:18:47.259 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.258+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~WHB8YZNVQRG9.1 size=1048576 2024-09-12T17:18:47.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.258+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~WHB8YZNVQRG9.2 size=887901 2024-09-12T17:18:47.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.258+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=WHB8YZNVQRG9 tag=CJCXSAAFYI5B type=write size=4033629 2024-09-12T17:18:47.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.262+0000 7f96641d38c0 1 < completed write operation key=9CBFWXFX7O3N tag=JBJ5Z12Y77NB type=write size=703254 2024-09-12T17:18:47.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.270+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~6II1GRS12RC0.0 size=1048576 2024-09-12T17:18:47.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.270+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~6II1GRS12RC0.1 size=713052 2024-09-12T17:18:47.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.270+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=6II1GRS12RC0 tag=J508FALWT5WC type=write size=2810204 2024-09-12T17:18:47.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.274+0000 7f96641d38c0 -1 < failed to complete operation key=ZKDOIH5SH6K0 tag=AJYMKJ2A3I64 type=del size=2792678: (22) Invalid argument 2024-09-12T17:18:47.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.278+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=V5XPZR1OJ704 type=del size=1145369 2024-09-12T17:18:47.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.282+0000 7f96641d38c0 1 < completed delete operation key=5ZZI4F92J7BO tag=8YE9D0Y1P1HP type=del 2024-09-12T17:18:47.288 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.286+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~ZAY7PHAHNF4Q.0 size=778944 2024-09-12T17:18:47.288 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.286+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=ZAY7PHAHNF4Q tag=7LXLSKGF880W type=write size=1827520 2024-09-12T17:18:47.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.290+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~04N8HZ4G538Q.0 size=1048576 2024-09-12T17:18:47.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.294+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~04N8HZ4G538Q.1 size=1048576 2024-09-12T17:18:47.297 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.294+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~04N8HZ4G538Q.2 size=353438 2024-09-12T17:18:47.302 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.302+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=04N8HZ4G538Q tag=51XA7548RPDU type=write size=3499166 2024-09-12T17:18:47.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.306+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~RCJMQABHV0EK.0 size=1048576 2024-09-12T17:18:47.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.310+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~RCJMQABHV0EK.1 size=1048576 2024-09-12T17:18:47.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.310+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~RCJMQABHV0EK.2 size=414355 2024-09-12T17:18:47.313 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.310+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=RCJMQABHV0EK tag=EH13A3IQTGEP type=write size=3560083 2024-09-12T17:18:47.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.314+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=WCPWZAT3EG76 type=del 2024-09-12T17:18:47.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.318+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~L450ANBCIQ3O.0 size=1048576 2024-09-12T17:18:47.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.322+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~L450ANBCIQ3O.1 size=600338 2024-09-12T17:18:47.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.322+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=L450ANBCIQ3O tag=L4AOPVOS73U8 type=write size=2697490 2024-09-12T17:18:47.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.322+0000 7f96641d38c0 1 < canceled part key=_multipart_3H8R2MJGR4SY.2~FOJS05F70WYB.0 size=1048576 2024-09-12T17:18:47.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.326+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~FOJS05F70WYB.1 size=1002892 2024-09-12T17:18:47.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.330+0000 7f96641d38c0 1 < canceled multipart upload key=3H8R2MJGR4SY upload=FOJS05F70WYB tag=1T23TV2EIK07 type=write size=3100044 2024-09-12T17:18:47.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.342+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~MIB94X6XXIGM.0 size=1048576 2024-09-12T17:18:47.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.346+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~MIB94X6XXIGM.1 size=462408 2024-09-12T17:18:47.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.346+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=MIB94X6XXIGM tag=O703B051MWS2 type=write size=2559560 2024-09-12T17:18:47.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.350+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=UTWYBKRHKXF3 type=del 2024-09-12T17:18:47.353 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.350+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=HIETY0DGQRHD type=del size=1409155 2024-09-12T17:18:47.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.354+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=YWJMAM39BGPC type=del 2024-09-12T17:18:47.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.358+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=BZF95TF5MGN5 type=del size=3870223 2024-09-12T17:18:47.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.362+0000 7f96641d38c0 1 < canceled operation key=GKJJDBNXC6QH tag=20GMALGHKCRT type=del size=2273160 2024-09-12T17:18:47.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.362+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=BYBSHPY082XJ type=del size=3911131 2024-09-12T17:18:47.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.366+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~ZO5HAV6X50KZ.0 size=1039938 2024-09-12T17:18:47.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.374+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=ZO5HAV6X50KZ tag=KPWB6HP3HWM8 type=write size=2088514 2024-09-12T17:18:47.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.378+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~JJBNJXDHLFJK.0 size=1048576 2024-09-12T17:18:47.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.382+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~JJBNJXDHLFJK.1 size=1048576 2024-09-12T17:18:47.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.382+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~JJBNJXDHLFJK.2 size=778784 2024-09-12T17:18:47.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.382+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=JJBNJXDHLFJK tag=96E09S10MCX6 type=write size=3924512 2024-09-12T17:18:47.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.386+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~GCF0EJ9ZBH6N.0 size=1048576 2024-09-12T17:18:47.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.390+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~GCF0EJ9ZBH6N.1 size=1048576 2024-09-12T17:18:47.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.390+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~GCF0EJ9ZBH6N.2 size=460972 2024-09-12T17:18:47.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.394+0000 7f96641d38c0 1 < completed multipart upload key=XDL9O7TEMBYF upload=GCF0EJ9ZBH6N tag=2ZGVO9D206BB type=write size=3606700 2024-09-12T17:18:47.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.402+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~RYXW2E7JZAUC.0 size=1048576 2024-09-12T17:18:47.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.402+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~RYXW2E7JZAUC.1 size=1048576 2024-09-12T17:18:47.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.406+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~RYXW2E7JZAUC.2 size=863262 2024-09-12T17:18:47.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.406+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=RYXW2E7JZAUC tag=CA0J3Q4I91UY type=write size=4008990 2024-09-12T17:18:47.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.406+0000 7f96641d38c0 1 < canceled operation key=6BH7SI911MMP tag=61IN305F6N3Q type=del size=3571266 2024-09-12T17:18:47.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.410+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~YJS4LTBK1Z0X.0 size=1048576 2024-09-12T17:18:47.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.414+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~YJS4LTBK1Z0X.1 size=1048576 2024-09-12T17:18:47.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.414+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~YJS4LTBK1Z0X.2 size=819849 2024-09-12T17:18:47.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.414+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=YJS4LTBK1Z0X tag=QXNLC8179DHX type=write size=3965577 2024-09-12T17:18:47.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.418+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~MSDCSGD50T8P.0 size=1048576 2024-09-12T17:18:47.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.422+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~MSDCSGD50T8P.1 size=1048576 2024-09-12T17:18:47.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.422+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~MSDCSGD50T8P.2 size=585170 2024-09-12T17:18:47.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.426+0000 7f96641d38c0 1 < completed multipart upload key=2TN3M8NKV9LN upload=MSDCSGD50T8P tag=5OO3K14PLPO8 type=write size=3730898 2024-09-12T17:18:47.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.430+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=NCZCEO29WAOM type=del size=2100322 2024-09-12T17:18:47.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.434+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=V96PFYODN0UG type=del 2024-09-12T17:18:47.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.438+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~JW92YCHM2DJR.0 size=1048576 2024-09-12T17:18:47.442 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.442+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~JW92YCHM2DJR.1 size=1048576 2024-09-12T17:18:47.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.442+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~JW92YCHM2DJR.2 size=811042 2024-09-12T17:18:47.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.442+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=JW92YCHM2DJR tag=QVZQISD8LHJ5 type=write size=3956770 2024-09-12T17:18:47.450 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.450+0000 7f96641d38c0 1 < suggested remove operation key=9CBFWXFX7O3N tag=6X3I22EUNQET type=del 2024-09-12T17:18:47.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.450+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=UN83K3NQI88O type=del size=572225 2024-09-12T17:18:47.456 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.454+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~WHB8YZNVQRG9.0 size=1048576 2024-09-12T17:18:47.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.458+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~WHB8YZNVQRG9.1 size=1048576 2024-09-12T17:18:47.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.458+0000 7f96641d38c0 1 < canceled part key=_multipart_9CBFWXFX7O3N.2~WHB8YZNVQRG9.2 size=887901 2024-09-12T17:18:47.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.462+0000 7f96641d38c0 1 < canceled multipart upload key=9CBFWXFX7O3N upload=WHB8YZNVQRG9 tag=CJCXSAAFYI5B type=write size=4033629 2024-09-12T17:18:47.467 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.466+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=LHYUQI97Q09I type=write size=154483 2024-09-12T17:18:47.470 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.466+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~6II1GRS12RC0.0 size=1048576 2024-09-12T17:18:47.472 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.470+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~6II1GRS12RC0.1 size=713052 2024-09-12T17:18:47.477 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.474+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=6II1GRS12RC0 tag=J508FALWT5WC type=write size=2810204 2024-09-12T17:18:47.484 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.482+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~5FUN6DRYQP05.0 size=131736 2024-09-12T17:18:47.484 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.482+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=5FUN6DRYQP05 tag=A4J7OCGMWSIP type=write size=1180312 2024-09-12T17:18:47.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.486+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=V5XPZR1OJ704 type=del 2024-09-12T17:18:47.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.490+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~TIW90I4TUJJP.0 size=1048576 2024-09-12T17:18:47.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.494+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~TIW90I4TUJJP.1 size=1048576 2024-09-12T17:18:47.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.494+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~TIW90I4TUJJP.2 size=303437 2024-09-12T17:18:47.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.494+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=TIW90I4TUJJP tag=9QP993XE9CZG type=write size=3449165 2024-09-12T17:18:47.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.498+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~ZAY7PHAHNF4Q.0 size=778944 2024-09-12T17:18:47.505 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.502+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=ZAY7PHAHNF4Q tag=7LXLSKGF880W type=write size=1827520 2024-09-12T17:18:47.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.506+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=SGO9DEU2XFHW type=del size=2220908 2024-09-12T17:18:47.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.506+0000 7f96641d38c0 1 < canceled part key=_multipart_EFORFJYOM45R.2~RCJMQABHV0EK.0 size=1048576 2024-09-12T17:18:47.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.510+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~RCJMQABHV0EK.1 size=1048576 2024-09-12T17:18:47.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.510+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~RCJMQABHV0EK.2 size=414355 2024-09-12T17:18:47.517 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.514+0000 7f96641d38c0 1 < canceled multipart upload key=EFORFJYOM45R upload=RCJMQABHV0EK tag=EH13A3IQTGEP type=write size=3560083 2024-09-12T17:18:47.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.518+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=HUAG9K8R4KR3 type=write size=753075 2024-09-12T17:18:47.523 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.522+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~L450ANBCIQ3O.0 size=1048576 2024-09-12T17:18:47.525 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.522+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~L450ANBCIQ3O.1 size=600338 2024-09-12T17:18:47.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.530+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=L450ANBCIQ3O tag=L4AOPVOS73U8 type=write size=2697490 2024-09-12T17:18:47.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.534+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~FZ8UC3TZJJ72.0 size=1048576 2024-09-12T17:18:47.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.534+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~FZ8UC3TZJJ72.1 size=163036 2024-09-12T17:18:47.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.534+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=FZ8UC3TZJJ72 tag=1CZ9ZTRFLHRU type=write size=2260188 2024-09-12T17:18:47.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.538+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~MIB94X6XXIGM.0 size=1048576 2024-09-12T17:18:47.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.542+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~MIB94X6XXIGM.1 size=462408 2024-09-12T17:18:47.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.546+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=MIB94X6XXIGM tag=O703B051MWS2 type=write size=2559560 2024-09-12T17:18:47.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.550+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=171ES1G5NEDO type=del size=3957166 2024-09-12T17:18:47.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.554+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=HIETY0DGQRHD type=del 2024-09-12T17:18:47.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.558+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~R3CE932ZY4PL.0 size=1048576 2024-09-12T17:18:47.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.558+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~R3CE932ZY4PL.1 size=1048576 2024-09-12T17:18:47.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.562+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~R3CE932ZY4PL.2 size=606774 2024-09-12T17:18:47.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.562+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=R3CE932ZY4PL tag=YGGQOGV6NEKB type=write size=3752502 2024-09-12T17:18:47.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.566+0000 7f96641d38c0 1 < suggested remove operation key=2TN3M8NKV9LN tag=BZF95TF5MGN5 type=del 2024-09-12T17:18:47.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.570+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=F2FCAGO19H9J type=del size=3232081 2024-09-12T17:18:47.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.570+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=BYBSHPY082XJ type=del 2024-09-12T17:18:47.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.574+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=NAKW288XUOJX type=del size=1976168 2024-09-12T17:18:47.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.574+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~JJBNJXDHLFJK.0 size=1048576 2024-09-12T17:18:47.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.578+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~JJBNJXDHLFJK.1 size=1048576 2024-09-12T17:18:47.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.578+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~JJBNJXDHLFJK.2 size=778784 2024-09-12T17:18:47.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.582+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=JJBNJXDHLFJK tag=96E09S10MCX6 type=write size=3924512 2024-09-12T17:18:47.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.586+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=A4P6CDYS1942 type=del size=2348260 2024-09-12T17:18:47.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.586+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~RYXW2E7JZAUC.0 size=1048576 2024-09-12T17:18:47.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.590+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~RYXW2E7JZAUC.1 size=1048576 2024-09-12T17:18:47.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.590+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~RYXW2E7JZAUC.2 size=863262 2024-09-12T17:18:47.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.598+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=RYXW2E7JZAUC tag=CA0J3Q4I91UY type=write size=4008990 2024-09-12T17:18:47.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.602+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~7E693DA03NDD.0 size=1048576 2024-09-12T17:18:47.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.606+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~7E693DA03NDD.1 size=1048576 2024-09-12T17:18:47.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.606+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~7E693DA03NDD.2 size=179968 2024-09-12T17:18:47.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.606+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=7E693DA03NDD tag=0WO80RDC8ZBP type=write size=3325696 2024-09-12T17:18:47.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.610+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~YJS4LTBK1Z0X.0 size=1048576 2024-09-12T17:18:47.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.610+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~YJS4LTBK1Z0X.1 size=1048576 2024-09-12T17:18:47.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.614+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~YJS4LTBK1Z0X.2 size=819849 2024-09-12T17:18:47.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.618+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=YJS4LTBK1Z0X tag=QXNLC8179DHX type=write size=3965577 2024-09-12T17:18:47.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.618+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=ITW9OK6D9YU3 type=del size=2818414 2024-09-12T17:18:47.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.622+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=NCZCEO29WAOM type=del 2024-09-12T17:18:47.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.622+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=GAVUWAIXLJVE type=write size=468915 2024-09-12T17:18:47.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.626+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~JW92YCHM2DJR.0 size=1048576 2024-09-12T17:18:47.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.626+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~JW92YCHM2DJR.1 size=1048576 2024-09-12T17:18:47.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.630+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~JW92YCHM2DJR.2 size=811042 2024-09-12T17:18:47.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.634+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=JW92YCHM2DJR tag=QVZQISD8LHJ5 type=write size=3956770 2024-09-12T17:18:47.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.634+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=GC07JSBJFPB4 type=del size=3595062 2024-09-12T17:18:47.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.638+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=UN83K3NQI88O type=del 2024-09-12T17:18:47.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.642+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~IH0TU63842XZ.0 size=543566 2024-09-12T17:18:47.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.642+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=IH0TU63842XZ tag=5MSHUC93DWTS type=write size=1592142 2024-09-12T17:18:47.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.642+0000 7f96641d38c0 1 < completed write operation key=NR82RUK97NQA tag=LHYUQI97Q09I type=write size=154483 2024-09-12T17:18:47.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.646+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~ZILTU0HDZSYV.0 size=783769 2024-09-12T17:18:47.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.646+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=ZILTU0HDZSYV tag=47Q27OS4VXGW type=write size=1832345 2024-09-12T17:18:47.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.650+0000 7f96641d38c0 1 < canceled part key=_multipart_37YXLWPZGA9J.2~5FUN6DRYQP05.0 size=131736 2024-09-12T17:18:47.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.650+0000 7f96641d38c0 1 < canceled multipart upload key=37YXLWPZGA9J upload=5FUN6DRYQP05 tag=A4J7OCGMWSIP type=write size=1180312 2024-09-12T17:18:47.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.654+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~5I1D6N1GBWI4.0 size=1048576 2024-09-12T17:18:47.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.658+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~5I1D6N1GBWI4.1 size=1048576 2024-09-12T17:18:47.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.658+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~5I1D6N1GBWI4.2 size=308708 2024-09-12T17:18:47.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.658+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=5I1D6N1GBWI4 tag=FPNP9RQ7STKP type=write size=3454436 2024-09-12T17:18:47.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.662+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~TIW90I4TUJJP.0 size=1048576 2024-09-12T17:18:47.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.662+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~TIW90I4TUJJP.1 size=1048576 2024-09-12T17:18:47.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.666+0000 7f96641d38c0 1 < completed part key=_multipart_XDL9O7TEMBYF.2~TIW90I4TUJJP.2 size=303437 2024-09-12T17:18:47.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.670+0000 7f96641d38c0 1 < completed multipart upload key=XDL9O7TEMBYF upload=TIW90I4TUJJP tag=9QP993XE9CZG type=write size=3449165 2024-09-12T17:18:47.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.670+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=J2ZVCO7A1HAW type=del size=758603 2024-09-12T17:18:47.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.674+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=SGO9DEU2XFHW type=del 2024-09-12T17:18:47.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.674+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~DYBXB752BSXH.0 size=188496 2024-09-12T17:18:47.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.674+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=DYBXB752BSXH tag=NODB8U5S0ERZ type=write size=1237072 2024-09-12T17:18:47.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.678+0000 7f96641d38c0 1 < completed write operation key=NR82RUK97NQA tag=HUAG9K8R4KR3 type=write size=753075 2024-09-12T17:18:47.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.682+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=7ZN4ILQFG06F type=del size=2843784 2024-09-12T17:18:47.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.682+0000 7f96641d38c0 1 < canceled part key=_multipart_EFORFJYOM45R.2~FZ8UC3TZJJ72.0 size=1048576 2024-09-12T17:18:47.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.682+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~FZ8UC3TZJJ72.1 size=163036 2024-09-12T17:18:47.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.686+0000 7f96641d38c0 1 < canceled multipart upload key=EFORFJYOM45R upload=FZ8UC3TZJJ72 tag=1CZ9ZTRFLHRU type=write size=2260188 2024-09-12T17:18:47.692 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.690+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~FNI34IXM2I8N.0 size=967236 2024-09-12T17:18:47.692 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.690+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=FNI34IXM2I8N tag=STM1CSWFW5EX type=write size=2015812 2024-09-12T17:18:47.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.694+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=171ES1G5NEDO type=del 2024-09-12T17:18:47.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.694+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=80S3E78JOO37 type=del size=2920576 2024-09-12T17:18:47.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.698+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~R3CE932ZY4PL.0 size=1048576 2024-09-12T17:18:47.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.698+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~R3CE932ZY4PL.1 size=1048576 2024-09-12T17:18:47.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.702+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~R3CE932ZY4PL.2 size=606774 2024-09-12T17:18:47.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.706+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=R3CE932ZY4PL tag=YGGQOGV6NEKB type=write size=3752502 2024-09-12T17:18:47.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.710+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=50X2IQB7J1LB type=del size=2650403 2024-09-12T17:18:47.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.710+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=F2FCAGO19H9J type=del 2024-09-12T17:18:47.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.714+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=D0H4VCXGJEOE type=write size=988902 2024-09-12T17:18:47.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.714+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=NAKW288XUOJX type=del 2024-09-12T17:18:47.721 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.722+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~T275QQE4DL72.0 size=1048576 2024-09-12T17:18:47.723 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.722+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~T275QQE4DL72.1 size=1048576 2024-09-12T17:18:47.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.722+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~T275QQE4DL72.2 size=621522 2024-09-12T17:18:47.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.722+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=T275QQE4DL72 tag=BU33MX0MK8LK type=write size=3767250 2024-09-12T17:18:47.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.730+0000 7f96641d38c0 1 < suggested remove operation key=HRU241T0FUEZ tag=A4P6CDYS1942 type=del 2024-09-12T17:18:47.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.734+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~XMTNMMF9TSWW.0 size=1048576 2024-09-12T17:18:47.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.734+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~XMTNMMF9TSWW.1 size=775975 2024-09-12T17:18:47.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.734+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=XMTNMMF9TSWW tag=Q2VA0R5Z81MW type=write size=2873127 2024-09-12T17:18:47.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.738+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~7E693DA03NDD.0 size=1048576 2024-09-12T17:18:47.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.738+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~7E693DA03NDD.1 size=1048576 2024-09-12T17:18:47.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.742+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~7E693DA03NDD.2 size=179968 2024-09-12T17:18:47.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.746+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=7E693DA03NDD tag=0WO80RDC8ZBP type=write size=3325696 2024-09-12T17:18:47.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.746+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=C3Q1ZKVFUYJH type=del size=2445088 2024-09-12T17:18:47.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.750+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=ITW9OK6D9YU3 type=del 2024-09-12T17:18:47.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.754+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~O5YNJLTW5D07.0 size=1048576 2024-09-12T17:18:47.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.758+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~O5YNJLTW5D07.1 size=1048576 2024-09-12T17:18:47.760 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.758+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~O5YNJLTW5D07.2 size=436111 2024-09-12T17:18:47.760 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.758+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=O5YNJLTW5D07 tag=AD66WTDLUMN5 type=write size=3581839 2024-09-12T17:18:47.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.762+0000 7f96641d38c0 1 < completed write operation key=H3LV5G117KOW tag=GAVUWAIXLJVE type=write size=468915 2024-09-12T17:18:47.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.762+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=MXNGTF43O25W type=write size=605992 2024-09-12T17:18:47.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.766+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=GC07JSBJFPB4 type=del 2024-09-12T17:18:47.770 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.770+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=NYZCDCZNVB62 type=write size=629574 2024-09-12T17:18:47.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.770+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~IH0TU63842XZ.0 size=543566 2024-09-12T17:18:47.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.774+0000 7f96641d38c0 1 < completed multipart upload key=EFORFJYOM45R upload=IH0TU63842XZ tag=5MSHUC93DWTS type=write size=1592142 2024-09-12T17:18:47.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.778+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=N9UX4N4H6WU5 type=del size=3357169 2024-09-12T17:18:47.782 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.782+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~ZILTU0HDZSYV.0 size=783769 2024-09-12T17:18:47.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.786+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=ZILTU0HDZSYV tag=47Q27OS4VXGW type=write size=1832345 2024-09-12T17:18:47.790 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.790+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~NS9OTN6OKZOG.0 size=118870 2024-09-12T17:18:47.790 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.790+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=NS9OTN6OKZOG tag=LCJZT2WGWXFM type=write size=1167446 2024-09-12T17:18:47.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.790+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~5I1D6N1GBWI4.0 size=1048576 2024-09-12T17:18:47.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.794+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~5I1D6N1GBWI4.1 size=1048576 2024-09-12T17:18:47.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.794+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~5I1D6N1GBWI4.2 size=308708 2024-09-12T17:18:47.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.798+0000 7f96641d38c0 1 < completed multipart upload key=2TN3M8NKV9LN upload=5I1D6N1GBWI4 tag=FPNP9RQ7STKP type=write size=3454436 2024-09-12T17:18:47.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.802+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=JGQQ2PVRDCJY type=del size=2702557 2024-09-12T17:18:47.807 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.806+0000 7f96641d38c0 1 < suggested remove operation key=XTVZIXTEES2O tag=J2ZVCO7A1HAW type=del 2024-09-12T17:18:47.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.810+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=5CQHAUJOZCTE type=del size=1226684 2024-09-12T17:18:47.816 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.814+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~DYBXB752BSXH.0 size=188496 2024-09-12T17:18:47.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.818+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=DYBXB752BSXH tag=NODB8U5S0ERZ type=write size=1237072 2024-09-12T17:18:47.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.826+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~O57Z0LRWWD8C.0 size=1048576 2024-09-12T17:18:47.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.826+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~O57Z0LRWWD8C.1 size=1048576 2024-09-12T17:18:47.830 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.830+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~O57Z0LRWWD8C.2 size=211150 2024-09-12T17:18:47.830 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.830+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=O57Z0LRWWD8C tag=DVMTXWBK11AI type=write size=3356878 2024-09-12T17:18:47.832 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.830+0000 7f96641d38c0 1 < canceled operation key=XDL9O7TEMBYF tag=7ZN4ILQFG06F type=del size=2843784 2024-09-12T17:18:47.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.834+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=GS1R0DQSF7EM type=del size=3460808 2024-09-12T17:18:47.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.838+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~FNI34IXM2I8N.0 size=967236 2024-09-12T17:18:47.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.842+0000 7f96641d38c0 1 < completed multipart upload key=NGA3P9RZJYWT upload=FNI34IXM2I8N tag=STM1CSWFW5EX type=write size=2015812 2024-09-12T17:18:47.846 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.846+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~EVWKDABHW9G3.0 size=1048576 2024-09-12T17:18:47.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.846+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~EVWKDABHW9G3.1 size=1048576 2024-09-12T17:18:47.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.850+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~EVWKDABHW9G3.2 size=1025766 2024-09-12T17:18:47.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.850+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=EVWKDABHW9G3 tag=TG2GVY1Y16YW type=write size=4171494 2024-09-12T17:18:47.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.850+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=80S3E78JOO37 type=del 2024-09-12T17:18:47.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.854+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=ZTX9FFDIDPYZ type=del size=2060536 2024-09-12T17:18:47.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.858+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=50X2IQB7J1LB type=del 2024-09-12T17:18:47.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.862+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=ZE9WL5R023VD type=del size=54153 2024-09-12T17:18:47.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.862+0000 7f96641d38c0 1 < completed write operation key=9CBFWXFX7O3N tag=D0H4VCXGJEOE type=write size=988902 2024-09-12T17:18:47.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.866+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=15CGFEWAYSAV type=write size=910927 2024-09-12T17:18:47.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.866+0000 7f96641d38c0 1 < canceled part key=_multipart_MOQXP4AXMTCK.2~T275QQE4DL72.0 size=1048576 2024-09-12T17:18:47.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.866+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~T275QQE4DL72.1 size=1048576 2024-09-12T17:18:47.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.870+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~T275QQE4DL72.2 size=621522 2024-09-12T17:18:47.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.874+0000 7f96641d38c0 1 < canceled multipart upload key=MOQXP4AXMTCK upload=T275QQE4DL72 tag=BU33MX0MK8LK type=write size=3767250 2024-09-12T17:18:47.880 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.878+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~2N75K37A2N9U.0 size=1048576 2024-09-12T17:18:47.882 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.882+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~2N75K37A2N9U.1 size=683149 2024-09-12T17:18:47.882 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.882+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=2N75K37A2N9U tag=RBPC8A54BG9I type=write size=2780301 2024-09-12T17:18:47.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.882+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~XMTNMMF9TSWW.0 size=1048576 2024-09-12T17:18:47.888 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.886+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~XMTNMMF9TSWW.1 size=775975 2024-09-12T17:18:47.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.890+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=XMTNMMF9TSWW tag=Q2VA0R5Z81MW type=write size=2873127 2024-09-12T17:18:47.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.894+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=BZMXIN2Z4B8Z type=write size=130638 2024-09-12T17:18:47.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.898+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=C3Q1ZKVFUYJH type=del 2024-09-12T17:18:47.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.898+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=FX3MNUC8MGF4 type=del size=2536517 2024-09-12T17:18:47.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.902+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~O5YNJLTW5D07.0 size=1048576 2024-09-12T17:18:47.905 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.906+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~O5YNJLTW5D07.1 size=1048576 2024-09-12T17:18:47.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.906+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~O5YNJLTW5D07.2 size=436111 2024-09-12T17:18:47.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.910+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=O5YNJLTW5D07 tag=AD66WTDLUMN5 type=write size=3581839 2024-09-12T17:18:47.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.914+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~W2UP0O6BEO3T.0 size=1048576 2024-09-12T17:18:47.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.918+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~W2UP0O6BEO3T.1 size=1048576 2024-09-12T17:18:47.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.918+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~W2UP0O6BEO3T.2 size=244743 2024-09-12T17:18:47.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.918+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=W2UP0O6BEO3T tag=3WKTDMSN7N38 type=write size=3390471 2024-09-12T17:18:47.922 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.922+0000 7f96641d38c0 1 < completed write operation key=HRU241T0FUEZ tag=MXNGTF43O25W type=write size=605992 2024-09-12T17:18:47.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.922+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=W1ZRB3KCNQWE type=del size=45878 2024-09-12T17:18:47.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.926+0000 7f96641d38c0 1 < completed write operation key=9CBFWXFX7O3N tag=NYZCDCZNVB62 type=write size=629574 2024-09-12T17:18:47.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.926+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=9WYD6OQ07XIV type=del size=2524198 2024-09-12T17:18:47.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.930+0000 7f96641d38c0 1 < completed delete operation key=5ZZI4F92J7BO tag=N9UX4N4H6WU5 type=del 2024-09-12T17:18:47.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.930+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=29N45YBD3VNQ type=del size=1391905 2024-09-12T17:18:47.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.934+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~NS9OTN6OKZOG.0 size=118870 2024-09-12T17:18:47.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.938+0000 7f96641d38c0 1 < completed multipart upload key=HRU241T0FUEZ upload=NS9OTN6OKZOG tag=LCJZT2WGWXFM type=write size=1167446 2024-09-12T17:18:47.944 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.942+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~YG6C8YKW8MII.0 size=1048576 2024-09-12T17:18:47.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.946+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~YG6C8YKW8MII.1 size=718914 2024-09-12T17:18:47.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.946+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=YG6C8YKW8MII tag=66UTYXKEELDL type=write size=2816066 2024-09-12T17:18:47.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.950+0000 7f96641d38c0 1 < suggested remove operation key=XDL9O7TEMBYF tag=JGQQ2PVRDCJY type=del 2024-09-12T17:18:47.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.954+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=WL2IB9C6CF8Z type=del size=3692506 2024-09-12T17:18:47.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.954+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=5CQHAUJOZCTE type=del 2024-09-12T17:18:47.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.958+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~E3YFDNJQBANH.0 size=572693 2024-09-12T17:18:47.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.958+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=E3YFDNJQBANH tag=3VLOUQ8VL2F1 type=write size=1621269 2024-09-12T17:18:47.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.962+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~O57Z0LRWWD8C.0 size=1048576 2024-09-12T17:18:47.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.966+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~O57Z0LRWWD8C.1 size=1048576 2024-09-12T17:18:47.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.966+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~O57Z0LRWWD8C.2 size=211150 2024-09-12T17:18:47.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.970+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=O57Z0LRWWD8C tag=DVMTXWBK11AI type=write size=3356878 2024-09-12T17:18:47.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.974+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=SO91GNCCDZGO type=del size=1442250 2024-09-12T17:18:47.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.978+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=GS1R0DQSF7EM type=del 2024-09-12T17:18:47.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.982+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~88Q3YZJK3HYN.0 size=1048576 2024-09-12T17:18:47.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.986+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~88Q3YZJK3HYN.1 size=1048576 2024-09-12T17:18:47.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.986+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~88Q3YZJK3HYN.2 size=369968 2024-09-12T17:18:47.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.986+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=88Q3YZJK3HYN tag=S717IQRC6RSC type=write size=3515696 2024-09-12T17:18:47.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.990+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~EVWKDABHW9G3.0 size=1048576 2024-09-12T17:18:47.994 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.994+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~EVWKDABHW9G3.1 size=1048576 2024-09-12T17:18:47.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.994+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~EVWKDABHW9G3.2 size=1025766 2024-09-12T17:18:48.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:47.998+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=EVWKDABHW9G3 tag=TG2GVY1Y16YW type=write size=4171494 2024-09-12T17:18:48.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.002+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=0HU09I6MFVZP type=del size=1494547 2024-09-12T17:18:48.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.006+0000 7f96641d38c0 1 < suggested update operation key=HRU241T0FUEZ tag=ZTX9FFDIDPYZ type=del size=2060536 2024-09-12T17:18:48.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.014+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~2X1H0GODUQAW.0 size=627672 2024-09-12T17:18:48.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.014+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=2X1H0GODUQAW tag=KNVCXSAGU3RV type=write size=1676248 2024-09-12T17:18:48.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.014+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=ZE9WL5R023VD type=del 2024-09-12T17:18:48.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.022+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~JRRC7UPWMC6B.0 size=1048576 2024-09-12T17:18:48.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.022+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~JRRC7UPWMC6B.1 size=1048576 2024-09-12T17:18:48.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.026+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~JRRC7UPWMC6B.2 size=368541 2024-09-12T17:18:48.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.026+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=JRRC7UPWMC6B tag=ZEB4KTG6T9AI type=write size=3514269 2024-09-12T17:18:48.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.030+0000 7f96641d38c0 1 < completed write operation key=DHODPSZ7Z0D4 tag=15CGFEWAYSAV type=write size=910927 2024-09-12T17:18:48.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.034+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~FQ5QTZLN9QV5.0 size=1048576 2024-09-12T17:18:48.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.038+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~FQ5QTZLN9QV5.1 size=1048576 2024-09-12T17:18:48.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.038+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~FQ5QTZLN9QV5.2 size=193473 2024-09-12T17:18:48.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.038+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=FQ5QTZLN9QV5 tag=QV0P0CDST4WL type=write size=3339201 2024-09-12T17:18:48.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.042+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~2N75K37A2N9U.0 size=1048576 2024-09-12T17:18:48.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.046+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~2N75K37A2N9U.1 size=683149 2024-09-12T17:18:48.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.050+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=2N75K37A2N9U tag=RBPC8A54BG9I type=write size=2780301 2024-09-12T17:18:48.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.054+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=RQB8T9OVQE7L type=del size=403990 2024-09-12T17:18:48.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.058+0000 7f96641d38c0 1 < completed write operation key=W40P2E1H5VT9 tag=BZMXIN2Z4B8Z type=write size=130638 2024-09-12T17:18:48.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.062+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=FEDQZM8DOWWV type=del size=4188680 2024-09-12T17:18:48.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.066+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=FX3MNUC8MGF4 type=del 2024-09-12T17:18:48.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.070+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=99WP3XFLCBBA type=del size=3861760 2024-09-12T17:18:48.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.074+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~W2UP0O6BEO3T.0 size=1048576 2024-09-12T17:18:48.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.074+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~W2UP0O6BEO3T.1 size=1048576 2024-09-12T17:18:48.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.078+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~W2UP0O6BEO3T.2 size=244743 2024-09-12T17:18:48.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.082+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=W2UP0O6BEO3T tag=3WKTDMSN7N38 type=write size=3390471 2024-09-12T17:18:48.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.086+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=Q4GMHAP522TJ type=del size=1610723 2024-09-12T17:18:48.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.090+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=W1ZRB3KCNQWE type=del 2024-09-12T17:18:48.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.094+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~OIR1QJV37LGI.0 size=1048576 2024-09-12T17:18:48.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.098+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~OIR1QJV37LGI.1 size=1006587 2024-09-12T17:18:48.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.098+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=OIR1QJV37LGI tag=YPIYVV7ZR8NZ type=write size=3103739 2024-09-12T17:18:48.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.102+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=9WYD6OQ07XIV type=del 2024-09-12T17:18:48.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.102+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=WWG01AF0W0FF type=del size=1755473 2024-09-12T17:18:48.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.106+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=29N45YBD3VNQ type=del 2024-09-12T17:18:48.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.114+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~741XJ8LC49G8.0 size=984468 2024-09-12T17:18:48.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.114+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=741XJ8LC49G8 tag=V70BH23L9VQX type=write size=2033044 2024-09-12T17:18:48.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.114+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~YG6C8YKW8MII.0 size=1048576 2024-09-12T17:18:48.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.118+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~YG6C8YKW8MII.1 size=718914 2024-09-12T17:18:48.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.122+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=YG6C8YKW8MII tag=66UTYXKEELDL type=write size=2816066 2024-09-12T17:18:48.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.126+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=KHR93MPK8789 type=del size=2844703 2024-09-12T17:18:48.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.130+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=WL2IB9C6CF8Z type=del 2024-09-12T17:18:48.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.134+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=9STMXOJ0BK54 type=del size=55965 2024-09-12T17:18:48.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.134+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~E3YFDNJQBANH.0 size=572693 2024-09-12T17:18:48.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.142+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=E3YFDNJQBANH tag=3VLOUQ8VL2F1 type=write size=1621269 2024-09-12T17:18:48.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.142+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=J124AOYFAOXQ type=del size=1285737 2024-09-12T17:18:48.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.146+0000 7f96641d38c0 1 < canceled operation key=RSVQJS9F1FR7 tag=SO91GNCCDZGO type=del size=1442250 2024-09-12T17:18:48.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.150+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=ASI92XG733OY type=write size=90090 2024-09-12T17:18:48.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.154+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~88Q3YZJK3HYN.0 size=1048576 2024-09-12T17:18:48.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.154+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~88Q3YZJK3HYN.1 size=1048576 2024-09-12T17:18:48.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.158+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~88Q3YZJK3HYN.2 size=369968 2024-09-12T17:18:48.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.162+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=88Q3YZJK3HYN tag=S717IQRC6RSC type=write size=3515696 2024-09-12T17:18:48.167 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.166+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=TMMRZDG10H1X type=del size=2357108 2024-09-12T17:18:48.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.170+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=0HU09I6MFVZP type=del 2024-09-12T17:18:48.173 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.170+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=QNP4YGQ27A5Q type=del size=2893358 2024-09-12T17:18:48.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.174+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~2X1H0GODUQAW.0 size=627672 2024-09-12T17:18:48.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.182+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=2X1H0GODUQAW tag=KNVCXSAGU3RV type=write size=1676248 2024-09-12T17:18:48.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.186+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=4RD5KWXL1ZIV type=del size=3163921 2024-09-12T17:18:48.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.186+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~JRRC7UPWMC6B.0 size=1048576 2024-09-12T17:18:48.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.190+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~JRRC7UPWMC6B.1 size=1048576 2024-09-12T17:18:48.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.194+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~JRRC7UPWMC6B.2 size=368541 2024-09-12T17:18:48.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.198+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=JRRC7UPWMC6B tag=ZEB4KTG6T9AI type=write size=3514269 2024-09-12T17:18:48.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.202+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=RDE5GOACHOIY type=del size=780964 2024-09-12T17:18:48.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.206+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~FQ5QTZLN9QV5.0 size=1048576 2024-09-12T17:18:48.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.210+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~FQ5QTZLN9QV5.1 size=1048576 2024-09-12T17:18:48.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.210+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~FQ5QTZLN9QV5.2 size=193473 2024-09-12T17:18:48.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.218+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=FQ5QTZLN9QV5 tag=QV0P0CDST4WL type=write size=3339201 2024-09-12T17:18:48.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.222+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~P4K6OH3Q0ZI4.0 size=693486 2024-09-12T17:18:48.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.222+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=P4K6OH3Q0ZI4 tag=Q51MK1WZW6DI type=write size=1742062 2024-09-12T17:18:48.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.226+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=RQB8T9OVQE7L type=del 2024-09-12T17:18:48.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.230+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=I5YN2M8UOIRR type=del size=1240148 2024-09-12T17:18:48.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.230+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=FEDQZM8DOWWV type=del 2024-09-12T17:18:48.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.238+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~JVILF45Y3IVW.0 size=1048576 2024-09-12T17:18:48.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.242+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~JVILF45Y3IVW.1 size=1048576 2024-09-12T17:18:48.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.242+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~JVILF45Y3IVW.2 size=963440 2024-09-12T17:18:48.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.242+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=JVILF45Y3IVW tag=5ZYC0Q3N70VG type=write size=4109168 2024-09-12T17:18:48.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.246+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=99WP3XFLCBBA type=del 2024-09-12T17:18:48.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.250+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=YFJTJEL0YFII type=del size=712923 2024-09-12T17:18:48.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.254+0000 7f96641d38c0 1 < suggested update operation key=5ZZI4F92J7BO tag=Q4GMHAP522TJ type=del size=1610723 2024-09-12T17:18:48.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.258+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=OUP5K2ERPO5F type=del size=4186983 2024-09-12T17:18:48.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.262+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~OIR1QJV37LGI.0 size=1048576 2024-09-12T17:18:48.267 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.266+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~OIR1QJV37LGI.1 size=1006587 2024-09-12T17:18:48.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.270+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=OIR1QJV37LGI tag=YPIYVV7ZR8NZ type=write size=3103739 2024-09-12T17:18:48.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.274+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~4438F80GG9IG.0 size=1048576 2024-09-12T17:18:48.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.278+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~4438F80GG9IG.1 size=1048576 2024-09-12T17:18:48.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.282+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~4438F80GG9IG.2 size=924547 2024-09-12T17:18:48.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.282+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=4438F80GG9IG tag=HBTADREU68C8 type=write size=4070275 2024-09-12T17:18:48.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.286+0000 7f96641d38c0 1 < suggested update operation key=NGA3P9RZJYWT tag=WWG01AF0W0FF type=del size=1755473 2024-09-12T17:18:48.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.290+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=CS1PDG1TKWWP type=del size=645547 2024-09-12T17:18:48.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.294+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~741XJ8LC49G8.0 size=984468 2024-09-12T17:18:48.301 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.298+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=741XJ8LC49G8 tag=V70BH23L9VQX type=write size=2033044 2024-09-12T17:18:48.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.306+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~HVOM1YQRCPBY.0 size=1048576 2024-09-12T17:18:48.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.306+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~HVOM1YQRCPBY.1 size=596345 2024-09-12T17:18:48.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.306+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=HVOM1YQRCPBY tag=FJJ3RYZNVII0 type=write size=2693497 2024-09-12T17:18:48.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.310+0000 7f96641d38c0 1 < canceled operation key=NR82RUK97NQA tag=KHR93MPK8789 type=del size=2844703 2024-09-12T17:18:48.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.318+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~5V6NXUK15SMR.0 size=1012670 2024-09-12T17:18:48.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.318+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=5V6NXUK15SMR tag=W5W59GXMS7SV type=write size=2061246 2024-09-12T17:18:48.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.322+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=9STMXOJ0BK54 type=del 2024-09-12T17:18:48.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.322+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=TQMQ9SAE533T type=del size=3015401 2024-09-12T17:18:48.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.326+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=J124AOYFAOXQ type=del 2024-09-12T17:18:48.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.334+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~T7E61RKYZZ4F.0 size=1048576 2024-09-12T17:18:48.337 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.334+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~T7E61RKYZZ4F.1 size=906205 2024-09-12T17:18:48.337 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.334+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=T7E61RKYZZ4F tag=A46RT6UA7K8M type=write size=3003357 2024-09-12T17:18:48.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.342+0000 7f96641d38c0 1 < suggested remove operation key=6BH7SI911MMP tag=ASI92XG733OY type=write 2024-09-12T17:18:48.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.346+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=PUAP0TJCEWHT type=del size=301905 2024-09-12T17:18:48.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.346+0000 7f96641d38c0 -1 < failed to complete operation key=NGA3P9RZJYWT tag=TMMRZDG10H1X type=del size=2357108: (22) Invalid argument 2024-09-12T17:18:48.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.354+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~Z6F6DRCWB0ZQ.0 size=15808 2024-09-12T17:18:48.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.354+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=Z6F6DRCWB0ZQ tag=LI3VMENRSPNC type=write size=1064384 2024-09-12T17:18:48.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.362+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=QNP4YGQ27A5Q type=del 2024-09-12T17:18:48.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.366+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=KWNCAY5RIRM3 type=del size=3578598 2024-09-12T17:18:48.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.370+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=4RD5KWXL1ZIV type=del 2024-09-12T17:18:48.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.378+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=NZGN43LZJ3B7 type=write size=90199 2024-09-12T17:18:48.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.382+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=RDE5GOACHOIY type=del 2024-09-12T17:18:48.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.382+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=BZ14RGNA69F0 type=del size=3123690 2024-09-12T17:18:48.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.386+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~P4K6OH3Q0ZI4.0 size=693486 2024-09-12T17:18:48.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.390+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=P4K6OH3Q0ZI4 tag=Q51MK1WZW6DI type=write size=1742062 2024-09-12T17:18:48.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.394+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=4FY32G8W0LSZ type=del size=4082025 2024-09-12T17:18:48.399 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.398+0000 7f96641d38c0 1 < suggested update operation key=RSVQJS9F1FR7 tag=I5YN2M8UOIRR type=del size=1240148 2024-09-12T17:18:48.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.402+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~OUCCRWZ5J11X.0 size=1048576 2024-09-12T17:18:48.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.406+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~OUCCRWZ5J11X.1 size=1048576 2024-09-12T17:18:48.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.406+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~OUCCRWZ5J11X.2 size=851307 2024-09-12T17:18:48.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.406+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=OUCCRWZ5J11X tag=CHQ7PG61XVYY type=write size=3997035 2024-09-12T17:18:48.410 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.410+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~JVILF45Y3IVW.0 size=1048576 2024-09-12T17:18:48.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.410+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~JVILF45Y3IVW.1 size=1048576 2024-09-12T17:18:48.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.414+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~JVILF45Y3IVW.2 size=963440 2024-09-12T17:18:48.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.418+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=JVILF45Y3IVW tag=5ZYC0Q3N70VG type=write size=4109168 2024-09-12T17:18:48.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.422+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~XS79LF7WP9K1.0 size=839903 2024-09-12T17:18:48.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.422+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=XS79LF7WP9K1 tag=RWBNQJ4ZS8QR type=write size=1888479 2024-09-12T17:18:48.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.422+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=YFJTJEL0YFII type=del 2024-09-12T17:18:48.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.426+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=DA7MOMQOPRVM type=del size=3494547 2024-09-12T17:18:48.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.426+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=OUP5K2ERPO5F type=del 2024-09-12T17:18:48.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.430+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~TU1Y7P7R3F9O.0 size=1048576 2024-09-12T17:18:48.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.434+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~TU1Y7P7R3F9O.1 size=11427 2024-09-12T17:18:48.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.434+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=TU1Y7P7R3F9O tag=1B5R3YOMF6JW type=write size=2108579 2024-09-12T17:18:48.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.438+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~4438F80GG9IG.0 size=1048576 2024-09-12T17:18:48.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.438+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~4438F80GG9IG.1 size=1048576 2024-09-12T17:18:48.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.442+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~4438F80GG9IG.2 size=924547 2024-09-12T17:18:48.449 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.446+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=4438F80GG9IG tag=HBTADREU68C8 type=write size=4070275 2024-09-12T17:18:48.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.454+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~MBBOQJSVU3E8.0 size=646256 2024-09-12T17:18:48.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.454+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=MBBOQJSVU3E8 tag=EOLFPDP6OIIO type=write size=1694832 2024-09-12T17:18:48.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.454+0000 7f96641d38c0 1 < canceled operation key=NG327LT02T1F tag=CS1PDG1TKWWP type=del size=645547 2024-09-12T17:18:48.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.462+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~SRQM9QF9P453.0 size=1046162 2024-09-12T17:18:48.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.462+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=SRQM9QF9P453 tag=LW9NGJ2EZLDT type=write size=2094738 2024-09-12T17:18:48.465 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.462+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~HVOM1YQRCPBY.0 size=1048576 2024-09-12T17:18:48.468 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.466+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~HVOM1YQRCPBY.1 size=596345 2024-09-12T17:18:48.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.470+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=HVOM1YQRCPBY tag=FJJ3RYZNVII0 type=write size=2693497 2024-09-12T17:18:48.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.474+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=JT9MCE2DJML9 type=del size=3101976 2024-09-12T17:18:48.478 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.478+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~5V6NXUK15SMR.0 size=1012670 2024-09-12T17:18:48.483 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.482+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=5V6NXUK15SMR tag=W5W59GXMS7SV type=write size=2061246 2024-09-12T17:18:48.485 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.486+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=HR70YIE01FWE type=del size=166193 2024-09-12T17:18:48.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.486+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=TQMQ9SAE533T type=del 2024-09-12T17:18:48.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.490+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~LC5Y7ET9A318.0 size=1048576 2024-09-12T17:18:48.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.494+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~LC5Y7ET9A318.1 size=873871 2024-09-12T17:18:48.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.494+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=LC5Y7ET9A318 tag=GCNYYMF7OK72 type=write size=2971023 2024-09-12T17:18:48.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.498+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~T7E61RKYZZ4F.0 size=1048576 2024-09-12T17:18:48.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.498+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~T7E61RKYZZ4F.1 size=906205 2024-09-12T17:18:48.506 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.506+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=T7E61RKYZZ4F tag=A46RT6UA7K8M type=write size=3003357 2024-09-12T17:18:48.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.506+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=D034J5W8UYIN type=del size=3197691 2024-09-12T17:18:48.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.510+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=PUAP0TJCEWHT type=del 2024-09-12T17:18:48.518 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.518+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~PHVQFSO5GWUE.0 size=565247 2024-09-12T17:18:48.518 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.518+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=PHVQFSO5GWUE tag=PLGFXIJBE1QZ type=write size=1613823 2024-09-12T17:18:48.521 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.518+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~Z6F6DRCWB0ZQ.0 size=15808 2024-09-12T17:18:48.527 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.526+0000 7f96641d38c0 1 < completed multipart upload key=47QQRTJKM4DB upload=Z6F6DRCWB0ZQ tag=LI3VMENRSPNC type=write size=1064384 2024-09-12T17:18:48.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.530+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=WFYBKYGVA9EK type=write size=878781 2024-09-12T17:18:48.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.530+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=KWNCAY5RIRM3 type=del 2024-09-12T17:18:48.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.534+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=KH6TNH0KU3HY type=del size=1123768 2024-09-12T17:18:48.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.542+0000 7f96641d38c0 1 < suggested remove operation key=2TN3M8NKV9LN tag=NZGN43LZJ3B7 type=write 2024-09-12T17:18:48.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.546+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~C8AV1RHSF1Z7.0 size=1048576 2024-09-12T17:18:48.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.546+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~C8AV1RHSF1Z7.1 size=871765 2024-09-12T17:18:48.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.546+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=C8AV1RHSF1Z7 tag=3C8QNXAT1NK3 type=write size=2968917 2024-09-12T17:18:48.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.550+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=BZ14RGNA69F0 type=del 2024-09-12T17:18:48.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.554+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=RUJYSAXBOWXJ type=del size=962316 2024-09-12T17:18:48.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.558+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=4FY32G8W0LSZ type=del 2024-09-12T17:18:48.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.562+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~G1A8QIQFCS4K.0 size=1048576 2024-09-12T17:18:48.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.566+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~G1A8QIQFCS4K.1 size=759896 2024-09-12T17:18:48.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.566+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=G1A8QIQFCS4K tag=JMKG61M9J38Q type=write size=2857048 2024-09-12T17:18:48.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.570+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~OUCCRWZ5J11X.0 size=1048576 2024-09-12T17:18:48.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.570+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~OUCCRWZ5J11X.1 size=1048576 2024-09-12T17:18:48.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.574+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~OUCCRWZ5J11X.2 size=851307 2024-09-12T17:18:48.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.578+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=OUCCRWZ5J11X tag=CHQ7PG61XVYY type=write size=3997035 2024-09-12T17:18:48.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.582+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~KP1G6YRLD87R.0 size=1048576 2024-09-12T17:18:48.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.582+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~KP1G6YRLD87R.1 size=1048576 2024-09-12T17:18:48.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.586+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~KP1G6YRLD87R.2 size=70415 2024-09-12T17:18:48.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.586+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=KP1G6YRLD87R tag=8QN57R2BU99V type=write size=3216143 2024-09-12T17:18:48.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.590+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~XS79LF7WP9K1.0 size=839903 2024-09-12T17:18:48.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.594+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=XS79LF7WP9K1 tag=RWBNQJ4ZS8QR type=write size=1888479 2024-09-12T17:18:48.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.598+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~LQ47MLTRJDQN.0 size=1048576 2024-09-12T17:18:48.601 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.598+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~LQ47MLTRJDQN.1 size=1048576 2024-09-12T17:18:48.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.602+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~LQ47MLTRJDQN.2 size=949981 2024-09-12T17:18:48.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.602+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=LQ47MLTRJDQN tag=P5MFB9Z3KU6L type=write size=4095709 2024-09-12T17:18:48.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.602+0000 7f96641d38c0 -1 < failed to complete operation key=2TN3M8NKV9LN tag=DA7MOMQOPRVM type=del size=3494547: (22) Invalid argument 2024-09-12T17:18:48.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.606+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=QBQKBK8JH84I type=del size=3223707 2024-09-12T17:18:48.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.610+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~TU1Y7P7R3F9O.0 size=1048576 2024-09-12T17:18:48.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.614+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~TU1Y7P7R3F9O.1 size=11427 2024-09-12T17:18:48.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.618+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=TU1Y7P7R3F9O tag=1B5R3YOMF6JW type=write size=2108579 2024-09-12T17:18:48.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.618+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=SAPMR855ZRG6 type=write size=212524 2024-09-12T17:18:48.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.626+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~MBBOQJSVU3E8.0 size=646256 2024-09-12T17:18:48.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.630+0000 7f96641d38c0 1 < completed multipart upload key=3SLNHJT3A1K1 upload=MBBOQJSVU3E8 tag=EOLFPDP6OIIO type=write size=1694832 2024-09-12T17:18:48.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.634+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=B76RUMT61F8J type=del size=1114196 2024-09-12T17:18:48.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.634+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~SRQM9QF9P453.0 size=1046162 2024-09-12T17:18:48.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.642+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=SRQM9QF9P453 tag=LW9NGJ2EZLDT type=write size=2094738 2024-09-12T17:18:48.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.642+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=U2KQ47QQ3PRJ type=del size=1394642 2024-09-12T17:18:48.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.646+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=JT9MCE2DJML9 type=del 2024-09-12T17:18:48.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.650+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=FPEBAB2NY9ZL type=del size=478589 2024-09-12T17:18:48.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.654+0000 7f96641d38c0 1 < canceled operation key=W40P2E1H5VT9 tag=HR70YIE01FWE type=del size=166193 2024-09-12T17:18:48.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.658+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~VPJCSQPZWLV6.0 size=605155 2024-09-12T17:18:48.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.658+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=VPJCSQPZWLV6 tag=L96PTGG1P32Y type=write size=1653731 2024-09-12T17:18:48.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.662+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~LC5Y7ET9A318.0 size=1048576 2024-09-12T17:18:48.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.662+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~LC5Y7ET9A318.1 size=873871 2024-09-12T17:18:48.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.666+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=LC5Y7ET9A318 tag=GCNYYMF7OK72 type=write size=2971023 2024-09-12T17:18:48.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.670+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~B5NT29DEK656.0 size=1048576 2024-09-12T17:18:48.675 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.674+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~B5NT29DEK656.1 size=498074 2024-09-12T17:18:48.675 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.674+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=B5NT29DEK656 tag=KJM0WG09GMRW type=write size=2595226 2024-09-12T17:18:48.678 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.678+0000 7f96641d38c0 1 < canceled operation key=G7CWVD9C2H2J tag=D034J5W8UYIN type=del size=3197691 2024-09-12T17:18:48.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.682+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~R5QOM3YCDQ81.0 size=1048576 2024-09-12T17:18:48.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.682+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~R5QOM3YCDQ81.1 size=1048576 2024-09-12T17:18:48.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.686+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~R5QOM3YCDQ81.2 size=68333 2024-09-12T17:18:48.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.686+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=R5QOM3YCDQ81 tag=7R1OL934QU2R type=write size=3214061 2024-09-12T17:18:48.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.686+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~PHVQFSO5GWUE.0 size=565247 2024-09-12T17:18:48.694 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.694+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=PHVQFSO5GWUE tag=PLGFXIJBE1QZ type=write size=1613823 2024-09-12T17:18:48.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.694+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=XFIZMMQFK52Q type=del size=2632081 2024-09-12T17:18:48.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.698+0000 7f96641d38c0 1 < completed write operation key=EFORFJYOM45R tag=WFYBKYGVA9EK type=write size=878781 2024-09-12T17:18:48.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.706+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~Z1U82FFWTXBS.0 size=1048576 2024-09-12T17:18:48.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.706+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~Z1U82FFWTXBS.1 size=1048576 2024-09-12T17:18:48.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.710+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~Z1U82FFWTXBS.2 size=672077 2024-09-12T17:18:48.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.710+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=Z1U82FFWTXBS tag=ZVVP61BIQ0VL type=write size=3817805 2024-09-12T17:18:48.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.710+0000 7f96641d38c0 1 < completed delete operation key=5ZZI4F92J7BO tag=KH6TNH0KU3HY type=del 2024-09-12T17:18:48.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.714+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=QN9GF4XGFHQ5 type=del size=3043137 2024-09-12T17:18:48.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.718+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~C8AV1RHSF1Z7.0 size=1048576 2024-09-12T17:18:48.721 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.718+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~C8AV1RHSF1Z7.1 size=871765 2024-09-12T17:18:48.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.722+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=C8AV1RHSF1Z7 tag=3C8QNXAT1NK3 type=write size=2968917 2024-09-12T17:18:48.728 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.726+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=LQ4DW9N51VE9 type=del size=314444 2024-09-12T17:18:48.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.730+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=RUJYSAXBOWXJ type=del 2024-09-12T17:18:48.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.734+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=R8621EONLV6C type=del size=2513481 2024-09-12T17:18:48.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.734+0000 7f96641d38c0 1 < canceled part key=_multipart_UBYUSW4C2V19.2~G1A8QIQFCS4K.0 size=1048576 2024-09-12T17:18:48.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.734+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~G1A8QIQFCS4K.1 size=759896 2024-09-12T17:18:48.741 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.738+0000 7f96641d38c0 1 < canceled multipart upload key=UBYUSW4C2V19 upload=G1A8QIQFCS4K tag=JMKG61M9J38Q type=write size=2857048 2024-09-12T17:18:48.744 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.742+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=I4XFULPUE9V6 type=del size=3457597 2024-09-12T17:18:48.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.746+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~KP1G6YRLD87R.0 size=1048576 2024-09-12T17:18:48.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.750+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~KP1G6YRLD87R.1 size=1048576 2024-09-12T17:18:48.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.750+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~KP1G6YRLD87R.2 size=70415 2024-09-12T17:18:48.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.754+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=KP1G6YRLD87R tag=8QN57R2BU99V type=write size=3216143 2024-09-12T17:18:48.760 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.758+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=V93T7ASX2OXF type=del size=4077138 2024-09-12T17:18:48.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.762+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~LQ47MLTRJDQN.0 size=1048576 2024-09-12T17:18:48.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.766+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~LQ47MLTRJDQN.1 size=1048576 2024-09-12T17:18:48.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.766+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~LQ47MLTRJDQN.2 size=949981 2024-09-12T17:18:48.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.770+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=LQ47MLTRJDQN tag=P5MFB9Z3KU6L type=write size=4095709 2024-09-12T17:18:48.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.778+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~D2V9UA9IX7TX.0 size=1048576 2024-09-12T17:18:48.782 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.782+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~D2V9UA9IX7TX.1 size=1048576 2024-09-12T17:18:48.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.782+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~D2V9UA9IX7TX.2 size=173698 2024-09-12T17:18:48.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.782+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=D2V9UA9IX7TX tag=PETSDGMRJXL5 type=write size=3319426 2024-09-12T17:18:48.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.790+0000 7f96641d38c0 1 < suggested remove operation key=NR82RUK97NQA tag=QBQKBK8JH84I type=del 2024-09-12T17:18:48.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.794+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=ZZBTS8REN1GN type=del size=2480407 2024-09-12T17:18:48.797 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.794+0000 7f96641d38c0 1 < completed write operation key=0X2HHMHJUJNL tag=SAPMR855ZRG6 type=write size=212524 2024-09-12T17:18:48.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.798+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=G3PAJ6O8QZXS type=del size=716215 2024-09-12T17:18:48.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.802+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=B76RUMT61F8J type=del 2024-09-12T17:18:48.807 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.806+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=8R5L0TDKDXDZ type=del size=1390721 2024-09-12T17:18:48.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.810+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=U2KQ47QQ3PRJ type=del 2024-09-12T17:18:48.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.810+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=MLN4EQ92ABZR type=del size=419332 2024-09-12T17:18:48.816 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.814+0000 7f96641d38c0 -1 < failed to complete operation key=NR82RUK97NQA tag=FPEBAB2NY9ZL type=del size=478589: (22) Invalid argument 2024-09-12T17:18:48.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.818+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=U7FMPHQZKEL2 type=write size=381919 2024-09-12T17:18:48.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.822+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~VPJCSQPZWLV6.0 size=605155 2024-09-12T17:18:48.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.826+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=VPJCSQPZWLV6 tag=L96PTGG1P32Y type=write size=1653731 2024-09-12T17:18:48.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.830+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=DWBSL5EU6TPZ type=del size=265497 2024-09-12T17:18:48.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.834+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~B5NT29DEK656.0 size=1048576 2024-09-12T17:18:48.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.838+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~B5NT29DEK656.1 size=498074 2024-09-12T17:18:48.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.842+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=B5NT29DEK656 tag=KJM0WG09GMRW type=write size=2595226 2024-09-12T17:18:48.846 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.846+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=FIVWY3DP228G type=del size=2360721 2024-09-12T17:18:48.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.846+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~R5QOM3YCDQ81.0 size=1048576 2024-09-12T17:18:48.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.850+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~R5QOM3YCDQ81.1 size=1048576 2024-09-12T17:18:48.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.850+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~R5QOM3YCDQ81.2 size=68333 2024-09-12T17:18:48.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.858+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=R5QOM3YCDQ81 tag=7R1OL934QU2R type=write size=3214061 2024-09-12T17:18:48.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.862+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=4A5DEEP6CJT5 type=del size=137130 2024-09-12T17:18:48.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.862+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=XFIZMMQFK52Q type=del 2024-09-12T17:18:48.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.866+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=6KFVYN42CXKF type=del size=3836446 2024-09-12T17:18:48.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.866+0000 7f96641d38c0 1 < canceled part key=_multipart_0X2HHMHJUJNL.2~Z1U82FFWTXBS.0 size=1048576 2024-09-12T17:18:48.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.870+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~Z1U82FFWTXBS.1 size=1048576 2024-09-12T17:18:48.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.874+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~Z1U82FFWTXBS.2 size=672077 2024-09-12T17:18:48.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.878+0000 7f96641d38c0 1 < canceled multipart upload key=0X2HHMHJUJNL upload=Z1U82FFWTXBS tag=ZVVP61BIQ0VL type=write size=3817805 2024-09-12T17:18:48.884 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.882+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~OYQP7TESU75O.0 size=1048576 2024-09-12T17:18:48.886 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.886+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~OYQP7TESU75O.1 size=369288 2024-09-12T17:18:48.886 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.886+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=OYQP7TESU75O tag=Y1YRTVNOFWEC type=write size=2466440 2024-09-12T17:18:48.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.886+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=QN9GF4XGFHQ5 type=del 2024-09-12T17:18:48.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.890+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=WTGHEZ0620PD type=del size=717861 2024-09-12T17:18:48.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.894+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=LQ4DW9N51VE9 type=del 2024-09-12T17:18:48.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.902+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=KUPDEONOY01J type=del size=1113146 2024-09-12T17:18:48.905 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.902+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=R8621EONLV6C type=del 2024-09-12T17:18:48.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.910+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~TVA7OM501KIJ.0 size=1048576 2024-09-12T17:18:48.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.910+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~TVA7OM501KIJ.1 size=1048576 2024-09-12T17:18:48.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.914+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~TVA7OM501KIJ.2 size=653183 2024-09-12T17:18:48.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.914+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=TVA7OM501KIJ tag=OK1INXND9AWQ type=write size=3798911 2024-09-12T17:18:48.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.918+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=I4XFULPUE9V6 type=del 2024-09-12T17:18:48.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.922+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~MU84SMZLJ9F2.0 size=1048576 2024-09-12T17:18:48.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.926+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~MU84SMZLJ9F2.1 size=626560 2024-09-12T17:18:48.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.926+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=MU84SMZLJ9F2 tag=G9ZN0QD81TQ6 type=write size=2723712 2024-09-12T17:18:48.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.926+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=V93T7ASX2OXF type=del 2024-09-12T17:18:48.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.934+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~YHJ9A3P4GY95.0 size=1048576 2024-09-12T17:18:48.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.938+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~YHJ9A3P4GY95.1 size=87206 2024-09-12T17:18:48.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.938+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=YHJ9A3P4GY95 tag=K8GWE0QB0J8X type=write size=2184358 2024-09-12T17:18:48.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.938+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~D2V9UA9IX7TX.0 size=1048576 2024-09-12T17:18:48.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.942+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~D2V9UA9IX7TX.1 size=1048576 2024-09-12T17:18:48.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.946+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~D2V9UA9IX7TX.2 size=173698 2024-09-12T17:18:48.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.950+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=D2V9UA9IX7TX tag=PETSDGMRJXL5 type=write size=3319426 2024-09-12T17:18:48.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.950+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=EZWRDDNVRIH3 type=del size=3185608 2024-09-12T17:18:48.958 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.958+0000 7f96641d38c0 1 < suggested update operation key=GKJJDBNXC6QH tag=ZZBTS8REN1GN type=del size=2480407 2024-09-12T17:18:48.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.962+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~8AJL989ADU7K.0 size=1048576 2024-09-12T17:18:48.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.962+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~8AJL989ADU7K.1 size=379384 2024-09-12T17:18:48.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.962+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=8AJL989ADU7K tag=CYL94JQB96J6 type=write size=2476536 2024-09-12T17:18:48.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.966+0000 7f96641d38c0 -1 < failed to complete operation key=GKJJDBNXC6QH tag=G3PAJ6O8QZXS type=del size=716215: (22) Invalid argument 2024-09-12T17:18:48.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.970+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=H6QJSRSZ0D9V type=del size=4098228 2024-09-12T17:18:48.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.974+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=8R5L0TDKDXDZ type=del 2024-09-12T17:18:48.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.978+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~1PRR4PJKT1MO.0 size=1048576 2024-09-12T17:18:48.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.978+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~1PRR4PJKT1MO.1 size=897698 2024-09-12T17:18:48.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.978+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=1PRR4PJKT1MO tag=H1SDH0JFNS79 type=write size=2994850 2024-09-12T17:18:48.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.986+0000 7f96641d38c0 1 < suggested remove operation key=8TU2VZOHL1ZZ tag=MLN4EQ92ABZR type=del 2024-09-12T17:18:48.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.990+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~03M80QP0FZY3.0 size=284388 2024-09-12T17:18:48.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.990+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=03M80QP0FZY3 tag=C1QCNEVA996V type=write size=1332964 2024-09-12T17:18:48.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.994+0000 7f96641d38c0 1 < completed write operation key=ZKDOIH5SH6K0 tag=U7FMPHQZKEL2 type=write size=381919 2024-09-12T17:18:48.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.998+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=CFT4SRS326Y4 type=del size=1520868 2024-09-12T17:18:49.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:48.998+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=DWBSL5EU6TPZ type=del 2024-09-12T17:18:49.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.002+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=QETWBM54T4G1 type=write size=238669 2024-09-12T17:18:49.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.006+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=FIVWY3DP228G type=del 2024-09-12T17:18:49.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.010+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~O3PSUQYG8N2O.0 size=1048576 2024-09-12T17:18:49.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.014+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~O3PSUQYG8N2O.1 size=455693 2024-09-12T17:18:49.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.014+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=O3PSUQYG8N2O tag=HPQ18HIH17R5 type=write size=2552845 2024-09-12T17:18:49.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.018+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=4A5DEEP6CJT5 type=del 2024-09-12T17:18:49.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.018+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=83XJLKLIFU0Q type=del size=97198 2024-09-12T17:18:49.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.022+0000 7f96641d38c0 -1 < failed to complete operation key=8TU2VZOHL1ZZ tag=6KFVYN42CXKF type=del size=3836446: (22) Invalid argument 2024-09-12T17:18:49.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.030+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~SRDR5MJ3IA2G.0 size=1048576 2024-09-12T17:18:49.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.030+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~SRDR5MJ3IA2G.1 size=1002769 2024-09-12T17:18:49.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.030+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=SRDR5MJ3IA2G tag=YN8FFPHW4028 type=write size=3099921 2024-09-12T17:18:49.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.034+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~OYQP7TESU75O.0 size=1048576 2024-09-12T17:18:49.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.038+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~OYQP7TESU75O.1 size=369288 2024-09-12T17:18:49.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.042+0000 7f96641d38c0 1 < completed multipart upload key=2TN3M8NKV9LN upload=OYQP7TESU75O tag=Y1YRTVNOFWEC type=write size=2466440 2024-09-12T17:18:49.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.046+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~KO2IBVD9ZJ1Q.0 size=1048576 2024-09-12T17:18:49.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.050+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~KO2IBVD9ZJ1Q.1 size=530626 2024-09-12T17:18:49.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.050+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=KO2IBVD9ZJ1Q tag=FTLXL0YLPEHC type=write size=2627778 2024-09-12T17:18:49.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.058+0000 7f96641d38c0 1 < suggested remove operation key=G7CWVD9C2H2J tag=WTGHEZ0620PD type=del 2024-09-12T17:18:49.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.058+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=WBKBG2E5XG2R type=del size=1860719 2024-09-12T17:18:49.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.062+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=KUPDEONOY01J type=del 2024-09-12T17:18:49.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.070+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~3WOXFOOKNP4Z.0 size=1048576 2024-09-12T17:18:49.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.070+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~3WOXFOOKNP4Z.1 size=659890 2024-09-12T17:18:49.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.070+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=3WOXFOOKNP4Z tag=72OUO0GA0JWP type=write size=2757042 2024-09-12T17:18:49.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.074+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~TVA7OM501KIJ.0 size=1048576 2024-09-12T17:18:49.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.078+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~TVA7OM501KIJ.1 size=1048576 2024-09-12T17:18:49.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.078+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~TVA7OM501KIJ.2 size=653183 2024-09-12T17:18:49.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.086+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=TVA7OM501KIJ tag=OK1INXND9AWQ type=write size=3798911 2024-09-12T17:18:49.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.090+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~3OOS5L1STJ3B.0 size=1048576 2024-09-12T17:18:49.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.094+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~3OOS5L1STJ3B.1 size=1048576 2024-09-12T17:18:49.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.094+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~3OOS5L1STJ3B.2 size=890481 2024-09-12T17:18:49.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.094+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=3OOS5L1STJ3B tag=QQQ7BB6NZZPE type=write size=4036209 2024-09-12T17:18:49.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.098+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~MU84SMZLJ9F2.0 size=1048576 2024-09-12T17:18:49.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.098+0000 7f96641d38c0 1 < canceled part key=_multipart_5ZZI4F92J7BO.2~MU84SMZLJ9F2.1 size=626560 2024-09-12T17:18:49.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.102+0000 7f96641d38c0 1 < canceled multipart upload key=5ZZI4F92J7BO upload=MU84SMZLJ9F2 tag=G9ZN0QD81TQ6 type=write size=2723712 2024-09-12T17:18:49.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.110+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~JJ03KVM99NWH.0 size=1048576 2024-09-12T17:18:49.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.110+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~JJ03KVM99NWH.1 size=435162 2024-09-12T17:18:49.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.110+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=JJ03KVM99NWH tag=87FJZZG9XWZY type=write size=2532314 2024-09-12T17:18:49.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.114+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~YHJ9A3P4GY95.0 size=1048576 2024-09-12T17:18:49.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.114+0000 7f96641d38c0 1 < canceled part key=_multipart_3SLNHJT3A1K1.2~YHJ9A3P4GY95.1 size=87206 2024-09-12T17:18:49.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.118+0000 7f96641d38c0 1 < canceled multipart upload key=3SLNHJT3A1K1 upload=YHJ9A3P4GY95 tag=K8GWE0QB0J8X type=write size=2184358 2024-09-12T17:18:49.126 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.126+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~5C9FU1B32A6J.0 size=1048576 2024-09-12T17:18:49.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.126+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~5C9FU1B32A6J.1 size=415179 2024-09-12T17:18:49.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.126+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=5C9FU1B32A6J tag=T7NZT5ONR2R7 type=write size=2512331 2024-09-12T17:18:49.132 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.130+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=EZWRDDNVRIH3 type=del 2024-09-12T17:18:49.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.134+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=3IT8I2GS8QAN type=write size=689703 2024-09-12T17:18:49.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.138+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~8AJL989ADU7K.0 size=1048576 2024-09-12T17:18:49.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.138+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~8AJL989ADU7K.1 size=379384 2024-09-12T17:18:49.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.142+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=8AJL989ADU7K tag=CYL94JQB96J6 type=write size=2476536 2024-09-12T17:18:49.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.146+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=1MO3IE5WO8XS type=write size=556654 2024-09-12T17:18:49.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.154+0000 7f96641d38c0 1 < suggested remove operation key=H3J23KLT1VUT tag=H6QJSRSZ0D9V type=del 2024-09-12T17:18:49.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.154+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=RLS5BQNVYOVC type=del size=2574434 2024-09-12T17:18:49.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.158+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~1PRR4PJKT1MO.0 size=1048576 2024-09-12T17:18:49.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.162+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~1PRR4PJKT1MO.1 size=897698 2024-09-12T17:18:49.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.166+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=1PRR4PJKT1MO tag=H1SDH0JFNS79 type=write size=2994850 2024-09-12T17:18:49.171 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.170+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=AQTGQAOT2OVY type=del size=3276322 2024-09-12T17:18:49.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.174+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~03M80QP0FZY3.0 size=284388 2024-09-12T17:18:49.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.182+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=03M80QP0FZY3 tag=C1QCNEVA996V type=write size=1332964 2024-09-12T17:18:49.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.190+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~CD1TDFL447DD.0 size=1048576 2024-09-12T17:18:49.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.190+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~CD1TDFL447DD.1 size=128948 2024-09-12T17:18:49.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.190+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=CD1TDFL447DD tag=ZQRJ1R1J4QCI type=write size=2226100 2024-09-12T17:18:49.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.194+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=CFT4SRS326Y4 type=del 2024-09-12T17:18:49.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.198+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=JKHMTOK47KPQ type=del size=1156252 2024-09-12T17:18:49.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.202+0000 7f96641d38c0 1 < suggested update operation key=47QQRTJKM4DB tag=QETWBM54T4G1 type=write size=238669 2024-09-12T17:18:49.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.206+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=17WOBF0E0JY7 type=write size=567413 2024-09-12T17:18:49.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.210+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~O3PSUQYG8N2O.0 size=1048576 2024-09-12T17:18:49.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.210+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~O3PSUQYG8N2O.1 size=455693 2024-09-12T17:18:49.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.218+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=O3PSUQYG8N2O tag=HPQ18HIH17R5 type=write size=2552845 2024-09-12T17:18:49.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.218+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=83YXMRSPQB0E type=write size=568185 2024-09-12T17:18:49.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.222+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=83XJLKLIFU0Q type=del 2024-09-12T17:18:49.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.226+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=ATOZ7GYCKNWX type=del size=3614258 2024-09-12T17:18:49.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.226+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~SRDR5MJ3IA2G.0 size=1048576 2024-09-12T17:18:49.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.230+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~SRDR5MJ3IA2G.1 size=1002769 2024-09-12T17:18:49.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.234+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=SRDR5MJ3IA2G tag=YN8FFPHW4028 type=write size=3099921 2024-09-12T17:18:49.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.234+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=63HF9IQPBOD8 type=del size=1386892 2024-09-12T17:18:49.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.238+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~KO2IBVD9ZJ1Q.0 size=1048576 2024-09-12T17:18:49.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.242+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~KO2IBVD9ZJ1Q.1 size=530626 2024-09-12T17:18:49.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.246+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=KO2IBVD9ZJ1Q tag=FTLXL0YLPEHC type=write size=2627778 2024-09-12T17:18:49.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.250+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=FNZZEI6GMUP2 type=write size=551934 2024-09-12T17:18:49.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.250+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=WBKBG2E5XG2R type=del 2024-09-12T17:18:49.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.258+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~UJO0DKHF2ZSJ.0 size=1048576 2024-09-12T17:18:49.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.258+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~UJO0DKHF2ZSJ.1 size=1048576 2024-09-12T17:18:49.263 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.262+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~UJO0DKHF2ZSJ.2 size=1019217 2024-09-12T17:18:49.263 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.262+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=UJO0DKHF2ZSJ tag=21RREV3YYAMF type=write size=4164945 2024-09-12T17:18:49.266 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.266+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~3WOXFOOKNP4Z.0 size=1048576 2024-09-12T17:18:49.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.266+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~3WOXFOOKNP4Z.1 size=659890 2024-09-12T17:18:49.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.274+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=3WOXFOOKNP4Z tag=72OUO0GA0JWP type=write size=2757042 2024-09-12T17:18:49.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.274+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=BE1GJ95VR61N type=write size=183220 2024-09-12T17:18:49.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.278+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~3OOS5L1STJ3B.0 size=1048576 2024-09-12T17:18:49.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.282+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~3OOS5L1STJ3B.1 size=1048576 2024-09-12T17:18:49.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.282+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~3OOS5L1STJ3B.2 size=890481 2024-09-12T17:18:49.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.290+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=3OOS5L1STJ3B tag=QQQ7BB6NZZPE type=write size=4036209 2024-09-12T17:18:49.297 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.294+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~5GRC197KIFW3.0 size=1048576 2024-09-12T17:18:49.299 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.298+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~5GRC197KIFW3.1 size=1006653 2024-09-12T17:18:49.299 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.298+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=5GRC197KIFW3 tag=0SSO1FZIPH79 type=write size=3103805 2024-09-12T17:18:49.302 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.302+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~JJ03KVM99NWH.0 size=1048576 2024-09-12T17:18:49.305 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.302+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~JJ03KVM99NWH.1 size=435162 2024-09-12T17:18:49.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.310+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=JJ03KVM99NWH tag=87FJZZG9XWZY type=write size=2532314 2024-09-12T17:18:49.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.314+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=N8V0BOBO5OFD type=del size=2654352 2024-09-12T17:18:49.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.314+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~5C9FU1B32A6J.0 size=1048576 2024-09-12T17:18:49.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.318+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~5C9FU1B32A6J.1 size=415179 2024-09-12T17:18:49.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.322+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=5C9FU1B32A6J tag=T7NZT5ONR2R7 type=write size=2512331 2024-09-12T17:18:49.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.326+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=W1XAO7O5WG9S type=del size=3586071 2024-09-12T17:18:49.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.330+0000 7f96641d38c0 1 < completed write operation key=G7CWVD9C2H2J tag=3IT8I2GS8QAN type=write size=689703 2024-09-12T17:18:49.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.334+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=4NPTVAMK5H66 type=del size=1812827 2024-09-12T17:18:49.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.338+0000 7f96641d38c0 1 < completed write operation key=XTVZIXTEES2O tag=1MO3IE5WO8XS type=write size=556654 2024-09-12T17:18:49.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.338+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=NFC3HONAPOLJ type=del size=3003307 2024-09-12T17:18:49.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.342+0000 7f96641d38c0 1 < canceled operation key=2TN3M8NKV9LN tag=RLS5BQNVYOVC type=del size=2574434 2024-09-12T17:18:49.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.350+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~ITJ5AL1IF1VG.0 size=743582 2024-09-12T17:18:49.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.350+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=ITJ5AL1IF1VG tag=A4C75O7632BV type=write size=1792158 2024-09-12T17:18:49.353 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.350+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=AQTGQAOT2OVY type=del 2024-09-12T17:18:49.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.358+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~GUU8DL9PYNZ8.0 size=780510 2024-09-12T17:18:49.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.358+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=GUU8DL9PYNZ8 tag=LKI2X52Z1X8F type=write size=1829086 2024-09-12T17:18:49.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.358+0000 7f96641d38c0 1 < canceled part key=_multipart_DHODPSZ7Z0D4.2~CD1TDFL447DD.0 size=1048576 2024-09-12T17:18:49.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.362+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~CD1TDFL447DD.1 size=128948 2024-09-12T17:18:49.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.366+0000 7f96641d38c0 1 < canceled multipart upload key=DHODPSZ7Z0D4 upload=CD1TDFL447DD tag=ZQRJ1R1J4QCI type=write size=2226100 2024-09-12T17:18:49.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.370+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=FEI7FIPS223T type=del size=1026030 2024-09-12T17:18:49.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.374+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=JKHMTOK47KPQ type=del 2024-09-12T17:18:49.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.378+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=BZHGQNRKLRDP type=del size=1007062 2024-09-12T17:18:49.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.382+0000 7f96641d38c0 1 < completed write operation key=ZKDOIH5SH6K0 tag=17WOBF0E0JY7 type=write size=567413 2024-09-12T17:18:49.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.382+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=18XEPZVY8HY8 type=write size=3771 2024-09-12T17:18:49.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.386+0000 7f96641d38c0 1 < canceled operation key=KXJYJ9VX7YVW tag=83YXMRSPQB0E type=write size=568185 2024-09-12T17:18:49.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.390+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~UA6N8V8EGHW4.0 size=1048576 2024-09-12T17:18:49.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.394+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~UA6N8V8EGHW4.1 size=963054 2024-09-12T17:18:49.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.394+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=UA6N8V8EGHW4 tag=SFESD5HS339G type=write size=3060206 2024-09-12T17:18:49.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.394+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=ATOZ7GYCKNWX type=del 2024-09-12T17:18:49.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.398+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=IYKLH1V6KX35 type=del size=1604827 2024-09-12T17:18:49.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.402+0000 7f96641d38c0 1 < suggested update operation key=9CBFWXFX7O3N tag=63HF9IQPBOD8 type=del size=1386892 2024-09-12T17:18:49.410 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.410+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~CKWCKATZ79GD.0 size=1048576 2024-09-12T17:18:49.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.410+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~CKWCKATZ79GD.1 size=798571 2024-09-12T17:18:49.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.410+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=CKWCKATZ79GD tag=8KCAQUKY614V type=write size=2895723 2024-09-12T17:18:49.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.414+0000 7f96641d38c0 1 < completed write operation key=W40P2E1H5VT9 tag=FNZZEI6GMUP2 type=write size=551934 2024-09-12T17:18:49.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.418+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=0SYP9BIJRKTF type=del size=607307 2024-09-12T17:18:49.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.422+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~UJO0DKHF2ZSJ.0 size=1048576 2024-09-12T17:18:49.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.422+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~UJO0DKHF2ZSJ.1 size=1048576 2024-09-12T17:18:49.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.426+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~UJO0DKHF2ZSJ.2 size=1019217 2024-09-12T17:18:49.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.430+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=UJO0DKHF2ZSJ tag=21RREV3YYAMF type=write size=4164945 2024-09-12T17:18:49.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.434+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=U4Z94DSX14CE type=write size=803805 2024-09-12T17:18:49.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.438+0000 7f96641d38c0 1 < completed write operation key=W40P2E1H5VT9 tag=BE1GJ95VR61N type=write size=183220 2024-09-12T17:18:49.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.438+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=63APVYU8GSI0 type=del size=1225041 2024-09-12T17:18:49.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.442+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~5GRC197KIFW3.0 size=1048576 2024-09-12T17:18:49.446 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.446+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~5GRC197KIFW3.1 size=1006653 2024-09-12T17:18:49.450 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.450+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=5GRC197KIFW3 tag=0SSO1FZIPH79 type=write size=3103805 2024-09-12T17:18:49.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.450+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=LNHQM2WXKX0N type=del size=3208006 2024-09-12T17:18:49.456 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.454+0000 7f96641d38c0 1 < completed delete operation key=5ZZI4F92J7BO tag=N8V0BOBO5OFD type=del 2024-09-12T17:18:49.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.462+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=EV4ZU9QCTIXI type=del size=554495 2024-09-12T17:18:49.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.462+0000 7f96641d38c0 1 < completed delete operation key=W40P2E1H5VT9 tag=W1XAO7O5WG9S type=del 2024-09-12T17:18:49.466 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.466+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=AAA1J4N8TCY5 type=write size=810882 2024-09-12T17:18:49.469 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.466+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=4NPTVAMK5H66 type=del 2024-09-12T17:18:49.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.470+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=AUWTRJT8E09P type=del size=646340 2024-09-12T17:18:49.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.474+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=NFC3HONAPOLJ type=del 2024-09-12T17:18:49.478 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.478+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~2R0F0THG0X01.0 size=1048576 2024-09-12T17:18:49.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.478+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~2R0F0THG0X01.1 size=43813 2024-09-12T17:18:49.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.478+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=2R0F0THG0X01 tag=UGI1BPFQSVAE type=write size=2140965 2024-09-12T17:18:49.482 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.482+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~ITJ5AL1IF1VG.0 size=743582 2024-09-12T17:18:49.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.486+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=ITJ5AL1IF1VG tag=A4C75O7632BV type=write size=1792158 2024-09-12T17:18:49.491 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.490+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~HWUXAZE0L3NP.0 size=961153 2024-09-12T17:18:49.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.490+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=HWUXAZE0L3NP tag=BEO3M03CSLDE type=write size=2009729 2024-09-12T17:18:49.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.494+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~GUU8DL9PYNZ8.0 size=780510 2024-09-12T17:18:49.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.498+0000 7f96641d38c0 1 < completed multipart upload key=EFORFJYOM45R upload=GUU8DL9PYNZ8 tag=LKI2X52Z1X8F type=write size=1829086 2024-09-12T17:18:49.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.498+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=9CCZ25CYHM3Q type=del size=1645402 2024-09-12T17:18:49.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.502+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=FEI7FIPS223T type=del 2024-09-12T17:18:49.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.510+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~PO4YVYJV96IF.0 size=1048576 2024-09-12T17:18:49.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.510+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~PO4YVYJV96IF.1 size=1048576 2024-09-12T17:18:49.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.514+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~PO4YVYJV96IF.2 size=224365 2024-09-12T17:18:49.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.514+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=PO4YVYJV96IF tag=WISMJLNSODHA type=write size=3370093 2024-09-12T17:18:49.517 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.514+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=BZHGQNRKLRDP type=del 2024-09-12T17:18:49.520 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.518+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=Q58E0GUN6I00 type=del size=2958014 2024-09-12T17:18:49.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.522+0000 7f96641d38c0 1 < completed write operation key=ZKDOIH5SH6K0 tag=18XEPZVY8HY8 type=write size=3771 2024-09-12T17:18:49.525 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.522+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=26RSRL1543TT type=del size=2482579 2024-09-12T17:18:49.528 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.526+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~UA6N8V8EGHW4.0 size=1048576 2024-09-12T17:18:49.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.530+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~UA6N8V8EGHW4.1 size=963054 2024-09-12T17:18:49.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.534+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=UA6N8V8EGHW4 tag=SFESD5HS339G type=write size=3060206 2024-09-12T17:18:49.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.538+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~B92318D3U5XU.0 size=1048576 2024-09-12T17:18:49.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.542+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~B92318D3U5XU.1 size=950183 2024-09-12T17:18:49.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.542+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=B92318D3U5XU tag=2LP4Z6JNTW7R type=write size=3047335 2024-09-12T17:18:49.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.546+0000 7f96641d38c0 1 < suggested update operation key=DHODPSZ7Z0D4 tag=IYKLH1V6KX35 type=del size=1604827 2024-09-12T17:18:49.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.550+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~T1ON9RF9494W.0 size=1048576 2024-09-12T17:18:49.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.554+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~T1ON9RF9494W.1 size=582718 2024-09-12T17:18:49.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.554+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=T1ON9RF9494W tag=4UU0H37FPECE type=write size=2679870 2024-09-12T17:18:49.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.554+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~CKWCKATZ79GD.0 size=1048576 2024-09-12T17:18:49.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.558+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~CKWCKATZ79GD.1 size=798571 2024-09-12T17:18:49.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.562+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=CKWCKATZ79GD tag=8KCAQUKY614V type=write size=2895723 2024-09-12T17:18:49.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.566+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~CS3M44GYUVH8.0 size=50121 2024-09-12T17:18:49.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.566+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=CS3M44GYUVH8 tag=5WZJMKPHTLTR type=write size=1098697 2024-09-12T17:18:49.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.570+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=0SYP9BIJRKTF type=del 2024-09-12T17:18:49.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.578+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~B3G94YEMO0JN.0 size=1048576 2024-09-12T17:18:49.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.578+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~B3G94YEMO0JN.1 size=1048576 2024-09-12T17:18:49.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.582+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~B3G94YEMO0JN.2 size=399434 2024-09-12T17:18:49.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.582+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=B3G94YEMO0JN tag=TC21X9Q96M9T type=write size=3545162 2024-09-12T17:18:49.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.582+0000 7f96641d38c0 1 < canceled operation key=NG327LT02T1F tag=U4Z94DSX14CE type=write size=803805 2024-09-12T17:18:49.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.586+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=Y0S4VTKJ3VGA type=del size=1945453 2024-09-12T17:18:49.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.590+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=63APVYU8GSI0 type=del 2024-09-12T17:18:49.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.590+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=5PMH352SIKDU type=del size=585416 2024-09-12T17:18:49.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.598+0000 7f96641d38c0 1 < suggested remove operation key=BDI9YFZCT5YY tag=LNHQM2WXKX0N type=del 2024-09-12T17:18:49.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.602+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~TFNCWKRRIV4R.0 size=1048576 2024-09-12T17:18:49.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.602+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~TFNCWKRRIV4R.1 size=1035676 2024-09-12T17:18:49.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.602+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=TFNCWKRRIV4R tag=MGO6U3EX3QBQ type=write size=3132828 2024-09-12T17:18:49.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.606+0000 7f96641d38c0 -1 < failed to complete operation key=BDI9YFZCT5YY tag=EV4ZU9QCTIXI type=del size=554495: (22) Invalid argument 2024-09-12T17:18:49.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.610+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=IGMQ1QSAADOD type=del size=3395483 2024-09-12T17:18:49.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.610+0000 7f96641d38c0 1 < completed write operation key=ZKDOIH5SH6K0 tag=AAA1J4N8TCY5 type=write size=810882 2024-09-12T17:18:49.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.614+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=1VTI91SHQU73 type=del size=2114040 2024-09-12T17:18:49.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.618+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=AUWTRJT8E09P type=del 2024-09-12T17:18:49.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.618+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=FMOGKTF0DBFW type=del size=2420328 2024-09-12T17:18:49.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.622+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~2R0F0THG0X01.0 size=1048576 2024-09-12T17:18:49.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.622+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~2R0F0THG0X01.1 size=43813 2024-09-12T17:18:49.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.626+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=2R0F0THG0X01 tag=UGI1BPFQSVAE type=write size=2140965 2024-09-12T17:18:49.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.630+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=G1MORDJR9GQV type=del size=1469172 2024-09-12T17:18:49.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.634+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~HWUXAZE0L3NP.0 size=961153 2024-09-12T17:18:49.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.638+0000 7f96641d38c0 1 < completed multipart upload key=2TN3M8NKV9LN upload=HWUXAZE0L3NP tag=BEO3M03CSLDE type=write size=2009729 2024-09-12T17:18:49.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.638+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=BXJMLN6BWN1G type=del size=456978 2024-09-12T17:18:49.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.642+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=9CCZ25CYHM3Q type=del 2024-09-12T17:18:49.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.646+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=0XZXEN9EHF82 type=del size=1931479 2024-09-12T17:18:49.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.646+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~PO4YVYJV96IF.0 size=1048576 2024-09-12T17:18:49.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.650+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~PO4YVYJV96IF.1 size=1048576 2024-09-12T17:18:49.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.654+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~PO4YVYJV96IF.2 size=224365 2024-09-12T17:18:49.658 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.658+0000 7f96641d38c0 1 < completed multipart upload key=NGA3P9RZJYWT upload=PO4YVYJV96IF tag=WISMJLNSODHA type=write size=3370093 2024-09-12T17:18:49.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.662+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~YCH47A6AIF7D.0 size=1048576 2024-09-12T17:18:49.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.666+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~YCH47A6AIF7D.1 size=181512 2024-09-12T17:18:49.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.666+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=YCH47A6AIF7D tag=QL1R4N0AJ8P5 type=write size=2278664 2024-09-12T17:18:49.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.666+0000 7f96641d38c0 1 < canceled operation key=LK3F25OHR7AO tag=Q58E0GUN6I00 type=del size=2958014 2024-09-12T17:18:49.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.674+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~RVGYC76DXDDC.0 size=1048576 2024-09-12T17:18:49.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.674+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~RVGYC76DXDDC.1 size=398196 2024-09-12T17:18:49.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.674+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=RVGYC76DXDDC tag=T6L1IM7HWQTZ type=write size=2495348 2024-09-12T17:18:49.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.678+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=26RSRL1543TT type=del 2024-09-12T17:18:49.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.682+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~QFJ7FX27IWIY.0 size=1048576 2024-09-12T17:18:49.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.686+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~QFJ7FX27IWIY.1 size=720867 2024-09-12T17:18:49.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.686+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=QFJ7FX27IWIY tag=U5PC8DF20RYZ type=write size=2818019 2024-09-12T17:18:49.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.686+0000 7f96641d38c0 1 < canceled part key=_multipart_EFORFJYOM45R.2~B92318D3U5XU.0 size=1048576 2024-09-12T17:18:49.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.686+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~B92318D3U5XU.1 size=950183 2024-09-12T17:18:49.693 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.690+0000 7f96641d38c0 1 < canceled multipart upload key=EFORFJYOM45R upload=B92318D3U5XU tag=2LP4Z6JNTW7R type=write size=3047335 2024-09-12T17:18:49.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.698+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~39YQABVEJVYB.0 size=1048576 2024-09-12T17:18:49.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.698+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~39YQABVEJVYB.1 size=699483 2024-09-12T17:18:49.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.698+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=39YQABVEJVYB tag=YGX2JLBPGV8O type=write size=2796635 2024-09-12T17:18:49.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.702+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~T1ON9RF9494W.0 size=1048576 2024-09-12T17:18:49.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.702+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~T1ON9RF9494W.1 size=582718 2024-09-12T17:18:49.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.710+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=T1ON9RF9494W tag=4UU0H37FPECE type=write size=2679870 2024-09-12T17:18:49.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.714+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=O0PRAE4NWK4R type=del size=1322156 2024-09-12T17:18:49.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.718+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~CS3M44GYUVH8.0 size=50121 2024-09-12T17:18:49.723 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.722+0000 7f96641d38c0 1 < completed multipart upload key=NGA3P9RZJYWT upload=CS3M44GYUVH8 tag=5WZJMKPHTLTR type=write size=1098697 2024-09-12T17:18:49.727 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.726+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~AXH198J8U423.0 size=183013 2024-09-12T17:18:49.727 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.726+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=AXH198J8U423 tag=HGWSF5Y6SVG9 type=write size=1231589 2024-09-12T17:18:49.729 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.726+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~B3G94YEMO0JN.0 size=1048576 2024-09-12T17:18:49.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.730+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~B3G94YEMO0JN.1 size=1048576 2024-09-12T17:18:49.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.730+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~B3G94YEMO0JN.2 size=399434 2024-09-12T17:18:49.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.738+0000 7f96641d38c0 1 < completed multipart upload key=0X2HHMHJUJNL upload=B3G94YEMO0JN tag=TC21X9Q96M9T type=write size=3545162 2024-09-12T17:18:49.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.738+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=JMO84LNYUMTU type=del size=2688968 2024-09-12T17:18:49.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.742+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=Y0S4VTKJ3VGA type=del 2024-09-12T17:18:49.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.746+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=0HTJ7RRW3GFX type=del size=3889602 2024-09-12T17:18:49.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.746+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=5PMH352SIKDU type=del 2024-09-12T17:18:49.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.750+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=8Z6GTO8C60F0 type=del size=2584010 2024-09-12T17:18:49.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.754+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~TFNCWKRRIV4R.0 size=1048576 2024-09-12T17:18:49.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.754+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~TFNCWKRRIV4R.1 size=1035676 2024-09-12T17:18:49.760 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.758+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=TFNCWKRRIV4R tag=MGO6U3EX3QBQ type=write size=3132828 2024-09-12T17:18:49.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.762+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~M2IBJ9NA728B.0 size=1048576 2024-09-12T17:18:49.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.766+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~M2IBJ9NA728B.1 size=543763 2024-09-12T17:18:49.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.766+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=M2IBJ9NA728B tag=HESFPPVWT69J type=write size=2640915 2024-09-12T17:18:49.770 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.770+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=IGMQ1QSAADOD type=del 2024-09-12T17:18:49.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.770+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=9RJH79ZZJMJG type=del size=1946774 2024-09-12T17:18:49.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.774+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=1VTI91SHQU73 type=del 2024-09-12T17:18:49.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.778+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=O4QMHA4C5JS3 type=del size=3386446 2024-09-12T17:18:49.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.782+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=FMOGKTF0DBFW type=del 2024-09-12T17:18:49.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.786+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=BEB9VAQK98PN type=del size=592827 2024-09-12T17:18:49.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.786+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=G1MORDJR9GQV type=del 2024-09-12T17:18:49.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.790+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=P8C81YWR0BEA type=del size=2324666 2024-09-12T17:18:49.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.794+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=BXJMLN6BWN1G type=del 2024-09-12T17:18:49.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.798+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~W2NO0FJYPKII.0 size=1048576 2024-09-12T17:18:49.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.802+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~W2NO0FJYPKII.1 size=1048576 2024-09-12T17:18:49.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.806+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~W2NO0FJYPKII.2 size=1013351 2024-09-12T17:18:49.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.806+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=W2NO0FJYPKII tag=IDM2AMQ71BOI type=write size=4159079 2024-09-12T17:18:49.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.810+0000 7f96641d38c0 1 < suggested remove operation key=8TU2VZOHL1ZZ tag=0XZXEN9EHF82 type=del 2024-09-12T17:18:49.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.814+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=PFTSA9VYWOQG type=del size=2687178 2024-09-12T17:18:49.818 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.818+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~YCH47A6AIF7D.0 size=1048576 2024-09-12T17:18:49.818 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.818+0000 7f96641d38c0 1 < canceled part key=_multipart_KXJYJ9VX7YVW.2~YCH47A6AIF7D.1 size=181512 2024-09-12T17:18:49.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.822+0000 7f96641d38c0 1 < canceled multipart upload key=KXJYJ9VX7YVW upload=YCH47A6AIF7D tag=QL1R4N0AJ8P5 type=write size=2278664 2024-09-12T17:18:49.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.822+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=T211A6I1FAVG type=del size=2595243 2024-09-12T17:18:49.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.826+0000 7f96641d38c0 1 < canceled part key=_multipart_GKJJDBNXC6QH.2~RVGYC76DXDDC.0 size=1048576 2024-09-12T17:18:49.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.826+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~RVGYC76DXDDC.1 size=398196 2024-09-12T17:18:49.832 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.830+0000 7f96641d38c0 1 < canceled multipart upload key=GKJJDBNXC6QH upload=RVGYC76DXDDC tag=T6L1IM7HWQTZ type=write size=2495348 2024-09-12T17:18:49.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.834+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=3DRSRH2MBX3C type=del size=1946468 2024-09-12T17:18:49.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.834+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~QFJ7FX27IWIY.0 size=1048576 2024-09-12T17:18:49.839 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.838+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~QFJ7FX27IWIY.1 size=720867 2024-09-12T17:18:49.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.842+0000 7f96641d38c0 1 < completed multipart upload key=2TN3M8NKV9LN upload=QFJ7FX27IWIY tag=U5PC8DF20RYZ type=write size=2818019 2024-09-12T17:18:49.847 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.846+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=FMYDHMQWPP2T type=write size=577194 2024-09-12T17:18:49.850 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.850+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~39YQABVEJVYB.0 size=1048576 2024-09-12T17:18:49.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.850+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~39YQABVEJVYB.1 size=699483 2024-09-12T17:18:49.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.854+0000 7f96641d38c0 1 < completed multipart upload key=3SLNHJT3A1K1 upload=39YQABVEJVYB tag=YGX2JLBPGV8O type=write size=2796635 2024-09-12T17:18:49.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.858+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=G4NZ4FVBE3EU type=del size=3728837 2024-09-12T17:18:49.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.862+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=O0PRAE4NWK4R type=del 2024-09-12T17:18:49.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.866+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~XBJPT919WPBG.0 size=1048576 2024-09-12T17:18:49.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.866+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~XBJPT919WPBG.1 size=1048576 2024-09-12T17:18:49.872 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.870+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~XBJPT919WPBG.2 size=624779 2024-09-12T17:18:49.872 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.870+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=XBJPT919WPBG tag=YLCCFVKZKMGO type=write size=3770507 2024-09-12T17:18:49.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.874+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~AXH198J8U423.0 size=183013 2024-09-12T17:18:49.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.878+0000 7f96641d38c0 1 < completed multipart upload key=47QQRTJKM4DB upload=AXH198J8U423 tag=HGWSF5Y6SVG9 type=write size=1231589 2024-09-12T17:18:49.884 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.882+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~VK0OH685NWF6.0 size=277098 2024-09-12T17:18:49.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.882+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=VK0OH685NWF6 tag=1UJLB51W57M5 type=write size=1325674 2024-09-12T17:18:49.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.886+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=JMO84LNYUMTU type=del 2024-09-12T17:18:49.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.890+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=E8FMU4BU13FB type=del size=2481731 2024-09-12T17:18:49.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.894+0000 7f96641d38c0 1 < suggested update operation key=ZKDOIH5SH6K0 tag=0HTJ7RRW3GFX type=del size=3889602 2024-09-12T17:18:49.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.898+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=ZVAHOQHMS18G type=del size=438961 2024-09-12T17:18:49.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.898+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=8Z6GTO8C60F0 type=del 2024-09-12T17:18:49.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.906+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~NGZSHESZDWSW.0 size=1048576 2024-09-12T17:18:49.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.906+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~NGZSHESZDWSW.1 size=1048576 2024-09-12T17:18:49.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.910+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~NGZSHESZDWSW.2 size=384002 2024-09-12T17:18:49.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.910+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=NGZSHESZDWSW tag=Q1LIEO00045B type=write size=3529730 2024-09-12T17:18:49.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.910+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~M2IBJ9NA728B.0 size=1048576 2024-09-12T17:18:49.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.914+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~M2IBJ9NA728B.1 size=543763 2024-09-12T17:18:49.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.918+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=M2IBJ9NA728B tag=HESFPPVWT69J type=write size=2640915 2024-09-12T17:18:49.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.922+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=1DSU5CQNXU3V type=write size=410221 2024-09-12T17:18:49.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.926+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=9RJH79ZZJMJG type=del 2024-09-12T17:18:49.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.926+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=BGJ9RTL61SXD type=del size=2627111 2024-09-12T17:18:49.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.930+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=O4QMHA4C5JS3 type=del 2024-09-12T17:18:49.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.930+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=1FYEU03ADZG2 type=del size=1119205 2024-09-12T17:18:49.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.934+0000 7f96641d38c0 1 < canceled operation key=IR9JQ4MAEH0P tag=BEB9VAQK98PN type=del size=592827 2024-09-12T17:18:49.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.938+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=HTCHV72OKHKP type=del size=968552 2024-09-12T17:18:49.942 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.942+0000 7f96641d38c0 1 < completed delete operation key=5ZZI4F92J7BO tag=P8C81YWR0BEA type=del 2024-09-12T17:18:49.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.942+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=EHXGU63N7I2J type=del size=4057139 2024-09-12T17:18:49.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.946+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~W2NO0FJYPKII.0 size=1048576 2024-09-12T17:18:49.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.950+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~W2NO0FJYPKII.1 size=1048576 2024-09-12T17:18:49.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.950+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~W2NO0FJYPKII.2 size=1013351 2024-09-12T17:18:49.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.954+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=W2NO0FJYPKII tag=IDM2AMQ71BOI type=write size=4159079 2024-09-12T17:18:49.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.962+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~QIS7749FOBZJ.0 size=496674 2024-09-12T17:18:49.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.962+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=QIS7749FOBZJ tag=MZLJ1EY6QJD1 type=write size=1545250 2024-09-12T17:18:49.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.966+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=PFTSA9VYWOQG type=del 2024-09-12T17:18:49.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.970+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=46RTAH13QHSG type=del size=3180075 2024-09-12T17:18:49.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.974+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=T211A6I1FAVG type=del 2024-09-12T17:18:49.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.978+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=6GZH946TAA6H type=del size=1813755 2024-09-12T17:18:49.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.978+0000 7f96641d38c0 1 < completed delete operation key=3H8R2MJGR4SY tag=3DRSRH2MBX3C type=del 2024-09-12T17:18:49.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.982+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~7TJOGQ1BXEK1.0 size=1048576 2024-09-12T17:18:49.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.986+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~7TJOGQ1BXEK1.1 size=1048576 2024-09-12T17:18:49.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.990+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~7TJOGQ1BXEK1.2 size=734300 2024-09-12T17:18:49.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.990+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=7TJOGQ1BXEK1 tag=DHAC617J3YKC type=write size=3880028 2024-09-12T17:18:49.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.994+0000 7f96641d38c0 1 < suggested remove operation key=W40P2E1H5VT9 tag=FMYDHMQWPP2T type=write 2024-09-12T17:18:49.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.998+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=NFSAKQICNPPU type=del size=1461513 2024-09-12T17:18:50.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:49.998+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=G4NZ4FVBE3EU type=del 2024-09-12T17:18:50.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.002+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=ETN69XA00K1Z type=del size=2832206 2024-09-12T17:18:50.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.006+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~XBJPT919WPBG.0 size=1048576 2024-09-12T17:18:50.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.006+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~XBJPT919WPBG.1 size=1048576 2024-09-12T17:18:50.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.010+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~XBJPT919WPBG.2 size=624779 2024-09-12T17:18:50.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.014+0000 7f96641d38c0 1 < completed multipart upload key=G7CWVD9C2H2J upload=XBJPT919WPBG tag=YLCCFVKZKMGO type=write size=3770507 2024-09-12T17:18:50.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.018+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=XO9UZ3EOFO9Y type=del size=1883071 2024-09-12T17:18:50.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.022+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~VK0OH685NWF6.0 size=277098 2024-09-12T17:18:50.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.026+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=VK0OH685NWF6 tag=1UJLB51W57M5 type=write size=1325674 2024-09-12T17:18:50.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.030+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=PZ8ESHOK3RPF type=write size=79699 2024-09-12T17:18:50.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.030+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=E8FMU4BU13FB type=del 2024-09-12T17:18:50.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.038+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~135F54JAHZUH.0 size=125533 2024-09-12T17:18:50.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.038+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=135F54JAHZUH tag=8FXON4CHFI1X type=write size=1174109 2024-09-12T17:18:50.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.042+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=ZVAHOQHMS18G type=del 2024-09-12T17:18:50.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.042+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=B7PH6ZV0SSAO type=del size=730892 2024-09-12T17:18:50.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.046+0000 7f96641d38c0 1 < canceled part key=_multipart_5ZZI4F92J7BO.2~NGZSHESZDWSW.0 size=1048576 2024-09-12T17:18:50.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.046+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~NGZSHESZDWSW.1 size=1048576 2024-09-12T17:18:50.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.050+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~NGZSHESZDWSW.2 size=384002 2024-09-12T17:18:50.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.054+0000 7f96641d38c0 1 < canceled multipart upload key=5ZZI4F92J7BO upload=NGZSHESZDWSW tag=Q1LIEO00045B type=write size=3529730 2024-09-12T17:18:50.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.058+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=FOAR6R9U9IUY type=del size=1709963 2024-09-12T17:18:50.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.062+0000 7f96641d38c0 1 < completed write operation key=5ZZI4F92J7BO tag=1DSU5CQNXU3V type=write size=410221 2024-09-12T17:18:50.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.066+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~KDFO2CL47TZ8.0 size=921033 2024-09-12T17:18:50.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.066+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=KDFO2CL47TZ8 tag=HJL65TIJCATR type=write size=1969609 2024-09-12T17:18:50.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.070+0000 7f96641d38c0 1 < canceled operation key=0X2HHMHJUJNL tag=BGJ9RTL61SXD type=del size=2627111 2024-09-12T17:18:50.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.070+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=EBYCDP6HR2C6 type=del size=1196024 2024-09-12T17:18:50.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.078+0000 7f96641d38c0 1 < suggested remove operation key=DHODPSZ7Z0D4 tag=1FYEU03ADZG2 type=del 2024-09-12T17:18:50.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.082+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~BEA2DTDMK02B.0 size=1048576 2024-09-12T17:18:50.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.082+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~BEA2DTDMK02B.1 size=1048576 2024-09-12T17:18:50.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.086+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~BEA2DTDMK02B.2 size=549164 2024-09-12T17:18:50.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.086+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=BEA2DTDMK02B tag=3YN2P88HMVWD type=write size=3694892 2024-09-12T17:18:50.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.086+0000 7f96641d38c0 1 < completed delete operation key=NG327LT02T1F tag=HTCHV72OKHKP type=del 2024-09-12T17:18:50.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.090+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~OB8U42B02I9U.0 size=889737 2024-09-12T17:18:50.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.090+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=OB8U42B02I9U tag=0Q6SJBVSB9KE type=write size=1938313 2024-09-12T17:18:50.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.094+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=EHXGU63N7I2J type=del 2024-09-12T17:18:50.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.098+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~FKESKJBUWA3L.0 size=207327 2024-09-12T17:18:50.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.098+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=FKESKJBUWA3L tag=NP9JK2R8YECL type=write size=1255903 2024-09-12T17:18:50.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.098+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~QIS7749FOBZJ.0 size=496674 2024-09-12T17:18:50.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.102+0000 7f96641d38c0 1 < completed multipart upload key=G7CWVD9C2H2J upload=QIS7749FOBZJ tag=MZLJ1EY6QJD1 type=write size=1545250 2024-09-12T17:18:50.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.106+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~YKSHIGHWRXDF.0 size=630412 2024-09-12T17:18:50.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.106+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=YKSHIGHWRXDF tag=FWLK0NWI9W9J type=write size=1678988 2024-09-12T17:18:50.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.110+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=46RTAH13QHSG type=del 2024-09-12T17:18:50.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.110+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=NJWLENXZXPCC type=del size=753037 2024-09-12T17:18:50.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.114+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=6GZH946TAA6H type=del 2024-09-12T17:18:50.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.114+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=RAZOOX11MB3K type=del size=2853436 2024-09-12T17:18:50.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.118+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~7TJOGQ1BXEK1.0 size=1048576 2024-09-12T17:18:50.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.118+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~7TJOGQ1BXEK1.1 size=1048576 2024-09-12T17:18:50.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.122+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~7TJOGQ1BXEK1.2 size=734300 2024-09-12T17:18:50.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.122+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=7TJOGQ1BXEK1 tag=DHAC617J3YKC type=write size=3880028 2024-09-12T17:18:50.126 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.126+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=8CN6MFTRJAA8 type=del size=1052703 2024-09-12T17:18:50.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.126+0000 7f96641d38c0 1 < canceled operation key=IR9JQ4MAEH0P tag=NFSAKQICNPPU type=del size=1461513 2024-09-12T17:18:50.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.126+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=YYEV3J2PCA49 type=del size=3989775 2024-09-12T17:18:50.132 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.130+0000 7f96641d38c0 1 < suggested remove operation key=37YXLWPZGA9J tag=ETN69XA00K1Z type=del 2024-09-12T17:18:50.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.134+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=TF5HZAP25489 type=write size=618341 2024-09-12T17:18:50.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.134+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=XO9UZ3EOFO9Y type=del 2024-09-12T17:18:50.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.138+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=F4AL4A22CUUO type=del size=1495243 2024-09-12T17:18:50.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.138+0000 7f96641d38c0 1 < completed write operation key=6BH7SI911MMP tag=PZ8ESHOK3RPF type=write size=79699 2024-09-12T17:18:50.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.138+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=CR8SH8L83ETZ type=del size=3864322 2024-09-12T17:18:50.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.142+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~135F54JAHZUH.0 size=125533 2024-09-12T17:18:50.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.146+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=135F54JAHZUH tag=8FXON4CHFI1X type=write size=1174109 2024-09-12T17:18:50.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.146+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=VJ39HR4F08TL type=del size=663707 2024-09-12T17:18:50.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.150+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=B7PH6ZV0SSAO type=del 2024-09-12T17:18:50.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.150+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~JHGDB6A3RPIZ.0 size=90602 2024-09-12T17:18:50.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.150+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=JHGDB6A3RPIZ tag=LOHMO19O41MX type=write size=1139178 2024-09-12T17:18:50.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.154+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=FOAR6R9U9IUY type=del 2024-09-12T17:18:50.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.154+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=VKUX7BENKG0I type=del size=4125258 2024-09-12T17:18:50.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.154+0000 7f96641d38c0 1 < canceled part key=_multipart_W40P2E1H5VT9.2~KDFO2CL47TZ8.0 size=921033 2024-09-12T17:18:50.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.158+0000 7f96641d38c0 1 < canceled multipart upload key=W40P2E1H5VT9 upload=KDFO2CL47TZ8 tag=HJL65TIJCATR type=write size=1969609 2024-09-12T17:18:50.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.162+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~48JN86OKGRD1.0 size=1048576 2024-09-12T17:18:50.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.166+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~48JN86OKGRD1.1 size=1048576 2024-09-12T17:18:50.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.166+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~48JN86OKGRD1.2 size=1015420 2024-09-12T17:18:50.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.166+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=48JN86OKGRD1 tag=75CC30WJB7UF type=write size=4161148 2024-09-12T17:18:50.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.170+0000 7f96641d38c0 -1 < failed to complete operation key=DHODPSZ7Z0D4 tag=EBYCDP6HR2C6 type=del size=1196024: (22) Invalid argument 2024-09-12T17:18:50.174 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.174+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~PG2T2Z3TE1FC.0 size=1048483 2024-09-12T17:18:50.174 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.174+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=PG2T2Z3TE1FC tag=G07YHKX5RKS5 type=write size=2097059 2024-09-12T17:18:50.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.174+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~BEA2DTDMK02B.0 size=1048576 2024-09-12T17:18:50.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.178+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~BEA2DTDMK02B.1 size=1048576 2024-09-12T17:18:50.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.178+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~BEA2DTDMK02B.2 size=549164 2024-09-12T17:18:50.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.182+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=BEA2DTDMK02B tag=3YN2P88HMVWD type=write size=3694892 2024-09-12T17:18:50.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.186+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~0WO2CCSWCV7E.0 size=1048576 2024-09-12T17:18:50.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.186+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~0WO2CCSWCV7E.1 size=362473 2024-09-12T17:18:50.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.186+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=0WO2CCSWCV7E tag=0QTEVTTVKTPS type=write size=2459625 2024-09-12T17:18:50.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.194+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~OB8U42B02I9U.0 size=889737 2024-09-12T17:18:50.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.198+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=OB8U42B02I9U tag=0Q6SJBVSB9KE type=write size=1938313 2024-09-12T17:18:50.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.202+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=SZ25CS2IGRFH type=del size=2760015 2024-09-12T17:18:50.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.202+0000 7f96641d38c0 1 < canceled part key=_multipart_BDI9YFZCT5YY.2~FKESKJBUWA3L.0 size=207327 2024-09-12T17:18:50.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.206+0000 7f96641d38c0 1 < canceled multipart upload key=BDI9YFZCT5YY upload=FKESKJBUWA3L tag=NP9JK2R8YECL type=write size=1255903 2024-09-12T17:18:50.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.206+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=4NZ5HN6M70SW type=del size=2158026 2024-09-12T17:18:50.212 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.210+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~YKSHIGHWRXDF.0 size=630412 2024-09-12T17:18:50.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.214+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=YKSHIGHWRXDF tag=FWLK0NWI9W9J type=write size=1678988 2024-09-12T17:18:50.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.218+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=DESW4NF06W8T type=del size=2040985 2024-09-12T17:18:50.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.222+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=NJWLENXZXPCC type=del 2024-09-12T17:18:50.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.222+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=GUECGNSKMD2W type=del size=2924809 2024-09-12T17:18:50.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.226+0000 7f96641d38c0 1 < suggested update operation key=NR82RUK97NQA tag=RAZOOX11MB3K type=del size=2853436 2024-09-12T17:18:50.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.230+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=8EI79T99618F type=del size=452089 2024-09-12T17:18:50.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.230+0000 7f96641d38c0 1 < canceled operation key=HRU241T0FUEZ tag=8CN6MFTRJAA8 type=del size=1052703 2024-09-12T17:18:50.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.238+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~JSFBD2ZZCCIV.0 size=1048576 2024-09-12T17:18:50.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.238+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~JSFBD2ZZCCIV.1 size=876684 2024-09-12T17:18:50.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.238+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=JSFBD2ZZCCIV tag=FCX5FNAOCVE4 type=write size=2973836 2024-09-12T17:18:50.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.242+0000 7f96641d38c0 1 < suggested update operation key=XDL9O7TEMBYF tag=YYEV3J2PCA49 type=del size=3989775 2024-09-12T17:18:50.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.246+0000 7f96641d38c0 1 > prepared part key=_multipart_37YXLWPZGA9J.2~LMUKN66NUCHG.0 size=867028 2024-09-12T17:18:50.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.246+0000 7f96641d38c0 1 > prepared multipart upload key=37YXLWPZGA9J upload=LMUKN66NUCHG tag=FDNL8IKIPPYE type=write size=1915604 2024-09-12T17:18:50.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.250+0000 7f96641d38c0 1 < canceled operation key=3SLNHJT3A1K1 tag=TF5HZAP25489 type=write size=618341 2024-09-12T17:18:50.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.254+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~DL9L01L8ES4Y.0 size=1048576 2024-09-12T17:18:50.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.258+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~DL9L01L8ES4Y.1 size=1048576 2024-09-12T17:18:50.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.258+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~DL9L01L8ES4Y.2 size=900117 2024-09-12T17:18:50.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.258+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=DL9L01L8ES4Y tag=VWKZEFBL25WM type=write size=4045845 2024-09-12T17:18:50.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.262+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=F4AL4A22CUUO type=del 2024-09-12T17:18:50.266 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.266+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~D6BOLZN633O5.0 size=298933 2024-09-12T17:18:50.266 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.266+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=D6BOLZN633O5 tag=C741LPS95UH7 type=write size=1347509 2024-09-12T17:18:50.268 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.266+0000 7f96641d38c0 1 < canceled operation key=BDI9YFZCT5YY tag=CR8SH8L83ETZ type=del size=3864322 2024-09-12T17:18:50.270 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.270+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=VJ4PRKI86G8B type=write size=66827 2024-09-12T17:18:50.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.274+0000 7f96641d38c0 1 < suggested remove operation key=KXJYJ9VX7YVW tag=VJ39HR4F08TL type=del 2024-09-12T17:18:50.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.278+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~0FTRMM0N7BKY.0 size=589551 2024-09-12T17:18:50.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.278+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=0FTRMM0N7BKY tag=2OBDQRZV4J9T type=write size=1638127 2024-09-12T17:18:50.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.278+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~JHGDB6A3RPIZ.0 size=90602 2024-09-12T17:18:50.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.282+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=JHGDB6A3RPIZ tag=LOHMO19O41MX type=write size=1139178 2024-09-12T17:18:50.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.286+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~S2GYTPFUO5YV.0 size=1048576 2024-09-12T17:18:50.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.290+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~S2GYTPFUO5YV.1 size=664113 2024-09-12T17:18:50.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.290+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=S2GYTPFUO5YV tag=SI1F9X86WS4L type=write size=2761265 2024-09-12T17:18:50.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.294+0000 7f96641d38c0 1 < canceled operation key=IR9JQ4MAEH0P tag=VKUX7BENKG0I type=del size=4125258 2024-09-12T17:18:50.297 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.294+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~Q931U4Y2LALD.0 size=813435 2024-09-12T17:18:50.297 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.294+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=Q931U4Y2LALD tag=HT4P63JRUXWL type=write size=1862011 2024-09-12T17:18:50.299 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.298+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~48JN86OKGRD1.0 size=1048576 2024-09-12T17:18:50.301 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.298+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~48JN86OKGRD1.1 size=1048576 2024-09-12T17:18:50.301 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.298+0000 7f96641d38c0 1 < canceled part key=_multipart_NG327LT02T1F.2~48JN86OKGRD1.2 size=1015420 2024-09-12T17:18:50.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.302+0000 7f96641d38c0 1 < canceled multipart upload key=NG327LT02T1F upload=48JN86OKGRD1 tag=75CC30WJB7UF type=write size=4161148 2024-09-12T17:18:50.306 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.306+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=DKI3NDD4SX71 type=write size=494617 2024-09-12T17:18:50.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.306+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~PG2T2Z3TE1FC.0 size=1048483 2024-09-12T17:18:50.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.310+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=PG2T2Z3TE1FC tag=G07YHKX5RKS5 type=write size=2097059 2024-09-12T17:18:50.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.314+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=XUPDL3DXUFC5 type=del size=1604221 2024-09-12T17:18:50.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.314+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~0WO2CCSWCV7E.0 size=1048576 2024-09-12T17:18:50.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.318+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~0WO2CCSWCV7E.1 size=362473 2024-09-12T17:18:50.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.318+0000 7f96641d38c0 1 < completed multipart upload key=EFORFJYOM45R upload=0WO2CCSWCV7E tag=0QTEVTTVKTPS type=write size=2459625 2024-09-12T17:18:50.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.322+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~5QT1LS6DVYWQ.0 size=930612 2024-09-12T17:18:50.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.322+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=5QT1LS6DVYWQ tag=2W95XLZKFB2N type=write size=1979188 2024-09-12T17:18:50.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.326+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=SZ25CS2IGRFH type=del 2024-09-12T17:18:50.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.330+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=JG7HRV82Y1ZP type=del size=3236766 2024-09-12T17:18:50.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.330+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=4NZ5HN6M70SW type=del 2024-09-12T17:18:50.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.334+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~PHA6NRV45ZSK.0 size=272262 2024-09-12T17:18:50.336 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.334+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=PHA6NRV45ZSK tag=22XPSZTDMC28 type=write size=1320838 2024-09-12T17:18:50.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.338+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=DESW4NF06W8T type=del 2024-09-12T17:18:50.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.338+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~HPJK3WHCK25V.0 size=1048576 2024-09-12T17:18:50.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.342+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~HPJK3WHCK25V.1 size=1048576 2024-09-12T17:18:50.345 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.342+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~HPJK3WHCK25V.2 size=835239 2024-09-12T17:18:50.345 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.342+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=HPJK3WHCK25V tag=1BX0Y1EG3LYU type=write size=3980967 2024-09-12T17:18:50.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.346+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=GUECGNSKMD2W type=del 2024-09-12T17:18:50.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.346+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=NG1OWHVU73Z9 type=del size=3986083 2024-09-12T17:18:50.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.350+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=8EI79T99618F type=del 2024-09-12T17:18:50.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.354+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~UMIMJPMFEJ6I.0 size=1048576 2024-09-12T17:18:50.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.354+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~UMIMJPMFEJ6I.1 size=981966 2024-09-12T17:18:50.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.354+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=UMIMJPMFEJ6I tag=GO8TJP9TZYNF type=write size=3079118 2024-09-12T17:18:50.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.358+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~JSFBD2ZZCCIV.0 size=1048576 2024-09-12T17:18:50.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.358+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~JSFBD2ZZCCIV.1 size=876684 2024-09-12T17:18:50.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.362+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=JSFBD2ZZCCIV tag=FCX5FNAOCVE4 type=write size=2973836 2024-09-12T17:18:50.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.366+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=9DGJXLYRIV9N type=del size=2532785 2024-09-12T17:18:50.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.370+0000 7f96641d38c0 1 < completed part key=_multipart_37YXLWPZGA9J.2~LMUKN66NUCHG.0 size=867028 2024-09-12T17:18:50.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.370+0000 7f96641d38c0 1 < completed multipart upload key=37YXLWPZGA9J upload=LMUKN66NUCHG tag=FDNL8IKIPPYE type=write size=1915604 2024-09-12T17:18:50.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.374+0000 7f96641d38c0 1 > prepared part key=_multipart_RSVQJS9F1FR7.2~24PMGBTOI7NH.0 size=420828 2024-09-12T17:18:50.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.374+0000 7f96641d38c0 1 > prepared multipart upload key=RSVQJS9F1FR7 upload=24PMGBTOI7NH tag=T5L3XWW01NIN type=write size=1469404 2024-09-12T17:18:50.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.378+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~DL9L01L8ES4Y.0 size=1048576 2024-09-12T17:18:50.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.378+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~DL9L01L8ES4Y.1 size=1048576 2024-09-12T17:18:50.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.378+0000 7f96641d38c0 1 < canceled part key=_multipart_47QQRTJKM4DB.2~DL9L01L8ES4Y.2 size=900117 2024-09-12T17:18:50.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.382+0000 7f96641d38c0 1 < canceled multipart upload key=47QQRTJKM4DB upload=DL9L01L8ES4Y tag=VWKZEFBL25WM type=write size=4045845 2024-09-12T17:18:50.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.386+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=RMR8E831GC25 type=del size=691514 2024-09-12T17:18:50.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.386+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~D6BOLZN633O5.0 size=298933 2024-09-12T17:18:50.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.390+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=D6BOLZN633O5 tag=C741LPS95UH7 type=write size=1347509 2024-09-12T17:18:50.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.390+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=EOKKS2DPNY4A type=write size=842137 2024-09-12T17:18:50.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.394+0000 7f96641d38c0 1 < completed write operation key=NGA3P9RZJYWT tag=VJ4PRKI86G8B type=write size=66827 2024-09-12T17:18:50.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.394+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=ZODO8ZW25IH8 type=del size=1508401 2024-09-12T17:18:50.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.394+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~0FTRMM0N7BKY.0 size=589551 2024-09-12T17:18:50.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.398+0000 7f96641d38c0 1 < completed multipart upload key=0X2HHMHJUJNL upload=0FTRMM0N7BKY tag=2OBDQRZV4J9T type=write size=1638127 2024-09-12T17:18:50.402 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.402+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=05MV5DWOZZQO type=del size=3027080 2024-09-12T17:18:50.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.402+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~S2GYTPFUO5YV.0 size=1048576 2024-09-12T17:18:50.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.402+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~S2GYTPFUO5YV.1 size=664113 2024-09-12T17:18:50.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.406+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=S2GYTPFUO5YV tag=SI1F9X86WS4L type=write size=2761265 2024-09-12T17:18:50.410 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.410+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~3O35REGB3QMO.0 size=1048576 2024-09-12T17:18:50.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.410+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~3O35REGB3QMO.1 size=1048576 2024-09-12T17:18:50.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.410+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~3O35REGB3QMO.2 size=852105 2024-09-12T17:18:50.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.410+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=3O35REGB3QMO tag=5BL5AJA9MTNO type=write size=3997833 2024-09-12T17:18:50.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.414+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~Q931U4Y2LALD.0 size=813435 2024-09-12T17:18:50.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.414+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=Q931U4Y2LALD tag=HT4P63JRUXWL type=write size=1862011 2024-09-12T17:18:50.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.418+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=JAYCT356BMFC type=del size=1101386 2024-09-12T17:18:50.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.418+0000 7f96641d38c0 1 < completed write operation key=6BH7SI911MMP tag=DKI3NDD4SX71 type=write size=494617 2024-09-12T17:18:50.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.418+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=F3V1746CBTBI type=del size=3618663 2024-09-12T17:18:50.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.422+0000 7f96641d38c0 1 < canceled operation key=H3J23KLT1VUT tag=XUPDL3DXUFC5 type=del size=1604221 2024-09-12T17:18:50.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.422+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=9XB7OWX8UGBY type=del size=3288793 2024-09-12T17:18:50.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.426+0000 7f96641d38c0 1 < completed part key=_multipart_W40P2E1H5VT9.2~5QT1LS6DVYWQ.0 size=930612 2024-09-12T17:18:50.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.426+0000 7f96641d38c0 1 < completed multipart upload key=W40P2E1H5VT9 upload=5QT1LS6DVYWQ tag=2W95XLZKFB2N type=write size=1979188 2024-09-12T17:18:50.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.430+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~NIF7DYSF3UF7.0 size=366232 2024-09-12T17:18:50.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.430+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=NIF7DYSF3UF7 tag=DUHHF1ZUTF54 type=write size=1414808 2024-09-12T17:18:50.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.434+0000 7f96641d38c0 1 < suggested remove operation key=ZKDOIH5SH6K0 tag=JG7HRV82Y1ZP type=del 2024-09-12T17:18:50.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.434+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=HXGLG3N46E2I type=write size=477298 2024-09-12T17:18:50.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.438+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~PHA6NRV45ZSK.0 size=272262 2024-09-12T17:18:50.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.438+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=PHA6NRV45ZSK tag=22XPSZTDMC28 type=write size=1320838 2024-09-12T17:18:50.442 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.442+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=ZG35DVZTCNB3 type=del size=1449548 2024-09-12T17:18:50.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.442+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~HPJK3WHCK25V.0 size=1048576 2024-09-12T17:18:50.445 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.442+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~HPJK3WHCK25V.1 size=1048576 2024-09-12T17:18:50.446 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.446+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~HPJK3WHCK25V.2 size=835239 2024-09-12T17:18:50.449 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.446+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=HPJK3WHCK25V tag=1BX0Y1EG3LYU type=write size=3980967 2024-09-12T17:18:50.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.450+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=SYJ7B56NX4JP type=del size=783472 2024-09-12T17:18:50.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.450+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=NG1OWHVU73Z9 type=del 2024-09-12T17:18:50.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.454+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=7ELA9009554F type=del size=278517 2024-09-12T17:18:50.456 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.454+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~UMIMJPMFEJ6I.0 size=1048576 2024-09-12T17:18:50.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.454+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~UMIMJPMFEJ6I.1 size=981966 2024-09-12T17:18:50.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.458+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=UMIMJPMFEJ6I tag=GO8TJP9TZYNF type=write size=3079118 2024-09-12T17:18:50.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.458+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=29AJHABI4HGI type=del size=3945730 2024-09-12T17:18:50.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.462+0000 7f96641d38c0 1 < canceled operation key=47QQRTJKM4DB tag=9DGJXLYRIV9N type=del size=2532785 2024-09-12T17:18:50.466 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.466+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~D4PMTYCKRBY2.0 size=1048576 2024-09-12T17:18:50.468 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.466+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~D4PMTYCKRBY2.1 size=1048576 2024-09-12T17:18:50.470 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.470+0000 7f96641d38c0 1 > prepared part key=_multipart_DHODPSZ7Z0D4.2~D4PMTYCKRBY2.2 size=919245 2024-09-12T17:18:50.470 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.470+0000 7f96641d38c0 1 > prepared multipart upload key=DHODPSZ7Z0D4 upload=D4PMTYCKRBY2 tag=JDQASUSNSPRR type=write size=4064973 2024-09-12T17:18:50.472 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.470+0000 7f96641d38c0 1 < completed part key=_multipart_RSVQJS9F1FR7.2~24PMGBTOI7NH.0 size=420828 2024-09-12T17:18:50.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.474+0000 7f96641d38c0 1 < completed multipart upload key=RSVQJS9F1FR7 upload=24PMGBTOI7NH tag=T5L3XWW01NIN type=write size=1469404 2024-09-12T17:18:50.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.474+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=FFFJP8D4WB29 type=del size=2576528 2024-09-12T17:18:50.479 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.478+0000 7f96641d38c0 1 < suggested remove operation key=37YXLWPZGA9J tag=RMR8E831GC25 type=del 2024-09-12T17:18:50.481 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.478+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=YJQ3ASDWN35A type=del size=457276 2024-09-12T17:18:50.482 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.482+0000 7f96641d38c0 1 < completed write operation key=47QQRTJKM4DB tag=EOKKS2DPNY4A type=write size=842137 2024-09-12T17:18:50.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.486+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~29G21IDX3NSL.0 size=136495 2024-09-12T17:18:50.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.486+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=29G21IDX3NSL tag=EZT9GYHSV9DZ type=write size=1185071 2024-09-12T17:18:50.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.486+0000 7f96641d38c0 1 < completed delete operation key=L9HUVE5A5NGT tag=ZODO8ZW25IH8 type=del 2024-09-12T17:18:50.491 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.490+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~0E35XMVSBH8D.0 size=1048576 2024-09-12T17:18:50.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.490+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~0E35XMVSBH8D.1 size=1048576 2024-09-12T17:18:50.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.494+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~0E35XMVSBH8D.2 size=555640 2024-09-12T17:18:50.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.494+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=0E35XMVSBH8D tag=O25MD3JDET8W type=write size=3701368 2024-09-12T17:18:50.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.494+0000 7f96641d38c0 -1 < failed to complete operation key=ZKDOIH5SH6K0 tag=05MV5DWOZZQO type=del size=3027080: (22) Invalid argument 2024-09-12T17:18:50.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.494+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=JR1VPD8125R6 type=write size=747499 2024-09-12T17:18:50.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.498+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~3O35REGB3QMO.0 size=1048576 2024-09-12T17:18:50.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.498+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~3O35REGB3QMO.1 size=1048576 2024-09-12T17:18:50.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.502+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~3O35REGB3QMO.2 size=852105 2024-09-12T17:18:50.506 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.506+0000 7f96641d38c0 1 < completed multipart upload key=HRU241T0FUEZ upload=3O35REGB3QMO tag=5BL5AJA9MTNO type=write size=3997833 2024-09-12T17:18:50.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.510+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~GL5BQMG8IQVX.0 size=1048576 2024-09-12T17:18:50.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.510+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~GL5BQMG8IQVX.1 size=1048576 2024-09-12T17:18:50.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.510+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~GL5BQMG8IQVX.2 size=696015 2024-09-12T17:18:50.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.510+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=GL5BQMG8IQVX tag=YNEL1YZ4RZOI type=write size=3841743 2024-09-12T17:18:50.518 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.518+0000 7f96641d38c0 1 < suggested update operation key=2TN3M8NKV9LN tag=JAYCT356BMFC type=del size=1101386 2024-09-12T17:18:50.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.522+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~0U1DY4V2H364.0 size=1048576 2024-09-12T17:18:50.523 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.522+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~0U1DY4V2H364.1 size=61936 2024-09-12T17:18:50.524 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.522+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=0U1DY4V2H364 tag=4Y0RAIME2RFP type=write size=2159088 2024-09-12T17:18:50.526 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.526+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=F3V1746CBTBI type=del 2024-09-12T17:18:50.528 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.526+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=PE869BJ73U9V type=write size=360253 2024-09-12T17:18:50.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.530+0000 7f96641d38c0 1 < completed delete operation key=UBYUSW4C2V19 tag=9XB7OWX8UGBY type=del 2024-09-12T17:18:50.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.530+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~8GJTPMYZ4I2Q.0 size=817814 2024-09-12T17:18:50.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.530+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=8GJTPMYZ4I2Q tag=6WIOBOUMD3CP type=write size=1866390 2024-09-12T17:18:50.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.534+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~NIF7DYSF3UF7.0 size=366232 2024-09-12T17:18:50.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.538+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=NIF7DYSF3UF7 tag=DUHHF1ZUTF54 type=write size=1414808 2024-09-12T17:18:50.541 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.538+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=5MZCRU7RJ109 type=del size=3544407 2024-09-12T17:18:50.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.542+0000 7f96641d38c0 1 < canceled operation key=L9HUVE5A5NGT tag=HXGLG3N46E2I type=write size=477298 2024-09-12T17:18:50.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.546+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=NP5X6X2XI367 type=write size=196196 2024-09-12T17:18:50.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.546+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=ZG35DVZTCNB3 type=del 2024-09-12T17:18:50.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.550+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=1YBH8T03NWAR type=del size=4055370 2024-09-12T17:18:50.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.550+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=SYJ7B56NX4JP type=del 2024-09-12T17:18:50.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.554+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=QVO7A3WD3HIV type=write size=862327 2024-09-12T17:18:50.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.554+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=7ELA9009554F type=del 2024-09-12T17:18:50.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.558+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=C51WCAN8QVIQ type=write size=803035 2024-09-12T17:18:50.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.558+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=29AJHABI4HGI type=del 2024-09-12T17:18:50.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.562+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=8FVM0OCX1XHJ type=del size=2136301 2024-09-12T17:18:50.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.562+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~D4PMTYCKRBY2.0 size=1048576 2024-09-12T17:18:50.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.566+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~D4PMTYCKRBY2.1 size=1048576 2024-09-12T17:18:50.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.570+0000 7f96641d38c0 1 < completed part key=_multipart_DHODPSZ7Z0D4.2~D4PMTYCKRBY2.2 size=919245 2024-09-12T17:18:50.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.574+0000 7f96641d38c0 1 < completed multipart upload key=DHODPSZ7Z0D4 upload=D4PMTYCKRBY2 tag=JDQASUSNSPRR type=write size=4064973 2024-09-12T17:18:50.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.574+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~E2RRXX9GHCQJ.0 size=546480 2024-09-12T17:18:50.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.578+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=E2RRXX9GHCQJ tag=30N56LV310EJ type=write size=1595056 2024-09-12T17:18:50.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.578+0000 7f96641d38c0 1 < canceled operation key=ZKDOIH5SH6K0 tag=FFFJP8D4WB29 type=del size=2576528 2024-09-12T17:18:50.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.582+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=ITOQ6GCOMTTR type=del size=159977 2024-09-12T17:18:50.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.582+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=YJQ3ASDWN35A type=del 2024-09-12T17:18:50.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.582+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=MS7KPPIBN1L6 type=del size=3000749 2024-09-12T17:18:50.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.586+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~29G21IDX3NSL.0 size=136495 2024-09-12T17:18:50.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.590+0000 7f96641d38c0 1 < completed multipart upload key=NGA3P9RZJYWT upload=29G21IDX3NSL tag=EZT9GYHSV9DZ type=write size=1185071 2024-09-12T17:18:50.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.594+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~BJVRK3NXF12T.0 size=457972 2024-09-12T17:18:50.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.594+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=BJVRK3NXF12T tag=85B6U88HJJ6E type=write size=1506548 2024-09-12T17:18:50.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.594+0000 7f96641d38c0 1 < canceled part key=_multipart_5ZZI4F92J7BO.2~0E35XMVSBH8D.0 size=1048576 2024-09-12T17:18:50.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.594+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~0E35XMVSBH8D.1 size=1048576 2024-09-12T17:18:50.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.598+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~0E35XMVSBH8D.2 size=555640 2024-09-12T17:18:50.601 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.598+0000 7f96641d38c0 1 < canceled multipart upload key=5ZZI4F92J7BO upload=0E35XMVSBH8D tag=O25MD3JDET8W type=write size=3701368 2024-09-12T17:18:50.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.602+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=DVCFR1TLD2YR type=del size=872990 2024-09-12T17:18:50.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.602+0000 7f96641d38c0 1 < completed write operation key=NR82RUK97NQA tag=JR1VPD8125R6 type=write size=747499 2024-09-12T17:18:50.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.606+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=2CGCW4LG5AS3 type=del size=3539219 2024-09-12T17:18:50.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.606+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~GL5BQMG8IQVX.0 size=1048576 2024-09-12T17:18:50.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.618+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~GL5BQMG8IQVX.1 size=1048576 2024-09-12T17:18:50.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.618+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~GL5BQMG8IQVX.2 size=696015 2024-09-12T17:18:50.660 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.622+0000 7f96641d38c0 1 < completed multipart upload key=HRU241T0FUEZ upload=GL5BQMG8IQVX tag=YNEL1YZ4RZOI type=write size=3841743 2024-09-12T17:18:50.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.662+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~O8V7UFKYO6G2.0 size=1048576 2024-09-12T17:18:50.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.662+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~O8V7UFKYO6G2.1 size=1048576 2024-09-12T17:18:50.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.666+0000 7f96641d38c0 1 > prepared part key=_multipart_3SLNHJT3A1K1.2~O8V7UFKYO6G2.2 size=679631 2024-09-12T17:18:50.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.666+0000 7f96641d38c0 1 > prepared multipart upload key=3SLNHJT3A1K1 upload=O8V7UFKYO6G2 tag=4I4623GDT4ZE type=write size=3825359 2024-09-12T17:18:50.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.670+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~0U1DY4V2H364.0 size=1048576 2024-09-12T17:18:50.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.670+0000 7f96641d38c0 1 < canceled part key=_multipart_47QQRTJKM4DB.2~0U1DY4V2H364.1 size=61936 2024-09-12T17:18:50.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.674+0000 7f96641d38c0 1 < canceled multipart upload key=47QQRTJKM4DB upload=0U1DY4V2H364 tag=4Y0RAIME2RFP type=write size=2159088 2024-09-12T17:18:50.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.682+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~ZWIFNR0J43N6.0 size=194574 2024-09-12T17:18:50.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.682+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=ZWIFNR0J43N6 tag=RHDUUAQ3GA4D type=write size=1243150 2024-09-12T17:18:50.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.686+0000 7f96641d38c0 1 < completed write operation key=G7CWVD9C2H2J tag=PE869BJ73U9V type=write size=360253 2024-09-12T17:18:50.694 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.694+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~KYFB1NDY0CVM.0 size=1048576 2024-09-12T17:18:50.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.694+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~KYFB1NDY0CVM.1 size=1048576 2024-09-12T17:18:50.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.698+0000 7f96641d38c0 1 > prepared part key=_multipart_NGA3P9RZJYWT.2~KYFB1NDY0CVM.2 size=680278 2024-09-12T17:18:50.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.698+0000 7f96641d38c0 1 > prepared multipart upload key=NGA3P9RZJYWT upload=KYFB1NDY0CVM tag=XPHAJAV8HORQ type=write size=3826006 2024-09-12T17:18:50.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.702+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~8GJTPMYZ4I2Q.0 size=817814 2024-09-12T17:18:50.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.706+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=8GJTPMYZ4I2Q tag=6WIOBOUMD3CP type=write size=1866390 2024-09-12T17:18:50.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.710+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=36UIJ8JVZ82Q type=del size=144798 2024-09-12T17:18:50.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.714+0000 7f96641d38c0 1 < canceled operation key=0X2HHMHJUJNL tag=5MZCRU7RJ109 type=del size=3544407 2024-09-12T17:18:50.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.722+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~L9BVBMH33JYS.0 size=513365 2024-09-12T17:18:50.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.722+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=L9BVBMH33JYS tag=S8K0Y4C139R2 type=write size=1561941 2024-09-12T17:18:50.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.722+0000 7f96641d38c0 1 < completed write operation key=L9HUVE5A5NGT tag=NP5X6X2XI367 type=write size=196196 2024-09-12T17:18:50.728 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.726+0000 7f96641d38c0 1 > prepared operation key=3H8R2MJGR4SY tag=1KF8YHERLMMN type=write size=423185 2024-09-12T17:18:50.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.730+0000 7f96641d38c0 1 < completed delete operation key=5ZZI4F92J7BO tag=1YBH8T03NWAR type=del 2024-09-12T17:18:50.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.734+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=8GLLFKPW4X5P type=del size=2666941 2024-09-12T17:18:50.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.738+0000 7f96641d38c0 1 < completed write operation key=DHODPSZ7Z0D4 tag=QVO7A3WD3HIV type=write size=862327 2024-09-12T17:18:50.744 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.742+0000 7f96641d38c0 1 > prepared part key=_multipart_XDL9O7TEMBYF.2~3GCFW4JF8CU7.0 size=360380 2024-09-12T17:18:50.744 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.742+0000 7f96641d38c0 1 > prepared multipart upload key=XDL9O7TEMBYF upload=3GCFW4JF8CU7 tag=VQQOOWI2VOT8 type=write size=1408956 2024-09-12T17:18:50.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.746+0000 7f96641d38c0 1 < completed write operation key=NGA3P9RZJYWT tag=C51WCAN8QVIQ type=write size=803035 2024-09-12T17:18:50.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.750+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=Y0E5ME92BQQQ type=del size=2618789 2024-09-12T17:18:50.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.754+0000 7f96641d38c0 1 < suggested remove operation key=ZKDOIH5SH6K0 tag=8FVM0OCX1XHJ type=del 2024-09-12T17:18:50.759 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.758+0000 7f96641d38c0 1 > prepared operation key=DHODPSZ7Z0D4 tag=7GL3K24FPICM type=del size=2538561 2024-09-12T17:18:50.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.762+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~E2RRXX9GHCQJ.0 size=546480 2024-09-12T17:18:50.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.766+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=E2RRXX9GHCQJ tag=30N56LV310EJ type=write size=1595056 2024-09-12T17:18:50.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.774+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~J3PEW73XIH5G.0 size=961324 2024-09-12T17:18:50.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.774+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=J3PEW73XIH5G tag=33QKOQDEICAP type=write size=2009900 2024-09-12T17:18:50.782 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.782+0000 7f96641d38c0 1 < suggested update operation key=3H8R2MJGR4SY tag=ITOQ6GCOMTTR type=del size=159977 2024-09-12T17:18:50.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.782+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=T2J2WI4DJMAD type=del size=1705895 2024-09-12T17:18:50.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.786+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=MS7KPPIBN1L6 type=del 2024-09-12T17:18:50.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.794+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~6T0MJ8NE9SGZ.0 size=1048576 2024-09-12T17:18:50.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.794+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~6T0MJ8NE9SGZ.1 size=316904 2024-09-12T17:18:50.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.794+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=6T0MJ8NE9SGZ tag=OA5LT3UVC841 type=write size=2414056 2024-09-12T17:18:50.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.798+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~BJVRK3NXF12T.0 size=457972 2024-09-12T17:18:50.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.802+0000 7f96641d38c0 1 < completed multipart upload key=NGA3P9RZJYWT upload=BJVRK3NXF12T tag=85B6U88HJJ6E type=write size=1506548 2024-09-12T17:18:50.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.806+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~PQC0E1KO99N0.0 size=259126 2024-09-12T17:18:50.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.806+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=PQC0E1KO99N0 tag=JNF206O2R9WP type=write size=1307702 2024-09-12T17:18:50.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.810+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=DVCFR1TLD2YR type=del 2024-09-12T17:18:50.816 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.814+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=ZZN76Y9URQY7 type=del size=525127 2024-09-12T17:18:50.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.822+0000 7f96641d38c0 1 < suggested update operation key=W40P2E1H5VT9 tag=2CGCW4LG5AS3 type=del size=3539219 2024-09-12T17:18:50.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.826+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~0MDRQ61UTW8T.0 size=1048576 2024-09-12T17:18:50.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.830+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~0MDRQ61UTW8T.1 size=841758 2024-09-12T17:18:50.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.830+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=0MDRQ61UTW8T tag=M2VYRSBV9L0N type=write size=2938910 2024-09-12T17:18:50.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.834+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~O8V7UFKYO6G2.0 size=1048576 2024-09-12T17:18:50.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.834+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~O8V7UFKYO6G2.1 size=1048576 2024-09-12T17:18:50.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.838+0000 7f96641d38c0 1 < completed part key=_multipart_3SLNHJT3A1K1.2~O8V7UFKYO6G2.2 size=679631 2024-09-12T17:18:50.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.846+0000 7f96641d38c0 1 < completed multipart upload key=3SLNHJT3A1K1 upload=O8V7UFKYO6G2 tag=4I4623GDT4ZE type=write size=3825359 2024-09-12T17:18:50.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.846+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=D78YLSLARI1V type=del size=2295560 2024-09-12T17:18:50.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.850+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~ZWIFNR0J43N6.0 size=194574 2024-09-12T17:18:50.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.858+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=ZWIFNR0J43N6 tag=RHDUUAQ3GA4D type=write size=1243150 2024-09-12T17:18:50.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.862+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~0FB768509ZJT.0 size=1048576 2024-09-12T17:18:50.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.866+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~0FB768509ZJT.1 size=1048576 2024-09-12T17:18:50.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.866+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~0FB768509ZJT.2 size=2658 2024-09-12T17:18:50.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.866+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=0FB768509ZJT tag=H0NM6WESCM9L type=write size=3148386 2024-09-12T17:18:50.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.870+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~KYFB1NDY0CVM.0 size=1048576 2024-09-12T17:18:50.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.874+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~KYFB1NDY0CVM.1 size=1048576 2024-09-12T17:18:50.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.878+0000 7f96641d38c0 1 < completed part key=_multipart_NGA3P9RZJYWT.2~KYFB1NDY0CVM.2 size=680278 2024-09-12T17:18:50.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.890+0000 7f96641d38c0 1 < completed multipart upload key=NGA3P9RZJYWT upload=KYFB1NDY0CVM tag=XPHAJAV8HORQ type=write size=3826006 2024-09-12T17:18:50.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.894+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=HWEIJMNCW2SB type=del size=1656148 2024-09-12T17:18:50.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.894+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=36UIJ8JVZ82Q type=del 2024-09-12T17:18:50.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.902+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~O7A0ODX09FBY.0 size=1048576 2024-09-12T17:18:50.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.906+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~O7A0ODX09FBY.1 size=1048576 2024-09-12T17:18:50.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.906+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~O7A0ODX09FBY.2 size=996718 2024-09-12T17:18:50.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.906+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=O7A0ODX09FBY tag=YZLXLY5IQI1H type=write size=4142446 2024-09-12T17:18:50.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.910+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~L9BVBMH33JYS.0 size=513365 2024-09-12T17:18:50.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.914+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=L9BVBMH33JYS tag=S8K0Y4C139R2 type=write size=1561941 2024-09-12T17:18:50.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.918+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=RSAREH4OB69Z type=del size=1773615 2024-09-12T17:18:50.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.926+0000 7f96641d38c0 1 < suggested update operation key=3H8R2MJGR4SY tag=1KF8YHERLMMN type=write size=423185 2024-09-12T17:18:50.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.926+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=TPKGLW27ITSO type=del size=2452522 2024-09-12T17:18:50.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.930+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=8GLLFKPW4X5P type=del 2024-09-12T17:18:50.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.934+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=VJO0AMCYVA9P type=del size=579628 2024-09-12T17:18:50.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.934+0000 7f96641d38c0 1 < canceled part key=_multipart_XDL9O7TEMBYF.2~3GCFW4JF8CU7.0 size=360380 2024-09-12T17:18:50.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.938+0000 7f96641d38c0 1 < canceled multipart upload key=XDL9O7TEMBYF upload=3GCFW4JF8CU7 tag=VQQOOWI2VOT8 type=write size=1408956 2024-09-12T17:18:50.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.942+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=L2MWGINOM0AC type=del size=576430 2024-09-12T17:18:51.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.946+0000 7f96641d38c0 1 < completed delete operation key=G7CWVD9C2H2J tag=Y0E5ME92BQQQ type=del 2024-09-12T17:18:51.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.954+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~10LAL9INV7CH.0 size=1048576 2024-09-12T17:18:51.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.954+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~10LAL9INV7CH.1 size=1048576 2024-09-12T17:18:51.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.958+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~10LAL9INV7CH.2 size=307057 2024-09-12T17:18:51.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.958+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=10LAL9INV7CH tag=AUV0JSM8D8SU type=write size=3452785 2024-09-12T17:18:51.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.962+0000 7f96641d38c0 1 < completed delete operation key=DHODPSZ7Z0D4 tag=7GL3K24FPICM type=del 2024-09-12T17:18:51.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.962+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=6E9N0X0X07GI type=del size=3673994 2024-09-12T17:18:51.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.966+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~J3PEW73XIH5G.0 size=961324 2024-09-12T17:18:51.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.970+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=J3PEW73XIH5G tag=33QKOQDEICAP type=write size=2009900 2024-09-12T17:18:51.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.978+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~Z0J2R29C1C1U.0 size=1048576 2024-09-12T17:18:51.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.978+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~Z0J2R29C1C1U.1 size=97730 2024-09-12T17:18:51.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.978+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=Z0J2R29C1C1U tag=LBQE02AHVRLT type=write size=2194882 2024-09-12T17:18:51.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.982+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=T2J2WI4DJMAD type=del 2024-09-12T17:18:51.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.986+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=QJKGK9JDWZIB type=del size=1707770 2024-09-12T17:18:51.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.990+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~6T0MJ8NE9SGZ.0 size=1048576 2024-09-12T17:18:51.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.994+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~6T0MJ8NE9SGZ.1 size=316904 2024-09-12T17:18:51.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:50.998+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=6T0MJ8NE9SGZ tag=OA5LT3UVC841 type=write size=2414056 2024-09-12T17:18:51.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.002+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~LCX39VL0D5LO.0 size=1048576 2024-09-12T17:18:51.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.006+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~LCX39VL0D5LO.1 size=1048576 2024-09-12T17:18:51.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.010+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~LCX39VL0D5LO.2 size=35550 2024-09-12T17:18:51.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.010+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=LCX39VL0D5LO tag=H9B24GO9VDZV type=write size=3181278 2024-09-12T17:18:51.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.014+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~PQC0E1KO99N0.0 size=259126 2024-09-12T17:18:51.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.018+0000 7f96641d38c0 1 < completed multipart upload key=NR82RUK97NQA upload=PQC0E1KO99N0 tag=JNF206O2R9WP type=write size=1307702 2024-09-12T17:18:51.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.022+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=TKBCWU2D8SEK type=del size=243339 2024-09-12T17:18:51.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.030+0000 7f96641d38c0 1 < suggested update operation key=BDI9YFZCT5YY tag=ZZN76Y9URQY7 type=del size=525127 2024-09-12T17:18:51.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.034+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=D02AMNU9JZ1C type=write size=457270 2024-09-12T17:18:51.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.038+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~0MDRQ61UTW8T.0 size=1048576 2024-09-12T17:18:51.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.038+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~0MDRQ61UTW8T.1 size=841758 2024-09-12T17:18:51.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.046+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=0MDRQ61UTW8T tag=M2VYRSBV9L0N type=write size=2938910 2024-09-12T17:18:51.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.046+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=BBSBXPLKN51D type=del size=3073348 2024-09-12T17:18:51.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.054+0000 7f96641d38c0 1 < suggested update operation key=2TN3M8NKV9LN tag=D78YLSLARI1V type=del size=2295560 2024-09-12T17:18:51.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.058+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~JVL87V6GIQK4.0 size=1048576 2024-09-12T17:18:51.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.062+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~JVL87V6GIQK4.1 size=1048576 2024-09-12T17:18:51.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.066+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~JVL87V6GIQK4.2 size=1045301 2024-09-12T17:18:51.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.066+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=JVL87V6GIQK4 tag=BCBM6EGCEKKQ type=write size=4191029 2024-09-12T17:18:51.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.066+0000 7f96641d38c0 1 < canceled part key=_multipart_8TU2VZOHL1ZZ.2~0FB768509ZJT.0 size=1048576 2024-09-12T17:18:51.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.066+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~0FB768509ZJT.1 size=1048576 2024-09-12T17:18:51.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.070+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~0FB768509ZJT.2 size=2658 2024-09-12T17:18:51.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.074+0000 7f96641d38c0 1 < canceled multipart upload key=8TU2VZOHL1ZZ upload=0FB768509ZJT tag=H0NM6WESCM9L type=write size=3148386 2024-09-12T17:18:51.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.078+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=CJKBU9PEYMJO type=del size=961577 2024-09-12T17:18:51.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.082+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=HWEIJMNCW2SB type=del 2024-09-12T17:18:51.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.086+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=EJXRBMHF041A type=del size=3280976 2024-09-12T17:18:51.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.090+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~O7A0ODX09FBY.0 size=1048576 2024-09-12T17:18:51.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.090+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~O7A0ODX09FBY.1 size=1048576 2024-09-12T17:18:51.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.094+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~O7A0ODX09FBY.2 size=996718 2024-09-12T17:18:51.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.098+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=O7A0ODX09FBY tag=YZLXLY5IQI1H type=write size=4142446 2024-09-12T17:18:51.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.102+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=27IOMX66QZF0 type=write size=348665 2024-09-12T17:18:51.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.106+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=RSAREH4OB69Z type=del 2024-09-12T17:18:51.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.110+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=4E78HEHRNJLK type=del size=2986884 2024-09-12T17:18:51.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.114+0000 7f96641d38c0 1 < completed delete operation key=NR82RUK97NQA tag=TPKGLW27ITSO type=del 2024-09-12T17:18:51.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.118+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=3LEA2R8WVJ7I type=del size=1263804 2024-09-12T17:18:51.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.122+0000 7f96641d38c0 1 < suggested remove operation key=RSVQJS9F1FR7 tag=VJO0AMCYVA9P type=del 2024-09-12T17:18:51.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.130+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~G3ZENZ3SEH9M.0 size=621771 2024-09-12T17:18:51.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.130+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=G3ZENZ3SEH9M tag=AV1ZHEHM0N4L type=write size=1670347 2024-09-12T17:18:51.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.134+0000 7f96641d38c0 1 < suggested update operation key=6BH7SI911MMP tag=L2MWGINOM0AC type=del size=576430 2024-09-12T17:18:51.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.138+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=ZL9G81XQC6Q7 type=del size=1717007 2024-09-12T17:18:51.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.142+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~10LAL9INV7CH.0 size=1048576 2024-09-12T17:18:51.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.146+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~10LAL9INV7CH.1 size=1048576 2024-09-12T17:18:51.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.150+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~10LAL9INV7CH.2 size=307057 2024-09-12T17:18:51.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.154+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=10LAL9INV7CH tag=AUV0JSM8D8SU type=write size=3452785 2024-09-12T17:18:51.159 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.158+0000 7f96641d38c0 1 > prepared operation key=3SLNHJT3A1K1 tag=VCPK7600CP0I type=del size=319718 2024-09-12T17:18:51.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.162+0000 7f96641d38c0 1 < completed delete operation key=0X2HHMHJUJNL tag=6E9N0X0X07GI type=del 2024-09-12T17:18:51.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.166+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~APHGFJ3ACVG2.0 size=1048576 2024-09-12T17:18:51.171 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.170+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~APHGFJ3ACVG2.1 size=1048576 2024-09-12T17:18:51.174 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.174+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~APHGFJ3ACVG2.2 size=412460 2024-09-12T17:18:51.174 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.174+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=APHGFJ3ACVG2 tag=H85WW26QFVP1 type=write size=3558188 2024-09-12T17:18:51.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.174+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~Z0J2R29C1C1U.0 size=1048576 2024-09-12T17:18:51.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.178+0000 7f96641d38c0 1 < completed part key=_multipart_5ZZI4F92J7BO.2~Z0J2R29C1C1U.1 size=97730 2024-09-12T17:18:51.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.182+0000 7f96641d38c0 1 < completed multipart upload key=5ZZI4F92J7BO upload=Z0J2R29C1C1U tag=LBQE02AHVRLT type=write size=2194882 2024-09-12T17:18:51.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.190+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=KKHXGYASHL96 type=del size=1497650 2024-09-12T17:18:51.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.194+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=QJKGK9JDWZIB type=del 2024-09-12T17:18:51.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.198+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=U0U767H03KB9 type=del size=765268 2024-09-12T17:18:51.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.202+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~LCX39VL0D5LO.0 size=1048576 2024-09-12T17:18:51.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.202+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~LCX39VL0D5LO.1 size=1048576 2024-09-12T17:18:51.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.206+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~LCX39VL0D5LO.2 size=35550 2024-09-12T17:18:51.214 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.214+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=LCX39VL0D5LO tag=H9B24GO9VDZV type=write size=3181278 2024-09-12T17:18:51.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.218+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~LOQT44QECHMD.0 size=1048576 2024-09-12T17:18:51.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.222+0000 7f96641d38c0 1 > prepared part key=_multipart_0X2HHMHJUJNL.2~LOQT44QECHMD.1 size=130487 2024-09-12T17:18:51.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.222+0000 7f96641d38c0 1 > prepared multipart upload key=0X2HHMHJUJNL upload=LOQT44QECHMD tag=74JO5ICM6DF7 type=write size=2227639 2024-09-12T17:18:51.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.226+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=TKBCWU2D8SEK type=del 2024-09-12T17:18:51.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.230+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=3HPQFKHF2JDB type=del size=450616 2024-09-12T17:18:51.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.238+0000 7f96641d38c0 1 < suggested update operation key=IR9JQ4MAEH0P tag=D02AMNU9JZ1C type=write size=457270 2024-09-12T17:18:51.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.238+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=VYF6R89O208W type=del size=387488 2024-09-12T17:18:51.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.242+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=BBSBXPLKN51D type=del 2024-09-12T17:18:51.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.246+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=OOOEKWRT0EC8 type=del size=564311 2024-09-12T17:18:51.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.250+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~JVL87V6GIQK4.0 size=1048576 2024-09-12T17:18:51.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.254+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~JVL87V6GIQK4.1 size=1048576 2024-09-12T17:18:51.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.254+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~JVL87V6GIQK4.2 size=1045301 2024-09-12T17:18:51.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.262+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=JVL87V6GIQK4 tag=BCBM6EGCEKKQ type=write size=4191029 2024-09-12T17:18:51.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.262+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=R0PR9ZMV8YTK type=del size=422927 2024-09-12T17:18:51.268 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.266+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=CJKBU9PEYMJO type=del 2024-09-12T17:18:51.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.270+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=L96NNM37DHK1 type=del size=4071345 2024-09-12T17:18:51.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.274+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=EJXRBMHF041A type=del 2024-09-12T17:18:51.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.274+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=0WKGR4STDD65 type=del size=3188426 2024-09-12T17:18:51.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.278+0000 7f96641d38c0 1 < completed write operation key=5ZZI4F92J7BO tag=27IOMX66QZF0 type=write size=348665 2024-09-12T17:18:51.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.282+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=OF9843HQJZKE type=del size=3780230 2024-09-12T17:18:51.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.290+0000 7f96641d38c0 1 < suggested update operation key=HRU241T0FUEZ tag=4E78HEHRNJLK type=del size=2986884 2024-09-12T17:18:51.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.294+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~Q8XJORIVUJ1T.0 size=1048576 2024-09-12T17:18:51.299 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.298+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~Q8XJORIVUJ1T.1 size=1048576 2024-09-12T17:18:51.301 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.298+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~Q8XJORIVUJ1T.2 size=991666 2024-09-12T17:18:51.301 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.298+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=Q8XJORIVUJ1T tag=QN691HM4PBK3 type=write size=4137394 2024-09-12T17:18:51.305 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.302+0000 7f96641d38c0 -1 < failed to complete operation key=IR9JQ4MAEH0P tag=3LEA2R8WVJ7I type=del size=1263804: (22) Invalid argument 2024-09-12T17:18:51.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.310+0000 7f96641d38c0 1 > prepared part key=_multipart_UBYUSW4C2V19.2~AUEARGGE1B3L.0 size=1040768 2024-09-12T17:18:51.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.310+0000 7f96641d38c0 1 > prepared multipart upload key=UBYUSW4C2V19 upload=AUEARGGE1B3L tag=3QAY60W6XECX type=write size=2089344 2024-09-12T17:18:51.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.314+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~G3ZENZ3SEH9M.0 size=621771 2024-09-12T17:18:51.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.318+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=G3ZENZ3SEH9M tag=AV1ZHEHM0N4L type=write size=1670347 2024-09-12T17:18:51.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.326+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~52CU9YUCGF0K.0 size=1048576 2024-09-12T17:18:51.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.326+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~52CU9YUCGF0K.1 size=634827 2024-09-12T17:18:51.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.326+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=52CU9YUCGF0K tag=Z34Z9J56Z0KQ type=write size=2731979 2024-09-12T17:18:51.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.330+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=ZL9G81XQC6Q7 type=del 2024-09-12T17:18:51.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.334+0000 7f96641d38c0 1 > prepared operation key=LK3F25OHR7AO tag=I07XYYFHV6V6 type=del size=761866 2024-09-12T17:18:51.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.338+0000 7f96641d38c0 1 < completed delete operation key=3SLNHJT3A1K1 tag=VCPK7600CP0I type=del 2024-09-12T17:18:51.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.338+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=HUP1CYDAZQ8B type=del size=2742781 2024-09-12T17:18:51.345 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.342+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~APHGFJ3ACVG2.0 size=1048576 2024-09-12T17:18:51.345 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.342+0000 7f96641d38c0 1 < canceled part key=_multipart_GKJJDBNXC6QH.2~APHGFJ3ACVG2.1 size=1048576 2024-09-12T17:18:51.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.346+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~APHGFJ3ACVG2.2 size=412460 2024-09-12T17:18:51.353 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.350+0000 7f96641d38c0 1 < canceled multipart upload key=GKJJDBNXC6QH upload=APHGFJ3ACVG2 tag=H85WW26QFVP1 type=write size=3558188 2024-09-12T17:18:51.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.354+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=C5SOXI0S27H6 type=write size=828412 2024-09-12T17:18:51.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.358+0000 7f96641d38c0 1 < canceled operation key=NR82RUK97NQA tag=KKHXGYASHL96 type=del size=1497650 2024-09-12T17:18:51.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.362+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=2PYH0UC2XG2J type=write size=966486 2024-09-12T17:18:51.369 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.366+0000 7f96641d38c0 1 < suggested remove operation key=UBYUSW4C2V19 tag=U0U767H03KB9 type=del 2024-09-12T17:18:51.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.370+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=G9K0CV6B0ZKO type=write size=973669 2024-09-12T17:18:51.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.374+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~LOQT44QECHMD.0 size=1048576 2024-09-12T17:18:51.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.374+0000 7f96641d38c0 1 < completed part key=_multipart_0X2HHMHJUJNL.2~LOQT44QECHMD.1 size=130487 2024-09-12T17:18:51.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.382+0000 7f96641d38c0 1 < completed multipart upload key=0X2HHMHJUJNL upload=LOQT44QECHMD tag=74JO5ICM6DF7 type=write size=2227639 2024-09-12T17:18:51.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.386+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=3B3UC5LDVQW6 type=del size=3864856 2024-09-12T17:18:51.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.386+0000 7f96641d38c0 -1 < failed to complete operation key=HRU241T0FUEZ tag=3HPQFKHF2JDB type=del size=450616: (22) Invalid argument 2024-09-12T17:18:51.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.390+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~6SGI82IGCY2X.0 size=1048576 2024-09-12T17:18:51.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.394+0000 7f96641d38c0 1 > prepared part key=_multipart_NR82RUK97NQA.2~6SGI82IGCY2X.1 size=227575 2024-09-12T17:18:51.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.394+0000 7f96641d38c0 1 > prepared multipart upload key=NR82RUK97NQA upload=6SGI82IGCY2X tag=FT8TF70WEOTH type=write size=2324727 2024-09-12T17:18:51.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.398+0000 7f96641d38c0 1 < suggested remove operation key=9CBFWXFX7O3N tag=VYF6R89O208W type=del 2024-09-12T17:18:51.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.402+0000 7f96641d38c0 1 > prepared operation key=BDI9YFZCT5YY tag=AMDIFI0NW860 type=write size=482216 2024-09-12T17:18:51.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.406+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=OOOEKWRT0EC8 type=del 2024-09-12T17:18:51.409 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.406+0000 7f96641d38c0 1 > prepared operation key=GKJJDBNXC6QH tag=2EXD7R325NA4 type=write size=595303 2024-09-12T17:18:51.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.410+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=R0PR9ZMV8YTK type=del 2024-09-12T17:18:51.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.414+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=BUO61EGKPD6T type=del size=165612 2024-09-12T17:18:51.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.418+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=L96NNM37DHK1 type=del 2024-09-12T17:18:51.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.422+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=ULD04QUSPH0N type=write size=291221 2024-09-12T17:18:51.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.426+0000 7f96641d38c0 1 < completed delete operation key=H3LV5G117KOW tag=0WKGR4STDD65 type=del 2024-09-12T17:18:51.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.430+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=8HYA400L92VA type=del size=2978653 2024-09-12T17:18:51.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.430+0000 7f96641d38c0 1 < completed delete operation key=GKJJDBNXC6QH tag=OF9843HQJZKE type=del 2024-09-12T17:18:51.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.434+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=BQH2FTZI59GJ type=del size=3398887 2024-09-12T17:18:51.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.438+0000 7f96641d38c0 1 < canceled part key=_multipart_HRU241T0FUEZ.2~Q8XJORIVUJ1T.0 size=1048576 2024-09-12T17:18:51.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.438+0000 7f96641d38c0 1 < canceled part key=_multipart_HRU241T0FUEZ.2~Q8XJORIVUJ1T.1 size=1048576 2024-09-12T17:18:51.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.438+0000 7f96641d38c0 1 < completed part key=_multipart_HRU241T0FUEZ.2~Q8XJORIVUJ1T.2 size=991666 2024-09-12T17:18:51.446 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.446+0000 7f96641d38c0 1 < canceled multipart upload key=HRU241T0FUEZ upload=Q8XJORIVUJ1T tag=QN691HM4PBK3 type=write size=4137394 2024-09-12T17:18:51.450 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.450+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=HOZ16SLNDVOY type=del size=4071188 2024-09-12T17:18:51.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.454+0000 7f96641d38c0 1 < completed part key=_multipart_UBYUSW4C2V19.2~AUEARGGE1B3L.0 size=1040768 2024-09-12T17:18:51.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.458+0000 7f96641d38c0 1 < completed multipart upload key=UBYUSW4C2V19 upload=AUEARGGE1B3L tag=3QAY60W6XECX type=write size=2089344 2024-09-12T17:18:51.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.462+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=HK9I4601B30O type=del size=1280495 2024-09-12T17:18:51.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.462+0000 7f96641d38c0 1 < canceled part key=_multipart_6BH7SI911MMP.2~52CU9YUCGF0K.0 size=1048576 2024-09-12T17:18:51.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.462+0000 7f96641d38c0 1 < canceled part key=_multipart_6BH7SI911MMP.2~52CU9YUCGF0K.1 size=634827 2024-09-12T17:18:51.468 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.466+0000 7f96641d38c0 1 < canceled multipart upload key=6BH7SI911MMP upload=52CU9YUCGF0K tag=Z34Z9J56Z0KQ type=write size=2731979 2024-09-12T17:18:51.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.470+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=37Y5NELBYVA2 type=del size=1638494 2024-09-12T17:18:51.475 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.474+0000 7f96641d38c0 1 < completed delete operation key=LK3F25OHR7AO tag=I07XYYFHV6V6 type=del 2024-09-12T17:18:51.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.478+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~FN2YWGF7PC8C.0 size=634080 2024-09-12T17:18:51.481 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.478+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=FN2YWGF7PC8C tag=CS94ZW63X3G8 type=write size=1682656 2024-09-12T17:18:51.483 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.482+0000 7f96641d38c0 -1 < failed to complete operation key=9CBFWXFX7O3N tag=HUP1CYDAZQ8B type=del size=2742781: (22) Invalid argument 2024-09-12T17:18:51.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.490+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~PD37ZN8CGHP1.0 size=853976 2024-09-12T17:18:51.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.490+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=PD37ZN8CGHP1 tag=MH1QPSJMZ2OT type=write size=1902552 2024-09-12T17:18:51.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.494+0000 7f96641d38c0 1 < completed write operation key=37YXLWPZGA9J tag=C5SOXI0S27H6 type=write size=828412 2024-09-12T17:18:51.505 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.502+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~FN1VU7YX03D8.0 size=1048576 2024-09-12T17:18:51.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.506+0000 7f96641d38c0 1 > prepared part key=_multipart_KXJYJ9VX7YVW.2~FN1VU7YX03D8.1 size=743323 2024-09-12T17:18:51.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.506+0000 7f96641d38c0 1 > prepared multipart upload key=KXJYJ9VX7YVW upload=FN1VU7YX03D8 tag=5ZNYQN6NB80E type=write size=2840475 2024-09-12T17:18:51.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.510+0000 7f96641d38c0 1 < completed write operation key=EFORFJYOM45R tag=2PYH0UC2XG2J type=write size=966486 2024-09-12T17:18:51.517 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.514+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=QC85SDUBIFIO type=del size=1379263 2024-09-12T17:18:51.521 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.518+0000 7f96641d38c0 1 < canceled operation key=37YXLWPZGA9J tag=G9K0CV6B0ZKO type=write size=973669 2024-09-12T17:18:51.525 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.522+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=UENU8OBXUWV6 type=del size=3091508 2024-09-12T17:18:51.528 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.526+0000 7f96641d38c0 1 < completed delete operation key=BDI9YFZCT5YY tag=3B3UC5LDVQW6 type=del 2024-09-12T17:18:51.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.534+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~P6YA0IGU0TO8.0 size=861087 2024-09-12T17:18:51.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.534+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=P6YA0IGU0TO8 tag=LWBKTXVILEKJ type=write size=1909663 2024-09-12T17:18:51.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.538+0000 7f96641d38c0 1 < completed part key=_multipart_NR82RUK97NQA.2~6SGI82IGCY2X.0 size=1048576 2024-09-12T17:18:51.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.538+0000 7f96641d38c0 1 < canceled part key=_multipart_NR82RUK97NQA.2~6SGI82IGCY2X.1 size=227575 2024-09-12T17:18:51.544 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.542+0000 7f96641d38c0 1 < canceled multipart upload key=NR82RUK97NQA upload=6SGI82IGCY2X tag=FT8TF70WEOTH type=write size=2324727 2024-09-12T17:18:51.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.546+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=Q9IQS94UUBT8 type=del size=3960426 2024-09-12T17:18:51.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.550+0000 7f96641d38c0 1 < completed write operation key=BDI9YFZCT5YY tag=AMDIFI0NW860 type=write size=482216 2024-09-12T17:18:51.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.554+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=NEII3L5YZ6RN type=del size=1633322 2024-09-12T17:18:51.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.554+0000 7f96641d38c0 1 < canceled operation key=GKJJDBNXC6QH tag=2EXD7R325NA4 type=write size=595303 2024-09-12T17:18:51.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.562+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~SJMD3F8PLZMP.0 size=733205 2024-09-12T17:18:51.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.562+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=SJMD3F8PLZMP tag=XRO9E4HY0ST1 type=write size=1781781 2024-09-12T17:18:51.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.566+0000 7f96641d38c0 1 < completed delete operation key=EFORFJYOM45R tag=BUO61EGKPD6T type=del 2024-09-12T17:18:51.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.570+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~Q7SS6430UJTB.0 size=1048576 2024-09-12T17:18:51.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.574+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~Q7SS6430UJTB.1 size=862884 2024-09-12T17:18:51.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.574+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=Q7SS6430UJTB tag=SEDNPX1QFZQG type=write size=2960036 2024-09-12T17:18:51.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.578+0000 7f96641d38c0 1 < completed write operation key=HRU241T0FUEZ tag=ULD04QUSPH0N type=write size=291221 2024-09-12T17:18:51.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.582+0000 7f96641d38c0 1 > prepared part key=_multipart_XTVZIXTEES2O.2~IYZVZ0VM2J1A.0 size=709944 2024-09-12T17:18:51.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.582+0000 7f96641d38c0 1 > prepared multipart upload key=XTVZIXTEES2O upload=IYZVZ0VM2J1A tag=FKHZESGANV11 type=write size=1758520 2024-09-12T17:18:51.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.586+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=8HYA400L92VA type=del 2024-09-12T17:18:51.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.590+0000 7f96641d38c0 1 > prepared operation key=EFORFJYOM45R tag=A3YCN26X0GCH type=del size=3641717 2024-09-12T17:18:51.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.594+0000 7f96641d38c0 1 < suggested remove operation key=XDL9O7TEMBYF tag=BQH2FTZI59GJ type=del 2024-09-12T17:18:51.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.602+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~6XRZSLRA93VA.0 size=1048576 2024-09-12T17:18:51.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.602+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~6XRZSLRA93VA.1 size=1048576 2024-09-12T17:18:51.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.606+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~6XRZSLRA93VA.2 size=144356 2024-09-12T17:18:51.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.606+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=6XRZSLRA93VA tag=JMFWQJJX5WAJ type=write size=3290084 2024-09-12T17:18:51.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.610+0000 7f96641d38c0 1 < completed delete operation key=MOQXP4AXMTCK tag=HOZ16SLNDVOY type=del 2024-09-12T17:18:51.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.614+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~LXJ6AX8Y07Z9.0 size=1048576 2024-09-12T17:18:51.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.618+0000 7f96641d38c0 1 > prepared part key=_multipart_ZKDOIH5SH6K0.2~LXJ6AX8Y07Z9.1 size=125006 2024-09-12T17:18:51.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.618+0000 7f96641d38c0 1 > prepared multipart upload key=ZKDOIH5SH6K0 upload=LXJ6AX8Y07Z9 tag=ZOGUG84O675M type=write size=2222158 2024-09-12T17:18:51.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.622+0000 7f96641d38c0 1 < canceled operation key=KXJYJ9VX7YVW tag=HK9I4601B30O type=del size=1280495 2024-09-12T17:18:51.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.626+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=NDJMQN6U2DCI type=del size=244713 2024-09-12T17:18:51.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.626+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=37Y5NELBYVA2 type=del 2024-09-12T17:18:51.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.630+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=YSNDC103S1F4 type=del size=1795555 2024-09-12T17:18:51.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.634+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~FN2YWGF7PC8C.0 size=634080 2024-09-12T17:18:51.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.638+0000 7f96641d38c0 1 < completed multipart upload key=47QQRTJKM4DB upload=FN2YWGF7PC8C tag=CS94ZW63X3G8 type=write size=1682656 2024-09-12T17:18:51.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.642+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=MR8U04JFX75V type=del size=743426 2024-09-12T17:18:51.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.646+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~PD37ZN8CGHP1.0 size=853976 2024-09-12T17:18:51.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.650+0000 7f96641d38c0 1 < completed multipart upload key=8TU2VZOHL1ZZ upload=PD37ZN8CGHP1 tag=MH1QPSJMZ2OT type=write size=1902552 2024-09-12T17:18:51.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.658+0000 7f96641d38c0 1 > prepared part key=_multipart_MOQXP4AXMTCK.2~2MUSDO86MV6F.0 size=884603 2024-09-12T17:18:51.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.658+0000 7f96641d38c0 1 > prepared multipart upload key=MOQXP4AXMTCK upload=2MUSDO86MV6F tag=EOU061XL2ETN type=write size=1933179 2024-09-12T17:18:51.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.662+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~FN1VU7YX03D8.0 size=1048576 2024-09-12T17:18:51.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.662+0000 7f96641d38c0 1 < completed part key=_multipart_KXJYJ9VX7YVW.2~FN1VU7YX03D8.1 size=743323 2024-09-12T17:18:51.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.670+0000 7f96641d38c0 1 < completed multipart upload key=KXJYJ9VX7YVW upload=FN1VU7YX03D8 tag=5ZNYQN6NB80E type=write size=2840475 2024-09-12T17:18:51.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.674+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~ZA61L4A659SY.0 size=1048576 2024-09-12T17:18:51.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.678+0000 7f96641d38c0 1 > prepared part key=_multipart_6BH7SI911MMP.2~ZA61L4A659SY.1 size=730449 2024-09-12T17:18:51.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.678+0000 7f96641d38c0 1 > prepared multipart upload key=6BH7SI911MMP upload=ZA61L4A659SY tag=T3VDWVPG3Y1F type=write size=2827601 2024-09-12T17:18:51.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.682+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=QC85SDUBIFIO type=del 2024-09-12T17:18:51.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.686+0000 7f96641d38c0 1 > prepared operation key=KXJYJ9VX7YVW tag=VJ3FM6UFJ13W type=write size=659078 2024-09-12T17:18:51.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.686+0000 7f96641d38c0 1 < completed delete operation key=5ZZI4F92J7BO tag=UENU8OBXUWV6 type=del 2024-09-12T17:18:51.693 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.690+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=81Z8ZLZ6069B type=del size=411387 2024-09-12T17:18:51.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.694+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~P6YA0IGU0TO8.0 size=861087 2024-09-12T17:18:51.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.698+0000 7f96641d38c0 1 < completed multipart upload key=G7CWVD9C2H2J upload=P6YA0IGU0TO8 tag=LWBKTXVILEKJ type=write size=1909663 2024-09-12T17:18:51.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.702+0000 7f96641d38c0 1 > prepared operation key=HRU241T0FUEZ tag=KZ91NDAQMJA0 type=write size=434067 2024-09-12T17:18:51.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.706+0000 7f96641d38c0 -1 < failed to complete operation key=XDL9O7TEMBYF tag=Q9IQS94UUBT8 type=del size=3960426: (22) Invalid argument 2024-09-12T17:18:51.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.714+0000 7f96641d38c0 1 > prepared part key=_multipart_H3J23KLT1VUT.2~4B8QBNLTE8RW.0 size=416269 2024-09-12T17:18:51.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.714+0000 7f96641d38c0 1 > prepared multipart upload key=H3J23KLT1VUT upload=4B8QBNLTE8RW tag=J8FJ2CF1S6AA type=write size=1464845 2024-09-12T17:18:51.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.718+0000 7f96641d38c0 1 < completed delete operation key=47QQRTJKM4DB tag=NEII3L5YZ6RN type=del 2024-09-12T17:18:51.721 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.718+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=J1BD2YOPPM07 type=del size=1285317 2024-09-12T17:18:51.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.722+0000 7f96641d38c0 1 < completed part key=_multipart_G7CWVD9C2H2J.2~SJMD3F8PLZMP.0 size=733205 2024-09-12T17:18:51.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.730+0000 7f96641d38c0 1 < completed multipart upload key=G7CWVD9C2H2J upload=SJMD3F8PLZMP tag=XRO9E4HY0ST1 type=write size=1781781 2024-09-12T17:18:51.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.730+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=2MHBGQ8305I0 type=del size=3490228 2024-09-12T17:18:51.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.734+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~Q7SS6430UJTB.0 size=1048576 2024-09-12T17:18:51.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.738+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~Q7SS6430UJTB.1 size=862884 2024-09-12T17:18:51.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.742+0000 7f96641d38c0 1 < completed multipart upload key=2TN3M8NKV9LN upload=Q7SS6430UJTB tag=SEDNPX1QFZQG type=write size=2960036 2024-09-12T17:18:51.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.746+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=0374I70S3NI5 type=del size=2081769 2024-09-12T17:18:51.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.750+0000 7f96641d38c0 1 < completed part key=_multipart_XTVZIXTEES2O.2~IYZVZ0VM2J1A.0 size=709944 2024-09-12T17:18:51.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.754+0000 7f96641d38c0 1 < completed multipart upload key=XTVZIXTEES2O upload=IYZVZ0VM2J1A tag=FKHZESGANV11 type=write size=1758520 2024-09-12T17:18:51.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.758+0000 7f96641d38c0 1 > prepared operation key=G7CWVD9C2H2J tag=LEHFZW0VB19F type=del size=3273151 2024-09-12T17:18:51.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.762+0000 7f96641d38c0 1 < suggested remove operation key=EFORFJYOM45R tag=A3YCN26X0GCH type=del 2024-09-12T17:18:51.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.766+0000 7f96641d38c0 1 > prepared operation key=H3LV5G117KOW tag=QXV5DPE7GQBW type=del size=463276 2024-09-12T17:18:51.770 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.770+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~6XRZSLRA93VA.0 size=1048576 2024-09-12T17:18:51.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.770+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~6XRZSLRA93VA.1 size=1048576 2024-09-12T17:18:51.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.774+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~6XRZSLRA93VA.2 size=144356 2024-09-12T17:18:51.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.778+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=6XRZSLRA93VA tag=JMFWQJJX5WAJ type=write size=3290084 2024-09-12T17:18:51.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.782+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=RMP8C4FEL6OQ type=write size=836687 2024-09-12T17:18:51.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.786+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~LXJ6AX8Y07Z9.0 size=1048576 2024-09-12T17:18:51.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.786+0000 7f96641d38c0 1 < completed part key=_multipart_ZKDOIH5SH6K0.2~LXJ6AX8Y07Z9.1 size=125006 2024-09-12T17:18:51.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.794+0000 7f96641d38c0 1 < completed multipart upload key=ZKDOIH5SH6K0 upload=LXJ6AX8Y07Z9 tag=ZOGUG84O675M type=write size=2222158 2024-09-12T17:18:51.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.798+0000 7f96641d38c0 1 > prepared part key=_multipart_LK3F25OHR7AO.2~DDXYUHN833TM.0 size=529210 2024-09-12T17:18:51.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.798+0000 7f96641d38c0 1 > prepared multipart upload key=LK3F25OHR7AO upload=DDXYUHN833TM tag=FI9TTVB8RE43 type=write size=1577786 2024-09-12T17:18:51.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.802+0000 7f96641d38c0 1 < completed delete operation key=HRU241T0FUEZ tag=NDJMQN6U2DCI type=del 2024-09-12T17:18:51.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.810+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~ZWLJ0FXWZJYK.0 size=1048576 2024-09-12T17:18:51.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.814+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~ZWLJ0FXWZJYK.1 size=148985 2024-09-12T17:18:51.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.814+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=ZWLJ0FXWZJYK tag=ZRGNUQW734GN type=write size=2246137 2024-09-12T17:18:51.818 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.818+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=YSNDC103S1F4 type=del 2024-09-12T17:18:51.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.818+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=VT0X23ZWRDZG type=write size=969373 2024-09-12T17:18:51.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.822+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=MR8U04JFX75V type=del 2024-09-12T17:18:51.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.826+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~AVNQUN82348W.0 size=1048576 2024-09-12T17:18:51.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.830+0000 7f96641d38c0 1 > prepared part key=_multipart_GKJJDBNXC6QH.2~AVNQUN82348W.1 size=477234 2024-09-12T17:18:51.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.830+0000 7f96641d38c0 1 > prepared multipart upload key=GKJJDBNXC6QH upload=AVNQUN82348W tag=LVSOHWT028Z9 type=write size=2574386 2024-09-12T17:18:51.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.834+0000 7f96641d38c0 1 < completed part key=_multipart_MOQXP4AXMTCK.2~2MUSDO86MV6F.0 size=884603 2024-09-12T17:18:51.839 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.838+0000 7f96641d38c0 1 < completed multipart upload key=MOQXP4AXMTCK upload=2MUSDO86MV6F tag=EOU061XL2ETN type=write size=1933179 2024-09-12T17:18:51.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.842+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=T4GFU3TI7NJN type=del size=1787633 2024-09-12T17:18:51.844 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.842+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~ZA61L4A659SY.0 size=1048576 2024-09-12T17:18:51.847 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.846+0000 7f96641d38c0 1 < completed part key=_multipart_6BH7SI911MMP.2~ZA61L4A659SY.1 size=730449 2024-09-12T17:18:51.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.850+0000 7f96641d38c0 1 < completed multipart upload key=6BH7SI911MMP upload=ZA61L4A659SY tag=T3VDWVPG3Y1F type=write size=2827601 2024-09-12T17:18:51.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.854+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~NF21GLS6Z8D7.0 size=1048576 2024-09-12T17:18:51.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.858+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~NF21GLS6Z8D7.1 size=1048576 2024-09-12T17:18:51.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.858+0000 7f96641d38c0 1 > prepared part key=_multipart_EFORFJYOM45R.2~NF21GLS6Z8D7.2 size=882560 2024-09-12T17:18:51.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.858+0000 7f96641d38c0 1 > prepared multipart upload key=EFORFJYOM45R upload=NF21GLS6Z8D7 tag=N7OE4X8D5UJW type=write size=4028288 2024-09-12T17:18:51.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.866+0000 7f96641d38c0 1 < suggested remove operation key=KXJYJ9VX7YVW tag=VJ3FM6UFJ13W type=write 2024-09-12T17:18:51.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.866+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=Q2PCIJI0UCP5 type=del size=283755 2024-09-12T17:18:51.872 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.870+0000 7f96641d38c0 1 < completed delete operation key=H3J23KLT1VUT tag=81Z8ZLZ6069B type=del 2024-09-12T17:18:51.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.874+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=3F0WCNRURMNC type=del size=3522166 2024-09-12T17:18:51.880 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.878+0000 7f96641d38c0 1 < suggested update operation key=HRU241T0FUEZ tag=KZ91NDAQMJA0 type=write size=434067 2024-09-12T17:18:51.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.882+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~47SOBYB2H0O2.0 size=1048576 2024-09-12T17:18:51.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.886+0000 7f96641d38c0 1 > prepared part key=_multipart_H3LV5G117KOW.2~47SOBYB2H0O2.1 size=698591 2024-09-12T17:18:51.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.886+0000 7f96641d38c0 1 > prepared multipart upload key=H3LV5G117KOW upload=47SOBYB2H0O2 tag=1DSM1BWOO065 type=write size=2795743 2024-09-12T17:18:51.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.890+0000 7f96641d38c0 1 < completed part key=_multipart_H3J23KLT1VUT.2~4B8QBNLTE8RW.0 size=416269 2024-09-12T17:18:51.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.894+0000 7f96641d38c0 1 < completed multipart upload key=H3J23KLT1VUT upload=4B8QBNLTE8RW tag=J8FJ2CF1S6AA type=write size=1464845 2024-09-12T17:18:51.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.898+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~71GBW0UH91FV.0 size=1048576 2024-09-12T17:18:51.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.902+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~71GBW0UH91FV.1 size=1048576 2024-09-12T17:18:51.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.906+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~71GBW0UH91FV.2 size=689536 2024-09-12T17:18:51.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.906+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=71GBW0UH91FV tag=DB17F31ZIJ9K type=write size=3835264 2024-09-12T17:18:51.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.910+0000 7f96641d38c0 1 < suggested remove operation key=G7CWVD9C2H2J tag=J1BD2YOPPM07 type=del 2024-09-12T17:18:51.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.914+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=8N1B7SO1TXPV type=del size=615750 2024-09-12T17:18:51.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.918+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=2MHBGQ8305I0 type=del 2024-09-12T17:18:51.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.918+0000 7f96641d38c0 1 > prepared operation key=W40P2E1H5VT9 tag=GGYDVEE9HPY0 type=del size=3866313 2024-09-12T17:18:51.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.922+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=0374I70S3NI5 type=del 2024-09-12T17:18:51.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.926+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=C78GI18QA335 type=del size=778456 2024-09-12T17:18:51.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.926+0000 7f96641d38c0 -1 < no bi entry to suggest for operation key=G7CWVD9C2H2J tag=LEHFZW0VB19F type=del size=3273151: (2) No such file or directory 2024-09-12T17:18:51.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.930+0000 7f96641d38c0 1 > prepared part key=_multipart_3H8R2MJGR4SY.2~RKGAFA4ACN49.0 size=104394 2024-09-12T17:18:51.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.930+0000 7f96641d38c0 1 > prepared multipart upload key=3H8R2MJGR4SY upload=RKGAFA4ACN49 tag=VBXU1OB1WU32 type=write size=1152970 2024-09-12T17:18:51.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.934+0000 7f96641d38c0 1 < canceled operation key=H3LV5G117KOW tag=QXV5DPE7GQBW type=del size=463276 2024-09-12T17:18:51.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.938+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=3Z4ONKBXHTA1 type=del size=590132 2024-09-12T17:18:51.942 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.942+0000 7f96641d38c0 1 < canceled operation key=NGA3P9RZJYWT tag=RMP8C4FEL6OQ type=write size=836687 2024-09-12T17:18:51.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.946+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~17Y3GL7H1IP5.0 size=1048576 2024-09-12T17:18:51.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.946+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~17Y3GL7H1IP5.1 size=1048576 2024-09-12T17:18:51.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.950+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~17Y3GL7H1IP5.2 size=294600 2024-09-12T17:18:51.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.950+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=17Y3GL7H1IP5 tag=E1V1AI7VC9RZ type=write size=3440328 2024-09-12T17:18:51.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.954+0000 7f96641d38c0 1 < completed part key=_multipart_LK3F25OHR7AO.2~DDXYUHN833TM.0 size=529210 2024-09-12T17:18:51.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.958+0000 7f96641d38c0 1 < completed multipart upload key=LK3F25OHR7AO upload=DDXYUHN833TM tag=FI9TTVB8RE43 type=write size=1577786 2024-09-12T17:18:51.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.962+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=CEGNTDSPLB3N type=del size=2967711 2024-09-12T17:18:51.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.966+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~ZWLJ0FXWZJYK.0 size=1048576 2024-09-12T17:18:51.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.966+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~ZWLJ0FXWZJYK.1 size=148985 2024-09-12T17:18:51.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.970+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=ZWLJ0FXWZJYK tag=ZRGNUQW734GN type=write size=2246137 2024-09-12T17:18:51.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.978+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~4B53PH5KJHTS.0 size=1048576 2024-09-12T17:18:51.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.978+0000 7f96641d38c0 1 > prepared part key=_multipart_9CBFWXFX7O3N.2~4B53PH5KJHTS.1 size=199282 2024-09-12T17:18:51.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.978+0000 7f96641d38c0 1 > prepared multipart upload key=9CBFWXFX7O3N upload=4B53PH5KJHTS tag=FCE9Q0MSPXF2 type=write size=2296434 2024-09-12T17:18:51.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.982+0000 7f96641d38c0 1 < canceled operation key=MOQXP4AXMTCK tag=VT0X23ZWRDZG type=write size=969373 2024-09-12T17:18:51.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.986+0000 7f96641d38c0 1 > prepared part key=_multipart_L9HUVE5A5NGT.2~0ZGEIV3LYQUJ.0 size=580380 2024-09-12T17:18:51.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.986+0000 7f96641d38c0 1 > prepared multipart upload key=L9HUVE5A5NGT upload=0ZGEIV3LYQUJ tag=CEUPSH3890OJ type=write size=1628956 2024-09-12T17:18:51.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.990+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~AVNQUN82348W.0 size=1048576 2024-09-12T17:18:51.994 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.994+0000 7f96641d38c0 1 < completed part key=_multipart_GKJJDBNXC6QH.2~AVNQUN82348W.1 size=477234 2024-09-12T17:18:51.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.998+0000 7f96641d38c0 1 < completed multipart upload key=GKJJDBNXC6QH upload=AVNQUN82348W tag=LVSOHWT028Z9 type=write size=2574386 2024-09-12T17:18:52.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:51.998+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=GPO5U84MGG2X type=del size=3691975 2024-09-12T17:18:52.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.006+0000 7f96641d38c0 1 < suggested remove operation key=L9HUVE5A5NGT tag=T4GFU3TI7NJN type=del 2024-09-12T17:18:52.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.010+0000 7f96641d38c0 1 > prepared part key=_multipart_G7CWVD9C2H2J.2~SWYHKH3N6HGT.0 size=357390 2024-09-12T17:18:52.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.010+0000 7f96641d38c0 1 > prepared multipart upload key=G7CWVD9C2H2J upload=SWYHKH3N6HGT tag=0Q2ELB0A88SH type=write size=1405966 2024-09-12T17:18:52.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.014+0000 7f96641d38c0 1 < completed part key=_multipart_EFORFJYOM45R.2~NF21GLS6Z8D7.0 size=1048576 2024-09-12T17:18:52.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.014+0000 7f96641d38c0 1 < canceled part key=_multipart_EFORFJYOM45R.2~NF21GLS6Z8D7.1 size=1048576 2024-09-12T17:18:52.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.014+0000 7f96641d38c0 1 < canceled part key=_multipart_EFORFJYOM45R.2~NF21GLS6Z8D7.2 size=882560 2024-09-12T17:18:52.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.018+0000 7f96641d38c0 1 < canceled multipart upload key=EFORFJYOM45R upload=NF21GLS6Z8D7 tag=N7OE4X8D5UJW type=write size=4028288 2024-09-12T17:18:52.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.026+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~0TY6LIONGSXC.0 size=1048576 2024-09-12T17:18:52.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.026+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~0TY6LIONGSXC.1 size=1048576 2024-09-12T17:18:52.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.030+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~0TY6LIONGSXC.2 size=153003 2024-09-12T17:18:52.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.030+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=0TY6LIONGSXC tag=V48W78U2P3JF type=write size=3298731 2024-09-12T17:18:52.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.034+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=Q2PCIJI0UCP5 type=del 2024-09-12T17:18:52.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.038+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~K04PWYWB3PIJ.0 size=1048576 2024-09-12T17:18:52.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.042+0000 7f96641d38c0 1 > prepared part key=_multipart_8TU2VZOHL1ZZ.2~K04PWYWB3PIJ.1 size=1009830 2024-09-12T17:18:52.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.042+0000 7f96641d38c0 1 > prepared multipart upload key=8TU2VZOHL1ZZ upload=K04PWYWB3PIJ tag=A4XHCNX7D6CF type=write size=3106982 2024-09-12T17:18:52.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.046+0000 7f96641d38c0 1 < completed delete operation key=6BH7SI911MMP tag=3F0WCNRURMNC type=del 2024-09-12T17:18:52.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.050+0000 7f96641d38c0 1 > prepared operation key=NR82RUK97NQA tag=8HRREOKOQV65 type=del size=3201815 2024-09-12T17:18:52.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.054+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~47SOBYB2H0O2.0 size=1048576 2024-09-12T17:18:52.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.054+0000 7f96641d38c0 1 < completed part key=_multipart_H3LV5G117KOW.2~47SOBYB2H0O2.1 size=698591 2024-09-12T17:18:52.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.062+0000 7f96641d38c0 1 < completed multipart upload key=H3LV5G117KOW upload=47SOBYB2H0O2 tag=1DSM1BWOO065 type=write size=2795743 2024-09-12T17:18:52.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.062+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=0RSVO3YYE723 type=del size=2227234 2024-09-12T17:18:52.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.066+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~71GBW0UH91FV.0 size=1048576 2024-09-12T17:18:52.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.070+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~71GBW0UH91FV.1 size=1048576 2024-09-12T17:18:52.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.074+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~71GBW0UH91FV.2 size=689536 2024-09-12T17:18:52.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.078+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=71GBW0UH91FV tag=DB17F31ZIJ9K type=write size=3835264 2024-09-12T17:18:52.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.090+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~3C6D4TD4LDDE.0 size=1048576 2024-09-12T17:18:52.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.090+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~3C6D4TD4LDDE.1 size=1048576 2024-09-12T17:18:52.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.094+0000 7f96641d38c0 1 > prepared part key=_multipart_47QQRTJKM4DB.2~3C6D4TD4LDDE.2 size=97246 2024-09-12T17:18:52.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.094+0000 7f96641d38c0 1 > prepared multipart upload key=47QQRTJKM4DB upload=3C6D4TD4LDDE tag=T9HB9QUDB4UA type=write size=3242974 2024-09-12T17:18:52.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.098+0000 7f96641d38c0 1 < completed delete operation key=37YXLWPZGA9J tag=8N1B7SO1TXPV type=del 2024-09-12T17:18:52.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.098+0000 7f96641d38c0 1 > prepared operation key=H3J23KLT1VUT tag=BJ4SMWSV50HX type=del size=1961176 2024-09-12T17:18:52.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.106+0000 7f96641d38c0 1 < suggested remove operation key=W40P2E1H5VT9 tag=GGYDVEE9HPY0 type=del 2024-09-12T17:18:52.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.110+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=KJ3PXNNVYN7E type=del size=2687283 2024-09-12T17:18:52.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.114+0000 7f96641d38c0 1 < suggested update operation key=9CBFWXFX7O3N tag=C78GI18QA335 type=del size=778456 2024-09-12T17:18:52.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.118+0000 7f96641d38c0 1 > prepared operation key=37YXLWPZGA9J tag=RG1SBCLJD462 type=del size=3776590 2024-09-12T17:18:52.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.122+0000 7f96641d38c0 1 < completed part key=_multipart_3H8R2MJGR4SY.2~RKGAFA4ACN49.0 size=104394 2024-09-12T17:18:52.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.126+0000 7f96641d38c0 1 < completed multipart upload key=3H8R2MJGR4SY upload=RKGAFA4ACN49 tag=VBXU1OB1WU32 type=write size=1152970 2024-09-12T17:18:52.130 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.130+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=037A0FCLRSTW type=del size=2443051 2024-09-12T17:18:52.133 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.130+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=3Z4ONKBXHTA1 type=del 2024-09-12T17:18:52.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.134+0000 7f96641d38c0 1 > prepared operation key=9CBFWXFX7O3N tag=DT5ZO6SUI574 type=del size=554742 2024-09-12T17:18:52.139 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.138+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~17Y3GL7H1IP5.0 size=1048576 2024-09-12T17:18:52.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.138+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~17Y3GL7H1IP5.1 size=1048576 2024-09-12T17:18:52.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.142+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~17Y3GL7H1IP5.2 size=294600 2024-09-12T17:18:52.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.146+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=17Y3GL7H1IP5 tag=E1V1AI7VC9RZ type=write size=3440328 2024-09-12T17:18:52.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.150+0000 7f96641d38c0 1 > prepared operation key=RSVQJS9F1FR7 tag=ROYJHJM5LXP2 type=del size=926282 2024-09-12T17:18:52.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.150+0000 7f96641d38c0 1 < completed delete operation key=IR9JQ4MAEH0P tag=CEGNTDSPLB3N type=del 2024-09-12T17:18:52.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.154+0000 7f96641d38c0 1 > prepared operation key=2TN3M8NKV9LN tag=A17PADKD8QDK type=del size=742528 2024-09-12T17:18:52.159 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.158+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~4B53PH5KJHTS.0 size=1048576 2024-09-12T17:18:52.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.158+0000 7f96641d38c0 1 < completed part key=_multipart_9CBFWXFX7O3N.2~4B53PH5KJHTS.1 size=199282 2024-09-12T17:18:52.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.166+0000 7f96641d38c0 1 < completed multipart upload key=9CBFWXFX7O3N upload=4B53PH5KJHTS tag=FCE9Q0MSPXF2 type=write size=2296434 2024-09-12T17:18:52.171 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.170+0000 7f96641d38c0 1 > prepared part key=_multipart_BDI9YFZCT5YY.2~0JZ2EZ9FEYC2.0 size=796578 2024-09-12T17:18:52.171 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.170+0000 7f96641d38c0 1 > prepared multipart upload key=BDI9YFZCT5YY upload=0JZ2EZ9FEYC2 tag=FPNKIX3KT3AU type=write size=1845154 2024-09-12T17:18:52.173 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.170+0000 7f96641d38c0 1 < completed part key=_multipart_L9HUVE5A5NGT.2~0ZGEIV3LYQUJ.0 size=580380 2024-09-12T17:18:52.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.174+0000 7f96641d38c0 1 < completed multipart upload key=L9HUVE5A5NGT upload=0ZGEIV3LYQUJ tag=CEUPSH3890OJ type=write size=1628956 2024-09-12T17:18:52.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.182+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~BUOJMWPHFI01.0 size=1048576 2024-09-12T17:18:52.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.182+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~BUOJMWPHFI01.1 size=1048576 2024-09-12T17:18:52.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.186+0000 7f96641d38c0 1 > prepared part key=_multipart_2TN3M8NKV9LN.2~BUOJMWPHFI01.2 size=727427 2024-09-12T17:18:52.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.186+0000 7f96641d38c0 1 > prepared multipart upload key=2TN3M8NKV9LN upload=BUOJMWPHFI01 tag=WSHVS9HTR60R type=write size=3873155 2024-09-12T17:18:52.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.186+0000 7f96641d38c0 1 < completed delete operation key=5ZZI4F92J7BO tag=GPO5U84MGG2X type=del 2024-09-12T17:18:52.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.194+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~1OX0ZWCXW40K.0 size=1048576 2024-09-12T17:18:52.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.194+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~1OX0ZWCXW40K.1 size=1048576 2024-09-12T17:18:52.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.198+0000 7f96641d38c0 1 > prepared part key=_multipart_NG327LT02T1F.2~1OX0ZWCXW40K.2 size=998296 2024-09-12T17:18:52.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.198+0000 7f96641d38c0 1 > prepared multipart upload key=NG327LT02T1F upload=1OX0ZWCXW40K tag=5UXF051BGYLJ type=write size=4144024 2024-09-12T17:18:52.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.198+0000 7f96641d38c0 1 < canceled part key=_multipart_G7CWVD9C2H2J.2~SWYHKH3N6HGT.0 size=357390 2024-09-12T17:18:52.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.202+0000 7f96641d38c0 1 < canceled multipart upload key=G7CWVD9C2H2J upload=SWYHKH3N6HGT tag=0Q2ELB0A88SH type=write size=1405966 2024-09-12T17:18:52.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.202+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=FGWY5W8LTCOZ type=del size=1141007 2024-09-12T17:18:52.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.206+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~0TY6LIONGSXC.0 size=1048576 2024-09-12T17:18:52.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.210+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~0TY6LIONGSXC.1 size=1048576 2024-09-12T17:18:52.212 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.210+0000 7f96641d38c0 1 < completed part key=_multipart_IR9JQ4MAEH0P.2~0TY6LIONGSXC.2 size=153003 2024-09-12T17:18:52.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.214+0000 7f96641d38c0 1 < completed multipart upload key=IR9JQ4MAEH0P upload=0TY6LIONGSXC tag=V48W78U2P3JF type=write size=3298731 2024-09-12T17:18:52.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.218+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=51JFZPZWTYVF type=del size=31527 2024-09-12T17:18:52.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.218+0000 7f96641d38c0 1 < canceled part key=_multipart_8TU2VZOHL1ZZ.2~K04PWYWB3PIJ.0 size=1048576 2024-09-12T17:18:52.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.222+0000 7f96641d38c0 1 < completed part key=_multipart_8TU2VZOHL1ZZ.2~K04PWYWB3PIJ.1 size=1009830 2024-09-12T17:18:52.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.226+0000 7f96641d38c0 1 < canceled multipart upload key=8TU2VZOHL1ZZ upload=K04PWYWB3PIJ tag=A4XHCNX7D6CF type=write size=3106982 2024-09-12T17:18:52.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.230+0000 7f96641d38c0 1 > prepared operation key=XDL9O7TEMBYF tag=GCS8A3GAHRVR type=del size=1420314 2024-09-12T17:18:52.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.234+0000 7f96641d38c0 1 < suggested remove operation key=NR82RUK97NQA tag=8HRREOKOQV65 type=del 2024-09-12T17:18:52.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.238+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=24YBU6YIDO0G type=del size=775970 2024-09-12T17:18:52.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.242+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=0RSVO3YYE723 type=del 2024-09-12T17:18:52.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.246+0000 7f96641d38c0 1 > prepared operation key=5ZZI4F92J7BO tag=UBIG4WRWUC2K type=del size=3682728 2024-09-12T17:18:52.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.250+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~3C6D4TD4LDDE.0 size=1048576 2024-09-12T17:18:52.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.250+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~3C6D4TD4LDDE.1 size=1048576 2024-09-12T17:18:52.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.254+0000 7f96641d38c0 1 < completed part key=_multipart_47QQRTJKM4DB.2~3C6D4TD4LDDE.2 size=97246 2024-09-12T17:18:52.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.262+0000 7f96641d38c0 1 < completed multipart upload key=47QQRTJKM4DB upload=3C6D4TD4LDDE tag=T9HB9QUDB4UA type=write size=3242974 2024-09-12T17:18:52.268 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.266+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~0XUOS1USMWN7.0 size=1048576 2024-09-12T17:18:52.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.270+0000 7f96641d38c0 1 > prepared part key=_multipart_W40P2E1H5VT9.2~0XUOS1USMWN7.1 size=921400 2024-09-12T17:18:52.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.270+0000 7f96641d38c0 1 > prepared multipart upload key=W40P2E1H5VT9 upload=0XUOS1USMWN7 tag=3GSCR33LPYCG type=write size=3018552 2024-09-12T17:18:52.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.274+0000 7f96641d38c0 1 < canceled operation key=H3J23KLT1VUT tag=BJ4SMWSV50HX type=del size=1961176 2024-09-12T17:18:52.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.278+0000 7f96641d38c0 1 > prepared operation key=L9HUVE5A5NGT tag=W19XSSVE5DME type=write size=476278 2024-09-12T17:18:52.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.278+0000 7f96641d38c0 1 < completed delete operation key=NGA3P9RZJYWT tag=KJ3PXNNVYN7E type=del 2024-09-12T17:18:52.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.286+0000 7f96641d38c0 1 > prepared part key=_multipart_5ZZI4F92J7BO.2~6TYSD909RMT2.0 size=794018 2024-09-12T17:18:52.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.286+0000 7f96641d38c0 1 > prepared multipart upload key=5ZZI4F92J7BO upload=6TYSD909RMT2 tag=3AUA8KVGJ3K4 type=write size=1842594 2024-09-12T17:18:52.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.290+0000 7f96641d38c0 1 < canceled operation key=37YXLWPZGA9J tag=RG1SBCLJD462 type=del size=3776590 2024-09-12T17:18:52.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.290+0000 7f96641d38c0 1 > prepared operation key=6BH7SI911MMP tag=86O6HM6LBB7N type=write size=122417 2024-09-12T17:18:52.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.294+0000 7f96641d38c0 1 < completed delete operation key=ZKDOIH5SH6K0 tag=037A0FCLRSTW type=del 2024-09-12T17:18:52.300 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.298+0000 7f96641d38c0 1 > prepared operation key=NG327LT02T1F tag=XHRZGU7ZZC00 type=del size=2632962 2024-09-12T17:18:52.303 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.302+0000 7f96641d38c0 1 < completed delete operation key=9CBFWXFX7O3N tag=DT5ZO6SUI574 type=del 2024-09-12T17:18:52.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.306+0000 7f96641d38c0 1 > prepared operation key=NGA3P9RZJYWT tag=Z1QI94AHSHML type=del size=1374657 2024-09-12T17:18:52.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.310+0000 7f96641d38c0 1 < completed delete operation key=RSVQJS9F1FR7 tag=ROYJHJM5LXP2 type=del 2024-09-12T17:18:52.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.314+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~XG1Z7MXYT3LS.0 size=1048576 2024-09-12T17:18:52.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.318+0000 7f96641d38c0 1 > prepared part key=_multipart_HRU241T0FUEZ.2~XG1Z7MXYT3LS.1 size=409486 2024-09-12T17:18:52.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.318+0000 7f96641d38c0 1 > prepared multipart upload key=HRU241T0FUEZ upload=XG1Z7MXYT3LS tag=6EUQO4IC4S5P type=write size=2506638 2024-09-12T17:18:52.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.318+0000 7f96641d38c0 1 < completed delete operation key=2TN3M8NKV9LN tag=A17PADKD8QDK type=del 2024-09-12T17:18:52.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.322+0000 7f96641d38c0 1 > prepared operation key=0X2HHMHJUJNL tag=4MNR5ITCOVWB type=write size=20931 2024-09-12T17:18:52.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.326+0000 7f96641d38c0 1 < completed part key=_multipart_BDI9YFZCT5YY.2~0JZ2EZ9FEYC2.0 size=796578 2024-09-12T17:18:52.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.330+0000 7f96641d38c0 1 < completed multipart upload key=BDI9YFZCT5YY upload=0JZ2EZ9FEYC2 tag=FPNKIX3KT3AU type=write size=1845154 2024-09-12T17:18:52.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.334+0000 7f96641d38c0 1 > prepared operation key=8TU2VZOHL1ZZ tag=J2MWW6CP8TWJ type=del size=4065708 2024-09-12T17:18:52.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.338+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~BUOJMWPHFI01.0 size=1048576 2024-09-12T17:18:52.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.338+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~BUOJMWPHFI01.1 size=1048576 2024-09-12T17:18:52.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.342+0000 7f96641d38c0 1 < completed part key=_multipart_2TN3M8NKV9LN.2~BUOJMWPHFI01.2 size=727427 2024-09-12T17:18:52.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.346+0000 7f96641d38c0 1 < completed multipart upload key=2TN3M8NKV9LN upload=BUOJMWPHFI01 tag=WSHVS9HTR60R type=write size=3873155 2024-09-12T17:18:52.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.350+0000 7f96641d38c0 1 > prepared operation key=XTVZIXTEES2O tag=8O5O9FEC45AC type=write size=424944 2024-09-12T17:18:52.353 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.350+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~1OX0ZWCXW40K.0 size=1048576 2024-09-12T17:18:52.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.354+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~1OX0ZWCXW40K.1 size=1048576 2024-09-12T17:18:52.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.358+0000 7f96641d38c0 1 < completed part key=_multipart_NG327LT02T1F.2~1OX0ZWCXW40K.2 size=998296 2024-09-12T17:18:52.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.362+0000 7f96641d38c0 1 < completed multipart upload key=NG327LT02T1F upload=1OX0ZWCXW40K tag=5UXF051BGYLJ type=write size=4144024 2024-09-12T17:18:52.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.366+0000 7f96641d38c0 1 > prepared operation key=UBYUSW4C2V19 tag=NAGAR2K9NNOI type=del size=361124 2024-09-12T17:18:52.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.374+0000 7f96641d38c0 1 < suggested remove operation key=0X2HHMHJUJNL tag=FGWY5W8LTCOZ type=del 2024-09-12T17:18:52.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.374+0000 7f96641d38c0 1 > prepared operation key=MOQXP4AXMTCK tag=7UKBO1FWW8A7 type=write size=129703 2024-09-12T17:18:52.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.378+0000 7f96641d38c0 1 < completed delete operation key=XTVZIXTEES2O tag=51JFZPZWTYVF type=del 2024-09-12T17:18:52.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.382+0000 7f96641d38c0 1 > prepared operation key=ZKDOIH5SH6K0 tag=XCFMQWBS1EKC type=del size=1896281 2024-09-12T17:18:52.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.382+0000 7f96641d38c0 1 < completed delete operation key=XDL9O7TEMBYF tag=GCS8A3GAHRVR type=del 2024-09-12T17:18:52.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.390+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~TQF1LYC3ZC7W.0 size=1048576 2024-09-12T17:18:52.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.390+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~TQF1LYC3ZC7W.1 size=1048576 2024-09-12T17:18:52.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.390+0000 7f96641d38c0 1 > prepared part key=_multipart_IR9JQ4MAEH0P.2~TQF1LYC3ZC7W.2 size=1045655 2024-09-12T17:18:52.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.390+0000 7f96641d38c0 1 > prepared multipart upload key=IR9JQ4MAEH0P upload=TQF1LYC3ZC7W tag=A0ZMH50HQC29 type=write size=4191383 2024-09-12T17:18:52.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.394+0000 7f96641d38c0 1 < completed delete operation key=8TU2VZOHL1ZZ tag=24YBU6YIDO0G type=del 2024-09-12T17:18:52.399 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.398+0000 7f96641d38c0 1 > prepared operation key=IR9JQ4MAEH0P tag=6MQMG4B8YNO1 type=del size=3252378 2024-09-12T17:18:52.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.402+0000 7f96641d38c0 1 < suggested update operation key=5ZZI4F92J7BO tag=UBIG4WRWUC2K type=del size=3682728 2024-09-12T17:18:52.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:18:52.406+0000 7f96641d38c0 1 > prepared operation key=47QQRTJKM4DB tag=WLU2022OFTYX type=del size=532343 2024-09-12T17:18:52.407 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] cls_rgw_stats.simulate (20869 ms) 2024-09-12T17:18:52.407 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 1 test from cls_rgw_stats (20869 ms total) 2024-09-12T17:18:52.408 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:18:52.408 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:18:53.403 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 1 test from 1 test suite ran. (23779 ms total) 2024-09-12T17:18:53.403 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 1 test. 2024-09-12T17:18:53.410 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:18:53.410 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:18:53.471 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T17:18:53.472 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T17:18:53.472 DEBUG:teuthology.orchestra.run.smithi119:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T17:18:53.539 INFO:tasks.workunit.client.0.smithi119.stdout:Running main() from gmock_main.cc 2024-09-12T17:18:53.539 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T17:18:53.539 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:18:55.426 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 31 tests from CmpOmap 2024-09-12T17:18:55.426 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T17:18:55.448 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (22 ms) 2024-09-12T17:18:55.448 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T17:18:55.464 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (16 ms) 2024-09-12T17:18:55.464 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T17:18:55.470 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (6 ms) 2024-09-12T17:18:55.470 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T17:18:55.476 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (7 ms) 2024-09-12T17:18:55.477 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T17:18:55.493 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_vals_str (16 ms) 2024-09-12T17:18:55.493 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T17:18:55.507 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_vals_u64 (12 ms) 2024-09-12T17:18:55.507 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T17:18:55.514 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (8 ms) 2024-09-12T17:18:55.514 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T17:18:55.522 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (8 ms) 2024-09-12T17:18:55.522 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T17:18:55.531 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (9 ms) 2024-09-12T17:18:55.531 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T17:18:55.542 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (11 ms) 2024-09-12T17:18:55.542 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T17:18:55.544 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (2 ms) 2024-09-12T17:18:55.544 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T17:18:55.546 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (2 ms) 2024-09-12T17:18:55.546 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T17:18:55.562 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (17 ms) 2024-09-12T17:18:55.563 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T17:18:55.581 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (18 ms) 2024-09-12T17:18:55.581 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T17:18:55.597 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (16 ms) 2024-09-12T17:18:55.597 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T17:18:55.614 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (17 ms) 2024-09-12T17:18:55.614 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T17:18:55.635 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_set_vals_str (21 ms) 2024-09-12T17:18:55.635 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T17:18:55.656 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (21 ms) 2024-09-12T17:18:55.656 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T17:18:55.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (7 ms) 2024-09-12T17:18:55.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T17:18:55.670 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (7 ms) 2024-09-12T17:18:55.670 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T17:18:55.673 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (3 ms) 2024-09-12T17:18:55.673 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T17:18:55.674 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-09-12T17:18:55.675 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T17:18:55.691 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (16 ms) 2024-09-12T17:18:55.691 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T17:18:55.707 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (17 ms) 2024-09-12T17:18:55.708 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T17:18:55.728 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (20 ms) 2024-09-12T17:18:55.728 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T17:18:55.751 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (23 ms) 2024-09-12T17:18:55.751 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T17:18:55.756 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (5 ms) 2024-09-12T17:18:55.756 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T17:18:55.763 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (7 ms) 2024-09-12T17:18:55.764 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T17:18:55.766 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-12T17:18:55.766 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T17:18:55.768 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-12T17:18:55.768 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T17:18:55.788 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (21 ms) 2024-09-12T17:18:55.789 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 31 tests from CmpOmap (363 ms total) 2024-09-12T17:18:55.789 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:18:55.789 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:18:56.431 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 31 tests from 1 test suite ran. (2892 ms total) 2024-09-12T17:18:56.431 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 31 tests. 2024-09-12T17:18:56.436 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:18:56.436 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:18:56.490 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T17:18:56.492 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T17:18:56.492 DEBUG:teuthology.orchestra.run.smithi119:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T17:18:56.561 INFO:tasks.workunit.client.0.smithi119.stdout:Running main() from gmock_main.cc 2024-09-12T17:18:56.561 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:18:56.562 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:18:56.562 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T17:18:56.562 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T17:18:59.476 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2915 ms) 2024-09-12T17:18:59.477 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T17:19:02.497 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3020 ms) 2024-09-12T17:19:02.497 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T17:19:05.505 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.Reserve (3008 ms) 2024-09-12T17:19:05.505 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T17:19:08.552 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3047 ms) 2024-09-12T17:19:08.552 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T17:19:12.665 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.Commit (4111 ms) 2024-09-12T17:19:12.666 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T17:19:16.713 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.Stats (4049 ms) 2024-09-12T17:19:16.714 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T17:19:20.755 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4044 ms) 2024-09-12T17:19:20.755 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T17:19:23.781 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.Abort (3026 ms) 2024-09-12T17:19:23.782 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T17:19:26.808 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.ReserveError (3026 ms) 2024-09-12T17:19:26.808 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T17:19:29.840 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.CommitError (3032 ms) 2024-09-12T17:19:29.840 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T17:19:32.913 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.AbortError (3071 ms) 2024-09-12T17:19:32.913 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T17:19:35.938 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3027 ms) 2024-09-12T17:19:35.938 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T17:19:38.990 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3052 ms) 2024-09-12T17:19:38.990 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T17:19:42.000 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3010 ms) 2024-09-12T17:19:42.000 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T17:19:45.045 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3045 ms) 2024-09-12T17:19:45.045 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T17:19:48.073 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3028 ms) 2024-09-12T17:19:48.073 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T17:19:51.131 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3058 ms) 2024-09-12T17:19:51.131 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T17:19:54.142 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.Cleanup (3011 ms) 2024-09-12T17:19:54.142 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T17:20:06.229 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.MultiProducer (12085 ms) 2024-09-12T17:20:06.229 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T17:20:11.273 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5045 ms) 2024-09-12T17:20:11.273 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T17:20:25.383 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14109 ms) 2024-09-12T17:20:25.383 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T17:20:31.419 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6035 ms) 2024-09-12T17:20:31.419 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T17:20:41.455 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (10038 ms) 2024-09-12T17:20:41.455 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T17:20:51.664 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (10208 ms) 2024-09-12T17:20:51.664 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 24 tests from TestCls2PCQueue (115102 ms total) 2024-09-12T17:20:51.664 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:20:51.664 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:20:51.665 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 24 tests from 1 test suite ran. (115102 ms total) 2024-09-12T17:20:51.665 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 24 tests. 2024-09-12T17:20:51.668 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:20:51.668 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:20:51.722 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T17:20:51.723 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T17:20:51.723 DEBUG:teuthology.orchestra.run.smithi119:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T17:20:51.799 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:51.799 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:51.799 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:20:51.800 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:20:53.664 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 4 tests from ClsAccount 2024-09-12T17:20:53.664 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] ClsAccount.add 2024-09-12T17:20:53.714 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] ClsAccount.add (50 ms) 2024-09-12T17:20:53.714 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] ClsAccount.get 2024-09-12T17:20:53.721 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] ClsAccount.get (7 ms) 2024-09-12T17:20:53.721 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] ClsAccount.rm 2024-09-12T17:20:53.733 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] ClsAccount.rm (12 ms) 2024-09-12T17:20:53.733 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] ClsAccount.list 2024-09-12T17:20:53.774 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] ClsAccount.list (41 ms) 2024-09-12T17:20:53.774 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 4 tests from ClsAccount (110 ms total) 2024-09-12T17:20:53.774 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:20:53.774 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:20:54.667 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 4 tests from 1 test suite ran. (2867 ms total) 2024-09-12T17:20:54.667 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 4 tests. 2024-09-12T17:20:54.674 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:20:54.674 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:20:54.729 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T17:20:54.730 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T17:20:54.730 DEBUG:teuthology.orchestra.run.smithi119:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T17:20:54.805 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:54.805 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:54.805 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T17:20:54.805 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:20:56.724 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T17:20:56.725 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T17:20:56.760 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] rgw_gc_log.init_existing_queue (35 ms) 2024-09-12T17:20:56.760 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T17:20:56.767 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] rgw_gc_log.init_existing_omap (7 ms) 2024-09-12T17:20:56.767 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T17:20:56.773 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (7 ms) 2024-09-12T17:20:56.774 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T17:20:56.777 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2024-09-12T17:20:56.777 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T17:20:56.781 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] rgw_gc_log.defer1_after_init (5 ms) 2024-09-12T17:20:56.782 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T17:20:56.785 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-09-12T17:20:56.785 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 6 tests from rgw_gc_log (60 ms total) 2024-09-12T17:20:56.785 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:20:56.785 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:20:57.724 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 6 tests from 1 test suite ran. (2918 ms total) 2024-09-12T17:20:57.724 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 6 tests. 2024-09-12T17:20:57.731 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:20:57.731 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:20:57.786 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T17:20:57.787 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T17:20:57.787 DEBUG:teuthology.orchestra.run.smithi119:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T17:20:57.864 INFO:tasks.workunit.client.0.smithi119.stdout:Running main() from gmock_main.cc 2024-09-12T17:20:57.864 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:20:57.864 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:20:57.864 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T17:20:57.864 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T17:20:57.865 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj 2024-09-12T17:20:57.865 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj 2024-09-12T17:20:57.865 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: _obj ns= i= 2024-09-12T17:20:57.865 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj 2024-09-12T17:20:57.865 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj 2024-09-12T17:20:57.865 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: _obj ns= i= 2024-09-12T17:20:57.865 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj 2024-09-12T17:20:57.865 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj 2024-09-12T17:20:57.865 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: _obj ns= i= 2024-09-12T17:20:57.865 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.865 INFO:tasks.workunit.client.0.smithi119.stdout: "obj1": { 2024-09-12T17:20:57.865 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.865 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.865 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.866 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.866 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.866 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.866 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.866 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.866 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.866 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.866 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.866 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.866 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_obj", 2024-09-12T17:20:57.866 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.866 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.866 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.867 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.867 INFO:tasks.workunit.client.0.smithi119.stdout: "obj2": { 2024-09-12T17:20:57.867 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.867 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.867 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.867 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.867 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.867 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.867 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.867 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.867 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.867 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.868 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.868 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.868 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_obj", 2024-09-12T17:20:57.868 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.868 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.868 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.868 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.868 INFO:tasks.workunit.client.0.smithi119.stdout: "obj3": { 2024-09-12T17:20:57.868 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.868 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.868 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.868 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.868 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.868 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.869 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.869 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.869 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.869 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.869 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.869 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.869 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_obj", 2024-09-12T17:20:57.869 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.869 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.869 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.869 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.869 INFO:tasks.workunit.client.0.smithi119.stdout: "obj3-2": { 2024-09-12T17:20:57.870 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.870 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.870 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.870 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.870 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.870 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.870 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.870 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.870 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.870 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.870 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.870 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.870 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_obj", 2024-09-12T17:20:57.871 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.871 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.871 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.871 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.871 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.871 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj 2024-09-12T17:20:57.871 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj 2024-09-12T17:20:57.871 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: _obj ns=ns i= 2024-09-12T17:20:57.871 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj 2024-09-12T17:20:57.871 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj 2024-09-12T17:20:57.871 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: _obj ns=ns i= 2024-09-12T17:20:57.871 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj 2024-09-12T17:20:57.871 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj 2024-09-12T17:20:57.872 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: _obj ns=ns i= 2024-09-12T17:20:57.872 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.872 INFO:tasks.workunit.client.0.smithi119.stdout: "obj1": { 2024-09-12T17:20:57.872 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.872 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.872 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.872 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.872 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.872 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.872 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.872 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.872 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.873 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.873 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.873 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.873 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_obj", 2024-09-12T17:20:57.873 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.873 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.873 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.873 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.873 INFO:tasks.workunit.client.0.smithi119.stdout: "obj2": { 2024-09-12T17:20:57.873 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.873 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.873 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.874 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.874 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.874 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.874 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.874 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.874 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.874 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.874 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.874 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.874 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_obj", 2024-09-12T17:20:57.874 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.874 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.874 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.875 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.875 INFO:tasks.workunit.client.0.smithi119.stdout: "obj3": { 2024-09-12T17:20:57.875 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.875 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.875 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.875 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.875 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.875 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.875 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.875 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.875 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.875 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.875 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.876 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.876 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_obj", 2024-09-12T17:20:57.876 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.876 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.876 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.876 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.876 INFO:tasks.workunit.client.0.smithi119.stdout: "obj3-2": { 2024-09-12T17:20:57.876 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.876 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.876 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.876 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.876 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.876 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.877 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.877 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.877 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.877 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.877 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.877 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.877 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_obj", 2024-09-12T17:20:57.877 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.877 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.877 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.877 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.877 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.878 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj[v1] 2024-09-12T17:20:57.878 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj[v1] 2024-09-12T17:20:57.878 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: _obj ns= i=v1 2024-09-12T17:20:57.878 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj[v1] 2024-09-12T17:20:57.878 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj[v1] 2024-09-12T17:20:57.878 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: _obj ns= i=v1 2024-09-12T17:20:57.878 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj[v1] 2024-09-12T17:20:57.878 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj[v1] 2024-09-12T17:20:57.878 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: _obj ns= i=v1 2024-09-12T17:20:57.878 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.878 INFO:tasks.workunit.client.0.smithi119.stdout: "obj1": { 2024-09-12T17:20:57.878 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.878 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.879 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.879 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.879 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.879 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.879 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.879 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.879 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.879 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.879 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.879 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.879 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_obj", 2024-09-12T17:20:57.879 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "v1", 2024-09-12T17:20:57.880 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.880 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.880 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.880 INFO:tasks.workunit.client.0.smithi119.stdout: "obj2": { 2024-09-12T17:20:57.880 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.880 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.880 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.880 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.880 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.880 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.880 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.880 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.880 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.880 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.881 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.881 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.881 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_obj", 2024-09-12T17:20:57.881 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "v1", 2024-09-12T17:20:57.881 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.881 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.881 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.881 INFO:tasks.workunit.client.0.smithi119.stdout: "obj3": { 2024-09-12T17:20:57.881 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.881 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.881 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.881 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.881 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.882 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.882 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.882 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.882 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.882 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.882 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.882 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.882 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_obj", 2024-09-12T17:20:57.882 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.882 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.882 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.882 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.882 INFO:tasks.workunit.client.0.smithi119.stdout: "obj3-2": { 2024-09-12T17:20:57.883 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.883 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.883 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.883 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.883 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.883 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.883 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.883 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.883 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.883 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.883 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.883 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.883 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_obj", 2024-09-12T17:20:57.884 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "v1", 2024-09-12T17:20:57.884 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.884 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.884 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.884 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.884 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj[v1] 2024-09-12T17:20:57.884 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj[v1] 2024-09-12T17:20:57.884 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:20:57.884 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj[v1] 2024-09-12T17:20:57.884 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj[v1] 2024-09-12T17:20:57.884 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:20:57.884 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj[v1] 2024-09-12T17:20:57.885 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: _obj[v1] 2024-09-12T17:20:57.885 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:20:57.885 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.885 INFO:tasks.workunit.client.0.smithi119.stdout: "obj1": { 2024-09-12T17:20:57.885 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.885 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.885 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.885 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.885 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.885 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.885 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.885 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.885 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.885 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.886 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.886 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.886 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_obj", 2024-09-12T17:20:57.886 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "v1", 2024-09-12T17:20:57.886 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.886 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.886 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.886 INFO:tasks.workunit.client.0.smithi119.stdout: "obj2": { 2024-09-12T17:20:57.886 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.886 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.886 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.886 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.887 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.887 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.887 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.887 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.887 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.887 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.887 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.887 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.887 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_obj", 2024-09-12T17:20:57.887 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "v1", 2024-09-12T17:20:57.887 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.887 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.887 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.887 INFO:tasks.workunit.client.0.smithi119.stdout: "obj3": { 2024-09-12T17:20:57.888 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.888 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.888 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.888 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.888 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.888 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.888 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.888 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.888 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.888 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.888 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.888 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.888 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_obj", 2024-09-12T17:20:57.889 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.889 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.889 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.889 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.889 INFO:tasks.workunit.client.0.smithi119.stdout: "obj3-2": { 2024-09-12T17:20:57.889 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.889 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.889 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.889 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.889 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.889 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.889 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.890 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.890 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.890 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.890 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.890 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.890 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_obj", 2024-09-12T17:20:57.890 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "v1", 2024-09-12T17:20:57.890 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.890 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.890 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.890 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.890 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T17:20:57.891 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T17:20:57.891 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj 2024-09-12T17:20:57.891 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj 2024-09-12T17:20:57.891 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: obj ns= i= 2024-09-12T17:20:57.891 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj 2024-09-12T17:20:57.891 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj 2024-09-12T17:20:57.891 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: obj ns= i= 2024-09-12T17:20:57.891 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj 2024-09-12T17:20:57.891 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj 2024-09-12T17:20:57.891 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: obj ns= i= 2024-09-12T17:20:57.891 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.891 INFO:tasks.workunit.client.0.smithi119.stdout: "obj1": { 2024-09-12T17:20:57.891 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.892 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.892 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.892 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.892 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.892 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.892 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.892 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.892 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.892 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.892 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.892 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.892 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "obj", 2024-09-12T17:20:57.892 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.893 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.893 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.893 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.893 INFO:tasks.workunit.client.0.smithi119.stdout: "obj2": { 2024-09-12T17:20:57.893 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.893 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.893 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.893 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.893 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.893 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.893 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.893 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.893 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.894 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.894 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.894 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.894 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "obj", 2024-09-12T17:20:57.894 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.894 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.894 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.894 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.894 INFO:tasks.workunit.client.0.smithi119.stdout: "obj3": { 2024-09-12T17:20:57.894 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.894 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.894 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.894 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.895 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.895 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.895 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.895 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.895 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.895 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.895 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.895 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.895 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "obj", 2024-09-12T17:20:57.895 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.895 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.895 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.895 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.896 INFO:tasks.workunit.client.0.smithi119.stdout: "obj3-2": { 2024-09-12T17:20:57.896 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.896 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.896 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.896 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.896 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.896 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.896 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.896 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.896 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.896 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.896 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.896 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.897 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "obj", 2024-09-12T17:20:57.897 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.897 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.897 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.897 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.897 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.897 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj 2024-09-12T17:20:57.897 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj 2024-09-12T17:20:57.897 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: obj ns=ns i= 2024-09-12T17:20:57.897 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj 2024-09-12T17:20:57.897 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj 2024-09-12T17:20:57.897 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: obj ns=ns i= 2024-09-12T17:20:57.898 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj 2024-09-12T17:20:57.898 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj 2024-09-12T17:20:57.898 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: obj ns=ns i= 2024-09-12T17:20:57.898 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.898 INFO:tasks.workunit.client.0.smithi119.stdout: "obj1": { 2024-09-12T17:20:57.898 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.898 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.898 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.898 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.898 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.898 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.898 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.898 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.898 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.899 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.899 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.899 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.899 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "obj", 2024-09-12T17:20:57.899 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.899 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.899 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.899 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.899 INFO:tasks.workunit.client.0.smithi119.stdout: "obj2": { 2024-09-12T17:20:57.899 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.899 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.899 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.899 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "obj", 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.901 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.901 INFO:tasks.workunit.client.0.smithi119.stdout: "obj3": { 2024-09-12T17:20:57.901 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.901 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.901 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.901 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.901 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.901 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.901 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.901 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.901 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.901 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.901 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.902 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.902 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "obj", 2024-09-12T17:20:57.902 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.902 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.902 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.902 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.902 INFO:tasks.workunit.client.0.smithi119.stdout: "obj3-2": { 2024-09-12T17:20:57.902 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.902 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.902 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.902 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.902 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.902 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.903 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.903 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.903 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.903 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.903 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.903 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.903 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "obj", 2024-09-12T17:20:57.903 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.903 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.903 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.903 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.903 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.903 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj[v1] 2024-09-12T17:20:57.904 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj[v1] 2024-09-12T17:20:57.904 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: obj ns= i=v1 2024-09-12T17:20:57.904 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj[v1] 2024-09-12T17:20:57.904 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj[v1] 2024-09-12T17:20:57.904 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: obj ns= i=v1 2024-09-12T17:20:57.904 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj[v1] 2024-09-12T17:20:57.904 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj[v1] 2024-09-12T17:20:57.904 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: obj ns= i=v1 2024-09-12T17:20:57.904 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.904 INFO:tasks.workunit.client.0.smithi119.stdout: "obj1": { 2024-09-12T17:20:57.904 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.904 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.904 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.905 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.905 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.905 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.905 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.905 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.905 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.905 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.905 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.905 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.905 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "obj", 2024-09-12T17:20:57.905 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "v1", 2024-09-12T17:20:57.905 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.905 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.906 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.906 INFO:tasks.workunit.client.0.smithi119.stdout: "obj2": { 2024-09-12T17:20:57.906 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.906 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.906 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.906 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.906 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.906 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.906 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.906 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.906 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.906 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.906 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.907 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.907 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "obj", 2024-09-12T17:20:57.907 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "v1", 2024-09-12T17:20:57.907 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.907 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.907 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.907 INFO:tasks.workunit.client.0.smithi119.stdout: "obj3": { 2024-09-12T17:20:57.907 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.907 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.907 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.907 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.907 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.908 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.908 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.908 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.908 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.908 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.908 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.908 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.908 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "obj", 2024-09-12T17:20:57.908 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.909 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.909 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.909 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.909 INFO:tasks.workunit.client.0.smithi119.stdout: "obj3-2": { 2024-09-12T17:20:57.909 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.909 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.909 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.909 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.909 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.909 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.909 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.909 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.909 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.909 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.910 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.910 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.910 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "obj", 2024-09-12T17:20:57.910 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "v1", 2024-09-12T17:20:57.910 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.910 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.910 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.910 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.910 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj[v1] 2024-09-12T17:20:57.910 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj[v1] 2024-09-12T17:20:57.910 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:20:57.910 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj[v1] 2024-09-12T17:20:57.910 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj[v1] 2024-09-12T17:20:57.910 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:20:57.911 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj[v1] 2024-09-12T17:20:57.911 INFO:tasks.workunit.client.0.smithi119.stdout:parsed: obj[v1] 2024-09-12T17:20:57.911 INFO:tasks.workunit.client.0.smithi119.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:20:57.911 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.911 INFO:tasks.workunit.client.0.smithi119.stdout: "obj1": { 2024-09-12T17:20:57.911 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.911 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.911 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.911 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.911 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.911 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.911 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.911 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.912 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.912 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.912 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.912 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.912 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "obj", 2024-09-12T17:20:57.912 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "v1", 2024-09-12T17:20:57.912 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.912 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.912 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.912 INFO:tasks.workunit.client.0.smithi119.stdout: "obj2": { 2024-09-12T17:20:57.912 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.912 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.912 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.913 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.913 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.913 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.913 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.913 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.913 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.913 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.913 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.913 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.913 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "obj", 2024-09-12T17:20:57.913 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "v1", 2024-09-12T17:20:57.913 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.913 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.914 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.914 INFO:tasks.workunit.client.0.smithi119.stdout: "obj3": { 2024-09-12T17:20:57.914 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.914 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.914 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.914 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.914 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.914 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.914 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.914 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.914 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.914 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.914 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.914 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.915 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "obj", 2024-09-12T17:20:57.915 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.915 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.915 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.915 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.915 INFO:tasks.workunit.client.0.smithi119.stdout: "obj3-2": { 2024-09-12T17:20:57.915 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.915 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.915 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.915 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.915 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.915 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.915 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.916 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.916 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.916 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.916 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.916 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.916 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "obj", 2024-09-12T17:20:57.916 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "v1", 2024-09-12T17:20:57.916 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.916 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.916 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.916 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.916 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestRGWObj.no_underscore (1 ms) 2024-09-12T17:20:57.916 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T17:20:57.916 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.917 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.917 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.917 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.917 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.917 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.917 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.917 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.917 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.917 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.917 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.917 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.917 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.917 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.917 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.918 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.918 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.918 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.918 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.918 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.918 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.918 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.918 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.918 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.918 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.918 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.918 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.918 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:57.919 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.919 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.919 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.919 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.919 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.919 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.919 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.919 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": "default-placement.data", 2024-09-12T17:20:57.919 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker_myobj", 2024-09-12T17:20:57.919 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:57.919 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.919 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.919 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.920 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.920 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.920 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.920 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.920 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.920 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.920 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.920 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.920 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.920 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.920 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.920 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.921 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.921 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:57.921 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.921 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.921 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.921 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.921 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.921 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.921 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.921 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.921 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.921 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.921 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.922 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.922 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.922 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.922 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.922 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.922 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.922 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.922 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.922 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.922 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.922 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.922 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.922 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.923 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.923 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.923 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.923 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.923 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.923 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.923 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.923 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.923 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:57.923 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.923 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.923 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.923 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.924 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.924 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.924 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.924 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:57.924 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker_myobj", 2024-09-12T17:20:57.924 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:57.924 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.924 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.924 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.924 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.924 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.924 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.924 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.925 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.925 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.925 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.925 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.925 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.925 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.925 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.925 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.925 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.925 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:57.925 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.925 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.926 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.926 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.926 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.926 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.926 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.926 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.926 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.926 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.926 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.926 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.926 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.926 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.926 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.926 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.927 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.927 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.927 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.927 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.927 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.927 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.927 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.927 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.927 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.927 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.927 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.927 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.927 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.928 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.928 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.928 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.928 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:57.928 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.928 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.928 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.928 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.928 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.928 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.928 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.928 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": "default-placement.data", 2024-09-12T17:20:57.929 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:20:57.929 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:57.929 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.929 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.929 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.930 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.930 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.930 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.930 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.930 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.930 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.930 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.930 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.930 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.930 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.930 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.930 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.931 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.931 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:57.931 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.931 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.931 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.931 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.931 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.931 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.931 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.931 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.931 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.931 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.931 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.932 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.932 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.932 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.932 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.932 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.932 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.932 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.932 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.932 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.932 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.932 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.932 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.932 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.933 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.933 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.933 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.933 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.933 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.933 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.933 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.933 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.933 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:57.933 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.933 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.933 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.933 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.934 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.934 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.934 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.934 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:57.934 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:20:57.934 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:57.934 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.934 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.934 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.934 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.934 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.934 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.934 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.935 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.935 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.935 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.935 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.935 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.935 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.935 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.935 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.935 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.935 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:57.935 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.935 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.935 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.936 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.936 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.936 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.936 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.936 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.936 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.936 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.936 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.936 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.936 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.936 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.936 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.936 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.937 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.937 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.937 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.937 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.937 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.937 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.937 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.937 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.937 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.937 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.937 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.937 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.937 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.938 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.938 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.938 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.938 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:57.938 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:57.938 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.938 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.938 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.938 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.938 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.938 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.938 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": "default-placement.data", 2024-09-12T17:20:57.938 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:20:57.938 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:57.939 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.939 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.939 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.939 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.939 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.939 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.939 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.939 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.939 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.939 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.939 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.939 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.940 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.940 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.940 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.940 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.940 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:57.940 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:57.940 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.940 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.940 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.940 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.940 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.940 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.940 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.940 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.941 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.941 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.941 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.941 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.941 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.941 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.941 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.941 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.941 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.941 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.941 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.941 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.941 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.942 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.942 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.942 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.942 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.942 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.942 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.942 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.942 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.942 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.942 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.942 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:57.942 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:57.942 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.943 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.943 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.943 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.943 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.943 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.943 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:57.943 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:20:57.943 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:57.943 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.943 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.943 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.943 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.943 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.944 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.944 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.944 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.944 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.944 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.944 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.944 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.944 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.944 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.944 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.944 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.944 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:57.945 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:57.945 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.945 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.945 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.945 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.945 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.945 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.945 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.945 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.945 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.945 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.945 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.945 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.945 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.946 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.946 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.946 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.946 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.946 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.946 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.946 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.946 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.946 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.946 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.946 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.946 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.946 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.947 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.947 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.947 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.947 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.947 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.947 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:57.947 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:57.947 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.947 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.947 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.947 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.947 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.948 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.948 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": "default-placement.data", 2024-09-12T17:20:57.948 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:20:57.948 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:57.948 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.948 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.948 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.948 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.948 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.948 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.948 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.948 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.948 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.948 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.949 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.949 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.949 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.949 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.949 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.949 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.949 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:57.949 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:57.949 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.949 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.949 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.949 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.949 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.950 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.950 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.950 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.950 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.950 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.950 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.950 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.950 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.950 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.950 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.950 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.950 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.950 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.950 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.951 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.951 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.951 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.951 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.951 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.951 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.951 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.951 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.951 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.951 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.951 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.951 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.951 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:57.951 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:57.951 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.952 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.952 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.952 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.952 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.952 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.952 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:57.952 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:20:57.952 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:57.952 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.952 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.952 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.952 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.952 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.952 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.953 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.953 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.953 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.953 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.953 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.953 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.953 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.953 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.953 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.953 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.953 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:57.954 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:57.954 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.954 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.954 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.954 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.954 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.954 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.954 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.954 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.954 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.954 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.954 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.955 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.955 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.955 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.955 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.955 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.955 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.955 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.955 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.955 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.955 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.955 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.955 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.956 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.956 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.956 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.956 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.956 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.956 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.956 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.956 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.956 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:57.956 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.956 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.956 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.956 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.957 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.957 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.957 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.957 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": "default-placement.data", 2024-09-12T17:20:57.957 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker___myobj", 2024-09-12T17:20:57.957 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "marker__myobj" 2024-09-12T17:20:57.957 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.957 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.957 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.957 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.957 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.957 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.958 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.958 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.958 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.958 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.958 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.958 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.958 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.958 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.958 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.958 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.958 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:57.958 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.958 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.959 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.959 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.959 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.959 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.959 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.959 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.959 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.959 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.959 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.959 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.959 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.959 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.959 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.960 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.960 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.960 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.960 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.960 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.960 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.960 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.960 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.960 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.960 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.960 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.960 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.960 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.961 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.961 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.961 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.961 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.961 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:57.961 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.961 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.961 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.961 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.961 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.961 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.961 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.962 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:57.962 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker___myobj", 2024-09-12T17:20:57.962 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "marker__myobj" 2024-09-12T17:20:57.962 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.962 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.962 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.962 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.962 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.962 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.962 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.962 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.962 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.962 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.963 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.963 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.963 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.963 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.963 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.963 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.963 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:57.963 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.963 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.963 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.963 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.963 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.964 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.964 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.964 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.964 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.964 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.964 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.964 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.964 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.964 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.964 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.964 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.964 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.965 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.965 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.965 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.965 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.965 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.965 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.965 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.965 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.965 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.965 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.965 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.965 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.965 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.966 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.966 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.966 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:57.966 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.966 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.966 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.966 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.966 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.966 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.966 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.966 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": "default-placement.data", 2024-09-12T17:20:57.966 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:20:57.966 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:57.967 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.967 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.967 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.967 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.967 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.967 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.967 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.967 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.967 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.967 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.967 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.967 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.967 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.968 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.968 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.968 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.968 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:57.968 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.968 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.968 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.968 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.968 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.968 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.968 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.968 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.968 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.968 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.969 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.969 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.969 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.969 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.969 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.969 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.969 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.969 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.969 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.969 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.969 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.969 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.969 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.969 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.970 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.970 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.970 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.970 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.970 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.970 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.970 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.970 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.970 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:57.970 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.970 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.970 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.970 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.970 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.970 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.971 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.971 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:57.971 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:20:57.971 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:57.971 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.971 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.971 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.971 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.971 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.971 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.971 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.971 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.971 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.972 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.972 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.972 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.972 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.972 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.972 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.972 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.972 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:57.972 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.972 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.972 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.972 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.972 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.973 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.973 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.973 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.973 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.973 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.973 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.973 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.973 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.973 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.973 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.973 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.973 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.974 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.974 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.974 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.974 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.974 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.974 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.974 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.974 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.974 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.974 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.974 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.974 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.974 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.975 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.975 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.975 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:57.975 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:57.975 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.975 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.975 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.975 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.975 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.975 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.975 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": "default-placement.data", 2024-09-12T17:20:57.975 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:20:57.975 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "marker__myobj" 2024-09-12T17:20:57.976 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.976 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.976 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.976 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.976 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.976 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.976 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.976 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.976 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.976 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.976 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.976 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.976 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.976 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.976 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.977 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.977 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:57.977 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:57.977 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.977 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.977 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.977 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.977 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.977 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.977 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.977 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.977 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.977 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.977 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.978 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.978 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.978 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.978 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.978 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.978 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.978 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.978 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.978 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.978 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.978 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.978 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.978 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.979 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.979 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.979 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.979 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.979 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.979 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.979 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.979 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:57.979 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:57.979 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.979 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.979 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.979 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.980 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.980 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.980 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:57.980 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:20:57.980 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "marker__myobj" 2024-09-12T17:20:57.980 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.980 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.980 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.980 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.980 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.980 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.980 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.981 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.981 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.981 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.981 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.981 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.981 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.981 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.981 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.981 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.981 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:57.981 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:57.981 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.981 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.982 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.982 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.982 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.982 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.982 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.982 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.982 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.982 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.982 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.982 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.982 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.982 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.982 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.982 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.982 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.983 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.983 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.983 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.983 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.983 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.983 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.983 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.983 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.983 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.983 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.983 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.983 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.984 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.984 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.984 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:57.984 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:57.984 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.984 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.984 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.984 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.984 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.984 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.984 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": "default-placement.data", 2024-09-12T17:20:57.984 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:20:57.984 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:57.984 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.985 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.985 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.985 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.985 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.985 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.985 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.985 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.985 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.985 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.985 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.985 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.985 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.985 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.986 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.986 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.986 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:57.986 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:57.986 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.986 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.986 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.986 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.986 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.986 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.986 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.986 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.986 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.986 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.987 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.987 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.987 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.987 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.987 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.987 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.987 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.987 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.987 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.987 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.987 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.987 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.987 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.987 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.988 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.988 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.988 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.988 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.988 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.988 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.988 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.988 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:57.988 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:57.988 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.988 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.988 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.988 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.989 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.989 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.989 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:57.989 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:20:57.989 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:57.989 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.989 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.989 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.989 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.989 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.989 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.989 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.989 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.989 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.990 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.990 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.990 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.990 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.990 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.990 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.990 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.990 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:57.990 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:57.990 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:57.990 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.990 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.990 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.990 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.991 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.991 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.991 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.991 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.991 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.991 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.991 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.991 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.991 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.991 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.991 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.991 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.992 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.992 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.992 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.992 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.992 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.992 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.992 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.992 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.992 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.992 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.992 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.993 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.993 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.993 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.993 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:57.993 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.993 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.993 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.993 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.993 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.993 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.993 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.993 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": "default-placement.data", 2024-09-12T17:20:57.994 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker___myobj_", 2024-09-12T17:20:57.994 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "marker__myobj_" 2024-09-12T17:20:57.994 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.994 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.994 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.994 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.994 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.994 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:57.994 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.994 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.994 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.994 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.994 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:57.995 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.995 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:57.995 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.995 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.995 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.995 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:57.995 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.995 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.995 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.995 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.995 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.995 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.995 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.996 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.996 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.996 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.996 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.996 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.996 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.996 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.996 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.996 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.996 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.996 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.996 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.996 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:57.997 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.997 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.997 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.997 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.997 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.997 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.997 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.997 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.997 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.997 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.997 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:57.997 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:57.998 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:57.998 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:57.998 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:57.998 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.998 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.998 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.998 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.998 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:57.998 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:57.998 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker___myobj_", 2024-09-12T17:20:57.998 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "marker__myobj_" 2024-09-12T17:20:57.998 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:57.999 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:57.999 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:57.999 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:57.999 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:57.999 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:57.999 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:57.999 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:57.999 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:57.999 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:57.999 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:57.999 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:57.999 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:57.999 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.000 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.000 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.000 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.000 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.000 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.000 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.000 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.000 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.000 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.000 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.000 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:58.000 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.000 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.001 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.001 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.001 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:58.001 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.001 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:58.001 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.001 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.001 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.001 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.001 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:58.001 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.001 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:58.001 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.001 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.002 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.002 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.002 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:58.002 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.002 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:58.002 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.002 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.002 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.002 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.002 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.002 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.002 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.002 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.002 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.003 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.003 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.003 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": "default-placement.data", 2024-09-12T17:20:58.003 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:20:58.003 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.003 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.003 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.003 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.003 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.003 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.003 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:58.003 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.003 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.004 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.004 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.004 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:58.004 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.004 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:58.004 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.004 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.004 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.004 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.004 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.004 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.004 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.004 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.004 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.005 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.005 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.005 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.005 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.005 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.005 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.005 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.005 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.005 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.005 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.005 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.005 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.005 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.005 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.006 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:58.006 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.006 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.006 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.006 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.006 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.006 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.006 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.006 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.006 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.006 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.006 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.006 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.007 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.007 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.007 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.007 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.007 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.007 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.007 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.007 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.007 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.007 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:20:58.007 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.007 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.007 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.008 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.008 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.008 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.008 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.008 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.008 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.008 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.008 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.008 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.008 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.008 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.008 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.009 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.009 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.009 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.009 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.009 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.009 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.009 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.009 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.009 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.009 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.009 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:58.009 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.009 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.010 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.010 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.010 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:58.010 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.010 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:58.010 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.010 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.010 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.010 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.010 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:58.010 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.010 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:58.010 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.011 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.011 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.011 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.011 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:58.011 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.011 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:58.011 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.011 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.011 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.011 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.011 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.011 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.011 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.011 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.012 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.012 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.012 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.012 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": "default-placement.data", 2024-09-12T17:20:58.012 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:20:58.012 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "marker__myobj_" 2024-09-12T17:20:58.012 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.012 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.012 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.012 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.012 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.012 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:58.013 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.013 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.013 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.013 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.013 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:58.013 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.013 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:58.013 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.013 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.013 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.013 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.013 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.013 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.014 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.014 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.014 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.014 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.014 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.014 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.014 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.014 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.014 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.014 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.014 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.014 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.014 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.015 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.015 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.015 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.015 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.015 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:58.015 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.015 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.015 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.015 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.015 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.015 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.015 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.015 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.015 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.016 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.016 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.016 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.016 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.016 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.016 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.016 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.016 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.016 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.016 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.016 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.016 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.016 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:20:58.016 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "marker__myobj_" 2024-09-12T17:20:58.017 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.017 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.017 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.017 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.017 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.017 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.017 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.017 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.017 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.017 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.017 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.017 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.017 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.018 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.018 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.018 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.018 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.018 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.018 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.018 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.018 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.018 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.018 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.018 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.018 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:58.018 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.018 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.019 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.019 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.019 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:58.019 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.019 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:58.019 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.019 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.019 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.019 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.019 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:58.019 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.019 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:58.019 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.019 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.019 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.020 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.020 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:58.020 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.020 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:58.020 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.020 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.020 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.020 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.020 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.020 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.020 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.020 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.020 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.020 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.021 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.021 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": "default-placement.data", 2024-09-12T17:20:58.021 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:20:58.021 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.021 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.021 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.021 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.021 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.021 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.021 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "test", 2024-09-12T17:20:58.021 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.021 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.021 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.021 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.022 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": "", 2024-09-12T17:20:58.022 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.022 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": "" 2024-09-12T17:20:58.022 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.022 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.022 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.022 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.022 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.022 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.022 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.022 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.022 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.022 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.022 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.023 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.023 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.023 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.023 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.023 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.023 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.023 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.023 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.023 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.023 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.023 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.023 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.023 INFO:tasks.workunit.client.0.smithi119.stdout: "obj": { 2024-09-12T17:20:58.024 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.024 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.024 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.024 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.024 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.024 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.024 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.024 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.024 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.024 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.024 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.024 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.025 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.025 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.025 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.025 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.025 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.025 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.025 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.025 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.025 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.025 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:20:58.025 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.025 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.025 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.025 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.026 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.026 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.026 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.026 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.026 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.026 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.026 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.026 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.026 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.026 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.026 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.026 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.026 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.026 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.027 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.027 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.027 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.027 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.027 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.027 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-12T17:20:58.027 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T17:20:58.027 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.027 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.027 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.027 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker_myobj", 2024-09-12T17:20:58.027 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.027 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.027 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.028 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.028 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.028 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.028 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.028 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.028 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.028 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.028 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.028 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.028 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.028 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.028 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.028 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.028 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.029 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:58.029 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.029 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.029 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.029 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.029 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.029 INFO:tasks.workunit.client.0.smithi119.stdout:raw=.data-pool:marker_myobj 2024-09-12T17:20:58.029 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.030 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj2": { 2024-09-12T17:20:58.030 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.030 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker_myobj", 2024-09-12T17:20:58.030 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.030 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.030 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.030 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.030 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj2": { 2024-09-12T17:20:58.030 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.030 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.030 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.031 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.031 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.031 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.031 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.031 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.031 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.031 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.031 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.031 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.031 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:58.031 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.031 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.032 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.032 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.032 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.032 INFO:tasks.workunit.client.0.smithi119.stdout:raw2=.data-pool:marker_myobj 2024-09-12T17:20:58.032 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.032 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.032 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.032 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:20:58.032 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.032 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.032 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.032 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.032 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.033 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.033 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.033 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.033 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.033 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.033 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.033 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.033 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.033 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.033 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.033 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.033 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.033 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:58.034 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.034 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.034 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.034 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.034 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.034 INFO:tasks.workunit.client.0.smithi119.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T17:20:58.034 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.034 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj2": { 2024-09-12T17:20:58.034 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.034 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:20:58.034 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.034 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.034 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.034 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.035 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj2": { 2024-09-12T17:20:58.035 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.035 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.035 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.035 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.035 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.035 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.035 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.035 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.035 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.035 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.035 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.035 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.036 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:58.036 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.036 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.036 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.036 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.036 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.036 INFO:tasks.workunit.client.0.smithi119.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T17:20:58.036 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.036 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.036 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.036 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:20:58.036 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.036 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.036 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.036 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.037 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.037 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.037 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.037 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.037 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.037 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.037 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.037 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.037 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.037 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.037 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.037 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.037 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.037 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:58.038 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.038 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.038 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.038 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.038 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.038 INFO:tasks.workunit.client.0.smithi119.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T17:20:58.038 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.038 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj2": { 2024-09-12T17:20:58.038 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.038 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:20:58.038 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.038 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.038 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.039 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.039 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj2": { 2024-09-12T17:20:58.039 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.039 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.039 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.039 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.039 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.039 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.039 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.039 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.039 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.039 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.039 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.039 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.039 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:58.040 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.040 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.040 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.040 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.040 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.040 INFO:tasks.workunit.client.0.smithi119.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T17:20:58.040 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.040 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.040 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.040 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:20:58.040 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.040 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.041 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.041 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.041 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.041 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.041 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.041 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.041 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.041 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.041 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.041 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.041 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.041 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.042 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.042 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.042 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.042 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:58.042 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.042 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.042 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.042 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.042 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.042 INFO:tasks.workunit.client.0.smithi119.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T17:20:58.042 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.042 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj2": { 2024-09-12T17:20:58.042 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.043 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:20:58.043 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.043 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.043 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.043 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.043 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj2": { 2024-09-12T17:20:58.043 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.043 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.043 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.043 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.043 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.043 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.043 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.043 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.044 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.044 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.044 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.044 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.044 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "myobj", 2024-09-12T17:20:58.044 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.044 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.044 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.044 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.044 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.044 INFO:tasks.workunit.client.0.smithi119.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T17:20:58.044 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.045 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.045 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.045 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker___myobj", 2024-09-12T17:20:58.045 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "marker__myobj" 2024-09-12T17:20:58.045 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.045 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.045 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.045 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.045 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.045 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.045 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.045 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.046 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.046 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.046 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.046 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.046 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.046 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.046 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.046 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.046 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:58.046 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.046 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.046 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.046 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.046 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.047 INFO:tasks.workunit.client.0.smithi119.stdout:raw=.data-pool:marker___myobj 2024-09-12T17:20:58.047 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.047 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj2": { 2024-09-12T17:20:58.047 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.047 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker___myobj", 2024-09-12T17:20:58.047 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "marker__myobj" 2024-09-12T17:20:58.047 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.047 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.047 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.047 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj2": { 2024-09-12T17:20:58.047 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.047 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.047 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.047 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.048 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.048 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.048 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.048 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.048 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.048 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.048 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.048 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.048 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:58.048 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.048 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.048 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.049 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.049 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.049 INFO:tasks.workunit.client.0.smithi119.stdout:raw2=.data-pool:marker___myobj 2024-09-12T17:20:58.049 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.049 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.049 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.049 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:20:58.049 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.049 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.049 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.049 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.049 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.049 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.050 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.050 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.050 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.050 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.050 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.050 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.050 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.050 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.050 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.050 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.050 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.050 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:58.050 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.051 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.051 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.051 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.051 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.051 INFO:tasks.workunit.client.0.smithi119.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T17:20:58.051 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.051 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj2": { 2024-09-12T17:20:58.051 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.051 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:20:58.051 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.052 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.052 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.052 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.052 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj2": { 2024-09-12T17:20:58.052 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.052 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.052 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.052 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.052 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.052 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.052 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.052 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.052 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.053 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.053 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.053 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.053 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:58.053 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.053 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.053 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.053 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.053 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.053 INFO:tasks.workunit.client.0.smithi119.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T17:20:58.053 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.053 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.053 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.053 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:20:58.054 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "marker__myobj" 2024-09-12T17:20:58.054 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.054 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.054 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.054 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.054 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.054 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.054 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.054 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.054 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.054 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.054 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.054 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.055 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.055 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.055 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.055 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.055 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:58.055 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.055 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.055 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.055 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.055 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.055 INFO:tasks.workunit.client.0.smithi119.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T17:20:58.055 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.055 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj2": { 2024-09-12T17:20:58.055 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.056 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:20:58.056 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "marker__myobj" 2024-09-12T17:20:58.056 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.056 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.056 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.056 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj2": { 2024-09-12T17:20:58.056 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.056 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.056 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.056 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.056 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.056 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.057 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.057 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.057 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.057 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.057 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.057 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.057 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:58.057 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.057 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.057 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.057 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.057 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.057 INFO:tasks.workunit.client.0.smithi119.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T17:20:58.058 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.058 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.058 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.058 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:20:58.058 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.058 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.058 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.058 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.058 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.058 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.058 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.058 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.059 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.059 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.059 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.059 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.059 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.059 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.059 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.059 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.059 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.059 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:58.059 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.059 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.059 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.060 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.060 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.060 INFO:tasks.workunit.client.0.smithi119.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T17:20:58.060 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.060 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj2": { 2024-09-12T17:20:58.060 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.060 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:20:58.060 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.060 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.060 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.060 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.061 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj2": { 2024-09-12T17:20:58.061 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.061 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.061 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.061 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.061 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.061 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.061 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.061 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.061 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.061 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.061 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.062 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.062 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj", 2024-09-12T17:20:58.062 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.062 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.062 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.062 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.062 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.062 INFO:tasks.workunit.client.0.smithi119.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T17:20:58.062 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.062 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.062 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.062 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker___myobj_", 2024-09-12T17:20:58.062 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "marker__myobj_" 2024-09-12T17:20:58.062 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.063 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.063 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.063 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.063 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.063 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.063 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.063 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.063 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.063 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.063 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.063 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.063 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.063 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.064 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.064 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.064 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.064 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.064 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.064 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.064 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.064 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.064 INFO:tasks.workunit.client.0.smithi119.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T17:20:58.064 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.064 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj2": { 2024-09-12T17:20:58.064 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.065 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker___myobj_", 2024-09-12T17:20:58.065 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "marker__myobj_" 2024-09-12T17:20:58.065 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.065 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.065 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.065 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj2": { 2024-09-12T17:20:58.065 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.065 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.065 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.065 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.065 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.065 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.065 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.066 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.066 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.066 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.066 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.066 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.066 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.066 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.066 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.066 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.066 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.066 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.066 INFO:tasks.workunit.client.0.smithi119.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T17:20:58.066 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.066 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.067 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.067 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:20:58.067 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.067 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.067 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.067 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.067 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.067 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.067 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.067 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.067 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.067 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.067 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.068 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.068 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.068 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.068 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.068 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.068 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.068 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.068 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.068 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.068 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.068 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.068 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.069 INFO:tasks.workunit.client.0.smithi119.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T17:20:58.069 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.069 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj2": { 2024-09-12T17:20:58.069 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.069 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:20:58.069 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.069 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.069 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.069 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.069 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj2": { 2024-09-12T17:20:58.069 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.069 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.069 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.070 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.070 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.070 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.070 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.070 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.070 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.070 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.070 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.070 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.070 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.070 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "", 2024-09-12T17:20:58.070 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.070 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.071 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.071 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.071 INFO:tasks.workunit.client.0.smithi119.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T17:20:58.071 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.071 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.071 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.071 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:20:58.071 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "marker__myobj_" 2024-09-12T17:20:58.071 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.071 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.071 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.071 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.071 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.071 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.072 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.072 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.072 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.072 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.072 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.072 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.072 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.072 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.072 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.072 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.072 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.072 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.072 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.072 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.073 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.073 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.073 INFO:tasks.workunit.client.0.smithi119.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T17:20:58.073 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.073 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj2": { 2024-09-12T17:20:58.073 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.073 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:20:58.073 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "marker__myobj_" 2024-09-12T17:20:58.073 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.073 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.073 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.073 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj2": { 2024-09-12T17:20:58.073 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.074 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.074 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.074 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.074 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.074 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.074 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.074 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.074 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.074 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.074 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.074 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.074 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.074 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.075 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "" 2024-09-12T17:20:58.075 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.075 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.075 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.075 INFO:tasks.workunit.client.0.smithi119.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T17:20:58.075 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.075 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj": { 2024-09-12T17:20:58.075 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.075 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:20:58.075 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.075 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.075 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.075 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.075 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj": { 2024-09-12T17:20:58.076 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.076 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.076 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.076 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.076 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.076 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.076 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.076 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.076 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.076 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.076 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.076 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.076 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.077 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.077 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.077 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.077 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.077 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.077 INFO:tasks.workunit.client.0.smithi119.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:20:58.077 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.077 INFO:tasks.workunit.client.0.smithi119.stdout: "raw_obj2": { 2024-09-12T17:20:58.077 INFO:tasks.workunit.client.0.smithi119.stdout: "pool": ".data-pool", 2024-09-12T17:20:58.077 INFO:tasks.workunit.client.0.smithi119.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:20:58.077 INFO:tasks.workunit.client.0.smithi119.stdout: "loc": "" 2024-09-12T17:20:58.077 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.078 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.078 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.078 INFO:tasks.workunit.client.0.smithi119.stdout: "new_obj2": { 2024-09-12T17:20:58.078 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket": { 2024-09-12T17:20:58.078 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "ebtest", 2024-09-12T17:20:58.078 INFO:tasks.workunit.client.0.smithi119.stdout: "marker": "marker", 2024-09-12T17:20:58.078 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:58.078 INFO:tasks.workunit.client.0.smithi119.stdout: "tenant": "", 2024-09-12T17:20:58.078 INFO:tasks.workunit.client.0.smithi119.stdout: "explicit_placement": { 2024-09-12T17:20:58.078 INFO:tasks.workunit.client.0.smithi119.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:58.078 INFO:tasks.workunit.client.0.smithi119.stdout: "data_extra_pool": "", 2024-09-12T17:20:58.078 INFO:tasks.workunit.client.0.smithi119.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:58.078 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.078 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.078 INFO:tasks.workunit.client.0.smithi119.stdout: "key": { 2024-09-12T17:20:58.079 INFO:tasks.workunit.client.0.smithi119.stdout: "name": "_myobj_", 2024-09-12T17:20:58.079 INFO:tasks.workunit.client.0.smithi119.stdout: "instance": "inst", 2024-09-12T17:20:58.079 INFO:tasks.workunit.client.0.smithi119.stdout: "ns": "ns" 2024-09-12T17:20:58.079 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.079 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.079 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.079 INFO:tasks.workunit.client.0.smithi119.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:20:58.079 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] TestRGWObj.old_to_raw (1 ms) 2024-09-12T17:20:58.079 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 4 tests from TestRGWObj (2 ms total) 2024-09-12T17:20:58.079 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:20:58.079 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:20:58.079 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 4 tests from 1 test suite ran. (2 ms total) 2024-09-12T17:20:58.079 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 4 tests. 2024-09-12T17:20:58.080 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:20:58.080 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:20:58.094 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T17:20:58.095 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T17:20:58.096 DEBUG:teuthology.orchestra.run.smithi119:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T17:20:58.304 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:58.304 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:58.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.359+0000 7f611f08f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.359+0000 7f611f08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.359+0000 7f611f08f9c0 20 realm 2024-09-12T17:20:58.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.359+0000 7f611f08f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.359+0000 7f611f08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.359+0000 7f611f08f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:58.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.359+0000 7f611f08f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.363+0000 7f611f08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.363+0000 7f611f08f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.363+0000 7f611f08f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:58.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.363+0000 7f611f08f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.363+0000 7f611f08f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:58.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.363+0000 7f611f08f9c0 20 searching for the correct realm 2024-09-12T17:20:58.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.371+0000 7f611c394640 0 -- 172.21.15.119:0/2927762643 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f61140c2040 msgr2=0x7f61140c2930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:20:58.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.379+0000 7f611c394640 0 -- 172.21.15.119:0/2927762643 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f610c001790 msgr2=0x7f610c008d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:58.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:20:58.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:20:58.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:58.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:58.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:58.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:58.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:58.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:58.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 zone default found 2024-09-12T17:20:58.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 4 Realm: () 2024-09-12T17:20:58.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:20:58.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:20:58.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:58.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 zonegroup default 2024-09-12T17:20:58.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.599+0000 7f611f08f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.601 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.603+0000 7f611f08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.601 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.603+0000 7f611f08f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.603+0000 7f611f08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.603+0000 7f611f08f9c0 20 started sync module instance, tier type = 2024-09-12T17:20:58.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.603+0000 7f611f08f9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:20:58.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.627+0000 7f611f08f9c0 20 add_watcher() i=0 2024-09-12T17:20:58.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.627+0000 7f611f08f9c0 20 add_watcher() i=1 2024-09-12T17:20:58.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.627+0000 7f611f08f9c0 20 add_watcher() i=2 2024-09-12T17:20:58.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.627+0000 7f611f08f9c0 20 add_watcher() i=3 2024-09-12T17:20:58.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.627+0000 7f611f08f9c0 20 add_watcher() i=4 2024-09-12T17:20:58.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.627+0000 7f611f08f9c0 20 add_watcher() i=5 2024-09-12T17:20:58.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.627+0000 7f611f08f9c0 20 add_watcher() i=6 2024-09-12T17:20:58.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.631+0000 7f611f08f9c0 20 add_watcher() i=7 2024-09-12T17:20:58.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.631+0000 7f611f08f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:58.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.635+0000 7f5fd2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:58.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.635+0000 7f611f08f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:58.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.635+0000 7f611f08f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:58.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.635+0000 7f611f08f9c0 5 note: GC not initialized 2024-09-12T17:20:58.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.635+0000 7f5fd1fe3640 20 reqs_thread_entry: start 2024-09-12T17:20:58.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.635+0000 7f611f08f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:20:58.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.635+0000 7f611f08f9c0 20 Filter name: none 2024-09-12T17:20:58.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.635+0000 7f5f437fe640 20 reqs_thread_entry: start 2024-09-12T17:20:58.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.635+0000 7f611f08f9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T17:20:58.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.635+0000 7f611f08f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.639+0000 7f611f08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.639+0000 7f611f08f9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T17:20:58.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.639+0000 7f611f08f9c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:20:58.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.639+0000 7f611f08f9c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T17:20:58.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.639+0000 7f611f08f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.639+0000 7f611f08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.639+0000 7f611f08f9c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T17:20:58.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.639+0000 7f611f08f9c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:20:58.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.639+0000 7f611f08f9c0 10 cache get: name=default.rgw.meta+users.keys+VqV6xKQlF4UmbPGXeR5daGBJoaw= : miss 2024-09-12T17:20:58.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.639+0000 7f611f08f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.639+0000 7f611f08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.639+0000 7f611f08f9c0 10 cache put: name=default.rgw.meta+users.keys+VqV6xKQlF4UmbPGXeR5daGBJoaw= info.flags=0x0 2024-09-12T17:20:58.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.639+0000 7f611f08f9c0 10 adding default.rgw.meta+users.keys+VqV6xKQlF4UmbPGXeR5daGBJoaw= to cache LRU end 2024-09-12T17:20:58.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.639+0000 7f611f08f9c0 10 cache get: name=default.rgw.meta+users.keys+VqV6xKQlF4UmbPGXeR5daGBJoaw= : hit (negative entry) 2024-09-12T17:20:58.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.639+0000 7f611f08f9c0 10 cache get: name=default.rgw.meta+users.keys+VqV6xKQlF4UmbPGXeR5daGBJoaw= : hit (negative entry) 2024-09-12T17:20:58.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.643+0000 7f611f08f9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:20:58.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.643+0000 7f611f08f9c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:20:58.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.643+0000 7f611f08f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T17:20:58.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.643+0000 7f5ff3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693187 cookie 94288108650256 notifier 5363 bl.length()=697 2024-09-12T17:20:58.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.643+0000 7f5ff3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:20:58.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.643+0000 7f5ff3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:20:58.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.651+0000 7f611f08f9c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:20:58.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.651+0000 7f611f08f9c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:20:58.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.651+0000 7f611f08f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T17:20:58.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.651+0000 7f5ff3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693184 cookie 94288108644640 notifier 5363 bl.length()=194 2024-09-12T17:20:58.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.651+0000 7f5ff3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:20:58.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.651+0000 7f5ff3fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:20:58.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.663+0000 7f611f08f9c0 10 cache put: name=default.rgw.meta+users.keys+VqV6xKQlF4UmbPGXeR5daGBJoaw= info.flags=0x7 2024-09-12T17:20:58.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.663+0000 7f611f08f9c0 10 moving default.rgw.meta+users.keys+VqV6xKQlF4UmbPGXeR5daGBJoaw= to cache LRU end 2024-09-12T17:20:58.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.663+0000 7f611f08f9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:VqV6xKQlF4UmbPGXeR5daGBJoaw=, ofs0, ns] 2024-09-12T17:20:58.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.663+0000 7f5ff37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693184 cookie 94288108667312 notifier 5363 bl.length()=203 2024-09-12T17:20:58.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.663+0000 7f5ff37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VqV6xKQlF4UmbPGXeR5daGBJoaw= info.flags=0x7 2024-09-12T17:20:58.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.663+0000 7f5ff37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VqV6xKQlF4UmbPGXeR5daGBJoaw= to cache LRU end 2024-09-12T17:20:58.668 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:20:58.668 INFO:tasks.workunit.client.0.smithi119.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T17:20:58.668 INFO:tasks.workunit.client.0.smithi119.stdout: "display_name": "librgw test user", 2024-09-12T17:20:58.668 INFO:tasks.workunit.client.0.smithi119.stdout: "email": "librgw@example.com", 2024-09-12T17:20:58.668 INFO:tasks.workunit.client.0.smithi119.stdout: "suspended": 0, 2024-09-12T17:20:58.668 INFO:tasks.workunit.client.0.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:20:58.668 INFO:tasks.workunit.client.0.smithi119.stdout: "subusers": [], 2024-09-12T17:20:58.668 INFO:tasks.workunit.client.0.smithi119.stdout: "keys": [ 2024-09-12T17:20:58.668 INFO:tasks.workunit.client.0.smithi119.stdout: { 2024-09-12T17:20:58.668 INFO:tasks.workunit.client.0.smithi119.stdout: "user": "ceph-test-librgw-file", 2024-09-12T17:20:58.669 INFO:tasks.workunit.client.0.smithi119.stdout: "access_key": "VqV6xKQlF4UmbPGXeR5daGBJoaw=", 2024-09-12T17:20:58.669 INFO:tasks.workunit.client.0.smithi119.stdout: "secret_key": "ZXTkBUey+3XuCfbYfJNH+o4gXUSYJ01tNXI6UorSadyd+ejBTbuShA==", 2024-09-12T17:20:58.669 INFO:tasks.workunit.client.0.smithi119.stdout: "active": true, 2024-09-12T17:20:58.669 INFO:tasks.workunit.client.0.smithi119.stdout: "create_date": "2024-09-12T17:20:58.643217Z" 2024-09-12T17:20:58.669 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:20:58.669 INFO:tasks.workunit.client.0.smithi119.stdout: ], 2024-09-12T17:20:58.669 INFO:tasks.workunit.client.0.smithi119.stdout: "swift_keys": [], 2024-09-12T17:20:58.669 INFO:tasks.workunit.client.0.smithi119.stdout: "caps": [], 2024-09-12T17:20:58.669 INFO:tasks.workunit.client.0.smithi119.stdout: "op_mask": "read, write, delete", 2024-09-12T17:20:58.669 INFO:tasks.workunit.client.0.smithi119.stdout: "default_placement": "", 2024-09-12T17:20:58.669 INFO:tasks.workunit.client.0.smithi119.stdout: "default_storage_class": "", 2024-09-12T17:20:58.669 INFO:tasks.workunit.client.0.smithi119.stdout: "placement_tags": [], 2024-09-12T17:20:58.669 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_quota": { 2024-09-12T17:20:58.669 INFO:tasks.workunit.client.0.smithi119.stdout: "enabled": false, 2024-09-12T17:20:58.670 INFO:tasks.workunit.client.0.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:20:58.670 INFO:tasks.workunit.client.0.smithi119.stdout: "max_size": -1, 2024-09-12T17:20:58.670 INFO:tasks.workunit.client.0.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:20:58.670 INFO:tasks.workunit.client.0.smithi119.stdout: "max_objects": -1 2024-09-12T17:20:58.670 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.670 INFO:tasks.workunit.client.0.smithi119.stdout: "user_quota": { 2024-09-12T17:20:58.670 INFO:tasks.workunit.client.0.smithi119.stdout: "enabled": false, 2024-09-12T17:20:58.670 INFO:tasks.workunit.client.0.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:20:58.670 INFO:tasks.workunit.client.0.smithi119.stdout: "max_size": -1, 2024-09-12T17:20:58.670 INFO:tasks.workunit.client.0.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:20:58.670 INFO:tasks.workunit.client.0.smithi119.stdout: "max_objects": -1 2024-09-12T17:20:58.670 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:20:58.670 INFO:tasks.workunit.client.0.smithi119.stdout: "temp_url_keys": [], 2024-09-12T17:20:58.670 INFO:tasks.workunit.client.0.smithi119.stdout: "type": "rgw", 2024-09-12T17:20:58.671 INFO:tasks.workunit.client.0.smithi119.stdout: "mfa_ids": [], 2024-09-12T17:20:58.671 INFO:tasks.workunit.client.0.smithi119.stdout: "account_id": "", 2024-09-12T17:20:58.671 INFO:tasks.workunit.client.0.smithi119.stdout: "path": "/", 2024-09-12T17:20:58.671 INFO:tasks.workunit.client.0.smithi119.stdout: "create_date": "2024-09-12T17:20:58.643201Z", 2024-09-12T17:20:58.671 INFO:tasks.workunit.client.0.smithi119.stdout: "tags": [], 2024-09-12T17:20:58.671 INFO:tasks.workunit.client.0.smithi119.stdout: "group_ids": [] 2024-09-12T17:20:58.671 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:20:58.671 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:20:58.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.671+0000 7f5fd2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:58.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.675+0000 7f611f08f9c0 20 remove_watcher() i=0 2024-09-12T17:20:58.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.675+0000 7f611f08f9c0 2 removed watcher, disabling cache 2024-09-12T17:20:58.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.679+0000 7f611f08f9c0 20 remove_watcher() i=1 2024-09-12T17:20:58.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.679+0000 7f611f08f9c0 20 remove_watcher() i=2 2024-09-12T17:20:58.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.683+0000 7f611f08f9c0 20 remove_watcher() i=3 2024-09-12T17:20:58.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.687+0000 7f611f08f9c0 20 remove_watcher() i=4 2024-09-12T17:20:58.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.687+0000 7f611f08f9c0 20 remove_watcher() i=5 2024-09-12T17:20:58.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.687+0000 7f611f08f9c0 20 remove_watcher() i=6 2024-09-12T17:20:58.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:20:58.691+0000 7f611f08f9c0 20 remove_watcher() i=7 2024-09-12T17:20:58.706 INFO:tasks.workunit.client.0.smithi119.stdout:phase 1.1 2024-09-12T17:20:58.728 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:20:58.728 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:20:58.728 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:20:58.728 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:20:58.741 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:58.741 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:59.669 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.INIT (941 ms) 2024-09-12T17:20:59.669 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:20:59.671 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MOUNT_NOROOT (3 ms) 2024-09-12T17:20:59.671 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:20:59.672 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:20:59.672 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:20:59.692 INFO:tasks.workunit.client.0.smithi119.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T17:20:59.701 INFO:tasks.workunit.client.0.smithi119.stdout:creating: nfsroot:foo/f1 2024-09-12T17:20:59.708 INFO:tasks.workunit.client.0.smithi119.stdout:creating: nfsroot:foo/f2 2024-09-12T17:20:59.715 INFO:tasks.workunit.client.0.smithi119.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T17:20:59.722 INFO:tasks.workunit.client.0.smithi119.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T17:20:59.730 INFO:tasks.workunit.client.0.smithi119.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T17:20:59.738 INFO:tasks.workunit.client.0.smithi119.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T17:20:59.746 INFO:tasks.workunit.client.0.smithi119.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T17:20:59.754 INFO:tasks.workunit.client.0.smithi119.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T17:20:59.761 INFO:tasks.workunit.client.0.smithi119.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T17:20:59.768 INFO:tasks.workunit.client.0.smithi119.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T17:20:59.775 INFO:tasks.workunit.client.0.smithi119.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T17:20:59.782 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SETUP_HIER1 (110 ms) 2024-09-12T17:20:59.782 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:21:00.056 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SETUP_DIRS1 (274 ms) 2024-09-12T17:21:00.056 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:21:00.056 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:21:00.056 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:21:00.093 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (37 ms) 2024-09-12T17:21:00.093 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:21:00.193 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (100 ms) 2024-09-12T17:21:00.193 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:21:00.193 INFO:tasks.workunit.client.0.smithi119.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T17:21:00.208 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (15 ms) 2024-09-12T17:21:00.208 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:21:00.208 INFO:tasks.workunit.client.0.smithi119.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T17:21:00.223 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (15 ms) 2024-09-12T17:21:00.223 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:21:00.224 INFO:tasks.workunit.client.0.smithi119.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:21:00.224 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:21:00.224 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:21:00.224 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:21:00.224 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:21:00.224 INFO:tasks.workunit.client.0.smithi119.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:21:00.224 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:21:00.224 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:21:00.224 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:21:00.224 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:21:00.224 INFO:tasks.workunit.client.0.smithi119.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:21:00.224 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:21:00.224 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:21:00.225 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:21:00.225 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:21:00.225 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:21:00.225 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:21:00.225 INFO:tasks.workunit.client.0.smithi119.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:21:00.225 INFO:tasks.workunit.client.0.smithi119.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:21:00.227 INFO:tasks.workunit.client.0.smithi119.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:21:00.228 INFO:tasks.workunit.client.0.smithi119.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:21:00.230 INFO:tasks.workunit.client.0.smithi119.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:21:00.230 INFO:tasks.workunit.client.0.smithi119.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:21:00.230 INFO:tasks.workunit.client.0.smithi119.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:21:00.234 INFO:tasks.workunit.client.0.smithi119.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:21:00.234 INFO:tasks.workunit.client.0.smithi119.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:21:00.237 INFO:tasks.workunit.client.0.smithi119.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:21:00.237 INFO:tasks.workunit.client.0.smithi119.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:21:00.238 INFO:tasks.workunit.client.0.smithi119.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:21:00.240 INFO:tasks.workunit.client.0.smithi119.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:21:00.240 INFO:tasks.workunit.client.0.smithi119.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:21:00.242 INFO:tasks.workunit.client.0.smithi119.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:21:00.242 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.READ_DIRS1 (18 ms) 2024-09-12T17:21:00.242 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:21:00.448 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.READF_SETUP1 (206 ms) 2024-09-12T17:21:00.448 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:21:00.448 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:21:00.448 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:21:00.448 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:21:00.448 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:21:00.448 INFO:tasks.workunit.client.0.smithi119.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:21:00.448 INFO:tasks.workunit.client.0.smithi119.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:21:00.448 INFO:tasks.workunit.client.0.smithi119.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:21:00.449 INFO:tasks.workunit.client.0.smithi119.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:21:00.449 INFO:tasks.workunit.client.0.smithi119.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:21:00.449 INFO:tasks.workunit.client.0.smithi119.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:21:00.449 INFO:tasks.workunit.client.0.smithi119.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:21:00.449 INFO:tasks.workunit.client.0.smithi119.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:21:00.449 INFO:tasks.workunit.client.0.smithi119.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:21:00.449 INFO:tasks.workunit.client.0.smithi119.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:21:00.449 INFO:tasks.workunit.client.0.smithi119.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:21:00.449 INFO:tasks.workunit.client.0.smithi119.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:21:00.449 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:21:00.449 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:21:00.466 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:21:00.467 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:21:00.473 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:21:00.476 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:21:00.483 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:21:00.485 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:21:00.485 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:21:00.488 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:21:00.488 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:21:00.488 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:21:00.489 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:21:00.494 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:21:00.494 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:21:00.494 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:21:00.494 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:21:00.495 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:21:00.495 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.HIER1 (46 ms) 2024-09-12T17:21:00.495 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:21:00.495 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:21:00.495 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:21:00.495 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:21:00.495 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:21:00.495 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:21:00.495 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:21:00.495 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:21:00.495 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:21:00.495 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:21:00.496 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:21:00.496 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:21:00.496 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:21:00.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:21:00.495+0000 7f96d5ab7a80 -1 shutting down 2024-09-12T17:21:00.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:21:00.499+0000 7f95af809640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57617, si_uid : 1000, si_addr0x3e80000e111, si_status0 2024-09-12T17:21:29.861 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SHUTDOWN (29367 ms) 2024-09-12T17:21:29.861 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 24 tests from LibRGW (31133 ms total) 2024-09-12T17:21:29.861 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:21:29.862 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:21:29.862 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 24 tests from 1 test suite ran. (31133 ms total) 2024-09-12T17:21:29.862 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 24 tests. 2024-09-12T17:21:29.875 INFO:tasks.workunit.client.0.smithi119.stdout:phase 1.2 2024-09-12T17:21:29.898 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:21:29.898 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:21:29.899 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:21:29.899 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:21:29.908 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:29.909 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:30.660 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.INIT (761 ms) 2024-09-12T17:21:30.660 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:21:30.662 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T17:21:30.662 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:21:30.662 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:21:30.662 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:21:30.662 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T17:21:30.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:21:30.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T17:21:30.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:21:30.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:21:30.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:21:30.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:21:30.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:21:30.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:21:30.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:21:30.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:21:30.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:21:30.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:21:30.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:21:30.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:21:30.664 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:21:30.664 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T17:21:30.664 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:21:30.664 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:21:30.664 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:21:30.664 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:21:30.664 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:21:30.664 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:21:30.664 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:21:30.664 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:21:30.664 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:21:30.664 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T17:21:30.664 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:21:30.665 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:21:30.665 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:21:30.665 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:21:30.665 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:21:30.665 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:21:30.665 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:21:30.665 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:21:30.665 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:21:30.665 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:21:30.665 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:21:30.665 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:21:30.665 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:21:30.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:21:30.663+0000 7f82349efa80 -1 shutting down 2024-09-12T17:21:30.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:21:30.667+0000 7f810e741640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58265, si_uid : 1000, si_addr0x3e80000e399, si_status0 2024-09-12T17:22:00.699 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SHUTDOWN (30037 ms) 2024-09-12T17:22:00.699 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 24 tests from LibRGW (30800 ms total) 2024-09-12T17:22:00.699 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:22:00.700 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:22:00.700 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 24 tests from 1 test suite ran. (30800 ms total) 2024-09-12T17:22:00.700 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 24 tests. 2024-09-12T17:22:00.716 INFO:tasks.workunit.client.0.smithi119.stdout:phase 1.3 2024-09-12T17:22:00.737 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:22:00.737 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:22:00.737 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:22:00.737 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:22:00.749 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:00.750 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:01.513 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.INIT (776 ms) 2024-09-12T17:22:01.513 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:22:01.515 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T17:22:01.515 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:22:01.515 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:22:01.515 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:22:01.525 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SETUP_HIER1 (10 ms) 2024-09-12T17:22:01.525 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:22:01.644 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SETUP_DIRS1 (118 ms) 2024-09-12T17:22:01.644 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:22:01.644 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:22:01.644 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:22:01.644 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:22:01.644 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:22:01.644 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:22:01.644 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:22:01.644 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:22:01.645 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:22:01.645 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:22:01.645 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:22:01.645 INFO:tasks.workunit.client.0.smithi119.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:22:01.645 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:22:01.645 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:22:01.645 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:22:01.645 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:22:01.645 INFO:tasks.workunit.client.0.smithi119.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:22:01.645 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:22:01.645 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:22:01.645 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:22:01.645 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:22:01.646 INFO:tasks.workunit.client.0.smithi119.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:22:01.646 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:22:01.646 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:22:01.646 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:22:01.646 INFO:tasks.workunit.client.0.smithi119.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:22:01.646 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:22:01.646 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:22:01.646 INFO:tasks.workunit.client.0.smithi119.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:22:01.646 INFO:tasks.workunit.client.0.smithi119.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:22:01.647 INFO:tasks.workunit.client.0.smithi119.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:22:01.647 INFO:tasks.workunit.client.0.smithi119.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:22:01.649 INFO:tasks.workunit.client.0.smithi119.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:22:01.649 INFO:tasks.workunit.client.0.smithi119.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:22:01.649 INFO:tasks.workunit.client.0.smithi119.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:22:01.653 INFO:tasks.workunit.client.0.smithi119.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:22:01.653 INFO:tasks.workunit.client.0.smithi119.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:22:01.656 INFO:tasks.workunit.client.0.smithi119.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:22:01.656 INFO:tasks.workunit.client.0.smithi119.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:22:01.656 INFO:tasks.workunit.client.0.smithi119.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:22:01.658 INFO:tasks.workunit.client.0.smithi119.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:22:01.658 INFO:tasks.workunit.client.0.smithi119.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:22:01.660 INFO:tasks.workunit.client.0.smithi119.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:22:01.660 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.READ_DIRS1 (16 ms) 2024-09-12T17:22:01.660 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:22:01.660 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:22:01.660 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:22:01.660 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:22:01.660 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:22:01.660 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:22:01.660 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:22:01.660 INFO:tasks.workunit.client.0.smithi119.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:22:01.661 INFO:tasks.workunit.client.0.smithi119.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:22:01.661 INFO:tasks.workunit.client.0.smithi119.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:22:01.661 INFO:tasks.workunit.client.0.smithi119.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:22:01.661 INFO:tasks.workunit.client.0.smithi119.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:22:01.661 INFO:tasks.workunit.client.0.smithi119.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:22:01.661 INFO:tasks.workunit.client.0.smithi119.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:22:01.661 INFO:tasks.workunit.client.0.smithi119.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:22:01.661 INFO:tasks.workunit.client.0.smithi119.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:22:01.661 INFO:tasks.workunit.client.0.smithi119.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:22:01.661 INFO:tasks.workunit.client.0.smithi119.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:22:01.661 INFO:tasks.workunit.client.0.smithi119.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:22:01.661 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:22:01.661 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:22:01.677 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:22:01.678 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:22:01.685 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:22:01.688 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:22:01.696 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:22:01.697 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:22:01.697 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:22:01.698 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:22:01.699 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:22:01.700 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:22:01.701 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:22:01.705 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:22:01.705 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:22:01.705 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:22:01.705 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:22:01.705 INFO:tasks.workunit.client.0.smithi119.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:22:01.705 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.HIER1 (45 ms) 2024-09-12T17:22:01.705 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:22:01.706 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:22:01.706 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:22:01.706 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:22:01.706 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:22:01.706 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:22:01.706 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:22:01.706 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:22:01.706 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:22:01.706 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:22:01.706 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:22:01.706 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:22:01.706 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:22:01.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:22:01.706+0000 7fc30ac72a80 -1 shutting down 2024-09-12T17:22:01.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:22:01.706+0000 7fc1e49c4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58910, si_uid : 1000, si_addr0x3e80000e61e, si_status0 2024-09-12T17:22:31.849 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SHUTDOWN (30144 ms) 2024-09-12T17:22:31.849 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 24 tests from LibRGW (31112 ms total) 2024-09-12T17:22:31.849 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:22:31.849 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:22:31.849 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 24 tests from 1 test suite ran. (31112 ms total) 2024-09-12T17:22:31.849 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 24 tests. 2024-09-12T17:22:31.863 INFO:tasks.workunit.client.0.smithi119.stdout:phase 2.1 2024-09-12T17:22:31.886 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:22:31.886 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:22:31.886 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:22:31.886 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:22:31.897 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:31.897 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:32.661 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.INIT (775 ms) 2024-09-12T17:22:32.662 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:22:32.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:22:32.663 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:22:32.681 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CREATE_BUCKET (18 ms) 2024-09-12T17:22:32.681 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:22:32.681 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:22:32.681 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:22:32.697 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave0 2024-09-12T17:22:32.716 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave1 2024-09-12T17:22:32.735 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave2 2024-09-12T17:22:32.751 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave3 2024-09-12T17:22:32.770 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave4 2024-09-12T17:22:32.790 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave5 2024-09-12T17:22:32.812 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave6 2024-09-12T17:22:32.833 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave7 2024-09-12T17:22:32.854 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave8 2024-09-12T17:22:32.876 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave9 2024-09-12T17:22:32.876 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (195 ms) 2024-09-12T17:22:32.876 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:22:33.611 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (735 ms) 2024-09-12T17:22:33.612 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:22:33.612 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:22:33.612 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:22:33.612 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:22:33.612 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:22:33.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:22:33.609+0000 7f719609ca80 -1 shutting down 2024-09-12T17:22:33.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:22:33.613+0000 7f706fdee640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59558, si_uid : 1000, si_addr0x3e80000e8a6, si_status0 2024-09-12T17:23:02.754 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SHUTDOWN (29142 ms) 2024-09-12T17:23:02.754 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 9 tests from LibRGW (30867 ms total) 2024-09-12T17:23:02.754 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:23:02.754 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:23:02.754 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 9 tests from 1 test suite ran. (30868 ms total) 2024-09-12T17:23:02.754 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 9 tests. 2024-09-12T17:23:02.764 INFO:tasks.workunit.client.0.smithi119.stdout:phase 2.2 2024-09-12T17:23:02.787 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:23:02.787 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:23:02.787 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:23:02.787 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:23:02.798 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:02.798 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:03.540 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.INIT (753 ms) 2024-09-12T17:23:03.540 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:23:03.542 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:23:03.542 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:23:03.543 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:23:03.543 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:23:03.597 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.DELETE_BUCKET (54 ms) 2024-09-12T17:23:03.597 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:23:03.615 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave0 2024-09-12T17:23:03.638 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave1 2024-09-12T17:23:03.662 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave2 2024-09-12T17:23:03.686 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave3 2024-09-12T17:23:03.710 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave4 2024-09-12T17:23:03.734 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave5 2024-09-12T17:23:03.757 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave6 2024-09-12T17:23:03.778 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave7 2024-09-12T17:23:03.801 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave8 2024-09-12T17:23:03.821 INFO:tasks.workunit.client.0.smithi119.stdout:created: sorrydave9 2024-09-12T17:23:03.821 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (224 ms) 2024-09-12T17:23:03.821 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:23:04.538 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (717 ms) 2024-09-12T17:23:04.539 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:23:04.539 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:23:04.539 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:23:04.539 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:23:04.539 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:23:04.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:23:04.537+0000 7fd5fb4d8a80 -1 shutting down 2024-09-12T17:23:04.541 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:23:04.541+0000 7fd4d522a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60203, si_uid : 1000, si_addr0x3e80000eb2b, si_status0 2024-09-12T17:23:33.815 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SHUTDOWN (29276 ms) 2024-09-12T17:23:33.815 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 9 tests from LibRGW (31027 ms total) 2024-09-12T17:23:33.815 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:23:33.815 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:23:33.816 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 9 tests from 1 test suite ran. (31027 ms total) 2024-09-12T17:23:33.816 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 9 tests. 2024-09-12T17:23:33.828 INFO:tasks.workunit.client.0.smithi119.stdout:phase 3.1 2024-09-12T17:23:34.169 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:23:34.169 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:23:34.169 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:23:34.169 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:23:34.178 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:34.178 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:34.712 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.INIT (543 ms) 2024-09-12T17:23:34.712 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:23:34.714 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:23:34.714 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:23:34.733 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CREATE_BUCKET (20 ms) 2024-09-12T17:23:34.734 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:23:34.741 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (8 ms) 2024-09-12T17:23:34.741 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:23:34.745 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T17:23:34.745 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:23:34.815 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.LARGE1 (69 ms) 2024-09-12T17:23:34.815 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:23:34.885 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.LARGE2 (68 ms) 2024-09-12T17:23:34.885 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:23:34.885 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:23:34.885 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:23:34.885 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:23:34.885 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:23:34.885 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:23:34.885 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:23:34.885 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:23:34.885 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:23:34.886 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:23:34.886 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:23:34.886 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:23:34.884+0000 7feca16f1a80 -1 shutting down 2024-09-12T17:23:34.886 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:23:34.888+0000 7feb7b443640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60848, si_uid : 1000, si_addr0x3e80000edb0, si_status0 2024-09-12T17:24:05.009 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SHUTDOWN (30125 ms) 2024-09-12T17:24:05.009 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 13 tests from LibRGW (30839 ms total) 2024-09-12T17:24:05.009 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:24:05.009 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:24:05.009 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 13 tests from 1 test suite ran. (30839 ms total) 2024-09-12T17:24:05.009 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 13 tests. 2024-09-12T17:24:05.026 INFO:tasks.workunit.client.0.smithi119.stdout:phase 3.2 2024-09-12T17:24:05.367 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:24:05.368 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:24:05.368 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:24:05.368 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:24:05.376 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:05.377 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:05.919 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.INIT (551 ms) 2024-09-12T17:24:05.919 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:24:05.921 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MOUNT (3 ms) 2024-09-12T17:24:05.921 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:24:05.921 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:24:05.921 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:24:05.933 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (12 ms) 2024-09-12T17:24:05.933 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:24:05.942 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (8 ms) 2024-09-12T17:24:05.942 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:24:06.016 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.LARGE1 (74 ms) 2024-09-12T17:24:06.016 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:24:06.016 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T17:24:06.016 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:24:06.016 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:24:06.016 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:24:06.028 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.DELETE_OBJECT (12 ms) 2024-09-12T17:24:06.028 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:24:06.091 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.DELETE_BUCKET (63 ms) 2024-09-12T17:24:06.091 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:24:06.091 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CLEANUP (1 ms) 2024-09-12T17:24:06.091 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:24:06.092 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:24:06.092 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:24:06.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:24:06.092+0000 7f012afffa80 -1 shutting down 2024-09-12T17:24:06.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:24:06.096+0000 7f0004d51640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61494, si_uid : 1000, si_addr0x3e80000f036, si_status0 2024-09-12T17:24:36.268 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SHUTDOWN (30176 ms) 2024-09-12T17:24:36.268 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 13 tests from LibRGW (30900 ms total) 2024-09-12T17:24:36.268 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:24:36.268 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:24:36.268 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 13 tests from 1 test suite ran. (30900 ms total) 2024-09-12T17:24:36.268 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 13 tests. 2024-09-12T17:24:36.286 INFO:tasks.workunit.client.0.smithi119.stdout:phase 4.1 2024-09-12T17:24:36.309 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:24:36.309 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:24:36.309 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:24:36.309 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:24:36.309 INFO:tasks.workunit.client.0.smithi119.stdout:read i1: 64001 2024-09-12T17:24:36.309 INFO:tasks.workunit.client.0.smithi119.stdout:read s1: blunderbuss 2024-09-12T17:24:36.309 INFO:tasks.workunit.client.0.smithi119.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:24:36.309 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:24:36.322 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:36.322 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:36.854 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.INIT (546 ms) 2024-09-12T17:24:36.854 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:24:36.856 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:24:36.856 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:24:36.885 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (29 ms) 2024-09-12T17:24:36.886 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:24:38.212 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_0 2024-09-12T17:24:38.212 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_1 2024-09-12T17:24:38.212 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_2 2024-09-12T17:24:38.213 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_3 2024-09-12T17:24:38.213 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_4 2024-09-12T17:24:38.213 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_5 2024-09-12T17:24:38.213 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_6 2024-09-12T17:24:38.213 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_7 2024-09-12T17:24:38.213 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_8 2024-09-12T17:24:38.213 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_9 2024-09-12T17:24:38.213 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_10 2024-09-12T17:24:38.213 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_11 2024-09-12T17:24:38.213 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_12 2024-09-12T17:24:38.213 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_13 2024-09-12T17:24:38.213 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_14 2024-09-12T17:24:38.214 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_15 2024-09-12T17:24:38.214 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_16 2024-09-12T17:24:38.214 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_17 2024-09-12T17:24:38.214 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_18 2024-09-12T17:24:38.214 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_19 2024-09-12T17:24:38.214 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_20 2024-09-12T17:24:38.214 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_21 2024-09-12T17:24:38.214 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_22 2024-09-12T17:24:38.214 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_23 2024-09-12T17:24:38.214 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_24 2024-09-12T17:24:38.214 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_25 2024-09-12T17:24:38.214 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_26 2024-09-12T17:24:38.214 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_27 2024-09-12T17:24:38.215 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_28 2024-09-12T17:24:38.215 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_29 2024-09-12T17:24:38.215 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_30 2024-09-12T17:24:38.215 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_31 2024-09-12T17:24:38.215 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_32 2024-09-12T17:24:38.215 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_33 2024-09-12T17:24:38.215 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_34 2024-09-12T17:24:38.215 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_35 2024-09-12T17:24:38.215 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_36 2024-09-12T17:24:38.215 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_37 2024-09-12T17:24:38.215 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_38 2024-09-12T17:24:38.215 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_39 2024-09-12T17:24:38.215 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_40 2024-09-12T17:24:38.216 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_41 2024-09-12T17:24:38.216 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_42 2024-09-12T17:24:38.216 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_43 2024-09-12T17:24:38.216 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_44 2024-09-12T17:24:38.216 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_45 2024-09-12T17:24:38.216 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_46 2024-09-12T17:24:38.216 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_47 2024-09-12T17:24:38.216 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_48 2024-09-12T17:24:38.216 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_49 2024-09-12T17:24:38.216 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_50 2024-09-12T17:24:38.216 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_51 2024-09-12T17:24:38.216 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_52 2024-09-12T17:24:38.217 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_53 2024-09-12T17:24:38.217 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_54 2024-09-12T17:24:38.217 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_55 2024-09-12T17:24:38.217 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_56 2024-09-12T17:24:38.217 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_57 2024-09-12T17:24:38.217 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_58 2024-09-12T17:24:38.217 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_59 2024-09-12T17:24:38.217 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_60 2024-09-12T17:24:38.217 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_61 2024-09-12T17:24:38.217 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_62 2024-09-12T17:24:38.217 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_63 2024-09-12T17:24:38.217 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_64 2024-09-12T17:24:38.217 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_65 2024-09-12T17:24:38.218 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_66 2024-09-12T17:24:38.218 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_67 2024-09-12T17:24:38.218 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_68 2024-09-12T17:24:38.218 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_69 2024-09-12T17:24:38.218 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_70 2024-09-12T17:24:38.218 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_71 2024-09-12T17:24:38.218 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_72 2024-09-12T17:24:38.218 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_73 2024-09-12T17:24:38.218 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_74 2024-09-12T17:24:38.218 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_75 2024-09-12T17:24:38.218 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_76 2024-09-12T17:24:38.219 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_77 2024-09-12T17:24:38.219 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_78 2024-09-12T17:24:38.219 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_79 2024-09-12T17:24:38.219 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_80 2024-09-12T17:24:38.219 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_81 2024-09-12T17:24:38.219 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_82 2024-09-12T17:24:38.219 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_83 2024-09-12T17:24:38.219 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_84 2024-09-12T17:24:38.219 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_85 2024-09-12T17:24:38.219 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_86 2024-09-12T17:24:38.219 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_87 2024-09-12T17:24:38.219 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_88 2024-09-12T17:24:38.220 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_89 2024-09-12T17:24:38.220 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_90 2024-09-12T17:24:38.220 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_91 2024-09-12T17:24:38.220 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_92 2024-09-12T17:24:38.220 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_93 2024-09-12T17:24:38.220 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_94 2024-09-12T17:24:38.220 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_95 2024-09-12T17:24:38.220 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_96 2024-09-12T17:24:38.220 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_97 2024-09-12T17:24:38.220 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_98 2024-09-12T17:24:38.220 INFO:tasks.workunit.client.0.smithi119.stdout:created: dmarker:f_99 2024-09-12T17:24:38.220 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1327 ms) 2024-09-12T17:24:38.220 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:24:38.221 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T17:24:38.221 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T17:24:38.221 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:24:38.221 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:24:38.221 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:24:38.222 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:24:38.222 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:24:38.222 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:24:38.222 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:24:38.222 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:24:38.222 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:24:38.222 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:24:38.222 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:24:38.222 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:24:38.222 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:24:38.222 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:24:38.222 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:24:38.222 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:24:38.223 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:24:38.223 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:24:38.223 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:24:38.223 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:24:38.223 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:24:38.223 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:24:38.223 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:24:38.223 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:24:38.223 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:24:38.223 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:24:38.223 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:24:38.224 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:24:38.224 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:24:38.224 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:24:38.224 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:24:38.224 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:24:38.224 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:24:38.224 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:24:38.224 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:24:38.224 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:24:38.224 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:24:38.224 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:24:38.225 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:24:38.225 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:24:38.225 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:24:38.225 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:24:38.225 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:24:38.225 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:24:38.225 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:24:38.225 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:24:38.225 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:24:38.225 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:24:38.225 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:24:38.225 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:24:38.226 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:24:38.226 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:24:38.226 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:24:38.226 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:24:38.226 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:24:38.226 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:24:38.226 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:24:38.226 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:24:38.226 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:24:38.226 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:24:38.226 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:24:38.226 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:24:38.226 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:24:38.227 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:24:38.227 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:24:38.227 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:24:38.227 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:24:38.227 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:24:38.227 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:24:38.227 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:24:38.227 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:24:38.227 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:24:38.227 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:24:38.227 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:24:38.227 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:24:38.227 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:24:38.227 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:24:38.227 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:24:38.228 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:24:38.228 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:24:38.228 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:24:38.228 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:24:38.228 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:24:38.228 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:24:38.228 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:24:38.228 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:24:38.228 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:24:38.228 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:24:38.228 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:24:38.228 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:24:38.229 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:24:38.229 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:24:38.229 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:24:38.229 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:24:38.229 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:24:38.229 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:24:38.229 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:24:38.229 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:24:38.229 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:24:38.229 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:24:38.229 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_READDIR (5 ms) 2024-09-12T17:24:38.229 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:24:38.230 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:24:38.230 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:24:38.230 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:24:38.230 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:24:38.230 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:24:38.231 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:24:38.231 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:24:38.231 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:24:38.231 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:24:38.231 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:24:38.231 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:24:38.231 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:24:38.231 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:24:38.231 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:24:38.231 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:24:38.231 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:24:38.231 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:24:38.231 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:24:38.231 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:24:38.232 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:24:38.232 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:24:38.232 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:24:38.232 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:24:38.232 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:24:38.232 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:24:38.232 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:24:38.232 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:24:38.232 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:24:38.232 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:24:38.232 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:24:38.232 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:24:38.232 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:24:38.233 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:24:38.233 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:24:38.233 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:24:38.233 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:24:38.233 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:24:38.233 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:24:38.233 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:24:38.233 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:24:38.233 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:24:38.233 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:24:38.233 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:24:38.233 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:24:38.234 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:24:38.234 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:24:38.234 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:24:38.234 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:24:38.234 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:24:38.234 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:24:38.234 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:24:38.234 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:24:38.234 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:24:38.234 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:24:38.234 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:24:38.234 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:24:38.234 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:24:38.235 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:24:38.235 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:24:38.235 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:24:38.235 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:24:38.235 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:24:38.235 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:24:38.235 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:24:38.235 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:24:38.235 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:24:38.235 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:24:38.235 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:24:38.235 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:24:38.235 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:24:38.235 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:24:38.235 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:24:38.236 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:24:38.236 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:24:38.236 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:24:38.236 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:24:38.236 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:24:38.236 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:24:38.236 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:24:38.236 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:24:38.236 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:24:38.236 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:24:38.236 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:24:38.236 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:24:38.236 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:24:38.237 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:24:38.237 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:24:38.237 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:24:38.237 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:24:38.237 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:24:38.237 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:24:38.237 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:24:38.237 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:24:38.237 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:24:38.237 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:24:38.237 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:24:38.237 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:24:38.238 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:24:38.238 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:24:38.238 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:24:38.238 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER2_READDIR (5 ms) 2024-09-12T17:24:38.238 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:24:38.238 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:24:38.238 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:24:38.238 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:24:38.238 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:24:38.238 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:24:38.238 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:24:38.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:24:38.227+0000 7fc0881eaa80 -1 shutting down 2024-09-12T17:24:38.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:24:38.227+0000 7fbf61f3c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62140, si_uid : 1000, si_addr0x3e80000f2bc, si_status0 2024-09-12T17:25:07.059 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SHUTDOWN (28836 ms) 2024-09-12T17:25:07.059 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 11 tests from LibRGW (30751 ms total) 2024-09-12T17:25:07.059 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:25:07.060 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:25:07.060 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 11 tests from 1 test suite ran. (30751 ms total) 2024-09-12T17:25:07.060 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 11 tests. 2024-09-12T17:25:07.074 INFO:tasks.workunit.client.0.smithi119.stdout:phase 4.2 2024-09-12T17:25:07.097 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:25:07.097 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:25:07.097 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:25:07.097 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:25:07.097 INFO:tasks.workunit.client.0.smithi119.stdout:read i1: 64001 2024-09-12T17:25:07.097 INFO:tasks.workunit.client.0.smithi119.stdout:read s1: blunderbuss 2024-09-12T17:25:07.097 INFO:tasks.workunit.client.0.smithi119.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:25:07.097 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:25:07.107 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:07.107 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:07.880 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.INIT (783 ms) 2024-09-12T17:25:07.880 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:25:07.882 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MOUNT (3 ms) 2024-09-12T17:25:07.882 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:25:07.898 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (15 ms) 2024-09-12T17:25:07.898 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:25:07.898 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:25:07.898 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:25:07.899 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:25:07.899 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:25:07.903 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:25:07.903 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:25:07.903 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:25:07.903 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:25:07.903 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:25:07.903 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:25:07.903 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:25:07.903 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:25:07.904 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:25:07.904 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:25:07.904 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:25:07.904 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:25:07.904 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:25:07.904 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:25:07.904 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:25:07.904 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:25:07.904 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:25:07.904 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:25:07.904 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:25:07.904 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:25:07.905 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:25:07.905 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:25:07.905 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:25:07.905 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:25:07.905 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:25:07.905 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:25:07.905 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:25:07.905 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:25:07.905 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:25:07.905 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:25:07.905 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:25:07.905 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:25:07.905 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:25:07.906 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:25:07.906 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:25:07.906 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:25:07.906 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:25:07.906 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:25:07.906 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:25:07.906 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:25:07.906 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:25:07.906 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:25:07.906 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:25:07.906 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:25:07.906 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:25:07.906 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:25:07.907 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:25:07.907 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:25:07.907 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:25:07.907 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:25:07.907 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:25:07.907 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:25:07.907 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:25:07.907 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:25:07.907 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:25:07.907 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:25:07.907 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:25:07.907 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:25:07.907 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:25:07.908 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:25:07.908 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:25:07.908 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:25:07.908 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:25:07.908 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:25:07.908 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:25:07.908 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:25:07.908 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:25:07.908 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:25:07.908 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:25:07.908 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:25:07.908 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:25:07.908 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:25:07.908 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:25:07.909 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:25:07.909 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:25:07.909 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:25:07.909 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:25:07.909 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:25:07.909 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:25:07.909 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:25:07.909 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:25:07.909 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:25:07.909 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:25:07.909 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:25:07.909 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:25:07.909 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:25:07.909 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:25:07.910 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:25:07.910 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:25:07.910 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:25:07.910 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:25:07.910 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:25:07.910 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:25:07.910 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:25:07.910 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:25:07.910 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:25:07.910 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:25:07.910 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:25:07.910 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:25:07.910 INFO:tasks.workunit.client.0.smithi119.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:25:07.911 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER2_READDIR (5 ms) 2024-09-12T17:25:07.911 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:25:07.911 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:25:07.911 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:25:07.911 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:25:07.911 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:25:07.911 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:25:07.911 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:25:07.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:25:07.907+0000 7f679e211a80 -1 shutting down 2024-09-12T17:25:07.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:25:07.907+0000 7f6677f63640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62788, si_uid : 1000, si_addr0x3e80000f544, si_status0 2024-09-12T17:25:38.141 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SHUTDOWN (30238 ms) 2024-09-12T17:25:38.141 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 11 tests from LibRGW (31044 ms total) 2024-09-12T17:25:38.141 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:25:38.141 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:25:38.141 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 11 tests from 1 test suite ran. (31044 ms total) 2024-09-12T17:25:38.142 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 11 tests. 2024-09-12T17:25:38.155 INFO:tasks.workunit.client.0.smithi119.stdout:phase 5.1 2024-09-12T17:25:38.189 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:25:38.189 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:25:38.189 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:25:38.189 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:25:38.200 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:38.201 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:38.758 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.INIT (569 ms) 2024-09-12T17:25:38.758 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:25:38.759 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:25:38.759 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:25:38.780 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CREATE_BUCKET (20 ms) 2024-09-12T17:25:38.780 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:25:38.787 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (8 ms) 2024-09-12T17:25:38.787 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:25:38.787 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:25:38.787 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:25:38.790 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T17:25:38.790 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:25:38.791 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:25:38.791 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:25:38.800 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.PUT_OBJECT (10 ms) 2024-09-12T17:25:38.800 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:25:38.804 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.GET_OBJECT (3 ms) 2024-09-12T17:25:38.804 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:25:38.804 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:25:38.804 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:25:38.804 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:25:38.804 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:25:38.805 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:25:38.805 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:25:38.805 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:25:38.805 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:25:38.805 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:25:38.805 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:25:38.805 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:25:38.805 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:25:38.805 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:25:38.805 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:25:38.805 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:25:38.805 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:25:38.805 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:25:38.806 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:25:38.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:25:38.806+0000 7fd5cbab0a80 -1 shutting down 2024-09-12T17:25:38.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:25:38.810+0000 7fd4a5802640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63433, si_uid : 1000, si_addr0x3e80000f7c9, si_status0 2024-09-12T17:26:09.099 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SHUTDOWN (30295 ms) 2024-09-12T17:26:09.099 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 19 tests from LibRGW (30910 ms total) 2024-09-12T17:26:09.099 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:26:09.099 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:26:09.099 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 19 tests from 1 test suite ran. (30910 ms total) 2024-09-12T17:26:09.099 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 19 tests. 2024-09-12T17:26:09.107 INFO:tasks.workunit.client.0.smithi119.stdout:phase 5.2 2024-09-12T17:26:09.143 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:26:09.143 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:26:09.143 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:26:09.143 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:26:09.151 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:09.151 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:09.695 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.INIT (551 ms) 2024-09-12T17:26:09.695 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:26:09.697 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MOUNT (3 ms) 2024-09-12T17:26:09.697 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:26:09.697 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:26:09.697 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:26:09.708 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (10 ms) 2024-09-12T17:26:09.708 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:26:09.708 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:26:09.708 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:26:09.708 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T17:26:09.708 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:26:09.708 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:26:09.708 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:26:09.708 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T17:26:09.709 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:26:09.709 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T17:26:09.709 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:26:09.709 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:26:09.709 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:26:09.709 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:26:09.709 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:26:09.709 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:26:09.709 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:26:09.709 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:26:09.709 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:26:09.709 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:26:09.709 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:26:09.717 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.DELETE_OBJECT (9 ms) 2024-09-12T17:26:09.717 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:26:09.778 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.DELETE_BUCKET (61 ms) 2024-09-12T17:26:09.778 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:26:09.779 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:26:09.779 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:26:09.779 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:26:09.779 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:26:09.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:26:09.782+0000 7fcfbcb01a80 -1 shutting down 2024-09-12T17:26:09.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:26:09.782+0000 7fce96853640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64081, si_uid : 1000, si_addr0x3e80000fa51, si_status0 2024-09-12T17:26:40.043 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SHUTDOWN (30265 ms) 2024-09-12T17:26:40.043 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 19 tests from LibRGW (30900 ms total) 2024-09-12T17:26:40.043 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:26:40.043 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:26:40.044 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 19 tests from 1 test suite ran. (30900 ms total) 2024-09-12T17:26:40.044 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 19 tests. 2024-09-12T17:26:40.056 INFO:tasks.workunit.client.0.smithi119.stdout:phase 6.1 2024-09-12T17:26:40.079 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:26:40.079 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment set-up. 2024-09-12T17:26:40.079 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 10 tests from LibRGW 2024-09-12T17:26:40.079 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:26:40.088 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:40.088 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:40.881 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.INIT (802 ms) 2024-09-12T17:26:40.881 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:26:40.883 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:26:40.883 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T17:26:40.921 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CREATE_BUCKETS (38 ms) 2024-09-12T17:26:40.921 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T17:26:40.937 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (16 ms) 2024-09-12T17:26:40.937 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T17:26:40.972 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.TOPDIR_RENAME (36 ms) 2024-09-12T17:26:40.973 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T17:26:41.026 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SUBDIR_RENAME (53 ms) 2024-09-12T17:26:41.026 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T17:26:41.084 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (58 ms) 2024-09-12T17:26:41.084 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:26:41.084 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:26:41.084 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:26:41.085 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:26:41.085 INFO:tasks.workunit.client.0.smithi119.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:26:41.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:26:41.085+0000 7fc1ed329a80 -1 shutting down 2024-09-12T17:26:41.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:26:41.089+0000 7fc0c707b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64726, si_uid : 1000, si_addr0x3e80000fcd6, si_status0 2024-09-12T17:27:11.142 INFO:tasks.workunit.client.0.smithi119.stdout:[ OK ] LibRGW.SHUTDOWN (30058 ms) 2024-09-12T17:27:11.143 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] 10 tests from LibRGW (31063 ms total) 2024-09-12T17:27:11.143 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:27:11.143 INFO:tasks.workunit.client.0.smithi119.stdout:[----------] Global test environment tear-down 2024-09-12T17:27:11.143 INFO:tasks.workunit.client.0.smithi119.stdout:[==========] 10 tests from 1 test suite ran. (31063 ms total) 2024-09-12T17:27:11.143 INFO:tasks.workunit.client.0.smithi119.stdout:[ PASSED ] 10 tests. 2024-09-12T17:27:11.158 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:27:11.158 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:27:11.174 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T17:27:11.175 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T17:27:11.176 DEBUG:teuthology.orchestra.run.smithi119:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T17:27:11.226 INFO:tasks.workunit.client.0.smithi119.stderr:+ [ -z ] 2024-09-12T17:27:11.226 INFO:tasks.workunit.client.0.smithi119.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:27:11.226 INFO:tasks.workunit.client.0.smithi119.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:27:11.226 INFO:tasks.workunit.client.0.smithi119.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-12T17:27:11.268 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:11.268 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:11.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.317+0000 7f47ff4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.317+0000 7f47ff4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:11.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.317+0000 7f47ff4ca9c0 20 realm 2024-09-12T17:27:11.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.317+0000 7f47ff4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.317+0000 7f47ff4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:11.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.317+0000 7f47ff4ca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:11.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.317+0000 7f47ff4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.317+0000 7f47ff4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:11.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.317+0000 7f47ff4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.321+0000 7f47ff4ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:11.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.321+0000 7f47ff4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.321+0000 7f47ff4ca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:11.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.321+0000 7f47ff4ca9c0 20 searching for the correct realm 2024-09-12T17:27:11.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.325+0000 7f47fd7d1640 0 -- 172.21.15.119:0/396170183 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f47e8008040 msgr2=0x7f47e8019410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:11.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.333+0000 7f47f7fff640 0 -- 172.21.15.119:0/396170183 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f47f80a0bc0 msgr2=0x7f47f807ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:11.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.549+0000 7f47ff4ca9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:27:11.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.549+0000 7f47ff4ca9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:27:11.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.549+0000 7f47ff4ca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:11.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.549+0000 7f47ff4ca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:11.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.549+0000 7f47ff4ca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:11.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.549+0000 7f47ff4ca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:11.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.549+0000 7f47ff4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.549+0000 7f47ff4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:11.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.549+0000 7f47ff4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.553+0000 7f47ff4ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:11.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.553+0000 7f47ff4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.553+0000 7f47ff4ca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:11.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.553+0000 7f47ff4ca9c0 20 zone default found 2024-09-12T17:27:11.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.553+0000 7f47ff4ca9c0 4 Realm: () 2024-09-12T17:27:11.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.553+0000 7f47ff4ca9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:27:11.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.553+0000 7f47ff4ca9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:27:11.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.553+0000 7f47ff4ca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:11.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.553+0000 7f47ff4ca9c0 20 zonegroup default 2024-09-12T17:27:11.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.553+0000 7f47ff4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.553+0000 7f47ff4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:11.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.553+0000 7f47ff4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.553+0000 7f47ff4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:11.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.553+0000 7f47ff4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.557+0000 7f47ff4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:11.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.557+0000 7f47ff4ca9c0 20 started sync module instance, tier type = 2024-09-12T17:27:11.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.557+0000 7f47ff4ca9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:27:11.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.581+0000 7f47ff4ca9c0 20 add_watcher() i=0 2024-09-12T17:27:11.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.581+0000 7f47ff4ca9c0 20 add_watcher() i=1 2024-09-12T17:27:11.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.581+0000 7f47ff4ca9c0 20 add_watcher() i=2 2024-09-12T17:27:11.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.581+0000 7f47ff4ca9c0 20 add_watcher() i=3 2024-09-12T17:27:11.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.581+0000 7f47ff4ca9c0 20 add_watcher() i=4 2024-09-12T17:27:11.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.581+0000 7f47ff4ca9c0 20 add_watcher() i=5 2024-09-12T17:27:11.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.581+0000 7f47ff4ca9c0 20 add_watcher() i=6 2024-09-12T17:27:11.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.581+0000 7f47ff4ca9c0 20 add_watcher() i=7 2024-09-12T17:27:11.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.581+0000 7f47ff4ca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:11.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.585+0000 7f46b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:11.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.585+0000 7f47ff4ca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:11.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.585+0000 7f47ff4ca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:11.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.585+0000 7f47ff4ca9c0 5 note: GC not initialized 2024-09-12T17:27:11.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f46b27e4640 20 reqs_thread_entry: start 2024-09-12T17:27:11.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:27:11.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 20 Filter name: none 2024-09-12T17:27:11.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f46ab7fe640 20 reqs_thread_entry: start 2024-09-12T17:27:11.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T17:27:11.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:11.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T17:27:11.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:27:11.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T17:27:11.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:11.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T17:27:11.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:27:11.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T17:27:11.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:11.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T17:27:11.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:27:11.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:27:11.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.589+0000 7f47ff4ca9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:27:11.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.593+0000 7f47ff4ca9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:27:11.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.593+0000 7f47ff4ca9c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:27:11.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.593+0000 7f47ff4ca9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T17:27:11.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.593+0000 7f46d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693190 cookie 94923138926896 notifier 5847 bl.length()=677 2024-09-12T17:27:11.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.593+0000 7f46d3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:27:11.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.593+0000 7f46d3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:27:11.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.597+0000 7f47ff4ca9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:27:11.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.597+0000 7f47ff4ca9c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:27:11.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.597+0000 7f47ff4ca9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T17:27:11.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.601+0000 7f46d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693198 cookie 94923138913952 notifier 5847 bl.length()=187 2024-09-12T17:27:11.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.601+0000 7f46d3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:27:11.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.601+0000 7f46d3fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:27:11.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.605+0000 7f47ff4ca9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:27:11.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.605+0000 7f47ff4ca9c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:27:11.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.605+0000 7f47ff4ca9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T17:27:11.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.605+0000 7f46d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693199 cookie 94923138913952 notifier 5847 bl.length()=197 2024-09-12T17:27:11.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.605+0000 7f46d37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:27:11.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.605+0000 7f46d37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:27:11.607 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:27:11.607 INFO:tasks.workunit.client.0.smithi119.stdout: "user_id": "ceph-test-maven", 2024-09-12T17:27:11.608 INFO:tasks.workunit.client.0.smithi119.stdout: "display_name": "maven test user", 2024-09-12T17:27:11.608 INFO:tasks.workunit.client.0.smithi119.stdout: "email": "sigv4@example.com", 2024-09-12T17:27:11.608 INFO:tasks.workunit.client.0.smithi119.stdout: "suspended": 0, 2024-09-12T17:27:11.608 INFO:tasks.workunit.client.0.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:27:11.608 INFO:tasks.workunit.client.0.smithi119.stdout: "subusers": [], 2024-09-12T17:27:11.608 INFO:tasks.workunit.client.0.smithi119.stdout: "keys": [ 2024-09-12T17:27:11.608 INFO:tasks.workunit.client.0.smithi119.stdout: { 2024-09-12T17:27:11.608 INFO:tasks.workunit.client.0.smithi119.stdout: "user": "ceph-test-maven", 2024-09-12T17:27:11.608 INFO:tasks.workunit.client.0.smithi119.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T17:27:11.608 INFO:tasks.workunit.client.0.smithi119.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T17:27:11.608 INFO:tasks.workunit.client.0.smithi119.stdout: "active": true, 2024-09-12T17:27:11.608 INFO:tasks.workunit.client.0.smithi119.stdout: "create_date": "2024-09-12T17:27:11.596253Z" 2024-09-12T17:27:11.609 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:27:11.609 INFO:tasks.workunit.client.0.smithi119.stdout: ], 2024-09-12T17:27:11.609 INFO:tasks.workunit.client.0.smithi119.stdout: "swift_keys": [], 2024-09-12T17:27:11.609 INFO:tasks.workunit.client.0.smithi119.stdout: "caps": [], 2024-09-12T17:27:11.609 INFO:tasks.workunit.client.0.smithi119.stdout: "op_mask": "read, write, delete", 2024-09-12T17:27:11.609 INFO:tasks.workunit.client.0.smithi119.stdout: "default_placement": "", 2024-09-12T17:27:11.609 INFO:tasks.workunit.client.0.smithi119.stdout: "default_storage_class": "", 2024-09-12T17:27:11.609 INFO:tasks.workunit.client.0.smithi119.stdout: "placement_tags": [], 2024-09-12T17:27:11.609 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_quota": { 2024-09-12T17:27:11.609 INFO:tasks.workunit.client.0.smithi119.stdout: "enabled": false, 2024-09-12T17:27:11.609 INFO:tasks.workunit.client.0.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:27:11.609 INFO:tasks.workunit.client.0.smithi119.stdout: "max_size": -1, 2024-09-12T17:27:11.610 INFO:tasks.workunit.client.0.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:27:11.610 INFO:tasks.workunit.client.0.smithi119.stdout: "max_objects": -1 2024-09-12T17:27:11.610 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:27:11.610 INFO:tasks.workunit.client.0.smithi119.stdout: "user_quota": { 2024-09-12T17:27:11.610 INFO:tasks.workunit.client.0.smithi119.stdout: "enabled": false, 2024-09-12T17:27:11.610 INFO:tasks.workunit.client.0.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:27:11.610 INFO:tasks.workunit.client.0.smithi119.stdout: "max_size": -1, 2024-09-12T17:27:11.610 INFO:tasks.workunit.client.0.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:27:11.610 INFO:tasks.workunit.client.0.smithi119.stdout: "max_objects": -1 2024-09-12T17:27:11.610 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:27:11.610 INFO:tasks.workunit.client.0.smithi119.stdout: "temp_url_keys": [], 2024-09-12T17:27:11.610 INFO:tasks.workunit.client.0.smithi119.stdout: "type": "rgw", 2024-09-12T17:27:11.610 INFO:tasks.workunit.client.0.smithi119.stdout: "mfa_ids": [], 2024-09-12T17:27:11.610 INFO:tasks.workunit.client.0.smithi119.stdout: "account_id": "", 2024-09-12T17:27:11.611 INFO:tasks.workunit.client.0.smithi119.stdout: "path": "/", 2024-09-12T17:27:11.611 INFO:tasks.workunit.client.0.smithi119.stdout: "create_date": "2024-09-12T17:27:11.596195Z", 2024-09-12T17:27:11.611 INFO:tasks.workunit.client.0.smithi119.stdout: "tags": [], 2024-09-12T17:27:11.611 INFO:tasks.workunit.client.0.smithi119.stdout: "group_ids": [] 2024-09-12T17:27:11.611 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:27:11.611 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:27:11.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.609+0000 7f46b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:11.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.617+0000 7f47ff4ca9c0 20 remove_watcher() i=0 2024-09-12T17:27:11.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.617+0000 7f47ff4ca9c0 2 removed watcher, disabling cache 2024-09-12T17:27:11.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.617+0000 7f47ff4ca9c0 20 remove_watcher() i=1 2024-09-12T17:27:11.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.621+0000 7f47ff4ca9c0 20 remove_watcher() i=2 2024-09-12T17:27:11.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.625+0000 7f47ff4ca9c0 20 remove_watcher() i=3 2024-09-12T17:27:11.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.625+0000 7f47ff4ca9c0 20 remove_watcher() i=4 2024-09-12T17:27:11.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.625+0000 7f47ff4ca9c0 20 remove_watcher() i=5 2024-09-12T17:27:11.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.629+0000 7f47ff4ca9c0 20 remove_watcher() i=6 2024-09-12T17:27:11.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:27:11.629+0000 7f47ff4ca9c0 20 remove_watcher() i=7 2024-09-12T17:27:11.642 INFO:tasks.workunit.client.0.smithi119.stderr:+ [ -z ] 2024-09-12T17:27:11.642 INFO:tasks.workunit.client.0.smithi119.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-12T17:27:11.642 INFO:tasks.workunit.client.0.smithi119.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-12T17:27:11.643 INFO:tasks.workunit.client.0.smithi119.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi119.front.sepia.ceph.com:80 2024-09-12T17:27:11.643 INFO:tasks.workunit.client.0.smithi119.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-12T17:27:11.643 INFO:tasks.workunit.client.0.smithi119.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T17:27:11.643 INFO:tasks.workunit.client.0.smithi119.stderr:+ ./mvnw clean package 2024-09-12T17:27:11.649 INFO:tasks.workunit.client.0.smithi119.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:27:16.013 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Scanning for projects... 2024-09-12T17:27:16.167 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T17:27:16.255 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 62 kB/s) 2024-09-12T17:27:16.281 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T17:27:16.315 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.4 MB/s) 2024-09-12T17:27:16.325 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T17:27:16.346 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.7 MB/s) 2024-09-12T17:27:16.380 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:27:16.381 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:27:16.381 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:27:16.381 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] from pom.xml 2024-09-12T17:27:16.381 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:27:16.384 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T17:27:16.401 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 312 kB/s) 2024-09-12T17:27:16.410 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T17:27:16.427 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-12T17:27:16.431 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T17:27:16.449 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.5 MB/s) 2024-09-12T17:27:16.456 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T17:27:16.473 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.2 MB/s) 2024-09-12T17:27:16.491 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T17:27:16.508 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.1 MB/s) 2024-09-12T17:27:16.518 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T17:27:16.533 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-12T17:27:16.535 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T17:27:16.550 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 578 kB/s) 2024-09-12T17:27:16.552 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T17:27:16.568 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.0 MB/s) 2024-09-12T17:27:16.572 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T17:27:16.587 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.5 MB/s) 2024-09-12T17:27:16.593 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T17:27:16.608 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 2.1 MB/s) 2024-09-12T17:27:16.614 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T17:27:16.629 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 654 kB/s) 2024-09-12T17:27:16.635 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T17:27:16.651 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 4.1 MB/s) 2024-09-12T17:27:16.658 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T17:27:16.674 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 332 kB/s) 2024-09-12T17:27:16.678 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T17:27:16.693 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.4 MB/s) 2024-09-12T17:27:16.696 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T17:27:16.712 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.1 MB/s) 2024-09-12T17:27:16.717 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T17:27:16.733 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.5 MB/s) 2024-09-12T17:27:16.741 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T17:27:16.757 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 352 kB/s) 2024-09-12T17:27:16.764 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T17:27:16.782 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.3 MB/s) 2024-09-12T17:27:16.791 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T17:27:16.807 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 398 kB/s) 2024-09-12T17:27:16.811 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T17:27:16.828 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 582 kB/s) 2024-09-12T17:27:16.832 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T17:27:16.849 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.7 MB/s) 2024-09-12T17:27:16.855 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T17:27:16.871 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.3 MB/s) 2024-09-12T17:27:16.879 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T17:27:16.896 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.6 MB/s) 2024-09-12T17:27:16.922 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T17:27:16.940 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 338 kB/s) 2024-09-12T17:27:16.944 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T17:27:16.962 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.2 MB/s) 2024-09-12T17:27:16.970 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T17:27:16.988 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-09-12T17:27:17.002 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T17:27:17.019 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 236 kB/s) 2024-09-12T17:27:17.023 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T17:27:17.039 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 91 kB/s) 2024-09-12T17:27:17.043 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T17:27:17.060 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 131 kB/s) 2024-09-12T17:27:17.069 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T17:27:17.088 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 191 kB/s) 2024-09-12T17:27:17.098 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T17:27:17.115 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 190 kB/s) 2024-09-12T17:27:17.123 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T17:27:17.142 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 609 kB/s) 2024-09-12T17:27:17.150 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T17:27:17.170 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 84 kB/s) 2024-09-12T17:27:17.178 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T17:27:17.195 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 212 kB/s) 2024-09-12T17:27:17.203 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T17:27:17.220 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 273 kB/s) 2024-09-12T17:27:17.226 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T17:27:17.242 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 72 kB/s) 2024-09-12T17:27:17.246 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T17:27:17.263 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 240 kB/s) 2024-09-12T17:27:17.267 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T17:27:17.283 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 863 kB/s) 2024-09-12T17:27:17.290 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T17:27:17.307 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 216 kB/s) 2024-09-12T17:27:17.314 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T17:27:17.330 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 144 kB/s) 2024-09-12T17:27:17.336 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T17:27:17.354 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 162 kB/s) 2024-09-12T17:27:17.361 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T17:27:17.379 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 412 kB/s) 2024-09-12T17:27:17.386 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T17:27:17.402 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 341 kB/s) 2024-09-12T17:27:17.410 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T17:27:17.427 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 218 kB/s) 2024-09-12T17:27:17.434 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T17:27:17.451 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 258 kB/s) 2024-09-12T17:27:17.455 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T17:27:17.472 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 134 kB/s) 2024-09-12T17:27:17.480 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T17:27:17.497 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 358 kB/s) 2024-09-12T17:27:17.507 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T17:27:17.525 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 357 kB/s) 2024-09-12T17:27:17.536 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T17:27:17.553 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 165 kB/s) 2024-09-12T17:27:17.564 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T17:27:17.581 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 193 kB/s) 2024-09-12T17:27:17.592 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T17:27:17.611 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 227 kB/s) 2024-09-12T17:27:17.615 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T17:27:17.631 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-09-12T17:27:17.640 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T17:27:17.657 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 389 kB/s) 2024-09-12T17:27:17.663 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T17:27:17.680 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 964 kB/s) 2024-09-12T17:27:17.686 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T17:27:17.704 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.9 MB/s) 2024-09-12T17:27:17.711 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T17:27:17.727 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.0 MB/s) 2024-09-12T17:27:17.737 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T17:27:17.754 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 276 kB/s) 2024-09-12T17:27:17.761 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T17:27:17.778 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 732 kB/s) 2024-09-12T17:27:17.789 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T17:27:17.807 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 776 kB/s) 2024-09-12T17:27:17.810 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T17:27:17.827 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.0 MB/s) 2024-09-12T17:27:17.852 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T17:27:17.868 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 979 kB/s) 2024-09-12T17:27:17.875 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T17:27:17.890 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.0 MB/s) 2024-09-12T17:27:17.894 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T17:27:17.914 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 37/79 kB Progress (1): 53/79 kB Progress (1): 69/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.0 MB/s) 2024-09-12T17:27:17.922 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T17:27:17.938 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.2 MB/s) 2024-09-12T17:27:17.945 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T17:27:17.961 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.2 MB/s) 2024-09-12T17:27:17.966 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T17:27:17.985 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.1 MB/s) 2024-09-12T17:27:17.996 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T17:27:18.013 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 226 kB/s) 2024-09-12T17:27:18.018 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T17:27:18.034 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 863 kB/s) 2024-09-12T17:27:18.040 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T17:27:18.058 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 189 kB/s) 2024-09-12T17:27:18.063 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T17:27:18.079 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 199 kB/s) 2024-09-12T17:27:18.084 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T17:27:18.100 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 127 kB/s) 2024-09-12T17:27:18.104 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T17:27:18.121 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 167 kB/s) 2024-09-12T17:27:18.126 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T17:27:18.143 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 95 kB/s) 2024-09-12T17:27:18.148 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T17:27:18.164 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 177 kB/s) 2024-09-12T17:27:18.170 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T17:27:18.186 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 188 kB/s) 2024-09-12T17:27:18.191 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T17:27:18.207 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 200 kB/s) 2024-09-12T17:27:18.213 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T17:27:18.230 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 60 kB/s) 2024-09-12T17:27:18.238 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T17:27:18.254 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 60 kB/s) 2024-09-12T17:27:18.262 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T17:27:18.279 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 180 kB/s) 2024-09-12T17:27:18.285 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T17:27:18.302 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 178 kB/s) 2024-09-12T17:27:18.308 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T17:27:18.325 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-12T17:27:18.332 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T17:27:18.349 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-12T17:27:18.354 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T17:27:18.372 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 168 kB/s) 2024-09-12T17:27:18.432 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T17:27:18.549 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 28 MB/s) 2024-09-12T17:27:18.552 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T17:27:18.552 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T17:27:18.553 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T17:27:18.553 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T17:27:18.553 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T17:27:18.592 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/49 kB Progress (1): 32/49 kB Progress (1): 49/49 kB Progress (1): 49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 1.2 MB/s) 2024-09-12T17:27:18.592 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T17:27:18.610 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 277 kB/s) 2024-09-12T17:27:18.610 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T17:27:18.626 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.4/71 kB Progress (1): 2.8/71 kB Progress (1): 4.1/71 kB Progress (1): 5.5/71 kB Progress (1): 6.9/71 kB Progress (1): 8.3/71 kB Progress (1): 9.7/71 kB Progress (1): 11/71 kB Progress (1): 12/71 kB Progress (1): 14/71 kB Progress (1): 15/71 kB Progress (1): 16/71 kB Progress (2): 16/71 kB | 1.4/16 kB Progress (2): 16/71 kB | 2.8/16 kB Progress (2): 16/71 kB | 4.1/16 kB Progress (2): 16/71 kB | 5.5/16 kB Progress (2): 16/71 kB | 6.9/16 kB Progress (2): 16/71 kB | 8.3/16 kB Progress (2): 16/71 kB | 9.7/16 kB Progress (2): 16/71 kB | 11/16 kB Progress (2): 16/71 kB | 12/16 kB Progress (2): 16/71 kB | 14/16 kB Progress (2): 16/71 kB | 15/16 kB Progress (2): 16/71 kB | 16 kB Progress (3): 16/71 kB | 16 kB | 16/782 kB Progress (3): 16/71 kB | 16 kB | 32/782 kB Progress (3): 32/71 kB | 16 kB | 32/782 kB Progress (3): 32/71 kB | 16 kB | 49/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 213 kB/s) 2024-09-12T17:27:18.626 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T17:27:18.637 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 32/71 kB | 65/782 kB Progress (2): 32/71 kB | 81/782 kB Progress (2): 32/71 kB | 98/782 kB Progress (2): 32/71 kB | 114/782 kB Progress (2): 32/71 kB | 130/782 kB Progress (2): 32/71 kB | 147/782 kB Progress (2): 32/71 kB | 163/782 kB Progress (2): 32/71 kB | 180/782 kB Progress (2): 32/71 kB | 196/782 kB Progress (2): 32/71 kB | 212/782 kB Progress (2): 32/71 kB | 229/782 kB Progress (3): 32/71 kB | 229/782 kB | 1.4/35 kB Progress (3): 32/71 kB | 229/782 kB | 2.8/35 kB Progress (3): 32/71 kB | 229/782 kB | 4.1/35 kB Progress (3): 32/71 kB | 245/782 kB | 4.1/35 kB Progress (3): 32/71 kB | 245/782 kB | 5.5/35 kB Progress (3): 32/71 kB | 245/782 kB | 6.9/35 kB Progress (3): 32/71 kB | 245/782 kB | 8.3/35 kB Progress (3): 32/71 kB | 262/782 kB | 8.3/35 kB Progress (3): 32/71 kB | 262/782 kB | 9.7/35 kB Progress (3): 32/71 kB | 262/782 kB | 11/35 kB Progress (3): 32/71 kB | 278/782 kB | 11/35 kB Progress (3): 32/71 kB | 278/782 kB | 12/35 kB Progress (3): 49/71 kB | 278/782 kB | 12/35 kB Progress (3): 49/71 kB | 278/782 kB | 14/35 kB Progress (3): 49/71 kB | 294/782 kB | 14/35 kB Progress (3): 49/71 kB | 294/782 kB | 15/35 kB Progress (3): 49/71 kB | 294/782 kB | 17/35 kB Progress (3): 49/71 kB | 294/782 kB | 18/35 kB Progress (3): 49/71 kB | 311/782 kB | 18/35 kB Progress (3): 49/71 kB | 311/782 kB | 19/35 kB Progress (3): 49/71 kB | 311/782 kB | 21/35 kB Progress (4): 49/71 kB | 311/782 kB | 21/35 kB | 16/98 kB Progress (4): 49/71 kB | 327/782 kB | 21/35 kB | 16/98 kB Progress (4): 49/71 kB | 327/782 kB | 22/35 kB | 16/98 kB Progress (4): 49/71 kB | 327/782 kB | 23/35 kB | 16/98 kB Progress (4): 49/71 kB | 327/782 kB | 25/35 kB | 16/98 kB Progress (4): 49/71 kB | 343/782 kB | 25/35 kB | 16/98 kB Progress (4): 49/71 kB | 343/782 kB | 26/35 kB | 16/98 kB Progress (4): 49/71 kB | 343/782 kB | 28/35 kB | 16/98 kB Progress (4): 49/71 kB | 343/782 kB | 29/35 kB | 16/98 kB Progress (4): 49/71 kB | 360/782 kB | 29/35 kB | 16/98 kB Progress (4): 49/71 kB | 360/782 kB | 30/35 kB | 16/98 kB Progress (4): 49/71 kB | 360/782 kB | 32/35 kB | 16/98 kB Progress (4): 49/71 kB | 360/782 kB | 33/35 kB | 16/98 kB Progress (4): 49/71 kB | 376/782 kB | 33/35 kB | 16/98 kB Progress (4): 49/71 kB | 376/782 kB | 34/35 kB | 16/98 kB Progress (4): 65/71 kB | 376/782 kB | 34/35 kB | 16/98 kB Progress (4): 65/71 kB | 376/782 kB | 35 kB | 16/98 kB Progress (4): 65/71 kB | 376/782 kB | 35 kB | 33/98 kB Progress (4): 71 kB | 376/782 kB | 35 kB | 33/98 kB Progress (4): 71 kB | 393/782 kB | 35 kB | 33/98 kB Progress (4): 71 kB | 402/782 kB | 35 kB | 33/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 820 kB/s) 2024-09-12T17:27:18.638 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T17:27:18.638 INFO:tasks.workunit.client.0.smithi119.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 409 kB/s) 2024-09-12T17:27:18.638 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T17:27:18.647 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 418/782 kB | 33/98 kB Progress (2): 435/782 kB | 33/98 kB Progress (2): 451/782 kB | 33/98 kB Progress (2): 468/782 kB | 33/98 kB Progress (2): 484/782 kB | 33/98 kB Progress (2): 500/782 kB | 33/98 kB Progress (2): 517/782 kB | 33/98 kB Progress (2): 533/782 kB | 33/98 kB Progress (2): 549/782 kB | 33/98 kB Progress (2): 566/782 kB | 33/98 kB Progress (2): 582/782 kB | 33/98 kB Progress (2): 599/782 kB | 33/98 kB Progress (3): 599/782 kB | 33/98 kB | 1.4/11 kB Progress (3): 599/782 kB | 33/98 kB | 2.8/11 kB Progress (3): 599/782 kB | 49/98 kB | 2.8/11 kB Progress (3): 615/782 kB | 49/98 kB | 2.8/11 kB Progress (3): 615/782 kB | 49/98 kB | 4.1/11 kB Progress (3): 615/782 kB | 49/98 kB | 5.5/11 kB Progress (3): 615/782 kB | 49/98 kB | 6.9/11 kB Progress (3): 631/782 kB | 49/98 kB | 6.9/11 kB Progress (3): 631/782 kB | 49/98 kB | 8.3/11 kB Progress (3): 631/782 kB | 49/98 kB | 9.7/11 kB Progress (3): 648/782 kB | 49/98 kB | 9.7/11 kB Progress (3): 648/782 kB | 49/98 kB | 11/11 kB Progress (3): 648/782 kB | 66/98 kB | 11/11 kB Progress (3): 664/782 kB | 66/98 kB | 11/11 kB Progress (3): 664/782 kB | 66/98 kB | 11 kB Progress (3): 681/782 kB | 66/98 kB | 11 kB Progress (3): 697/782 kB | 66/98 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 121 kB/s) 2024-09-12T17:27:18.648 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T17:27:18.651 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 713/782 kB | 66/98 kB Progress (2): 713/782 kB | 82/98 kB Progress (2): 730/782 kB | 82/98 kB Progress (2): 746/782 kB | 82/98 kB Progress (2): 762/782 kB | 82/98 kB Progress (2): 779/782 kB | 82/98 kB Progress (2): 782 kB | 82/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 8.0 MB/s) 2024-09-12T17:27:18.651 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T17:27:18.654 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 82/98 kB | 16/205 kB Progress (3): 82/98 kB | 16/205 kB | 16/30 kB Progress (3): 82/98 kB | 33/205 kB | 16/30 kB Progress (3): 82/98 kB | 33/205 kB | 30 kB Progress (3): 82/98 kB | 49/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 299 kB/s) 2024-09-12T17:27:18.655 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T17:27:18.657 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 82/98 kB | 66/205 kB Progress (2): 82/98 kB | 82/205 kB Progress (2): 98 kB | 82/205 kB Progress (2): 98 kB | 98/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 908 kB/s) 2024-09-12T17:27:18.657 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T17:27:18.667 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 98/205 kB | 1.4/81 kB Progress (2): 98/205 kB | 2.8/81 kB Progress (2): 98/205 kB | 4.1/81 kB Progress (2): 98/205 kB | 5.5/81 kB Progress (2): 115/205 kB | 5.5/81 kB Progress (2): 115/205 kB | 6.9/81 kB Progress (2): 115/205 kB | 8.3/81 kB Progress (2): 115/205 kB | 9.7/81 kB Progress (2): 131/205 kB | 9.7/81 kB Progress (2): 131/205 kB | 11/81 kB Progress (2): 131/205 kB | 12/81 kB Progress (2): 131/205 kB | 14/81 kB Progress (2): 147/205 kB | 14/81 kB Progress (2): 147/205 kB | 15/81 kB Progress (2): 147/205 kB | 16/81 kB Progress (2): 164/205 kB | 16/81 kB Progress (2): 180/205 kB | 16/81 kB Progress (2): 197/205 kB | 16/81 kB Progress (2): 205 kB | 16/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 1.8 MB/s) 2024-09-12T17:27:18.667 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T17:27:18.672 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 32/81 kB Progress (2): 32/81 kB | 16/798 kB Progress (3): 32/81 kB | 16/798 kB | 13 kB Progress (4): 32/81 kB | 16/798 kB | 13 kB | 16/182 kB Progress (4): 32/81 kB | 33/798 kB | 13 kB | 16/182 kB Progress (4): 32/81 kB | 33/798 kB | 13 kB | 33/182 kB Progress (4): 32/81 kB | 49/798 kB | 13 kB | 33/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 116 kB/s) 2024-09-12T17:27:18.672 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T17:27:18.681 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (3): 32/81 kB | 49/798 kB | 49/182 kB Progress (3): 32/81 kB | 66/798 kB | 49/182 kB Progress (3): 32/81 kB | 66/798 kB | 62/182 kB Progress (3): 32/81 kB | 66/798 kB | 78/182 kB Progress (3): 32/81 kB | 82/798 kB | 78/182 kB Progress (3): 32/81 kB | 98/798 kB | 78/182 kB Progress (3): 32/81 kB | 98/798 kB | 94/182 kB Progress (3): 32/81 kB | 115/798 kB | 94/182 kB Progress (3): 32/81 kB | 131/798 kB | 94/182 kB Progress (3): 32/81 kB | 131/798 kB | 111/182 kB Progress (3): 32/81 kB | 147/798 kB | 111/182 kB Progress (3): 32/81 kB | 147/798 kB | 127/182 kB Progress (3): 49/81 kB | 147/798 kB | 127/182 kB Progress (3): 49/81 kB | 164/798 kB | 127/182 kB Progress (3): 49/81 kB | 180/798 kB | 127/182 kB Progress (3): 49/81 kB | 197/798 kB | 127/182 kB Progress (3): 49/81 kB | 213/798 kB | 127/182 kB Progress (3): 49/81 kB | 229/798 kB | 127/182 kB Progress (3): 65/81 kB | 229/798 kB | 127/182 kB Progress (3): 65/81 kB | 246/798 kB | 127/182 kB Progress (3): 65/81 kB | 256/798 kB | 127/182 kB Progress (3): 65/81 kB | 272/798 kB | 127/182 kB Progress (3): 65/81 kB | 289/798 kB | 127/182 kB Progress (3): 65/81 kB | 305/798 kB | 127/182 kB Progress (3): 81 kB | 305/798 kB | 127/182 kB Progress (3): 81 kB | 321/798 kB | 127/182 kB Progress (3): 81 kB | 338/798 kB | 127/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 640 kB/s) 2024-09-12T17:27:18.681 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T17:27:18.684 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 354/798 kB | 127/182 kB Progress (2): 354/798 kB | 143/182 kB Progress (2): 370/798 kB | 143/182 kB Progress (2): 370/798 kB | 160/182 kB Progress (2): 387/798 kB | 160/182 kB Progress (3): 387/798 kB | 160/182 kB | 16/151 kB Progress (3): 387/798 kB | 176/182 kB | 16/151 kB Progress (3): 387/798 kB | 182 kB | 16/151 kB Progress (3): 403/798 kB | 182 kB | 16/151 kB Progress (3): 403/798 kB | 182 kB | 33/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.5 MB/s) 2024-09-12T17:27:18.684 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T17:27:18.689 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 420/798 kB | 33/151 kB Progress (2): 420/798 kB | 49/151 kB Progress (2): 436/798 kB | 49/151 kB Progress (2): 436/798 kB | 66/151 kB Progress (2): 452/798 kB | 66/151 kB Progress (2): 452/798 kB | 82/151 kB Progress (2): 469/798 kB | 82/151 kB Progress (2): 469/798 kB | 98/151 kB Progress (2): 485/798 kB | 98/151 kB Progress (2): 485/798 kB | 115/151 kB Progress (2): 502/798 kB | 115/151 kB Progress (3): 502/798 kB | 115/151 kB | 16/27 kB Progress (3): 502/798 kB | 131/151 kB | 16/27 kB Progress (3): 518/798 kB | 131/151 kB | 16/27 kB Progress (3): 518/798 kB | 131/151 kB | 27 kB Progress (3): 518/798 kB | 147/151 kB | 27 kB Progress (3): 534/798 kB | 147/151 kB | 27 kB Progress (3): 534/798 kB | 151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 208 kB/s) 2024-09-12T17:27:18.689 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T17:27:18.690 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 551/798 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.1 MB/s) 2024-09-12T17:27:18.690 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T17:27:18.698 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 567/798 kB Progress (1): 583/798 kB Progress (1): 600/798 kB Progress (1): 616/798 kB Progress (1): 633/798 kB Progress (1): 649/798 kB Progress (1): 665/798 kB Progress (1): 682/798 kB Progress (1): 698/798 kB Progress (1): 715/798 kB Progress (1): 731/798 kB Progress (1): 747/798 kB Progress (1): 764/798 kB Progress (2): 764/798 kB | 16/30 kB Progress (2): 780/798 kB | 16/30 kB Progress (2): 780/798 kB | 30 kB Progress (2): 796/798 kB | 30 kB Progress (2): 798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 5.7 MB/s) 2024-09-12T17:27:18.698 INFO:tasks.workunit.client.0.smithi119.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 216 kB/s) 2024-09-12T17:27:18.698 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T17:27:18.698 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T17:27:18.706 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/385 kB Progress (1): 33/385 kB Progress (1): 49/385 kB Progress (1): 66/385 kB Progress (1): 82/385 kB Progress (1): 98/385 kB Progress (1): 115/385 kB Progress (1): 131/385 kB Progress (1): 147/385 kB Progress (1): 164/385 kB Progress (1): 180/385 kB Progress (1): 197/385 kB Progress (1): 213/385 kB Progress (1): 229/385 kB Progress (1): 246/385 kB Progress (1): 262/385 kB Progress (1): 279/385 kB Progress (1): 295/385 kB Progress (1): 311/385 kB Progress (2): 311/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 89 kB/s) 2024-09-12T17:27:18.706 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T17:27:18.712 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 311/385 kB | 16/75 kB Progress (2): 311/385 kB | 33/75 kB Progress (2): 311/385 kB | 49/75 kB Progress (2): 311/385 kB | 66/75 kB Progress (2): 328/385 kB | 66/75 kB Progress (2): 344/385 kB | 66/75 kB Progress (2): 344/385 kB | 75 kB Progress (2): 360/385 kB | 75 kB Progress (2): 377/385 kB | 75 kB Progress (2): 385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 487 kB/s) 2024-09-12T17:27:18.712 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T17:27:18.712 INFO:tasks.workunit.client.0.smithi119.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.5 MB/s) 2024-09-12T17:27:18.712 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T17:27:18.727 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/780 kB Progress (1): 33/780 kB Progress (1): 49/780 kB Progress (1): 66/780 kB Progress (2): 66/780 kB | 16/329 kB Progress (2): 82/780 kB | 16/329 kB Progress (2): 98/780 kB | 16/329 kB Progress (2): 115/780 kB | 16/329 kB Progress (2): 115/780 kB | 33/329 kB Progress (2): 131/780 kB | 33/329 kB Progress (2): 147/780 kB | 33/329 kB Progress (2): 147/780 kB | 49/329 kB Progress (2): 164/780 kB | 49/329 kB Progress (2): 180/780 kB | 49/329 kB Progress (2): 197/780 kB | 49/329 kB Progress (2): 197/780 kB | 66/329 kB Progress (2): 213/780 kB | 66/329 kB Progress (2): 229/780 kB | 66/329 kB Progress (2): 229/780 kB | 82/329 kB Progress (2): 246/780 kB | 82/329 kB Progress (2): 256/780 kB | 82/329 kB Progress (2): 272/780 kB | 82/329 kB Progress (2): 272/780 kB | 98/329 kB Progress (2): 289/780 kB | 98/329 kB Progress (2): 305/780 kB | 98/329 kB Progress (2): 305/780 kB | 115/329 kB Progress (2): 321/780 kB | 115/329 kB Progress (2): 338/780 kB | 115/329 kB Progress (2): 354/780 kB | 115/329 kB Progress (2): 370/780 kB | 115/329 kB Progress (2): 387/780 kB | 115/329 kB Progress (2): 403/780 kB | 115/329 kB Progress (2): 420/780 kB | 115/329 kB Progress (2): 436/780 kB | 115/329 kB Progress (2): 452/780 kB | 115/329 kB Progress (2): 469/780 kB | 115/329 kB Progress (2): 485/780 kB | 115/329 kB Progress (2): 502/780 kB | 115/329 kB Progress (3): 502/780 kB | 115/329 kB | 16/501 kB Progress (3): 518/780 kB | 115/329 kB | 16/501 kB Progress (3): 534/780 kB | 115/329 kB | 16/501 kB Progress (3): 534/780 kB | 115/329 kB | 32/501 kB Progress (3): 551/780 kB | 115/329 kB | 32/501 kB Progress (3): 567/780 kB | 115/329 kB | 32/501 kB Progress (3): 567/780 kB | 115/329 kB | 49/501 kB Progress (3): 583/780 kB | 115/329 kB | 49/501 kB Progress (3): 600/780 kB | 115/329 kB | 49/501 kB Progress (3): 600/780 kB | 115/329 kB | 65/501 kB Progress (3): 616/780 kB | 115/329 kB | 65/501 kB Progress (3): 633/780 kB | 115/329 kB | 65/501 kB Progress (3): 633/780 kB | 115/329 kB | 81/501 kB Progress (3): 649/780 kB | 115/329 kB | 81/501 kB Progress (3): 665/780 kB | 115/329 kB | 81/501 kB Progress (3): 665/780 kB | 115/329 kB | 98/501 kB Progress (3): 682/780 kB | 115/329 kB | 98/501 kB Progress (3): 698/780 kB | 115/329 kB | 98/501 kB Progress (3): 698/780 kB | 115/329 kB | 114/501 kB Progress (3): 715/780 kB | 115/329 kB | 114/501 kB Progress (3): 715/780 kB | 131/329 kB | 114/501 kB Progress (3): 731/780 kB | 131/329 kB | 114/501 kB Progress (3): 747/780 kB | 131/329 kB | 114/501 kB Progress (3): 747/780 kB | 131/329 kB | 130/501 kB Progress (3): 764/780 kB | 131/329 kB | 130/501 kB Progress (3): 764/780 kB | 147/329 kB | 130/501 kB Progress (3): 780/780 kB | 147/329 kB | 130/501 kB Progress (4): 780/780 kB | 147/329 kB | 130/501 kB | 16/354 kB Progress (4): 780 kB | 147/329 kB | 130/501 kB | 16/354 kB Progress (4): 780 kB | 147/329 kB | 147/501 kB | 16/354 kB Progress (5): 780 kB | 147/329 kB | 147/501 kB | 16/354 kB | 16/41 kB Progress (5): 780 kB | 147/329 kB | 147/501 kB | 33/354 kB | 16/41 kB Progress (5): 780 kB | 164/329 kB | 147/501 kB | 33/354 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.6 MB/s) 2024-09-12T17:27:18.727 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (4): 164/329 kB | 147/501 kB | 49/354 kB | 16/41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T17:27:18.728 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (4): 164/329 kB | 163/501 kB | 49/354 kB | 16/41 kB Progress (4): 164/329 kB | 163/501 kB | 49/354 kB | 33/41 kB Progress (4): 164/329 kB | 163/501 kB | 64/354 kB | 33/41 kB Progress (4): 180/329 kB | 163/501 kB | 64/354 kB | 33/41 kB Progress (4): 180/329 kB | 163/501 kB | 64/354 kB | 41 kB Progress (4): 180/329 kB | 163/501 kB | 81/354 kB | 41 kB Progress (4): 180/329 kB | 180/501 kB | 81/354 kB | 41 kB Progress (4): 180/329 kB | 180/501 kB | 97/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 243 kB/s) 2024-09-12T17:27:18.729 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T17:27:18.748 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (3): 197/329 kB | 180/501 kB | 97/354 kB Progress (3): 197/329 kB | 180/501 kB | 114/354 kB Progress (3): 197/329 kB | 196/501 kB | 114/354 kB Progress (3): 197/329 kB | 196/501 kB | 130/354 kB Progress (3): 213/329 kB | 196/501 kB | 130/354 kB Progress (3): 213/329 kB | 196/501 kB | 146/354 kB Progress (3): 213/329 kB | 212/501 kB | 146/354 kB Progress (3): 213/329 kB | 212/501 kB | 163/354 kB Progress (3): 229/329 kB | 212/501 kB | 163/354 kB Progress (3): 229/329 kB | 212/501 kB | 179/354 kB Progress (3): 229/329 kB | 229/501 kB | 179/354 kB Progress (3): 229/329 kB | 229/501 kB | 195/354 kB Progress (3): 246/329 kB | 229/501 kB | 195/354 kB Progress (3): 246/329 kB | 229/501 kB | 212/354 kB Progress (3): 246/329 kB | 245/501 kB | 212/354 kB Progress (3): 256/329 kB | 245/501 kB | 212/354 kB Progress (3): 256/329 kB | 245/501 kB | 228/354 kB Progress (3): 256/329 kB | 245/501 kB | 245/354 kB Progress (3): 256/329 kB | 262/501 kB | 245/354 kB Progress (3): 272/329 kB | 262/501 kB | 245/354 kB Progress (3): 272/329 kB | 262/501 kB | 261/354 kB Progress (3): 289/329 kB | 262/501 kB | 261/354 kB Progress (3): 289/329 kB | 262/501 kB | 277/354 kB Progress (3): 289/329 kB | 278/501 kB | 277/354 kB Progress (4): 289/329 kB | 278/501 kB | 277/354 kB | 6.4 kB Progress (4): 289/329 kB | 278/501 kB | 294/354 kB | 6.4 kB Progress (4): 305/329 kB | 278/501 kB | 294/354 kB | 6.4 kB Progress (5): 305/329 kB | 278/501 kB | 294/354 kB | 6.4 kB | 16/586 kB Progress (5): 305/329 kB | 278/501 kB | 310/354 kB | 6.4 kB | 16/586 kB Progress (5): 305/329 kB | 294/501 kB | 310/354 kB | 6.4 kB | 16/586 kB Progress (5): 321/329 kB | 294/501 kB | 310/354 kB | 6.4 kB | 16/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 34 kB/s) 2024-09-12T17:27:18.748 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (4): 321/329 kB | 294/501 kB | 327/354 kB | 16/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T17:27:18.750 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (4): 329 kB | 294/501 kB | 327/354 kB | 16/586 kB Progress (4): 329 kB | 294/501 kB | 327/354 kB | 33/586 kB Progress (4): 329 kB | 294/501 kB | 343/354 kB | 33/586 kB Progress (4): 329 kB | 311/501 kB | 343/354 kB | 33/586 kB Progress (4): 329 kB | 311/501 kB | 354 kB | 33/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.7 MB/s) 2024-09-12T17:27:18.750 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (3): 311/501 kB | 354 kB | 49/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T17:27:18.751 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (3): 327/501 kB | 354 kB | 49/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.9 MB/s) 2024-09-12T17:27:18.751 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 327/501 kB | 66/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T17:27:18.754 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 343/501 kB | 66/586 kB Progress (2): 343/501 kB | 82/586 kB Progress (2): 360/501 kB | 82/586 kB Progress (2): 360/501 kB | 98/586 kB Progress (2): 376/501 kB | 98/586 kB Progress (2): 376/501 kB | 115/586 kB Progress (2): 393/501 kB | 115/586 kB Progress (2): 393/501 kB | 131/586 kB Progress (2): 402/501 kB | 131/586 kB Progress (2): 402/501 kB | 147/586 kB Progress (2): 418/501 kB | 147/586 kB Progress (2): 435/501 kB | 147/586 kB Progress (2): 451/501 kB | 147/586 kB Progress (2): 468/501 kB | 147/586 kB Progress (2): 484/501 kB | 147/586 kB Progress (2): 500/501 kB | 147/586 kB Progress (2): 501 kB | 147/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.6 MB/s) 2024-09-12T17:27:18.754 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T17:27:18.764 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 164/586 kB Progress (1): 180/586 kB Progress (1): 197/586 kB Progress (1): 213/586 kB Progress (1): 229/586 kB Progress (1): 246/586 kB Progress (1): 262/586 kB Progress (1): 279/586 kB Progress (1): 295/586 kB Progress (1): 311/586 kB Progress (1): 328/586 kB Progress (1): 344/586 kB Progress (1): 360/586 kB Progress (1): 377/586 kB Progress (1): 393/586 kB Progress (1): 410/586 kB Progress (1): 426/586 kB Progress (1): 442/586 kB Progress (2): 442/586 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 70 kB/s) 2024-09-12T17:27:18.764 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 442/586 kB | 16/106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T17:27:18.765 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 442/586 kB | 33/106 kB Progress (2): 442/586 kB | 49/106 kB Progress (2): 442/586 kB | 66/106 kB Progress (2): 442/586 kB | 82/106 kB Progress (2): 442/586 kB | 98/106 kB Progress (2): 442/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 516 kB/s) 2024-09-12T17:27:18.765 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T17:27:18.771 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 442/586 kB | 16/211 kB Progress (2): 459/586 kB | 16/211 kB Progress (2): 475/586 kB | 16/211 kB Progress (2): 492/586 kB | 16/211 kB Progress (2): 492/586 kB | 32/211 kB Progress (3): 492/586 kB | 32/211 kB | 6.8 kB Progress (3): 508/586 kB | 32/211 kB | 6.8 kB Progress (3): 508/586 kB | 49/211 kB | 6.8 kB Progress (3): 508/586 kB | 65/211 kB | 6.8 kB Progress (3): 524/586 kB | 65/211 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 33 kB/s) 2024-09-12T17:27:18.771 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T17:27:18.771 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 524/586 kB | 81/211 kB Progress (2): 541/586 kB | 81/211 kB Progress (2): 541/586 kB | 98/211 kB Progress (2): 541/586 kB | 114/211 kB Progress (2): 557/586 kB | 114/211 kB Progress (2): 557/586 kB | 130/211 kB Progress (2): 573/586 kB | 130/211 kB Progress (2): 573/586 kB | 147/211 kB Progress (2): 585/586 kB | 147/211 kB Progress (2): 586 kB | 147/211 kB Progress (2): 586 kB | 163/211 kB Progress (2): 586 kB | 180/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.8 MB/s) 2024-09-12T17:27:18.771 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 196/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:27:18.771 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 995 kB/s) 2024-09-12T17:27:18.772 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T17:27:18.784 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (2): 66/245 kB | 16/205 kB Progress (2): 82/245 kB | 16/205 kB Progress (2): 82/245 kB | 32/205 kB Progress (2): 82/245 kB | 49/205 kB Progress (2): 98/245 kB | 49/205 kB Progress (2): 98/245 kB | 65/205 kB Progress (2): 115/245 kB | 65/205 kB Progress (2): 115/245 kB | 81/205 kB Progress (2): 115/245 kB | 98/205 kB Progress (2): 131/245 kB | 98/205 kB Progress (2): 131/245 kB | 114/205 kB Progress (2): 147/245 kB | 114/205 kB Progress (2): 147/245 kB | 130/205 kB Progress (2): 147/245 kB | 147/205 kB Progress (2): 164/245 kB | 147/205 kB Progress (2): 164/245 kB | 163/205 kB Progress (2): 180/245 kB | 163/205 kB Progress (2): 180/245 kB | 180/205 kB Progress (2): 180/245 kB | 196/205 kB Progress (3): 180/245 kB | 196/205 kB | 15 kB Progress (3): 180/245 kB | 205 kB | 15 kB Progress (3): 197/245 kB | 205 kB | 15 kB Progress (3): 213/245 kB | 205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 914 kB/s) 2024-09-12T17:27:18.784 INFO:tasks.workunit.client.0.smithi119.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 68 kB/s) 2024-09-12T17:27:18.784 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T17:27:18.784 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 219/245 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T17:27:18.786 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 236/245 kB Progress (1): 245 kB Progress (2): 245 kB | 16/16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.1 MB/s) 2024-09-12T17:27:18.786 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T17:27:18.786 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 16 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 73 kB/s) 2024-09-12T17:27:18.786 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T17:27:18.786 INFO:tasks.workunit.client.0.smithi119.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 28 kB/s) 2024-09-12T17:27:18.798 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 101 kB/s) 2024-09-12T17:27:18.799 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 94 kB/s) 2024-09-12T17:27:18.799 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 73 kB/s) 2024-09-12T17:27:18.805 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/184 kB Progress (1): 32/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 750 kB/s) 2024-09-12T17:27:18.832 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:27:18.832 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T17:27:18.841 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T17:27:18.855 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-12T17:27:18.859 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T17:27:18.873 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-12T17:27:18.875 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T17:27:18.891 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/43 kB Progress (1): 32/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.7 MB/s) 2024-09-12T17:27:18.897 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T17:27:18.911 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 950 kB/s) 2024-09-12T17:27:18.917 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T17:27:18.936 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 81/153 kB Progress (1): 98/153 kB Progress (1): 114/153 kB Progress (1): 130/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 8.1 MB/s) 2024-09-12T17:27:18.937 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T17:27:18.957 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 115/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 164/215 kB Progress (1): 180/215 kB Progress (1): 197/215 kB Progress (1): 213/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 10 MB/s) 2024-09-12T17:27:19.013 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:27:19.013 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:27:19.017 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T17:27:19.032 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-12T17:27:19.034 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T17:27:19.048 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.6 MB/s) 2024-09-12T17:27:19.052 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T17:27:19.066 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 585 kB/s) 2024-09-12T17:27:19.068 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T17:27:19.084 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.7 MB/s) 2024-09-12T17:27:19.087 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T17:27:19.102 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-12T17:27:19.105 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T17:27:19.119 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 215 kB/s) 2024-09-12T17:27:19.124 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T17:27:19.139 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 41 kB/s) 2024-09-12T17:27:19.142 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T17:27:19.157 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 183 kB/s) 2024-09-12T17:27:19.160 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T17:27:19.175 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 940 kB/s) 2024-09-12T17:27:19.181 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T17:27:19.195 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 214 kB/s) 2024-09-12T17:27:19.198 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T17:27:19.214 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 522 kB/s) 2024-09-12T17:27:19.218 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T17:27:19.233 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 523 kB/s) 2024-09-12T17:27:19.239 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T17:27:19.254 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 534 kB/s) 2024-09-12T17:27:19.260 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T17:27:19.276 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.2 MB/s) 2024-09-12T17:27:19.286 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T17:27:19.302 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 340 kB/s) 2024-09-12T17:27:19.307 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T17:27:19.323 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.8 MB/s) 2024-09-12T17:27:19.333 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T17:27:19.348 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 340 kB/s) 2024-09-12T17:27:19.357 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T17:27:19.375 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.7 MB/s) 2024-09-12T17:27:19.376 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T17:27:19.376 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T17:27:19.377 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T17:27:19.377 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T17:27:19.377 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T17:27:19.394 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/55 kB Progress (3): 2.5 kB | 16/55 kB | 8.5 kB Progress (4): 2.5 kB | 16/55 kB | 8.5 kB | 16/269 kB Progress (4): 2.5 kB | 33/55 kB | 8.5 kB | 16/269 kB Progress (4): 2.5 kB | 33/55 kB | 8.5 kB | 33/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 156 kB/s) 2024-09-12T17:27:19.394 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (3): 49/55 kB | 8.5 kB | 33/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-09-12T17:27:19.394 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T17:27:19.395 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T17:27:19.395 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 55 kB | 33/269 kB Progress (2): 55 kB | 49/269 kB Progress (3): 55 kB | 49/269 kB | 16/41 kB Progress (3): 55 kB | 66/269 kB | 16/41 kB Progress (3): 55 kB | 66/269 kB | 33/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.2 MB/s) 2024-09-12T17:27:19.395 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 66/269 kB | 41 kB Progress (2): 82/269 kB | 41 kB Progress (2): 98/269 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.3 MB/s) 2024-09-12T17:27:19.398 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 115/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 262/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 12 MB/s) 2024-09-12T17:27:19.419 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/327 kB Progress (2): 16/327 kB | 16/587 kB Progress (2): 16/327 kB | 33/587 kB Progress (2): 33/327 kB | 33/587 kB Progress (2): 33/327 kB | 49/587 kB Progress (2): 33/327 kB | 62/587 kB Progress (2): 49/327 kB | 62/587 kB Progress (2): 49/327 kB | 78/587 kB Progress (2): 49/327 kB | 94/587 kB Progress (2): 64/327 kB | 94/587 kB Progress (2): 64/327 kB | 111/587 kB Progress (2): 81/327 kB | 111/587 kB Progress (2): 81/327 kB | 127/587 kB Progress (2): 81/327 kB | 144/587 kB Progress (2): 97/327 kB | 144/587 kB Progress (2): 97/327 kB | 160/587 kB Progress (2): 97/327 kB | 176/587 kB Progress (2): 113/327 kB | 176/587 kB Progress (2): 113/327 kB | 193/587 kB Progress (2): 113/327 kB | 209/587 kB Progress (2): 130/327 kB | 209/587 kB Progress (2): 130/327 kB | 225/587 kB Progress (2): 130/327 kB | 242/587 kB Progress (2): 146/327 kB | 242/587 kB Progress (2): 146/327 kB | 258/587 kB Progress (2): 146/327 kB | 275/587 kB Progress (2): 163/327 kB | 275/587 kB Progress (2): 163/327 kB | 291/587 kB Progress (2): 163/327 kB | 307/587 kB Progress (2): 179/327 kB | 307/587 kB Progress (2): 179/327 kB | 324/587 kB Progress (2): 179/327 kB | 340/587 kB Progress (2): 195/327 kB | 340/587 kB Progress (2): 195/327 kB | 357/587 kB Progress (2): 195/327 kB | 373/587 kB Progress (2): 212/327 kB | 373/587 kB Progress (2): 212/327 kB | 389/587 kB Progress (2): 212/327 kB | 406/587 kB Progress (2): 228/327 kB | 406/587 kB Progress (2): 228/327 kB | 422/587 kB Progress (2): 228/327 kB | 438/587 kB Progress (2): 244/327 kB | 438/587 kB Progress (2): 244/327 kB | 455/587 kB Progress (2): 244/327 kB | 471/587 kB Progress (2): 261/327 kB | 471/587 kB Progress (2): 261/327 kB | 488/587 kB Progress (2): 261/327 kB | 504/587 kB Progress (2): 277/327 kB | 504/587 kB Progress (2): 277/327 kB | 520/587 kB Progress (2): 277/327 kB | 537/587 kB Progress (2): 294/327 kB | 537/587 kB Progress (2): 294/327 kB | 553/587 kB Progress (2): 294/327 kB | 570/587 kB Progress (2): 310/327 kB | 570/587 kB Progress (2): 310/327 kB | 586/587 kB Progress (2): 310/327 kB | 587 kB Progress (2): 326/327 kB | 587 kB Progress (2): 327 kB | 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 14 MB/s) 2024-09-12T17:27:19.419 INFO:tasks.workunit.client.0.smithi119.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 7.8 MB/s) 2024-09-12T17:27:19.472 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:27:19.472 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:27:19.473 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:27:19.477 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T17:27:19.493 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-12T17:27:19.495 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T17:27:19.509 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-12T17:27:19.511 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T17:27:19.526 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.2 MB/s) 2024-09-12T17:27:19.529 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T17:27:19.543 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-12T17:27:19.546 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T17:27:19.562 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 51 kB/s) 2024-09-12T17:27:19.564 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T17:27:19.578 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-12T17:27:19.581 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T17:27:19.595 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-12T17:27:19.598 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T17:27:19.612 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 355 kB/s) 2024-09-12T17:27:19.615 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T17:27:19.628 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 296 kB/s) 2024-09-12T17:27:19.632 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T17:27:19.645 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 169 kB/s) 2024-09-12T17:27:19.648 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T17:27:19.662 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-12T17:27:19.665 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T17:27:19.679 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-12T17:27:19.682 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T17:27:19.696 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-12T17:27:19.699 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T17:27:19.714 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-12T17:27:19.716 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T17:27:19.731 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 559 kB/s) 2024-09-12T17:27:19.733 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T17:27:19.750 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 158 kB/s) 2024-09-12T17:27:19.756 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T17:27:19.770 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 375 kB/s) 2024-09-12T17:27:19.776 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T17:27:19.794 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 71 kB/s) 2024-09-12T17:27:19.799 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T17:27:19.816 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 45 kB/s) 2024-09-12T17:27:19.819 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T17:27:19.834 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 402 kB/s) 2024-09-12T17:27:19.838 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T17:27:19.854 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.6 MB/s) 2024-09-12T17:27:19.861 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T17:27:19.878 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 67 kB/s) 2024-09-12T17:27:19.881 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T17:27:19.895 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 88 kB/s) 2024-09-12T17:27:19.903 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T17:27:19.918 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 903 kB/s) 2024-09-12T17:27:19.918 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T17:27:19.919 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T17:27:19.919 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T17:27:19.919 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T17:27:19.920 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T17:27:19.933 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/55 kB Progress (3): 4.2 kB | 16/55 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-12T17:27:19.934 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T17:27:19.935 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 33/55 kB | 16/122 kB Progress (3): 33/55 kB | 16/122 kB | 16/27 kB Progress (3): 33/55 kB | 33/122 kB | 16/27 kB Progress (3): 33/55 kB | 33/122 kB | 27 kB Progress (3): 49/55 kB | 33/122 kB | 27 kB Progress (3): 49/55 kB | 49/122 kB | 27 kB Progress (3): 55 kB | 49/122 kB | 27 kB Progress (4): 55 kB | 49/122 kB | 27 kB | 16/334 kB Progress (4): 55 kB | 66/122 kB | 27 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.8 MB/s) 2024-09-12T17:27:19.935 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T17:27:19.936 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (3): 55 kB | 82/122 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.4 MB/s) 2024-09-12T17:27:19.936 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 82/122 kB | 33/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T17:27:19.936 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 98/122 kB | 33/334 kB Progress (2): 98/122 kB | 49/334 kB Progress (2): 115/122 kB | 49/334 kB Progress (2): 122 kB | 49/334 kB Progress (2): 122 kB | 66/334 kB Progress (2): 122 kB | 82/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.8 MB/s) 2024-09-12T17:27:19.942 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 98/334 kB Progress (1): 115/334 kB Progress (1): 131/334 kB Progress (1): 147/334 kB Progress (1): 164/334 kB Progress (1): 180/334 kB Progress (1): 197/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 246/334 kB Progress (1): 256/334 kB Progress (1): 272/334 kB Progress (1): 289/334 kB Progress (1): 305/334 kB Progress (1): 321/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 15 MB/s) 2024-09-12T17:27:19.952 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/267 kB Progress (2): 16/267 kB | 4.7 kB Progress (2): 33/267 kB | 4.7 kB Progress (2): 49/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 161 kB/s) 2024-09-12T17:27:19.952 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 66/267 kB Progress (2): 66/267 kB | 16/23 kB Progress (2): 82/267 kB | 16/23 kB Progress (2): 82/267 kB | 23 kB Progress (2): 98/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 760 kB/s) 2024-09-12T17:27:19.953 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.1 MB/s) 2024-09-12T17:27:20.047 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T17:27:20.049 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T17:27:21.167 INFO:tasks.workunit.client.0.smithi119.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:27:21.168 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:27:21.168 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:27:21.170 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:27:21.171 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:27:21.171 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:27:21.176 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T17:27:21.176 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T17:27:21.358 INFO:tasks.workunit.client.0.smithi119.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:27:21.358 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:27:21.358 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:27:21.362 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T17:27:21.377 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 446 kB/s) 2024-09-12T17:27:21.380 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T17:27:21.394 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 252 kB/s) 2024-09-12T17:27:21.398 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T17:27:21.412 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 233 kB/s) 2024-09-12T17:27:21.416 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T17:27:21.431 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-12T17:27:21.434 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T17:27:21.448 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 236 kB/s) 2024-09-12T17:27:21.451 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T17:27:21.465 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-12T17:27:21.469 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T17:27:21.483 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-12T17:27:21.487 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T17:27:21.501 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-12T17:27:21.503 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T17:27:21.517 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.2 MB/s) 2024-09-12T17:27:21.520 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T17:27:21.534 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-12T17:27:21.536 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T17:27:21.551 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-12T17:27:21.553 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T17:27:21.568 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 157 kB/s) 2024-09-12T17:27:21.569 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T17:27:21.584 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-12T17:27:21.586 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T17:27:21.601 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.5 MB/s) 2024-09-12T17:27:21.603 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T17:27:21.617 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-12T17:27:21.620 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T17:27:21.635 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-12T17:27:21.637 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T17:27:21.652 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.7 MB/s) 2024-09-12T17:27:21.655 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T17:27:21.670 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 538 kB/s) 2024-09-12T17:27:21.674 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T17:27:21.690 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 136 kB/s) 2024-09-12T17:27:21.693 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T17:27:21.708 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 173 kB/s) 2024-09-12T17:27:21.711 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T17:27:21.725 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-12T17:27:21.726 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T17:27:21.740 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-12T17:27:21.742 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T17:27:21.756 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.6 MB/s) 2024-09-12T17:27:21.758 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T17:27:21.771 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-12T17:27:21.773 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T17:27:21.787 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-12T17:27:21.791 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T17:27:21.805 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-12T17:27:21.807 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T17:27:21.820 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 523 kB/s) 2024-09-12T17:27:21.822 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T17:27:21.838 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 646 kB/s) 2024-09-12T17:27:21.839 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T17:27:21.851 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 159 kB/s) 2024-09-12T17:27:21.853 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T17:27:21.867 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-12T17:27:21.870 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T17:27:21.884 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-12T17:27:21.888 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T17:27:21.903 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 998 kB/s) 2024-09-12T17:27:21.905 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T17:27:21.920 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 967 kB/s) 2024-09-12T17:27:21.924 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T17:27:21.938 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-12T17:27:21.940 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T17:27:21.954 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-12T17:27:21.956 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T17:27:21.972 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 392 kB/s) 2024-09-12T17:27:21.974 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T17:27:21.989 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/32 kB Progress (1): 32/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.2 MB/s) 2024-09-12T17:27:21.993 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T17:27:22.008 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.1 MB/s) 2024-09-12T17:27:22.011 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T17:27:22.026 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 925 kB/s) 2024-09-12T17:27:22.030 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T17:27:22.045 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-12T17:27:22.049 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T17:27:22.061 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-12T17:27:22.065 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T17:27:22.080 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 527 kB/s) 2024-09-12T17:27:22.084 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T17:27:22.100 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 187 kB/s) 2024-09-12T17:27:22.106 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T17:27:22.121 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 283 kB/s) 2024-09-12T17:27:22.127 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T17:27:22.142 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 137 kB/s) 2024-09-12T17:27:22.147 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T17:27:22.162 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 217 kB/s) 2024-09-12T17:27:22.169 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T17:27:22.185 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 643 kB/s) 2024-09-12T17:27:22.189 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T17:27:22.208 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 709 kB/s) 2024-09-12T17:27:22.212 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T17:27:22.227 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-12T17:27:22.231 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T17:27:22.251 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 24 kB/s) 2024-09-12T17:27:22.251 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T17:27:22.264 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 407 kB/s) 2024-09-12T17:27:22.267 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T17:27:22.281 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 489 kB/s) 2024-09-12T17:27:22.283 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T17:27:22.298 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 322 kB/s) 2024-09-12T17:27:22.302 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T17:27:22.316 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 487 kB/s) 2024-09-12T17:27:22.320 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T17:27:22.335 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-12T17:27:22.338 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T17:27:22.354 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.9 MB/s) 2024-09-12T17:27:22.360 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T17:27:22.376 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-12T17:27:22.384 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T17:27:22.400 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 332 kB/s) 2024-09-12T17:27:22.404 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T17:27:22.420 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 267 kB/s) 2024-09-12T17:27:22.424 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T17:27:22.439 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 213 kB/s) 2024-09-12T17:27:22.442 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T17:27:22.459 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.6 MB/s) 2024-09-12T17:27:22.465 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T17:27:22.480 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 158 kB/s) 2024-09-12T17:27:22.495 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T17:27:22.523 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/308 kB Progress (1): 32/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 81/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 212/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 11 MB/s) 2024-09-12T17:27:22.524 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T17:27:22.524 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T17:27:22.525 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T17:27:22.525 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T17:27:22.526 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T17:27:22.542 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (1): 64/171 kB Progress (1): 81/171 kB Progress (1): 97/171 kB Progress (1): 113/171 kB Progress (1): 130/171 kB Progress (2): 130/171 kB | 16/26 kB Progress (2): 146/171 kB | 16/26 kB Progress (2): 146/171 kB | 26 kB Progress (2): 163/171 kB | 26 kB Progress (2): 171 kB | 26 kB Progress (3): 171 kB | 26 kB | 8.2 kB Progress (4): 171 kB | 26 kB | 8.2 kB | 16/118 kB Progress (5): 171 kB | 26 kB | 8.2 kB | 16/118 kB | 14 kB Progress (5): 171 kB | 26 kB | 8.2 kB | 33/118 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.0 MB/s) 2024-09-12T17:27:22.542 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T17:27:22.542 INFO:tasks.workunit.client.0.smithi119.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 454 kB/s) 2024-09-12T17:27:22.543 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T17:27:22.544 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (3): 26 kB | 49/118 kB | 14 kB Progress (3): 26 kB | 66/118 kB | 14 kB Progress (3): 26 kB | 82/118 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.4 MB/s) 2024-09-12T17:27:22.544 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T17:27:22.544 INFO:tasks.workunit.client.0.smithi119.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 679 kB/s) 2024-09-12T17:27:22.545 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 98/118 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T17:27:22.545 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 115/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.6 MB/s) 2024-09-12T17:27:22.545 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T17:27:22.561 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/136 kB Progress (1): 33/136 kB Progress (1): 49/136 kB Progress (2): 49/136 kB | 16/146 kB Progress (2): 64/136 kB | 16/146 kB Progress (3): 64/136 kB | 16/146 kB | 16/61 kB Progress (3): 64/136 kB | 33/146 kB | 16/61 kB Progress (3): 81/136 kB | 33/146 kB | 16/61 kB Progress (3): 81/136 kB | 33/146 kB | 32/61 kB Progress (3): 97/136 kB | 33/146 kB | 32/61 kB Progress (3): 97/136 kB | 49/146 kB | 32/61 kB Progress (4): 97/136 kB | 49/146 kB | 32/61 kB | 16/58 kB Progress (4): 97/136 kB | 49/146 kB | 49/61 kB | 16/58 kB Progress (4): 113/136 kB | 49/146 kB | 49/61 kB | 16/58 kB Progress (5): 113/136 kB | 49/146 kB | 49/61 kB | 16/58 kB | 16/501 kB Progress (5): 113/136 kB | 66/146 kB | 49/61 kB | 16/58 kB | 16/501 kB Progress (5): 113/136 kB | 66/146 kB | 61 kB | 16/58 kB | 16/501 kB Progress (5): 113/136 kB | 66/146 kB | 61 kB | 32/58 kB | 16/501 kB Progress (5): 130/136 kB | 66/146 kB | 61 kB | 32/58 kB | 16/501 kB Progress (5): 130/136 kB | 66/146 kB | 61 kB | 32/58 kB | 33/501 kB Progress (5): 130/136 kB | 82/146 kB | 61 kB | 32/58 kB | 33/501 kB Progress (5): 136 kB | 82/146 kB | 61 kB | 32/58 kB | 33/501 kB Progress (5): 136 kB | 82/146 kB | 61 kB | 32/58 kB | 37/501 kB Progress (5): 136 kB | 82/146 kB | 61 kB | 49/58 kB | 37/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.7 MB/s) 2024-09-12T17:27:22.561 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (4): 136 kB | 98/146 kB | 49/58 kB | 37/501 kB Progress (4): 136 kB | 98/146 kB | 58 kB | 37/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.9 MB/s) 2024-09-12T17:27:22.561 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T17:27:22.561 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T17:27:22.561 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (3): 98/146 kB | 58 kB | 53/501 kB Progress (3): 115/146 kB | 58 kB | 53/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.6 MB/s) 2024-09-12T17:27:22.562 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 115/146 kB | 69/501 kB Progress (2): 131/146 kB | 69/501 kB Progress (2): 146 kB | 69/501 kB Progress (2): 146 kB | 86/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.1 MB/s) 2024-09-12T17:27:22.573 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 102/501 kB Progress (1): 118/501 kB Progress (1): 135/501 kB Progress (1): 151/501 kB Progress (1): 168/501 kB Progress (1): 184/501 kB Progress (1): 200/501 kB Progress (1): 217/501 kB Progress (1): 233/501 kB Progress (1): 250/501 kB Progress (1): 266/501 kB Progress (1): 282/501 kB Progress (1): 299/501 kB Progress (1): 315/501 kB Progress (1): 331/501 kB Progress (1): 348/501 kB Progress (1): 364/501 kB Progress (1): 381/501 kB Progress (1): 397/501 kB Progress (1): 413/501 kB Progress (1): 430/501 kB Progress (1): 446/501 kB Progress (1): 463/501 kB Progress (1): 479/501 kB Progress (1): 495/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 10 MB/s) 2024-09-12T17:27:22.575 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.5 MB/s) 2024-09-12T17:27:22.618 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 26 MB/s) 2024-09-12T17:27:22.733 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:27:22.733 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T17:27:22.738 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T17:27:22.752 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 299 kB/s) 2024-09-12T17:27:22.754 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T17:27:22.768 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-12T17:27:22.770 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T17:27:22.785 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-12T17:27:22.789 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T17:27:22.805 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.2 MB/s) 2024-09-12T17:27:22.809 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T17:27:22.823 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-12T17:27:22.825 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T17:27:22.838 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 302 kB/s) 2024-09-12T17:27:22.841 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T17:27:22.857 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 401 kB/s) 2024-09-12T17:27:22.860 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T17:27:22.872 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-12T17:27:22.875 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T17:27:22.889 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-12T17:27:22.895 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T17:27:22.909 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-12T17:27:22.913 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T17:27:22.926 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 157 kB/s) 2024-09-12T17:27:22.929 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T17:27:22.942 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 632 kB/s) 2024-09-12T17:27:22.944 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T17:27:22.959 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-12T17:27:22.966 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T17:27:22.982 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.3 MB/s) 2024-09-12T17:27:22.982 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T17:27:22.983 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T17:27:22.983 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T17:27:22.983 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T17:27:22.983 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T17:27:23.000 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/58 kB Progress (2): 16/58 kB | 16/26 kB Progress (3): 16/58 kB | 16/26 kB | 16/79 kB Progress (3): 33/58 kB | 16/26 kB | 16/79 kB Progress (3): 33/58 kB | 26 kB | 16/79 kB Progress (3): 33/58 kB | 26 kB | 32/79 kB Progress (3): 49/58 kB | 26 kB | 32/79 kB Progress (3): 49/58 kB | 26 kB | 49/79 kB Progress (3): 58 kB | 26 kB | 49/79 kB Progress (3): 58 kB | 26 kB | 65/79 kB Progress (4): 58 kB | 26 kB | 65/79 kB | 16/211 kB Progress (4): 58 kB | 26 kB | 79 kB | 16/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.5 MB/s) 2024-09-12T17:27:23.000 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (4): 58 kB | 79 kB | 16/211 kB | 0/1.0 MB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T17:27:23.000 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (4): 58 kB | 79 kB | 33/211 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.6 MB/s) 2024-09-12T17:27:23.001 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T17:27:23.001 INFO:tasks.workunit.client.0.smithi119.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.7 MB/s) 2024-09-12T17:27:23.006 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 33/211 kB | 0/1.0 MB Progress (2): 49/211 kB | 0/1.0 MB Progress (2): 49/211 kB | 0/1.0 MB Progress (2): 66/211 kB | 0/1.0 MB Progress (2): 66/211 kB | 0.1/1.0 MB Progress (2): 66/211 kB | 0.1/1.0 MB Progress (2): 82/211 kB | 0.1/1.0 MB Progress (2): 82/211 kB | 0.1/1.0 MB Progress (2): 98/211 kB | 0.1/1.0 MB Progress (2): 98/211 kB | 0.1/1.0 MB Progress (2): 115/211 kB | 0.1/1.0 MB Progress (2): 115/211 kB | 0.1/1.0 MB Progress (2): 115/211 kB | 0.1/1.0 MB Progress (2): 131/211 kB | 0.1/1.0 MB Progress (2): 131/211 kB | 0.2/1.0 MB Progress (2): 147/211 kB | 0.2/1.0 MB Progress (2): 147/211 kB | 0.2/1.0 MB Progress (2): 147/211 kB | 0.2/1.0 MB Progress (2): 164/211 kB | 0.2/1.0 MB Progress (2): 164/211 kB | 0.2/1.0 MB Progress (2): 180/211 kB | 0.2/1.0 MB Progress (2): 180/211 kB | 0.2/1.0 MB Progress (2): 180/211 kB | 0.2/1.0 MB Progress (2): 197/211 kB | 0.2/1.0 MB Progress (2): 197/211 kB | 0.3/1.0 MB Progress (2): 211 kB | 0.3/1.0 MB Progress (2): 211 kB | 0.3/1.0 MB Progress (2): 211 kB | 0.3/1.0 MB Progress (2): 211 kB | 0.3/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 8.8 MB/s) 2024-09-12T17:27:23.018 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (2): 0.6/1.0 MB | 33/116 kB Progress (3): 0.6/1.0 MB | 33/116 kB | 16/267 kB Progress (3): 0.6/1.0 MB | 33/116 kB | 16/267 kB Progress (3): 0.6/1.0 MB | 49/116 kB | 16/267 kB Progress (3): 0.6/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 0.6/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 0.6/1.0 MB | 66/116 kB | 33/267 kB Progress (3): 0.6/1.0 MB | 66/116 kB | 49/267 kB Progress (3): 0.6/1.0 MB | 66/116 kB | 66/267 kB Progress (3): 0.6/1.0 MB | 66/116 kB | 66/267 kB Progress (3): 0.6/1.0 MB | 82/116 kB | 66/267 kB Progress (3): 0.6/1.0 MB | 82/116 kB | 82/267 kB Progress (3): 0.6/1.0 MB | 82/116 kB | 98/267 kB Progress (3): 0.7/1.0 MB | 82/116 kB | 98/267 kB Progress (3): 0.7/1.0 MB | 98/116 kB | 98/267 kB Progress (3): 0.7/1.0 MB | 98/116 kB | 115/267 kB Progress (3): 0.7/1.0 MB | 98/116 kB | 115/267 kB Progress (3): 0.7/1.0 MB | 115/116 kB | 115/267 kB Progress (3): 0.7/1.0 MB | 115/116 kB | 131/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 131/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 131/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 147/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 164/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 164/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.4 MB/s) 2024-09-12T17:27:23.021 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 0.7/1.0 MB | 180/267 kB Progress (2): 0.7/1.0 MB | 180/267 kB Progress (2): 0.7/1.0 MB | 197/267 kB Progress (2): 0.7/1.0 MB | 197/267 kB Progress (2): 0.7/1.0 MB | 213/267 kB Progress (2): 0.8/1.0 MB | 213/267 kB Progress (2): 0.8/1.0 MB | 229/267 kB Progress (2): 0.8/1.0 MB | 229/267 kB Progress (2): 0.8/1.0 MB | 246/267 kB Progress (2): 0.8/1.0 MB | 246/267 kB Progress (2): 0.8/1.0 MB | 262/267 kB Progress (2): 0.8/1.0 MB | 262/267 kB Progress (2): 0.8/1.0 MB | 267 kB Progress (2): 0.8/1.0 MB | 267 kB Progress (2): 0.8/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.2 MB/s) 2024-09-12T17:27:23.025 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 24 MB/s) 2024-09-12T17:27:23.196 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T17:27:23.241 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:27:23.241 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:27:23.241 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:27:23.242 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Total time: 7.249 s 2024-09-12T17:27:23.242 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Finished at: 2024-09-12T17:27:23Z 2024-09-12T17:27:23.242 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:27:23.271 INFO:tasks.workunit.client.0.smithi119.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T17:27:23.277 INFO:tasks.workunit.client.0.smithi119.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:27:24.368 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Scanning for projects... 2024-09-12T17:27:24.450 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:27:24.450 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:27:24.450 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:27:24.450 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] from pom.xml 2024-09-12T17:27:24.451 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:27:24.717 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:27:24.717 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:27:24.845 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:27:24.846 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:27:24.846 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:27:24.942 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:27:24.942 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:27:24.942 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:27:24.946 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:27:24.946 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:27:24.946 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:27:24.949 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:27:24.949 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:27:24.949 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:27:25.143 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T17:27:25.365 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T17:27:25.565 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-09-12T17:27:25.573 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T17:27:25.590 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 154 kB/s) 2024-09-12T17:27:25.596 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T17:27:25.612 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-12T17:27:25.617 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T17:27:25.633 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 189 kB/s) 2024-09-12T17:27:25.636 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T17:27:25.652 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 188 kB/s) 2024-09-12T17:27:25.655 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T17:27:25.670 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-12T17:27:25.672 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T17:27:25.689 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 167 kB/s) 2024-09-12T17:27:25.695 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T17:27:25.716 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.2 MB/s) 2024-09-12T17:27:25.717 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T17:27:25.718 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T17:27:25.719 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T17:27:25.719 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T17:27:25.720 INFO:tasks.workunit.client.0.smithi119.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T17:27:25.740 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 731 kB/s) 2024-09-12T17:27:25.773 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/169 kB Progress (2): 2.8/7.7 kB | 1.4/169 kB Progress (2): 2.8/7.7 kB | 2.8/169 kB Progress (2): 4.1/7.7 kB | 2.8/169 kB Progress (2): 4.1/7.7 kB | 4.1/169 kB Progress (2): 5.5/7.7 kB | 4.1/169 kB Progress (2): 5.5/7.7 kB | 5.5/169 kB Progress (2): 6.9/7.7 kB | 5.5/169 kB Progress (2): 6.9/7.7 kB | 6.9/169 kB Progress (2): 7.7 kB | 6.9/169 kB Progress (3): 7.7 kB | 6.9/169 kB | 16/189 kB Progress (3): 7.7 kB | 8.3/169 kB | 16/189 kB Progress (3): 7.7 kB | 9.7/169 kB | 16/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 139 kB/s) 2024-09-12T17:27:25.799 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (3): 9.7/169 kB | 16/189 kB | 16/103 kB Progress (3): 11/169 kB | 16/189 kB | 16/103 kB Progress (3): 11/169 kB | 33/189 kB | 16/103 kB Progress (3): 12/169 kB | 33/189 kB | 16/103 kB Progress (3): 14/169 kB | 33/189 kB | 16/103 kB Progress (3): 15/169 kB | 33/189 kB | 16/103 kB Progress (3): 15/169 kB | 33/189 kB | 33/103 kB Progress (3): 17/169 kB | 33/189 kB | 33/103 kB Progress (3): 18/169 kB | 33/189 kB | 33/103 kB Progress (3): 19/169 kB | 33/189 kB | 33/103 kB Progress (3): 21/169 kB | 33/189 kB | 33/103 kB Progress (3): 22/169 kB | 33/189 kB | 33/103 kB Progress (3): 23/169 kB | 33/189 kB | 33/103 kB Progress (3): 25/169 kB | 33/189 kB | 33/103 kB Progress (3): 26/169 kB | 33/189 kB | 33/103 kB Progress (3): 28/169 kB | 33/189 kB | 33/103 kB Progress (3): 29/169 kB | 33/189 kB | 33/103 kB Progress (3): 30/169 kB | 33/189 kB | 33/103 kB Progress (3): 32/169 kB | 33/189 kB | 33/103 kB Progress (3): 33/169 kB | 33/189 kB | 33/103 kB Progress (3): 34/169 kB | 33/189 kB | 33/103 kB Progress (3): 36/169 kB | 33/189 kB | 33/103 kB Progress (3): 37/169 kB | 33/189 kB | 33/103 kB Progress (3): 37/169 kB | 49/189 kB | 33/103 kB Progress (3): 53/169 kB | 49/189 kB | 33/103 kB Progress (3): 53/169 kB | 49/189 kB | 49/103 kB Progress (3): 53/169 kB | 66/189 kB | 49/103 kB Progress (3): 53/169 kB | 66/189 kB | 66/103 kB Progress (3): 69/169 kB | 66/189 kB | 66/103 kB Progress (3): 69/169 kB | 82/189 kB | 66/103 kB Progress (3): 69/169 kB | 98/189 kB | 66/103 kB Progress (3): 69/169 kB | 98/189 kB | 82/103 kB Progress (3): 86/169 kB | 98/189 kB | 82/103 kB Progress (3): 86/169 kB | 115/189 kB | 82/103 kB Progress (3): 102/169 kB | 115/189 kB | 82/103 kB Progress (3): 102/169 kB | 115/189 kB | 98/103 kB Progress (3): 102/169 kB | 131/189 kB | 98/103 kB Progress (3): 102/169 kB | 131/189 kB | 103 kB Progress (3): 118/169 kB | 131/189 kB | 103 kB Progress (3): 118/169 kB | 147/189 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-12T17:27:25.803 INFO:tasks.workunit.client.0.smithi119.stdout:Progress (2): 135/169 kB | 147/189 kB Progress (2): 135/169 kB | 164/189 kB Progress (2): 151/169 kB | 164/189 kB Progress (2): 151/169 kB | 180/189 kB Progress (2): 151/169 kB | 189 kB Progress (2): 168/169 kB | 189 kB Progress (2): 169 kB | 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.2 MB/s) 2024-09-12T17:27:25.803 INFO:tasks.workunit.client.0.smithi119.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 2.0 MB/s) 2024-09-12T17:27:25.819 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:27:25.819 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:27:25.819 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] T E S T S 2024-09-12T17:27:25.819 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:27:26.384 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T17:27:26.468 INFO:tasks.workunit.client.0.smithi119.stdout:PutObjects.java: starting test run: 2024-09-12T17:27:26.469 INFO:tasks.workunit.client.0.smithi119.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:27:26.469 INFO:tasks.workunit.client.0.smithi119.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:27:26.469 INFO:tasks.workunit.client.0.smithi119.stdout: EndpointUrl=http://smithi119.front.sepia.ceph.com:80 2024-09-12T17:27:26.469 INFO:tasks.workunit.client.0.smithi119.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T17:27:26.667 INFO:tasks.workunit.client.0.smithi119.stdout:DEBUG: Environment Variables Read 2024-09-12T17:27:26.969 INFO:tasks.workunit.client.0.smithi119.stdout:DEBUG: S3 Client Initialized 2024-09-12T17:27:26.970 INFO:tasks.workunit.client.0.smithi119.stdout:DEBUG: Generating File 2024-09-12T17:27:26.970 INFO:tasks.workunit.client.0.smithi119.stdout:DEBUG: File Generated 2024-09-12T17:27:26.970 INFO:tasks.workunit.client.0.smithi119.stdout:DEBUG: Generating File 2024-09-12T17:27:26.970 INFO:tasks.workunit.client.0.smithi119.stdout:DEBUG: File Generated 2024-09-12T17:27:26.970 INFO:tasks.workunit.client.0.smithi119.stdout:DEBUG: Generating File 2024-09-12T17:27:26.970 INFO:tasks.workunit.client.0.smithi119.stdout:DEBUG: File Generated 2024-09-12T17:27:26.970 INFO:tasks.workunit.client.0.smithi119.stdout:DEBUG: Generating File 2024-09-12T17:27:26.970 INFO:tasks.workunit.client.0.smithi119.stdout:DEBUG: File Generated 2024-09-12T17:27:26.970 INFO:tasks.workunit.client.0.smithi119.stdout:DEBUG: Generating File 2024-09-12T17:27:26.970 INFO:tasks.workunit.client.0.smithi119.stdout:DEBUG: File Generated 2024-09-12T17:27:26.970 INFO:tasks.workunit.client.0.smithi119.stdout:DEBUG: Generating File 2024-09-12T17:27:26.971 INFO:tasks.workunit.client.0.smithi119.stdout:DEBUG: File Generated 2024-09-12T17:27:26.971 INFO:tasks.workunit.client.0.smithi119.stdout:DEBUG: Generated Big Files 2024-09-12T17:27:27.369 INFO:tasks.workunit.client.0.smithi119.stdout:HeadBucketResponse() 2024-09-12T17:27:27.369 INFO:tasks.workunit.client.0.smithi119.stdout:sheik is ready 2024-09-12T17:27:27.369 INFO:tasks.workunit.client.0.smithi119.stdout:DEBUG: Test Bucket Created 2024-09-12T17:27:27.469 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T17:27:27.769 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T17:27:27.970 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T17:27:28.271 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T17:27:28.571 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T17:27:28.872 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T17:27:29.373 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T17:27:29.774 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T17:27:30.476 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T17:27:31.178 INFO:tasks.workunit.client.0.smithi119.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T17:27:35.488 INFO:tasks.workunit.client.0.smithi119.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T17:27:41.801 INFO:tasks.workunit.client.0.smithi119.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T17:28:17.989 INFO:tasks.workunit.client.0.smithi119.stdout:arg: file-0b 2024-09-12T17:28:17.992 INFO:tasks.workunit.client.0.smithi119.stdout:arg: file-8b 2024-09-12T17:28:17.993 INFO:tasks.workunit.client.0.smithi119.stdout:arg: file-200b 2024-09-12T17:28:17.994 INFO:tasks.workunit.client.0.smithi119.stdout:arg: file-21983b 2024-09-12T17:28:17.995 INFO:tasks.workunit.client.0.smithi119.stdout:arg: file-5519b 2024-09-12T17:28:17.997 INFO:tasks.workunit.client.0.smithi119.stdout:arg: file-204329b 2024-09-12T17:28:17.998 INFO:tasks.workunit.client.0.smithi119.stdout:arg: file-256k 2024-09-12T17:28:17.999 INFO:tasks.workunit.client.0.smithi119.stdout:arg: file-1m 2024-09-12T17:28:18.000 INFO:tasks.workunit.client.0.smithi119.stdout:arg: file-1038757b 2024-09-12T17:28:18.075 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T17:28:18.175 INFO:tasks.workunit.client.0.smithi119.stdout:PutObjectResponse 2024-09-12T17:28:18.276 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T17:28:18.376 INFO:tasks.workunit.client.0.smithi119.stdout:PutObjectResponse 2024-09-12T17:28:18.476 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T17:28:18.676 INFO:tasks.workunit.client.0.smithi119.stdout:PutObjectResponse 2024-09-12T17:28:18.777 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T17:28:18.977 INFO:tasks.workunit.client.0.smithi119.stdout:PutObjectResponse 2024-09-12T17:28:19.177 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T17:28:19.378 INFO:tasks.workunit.client.0.smithi119.stdout:PutObjectResponse 2024-09-12T17:28:19.478 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T17:28:19.778 INFO:tasks.workunit.client.0.smithi119.stdout:PutObjectResponse 2024-09-12T17:28:19.879 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T17:28:20.179 INFO:tasks.workunit.client.0.smithi119.stdout:PutObjectResponse 2024-09-12T17:28:20.279 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T17:28:20.780 INFO:tasks.workunit.client.0.smithi119.stdout:PutObjectResponse 2024-09-12T17:28:20.980 INFO:tasks.workunit.client.0.smithi119.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T17:28:21.581 INFO:tasks.workunit.client.0.smithi119.stdout:PutObjectResponse 2024-09-12T17:28:21.782 INFO:tasks.workunit.client.0.smithi119.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T17:28:24.686 INFO:tasks.workunit.client.0.smithi119.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T17:28:29.192 INFO:tasks.workunit.client.0.smithi119.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T17:29:10.957 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 104.6 s -- in io.ceph.jcksum.PutObjects 2024-09-12T17:29:10.983 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:29:10.983 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Results: 2024-09-12T17:29:10.983 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:29:10.983 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T17:29:10.983 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] 2024-09-12T17:29:10.985 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:29:10.985 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:29:10.985 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:29:10.986 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Total time: 01:46 min 2024-09-12T17:29:10.986 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] Finished at: 2024-09-12T17:29:10Z 2024-09-12T17:29:10.986 INFO:tasks.workunit.client.0.smithi119.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:29:11.016 INFO:tasks.workunit.client.0.smithi119.stderr:+ exit 2024-09-12T17:29:11.016 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:29:11.016 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:29:11.072 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T17:29:11.072 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:29:11.479 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:11.479 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:29:11.492 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:29:11.492 DEBUG:teuthology.orchestra.run.smithi119:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:29:11.541 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:29:11.542 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:29:11.553 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:29:11.553 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:29:11.553 DEBUG:teuthology.orchestra.run.smithi119:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:29:11.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:29:11.589 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:29:11.589 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:29:11.637 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:29:11.637 DEBUG:teuthology.orchestra.run.smithi119:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:29:11.689 INFO:tasks.workunit:timeout=3h 2024-09-12T17:29:11.689 INFO:tasks.workunit:cleanup=True 2024-09-12T17:29:11.690 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:29:11.739 INFO:tasks.workunit.client.0.smithi119.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:30:09.831 INFO:tasks.workunit.client.0.smithi119.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:30:09.832 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:30:09.832 INFO:tasks.workunit.client.0.smithi119.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:30:09.832 INFO:tasks.workunit.client.0.smithi119.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:30:09.832 INFO:tasks.workunit.client.0.smithi119.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:30:09.832 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:30:09.832 INFO:tasks.workunit.client.0.smithi119.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:30:09.832 INFO:tasks.workunit.client.0.smithi119.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:30:09.833 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:30:09.833 INFO:tasks.workunit.client.0.smithi119.stderr: git switch -c 2024-09-12T17:30:09.833 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:30:09.833 INFO:tasks.workunit.client.0.smithi119.stderr:Or undo this operation with: 2024-09-12T17:30:09.833 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:30:09.833 INFO:tasks.workunit.client.0.smithi119.stderr: git switch - 2024-09-12T17:30:09.833 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:30:09.833 INFO:tasks.workunit.client.0.smithi119.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:30:09.833 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:30:09.833 INFO:tasks.workunit.client.0.smithi119.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:30:09.839 DEBUG:teuthology.orchestra.run.smithi119:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:30:09.886 INFO:tasks.workunit.client.0.smithi119.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:30:09.889 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:30:09.889 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:30:09.944 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:30:09.999 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:30:10.046 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:30:10.047 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:30:10.048 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:30:10.090 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:30:10.093 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:30:10.094 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:30:10.141 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T17:30:10.142 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T17:30:10.142 DEBUG:teuthology.orchestra.run.smithi119:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T17:30:10.196 INFO:tasks.workunit.client.0.smithi119.stdout:INFO: fully qualified domain name: smithi119.front.sepia.ceph.com 2024-09-12T17:30:10.196 INFO:tasks.workunit.client.0.smithi119.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T17:30:10.197 INFO:tasks.workunit.client.0.smithi119.stdout:== TESTING VERSIONED BUCKET == 2024-09-12T17:30:13.442 INFO:tasks.workunit.client.0.smithi119.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T17:30:13.646 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting pip 2024-09-12T17:30:13.649 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:30:13.682 INFO:tasks.workunit.client.0.smithi119.stdout:Installing collected packages: pip 2024-09-12T17:30:13.682 INFO:tasks.workunit.client.0.smithi119.stdout: Attempting uninstall: pip 2024-09-12T17:30:13.683 INFO:tasks.workunit.client.0.smithi119.stdout: Found existing installation: pip 22.0.2 2024-09-12T17:30:13.942 INFO:tasks.workunit.client.0.smithi119.stdout: Uninstalling pip-22.0.2: 2024-09-12T17:30:13.948 INFO:tasks.workunit.client.0.smithi119.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T17:30:14.707 INFO:tasks.workunit.client.0.smithi119.stdout:Successfully installed pip-24.2 2024-09-12T17:30:15.760 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting boto3 2024-09-12T17:30:15.761 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:30:16.255 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:30:16.256 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:30:16.307 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:30:16.308 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:30:16.355 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:30:16.356 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:30:16.405 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:30:16.406 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:30:16.484 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:30:16.485 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T17:30:16.627 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:30:16.628 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:30:16.631 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:30:16.633 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:30:16.644 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:30:16.644 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:30:16.645 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:30:16.646 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T17:30:16.647 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:30:16.715 INFO:tasks.workunit.client.0.smithi119.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:30:17.808 INFO:tasks.workunit.client.0.smithi119.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T17:30:18.170 INFO:tasks.workunit.client.0.smithi119.stdout:INFO: creating user 2024-09-12T17:30:18.305 INFO:tasks.workunit.client.0.smithi119.stdout:{ 2024-09-12T17:30:18.305 INFO:tasks.workunit.client.0.smithi119.stdout: "user_id": "testid", 2024-09-12T17:30:18.305 INFO:tasks.workunit.client.0.smithi119.stdout: "display_name": "M. Tester", 2024-09-12T17:30:18.305 INFO:tasks.workunit.client.0.smithi119.stdout: "email": "tester@ceph.com", 2024-09-12T17:30:18.305 INFO:tasks.workunit.client.0.smithi119.stdout: "suspended": 0, 2024-09-12T17:30:18.305 INFO:tasks.workunit.client.0.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:30:18.306 INFO:tasks.workunit.client.0.smithi119.stdout: "subusers": [], 2024-09-12T17:30:18.306 INFO:tasks.workunit.client.0.smithi119.stdout: "keys": [ 2024-09-12T17:30:18.306 INFO:tasks.workunit.client.0.smithi119.stdout: { 2024-09-12T17:30:18.306 INFO:tasks.workunit.client.0.smithi119.stdout: "user": "testid", 2024-09-12T17:30:18.306 INFO:tasks.workunit.client.0.smithi119.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T17:30:18.306 INFO:tasks.workunit.client.0.smithi119.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T17:30:18.306 INFO:tasks.workunit.client.0.smithi119.stdout: "active": true, 2024-09-12T17:30:18.306 INFO:tasks.workunit.client.0.smithi119.stdout: "create_date": "2024-09-12T17:30:18.300751Z" 2024-09-12T17:30:18.306 INFO:tasks.workunit.client.0.smithi119.stdout: } 2024-09-12T17:30:18.306 INFO:tasks.workunit.client.0.smithi119.stdout: ], 2024-09-12T17:30:18.306 INFO:tasks.workunit.client.0.smithi119.stdout: "swift_keys": [], 2024-09-12T17:30:18.306 INFO:tasks.workunit.client.0.smithi119.stdout: "caps": [], 2024-09-12T17:30:18.306 INFO:tasks.workunit.client.0.smithi119.stdout: "op_mask": "read, write, delete", 2024-09-12T17:30:18.307 INFO:tasks.workunit.client.0.smithi119.stdout: "default_placement": "", 2024-09-12T17:30:18.307 INFO:tasks.workunit.client.0.smithi119.stdout: "default_storage_class": "", 2024-09-12T17:30:18.307 INFO:tasks.workunit.client.0.smithi119.stdout: "placement_tags": [], 2024-09-12T17:30:18.307 INFO:tasks.workunit.client.0.smithi119.stdout: "bucket_quota": { 2024-09-12T17:30:18.307 INFO:tasks.workunit.client.0.smithi119.stdout: "enabled": false, 2024-09-12T17:30:18.307 INFO:tasks.workunit.client.0.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:30:18.307 INFO:tasks.workunit.client.0.smithi119.stdout: "max_size": -1, 2024-09-12T17:30:18.307 INFO:tasks.workunit.client.0.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:30:18.307 INFO:tasks.workunit.client.0.smithi119.stdout: "max_objects": -1 2024-09-12T17:30:18.307 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:30:18.307 INFO:tasks.workunit.client.0.smithi119.stdout: "user_quota": { 2024-09-12T17:30:18.307 INFO:tasks.workunit.client.0.smithi119.stdout: "enabled": false, 2024-09-12T17:30:18.307 INFO:tasks.workunit.client.0.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:30:18.308 INFO:tasks.workunit.client.0.smithi119.stdout: "max_size": -1, 2024-09-12T17:30:18.308 INFO:tasks.workunit.client.0.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:30:18.308 INFO:tasks.workunit.client.0.smithi119.stdout: "max_objects": -1 2024-09-12T17:30:18.308 INFO:tasks.workunit.client.0.smithi119.stdout: }, 2024-09-12T17:30:18.308 INFO:tasks.workunit.client.0.smithi119.stdout: "temp_url_keys": [], 2024-09-12T17:30:18.308 INFO:tasks.workunit.client.0.smithi119.stdout: "type": "rgw", 2024-09-12T17:30:18.308 INFO:tasks.workunit.client.0.smithi119.stdout: "mfa_ids": [], 2024-09-12T17:30:18.308 INFO:tasks.workunit.client.0.smithi119.stdout: "account_id": "", 2024-09-12T17:30:18.308 INFO:tasks.workunit.client.0.smithi119.stdout: "path": "/", 2024-09-12T17:30:18.308 INFO:tasks.workunit.client.0.smithi119.stdout: "create_date": "2024-09-12T17:30:18.300738Z", 2024-09-12T17:30:18.308 INFO:tasks.workunit.client.0.smithi119.stdout: "tags": [], 2024-09-12T17:30:18.308 INFO:tasks.workunit.client.0.smithi119.stdout: "group_ids": [] 2024-09-12T17:30:18.308 INFO:tasks.workunit.client.0.smithi119.stdout:} 2024-09-12T17:30:18.309 INFO:tasks.workunit.client.0.smithi119.stdout: 2024-09-12T17:30:18.691 INFO:tasks.workunit.client.0.smithi119.stderr:5+0 records in 2024-09-12T17:30:18.691 INFO:tasks.workunit.client.0.smithi119.stderr:5+0 records out 2024-09-12T17:30:18.691 INFO:tasks.workunit.client.0.smithi119.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0213417 s, 246 MB/s 2024-09-12T17:30:34.704 INFO:tasks.workunit.client.0.smithi119.stdout:bucket nams is reupload-bkt-108045 2024-09-12T17:30:34.705 INFO:tasks.workunit.client.0.smithi119.stdout:endpoint is http://smithi119.front.sepia.ceph.com:80 2024-09-12T17:30:34.705 INFO:tasks.workunit.client.0.smithi119.stdout:start UploadId=2~YAQN2F_v9NMS7yxWIg2x6opiSw5uxLg 2024-09-12T17:30:34.705 INFO:tasks.workunit.client.0.smithi119.stdout:phase 1 uploaded part {'ETag': '"b1a1e82a9d252be8d7db10ae4e3638fd"', 'PartNumber': 1} 2024-09-12T17:30:34.705 INFO:tasks.workunit.client.0.smithi119.stdout:phase 1 uploaded part {'ETag': '"b1a1e82a9d252be8d7db10ae4e3638fd"', 'PartNumber': 2} 2024-09-12T17:30:34.705 INFO:tasks.workunit.client.0.smithi119.stdout:phase 2 uploaded part {'ETag': '"b1a1e82a9d252be8d7db10ae4e3638fd"', 'PartNumber': 1} 2024-09-12T17:30:34.705 INFO:tasks.workunit.client.0.smithi119.stdout:phase 2 uploaded part {'ETag': '"b1a1e82a9d252be8d7db10ae4e3638fd"', 'PartNumber': 1} 2024-09-12T17:30:34.705 INFO:tasks.workunit.client.0.smithi119.stdout:phase 2 uploaded part {'ETag': '"b1a1e82a9d252be8d7db10ae4e3638fd"', 'PartNumber': 1} 2024-09-12T17:30:34.705 INFO:tasks.workunit.client.0.smithi119.stdout:phase 2 uploaded part {'ETag': '"b1a1e82a9d252be8d7db10ae4e3638fd"', 'PartNumber': 1} 2024-09-12T17:30:34.705 INFO:tasks.workunit.client.0.smithi119.stdout:phase 2 uploaded part {'ETag': '"b1a1e82a9d252be8d7db10ae4e3638fd"', 'PartNumber': 1} 2024-09-12T17:30:34.705 INFO:tasks.workunit.client.0.smithi119.stdout:phase 2 uploaded part {'ETag': '"b1a1e82a9d252be8d7db10ae4e3638fd"', 'PartNumber': 1} 2024-09-12T17:30:34.705 INFO:tasks.workunit.client.0.smithi119.stdout:phase 2 uploaded part {'ETag': '"b1a1e82a9d252be8d7db10ae4e3638fd"', 'PartNumber': 1} 2024-09-12T17:30:34.706 INFO:tasks.workunit.client.0.smithi119.stdout:phase 2 uploaded part {'ETag': '"b1a1e82a9d252be8d7db10ae4e3638fd"', 'PartNumber': 1} 2024-09-12T17:30:34.706 INFO:tasks.workunit.client.0.smithi119.stdout:phase 2 uploaded part {'ETag': '"b1a1e82a9d252be8d7db10ae4e3638fd"', 'PartNumber': 1} 2024-09-12T17:30:34.706 INFO:tasks.workunit.client.0.smithi119.stdout:phase 2 uploaded part {'ETag': '"b1a1e82a9d252be8d7db10ae4e3638fd"', 'PartNumber': 1} 2024-09-12T17:30:34.706 INFO:tasks.workunit.client.0.smithi119.stdout:phase 2 uploaded part {'ETag': '"b1a1e82a9d252be8d7db10ae4e3638fd"', 'PartNumber': 1} 2024-09-12T17:30:34.706 INFO:tasks.workunit.client.0.smithi119.stdout:completing multipart upload, parts=[{'ETag': '"b1a1e82a9d252be8d7db10ae4e3638fd"', 'PartNumber': 1}, {'ETag': '"b1a1e82a9d252be8d7db10ae4e3638fd"', 'PartNumber': 2}] 2024-09-12T17:30:36.474 INFO:tasks.workunit.client.0.smithi119.stdout:radosgw-admin bucket radoslist: 2024-09-12T17:30:36.474 INFO:tasks.workunit.client.0.smithi119.stdout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4_mpu_test4 2024-09-12T17:30:36.474 INFO:tasks.workunit.client.0.smithi119.stdout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4__multipart_mpu_test4.2~YAQN2F_v9NMS7yxWIg2x6opiSw5uxLg.2 2024-09-12T17:30:36.474 INFO:tasks.workunit.client.0.smithi119.stdout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4__multipart_mpu_test4.cwTaaJ4haZWoet_4Jz68yjuByYnQnnJ1.1 2024-09-12T17:30:36.474 INFO:tasks.workunit.client.0.smithi119.stdout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4__shadow_mpu_test4.2~YAQN2F_v9NMS7yxWIg2x6opiSw5uxLg.2_1 2024-09-12T17:30:36.474 INFO:tasks.workunit.client.0.smithi119.stdout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4__shadow_mpu_test4.cwTaaJ4haZWoet_4Jz68yjuByYnQnnJ1.1_1 2024-09-12T17:30:36.474 INFO:tasks.workunit.client.0.smithi119.stdout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4__:zGoMWzgjJW-fWIepAz8RfaSKrFE8ARM_mpu_test4 2024-09-12T17:30:36.556 INFO:tasks.workunit.client.0.smithi119.stdout:rados ls: 2024-09-12T17:30:36.557 INFO:tasks.workunit.client.0.smithi119.stdout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4_mpu_test4 2024-09-12T17:30:36.557 INFO:tasks.workunit.client.0.smithi119.stdout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4__multipart_mpu_test4.2~YAQN2F_v9NMS7yxWIg2x6opiSw5uxLg.2 2024-09-12T17:30:36.557 INFO:tasks.workunit.client.0.smithi119.stdout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4__multipart_mpu_test4.cwTaaJ4haZWoet_4Jz68yjuByYnQnnJ1.1 2024-09-12T17:30:36.557 INFO:tasks.workunit.client.0.smithi119.stdout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4__shadow_mpu_test4.2~YAQN2F_v9NMS7yxWIg2x6opiSw5uxLg.2_1 2024-09-12T17:30:36.557 INFO:tasks.workunit.client.0.smithi119.stdout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4__shadow_mpu_test4.cwTaaJ4haZWoet_4Jz68yjuByYnQnnJ1.1_1 2024-09-12T17:30:36.557 INFO:tasks.workunit.client.0.smithi119.stdout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4__:zGoMWzgjJW-fWIepAz8RfaSKrFE8ARM_mpu_test4 2024-09-12T17:30:36.574 INFO:tasks.workunit.client.0.smithi119.stdout:== PASSED == 2024-09-12T17:30:36.574 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:30:36.575 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:30:36.627 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T17:30:36.627 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:30:37.021 DEBUG:teuthology.parallel:result is None 2024-09-12T17:30:37.021 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:30:37.032 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:30:37.032 DEBUG:teuthology.orchestra.run.smithi119:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:30:37.086 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:30:37.087 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T17:30:37.111 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T17:30:37.112 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T17:30:37.112 INFO:tasks.ragweed:Using branch 'wip-rgw-meta-handlers' for ragweed 2024-09-12T17:30:37.112 DEBUG:teuthology.orchestra.run.smithi119:> git clone -b wip-rgw-meta-handlers https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:30:37.129 INFO:teuthology.orchestra.run.smithi119.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:30:37.185 INFO:teuthology.orchestra.run.smithi119.stderr:fatal: Remote branch wip-rgw-meta-handlers not found in upstream origin 2024-09-12T17:30:37.185 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-12T17:30:37.187 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-12T17:30:37.187 DEBUG:teuthology.orchestra.run.smithi119:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:30:37.234 INFO:teuthology.orchestra.run.smithi119.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:30:37.416 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T17:30:37.417 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T17:30:37.417 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key PCYTVXDHLABRRNQAZNOK --secret w7r5+xDJNBk3BqDQ6Dfflbe8OmPd/DulFTEL0uPoW5C+jm/HGTvizQ== --email ragweed.client.0+test@test.test --system false 2024-09-12T17:30:37.508 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:37.509 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:37.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.556+0000 7f90201c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.556+0000 7f90201c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.556+0000 7f90201c89c0 20 realm 2024-09-12T17:30:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.556+0000 7f90201c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.556+0000 7f90201c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.556+0000 7f90201c89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.556+0000 7f90201c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.556+0000 7f90201c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:37.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.556+0000 7f90201c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.560+0000 7f90201c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:37.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.560+0000 7f90201c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.560+0000 7f90201c89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:37.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.560+0000 7f90201c89c0 20 searching for the correct realm 2024-09-12T17:30:37.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.564+0000 7f901e4cf640 0 -- 172.21.15.119:0/2126572950 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x5614ca47dff0 msgr2=0x5614ca4803e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:37.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.572+0000 7f90154cd640 0 -- 172.21.15.119:0/2126572950 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f9018029910 msgr2=0x7f901803f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:37.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.788+0000 7f90201c89c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:30:37.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.788+0000 7f90201c89c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:30:37.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.788+0000 7f90201c89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:37.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.788+0000 7f90201c89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:37.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.788+0000 7f90201c89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:37.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.788+0000 7f90201c89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:37.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.788+0000 7f90201c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.792+0000 7f90201c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:37.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.792+0000 7f90201c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.792+0000 7f90201c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:37.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.792+0000 7f90201c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.792+0000 7f90201c89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:37.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.792+0000 7f90201c89c0 20 zone default found 2024-09-12T17:30:37.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.792+0000 7f90201c89c0 4 Realm: () 2024-09-12T17:30:37.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.792+0000 7f90201c89c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:30:37.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.792+0000 7f90201c89c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:30:37.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.792+0000 7f90201c89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:37.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.792+0000 7f90201c89c0 20 zonegroup default 2024-09-12T17:30:37.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.792+0000 7f90201c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.792+0000 7f90201c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:37.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.792+0000 7f90201c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.792+0000 7f90201c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:37.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.792+0000 7f90201c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.796+0000 7f90201c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:37.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.796+0000 7f90201c89c0 20 started sync module instance, tier type = 2024-09-12T17:30:37.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.796+0000 7f90201c89c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:30:37.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.820+0000 7f90201c89c0 20 add_watcher() i=0 2024-09-12T17:30:37.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.820+0000 7f90201c89c0 20 add_watcher() i=1 2024-09-12T17:30:37.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.820+0000 7f90201c89c0 20 add_watcher() i=2 2024-09-12T17:30:37.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.820+0000 7f90201c89c0 20 add_watcher() i=3 2024-09-12T17:30:37.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.820+0000 7f90201c89c0 20 add_watcher() i=4 2024-09-12T17:30:37.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.820+0000 7f90201c89c0 20 add_watcher() i=5 2024-09-12T17:30:37.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.820+0000 7f90201c89c0 20 add_watcher() i=6 2024-09-12T17:30:37.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.820+0000 7f90201c89c0 20 add_watcher() i=7 2024-09-12T17:30:37.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.820+0000 7f90201c89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:37.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.824+0000 7f8ecf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:37.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.824+0000 7f90201c89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:37.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.824+0000 7f90201c89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:37.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.824+0000 7f90201c89c0 5 note: GC not initialized 2024-09-12T17:30:37.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.824+0000 7f8ece7fc640 20 reqs_thread_entry: start 2024-09-12T17:30:37.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 20 init_complete bucket index max shards: 11 2024-09-12T17:30:37.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 20 Filter name: none 2024-09-12T17:30:37.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f8e3ffff640 20 reqs_thread_entry: start 2024-09-12T17:30:37.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:30:37.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:37.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T17:30:37.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:30:37.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T17:30:37.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:37.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T17:30:37.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:30:37.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 10 cache get: name=default.rgw.meta+users.keys+PCYTVXDHLABRRNQAZNOK : miss 2024-09-12T17:30:37.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:37.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 10 cache put: name=default.rgw.meta+users.keys+PCYTVXDHLABRRNQAZNOK info.flags=0x0 2024-09-12T17:30:37.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 10 adding default.rgw.meta+users.keys+PCYTVXDHLABRRNQAZNOK to cache LRU end 2024-09-12T17:30:37.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 10 cache get: name=default.rgw.meta+users.keys+PCYTVXDHLABRRNQAZNOK : hit (negative entry) 2024-09-12T17:30:37.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.828+0000 7f90201c89c0 10 cache get: name=default.rgw.meta+users.keys+PCYTVXDHLABRRNQAZNOK : hit (negative entry) 2024-09-12T17:30:37.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.832+0000 7f90201c89c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:30:37.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.832+0000 7f90201c89c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:30:37.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.832+0000 7f90201c89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:30:37.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.832+0000 7f8f017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595094 cookie 94647293087648 notifier 5961 bl.length()=675 2024-09-12T17:30:37.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.832+0000 7f8f017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:30:37.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.832+0000 7f8f017fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:30:37.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.840+0000 7f90201c89c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:30:37.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.840+0000 7f90201c89c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:30:37.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.840+0000 7f90201c89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:30:37.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.840+0000 7f8f017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595088 cookie 94647293074704 notifier 5961 bl.length()=202 2024-09-12T17:30:37.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.840+0000 7f8f017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:30:37.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.840+0000 7f8f017fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:30:37.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.848+0000 7f90201c89c0 10 cache put: name=default.rgw.meta+users.keys+PCYTVXDHLABRRNQAZNOK info.flags=0x7 2024-09-12T17:30:37.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.848+0000 7f90201c89c0 10 moving default.rgw.meta+users.keys+PCYTVXDHLABRRNQAZNOK to cache LRU end 2024-09-12T17:30:37.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.848+0000 7f90201c89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:PCYTVXDHLABRRNQAZNOK, ofs0, ns] 2024-09-12T17:30:37.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.848+0000 7f8f017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595095 cookie 94647293087648 notifier 5961 bl.length()=190 2024-09-12T17:30:37.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.848+0000 7f8f017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PCYTVXDHLABRRNQAZNOK info.flags=0x7 2024-09-12T17:30:37.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.848+0000 7f8f017fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PCYTVXDHLABRRNQAZNOK to cache LRU end 2024-09-12T17:30:37.844 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T17:30:37.844 INFO:teuthology.orchestra.run.smithi119.stdout: "user_id": "ragweed.client.0", 2024-09-12T17:30:37.844 INFO:teuthology.orchestra.run.smithi119.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T17:30:37.845 INFO:teuthology.orchestra.run.smithi119.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T17:30:37.845 INFO:teuthology.orchestra.run.smithi119.stdout: "suspended": 0, 2024-09-12T17:30:37.845 INFO:teuthology.orchestra.run.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:30:37.845 INFO:teuthology.orchestra.run.smithi119.stdout: "subusers": [], 2024-09-12T17:30:37.845 INFO:teuthology.orchestra.run.smithi119.stdout: "keys": [ 2024-09-12T17:30:37.845 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T17:30:37.845 INFO:teuthology.orchestra.run.smithi119.stdout: "user": "ragweed.client.0", 2024-09-12T17:30:37.845 INFO:teuthology.orchestra.run.smithi119.stdout: "access_key": "PCYTVXDHLABRRNQAZNOK", 2024-09-12T17:30:37.845 INFO:teuthology.orchestra.run.smithi119.stdout: "secret_key": "w7r5+xDJNBk3BqDQ6Dfflbe8OmPd/DulFTEL0uPoW5C+jm/HGTvizQ==", 2024-09-12T17:30:37.845 INFO:teuthology.orchestra.run.smithi119.stdout: "active": true, 2024-09-12T17:30:37.845 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:30:37.832883Z" 2024-09-12T17:30:37.845 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T17:30:37.845 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-12T17:30:37.846 INFO:teuthology.orchestra.run.smithi119.stdout: "swift_keys": [], 2024-09-12T17:30:37.846 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": [], 2024-09-12T17:30:37.846 INFO:teuthology.orchestra.run.smithi119.stdout: "op_mask": "read, write, delete", 2024-09-12T17:30:37.846 INFO:teuthology.orchestra.run.smithi119.stdout: "default_placement": "", 2024-09-12T17:30:37.846 INFO:teuthology.orchestra.run.smithi119.stdout: "default_storage_class": "", 2024-09-12T17:30:37.846 INFO:teuthology.orchestra.run.smithi119.stdout: "placement_tags": [], 2024-09-12T17:30:37.846 INFO:teuthology.orchestra.run.smithi119.stdout: "bucket_quota": { 2024-09-12T17:30:37.846 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:30:37.846 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:30:37.846 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:30:37.846 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:30:37.846 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:30:37.846 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:30:37.846 INFO:teuthology.orchestra.run.smithi119.stdout: "user_quota": { 2024-09-12T17:30:37.847 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:30:37.847 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:30:37.847 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:30:37.847 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:30:37.847 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:30:37.847 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:30:37.847 INFO:teuthology.orchestra.run.smithi119.stdout: "temp_url_keys": [], 2024-09-12T17:30:37.847 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "rgw", 2024-09-12T17:30:37.847 INFO:teuthology.orchestra.run.smithi119.stdout: "mfa_ids": [], 2024-09-12T17:30:37.847 INFO:teuthology.orchestra.run.smithi119.stdout: "account_id": "", 2024-09-12T17:30:37.848 INFO:teuthology.orchestra.run.smithi119.stdout: "path": "/", 2024-09-12T17:30:37.848 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:30:37.832850Z", 2024-09-12T17:30:37.848 INFO:teuthology.orchestra.run.smithi119.stdout: "tags": [], 2024-09-12T17:30:37.848 INFO:teuthology.orchestra.run.smithi119.stdout: "group_ids": [] 2024-09-12T17:30:37.848 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T17:30:37.848 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:30:37.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.852+0000 7f8ecf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:37.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.856+0000 7f90201c89c0 20 remove_watcher() i=0 2024-09-12T17:30:37.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.856+0000 7f90201c89c0 2 removed watcher, disabling cache 2024-09-12T17:30:37.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.860+0000 7f90201c89c0 20 remove_watcher() i=1 2024-09-12T17:30:37.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.860+0000 7f90201c89c0 20 remove_watcher() i=2 2024-09-12T17:30:37.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.864+0000 7f90201c89c0 20 remove_watcher() i=3 2024-09-12T17:30:37.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.868+0000 7f90201c89c0 20 remove_watcher() i=4 2024-09-12T17:30:37.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.868+0000 7f90201c89c0 20 remove_watcher() i=5 2024-09-12T17:30:37.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.872+0000 7f90201c89c0 20 remove_watcher() i=6 2024-09-12T17:30:37.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.872+0000 7f90201c89c0 20 remove_watcher() i=7 2024-09-12T17:30:37.887 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T17:30:37.887 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key UABWDDPHKOVINVEQHCNK --secret RbPZEw81B1TPhyuJ/Aw5uPczIpAslOQ7lmHRR06kafv6ZpSV5XzGwg== --email sysuser.client.0+test@test.test --system true 2024-09-12T17:30:37.934 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:37.934 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:37.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.984+0000 7fc0f10619c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.984+0000 7fc0f10619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:37.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.984+0000 7fc0f10619c0 20 realm 2024-09-12T17:30:37.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.984+0000 7fc0f10619c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.984+0000 7fc0f10619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:37.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.984+0000 7fc0f10619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:37.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.984+0000 7fc0f10619c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.988+0000 7fc0f10619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:37.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.988+0000 7fc0f10619c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.988+0000 7fc0f10619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:37.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.988+0000 7fc0f10619c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:37.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.988+0000 7fc0f10619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:37.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.988+0000 7fc0f10619c0 20 searching for the correct realm 2024-09-12T17:30:37.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:37.992+0000 7fc0ee366640 0 -- 172.21.15.119:0/545833398 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fc0e001d040 msgr2=0x7fc0e0037400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:30:38.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.204+0000 7fc0ef368640 0 -- 172.21.15.119:0/545833398 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fc0d8087bc0 msgr2=0x7fc0d8009960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:38.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:30:38.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:30:38.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:38.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:38.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:38.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:38.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:38.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:38.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:38.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:38.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:38.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:38.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 zone default found 2024-09-12T17:30:38.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 4 Realm: () 2024-09-12T17:30:38.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:30:38.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:30:38.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:38.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 zonegroup default 2024-09-12T17:30:38.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:38.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:38.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.224+0000 7fc0f10619c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:38.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.228+0000 7fc0f10619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:38.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.228+0000 7fc0f10619c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:38.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.228+0000 7fc0f10619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:38.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.228+0000 7fc0f10619c0 20 started sync module instance, tier type = 2024-09-12T17:30:38.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.228+0000 7fc0f10619c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:30:38.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.252+0000 7fc0f10619c0 20 add_watcher() i=0 2024-09-12T17:30:38.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.252+0000 7fc0f10619c0 20 add_watcher() i=1 2024-09-12T17:30:38.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.252+0000 7fc0f10619c0 20 add_watcher() i=2 2024-09-12T17:30:38.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.252+0000 7fc0f10619c0 20 add_watcher() i=3 2024-09-12T17:30:38.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.252+0000 7fc0f10619c0 20 add_watcher() i=4 2024-09-12T17:30:38.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.252+0000 7fc0f10619c0 20 add_watcher() i=5 2024-09-12T17:30:38.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.252+0000 7fc0f10619c0 20 add_watcher() i=6 2024-09-12T17:30:38.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.252+0000 7fc0f10619c0 20 add_watcher() i=7 2024-09-12T17:30:38.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.252+0000 7fc0f10619c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:38.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.256+0000 7fbfa57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:38.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.256+0000 7fc0f10619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:38.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.256+0000 7fc0f10619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:38.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.256+0000 7fc0f10619c0 5 note: GC not initialized 2024-09-12T17:30:38.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fbf1ffff640 20 reqs_thread_entry: start 2024-09-12T17:30:38.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 20 init_complete bucket index max shards: 11 2024-09-12T17:30:38.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 20 Filter name: none 2024-09-12T17:30:38.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fbf1dffb640 20 reqs_thread_entry: start 2024-09-12T17:30:38.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:30:38.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:38.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:38.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T17:30:38.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:30:38.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T17:30:38.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:38.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:38.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T17:30:38.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:30:38.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 10 cache get: name=default.rgw.meta+users.keys+UABWDDPHKOVINVEQHCNK : miss 2024-09-12T17:30:38.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:38.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:38.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 10 cache put: name=default.rgw.meta+users.keys+UABWDDPHKOVINVEQHCNK info.flags=0x0 2024-09-12T17:30:38.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 10 adding default.rgw.meta+users.keys+UABWDDPHKOVINVEQHCNK to cache LRU end 2024-09-12T17:30:38.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 10 cache get: name=default.rgw.meta+users.keys+UABWDDPHKOVINVEQHCNK : hit (negative entry) 2024-09-12T17:30:38.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.260+0000 7fc0f10619c0 10 cache get: name=default.rgw.meta+users.keys+UABWDDPHKOVINVEQHCNK : hit (negative entry) 2024-09-12T17:30:38.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.264+0000 7fc0f10619c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:30:38.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.264+0000 7fc0f10619c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:30:38.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.264+0000 7fc0f10619c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:30:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.264+0000 7fbfd27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595089 cookie 94318595561664 notifier 5979 bl.length()=675 2024-09-12T17:30:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.264+0000 7fbfd27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:30:38.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.264+0000 7fbfd27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:30:38.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.268+0000 7fc0f10619c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:30:38.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.268+0000 7fc0f10619c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:30:38.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.268+0000 7fc0f10619c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:30:38.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.272+0000 7fbfd27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595096 cookie 94318595569984 notifier 5979 bl.length()=202 2024-09-12T17:30:38.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.272+0000 7fbfd27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:30:38.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.272+0000 7fbfd27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:30:38.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.276+0000 7fc0f10619c0 10 cache put: name=default.rgw.meta+users.keys+UABWDDPHKOVINVEQHCNK info.flags=0x7 2024-09-12T17:30:38.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.276+0000 7fc0f10619c0 10 moving default.rgw.meta+users.keys+UABWDDPHKOVINVEQHCNK to cache LRU end 2024-09-12T17:30:38.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.276+0000 7fc0f10619c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:UABWDDPHKOVINVEQHCNK, ofs0, ns] 2024-09-12T17:30:38.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.276+0000 7fbfd1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595117 cookie 94318595559536 notifier 5979 bl.length()=190 2024-09-12T17:30:38.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.276+0000 7fbfd1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+UABWDDPHKOVINVEQHCNK info.flags=0x7 2024-09-12T17:30:38.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.276+0000 7fbfd1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+UABWDDPHKOVINVEQHCNK to cache LRU end 2024-09-12T17:30:38.274 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T17:30:38.274 INFO:teuthology.orchestra.run.smithi119.stdout: "user_id": "sysuser.client.0", 2024-09-12T17:30:38.274 INFO:teuthology.orchestra.run.smithi119.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T17:30:38.274 INFO:teuthology.orchestra.run.smithi119.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T17:30:38.274 INFO:teuthology.orchestra.run.smithi119.stdout: "suspended": 0, 2024-09-12T17:30:38.274 INFO:teuthology.orchestra.run.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:30:38.275 INFO:teuthology.orchestra.run.smithi119.stdout: "subusers": [], 2024-09-12T17:30:38.275 INFO:teuthology.orchestra.run.smithi119.stdout: "keys": [ 2024-09-12T17:30:38.275 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T17:30:38.275 INFO:teuthology.orchestra.run.smithi119.stdout: "user": "sysuser.client.0", 2024-09-12T17:30:38.275 INFO:teuthology.orchestra.run.smithi119.stdout: "access_key": "UABWDDPHKOVINVEQHCNK", 2024-09-12T17:30:38.275 INFO:teuthology.orchestra.run.smithi119.stdout: "secret_key": "RbPZEw81B1TPhyuJ/Aw5uPczIpAslOQ7lmHRR06kafv6ZpSV5XzGwg==", 2024-09-12T17:30:38.275 INFO:teuthology.orchestra.run.smithi119.stdout: "active": true, 2024-09-12T17:30:38.275 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:30:38.264159Z" 2024-09-12T17:30:38.275 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T17:30:38.275 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-12T17:30:38.275 INFO:teuthology.orchestra.run.smithi119.stdout: "swift_keys": [], 2024-09-12T17:30:38.275 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": [], 2024-09-12T17:30:38.275 INFO:teuthology.orchestra.run.smithi119.stdout: "op_mask": "read, write, delete", 2024-09-12T17:30:38.276 INFO:teuthology.orchestra.run.smithi119.stdout: "system": true, 2024-09-12T17:30:38.276 INFO:teuthology.orchestra.run.smithi119.stdout: "default_placement": "", 2024-09-12T17:30:38.276 INFO:teuthology.orchestra.run.smithi119.stdout: "default_storage_class": "", 2024-09-12T17:30:38.276 INFO:teuthology.orchestra.run.smithi119.stdout: "placement_tags": [], 2024-09-12T17:30:38.276 INFO:teuthology.orchestra.run.smithi119.stdout: "bucket_quota": { 2024-09-12T17:30:38.276 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:30:38.276 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:30:38.276 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:30:38.276 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:30:38.276 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:30:38.276 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:30:38.276 INFO:teuthology.orchestra.run.smithi119.stdout: "user_quota": { 2024-09-12T17:30:38.276 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:30:38.276 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:30:38.277 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:30:38.277 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:30:38.277 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:30:38.277 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:30:38.277 INFO:teuthology.orchestra.run.smithi119.stdout: "temp_url_keys": [], 2024-09-12T17:30:38.277 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "rgw", 2024-09-12T17:30:38.277 INFO:teuthology.orchestra.run.smithi119.stdout: "mfa_ids": [], 2024-09-12T17:30:38.277 INFO:teuthology.orchestra.run.smithi119.stdout: "account_id": "", 2024-09-12T17:30:38.277 INFO:teuthology.orchestra.run.smithi119.stdout: "path": "/", 2024-09-12T17:30:38.277 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:30:38.264124Z", 2024-09-12T17:30:38.277 INFO:teuthology.orchestra.run.smithi119.stdout: "tags": [], 2024-09-12T17:30:38.277 INFO:teuthology.orchestra.run.smithi119.stdout: "group_ids": [] 2024-09-12T17:30:38.277 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T17:30:38.277 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:30:38.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.280+0000 7fbfa57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:38.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.284+0000 7fc0f10619c0 20 remove_watcher() i=0 2024-09-12T17:30:38.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.284+0000 7fc0f10619c0 2 removed watcher, disabling cache 2024-09-12T17:30:38.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.288+0000 7fc0f10619c0 20 remove_watcher() i=1 2024-09-12T17:30:38.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.288+0000 7fc0f10619c0 20 remove_watcher() i=2 2024-09-12T17:30:38.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.292+0000 7fc0f10619c0 20 remove_watcher() i=3 2024-09-12T17:30:38.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.292+0000 7fc0f10619c0 20 remove_watcher() i=4 2024-09-12T17:30:38.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.296+0000 7fc0f10619c0 20 remove_watcher() i=5 2024-09-12T17:30:38.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.296+0000 7fc0f10619c0 20 remove_watcher() i=6 2024-09-12T17:30:38.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:30:38.300+0000 7fc0f10619c0 20 remove_watcher() i=7 2024-09-12T17:30:38.309 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T17:30:38.310 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:30:38.310 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T17:30:38.316 INFO:tasks.ragweed:Configuring boto... 2024-09-12T17:30:38.316 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:30:38.316 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T17:30:38.361 DEBUG:teuthology.orchestra.run.smithi119:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T17:30:38.834 INFO:teuthology.orchestra.run.smithi119.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T17:30:39.017 INFO:teuthology.orchestra.run.smithi119.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T17:30:39.626 INFO:teuthology.orchestra.run.smithi119.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:30:42.468 INFO:teuthology.orchestra.run.smithi119.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T17:30:47.172 INFO:teuthology.orchestra.run.smithi119.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=5cff2d05b65c444669bac2ebf0f353d5b3ed9d56f36563a4d54703446e7adca8,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-12T17:30:47.172 INFO:teuthology.orchestra.run.smithi119.stdout:py run-test-pre: PYTHONHASHSEED='1448488561' 2024-09-12T17:30:47.172 INFO:teuthology.orchestra.run.smithi119.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T17:30:47.340 INFO:teuthology.orchestra.run.smithi119.stdout:============================= test session starts ============================== 2024-09-12T17:30:47.340 INFO:teuthology.orchestra.run.smithi119.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T17:30:47.340 INFO:teuthology.orchestra.run.smithi119.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:30:47.341 INFO:teuthology.orchestra.run.smithi119.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-12T17:30:47.496 INFO:teuthology.orchestra.run.smithi119.stdout:collecting ... collected 9 items 2024-09-12T17:30:47.497 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:30:52.546 INFO:teuthology.orchestra.run.smithi119.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T17:30:56.738 INFO:teuthology.orchestra.run.smithi119.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T17:31:00.874 INFO:teuthology.orchestra.run.smithi119.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T17:31:05.674 INFO:teuthology.orchestra.run.smithi119.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T17:31:10.508 INFO:teuthology.orchestra.run.smithi119.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T17:31:21.444 INFO:teuthology.orchestra.run.smithi119.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T17:31:30.613 INFO:teuthology.orchestra.run.smithi119.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T17:31:39.605 INFO:teuthology.orchestra.run.smithi119.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T17:31:55.909 INFO:teuthology.orchestra.run.smithi119.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T17:31:55.909 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:31:55.910 INFO:teuthology.orchestra.run.smithi119.stdout:=============================== warnings summary =============================== 2024-09-12T17:31:55.910 INFO:teuthology.orchestra.run.smithi119.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T17:31:55.910 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T17:31:55.910 INFO:teuthology.orchestra.run.smithi119.stdout: import imp 2024-09-12T17:31:55.910 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:31:55.910 INFO:teuthology.orchestra.run.smithi119.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-12T17:31:55.910 INFO:teuthology.orchestra.run.smithi119.stdout:=================== 9 passed, 1 warning in 68.57s (0:01:08) ==================== 2024-09-12T17:31:55.956 INFO:teuthology.orchestra.run.smithi119.stdout:___________________________________ summary ____________________________________ 2024-09-12T17:31:55.956 INFO:teuthology.orchestra.run.smithi119.stdout: py: commands succeeded 2024-09-12T17:31:55.956 INFO:teuthology.orchestra.run.smithi119.stdout: congratulations :) 2024-09-12T17:31:55.976 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T17:31:55.977 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T17:31:55.982 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T17:31:56.063 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:56.064 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:31:56.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.110+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.110+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:56.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.110+0000 7f1de54629c0 20 realm 2024-09-12T17:31:56.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.110+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.110+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:56.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.110+0000 7f1de54629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:31:56.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.110+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.110+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:56.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.110+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.114+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:56.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.114+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.114+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:31:56.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.114+0000 7f1de54629c0 20 searching for the correct realm 2024-09-12T17:31:56.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.118+0000 7f1de3769640 0 -- 172.21.15.119:0/564868268 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x562969f69cf0 msgr2=0x562969f6c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:56.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.126+0000 7f1de2767640 0 -- 172.21.15.119:0/564868268 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f1dd4025040 msgr2=0x7f1dd4038440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:56.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.342+0000 7f1de54629c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:31:56.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.342+0000 7f1de54629c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:31:56.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.342+0000 7f1de54629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:31:56.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.342+0000 7f1de54629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:31:56.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.342+0000 7f1de54629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:31:56.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.342+0000 7f1de54629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:31:56.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.342+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.346+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:56.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.346+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.346+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:56.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.346+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.346+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:31:56.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.346+0000 7f1de54629c0 20 zone default found 2024-09-12T17:31:56.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.346+0000 7f1de54629c0 4 Realm: () 2024-09-12T17:31:56.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.346+0000 7f1de54629c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:31:56.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.346+0000 7f1de54629c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:31:56.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.346+0000 7f1de54629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:31:56.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.346+0000 7f1de54629c0 20 zonegroup default 2024-09-12T17:31:56.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.346+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.346+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:56.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.346+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.350+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:56.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.350+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.350+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:56.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.350+0000 7f1de54629c0 20 started sync module instance, tier type = 2024-09-12T17:31:56.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.350+0000 7f1de54629c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:31:56.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.370+0000 7f1de54629c0 20 add_watcher() i=0 2024-09-12T17:31:56.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.370+0000 7f1de54629c0 20 add_watcher() i=1 2024-09-12T17:31:56.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.370+0000 7f1de54629c0 20 add_watcher() i=2 2024-09-12T17:31:56.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.370+0000 7f1de54629c0 20 add_watcher() i=3 2024-09-12T17:31:56.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.370+0000 7f1de54629c0 20 add_watcher() i=4 2024-09-12T17:31:56.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.370+0000 7f1de54629c0 20 add_watcher() i=5 2024-09-12T17:31:56.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.370+0000 7f1de54629c0 20 add_watcher() i=6 2024-09-12T17:31:56.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.374+0000 7f1de54629c0 20 add_watcher() i=7 2024-09-12T17:31:56.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.374+0000 7f1de54629c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:31:56.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.378+0000 7f1c997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:56.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.378+0000 7f1de54629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:31:56.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.378+0000 7f1de54629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:31:56.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.466+0000 7f1c13fff640 20 reqs_thread_entry: start 2024-09-12T17:31:56.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.466+0000 7f1de54629c0 20 init_complete bucket index max shards: 11 2024-09-12T17:31:56.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.466+0000 7f1de54629c0 20 Filter name: none 2024-09-12T17:31:56.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.466+0000 7f1c11ffb640 20 reqs_thread_entry: start 2024-09-12T17:31:56.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.466+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:31:56.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.466+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.466+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:31:56.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.466+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T17:31:56.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.466+0000 7f1de54629c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:31:56.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.466+0000 7f1de54629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:56.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.466+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5 : miss 2024-09-12T17:31:56.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.466+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.470+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T17:31:56.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.470+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5 info.flags=0x17 2024-09-12T17:31:56.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.470+0000 7f1de54629c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5 to cache LRU end 2024-09-12T17:31:56.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.470+0000 7f1de54629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:56.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.470+0000 7f1de54629c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:31:56.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.470+0000 7f1de54629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5 2024-09-12T17:31:56.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.470+0000 7f1de54629c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:31:56.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.470+0000 7f1de54629c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T17:31:56.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.470+0000 7f1de54629c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T17:31:56.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.474+0000 7f1de54629c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T17:31:56.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.474+0000 7f1de54629c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T17:31:56.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.474+0000 7f1de54629c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T17:31:56.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.474+0000 7f1de54629c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T17:31:56.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.474+0000 7f1de54629c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T17:31:56.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.478+0000 7f1de54629c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T17:31:56.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.478+0000 7f1de54629c0 20 get_obj_state: octx=0x562969d90540 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x56296a01ffc8 s->prefetch_data=0 2024-09-12T17:31:56.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.478+0000 7f1de54629c0 10 manifest: total_size = 5053 2024-09-12T17:31:56.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.478+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16379098036230393502 2024-09-12T17:31:56.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.478+0000 7f1de54629c0 20 get_obj_state: octx=0x562969d90540 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x56296a01ffc8 s->prefetch_data=0 2024-09-12T17:31:56.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.478+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x56296a01ffc8 2024-09-12T17:31:56.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.478+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5.1 2024-09-12T17:31:56.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.482+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.482+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5053 stripe_ofs=5053 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.482+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16379098036230393502 2024-09-12T17:31:56.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.482+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.482+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.eFC-N9HyrVBnEw4shBfSyUnju8bhL2-_0 2024-09-12T17:31:56.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.482+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:31:56.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.482+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.482+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16379098036230393502 2024-09-12T17:31:56.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.486+0000 7f1de54629c0 20 get_obj_state: octx=0x562969d90540 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x56296a01ffc8 s->prefetch_data=0 2024-09-12T17:31:56.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.486+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:31:56.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.486+0000 7f1de54629c0 10 manifest: total_size = 7483 2024-09-12T17:31:56.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.486+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5720086665172111917 2024-09-12T17:31:56.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.486+0000 7f1de54629c0 20 get_obj_state: octx=0x562969d90540 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x56296a01ffc8 s->prefetch_data=0 2024-09-12T17:31:56.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.486+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x56296a01ffc8 2024-09-12T17:31:56.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.486+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5.2 2024-09-12T17:31:56.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.490+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.490+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=7483 stripe_ofs=7483 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.490+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5720086665172111917 2024-09-12T17:31:56.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.490+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.490+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.gLr-IHpkpCRJziEc24p9odBVtFELoxy_0 2024-09-12T17:31:56.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.490+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:31:56.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.490+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.490+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5720086665172111917 2024-09-12T17:31:56.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.494+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T17:31:56.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.494+0000 7f1de54629c0 20 get_obj_state: octx=0x562969d90540 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x562969fa8198 s->prefetch_data=0 2024-09-12T17:31:56.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.494+0000 7f1de54629c0 10 manifest: total_size = 5011 2024-09-12T17:31:56.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.494+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10511557525969913233 2024-09-12T17:31:56.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.494+0000 7f1de54629c0 20 get_obj_state: octx=0x562969d90540 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x562969fa8198 s->prefetch_data=0 2024-09-12T17:31:56.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.494+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fa8198 2024-09-12T17:31:56.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.494+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5.2 2024-09-12T17:31:56.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.498+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.498+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5011 stripe_ofs=5011 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.498+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10511557525969913233 2024-09-12T17:31:56.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.498+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.498+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.lvOO4BvIVqShv2L9c6gBWldUoZPjBZR_0 2024-09-12T17:31:56.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.498+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:31:56.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.498+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.498+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10511557525969913233 2024-09-12T17:31:56.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.498+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T17:31:56.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.502+0000 7f1de54629c0 20 get_obj_state: octx=0x562969d90540 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x562969fa8198 s->prefetch_data=0 2024-09-12T17:31:56.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.502+0000 7f1de54629c0 10 manifest: total_size = 4977 2024-09-12T17:31:56.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.502+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8037329698795032877 2024-09-12T17:31:56.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.502+0000 7f1de54629c0 20 get_obj_state: octx=0x562969d90540 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x562969fa8198 s->prefetch_data=0 2024-09-12T17:31:56.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.502+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fa8198 2024-09-12T17:31:56.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.502+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5.3 2024-09-12T17:31:56.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.506+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.506+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4977 stripe_ofs=4977 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.506+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8037329698795032877 2024-09-12T17:31:56.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.506+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.506+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.DaP7L1FhEM3F-ae4Ui0GG7U_jOfDaVb_0 2024-09-12T17:31:56.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.506+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:31:56.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.506+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.506+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8037329698795032877 2024-09-12T17:31:56.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.506+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T17:31:56.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.510+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc064340 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x562969fa8198 s->prefetch_data=0 2024-09-12T17:31:56.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.510+0000 7f1de54629c0 10 manifest: total_size = 7549 2024-09-12T17:31:56.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.510+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11529627708681969685 2024-09-12T17:31:56.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.510+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc064340 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x562969fa8198 s->prefetch_data=0 2024-09-12T17:31:56.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.510+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fa8198 2024-09-12T17:31:56.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.510+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5.4 2024-09-12T17:31:56.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.514+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.514+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=7549 stripe_ofs=7549 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.514+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11529627708681969685 2024-09-12T17:31:56.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.514+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.514+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.aby0QwHv3X0kqBJ5wZ9N7F4WyOC5CDz_0 2024-09-12T17:31:56.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.514+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:31:56.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.514+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.514+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11529627708681969685 2024-09-12T17:31:56.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.518+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T17:31:56.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.518+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc064340 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x562969fa8108 s->prefetch_data=0 2024-09-12T17:31:56.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.518+0000 7f1de54629c0 10 manifest: total_size = 4950 2024-09-12T17:31:56.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.518+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15872939156656258229 2024-09-12T17:31:56.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.518+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc064340 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x562969fa8108 s->prefetch_data=0 2024-09-12T17:31:56.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.518+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fa8108 2024-09-12T17:31:56.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.518+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5.4 2024-09-12T17:31:56.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.526+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.526+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4950 stripe_ofs=4950 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.526+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15872939156656258229 2024-09-12T17:31:56.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.526+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.526+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.WrPQTh8NhC3Eqq9lN0QNdghVGU3ixpg_0 2024-09-12T17:31:56.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.526+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:31:56.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.526+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.526+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15872939156656258229 2024-09-12T17:31:56.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.526+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T17:31:56.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.526+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc089bd0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x562969fa8108 s->prefetch_data=0 2024-09-12T17:31:56.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.526+0000 7f1de54629c0 10 manifest: total_size = 7430 2024-09-12T17:31:56.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.526+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2023055123320550331 2024-09-12T17:31:56.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.526+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc089bd0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x562969fa8108 s->prefetch_data=0 2024-09-12T17:31:56.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.526+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fa8108 2024-09-12T17:31:56.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.526+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5.5 2024-09-12T17:31:56.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.530+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.530+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=7430 stripe_ofs=7430 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.530+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2023055123320550331 2024-09-12T17:31:56.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.530+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.530+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.Z4k9iij9KR06iX-H_WP_eq0OJjAi0ME_0 2024-09-12T17:31:56.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.530+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:31:56.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.530+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.530+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2023055123320550331 2024-09-12T17:31:56.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.534+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc064340 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x562969fa8108 s->prefetch_data=0 2024-09-12T17:31:56.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.534+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T17:31:56.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.534+0000 7f1de54629c0 10 manifest: total_size = 14187 2024-09-12T17:31:56.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.534+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13754968116813053155 2024-09-12T17:31:56.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.534+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc064340 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x562969fa8108 s->prefetch_data=0 2024-09-12T17:31:56.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.534+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fa8108 2024-09-12T17:31:56.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.534+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5.7 2024-09-12T17:31:56.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.542+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.542+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=14187 stripe_ofs=14187 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.542+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13754968116813053155 2024-09-12T17:31:56.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.542+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.542+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.Xx6_yVPJvGC8vMEE3XeLsVcNrXly3Nj_0 2024-09-12T17:31:56.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.542+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:31:56.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.542+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.542+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13754968116813053155 2024-09-12T17:31:56.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.546+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc064340 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x562969fa8108 s->prefetch_data=0 2024-09-12T17:31:56.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.546+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T17:31:56.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.546+0000 7f1de54629c0 10 manifest: total_size = 5422 2024-09-12T17:31:56.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.546+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16804753628595489948 2024-09-12T17:31:56.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.546+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc064340 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x562969fa8108 s->prefetch_data=0 2024-09-12T17:31:56.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.546+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fa8108 2024-09-12T17:31:56.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.546+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5.8 2024-09-12T17:31:56.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.550+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.550+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5422 stripe_ofs=5422 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.550+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16804753628595489948 2024-09-12T17:31:56.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.550+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.550+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.C4oIweLYqaELhDMcCj2gz1umVZYQtXm_0 2024-09-12T17:31:56.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.550+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:31:56.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.550+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.550+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16804753628595489948 2024-09-12T17:31:56.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.554+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T17:31:56.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.554+0000 7f1de54629c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:31:56.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.554+0000 7f1de54629c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:31:56.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.554+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:31:56.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.554+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:31:56.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.554+0000 7f1de54629c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:31:56.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.554+0000 7f1de54629c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:31:56.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.554+0000 7f1de54629c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5])"; uploads.size()=0; is_truncated=0 2024-09-12T17:31:56.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.558+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T17:31:56.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.558+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.558+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T17:31:56.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.558+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T17:31:56.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.558+0000 7f1de54629c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T17:31:56.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.562+0000 7f1de54629c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T17:31:56.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.562+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T17:31:56.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.562+0000 7f1cc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398876 cookie 94735871425824 notifier 5732 bl.length()=162 2024-09-12T17:31:56.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.566+0000 7f1de54629c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5 from cache 2024-09-12T17:31:56.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.566+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5, ofs0, ns] 2024-09-12T17:31:56.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.570+0000 7f1cc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398873 cookie 94735871454512 notifier 5732 bl.length()=219 2024-09-12T17:31:56.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.578+0000 7f1de54629c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5 : miss 2024-09-12T17:31:56.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.578+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.578+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:56.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.578+0000 7f1de54629c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5 info.flags=0x0 2024-09-12T17:31:56.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.578+0000 7f1de54629c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5 to cache LRU end 2024-09-12T17:31:56.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.582+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12 : miss 2024-09-12T17:31:56.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.582+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.582+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T17:31:56.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.582+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12 info.flags=0x17 2024-09-12T17:31:56.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.582+0000 7f1de54629c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12 to cache LRU end 2024-09-12T17:31:56.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.582+0000 7f1de54629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:56.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.582+0000 7f1de54629c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:31:56.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.582+0000 7f1de54629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12 2024-09-12T17:31:56.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.590+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo 2024-09-12T17:31:56.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.590+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa24d0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x562969fa0c78 s->prefetch_data=0 2024-09-12T17:31:56.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.590+0000 7f1de54629c0 10 manifest: total_size = 18874368 2024-09-12T17:31:56.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.590+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5313167539662983166 2024-09-12T17:31:56.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.590+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa24d0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x562969fa0c78 s->prefetch_data=0 2024-09-12T17:31:56.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.590+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fa0c78 2024-09-12T17:31:56.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.590+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12.10 2024-09-12T17:31:56.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:56.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:56.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:56.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:56.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:56.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:56.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:56.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:31:56.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:31:56.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:31:56.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:31:56.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:31:56.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T17:31:56.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:31:56.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T17:31:56.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5313167539662983166 2024-09-12T17:31:56.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12__multipart_foo.2~TYSb7E2pz6SWu7feLR0e01_si8tEWAh.1 2024-09-12T17:31:56.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T17:31:56.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12__shadow_foo.2~TYSb7E2pz6SWu7feLR0e01_si8tEWAh.1_1 2024-09-12T17:31:56.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 590 2024-09-12T17:31:56.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12__multipart_foo.2~TYSb7E2pz6SWu7feLR0e01_si8tEWAh.2 2024-09-12T17:31:56.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 836 2024-09-12T17:31:56.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12__shadow_foo.2~TYSb7E2pz6SWu7feLR0e01_si8tEWAh.2_1 2024-09-12T17:31:56.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1080 2024-09-12T17:31:56.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12__multipart_foo.2~TYSb7E2pz6SWu7feLR0e01_si8tEWAh.3 2024-09-12T17:31:56.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1326 2024-09-12T17:31:56.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12__shadow_foo.2~TYSb7E2pz6SWu7feLR0e01_si8tEWAh.3_1 2024-09-12T17:31:56.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1570 2024-09-12T17:31:56.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12__multipart_foo.2~TYSb7E2pz6SWu7feLR0e01_si8tEWAh.4 2024-09-12T17:31:56.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1816 2024-09-12T17:31:56.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.598+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5313167539662983166 2024-09-12T17:31:56.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.602+0000 7f1de54629c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:31:56.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.602+0000 7f1de54629c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:31:56.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.602+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:31:56.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.606+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:31:56.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.606+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:31:56.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.606+0000 7f1de54629c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:31:56.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.606+0000 7f1de54629c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:31:56.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.606+0000 7f1de54629c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12])"; uploads.size()=0; is_truncated=0 2024-09-12T17:31:56.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.606+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T17:31:56.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.606+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.610+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T17:31:56.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.610+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T17:31:56.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.610+0000 7f1de54629c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T17:31:56.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.610+0000 7f1de54629c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T17:31:56.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.610+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T17:31:56.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.614+0000 7f1cc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398899 cookie 94735871423312 notifier 5732 bl.length()=191 2024-09-12T17:31:56.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.618+0000 7f1de54629c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12 from cache 2024-09-12T17:31:56.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.618+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12, ofs0, ns] 2024-09-12T17:31:56.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.618+0000 7f1cc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398877 cookie 94735871425824 notifier 5732 bl.length()=249 2024-09-12T17:31:56.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.626+0000 7f1de54629c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12 : miss 2024-09-12T17:31:56.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.626+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.626+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:56.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.626+0000 7f1de54629c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12 info.flags=0x0 2024-09-12T17:31:56.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.626+0000 7f1de54629c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12 to cache LRU end 2024-09-12T17:31:56.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.630+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13 : miss 2024-09-12T17:31:56.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.630+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.630+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T17:31:56.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.630+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13 info.flags=0x17 2024-09-12T17:31:56.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.630+0000 7f1de54629c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13 to cache LRU end 2024-09-12T17:31:56.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.630+0000 7f1de54629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:56.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.630+0000 7f1de54629c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:31:56.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.630+0000 7f1de54629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13 2024-09-12T17:31:56.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.638+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo 2024-09-12T17:31:56.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.638+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fac450 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x562969fb81f8 s->prefetch_data=0 2024-09-12T17:31:56.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.638+0000 7f1de54629c0 10 manifest: total_size = 18874368 2024-09-12T17:31:56.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.638+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5192372696479772500 2024-09-12T17:31:56.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.638+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fac450 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x562969fb81f8 s->prefetch_data=0 2024-09-12T17:31:56.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.638+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fb81f8 2024-09-12T17:31:56.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.638+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13.10 2024-09-12T17:31:56.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:56.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:56.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:56.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:56.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:56.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:56.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:56.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:31:56.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:31:56.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:31:56.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:31:56.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:31:56.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T17:31:56.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:31:56.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T17:31:56.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5192372696479772500 2024-09-12T17:31:56.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13__multipart_foo.2~JjUitW07m0VBazlIoCHQ2aR9JxP80Mc.1 2024-09-12T17:31:56.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T17:31:56.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13__shadow_foo.2~JjUitW07m0VBazlIoCHQ2aR9JxP80Mc.1_1 2024-09-12T17:31:56.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 590 2024-09-12T17:31:56.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13__multipart_foo.2~JjUitW07m0VBazlIoCHQ2aR9JxP80Mc.2 2024-09-12T17:31:56.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 836 2024-09-12T17:31:56.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13__shadow_foo.2~JjUitW07m0VBazlIoCHQ2aR9JxP80Mc.2_1 2024-09-12T17:31:56.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1080 2024-09-12T17:31:56.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13__multipart_foo.2~JjUitW07m0VBazlIoCHQ2aR9JxP80Mc.3 2024-09-12T17:31:56.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1326 2024-09-12T17:31:56.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13__shadow_foo.2~JjUitW07m0VBazlIoCHQ2aR9JxP80Mc.3_1 2024-09-12T17:31:56.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1570 2024-09-12T17:31:56.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13__multipart_foo.2~JjUitW07m0VBazlIoCHQ2aR9JxP80Mc.4 2024-09-12T17:31:56.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1816 2024-09-12T17:31:56.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5192372696479772500 2024-09-12T17:31:56.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:31:56.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:31:56.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.646+0000 7f1de54629c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:31:56.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.650+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:31:56.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.650+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:31:56.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.650+0000 7f1de54629c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:31:56.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.650+0000 7f1de54629c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:31:56.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.650+0000 7f1de54629c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13])"; uploads.size()=0; is_truncated=0 2024-09-12T17:31:56.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.650+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T17:31:56.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.650+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.654+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T17:31:56.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.654+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T17:31:56.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.654+0000 7f1de54629c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T17:31:56.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.654+0000 7f1de54629c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T17:31:56.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.654+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T17:31:56.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.658+0000 7f1cc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398874 cookie 94735871454512 notifier 5732 bl.length()=198 2024-09-12T17:31:56.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.662+0000 7f1de54629c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13 from cache 2024-09-12T17:31:56.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.662+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13, ofs0, ns] 2024-09-12T17:31:56.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.662+0000 7f1cc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398874 cookie 94735871464576 notifier 5732 bl.length()=256 2024-09-12T17:31:56.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.670+0000 7f1de54629c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13 : miss 2024-09-12T17:31:56.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.670+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.670+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:56.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.670+0000 7f1de54629c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13 info.flags=0x0 2024-09-12T17:31:56.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.670+0000 7f1de54629c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13 to cache LRU end 2024-09-12T17:31:56.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.674+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11 : miss 2024-09-12T17:31:56.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.674+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.678+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T17:31:56.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.678+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11 info.flags=0x17 2024-09-12T17:31:56.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.678+0000 7f1de54629c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11 to cache LRU end 2024-09-12T17:31:56.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.678+0000 7f1de54629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:56.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.678+0000 7f1de54629c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:31:56.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.678+0000 7f1de54629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11 2024-09-12T17:31:56.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.686+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo[guLYQhrkRNHVcBTJksbLyqfWNa8TAzC] 2024-09-12T17:31:56.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.686+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11.10 2024-09-12T17:31:56.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.686+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa27a0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x562969fa1078 s->prefetch_data=0 2024-09-12T17:31:56.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.686+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to bpugwyolv8il9u0wn0kbiup4bo93j0c7 2024-09-12T17:31:56.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.686+0000 7f1de54629c0 20 get_obj_state_impl: setting s->olh_tag to bgclb480pzgipvw0h9zzj20d3k46h8q3 2024-09-12T17:31:56.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.686+0000 7f1de54629c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bgclb480pzgipvw0h9zzj20d3k46h8q3 2024-09-12T17:31:56.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.690+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11.10 2024-09-12T17:31:56.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.690+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11.10 2024-09-12T17:31:56.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.694+0000 7f1de54629c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T17:31:56.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.694+0000 7f1de54629c0 20 olh_log_entry: epoch=3 op=3 key=foo[guLYQhrkRNHVcBTJksbLyqfWNa8TAzC] 2024-09-12T17:31:56.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.694+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa27a0 obj=test-client.0-r-test-multipart-index-versioning.1:_:guLYQhrkRNHVcBTJksbLyqfWNa8TAzC_foo state=0x562969fb3598 s->prefetch_data=0 2024-09-12T17:31:56.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.694+0000 7f1de54629c0 10 manifest: total_size = 18874368 2024-09-12T17:31:56.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.694+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12160401997955455530 2024-09-12T17:31:56.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.694+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa27a0 obj=test-client.0-r-test-multipart-index-versioning.1:_:guLYQhrkRNHVcBTJksbLyqfWNa8TAzC_foo state=0x562969fb3598 s->prefetch_data=0 2024-09-12T17:31:56.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.694+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fb3598 2024-09-12T17:31:56.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.694+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11.10 2024-09-12T17:31:56.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:56.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:56.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:56.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:56.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:56.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:56.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:56.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:31:56.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:31:56.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:31:56.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:31:56.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:31:56.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T17:31:56.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:31:56.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T17:31:56.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12160401997955455530 2024-09-12T17:31:56.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11__multipart_foo.2~npb7hBg2wdwR1jQ52w4pGaz9YumDb6Y.1 2024-09-12T17:31:56.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T17:31:56.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11__shadow_foo.2~npb7hBg2wdwR1jQ52w4pGaz9YumDb6Y.1_1 2024-09-12T17:31:56.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2024-09-12T17:31:56.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11__multipart_foo.2~npb7hBg2wdwR1jQ52w4pGaz9YumDb6Y.2 2024-09-12T17:31:56.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2024-09-12T17:31:56.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11__shadow_foo.2~npb7hBg2wdwR1jQ52w4pGaz9YumDb6Y.2_1 2024-09-12T17:31:56.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1081 2024-09-12T17:31:56.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11__multipart_foo.2~npb7hBg2wdwR1jQ52w4pGaz9YumDb6Y.3 2024-09-12T17:31:56.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1327 2024-09-12T17:31:56.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11__shadow_foo.2~npb7hBg2wdwR1jQ52w4pGaz9YumDb6Y.3_1 2024-09-12T17:31:56.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1571 2024-09-12T17:31:56.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11__multipart_foo.2~npb7hBg2wdwR1jQ52w4pGaz9YumDb6Y.4 2024-09-12T17:31:56.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1817 2024-09-12T17:31:56.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.698+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12160401997955455530 2024-09-12T17:31:56.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.702+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo[guLYQhrkRNHVcBTJksbLyqfWNa8TAzC] 2024-09-12T17:31:56.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.706+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa27a0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x562969fa1078 s->prefetch_data=0 2024-09-12T17:31:56.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.706+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11.10 2024-09-12T17:31:56.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.710+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11.10 2024-09-12T17:31:56.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.710+0000 7f1de54629c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:31:56.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.710+0000 7f1de54629c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:31:56.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.714+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:31:56.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.714+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:31:56.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.714+0000 7f1de54629c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:31:56.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.714+0000 7f1de54629c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:31:56.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.714+0000 7f1de54629c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11])"; uploads.size()=0; is_truncated=0 2024-09-12T17:31:56.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.718+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T17:31:56.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.718+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.718+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T17:31:56.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.718+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T17:31:56.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.718+0000 7f1de54629c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T17:31:56.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.718+0000 7f1de54629c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T17:31:56.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.718+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T17:31:56.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.722+0000 7f1cc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398875 cookie 94735871454512 notifier 5732 bl.length()=193 2024-09-12T17:31:56.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.726+0000 7f1de54629c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11 from cache 2024-09-12T17:31:56.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.726+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11, ofs0, ns] 2024-09-12T17:31:56.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.726+0000 7f1cc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398908 cookie 94735871458832 notifier 5732 bl.length()=251 2024-09-12T17:31:56.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.734+0000 7f1de54629c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11 : miss 2024-09-12T17:31:56.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.734+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.738+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:56.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.738+0000 7f1de54629c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11 info.flags=0x0 2024-09-12T17:31:56.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.738+0000 7f1de54629c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11 to cache LRU end 2024-09-12T17:31:56.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.742+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10 : miss 2024-09-12T17:31:56.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.742+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.742+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=449 2024-09-12T17:31:56.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.742+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10 info.flags=0x17 2024-09-12T17:31:56.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.742+0000 7f1de54629c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10 to cache LRU end 2024-09-12T17:31:56.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.742+0000 7f1de54629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:56.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.742+0000 7f1de54629c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:31:56.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.742+0000 7f1de54629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10 2024-09-12T17:31:56.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.750+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo 2024-09-12T17:31:56.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.750+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fb5ec0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x562969fb8038 s->prefetch_data=0 2024-09-12T17:31:56.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.754+0000 7f1de54629c0 10 manifest: total_size = 1667 2024-09-12T17:31:56.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.754+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.948963268087707501 2024-09-12T17:31:56.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.754+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fb5ec0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x562969fb8038 s->prefetch_data=0 2024-09-12T17:31:56.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.754+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fb8038 2024-09-12T17:31:56.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.754+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10.10 2024-09-12T17:31:56.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:31:56.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-12T17:31:56.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T17:31:56.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:31:56.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-12T17:31:56.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T17:31:56.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:31:56.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=516 2024-09-12T17:31:56.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T17:31:56.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T17:31:56.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4195852 part_ofs=1548 rule->part_size=119 2024-09-12T17:31:56.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T17:31:56.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.948963268087707501 2024-09-12T17:31:56.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10__multipart_foo.2~7AAYDqmjXFlE_S2TN3tzmkjjDXHIl_l.1 2024-09-12T17:31:56.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-12T17:31:56.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10__multipart_foo.2~7AAYDqmjXFlE_S2TN3tzmkjjDXHIl_l.2 2024-09-12T17:31:56.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2024-09-12T17:31:56.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10__multipart_foo.2~7AAYDqmjXFlE_S2TN3tzmkjjDXHIl_l.3 2024-09-12T17:31:56.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2024-09-12T17:31:56.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10__multipart_foo.2~7AAYDqmjXFlE_S2TN3tzmkjjDXHIl_l.4 2024-09-12T17:31:56.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1083 2024-09-12T17:31:56.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.758+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.948963268087707501 2024-09-12T17:31:56.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.762+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:31:56.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.762+0000 7f1de54629c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:31:56.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.762+0000 7f1de54629c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:31:56.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.766+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:31:56.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.766+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:31:56.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.766+0000 7f1de54629c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:31:56.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.766+0000 7f1de54629c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:31:56.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.766+0000 7f1de54629c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10])"; uploads.size()=0; is_truncated=0 2024-09-12T17:31:56.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.770+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T17:31:56.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.770+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.770+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=227 2024-09-12T17:31:56.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.770+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T17:31:56.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.770+0000 7f1de54629c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T17:31:56.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.774+0000 7f1de54629c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T17:31:56.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.774+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T17:31:56.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.774+0000 7f1cc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398878 cookie 94735871461168 notifier 5732 bl.length()=183 2024-09-12T17:31:56.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.778+0000 7f1de54629c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10 from cache 2024-09-12T17:31:56.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.778+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10, ofs0, ns] 2024-09-12T17:31:56.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.778+0000 7f1cc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398900 cookie 94735871423312 notifier 5732 bl.length()=241 2024-09-12T17:31:56.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.786+0000 7f1de54629c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10 : miss 2024-09-12T17:31:56.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.786+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.790+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:56.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.790+0000 7f1de54629c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10 info.flags=0x0 2024-09-12T17:31:56.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.790+0000 7f1de54629c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10 to cache LRU end 2024-09-12T17:31:56.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.794+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16 : miss 2024-09-12T17:31:56.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.794+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.794+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:31:56.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.794+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16 info.flags=0x17 2024-09-12T17:31:56.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.794+0000 7f1de54629c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16 to cache LRU end 2024-09-12T17:31:56.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.794+0000 7f1de54629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:56.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.794+0000 7f1de54629c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:31:56.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.794+0000 7f1de54629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16 2024-09-12T17:31:56.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.794+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:31:56.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.798+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:31:56.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.798+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:31:56.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.798+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:31:56.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.798+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:31:56.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.798+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:31:56.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.802+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:31:56.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.802+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:31:56.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.802+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:31:56.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.802+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:31:56.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.802+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:31:56.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.802+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:31:56.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.806+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa7d20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.806+0000 7f1de54629c0 10 manifest: total_size = 22651 2024-09-12T17:31:56.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.806+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to _RtXW7np_bVEXyCw5_ywMGd1kTEJ69Al 2024-09-12T17:31:56.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.806+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa7d20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.806+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:56.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.806+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16.0 2024-09-12T17:31:56.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.810+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.810+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.810+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: _RtXW7np_bVEXyCw5_ywMGd1kTEJ69Al 2024-09-12T17:31:56.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.810+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.810+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.7crKhVOKl17n2vUOfk_X0vSzkf6ho99_0 2024-09-12T17:31:56.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.810+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:31:56.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.810+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.810+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _RtXW7np_bVEXyCw5_ywMGd1kTEJ69Al 2024-09-12T17:31:56.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.814+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:31:56.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.814+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa4340 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.814+0000 7f1de54629c0 10 manifest: total_size = 5242880 2024-09-12T17:31:56.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.814+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to _vyzfajOzqYddUCNJPtZ-ZxELvr26HYe 2024-09-12T17:31:56.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.814+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa4340 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.814+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:56.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.814+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16.2 2024-09-12T17:31:56.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.822+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.822+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.822+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.822+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.822+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: _vyzfajOzqYddUCNJPtZ-ZxELvr26HYe 2024-09-12T17:31:56.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.822+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.822+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.QYRA0rgiciW__ynYKKauOxxdDjKO0u3_0 2024-09-12T17:31:56.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.822+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:31:56.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.822+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.QYRA0rgiciW__ynYKKauOxxdDjKO0u3_1 2024-09-12T17:31:56.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.822+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:31:56.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.822+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.822+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _vyzfajOzqYddUCNJPtZ-ZxELvr26HYe 2024-09-12T17:31:56.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.826+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fb8ec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.826+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:31:56.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.826+0000 7f1de54629c0 10 manifest: total_size = 5242880 2024-09-12T17:31:56.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.826+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160199255982712328 2024-09-12T17:31:56.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.826+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fb8ec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.826+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:56.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.826+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16.3 2024-09-12T17:31:56.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.830+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.830+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.830+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.830+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.830+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160199255982712328 2024-09-12T17:31:56.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.830+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.830+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.AAo2fbUfygtrhQBYVIc2lkOCfwQ36ro_0 2024-09-12T17:31:56.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.830+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 336 2024-09-12T17:31:56.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.830+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.AAo2fbUfygtrhQBYVIc2lkOCfwQ36ro_1 2024-09-12T17:31:56.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.830+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 573 2024-09-12T17:31:56.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.830+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.830+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160199255982712328 2024-09-12T17:31:56.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.834+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:31:56.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.834+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd406b490 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.834+0000 7f1de54629c0 10 manifest: total_size = 5242880 2024-09-12T17:31:56.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.834+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to _f56ULyuKUuPR8bB0qjRXFaUKcgYpAGy 2024-09-12T17:31:56.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.834+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd406b490 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.834+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:56.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.834+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16.5 2024-09-12T17:31:56.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.842+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.842+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.842+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.842+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.842+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: _f56ULyuKUuPR8bB0qjRXFaUKcgYpAGy 2024-09-12T17:31:56.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.842+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.842+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.VX9ugkuPX0fDP8rG0v4U6g2Qpa8J3rJ_0 2024-09-12T17:31:56.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.842+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:31:56.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.842+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.VX9ugkuPX0fDP8rG0v4U6g2Qpa8J3rJ_1 2024-09-12T17:31:56.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.842+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T17:31:56.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.842+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.842+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _f56ULyuKUuPR8bB0qjRXFaUKcgYpAGy 2024-09-12T17:31:56.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.846+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd4038fc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.846+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:31:56.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.846+0000 7f1de54629c0 10 manifest: total_size = 5242880 2024-09-12T17:31:56.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.846+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to _zAfoNxG11RS4vyaaEOVqlYCXLKZIeef 2024-09-12T17:31:56.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.846+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd4038fc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.846+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:56.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.846+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16.5 2024-09-12T17:31:56.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.850+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.850+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.850+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.850+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.850+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: _zAfoNxG11RS4vyaaEOVqlYCXLKZIeef 2024-09-12T17:31:56.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.850+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.850+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.AWhWLUmlzGAaJTNambI2iujLsm8uuCf_0 2024-09-12T17:31:56.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.850+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:31:56.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.850+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.AWhWLUmlzGAaJTNambI2iujLsm8uuCf_1 2024-09-12T17:31:56.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.850+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T17:31:56.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.850+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.850+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _zAfoNxG11RS4vyaaEOVqlYCXLKZIeef 2024-09-12T17:31:56.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.854+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc064340 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.854+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:31:56.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.854+0000 7f1de54629c0 10 manifest: total_size = 22651 2024-09-12T17:31:56.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.854+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17282991394478149969 2024-09-12T17:31:56.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.854+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc064340 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.854+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:56.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.854+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16.5 2024-09-12T17:31:56.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.862+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.862+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.862+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17282991394478149969 2024-09-12T17:31:56.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.862+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.862+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.lVzESq797WaV1iLzzVfyBhZZTx8Dq65_0 2024-09-12T17:31:56.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.862+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T17:31:56.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.862+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.862+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17282991394478149969 2024-09-12T17:31:56.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.862+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:31:56.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.866+0000 7f1de54629c0 20 get_obj_state: octx=0x562969faaa00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.866+0000 7f1de54629c0 10 manifest: total_size = 5242880 2024-09-12T17:31:56.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.866+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to _vKhIN7KsUBZkHYArVQrYxS6W_QClmLl 2024-09-12T17:31:56.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.866+0000 7f1de54629c0 20 get_obj_state: octx=0x562969faaa00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.866+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:56.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.866+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16.7 2024-09-12T17:31:56.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.870+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.870+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.870+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.870+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.870+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: _vKhIN7KsUBZkHYArVQrYxS6W_QClmLl 2024-09-12T17:31:56.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.870+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.870+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.gL-oFHKm6ODmx8hP84x0vaQL8OgPgLn_0 2024-09-12T17:31:56.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.870+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:31:56.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.870+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.gL-oFHKm6ODmx8hP84x0vaQL8OgPgLn_1 2024-09-12T17:31:56.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.870+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:31:56.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.870+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.870+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _vKhIN7KsUBZkHYArVQrYxS6W_QClmLl 2024-09-12T17:31:56.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.874+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd4055940 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.874+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:31:56.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.874+0000 7f1de54629c0 10 manifest: total_size = 5242880 2024-09-12T17:31:56.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.874+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4957205627766043379 2024-09-12T17:31:56.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.874+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd4055940 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.874+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:56.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.874+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16.7 2024-09-12T17:31:56.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4957205627766043379 2024-09-12T17:31:56.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.2v2BQmXSMhQuyoWKz_LOPCcXrcrrKyX_0 2024-09-12T17:31:56.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T17:31:56.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.2v2BQmXSMhQuyoWKz_LOPCcXrcrrKyX_1 2024-09-12T17:31:56.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T17:31:56.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4957205627766043379 2024-09-12T17:31:56.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd813b1c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:31:56.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 10 manifest: total_size = 22651 2024-09-12T17:31:56.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3311967373833908892 2024-09-12T17:31:56.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd813b1c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:56.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.882+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16.7 2024-09-12T17:31:56.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.890+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.890+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.890+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3311967373833908892 2024-09-12T17:31:56.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.890+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.890+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.lVzESq797WaV1iLzzVfyBhZZTx8Dq65_0 2024-09-12T17:31:56.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.890+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T17:31:56.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.890+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.890+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3311967373833908892 2024-09-12T17:31:56.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.894+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:31:56.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.894+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc064340 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.894+0000 7f1de54629c0 10 manifest: total_size = 5242880 2024-09-12T17:31:56.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.894+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.536454783019206846 2024-09-12T17:31:56.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.894+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc064340 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.894+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:56.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.894+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16.8 2024-09-12T17:31:56.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.898+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.898+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.898+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.898+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.898+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.536454783019206846 2024-09-12T17:31:56.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.898+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.898+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.2v2BQmXSMhQuyoWKz_LOPCcXrcrrKyX_0 2024-09-12T17:31:56.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.898+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:31:56.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.898+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.2v2BQmXSMhQuyoWKz_LOPCcXrcrrKyX_1 2024-09-12T17:31:56.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.898+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 577 2024-09-12T17:31:56.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.898+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.898+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.536454783019206846 2024-09-12T17:31:56.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.902+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:31:56.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.902+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa4490 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.902+0000 7f1de54629c0 10 manifest: total_size = 22651 2024-09-12T17:31:56.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.902+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to _eT8arOG8xz_mqq6wj6RQZi9K6VN1Wsz 2024-09-12T17:31:56.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.902+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa4490 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.902+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:56.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.902+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16.8 2024-09-12T17:31:56.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.910+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.910+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.910+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: _eT8arOG8xz_mqq6wj6RQZi9K6VN1Wsz 2024-09-12T17:31:56.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.910+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.910+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.N91ONlmuNw5gMqICXAONphPYJMKhC0o_0 2024-09-12T17:31:56.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.910+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:31:56.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.910+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.910+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _eT8arOG8xz_mqq6wj6RQZi9K6VN1Wsz 2024-09-12T17:31:56.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.914+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:31:56.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.914+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc066760 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.914+0000 7f1de54629c0 10 manifest: total_size = 5242880 2024-09-12T17:31:56.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.914+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.795468978822280530 2024-09-12T17:31:56.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.914+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc066760 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.914+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:56.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.914+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16.9 2024-09-12T17:31:56.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.922+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.922+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.922+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.922+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.922+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.795468978822280530 2024-09-12T17:31:56.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.922+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.922+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.AAo2fbUfygtrhQBYVIc2lkOCfwQ36ro_0 2024-09-12T17:31:56.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.922+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 336 2024-09-12T17:31:56.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.922+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.AAo2fbUfygtrhQBYVIc2lkOCfwQ36ro_1 2024-09-12T17:31:56.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.922+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 573 2024-09-12T17:31:56.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.922+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.922+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.795468978822280530 2024-09-12T17:31:56.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.922+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:31:56.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.922+0000 7f1de54629c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:31:56.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.922+0000 7f1de54629c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:31:56.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.926+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:31:56.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.926+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:31:56.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.926+0000 7f1de54629c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:31:56.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.926+0000 7f1de54629c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:31:56.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.926+0000 7f1de54629c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16])"; uploads.size()=0; is_truncated=0 2024-09-12T17:31:56.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.930+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T17:31:56.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.930+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.930+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T17:31:56.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.930+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T17:31:56.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.930+0000 7f1de54629c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T17:31:56.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.934+0000 7f1de54629c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T17:31:56.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.934+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T17:31:56.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.934+0000 7f1cc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398876 cookie 94735871454512 notifier 5732 bl.length()=189 2024-09-12T17:31:56.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.938+0000 7f1de54629c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16 from cache 2024-09-12T17:31:56.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.938+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16, ofs0, ns] 2024-09-12T17:31:56.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.942+0000 7f1cc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398909 cookie 94735871458832 notifier 5732 bl.length()=247 2024-09-12T17:31:56.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.950+0000 7f1de54629c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16 : miss 2024-09-12T17:31:56.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.950+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.950+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:56.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.950+0000 7f1de54629c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16 info.flags=0x0 2024-09-12T17:31:56.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.950+0000 7f1de54629c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16 to cache LRU end 2024-09-12T17:31:56.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.954+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17 : miss 2024-09-12T17:31:56.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.954+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:56.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.958+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:31:56.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.958+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17 info.flags=0x17 2024-09-12T17:31:56.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.958+0000 7f1de54629c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17 to cache LRU end 2024-09-12T17:31:56.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.958+0000 7f1de54629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:56.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.958+0000 7f1de54629c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:31:56.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.958+0000 7f1de54629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17 2024-09-12T17:31:56.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.958+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:31:56.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.962+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:31:56.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.962+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:31:56.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.962+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:31:56.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.962+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:31:56.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.962+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:31:56.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.966+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:31:56.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.966+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:31:56.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.966+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:31:56.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.966+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:31:56.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.966+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:31:56.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.966+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:31:56.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.970+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fbd7d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.970+0000 7f1de54629c0 10 manifest: total_size = 45360 2024-09-12T17:31:56.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.970+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to _1P0ESBwShbGcdnRk5jiK22Y9PnxeWqb 2024-09-12T17:31:56.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.970+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fbd7d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.970+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:56.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.970+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17.0 2024-09-12T17:31:56.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.974+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.974+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.974+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: _1P0ESBwShbGcdnRk5jiK22Y9PnxeWqb 2024-09-12T17:31:56.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.974+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.974+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.ZvQxubbwTNa2PZXCx_Ar6-KtnsDK1Gi_0 2024-09-12T17:31:56.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.974+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:31:56.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.974+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.974+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _1P0ESBwShbGcdnRk5jiK22Y9PnxeWqb 2024-09-12T17:31:56.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.978+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:31:56.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.978+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd4055490 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.978+0000 7f1de54629c0 10 manifest: total_size = 11534336 2024-09-12T17:31:56.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.978+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to _7mT_QuF8khdmJcRQcvYJ13QPClTTpoW 2024-09-12T17:31:56.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.978+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd4055490 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.978+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:56.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.978+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17.2 2024-09-12T17:31:56.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.986+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.986+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.986+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.986+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.986+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:56.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.986+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:31:56.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.986+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: _7mT_QuF8khdmJcRQcvYJ13QPClTTpoW 2024-09-12T17:31:56.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.986+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.986+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.DNvztgmBEoa6PFNc86TrvkV1TgIfXub_0 2024-09-12T17:31:56.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.986+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:31:56.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.986+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.DNvztgmBEoa6PFNc86TrvkV1TgIfXub_1 2024-09-12T17:31:56.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.986+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:31:56.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.986+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.DNvztgmBEoa6PFNc86TrvkV1TgIfXub_2 2024-09-12T17:31:56.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.986+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T17:31:56.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.986+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.986+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _7mT_QuF8khdmJcRQcvYJ13QPClTTpoW 2024-09-12T17:31:56.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.990+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa0930 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.990+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:31:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.990+0000 7f1de54629c0 10 manifest: total_size = 11534336 2024-09-12T17:31:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.990+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9555249048264848867 2024-09-12T17:31:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.990+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa0930 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.990+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:56.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.990+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17.3 2024-09-12T17:31:56.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:56.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:56.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:56.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:31:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:31:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:31:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:31:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9555249048264848867 2024-09-12T17:31:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.1 2024-09-12T17:31:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T17:31:56.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.1_1 2024-09-12T17:31:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T17:31:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.2 2024-09-12T17:31:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T17:31:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.2_1 2024-09-12T17:31:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T17:31:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.3 2024-09-12T17:31:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T17:31:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:56.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.994+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9555249048264848867 2024-09-12T17:31:56.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.998+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:31:56.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.998+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd80feb80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.998+0000 7f1de54629c0 10 manifest: total_size = 11534336 2024-09-12T17:31:56.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.998+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to _jfwy7bZNf2wWjMxiydKQhwXVup9HH53 2024-09-12T17:31:56.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.998+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd80feb80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:56.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.998+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:56.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:56.998+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17.5 2024-09-12T17:31:57.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.006+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.006+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.006+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.006+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.006+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.006+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.006+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: _jfwy7bZNf2wWjMxiydKQhwXVup9HH53 2024-09-12T17:31:57.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.006+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.006+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.pywdbt2t-vfN0GzNFfSwGJ-XcnKPcad_0 2024-09-12T17:31:57.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.006+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:31:57.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.006+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.pywdbt2t-vfN0GzNFfSwGJ-XcnKPcad_1 2024-09-12T17:31:57.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.006+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T17:31:57.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.006+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.pywdbt2t-vfN0GzNFfSwGJ-XcnKPcad_2 2024-09-12T17:31:57.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.006+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T17:31:57.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.006+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.006+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _jfwy7bZNf2wWjMxiydKQhwXVup9HH53 2024-09-12T17:31:57.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.010+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:31:57.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.010+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd80abbb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.010+0000 7f1de54629c0 10 manifest: total_size = 11534336 2024-09-12T17:31:57.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.010+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to _6Cp19SFwLgrTgXJjNTLEhT95uQDd1Kb 2024-09-12T17:31:57.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.010+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd80abbb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.010+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.010+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17.5 2024-09-12T17:31:57.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: _6Cp19SFwLgrTgXJjNTLEhT95uQDd1Kb 2024-09-12T17:31:57.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.8xWqNDXH8r24Uuox-XNHwNZB4ussicd_0 2024-09-12T17:31:57.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:31:57.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.8xWqNDXH8r24Uuox-XNHwNZB4ussicd_1 2024-09-12T17:31:57.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T17:31:57.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.8xWqNDXH8r24Uuox-XNHwNZB4ussicd_2 2024-09-12T17:31:57.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T17:31:57.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _6Cp19SFwLgrTgXJjNTLEhT95uQDd1Kb 2024-09-12T17:31:57.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.018+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:31:57.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.022+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd4055490 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.022+0000 7f1de54629c0 10 manifest: total_size = 45360 2024-09-12T17:31:57.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.022+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5604725477027928390 2024-09-12T17:31:57.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.022+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd4055490 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.022+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.022+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17.5 2024-09-12T17:31:57.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:31:57.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-12T17:31:57.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T17:31:57.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:31:57.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-12T17:31:57.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-12T17:31:57.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-12T17:31:57.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2024-09-12T17:31:57.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-12T17:31:57.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5604725477027928390 2024-09-12T17:31:57.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-STANDARD.2~B2dC-mdSBfQtqUfRQPYLAC99mRrHXTB.1 2024-09-12T17:31:57.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T17:31:57.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-STANDARD.2~B2dC-mdSBfQtqUfRQPYLAC99mRrHXTB.2 2024-09-12T17:31:57.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T17:31:57.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-STANDARD.2~B2dC-mdSBfQtqUfRQPYLAC99mRrHXTB.3 2024-09-12T17:31:57.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T17:31:57.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.026+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5604725477027928390 2024-09-12T17:31:57.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.030+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:31:57.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.030+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd80abbb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.030+0000 7f1de54629c0 10 manifest: total_size = 11534336 2024-09-12T17:31:57.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.030+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to _tL-owelgoVc3T1qAvGXru3fPf8lKO-k 2024-09-12T17:31:57.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.030+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd80abbb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.030+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.030+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17.7 2024-09-12T17:31:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.038+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.038+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.038+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.038+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.038+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.038+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.038+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: _tL-owelgoVc3T1qAvGXru3fPf8lKO-k 2024-09-12T17:31:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.038+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.038+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_._b9nMRh_hMlOQyxxOJoVChP2kaENDtf_0 2024-09-12T17:31:57.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.038+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:31:57.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.038+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_._b9nMRh_hMlOQyxxOJoVChP2kaENDtf_1 2024-09-12T17:31:57.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.038+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:31:57.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.038+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_._b9nMRh_hMlOQyxxOJoVChP2kaENDtf_2 2024-09-12T17:31:57.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.038+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T17:31:57.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.038+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.038+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _tL-owelgoVc3T1qAvGXru3fPf8lKO-k 2024-09-12T17:31:57.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.042+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:31:57.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.042+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc064340 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.042+0000 7f1de54629c0 10 manifest: total_size = 11534336 2024-09-12T17:31:57.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.042+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6545071648289882598 2024-09-12T17:31:57.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.042+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc064340 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.042+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.042+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17.7 2024-09-12T17:31:57.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:57.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:57.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:57.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:31:57.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:31:57.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:31:57.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:31:57.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6545071648289882598 2024-09-12T17:31:57.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.1 2024-09-12T17:31:57.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T17:31:57.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.1_1 2024-09-12T17:31:57.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T17:31:57.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.2 2024-09-12T17:31:57.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T17:31:57.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.2_1 2024-09-12T17:31:57.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T17:31:57.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.3 2024-09-12T17:31:57.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T17:31:57.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6545071648289882598 2024-09-12T17:31:57.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.050+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:31:57.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.054+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd80abbb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.054+0000 7f1de54629c0 10 manifest: total_size = 45360 2024-09-12T17:31:57.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.054+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17778293772344010913 2024-09-12T17:31:57.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.054+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd80abbb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.054+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.054+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17.7 2024-09-12T17:31:57.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:31:57.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-12T17:31:57.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T17:31:57.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:31:57.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-12T17:31:57.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-12T17:31:57.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-12T17:31:57.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2024-09-12T17:31:57.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-12T17:31:57.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17778293772344010913 2024-09-12T17:31:57.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-STANDARD.2~B2dC-mdSBfQtqUfRQPYLAC99mRrHXTB.1 2024-09-12T17:31:57.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T17:31:57.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-STANDARD.2~B2dC-mdSBfQtqUfRQPYLAC99mRrHXTB.2 2024-09-12T17:31:57.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T17:31:57.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-STANDARD.2~B2dC-mdSBfQtqUfRQPYLAC99mRrHXTB.3 2024-09-12T17:31:57.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T17:31:57.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17778293772344010913 2024-09-12T17:31:57.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.062+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:31:57.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.066+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd80feb80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.066+0000 7f1de54629c0 10 manifest: total_size = 11534336 2024-09-12T17:31:57.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.066+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7571909418216920418 2024-09-12T17:31:57.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.066+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd80feb80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.066+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.066+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17.8 2024-09-12T17:31:57.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:57.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:57.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:57.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:31:57.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:31:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:31:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:31:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7571909418216920418 2024-09-12T17:31:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.1 2024-09-12T17:31:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T17:31:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.1_1 2024-09-12T17:31:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T17:31:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.2 2024-09-12T17:31:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T17:31:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.2_1 2024-09-12T17:31:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T17:31:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.3 2024-09-12T17:31:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T17:31:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.070+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7571909418216920418 2024-09-12T17:31:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.074+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:31:57.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.074+0000 7f1de54629c0 20 get_obj_state: octx=0x56296a021fb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.074+0000 7f1de54629c0 10 manifest: total_size = 45360 2024-09-12T17:31:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.074+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to _c4EzlECL1f7ZGRGrd2eZ9U40XlLAWi2 2024-09-12T17:31:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.074+0000 7f1de54629c0 20 get_obj_state: octx=0x56296a021fb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.074+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.074+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17.8 2024-09-12T17:31:57.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.082+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.082+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.082+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: _c4EzlECL1f7ZGRGrd2eZ9U40XlLAWi2 2024-09-12T17:31:57.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.082+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.082+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.RrbK3B5JST8i2J4_NLQ93fLRe5WxF4v_0 2024-09-12T17:31:57.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.082+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:31:57.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.082+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.082+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _c4EzlECL1f7ZGRGrd2eZ9U40XlLAWi2 2024-09-12T17:31:57.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.086+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:31:57.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.086+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd80abbb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.086+0000 7f1de54629c0 10 manifest: total_size = 11534336 2024-09-12T17:31:57.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.086+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16693570649545422106 2024-09-12T17:31:57.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.086+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd80abbb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.086+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.086+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17.9 2024-09-12T17:31:57.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:57.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:57.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:57.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:31:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:31:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:31:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:31:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16693570649545422106 2024-09-12T17:31:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.1 2024-09-12T17:31:57.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T17:31:57.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.1_1 2024-09-12T17:31:57.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-12T17:31:57.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.2 2024-09-12T17:31:57.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-12T17:31:57.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.2_1 2024-09-12T17:31:57.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-12T17:31:57.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.3 2024-09-12T17:31:57.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-12T17:31:57.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.090+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16693570649545422106 2024-09-12T17:31:57.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.094+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:31:57.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.094+0000 7f1de54629c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:31:57.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.094+0000 7f1de54629c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:31:57.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.098+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:31:57.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.098+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:31:57.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.098+0000 7f1de54629c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:31:57.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.098+0000 7f1de54629c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:31:57.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.098+0000 7f1de54629c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17])"; uploads.size()=0; is_truncated=0 2024-09-12T17:31:57.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.102+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T17:31:57.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.102+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.102+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T17:31:57.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.102+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T17:31:57.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.102+0000 7f1de54629c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T17:31:57.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.106+0000 7f1de54629c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T17:31:57.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.106+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T17:31:57.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.106+0000 7f1cc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398910 cookie 94735871458832 notifier 5732 bl.length()=199 2024-09-12T17:31:57.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.114+0000 7f1de54629c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17 from cache 2024-09-12T17:31:57.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.114+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17, ofs0, ns] 2024-09-12T17:31:57.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.114+0000 7f1cc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398875 cookie 94735871468176 notifier 5732 bl.length()=257 2024-09-12T17:31:57.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.122+0000 7f1de54629c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17 : miss 2024-09-12T17:31:57.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.122+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.122+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.122+0000 7f1de54629c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17 info.flags=0x0 2024-09-12T17:31:57.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.122+0000 7f1de54629c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17 to cache LRU end 2024-09-12T17:31:57.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.126+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15 : miss 2024-09-12T17:31:57.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.126+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.126+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:31:57.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.126+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15 info.flags=0x17 2024-09-12T17:31:57.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.126+0000 7f1de54629c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15 to cache LRU end 2024-09-12T17:31:57.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.126+0000 7f1de54629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:57.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.126+0000 7f1de54629c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:31:57.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.126+0000 7f1de54629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15 2024-09-12T17:31:57.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.130+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:31:57.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.134+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:31:57.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.134+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:31:57.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.138+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa7c30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.138+0000 7f1de54629c0 10 manifest: total_size = 11534336 2024-09-12T17:31:57.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.138+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18044038350532231209 2024-09-12T17:31:57.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.138+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa7c30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.138+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.138+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15.3 2024-09-12T17:31:57.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:57.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:57.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:57.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:31:57.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:31:57.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:31:57.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:31:57.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18044038350532231209 2024-09-12T17:31:57.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-FROZEN.2~jQdl0gSfec2B7tWsLreqHQFvZObY7wp.1 2024-09-12T17:31:57.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T17:31:57.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__shadow_foo-FROZEN.2~jQdl0gSfec2B7tWsLreqHQFvZObY7wp.1_1 2024-09-12T17:31:57.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-12T17:31:57.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-FROZEN.2~jQdl0gSfec2B7tWsLreqHQFvZObY7wp.2 2024-09-12T17:31:57.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-12T17:31:57.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__shadow_foo-FROZEN.2~jQdl0gSfec2B7tWsLreqHQFvZObY7wp.2_1 2024-09-12T17:31:57.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-12T17:31:57.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-FROZEN.2~jQdl0gSfec2B7tWsLreqHQFvZObY7wp.3 2024-09-12T17:31:57.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-12T17:31:57.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.142+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18044038350532231209 2024-09-12T17:31:57.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.146+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:31:57.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.146+0000 7f1de54629c0 20 get_obj_state: octx=0x562969f09c30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.146+0000 7f1de54629c0 10 manifest: total_size = 541681 2024-09-12T17:31:57.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.146+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3657166848837433462 2024-09-12T17:31:57.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.146+0000 7f1de54629c0 20 get_obj_state: octx=0x562969f09c30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.146+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.146+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15.5 2024-09-12T17:31:57.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T17:31:57.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T17:31:57.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T17:31:57.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T17:31:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T17:31:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-12T17:31:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-12T17:31:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2024-09-12T17:31:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-12T17:31:57.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3657166848837433462 2024-09-12T17:31:57.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-STANDARD.2~lXEFAOCJBpkgeBX5l5OdrMzxXuVsXnQ.1 2024-09-12T17:31:57.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T17:31:57.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-STANDARD.2~lXEFAOCJBpkgeBX5l5OdrMzxXuVsXnQ.2 2024-09-12T17:31:57.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T17:31:57.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-STANDARD.2~lXEFAOCJBpkgeBX5l5OdrMzxXuVsXnQ.3 2024-09-12T17:31:57.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T17:31:57.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.154+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3657166848837433462 2024-09-12T17:31:57.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.158+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:31:57.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.158+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd4055490 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.158+0000 7f1de54629c0 10 manifest: total_size = 11534336 2024-09-12T17:31:57.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.158+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9136144736747085220 2024-09-12T17:31:57.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.158+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1dd4055490 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.158+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.158+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15.7 2024-09-12T17:31:57.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:57.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:57.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:31:57.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:31:57.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:31:57.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:31:57.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:31:57.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:31:57.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:31:57.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9136144736747085220 2024-09-12T17:31:57.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-LUKEWARM.2~Pg9lo4FJ3x1wYydZCd1h7k8iH2uDWKu.1 2024-09-12T17:31:57.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T17:31:57.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__shadow_foo-LUKEWARM.2~Pg9lo4FJ3x1wYydZCd1h7k8iH2uDWKu.1_1 2024-09-12T17:31:57.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T17:31:57.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-LUKEWARM.2~Pg9lo4FJ3x1wYydZCd1h7k8iH2uDWKu.2 2024-09-12T17:31:57.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T17:31:57.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__shadow_foo-LUKEWARM.2~Pg9lo4FJ3x1wYydZCd1h7k8iH2uDWKu.2_1 2024-09-12T17:31:57.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T17:31:57.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-LUKEWARM.2~Pg9lo4FJ3x1wYydZCd1h7k8iH2uDWKu.3 2024-09-12T17:31:57.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T17:31:57.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.162+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9136144736747085220 2024-09-12T17:31:57.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.166+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:31:57.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.166+0000 7f1de54629c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:31:57.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.166+0000 7f1de54629c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:31:57.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.170+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:31:57.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.170+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:31:57.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.170+0000 7f1de54629c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:31:57.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.170+0000 7f1de54629c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:31:57.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.170+0000 7f1de54629c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15])"; uploads.size()=0; is_truncated=0 2024-09-12T17:31:57.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.174+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T17:31:57.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.174+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.174+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T17:31:57.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.174+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T17:31:57.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.174+0000 7f1de54629c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T17:31:57.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.178+0000 7f1de54629c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T17:31:57.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.178+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T17:31:57.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.178+0000 7f1cc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398876 cookie 94735871464576 notifier 5732 bl.length()=194 2024-09-12T17:31:57.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.186+0000 7f1de54629c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15 from cache 2024-09-12T17:31:57.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.186+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15, ofs0, ns] 2024-09-12T17:31:57.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.186+0000 7f1cc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398877 cookie 94735871468176 notifier 5732 bl.length()=252 2024-09-12T17:31:57.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.194+0000 7f1de54629c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15 : miss 2024-09-12T17:31:57.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.194+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.194+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.194+0000 7f1de54629c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15 info.flags=0x0 2024-09-12T17:31:57.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.194+0000 7f1de54629c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15 to cache LRU end 2024-09-12T17:31:57.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.198+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14 : miss 2024-09-12T17:31:57.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.198+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.202+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T17:31:57.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.202+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14 info.flags=0x17 2024-09-12T17:31:57.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.202+0000 7f1de54629c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14 to cache LRU end 2024-09-12T17:31:57.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.202+0000 7f1de54629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:57.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.202+0000 7f1de54629c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:31:57.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.202+0000 7f1de54629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14 2024-09-12T17:31:57.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.206+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:31:57.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.206+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:31:57.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.206+0000 7f1de54629c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:31:57.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.210+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fb7b60 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.210+0000 7f1de54629c0 10 manifest: total_size = 10485760 2024-09-12T17:31:57.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.210+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8253704328200987311 2024-09-12T17:31:57.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.210+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fb7b60 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.210+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.210+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14.3 2024-09-12T17:31:57.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.218+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.218+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.218+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.218+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.218+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.218+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.218+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8253704328200987311 2024-09-12T17:31:57.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.218+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.218+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14__shadow_.Vnamf1OhbYNOE4-xePdD5OSEY79ckQH_0 2024-09-12T17:31:57.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.218+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T17:31:57.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.218+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14__shadow_.Vnamf1OhbYNOE4-xePdD5OSEY79ckQH_1 2024-09-12T17:31:57.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.218+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T17:31:57.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.218+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14__shadow_.Vnamf1OhbYNOE4-xePdD5OSEY79ckQH_2 2024-09-12T17:31:57.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.218+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 811 2024-09-12T17:31:57.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.218+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.218+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8253704328200987311 2024-09-12T17:31:57.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.222+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:31:57.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.222+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc064340 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.222+0000 7f1de54629c0 10 manifest: total_size = 649292 2024-09-12T17:31:57.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.222+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8733849924896191556 2024-09-12T17:31:57.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.222+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc064340 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.222+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.222+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14.5 2024-09-12T17:31:57.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.226+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.226+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=649292 stripe_ofs=649292 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.226+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8733849924896191556 2024-09-12T17:31:57.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.226+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.226+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14__shadow_.DprmY0pGl61QKCAwkVW9orwxNN9a9f0_0 2024-09-12T17:31:57.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.226+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T17:31:57.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.226+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.226+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8733849924896191556 2024-09-12T17:31:57.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.230+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:31:57.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.230+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc089f50 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.234+0000 7f1de54629c0 10 manifest: total_size = 10485760 2024-09-12T17:31:57.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.234+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6361960372815130445 2024-09-12T17:31:57.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.234+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc089f50 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.234+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.234+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14.7 2024-09-12T17:31:57.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.238+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.238+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.238+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.238+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.238+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.238+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.238+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6361960372815130445 2024-09-12T17:31:57.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.238+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.238+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14__shadow_.gclBoRI-xKUBe-DwEMdlOhb5EQQjMsJ_0 2024-09-12T17:31:57.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.238+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T17:31:57.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.238+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14__shadow_.gclBoRI-xKUBe-DwEMdlOhb5EQQjMsJ_1 2024-09-12T17:31:57.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.238+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T17:31:57.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.238+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14__shadow_.gclBoRI-xKUBe-DwEMdlOhb5EQQjMsJ_2 2024-09-12T17:31:57.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.238+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 817 2024-09-12T17:31:57.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.238+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.238+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6361960372815130445 2024-09-12T17:31:57.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.242+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:31:57.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.242+0000 7f1de54629c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:31:57.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.242+0000 7f1de54629c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:31:57.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.242+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:31:57.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.242+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:31:57.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.242+0000 7f1de54629c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:31:57.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.242+0000 7f1de54629c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:31:57.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.242+0000 7f1de54629c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14])"; uploads.size()=0; is_truncated=0 2024-09-12T17:31:57.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.246+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T17:31:57.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.246+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.250+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T17:31:57.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.250+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T17:31:57.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.250+0000 7f1de54629c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T17:31:57.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.250+0000 7f1de54629c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T17:31:57.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.250+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T17:31:57.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.250+0000 7f1cc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398877 cookie 94735871454512 notifier 5732 bl.length()=184 2024-09-12T17:31:57.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.258+0000 7f1de54629c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14 from cache 2024-09-12T17:31:57.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.258+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14, ofs0, ns] 2024-09-12T17:31:57.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.258+0000 7f1cc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398878 cookie 94735871464576 notifier 5732 bl.length()=242 2024-09-12T17:31:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.270+0000 7f1de54629c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14 : miss 2024-09-12T17:31:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.270+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.270+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.270+0000 7f1de54629c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14 info.flags=0x0 2024-09-12T17:31:57.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.270+0000 7f1de54629c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14 to cache LRU end 2024-09-12T17:31:57.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.274+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7 : miss 2024-09-12T17:31:57.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.274+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.274+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:31:57.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.274+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7 info.flags=0x17 2024-09-12T17:31:57.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.274+0000 7f1de54629c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7 to cache LRU end 2024-09-12T17:31:57.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.274+0000 7f1de54629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:57.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.274+0000 7f1de54629c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:31:57.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.274+0000 7f1de54629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7 2024-09-12T17:31:57.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.278+0000 7f1de54629c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:31:57.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.278+0000 7f1de54629c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:31:57.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.282+0000 7f1de54629c0 10 cls_bucket_list_unordered: got __ 2024-09-12T17:31:57.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.286+0000 7f1de54629c0 10 cls_bucket_list_unordered: got obj 2024-09-12T17:31:57.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.286+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fb6430 obj=test-client.0-r-test-small-obj-data.1:___ state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.286+0000 7f1de54629c0 10 manifest: total_size = 0 2024-09-12T17:31:57.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.286+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2999315495155552191 2024-09-12T17:31:57.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.286+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fb6430 obj=test-client.0-r-test-small-obj-data.1:___ state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.286+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.286+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7.2 2024-09-12T17:31:57.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.294+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fb6430 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.294+0000 7f1de54629c0 10 manifest: total_size = 0 2024-09-12T17:31:57.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.294+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4477304002154786298 2024-09-12T17:31:57.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.294+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fb6430 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.294+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.294+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7.3 2024-09-12T17:31:57.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.298+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:31:57.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.302+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fb6430 obj=test-client.0-r-test-small-obj-data.1:__ state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.302+0000 7f1de54629c0 10 manifest: total_size = 0 2024-09-12T17:31:57.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.302+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9124158282577888204 2024-09-12T17:31:57.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.302+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fb6430 obj=test-client.0-r-test-small-obj-data.1:__ state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.302+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.302+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7.6 2024-09-12T17:31:57.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.306+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:31:57.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.310+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc089bd0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.310+0000 7f1de54629c0 10 manifest: total_size = 0 2024-09-12T17:31:57.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.310+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.296951378310489485 2024-09-12T17:31:57.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.310+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc089bd0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x562969f08ed8 s->prefetch_data=0 2024-09-12T17:31:57.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.310+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969f08ed8 2024-09-12T17:31:57.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.310+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7.8 2024-09-12T17:31:57.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.314+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:31:57.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.318+0000 7f1de54629c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:31:57.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.318+0000 7f1de54629c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:31:57.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.322+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:31:57.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.322+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:31:57.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.322+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:31:57.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.322+0000 7f1de54629c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:31:57.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.322+0000 7f1de54629c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:31:57.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.322+0000 7f1de54629c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7])"; uploads.size()=0; is_truncated=0 2024-09-12T17:31:57.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.326+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T17:31:57.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.326+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.326+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:31:57.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.326+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T17:31:57.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.326+0000 7f1de54629c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T17:31:57.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.330+0000 7f1de54629c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T17:31:57.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.330+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T17:31:57.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.330+0000 7f1cc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398901 cookie 94735871423312 notifier 5732 bl.length()=181 2024-09-12T17:31:57.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.338+0000 7f1de54629c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7 from cache 2024-09-12T17:31:57.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.338+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7, ofs0, ns] 2024-09-12T17:31:57.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.338+0000 7f1cc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398879 cookie 94735871464576 notifier 5732 bl.length()=238 2024-09-12T17:31:57.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.346+0000 7f1de54629c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7 : miss 2024-09-12T17:31:57.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.346+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.346+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.346+0000 7f1de54629c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7 info.flags=0x0 2024-09-12T17:31:57.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.346+0000 7f1de54629c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7 to cache LRU end 2024-09-12T17:31:57.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.354+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8 : miss 2024-09-12T17:31:57.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.354+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.354+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:31:57.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.354+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8 info.flags=0x17 2024-09-12T17:31:57.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.354+0000 7f1de54629c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8 to cache LRU end 2024-09-12T17:31:57.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.354+0000 7f1de54629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:57.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.354+0000 7f1de54629c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:31:57.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.354+0000 7f1de54629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8 2024-09-12T17:31:57.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.354+0000 7f1de54629c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:31:57.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.358+0000 7f1de54629c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:31:57.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.358+0000 7f1de54629c0 10 cls_bucket_list_unordered: got __ 2024-09-12T17:31:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.362+0000 7f1de54629c0 10 cls_bucket_list_unordered: got obj 2024-09-12T17:31:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.362+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc089f50 obj=test-client.0-r-test-small-obj-data.2:___ state=0x562969fd0a18 s->prefetch_data=0 2024-09-12T17:31:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.366+0000 7f1de54629c0 10 manifest: total_size = 24595 2024-09-12T17:31:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.366+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16946559474477116778 2024-09-12T17:31:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.366+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc089f50 obj=test-client.0-r-test-small-obj-data.2:___ state=0x562969fd0a18 s->prefetch_data=0 2024-09-12T17:31:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.366+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fd0a18 2024-09-12T17:31:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.366+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8.2 2024-09-12T17:31:57.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.370+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.370+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.370+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16946559474477116778 2024-09-12T17:31:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.370+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.370+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8__shadow_.ij7i3IFV5P5Z9w2p9WFd11JFgqDUgub_0 2024-09-12T17:31:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.370+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:31:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.370+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.370+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16946559474477116778 2024-09-12T17:31:57.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.374+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc089f50 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x562969fd0a18 s->prefetch_data=0 2024-09-12T17:31:57.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.374+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:31:57.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.374+0000 7f1de54629c0 10 manifest: total_size = 527 2024-09-12T17:31:57.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.374+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7099280287857698429 2024-09-12T17:31:57.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.374+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc089f50 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x562969fd0a18 s->prefetch_data=0 2024-09-12T17:31:57.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.374+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fd0a18 2024-09-12T17:31:57.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.374+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8.3 2024-09-12T17:31:57.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.382+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.382+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.382+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7099280287857698429 2024-09-12T17:31:57.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.382+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.382+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8__shadow_.2eH1YXnQsaU-MWyiWHvEKVamIJjghpZ_0 2024-09-12T17:31:57.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.382+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:31:57.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.382+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.382+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7099280287857698429 2024-09-12T17:31:57.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.386+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc089bd0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x562969fd0a18 s->prefetch_data=0 2024-09-12T17:31:57.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.386+0000 7f1de54629c0 10 manifest: total_size = 24595 2024-09-12T17:31:57.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.386+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1794682688058021129 2024-09-12T17:31:57.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.386+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc089bd0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x562969fd0a18 s->prefetch_data=0 2024-09-12T17:31:57.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.386+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fd0a18 2024-09-12T17:31:57.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.386+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8.6 2024-09-12T17:31:57.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.386+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:31:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.394+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.394+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.394+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1794682688058021129 2024-09-12T17:31:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.394+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.394+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8__shadow_.Lt7_gIiwDZ0UpuqXSIjABqqOTvxXZwW_0 2024-09-12T17:31:57.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.394+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:31:57.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.394+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.394+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1794682688058021129 2024-09-12T17:31:57.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.398+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:31:57.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.398+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc089bd0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x562969fd0a18 s->prefetch_data=0 2024-09-12T17:31:57.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.398+0000 7f1de54629c0 10 manifest: total_size = 2078 2024-09-12T17:31:57.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.398+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2098507457251307049 2024-09-12T17:31:57.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.398+0000 7f1de54629c0 20 get_obj_state: octx=0x7f1ddc089bd0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x562969fd0a18 s->prefetch_data=0 2024-09-12T17:31:57.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.398+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fd0a18 2024-09-12T17:31:57.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.398+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8.8 2024-09-12T17:31:57.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.406+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.406+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.406+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2098507457251307049 2024-09-12T17:31:57.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.406+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.406+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8__shadow_.4W9yTA51XNnE0k4ttQlvnhW1VfdhuXl_0 2024-09-12T17:31:57.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.406+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:31:57.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.406+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.406+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2098507457251307049 2024-09-12T17:31:57.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.410+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:31:57.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.410+0000 7f1de54629c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:31:57.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.410+0000 7f1de54629c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:31:57.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.410+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:31:57.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.410+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:31:57.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.410+0000 7f1de54629c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:31:57.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.410+0000 7f1de54629c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:31:57.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.410+0000 7f1de54629c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8])"; uploads.size()=0; is_truncated=0 2024-09-12T17:31:57.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.414+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T17:31:57.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.414+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.414+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:31:57.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.414+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T17:31:57.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.414+0000 7f1de54629c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T17:31:57.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.418+0000 7f1de54629c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T17:31:57.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.418+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T17:31:57.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.418+0000 7f1cc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398902 cookie 94735871423312 notifier 5732 bl.length()=181 2024-09-12T17:31:57.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.426+0000 7f1de54629c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8 from cache 2024-09-12T17:31:57.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.426+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8, ofs0, ns] 2024-09-12T17:31:57.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.426+0000 7f1cc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398880 cookie 94735871464576 notifier 5732 bl.length()=238 2024-09-12T17:31:57.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.438+0000 7f1de54629c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8 : miss 2024-09-12T17:31:57.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.438+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.438+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.438+0000 7f1de54629c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8 info.flags=0x0 2024-09-12T17:31:57.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.438+0000 7f1de54629c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8 to cache LRU end 2024-09-12T17:31:57.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.442+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9 : miss 2024-09-12T17:31:57.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.442+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.442+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:31:57.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.442+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9 info.flags=0x17 2024-09-12T17:31:57.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.442+0000 7f1de54629c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9 to cache LRU end 2024-09-12T17:31:57.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.442+0000 7f1de54629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:57.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.442+0000 7f1de54629c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:31:57.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.442+0000 7f1de54629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9 2024-09-12T17:31:57.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.446+0000 7f1de54629c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:31:57.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.446+0000 7f1de54629c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:31:57.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.450+0000 7f1de54629c0 10 cls_bucket_list_unordered: got __ 2024-09-12T17:31:57.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.450+0000 7f1de54629c0 10 cls_bucket_list_unordered: got obj 2024-09-12T17:31:57.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.454+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fb7570 obj=test-client.0-r-test-small-obj-data.3:___ state=0x562969fa63a8 s->prefetch_data=0 2024-09-12T17:31:57.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.454+0000 7f1de54629c0 10 manifest: total_size = 1035 2024-09-12T17:31:57.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.454+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4750437457234591568 2024-09-12T17:31:57.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.454+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fb7570 obj=test-client.0-r-test-small-obj-data.3:___ state=0x562969fa63a8 s->prefetch_data=0 2024-09-12T17:31:57.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.454+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fa63a8 2024-09-12T17:31:57.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.454+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9.2 2024-09-12T17:31:57.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.462+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.462+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.462+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4750437457234591568 2024-09-12T17:31:57.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.462+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.462+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9__shadow_.WNvGLOO3xuFofp5XH2YpVuriNIUbb13_0 2024-09-12T17:31:57.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.462+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:31:57.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.462+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.462+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4750437457234591568 2024-09-12T17:31:57.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.466+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:31:57.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.466+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa98a0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x562969fa63a8 s->prefetch_data=0 2024-09-12T17:31:57.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.466+0000 7f1de54629c0 10 manifest: total_size = 1048576 2024-09-12T17:31:57.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.466+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14551332519571767437 2024-09-12T17:31:57.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.466+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa98a0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x562969fa63a8 s->prefetch_data=0 2024-09-12T17:31:57.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.466+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fa63a8 2024-09-12T17:31:57.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.466+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9.3 2024-09-12T17:31:57.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.474+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.474+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.474+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14551332519571767437 2024-09-12T17:31:57.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.474+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.474+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9__shadow_.3rYr6UhzczU2rQaEAzppwUEyWcFN7to_0 2024-09-12T17:31:57.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.474+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:31:57.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.474+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.474+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14551332519571767437 2024-09-12T17:31:57.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.478+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:31:57.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.478+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa98a0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x562969fa63a8 s->prefetch_data=0 2024-09-12T17:31:57.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.478+0000 7f1de54629c0 10 manifest: total_size = 1048576 2024-09-12T17:31:57.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.478+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8502928286335774732 2024-09-12T17:31:57.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.478+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa98a0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x562969fa63a8 s->prefetch_data=0 2024-09-12T17:31:57.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.478+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fa63a8 2024-09-12T17:31:57.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.478+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9.6 2024-09-12T17:31:57.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.486+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.486+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.486+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8502928286335774732 2024-09-12T17:31:57.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.486+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.486+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9__shadow_.Bfg8OJ5q6Hfg7MT1LXzquwJ1ezbq923_0 2024-09-12T17:31:57.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.486+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:31:57.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.486+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.486+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8502928286335774732 2024-09-12T17:31:57.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.486+0000 7f1cc67fc640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:31:57.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.486+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa98a0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x562969fa63a8 s->prefetch_data=0 2024-09-12T17:31:57.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.490+0000 7f1de54629c0 10 manifest: total_size = 55 2024-09-12T17:31:57.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.490+0000 7f1de54629c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16158128735114956740 2024-09-12T17:31:57.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.490+0000 7f1de54629c0 20 get_obj_state: octx=0x562969fa98a0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x562969fa63a8 s->prefetch_data=0 2024-09-12T17:31:57.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.490+0000 7f1de54629c0 20 prepare_atomic_modification: state is not atomic. state=0x562969fa63a8 2024-09-12T17:31:57.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.490+0000 7f1de54629c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9.8 2024-09-12T17:31:57.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.494+0000 7f1de54629c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:31:57.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.494+0000 7f1de54629c0 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-12T17:31:57.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.494+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16158128735114956740 2024-09-12T17:31:57.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.494+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:31:57.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.494+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9__shadow_.eXUW0MQ863npMYu2SK85mT6-8O2ze0O_0 2024-09-12T17:31:57.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.494+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:31:57.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.494+0000 7f1de54629c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:31:57.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.494+0000 7f1de54629c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16158128735114956740 2024-09-12T17:31:57.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.498+0000 7f1cc5ffb640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:31:57.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.498+0000 7f1de54629c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:31:57.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.498+0000 7f1de54629c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:31:57.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.502+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:31:57.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.502+0000 7f1de54629c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:31:57.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.502+0000 7f1de54629c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:31:57.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.502+0000 7f1de54629c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:31:57.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.502+0000 7f1de54629c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9])"; uploads.size()=0; is_truncated=0 2024-09-12T17:31:57.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.506+0000 7f1de54629c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T17:31:57.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.506+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.506+0000 7f1de54629c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:31:57.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.506+0000 7f1de54629c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T17:31:57.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.506+0000 7f1de54629c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T17:31:57.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.510+0000 7f1de54629c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T17:31:57.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.510+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T17:31:57.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.510+0000 7f1cc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398903 cookie 94735871423312 notifier 5732 bl.length()=181 2024-09-12T17:31:57.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.518+0000 7f1de54629c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9 from cache 2024-09-12T17:31:57.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.518+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9, ofs0, ns] 2024-09-12T17:31:57.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.518+0000 7f1cc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398881 cookie 94735871464576 notifier 5732 bl.length()=238 2024-09-12T17:31:57.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.526+0000 7f1de54629c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9 : miss 2024-09-12T17:31:57.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.526+0000 7f1de54629c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.526+0000 7f1de54629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.526+0000 7f1de54629c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9 info.flags=0x0 2024-09-12T17:31:57.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.526+0000 7f1de54629c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9 to cache LRU end 2024-09-12T17:31:57.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.534+0000 7f1de54629c0 10 removing key index: PCYTVXDHLABRRNQAZNOK 2024-09-12T17:31:57.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.534+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:PCYTVXDHLABRRNQAZNOK, ofs0, ns] 2024-09-12T17:31:57.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.534+0000 7f1cc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398879 cookie 94735871461168 notifier 5732 bl.length()=170 2024-09-12T17:31:57.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.538+0000 7f1de54629c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T17:31:57.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.542+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:31:57.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.542+0000 7f1cc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398878 cookie 94735871454512 notifier 5732 bl.length()=182 2024-09-12T17:31:57.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.546+0000 7f1de54629c0 10 removing user buckets index 2024-09-12T17:31:57.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.550+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T17:31:57.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.550+0000 7f1cc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398882 cookie 94735871464576 notifier 5732 bl.length()=173 2024-09-12T17:31:57.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.554+0000 7f1de54629c0 10 removing user index: ragweed.client.0 2024-09-12T17:31:57.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.554+0000 7f1de54629c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T17:31:57.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.554+0000 7f1de54629c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:31:57.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.558+0000 7f1cc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398880 cookie 94735871461168 notifier 5732 bl.length()=165 2024-09-12T17:31:57.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.566+0000 7f1c997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:57.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.570+0000 7f1de54629c0 20 remove_watcher() i=0 2024-09-12T17:31:57.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.570+0000 7f1de54629c0 2 removed watcher, disabling cache 2024-09-12T17:31:57.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.574+0000 7f1de54629c0 20 remove_watcher() i=1 2024-09-12T17:31:57.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.574+0000 7f1de54629c0 20 remove_watcher() i=2 2024-09-12T17:31:57.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.578+0000 7f1de54629c0 20 remove_watcher() i=3 2024-09-12T17:31:57.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.578+0000 7f1de54629c0 20 remove_watcher() i=4 2024-09-12T17:31:57.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.582+0000 7f1de54629c0 20 remove_watcher() i=5 2024-09-12T17:31:57.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.582+0000 7f1de54629c0 20 remove_watcher() i=6 2024-09-12T17:31:57.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.586+0000 7f1de54629c0 20 remove_watcher() i=7 2024-09-12T17:31:57.599 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T17:31:57.677 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:57.677 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:31:57.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.722+0000 7fae428f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.726+0000 7fae428f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.726+0000 7fae428f99c0 20 realm 2024-09-12T17:31:57.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.726+0000 7fae428f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.726+0000 7fae428f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.726+0000 7fae428f99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:31:57.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.726+0000 7fae428f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.726+0000 7fae428f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.726+0000 7fae428f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.726+0000 7fae428f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:57.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.726+0000 7fae428f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.730+0000 7fae428f99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:31:57.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.730+0000 7fae428f99c0 20 searching for the correct realm 2024-09-12T17:31:57.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.734+0000 7fae40c00640 0 -- 172.21.15.119:0/64055491 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x562983625f00 msgr2=0x562983628310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:57.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.738+0000 7fae3fbfe640 0 -- 172.21.15.119:0/64055491 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fae380d8b30 msgr2=0x7fae380c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:57.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.954+0000 7fae428f99c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:31:57.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.954+0000 7fae428f99c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:31:57.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.954+0000 7fae428f99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:31:57.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.954+0000 7fae428f99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:31:57.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.954+0000 7fae428f99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:31:57.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.954+0000 7fae428f99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:31:57.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.954+0000 7fae428f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.954+0000 7fae428f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.954+0000 7fae428f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.954+0000 7fae428f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:57.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.954+0000 7fae428f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.958+0000 7fae428f99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:31:57.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.958+0000 7fae428f99c0 20 zone default found 2024-09-12T17:31:57.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.958+0000 7fae428f99c0 4 Realm: () 2024-09-12T17:31:57.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.958+0000 7fae428f99c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:31:57.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.958+0000 7fae428f99c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:31:57.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.958+0000 7fae428f99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:31:57.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.958+0000 7fae428f99c0 20 zonegroup default 2024-09-12T17:31:57.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.958+0000 7fae428f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.958+0000 7fae428f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.958+0000 7fae428f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.958+0000 7fae428f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.958+0000 7fae428f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.958+0000 7fae428f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.958+0000 7fae428f99c0 20 started sync module instance, tier type = 2024-09-12T17:31:57.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.958+0000 7fae428f99c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:31:57.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.982+0000 7fae428f99c0 20 add_watcher() i=0 2024-09-12T17:31:57.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.982+0000 7fae428f99c0 20 add_watcher() i=1 2024-09-12T17:31:57.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.982+0000 7fae428f99c0 20 add_watcher() i=2 2024-09-12T17:31:57.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.982+0000 7fae428f99c0 20 add_watcher() i=3 2024-09-12T17:31:57.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.982+0000 7fae428f99c0 20 add_watcher() i=4 2024-09-12T17:31:57.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.982+0000 7fae428f99c0 20 add_watcher() i=5 2024-09-12T17:31:57.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.982+0000 7fae428f99c0 20 add_watcher() i=6 2024-09-12T17:31:57.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.982+0000 7fae428f99c0 20 add_watcher() i=7 2024-09-12T17:31:57.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.982+0000 7fae428f99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:31:57.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.986+0000 7facf77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:57.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.990+0000 7fae428f99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:31:57.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:57.990+0000 7fae428f99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:31:58.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.078+0000 7facf67dc640 20 reqs_thread_entry: start 2024-09-12T17:31:58.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.078+0000 7fae428f99c0 20 init_complete bucket index max shards: 11 2024-09-12T17:31:58.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.078+0000 7fae428f99c0 20 Filter name: none 2024-09-12T17:31:58.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.078+0000 7facef7fe640 20 reqs_thread_entry: start 2024-09-12T17:31:58.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.078+0000 7fae428f99c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:31:58.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.078+0000 7fae428f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.078+0000 7fae428f99c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:31:58.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.078+0000 7fae428f99c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T17:31:58.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.078+0000 7fae428f99c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:31:58.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.078+0000 7fae428f99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:58.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.078+0000 7fae428f99c0 10 removing key index: UABWDDPHKOVINVEQHCNK 2024-09-12T17:31:58.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.082+0000 7fae428f99c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:UABWDDPHKOVINVEQHCNK, ofs0, ns] 2024-09-12T17:31:58.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.082+0000 7fad177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398904 cookie 94736297915808 notifier 5750 bl.length()=170 2024-09-12T17:31:58.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.086+0000 7fae428f99c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T17:31:58.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.090+0000 7fae428f99c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:31:58.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.090+0000 7fad177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398881 cookie 94736297953008 notifier 5750 bl.length()=182 2024-09-12T17:31:58.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.090+0000 7fae428f99c0 10 removing user buckets index 2024-09-12T17:31:58.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.094+0000 7fae428f99c0 10 removing user index: sysuser.client.0 2024-09-12T17:31:58.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.094+0000 7fae428f99c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T17:31:58.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.094+0000 7fae428f99c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:31:58.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.098+0000 7fad177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398879 cookie 94736297946960 notifier 5750 bl.length()=165 2024-09-12T17:31:58.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.098+0000 7facf77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:58.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.106+0000 7fae428f99c0 20 remove_watcher() i=0 2024-09-12T17:31:58.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.106+0000 7fae428f99c0 2 removed watcher, disabling cache 2024-09-12T17:31:58.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.106+0000 7fae428f99c0 20 remove_watcher() i=1 2024-09-12T17:31:58.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.110+0000 7fae428f99c0 20 remove_watcher() i=2 2024-09-12T17:31:58.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.110+0000 7fae428f99c0 20 remove_watcher() i=3 2024-09-12T17:31:58.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.114+0000 7fae428f99c0 20 remove_watcher() i=4 2024-09-12T17:31:58.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.114+0000 7fae428f99c0 20 remove_watcher() i=5 2024-09-12T17:31:58.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.118+0000 7fae428f99c0 20 remove_watcher() i=6 2024-09-12T17:31:58.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:31:58.118+0000 7fae428f99c0 20 remove_watcher() i=7 2024-09-12T17:31:58.132 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T17:31:58.132 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:31:58.220 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:31:58.231 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:31:58.231 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:31:58.231 DEBUG:teuthology.orchestra.run.smithi119:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:31:58.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:31:58.237 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:31:58.237 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:31:58.286 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:31:58.286 DEBUG:teuthology.orchestra.run.smithi119:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:31:58.334 INFO:tasks.workunit:timeout=3h 2024-09-12T17:31:58.334 INFO:tasks.workunit:cleanup=True 2024-09-12T17:31:58.335 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:31:58.383 INFO:tasks.workunit.client.0.smithi119.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:32:55.630 INFO:tasks.workunit.client.0.smithi119.stderr:Updating files: 97% (12385/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:32:56.414 INFO:tasks.workunit.client.0.smithi119.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:32:56.414 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:32:56.415 INFO:tasks.workunit.client.0.smithi119.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:32:56.415 INFO:tasks.workunit.client.0.smithi119.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:32:56.415 INFO:tasks.workunit.client.0.smithi119.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:32:56.415 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:32:56.415 INFO:tasks.workunit.client.0.smithi119.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:32:56.415 INFO:tasks.workunit.client.0.smithi119.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:32:56.415 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:32:56.415 INFO:tasks.workunit.client.0.smithi119.stderr: git switch -c 2024-09-12T17:32:56.416 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:32:56.416 INFO:tasks.workunit.client.0.smithi119.stderr:Or undo this operation with: 2024-09-12T17:32:56.416 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:32:56.416 INFO:tasks.workunit.client.0.smithi119.stderr: git switch - 2024-09-12T17:32:56.416 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:32:56.416 INFO:tasks.workunit.client.0.smithi119.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:32:56.416 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:32:56.416 INFO:tasks.workunit.client.0.smithi119.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:32:56.423 DEBUG:teuthology.orchestra.run.smithi119:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:32:56.470 INFO:tasks.workunit.client.0.smithi119.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:32:56.474 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:32:56.474 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:32:56.529 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:32:56.582 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:32:56.620 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:32:56.621 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:32:56.621 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:32:56.661 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:32:56.664 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:32:56.664 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:32:56.721 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T17:32:56.724 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T17:32:56.724 DEBUG:teuthology.orchestra.run.smithi119:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:32:56.790 INFO:tasks.workunit.client.0.smithi119.stderr:+ ulimit -c 0 2024-09-12T17:32:56.790 INFO:tasks.workunit.client.0.smithi119.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:32:56.791 INFO:tasks.workunit.client.0.smithi119.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:32:56.791 INFO:tasks.workunit.client.0.smithi119.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:32:59.675 INFO:tasks.workunit.client.0.smithi119.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:32:59.675 INFO:tasks.workunit.client.0.smithi119.stderr:++ deactivate nondestructive 2024-09-12T17:32:59.675 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n '' ']' 2024-09-12T17:32:59.675 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n '' ']' 2024-09-12T17:32:59.676 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:32:59.676 INFO:tasks.workunit.client.0.smithi119.stderr:++ hash -r 2024-09-12T17:32:59.676 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n '' ']' 2024-09-12T17:32:59.676 INFO:tasks.workunit.client.0.smithi119.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:32:59.676 INFO:tasks.workunit.client.0.smithi119.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:32:59.676 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:32:59.676 INFO:tasks.workunit.client.0.smithi119.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:32:59.676 INFO:tasks.workunit.client.0.smithi119.stderr:++ export VIRTUAL_ENV 2024-09-12T17:32:59.676 INFO:tasks.workunit.client.0.smithi119.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:32:59.676 INFO:tasks.workunit.client.0.smithi119.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:32:59.676 INFO:tasks.workunit.client.0.smithi119.stderr:++ export PATH 2024-09-12T17:32:59.676 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n '' ']' 2024-09-12T17:32:59.676 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -z '' ']' 2024-09-12T17:32:59.677 INFO:tasks.workunit.client.0.smithi119.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:32:59.677 INFO:tasks.workunit.client.0.smithi119.stderr:++ PS1='(rgw) ' 2024-09-12T17:32:59.677 INFO:tasks.workunit.client.0.smithi119.stderr:++ export PS1 2024-09-12T17:32:59.677 INFO:tasks.workunit.client.0.smithi119.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T17:32:59.677 INFO:tasks.workunit.client.0.smithi119.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T17:32:59.677 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:32:59.677 INFO:tasks.workunit.client.0.smithi119.stderr:++ hash -r 2024-09-12T17:32:59.677 INFO:tasks.workunit.client.0.smithi119.stderr:+ pip install pip --upgrade 2024-09-12T17:33:00.072 INFO:tasks.workunit.client.0.smithi119.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T17:33:00.275 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting pip 2024-09-12T17:33:00.281 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:33:00.315 INFO:tasks.workunit.client.0.smithi119.stdout:Installing collected packages: pip 2024-09-12T17:33:00.315 INFO:tasks.workunit.client.0.smithi119.stdout: Attempting uninstall: pip 2024-09-12T17:33:00.315 INFO:tasks.workunit.client.0.smithi119.stdout: Found existing installation: pip 22.0.2 2024-09-12T17:33:00.576 INFO:tasks.workunit.client.0.smithi119.stdout: Uninstalling pip-22.0.2: 2024-09-12T17:33:00.582 INFO:tasks.workunit.client.0.smithi119.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T17:33:01.624 INFO:tasks.workunit.client.0.smithi119.stdout:Successfully installed pip-24.2 2024-09-12T17:33:01.695 INFO:tasks.workunit.client.0.smithi119.stderr:+ pip install boto3 2024-09-12T17:33:02.669 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting boto3 2024-09-12T17:33:02.671 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:33:03.176 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:33:03.177 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:33:03.241 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:33:03.242 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:33:03.288 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:33:03.290 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:33:03.342 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:33:03.344 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:33:03.465 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:33:03.467 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T17:33:03.610 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:33:03.611 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:33:03.616 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:33:03.617 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:33:03.628 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:33:03.628 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:33:03.630 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:33:03.630 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T17:33:03.631 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:33:03.697 INFO:tasks.workunit.client.0.smithi119.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:33:04.885 INFO:tasks.workunit.client.0.smithi119.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T17:33:05.106 INFO:tasks.workunit.client.0.smithi119.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T17:33:05.252 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T17:33:05.289 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:05.289 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:05.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.340+0000 7efd1199a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:05.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.340+0000 7efd1199a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:05.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.340+0000 7efd1199a9c0 20 realm 2024-09-12T17:33:05.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.340+0000 7efd1199a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:05.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.340+0000 7efd1199a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:05.336 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.340+0000 7efd1199a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:05.336 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.340+0000 7efd1199a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:05.336 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.340+0000 7efd1199a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:05.336 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.340+0000 7efd1199a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:05.337 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.340+0000 7efd1199a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:05.337 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.340+0000 7efd1199a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:05.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.344+0000 7efd1199a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:05.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.344+0000 7efd1199a9c0 20 searching for the correct realm 2024-09-12T17:33:05.342 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.348+0000 7efd0fca1640 0 -- 172.21.15.119:0/2476845249 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55c61f920270 msgr2=0x55c61f922660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:05.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.352+0000 7efd0ec9f640 0 -- 172.21.15.119:0/2476845249 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7efd080717f0 msgr2=0x7efd0806f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:05.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.568+0000 7efd1199a9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:05.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.568+0000 7efd1199a9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:05.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.568+0000 7efd1199a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:05.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.568+0000 7efd1199a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:05.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.568+0000 7efd1199a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:05.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.568+0000 7efd1199a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:05.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.568+0000 7efd1199a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:05.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.572+0000 7efd1199a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:05.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.572+0000 7efd1199a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:05.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.572+0000 7efd1199a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:05.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.572+0000 7efd1199a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:05.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.572+0000 7efd1199a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:05.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.572+0000 7efd1199a9c0 20 zone default found 2024-09-12T17:33:05.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.572+0000 7efd1199a9c0 4 Realm: () 2024-09-12T17:33:05.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.572+0000 7efd1199a9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:05.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.572+0000 7efd1199a9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:05.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.572+0000 7efd1199a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:05.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.572+0000 7efd1199a9c0 20 zonegroup default 2024-09-12T17:33:05.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.572+0000 7efd1199a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:05.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.572+0000 7efd1199a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:05.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.572+0000 7efd1199a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:05.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.576+0000 7efd1199a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:05.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.576+0000 7efd1199a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:05.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.576+0000 7efd1199a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:05.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.576+0000 7efd1199a9c0 20 started sync module instance, tier type = 2024-09-12T17:33:05.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.576+0000 7efd1199a9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:05.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.600+0000 7efd1199a9c0 20 add_watcher() i=0 2024-09-12T17:33:05.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.600+0000 7efd1199a9c0 20 add_watcher() i=1 2024-09-12T17:33:05.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.600+0000 7efd1199a9c0 20 add_watcher() i=2 2024-09-12T17:33:05.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.600+0000 7efd1199a9c0 20 add_watcher() i=3 2024-09-12T17:33:05.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.600+0000 7efd1199a9c0 20 add_watcher() i=4 2024-09-12T17:33:05.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.600+0000 7efd1199a9c0 20 add_watcher() i=5 2024-09-12T17:33:05.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.600+0000 7efd1199a9c0 20 add_watcher() i=6 2024-09-12T17:33:05.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.600+0000 7efd1199a9c0 20 add_watcher() i=7 2024-09-12T17:33:05.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.600+0000 7efd1199a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:05.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.604+0000 7efbc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:05.601 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:05.601 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:05.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 5 note: GC not initialized 2024-09-12T17:33:05.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efbc4fe1640 20 reqs_thread_entry: start 2024-09-12T17:33:05.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:05.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 20 Filter name: none 2024-09-12T17:33:05.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efb3e7fc640 20 reqs_thread_entry: start 2024-09-12T17:33:05.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T17:33:05.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:05.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:05.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T17:33:05.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T17:33:05.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T17:33:05.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:05.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 20 rados_obj.operate() r=0 bl.length=22 2024-09-12T17:33:05.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-12T17:33:05.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:33:05.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-12T17:33:05.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.608+0000 7efd1199a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:05.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.612+0000 7efd1199a9c0 20 rados_obj.operate() r=0 bl.length=420 2024-09-12T17:33:05.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.612+0000 7efd1199a9c0 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-12T17:33:05.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.612+0000 7efd1199a9c0 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-12T17:33:05.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.612+0000 7efd1199a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:05.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.612+0000 7efd1199a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-12T17:33:05.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.612+0000 7efd1199a9c0 20 get_user_info_from_index found 0 xattrs 2024-09-12T17:33:05.607 INFO:tasks.workunit.client.0.smithi119.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-12T17:33:05.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.612+0000 7efbc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:05.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.616+0000 7efd1199a9c0 20 remove_watcher() i=0 2024-09-12T17:33:05.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.616+0000 7efd1199a9c0 2 removed watcher, disabling cache 2024-09-12T17:33:05.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.620+0000 7efd1199a9c0 20 remove_watcher() i=1 2024-09-12T17:33:05.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.620+0000 7efd1199a9c0 20 remove_watcher() i=2 2024-09-12T17:33:05.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.624+0000 7efd1199a9c0 20 remove_watcher() i=3 2024-09-12T17:33:05.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.624+0000 7efd1199a9c0 20 remove_watcher() i=4 2024-09-12T17:33:05.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.628+0000 7efd1199a9c0 20 remove_watcher() i=5 2024-09-12T17:33:05.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.628+0000 7efd1199a9c0 20 remove_watcher() i=6 2024-09-12T17:33:05.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:05.632+0000 7efd1199a9c0 20 remove_watcher() i=7 2024-09-12T17:33:06.342 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard add 2024-09-12T17:33:06.343 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:06.343 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:33:06.377 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:06.377 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:06.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.428+0000 7fea7bffa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.432+0000 7fea7bffa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:06.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.432+0000 7fea7bffa9c0 20 realm 2024-09-12T17:33:06.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.432+0000 7fea7bffa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.432+0000 7fea7bffa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:06.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.432+0000 7fea7bffa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:06.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.432+0000 7fea7bffa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.432+0000 7fea7bffa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:06.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.432+0000 7fea7bffa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.432+0000 7fea7bffa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:06.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.432+0000 7fea7bffa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.436+0000 7fea7bffa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:06.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.436+0000 7fea7bffa9c0 20 searching for the correct realm 2024-09-12T17:33:06.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.436+0000 7fea712ff640 0 -- 172.21.15.119:0/2367806157 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fea6c0ce040 msgr2=0x7fea6c0ba420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:06.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.648+0000 7fea7a301640 0 -- 172.21.15.119:0/2367806157 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fea64044070 msgr2=0x7fea640676d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:06.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:06.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:06.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:06.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:06.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:06.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:06.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:06.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:06.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:06.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 20 zone default found 2024-09-12T17:33:06.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 4 Realm: () 2024-09-12T17:33:06.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:06.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:06.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:06.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 20 zonegroup default 2024-09-12T17:33:06.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.668+0000 7fea7bffa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.672+0000 7fea7bffa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:06.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.672+0000 7fea7bffa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.672+0000 7fea7bffa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:06.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.672+0000 7fea7bffa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.672+0000 7fea7bffa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:06.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.672+0000 7fea7bffa9c0 20 started sync module instance, tier type = 2024-09-12T17:33:06.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.672+0000 7fea7bffa9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:06.692 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.696+0000 7fea7bffa9c0 20 add_watcher() i=0 2024-09-12T17:33:06.692 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.696+0000 7fea7bffa9c0 20 add_watcher() i=1 2024-09-12T17:33:06.692 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.696+0000 7fea7bffa9c0 20 add_watcher() i=2 2024-09-12T17:33:06.692 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.696+0000 7fea7bffa9c0 20 add_watcher() i=3 2024-09-12T17:33:06.692 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.696+0000 7fea7bffa9c0 20 add_watcher() i=4 2024-09-12T17:33:06.692 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.696+0000 7fea7bffa9c0 20 add_watcher() i=5 2024-09-12T17:33:06.692 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.696+0000 7fea7bffa9c0 20 add_watcher() i=6 2024-09-12T17:33:06.694 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.700+0000 7fea7bffa9c0 20 add_watcher() i=7 2024-09-12T17:33:06.694 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.700+0000 7fea7bffa9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:06.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.704+0000 7fe92ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:06.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.704+0000 7fea7bffa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:06.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.704+0000 7fea7bffa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:06.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.704+0000 7fea7bffa9c0 5 note: GC not initialized 2024-09-12T17:33:06.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.704+0000 7fe92efe5640 20 reqs_thread_entry: start 2024-09-12T17:33:06.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.704+0000 7fea7bffa9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:06.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.704+0000 7fea7bffa9c0 20 Filter name: none 2024-09-12T17:33:06.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.704+0000 7fe92cfe1640 20 reqs_thread_entry: start 2024-09-12T17:33:06.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.704+0000 7fea7bffa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.708+0000 7fea7bffa9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:33:06.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.708+0000 7fea7bffa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.708+0000 7fea7bffa9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:33:06.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.708+0000 7fea7bffa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:06.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.708+0000 7fea7bffa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.708+0000 7fea7bffa9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:33:06.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.708+0000 7fea7bffa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.708+0000 7fea7bffa9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:33:06.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.708+0000 7fea7bffa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:06.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.712+0000 7fe92ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:06.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.720+0000 7fea7bffa9c0 20 remove_watcher() i=0 2024-09-12T17:33:06.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.720+0000 7fea7bffa9c0 2 removed watcher, disabling cache 2024-09-12T17:33:06.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.720+0000 7fea7bffa9c0 20 remove_watcher() i=1 2024-09-12T17:33:06.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.724+0000 7fea7bffa9c0 20 remove_watcher() i=2 2024-09-12T17:33:06.721 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.724+0000 7fea7bffa9c0 20 remove_watcher() i=3 2024-09-12T17:33:06.723 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.728+0000 7fea7bffa9c0 20 remove_watcher() i=4 2024-09-12T17:33:06.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.728+0000 7fea7bffa9c0 20 remove_watcher() i=5 2024-09-12T17:33:06.726 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.732+0000 7fea7bffa9c0 20 remove_watcher() i=6 2024-09-12T17:33:06.727 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.732+0000 7fea7bffa9c0 20 remove_watcher() i=7 2024-09-12T17:33:06.743 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:06.743 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:33:06.743 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: a-bucket id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T17:33:06.743 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:06.743 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-12T17:33:06.776 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:06.777 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:06.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.828+0000 7f49e71d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.828+0000 7f49e71d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:06.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.828+0000 7f49e71d59c0 20 realm 2024-09-12T17:33:06.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.828+0000 7f49e71d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.828+0000 7f49e71d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:06.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.828+0000 7f49e71d59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:06.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.828+0000 7f49e71d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.828+0000 7f49e71d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:06.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.828+0000 7f49e71d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.832+0000 7f49e71d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:06.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.832+0000 7f49e71d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:06.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.832+0000 7f49e71d59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:06.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.832+0000 7f49e71d59c0 20 searching for the correct realm 2024-09-12T17:33:06.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.836+0000 7f49e54dc640 0 -- 172.21.15.119:0/450858095 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f49d005be20 msgr2=0x7f49d00729d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:06.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:06.844+0000 7f49dffff640 0 -- 172.21.15.119:0/450858095 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f49e0120040 msgr2=0x7f49e011e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:07.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.060+0000 7f49e71d59c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:07.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.060+0000 7f49e71d59c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:07.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.060+0000 7f49e71d59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:07.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.060+0000 7f49e71d59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:07.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.060+0000 7f49e71d59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:07.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.060+0000 7f49e71d59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:07.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.060+0000 7f49e71d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.064+0000 7f49e71d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.064+0000 7f49e71d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.064+0000 7f49e71d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:07.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.064+0000 7f49e71d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.064+0000 7f49e71d59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:07.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.064+0000 7f49e71d59c0 20 zone default found 2024-09-12T17:33:07.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.064+0000 7f49e71d59c0 4 Realm: () 2024-09-12T17:33:07.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.064+0000 7f49e71d59c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:07.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.064+0000 7f49e71d59c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:07.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.064+0000 7f49e71d59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:07.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.064+0000 7f49e71d59c0 20 zonegroup default 2024-09-12T17:33:07.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.064+0000 7f49e71d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.064+0000 7f49e71d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.064+0000 7f49e71d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.064+0000 7f49e71d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.064+0000 7f49e71d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.068+0000 7f49e71d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.068+0000 7f49e71d59c0 20 started sync module instance, tier type = 2024-09-12T17:33:07.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.068+0000 7f49e71d59c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:07.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.092+0000 7f49e71d59c0 20 add_watcher() i=0 2024-09-12T17:33:07.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.092+0000 7f49e71d59c0 20 add_watcher() i=1 2024-09-12T17:33:07.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.092+0000 7f49e71d59c0 20 add_watcher() i=2 2024-09-12T17:33:07.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.092+0000 7f49e71d59c0 20 add_watcher() i=3 2024-09-12T17:33:07.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.092+0000 7f49e71d59c0 20 add_watcher() i=4 2024-09-12T17:33:07.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.092+0000 7f49e71d59c0 20 add_watcher() i=5 2024-09-12T17:33:07.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.092+0000 7f49e71d59c0 20 add_watcher() i=6 2024-09-12T17:33:07.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.092+0000 7f49e71d59c0 20 add_watcher() i=7 2024-09-12T17:33:07.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.092+0000 7f49e71d59c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:07.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.096+0000 7f489afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:07.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:07.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:07.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 5 note: GC not initialized 2024-09-12T17:33:07.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f4899fe3640 20 reqs_thread_entry: start 2024-09-12T17:33:07.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:07.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 20 Filter name: none 2024-09-12T17:33:07.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f480b7fe640 20 reqs_thread_entry: start 2024-09-12T17:33:07.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:33:07.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:33:07.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:33:07.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:33:07.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:33:07.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:33:07.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:33:07.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:33:07.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:07.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:33:07.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.100+0000 7f49e71d59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:33:07.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.104+0000 7f489afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:07.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.112+0000 7f49e71d59c0 20 remove_watcher() i=0 2024-09-12T17:33:07.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.112+0000 7f49e71d59c0 2 removed watcher, disabling cache 2024-09-12T17:33:07.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.112+0000 7f49e71d59c0 20 remove_watcher() i=1 2024-09-12T17:33:07.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.116+0000 7f49e71d59c0 20 remove_watcher() i=2 2024-09-12T17:33:07.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.116+0000 7f49e71d59c0 20 remove_watcher() i=3 2024-09-12T17:33:07.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.120+0000 7f49e71d59c0 20 remove_watcher() i=4 2024-09-12T17:33:07.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.124+0000 7f49e71d59c0 20 remove_watcher() i=5 2024-09-12T17:33:07.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.124+0000 7f49e71d59c0 20 remove_watcher() i=6 2024-09-12T17:33:07.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.124+0000 7f49e71d59c0 20 remove_watcher() i=7 2024-09-12T17:33:07.137 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin reshard list 2024-09-12T17:33:07.166 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:07.166 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:07.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.216+0000 7fbf637969c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.216+0000 7fbf637969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.216+0000 7fbf637969c0 20 realm 2024-09-12T17:33:07.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.216+0000 7fbf637969c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.220+0000 7fbf637969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.220+0000 7fbf637969c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:07.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.220+0000 7fbf637969c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.214 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.220+0000 7fbf637969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.214 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.220+0000 7fbf637969c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.215 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.220+0000 7fbf637969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:07.215 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.220+0000 7fbf637969c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.220+0000 7fbf637969c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:07.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.220+0000 7fbf637969c0 20 searching for the correct realm 2024-09-12T17:33:07.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.224+0000 7fbf60a9b640 0 -- 172.21.15.119:0/2353209326 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fbf54021060 msgr2=0x7fbf5405c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:07.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.440+0000 7fbf61a9d640 0 -- 172.21.15.119:0/2353209326 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fbf58025400 msgr2=0x7fbf58025820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:07.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.456+0000 7fbf637969c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:07.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.456+0000 7fbf637969c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:07.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.456+0000 7fbf637969c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:07.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.456+0000 7fbf637969c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:07.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.456+0000 7fbf637969c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:07.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.456+0000 7fbf637969c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:07.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.456+0000 7fbf637969c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.456+0000 7fbf637969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.456+0000 7fbf637969c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.456+0000 7fbf637969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:07.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.456+0000 7fbf637969c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.460+0000 7fbf637969c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:07.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.460+0000 7fbf637969c0 20 zone default found 2024-09-12T17:33:07.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.460+0000 7fbf637969c0 4 Realm: () 2024-09-12T17:33:07.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.460+0000 7fbf637969c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:07.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.460+0000 7fbf637969c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:07.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.460+0000 7fbf637969c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:07.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.460+0000 7fbf637969c0 20 zonegroup default 2024-09-12T17:33:07.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.460+0000 7fbf637969c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.460+0000 7fbf637969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.460+0000 7fbf637969c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.460+0000 7fbf637969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.460+0000 7fbf637969c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.456 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.460+0000 7fbf637969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.456 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.460+0000 7fbf637969c0 20 started sync module instance, tier type = 2024-09-12T17:33:07.456 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.460+0000 7fbf637969c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:07.481 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.484+0000 7fbf637969c0 20 add_watcher() i=0 2024-09-12T17:33:07.481 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.484+0000 7fbf637969c0 20 add_watcher() i=1 2024-09-12T17:33:07.481 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.484+0000 7fbf637969c0 20 add_watcher() i=2 2024-09-12T17:33:07.481 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.484+0000 7fbf637969c0 20 add_watcher() i=3 2024-09-12T17:33:07.481 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.484+0000 7fbf637969c0 20 add_watcher() i=4 2024-09-12T17:33:07.485 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.484+0000 7fbf637969c0 20 add_watcher() i=5 2024-09-12T17:33:07.485 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.484+0000 7fbf637969c0 20 add_watcher() i=6 2024-09-12T17:33:07.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.488+0000 7fbf637969c0 20 add_watcher() i=7 2024-09-12T17:33:07.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.488+0000 7fbf637969c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:07.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.492+0000 7fbe17fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:07.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.492+0000 7fbf637969c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:07.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.492+0000 7fbf637969c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:07.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.492+0000 7fbf637969c0 5 note: GC not initialized 2024-09-12T17:33:07.489 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.492+0000 7fbe16fe5640 20 reqs_thread_entry: start 2024-09-12T17:33:07.489 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.492+0000 7fbf637969c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:07.489 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.492+0000 7fbf637969c0 20 Filter name: none 2024-09-12T17:33:07.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.492+0000 7fbe14fe1640 20 reqs_thread_entry: start 2024-09-12T17:33:07.502 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.508+0000 7fbe17fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:07.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.512+0000 7fbf637969c0 20 remove_watcher() i=0 2024-09-12T17:33:07.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.512+0000 7fbf637969c0 2 removed watcher, disabling cache 2024-09-12T17:33:07.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.516+0000 7fbf637969c0 20 remove_watcher() i=1 2024-09-12T17:33:07.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.516+0000 7fbf637969c0 20 remove_watcher() i=2 2024-09-12T17:33:07.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.520+0000 7fbf637969c0 20 remove_watcher() i=3 2024-09-12T17:33:07.517 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.520+0000 7fbf637969c0 20 remove_watcher() i=4 2024-09-12T17:33:07.518 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.524+0000 7fbf637969c0 20 remove_watcher() i=5 2024-09-12T17:33:07.520 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.524+0000 7fbf637969c0 20 remove_watcher() i=6 2024-09-12T17:33:07.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.528+0000 7fbf637969c0 20 remove_watcher() i=7 2024-09-12T17:33:07.546 INFO:tasks.workunit.client.0.smithi119.stderr:bucket name a-bucket 2024-09-12T17:33:07.546 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard process 2024-09-12T17:33:07.546 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:07.547 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin reshard process 2024-09-12T17:33:07.573 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:07.573 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:07.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.624+0000 7f09f71e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.628+0000 7f09f71e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.628+0000 7f09f71e99c0 20 realm 2024-09-12T17:33:07.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.628+0000 7f09f71e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.628+0000 7f09f71e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.628+0000 7f09f71e99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:07.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.628+0000 7f09f71e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.628+0000 7f09f71e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.628+0000 7f09f71e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.628+0000 7f09f71e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:07.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.628+0000 7f09f71e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.632+0000 7f09f71e99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:07.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.632+0000 7f09f71e99c0 20 searching for the correct realm 2024-09-12T17:33:07.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.632+0000 7f09f44ee640 0 -- 172.21.15.119:0/551882622 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f09e4008050 msgr2=0x7f09e4036940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:33:07.839 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.844+0000 7f09f54f0640 0 -- 172.21.15.119:0/551882622 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f09e80f6020 msgr2=0x7f09e80fd750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:07.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:07.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:07.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:07.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:07.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:07.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:07.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:07.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:07.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 zone default found 2024-09-12T17:33:07.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 4 Realm: () 2024-09-12T17:33:07.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:07.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:07.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:07.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 zonegroup default 2024-09-12T17:33:07.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.864+0000 7f09f71e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.868+0000 7f09f71e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.868+0000 7f09f71e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.868+0000 7f09f71e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:07.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.868+0000 7f09f71e99c0 20 started sync module instance, tier type = 2024-09-12T17:33:07.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.868+0000 7f09f71e99c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:07.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.892+0000 7f09f71e99c0 20 add_watcher() i=0 2024-09-12T17:33:07.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.892+0000 7f09f71e99c0 20 add_watcher() i=1 2024-09-12T17:33:07.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.892+0000 7f09f71e99c0 20 add_watcher() i=2 2024-09-12T17:33:07.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.892+0000 7f09f71e99c0 20 add_watcher() i=3 2024-09-12T17:33:07.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.892+0000 7f09f71e99c0 20 add_watcher() i=4 2024-09-12T17:33:07.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.892+0000 7f09f71e99c0 20 add_watcher() i=5 2024-09-12T17:33:07.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.892+0000 7f09f71e99c0 20 add_watcher() i=6 2024-09-12T17:33:07.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.892+0000 7f09f71e99c0 20 add_watcher() i=7 2024-09-12T17:33:07.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.892+0000 7f09f71e99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:07.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.896+0000 7f08aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:07.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.900+0000 7f09f71e99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:07.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.900+0000 7f09f71e99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:07.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.900+0000 7f09f71e99c0 5 note: GC not initialized 2024-09-12T17:33:07.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.900+0000 7f08a9fe3640 20 reqs_thread_entry: start 2024-09-12T17:33:07.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.900+0000 7f09f71e99c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:07.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.900+0000 7f09f71e99c0 20 Filter name: none 2024-09-12T17:33:07.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.900+0000 7f081b7fe640 20 reqs_thread_entry: start 2024-09-12T17:33:07.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.900+0000 7f09f71e99c0 20 processing logshard = reshard.0000000000 2024-09-12T17:33:07.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.904+0000 7f09f71e99c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:33:07.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.904+0000 7f09f71e99c0 20 processing logshard = reshard.0000000001 2024-09-12T17:33:07.907 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.912+0000 7f09f71e99c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:33:07.907 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.912+0000 7f09f71e99c0 20 processing logshard = reshard.0000000002 2024-09-12T17:33:07.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.916+0000 7f09f71e99c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:33:07.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.916+0000 7f09f71e99c0 20 processing logshard = reshard.0000000003 2024-09-12T17:33:07.917 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.920+0000 7f09f71e99c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:33:07.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.920+0000 7f09f71e99c0 20 processing logshard = reshard.0000000004 2024-09-12T17:33:07.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.928+0000 7f09f71e99c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:33:07.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.928+0000 7f09f71e99c0 20 processing logshard = reshard.0000000005 2024-09-12T17:33:07.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.932+0000 7f09f71e99c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:33:07.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.932+0000 7f09f71e99c0 20 processing logshard = reshard.0000000006 2024-09-12T17:33:07.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.936+0000 7f09f71e99c0 20 process_entry resharding a-bucket 2024-09-12T17:33:07.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.936+0000 7f09f71e99c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:33:07.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.936+0000 7f09f71e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.936+0000 7f09f71e99c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:33:07.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.936+0000 7f09f71e99c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:33:07.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.936+0000 7f09f71e99c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:33:07.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.936+0000 7f09f71e99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:33:07.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.936+0000 7f09f71e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:07.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.936+0000 7f09f71e99c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:33:07.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.936+0000 7f09f71e99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:33:07.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.936+0000 7f09f71e99c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:33:07.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.936+0000 7f09f71e99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:07.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.936+0000 7f09f71e99c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:33:07.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.936+0000 7f09f71e99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:33:07.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.952+0000 7f09f71e99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:33:07.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.952+0000 7f09f71e99c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:33:07.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.952+0000 7f09f71e99c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:33:07.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.952+0000 7f09f71e99c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:33:07.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.952+0000 7f08cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333476 cookie 94337048281184 notifier 6126 bl.length()=911 2024-09-12T17:33:07.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.952+0000 7f08cbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:33:07.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.952+0000 7f08cbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:33:07.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.952+0000 7f08cbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:33:07.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.956+0000 7f09f71e99c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:33:07.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.956+0000 7f09f71e99c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:33:07.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.956+0000 7f09f71e99c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:33:07.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.956+0000 7f09f71e99c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:33:07.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.0 2024-09-12T17:33:07.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.0 2024-09-12T17:33:07.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.1 2024-09-12T17:33:07.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.1 2024-09-12T17:33:07.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.2 2024-09-12T17:33:07.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.2 2024-09-12T17:33:07.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.3 2024-09-12T17:33:07.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.3 2024-09-12T17:33:07.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.4 2024-09-12T17:33:07.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.4 2024-09-12T17:33:07.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.5 2024-09-12T17:33:07.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.5 2024-09-12T17:33:07.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.6 2024-09-12T17:33:07.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.6 2024-09-12T17:33:07.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.7 2024-09-12T17:33:07.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.7 2024-09-12T17:33:07.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.8 2024-09-12T17:33:07.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.8 2024-09-12T17:33:07.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.9 2024-09-12T17:33:07.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.9 2024-09-12T17:33:07.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.10 2024-09-12T17:33:07.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.10 2024-09-12T17:33:07.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.11 2024-09-12T17:33:07.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.11 2024-09-12T17:33:07.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.964+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.0 2024-09-12T17:33:07.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.968+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1 2024-09-12T17:33:07.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.968+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2 2024-09-12T17:33:07.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.968+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3 2024-09-12T17:33:07.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.968+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.4 2024-09-12T17:33:07.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.972+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.5 2024-09-12T17:33:07.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.972+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.6 2024-09-12T17:33:07.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.972+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.7 2024-09-12T17:33:07.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.972+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.8 2024-09-12T17:33:07.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.976+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.9 2024-09-12T17:33:07.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.976+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.10 2024-09-12T17:33:07.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.976+0000 7f09f71e99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:07.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.976+0000 7f09f71e99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:33:07.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.980+0000 7f09f71e99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:33:07.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.980+0000 7f09f71e99c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:33:07.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.980+0000 7f09f71e99c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:33:07.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.980+0000 7f09f71e99c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:33:07.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.980+0000 7f08cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333477 cookie 94337048281184 notifier 6126 bl.length()=911 2024-09-12T17:33:07.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.980+0000 7f08cbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:33:07.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.980+0000 7f08cbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:33:07.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.980+0000 7f08cbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:33:07.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.984+0000 7f09f71e99c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:33:07.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.984+0000 7f09f71e99c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:33:07.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.984+0000 7f09f71e99c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:33:07.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.984+0000 7f09f71e99c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:33:07.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.988+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.0 2024-09-12T17:33:07.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.988+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1 2024-09-12T17:33:07.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.992+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2 2024-09-12T17:33:07.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.992+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3 2024-09-12T17:33:07.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.992+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.4 2024-09-12T17:33:07.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.992+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.5 2024-09-12T17:33:07.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.992+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.6 2024-09-12T17:33:07.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.992+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.7 2024-09-12T17:33:07.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.996+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.8 2024-09-12T17:33:07.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.996+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.9 2024-09-12T17:33:07.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.996+0000 7f09f71e99c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.10 2024-09-12T17:33:07.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.996+0000 7f09f71e99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:07.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:07.996+0000 7f09f71e99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:33:07.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.000+0000 7f09f71e99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:33:07.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.000+0000 7f09f71e99c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:33:07.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.000+0000 7f09f71e99c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:33:07.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.000+0000 7f09f71e99c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:33:07.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.000+0000 7f08cb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333478 cookie 94337048281184 notifier 6126 bl.length()=879 2024-09-12T17:33:07.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.000+0000 7f08cb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:33:07.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.000+0000 7f08cb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:33:07.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.000+0000 7f08cb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:33:07.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.004+0000 7f09f71e99c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:33:07.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.004+0000 7f09f71e99c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:33:07.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.004+0000 7f09f71e99c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:33:07.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.004+0000 7f09f71e99c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:33:08.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.008+0000 7f09f71e99c0 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-12T17:33:08.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.012+0000 7f09f71e99c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:33:08.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.016+0000 7f09f71e99c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:33:08.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.016+0000 7f09f71e99c0 20 processing logshard = reshard.0000000007 2024-09-12T17:33:08.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.024+0000 7f09f71e99c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:33:08.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.024+0000 7f09f71e99c0 20 processing logshard = reshard.0000000008 2024-09-12T17:33:08.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.032+0000 7f09f71e99c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:33:08.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.032+0000 7f09f71e99c0 20 processing logshard = reshard.0000000009 2024-09-12T17:33:08.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.036+0000 7f09f71e99c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:33:08.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.036+0000 7f09f71e99c0 20 processing logshard = reshard.0000000010 2024-09-12T17:33:08.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.044+0000 7f09f71e99c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:33:08.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.044+0000 7f09f71e99c0 20 processing logshard = reshard.0000000011 2024-09-12T17:33:08.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.048+0000 7f09f71e99c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:33:08.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.048+0000 7f09f71e99c0 20 processing logshard = reshard.0000000012 2024-09-12T17:33:08.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.056+0000 7f09f71e99c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:33:08.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.056+0000 7f09f71e99c0 20 processing logshard = reshard.0000000013 2024-09-12T17:33:08.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.064+0000 7f09f71e99c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:33:08.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.064+0000 7f09f71e99c0 20 processing logshard = reshard.0000000014 2024-09-12T17:33:08.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.068+0000 7f09f71e99c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:33:08.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.068+0000 7f09f71e99c0 20 processing logshard = reshard.0000000015 2024-09-12T17:33:08.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.076+0000 7f09f71e99c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:33:08.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.080+0000 7f08aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:08.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.084+0000 7f09f71e99c0 20 remove_watcher() i=0 2024-09-12T17:33:08.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.084+0000 7f09f71e99c0 2 removed watcher, disabling cache 2024-09-12T17:33:08.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.088+0000 7f09f71e99c0 20 remove_watcher() i=1 2024-09-12T17:33:08.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.088+0000 7f09f71e99c0 20 remove_watcher() i=2 2024-09-12T17:33:08.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.092+0000 7f09f71e99c0 20 remove_watcher() i=3 2024-09-12T17:33:08.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.096+0000 7f09f71e99c0 20 remove_watcher() i=4 2024-09-12T17:33:08.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.096+0000 7f09f71e99c0 20 remove_watcher() i=5 2024-09-12T17:33:08.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.100+0000 7f09f71e99c0 20 remove_watcher() i=6 2024-09-12T17:33:08.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:08.100+0000 7f09f71e99c0 20 remove_watcher() i=7 2024-09-12T17:33:13.122 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:33:13.156 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:13.156 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:13.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.207+0000 7f1b385ef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:13.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.207+0000 7f1b385ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:13.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.207+0000 7f1b385ef9c0 20 realm 2024-09-12T17:33:13.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.207+0000 7f1b385ef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:13.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.207+0000 7f1b385ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:13.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.207+0000 7f1b385ef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:13.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.207+0000 7f1b385ef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:13.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.211+0000 7f1b385ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:13.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.211+0000 7f1b385ef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:13.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.211+0000 7f1b385ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:13.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.211+0000 7f1b385ef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:13.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.211+0000 7f1b385ef9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:13.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.211+0000 7f1b385ef9c0 20 searching for the correct realm 2024-09-12T17:33:13.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.215+0000 7f1b368f6640 0 -- 172.21.15.119:0/600233418 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f1b2c01f070 msgr2=0x7f1b2c029710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:13.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.223+0000 7f1b358f4640 0 -- 172.21.15.119:0/600233418 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f1b300e3040 msgr2=0x7f1b300e3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:33:13.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.439+0000 7f1b385ef9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:13.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.439+0000 7f1b385ef9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:13.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.439+0000 7f1b385ef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:13.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.439+0000 7f1b385ef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:13.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.439+0000 7f1b385ef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:13.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.439+0000 7f1b385ef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:13.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.439+0000 7f1b385ef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:13.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.439+0000 7f1b385ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:13.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.439+0000 7f1b385ef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:13.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.439+0000 7f1b385ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:13.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.439+0000 7f1b385ef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:13.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.443+0000 7f1b385ef9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:13.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.443+0000 7f1b385ef9c0 20 zone default found 2024-09-12T17:33:13.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.443+0000 7f1b385ef9c0 4 Realm: () 2024-09-12T17:33:13.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.443+0000 7f1b385ef9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:13.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.443+0000 7f1b385ef9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:13.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.443+0000 7f1b385ef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:13.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.443+0000 7f1b385ef9c0 20 zonegroup default 2024-09-12T17:33:13.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.443+0000 7f1b385ef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:13.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.443+0000 7f1b385ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:13.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.443+0000 7f1b385ef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:13.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.443+0000 7f1b385ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:13.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.443+0000 7f1b385ef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:13.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.443+0000 7f1b385ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:13.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.443+0000 7f1b385ef9c0 20 started sync module instance, tier type = 2024-09-12T17:33:13.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.443+0000 7f1b385ef9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:13.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.467+0000 7f1b385ef9c0 20 add_watcher() i=0 2024-09-12T17:33:13.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.467+0000 7f1b385ef9c0 20 add_watcher() i=1 2024-09-12T17:33:13.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.467+0000 7f1b385ef9c0 20 add_watcher() i=2 2024-09-12T17:33:13.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.467+0000 7f1b385ef9c0 20 add_watcher() i=3 2024-09-12T17:33:13.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.467+0000 7f1b385ef9c0 20 add_watcher() i=4 2024-09-12T17:33:13.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.467+0000 7f1b385ef9c0 20 add_watcher() i=5 2024-09-12T17:33:13.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.467+0000 7f1b385ef9c0 20 add_watcher() i=6 2024-09-12T17:33:13.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.467+0000 7f1b385ef9c0 20 add_watcher() i=7 2024-09-12T17:33:13.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.467+0000 7f1b385ef9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:13.468 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.471+0000 7f19ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:13.469 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.471+0000 7f1b385ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:13.469 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.471+0000 7f1b385ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:13.469 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.471+0000 7f1b385ef9c0 5 note: GC not initialized 2024-09-12T17:33:13.470 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.471+0000 7f19677fe640 20 reqs_thread_entry: start 2024-09-12T17:33:13.470 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.475+0000 7f1b385ef9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:13.470 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.475+0000 7f1b385ef9c0 20 Filter name: none 2024-09-12T17:33:13.470 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.475+0000 7f19657fa640 20 reqs_thread_entry: start 2024-09-12T17:33:13.470 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.475+0000 7f1b385ef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:13.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.475+0000 7f1b385ef9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:33:13.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.475+0000 7f1b385ef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:13.472 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.475+0000 7f1b385ef9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:33:13.472 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.475+0000 7f1b385ef9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:13.472 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.475+0000 7f1b385ef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:13.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.475+0000 7f1b385ef9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:33:13.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.475+0000 7f1b385ef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:13.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.479+0000 7f1b385ef9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:33:13.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.479+0000 7f1b385ef9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:13.477 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.479+0000 7f19ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:13.482 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.487+0000 7f1b385ef9c0 20 remove_watcher() i=0 2024-09-12T17:33:13.482 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.487+0000 7f1b385ef9c0 2 removed watcher, disabling cache 2024-09-12T17:33:13.484 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.487+0000 7f1b385ef9c0 20 remove_watcher() i=1 2024-09-12T17:33:13.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.491+0000 7f1b385ef9c0 20 remove_watcher() i=2 2024-09-12T17:33:13.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.491+0000 7f1b385ef9c0 20 remove_watcher() i=3 2024-09-12T17:33:13.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.495+0000 7f1b385ef9c0 20 remove_watcher() i=4 2024-09-12T17:33:13.491 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.495+0000 7f1b385ef9c0 20 remove_watcher() i=5 2024-09-12T17:33:13.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.499+0000 7f1b385ef9c0 20 remove_watcher() i=6 2024-09-12T17:33:13.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:13.499+0000 7f1b385ef9c0 20 remove_watcher() i=7 2024-09-12T17:33:13.510 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:13.510 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:33:13.510 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: a-bucket id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T17:33:13.510 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:13.510 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard add non empty bucket 2024-09-12T17:33:13.510 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:14.244 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:33:14.276 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:14.276 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:14.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.327+0000 7f28bd3e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.327+0000 7f28bd3e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:14.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.327+0000 7f28bd3e99c0 20 realm 2024-09-12T17:33:14.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.327+0000 7f28bd3e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.327+0000 7f28bd3e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:14.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.327+0000 7f28bd3e99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:14.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.327+0000 7f28bd3e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.327+0000 7f28bd3e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:14.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.327+0000 7f28bd3e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.331+0000 7f28bd3e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:14.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.331+0000 7f28bd3e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.331+0000 7f28bd3e99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:14.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.331+0000 7f28bd3e99c0 20 searching for the correct realm 2024-09-12T17:33:14.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.335+0000 7f28bb6f0640 0 -- 172.21.15.119:0/1751216991 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f28b004e040 msgr2=0x7f28b004e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:33:14.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.343+0000 7f28ba6ee640 0 -- 172.21.15.119:0/1751216991 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f28b40fcfd0 msgr2=0x7f28b41048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:14.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.559+0000 7f28bd3e99c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:14.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.559+0000 7f28bd3e99c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:14.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.559+0000 7f28bd3e99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:14.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.559+0000 7f28bd3e99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:14.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.559+0000 7f28bd3e99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:14.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.559+0000 7f28bd3e99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:14.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.559+0000 7f28bd3e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.559+0000 7f28bd3e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:14.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.559+0000 7f28bd3e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:14.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:14.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 20 zone default found 2024-09-12T17:33:14.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 4 Realm: () 2024-09-12T17:33:14.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:14.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:14.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:14.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 20 zonegroup default 2024-09-12T17:33:14.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:14.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:14.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:14.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 20 started sync module instance, tier type = 2024-09-12T17:33:14.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.563+0000 7f28bd3e99c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:14.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.587+0000 7f28bd3e99c0 20 add_watcher() i=0 2024-09-12T17:33:14.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.587+0000 7f28bd3e99c0 20 add_watcher() i=1 2024-09-12T17:33:14.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.587+0000 7f28bd3e99c0 20 add_watcher() i=2 2024-09-12T17:33:14.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.587+0000 7f28bd3e99c0 20 add_watcher() i=3 2024-09-12T17:33:14.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.587+0000 7f28bd3e99c0 20 add_watcher() i=4 2024-09-12T17:33:14.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.587+0000 7f28bd3e99c0 20 add_watcher() i=5 2024-09-12T17:33:14.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.587+0000 7f28bd3e99c0 20 add_watcher() i=6 2024-09-12T17:33:14.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.591+0000 7f28bd3e99c0 20 add_watcher() i=7 2024-09-12T17:33:14.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.591+0000 7f28bd3e99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:14.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.591+0000 7f2771fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:14.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.595+0000 7f28bd3e99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:14.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.595+0000 7f28bd3e99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:14.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.595+0000 7f28bd3e99c0 5 note: GC not initialized 2024-09-12T17:33:14.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.595+0000 7f2770fe1640 20 reqs_thread_entry: start 2024-09-12T17:33:14.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.595+0000 7f28bd3e99c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:14.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.595+0000 7f28bd3e99c0 20 Filter name: none 2024-09-12T17:33:14.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.595+0000 7f276a7fc640 20 reqs_thread_entry: start 2024-09-12T17:33:14.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.595+0000 7f28bd3e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.595+0000 7f28bd3e99c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:33:14.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.595+0000 7f28bd3e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.599+0000 7f28bd3e99c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:33:14.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.599+0000 7f28bd3e99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:14.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.599+0000 7f28bd3e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.599+0000 7f28bd3e99c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:33:14.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.599+0000 7f28bd3e99c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.599+0000 7f28bd3e99c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:33:14.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.599+0000 7f28bd3e99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:14.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.603+0000 7f2771fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:14.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.607+0000 7f28bd3e99c0 20 remove_watcher() i=0 2024-09-12T17:33:14.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.607+0000 7f28bd3e99c0 2 removed watcher, disabling cache 2024-09-12T17:33:14.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.611+0000 7f28bd3e99c0 20 remove_watcher() i=1 2024-09-12T17:33:14.609 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.615+0000 7f28bd3e99c0 20 remove_watcher() i=2 2024-09-12T17:33:14.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.615+0000 7f28bd3e99c0 20 remove_watcher() i=3 2024-09-12T17:33:14.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.619+0000 7f28bd3e99c0 20 remove_watcher() i=4 2024-09-12T17:33:14.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.619+0000 7f28bd3e99c0 20 remove_watcher() i=5 2024-09-12T17:33:14.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.619+0000 7f28bd3e99c0 20 remove_watcher() i=6 2024-09-12T17:33:14.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.623+0000 7f28bd3e99c0 20 remove_watcher() i=7 2024-09-12T17:33:14.633 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:14.633 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:33:14.633 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: a-bucket id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-12T17:33:14.633 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:14.633 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-12T17:33:14.661 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:14.661 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:14.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.711+0000 7fe2f65c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.715+0000 7fe2f65c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:14.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.715+0000 7fe2f65c19c0 20 realm 2024-09-12T17:33:14.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.715+0000 7fe2f65c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.715+0000 7fe2f65c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:14.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.715+0000 7fe2f65c19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:14.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.715+0000 7fe2f65c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.715+0000 7fe2f65c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:14.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.715+0000 7fe2f65c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.715+0000 7fe2f65c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:14.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.715+0000 7fe2f65c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.719+0000 7fe2f65c19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:14.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.719+0000 7fe2f65c19c0 20 searching for the correct realm 2024-09-12T17:33:14.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.719+0000 7fe2f38c6640 0 -- 172.21.15.119:0/172634017 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fe2e4008050 msgr2=0x7fe2e4063960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:14.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.935+0000 7fe2f48c8640 0 -- 172.21.15.119:0/172634017 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fe2e80c0040 msgr2=0x7fe2e8007b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:14.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.951+0000 7fe2f65c19c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:14.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.951+0000 7fe2f65c19c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:14.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.951+0000 7fe2f65c19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:14.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.951+0000 7fe2f65c19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:14.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.951+0000 7fe2f65c19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:14.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.951+0000 7fe2f65c19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:14.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.951+0000 7fe2f65c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.951+0000 7fe2f65c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:14.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.951+0000 7fe2f65c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.951+0000 7fe2f65c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:14.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.951+0000 7fe2f65c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.955+0000 7fe2f65c19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:14.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.955+0000 7fe2f65c19c0 20 zone default found 2024-09-12T17:33:14.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.955+0000 7fe2f65c19c0 4 Realm: () 2024-09-12T17:33:14.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.955+0000 7fe2f65c19c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:14.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.955+0000 7fe2f65c19c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:14.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.955+0000 7fe2f65c19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:14.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.955+0000 7fe2f65c19c0 20 zonegroup default 2024-09-12T17:33:14.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.955+0000 7fe2f65c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.955+0000 7fe2f65c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:14.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.955+0000 7fe2f65c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.955+0000 7fe2f65c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:14.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.955+0000 7fe2f65c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.955+0000 7fe2f65c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:14.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.955+0000 7fe2f65c19c0 20 started sync module instance, tier type = 2024-09-12T17:33:14.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.955+0000 7fe2f65c19c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:14.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.979+0000 7fe2f65c19c0 20 add_watcher() i=0 2024-09-12T17:33:14.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.979+0000 7fe2f65c19c0 20 add_watcher() i=1 2024-09-12T17:33:14.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.979+0000 7fe2f65c19c0 20 add_watcher() i=2 2024-09-12T17:33:14.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.979+0000 7fe2f65c19c0 20 add_watcher() i=3 2024-09-12T17:33:14.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.979+0000 7fe2f65c19c0 20 add_watcher() i=4 2024-09-12T17:33:14.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.979+0000 7fe2f65c19c0 20 add_watcher() i=5 2024-09-12T17:33:14.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.979+0000 7fe2f65c19c0 20 add_watcher() i=6 2024-09-12T17:33:14.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.979+0000 7fe2f65c19c0 20 add_watcher() i=7 2024-09-12T17:33:14.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.979+0000 7fe2f65c19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:14.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.983+0000 7fe1aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:14.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.983+0000 7fe2f65c19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:14.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.983+0000 7fe2f65c19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:14.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.983+0000 7fe2f65c19c0 5 note: GC not initialized 2024-09-12T17:33:14.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.983+0000 7fe1a9fdb640 20 reqs_thread_entry: start 2024-09-12T17:33:14.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.983+0000 7fe2f65c19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:14.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.983+0000 7fe2f65c19c0 20 Filter name: none 2024-09-12T17:33:14.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.983+0000 7fe11b7fe640 20 reqs_thread_entry: start 2024-09-12T17:33:14.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.983+0000 7fe2f65c19c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:33:14.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.983+0000 7fe2f65c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.987+0000 7fe2f65c19c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:33:14.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.987+0000 7fe2f65c19c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:33:14.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.987+0000 7fe2f65c19c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:33:14.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.987+0000 7fe2f65c19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:33:14.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.987+0000 7fe2f65c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:14.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.987+0000 7fe2f65c19c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:33:14.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.987+0000 7fe2f65c19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:33:14.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.987+0000 7fe2f65c19c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:33:14.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.987+0000 7fe2f65c19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:14.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.987+0000 7fe2f65c19c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:33:14.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.987+0000 7fe2f65c19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:33:14.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.991+0000 7fe1aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:14.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.995+0000 7fe2f65c19c0 20 remove_watcher() i=0 2024-09-12T17:33:14.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.995+0000 7fe2f65c19c0 2 removed watcher, disabling cache 2024-09-12T17:33:14.993 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.995+0000 7fe2f65c19c0 20 remove_watcher() i=1 2024-09-12T17:33:14.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:14.999+0000 7fe2f65c19c0 20 remove_watcher() i=2 2024-09-12T17:33:14.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.003+0000 7fe2f65c19c0 20 remove_watcher() i=3 2024-09-12T17:33:14.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.003+0000 7fe2f65c19c0 20 remove_watcher() i=4 2024-09-12T17:33:15.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.003+0000 7fe2f65c19c0 20 remove_watcher() i=5 2024-09-12T17:33:15.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.007+0000 7fe2f65c19c0 20 remove_watcher() i=6 2024-09-12T17:33:15.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.007+0000 7fe2f65c19c0 20 remove_watcher() i=7 2024-09-12T17:33:15.020 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin reshard list 2024-09-12T17:33:15.044 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:15.044 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:15.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.279+0000 7f9f87e75640 0 --2- 172.21.15.119:0/1548523025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56421b145340 0x56421b2ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:33:15.302 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.307+0000 7f9f8ab709c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.307+0000 7f9f8ab709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:15.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.307+0000 7f9f8ab709c0 20 realm 2024-09-12T17:33:15.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.307+0000 7f9f8ab709c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.307+0000 7f9f8ab709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:15.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.307+0000 7f9f8ab709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:15.305 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.307+0000 7f9f8ab709c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.305 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.307+0000 7f9f8ab709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:15.305 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.307+0000 7f9f8ab709c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.306 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.311+0000 7f9f8ab709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:15.306 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.311+0000 7f9f8ab709c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.311+0000 7f9f8ab709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:15.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.311+0000 7f9f8ab709c0 20 searching for the correct realm 2024-09-12T17:33:15.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.315+0000 7f9f87e75640 0 -- 172.21.15.119:0/103706830 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f9f78071bc0 msgr2=0x7f9f7805b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:15.525 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.527+0000 7f9f88e77640 0 -- 172.21.15.119:0/103706830 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f9f7c046060 msgr2=0x7f9f7c06b5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:15.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:15.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:15.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:15.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:15.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:15.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:15.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.544 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:15.544 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.544 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:15.544 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.545 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:15.545 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 20 zone default found 2024-09-12T17:33:15.545 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 4 Realm: () 2024-09-12T17:33:15.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:15.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:15.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:15.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 20 zonegroup default 2024-09-12T17:33:15.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.547+0000 7f9f8ab709c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.551+0000 7f9f8ab709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:15.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.551+0000 7f9f8ab709c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.551+0000 7f9f8ab709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:15.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.551+0000 7f9f8ab709c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.551+0000 7f9f8ab709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:15.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.551+0000 7f9f8ab709c0 20 started sync module instance, tier type = 2024-09-12T17:33:15.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.551+0000 7f9f8ab709c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:15.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.575+0000 7f9f8ab709c0 20 add_watcher() i=0 2024-09-12T17:33:15.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.575+0000 7f9f8ab709c0 20 add_watcher() i=1 2024-09-12T17:33:15.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.575+0000 7f9f8ab709c0 20 add_watcher() i=2 2024-09-12T17:33:15.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.575+0000 7f9f8ab709c0 20 add_watcher() i=3 2024-09-12T17:33:15.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.575+0000 7f9f8ab709c0 20 add_watcher() i=4 2024-09-12T17:33:15.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.575+0000 7f9f8ab709c0 20 add_watcher() i=5 2024-09-12T17:33:15.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.575+0000 7f9f8ab709c0 20 add_watcher() i=6 2024-09-12T17:33:15.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.575+0000 7f9f8ab709c0 20 add_watcher() i=7 2024-09-12T17:33:15.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.575+0000 7f9f8ab709c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:15.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.579+0000 7f9e3f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:15.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.579+0000 7f9f8ab709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:15.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.579+0000 7f9f8ab709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:15.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.579+0000 7f9f8ab709c0 5 note: GC not initialized 2024-09-12T17:33:15.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.583+0000 7f9e3e7dc640 20 reqs_thread_entry: start 2024-09-12T17:33:15.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.583+0000 7f9f8ab709c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:15.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.583+0000 7f9f8ab709c0 20 Filter name: none 2024-09-12T17:33:15.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.583+0000 7f9e377fe640 20 reqs_thread_entry: start 2024-09-12T17:33:15.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.595+0000 7f9e3f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:15.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.599+0000 7f9f8ab709c0 20 remove_watcher() i=0 2024-09-12T17:33:15.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.599+0000 7f9f8ab709c0 2 removed watcher, disabling cache 2024-09-12T17:33:15.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.603+0000 7f9f8ab709c0 20 remove_watcher() i=1 2024-09-12T17:33:15.601 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.603+0000 7f9f8ab709c0 20 remove_watcher() i=2 2024-09-12T17:33:15.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.607+0000 7f9f8ab709c0 20 remove_watcher() i=3 2024-09-12T17:33:15.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.611+0000 7f9f8ab709c0 20 remove_watcher() i=4 2024-09-12T17:33:15.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.611+0000 7f9f8ab709c0 20 remove_watcher() i=5 2024-09-12T17:33:15.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.611+0000 7f9f8ab709c0 20 remove_watcher() i=6 2024-09-12T17:33:15.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.615+0000 7f9f8ab709c0 20 remove_watcher() i=7 2024-09-12T17:33:15.628 INFO:tasks.workunit.client.0.smithi119.stderr:bucket name a-bucket 2024-09-12T17:33:15.628 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard process non empty bucket 2024-09-12T17:33:15.628 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:15.629 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin reshard process 2024-09-12T17:33:15.657 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:15.657 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:15.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.707+0000 7f1c7c2c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.711+0000 7f1c7c2c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:15.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.711+0000 7f1c7c2c19c0 20 realm 2024-09-12T17:33:15.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.711+0000 7f1c7c2c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.711+0000 7f1c7c2c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:15.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.711+0000 7f1c7c2c19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:15.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.711+0000 7f1c7c2c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.711+0000 7f1c7c2c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:15.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.711+0000 7f1c7c2c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.711+0000 7f1c7c2c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:15.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.711+0000 7f1c7c2c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.715+0000 7f1c7c2c19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:15.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.715+0000 7f1c7c2c19c0 20 searching for the correct realm 2024-09-12T17:33:15.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.715+0000 7f1c7a5c8640 0 -- 172.21.15.119:0/4095664389 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f1c70015d80 msgr2=0x7f1c70090970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:15.720 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.723+0000 7f1c795c6640 0 -- 172.21.15.119:0/4095664389 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f1c74033040 msgr2=0x7f1c7404a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:15.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.939+0000 7f1c7c2c19c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:15.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.939+0000 7f1c7c2c19c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:15.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.939+0000 7f1c7c2c19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:15.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.939+0000 7f1c7c2c19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:15.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.939+0000 7f1c7c2c19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:15.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.939+0000 7f1c7c2c19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:15.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.939+0000 7f1c7c2c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.943+0000 7f1c7c2c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:15.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.943+0000 7f1c7c2c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.943+0000 7f1c7c2c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:15.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.943+0000 7f1c7c2c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.943+0000 7f1c7c2c19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:15.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.943+0000 7f1c7c2c19c0 20 zone default found 2024-09-12T17:33:15.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.943+0000 7f1c7c2c19c0 4 Realm: () 2024-09-12T17:33:15.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.943+0000 7f1c7c2c19c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:15.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.943+0000 7f1c7c2c19c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:15.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.943+0000 7f1c7c2c19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:15.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.943+0000 7f1c7c2c19c0 20 zonegroup default 2024-09-12T17:33:15.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.943+0000 7f1c7c2c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.943+0000 7f1c7c2c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:15.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.943+0000 7f1c7c2c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.943+0000 7f1c7c2c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:15.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.943+0000 7f1c7c2c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:15.942 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.947+0000 7f1c7c2c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:15.942 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.947+0000 7f1c7c2c19c0 20 started sync module instance, tier type = 2024-09-12T17:33:15.942 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.947+0000 7f1c7c2c19c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:15.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.967+0000 7f1c7c2c19c0 20 add_watcher() i=0 2024-09-12T17:33:15.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.967+0000 7f1c7c2c19c0 20 add_watcher() i=1 2024-09-12T17:33:15.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.967+0000 7f1c7c2c19c0 20 add_watcher() i=2 2024-09-12T17:33:15.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.967+0000 7f1c7c2c19c0 20 add_watcher() i=3 2024-09-12T17:33:15.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.967+0000 7f1c7c2c19c0 20 add_watcher() i=4 2024-09-12T17:33:15.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.967+0000 7f1c7c2c19c0 20 add_watcher() i=5 2024-09-12T17:33:15.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.967+0000 7f1c7c2c19c0 20 add_watcher() i=6 2024-09-12T17:33:15.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.967+0000 7f1c7c2c19c0 20 add_watcher() i=7 2024-09-12T17:33:15.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.967+0000 7f1c7c2c19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:15.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.971+0000 7f1b2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:15.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.975+0000 7f1c7c2c19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:15.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.975+0000 7f1c7c2c19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:15.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.975+0000 7f1c7c2c19c0 5 note: GC not initialized 2024-09-12T17:33:15.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.975+0000 7f1b2a7fc640 20 reqs_thread_entry: start 2024-09-12T17:33:15.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.975+0000 7f1c7c2c19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:15.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.975+0000 7f1c7c2c19c0 20 Filter name: none 2024-09-12T17:33:15.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.975+0000 7f1a9bfff640 20 reqs_thread_entry: start 2024-09-12T17:33:15.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.975+0000 7f1c7c2c19c0 20 processing logshard = reshard.0000000000 2024-09-12T17:33:15.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.979+0000 7f1c7c2c19c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:33:15.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.979+0000 7f1c7c2c19c0 20 processing logshard = reshard.0000000001 2024-09-12T17:33:15.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.983+0000 7f1c7c2c19c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:33:15.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.983+0000 7f1c7c2c19c0 20 processing logshard = reshard.0000000002 2024-09-12T17:33:15.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.991+0000 7f1c7c2c19c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:33:15.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.991+0000 7f1c7c2c19c0 20 processing logshard = reshard.0000000003 2024-09-12T17:33:15.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.995+0000 7f1c7c2c19c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:33:15.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.995+0000 7f1c7c2c19c0 20 processing logshard = reshard.0000000004 2024-09-12T17:33:15.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.999+0000 7f1c7c2c19c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:33:15.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:15.999+0000 7f1c7c2c19c0 20 processing logshard = reshard.0000000005 2024-09-12T17:33:16.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.007+0000 7f1c7c2c19c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:33:16.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.007+0000 7f1c7c2c19c0 20 processing logshard = reshard.0000000006 2024-09-12T17:33:16.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.011+0000 7f1c7c2c19c0 20 process_entry resharding a-bucket 2024-09-12T17:33:16.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.011+0000 7f1c7c2c19c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:33:16.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.011+0000 7f1c7c2c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.011+0000 7f1c7c2c19c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:33:16.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.011+0000 7f1c7c2c19c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:33:16.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.011+0000 7f1c7c2c19c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:33:16.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.011+0000 7f1c7c2c19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:33:16.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.011+0000 7f1c7c2c19c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.011+0000 7f1c7c2c19c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:33:16.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.011+0000 7f1c7c2c19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:33:16.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.011+0000 7f1c7c2c19c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:33:16.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.011+0000 7f1c7c2c19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:16.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.011+0000 7f1c7c2c19c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:33:16.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.011+0000 7f1c7c2c19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:33:16.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.027+0000 7f1c7c2c19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:33:16.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.027+0000 7f1c7c2c19c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:33:16.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.027+0000 7f1c7c2c19c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:33:16.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.027+0000 7f1c7c2c19c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:33:16.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.027+0000 7f1b5cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333479 cookie 94043302745840 notifier 6210 bl.length()=911 2024-09-12T17:33:16.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.027+0000 7f1b5cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:33:16.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.027+0000 7f1b5cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:33:16.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.027+0000 7f1b5cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:33:16.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.031+0000 7f1c7c2c19c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:33:16.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.031+0000 7f1c7c2c19c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:33:16.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.031+0000 7f1c7c2c19c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:33:16.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.031+0000 7f1c7c2c19c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:33:16.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:33:16.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:33:16.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:33:16.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:33:16.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:33:16.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:33:16.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:33:16.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:33:16.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:33:16.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:33:16.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:33:16.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:33:16.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:33:16.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:33:16.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:33:16.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:33:16.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:33:16.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:33:16.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:33:16.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:33:16.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:33:16.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:33:16.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:33:16.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:33:16.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:33:16.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:33:16.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.0 2024-09-12T17:33:16.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.039+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.0 2024-09-12T17:33:16.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.043+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.1 2024-09-12T17:33:16.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.043+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.1 2024-09-12T17:33:16.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.043+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.2 2024-09-12T17:33:16.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.043+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.2 2024-09-12T17:33:16.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.043+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.3 2024-09-12T17:33:16.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.043+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.3 2024-09-12T17:33:16.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.043+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.4 2024-09-12T17:33:16.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.043+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.4 2024-09-12T17:33:16.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.047+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.5 2024-09-12T17:33:16.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.047+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.5 2024-09-12T17:33:16.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.047+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.6 2024-09-12T17:33:16.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.047+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.6 2024-09-12T17:33:16.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.047+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.7 2024-09-12T17:33:16.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.047+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.7 2024-09-12T17:33:16.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.047+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.8 2024-09-12T17:33:16.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.047+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.8 2024-09-12T17:33:16.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.047+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.9 2024-09-12T17:33:16.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.047+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.9 2024-09-12T17:33:16.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.051+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.10 2024-09-12T17:33:16.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.051+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.10 2024-09-12T17:33:16.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.051+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.11 2024-09-12T17:33:16.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.051+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.11 2024-09-12T17:33:16.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.055+0000 7f1c7c2c19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:16.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.055+0000 7f1c7c2c19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:33:16.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.059+0000 7f1c7c2c19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:33:16.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.059+0000 7f1c7c2c19c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:33:16.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.059+0000 7f1c7c2c19c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:33:16.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.059+0000 7f1c7c2c19c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:33:16.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.059+0000 7f1b5d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333480 cookie 94043302745840 notifier 6210 bl.length()=911 2024-09-12T17:33:16.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.059+0000 7f1b5d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:33:16.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.059+0000 7f1b5d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:33:16.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.059+0000 7f1b5d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:33:16.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.063+0000 7f1c7c2c19c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:33:16.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.063+0000 7f1c7c2c19c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:33:16.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.063+0000 7f1c7c2c19c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:33:16.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.063+0000 7f1c7c2c19c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:33:16.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.067+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.0 2024-09-12T17:33:16.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.067+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.0 2024-09-12T17:33:16.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.067+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.1 2024-09-12T17:33:16.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.067+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.1 2024-09-12T17:33:16.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.071+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.2 2024-09-12T17:33:16.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.071+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.2 2024-09-12T17:33:16.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.071+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.3 2024-09-12T17:33:16.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.071+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.3 2024-09-12T17:33:16.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.071+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.4 2024-09-12T17:33:16.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.071+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.4 2024-09-12T17:33:16.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.071+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.5 2024-09-12T17:33:16.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.071+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.5 2024-09-12T17:33:16.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.071+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.6 2024-09-12T17:33:16.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.071+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.6 2024-09-12T17:33:16.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.071+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.7 2024-09-12T17:33:16.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.071+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.7 2024-09-12T17:33:16.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.075+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.8 2024-09-12T17:33:16.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.075+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.8 2024-09-12T17:33:16.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.075+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.9 2024-09-12T17:33:16.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.075+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.9 2024-09-12T17:33:16.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.075+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.10 2024-09-12T17:33:16.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.075+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.10 2024-09-12T17:33:16.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.075+0000 7f1c7c2c19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.11 2024-09-12T17:33:16.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.075+0000 7f1c7c2c19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.1.11 2024-09-12T17:33:16.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.075+0000 7f1c7c2c19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:16.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.075+0000 7f1c7c2c19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:33:16.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.079+0000 7f1c7c2c19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:33:16.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.079+0000 7f1c7c2c19c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:33:16.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.079+0000 7f1c7c2c19c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:33:16.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.079+0000 7f1c7c2c19c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:33:16.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.079+0000 7f1b5cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333481 cookie 94043302745840 notifier 6210 bl.length()=879 2024-09-12T17:33:16.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.079+0000 7f1b5cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:33:16.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.079+0000 7f1b5cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:33:16.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.079+0000 7f1b5cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:33:16.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.083+0000 7f1c7c2c19c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:33:16.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.083+0000 7f1c7c2c19c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:33:16.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.083+0000 7f1c7c2c19c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:33:16.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.083+0000 7f1c7c2c19c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:33:16.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.091+0000 7f1c7c2c19c0 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-12T17:33:16.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.091+0000 7f1c7c2c19c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:33:16.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.095+0000 7f1c7c2c19c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:33:16.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.095+0000 7f1c7c2c19c0 20 processing logshard = reshard.0000000007 2024-09-12T17:33:16.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.103+0000 7f1c7c2c19c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:33:16.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.103+0000 7f1c7c2c19c0 20 processing logshard = reshard.0000000008 2024-09-12T17:33:16.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.111+0000 7f1c7c2c19c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:33:16.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.111+0000 7f1c7c2c19c0 20 processing logshard = reshard.0000000009 2024-09-12T17:33:16.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.119+0000 7f1c7c2c19c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:33:16.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.119+0000 7f1c7c2c19c0 20 processing logshard = reshard.0000000010 2024-09-12T17:33:16.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.123+0000 7f1c7c2c19c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:33:16.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.123+0000 7f1c7c2c19c0 20 processing logshard = reshard.0000000011 2024-09-12T17:33:16.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.131+0000 7f1c7c2c19c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:33:16.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.131+0000 7f1c7c2c19c0 20 processing logshard = reshard.0000000012 2024-09-12T17:33:16.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.139+0000 7f1c7c2c19c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:33:16.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.139+0000 7f1c7c2c19c0 20 processing logshard = reshard.0000000013 2024-09-12T17:33:16.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.143+0000 7f1c7c2c19c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:33:16.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.143+0000 7f1c7c2c19c0 20 processing logshard = reshard.0000000014 2024-09-12T17:33:16.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.151+0000 7f1c7c2c19c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:33:16.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.151+0000 7f1c7c2c19c0 20 processing logshard = reshard.0000000015 2024-09-12T17:33:16.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.159+0000 7f1c7c2c19c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:33:16.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.159+0000 7f1b2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:16.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.163+0000 7f1c7c2c19c0 20 remove_watcher() i=0 2024-09-12T17:33:16.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.167+0000 7f1c7c2c19c0 2 removed watcher, disabling cache 2024-09-12T17:33:16.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.167+0000 7f1c7c2c19c0 20 remove_watcher() i=1 2024-09-12T17:33:16.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.171+0000 7f1c7c2c19c0 20 remove_watcher() i=2 2024-09-12T17:33:16.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.171+0000 7f1c7c2c19c0 20 remove_watcher() i=3 2024-09-12T17:33:16.171 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.175+0000 7f1c7c2c19c0 20 remove_watcher() i=4 2024-09-12T17:33:16.173 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.175+0000 7f1c7c2c19c0 20 remove_watcher() i=5 2024-09-12T17:33:16.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.179+0000 7f1c7c2c19c0 20 remove_watcher() i=6 2024-09-12T17:33:16.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.179+0000 7f1c7c2c19c0 20 remove_watcher() i=7 2024-09-12T17:33:16.196 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:33:16.226 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:16.226 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:16.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.275+0000 7f714968b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.279+0000 7f714968b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.279+0000 7f714968b9c0 20 realm 2024-09-12T17:33:16.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.279+0000 7f714968b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.279+0000 7f714968b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.279+0000 7f714968b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:16.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.279+0000 7f714968b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.279+0000 7f714968b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.279+0000 7f714968b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.279+0000 7f714968b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:16.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.279+0000 7f714968b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.283+0000 7f714968b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:16.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.283+0000 7f714968b9c0 20 searching for the correct realm 2024-09-12T17:33:16.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.283+0000 7f7147992640 0 -- 172.21.15.119:0/2493706022 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55eeb6af3880 msgr2=0x55eeb6af5c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:16.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.291+0000 7f713ffff640 0 -- 172.21.15.119:0/2493706022 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f7140018040 msgr2=0x7f7140026920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:16.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.507+0000 7f714968b9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:16.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.507+0000 7f714968b9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:16.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.507+0000 7f714968b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:16.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.507+0000 7f714968b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:16.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.507+0000 7f714968b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:16.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.507+0000 7f714968b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:16.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.507+0000 7f714968b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.507+0000 7f714968b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.507+0000 7f714968b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.505 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.507+0000 7f714968b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:16.505 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.507+0000 7f714968b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.506 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.511+0000 7f714968b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:16.506 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.511+0000 7f714968b9c0 20 zone default found 2024-09-12T17:33:16.506 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.511+0000 7f714968b9c0 4 Realm: () 2024-09-12T17:33:16.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.511+0000 7f714968b9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:16.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.511+0000 7f714968b9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:16.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.511+0000 7f714968b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:16.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.511+0000 7f714968b9c0 20 zonegroup default 2024-09-12T17:33:16.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.511+0000 7f714968b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.511+0000 7f714968b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.511+0000 7f714968b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.511+0000 7f714968b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.511+0000 7f714968b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.511+0000 7f714968b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.511+0000 7f714968b9c0 20 started sync module instance, tier type = 2024-09-12T17:33:16.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.511+0000 7f714968b9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:16.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.535+0000 7f714968b9c0 20 add_watcher() i=0 2024-09-12T17:33:16.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.535+0000 7f714968b9c0 20 add_watcher() i=1 2024-09-12T17:33:16.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.535+0000 7f714968b9c0 20 add_watcher() i=2 2024-09-12T17:33:16.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.535+0000 7f714968b9c0 20 add_watcher() i=3 2024-09-12T17:33:16.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.535+0000 7f714968b9c0 20 add_watcher() i=4 2024-09-12T17:33:16.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.535+0000 7f714968b9c0 20 add_watcher() i=5 2024-09-12T17:33:16.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.535+0000 7f714968b9c0 20 add_watcher() i=6 2024-09-12T17:33:16.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.539+0000 7f714968b9c0 20 add_watcher() i=7 2024-09-12T17:33:16.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.539+0000 7f714968b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:16.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.543+0000 7f6ffdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:16.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.543+0000 7f714968b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:16.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.543+0000 7f714968b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:16.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.543+0000 7f714968b9c0 5 note: GC not initialized 2024-09-12T17:33:16.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.543+0000 7f6ffcfe1640 20 reqs_thread_entry: start 2024-09-12T17:33:16.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.543+0000 7f714968b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:16.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.543+0000 7f714968b9c0 20 Filter name: none 2024-09-12T17:33:16.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.543+0000 7f6f767fc640 20 reqs_thread_entry: start 2024-09-12T17:33:16.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.543+0000 7f714968b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.541 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.543+0000 7f714968b9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:33:16.541 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.543+0000 7f714968b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.547+0000 7f714968b9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:33:16.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.547+0000 7f714968b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:16.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.547+0000 7f714968b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.547+0000 7f714968b9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:33:16.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.547+0000 7f714968b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.544 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.547+0000 7f714968b9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:33:16.544 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.547+0000 7f714968b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:16.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.551+0000 7f6ffdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:16.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.555+0000 7f714968b9c0 20 remove_watcher() i=0 2024-09-12T17:33:16.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.555+0000 7f714968b9c0 2 removed watcher, disabling cache 2024-09-12T17:33:16.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.559+0000 7f714968b9c0 20 remove_watcher() i=1 2024-09-12T17:33:16.556 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.559+0000 7f714968b9c0 20 remove_watcher() i=2 2024-09-12T17:33:16.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.563+0000 7f714968b9c0 20 remove_watcher() i=3 2024-09-12T17:33:16.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.563+0000 7f714968b9c0 20 remove_watcher() i=4 2024-09-12T17:33:16.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.567+0000 7f714968b9c0 20 remove_watcher() i=5 2024-09-12T17:33:16.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.567+0000 7f714968b9c0 20 remove_watcher() i=6 2024-09-12T17:33:16.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:16.567+0000 7f714968b9c0 20 remove_watcher() i=7 2024-09-12T17:33:16.581 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:16.581 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:33:16.581 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: a-bucket id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T17:33:16.581 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:16.581 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T17:33:16.581 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:18.745 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:33:18.779 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:18.779 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:18.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:18.831+0000 7f67627309c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:18.831+0000 7f67627309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:18.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:18.831+0000 7f67627309c0 20 realm 2024-09-12T17:33:18.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:18.831+0000 7f67627309c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:18.831+0000 7f67627309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:18.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:18.831+0000 7f67627309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:18.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:18.831+0000 7f67627309c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:18.831+0000 7f67627309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:18.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:18.831+0000 7f67627309c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:18.835+0000 7f67627309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:18.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:18.835+0000 7f67627309c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.832 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:18.835+0000 7f67627309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:18.833 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:18.835+0000 7f67627309c0 20 searching for the correct realm 2024-09-12T17:33:18.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:18.839+0000 7f6760a37640 0 -- 172.21.15.119:0/2733377620 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f674806e040 msgr2=0x7f67480636f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:19.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.055+0000 7f675fa35640 0 -- 172.21.15.119:0/2733377620 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f6750002b90 msgr2=0x7f67500d61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:19.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.271+0000 7f67627309c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:19.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.271+0000 7f67627309c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:19.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.271+0000 7f67627309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:19.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.271+0000 7f67627309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:19.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.271+0000 7f67627309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:19.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.271+0000 7f67627309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:19.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.271+0000 7f67627309c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.270 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.271+0000 7f67627309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.270 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.275+0000 7f67627309c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.270 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.275+0000 7f67627309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:19.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.275+0000 7f67627309c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.275+0000 7f67627309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:19.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.275+0000 7f67627309c0 20 zone default found 2024-09-12T17:33:19.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.275+0000 7f67627309c0 4 Realm: () 2024-09-12T17:33:19.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.275+0000 7f67627309c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:19.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.275+0000 7f67627309c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:19.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.275+0000 7f67627309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:19.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.275+0000 7f67627309c0 20 zonegroup default 2024-09-12T17:33:19.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.275+0000 7f67627309c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.275+0000 7f67627309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.275+0000 7f67627309c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.279+0000 7f67627309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.279+0000 7f67627309c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.279+0000 7f67627309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.279+0000 7f67627309c0 20 started sync module instance, tier type = 2024-09-12T17:33:19.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.279+0000 7f67627309c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:19.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.303+0000 7f67627309c0 20 add_watcher() i=0 2024-09-12T17:33:19.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.303+0000 7f67627309c0 20 add_watcher() i=1 2024-09-12T17:33:19.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.303+0000 7f67627309c0 20 add_watcher() i=2 2024-09-12T17:33:19.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.303+0000 7f67627309c0 20 add_watcher() i=3 2024-09-12T17:33:19.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.303+0000 7f67627309c0 20 add_watcher() i=4 2024-09-12T17:33:19.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.303+0000 7f67627309c0 20 add_watcher() i=5 2024-09-12T17:33:19.299 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.303+0000 7f67627309c0 20 add_watcher() i=6 2024-09-12T17:33:19.300 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.303+0000 7f67627309c0 20 add_watcher() i=7 2024-09-12T17:33:19.300 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.303+0000 7f67627309c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:19.305 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.307+0000 7f6616fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:19.306 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.311+0000 7f67627309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:19.306 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.311+0000 7f67627309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:19.306 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.311+0000 7f67627309c0 5 note: GC not initialized 2024-09-12T17:33:19.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.311+0000 7f6615fdb640 20 reqs_thread_entry: start 2024-09-12T17:33:19.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.311+0000 7f67627309c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:19.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.311+0000 7f67627309c0 20 Filter name: none 2024-09-12T17:33:19.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.311+0000 7f65877fe640 20 reqs_thread_entry: start 2024-09-12T17:33:19.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.311+0000 7f67627309c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.311+0000 7f67627309c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:33:19.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.311+0000 7f67627309c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.315+0000 7f67627309c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:33:19.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.315+0000 7f67627309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:19.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.315+0000 7f67627309c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.315+0000 7f67627309c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:33:19.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.315+0000 7f67627309c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.315+0000 7f67627309c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:33:19.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.315+0000 7f67627309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:19.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.319+0000 7f6616fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:19.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.323+0000 7f67627309c0 20 remove_watcher() i=0 2024-09-12T17:33:19.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.323+0000 7f67627309c0 2 removed watcher, disabling cache 2024-09-12T17:33:19.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.327+0000 7f67627309c0 20 remove_watcher() i=1 2024-09-12T17:33:19.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.327+0000 7f67627309c0 20 remove_watcher() i=2 2024-09-12T17:33:19.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.331+0000 7f67627309c0 20 remove_watcher() i=3 2024-09-12T17:33:19.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.331+0000 7f67627309c0 20 remove_watcher() i=4 2024-09-12T17:33:19.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.335+0000 7f67627309c0 20 remove_watcher() i=5 2024-09-12T17:33:19.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.335+0000 7f67627309c0 20 remove_watcher() i=6 2024-09-12T17:33:19.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.335+0000 7f67627309c0 20 remove_watcher() i=7 2024-09-12T17:33:19.349 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:19.350 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:33:19.350 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-init-index id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:33:19.350 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:19.350 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T17:33:19.386 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:19.386 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:19.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.435+0000 7f4e50ec09c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.435+0000 7f4e50ec09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.435+0000 7f4e50ec09c0 20 realm 2024-09-12T17:33:19.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.435+0000 7f4e50ec09c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.435+0000 7f4e50ec09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.435+0000 7f4e50ec09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:19.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.435+0000 7f4e50ec09c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.435+0000 7f4e50ec09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.435+0000 7f4e50ec09c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.439+0000 7f4e50ec09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:19.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.439+0000 7f4e50ec09c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.439+0000 7f4e50ec09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:19.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.439+0000 7f4e50ec09c0 20 searching for the correct realm 2024-09-12T17:33:19.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.443+0000 7f4e4f1c7640 0 -- 172.21.15.119:0/3965593147 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55e011f3cb10 msgr2=0x55e011f3ef20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:33:19.448 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.451+0000 7f4e47fff640 0 -- 172.21.15.119:0/3965593147 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f4e480513f0 msgr2=0x7f4e48051870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:33:19.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:19.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:19.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:19.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:19.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:19.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:19.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:19.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:19.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 zone default found 2024-09-12T17:33:19.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 4 Realm: () 2024-09-12T17:33:19.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:19.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:19.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:19.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 zonegroup default 2024-09-12T17:33:19.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.671+0000 7f4e50ec09c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.675+0000 7f4e50ec09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.675+0000 7f4e50ec09c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.675+0000 7f4e50ec09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.675+0000 7f4e50ec09c0 20 started sync module instance, tier type = 2024-09-12T17:33:19.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.675+0000 7f4e50ec09c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:19.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.699+0000 7f4e50ec09c0 20 add_watcher() i=0 2024-09-12T17:33:19.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.699+0000 7f4e50ec09c0 20 add_watcher() i=1 2024-09-12T17:33:19.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.699+0000 7f4e50ec09c0 20 add_watcher() i=2 2024-09-12T17:33:19.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.699+0000 7f4e50ec09c0 20 add_watcher() i=3 2024-09-12T17:33:19.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.699+0000 7f4e50ec09c0 20 add_watcher() i=4 2024-09-12T17:33:19.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.699+0000 7f4e50ec09c0 20 add_watcher() i=5 2024-09-12T17:33:19.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.699+0000 7f4e50ec09c0 20 add_watcher() i=6 2024-09-12T17:33:19.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.699+0000 7f4e50ec09c0 20 add_watcher() i=7 2024-09-12T17:33:19.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.699+0000 7f4e50ec09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:19.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.703+0000 7f4d057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:19.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.707+0000 7f4e50ec09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:19.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.707+0000 7f4e50ec09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:19.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.707+0000 7f4e50ec09c0 5 note: GC not initialized 2024-09-12T17:33:19.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.707+0000 7f4c7ffff640 20 reqs_thread_entry: start 2024-09-12T17:33:19.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.707+0000 7f4e50ec09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:19.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.707+0000 7f4e50ec09c0 20 Filter name: none 2024-09-12T17:33:19.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.707+0000 7f4c7dffb640 20 reqs_thread_entry: start 2024-09-12T17:33:19.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.707+0000 7f4e50ec09c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:33:19.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.707+0000 7f4e50ec09c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.707+0000 7f4e50ec09c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:33:19.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.707+0000 7f4e50ec09c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:33:19.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.707+0000 7f4e50ec09c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:33:19.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.707+0000 7f4e50ec09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 : miss 2024-09-12T17:33:19.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.707+0000 7f4e50ec09c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.711+0000 7f4e50ec09c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:33:19.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.711+0000 7f4e50ec09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 info.flags=0x17 2024-09-12T17:33:19.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.711+0000 7f4e50ec09c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 to cache LRU end 2024-09-12T17:33:19.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.711+0000 7f4e50ec09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:19.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.711+0000 7f4e50ec09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:19.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.711+0000 7f4e50ec09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 2024-09-12T17:33:19.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.711+0000 7f4e50ec09c0 -1 Injecting error=-5 at location=init_index 2024-09-12T17:33:19.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.711+0000 7f4e50ec09c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T17:33:19.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.715+0000 7f4d057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:19.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.719+0000 7f4e50ec09c0 20 remove_watcher() i=0 2024-09-12T17:33:19.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.719+0000 7f4e50ec09c0 2 removed watcher, disabling cache 2024-09-12T17:33:19.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.723+0000 7f4e50ec09c0 20 remove_watcher() i=1 2024-09-12T17:33:19.721 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.723+0000 7f4e50ec09c0 20 remove_watcher() i=2 2024-09-12T17:33:19.723 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.727+0000 7f4e50ec09c0 20 remove_watcher() i=3 2024-09-12T17:33:19.727 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.731+0000 7f4e50ec09c0 20 remove_watcher() i=4 2024-09-12T17:33:19.729 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.731+0000 7f4e50ec09c0 20 remove_watcher() i=5 2024-09-12T17:33:19.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.735+0000 7f4e50ec09c0 20 remove_watcher() i=6 2024-09-12T17:33:19.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.735+0000 7f4e50ec09c0 20 remove_watcher() i=7 2024-09-12T17:33:19.753 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:33:19.786 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:19.786 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:19.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.839+0000 7f7836bc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.839+0000 7f7836bc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.839+0000 7f7836bc79c0 20 realm 2024-09-12T17:33:19.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.839+0000 7f7836bc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.839+0000 7f7836bc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.839+0000 7f7836bc79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:19.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.839+0000 7f7836bc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.839+0000 7f7836bc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.839+0000 7f7836bc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.843+0000 7f7836bc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:19.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.843+0000 7f7836bc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.843+0000 7f7836bc79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:19.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.843+0000 7f7836bc79c0 20 searching for the correct realm 2024-09-12T17:33:19.843 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.847+0000 7f7834ece640 0 -- 172.21.15.119:0/2712728215 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f7828065b20 msgr2=0x7f7828090ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:19.850 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:19.855+0000 7f7833ecc640 0 -- 172.21.15.119:0/2712728215 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f782c06d2f0 msgr2=0x7f782c069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:33:20.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.071+0000 7f7836bc79c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:20.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.071+0000 7f7836bc79c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:20.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.071+0000 7f7836bc79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:20.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.071+0000 7f7836bc79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:20.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.071+0000 7f7836bc79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:20.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.071+0000 7f7836bc79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:20.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.071+0000 7f7836bc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.071+0000 7f7836bc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:20.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.071+0000 7f7836bc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:20.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:20.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 20 zone default found 2024-09-12T17:33:20.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 4 Realm: () 2024-09-12T17:33:20.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:20.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:20.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:20.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 20 zonegroup default 2024-09-12T17:33:20.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:20.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:20.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:20.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 20 started sync module instance, tier type = 2024-09-12T17:33:20.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.075+0000 7f7836bc79c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:20.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.103+0000 7f7836bc79c0 20 add_watcher() i=0 2024-09-12T17:33:20.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.103+0000 7f7836bc79c0 20 add_watcher() i=1 2024-09-12T17:33:20.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.103+0000 7f7836bc79c0 20 add_watcher() i=2 2024-09-12T17:33:20.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.103+0000 7f7836bc79c0 20 add_watcher() i=3 2024-09-12T17:33:20.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.103+0000 7f7836bc79c0 20 add_watcher() i=4 2024-09-12T17:33:20.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.103+0000 7f7836bc79c0 20 add_watcher() i=5 2024-09-12T17:33:20.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.103+0000 7f7836bc79c0 20 add_watcher() i=6 2024-09-12T17:33:20.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.103+0000 7f7836bc79c0 20 add_watcher() i=7 2024-09-12T17:33:20.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.103+0000 7f7836bc79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:20.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.107+0000 7f76eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:20.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.107+0000 7f7836bc79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:20.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.107+0000 7f7836bc79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:20.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.107+0000 7f7836bc79c0 5 note: GC not initialized 2024-09-12T17:33:20.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.111+0000 7f76e9fdb640 20 reqs_thread_entry: start 2024-09-12T17:33:20.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.111+0000 7f7836bc79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:20.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.111+0000 7f7836bc79c0 20 Filter name: none 2024-09-12T17:33:20.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.111+0000 7f765b7fe640 20 reqs_thread_entry: start 2024-09-12T17:33:20.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.111+0000 7f7836bc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.111+0000 7f7836bc79c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:33:20.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.111+0000 7f7836bc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.111+0000 7f7836bc79c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:33:20.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.111+0000 7f7836bc79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:20.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.111+0000 7f7836bc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.111+0000 7f7836bc79c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:33:20.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.111+0000 7f7836bc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.115+0000 7f7836bc79c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:33:20.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.115+0000 7f7836bc79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:20.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.119+0000 7f76eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:20.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.123+0000 7f7836bc79c0 20 remove_watcher() i=0 2024-09-12T17:33:20.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.123+0000 7f7836bc79c0 2 removed watcher, disabling cache 2024-09-12T17:33:20.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.123+0000 7f7836bc79c0 20 remove_watcher() i=1 2024-09-12T17:33:20.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.127+0000 7f7836bc79c0 20 remove_watcher() i=2 2024-09-12T17:33:20.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.131+0000 7f7836bc79c0 20 remove_watcher() i=3 2024-09-12T17:33:20.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.131+0000 7f7836bc79c0 20 remove_watcher() i=4 2024-09-12T17:33:20.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.131+0000 7f7836bc79c0 20 remove_watcher() i=5 2024-09-12T17:33:20.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.135+0000 7f7836bc79c0 20 remove_watcher() i=6 2024-09-12T17:33:20.132 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.135+0000 7f7836bc79c0 20 remove_watcher() i=7 2024-09-12T17:33:20.147 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:20.147 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:33:20.147 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-init-index id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:33:20.147 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:20.259 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:33:20.296 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:20.296 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:20.342 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.347+0000 7fcb854c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.347+0000 7fcb854c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:20.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.347+0000 7fcb854c79c0 20 realm 2024-09-12T17:33:20.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.347+0000 7fcb854c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.347+0000 7fcb854c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:20.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.347+0000 7fcb854c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:20.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.347+0000 7fcb854c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.347+0000 7fcb854c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:20.345 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.347+0000 7fcb854c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.351+0000 7fcb854c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:20.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.351+0000 7fcb854c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.351+0000 7fcb854c79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:20.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.351+0000 7fcb854c79c0 20 searching for the correct realm 2024-09-12T17:33:20.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.351+0000 7fcb827cc640 0 -- 172.21.15.119:0/1893862632 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fcb74008440 msgr2=0x7fcb74008860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:20.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.567+0000 7fcb837ce640 0 -- 172.21.15.119:0/1893862632 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fcb7802da70 msgr2=0x7fcb780620e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:20.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:20.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:20.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:20.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:20.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:20.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:20.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:20.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:20.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:20.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 20 zone default found 2024-09-12T17:33:20.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 4 Realm: () 2024-09-12T17:33:20.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:20.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:20.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:20.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 20 zonegroup default 2024-09-12T17:33:20.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.587+0000 7fcb854c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.591+0000 7fcb854c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:20.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.591+0000 7fcb854c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.591+0000 7fcb854c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:20.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.591+0000 7fcb854c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.591+0000 7fcb854c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:20.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.591+0000 7fcb854c79c0 20 started sync module instance, tier type = 2024-09-12T17:33:20.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.591+0000 7fcb854c79c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:20.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.619+0000 7fcb854c79c0 20 add_watcher() i=0 2024-09-12T17:33:20.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.619+0000 7fcb854c79c0 20 add_watcher() i=1 2024-09-12T17:33:20.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.619+0000 7fcb854c79c0 20 add_watcher() i=2 2024-09-12T17:33:20.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.619+0000 7fcb854c79c0 20 add_watcher() i=3 2024-09-12T17:33:20.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.619+0000 7fcb854c79c0 20 add_watcher() i=4 2024-09-12T17:33:20.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.619+0000 7fcb854c79c0 20 add_watcher() i=5 2024-09-12T17:33:20.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.619+0000 7fcb854c79c0 20 add_watcher() i=6 2024-09-12T17:33:20.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.623+0000 7fcb854c79c0 20 add_watcher() i=7 2024-09-12T17:33:20.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.623+0000 7fcb854c79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:20.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.627+0000 7fca397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:20.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.627+0000 7fcb854c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:20.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.627+0000 7fcb854c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:20.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.627+0000 7fcb854c79c0 5 note: GC not initialized 2024-09-12T17:33:20.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.627+0000 7fc9b3fff640 20 reqs_thread_entry: start 2024-09-12T17:33:20.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.627+0000 7fcb854c79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:20.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.627+0000 7fcb854c79c0 20 Filter name: none 2024-09-12T17:33:20.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.627+0000 7fc9b1ffb640 20 reqs_thread_entry: start 2024-09-12T17:33:20.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.627+0000 7fcb854c79c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:33:20.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.627+0000 7fcb854c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.631+0000 7fcb854c79c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:33:20.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.631+0000 7fcb854c79c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:33:20.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.631+0000 7fcb854c79c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:33:20.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.631+0000 7fcb854c79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 : miss 2024-09-12T17:33:20.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.631+0000 7fcb854c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.631+0000 7fcb854c79c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:33:20.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.631+0000 7fcb854c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 info.flags=0x17 2024-09-12T17:33:20.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.631+0000 7fcb854c79c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 to cache LRU end 2024-09-12T17:33:20.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.631+0000 7fcb854c79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:20.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.631+0000 7fcb854c79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:20.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.631+0000 7fcb854c79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 2024-09-12T17:33:20.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.643+0000 7fcb854c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 info.flags=0x17 2024-09-12T17:33:20.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.643+0000 7fcb854c79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 to cache LRU end 2024-09-12T17:33:20.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.643+0000 7fcb854c79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:20.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.643+0000 7fcb854c79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20, ofs0, ns] 2024-09-12T17:33:20.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.643+0000 7fca65ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333473 cookie 93857267713648 notifier 5996 bl.length()=995 2024-09-12T17:33:20.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.643+0000 7fca65ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 info.flags=0x17 2024-09-12T17:33:20.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.643+0000 7fca65ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 to cache LRU end 2024-09-12T17:33:20.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.643+0000 7fca65ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:20.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.647+0000 7fcb854c79c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20]): orig_sources= new_sources= 2024-09-12T17:33:20.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.647+0000 7fcb854c79c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20]): potential sources added=[] removed=[] 2024-09-12T17:33:20.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.647+0000 7fcb854c79c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20]): orig_dests= new_dests= 2024-09-12T17:33:20.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.647+0000 7fcb854c79c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20]): potential dests added=[] removed=[] 2024-09-12T17:33:20.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.0 2024-09-12T17:33:20.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.0 2024-09-12T17:33:20.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.1 2024-09-12T17:33:20.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.1 2024-09-12T17:33:20.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.2 2024-09-12T17:33:20.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.2 2024-09-12T17:33:20.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.3 2024-09-12T17:33:20.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.3 2024-09-12T17:33:20.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.4 2024-09-12T17:33:20.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.4 2024-09-12T17:33:20.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.5 2024-09-12T17:33:20.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.5 2024-09-12T17:33:20.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.6 2024-09-12T17:33:20.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.6 2024-09-12T17:33:20.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.7 2024-09-12T17:33:20.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.7 2024-09-12T17:33:20.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.8 2024-09-12T17:33:20.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.8 2024-09-12T17:33:20.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.9 2024-09-12T17:33:20.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.9 2024-09-12T17:33:20.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.10 2024-09-12T17:33:20.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.10 2024-09-12T17:33:20.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.11 2024-09-12T17:33:20.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1.11 2024-09-12T17:33:20.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.0 2024-09-12T17:33:20.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1 2024-09-12T17:33:20.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.2 2024-09-12T17:33:20.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.655+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.3 2024-09-12T17:33:20.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.659+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.4 2024-09-12T17:33:20.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.659+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.5 2024-09-12T17:33:20.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.659+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.6 2024-09-12T17:33:20.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.659+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.7 2024-09-12T17:33:20.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.663+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.8 2024-09-12T17:33:20.658 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.663+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.9 2024-09-12T17:33:20.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.663+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.10 2024-09-12T17:33:20.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.671+0000 7fcb854c79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:20.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.671+0000 7fcb854c79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 2024-09-12T17:33:20.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.671+0000 7fcb854c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 info.flags=0x17 2024-09-12T17:33:20.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.671+0000 7fcb854c79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 to cache LRU end 2024-09-12T17:33:20.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.671+0000 7fcb854c79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:20.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.671+0000 7fcb854c79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20, ofs0, ns] 2024-09-12T17:33:20.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.671+0000 7fca65ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333474 cookie 93857267713648 notifier 5996 bl.length()=995 2024-09-12T17:33:20.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.671+0000 7fca65ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 info.flags=0x17 2024-09-12T17:33:20.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.671+0000 7fca65ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 to cache LRU end 2024-09-12T17:33:20.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.671+0000 7fca65ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:20.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.675+0000 7fcb854c79c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20]): orig_sources= new_sources= 2024-09-12T17:33:20.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.675+0000 7fcb854c79c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20]): potential sources added=[] removed=[] 2024-09-12T17:33:20.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.675+0000 7fcb854c79c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20]): orig_dests= new_dests= 2024-09-12T17:33:20.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.675+0000 7fcb854c79c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20]): potential dests added=[] removed=[] 2024-09-12T17:33:20.675 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.679+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.0 2024-09-12T17:33:20.676 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.679+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.1 2024-09-12T17:33:20.676 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.679+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.2 2024-09-12T17:33:20.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.679+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.3 2024-09-12T17:33:20.678 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.683+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.4 2024-09-12T17:33:20.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.683+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.5 2024-09-12T17:33:20.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.683+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.6 2024-09-12T17:33:20.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.683+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.7 2024-09-12T17:33:20.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.683+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.8 2024-09-12T17:33:20.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.683+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.9 2024-09-12T17:33:20.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.687+0000 7fcb854c79c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20.10 2024-09-12T17:33:20.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.687+0000 7fcb854c79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:20.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.687+0000 7fcb854c79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 2024-09-12T17:33:20.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.687+0000 7fcb854c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 info.flags=0x17 2024-09-12T17:33:20.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.687+0000 7fcb854c79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 to cache LRU end 2024-09-12T17:33:20.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.687+0000 7fcb854c79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:20.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.687+0000 7fcb854c79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20, ofs0, ns] 2024-09-12T17:33:20.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.687+0000 7fca667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333475 cookie 93857267713648 notifier 5996 bl.length()=963 2024-09-12T17:33:20.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.687+0000 7fca667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 info.flags=0x17 2024-09-12T17:33:20.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.687+0000 7fca667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 to cache LRU end 2024-09-12T17:33:20.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.687+0000 7fca667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:20.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.691+0000 7fcb854c79c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20]): orig_sources= new_sources= 2024-09-12T17:33:20.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.691+0000 7fcb854c79c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20]): potential sources added=[] removed=[] 2024-09-12T17:33:20.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.691+0000 7fcb854c79c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20]): orig_dests= new_dests= 2024-09-12T17:33:20.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.691+0000 7fcb854c79c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20]): potential dests added=[] removed=[] 2024-09-12T17:33:20.693 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.695+0000 7fcb854c79c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T17:33:20.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.699+0000 7fca397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:20.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.707+0000 7fcb854c79c0 20 remove_watcher() i=0 2024-09-12T17:33:20.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.707+0000 7fcb854c79c0 2 removed watcher, disabling cache 2024-09-12T17:33:20.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.711+0000 7fcb854c79c0 20 remove_watcher() i=1 2024-09-12T17:33:20.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.715+0000 7fcb854c79c0 20 remove_watcher() i=2 2024-09-12T17:33:20.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.719+0000 7fcb854c79c0 20 remove_watcher() i=3 2024-09-12T17:33:20.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.723+0000 7fcb854c79c0 20 remove_watcher() i=4 2024-09-12T17:33:20.721 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.723+0000 7fcb854c79c0 20 remove_watcher() i=5 2024-09-12T17:33:20.723 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.727+0000 7fcb854c79c0 20 remove_watcher() i=6 2024-09-12T17:33:20.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.727+0000 7fcb854c79c0 20 remove_watcher() i=7 2024-09-12T17:33:20.747 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:33:20.782 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:20.783 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:20.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.831+0000 7fb0d66239c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.830 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.835+0000 7fb0d66239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:20.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.835+0000 7fb0d66239c0 20 realm 2024-09-12T17:33:20.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.835+0000 7fb0d66239c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.835+0000 7fb0d66239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:20.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.835+0000 7fb0d66239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:20.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.835+0000 7fb0d66239c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.835+0000 7fb0d66239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:20.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.835+0000 7fb0d66239c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.832 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.835+0000 7fb0d66239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:20.832 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.835+0000 7fb0d66239c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:20.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.839+0000 7fb0d66239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:20.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.839+0000 7fb0d66239c0 20 searching for the correct realm 2024-09-12T17:33:20.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.839+0000 7fb0d492a640 0 -- 172.21.15.119:0/188772346 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fb0c8101040 msgr2=0x7fb0c80d19d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:20.844 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:20.847+0000 7fb0d3928640 0 -- 172.21.15.119:0/188772346 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fb0cc05aef0 msgr2=0x7fb0cc0476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:21.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.063+0000 7fb0d66239c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:21.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.063+0000 7fb0d66239c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:21.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.063+0000 7fb0d66239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:21.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.063+0000 7fb0d66239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:21.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.063+0000 7fb0d66239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:21.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.063+0000 7fb0d66239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:21.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.063+0000 7fb0d66239c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.063+0000 7fb0d66239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.063+0000 7fb0d66239c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.067+0000 7fb0d66239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:21.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.067+0000 7fb0d66239c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.067+0000 7fb0d66239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:21.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.067+0000 7fb0d66239c0 20 zone default found 2024-09-12T17:33:21.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.067+0000 7fb0d66239c0 4 Realm: () 2024-09-12T17:33:21.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.067+0000 7fb0d66239c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:21.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.067+0000 7fb0d66239c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:21.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.067+0000 7fb0d66239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:21.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.067+0000 7fb0d66239c0 20 zonegroup default 2024-09-12T17:33:21.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.067+0000 7fb0d66239c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.067+0000 7fb0d66239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.067+0000 7fb0d66239c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.067+0000 7fb0d66239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.067+0000 7fb0d66239c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.071+0000 7fb0d66239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.071+0000 7fb0d66239c0 20 started sync module instance, tier type = 2024-09-12T17:33:21.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.071+0000 7fb0d66239c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:21.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.095+0000 7fb0d66239c0 20 add_watcher() i=0 2024-09-12T17:33:21.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.095+0000 7fb0d66239c0 20 add_watcher() i=1 2024-09-12T17:33:21.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.095+0000 7fb0d66239c0 20 add_watcher() i=2 2024-09-12T17:33:21.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.095+0000 7fb0d66239c0 20 add_watcher() i=3 2024-09-12T17:33:21.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.095+0000 7fb0d66239c0 20 add_watcher() i=4 2024-09-12T17:33:21.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.095+0000 7fb0d66239c0 20 add_watcher() i=5 2024-09-12T17:33:21.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.095+0000 7fb0d66239c0 20 add_watcher() i=6 2024-09-12T17:33:21.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.099+0000 7fb0d66239c0 20 add_watcher() i=7 2024-09-12T17:33:21.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.099+0000 7fb0d66239c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:21.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.107+0000 7faf8afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:21.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.107+0000 7fb0d66239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:21.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.107+0000 7fb0d66239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:21.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.107+0000 7fb0d66239c0 5 note: GC not initialized 2024-09-12T17:33:21.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.107+0000 7faf89fdb640 20 reqs_thread_entry: start 2024-09-12T17:33:21.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.107+0000 7fb0d66239c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:21.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.107+0000 7fb0d66239c0 20 Filter name: none 2024-09-12T17:33:21.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.107+0000 7faefb7fe640 20 reqs_thread_entry: start 2024-09-12T17:33:21.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.107+0000 7fb0d66239c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.107+0000 7fb0d66239c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:33:21.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.107+0000 7fb0d66239c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.111+0000 7fb0d66239c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:33:21.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.111+0000 7fb0d66239c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:21.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.111+0000 7fb0d66239c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.111+0000 7fb0d66239c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:33:21.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.111+0000 7fb0d66239c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.111+0000 7fb0d66239c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:33:21.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.111+0000 7fb0d66239c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:21.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.115+0000 7faf8afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:21.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.119+0000 7fb0d66239c0 20 remove_watcher() i=0 2024-09-12T17:33:21.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.119+0000 7fb0d66239c0 2 removed watcher, disabling cache 2024-09-12T17:33:21.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.123+0000 7fb0d66239c0 20 remove_watcher() i=1 2024-09-12T17:33:21.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.123+0000 7fb0d66239c0 20 remove_watcher() i=2 2024-09-12T17:33:21.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.127+0000 7fb0d66239c0 20 remove_watcher() i=3 2024-09-12T17:33:21.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.127+0000 7fb0d66239c0 20 remove_watcher() i=4 2024-09-12T17:33:21.126 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.131+0000 7fb0d66239c0 20 remove_watcher() i=5 2024-09-12T17:33:21.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.131+0000 7fb0d66239c0 20 remove_watcher() i=6 2024-09-12T17:33:21.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:21.131+0000 7fb0d66239c0 20 remove_watcher() i=7 2024-09-12T17:33:21.148 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:21.148 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:33:21.148 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-init-index id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:33:21.148 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:22.067 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T17:33:22.067 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:24.239 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:33:24.271 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:24.271 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:24.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.319+0000 7f665f0ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.323+0000 7f665f0ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.323+0000 7f665f0ad9c0 20 realm 2024-09-12T17:33:24.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.323+0000 7f665f0ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.323+0000 7f665f0ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.323+0000 7f665f0ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:24.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.323+0000 7f665f0ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.323+0000 7f665f0ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.323+0000 7f665f0ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.323+0000 7f665f0ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:24.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.323+0000 7f665f0ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.327+0000 7f665f0ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:24.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.327+0000 7f665f0ad9c0 20 searching for the correct realm 2024-09-12T17:33:24.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.331+0000 7f665d3b4640 0 -- 172.21.15.119:0/954351568 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55bd17e3bea0 msgr2=0x55bd17e3e290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:24.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.335+0000 7f665c3b2640 0 -- 172.21.15.119:0/954351568 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f66540ff8f0 msgr2=0x7f66541111c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:33:24.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.551+0000 7f665f0ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:24.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.551+0000 7f665f0ad9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:24.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.551+0000 7f665f0ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:24.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.551+0000 7f665f0ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:24.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.551+0000 7f665f0ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:24.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.551+0000 7f665f0ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:24.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.551+0000 7f665f0ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.551+0000 7f665f0ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.551+0000 7f665f0ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:24.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:24.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 20 zone default found 2024-09-12T17:33:24.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 4 Realm: () 2024-09-12T17:33:24.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:24.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:24.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:24.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 20 zonegroup default 2024-09-12T17:33:24.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 20 started sync module instance, tier type = 2024-09-12T17:33:24.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.555+0000 7f665f0ad9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:24.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.583+0000 7f665f0ad9c0 20 add_watcher() i=0 2024-09-12T17:33:24.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.583+0000 7f665f0ad9c0 20 add_watcher() i=1 2024-09-12T17:33:24.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.583+0000 7f665f0ad9c0 20 add_watcher() i=2 2024-09-12T17:33:24.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.583+0000 7f665f0ad9c0 20 add_watcher() i=3 2024-09-12T17:33:24.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.583+0000 7f665f0ad9c0 20 add_watcher() i=4 2024-09-12T17:33:24.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.583+0000 7f665f0ad9c0 20 add_watcher() i=5 2024-09-12T17:33:24.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.583+0000 7f665f0ad9c0 20 add_watcher() i=6 2024-09-12T17:33:24.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.587+0000 7f665f0ad9c0 20 add_watcher() i=7 2024-09-12T17:33:24.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.587+0000 7f665f0ad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:24.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.591+0000 7f65137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:24.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.591+0000 7f665f0ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:24.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.591+0000 7f665f0ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:24.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.591+0000 7f665f0ad9c0 5 note: GC not initialized 2024-09-12T17:33:24.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.591+0000 7f65127e4640 20 reqs_thread_entry: start 2024-09-12T17:33:24.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.591+0000 7f665f0ad9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:24.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.591+0000 7f665f0ad9c0 20 Filter name: none 2024-09-12T17:33:24.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.591+0000 7f650b7fe640 20 reqs_thread_entry: start 2024-09-12T17:33:24.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.591+0000 7f665f0ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.595+0000 7f665f0ad9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:33:24.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.595+0000 7f665f0ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.595+0000 7f665f0ad9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:33:24.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.595+0000 7f665f0ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:24.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.595+0000 7f665f0ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.595+0000 7f665f0ad9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:33:24.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.595+0000 7f665f0ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.595+0000 7f665f0ad9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:33:24.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.595+0000 7f665f0ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:24.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.599+0000 7f65137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:24.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.607+0000 7f665f0ad9c0 20 remove_watcher() i=0 2024-09-12T17:33:24.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.607+0000 7f665f0ad9c0 2 removed watcher, disabling cache 2024-09-12T17:33:24.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.607+0000 7f665f0ad9c0 20 remove_watcher() i=1 2024-09-12T17:33:24.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.611+0000 7f665f0ad9c0 20 remove_watcher() i=2 2024-09-12T17:33:24.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.611+0000 7f665f0ad9c0 20 remove_watcher() i=3 2024-09-12T17:33:24.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.615+0000 7f665f0ad9c0 20 remove_watcher() i=4 2024-09-12T17:33:24.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.615+0000 7f665f0ad9c0 20 remove_watcher() i=5 2024-09-12T17:33:24.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.619+0000 7f665f0ad9c0 20 remove_watcher() i=6 2024-09-12T17:33:24.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.619+0000 7f665f0ad9c0 20 remove_watcher() i=7 2024-09-12T17:33:24.633 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:24.633 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:33:24.633 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-init-index id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:33:24.633 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:24.633 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T17:33:24.668 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:24.668 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:24.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.719+0000 7f86fcbeb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.719+0000 7f86fcbeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.719+0000 7f86fcbeb9c0 20 realm 2024-09-12T17:33:24.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.719+0000 7f86fcbeb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.719+0000 7f86fcbeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.719+0000 7f86fcbeb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:24.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.719+0000 7f86fcbeb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.719+0000 7f86fcbeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.719+0000 7f86fcbeb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.723+0000 7f86fcbeb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:24.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.723+0000 7f86fcbeb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.723+0000 7f86fcbeb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:24.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.723+0000 7f86fcbeb9c0 20 searching for the correct realm 2024-09-12T17:33:24.723 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.727+0000 7f86faef2640 0 -- 172.21.15.119:0/1083347098 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55b40f7261c0 msgr2=0x55b40f7285b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:24.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.735+0000 7f86f9ef0640 0 -- 172.21.15.119:0/1083347098 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f86f406c570 msgr2=0x7f86f4064aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:24.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.951+0000 7f86fcbeb9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:24.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.951+0000 7f86fcbeb9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:24.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.951+0000 7f86fcbeb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:24.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.951+0000 7f86fcbeb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:24.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.951+0000 7f86fcbeb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:24.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.951+0000 7f86fcbeb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:24.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.951+0000 7f86fcbeb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.951+0000 7f86fcbeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.951+0000 7f86fcbeb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.955+0000 7f86fcbeb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:24.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.955+0000 7f86fcbeb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.955+0000 7f86fcbeb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:24.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.955+0000 7f86fcbeb9c0 20 zone default found 2024-09-12T17:33:24.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.955+0000 7f86fcbeb9c0 4 Realm: () 2024-09-12T17:33:24.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.955+0000 7f86fcbeb9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:24.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.955+0000 7f86fcbeb9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:24.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.955+0000 7f86fcbeb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:24.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.955+0000 7f86fcbeb9c0 20 zonegroup default 2024-09-12T17:33:24.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.955+0000 7f86fcbeb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.955+0000 7f86fcbeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.955+0000 7f86fcbeb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.955+0000 7f86fcbeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.955+0000 7f86fcbeb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.959+0000 7f86fcbeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.959+0000 7f86fcbeb9c0 20 started sync module instance, tier type = 2024-09-12T17:33:24.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.959+0000 7f86fcbeb9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:24.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.979+0000 7f86fcbeb9c0 20 add_watcher() i=0 2024-09-12T17:33:24.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.979+0000 7f86fcbeb9c0 20 add_watcher() i=1 2024-09-12T17:33:24.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.979+0000 7f86fcbeb9c0 20 add_watcher() i=2 2024-09-12T17:33:24.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.979+0000 7f86fcbeb9c0 20 add_watcher() i=3 2024-09-12T17:33:24.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.979+0000 7f86fcbeb9c0 20 add_watcher() i=4 2024-09-12T17:33:24.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.979+0000 7f86fcbeb9c0 20 add_watcher() i=5 2024-09-12T17:33:24.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.979+0000 7f86fcbeb9c0 20 add_watcher() i=6 2024-09-12T17:33:24.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.983+0000 7f86fcbeb9c0 20 add_watcher() i=7 2024-09-12T17:33:24.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.983+0000 7f86fcbeb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:24.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.987+0000 7f85b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:24.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.987+0000 7f86fcbeb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:24.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.987+0000 7f86fcbeb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:24.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.987+0000 7f86fcbeb9c0 5 note: GC not initialized 2024-09-12T17:33:24.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.987+0000 7f852b7fe640 20 reqs_thread_entry: start 2024-09-12T17:33:24.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.987+0000 7f86fcbeb9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:24.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.987+0000 7f86fcbeb9c0 20 Filter name: none 2024-09-12T17:33:24.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.991+0000 7f85297fa640 20 reqs_thread_entry: start 2024-09-12T17:33:24.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.991+0000 7f86fcbeb9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:33:24.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.991+0000 7f86fcbeb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.991+0000 7f86fcbeb9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:33:24.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.991+0000 7f86fcbeb9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:33:24.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.991+0000 7f86fcbeb9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:33:24.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.991+0000 7f86fcbeb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21 : miss 2024-09-12T17:33:24.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.991+0000 7f86fcbeb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.991+0000 7f86fcbeb9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:33:24.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.991+0000 7f86fcbeb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21 info.flags=0x17 2024-09-12T17:33:24.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.991+0000 7f86fcbeb9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21 to cache LRU end 2024-09-12T17:33:24.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.991+0000 7f86fcbeb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:24.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.991+0000 7f86fcbeb9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:24.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.991+0000 7f86fcbeb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21 2024-09-12T17:33:24.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.995+0000 7f86fcbeb9c0 -1 Injecting error=-95 at location=init_index 2024-09-12T17:33:24.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:24.995+0000 7f86fcbeb9c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:33:24.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.003+0000 7f86fcbeb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21 info.flags=0x17 2024-09-12T17:33:24.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.003+0000 7f86fcbeb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21 to cache LRU end 2024-09-12T17:33:24.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.003+0000 7f86fcbeb9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:24.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.003+0000 7f86fcbeb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21, ofs0, ns] 2024-09-12T17:33:24.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.003+0000 7f85ddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333478 cookie 94231841668416 notifier 6041 bl.length()=995 2024-09-12T17:33:24.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.003+0000 7f85ddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21 info.flags=0x17 2024-09-12T17:33:24.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.003+0000 7f85ddffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21 to cache LRU end 2024-09-12T17:33:24.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.003+0000 7f85ddffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:25.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.007+0000 7f86fcbeb9c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21]): orig_sources= new_sources= 2024-09-12T17:33:25.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.007+0000 7f86fcbeb9c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21]): potential sources added=[] removed=[] 2024-09-12T17:33:25.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.007+0000 7f86fcbeb9c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21]): orig_dests= new_dests= 2024-09-12T17:33:25.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.007+0000 7f86fcbeb9c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21]): potential dests added=[] removed=[] 2024-09-12T17:33:25.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.0 2024-09-12T17:33:25.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.0 2024-09-12T17:33:25.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.1 2024-09-12T17:33:25.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.1 2024-09-12T17:33:25.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.2 2024-09-12T17:33:25.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.2 2024-09-12T17:33:25.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.3 2024-09-12T17:33:25.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.3 2024-09-12T17:33:25.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.4 2024-09-12T17:33:25.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.4 2024-09-12T17:33:25.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.5 2024-09-12T17:33:25.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.5 2024-09-12T17:33:25.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.6 2024-09-12T17:33:25.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.6 2024-09-12T17:33:25.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.7 2024-09-12T17:33:25.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.7 2024-09-12T17:33:25.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.8 2024-09-12T17:33:25.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.8 2024-09-12T17:33:25.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.9 2024-09-12T17:33:25.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.9 2024-09-12T17:33:25.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.10 2024-09-12T17:33:25.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.10 2024-09-12T17:33:25.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.11 2024-09-12T17:33:25.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1.11 2024-09-12T17:33:25.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.0 2024-09-12T17:33:25.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.011+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.1 2024-09-12T17:33:25.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.015+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.2 2024-09-12T17:33:25.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.015+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.3 2024-09-12T17:33:25.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.015+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.4 2024-09-12T17:33:25.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.019+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.5 2024-09-12T17:33:25.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.019+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.6 2024-09-12T17:33:25.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.019+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.7 2024-09-12T17:33:25.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.023+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.8 2024-09-12T17:33:25.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.023+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.9 2024-09-12T17:33:25.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.023+0000 7f86fcbeb9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21.10 2024-09-12T17:33:25.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.031+0000 7f86fcbeb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:25.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.031+0000 7f86fcbeb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21 2024-09-12T17:33:25.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.035+0000 7f86fcbeb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21 info.flags=0x17 2024-09-12T17:33:25.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.035+0000 7f86fcbeb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21 to cache LRU end 2024-09-12T17:33:25.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.035+0000 7f86fcbeb9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:25.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.035+0000 7f86fcbeb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21, ofs0, ns] 2024-09-12T17:33:25.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.035+0000 7f85dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333479 cookie 94231841668416 notifier 6041 bl.length()=963 2024-09-12T17:33:25.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.035+0000 7f85dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21 info.flags=0x17 2024-09-12T17:33:25.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.035+0000 7f85dd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21 to cache LRU end 2024-09-12T17:33:25.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.035+0000 7f85dd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:25.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.039+0000 7f86fcbeb9c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21]): orig_sources= new_sources= 2024-09-12T17:33:25.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.039+0000 7f86fcbeb9c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21]): potential sources added=[] removed=[] 2024-09-12T17:33:25.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.039+0000 7f86fcbeb9c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21]): orig_dests= new_dests= 2024-09-12T17:33:25.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.039+0000 7f86fcbeb9c0 20 handle_bi_update(): bucket=:error-at-init-index[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21]): potential dests added=[] removed=[] 2024-09-12T17:33:25.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.043+0000 7f86fcbeb9c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T17:33:25.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.047+0000 7f85b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:25.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.051+0000 7f86fcbeb9c0 20 remove_watcher() i=0 2024-09-12T17:33:25.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.051+0000 7f86fcbeb9c0 2 removed watcher, disabling cache 2024-09-12T17:33:25.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.055+0000 7f86fcbeb9c0 20 remove_watcher() i=1 2024-09-12T17:33:25.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.055+0000 7f86fcbeb9c0 20 remove_watcher() i=2 2024-09-12T17:33:25.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.055+0000 7f86fcbeb9c0 20 remove_watcher() i=3 2024-09-12T17:33:25.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.059+0000 7f86fcbeb9c0 20 remove_watcher() i=4 2024-09-12T17:33:25.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.059+0000 7f86fcbeb9c0 20 remove_watcher() i=5 2024-09-12T17:33:25.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.063+0000 7f86fcbeb9c0 20 remove_watcher() i=6 2024-09-12T17:33:25.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.063+0000 7f86fcbeb9c0 20 remove_watcher() i=7 2024-09-12T17:33:25.075 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:33:25.105 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:25.106 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:25.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.155+0000 7ff66be329c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:25.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.155+0000 7ff66be329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:25.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.155+0000 7ff66be329c0 20 realm 2024-09-12T17:33:25.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.155+0000 7ff66be329c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:25.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.155+0000 7ff66be329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:25.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.155+0000 7ff66be329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:25.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.155+0000 7ff66be329c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:25.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.159+0000 7ff66be329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:25.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.159+0000 7ff66be329c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:25.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.159+0000 7ff66be329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:25.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.159+0000 7ff66be329c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:25.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.159+0000 7ff66be329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:25.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.159+0000 7ff66be329c0 20 searching for the correct realm 2024-09-12T17:33:25.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.163+0000 7ff663fff640 0 -- 172.21.15.119:0/4091086588 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7ff65c067750 msgr2=0x7ff65c0658c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:25.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.379+0000 7ff66a139640 0 -- 172.21.15.119:0/4091086588 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7ff6540d3040 msgr2=0x7ff6540d2410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:25.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.395+0000 7ff66be329c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:25.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.395+0000 7ff66be329c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:25.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.395+0000 7ff66be329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:25.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.395+0000 7ff66be329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:25.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.395+0000 7ff66be329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:25.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.395+0000 7ff66be329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:25.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.395+0000 7ff66be329c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:25.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.395+0000 7ff66be329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:25.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.395+0000 7ff66be329c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:25.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.395+0000 7ff66be329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:25.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.395+0000 7ff66be329c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:25.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.399+0000 7ff66be329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:25.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.399+0000 7ff66be329c0 20 zone default found 2024-09-12T17:33:25.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.399+0000 7ff66be329c0 4 Realm: () 2024-09-12T17:33:25.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.399+0000 7ff66be329c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:25.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.399+0000 7ff66be329c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:25.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.399+0000 7ff66be329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:25.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.399+0000 7ff66be329c0 20 zonegroup default 2024-09-12T17:33:25.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.399+0000 7ff66be329c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:25.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.399+0000 7ff66be329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:25.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.399+0000 7ff66be329c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:25.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.399+0000 7ff66be329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:25.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.399+0000 7ff66be329c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:25.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.399+0000 7ff66be329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:25.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.399+0000 7ff66be329c0 20 started sync module instance, tier type = 2024-09-12T17:33:25.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.399+0000 7ff66be329c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:25.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.423+0000 7ff66be329c0 20 add_watcher() i=0 2024-09-12T17:33:25.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.423+0000 7ff66be329c0 20 add_watcher() i=1 2024-09-12T17:33:25.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.423+0000 7ff66be329c0 20 add_watcher() i=2 2024-09-12T17:33:25.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.423+0000 7ff66be329c0 20 add_watcher() i=3 2024-09-12T17:33:25.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.423+0000 7ff66be329c0 20 add_watcher() i=4 2024-09-12T17:33:25.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.423+0000 7ff66be329c0 20 add_watcher() i=5 2024-09-12T17:33:25.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.423+0000 7ff66be329c0 20 add_watcher() i=6 2024-09-12T17:33:25.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.423+0000 7ff66be329c0 20 add_watcher() i=7 2024-09-12T17:33:25.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.423+0000 7ff66be329c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:25.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.427+0000 7ff51b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:25.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.427+0000 7ff66be329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:25.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.427+0000 7ff66be329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:25.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.427+0000 7ff66be329c0 5 note: GC not initialized 2024-09-12T17:33:25.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.431+0000 7ff51a7fc640 20 reqs_thread_entry: start 2024-09-12T17:33:25.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.431+0000 7ff66be329c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:25.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.431+0000 7ff66be329c0 20 Filter name: none 2024-09-12T17:33:25.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.431+0000 7ff48bfff640 20 reqs_thread_entry: start 2024-09-12T17:33:25.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.431+0000 7ff66be329c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:25.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.431+0000 7ff66be329c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:33:25.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.431+0000 7ff66be329c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:25.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.431+0000 7ff66be329c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:33:25.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.431+0000 7ff66be329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:25.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.431+0000 7ff66be329c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:25.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.435+0000 7ff66be329c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:33:25.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.435+0000 7ff66be329c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:25.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.435+0000 7ff66be329c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:33:25.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.435+0000 7ff66be329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:25.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.439+0000 7ff51b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:25.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.443+0000 7ff66be329c0 20 remove_watcher() i=0 2024-09-12T17:33:25.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.443+0000 7ff66be329c0 2 removed watcher, disabling cache 2024-09-12T17:33:25.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.443+0000 7ff66be329c0 20 remove_watcher() i=1 2024-09-12T17:33:25.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.447+0000 7ff66be329c0 20 remove_watcher() i=2 2024-09-12T17:33:25.445 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.447+0000 7ff66be329c0 20 remove_watcher() i=3 2024-09-12T17:33:25.448 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.451+0000 7ff66be329c0 20 remove_watcher() i=4 2024-09-12T17:33:25.449 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.451+0000 7ff66be329c0 20 remove_watcher() i=5 2024-09-12T17:33:25.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.455+0000 7ff66be329c0 20 remove_watcher() i=6 2024-09-12T17:33:25.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:25.455+0000 7ff66be329c0 20 remove_watcher() i=7 2024-09-12T17:33:25.469 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:25.469 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:33:25.469 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-init-index id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:33:25.469 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:26.420 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T17:33:26.421 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:28.583 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:33:28.615 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:28.616 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:28.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.667+0000 7f4a66e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:28.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.667+0000 7f4a66e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:28.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.667+0000 7f4a66e6d9c0 20 realm 2024-09-12T17:33:28.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.667+0000 7f4a66e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:28.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.667+0000 7f4a66e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:28.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.667+0000 7f4a66e6d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:28.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.671+0000 7f4a66e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:28.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.671+0000 7f4a66e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:28.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.671+0000 7f4a66e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:28.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.671+0000 7f4a66e6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:28.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.671+0000 7f4a66e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:28.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.671+0000 7f4a66e6d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:28.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.671+0000 7f4a66e6d9c0 20 searching for the correct realm 2024-09-12T17:33:28.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.679+0000 7f4a64172640 0 -- 172.21.15.119:0/1072581352 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f4a5805be50 msgr2=0x7f4a58063b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:28.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.683+0000 7f4a64172640 0 -- 172.21.15.119:0/1072581352 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f4a5c0bb020 msgr2=0x7f4a5c132290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:28.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.899+0000 7f4a66e6d9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:28.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.899+0000 7f4a66e6d9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:28.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.899+0000 7f4a66e6d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:28.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.899+0000 7f4a66e6d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:28.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.899+0000 7f4a66e6d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:28.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.899+0000 7f4a66e6d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:28.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.899+0000 7f4a66e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:28.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.903+0000 7f4a66e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:28.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.903+0000 7f4a66e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:28.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.903+0000 7f4a66e6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:28.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.903+0000 7f4a66e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:28.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.903+0000 7f4a66e6d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:28.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.903+0000 7f4a66e6d9c0 20 zone default found 2024-09-12T17:33:28.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.903+0000 7f4a66e6d9c0 4 Realm: () 2024-09-12T17:33:28.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.903+0000 7f4a66e6d9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:28.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.903+0000 7f4a66e6d9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:28.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.903+0000 7f4a66e6d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:28.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.903+0000 7f4a66e6d9c0 20 zonegroup default 2024-09-12T17:33:28.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.903+0000 7f4a66e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:28.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.903+0000 7f4a66e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:28.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.903+0000 7f4a66e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:28.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.903+0000 7f4a66e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:28.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.903+0000 7f4a66e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:28.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.907+0000 7f4a66e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:28.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.907+0000 7f4a66e6d9c0 20 started sync module instance, tier type = 2024-09-12T17:33:28.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.907+0000 7f4a66e6d9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:28.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.927+0000 7f4a66e6d9c0 20 add_watcher() i=0 2024-09-12T17:33:28.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.927+0000 7f4a66e6d9c0 20 add_watcher() i=1 2024-09-12T17:33:28.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.927+0000 7f4a66e6d9c0 20 add_watcher() i=2 2024-09-12T17:33:28.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.927+0000 7f4a66e6d9c0 20 add_watcher() i=3 2024-09-12T17:33:28.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.927+0000 7f4a66e6d9c0 20 add_watcher() i=4 2024-09-12T17:33:28.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.927+0000 7f4a66e6d9c0 20 add_watcher() i=5 2024-09-12T17:33:28.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.927+0000 7f4a66e6d9c0 20 add_watcher() i=6 2024-09-12T17:33:28.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.931+0000 7f4a66e6d9c0 20 add_watcher() i=7 2024-09-12T17:33:28.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.931+0000 7f4a66e6d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:28.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.935+0000 7f491b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:28.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.935+0000 7f4a66e6d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:28.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.935+0000 7f4a66e6d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:28.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.935+0000 7f4a66e6d9c0 5 note: GC not initialized 2024-09-12T17:33:28.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.935+0000 7f491a7e4640 20 reqs_thread_entry: start 2024-09-12T17:33:28.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.935+0000 7f4a66e6d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:28.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.935+0000 7f4a66e6d9c0 20 Filter name: none 2024-09-12T17:33:28.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.939+0000 7f49137fe640 20 reqs_thread_entry: start 2024-09-12T17:33:28.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.939+0000 7f4a66e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:28.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.939+0000 7f4a66e6d9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:33:28.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.939+0000 7f4a66e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:28.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.939+0000 7f4a66e6d9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:33:28.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.939+0000 7f4a66e6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:28.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.939+0000 7f4a66e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:28.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.939+0000 7f4a66e6d9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:33:28.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.939+0000 7f4a66e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:28.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.943+0000 7f4a66e6d9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:33:28.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.943+0000 7f4a66e6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:28.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.943+0000 7f491b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:28.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.947+0000 7f4a66e6d9c0 20 remove_watcher() i=0 2024-09-12T17:33:28.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.947+0000 7f4a66e6d9c0 2 removed watcher, disabling cache 2024-09-12T17:33:28.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.951+0000 7f4a66e6d9c0 20 remove_watcher() i=1 2024-09-12T17:33:28.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.951+0000 7f4a66e6d9c0 20 remove_watcher() i=2 2024-09-12T17:33:28.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.955+0000 7f4a66e6d9c0 20 remove_watcher() i=3 2024-09-12T17:33:28.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.959+0000 7f4a66e6d9c0 20 remove_watcher() i=4 2024-09-12T17:33:28.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.959+0000 7f4a66e6d9c0 20 remove_watcher() i=5 2024-09-12T17:33:28.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.959+0000 7f4a66e6d9c0 20 remove_watcher() i=6 2024-09-12T17:33:28.958 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:28.963+0000 7f4a66e6d9c0 20 remove_watcher() i=7 2024-09-12T17:33:28.973 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:28.973 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:33:28.973 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-init-indext id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:33:28.973 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:28.973 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T17:33:29.006 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:29.007 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:29.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 realm 2024-09-12T17:33:29.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.055+0000 7fe3af47b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:29.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.059+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.059+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.059+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:29.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.059+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.059+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:29.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.063+0000 7fe3af47b9c0 20 searching for the correct realm 2024-09-12T17:33:29.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.063+0000 7fe3ad782640 0 -- 172.21.15.119:0/3089000198 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55f19b6207a0 msgr2=0x55f19b622b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:29.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.071+0000 7fe3ac780640 0 -- 172.21.15.119:0/3089000198 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fe3a4068130 msgr2=0x7fe3a407d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:29.286 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:29.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:29.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:29.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:29.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:29.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:29.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:29.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.288 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:29.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 zone default found 2024-09-12T17:33:29.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 4 Realm: () 2024-09-12T17:33:29.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:29.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:29.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:29.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 zonegroup default 2024-09-12T17:33:29.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.295+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.295+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.295+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.295+0000 7fe3af47b9c0 20 started sync module instance, tier type = 2024-09-12T17:33:29.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.295+0000 7fe3af47b9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:29.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=0 2024-09-12T17:33:29.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=1 2024-09-12T17:33:29.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=2 2024-09-12T17:33:29.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=3 2024-09-12T17:33:29.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=4 2024-09-12T17:33:29.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=5 2024-09-12T17:33:29.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=6 2024-09-12T17:33:29.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.323+0000 7fe3af47b9c0 20 add_watcher() i=7 2024-09-12T17:33:29.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.323+0000 7fe3af47b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:29.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.327+0000 7fe2637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:29.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:29.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:29.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 note: GC not initialized 2024-09-12T17:33:29.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.327+0000 7fe2627e4640 20 reqs_thread_entry: start 2024-09-12T17:33:29.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:29.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 Filter name: none 2024-09-12T17:33:29.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.327+0000 7fe25b7fe640 20 reqs_thread_entry: start 2024-09-12T17:33:29.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.327+0000 7fe3af47b9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:33:29.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:33:29.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.327+0000 7fe3af47b9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:33:29.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.327+0000 7fe3af47b9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:33:29.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.327+0000 7fe3af47b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 : miss 2024-09-12T17:33:29.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.331+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:33:29.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.331+0000 7fe3af47b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 info.flags=0x17 2024-09-12T17:33:29.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.331+0000 7fe3af47b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 to cache LRU end 2024-09-12T17:33:29.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.331+0000 7fe3af47b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:29.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.331+0000 7fe3af47b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:29.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.331+0000 7fe3af47b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 2024-09-12T17:33:29.330 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe3af47b9c0 time 2024-09-12T17:33:29.337575+0000 2024-09-12T17:33:29.330 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:33:29.333 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:33:29.333 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe3b2d552eb] 2024-09-12T17:33:29.334 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe3b2d5549f] 2024-09-12T17:33:29.334 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f1997250c1] 2024-09-12T17:33:29.334 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x140f572) [0x55f19a17a572] 2024-09-12T17:33:29.334 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f19973718d] 2024-09-12T17:33:29.334 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:33:29.334 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe3b1bbbd90] 2024-09-12T17:33:29.334 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:33:29.334 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:33:29.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.335+0000 7fe3af47b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe3af47b9c0 time 2024-09-12T17:33:29.337575+0000 2024-09-12T17:33:29.334 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:33:29.334 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.335 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:33:29.335 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe3b2d552eb] 2024-09-12T17:33:29.335 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe3b2d5549f] 2024-09-12T17:33:29.335 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f1997250c1] 2024-09-12T17:33:29.335 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x140f572) [0x55f19a17a572] 2024-09-12T17:33:29.335 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f19973718d] 2024-09-12T17:33:29.335 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:33:29.335 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe3b1bbbd90] 2024-09-12T17:33:29.335 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:33:29.335 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:33:29.335 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.335 INFO:tasks.workunit.client.0.smithi119.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:33:29.335 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fe3af47b9c0 thread_name:radosgw-admin 2024-09-12T17:33:29.386 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:33:29.386 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe3b1bd4520] 2024-09-12T17:33:29.387 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:33:29.387 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:33:29.387 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:33:29.387 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe3b2d55345] 2024-09-12T17:33:29.387 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe3b2d5549f] 2024-09-12T17:33:29.387 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f1997250c1] 2024-09-12T17:33:29.387 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x140f572) [0x55f19a17a572] 2024-09-12T17:33:29.387 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f19973718d] 2024-09-12T17:33:29.387 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:33:29.387 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe3b1bbbd90] 2024-09-12T17:33:29.387 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:33:29.387 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:33:29.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.339+0000 7fe3af47b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:33:29.388 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fe3af47b9c0 thread_name:radosgw-admin 2024-09-12T17:33:29.388 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.388 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:33:29.388 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe3b1bd4520] 2024-09-12T17:33:29.388 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:33:29.388 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:33:29.388 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:33:29.388 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe3b2d55345] 2024-09-12T17:33:29.388 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe3b2d5549f] 2024-09-12T17:33:29.388 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f1997250c1] 2024-09-12T17:33:29.388 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x140f572) [0x55f19a17a572] 2024-09-12T17:33:29.388 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f19973718d] 2024-09-12T17:33:29.389 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:33:29.389 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe3b1bbbd90] 2024-09-12T17:33:29.389 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:33:29.389 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:33:29.389 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:33:29.389 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.389 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:33:29.389 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:33:29.031+0000 7fe3ac780640 10 monclient(hunting): get_auth_request con 0x55f19b478860 auth_method 0 2024-09-12T17:33:29.389 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:33:29.031+0000 7fe3ac780640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.389 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:33:29.031+0000 7fe3ac780640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.389 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:33:29.031+0000 7fe3ac780640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.389 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:33:29.031+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.389 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:33:29.031+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.389 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:33:29.031+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.390 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:33:29.031+0000 7fe3ac780640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.390 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:33:29.031+0000 7fe3ac780640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.390 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:33:29.031+0000 7fe3ac780640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.390 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:33:29.031+0000 7fe3ad782640 10 monclient(hunting): handle_auth_done global_id 6405 payload 274 2024-09-12T17:33:29.390 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:33:29.031+0000 7fe3ad782640 10 monclient: _finish_hunting 0 2024-09-12T17:33:29.390 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:33:29.031+0000 7fe3ad782640 1 monclient: found mon.noname-a 2024-09-12T17:33:29.390 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:33:29.031+0000 7fe3ad782640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:33:29.390 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:33:29.031+0000 7fe3acf81640 10 monclient: get_auth_request con 0x55f19b3b7ad0 auth_method 0 2024-09-12T17:33:29.390 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.390 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:33:29.390 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: dump: 2024-09-12T17:33:29.390 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.390 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.391 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.391 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.391 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.391 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.391 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.391 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.391 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.391 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.391 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: _finish_auth 0 2024-09-12T17:33:29.391 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: _check_auth_tickets 2024-09-12T17:33:29.391 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 monclient: authenticate success, global_id 6405 2024-09-12T17:33:29.391 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:29.391 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.391 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:33:29.392 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: dump: 2024-09-12T17:33:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.392 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.392 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:33:29.392 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 4 set_mon_vals no callback set 2024-09-12T17:33:29.392 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 10 monclient: shutdown 2024-09-12T17:33:29.393 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) unregister_commands rotate-key 2024-09-12T17:33:29.393 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 10 monclient: build_initial_monmap 2024-09-12T17:33:29.393 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:33:29.393 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 10 monclient: monmap: 2024-09-12T17:33:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:33:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:33:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:33:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:33:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:33:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:33:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:33:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:33:29.394 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.394 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding auth protocol: cephx 2024-09-12T17:33:29.394 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding auth protocol: cephx 2024-09-12T17:33:29.394 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding auth protocol: cephx 2024-09-12T17:33:29.394 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: secure 2024-09-12T17:33:29.394 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: crc 2024-09-12T17:33:29.394 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: secure 2024-09-12T17:33:29.394 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: crc 2024-09-12T17:33:29.394 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: secure 2024-09-12T17:33:29.394 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: crc 2024-09-12T17:33:29.394 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: crc 2024-09-12T17:33:29.394 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: secure 2024-09-12T17:33:29.394 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: crc 2024-09-12T17:33:29.394 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: secure 2024-09-12T17:33:29.395 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: crc 2024-09-12T17:33:29.395 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: secure 2024-09-12T17:33:29.395 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.395 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 1 librados: starting msgr at 2024-09-12T17:33:29.395 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 1 librados: starting objecter 2024-09-12T17:33:29.395 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command objecter_requests hook 0x55f19b534310 2024-09-12T17:33:29.395 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 1 librados: setting wanted keys 2024-09-12T17:33:29.395 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 1 librados: calling monclient init 2024-09-12T17:33:29.395 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient: init 2024-09-12T17:33:29.395 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding auth protocol: cephx 2024-09-12T17:33:29.395 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding auth protocol: cephx 2024-09-12T17:33:29.395 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding auth protocol: cephx 2024-09-12T17:33:29.395 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: secure 2024-09-12T17:33:29.396 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: crc 2024-09-12T17:33:29.396 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: secure 2024-09-12T17:33:29.396 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: crc 2024-09-12T17:33:29.396 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: secure 2024-09-12T17:33:29.396 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: crc 2024-09-12T17:33:29.396 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: crc 2024-09-12T17:33:29.396 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: secure 2024-09-12T17:33:29.396 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: crc 2024-09-12T17:33:29.396 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: secure 2024-09-12T17:33:29.396 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: crc 2024-09-12T17:33:29.396 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: secure 2024-09-12T17:33:29.396 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.396 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.397 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command rotate-key hook 0x55f19b52c818 2024-09-12T17:33:29.397 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:33:29.397 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:33:29.397 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f19b3b7ad0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:33:29.397 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f19b478860 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:33:29.397 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f19b52f860 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:33:29.397 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.397 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.397 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.397 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:33:29.397 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient(hunting): authenticate will time out at 2377.068946s 2024-09-12T17:33:29.397 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient(hunting): get_auth_request con 0x55f19b3b7ad0 auth_method 0 2024-09-12T17:33:29.397 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.398 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.398 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.398 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:33:29.035+0000 7fe3ad782640 10 monclient(hunting): get_auth_request con 0x55f19b52f860 auth_method 0 2024-09-12T17:33:29.398 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:33:29.035+0000 7fe3ad782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.398 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:33:29.035+0000 7fe3ad782640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.398 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:33:29.035+0000 7fe3ad782640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.398 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.398 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.398 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.398 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:33:29.035+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.398 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:33:29.035+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.398 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:33:29.035+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.398 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient(hunting): handle_auth_done global_id 6408 payload 824 2024-09-12T17:33:29.398 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient: _finish_hunting 0 2024-09-12T17:33:29.399 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:33:29.035+0000 7fe3acf81640 1 monclient: found mon.noname-a 2024-09-12T17:33:29.399 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:33:29.399 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.399 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:33:29.399 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: dump: 2024-09-12T17:33:29.399 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.399 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.399 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.399 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.399 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.399 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.399 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.399 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.400 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.400 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.400 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: _finish_auth 0 2024-09-12T17:33:29.400 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: _check_auth_tickets 2024-09-12T17:33:29.400 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 monclient: authenticate success, global_id 6408 2024-09-12T17:33:29.400 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient: _renew_subs 2024-09-12T17:33:29.400 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:33:29.400 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient: _renew_subs 2024-09-12T17:33:29.400 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:33:29.400 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 1 librados: init done 2024-09-12T17:33:29.400 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:29.400 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.400 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:33:29.401 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: dump: 2024-09-12T17:33:29.401 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.401 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.401 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.401 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.401 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.401 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.401 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.401 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.401 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.401 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.401 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:33:29.035+0000 7fe29ae0d640 4 set_mon_vals no callback set 2024-09-12T17:33:29.401 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:33:29.035+0000 7fe29960a640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:33:29.401 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:33:29.035+0000 7fe29960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:33:29.402 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:33:29.035+0000 7fe29960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:33:29.402 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:33:29.039+0000 7fe3ac780640 10 monclient: get_auth_request con 0x7fe294070ae0 auth_method 0 2024-09-12T17:33:29.402 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:33:29.039+0000 7fe3ad782640 10 monclient: get_auth_request con 0x55f19b56ac30 auth_method 0 2024-09-12T17:33:29.402 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:33:29.039+0000 7fe3acf81640 10 monclient: get_auth_request con 0x55f19b5775f0 auth_method 0 2024-09-12T17:33:29.402 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:33:29.039+0000 7fe3ac780640 10 monclient: get_auth_request con 0x55f19b57b9a0 auth_method 0 2024-09-12T17:33:29.402 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:33:29.043+0000 7fe3ad782640 10 monclient: get_auth_request con 0x55f19b57ae70 auth_method 0 2024-09-12T17:33:29.402 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 10 monclient: build_initial_monmap 2024-09-12T17:33:29.402 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:33:29.402 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 10 monclient: monmap: 2024-09-12T17:33:29.402 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:33:29.402 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:33:29.402 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:33:29.403 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:33:29.403 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:33:29.403 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.403 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:33:29.403 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:33:29.403 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:33:29.403 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.403 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding auth protocol: cephx 2024-09-12T17:33:29.403 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding auth protocol: cephx 2024-09-12T17:33:29.403 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding auth protocol: cephx 2024-09-12T17:33:29.403 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: secure 2024-09-12T17:33:29.403 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: crc 2024-09-12T17:33:29.403 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: secure 2024-09-12T17:33:29.403 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: crc 2024-09-12T17:33:29.404 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: secure 2024-09-12T17:33:29.404 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: crc 2024-09-12T17:33:29.404 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: crc 2024-09-12T17:33:29.404 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: secure 2024-09-12T17:33:29.404 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: crc 2024-09-12T17:33:29.404 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: secure 2024-09-12T17:33:29.404 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: crc 2024-09-12T17:33:29.404 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: secure 2024-09-12T17:33:29.404 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.404 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f19b5874e0 EEXIST 2024-09-12T17:33:29.404 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 10 monclient: init 2024-09-12T17:33:29.404 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding auth protocol: cephx 2024-09-12T17:33:29.405 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding auth protocol: cephx 2024-09-12T17:33:29.405 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding auth protocol: cephx 2024-09-12T17:33:29.405 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: secure 2024-09-12T17:33:29.405 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: crc 2024-09-12T17:33:29.405 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: secure 2024-09-12T17:33:29.405 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: crc 2024-09-12T17:33:29.405 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: secure 2024-09-12T17:33:29.405 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: crc 2024-09-12T17:33:29.405 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: crc 2024-09-12T17:33:29.405 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: secure 2024-09-12T17:33:29.405 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: crc 2024-09-12T17:33:29.405 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: secure 2024-09-12T17:33:29.405 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: crc 2024-09-12T17:33:29.406 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: secure 2024-09-12T17:33:29.406 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.406 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.406 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command rotate-key cmddesc rotate-key hook 0x55f19b582b90 EEXIST 2024-09-12T17:33:29.406 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:33:29.406 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:33:29.406 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f19b5ab690 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:33:29.406 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f19b5aafc0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:33:29.406 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f19b5a99a0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:33:29.406 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.406 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.406 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.406 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:33:29.407 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient(hunting): authenticate will time out at 2377.080552s 2024-09-12T17:33:29.407 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient(hunting): get_auth_request con 0x55f19b5aafc0 auth_method 0 2024-09-12T17:33:29.407 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.407 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.407 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.407 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:33:29.047+0000 7fe3acf81640 10 monclient(hunting): get_auth_request con 0x55f19b5a99a0 auth_method 0 2024-09-12T17:33:29.407 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:33:29.047+0000 7fe3acf81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.407 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:33:29.047+0000 7fe3acf81640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.407 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:33:29.047+0000 7fe3acf81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.407 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.407 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.407 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.407 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:33:29.047+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.408 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:33:29.047+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.408 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:33:29.047+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.408 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:33:29.047+0000 7fe3ac780640 10 monclient(hunting): get_auth_request con 0x55f19b5ab690 auth_method 0 2024-09-12T17:33:29.408 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:33:29.047+0000 7fe3ac780640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.408 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:33:29.047+0000 7fe3ac780640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.408 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:33:29.047+0000 7fe3ac780640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.408 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient(hunting): handle_auth_done global_id 6411 payload 824 2024-09-12T17:33:29.408 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient: _finish_hunting 0 2024-09-12T17:33:29.408 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:33:29.047+0000 7fe3ad782640 1 monclient: found mon.noname-a 2024-09-12T17:33:29.408 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:33:29.408 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.408 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:33:29.408 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: dump: 2024-09-12T17:33:29.409 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.409 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.409 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.409 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.409 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.409 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.409 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.409 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.409 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.409 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.409 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: _finish_auth 0 2024-09-12T17:33:29.409 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: _check_auth_tickets 2024-09-12T17:33:29.410 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:29.410 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.410 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:33:29.410 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: dump: 2024-09-12T17:33:29.410 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.410 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.410 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.410 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.410 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.410 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.410 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.410 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.410 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.410 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.411 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 monclient: authenticate success, global_id 6411 2024-09-12T17:33:29.411 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:33:29.047+0000 7fe3adf83640 4 set_mon_vals no callback set 2024-09-12T17:33:29.411 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: _renew_subs 2024-09-12T17:33:29.411 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:33:29.411 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: _renew_subs 2024-09-12T17:33:29.411 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:33:29.411 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:33:29.047+0000 7fe2927fc640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:33:29.411 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:33:29.047+0000 7fe2927fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:33:29.411 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:33:29.047+0000 7fe2927fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:33:29.411 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: get_monmap_and_config 2024-09-12T17:33:29.411 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: build_initial_monmap 2024-09-12T17:33:29.411 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:33:29.412 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: monmap: 2024-09-12T17:33:29.412 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:33:29.412 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:33:29.412 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:33:29.412 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:33:29.412 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:33:29.412 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.412 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:33:29.412 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:33:29.412 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:33:29.412 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.412 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding auth protocol: cephx 2024-09-12T17:33:29.412 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding auth protocol: cephx 2024-09-12T17:33:29.413 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding auth protocol: cephx 2024-09-12T17:33:29.413 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: secure 2024-09-12T17:33:29.413 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: crc 2024-09-12T17:33:29.413 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: secure 2024-09-12T17:33:29.413 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: crc 2024-09-12T17:33:29.413 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: secure 2024-09-12T17:33:29.413 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: crc 2024-09-12T17:33:29.413 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: crc 2024-09-12T17:33:29.413 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: secure 2024-09-12T17:33:29.413 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: crc 2024-09-12T17:33:29.413 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: secure 2024-09-12T17:33:29.413 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: crc 2024-09-12T17:33:29.413 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: secure 2024-09-12T17:33:29.413 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:33:29.047+0000 7fe3ac780640 10 monclient: get_auth_request con 0x7fe284070bc0 auth_method 0 2024-09-12T17:33:29.414 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.414 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: init 2024-09-12T17:33:29.414 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding auth protocol: cephx 2024-09-12T17:33:29.414 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding auth protocol: cephx 2024-09-12T17:33:29.414 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding auth protocol: cephx 2024-09-12T17:33:29.414 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: secure 2024-09-12T17:33:29.414 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: crc 2024-09-12T17:33:29.414 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: secure 2024-09-12T17:33:29.414 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: crc 2024-09-12T17:33:29.414 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: secure 2024-09-12T17:33:29.414 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: crc 2024-09-12T17:33:29.414 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: crc 2024-09-12T17:33:29.414 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: secure 2024-09-12T17:33:29.415 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: crc 2024-09-12T17:33:29.415 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: secure 2024-09-12T17:33:29.415 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: crc 2024-09-12T17:33:29.415 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: secure 2024-09-12T17:33:29.415 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.415 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.415 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc378ce718 EEXIST 2024-09-12T17:33:29.415 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:33:29.415 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:33:29.415 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f19b5f9550 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:33:29.415 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f19b5f9930 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:33:29.415 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f19b5fadf0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:33:29.415 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.416 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.416 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.416 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:33:29.416 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): authenticate will time out at 2377.084768s 2024-09-12T17:33:29.416 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): get_auth_request con 0x55f19b5f9930 auth_method 0 2024-09-12T17:33:29.416 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.416 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.416 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.416 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): get_auth_request con 0x55f19b5fadf0 auth_method 0 2024-09-12T17:33:29.416 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.416 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.416 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.416 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.417 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.417 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.417 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.417 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.417 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.417 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): handle_auth_done global_id 6414 payload 274 2024-09-12T17:33:29.417 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient: _finish_hunting 0 2024-09-12T17:33:29.417 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:33:29.051+0000 7fe3ad782640 1 monclient: found mon.noname-a 2024-09-12T17:33:29.417 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:33:29.417 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:33:29.051+0000 7fe3ac780640 10 monclient: get_auth_request con 0x55f19b5f9550 auth_method 0 2024-09-12T17:33:29.417 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.417 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:33:29.417 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: dump: 2024-09-12T17:33:29.418 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.418 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.418 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.418 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.418 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.418 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.418 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.418 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.418 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.418 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.418 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: _finish_auth 0 2024-09-12T17:33:29.418 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: _check_auth_tickets 2024-09-12T17:33:29.418 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:29.419 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.419 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:33:29.419 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: dump: 2024-09-12T17:33:29.419 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.419 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.419 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.419 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.419 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.419 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.419 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.419 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.419 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.419 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.419 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 monclient: authenticate success, global_id 6414 2024-09-12T17:33:29.420 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:33:29.420 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 4 set_mon_vals no callback set 2024-09-12T17:33:29.420 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: shutdown 2024-09-12T17:33:29.420 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: build_initial_monmap 2024-09-12T17:33:29.420 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:33:29.420 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: monmap: 2024-09-12T17:33:29.420 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:33:29.420 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:33:29.420 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:33:29.420 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:33:29.420 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:33:29.420 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.420 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:33:29.421 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:33:29.421 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:33:29.421 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.421 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding auth protocol: cephx 2024-09-12T17:33:29.421 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding auth protocol: cephx 2024-09-12T17:33:29.421 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding auth protocol: cephx 2024-09-12T17:33:29.421 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: secure 2024-09-12T17:33:29.421 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: crc 2024-09-12T17:33:29.421 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: secure 2024-09-12T17:33:29.421 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: crc 2024-09-12T17:33:29.421 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: secure 2024-09-12T17:33:29.421 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: crc 2024-09-12T17:33:29.422 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: crc 2024-09-12T17:33:29.422 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: secure 2024-09-12T17:33:29.422 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: crc 2024-09-12T17:33:29.422 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: secure 2024-09-12T17:33:29.422 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: crc 2024-09-12T17:33:29.422 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: secure 2024-09-12T17:33:29.422 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.422 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 1 librados: starting msgr at 2024-09-12T17:33:29.422 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 1 librados: starting objecter 2024-09-12T17:33:29.422 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f19b5f9430 EEXIST 2024-09-12T17:33:29.422 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 1 librados: setting wanted keys 2024-09-12T17:33:29.422 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 1 librados: calling monclient init 2024-09-12T17:33:29.422 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: init 2024-09-12T17:33:29.423 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding auth protocol: cephx 2024-09-12T17:33:29.423 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding auth protocol: cephx 2024-09-12T17:33:29.423 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding auth protocol: cephx 2024-09-12T17:33:29.423 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: secure 2024-09-12T17:33:29.423 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: crc 2024-09-12T17:33:29.423 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: secure 2024-09-12T17:33:29.423 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: crc 2024-09-12T17:33:29.423 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: secure 2024-09-12T17:33:29.423 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: crc 2024-09-12T17:33:29.423 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: crc 2024-09-12T17:33:29.423 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: secure 2024-09-12T17:33:29.423 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: crc 2024-09-12T17:33:29.423 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: secure 2024-09-12T17:33:29.424 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: crc 2024-09-12T17:33:29.424 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: secure 2024-09-12T17:33:29.424 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.424 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.424 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command rotate-key cmddesc rotate-key hook 0x55f19b5ad5f8 EEXIST 2024-09-12T17:33:29.424 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:33:29.424 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:33:29.424 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f19b5f9550 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:33:29.424 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f19b5fadf0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:33:29.424 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f19b5ebbb0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:33:29.424 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.424 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.424 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.425 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:33:29.425 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): authenticate will time out at 2377.087416s 2024-09-12T17:33:29.425 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): get_auth_request con 0x55f19b5ebbb0 auth_method 0 2024-09-12T17:33:29.425 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.425 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.425 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.425 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): get_auth_request con 0x55f19b5fadf0 auth_method 0 2024-09-12T17:33:29.425 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.425 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.425 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.425 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.425 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.425 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.426 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.426 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.426 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.426 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): handle_auth_done global_id 6086 payload 824 2024-09-12T17:33:29.426 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient: _finish_hunting 0 2024-09-12T17:33:29.426 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:33:29.051+0000 7fe3acf81640 1 monclient: found mon.noname-c 2024-09-12T17:33:29.426 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:33:29.426 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:33:29.051+0000 7fe3ac780640 10 monclient: get_auth_request con 0x55f19b5f9550 auth_method 0 2024-09-12T17:33:29.426 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.426 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:33:29.426 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: dump: 2024-09-12T17:33:29.426 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.426 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.426 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.427 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.427 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.427 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.427 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.427 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.427 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.427 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.427 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: _finish_auth 0 2024-09-12T17:33:29.427 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: _check_auth_tickets 2024-09-12T17:33:29.427 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:29.427 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.427 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:33:29.427 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: dump: 2024-09-12T17:33:29.428 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.428 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.428 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.428 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.428 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.428 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.428 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.428 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.428 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.428 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.428 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:33:29.055+0000 7fe283fff640 4 set_mon_vals no callback set 2024-09-12T17:33:29.428 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 5 monclient: authenticate success, global_id 6086 2024-09-12T17:33:29.428 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 10 monclient: _renew_subs 2024-09-12T17:33:29.428 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:33:29.429 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 10 monclient: _renew_subs 2024-09-12T17:33:29.429 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:33:29.429 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 1 librados: init done 2024-09-12T17:33:29.429 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command cr dump hook 0x55f19b5f0238 2024-09-12T17:33:29.429 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.429 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:33:29.055+0000 7fe2827fc640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:33:29.429 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:33:29.055+0000 7fe2827fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:33:29.429 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:33:29.055+0000 7fe2827fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:33:29.429 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:33:29.055+0000 7fe3ad782640 10 monclient: get_auth_request con 0x55f19b618d00 auth_method 0 2024-09-12T17:33:29.429 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:33:29.055+0000 7fe3ac780640 10 monclient: get_auth_request con 0x7fe278070b10 auth_method 0 2024-09-12T17:33:29.429 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.429 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 realm 2024-09-12T17:33:29.429 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.430 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.430 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:29.430 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.430 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:33:29.059+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.430 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:33:29.059+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.430 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:33:29.059+0000 7fe3ac780640 10 monclient: get_auth_request con 0x55f19b61d010 auth_method 0 2024-09-12T17:33:29.430 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:33:29.059+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:29.430 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:33:29.059+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.430 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:33:29.059+0000 7fe3ad782640 10 monclient: get_auth_request con 0x55f19b6207a0 auth_method 0 2024-09-12T17:33:29.430 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:33:29.059+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:29.430 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:33:29.063+0000 7fe3af47b9c0 20 searching for the correct realm 2024-09-12T17:33:29.430 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:33:29.063+0000 7fe3acf81640 10 monclient: get_auth_request con 0x55f19b625470 auth_method 0 2024-09-12T17:33:29.430 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:33:29.063+0000 7fe3ac780640 10 monclient: get_auth_request con 0x7fe39c0c0020 auth_method 0 2024-09-12T17:33:29.430 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:33:29.063+0000 7fe3ad782640 10 monclient: get_auth_request con 0x7fe394047040 auth_method 0 2024-09-12T17:33:29.431 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:33:29.063+0000 7fe3ad782640 0 -- 172.21.15.119:0/3089000198 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55f19b6207a0 msgr2=0x55f19b622b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:29.431 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:33:29.063+0000 7fe2827fc640 1 client.6086.objecter ms_handle_reset 0x55f19b6207a0 session 0x55f19b61c870 osd.4 2024-09-12T17:33:29.431 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:33:29.063+0000 7fe2827fc640 10 monclient: _renew_subs 2024-09-12T17:33:29.431 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:33:29.063+0000 7fe2827fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:33:29.431 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:33:29.067+0000 7fe3ad782640 10 monclient: get_auth_request con 0x7fe278081240 auth_method 0 2024-09-12T17:33:29.431 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:33:29.067+0000 7fe3acf81640 10 monclient: get_auth_request con 0x7fe3a4095040 auth_method 0 2024-09-12T17:33:29.431 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:33:29.071+0000 7fe3ac780640 10 monclient: get_auth_request con 0x7fe3a4068130 auth_method 0 2024-09-12T17:33:29.431 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:33:29.071+0000 7fe3ac780640 0 -- 172.21.15.119:0/3089000198 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fe3a4068130 msgr2=0x7fe3a407d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:29.431 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:33:29.275+0000 7fe3ac780640 10 monclient: get_auth_request con 0x7fe3a4068130 auth_method 0 2024-09-12T17:33:29.431 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:33:29.279+0000 7fe2827fc640 1 client.6086.objecter ms_handle_reset 0x55f19b618d00 session 0x55f19b618630 osd.1 2024-09-12T17:33:29.431 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:33:29.279+0000 7fe3ad782640 10 monclient: get_auth_request con 0x55f19b6207a0 auth_method 0 2024-09-12T17:33:29.431 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:29.431 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:29.431 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:29.432 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:29.432 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:29.432 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:29.432 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.432 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.432 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.432 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:29.432 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.432 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:29.432 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 zone default found 2024-09-12T17:33:29.432 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 4 Realm: () 2024-09-12T17:33:29.432 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:29.432 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:29.433 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:29.433 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 zonegroup default 2024-09-12T17:33:29.433 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.433 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.433 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.433 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:33:29.295+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.433 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:33:29.295+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.433 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:33:29.295+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.433 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:33:29.295+0000 7fe3af47b9c0 20 started sync module instance, tier type = 2024-09-12T17:33:29.433 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:33:29.295+0000 7fe3af47b9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:29.433 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=0 2024-09-12T17:33:29.433 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=1 2024-09-12T17:33:29.433 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=2 2024-09-12T17:33:29.434 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=3 2024-09-12T17:33:29.434 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=4 2024-09-12T17:33:29.434 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=5 2024-09-12T17:33:29.434 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=6 2024-09-12T17:33:29.434 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:33:29.323+0000 7fe3af47b9c0 20 add_watcher() i=7 2024-09-12T17:33:29.434 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:33:29.323+0000 7fe3af47b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:29.434 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding auth protocol: cephx 2024-09-12T17:33:29.434 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding auth protocol: cephx 2024-09-12T17:33:29.434 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding auth protocol: cephx 2024-09-12T17:33:29.434 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: secure 2024-09-12T17:33:29.434 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: crc 2024-09-12T17:33:29.434 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: secure 2024-09-12T17:33:29.434 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: crc 2024-09-12T17:33:29.434 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: secure 2024-09-12T17:33:29.435 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: crc 2024-09-12T17:33:29.435 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: crc 2024-09-12T17:33:29.435 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: secure 2024-09-12T17:33:29.435 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: crc 2024-09-12T17:33:29.435 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: secure 2024-09-12T17:33:29.435 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: crc 2024-09-12T17:33:29.435 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:33:29.327+0000 7fe2637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:29.435 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: secure 2024-09-12T17:33:29.435 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.435 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:29.435 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:29.435 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command cache list hook 0x55f19b5ecdc0 2024-09-12T17:33:29.435 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command cache inspect hook 0x55f19b5ecdc0 2024-09-12T17:33:29.435 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command cache erase hook 0x55f19b5ecdc0 2024-09-12T17:33:29.436 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command cache zap hook 0x55f19b5ecdc0 2024-09-12T17:33:29.436 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 note: GC not initialized 2024-09-12T17:33:29.436 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:33:29.327+0000 7fe2627e4640 20 reqs_thread_entry: start 2024-09-12T17:33:29.436 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command sync trace show hook 0x7fe39400c660 2024-09-12T17:33:29.436 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command sync trace history hook 0x7fe39400c660 2024-09-12T17:33:29.436 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command sync trace active hook 0x7fe39400c660 2024-09-12T17:33:29.436 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command sync trace active_short hook 0x7fe39400c660 2024-09-12T17:33:29.436 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:29.436 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 Filter name: none 2024-09-12T17:33:29.436 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:33:29.327+0000 7fe25b7fe640 20 reqs_thread_entry: start 2024-09-12T17:33:29.436 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:33:29.436 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.436 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:33:29.437 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:33:29.437 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:33:29.437 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 : miss 2024-09-12T17:33:29.437 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.437 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:33:29.331+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:33:29.437 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:33:29.331+0000 7fe3af47b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 info.flags=0x17 2024-09-12T17:33:29.437 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:33:29.331+0000 7fe3af47b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 to cache LRU end 2024-09-12T17:33:29.437 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:33:29.331+0000 7fe3af47b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:29.437 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:33:29.331+0000 7fe3af47b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:29.437 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:33:29.331+0000 7fe3af47b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 2024-09-12T17:33:29.437 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:33:29.335+0000 7fe3af47b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe3af47b9c0 time 2024-09-12T17:33:29.337575+0000 2024-09-12T17:33:29.437 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:33:29.437 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.438 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:33:29.438 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe3b2d552eb] 2024-09-12T17:33:29.438 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe3b2d5549f] 2024-09-12T17:33:29.438 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f1997250c1] 2024-09-12T17:33:29.438 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x140f572) [0x55f19a17a572] 2024-09-12T17:33:29.438 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f19973718d] 2024-09-12T17:33:29.438 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:33:29.438 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe3b1bbbd90] 2024-09-12T17:33:29.438 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:33:29.438 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:33:29.438 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.438 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:33:29.339+0000 7fe3af47b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:33:29.438 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fe3af47b9c0 thread_name:radosgw-admin 2024-09-12T17:33:29.439 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.439 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:33:29.439 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe3b1bd4520] 2024-09-12T17:33:29.439 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:33:29.439 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:33:29.439 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:33:29.439 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe3b2d55345] 2024-09-12T17:33:29.439 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe3b2d5549f] 2024-09-12T17:33:29.439 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f1997250c1] 2024-09-12T17:33:29.439 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x140f572) [0x55f19a17a572] 2024-09-12T17:33:29.439 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f19973718d] 2024-09-12T17:33:29.439 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:33:29.439 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe3b1bbbd90] 2024-09-12T17:33:29.439 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:33:29.440 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:33:29.440 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:33:29.440 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.440 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:33:29.440 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:33:29.440 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:33:29.440 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:33:29.440 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:33:29.440 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:33:29.440 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:33:29.440 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:33:29.440 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:33:29.440 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:33:29.441 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:33:29.441 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:33:29.441 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:33:29.441 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:33:29.441 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:33:29.441 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:33:29.441 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:33:29.441 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:33:29.441 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:33:29.441 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:33:29.441 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:33:29.441 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:33:29.441 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:33:29.442 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:33:29.442 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:33:29.442 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:33:29.442 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:33:29.442 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:33:29.442 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:33:29.442 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:33:29.442 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:33:29.442 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:33:29.442 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:33:29.442 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:33:29.442 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:33:29.442 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:33:29.443 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:33:29.443 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:33:29.443 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:33:29.443 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:33:29.443 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:33:29.443 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:33:29.443 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:33:29.443 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:33:29.443 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:33:29.443 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:33:29.443 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:33:29.443 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:33:29.443 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:33:29.444 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:33:29.444 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:33:29.444 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:33:29.444 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:33:29.444 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:33:29.444 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:33:29.444 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:33:29.444 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:33:29.444 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:33:29.444 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:33:29.444 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:33:29.444 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:33:29.444 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:33:29.445 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:33:29.445 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:33:29.445 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:33:29.445 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:33:29.445 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:33:29.445 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:33:29.445 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:33:29.445 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:33:29.445 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:33:29.445 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:33:29.445 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:33:29.445 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:33:29.445 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:33:29.445 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:33:29.446 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:33:29.446 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:33:29.446 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:33:29.446 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:33:29.446 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:33:29.446 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:33:29.446 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:33:29.446 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:33:29.446 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:33:29.446 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:33:29.447 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:33:29.447 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:33:29.447 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:33:29.447 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:33:29.447 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:33:29.447 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:33:29.447 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:33:29.447 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:33:29.447 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe25b7fe640 / http_manager 2024-09-12T17:33:29.447 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe2627e4640 / http_manager 2024-09-12T17:33:29.447 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe2637e6640 / rgw_dt_lg_renew 2024-09-12T17:33:29.447 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe2827fc640 / ms_dispatch 2024-09-12T17:33:29.448 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe283fff640 / io_context_pool 2024-09-12T17:33:29.448 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe2927fc640 / ms_dispatch 2024-09-12T17:33:29.448 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe29960a640 / ms_dispatch 2024-09-12T17:33:29.448 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe29ae0d640 / io_context_pool 2024-09-12T17:33:29.448 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe3ac780640 / msgr-worker-2 2024-09-12T17:33:29.448 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe3acf81640 / msgr-worker-1 2024-09-12T17:33:29.448 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe3ad782640 / msgr-worker-0 2024-09-12T17:33:29.448 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe3adf83640 / io_context_pool 2024-09-12T17:33:29.448 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe3af47b9c0 / radosgw-admin 2024-09-12T17:33:29.448 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:33:29.448 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:33:29.448 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/log/ceph/ceph-client.admin.83797.log 2024-09-12T17:33:29.448 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:33:29.449 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:33:29.449 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:33:29.031+0000 7fe3ac780640 10 monclient(hunting): get_auth_request con 0x55f19b478860 auth_method 0 2024-09-12T17:33:29.449 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:33:29.031+0000 7fe3ac780640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.449 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:33:29.031+0000 7fe3ac780640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.449 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:33:29.031+0000 7fe3ac780640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.449 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:33:29.031+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.449 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:33:29.031+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.449 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:33:29.031+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.449 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:33:29.031+0000 7fe3ac780640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.449 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:33:29.031+0000 7fe3ac780640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.449 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:33:29.031+0000 7fe3ac780640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.449 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:33:29.031+0000 7fe3ad782640 10 monclient(hunting): handle_auth_done global_id 6405 payload 274 2024-09-12T17:33:29.449 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:33:29.031+0000 7fe3ad782640 10 monclient: _finish_hunting 0 2024-09-12T17:33:29.450 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:33:29.031+0000 7fe3ad782640 1 monclient: found mon.noname-a 2024-09-12T17:33:29.450 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:33:29.031+0000 7fe3ad782640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:33:29.450 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:33:29.031+0000 7fe3acf81640 10 monclient: get_auth_request con 0x55f19b3b7ad0 auth_method 0 2024-09-12T17:33:29.450 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.450 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:33:29.450 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: dump: 2024-09-12T17:33:29.450 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.450 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.450 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.450 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.450 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.450 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.450 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.451 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.451 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.451 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.451 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: _finish_auth 0 2024-09-12T17:33:29.451 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: _check_auth_tickets 2024-09-12T17:33:29.451 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 monclient: authenticate success, global_id 6405 2024-09-12T17:33:29.451 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:29.451 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.451 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:33:29.451 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:33:29.031+0000 7fe29ae0d640 10 monclient: dump: 2024-09-12T17:33:29.451 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.451 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.451 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.452 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.452 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.452 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.452 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.452 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.452 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.452 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.452 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:33:29.452 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 4 set_mon_vals no callback set 2024-09-12T17:33:29.452 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 10 monclient: shutdown 2024-09-12T17:33:29.452 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) unregister_commands rotate-key 2024-09-12T17:33:29.452 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 10 monclient: build_initial_monmap 2024-09-12T17:33:29.452 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:33:29.453 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 10 monclient: monmap: 2024-09-12T17:33:29.453 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:33:29.453 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:33:29.453 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:33:29.453 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:33:29.453 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:33:29.453 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.453 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:33:29.453 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:33:29.453 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:33:29.453 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.453 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding auth protocol: cephx 2024-09-12T17:33:29.453 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding auth protocol: cephx 2024-09-12T17:33:29.454 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding auth protocol: cephx 2024-09-12T17:33:29.454 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: secure 2024-09-12T17:33:29.454 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: crc 2024-09-12T17:33:29.454 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: secure 2024-09-12T17:33:29.454 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: crc 2024-09-12T17:33:29.454 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: secure 2024-09-12T17:33:29.454 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: crc 2024-09-12T17:33:29.454 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: crc 2024-09-12T17:33:29.454 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: secure 2024-09-12T17:33:29.454 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: crc 2024-09-12T17:33:29.454 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: secure 2024-09-12T17:33:29.454 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: crc 2024-09-12T17:33:29.454 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b532700) adding con mode: secure 2024-09-12T17:33:29.454 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:33:29.031+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.455 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 1 librados: starting msgr at 2024-09-12T17:33:29.455 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 1 librados: starting objecter 2024-09-12T17:33:29.455 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command objecter_requests hook 0x55f19b534310 2024-09-12T17:33:29.455 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 1 librados: setting wanted keys 2024-09-12T17:33:29.455 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 1 librados: calling monclient init 2024-09-12T17:33:29.455 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient: init 2024-09-12T17:33:29.455 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding auth protocol: cephx 2024-09-12T17:33:29.455 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding auth protocol: cephx 2024-09-12T17:33:29.455 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding auth protocol: cephx 2024-09-12T17:33:29.455 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: secure 2024-09-12T17:33:29.455 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: crc 2024-09-12T17:33:29.455 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: secure 2024-09-12T17:33:29.455 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: crc 2024-09-12T17:33:29.456 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: secure 2024-09-12T17:33:29.456 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: crc 2024-09-12T17:33:29.456 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: crc 2024-09-12T17:33:29.456 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: secure 2024-09-12T17:33:29.456 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: crc 2024-09-12T17:33:29.456 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: secure 2024-09-12T17:33:29.456 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: crc 2024-09-12T17:33:29.456 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b52c6d0) adding con mode: secure 2024-09-12T17:33:29.456 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.456 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.456 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command rotate-key hook 0x55f19b52c818 2024-09-12T17:33:29.456 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:33:29.456 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:33:29.457 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f19b3b7ad0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:33:29.457 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f19b478860 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:33:29.457 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f19b52f860 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:33:29.457 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.457 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.457 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.457 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:33:29.457 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient(hunting): authenticate will time out at 2377.068946s 2024-09-12T17:33:29.457 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient(hunting): get_auth_request con 0x55f19b3b7ad0 auth_method 0 2024-09-12T17:33:29.457 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.457 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.457 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.457 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:33:29.035+0000 7fe3ad782640 10 monclient(hunting): get_auth_request con 0x55f19b52f860 auth_method 0 2024-09-12T17:33:29.458 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:33:29.035+0000 7fe3ad782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.458 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:33:29.035+0000 7fe3ad782640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.458 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:33:29.035+0000 7fe3ad782640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.458 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.458 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.458 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.458 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:33:29.035+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.458 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:33:29.035+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.458 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:33:29.035+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.458 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient(hunting): handle_auth_done global_id 6408 payload 824 2024-09-12T17:33:29.458 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient: _finish_hunting 0 2024-09-12T17:33:29.458 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:33:29.035+0000 7fe3acf81640 1 monclient: found mon.noname-a 2024-09-12T17:33:29.458 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:33:29.035+0000 7fe3acf81640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:33:29.459 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.459 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:33:29.459 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: dump: 2024-09-12T17:33:29.459 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.459 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.459 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.459 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.459 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.459 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.459 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.459 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.459 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.459 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.459 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: _finish_auth 0 2024-09-12T17:33:29.460 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: _check_auth_tickets 2024-09-12T17:33:29.460 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 5 monclient: authenticate success, global_id 6408 2024-09-12T17:33:29.460 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient: _renew_subs 2024-09-12T17:33:29.460 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:33:29.460 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient: _renew_subs 2024-09-12T17:33:29.460 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:33:29.460 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:33:29.035+0000 7fe3af47b9c0 1 librados: init done 2024-09-12T17:33:29.460 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:29.460 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.460 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:33:29.460 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:33:29.035+0000 7fe29960a640 10 monclient: dump: 2024-09-12T17:33:29.460 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.461 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.461 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.461 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.461 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.461 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.461 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.461 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.461 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.461 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.461 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:33:29.035+0000 7fe29ae0d640 4 set_mon_vals no callback set 2024-09-12T17:33:29.461 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:33:29.035+0000 7fe29960a640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:33:29.461 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:33:29.035+0000 7fe29960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:33:29.461 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:33:29.035+0000 7fe29960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:33:29.462 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:33:29.039+0000 7fe3ac780640 10 monclient: get_auth_request con 0x7fe294070ae0 auth_method 0 2024-09-12T17:33:29.462 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:33:29.039+0000 7fe3ad782640 10 monclient: get_auth_request con 0x55f19b56ac30 auth_method 0 2024-09-12T17:33:29.462 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:33:29.039+0000 7fe3acf81640 10 monclient: get_auth_request con 0x55f19b5775f0 auth_method 0 2024-09-12T17:33:29.462 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:33:29.039+0000 7fe3ac780640 10 monclient: get_auth_request con 0x55f19b57b9a0 auth_method 0 2024-09-12T17:33:29.462 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:33:29.043+0000 7fe3ad782640 10 monclient: get_auth_request con 0x55f19b57ae70 auth_method 0 2024-09-12T17:33:29.462 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 10 monclient: build_initial_monmap 2024-09-12T17:33:29.462 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:33:29.462 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 10 monclient: monmap: 2024-09-12T17:33:29.462 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:33:29.462 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:33:29.462 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:33:29.462 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:33:29.462 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:33:29.462 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.463 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:33:29.463 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:33:29.463 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:33:29.463 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.463 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding auth protocol: cephx 2024-09-12T17:33:29.463 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding auth protocol: cephx 2024-09-12T17:33:29.463 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding auth protocol: cephx 2024-09-12T17:33:29.463 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: secure 2024-09-12T17:33:29.463 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: crc 2024-09-12T17:33:29.463 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: secure 2024-09-12T17:33:29.463 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: crc 2024-09-12T17:33:29.463 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: secure 2024-09-12T17:33:29.463 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: crc 2024-09-12T17:33:29.464 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: crc 2024-09-12T17:33:29.464 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: secure 2024-09-12T17:33:29.464 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: crc 2024-09-12T17:33:29.464 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: secure 2024-09-12T17:33:29.464 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: crc 2024-09-12T17:33:29.464 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b583ba0) adding con mode: secure 2024-09-12T17:33:29.464 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.464 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f19b5874e0 EEXIST 2024-09-12T17:33:29.464 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 10 monclient: init 2024-09-12T17:33:29.464 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding auth protocol: cephx 2024-09-12T17:33:29.464 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding auth protocol: cephx 2024-09-12T17:33:29.464 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding auth protocol: cephx 2024-09-12T17:33:29.464 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: secure 2024-09-12T17:33:29.465 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: crc 2024-09-12T17:33:29.465 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: secure 2024-09-12T17:33:29.465 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: crc 2024-09-12T17:33:29.465 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: secure 2024-09-12T17:33:29.465 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: crc 2024-09-12T17:33:29.465 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: crc 2024-09-12T17:33:29.465 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: secure 2024-09-12T17:33:29.465 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: crc 2024-09-12T17:33:29.465 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: secure 2024-09-12T17:33:29.465 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: crc 2024-09-12T17:33:29.465 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:33:29.043+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b582a48) adding con mode: secure 2024-09-12T17:33:29.465 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.465 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.466 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command rotate-key cmddesc rotate-key hook 0x55f19b582b90 EEXIST 2024-09-12T17:33:29.466 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:33:29.466 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:33:29.466 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f19b5ab690 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:33:29.466 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f19b5aafc0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:33:29.466 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f19b5a99a0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:33:29.466 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.466 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.466 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.466 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:33:29.466 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient(hunting): authenticate will time out at 2377.080552s 2024-09-12T17:33:29.466 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient(hunting): get_auth_request con 0x55f19b5aafc0 auth_method 0 2024-09-12T17:33:29.467 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.467 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.467 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.467 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:33:29.047+0000 7fe3acf81640 10 monclient(hunting): get_auth_request con 0x55f19b5a99a0 auth_method 0 2024-09-12T17:33:29.467 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:33:29.047+0000 7fe3acf81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.467 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:33:29.047+0000 7fe3acf81640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.467 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:33:29.047+0000 7fe3acf81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.467 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.467 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.467 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.467 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:33:29.047+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.467 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:33:29.047+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.467 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:33:29.047+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.467 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:33:29.047+0000 7fe3ac780640 10 monclient(hunting): get_auth_request con 0x55f19b5ab690 auth_method 0 2024-09-12T17:33:29.468 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:33:29.047+0000 7fe3ac780640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.468 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:33:29.047+0000 7fe3ac780640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.468 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:33:29.047+0000 7fe3ac780640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.468 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient(hunting): handle_auth_done global_id 6411 payload 824 2024-09-12T17:33:29.468 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient: _finish_hunting 0 2024-09-12T17:33:29.468 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:33:29.047+0000 7fe3ad782640 1 monclient: found mon.noname-a 2024-09-12T17:33:29.468 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:33:29.047+0000 7fe3ad782640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:33:29.468 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.468 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:33:29.468 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: dump: 2024-09-12T17:33:29.468 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.468 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.468 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.469 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.469 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.469 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.469 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.469 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.469 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.469 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.469 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: _finish_auth 0 2024-09-12T17:33:29.469 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: _check_auth_tickets 2024-09-12T17:33:29.469 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:29.469 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.469 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:33:29.469 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:33:29.047+0000 7fe2927fc640 10 monclient: dump: 2024-09-12T17:33:29.470 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.470 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.470 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.470 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.470 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.470 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.470 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.470 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.470 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.470 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.470 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 monclient: authenticate success, global_id 6411 2024-09-12T17:33:29.470 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:33:29.047+0000 7fe3adf83640 4 set_mon_vals no callback set 2024-09-12T17:33:29.470 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: _renew_subs 2024-09-12T17:33:29.471 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:33:29.471 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: _renew_subs 2024-09-12T17:33:29.471 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:33:29.471 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:33:29.047+0000 7fe2927fc640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:33:29.471 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:33:29.047+0000 7fe2927fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:33:29.471 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:33:29.047+0000 7fe2927fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:33:29.471 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: get_monmap_and_config 2024-09-12T17:33:29.471 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: build_initial_monmap 2024-09-12T17:33:29.471 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:33:29.471 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 10 monclient: monmap: 2024-09-12T17:33:29.471 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:33:29.471 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:33:29.471 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:33:29.472 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:33:29.472 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:33:29.472 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.472 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:33:29.472 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:33:29.472 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:33:29.472 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.472 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding auth protocol: cephx 2024-09-12T17:33:29.472 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding auth protocol: cephx 2024-09-12T17:33:29.472 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding auth protocol: cephx 2024-09-12T17:33:29.472 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: secure 2024-09-12T17:33:29.472 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: crc 2024-09-12T17:33:29.472 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: secure 2024-09-12T17:33:29.473 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: crc 2024-09-12T17:33:29.473 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: secure 2024-09-12T17:33:29.473 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: crc 2024-09-12T17:33:29.473 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: crc 2024-09-12T17:33:29.473 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: secure 2024-09-12T17:33:29.473 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: crc 2024-09-12T17:33:29.473 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: secure 2024-09-12T17:33:29.473 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: crc 2024-09-12T17:33:29.473 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:33:29.047+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf80) adding con mode: secure 2024-09-12T17:33:29.473 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:33:29.047+0000 7fe3ac780640 10 monclient: get_auth_request con 0x7fe284070bc0 auth_method 0 2024-09-12T17:33:29.473 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.473 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: init 2024-09-12T17:33:29.473 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding auth protocol: cephx 2024-09-12T17:33:29.473 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding auth protocol: cephx 2024-09-12T17:33:29.474 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding auth protocol: cephx 2024-09-12T17:33:29.474 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: secure 2024-09-12T17:33:29.474 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: crc 2024-09-12T17:33:29.474 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: secure 2024-09-12T17:33:29.474 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: crc 2024-09-12T17:33:29.474 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: secure 2024-09-12T17:33:29.474 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: crc 2024-09-12T17:33:29.474 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: crc 2024-09-12T17:33:29.474 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: secure 2024-09-12T17:33:29.474 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: crc 2024-09-12T17:33:29.474 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: secure 2024-09-12T17:33:29.474 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: crc 2024-09-12T17:33:29.475 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ce5d0) adding con mode: secure 2024-09-12T17:33:29.475 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.475 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.475 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc378ce718 EEXIST 2024-09-12T17:33:29.475 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:33:29.475 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:33:29.475 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f19b5f9550 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:33:29.475 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f19b5f9930 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:33:29.475 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f19b5fadf0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:33:29.475 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.475 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.475 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.475 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:33:29.475 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): authenticate will time out at 2377.084768s 2024-09-12T17:33:29.476 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): get_auth_request con 0x55f19b5f9930 auth_method 0 2024-09-12T17:33:29.476 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.476 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.476 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.476 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): get_auth_request con 0x55f19b5fadf0 auth_method 0 2024-09-12T17:33:29.476 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.476 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.476 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.476 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.476 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.476 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.476 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.476 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.477 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.477 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): handle_auth_done global_id 6414 payload 274 2024-09-12T17:33:29.477 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient: _finish_hunting 0 2024-09-12T17:33:29.477 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:33:29.051+0000 7fe3ad782640 1 monclient: found mon.noname-a 2024-09-12T17:33:29.477 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:33:29.477 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:33:29.051+0000 7fe3ac780640 10 monclient: get_auth_request con 0x55f19b5f9550 auth_method 0 2024-09-12T17:33:29.477 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.477 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:33:29.477 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: dump: 2024-09-12T17:33:29.477 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.477 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.477 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.478 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.478 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.478 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.478 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.478 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.478 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.478 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.478 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: _finish_auth 0 2024-09-12T17:33:29.478 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: _check_auth_tickets 2024-09-12T17:33:29.478 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:29.478 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.478 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:33:29.478 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:33:29.051+0000 7fe283fff640 10 monclient: dump: 2024-09-12T17:33:29.479 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.479 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.479 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.479 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.479 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.479 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.479 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.479 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.479 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.479 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.479 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 monclient: authenticate success, global_id 6414 2024-09-12T17:33:29.479 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:33:29.479 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 4 set_mon_vals no callback set 2024-09-12T17:33:29.480 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: shutdown 2024-09-12T17:33:29.480 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: build_initial_monmap 2024-09-12T17:33:29.480 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:33:29.480 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: monmap: 2024-09-12T17:33:29.480 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:33:29.480 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:33:29.480 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:33:29.480 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:33:29.480 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:33:29.480 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.480 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:33:29.480 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:33:29.480 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:33:29.481 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.481 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding auth protocol: cephx 2024-09-12T17:33:29.481 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding auth protocol: cephx 2024-09-12T17:33:29.481 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding auth protocol: cephx 2024-09-12T17:33:29.481 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: secure 2024-09-12T17:33:29.481 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: crc 2024-09-12T17:33:29.481 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: secure 2024-09-12T17:33:29.481 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: crc 2024-09-12T17:33:29.481 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: secure 2024-09-12T17:33:29.481 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: crc 2024-09-12T17:33:29.481 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: crc 2024-09-12T17:33:29.481 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: secure 2024-09-12T17:33:29.481 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: crc 2024-09-12T17:33:29.482 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: secure 2024-09-12T17:33:29.482 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: crc 2024-09-12T17:33:29.482 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5caf30) adding con mode: secure 2024-09-12T17:33:29.482 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.482 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 1 librados: starting msgr at 2024-09-12T17:33:29.482 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 1 librados: starting objecter 2024-09-12T17:33:29.482 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f19b5f9430 EEXIST 2024-09-12T17:33:29.482 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 1 librados: setting wanted keys 2024-09-12T17:33:29.482 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 1 librados: calling monclient init 2024-09-12T17:33:29.482 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: init 2024-09-12T17:33:29.482 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding auth protocol: cephx 2024-09-12T17:33:29.482 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding auth protocol: cephx 2024-09-12T17:33:29.482 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding auth protocol: cephx 2024-09-12T17:33:29.483 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: secure 2024-09-12T17:33:29.483 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: crc 2024-09-12T17:33:29.483 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: secure 2024-09-12T17:33:29.483 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: crc 2024-09-12T17:33:29.483 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: secure 2024-09-12T17:33:29.483 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: crc 2024-09-12T17:33:29.483 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: crc 2024-09-12T17:33:29.483 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: secure 2024-09-12T17:33:29.483 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: crc 2024-09-12T17:33:29.483 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: secure 2024-09-12T17:33:29.483 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: crc 2024-09-12T17:33:29.483 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 AuthRegistry(0x55f19b5ad4b0) adding con mode: secure 2024-09-12T17:33:29.483 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.483 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.484 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command rotate-key cmddesc rotate-key hook 0x55f19b5ad5f8 EEXIST 2024-09-12T17:33:29.484 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:33:29.484 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:33:29.484 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f19b5f9550 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:33:29.484 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f19b5fadf0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:33:29.484 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f19b5ebbb0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:33:29.484 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.484 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.484 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:29.484 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:33:29.484 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:33:29.051+0000 7fe3af47b9c0 10 monclient(hunting): authenticate will time out at 2377.087416s 2024-09-12T17:33:29.484 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): get_auth_request con 0x55f19b5ebbb0 auth_method 0 2024-09-12T17:33:29.485 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.485 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.485 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.485 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): get_auth_request con 0x55f19b5fadf0 auth_method 0 2024-09-12T17:33:29.485 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:29.485 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:29.485 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:29.485 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.485 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.485 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.485 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:29.485 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:29.485 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:33:29.051+0000 7fe3ad782640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:29.486 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient(hunting): handle_auth_done global_id 6086 payload 824 2024-09-12T17:33:29.486 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient: _finish_hunting 0 2024-09-12T17:33:29.486 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:33:29.051+0000 7fe3acf81640 1 monclient: found mon.noname-c 2024-09-12T17:33:29.486 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:33:29.051+0000 7fe3acf81640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:33:29.486 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:33:29.051+0000 7fe3ac780640 10 monclient: get_auth_request con 0x55f19b5f9550 auth_method 0 2024-09-12T17:33:29.486 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.486 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:33:29.486 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: dump: 2024-09-12T17:33:29.486 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.486 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.486 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.486 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.486 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.487 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.487 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.487 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.487 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.487 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.487 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: _finish_auth 0 2024-09-12T17:33:29.487 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: _check_auth_tickets 2024-09-12T17:33:29.487 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:29.487 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:29.487 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:33:29.487 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:33:29.055+0000 7fe2827fc640 10 monclient: dump: 2024-09-12T17:33:29.487 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:33:29.487 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:33:29.487 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.488 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:33:29.488 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:29.488 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:33:29.488 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:33:29.488 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:33:29.488 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:33:29.488 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.488 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:33:29.055+0000 7fe283fff640 4 set_mon_vals no callback set 2024-09-12T17:33:29.488 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 5 monclient: authenticate success, global_id 6086 2024-09-12T17:33:29.488 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 10 monclient: _renew_subs 2024-09-12T17:33:29.488 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:33:29.488 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 10 monclient: _renew_subs 2024-09-12T17:33:29.488 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:33:29.489 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 1 librados: init done 2024-09-12T17:33:29.489 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command cr dump hook 0x55f19b5f0238 2024-09-12T17:33:29.489 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.489 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:33:29.055+0000 7fe2827fc640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:33:29.489 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:33:29.055+0000 7fe2827fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:33:29.489 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:33:29.055+0000 7fe2827fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:33:29.489 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:33:29.055+0000 7fe3ad782640 10 monclient: get_auth_request con 0x55f19b618d00 auth_method 0 2024-09-12T17:33:29.489 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:33:29.055+0000 7fe3ac780640 10 monclient: get_auth_request con 0x7fe278070b10 auth_method 0 2024-09-12T17:33:29.489 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.489 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 realm 2024-09-12T17:33:29.489 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.489 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.489 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:29.490 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:33:29.055+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.490 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:33:29.059+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.490 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:33:29.059+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.490 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:33:29.059+0000 7fe3ac780640 10 monclient: get_auth_request con 0x55f19b61d010 auth_method 0 2024-09-12T17:33:29.490 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:33:29.059+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:29.490 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:33:29.059+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.490 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:33:29.059+0000 7fe3ad782640 10 monclient: get_auth_request con 0x55f19b6207a0 auth_method 0 2024-09-12T17:33:29.490 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:33:29.059+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:29.490 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:33:29.063+0000 7fe3af47b9c0 20 searching for the correct realm 2024-09-12T17:33:29.490 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:33:29.063+0000 7fe3acf81640 10 monclient: get_auth_request con 0x55f19b625470 auth_method 0 2024-09-12T17:33:29.490 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:33:29.063+0000 7fe3ac780640 10 monclient: get_auth_request con 0x7fe39c0c0020 auth_method 0 2024-09-12T17:33:29.490 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:33:29.063+0000 7fe3ad782640 10 monclient: get_auth_request con 0x7fe394047040 auth_method 0 2024-09-12T17:33:29.490 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:33:29.063+0000 7fe3ad782640 0 -- 172.21.15.119:0/3089000198 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55f19b6207a0 msgr2=0x55f19b622b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:29.490 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:33:29.063+0000 7fe2827fc640 1 client.6086.objecter ms_handle_reset 0x55f19b6207a0 session 0x55f19b61c870 osd.4 2024-09-12T17:33:29.491 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:33:29.063+0000 7fe2827fc640 10 monclient: _renew_subs 2024-09-12T17:33:29.491 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:33:29.063+0000 7fe2827fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:33:29.491 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:33:29.067+0000 7fe3ad782640 10 monclient: get_auth_request con 0x7fe278081240 auth_method 0 2024-09-12T17:33:29.491 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:33:29.067+0000 7fe3acf81640 10 monclient: get_auth_request con 0x7fe3a4095040 auth_method 0 2024-09-12T17:33:29.491 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:33:29.071+0000 7fe3ac780640 10 monclient: get_auth_request con 0x7fe3a4068130 auth_method 0 2024-09-12T17:33:29.491 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:33:29.071+0000 7fe3ac780640 0 -- 172.21.15.119:0/3089000198 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fe3a4068130 msgr2=0x7fe3a407d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:29.491 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:33:29.275+0000 7fe3ac780640 10 monclient: get_auth_request con 0x7fe3a4068130 auth_method 0 2024-09-12T17:33:29.491 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:33:29.279+0000 7fe2827fc640 1 client.6086.objecter ms_handle_reset 0x55f19b618d00 session 0x55f19b618630 osd.1 2024-09-12T17:33:29.491 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:33:29.279+0000 7fe3ad782640 10 monclient: get_auth_request con 0x55f19b6207a0 auth_method 0 2024-09-12T17:33:29.491 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:29.491 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:29.491 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:29.491 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:29.492 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:29.492 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:29.492 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.492 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.492 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.492 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:29.492 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.492 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:29.492 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 zone default found 2024-09-12T17:33:29.492 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 4 Realm: () 2024-09-12T17:33:29.492 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:29.492 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:29.492 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:29.493 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 zonegroup default 2024-09-12T17:33:29.493 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.493 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.493 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:33:29.291+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.493 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:33:29.295+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.493 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:33:29.295+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.493 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:33:29.295+0000 7fe3af47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.493 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:33:29.295+0000 7fe3af47b9c0 20 started sync module instance, tier type = 2024-09-12T17:33:29.493 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:33:29.295+0000 7fe3af47b9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:29.493 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=0 2024-09-12T17:33:29.493 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=1 2024-09-12T17:33:29.493 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=2 2024-09-12T17:33:29.494 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=3 2024-09-12T17:33:29.494 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=4 2024-09-12T17:33:29.494 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=5 2024-09-12T17:33:29.494 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:33:29.319+0000 7fe3af47b9c0 20 add_watcher() i=6 2024-09-12T17:33:29.494 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:33:29.323+0000 7fe3af47b9c0 20 add_watcher() i=7 2024-09-12T17:33:29.494 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:33:29.323+0000 7fe3af47b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:29.494 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding auth protocol: cephx 2024-09-12T17:33:29.494 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding auth protocol: cephx 2024-09-12T17:33:29.494 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding auth protocol: cephx 2024-09-12T17:33:29.494 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: secure 2024-09-12T17:33:29.494 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: crc 2024-09-12T17:33:29.494 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: secure 2024-09-12T17:33:29.494 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: crc 2024-09-12T17:33:29.494 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: secure 2024-09-12T17:33:29.495 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: crc 2024-09-12T17:33:29.495 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: crc 2024-09-12T17:33:29.495 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: secure 2024-09-12T17:33:29.495 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: crc 2024-09-12T17:33:29.495 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: secure 2024-09-12T17:33:29.495 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: crc 2024-09-12T17:33:29.495 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:33:29.327+0000 7fe2637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:29.495 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 AuthRegistry(0x7ffc378ceaa0) adding con mode: secure 2024-09-12T17:33:29.495 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:29.495 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:29.495 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:29.495 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command cache list hook 0x55f19b5ecdc0 2024-09-12T17:33:29.495 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command cache inspect hook 0x55f19b5ecdc0 2024-09-12T17:33:29.496 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command cache erase hook 0x55f19b5ecdc0 2024-09-12T17:33:29.496 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command cache zap hook 0x55f19b5ecdc0 2024-09-12T17:33:29.496 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 note: GC not initialized 2024-09-12T17:33:29.496 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:33:29.327+0000 7fe2627e4640 20 reqs_thread_entry: start 2024-09-12T17:33:29.496 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command sync trace show hook 0x7fe39400c660 2024-09-12T17:33:29.496 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command sync trace history hook 0x7fe39400c660 2024-09-12T17:33:29.496 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command sync trace active hook 0x7fe39400c660 2024-09-12T17:33:29.496 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 5 asok(0x55f19b31f2b0) register_command sync trace active_short hook 0x7fe39400c660 2024-09-12T17:33:29.496 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:29.496 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 Filter name: none 2024-09-12T17:33:29.496 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:33:29.327+0000 7fe25b7fe640 20 reqs_thread_entry: start 2024-09-12T17:33:29.496 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:33:29.496 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.497 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:33:29.497 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:33:29.497 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:33:29.497 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 : miss 2024-09-12T17:33:29.497 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:33:29.327+0000 7fe3af47b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.497 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:33:29.331+0000 7fe3af47b9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:33:29.497 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:33:29.331+0000 7fe3af47b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 info.flags=0x17 2024-09-12T17:33:29.497 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:33:29.331+0000 7fe3af47b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 to cache LRU end 2024-09-12T17:33:29.497 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:33:29.331+0000 7fe3af47b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:29.497 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:33:29.331+0000 7fe3af47b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:29.497 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:33:29.331+0000 7fe3af47b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 2024-09-12T17:33:29.497 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:33:29.335+0000 7fe3af47b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe3af47b9c0 time 2024-09-12T17:33:29.337575+0000 2024-09-12T17:33:29.497 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:33:29.498 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.498 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:33:29.498 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe3b2d552eb] 2024-09-12T17:33:29.498 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe3b2d5549f] 2024-09-12T17:33:29.498 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f1997250c1] 2024-09-12T17:33:29.498 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x140f572) [0x55f19a17a572] 2024-09-12T17:33:29.498 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f19973718d] 2024-09-12T17:33:29.498 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:33:29.498 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe3b1bbbd90] 2024-09-12T17:33:29.498 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:33:29.498 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:33:29.498 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.498 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:33:29.339+0000 7fe3af47b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:33:29.498 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fe3af47b9c0 thread_name:radosgw-admin 2024-09-12T17:33:29.499 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.499 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:33:29.499 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe3b1bd4520] 2024-09-12T17:33:29.499 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:33:29.499 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:33:29.499 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:33:29.499 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe3b2d55345] 2024-09-12T17:33:29.499 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe3b2d5549f] 2024-09-12T17:33:29.499 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f1997250c1] 2024-09-12T17:33:29.499 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x140f572) [0x55f19a17a572] 2024-09-12T17:33:29.499 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f19973718d] 2024-09-12T17:33:29.499 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:33:29.500 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe3b1bbbd90] 2024-09-12T17:33:29.500 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:33:29.500 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:33:29.500 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:33:29.500 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.500 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:33:29.500 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:33:29.500 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:33:29.500 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:33:29.500 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:33:29.500 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:33:29.500 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:33:29.500 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:33:29.500 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:33:29.501 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:33:29.501 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:33:29.501 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:33:29.501 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:33:29.501 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:33:29.501 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:33:29.501 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:33:29.501 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:33:29.501 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:33:29.501 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:33:29.501 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:33:29.501 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:33:29.501 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:33:29.502 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:33:29.502 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:33:29.502 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:33:29.502 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:33:29.502 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:33:29.502 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:33:29.502 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:33:29.502 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:33:29.502 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:33:29.502 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:33:29.502 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:33:29.502 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:33:29.502 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:33:29.502 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:33:29.502 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:33:29.503 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:33:29.503 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:33:29.503 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:33:29.503 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:33:29.503 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:33:29.503 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:33:29.503 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:33:29.503 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:33:29.503 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:33:29.503 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:33:29.503 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:33:29.503 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:33:29.503 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:33:29.504 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:33:29.504 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:33:29.504 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:33:29.504 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:33:29.504 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:33:29.504 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:33:29.504 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:33:29.504 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:33:29.504 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:33:29.504 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:33:29.504 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:33:29.504 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:33:29.505 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:33:29.505 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:33:29.505 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:33:29.505 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:33:29.505 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:33:29.505 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:33:29.505 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:33:29.505 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:33:29.505 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:33:29.505 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:33:29.505 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:33:29.505 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:33:29.505 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:33:29.505 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:33:29.506 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:33:29.506 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:33:29.506 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:33:29.506 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:33:29.506 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:33:29.506 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:33:29.506 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:33:29.506 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:33:29.506 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:33:29.506 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:33:29.506 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:33:29.506 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:33:29.506 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:33:29.506 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:33:29.507 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:33:29.507 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:33:29.507 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:33:29.507 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:33:29.507 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe25b7fe640 / http_manager 2024-09-12T17:33:29.507 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe2627e4640 / http_manager 2024-09-12T17:33:29.507 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe2637e6640 / rgw_dt_lg_renew 2024-09-12T17:33:29.507 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe2827fc640 / ms_dispatch 2024-09-12T17:33:29.507 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe283fff640 / io_context_pool 2024-09-12T17:33:29.507 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe2927fc640 / ms_dispatch 2024-09-12T17:33:29.507 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe29960a640 / ms_dispatch 2024-09-12T17:33:29.507 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe29ae0d640 / io_context_pool 2024-09-12T17:33:29.507 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe3ac780640 / msgr-worker-2 2024-09-12T17:33:29.508 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe3acf81640 / msgr-worker-1 2024-09-12T17:33:29.508 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe3ad782640 / msgr-worker-0 2024-09-12T17:33:29.508 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe3adf83640 / io_context_pool 2024-09-12T17:33:29.508 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe3af47b9c0 / radosgw-admin 2024-09-12T17:33:29.508 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:33:29.508 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:33:29.508 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:33:29.344536Z_008cfc69-c1ca-4670-9095-55ce04fa528e/log 2024-09-12T17:33:29.508 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:33:29.508 INFO:tasks.workunit.client.0.smithi119.stderr:Aborted 2024-09-12T17:33:29.508 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:33:29.508 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:29.508 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:29.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.431+0000 7fc151bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.435+0000 7fc151bdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.435+0000 7fc151bdf9c0 20 realm 2024-09-12T17:33:29.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.435+0000 7fc151bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.435+0000 7fc151bdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.435+0000 7fc151bdf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:29.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.435+0000 7fc151bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.435+0000 7fc151bdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.435+0000 7fc151bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.435+0000 7fc151bdf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:29.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.435+0000 7fc151bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.439+0000 7fc151bdf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:29.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.439+0000 7fc151bdf9c0 20 searching for the correct realm 2024-09-12T17:33:29.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.439+0000 7fc14fee6640 0 -- 172.21.15.119:0/1312296931 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55e0ecae5be0 msgr2=0x55e0ecae7fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:33:29.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.447+0000 7fc14eee4640 0 -- 172.21.15.119:0/1312296931 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fc14800e040 msgr2=0x7fc1480870d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:33:29.660 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.663+0000 7fc151bdf9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:29.660 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.663+0000 7fc151bdf9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:29.660 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.663+0000 7fc151bdf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:29.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.663+0000 7fc151bdf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:29.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.663+0000 7fc151bdf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:29.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.663+0000 7fc151bdf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:29.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.663+0000 7fc151bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.663+0000 7fc151bdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.663+0000 7fc151bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.663+0000 7fc151bdf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:29.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.667+0000 7fc151bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.667+0000 7fc151bdf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:29.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.667+0000 7fc151bdf9c0 20 zone default found 2024-09-12T17:33:29.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.667+0000 7fc151bdf9c0 4 Realm: () 2024-09-12T17:33:29.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.667+0000 7fc151bdf9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:29.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.667+0000 7fc151bdf9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:29.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.667+0000 7fc151bdf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:29.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.667+0000 7fc151bdf9c0 20 zonegroup default 2024-09-12T17:33:29.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.667+0000 7fc151bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.667+0000 7fc151bdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.667+0000 7fc151bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.667+0000 7fc151bdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.667+0000 7fc151bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.667+0000 7fc151bdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.667+0000 7fc151bdf9c0 20 started sync module instance, tier type = 2024-09-12T17:33:29.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.667+0000 7fc151bdf9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:29.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.691+0000 7fc151bdf9c0 20 add_watcher() i=0 2024-09-12T17:33:29.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.691+0000 7fc151bdf9c0 20 add_watcher() i=1 2024-09-12T17:33:29.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.691+0000 7fc151bdf9c0 20 add_watcher() i=2 2024-09-12T17:33:29.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.691+0000 7fc151bdf9c0 20 add_watcher() i=3 2024-09-12T17:33:29.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.691+0000 7fc151bdf9c0 20 add_watcher() i=4 2024-09-12T17:33:29.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.691+0000 7fc151bdf9c0 20 add_watcher() i=5 2024-09-12T17:33:29.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.691+0000 7fc151bdf9c0 20 add_watcher() i=6 2024-09-12T17:33:29.691 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.695+0000 7fc151bdf9c0 20 add_watcher() i=7 2024-09-12T17:33:29.691 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.695+0000 7fc151bdf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:29.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.699+0000 7fc005fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:29.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.699+0000 7fc151bdf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:29.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.699+0000 7fc151bdf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:29.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.699+0000 7fc151bdf9c0 5 note: GC not initialized 2024-09-12T17:33:29.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.699+0000 7fc004fe1640 20 reqs_thread_entry: start 2024-09-12T17:33:29.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.699+0000 7fc151bdf9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:29.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.699+0000 7fc151bdf9c0 20 Filter name: none 2024-09-12T17:33:29.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.699+0000 7fbf7e7fc640 20 reqs_thread_entry: start 2024-09-12T17:33:29.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.699+0000 7fc151bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.703+0000 7fc151bdf9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:33:29.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.703+0000 7fc151bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.703+0000 7fc151bdf9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:33:29.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.703+0000 7fc151bdf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:29.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.703+0000 7fc151bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.703+0000 7fc151bdf9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:33:29.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.703+0000 7fc151bdf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.703+0000 7fc151bdf9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:33:29.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.703+0000 7fc151bdf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:29.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.707+0000 7fc005fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:29.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.715+0000 7fc151bdf9c0 20 remove_watcher() i=0 2024-09-12T17:33:29.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.715+0000 7fc151bdf9c0 2 removed watcher, disabling cache 2024-09-12T17:33:29.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.715+0000 7fc151bdf9c0 20 remove_watcher() i=1 2024-09-12T17:33:29.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.719+0000 7fc151bdf9c0 20 remove_watcher() i=2 2024-09-12T17:33:29.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.719+0000 7fc151bdf9c0 20 remove_watcher() i=3 2024-09-12T17:33:29.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.723+0000 7fc151bdf9c0 20 remove_watcher() i=4 2024-09-12T17:33:29.720 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.723+0000 7fc151bdf9c0 20 remove_watcher() i=5 2024-09-12T17:33:29.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.727+0000 7fc151bdf9c0 20 remove_watcher() i=6 2024-09-12T17:33:29.723 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.727+0000 7fc151bdf9c0 20 remove_watcher() i=7 2024-09-12T17:33:29.739 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.739 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:33:29.739 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-init-indext id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:33:29.739 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:33:29.843 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:33:29.879 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:29.879 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:29.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.927+0000 7f24bcdfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.931+0000 7f24bcdfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.931+0000 7f24bcdfb9c0 20 realm 2024-09-12T17:33:29.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.931+0000 7f24bcdfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.931+0000 7f24bcdfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.931+0000 7f24bcdfb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:29.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.931+0000 7f24bcdfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.931+0000 7f24bcdfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:29.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.931+0000 7f24bcdfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.931+0000 7f24bcdfb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:29.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.931+0000 7f24bcdfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:29.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.935+0000 7f24bcdfb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:29.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.935+0000 7f24bcdfb9c0 20 searching for the correct realm 2024-09-12T17:33:29.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:29.939+0000 7f24bb102640 0 -- 172.21.15.119:0/2807148026 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f24b0068240 msgr2=0x7f24b006e9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:30.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.155+0000 7f24ba100640 0 -- 172.21.15.119:0/2807148026 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f24b4105940 msgr2=0x7f24b41160a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:30.369 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.371+0000 7f24bcdfb9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:33:30.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.371+0000 7f24bcdfb9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:33:30.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.371+0000 7f24bcdfb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:30.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.371+0000 7f24bcdfb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:30.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.371+0000 7f24bcdfb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:30.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.371+0000 7f24bcdfb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:30.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.371+0000 7f24bcdfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:30.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.375+0000 7f24bcdfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:30.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.375+0000 7f24bcdfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:30.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.375+0000 7f24bcdfb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:30.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.375+0000 7f24bcdfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:30.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.375+0000 7f24bcdfb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:30.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.375+0000 7f24bcdfb9c0 20 zone default found 2024-09-12T17:33:30.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.375+0000 7f24bcdfb9c0 4 Realm: () 2024-09-12T17:33:30.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.375+0000 7f24bcdfb9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:33:30.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.375+0000 7f24bcdfb9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:33:30.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.375+0000 7f24bcdfb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:30.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.375+0000 7f24bcdfb9c0 20 zonegroup default 2024-09-12T17:33:30.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.375+0000 7f24bcdfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:30.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.375+0000 7f24bcdfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:30.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.375+0000 7f24bcdfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:30.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.375+0000 7f24bcdfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:30.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.375+0000 7f24bcdfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:30.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.379+0000 7f24bcdfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:30.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.379+0000 7f24bcdfb9c0 20 started sync module instance, tier type = 2024-09-12T17:33:30.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.379+0000 7f24bcdfb9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:33:30.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.399+0000 7f24bcdfb9c0 20 add_watcher() i=0 2024-09-12T17:33:30.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.399+0000 7f24bcdfb9c0 20 add_watcher() i=1 2024-09-12T17:33:30.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.399+0000 7f24bcdfb9c0 20 add_watcher() i=2 2024-09-12T17:33:30.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.399+0000 7f24bcdfb9c0 20 add_watcher() i=3 2024-09-12T17:33:30.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.399+0000 7f24bcdfb9c0 20 add_watcher() i=4 2024-09-12T17:33:30.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.399+0000 7f24bcdfb9c0 20 add_watcher() i=5 2024-09-12T17:33:30.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.399+0000 7f24bcdfb9c0 20 add_watcher() i=6 2024-09-12T17:33:30.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.403+0000 7f24bcdfb9c0 20 add_watcher() i=7 2024-09-12T17:33:30.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.403+0000 7f24bcdfb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:30.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.407+0000 7f23717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:30.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.407+0000 7f24bcdfb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:30.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.407+0000 7f24bcdfb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:30.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.407+0000 7f24bcdfb9c0 5 note: GC not initialized 2024-09-12T17:33:30.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.407+0000 7f22ebfff640 20 reqs_thread_entry: start 2024-09-12T17:33:30.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.411+0000 7f24bcdfb9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:33:30.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.411+0000 7f24bcdfb9c0 20 Filter name: none 2024-09-12T17:33:30.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.411+0000 7f22e9ffb640 20 reqs_thread_entry: start 2024-09-12T17:33:30.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.411+0000 7f24bcdfb9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:33:30.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.411+0000 7f24bcdfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:30.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.411+0000 7f24bcdfb9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:33:30.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.411+0000 7f24bcdfb9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:33:30.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.411+0000 7f24bcdfb9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:33:30.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.411+0000 7f24bcdfb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 : miss 2024-09-12T17:33:30.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.411+0000 7f24bcdfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:33:30.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.411+0000 7f24bcdfb9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:33:30.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.411+0000 7f24bcdfb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 info.flags=0x17 2024-09-12T17:33:30.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.411+0000 7f24bcdfb9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 to cache LRU end 2024-09-12T17:33:30.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.411+0000 7f24bcdfb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:30.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.411+0000 7f24bcdfb9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:30.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.411+0000 7f24bcdfb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 2024-09-12T17:33:30.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.415+0000 7f24bcdfb9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 to be held by another RGW process; skipping for now 2024-09-12T17:33:30.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.415+0000 7f23717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:30.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.419+0000 7f24bcdfb9c0 20 remove_watcher() i=0 2024-09-12T17:33:30.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.419+0000 7f24bcdfb9c0 2 removed watcher, disabling cache 2024-09-12T17:33:30.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.423+0000 7f24bcdfb9c0 20 remove_watcher() i=1 2024-09-12T17:33:30.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.427+0000 7f24bcdfb9c0 20 remove_watcher() i=2 2024-09-12T17:33:30.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.427+0000 7f24bcdfb9c0 20 remove_watcher() i=3 2024-09-12T17:33:30.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.431+0000 7f24bcdfb9c0 20 remove_watcher() i=4 2024-09-12T17:33:30.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.431+0000 7f24bcdfb9c0 20 remove_watcher() i=5 2024-09-12T17:33:30.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.431+0000 7f24bcdfb9c0 20 remove_watcher() i=6 2024-09-12T17:33:30.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:33:30.431+0000 7f24bcdfb9c0 20 remove_watcher() i=7 2024-09-12T17:33:30.446 INFO:tasks.workunit.client.0.smithi119.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:34:00.476 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:34:00.512 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:00.512 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:00.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:00.561+0000 7fbc3af759c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:00.561+0000 7fbc3af759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:00.561+0000 7fbc3af759c0 20 realm 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:00.561+0000 7fbc3af759c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:00.561+0000 7fbc3af759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:00.561+0000 7fbc3af759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:00.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:00.561+0000 7fbc3af759c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:00.561+0000 7fbc3af759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:00.561+0000 7fbc3af759c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:00.565+0000 7fbc3af759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:00.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:00.565+0000 7fbc3af759c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:00.565+0000 7fbc3af759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:00.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:00.565+0000 7fbc3af759c0 20 searching for the correct realm 2024-09-12T17:34:00.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:00.569+0000 7fbc3927c640 0 -- 172.21.15.119:0/1792742354 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fbc20031060 msgr2=0x7fbc20062380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:00.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:00.785+0000 7fbc3827a640 0 -- 172.21.15.119:0/1792742354 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fbc300a9070 msgr2=0x7fbc300ff880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:01.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.001+0000 7fbc3af759c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:01.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.001+0000 7fbc3af759c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:01.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.001+0000 7fbc3af759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:01.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.001+0000 7fbc3af759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:01.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.001+0000 7fbc3af759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:01.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.001+0000 7fbc3af759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:01.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.001+0000 7fbc3af759c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.001+0000 7fbc3af759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.001+0000 7fbc3af759c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:01.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:01.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 20 zone default found 2024-09-12T17:34:01.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 4 Realm: () 2024-09-12T17:34:01.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:01.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:01.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:01.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 20 zonegroup default 2024-09-12T17:34:01.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 20 started sync module instance, tier type = 2024-09-12T17:34:01.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.005+0000 7fbc3af759c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:01.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.029+0000 7fbc3af759c0 20 add_watcher() i=0 2024-09-12T17:34:01.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.029+0000 7fbc3af759c0 20 add_watcher() i=1 2024-09-12T17:34:01.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.029+0000 7fbc3af759c0 20 add_watcher() i=2 2024-09-12T17:34:01.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.029+0000 7fbc3af759c0 20 add_watcher() i=3 2024-09-12T17:34:01.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.029+0000 7fbc3af759c0 20 add_watcher() i=4 2024-09-12T17:34:01.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.029+0000 7fbc3af759c0 20 add_watcher() i=5 2024-09-12T17:34:01.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.029+0000 7fbc3af759c0 20 add_watcher() i=6 2024-09-12T17:34:01.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.029+0000 7fbc3af759c0 20 add_watcher() i=7 2024-09-12T17:34:01.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.029+0000 7fbc3af759c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:01.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.033+0000 7fbaef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:01.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.037+0000 7fbc3af759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:01.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.037+0000 7fbc3af759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:01.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.037+0000 7fbc3af759c0 5 note: GC not initialized 2024-09-12T17:34:01.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.037+0000 7fbaee7e4640 20 reqs_thread_entry: start 2024-09-12T17:34:01.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.037+0000 7fbc3af759c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:01.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.037+0000 7fbc3af759c0 20 Filter name: none 2024-09-12T17:34:01.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.037+0000 7fbae77fe640 20 reqs_thread_entry: start 2024-09-12T17:34:01.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.037+0000 7fbc3af759c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:34:01.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.037+0000 7fbc3af759c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.037+0000 7fbc3af759c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:34:01.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.037+0000 7fbc3af759c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:34:01.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.037+0000 7fbc3af759c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:34:01.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.037+0000 7fbc3af759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 : miss 2024-09-12T17:34:01.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.037+0000 7fbc3af759c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.041+0000 7fbc3af759c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:34:01.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.041+0000 7fbc3af759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 info.flags=0x17 2024-09-12T17:34:01.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.041+0000 7fbc3af759c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 to cache LRU end 2024-09-12T17:34:01.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.041+0000 7fbc3af759c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:01.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.041+0000 7fbc3af759c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:01.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.041+0000 7fbc3af759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 2024-09-12T17:34:01.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.049+0000 7fbc3af759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 info.flags=0x17 2024-09-12T17:34:01.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.049+0000 7fbc3af759c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 to cache LRU end 2024-09-12T17:34:01.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.049+0000 7fbc3af759c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:01.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.049+0000 7fbc3af759c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22, ofs0, ns] 2024-09-12T17:34:01.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.053+0000 7fbb0f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333482 cookie 94779459263168 notifier 6468 bl.length()=997 2024-09-12T17:34:01.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.053+0000 7fbb0f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 info.flags=0x17 2024-09-12T17:34:01.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.053+0000 7fbb0f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 to cache LRU end 2024-09-12T17:34:01.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.053+0000 7fbb0f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:01.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.053+0000 7fbc3af759c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22]): orig_sources= new_sources= 2024-09-12T17:34:01.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.053+0000 7fbc3af759c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22]): potential sources added=[] removed=[] 2024-09-12T17:34:01.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.053+0000 7fbc3af759c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22]): orig_dests= new_dests= 2024-09-12T17:34:01.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.053+0000 7fbc3af759c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22]): potential dests added=[] removed=[] 2024-09-12T17:34:01.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.0 2024-09-12T17:34:01.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.0 2024-09-12T17:34:01.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.1 2024-09-12T17:34:01.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.1 2024-09-12T17:34:01.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.2 2024-09-12T17:34:01.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.2 2024-09-12T17:34:01.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.3 2024-09-12T17:34:01.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.3 2024-09-12T17:34:01.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.4 2024-09-12T17:34:01.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.4 2024-09-12T17:34:01.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.5 2024-09-12T17:34:01.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.5 2024-09-12T17:34:01.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.6 2024-09-12T17:34:01.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.6 2024-09-12T17:34:01.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.7 2024-09-12T17:34:01.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.7 2024-09-12T17:34:01.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.8 2024-09-12T17:34:01.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.8 2024-09-12T17:34:01.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.9 2024-09-12T17:34:01.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.9 2024-09-12T17:34:01.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.10 2024-09-12T17:34:01.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.10 2024-09-12T17:34:01.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.11 2024-09-12T17:34:01.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1.11 2024-09-12T17:34:01.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.0 2024-09-12T17:34:01.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1 2024-09-12T17:34:01.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.2 2024-09-12T17:34:01.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.065+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.3 2024-09-12T17:34:01.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.069+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.4 2024-09-12T17:34:01.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.069+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.5 2024-09-12T17:34:01.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.069+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.6 2024-09-12T17:34:01.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.069+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.7 2024-09-12T17:34:01.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.073+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.8 2024-09-12T17:34:01.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.073+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.9 2024-09-12T17:34:01.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.073+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.10 2024-09-12T17:34:01.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.081+0000 7fbc3af759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:01.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.081+0000 7fbc3af759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 2024-09-12T17:34:01.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.085+0000 7fbc3af759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 info.flags=0x17 2024-09-12T17:34:01.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.085+0000 7fbc3af759c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 to cache LRU end 2024-09-12T17:34:01.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.085+0000 7fbc3af759c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:01.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.085+0000 7fbc3af759c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22, ofs0, ns] 2024-09-12T17:34:01.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.085+0000 7fbb0f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333483 cookie 94779459263168 notifier 6468 bl.length()=997 2024-09-12T17:34:01.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.085+0000 7fbb0f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 info.flags=0x17 2024-09-12T17:34:01.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.085+0000 7fbb0f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 to cache LRU end 2024-09-12T17:34:01.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.085+0000 7fbb0f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:01.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.093+0000 7fbc3af759c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22]): orig_sources= new_sources= 2024-09-12T17:34:01.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.093+0000 7fbc3af759c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22]): potential sources added=[] removed=[] 2024-09-12T17:34:01.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.093+0000 7fbc3af759c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22]): orig_dests= new_dests= 2024-09-12T17:34:01.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.093+0000 7fbc3af759c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22]): potential dests added=[] removed=[] 2024-09-12T17:34:01.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.097+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.0 2024-09-12T17:34:01.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.097+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.1 2024-09-12T17:34:01.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.101+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.2 2024-09-12T17:34:01.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.101+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.3 2024-09-12T17:34:01.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.101+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.4 2024-09-12T17:34:01.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.101+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.5 2024-09-12T17:34:01.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.101+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.6 2024-09-12T17:34:01.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.101+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.7 2024-09-12T17:34:01.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.105+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.8 2024-09-12T17:34:01.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.105+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.9 2024-09-12T17:34:01.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.105+0000 7fbc3af759c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22.10 2024-09-12T17:34:01.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.105+0000 7fbc3af759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:01.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.105+0000 7fbc3af759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 2024-09-12T17:34:01.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.109+0000 7fbc3af759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 info.flags=0x17 2024-09-12T17:34:01.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.109+0000 7fbc3af759c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 to cache LRU end 2024-09-12T17:34:01.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.109+0000 7fbc3af759c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:01.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.109+0000 7fbc3af759c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22, ofs0, ns] 2024-09-12T17:34:01.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.109+0000 7fbb0ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333484 cookie 94779459263168 notifier 6468 bl.length()=965 2024-09-12T17:34:01.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.109+0000 7fbb0ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 info.flags=0x17 2024-09-12T17:34:01.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.109+0000 7fbb0ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 to cache LRU end 2024-09-12T17:34:01.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.109+0000 7fbb0ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:01.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.113+0000 7fbc3af759c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22]): orig_sources= new_sources= 2024-09-12T17:34:01.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.113+0000 7fbc3af759c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22]): potential sources added=[] removed=[] 2024-09-12T17:34:01.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.113+0000 7fbc3af759c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22]): orig_dests= new_dests= 2024-09-12T17:34:01.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.113+0000 7fbc3af759c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22]): potential dests added=[] removed=[] 2024-09-12T17:34:01.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.121+0000 7fbc3af759c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-12T17:34:01.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.121+0000 7fbaef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:01.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.129+0000 7fbc3af759c0 20 remove_watcher() i=0 2024-09-12T17:34:01.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.129+0000 7fbc3af759c0 2 removed watcher, disabling cache 2024-09-12T17:34:01.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.129+0000 7fbc3af759c0 20 remove_watcher() i=1 2024-09-12T17:34:01.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.133+0000 7fbc3af759c0 20 remove_watcher() i=2 2024-09-12T17:34:01.133 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.133+0000 7fbc3af759c0 20 remove_watcher() i=3 2024-09-12T17:34:01.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.137+0000 7fbc3af759c0 20 remove_watcher() i=4 2024-09-12T17:34:01.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.137+0000 7fbc3af759c0 20 remove_watcher() i=5 2024-09-12T17:34:01.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.141+0000 7fbc3af759c0 20 remove_watcher() i=6 2024-09-12T17:34:01.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.141+0000 7fbc3af759c0 20 remove_watcher() i=7 2024-09-12T17:34:01.156 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:34:01.183 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:01.183 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:01.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.229+0000 7fe2935639c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.233+0000 7fe2935639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.233+0000 7fe2935639c0 20 realm 2024-09-12T17:34:01.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.233+0000 7fe2935639c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.233+0000 7fe2935639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.233+0000 7fe2935639c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:01.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.233+0000 7fe2935639c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.233+0000 7fe2935639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.233+0000 7fe2935639c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.234 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.233+0000 7fe2935639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:01.234 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.233+0000 7fe2935639c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.237+0000 7fe2935639c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:01.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.237+0000 7fe2935639c0 20 searching for the correct realm 2024-09-12T17:34:01.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.237+0000 7fe291069640 0 -- 172.21.15.119:0/562873170 >> [v2:172.21.15.119:6800/1732749810,v1:172.21.15.119:6801/1732749810] conn(0x562f5b579620 msgr2=0x562f5b57bae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:01.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.245+0000 7fe291069640 0 -- 172.21.15.119:0/562873170 >> [v2:172.21.15.194:6824/504391855,v1:172.21.15.194:6825/504391855] conn(0x7fe28c01f060 msgr2=0x7fe28c074780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:01.470 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.469+0000 7fe2935639c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:01.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.469+0000 7fe2935639c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:01.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.469+0000 7fe2935639c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:01.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.469+0000 7fe2935639c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:01.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.469+0000 7fe2935639c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:01.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.469+0000 7fe2935639c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:01.472 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.469+0000 7fe2935639c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.472 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.473+0000 7fe2935639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.472 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.473+0000 7fe2935639c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.473+0000 7fe2935639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:01.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.473+0000 7fe2935639c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.473+0000 7fe2935639c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:01.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.473+0000 7fe2935639c0 20 zone default found 2024-09-12T17:34:01.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.473+0000 7fe2935639c0 4 Realm: () 2024-09-12T17:34:01.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.473+0000 7fe2935639c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:01.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.473+0000 7fe2935639c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:01.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.473+0000 7fe2935639c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:01.475 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.473+0000 7fe2935639c0 20 zonegroup default 2024-09-12T17:34:01.475 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.473+0000 7fe2935639c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.475 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.473+0000 7fe2935639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.473+0000 7fe2935639c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.477+0000 7fe2935639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.477+0000 7fe2935639c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.477+0000 7fe2935639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.477+0000 7fe2935639c0 20 started sync module instance, tier type = 2024-09-12T17:34:01.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.477+0000 7fe2935639c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:01.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.501+0000 7fe2935639c0 20 add_watcher() i=0 2024-09-12T17:34:01.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.501+0000 7fe2935639c0 20 add_watcher() i=1 2024-09-12T17:34:01.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.501+0000 7fe2935639c0 20 add_watcher() i=2 2024-09-12T17:34:01.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.501+0000 7fe2935639c0 20 add_watcher() i=3 2024-09-12T17:34:01.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.501+0000 7fe2935639c0 20 add_watcher() i=4 2024-09-12T17:34:01.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.501+0000 7fe2935639c0 20 add_watcher() i=5 2024-09-12T17:34:01.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.501+0000 7fe2935639c0 20 add_watcher() i=6 2024-09-12T17:34:01.502 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.501+0000 7fe2935639c0 20 add_watcher() i=7 2024-09-12T17:34:01.502 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.501+0000 7fe2935639c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:01.506 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.505+0000 7fe1477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:01.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.509+0000 7fe2935639c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:01.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.509+0000 7fe2935639c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:01.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.509+0000 7fe2935639c0 5 note: GC not initialized 2024-09-12T17:34:01.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.509+0000 7fe1467e4640 20 reqs_thread_entry: start 2024-09-12T17:34:01.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.509+0000 7fe2935639c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:01.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.509+0000 7fe2935639c0 20 Filter name: none 2024-09-12T17:34:01.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.509+0000 7fe0b7fff640 20 reqs_thread_entry: start 2024-09-12T17:34:01.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.509+0000 7fe2935639c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.509+0000 7fe2935639c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:34:01.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.509+0000 7fe2935639c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.513+0000 7fe2935639c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:34:01.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.513+0000 7fe2935639c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:01.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.513+0000 7fe2935639c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.513+0000 7fe2935639c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:34:01.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.513+0000 7fe2935639c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.513+0000 7fe2935639c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:34:01.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.513+0000 7fe2935639c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:01.515 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.517+0000 7fe1477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:01.520 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.521+0000 7fe2935639c0 20 remove_watcher() i=0 2024-09-12T17:34:01.520 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.521+0000 7fe2935639c0 2 removed watcher, disabling cache 2024-09-12T17:34:01.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.525+0000 7fe2935639c0 20 remove_watcher() i=1 2024-09-12T17:34:01.525 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.525+0000 7fe2935639c0 20 remove_watcher() i=2 2024-09-12T17:34:01.527 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.529+0000 7fe2935639c0 20 remove_watcher() i=3 2024-09-12T17:34:01.529 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.529+0000 7fe2935639c0 20 remove_watcher() i=4 2024-09-12T17:34:01.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.533+0000 7fe2935639c0 20 remove_watcher() i=5 2024-09-12T17:34:01.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.533+0000 7fe2935639c0 20 remove_watcher() i=6 2024-09-12T17:34:01.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:01.533+0000 7fe2935639c0 20 remove_watcher() i=7 2024-09-12T17:34:01.550 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:01.550 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:34:01.550 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-init-indext id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:34:01.550 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:02.479 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T17:34:02.479 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:04.692 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:34:04.724 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:04.725 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:04.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:04.773+0000 7ffb569e59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:04.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:04.773+0000 7ffb569e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:04.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:04.773+0000 7ffb569e59c0 20 realm 2024-09-12T17:34:04.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:04.773+0000 7ffb569e59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:04.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:04.777+0000 7ffb569e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:04.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:04.777+0000 7ffb569e59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:04.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:04.777+0000 7ffb569e59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:04.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:04.777+0000 7ffb569e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:04.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:04.777+0000 7ffb569e59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:04.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:04.777+0000 7ffb569e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:04.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:04.777+0000 7ffb569e59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:04.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:04.777+0000 7ffb569e59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:04.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:04.777+0000 7ffb569e59c0 20 searching for the correct realm 2024-09-12T17:34:04.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:04.781+0000 7ffb54cec640 0 -- 172.21.15.119:0/2756846562 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7ffb3c0e2030 msgr2=0x7ffb3c0d5920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:04.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:04.789+0000 7ffb53cea640 0 -- 172.21.15.119:0/2756846562 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7ffb4c048930 msgr2=0x7ffb4c05f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:05.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:05.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:05.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:05.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:05.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:05.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:05.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:05.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:05.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:05.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 zone default found 2024-09-12T17:34:05.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 4 Realm: () 2024-09-12T17:34:05.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:05.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:05.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:05.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 zonegroup default 2024-09-12T17:34:05.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:05.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.009+0000 7ffb569e59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.013+0000 7ffb569e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:05.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.013+0000 7ffb569e59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.013+0000 7ffb569e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:05.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.013+0000 7ffb569e59c0 20 started sync module instance, tier type = 2024-09-12T17:34:05.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.013+0000 7ffb569e59c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:05.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.037+0000 7ffb569e59c0 20 add_watcher() i=0 2024-09-12T17:34:05.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.037+0000 7ffb569e59c0 20 add_watcher() i=1 2024-09-12T17:34:05.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.037+0000 7ffb569e59c0 20 add_watcher() i=2 2024-09-12T17:34:05.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.037+0000 7ffb569e59c0 20 add_watcher() i=3 2024-09-12T17:34:05.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.037+0000 7ffb569e59c0 20 add_watcher() i=4 2024-09-12T17:34:05.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.037+0000 7ffb569e59c0 20 add_watcher() i=5 2024-09-12T17:34:05.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.037+0000 7ffb569e59c0 20 add_watcher() i=6 2024-09-12T17:34:05.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.041+0000 7ffb569e59c0 20 add_watcher() i=7 2024-09-12T17:34:05.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.041+0000 7ffb569e59c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:05.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.045+0000 7ffa0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:05.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.045+0000 7ffb569e59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:05.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.045+0000 7ffb569e59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:05.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.045+0000 7ffb569e59c0 5 note: GC not initialized 2024-09-12T17:34:05.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.045+0000 7ffa09fdb640 20 reqs_thread_entry: start 2024-09-12T17:34:05.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.045+0000 7ffb569e59c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:05.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.045+0000 7ffb569e59c0 20 Filter name: none 2024-09-12T17:34:05.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.045+0000 7ff97b7fe640 20 reqs_thread_entry: start 2024-09-12T17:34:05.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.045+0000 7ffb569e59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.045+0000 7ffb569e59c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:05.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.045+0000 7ffb569e59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.049+0000 7ffb569e59c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:05.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.049+0000 7ffb569e59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:05.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.049+0000 7ffb569e59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.049+0000 7ffb569e59c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:05.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.049+0000 7ffb569e59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.049+0000 7ffb569e59c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:05.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.049+0000 7ffb569e59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:05.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.053+0000 7ffa0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:05.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.057+0000 7ffb569e59c0 20 remove_watcher() i=0 2024-09-12T17:34:05.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.057+0000 7ffb569e59c0 2 removed watcher, disabling cache 2024-09-12T17:34:05.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.061+0000 7ffb569e59c0 20 remove_watcher() i=1 2024-09-12T17:34:05.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.065+0000 7ffb569e59c0 20 remove_watcher() i=2 2024-09-12T17:34:05.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.065+0000 7ffb569e59c0 20 remove_watcher() i=3 2024-09-12T17:34:05.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.069+0000 7ffb569e59c0 20 remove_watcher() i=4 2024-09-12T17:34:05.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.069+0000 7ffb569e59c0 20 remove_watcher() i=5 2024-09-12T17:34:05.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.069+0000 7ffb569e59c0 20 remove_watcher() i=6 2024-09-12T17:34:05.078 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.073+0000 7ffb569e59c0 20 remove_watcher() i=7 2024-09-12T17:34:05.105 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:05.105 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:34:05.105 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-set-target-layout id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:34:05.105 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:05.105 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T17:34:05.137 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:05.138 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:05.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.173+0000 7fcf39dad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.173+0000 7fcf39dad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:05.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.173+0000 7fcf39dad9c0 20 realm 2024-09-12T17:34:05.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.173+0000 7fcf39dad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.173+0000 7fcf39dad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:05.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.173+0000 7fcf39dad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:05.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.173+0000 7fcf39dad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.173+0000 7fcf39dad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:05.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.173+0000 7fcf39dad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.177+0000 7fcf39dad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:05.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.177+0000 7fcf39dad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.177+0000 7fcf39dad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:05.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.177+0000 7fcf39dad9c0 20 searching for the correct realm 2024-09-12T17:34:05.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.181+0000 7fcf370b2640 0 -- 172.21.15.119:0/3418891500 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fcf280b3070 msgr2=0x7fcf280cc930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:05.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.397+0000 7fcf380b4640 0 -- 172.21.15.119:0/3418891500 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fcf20003100 msgr2=0x7fcf2c0153c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:05.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:05.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:05.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:05.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:05.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:05.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:05.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:05.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:05.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:05.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 20 zone default found 2024-09-12T17:34:05.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 4 Realm: () 2024-09-12T17:34:05.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:05.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:05.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:05.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 20 zonegroup default 2024-09-12T17:34:05.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.413+0000 7fcf39dad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.417+0000 7fcf39dad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:05.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.417+0000 7fcf39dad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.417+0000 7fcf39dad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:05.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.417+0000 7fcf39dad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.417+0000 7fcf39dad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:05.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.417+0000 7fcf39dad9c0 20 started sync module instance, tier type = 2024-09-12T17:34:05.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.417+0000 7fcf39dad9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:05.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.441+0000 7fcf39dad9c0 20 add_watcher() i=0 2024-09-12T17:34:05.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.441+0000 7fcf39dad9c0 20 add_watcher() i=1 2024-09-12T17:34:05.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.441+0000 7fcf39dad9c0 20 add_watcher() i=2 2024-09-12T17:34:05.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.441+0000 7fcf39dad9c0 20 add_watcher() i=3 2024-09-12T17:34:05.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.441+0000 7fcf39dad9c0 20 add_watcher() i=4 2024-09-12T17:34:05.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.441+0000 7fcf39dad9c0 20 add_watcher() i=5 2024-09-12T17:34:05.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.441+0000 7fcf39dad9c0 20 add_watcher() i=6 2024-09-12T17:34:05.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.445+0000 7fcf39dad9c0 20 add_watcher() i=7 2024-09-12T17:34:05.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.445+0000 7fcf39dad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:05.450 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.449+0000 7fcdedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:05.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.449+0000 7fcf39dad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:05.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.449+0000 7fcf39dad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:05.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.449+0000 7fcf39dad9c0 5 note: GC not initialized 2024-09-12T17:34:05.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.449+0000 7fcdecfe1640 20 reqs_thread_entry: start 2024-09-12T17:34:05.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.449+0000 7fcf39dad9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:05.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.449+0000 7fcf39dad9c0 20 Filter name: none 2024-09-12T17:34:05.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.449+0000 7fcd667fc640 20 reqs_thread_entry: start 2024-09-12T17:34:05.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.449+0000 7fcf39dad9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:34:05.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.449+0000 7fcf39dad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.449+0000 7fcf39dad9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:05.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.449+0000 7fcf39dad9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:34:05.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.449+0000 7fcf39dad9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:34:05.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.449+0000 7fcf39dad9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 : miss 2024-09-12T17:34:05.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.449+0000 7fcf39dad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.453+0000 7fcf39dad9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:05.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.453+0000 7fcf39dad9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 info.flags=0x17 2024-09-12T17:34:05.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.453+0000 7fcf39dad9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 to cache LRU end 2024-09-12T17:34:05.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.453+0000 7fcf39dad9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:05.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.453+0000 7fcf39dad9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:05.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.453+0000 7fcf39dad9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 2024-09-12T17:34:05.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.461+0000 7fcf39dad9c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T17:34:05.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.461+0000 7fcf39dad9c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T17:34:05.468 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.469+0000 7fcdedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:05.472 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.473+0000 7fcf39dad9c0 20 remove_watcher() i=0 2024-09-12T17:34:05.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.473+0000 7fcf39dad9c0 2 removed watcher, disabling cache 2024-09-12T17:34:05.475 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.477+0000 7fcf39dad9c0 20 remove_watcher() i=1 2024-09-12T17:34:05.477 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.477+0000 7fcf39dad9c0 20 remove_watcher() i=2 2024-09-12T17:34:05.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.481+0000 7fcf39dad9c0 20 remove_watcher() i=3 2024-09-12T17:34:05.482 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.481+0000 7fcf39dad9c0 20 remove_watcher() i=4 2024-09-12T17:34:05.483 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.485+0000 7fcf39dad9c0 20 remove_watcher() i=5 2024-09-12T17:34:05.485 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.485+0000 7fcf39dad9c0 20 remove_watcher() i=6 2024-09-12T17:34:05.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.489+0000 7fcf39dad9c0 20 remove_watcher() i=7 2024-09-12T17:34:05.503 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:34:05.533 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:05.533 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:05.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.581+0000 7f1c0b7099c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.585+0000 7f1c0b7099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:05.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.585+0000 7f1c0b7099c0 20 realm 2024-09-12T17:34:05.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.585+0000 7f1c0b7099c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.585+0000 7f1c0b7099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:05.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.585+0000 7f1c0b7099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:05.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.585+0000 7f1c0b7099c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.585+0000 7f1c0b7099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:05.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.585+0000 7f1c0b7099c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.585+0000 7f1c0b7099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:05.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.585+0000 7f1c0b7099c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:05.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.589+0000 7f1c0b7099c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:05.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.589+0000 7f1c0b7099c0 20 searching for the correct realm 2024-09-12T17:34:05.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.589+0000 7f1c09a10640 0 -- 172.21.15.119:0/761035779 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x5629c25379e0 msgr2=0x7f1c000459b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:05.805 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:05.805+0000 7f1c08a0e640 0 -- 172.21.15.119:0/761035779 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f1c04084270 msgr2=0x7f1c0406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:06.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.021+0000 7f1c0b7099c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:06.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.021+0000 7f1c0b7099c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:06.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.021+0000 7f1c0b7099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:06.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.021+0000 7f1c0b7099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:06.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.021+0000 7f1c0b7099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:06.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.021+0000 7f1c0b7099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:06.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.021+0000 7f1c0b7099c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.021+0000 7f1c0b7099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:06.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.021+0000 7f1c0b7099c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:06.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:06.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 20 zone default found 2024-09-12T17:34:06.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 4 Realm: () 2024-09-12T17:34:06.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:06.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:06.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:06.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 20 zonegroup default 2024-09-12T17:34:06.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:06.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:06.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:06.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 20 started sync module instance, tier type = 2024-09-12T17:34:06.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.025+0000 7f1c0b7099c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:06.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.049+0000 7f1c0b7099c0 20 add_watcher() i=0 2024-09-12T17:34:06.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.049+0000 7f1c0b7099c0 20 add_watcher() i=1 2024-09-12T17:34:06.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.049+0000 7f1c0b7099c0 20 add_watcher() i=2 2024-09-12T17:34:06.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.049+0000 7f1c0b7099c0 20 add_watcher() i=3 2024-09-12T17:34:06.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.049+0000 7f1c0b7099c0 20 add_watcher() i=4 2024-09-12T17:34:06.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.049+0000 7f1c0b7099c0 20 add_watcher() i=5 2024-09-12T17:34:06.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.049+0000 7f1c0b7099c0 20 add_watcher() i=6 2024-09-12T17:34:06.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.053+0000 7f1c0b7099c0 20 add_watcher() i=7 2024-09-12T17:34:06.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.053+0000 7f1c0b7099c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:06.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.057+0000 7f1abf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:06.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.057+0000 7f1c0b7099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:06.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.057+0000 7f1c0b7099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:06.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.057+0000 7f1c0b7099c0 5 note: GC not initialized 2024-09-12T17:34:06.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.057+0000 7f1abe7e4640 20 reqs_thread_entry: start 2024-09-12T17:34:06.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.057+0000 7f1c0b7099c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:06.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.061+0000 7f1c0b7099c0 20 Filter name: none 2024-09-12T17:34:06.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.061+0000 7f1a2ffff640 20 reqs_thread_entry: start 2024-09-12T17:34:06.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.061+0000 7f1c0b7099c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.061+0000 7f1c0b7099c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:06.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.061+0000 7f1c0b7099c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.061+0000 7f1c0b7099c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:06.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.061+0000 7f1c0b7099c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:06.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.061+0000 7f1c0b7099c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.061+0000 7f1c0b7099c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:06.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.061+0000 7f1c0b7099c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.065+0000 7f1c0b7099c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:06.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.065+0000 7f1c0b7099c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:06.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.065+0000 7f1abf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:06.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.069+0000 7f1c0b7099c0 20 remove_watcher() i=0 2024-09-12T17:34:06.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.069+0000 7f1c0b7099c0 2 removed watcher, disabling cache 2024-09-12T17:34:06.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.073+0000 7f1c0b7099c0 20 remove_watcher() i=1 2024-09-12T17:34:06.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.077+0000 7f1c0b7099c0 20 remove_watcher() i=2 2024-09-12T17:34:06.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.077+0000 7f1c0b7099c0 20 remove_watcher() i=3 2024-09-12T17:34:06.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.081+0000 7f1c0b7099c0 20 remove_watcher() i=4 2024-09-12T17:34:06.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.081+0000 7f1c0b7099c0 20 remove_watcher() i=5 2024-09-12T17:34:06.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.085+0000 7f1c0b7099c0 20 remove_watcher() i=6 2024-09-12T17:34:06.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.085+0000 7f1c0b7099c0 20 remove_watcher() i=7 2024-09-12T17:34:06.101 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:06.101 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:34:06.101 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-set-target-layout id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:34:06.101 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:06.236 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:34:06.272 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:06.272 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:06.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.501+0000 7f81bc3b9640 0 --2- 172.21.15.119:0/3751975274 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf893c31e0 0x55bf89483480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:34:06.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.737+0000 7f81bf0b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.737+0000 7f81bf0b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:06.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.737+0000 7f81bf0b49c0 20 realm 2024-09-12T17:34:06.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.737+0000 7f81bf0b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.741+0000 7f81bf0b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:06.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.741+0000 7f81bf0b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:06.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.741+0000 7f81bf0b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.741+0000 7f81bf0b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:06.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.741+0000 7f81bf0b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.741+0000 7f81bf0b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:06.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.741+0000 7f81bf0b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.741+0000 7f81bf0b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:06.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.741+0000 7f81bf0b49c0 20 searching for the correct realm 2024-09-12T17:34:06.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.745+0000 7f81bc3b9640 0 -- 172.21.15.119:0/3767585680 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f81b4036060 msgr2=0x7f81b4079a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:06.958 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.957+0000 7f81bd3bb640 0 -- 172.21.15.119:0/3767585680 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f81a410c040 msgr2=0x7f81a40f78f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:06.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.977+0000 7f81bf0b49c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:06.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.977+0000 7f81bf0b49c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:06.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.977+0000 7f81bf0b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:06.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.977+0000 7f81bf0b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:06.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.977+0000 7f81bf0b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:06.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.977+0000 7f81bf0b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:06.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.977+0000 7f81bf0b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.977+0000 7f81bf0b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:06.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.977+0000 7f81bf0b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.977+0000 7f81bf0b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:06.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.977+0000 7f81bf0b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.981+0000 7f81bf0b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:06.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.981+0000 7f81bf0b49c0 20 zone default found 2024-09-12T17:34:06.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.981+0000 7f81bf0b49c0 4 Realm: () 2024-09-12T17:34:06.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.981+0000 7f81bf0b49c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:06.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.981+0000 7f81bf0b49c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:06.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.981+0000 7f81bf0b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:06.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.981+0000 7f81bf0b49c0 20 zonegroup default 2024-09-12T17:34:06.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.981+0000 7f81bf0b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.981+0000 7f81bf0b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:06.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.981+0000 7f81bf0b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.981+0000 7f81bf0b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:06.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.981+0000 7f81bf0b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:06.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.981+0000 7f81bf0b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:06.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.981+0000 7f81bf0b49c0 20 started sync module instance, tier type = 2024-09-12T17:34:06.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:06.981+0000 7f81bf0b49c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:07.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.001+0000 7f81bf0b49c0 20 add_watcher() i=0 2024-09-12T17:34:07.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.001+0000 7f81bf0b49c0 20 add_watcher() i=1 2024-09-12T17:34:07.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.001+0000 7f81bf0b49c0 20 add_watcher() i=2 2024-09-12T17:34:07.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.001+0000 7f81bf0b49c0 20 add_watcher() i=3 2024-09-12T17:34:07.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.001+0000 7f81bf0b49c0 20 add_watcher() i=4 2024-09-12T17:34:07.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.001+0000 7f81bf0b49c0 20 add_watcher() i=5 2024-09-12T17:34:07.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.001+0000 7f81bf0b49c0 20 add_watcher() i=6 2024-09-12T17:34:07.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.005+0000 7f81bf0b49c0 20 add_watcher() i=7 2024-09-12T17:34:07.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.005+0000 7f81bf0b49c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:07.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.005+0000 7f80737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:07.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:07.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:07.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 5 note: GC not initialized 2024-09-12T17:34:07.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f80727e4640 20 reqs_thread_entry: start 2024-09-12T17:34:07.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:07.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 20 Filter name: none 2024-09-12T17:34:07.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f806b7fe640 20 reqs_thread_entry: start 2024-09-12T17:34:07.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:34:07.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:07.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:34:07.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:34:07.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 : miss 2024-09-12T17:34:07.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:07.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 info.flags=0x17 2024-09-12T17:34:07.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 to cache LRU end 2024-09-12T17:34:07.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:07.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:07.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.009+0000 7f81bf0b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 2024-09-12T17:34:07.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.021+0000 7f81bf0b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 info.flags=0x17 2024-09-12T17:34:07.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.021+0000 7f81bf0b49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 to cache LRU end 2024-09-12T17:34:07.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.021+0000 7f81bf0b49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:07.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.021+0000 7f81bf0b49c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23, ofs0, ns] 2024-09-12T17:34:07.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.021+0000 7f8093fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333483 cookie 94281131337728 notifier 6561 bl.length()=1009 2024-09-12T17:34:07.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.021+0000 7f8093fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 info.flags=0x17 2024-09-12T17:34:07.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.021+0000 7f8093fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 to cache LRU end 2024-09-12T17:34:07.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.021+0000 7f8093fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:07.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.025+0000 7f81bf0b49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23]): orig_sources= new_sources= 2024-09-12T17:34:07.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.025+0000 7f81bf0b49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23]): potential sources added=[] removed=[] 2024-09-12T17:34:07.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.025+0000 7f81bf0b49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23]): orig_dests= new_dests= 2024-09-12T17:34:07.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.025+0000 7f81bf0b49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23]): potential dests added=[] removed=[] 2024-09-12T17:34:07.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.0 2024-09-12T17:34:07.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.0 2024-09-12T17:34:07.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.1 2024-09-12T17:34:07.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.1 2024-09-12T17:34:07.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.2 2024-09-12T17:34:07.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.2 2024-09-12T17:34:07.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.3 2024-09-12T17:34:07.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.3 2024-09-12T17:34:07.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.4 2024-09-12T17:34:07.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.4 2024-09-12T17:34:07.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.5 2024-09-12T17:34:07.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.5 2024-09-12T17:34:07.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.6 2024-09-12T17:34:07.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.6 2024-09-12T17:34:07.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.7 2024-09-12T17:34:07.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.7 2024-09-12T17:34:07.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.8 2024-09-12T17:34:07.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.8 2024-09-12T17:34:07.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.9 2024-09-12T17:34:07.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.9 2024-09-12T17:34:07.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.10 2024-09-12T17:34:07.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.10 2024-09-12T17:34:07.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.11 2024-09-12T17:34:07.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1.11 2024-09-12T17:34:07.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.0 2024-09-12T17:34:07.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1 2024-09-12T17:34:07.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.041+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.2 2024-09-12T17:34:07.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.045+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.3 2024-09-12T17:34:07.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.045+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.4 2024-09-12T17:34:07.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.045+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.5 2024-09-12T17:34:07.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.045+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.6 2024-09-12T17:34:07.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.049+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.7 2024-09-12T17:34:07.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.049+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.8 2024-09-12T17:34:07.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.049+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.9 2024-09-12T17:34:07.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.049+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.10 2024-09-12T17:34:07.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.057+0000 7f81bf0b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:07.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.057+0000 7f81bf0b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 2024-09-12T17:34:07.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.061+0000 7f81bf0b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 info.flags=0x17 2024-09-12T17:34:07.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.061+0000 7f81bf0b49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 to cache LRU end 2024-09-12T17:34:07.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.061+0000 7f81bf0b49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:07.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.061+0000 7f81bf0b49c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23, ofs0, ns] 2024-09-12T17:34:07.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.061+0000 7f8093fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333484 cookie 94281131337728 notifier 6561 bl.length()=1009 2024-09-12T17:34:07.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.061+0000 7f8093fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 info.flags=0x17 2024-09-12T17:34:07.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.061+0000 7f8093fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 to cache LRU end 2024-09-12T17:34:07.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.061+0000 7f8093fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:07.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.065+0000 7f81bf0b49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23]): orig_sources= new_sources= 2024-09-12T17:34:07.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.065+0000 7f81bf0b49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23]): potential sources added=[] removed=[] 2024-09-12T17:34:07.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.065+0000 7f81bf0b49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23]): orig_dests= new_dests= 2024-09-12T17:34:07.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.065+0000 7f81bf0b49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23]): potential dests added=[] removed=[] 2024-09-12T17:34:07.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.069+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.0 2024-09-12T17:34:07.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.073+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.1 2024-09-12T17:34:07.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.073+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.2 2024-09-12T17:34:07.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.073+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.3 2024-09-12T17:34:07.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.073+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.4 2024-09-12T17:34:07.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.073+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.5 2024-09-12T17:34:07.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.077+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.6 2024-09-12T17:34:07.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.077+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.7 2024-09-12T17:34:07.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.077+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.8 2024-09-12T17:34:07.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.077+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.9 2024-09-12T17:34:07.078 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.077+0000 7f81bf0b49c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23.10 2024-09-12T17:34:07.078 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.081+0000 7f81bf0b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:07.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.081+0000 7f81bf0b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 2024-09-12T17:34:07.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.081+0000 7f81bf0b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 info.flags=0x17 2024-09-12T17:34:07.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.081+0000 7f81bf0b49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 to cache LRU end 2024-09-12T17:34:07.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.081+0000 7f81bf0b49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:07.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.081+0000 7f81bf0b49c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23, ofs0, ns] 2024-09-12T17:34:07.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.085+0000 7f80937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333485 cookie 94281131337728 notifier 6561 bl.length()=977 2024-09-12T17:34:07.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.085+0000 7f80937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 info.flags=0x17 2024-09-12T17:34:07.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.085+0000 7f80937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 to cache LRU end 2024-09-12T17:34:07.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.085+0000 7f80937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:07.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.085+0000 7f81bf0b49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23]): orig_sources= new_sources= 2024-09-12T17:34:07.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.085+0000 7f81bf0b49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23]): potential sources added=[] removed=[] 2024-09-12T17:34:07.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.085+0000 7f81bf0b49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23]): orig_dests= new_dests= 2024-09-12T17:34:07.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.085+0000 7f81bf0b49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23]): potential dests added=[] removed=[] 2024-09-12T17:34:07.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.093+0000 7f81bf0b49c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:34:07.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.097+0000 7f80737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:07.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.101+0000 7f81bf0b49c0 20 remove_watcher() i=0 2024-09-12T17:34:07.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.101+0000 7f81bf0b49c0 2 removed watcher, disabling cache 2024-09-12T17:34:07.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.105+0000 7f81bf0b49c0 20 remove_watcher() i=1 2024-09-12T17:34:07.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.105+0000 7f81bf0b49c0 20 remove_watcher() i=2 2024-09-12T17:34:07.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.109+0000 7f81bf0b49c0 20 remove_watcher() i=3 2024-09-12T17:34:07.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.109+0000 7f81bf0b49c0 20 remove_watcher() i=4 2024-09-12T17:34:07.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.113+0000 7f81bf0b49c0 20 remove_watcher() i=5 2024-09-12T17:34:07.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.113+0000 7f81bf0b49c0 20 remove_watcher() i=6 2024-09-12T17:34:07.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.117+0000 7f81bf0b49c0 20 remove_watcher() i=7 2024-09-12T17:34:07.131 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:34:07.160 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:07.160 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:07.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.209+0000 7febc07d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.209+0000 7febc07d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:07.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.209+0000 7febc07d59c0 20 realm 2024-09-12T17:34:07.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.209+0000 7febc07d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.209+0000 7febc07d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:07.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.209+0000 7febc07d59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:07.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.209+0000 7febc07d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.209+0000 7febc07d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:07.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.209+0000 7febc07d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.213+0000 7febc07d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:07.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.213+0000 7febc07d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.213+0000 7febc07d59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:07.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.213+0000 7febc07d59c0 20 searching for the correct realm 2024-09-12T17:34:07.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.217+0000 7febbeadc640 0 -- 172.21.15.119:0/3186255459 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7febb4008050 msgr2=0x7febb405be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:07.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.433+0000 7febbdada640 0 -- 172.21.15.119:0/3186255459 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7febb8064520 msgr2=0x7febb8032780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:07.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.649+0000 7febc07d59c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:07.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.649+0000 7febc07d59c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:07.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.649+0000 7febc07d59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:07.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.649+0000 7febc07d59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:07.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.649+0000 7febc07d59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:07.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.649+0000 7febc07d59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:07.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.649+0000 7febc07d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.653+0000 7febc07d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:07.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.653+0000 7febc07d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.653+0000 7febc07d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:07.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.653+0000 7febc07d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.653+0000 7febc07d59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:07.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.653+0000 7febc07d59c0 20 zone default found 2024-09-12T17:34:07.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.653+0000 7febc07d59c0 4 Realm: () 2024-09-12T17:34:07.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.653+0000 7febc07d59c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:07.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.653+0000 7febc07d59c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:07.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.653+0000 7febc07d59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:07.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.653+0000 7febc07d59c0 20 zonegroup default 2024-09-12T17:34:07.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.653+0000 7febc07d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.653+0000 7febc07d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:07.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.653+0000 7febc07d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.653+0000 7febc07d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:07.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.653+0000 7febc07d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.657+0000 7febc07d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:07.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.657+0000 7febc07d59c0 20 started sync module instance, tier type = 2024-09-12T17:34:07.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.657+0000 7febc07d59c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:07.678 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.677+0000 7febc07d59c0 20 add_watcher() i=0 2024-09-12T17:34:07.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.677+0000 7febc07d59c0 20 add_watcher() i=1 2024-09-12T17:34:07.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.677+0000 7febc07d59c0 20 add_watcher() i=2 2024-09-12T17:34:07.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.677+0000 7febc07d59c0 20 add_watcher() i=3 2024-09-12T17:34:07.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.677+0000 7febc07d59c0 20 add_watcher() i=4 2024-09-12T17:34:07.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.677+0000 7febc07d59c0 20 add_watcher() i=5 2024-09-12T17:34:07.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.677+0000 7febc07d59c0 20 add_watcher() i=6 2024-09-12T17:34:07.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.681+0000 7febc07d59c0 20 add_watcher() i=7 2024-09-12T17:34:07.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.681+0000 7febc07d59c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:07.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.685+0000 7fea74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:07.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.685+0000 7febc07d59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:07.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.685+0000 7febc07d59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:07.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.685+0000 7febc07d59c0 5 note: GC not initialized 2024-09-12T17:34:07.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.685+0000 7fe9ef7fe640 20 reqs_thread_entry: start 2024-09-12T17:34:07.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.685+0000 7febc07d59c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:07.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.685+0000 7febc07d59c0 20 Filter name: none 2024-09-12T17:34:07.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.685+0000 7fe9ed7fa640 20 reqs_thread_entry: start 2024-09-12T17:34:07.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.689+0000 7febc07d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.689+0000 7febc07d59c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:07.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.689+0000 7febc07d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.689+0000 7febc07d59c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:07.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.689+0000 7febc07d59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:07.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.689+0000 7febc07d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.689+0000 7febc07d59c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:07.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.689+0000 7febc07d59c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:07.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.689+0000 7febc07d59c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:07.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.689+0000 7febc07d59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:07.693 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.693+0000 7fea74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:07.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.701+0000 7febc07d59c0 20 remove_watcher() i=0 2024-09-12T17:34:07.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.701+0000 7febc07d59c0 2 removed watcher, disabling cache 2024-09-12T17:34:07.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.701+0000 7febc07d59c0 20 remove_watcher() i=1 2024-09-12T17:34:07.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.705+0000 7febc07d59c0 20 remove_watcher() i=2 2024-09-12T17:34:07.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.705+0000 7febc07d59c0 20 remove_watcher() i=3 2024-09-12T17:34:07.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.709+0000 7febc07d59c0 20 remove_watcher() i=4 2024-09-12T17:34:07.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.709+0000 7febc07d59c0 20 remove_watcher() i=5 2024-09-12T17:34:07.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.713+0000 7febc07d59c0 20 remove_watcher() i=6 2024-09-12T17:34:07.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:07.713+0000 7febc07d59c0 20 remove_watcher() i=7 2024-09-12T17:34:07.729 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:07.730 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:34:07.730 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-set-target-layout id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:34:07.730 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:08.715 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T17:34:08.715 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:10.874 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:34:10.907 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:10.907 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:10.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:10.953+0000 7f2db08819c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:10.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:10.953+0000 7f2db08819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:10.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:10.953+0000 7f2db08819c0 20 realm 2024-09-12T17:34:10.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:10.953+0000 7f2db08819c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:10.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:10.957+0000 7f2db08819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:10.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:10.957+0000 7f2db08819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:10.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:10.957+0000 7f2db08819c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:10.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:10.957+0000 7f2db08819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:10.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:10.957+0000 7f2db08819c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:10.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:10.957+0000 7f2db08819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:10.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:10.957+0000 7f2db08819c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:10.958 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:10.957+0000 7f2db08819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:10.958 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:10.957+0000 7f2db08819c0 20 searching for the correct realm 2024-09-12T17:34:11.167 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.169+0000 7f2daeb88640 0 -- 172.21.15.119:0/3277065711 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f2da4075030 msgr2=0x7f2da4063430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:11.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.385+0000 7f2dadb86640 0 -- 172.21.15.119:0/3277065711 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f2da807d040 msgr2=0x7f2da806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:11.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.601+0000 7f2db08819c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:11.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:11.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:11.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:11.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:11.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:11.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:11.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:11.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:11.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 20 zone default found 2024-09-12T17:34:11.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 4 Realm: () 2024-09-12T17:34:11.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:11.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:11.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:11.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 20 zonegroup default 2024-09-12T17:34:11.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:11.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.605+0000 7f2db08819c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.609+0000 7f2db08819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:11.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.609+0000 7f2db08819c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.609+0000 7f2db08819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:11.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.609+0000 7f2db08819c0 20 started sync module instance, tier type = 2024-09-12T17:34:11.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.609+0000 7f2db08819c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:11.631 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.633+0000 7f2db08819c0 20 add_watcher() i=0 2024-09-12T17:34:11.631 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.633+0000 7f2db08819c0 20 add_watcher() i=1 2024-09-12T17:34:11.631 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.633+0000 7f2db08819c0 20 add_watcher() i=2 2024-09-12T17:34:11.631 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.633+0000 7f2db08819c0 20 add_watcher() i=3 2024-09-12T17:34:11.631 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.633+0000 7f2db08819c0 20 add_watcher() i=4 2024-09-12T17:34:11.631 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.633+0000 7f2db08819c0 20 add_watcher() i=5 2024-09-12T17:34:11.631 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.633+0000 7f2db08819c0 20 add_watcher() i=6 2024-09-12T17:34:11.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.633+0000 7f2db08819c0 20 add_watcher() i=7 2024-09-12T17:34:11.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.633+0000 7f2db08819c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:11.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.637+0000 7f2c64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:11.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.641+0000 7f2db08819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:11.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.641+0000 7f2db08819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:11.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.641+0000 7f2db08819c0 5 note: GC not initialized 2024-09-12T17:34:11.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.641+0000 7f2bdf7fe640 20 reqs_thread_entry: start 2024-09-12T17:34:11.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.641+0000 7f2db08819c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:11.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.641+0000 7f2db08819c0 20 Filter name: none 2024-09-12T17:34:11.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.641+0000 7f2bdd7fa640 20 reqs_thread_entry: start 2024-09-12T17:34:11.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.641+0000 7f2db08819c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.641+0000 7f2db08819c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:11.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.641+0000 7f2db08819c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.645+0000 7f2db08819c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:11.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.645+0000 7f2db08819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:11.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.645+0000 7f2db08819c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.645+0000 7f2db08819c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:11.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.645+0000 7f2db08819c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.645+0000 7f2db08819c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:11.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.645+0000 7f2db08819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:11.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.649+0000 7f2c64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:11.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.653+0000 7f2db08819c0 20 remove_watcher() i=0 2024-09-12T17:34:11.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.653+0000 7f2db08819c0 2 removed watcher, disabling cache 2024-09-12T17:34:11.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.653+0000 7f2db08819c0 20 remove_watcher() i=1 2024-09-12T17:34:11.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.657+0000 7f2db08819c0 20 remove_watcher() i=2 2024-09-12T17:34:11.659 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.661+0000 7f2db08819c0 20 remove_watcher() i=3 2024-09-12T17:34:11.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.661+0000 7f2db08819c0 20 remove_watcher() i=4 2024-09-12T17:34:11.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.665+0000 7f2db08819c0 20 remove_watcher() i=5 2024-09-12T17:34:11.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.665+0000 7f2db08819c0 20 remove_watcher() i=6 2024-09-12T17:34:11.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.665+0000 7f2db08819c0 20 remove_watcher() i=7 2024-09-12T17:34:11.680 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:11.680 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:34:11.680 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-set-target-layout id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:34:11.680 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:11.681 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T17:34:11.718 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:11.718 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:11.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.761+0000 7f2b33af19c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.765+0000 7f2b33af19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:11.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.765+0000 7f2b33af19c0 20 realm 2024-09-12T17:34:11.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.765+0000 7f2b33af19c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.765+0000 7f2b33af19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:11.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.765+0000 7f2b33af19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:11.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.765+0000 7f2b33af19c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.765+0000 7f2b33af19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:11.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.765+0000 7f2b33af19c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.765+0000 7f2b33af19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:11.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.765+0000 7f2b33af19c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.769+0000 7f2b33af19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:11.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.769+0000 7f2b33af19c0 20 searching for the correct realm 2024-09-12T17:34:11.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.769+0000 7f2b31df8640 0 -- 172.21.15.119:0/1454063461 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f2b1c0f0900 msgr2=0x7f2b1c0d23f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:11.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.781+0000 7f2b30df6640 0 -- 172.21.15.119:0/1454063461 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f2b2c06d4e0 msgr2=0x7f2b2c03f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:11.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.997+0000 7f2b33af19c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:11.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.997+0000 7f2b33af19c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:11.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.997+0000 7f2b33af19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:11.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.997+0000 7f2b33af19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:11.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.997+0000 7f2b33af19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:11.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.997+0000 7f2b33af19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:11.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.997+0000 7f2b33af19c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.997+0000 7f2b33af19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:11.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.997+0000 7f2b33af19c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.997+0000 7f2b33af19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:11.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:11.997+0000 7f2b33af19c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:11.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.001+0000 7f2b33af19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:11.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.001+0000 7f2b33af19c0 20 zone default found 2024-09-12T17:34:11.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.001+0000 7f2b33af19c0 4 Realm: () 2024-09-12T17:34:11.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.001+0000 7f2b33af19c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:11.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.001+0000 7f2b33af19c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:11.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.001+0000 7f2b33af19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:11.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.001+0000 7f2b33af19c0 20 zonegroup default 2024-09-12T17:34:12.000 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.001+0000 7f2b33af19c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.000 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.001+0000 7f2b33af19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:12.000 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.001+0000 7f2b33af19c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.001+0000 7f2b33af19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:12.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.001+0000 7f2b33af19c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.001+0000 7f2b33af19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:12.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.001+0000 7f2b33af19c0 20 started sync module instance, tier type = 2024-09-12T17:34:12.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.001+0000 7f2b33af19c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:12.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.025+0000 7f2b33af19c0 20 add_watcher() i=0 2024-09-12T17:34:12.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.025+0000 7f2b33af19c0 20 add_watcher() i=1 2024-09-12T17:34:12.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.025+0000 7f2b33af19c0 20 add_watcher() i=2 2024-09-12T17:34:12.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.025+0000 7f2b33af19c0 20 add_watcher() i=3 2024-09-12T17:34:12.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.025+0000 7f2b33af19c0 20 add_watcher() i=4 2024-09-12T17:34:12.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.025+0000 7f2b33af19c0 20 add_watcher() i=5 2024-09-12T17:34:12.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.025+0000 7f2b33af19c0 20 add_watcher() i=6 2024-09-12T17:34:12.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.029+0000 7f2b33af19c0 20 add_watcher() i=7 2024-09-12T17:34:12.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.029+0000 7f2b33af19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:12.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.033+0000 7f29e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:12.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.033+0000 7f2b33af19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:12.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.033+0000 7f2b33af19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:12.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.033+0000 7f2b33af19c0 5 note: GC not initialized 2024-09-12T17:34:12.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.033+0000 7f29e67e4640 20 reqs_thread_entry: start 2024-09-12T17:34:12.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.033+0000 7f2b33af19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:12.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.033+0000 7f2b33af19c0 20 Filter name: none 2024-09-12T17:34:12.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.033+0000 7f2957fff640 20 reqs_thread_entry: start 2024-09-12T17:34:12.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.033+0000 7f2b33af19c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:34:12.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.033+0000 7f2b33af19c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.037+0000 7f2b33af19c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:12.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.037+0000 7f2b33af19c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:34:12.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.037+0000 7f2b33af19c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:34:12.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.037+0000 7f2b33af19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 : miss 2024-09-12T17:34:12.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.037+0000 7f2b33af19c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.037+0000 7f2b33af19c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:12.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.037+0000 7f2b33af19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 info.flags=0x17 2024-09-12T17:34:12.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.037+0000 7f2b33af19c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 to cache LRU end 2024-09-12T17:34:12.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.037+0000 7f2b33af19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:12.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.037+0000 7f2b33af19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:12.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.037+0000 7f2b33af19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 2024-09-12T17:34:12.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.045+0000 7f2b33af19c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T17:34:12.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.049+0000 7f2b33af19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 info.flags=0x17 2024-09-12T17:34:12.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.049+0000 7f2b33af19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 to cache LRU end 2024-09-12T17:34:12.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.049+0000 7f2b33af19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:12.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.049+0000 7f2b33af19c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24, ofs0, ns] 2024-09-12T17:34:12.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.049+0000 7f2a07fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333488 cookie 93880925790288 notifier 6275 bl.length()=1009 2024-09-12T17:34:12.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.049+0000 7f2a07fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 info.flags=0x17 2024-09-12T17:34:12.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.049+0000 7f2a07fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 to cache LRU end 2024-09-12T17:34:12.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.049+0000 7f2a07fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:12.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.053+0000 7f2b33af19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24]): orig_sources= new_sources= 2024-09-12T17:34:12.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.053+0000 7f2b33af19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24]): potential sources added=[] removed=[] 2024-09-12T17:34:12.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.053+0000 7f2b33af19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24]): orig_dests= new_dests= 2024-09-12T17:34:12.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.053+0000 7f2b33af19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24]): potential dests added=[] removed=[] 2024-09-12T17:34:12.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.0 2024-09-12T17:34:12.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.0 2024-09-12T17:34:12.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.1 2024-09-12T17:34:12.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.1 2024-09-12T17:34:12.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.2 2024-09-12T17:34:12.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.2 2024-09-12T17:34:12.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.3 2024-09-12T17:34:12.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.3 2024-09-12T17:34:12.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.4 2024-09-12T17:34:12.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.4 2024-09-12T17:34:12.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.5 2024-09-12T17:34:12.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.5 2024-09-12T17:34:12.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.6 2024-09-12T17:34:12.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.6 2024-09-12T17:34:12.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.7 2024-09-12T17:34:12.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.7 2024-09-12T17:34:12.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.8 2024-09-12T17:34:12.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.8 2024-09-12T17:34:12.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.9 2024-09-12T17:34:12.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.9 2024-09-12T17:34:12.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.10 2024-09-12T17:34:12.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.10 2024-09-12T17:34:12.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.11 2024-09-12T17:34:12.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1.11 2024-09-12T17:34:12.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.0 2024-09-12T17:34:12.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1 2024-09-12T17:34:12.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.2 2024-09-12T17:34:12.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.065+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.3 2024-09-12T17:34:12.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.069+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.4 2024-09-12T17:34:12.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.069+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.5 2024-09-12T17:34:12.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.069+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.6 2024-09-12T17:34:12.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.069+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.7 2024-09-12T17:34:12.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.069+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.8 2024-09-12T17:34:12.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.073+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.9 2024-09-12T17:34:12.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.073+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.10 2024-09-12T17:34:12.078 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.077+0000 7f2b33af19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:12.078 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.077+0000 7f2b33af19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 2024-09-12T17:34:12.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.081+0000 7f2b33af19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 info.flags=0x17 2024-09-12T17:34:12.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.081+0000 7f2b33af19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 to cache LRU end 2024-09-12T17:34:12.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.081+0000 7f2b33af19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:12.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.081+0000 7f2b33af19c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24, ofs0, ns] 2024-09-12T17:34:12.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.081+0000 7f2a07fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333489 cookie 93880925790288 notifier 6275 bl.length()=1009 2024-09-12T17:34:12.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.081+0000 7f2a07fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 info.flags=0x17 2024-09-12T17:34:12.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.081+0000 7f2a07fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 to cache LRU end 2024-09-12T17:34:12.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.081+0000 7f2a07fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:12.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.085+0000 7f2b33af19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24]): orig_sources= new_sources= 2024-09-12T17:34:12.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.085+0000 7f2b33af19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24]): potential sources added=[] removed=[] 2024-09-12T17:34:12.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.085+0000 7f2b33af19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24]): orig_dests= new_dests= 2024-09-12T17:34:12.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.085+0000 7f2b33af19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24]): potential dests added=[] removed=[] 2024-09-12T17:34:12.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.089+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.0 2024-09-12T17:34:12.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.089+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.1 2024-09-12T17:34:12.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.093+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.2 2024-09-12T17:34:12.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.093+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.3 2024-09-12T17:34:12.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.093+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.4 2024-09-12T17:34:12.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.093+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.5 2024-09-12T17:34:12.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.093+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.6 2024-09-12T17:34:12.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.093+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.7 2024-09-12T17:34:12.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.097+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.8 2024-09-12T17:34:12.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.097+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.9 2024-09-12T17:34:12.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.097+0000 7f2b33af19c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24.10 2024-09-12T17:34:12.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.097+0000 7f2b33af19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:12.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.097+0000 7f2b33af19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 2024-09-12T17:34:12.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.101+0000 7f2b33af19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 info.flags=0x17 2024-09-12T17:34:12.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.101+0000 7f2b33af19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 to cache LRU end 2024-09-12T17:34:12.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.101+0000 7f2b33af19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:12.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.101+0000 7f2b33af19c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24, ofs0, ns] 2024-09-12T17:34:12.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.105+0000 7f2a07fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333490 cookie 93880925790288 notifier 6275 bl.length()=977 2024-09-12T17:34:12.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.105+0000 7f2a07fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 info.flags=0x17 2024-09-12T17:34:12.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.105+0000 7f2a07fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 to cache LRU end 2024-09-12T17:34:12.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.105+0000 7f2a07fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:12.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.105+0000 7f2b33af19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24]): orig_sources= new_sources= 2024-09-12T17:34:12.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.105+0000 7f2b33af19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24]): potential sources added=[] removed=[] 2024-09-12T17:34:12.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.105+0000 7f2b33af19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24]): orig_dests= new_dests= 2024-09-12T17:34:12.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.105+0000 7f2b33af19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24]): potential dests added=[] removed=[] 2024-09-12T17:34:12.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.109+0000 7f2b33af19c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:34:12.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.113+0000 7f29e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:12.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.121+0000 7f2b33af19c0 20 remove_watcher() i=0 2024-09-12T17:34:12.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.121+0000 7f2b33af19c0 2 removed watcher, disabling cache 2024-09-12T17:34:12.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.121+0000 7f2b33af19c0 20 remove_watcher() i=1 2024-09-12T17:34:12.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.125+0000 7f2b33af19c0 20 remove_watcher() i=2 2024-09-12T17:34:12.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.125+0000 7f2b33af19c0 20 remove_watcher() i=3 2024-09-12T17:34:12.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.129+0000 7f2b33af19c0 20 remove_watcher() i=4 2024-09-12T17:34:12.130 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.129+0000 7f2b33af19c0 20 remove_watcher() i=5 2024-09-12T17:34:12.131 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.133+0000 7f2b33af19c0 20 remove_watcher() i=6 2024-09-12T17:34:12.133 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.133+0000 7f2b33af19c0 20 remove_watcher() i=7 2024-09-12T17:34:12.157 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:34:12.186 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:12.186 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:12.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.233+0000 7f18fbdc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.237+0000 7f18fbdc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:12.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.237+0000 7f18fbdc79c0 20 realm 2024-09-12T17:34:12.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.237+0000 7f18fbdc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.237+0000 7f18fbdc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:12.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.237+0000 7f18fbdc79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:12.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.237+0000 7f18fbdc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.237+0000 7f18fbdc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:12.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.237+0000 7f18fbdc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.237+0000 7f18fbdc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:12.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.237+0000 7f18fbdc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.241+0000 7f18fbdc79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:12.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.241+0000 7f18fbdc79c0 20 searching for the correct realm 2024-09-12T17:34:12.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.245+0000 7f18fa0ce640 0 -- 172.21.15.119:0/1286021987 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f18e40649c0 msgr2=0x7f18e4064430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:12.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.461+0000 7f18f3fff640 0 -- 172.21.15.119:0/1286021987 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f18f404d920 msgr2=0x7f18f4021400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:12.678 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:12.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:12.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:12.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:12.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:12.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:12.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:12.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:12.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:12.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 zone default found 2024-09-12T17:34:12.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 4 Realm: () 2024-09-12T17:34:12.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:12.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:12.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:12.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 zonegroup default 2024-09-12T17:34:12.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:12.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.681+0000 7f18fbdc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.685+0000 7f18fbdc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:12.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.685+0000 7f18fbdc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.685+0000 7f18fbdc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:12.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.685+0000 7f18fbdc79c0 20 started sync module instance, tier type = 2024-09-12T17:34:12.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.685+0000 7f18fbdc79c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:12.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.709+0000 7f18fbdc79c0 20 add_watcher() i=0 2024-09-12T17:34:12.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.709+0000 7f18fbdc79c0 20 add_watcher() i=1 2024-09-12T17:34:12.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.709+0000 7f18fbdc79c0 20 add_watcher() i=2 2024-09-12T17:34:12.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.709+0000 7f18fbdc79c0 20 add_watcher() i=3 2024-09-12T17:34:12.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.709+0000 7f18fbdc79c0 20 add_watcher() i=4 2024-09-12T17:34:12.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.709+0000 7f18fbdc79c0 20 add_watcher() i=5 2024-09-12T17:34:12.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.709+0000 7f18fbdc79c0 20 add_watcher() i=6 2024-09-12T17:34:12.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.713+0000 7f18fbdc79c0 20 add_watcher() i=7 2024-09-12T17:34:12.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.713+0000 7f18fbdc79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:12.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.717+0000 7f17abfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:12.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.717+0000 7f18fbdc79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:12.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.717+0000 7f18fbdc79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:12.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.717+0000 7f18fbdc79c0 5 note: GC not initialized 2024-09-12T17:34:12.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.717+0000 7f17aaffd640 20 reqs_thread_entry: start 2024-09-12T17:34:12.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.717+0000 7f18fbdc79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:12.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.717+0000 7f18fbdc79c0 20 Filter name: none 2024-09-12T17:34:12.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.717+0000 7f17a8ff9640 20 reqs_thread_entry: start 2024-09-12T17:34:12.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.717+0000 7f18fbdc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.717+0000 7f18fbdc79c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:12.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.717+0000 7f18fbdc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.721+0000 7f18fbdc79c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:12.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.721+0000 7f18fbdc79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:12.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.721+0000 7f18fbdc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.721+0000 7f18fbdc79c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:12.720 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.721+0000 7f18fbdc79c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:12.720 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.721+0000 7f18fbdc79c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:12.720 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.721+0000 7f18fbdc79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:12.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.725+0000 7f17abfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:12.729 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.729+0000 7f18fbdc79c0 20 remove_watcher() i=0 2024-09-12T17:34:12.729 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.729+0000 7f18fbdc79c0 2 removed watcher, disabling cache 2024-09-12T17:34:12.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.733+0000 7f18fbdc79c0 20 remove_watcher() i=1 2024-09-12T17:34:12.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.733+0000 7f18fbdc79c0 20 remove_watcher() i=2 2024-09-12T17:34:12.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.737+0000 7f18fbdc79c0 20 remove_watcher() i=3 2024-09-12T17:34:12.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.737+0000 7f18fbdc79c0 20 remove_watcher() i=4 2024-09-12T17:34:12.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.741+0000 7f18fbdc79c0 20 remove_watcher() i=5 2024-09-12T17:34:12.741 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.741+0000 7f18fbdc79c0 20 remove_watcher() i=6 2024-09-12T17:34:12.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:12.745+0000 7f18fbdc79c0 20 remove_watcher() i=7 2024-09-12T17:34:12.760 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:12.760 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:34:12.760 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-set-target-layout id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:34:12.760 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:13.760 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T17:34:13.760 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:15.935 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:34:15.967 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:15.967 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:16.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.017+0000 7f915ecd99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.017+0000 7f915ecd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.017+0000 7f915ecd99c0 20 realm 2024-09-12T17:34:16.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.017+0000 7f915ecd99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.017+0000 7f915ecd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.017+0000 7f915ecd99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:16.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.017+0000 7f915ecd99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.017+0000 7f915ecd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.017+0000 7f915ecd99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.021+0000 7f915ecd99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:16.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.021+0000 7f915ecd99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.021+0000 7f915ecd99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:16.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.021+0000 7f915ecd99c0 20 searching for the correct realm 2024-09-12T17:34:16.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.025+0000 7f915cfe0640 0 -- 172.21.15.119:0/4172097447 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x5626d6c74290 msgr2=0x5626d6c76680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:16.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.033+0000 7f915bfde640 0 -- 172.21.15.119:0/4172097447 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f91540ec930 msgr2=0x7f91540dd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:16.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:16.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:16.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:16.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:16.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:16.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:16.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:16.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:16.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 zone default found 2024-09-12T17:34:16.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 4 Realm: () 2024-09-12T17:34:16.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:16.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:16.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:16.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 zonegroup default 2024-09-12T17:34:16.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.253+0000 7f915ecd99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.257+0000 7f915ecd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.257+0000 7f915ecd99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.257+0000 7f915ecd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.257+0000 7f915ecd99c0 20 started sync module instance, tier type = 2024-09-12T17:34:16.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.257+0000 7f915ecd99c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:16.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.281+0000 7f915ecd99c0 20 add_watcher() i=0 2024-09-12T17:34:16.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.281+0000 7f915ecd99c0 20 add_watcher() i=1 2024-09-12T17:34:16.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.281+0000 7f915ecd99c0 20 add_watcher() i=2 2024-09-12T17:34:16.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.281+0000 7f915ecd99c0 20 add_watcher() i=3 2024-09-12T17:34:16.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.281+0000 7f915ecd99c0 20 add_watcher() i=4 2024-09-12T17:34:16.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.281+0000 7f915ecd99c0 20 add_watcher() i=5 2024-09-12T17:34:16.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.281+0000 7f915ecd99c0 20 add_watcher() i=6 2024-09-12T17:34:16.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.285+0000 7f915ecd99c0 20 add_watcher() i=7 2024-09-12T17:34:16.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.285+0000 7f915ecd99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:16.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.289+0000 7f9012fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:16.288 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.289+0000 7f915ecd99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:16.288 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.289+0000 7f915ecd99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:16.288 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.289+0000 7f915ecd99c0 5 note: GC not initialized 2024-09-12T17:34:16.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.289+0000 7f9011fdb640 20 reqs_thread_entry: start 2024-09-12T17:34:16.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.289+0000 7f915ecd99c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:16.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.289+0000 7f915ecd99c0 20 Filter name: none 2024-09-12T17:34:16.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.289+0000 7f8f837fe640 20 reqs_thread_entry: start 2024-09-12T17:34:16.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.289+0000 7f915ecd99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.293+0000 7f915ecd99c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:16.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.293+0000 7f915ecd99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.293+0000 7f915ecd99c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:16.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.293+0000 7f915ecd99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:16.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.293+0000 7f915ecd99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.293+0000 7f915ecd99c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:16.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.293+0000 7f915ecd99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.293+0000 7f915ecd99c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:16.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.293+0000 7f915ecd99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:16.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.297+0000 7f9012fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:16.300 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.301+0000 7f915ecd99c0 20 remove_watcher() i=0 2024-09-12T17:34:16.300 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.301+0000 7f915ecd99c0 2 removed watcher, disabling cache 2024-09-12T17:34:16.303 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.305+0000 7f915ecd99c0 20 remove_watcher() i=1 2024-09-12T17:34:16.306 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.305+0000 7f915ecd99c0 20 remove_watcher() i=2 2024-09-12T17:34:16.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.309+0000 7f915ecd99c0 20 remove_watcher() i=3 2024-09-12T17:34:16.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.313+0000 7f915ecd99c0 20 remove_watcher() i=4 2024-09-12T17:34:16.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.313+0000 7f915ecd99c0 20 remove_watcher() i=5 2024-09-12T17:34:16.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.317+0000 7f915ecd99c0 20 remove_watcher() i=6 2024-09-12T17:34:16.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.317+0000 7f915ecd99c0 20 remove_watcher() i=7 2024-09-12T17:34:16.330 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.330 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:34:16.330 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-set-target-layout id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:34:16.330 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.331 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T17:34:16.363 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:16.364 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:16.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.413+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.413+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.413+0000 7fc745a149c0 20 realm 2024-09-12T17:34:16.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.413+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.417+0000 7fc745a149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:16.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:16.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.421+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:16.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.421+0000 7fc745a149c0 20 searching for the correct realm 2024-09-12T17:34:16.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.421+0000 7fc743d1b640 0 -- 172.21.15.119:0/3522203285 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fc72c02a070 msgr2=0x7fc72c039940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:16.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.637+0000 7fc742d19640 0 -- 172.21.15.119:0/3522203285 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fc73c07f140 msgr2=0x7fc73c05d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:16.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.853+0000 7fc745a149c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:16.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:16.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:16.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:16.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:16.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:16.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.856 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.856 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:16.856 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:16.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 20 zone default found 2024-09-12T17:34:16.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 4 Realm: () 2024-09-12T17:34:16.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:16.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:16.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:16.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 20 zonegroup default 2024-09-12T17:34:16.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.861+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.861+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.861+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.861+0000 7fc745a149c0 20 started sync module instance, tier type = 2024-09-12T17:34:16.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.861+0000 7fc745a149c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:16.884 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=0 2024-09-12T17:34:16.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=1 2024-09-12T17:34:16.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=2 2024-09-12T17:34:16.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=3 2024-09-12T17:34:16.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=4 2024-09-12T17:34:16.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=5 2024-09-12T17:34:16.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=6 2024-09-12T17:34:16.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.889+0000 7fc745a149c0 20 add_watcher() i=7 2024-09-12T17:34:16.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.889+0000 7fc745a149c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:16.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.893+0000 7fc5f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:16.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.893+0000 7fc745a149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:16.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.893+0000 7fc745a149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:16.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.893+0000 7fc745a149c0 5 note: GC not initialized 2024-09-12T17:34:16.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.893+0000 7fc5f8fe1640 20 reqs_thread_entry: start 2024-09-12T17:34:16.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.893+0000 7fc745a149c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:16.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.893+0000 7fc745a149c0 20 Filter name: none 2024-09-12T17:34:16.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.893+0000 7fc5727fc640 20 reqs_thread_entry: start 2024-09-12T17:34:16.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.893+0000 7fc745a149c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:34:16.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.893+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.897+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:16.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.897+0000 7fc745a149c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:34:16.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.897+0000 7fc745a149c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:34:16.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.897+0000 7fc745a149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 : miss 2024-09-12T17:34:16.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.897+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.897+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:16.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.897+0000 7fc745a149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 info.flags=0x17 2024-09-12T17:34:16.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.897+0000 7fc745a149c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 to cache LRU end 2024-09-12T17:34:16.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.897+0000 7fc745a149c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:16.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.897+0000 7fc745a149c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:16.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.897+0000 7fc745a149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 2024-09-12T17:34:16.903 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc745a149c0 time 2024-09-12T17:34:16.910369+0000 2024-09-12T17:34:16.903 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:34:16.905 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:16.905 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc7492ee2eb] 2024-09-12T17:34:16.905 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc7492ee49f] 2024-09-12T17:34:16.905 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5569389e00c1] 2024-09-12T17:34:16.905 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x140f6b8) [0x5569394356b8] 2024-09-12T17:34:16.905 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5569389f218d] 2024-09-12T17:34:16.905 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:34:16.905 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc748154d90] 2024-09-12T17:34:16.905 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:34:16.905 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:34:16.905 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.905+0000 7fc745a149c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc745a149c0 time 2024-09-12T17:34:16.910369+0000 2024-09-12T17:34:16.906 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:34:16.906 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.906 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:16.906 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc7492ee2eb] 2024-09-12T17:34:16.906 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc7492ee49f] 2024-09-12T17:34:16.906 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5569389e00c1] 2024-09-12T17:34:16.906 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x140f6b8) [0x5569394356b8] 2024-09-12T17:34:16.906 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5569389f218d] 2024-09-12T17:34:16.906 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:34:16.906 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc748154d90] 2024-09-12T17:34:16.906 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:34:16.906 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:34:16.906 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.907 INFO:tasks.workunit.client.0.smithi119.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:34:16.907 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fc745a149c0 thread_name:radosgw-admin 2024-09-12T17:34:16.918 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:16.918 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc74816d520] 2024-09-12T17:34:16.918 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:34:16.918 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:34:16.918 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:34:16.918 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc7492ee345] 2024-09-12T17:34:16.918 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc7492ee49f] 2024-09-12T17:34:16.919 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5569389e00c1] 2024-09-12T17:34:16.919 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x140f6b8) [0x5569394356b8] 2024-09-12T17:34:16.919 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5569389f218d] 2024-09-12T17:34:16.919 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:34:16.919 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc748154d90] 2024-09-12T17:34:16.919 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:34:16.919 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:34:16.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.905+0000 7fc745a149c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:34:16.919 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fc745a149c0 thread_name:radosgw-admin 2024-09-12T17:34:16.920 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.920 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:16.920 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc74816d520] 2024-09-12T17:34:16.920 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:34:16.920 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:34:16.920 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:34:16.920 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc7492ee345] 2024-09-12T17:34:16.920 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc7492ee49f] 2024-09-12T17:34:16.920 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5569389e00c1] 2024-09-12T17:34:16.921 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x140f6b8) [0x5569394356b8] 2024-09-12T17:34:16.921 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5569389f218d] 2024-09-12T17:34:16.921 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:34:16.921 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc748154d90] 2024-09-12T17:34:16.921 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:34:16.921 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:34:16.921 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:34:16.921 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.921 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:34:16.921 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:34:16.389+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:16.921 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:34:16.389+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:16.921 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:34:16.389+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:16.922 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:34:16.389+0000 7fc743d1b640 10 monclient(hunting): handle_auth_done global_id 6314 payload 274 2024-09-12T17:34:16.922 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:34:16.389+0000 7fc743d1b640 10 monclient: _finish_hunting 0 2024-09-12T17:34:16.922 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:34:16.389+0000 7fc743d1b640 1 monclient: found mon.noname-c 2024-09-12T17:34:16.922 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:34:16.389+0000 7fc743d1b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:34:16.922 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:34:16.389+0000 7fc742d19640 10 monclient: get_auth_request con 0x556939fa01f0 auth_method 0 2024-09-12T17:34:16.922 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:16.922 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:34:16.922 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: dump: 2024-09-12T17:34:16.922 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:16.922 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:16.922 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.922 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.922 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:16.923 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.923 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:16.923 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:16.923 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:16.923 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.923 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: _finish_auth 0 2024-09-12T17:34:16.923 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: _check_auth_tickets 2024-09-12T17:34:16.923 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:16.923 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:16.923 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:34:16.923 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: dump: 2024-09-12T17:34:16.923 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:16.923 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:16.924 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.924 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.924 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:16.924 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.924 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:16.924 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:16.924 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:16.924 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.924 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 monclient: authenticate success, global_id 6314 2024-09-12T17:34:16.924 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:34:16.389+0000 7fc745a149c0 10 monclient: get_monmap_and_config success 2024-09-12T17:34:16.924 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:34:16.389+0000 7fc745a149c0 4 set_mon_vals no callback set 2024-09-12T17:34:16.924 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:34:16.389+0000 7fc745a149c0 10 monclient: shutdown 2024-09-12T17:34:16.924 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 asok(0x556939e4f2b0) unregister_commands rotate-key 2024-09-12T17:34:16.924 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:34:16.389+0000 7fc745a149c0 10 monclient: build_initial_monmap 2024-09-12T17:34:16.925 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:34:16.389+0000 7fc745a149c0 1 build_initial for_mkfs: 0 2024-09-12T17:34:16.925 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:34:16.389+0000 7fc745a149c0 10 monclient: monmap: 2024-09-12T17:34:16.925 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:34:16.925 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:16.925 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:34:16.925 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:34:16.925 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:16.925 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.925 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:34:16.925 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:34:16.925 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:34:16.925 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.925 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding auth protocol: cephx 2024-09-12T17:34:16.926 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding auth protocol: cephx 2024-09-12T17:34:16.926 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding auth protocol: cephx 2024-09-12T17:34:16.926 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: secure 2024-09-12T17:34:16.926 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: crc 2024-09-12T17:34:16.926 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: secure 2024-09-12T17:34:16.926 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: crc 2024-09-12T17:34:16.926 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: secure 2024-09-12T17:34:16.926 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: crc 2024-09-12T17:34:16.926 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: crc 2024-09-12T17:34:16.926 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: secure 2024-09-12T17:34:16.926 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: crc 2024-09-12T17:34:16.926 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: secure 2024-09-12T17:34:16.926 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: crc 2024-09-12T17:34:16.927 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: secure 2024-09-12T17:34:16.927 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:34:16.389+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.927 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:34:16.389+0000 7fc745a149c0 1 librados: starting msgr at 2024-09-12T17:34:16.927 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:34:16.389+0000 7fc745a149c0 1 librados: starting objecter 2024-09-12T17:34:16.927 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command objecter_requests hook 0x55693a08bd90 2024-09-12T17:34:16.927 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:34:16.389+0000 7fc745a149c0 1 librados: setting wanted keys 2024-09-12T17:34:16.927 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:34:16.389+0000 7fc745a149c0 1 librados: calling monclient init 2024-09-12T17:34:16.927 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:34:16.389+0000 7fc745a149c0 10 monclient: init 2024-09-12T17:34:16.927 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding auth protocol: cephx 2024-09-12T17:34:16.927 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding auth protocol: cephx 2024-09-12T17:34:16.927 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding auth protocol: cephx 2024-09-12T17:34:16.927 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: secure 2024-09-12T17:34:16.927 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: crc 2024-09-12T17:34:16.928 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: secure 2024-09-12T17:34:16.928 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: crc 2024-09-12T17:34:16.928 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: secure 2024-09-12T17:34:16.928 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: crc 2024-09-12T17:34:16.928 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: crc 2024-09-12T17:34:16.928 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: secure 2024-09-12T17:34:16.928 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: crc 2024-09-12T17:34:16.928 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: secure 2024-09-12T17:34:16.928 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: crc 2024-09-12T17:34:16.928 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: secure 2024-09-12T17:34:16.928 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:34:16.393+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.928 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:34:16.393+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.929 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:34:16.393+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command rotate-key hook 0x55693a05a638 2024-09-12T17:34:16.929 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient: _reopen_session rank -1 2024-09-12T17:34:16.929 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:34:16.929 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-b con 0x556939f0ae30 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:34:16.929 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-c con 0x556939fa01f0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:34:16.929 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-a con 0x556939fa05d0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:34:16.929 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:16.929 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:16.929 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:16.929 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient(hunting): _renew_subs 2024-09-12T17:34:16.929 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient(hunting): authenticate will time out at 2424.428433s 2024-09-12T17:34:16.929 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient(hunting): get_auth_request con 0x556939fa05d0 auth_method 0 2024-09-12T17:34:16.929 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:16.929 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:16.930 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:16.930 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:34:16.393+0000 7fc742d19640 10 monclient(hunting): get_auth_request con 0x556939fa01f0 auth_method 0 2024-09-12T17:34:16.930 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:34:16.393+0000 7fc742d19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:16.930 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:34:16.393+0000 7fc742d19640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:16.930 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:34:16.393+0000 7fc742d19640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:16.930 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:16.930 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:16.930 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:16.930 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:34:16.393+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:16.930 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:34:16.393+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:16.930 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:34:16.393+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:16.930 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:34:16.393+0000 7fc74351a640 10 monclient(hunting): get_auth_request con 0x556939f0ae30 auth_method 0 2024-09-12T17:34:16.930 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:34:16.393+0000 7fc74351a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:16.930 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:34:16.393+0000 7fc74351a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:16.931 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:34:16.393+0000 7fc74351a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:16.931 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient(hunting): handle_auth_done global_id 6669 payload 824 2024-09-12T17:34:16.931 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient: _finish_hunting 0 2024-09-12T17:34:16.931 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:34:16.393+0000 7fc743d1b640 1 monclient: found mon.noname-a 2024-09-12T17:34:16.931 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:34:16.931 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:16.931 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:34:16.931 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: dump: 2024-09-12T17:34:16.931 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:16.931 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:16.931 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.931 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.931 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:16.932 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.932 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:16.932 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:16.932 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:16.932 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.932 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: _finish_auth 0 2024-09-12T17:34:16.932 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: _check_auth_tickets 2024-09-12T17:34:16.932 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:16.932 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:16.932 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:34:16.932 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: dump: 2024-09-12T17:34:16.932 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:16.932 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:16.933 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.933 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.933 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:16.933 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.933 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:16.933 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:16.933 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:16.933 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.933 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:34:16.393+0000 7fc63160a640 4 set_mon_vals no callback set 2024-09-12T17:34:16.933 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:34:16.393+0000 7fc745a149c0 5 monclient: authenticate success, global_id 6669 2024-09-12T17:34:16.933 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient: _renew_subs 2024-09-12T17:34:16.933 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:34:16.933 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient: _renew_subs 2024-09-12T17:34:16.933 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:34:16.934 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:34:16.393+0000 7fc745a149c0 1 librados: init done 2024-09-12T17:34:16.934 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:34:16.393+0000 7fc62fe07640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:34:16.934 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:34:16.393+0000 7fc62fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:34:16.934 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:34:16.393+0000 7fc62fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:34:16.934 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:34:16.393+0000 7fc74351a640 10 monclient: get_auth_request con 0x7fc628070ae0 auth_method 0 2024-09-12T17:34:16.934 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:34:16.393+0000 7fc742d19640 10 monclient: get_auth_request con 0x55693a087760 auth_method 0 2024-09-12T17:34:16.934 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:34:16.397+0000 7fc74351a640 10 monclient: get_auth_request con 0x55693a0abc20 auth_method 0 2024-09-12T17:34:16.934 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:34:16.397+0000 7fc742d19640 10 monclient: get_auth_request con 0x55693a0afe10 auth_method 0 2024-09-12T17:34:16.934 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:34:16.401+0000 7fc743d1b640 10 monclient: get_auth_request con 0x55693a0af480 auth_method 0 2024-09-12T17:34:16.934 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:34:16.401+0000 7fc745a149c0 10 monclient: build_initial_monmap 2024-09-12T17:34:16.934 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:34:16.401+0000 7fc745a149c0 1 build_initial for_mkfs: 0 2024-09-12T17:34:16.934 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:34:16.401+0000 7fc745a149c0 10 monclient: monmap: 2024-09-12T17:34:16.935 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:34:16.935 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:16.935 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:34:16.935 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:34:16.935 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:16.935 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.935 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:34:16.935 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:34:16.935 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:34:16.935 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.935 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding auth protocol: cephx 2024-09-12T17:34:16.935 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding auth protocol: cephx 2024-09-12T17:34:16.935 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding auth protocol: cephx 2024-09-12T17:34:16.936 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: secure 2024-09-12T17:34:16.936 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: crc 2024-09-12T17:34:16.936 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: secure 2024-09-12T17:34:16.936 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: crc 2024-09-12T17:34:16.936 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: secure 2024-09-12T17:34:16.936 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: crc 2024-09-12T17:34:16.936 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: crc 2024-09-12T17:34:16.936 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: secure 2024-09-12T17:34:16.936 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: crc 2024-09-12T17:34:16.936 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: secure 2024-09-12T17:34:16.936 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: crc 2024-09-12T17:34:16.936 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: secure 2024-09-12T17:34:16.936 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:34:16.405+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.937 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55693a0bb6e0 EEXIST 2024-09-12T17:34:16.937 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient: init 2024-09-12T17:34:16.937 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding auth protocol: cephx 2024-09-12T17:34:16.937 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding auth protocol: cephx 2024-09-12T17:34:16.937 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding auth protocol: cephx 2024-09-12T17:34:16.937 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: secure 2024-09-12T17:34:16.937 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: crc 2024-09-12T17:34:16.937 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: secure 2024-09-12T17:34:16.937 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: crc 2024-09-12T17:34:16.937 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: secure 2024-09-12T17:34:16.937 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: crc 2024-09-12T17:34:16.937 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: crc 2024-09-12T17:34:16.937 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: secure 2024-09-12T17:34:16.938 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: crc 2024-09-12T17:34:16.938 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: secure 2024-09-12T17:34:16.938 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: crc 2024-09-12T17:34:16.938 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: secure 2024-09-12T17:34:16.938 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:34:16.405+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.938 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:34:16.405+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.938 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command rotate-key cmddesc rotate-key hook 0x55693a0b6d40 EEXIST 2024-09-12T17:34:16.938 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient: _reopen_session rank -1 2024-09-12T17:34:16.938 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:34:16.938 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-b con 0x55693a0df890 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:34:16.938 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-c con 0x55693a0df1c0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:34:16.938 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-a con 0x55693a0ddba0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:34:16.938 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:16.938 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:16.939 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:16.939 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient(hunting): _renew_subs 2024-09-12T17:34:16.939 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient(hunting): authenticate will time out at 2424.440941s 2024-09-12T17:34:16.939 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:34:16.405+0000 7fc74351a640 10 monclient(hunting): get_auth_request con 0x55693a0ddba0 auth_method 0 2024-09-12T17:34:16.939 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:34:16.405+0000 7fc74351a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:16.939 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:34:16.405+0000 7fc74351a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:16.939 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:34:16.405+0000 7fc74351a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:16.939 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient(hunting): get_auth_request con 0x55693a0df1c0 auth_method 0 2024-09-12T17:34:16.939 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:16.939 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:16.939 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:16.939 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:34:16.405+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:16.939 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:34:16.405+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:16.940 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:34:16.405+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:16.940 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:16.940 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:16.940 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:16.940 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:34:16.405+0000 7fc742d19640 10 monclient(hunting): get_auth_request con 0x55693a0df890 auth_method 0 2024-09-12T17:34:16.940 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:34:16.405+0000 7fc742d19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:16.940 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:34:16.405+0000 7fc742d19640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:16.940 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:34:16.405+0000 7fc742d19640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:16.940 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:34:16.405+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:16.940 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:34:16.405+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:16.940 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:34:16.405+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:16.940 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient(hunting): handle_auth_done global_id 6320 payload 824 2024-09-12T17:34:16.940 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient: _finish_hunting 0 2024-09-12T17:34:16.941 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:34:16.405+0000 7fc743d1b640 1 monclient: found mon.noname-c 2024-09-12T17:34:16.941 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:34:16.941 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:16.941 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:34:16.941 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: dump: 2024-09-12T17:34:16.941 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:16.941 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:16.941 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.941 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.941 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:16.941 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.942 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:16.942 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:16.942 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:16.942 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.942 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: _finish_auth 0 2024-09-12T17:34:16.942 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: _check_auth_tickets 2024-09-12T17:34:16.942 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 monclient: authenticate success, global_id 6320 2024-09-12T17:34:16.942 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient: _renew_subs 2024-09-12T17:34:16.942 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:34:16.942 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:16.942 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:16.943 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:34:16.943 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: dump: 2024-09-12T17:34:16.943 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:16.943 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:16.943 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.943 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.943 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:16.943 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.943 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:16.943 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:16.943 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:16.944 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.944 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:34:16.405+0000 7fc74451c640 4 set_mon_vals no callback set 2024-09-12T17:34:16.944 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient: _renew_subs 2024-09-12T17:34:16.944 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:34:16.944 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:34:16.405+0000 7fc62d602640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:34:16.944 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:34:16.405+0000 7fc62d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:34:16.944 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:34:16.405+0000 7fc62d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:34:16.944 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: get_monmap_and_config 2024-09-12T17:34:16.944 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: build_initial_monmap 2024-09-12T17:34:16.944 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:34:16.409+0000 7fc745a149c0 1 build_initial for_mkfs: 0 2024-09-12T17:34:16.944 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: monmap: 2024-09-12T17:34:16.945 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:34:16.945 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:16.945 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:34:16.945 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:34:16.945 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:16.945 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.945 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:34:16.945 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:34:16.945 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:34:16.945 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.945 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding auth protocol: cephx 2024-09-12T17:34:16.946 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding auth protocol: cephx 2024-09-12T17:34:16.946 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding auth protocol: cephx 2024-09-12T17:34:16.946 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: secure 2024-09-12T17:34:16.946 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: crc 2024-09-12T17:34:16.946 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: secure 2024-09-12T17:34:16.946 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: crc 2024-09-12T17:34:16.946 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: secure 2024-09-12T17:34:16.946 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: crc 2024-09-12T17:34:16.946 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: crc 2024-09-12T17:34:16.946 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: secure 2024-09-12T17:34:16.946 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: crc 2024-09-12T17:34:16.947 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: secure 2024-09-12T17:34:16.947 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: crc 2024-09-12T17:34:16.947 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: secure 2024-09-12T17:34:16.947 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:34:16.409+0000 7fc742d19640 10 monclient: get_auth_request con 0x7fc61c070a20 auth_method 0 2024-09-12T17:34:16.947 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:34:16.409+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.947 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: init 2024-09-12T17:34:16.947 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding auth protocol: cephx 2024-09-12T17:34:16.947 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding auth protocol: cephx 2024-09-12T17:34:16.947 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding auth protocol: cephx 2024-09-12T17:34:16.947 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: secure 2024-09-12T17:34:16.948 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: crc 2024-09-12T17:34:16.948 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: secure 2024-09-12T17:34:16.948 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: crc 2024-09-12T17:34:16.948 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: secure 2024-09-12T17:34:16.948 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: crc 2024-09-12T17:34:16.948 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: crc 2024-09-12T17:34:16.948 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: secure 2024-09-12T17:34:16.948 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: crc 2024-09-12T17:34:16.948 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: secure 2024-09-12T17:34:16.948 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: crc 2024-09-12T17:34:16.948 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: secure 2024-09-12T17:34:16.948 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:34:16.409+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.949 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:34:16.409+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.949 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe8e605e58 EEXIST 2024-09-12T17:34:16.949 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: _reopen_session rank -1 2024-09-12T17:34:16.949 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:34:16.949 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-c con 0x55693a133040 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:34:16.949 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-b con 0x55693a133420 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:34:16.949 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-a con 0x55693a12ec00 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:34:16.949 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:16.949 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:16.949 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:16.950 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): _renew_subs 2024-09-12T17:34:16.950 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): authenticate will time out at 2424.445132s 2024-09-12T17:34:16.950 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:34:16.409+0000 7fc742d19640 10 monclient(hunting): get_auth_request con 0x55693a133040 auth_method 0 2024-09-12T17:34:16.950 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:34:16.409+0000 7fc742d19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:16.950 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:34:16.409+0000 7fc742d19640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:16.950 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:34:16.409+0000 7fc742d19640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:16.950 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): get_auth_request con 0x55693a12ec00 auth_method 0 2024-09-12T17:34:16.950 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:16.950 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:16.950 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:16.950 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:16.951 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:16.951 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:16.951 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:34:16.409+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:16.951 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:34:16.409+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:16.951 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:34:16.409+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:16.951 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:34:16.409+0000 7fc743d1b640 10 monclient(hunting): get_auth_request con 0x55693a133420 auth_method 0 2024-09-12T17:34:16.951 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:34:16.409+0000 7fc743d1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:16.951 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:34:16.409+0000 7fc743d1b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:16.951 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:34:16.409+0000 7fc743d1b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:16.951 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): handle_auth_done global_id 6675 payload 274 2024-09-12T17:34:16.952 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient: _finish_hunting 0 2024-09-12T17:34:16.952 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:34:16.409+0000 7fc74351a640 1 monclient: found mon.noname-a 2024-09-12T17:34:16.952 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:34:16.952 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:16.952 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:34:16.952 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: dump: 2024-09-12T17:34:16.952 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:16.952 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:16.952 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.952 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.952 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:16.952 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.953 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:16.953 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:16.953 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:16.953 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.953 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: _finish_auth 0 2024-09-12T17:34:16.953 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:34:16.953 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:16.953 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:16.953 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:34:16.953 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: dump: 2024-09-12T17:34:16.953 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:16.953 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:16.954 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.954 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.954 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:16.954 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.954 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:16.954 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:16.954 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:16.954 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.954 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 monclient: authenticate success, global_id 6675 2024-09-12T17:34:16.954 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: get_monmap_and_config success 2024-09-12T17:34:16.954 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:34:16.409+0000 7fc745a149c0 4 set_mon_vals no callback set 2024-09-12T17:34:16.954 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: shutdown 2024-09-12T17:34:16.954 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: build_initial_monmap 2024-09-12T17:34:16.954 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:34:16.409+0000 7fc745a149c0 1 build_initial for_mkfs: 0 2024-09-12T17:34:16.955 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: monmap: 2024-09-12T17:34:16.955 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:34:16.955 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:16.955 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:34:16.955 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:34:16.955 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:16.955 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.955 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:34:16.955 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:34:16.955 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:34:16.955 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.956 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding auth protocol: cephx 2024-09-12T17:34:16.956 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding auth protocol: cephx 2024-09-12T17:34:16.956 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding auth protocol: cephx 2024-09-12T17:34:16.956 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: secure 2024-09-12T17:34:16.956 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: crc 2024-09-12T17:34:16.956 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: secure 2024-09-12T17:34:16.956 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: crc 2024-09-12T17:34:16.956 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: secure 2024-09-12T17:34:16.956 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: crc 2024-09-12T17:34:16.956 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: crc 2024-09-12T17:34:16.956 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: secure 2024-09-12T17:34:16.956 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: crc 2024-09-12T17:34:16.956 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: secure 2024-09-12T17:34:16.957 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: crc 2024-09-12T17:34:16.957 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: secure 2024-09-12T17:34:16.957 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:34:16.409+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.957 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:34:16.409+0000 7fc745a149c0 1 librados: starting msgr at 2024-09-12T17:34:16.957 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:34:16.409+0000 7fc745a149c0 1 librados: starting objecter 2024-09-12T17:34:16.957 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55693a1016e0 EEXIST 2024-09-12T17:34:16.957 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:34:16.409+0000 7fc745a149c0 1 librados: setting wanted keys 2024-09-12T17:34:16.957 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:34:16.409+0000 7fc745a149c0 1 librados: calling monclient init 2024-09-12T17:34:16.957 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: init 2024-09-12T17:34:16.957 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding auth protocol: cephx 2024-09-12T17:34:16.957 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding auth protocol: cephx 2024-09-12T17:34:16.957 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding auth protocol: cephx 2024-09-12T17:34:16.957 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: secure 2024-09-12T17:34:16.958 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: crc 2024-09-12T17:34:16.958 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: secure 2024-09-12T17:34:16.958 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: crc 2024-09-12T17:34:16.958 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: secure 2024-09-12T17:34:16.958 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: crc 2024-09-12T17:34:16.958 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: crc 2024-09-12T17:34:16.958 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: secure 2024-09-12T17:34:16.958 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: crc 2024-09-12T17:34:16.958 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: secure 2024-09-12T17:34:16.958 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: crc 2024-09-12T17:34:16.958 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: secure 2024-09-12T17:34:16.958 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:34:16.409+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.958 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:34:16.409+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.959 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command rotate-key cmddesc rotate-key hook 0x55693a0e17f8 EEXIST 2024-09-12T17:34:16.959 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: _reopen_session rank -1 2024-09-12T17:34:16.959 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:34:16.959 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-b con 0x55693a12ec00 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:34:16.959 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-c con 0x55693a133040 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:34:16.959 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-a con 0x55693a12b7c0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:34:16.959 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:16.959 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:16.959 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:16.959 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): _renew_subs 2024-09-12T17:34:16.959 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): authenticate will time out at 2424.447773s 2024-09-12T17:34:16.959 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): get_auth_request con 0x55693a12b7c0 auth_method 0 2024-09-12T17:34:16.959 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:16.959 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:16.960 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:16.960 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:34:16.409+0000 7fc743d1b640 10 monclient(hunting): get_auth_request con 0x55693a133040 auth_method 0 2024-09-12T17:34:16.960 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:34:16.409+0000 7fc743d1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:16.960 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:34:16.409+0000 7fc743d1b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:16.960 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:34:16.409+0000 7fc743d1b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:16.960 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:16.960 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:16.960 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:34:16.413+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:16.960 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:34:16.413+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:16.960 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:34:16.413+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:16.960 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:34:16.413+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:16.960 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:34:16.413+0000 7fc742d19640 10 monclient(hunting): get_auth_request con 0x55693a12ec00 auth_method 0 2024-09-12T17:34:16.960 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:34:16.413+0000 7fc742d19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:16.961 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:34:16.413+0000 7fc742d19640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:16.961 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:34:16.413+0000 7fc742d19640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:16.961 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:34:16.413+0000 7fc74351a640 10 monclient(hunting): handle_auth_done global_id 6678 payload 824 2024-09-12T17:34:16.961 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:34:16.413+0000 7fc74351a640 10 monclient: _finish_hunting 0 2024-09-12T17:34:16.961 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:34:16.413+0000 7fc74351a640 1 monclient: found mon.noname-a 2024-09-12T17:34:16.961 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:34:16.413+0000 7fc74351a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:34:16.961 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:16.961 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:34:16.961 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: dump: 2024-09-12T17:34:16.961 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:16.961 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:16.961 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.962 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.962 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:16.962 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.962 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:16.962 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:16.962 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:16.962 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.962 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: _finish_auth 0 2024-09-12T17:34:16.962 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: _check_auth_tickets 2024-09-12T17:34:16.962 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:16.962 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:16.962 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:34:16.962 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: dump: 2024-09-12T17:34:16.962 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:16.963 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:16.963 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.963 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.963 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:16.963 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.963 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:16.963 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:16.963 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:16.963 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.963 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:34:16.413+0000 7fc745a149c0 5 monclient: authenticate success, global_id 6678 2024-09-12T17:34:16.963 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:34:16.413+0000 7fc745a149c0 10 monclient: _renew_subs 2024-09-12T17:34:16.963 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:34:16.413+0000 7fc626ffd640 4 set_mon_vals no callback set 2024-09-12T17:34:16.963 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:34:16.413+0000 7fc745a149c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:34:16.964 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:34:16.413+0000 7fc745a149c0 10 monclient: _renew_subs 2024-09-12T17:34:16.964 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:34:16.413+0000 7fc745a149c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:34:16.964 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:34:16.413+0000 7fc745a149c0 1 librados: init done 2024-09-12T17:34:16.964 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:34:16.413+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command cr dump hook 0x55693a127bb8 2024-09-12T17:34:16.964 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:34:16.413+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.964 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:34:16.413+0000 7fc6257fa640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:34:16.964 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:34:16.413+0000 7fc6257fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:34:16.964 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:34:16.413+0000 7fc6257fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:34:16.964 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:34:16.413+0000 7fc742d19640 10 monclient: get_auth_request con 0x7fc60c070ae0 auth_method 0 2024-09-12T17:34:16.964 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:34:16.413+0000 7fc743d1b640 10 monclient: get_auth_request con 0x55693a14cfd0 auth_method 0 2024-09-12T17:34:16.964 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:34:16.413+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.964 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:34:16.413+0000 7fc745a149c0 20 realm 2024-09-12T17:34:16.965 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:34:16.413+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.965 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.965 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:34:16.417+0000 7fc745a149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:16.965 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.965 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.965 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.965 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:34:16.417+0000 7fc742d19640 10 monclient: get_auth_request con 0x55693a151240 auth_method 0 2024-09-12T17:34:16.965 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:16.965 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.965 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:34:16.417+0000 7fc743d1b640 10 monclient: get_auth_request con 0x55693a154af0 auth_method 0 2024-09-12T17:34:16.965 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:34:16.421+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:16.965 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:34:16.421+0000 7fc745a149c0 20 searching for the correct realm 2024-09-12T17:34:16.965 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:34:16.421+0000 7fc74351a640 10 monclient: get_auth_request con 0x55693a159810 auth_method 0 2024-09-12T17:34:16.965 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:34:16.421+0000 7fc742d19640 10 monclient: get_auth_request con 0x7fc7340c3040 auth_method 0 2024-09-12T17:34:16.966 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:34:16.421+0000 7fc743d1b640 10 monclient: get_auth_request con 0x7fc72c02a070 auth_method 0 2024-09-12T17:34:16.966 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:34:16.421+0000 7fc743d1b640 0 -- 172.21.15.119:0/3522203285 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fc72c02a070 msgr2=0x7fc72c039940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:16.966 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:34:16.625+0000 7fc743d1b640 10 monclient: get_auth_request con 0x7fc72c02a070 auth_method 0 2024-09-12T17:34:16.966 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:34:16.629+0000 7fc74351a640 10 monclient: get_auth_request con 0x7fc73c01a040 auth_method 0 2024-09-12T17:34:16.966 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:34:16.637+0000 7fc742d19640 0 -- 172.21.15.119:0/3522203285 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fc73c07f140 msgr2=0x7fc73c05d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:16.966 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:34:16.841+0000 7fc742d19640 10 monclient: get_auth_request con 0x7fc73c07f140 auth_method 0 2024-09-12T17:34:16.966 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:34:16.853+0000 7fc745a149c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:16.966 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:16.966 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:16.966 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:16.966 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:16.966 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:16.966 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.967 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.967 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.967 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:16.967 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.967 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:16.967 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 zone default found 2024-09-12T17:34:16.967 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:34:16.857+0000 7fc745a149c0 4 Realm: () 2024-09-12T17:34:16.967 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:34:16.857+0000 7fc745a149c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:16.967 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:34:16.857+0000 7fc745a149c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:16.967 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:34:16.857+0000 7fc745a149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:16.967 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 zonegroup default 2024-09-12T17:34:16.967 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.967 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.968 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.968 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:34:16.861+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.968 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:34:16.861+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.968 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:34:16.861+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:16.968 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:34:16.861+0000 7fc745a149c0 20 started sync module instance, tier type = 2024-09-12T17:34:16.968 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:34:16.861+0000 7fc745a149c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:16.968 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=0 2024-09-12T17:34:16.968 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=1 2024-09-12T17:34:16.968 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=2 2024-09-12T17:34:16.968 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=3 2024-09-12T17:34:16.968 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=4 2024-09-12T17:34:16.968 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=5 2024-09-12T17:34:16.968 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=6 2024-09-12T17:34:16.969 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:34:16.889+0000 7fc745a149c0 20 add_watcher() i=7 2024-09-12T17:34:16.969 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:34:16.889+0000 7fc745a149c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:16.969 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding auth protocol: cephx 2024-09-12T17:34:16.969 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding auth protocol: cephx 2024-09-12T17:34:16.969 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding auth protocol: cephx 2024-09-12T17:34:16.969 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: secure 2024-09-12T17:34:16.969 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: crc 2024-09-12T17:34:16.969 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: secure 2024-09-12T17:34:16.969 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: crc 2024-09-12T17:34:16.969 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: secure 2024-09-12T17:34:16.969 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: crc 2024-09-12T17:34:16.969 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: crc 2024-09-12T17:34:16.969 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: secure 2024-09-12T17:34:16.969 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: crc 2024-09-12T17:34:16.970 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: secure 2024-09-12T17:34:16.970 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: crc 2024-09-12T17:34:16.970 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: secure 2024-09-12T17:34:16.970 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:34:16.893+0000 7fc5f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:16.970 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:34:16.893+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.970 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:34:16.893+0000 7fc745a149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:16.970 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:34:16.893+0000 7fc745a149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:16.970 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command cache list hook 0x55693a127100 2024-09-12T17:34:16.970 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command cache inspect hook 0x55693a127100 2024-09-12T17:34:16.970 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command cache erase hook 0x55693a127100 2024-09-12T17:34:16.970 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command cache zap hook 0x55693a127100 2024-09-12T17:34:16.970 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 note: GC not initialized 2024-09-12T17:34:16.970 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:34:16.893+0000 7fc5f8fe1640 20 reqs_thread_entry: start 2024-09-12T17:34:16.971 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command sync trace show hook 0x7fc7340aad90 2024-09-12T17:34:16.971 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command sync trace history hook 0x7fc7340aad90 2024-09-12T17:34:16.971 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command sync trace active hook 0x7fc7340aad90 2024-09-12T17:34:16.971 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command sync trace active_short hook 0x7fc7340aad90 2024-09-12T17:34:16.971 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:34:16.893+0000 7fc745a149c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:16.971 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:34:16.893+0000 7fc745a149c0 20 Filter name: none 2024-09-12T17:34:16.971 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:34:16.893+0000 7fc5727fc640 20 reqs_thread_entry: start 2024-09-12T17:34:16.971 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:34:16.893+0000 7fc745a149c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:34:16.971 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:34:16.893+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.971 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:34:16.897+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:16.971 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:34:16.897+0000 7fc745a149c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:34:16.971 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:34:16.897+0000 7fc745a149c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:34:16.971 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:34:16.897+0000 7fc745a149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 : miss 2024-09-12T17:34:16.972 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:34:16.897+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:16.972 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:34:16.897+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:16.972 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:34:16.897+0000 7fc745a149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 info.flags=0x17 2024-09-12T17:34:16.972 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:34:16.897+0000 7fc745a149c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 to cache LRU end 2024-09-12T17:34:16.972 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:34:16.897+0000 7fc745a149c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:16.972 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:34:16.897+0000 7fc745a149c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:16.972 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:34:16.897+0000 7fc745a149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 2024-09-12T17:34:16.972 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:34:16.905+0000 7fc745a149c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc745a149c0 time 2024-09-12T17:34:16.910369+0000 2024-09-12T17:34:16.972 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:34:16.972 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.972 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:16.972 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc7492ee2eb] 2024-09-12T17:34:16.972 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc7492ee49f] 2024-09-12T17:34:16.973 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5569389e00c1] 2024-09-12T17:34:16.973 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x140f6b8) [0x5569394356b8] 2024-09-12T17:34:16.973 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5569389f218d] 2024-09-12T17:34:16.973 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:34:16.973 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc748154d90] 2024-09-12T17:34:16.973 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:34:16.973 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:34:16.973 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.973 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:34:16.905+0000 7fc745a149c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:34:16.973 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fc745a149c0 thread_name:radosgw-admin 2024-09-12T17:34:16.973 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.973 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:16.974 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc74816d520] 2024-09-12T17:34:16.974 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:34:16.974 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:34:16.974 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:34:16.974 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc7492ee345] 2024-09-12T17:34:16.974 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc7492ee49f] 2024-09-12T17:34:16.974 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5569389e00c1] 2024-09-12T17:34:16.974 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x140f6b8) [0x5569394356b8] 2024-09-12T17:34:16.974 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5569389f218d] 2024-09-12T17:34:16.974 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:34:16.974 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc748154d90] 2024-09-12T17:34:16.974 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:34:16.974 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:34:16.974 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:34:16.975 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.975 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:34:16.975 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:34:16.975 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:34:16.975 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:34:16.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:34:16.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:34:16.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:34:16.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:34:16.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:34:16.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:34:16.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:34:16.975 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:34:16.975 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:34:16.976 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:34:16.976 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:34:16.976 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:34:16.976 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:34:16.976 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:34:16.976 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:34:16.976 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:34:16.976 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:34:16.976 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:34:16.976 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:34:16.976 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:34:16.976 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:34:16.976 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:34:16.976 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:34:16.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:34:16.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:34:16.977 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:34:16.977 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:34:16.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:34:16.977 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:34:16.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:34:16.977 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:34:16.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:34:16.977 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:34:16.977 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:34:16.977 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:34:16.977 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:34:16.978 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:34:16.978 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:34:16.978 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:34:16.978 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:34:16.978 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:34:16.978 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:34:16.978 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:34:16.978 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:34:16.978 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:34:16.978 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:34:16.978 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:34:16.978 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:34:16.978 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:34:16.978 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:34:16.979 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:34:16.979 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:34:16.979 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:34:16.979 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:34:16.979 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:34:16.979 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:34:16.979 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:34:16.979 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:34:16.979 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:34:16.979 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:34:16.979 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:34:16.979 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:34:16.979 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:34:16.979 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:34:16.980 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:34:16.980 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:34:16.980 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:34:16.980 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:34:16.980 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:34:16.980 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:34:16.980 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:34:16.980 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:34:16.980 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:34:16.980 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:34:16.980 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:34:16.980 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:34:16.980 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:34:16.980 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:34:16.981 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:34:16.981 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:34:16.981 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:34:16.981 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:34:16.981 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:34:16.981 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:34:16.981 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:34:16.981 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:34:16.981 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:34:16.981 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:34:16.981 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:34:16.981 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:34:16.981 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc5727fc640 / http_manager 2024-09-12T17:34:16.982 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc5f8fe1640 / http_manager 2024-09-12T17:34:16.982 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc5f9fe3640 / rgw_dt_lg_renew 2024-09-12T17:34:16.982 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc6257fa640 / ms_dispatch 2024-09-12T17:34:16.982 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc626ffd640 / io_context_pool 2024-09-12T17:34:16.982 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc62d602640 / ms_dispatch 2024-09-12T17:34:16.982 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc62fe07640 / ms_dispatch 2024-09-12T17:34:16.982 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc63160a640 / io_context_pool 2024-09-12T17:34:16.982 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc742d19640 / msgr-worker-2 2024-09-12T17:34:16.982 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc74351a640 / msgr-worker-1 2024-09-12T17:34:16.982 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc743d1b640 / msgr-worker-0 2024-09-12T17:34:16.982 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc74451c640 / io_context_pool 2024-09-12T17:34:16.982 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc745a149c0 / radosgw-admin 2024-09-12T17:34:16.982 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:34:16.982 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:34:16.983 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/log/ceph/ceph-client.admin.92057.log 2024-09-12T17:34:16.983 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:34:16.983 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:34:16.983 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:34:16.389+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:16.983 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:34:16.389+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:16.983 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:34:16.389+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:16.983 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:34:16.389+0000 7fc743d1b640 10 monclient(hunting): handle_auth_done global_id 6314 payload 274 2024-09-12T17:34:16.983 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:34:16.389+0000 7fc743d1b640 10 monclient: _finish_hunting 0 2024-09-12T17:34:16.983 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:34:16.389+0000 7fc743d1b640 1 monclient: found mon.noname-c 2024-09-12T17:34:16.983 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:34:16.389+0000 7fc743d1b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:34:16.983 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:34:16.389+0000 7fc742d19640 10 monclient: get_auth_request con 0x556939fa01f0 auth_method 0 2024-09-12T17:34:16.983 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:16.983 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:34:16.983 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: dump: 2024-09-12T17:34:16.984 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:16.984 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:16.984 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.984 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.984 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:16.984 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.984 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:16.984 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:16.984 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:16.984 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.984 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: _finish_auth 0 2024-09-12T17:34:16.984 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: _check_auth_tickets 2024-09-12T17:34:16.985 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:16.985 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:16.985 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:34:16.985 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:34:16.389+0000 7fc63160a640 10 monclient: dump: 2024-09-12T17:34:16.985 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:16.985 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:16.985 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.985 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.985 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:16.985 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.985 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:16.985 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:16.985 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:16.986 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.986 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 monclient: authenticate success, global_id 6314 2024-09-12T17:34:16.986 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:34:16.389+0000 7fc745a149c0 10 monclient: get_monmap_and_config success 2024-09-12T17:34:16.986 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:34:16.389+0000 7fc745a149c0 4 set_mon_vals no callback set 2024-09-12T17:34:16.986 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:34:16.389+0000 7fc745a149c0 10 monclient: shutdown 2024-09-12T17:34:16.986 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 asok(0x556939e4f2b0) unregister_commands rotate-key 2024-09-12T17:34:16.986 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:34:16.389+0000 7fc745a149c0 10 monclient: build_initial_monmap 2024-09-12T17:34:16.986 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:34:16.389+0000 7fc745a149c0 1 build_initial for_mkfs: 0 2024-09-12T17:34:16.986 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:34:16.389+0000 7fc745a149c0 10 monclient: monmap: 2024-09-12T17:34:16.986 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:34:16.986 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:16.986 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:34:16.986 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:34:16.987 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:16.987 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.987 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:34:16.987 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:34:16.987 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:34:16.987 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.987 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding auth protocol: cephx 2024-09-12T17:34:16.987 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding auth protocol: cephx 2024-09-12T17:34:16.987 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding auth protocol: cephx 2024-09-12T17:34:16.987 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: secure 2024-09-12T17:34:16.987 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: crc 2024-09-12T17:34:16.987 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: secure 2024-09-12T17:34:16.987 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: crc 2024-09-12T17:34:16.987 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: secure 2024-09-12T17:34:16.988 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: crc 2024-09-12T17:34:16.988 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: crc 2024-09-12T17:34:16.988 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: secure 2024-09-12T17:34:16.988 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: crc 2024-09-12T17:34:16.988 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: secure 2024-09-12T17:34:16.988 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: crc 2024-09-12T17:34:16.988 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05c5d0) adding con mode: secure 2024-09-12T17:34:16.988 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:34:16.389+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.988 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:34:16.389+0000 7fc745a149c0 1 librados: starting msgr at 2024-09-12T17:34:16.988 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:34:16.389+0000 7fc745a149c0 1 librados: starting objecter 2024-09-12T17:34:16.988 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command objecter_requests hook 0x55693a08bd90 2024-09-12T17:34:16.988 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:34:16.389+0000 7fc745a149c0 1 librados: setting wanted keys 2024-09-12T17:34:16.988 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:34:16.389+0000 7fc745a149c0 1 librados: calling monclient init 2024-09-12T17:34:16.989 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:34:16.389+0000 7fc745a149c0 10 monclient: init 2024-09-12T17:34:16.989 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding auth protocol: cephx 2024-09-12T17:34:16.989 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding auth protocol: cephx 2024-09-12T17:34:16.989 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding auth protocol: cephx 2024-09-12T17:34:16.989 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: secure 2024-09-12T17:34:16.989 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: crc 2024-09-12T17:34:16.989 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: secure 2024-09-12T17:34:16.989 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: crc 2024-09-12T17:34:16.989 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: secure 2024-09-12T17:34:16.989 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: crc 2024-09-12T17:34:16.989 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: crc 2024-09-12T17:34:16.990 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: secure 2024-09-12T17:34:16.990 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: crc 2024-09-12T17:34:16.990 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: secure 2024-09-12T17:34:16.990 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: crc 2024-09-12T17:34:16.990 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:34:16.389+0000 7fc745a149c0 5 AuthRegistry(0x55693a05a4f0) adding con mode: secure 2024-09-12T17:34:16.990 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:34:16.393+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.990 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:34:16.393+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.990 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:34:16.393+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command rotate-key hook 0x55693a05a638 2024-09-12T17:34:16.990 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient: _reopen_session rank -1 2024-09-12T17:34:16.990 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:34:16.990 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-b con 0x556939f0ae30 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:34:16.990 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-c con 0x556939fa01f0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:34:16.991 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-a con 0x556939fa05d0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:34:16.991 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:16.991 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:16.991 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:16.991 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient(hunting): _renew_subs 2024-09-12T17:34:16.991 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient(hunting): authenticate will time out at 2424.428433s 2024-09-12T17:34:16.991 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient(hunting): get_auth_request con 0x556939fa05d0 auth_method 0 2024-09-12T17:34:16.991 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:16.991 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:16.991 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:16.991 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:34:16.393+0000 7fc742d19640 10 monclient(hunting): get_auth_request con 0x556939fa01f0 auth_method 0 2024-09-12T17:34:16.991 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:34:16.393+0000 7fc742d19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:16.991 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:34:16.393+0000 7fc742d19640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:16.991 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:34:16.393+0000 7fc742d19640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:16.992 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:16.992 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:16.992 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:16.992 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:34:16.393+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:16.992 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:34:16.393+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:16.992 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:34:16.393+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:16.992 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:34:16.393+0000 7fc74351a640 10 monclient(hunting): get_auth_request con 0x556939f0ae30 auth_method 0 2024-09-12T17:34:16.992 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:34:16.393+0000 7fc74351a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:16.992 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:34:16.393+0000 7fc74351a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:16.992 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:34:16.393+0000 7fc74351a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:16.992 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient(hunting): handle_auth_done global_id 6669 payload 824 2024-09-12T17:34:16.992 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient: _finish_hunting 0 2024-09-12T17:34:16.992 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:34:16.393+0000 7fc743d1b640 1 monclient: found mon.noname-a 2024-09-12T17:34:16.993 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:34:16.393+0000 7fc743d1b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:34:16.993 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:16.993 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:34:16.993 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: dump: 2024-09-12T17:34:16.993 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:16.993 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:16.993 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.993 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.993 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:16.993 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.993 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:16.993 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:16.993 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:16.994 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.994 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: _finish_auth 0 2024-09-12T17:34:16.994 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: _check_auth_tickets 2024-09-12T17:34:16.994 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:16.994 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:16.994 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:34:16.994 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:34:16.393+0000 7fc62fe07640 10 monclient: dump: 2024-09-12T17:34:16.994 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:16.994 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:16.994 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.994 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:16.994 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:16.994 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.994 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:16.995 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:16.995 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:16.995 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.995 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:34:16.393+0000 7fc63160a640 4 set_mon_vals no callback set 2024-09-12T17:34:16.995 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:34:16.393+0000 7fc745a149c0 5 monclient: authenticate success, global_id 6669 2024-09-12T17:34:16.995 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient: _renew_subs 2024-09-12T17:34:16.995 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:34:16.995 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient: _renew_subs 2024-09-12T17:34:16.995 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:34:16.393+0000 7fc745a149c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:34:16.995 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:34:16.393+0000 7fc745a149c0 1 librados: init done 2024-09-12T17:34:16.995 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:34:16.393+0000 7fc62fe07640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:34:16.995 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:34:16.393+0000 7fc62fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:34:16.995 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:34:16.393+0000 7fc62fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:34:16.995 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:34:16.393+0000 7fc74351a640 10 monclient: get_auth_request con 0x7fc628070ae0 auth_method 0 2024-09-12T17:34:16.996 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:34:16.393+0000 7fc742d19640 10 monclient: get_auth_request con 0x55693a087760 auth_method 0 2024-09-12T17:34:16.996 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:34:16.397+0000 7fc74351a640 10 monclient: get_auth_request con 0x55693a0abc20 auth_method 0 2024-09-12T17:34:16.996 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:34:16.397+0000 7fc742d19640 10 monclient: get_auth_request con 0x55693a0afe10 auth_method 0 2024-09-12T17:34:16.996 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:34:16.401+0000 7fc743d1b640 10 monclient: get_auth_request con 0x55693a0af480 auth_method 0 2024-09-12T17:34:16.996 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:34:16.401+0000 7fc745a149c0 10 monclient: build_initial_monmap 2024-09-12T17:34:16.996 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:34:16.401+0000 7fc745a149c0 1 build_initial for_mkfs: 0 2024-09-12T17:34:16.996 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:34:16.401+0000 7fc745a149c0 10 monclient: monmap: 2024-09-12T17:34:16.996 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:34:16.996 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:16.996 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:34:16.996 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:34:16.996 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:16.996 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:16.996 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:34:16.997 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:34:16.997 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:34:16.997 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:16.997 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding auth protocol: cephx 2024-09-12T17:34:16.997 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding auth protocol: cephx 2024-09-12T17:34:16.997 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding auth protocol: cephx 2024-09-12T17:34:16.997 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: secure 2024-09-12T17:34:16.997 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: crc 2024-09-12T17:34:16.997 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: secure 2024-09-12T17:34:16.997 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: crc 2024-09-12T17:34:16.997 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: secure 2024-09-12T17:34:16.997 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: crc 2024-09-12T17:34:16.997 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: crc 2024-09-12T17:34:16.997 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: secure 2024-09-12T17:34:16.998 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: crc 2024-09-12T17:34:16.998 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: secure 2024-09-12T17:34:16.998 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: crc 2024-09-12T17:34:16.998 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:34:16.401+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b7cb0) adding con mode: secure 2024-09-12T17:34:16.998 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:34:16.405+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.998 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55693a0bb6e0 EEXIST 2024-09-12T17:34:16.998 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient: init 2024-09-12T17:34:16.998 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding auth protocol: cephx 2024-09-12T17:34:16.998 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding auth protocol: cephx 2024-09-12T17:34:16.998 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding auth protocol: cephx 2024-09-12T17:34:16.998 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: secure 2024-09-12T17:34:16.998 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: crc 2024-09-12T17:34:16.998 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: secure 2024-09-12T17:34:16.998 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: crc 2024-09-12T17:34:16.999 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: secure 2024-09-12T17:34:16.999 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: crc 2024-09-12T17:34:16.999 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: crc 2024-09-12T17:34:16.999 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: secure 2024-09-12T17:34:16.999 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: crc 2024-09-12T17:34:16.999 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: secure 2024-09-12T17:34:16.999 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: crc 2024-09-12T17:34:16.999 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 AuthRegistry(0x55693a0b6bf8) adding con mode: secure 2024-09-12T17:34:16.999 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:34:16.405+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.999 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:34:16.405+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:16.999 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command rotate-key cmddesc rotate-key hook 0x55693a0b6d40 EEXIST 2024-09-12T17:34:16.999 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient: _reopen_session rank -1 2024-09-12T17:34:16.999 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:34:16.999 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-b con 0x55693a0df890 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:34:16.999 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-c con 0x55693a0df1c0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:34:17.000 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-a con 0x55693a0ddba0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:34:17.000 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:17.000 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:17.000 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:17.000 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient(hunting): _renew_subs 2024-09-12T17:34:17.000 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient(hunting): authenticate will time out at 2424.440941s 2024-09-12T17:34:17.000 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:34:16.405+0000 7fc74351a640 10 monclient(hunting): get_auth_request con 0x55693a0ddba0 auth_method 0 2024-09-12T17:34:17.000 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:34:16.405+0000 7fc74351a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:17.000 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:34:16.405+0000 7fc74351a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:17.000 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:34:16.405+0000 7fc74351a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:17.000 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient(hunting): get_auth_request con 0x55693a0df1c0 auth_method 0 2024-09-12T17:34:17.000 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:17.000 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:17.001 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:17.001 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:34:16.405+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:17.001 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:34:16.405+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:17.001 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:34:16.405+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:17.001 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:17.001 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:17.001 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:17.001 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:34:16.405+0000 7fc742d19640 10 monclient(hunting): get_auth_request con 0x55693a0df890 auth_method 0 2024-09-12T17:34:17.001 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:34:16.405+0000 7fc742d19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:17.001 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:34:16.405+0000 7fc742d19640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:17.001 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:34:16.405+0000 7fc742d19640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:17.001 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:34:16.405+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:17.001 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:34:16.405+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:17.001 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:34:16.405+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:17.002 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient(hunting): handle_auth_done global_id 6320 payload 824 2024-09-12T17:34:17.002 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient: _finish_hunting 0 2024-09-12T17:34:17.002 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:34:16.405+0000 7fc743d1b640 1 monclient: found mon.noname-c 2024-09-12T17:34:17.002 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:34:16.405+0000 7fc743d1b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:34:17.002 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:17.002 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:34:17.002 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: dump: 2024-09-12T17:34:17.002 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:17.002 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:17.002 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:17.002 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:17.002 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:17.002 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:17.002 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:17.003 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:17.003 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:17.003 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:17.003 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: _finish_auth 0 2024-09-12T17:34:17.003 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: _check_auth_tickets 2024-09-12T17:34:17.003 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:34:16.405+0000 7fc745a149c0 5 monclient: authenticate success, global_id 6320 2024-09-12T17:34:17.003 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient: _renew_subs 2024-09-12T17:34:17.003 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:34:17.003 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:17.003 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:17.003 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:34:17.003 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:34:16.405+0000 7fc62d602640 10 monclient: dump: 2024-09-12T17:34:17.003 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:17.004 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:17.004 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:17.004 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:17.004 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:17.004 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:17.004 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:17.004 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:17.004 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:17.004 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:17.004 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:34:16.405+0000 7fc74451c640 4 set_mon_vals no callback set 2024-09-12T17:34:17.004 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient: _renew_subs 2024-09-12T17:34:17.004 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:34:16.405+0000 7fc745a149c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:34:17.004 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:34:16.405+0000 7fc62d602640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:34:17.004 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:34:16.405+0000 7fc62d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:34:17.005 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:34:16.405+0000 7fc62d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:34:17.005 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: get_monmap_and_config 2024-09-12T17:34:17.005 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: build_initial_monmap 2024-09-12T17:34:17.005 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:34:16.409+0000 7fc745a149c0 1 build_initial for_mkfs: 0 2024-09-12T17:34:17.005 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: monmap: 2024-09-12T17:34:17.005 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:34:17.005 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:17.005 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:34:17.005 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:34:17.005 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:17.005 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:17.005 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:34:17.005 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:34:17.006 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:34:17.006 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:17.006 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding auth protocol: cephx 2024-09-12T17:34:17.006 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding auth protocol: cephx 2024-09-12T17:34:17.006 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding auth protocol: cephx 2024-09-12T17:34:17.006 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: secure 2024-09-12T17:34:17.006 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: crc 2024-09-12T17:34:17.006 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: secure 2024-09-12T17:34:17.006 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: crc 2024-09-12T17:34:17.006 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: secure 2024-09-12T17:34:17.006 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: crc 2024-09-12T17:34:17.006 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: crc 2024-09-12T17:34:17.006 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: secure 2024-09-12T17:34:17.006 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: crc 2024-09-12T17:34:17.007 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: secure 2024-09-12T17:34:17.007 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: crc 2024-09-12T17:34:17.007 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0fecb0) adding con mode: secure 2024-09-12T17:34:17.007 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:34:16.409+0000 7fc742d19640 10 monclient: get_auth_request con 0x7fc61c070a20 auth_method 0 2024-09-12T17:34:17.007 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:34:16.409+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:17.007 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: init 2024-09-12T17:34:17.007 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding auth protocol: cephx 2024-09-12T17:34:17.007 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding auth protocol: cephx 2024-09-12T17:34:17.007 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding auth protocol: cephx 2024-09-12T17:34:17.007 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: secure 2024-09-12T17:34:17.007 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: crc 2024-09-12T17:34:17.007 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: secure 2024-09-12T17:34:17.007 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: crc 2024-09-12T17:34:17.007 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: secure 2024-09-12T17:34:17.008 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: crc 2024-09-12T17:34:17.008 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: crc 2024-09-12T17:34:17.008 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: secure 2024-09-12T17:34:17.008 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: crc 2024-09-12T17:34:17.008 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: secure 2024-09-12T17:34:17.008 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: crc 2024-09-12T17:34:17.008 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e605d10) adding con mode: secure 2024-09-12T17:34:17.008 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:34:16.409+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:17.008 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:34:16.409+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:17.008 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe8e605e58 EEXIST 2024-09-12T17:34:17.008 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: _reopen_session rank -1 2024-09-12T17:34:17.008 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:34:17.008 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-c con 0x55693a133040 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:34:17.009 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-b con 0x55693a133420 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:34:17.009 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-a con 0x55693a12ec00 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:34:17.009 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:17.009 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:17.009 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:17.009 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): _renew_subs 2024-09-12T17:34:17.009 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): authenticate will time out at 2424.445132s 2024-09-12T17:34:17.009 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:34:16.409+0000 7fc742d19640 10 monclient(hunting): get_auth_request con 0x55693a133040 auth_method 0 2024-09-12T17:34:17.009 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:34:16.409+0000 7fc742d19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:17.009 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:34:16.409+0000 7fc742d19640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:17.009 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:34:16.409+0000 7fc742d19640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:17.009 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): get_auth_request con 0x55693a12ec00 auth_method 0 2024-09-12T17:34:17.009 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:17.010 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:17.010 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:17.010 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:17.010 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:17.010 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:17.010 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:34:16.409+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:17.010 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:34:16.409+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:17.010 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:34:16.409+0000 7fc742d19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:17.010 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:34:16.409+0000 7fc743d1b640 10 monclient(hunting): get_auth_request con 0x55693a133420 auth_method 0 2024-09-12T17:34:17.010 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:34:16.409+0000 7fc743d1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:17.010 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:34:16.409+0000 7fc743d1b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:17.010 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:34:16.409+0000 7fc743d1b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:17.010 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): handle_auth_done global_id 6675 payload 274 2024-09-12T17:34:17.010 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient: _finish_hunting 0 2024-09-12T17:34:17.011 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:34:16.409+0000 7fc74351a640 1 monclient: found mon.noname-a 2024-09-12T17:34:17.011 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:34:17.011 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:17.011 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:34:17.011 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: dump: 2024-09-12T17:34:17.011 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:17.011 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:17.011 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:17.011 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:17.012 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:17.012 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:17.012 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:17.012 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:17.012 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:17.012 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:17.012 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: _finish_auth 0 2024-09-12T17:34:17.012 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:34:17.012 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:17.012 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:17.012 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:34:17.012 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:34:16.409+0000 7fc626ffd640 10 monclient: dump: 2024-09-12T17:34:17.012 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:17.013 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:17.013 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 monclient: authenticate success, global_id 6675 2024-09-12T17:34:17.014 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: get_monmap_and_config success 2024-09-12T17:34:17.014 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:34:16.409+0000 7fc745a149c0 4 set_mon_vals no callback set 2024-09-12T17:34:17.014 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: shutdown 2024-09-12T17:34:17.014 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: build_initial_monmap 2024-09-12T17:34:17.014 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:34:16.409+0000 7fc745a149c0 1 build_initial for_mkfs: 0 2024-09-12T17:34:17.014 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: monmap: 2024-09-12T17:34:17.014 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:34:17.014 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:17.014 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:34:17.014 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:34:17.014 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:17.014 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:17.015 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:34:17.015 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:34:17.015 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:34:17.015 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:17.015 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding auth protocol: cephx 2024-09-12T17:34:17.015 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding auth protocol: cephx 2024-09-12T17:34:17.015 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding auth protocol: cephx 2024-09-12T17:34:17.015 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: secure 2024-09-12T17:34:17.015 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: crc 2024-09-12T17:34:17.015 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: secure 2024-09-12T17:34:17.016 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: crc 2024-09-12T17:34:17.016 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: secure 2024-09-12T17:34:17.016 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: crc 2024-09-12T17:34:17.016 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: crc 2024-09-12T17:34:17.016 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: secure 2024-09-12T17:34:17.016 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: crc 2024-09-12T17:34:17.016 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: secure 2024-09-12T17:34:17.016 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: crc 2024-09-12T17:34:17.016 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a123880) adding con mode: secure 2024-09-12T17:34:17.016 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:34:16.409+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:17.016 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:34:16.409+0000 7fc745a149c0 1 librados: starting msgr at 2024-09-12T17:34:17.016 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:34:16.409+0000 7fc745a149c0 1 librados: starting objecter 2024-09-12T17:34:17.016 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55693a1016e0 EEXIST 2024-09-12T17:34:17.017 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:34:16.409+0000 7fc745a149c0 1 librados: setting wanted keys 2024-09-12T17:34:17.017 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:34:16.409+0000 7fc745a149c0 1 librados: calling monclient init 2024-09-12T17:34:17.017 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: init 2024-09-12T17:34:17.017 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding auth protocol: cephx 2024-09-12T17:34:17.017 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding auth protocol: cephx 2024-09-12T17:34:17.017 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding auth protocol: cephx 2024-09-12T17:34:17.017 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: secure 2024-09-12T17:34:17.017 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: crc 2024-09-12T17:34:17.017 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: secure 2024-09-12T17:34:17.017 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: crc 2024-09-12T17:34:17.018 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: secure 2024-09-12T17:34:17.018 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: crc 2024-09-12T17:34:17.018 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: crc 2024-09-12T17:34:17.018 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: secure 2024-09-12T17:34:17.018 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: crc 2024-09-12T17:34:17.018 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: secure 2024-09-12T17:34:17.018 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: crc 2024-09-12T17:34:17.018 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 AuthRegistry(0x55693a0e16b0) adding con mode: secure 2024-09-12T17:34:17.018 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:34:16.409+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:17.018 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:34:16.409+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:17.018 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:34:16.409+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command rotate-key cmddesc rotate-key hook 0x55693a0e17f8 EEXIST 2024-09-12T17:34:17.018 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: _reopen_session rank -1 2024-09-12T17:34:17.019 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:34:17.019 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-b con 0x55693a12ec00 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:34:17.019 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-c con 0x55693a133040 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:34:17.019 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): picked mon.noname-a con 0x55693a12b7c0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:34:17.019 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:17.019 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:17.019 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:17.019 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): _renew_subs 2024-09-12T17:34:17.019 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:34:16.409+0000 7fc745a149c0 10 monclient(hunting): authenticate will time out at 2424.447773s 2024-09-12T17:34:17.019 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): get_auth_request con 0x55693a12b7c0 auth_method 0 2024-09-12T17:34:17.019 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:17.020 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:17.020 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:17.020 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:34:16.409+0000 7fc743d1b640 10 monclient(hunting): get_auth_request con 0x55693a133040 auth_method 0 2024-09-12T17:34:17.020 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:34:16.409+0000 7fc743d1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:17.020 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:34:16.409+0000 7fc743d1b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:17.020 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:34:16.409+0000 7fc743d1b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:17.020 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:17.020 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:34:16.409+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:17.020 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:34:16.413+0000 7fc74351a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:17.020 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:34:16.413+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:17.020 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:34:16.413+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:17.021 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:34:16.413+0000 7fc743d1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:17.021 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:34:16.413+0000 7fc742d19640 10 monclient(hunting): get_auth_request con 0x55693a12ec00 auth_method 0 2024-09-12T17:34:17.021 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:34:16.413+0000 7fc742d19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:17.021 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:34:16.413+0000 7fc742d19640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:17.021 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:34:16.413+0000 7fc742d19640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:17.021 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:34:16.413+0000 7fc74351a640 10 monclient(hunting): handle_auth_done global_id 6678 payload 824 2024-09-12T17:34:17.021 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:34:16.413+0000 7fc74351a640 10 monclient: _finish_hunting 0 2024-09-12T17:34:17.021 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:34:16.413+0000 7fc74351a640 1 monclient: found mon.noname-a 2024-09-12T17:34:17.021 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:34:16.413+0000 7fc74351a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:34:17.021 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:17.022 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:34:17.022 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: dump: 2024-09-12T17:34:17.022 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:17.022 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:17.022 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:17.022 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:17.022 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:17.022 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:17.022 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:17.022 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:17.022 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:17.023 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:17.023 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: _finish_auth 0 2024-09-12T17:34:17.023 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: _check_auth_tickets 2024-09-12T17:34:17.023 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:17.023 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:17.023 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:34:17.023 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:34:16.413+0000 7fc6257fa640 10 monclient: dump: 2024-09-12T17:34:17.023 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:34:17.023 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:34:17.023 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:17.023 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:34:17.023 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:17.023 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:34:17.023 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:34:17.024 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:34:17.024 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:34:17.024 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:17.024 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:34:16.413+0000 7fc745a149c0 5 monclient: authenticate success, global_id 6678 2024-09-12T17:34:17.024 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:34:16.413+0000 7fc745a149c0 10 monclient: _renew_subs 2024-09-12T17:34:17.024 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:34:16.413+0000 7fc626ffd640 4 set_mon_vals no callback set 2024-09-12T17:34:17.024 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:34:16.413+0000 7fc745a149c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:34:17.024 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:34:16.413+0000 7fc745a149c0 10 monclient: _renew_subs 2024-09-12T17:34:17.024 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:34:16.413+0000 7fc745a149c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:34:17.024 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:34:16.413+0000 7fc745a149c0 1 librados: init done 2024-09-12T17:34:17.024 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:34:16.413+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command cr dump hook 0x55693a127bb8 2024-09-12T17:34:17.024 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:34:16.413+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.024 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:34:16.413+0000 7fc6257fa640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:34:17.025 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:34:16.413+0000 7fc6257fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:34:17.025 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:34:16.413+0000 7fc6257fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:34:17.025 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:34:16.413+0000 7fc742d19640 10 monclient: get_auth_request con 0x7fc60c070ae0 auth_method 0 2024-09-12T17:34:17.025 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:34:16.413+0000 7fc743d1b640 10 monclient: get_auth_request con 0x55693a14cfd0 auth_method 0 2024-09-12T17:34:17.025 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:34:16.413+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.025 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:34:16.413+0000 7fc745a149c0 20 realm 2024-09-12T17:34:17.025 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:34:16.413+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.025 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.025 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:34:16.417+0000 7fc745a149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:17.026 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.026 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.026 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.026 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:34:16.417+0000 7fc742d19640 10 monclient: get_auth_request con 0x55693a151240 auth_method 0 2024-09-12T17:34:17.026 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:17.026 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:34:16.417+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.026 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:34:16.417+0000 7fc743d1b640 10 monclient: get_auth_request con 0x55693a154af0 auth_method 0 2024-09-12T17:34:17.026 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:34:16.421+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:17.026 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:34:16.421+0000 7fc745a149c0 20 searching for the correct realm 2024-09-12T17:34:17.026 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:34:16.421+0000 7fc74351a640 10 monclient: get_auth_request con 0x55693a159810 auth_method 0 2024-09-12T17:34:17.026 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:34:16.421+0000 7fc742d19640 10 monclient: get_auth_request con 0x7fc7340c3040 auth_method 0 2024-09-12T17:34:17.026 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:34:16.421+0000 7fc743d1b640 10 monclient: get_auth_request con 0x7fc72c02a070 auth_method 0 2024-09-12T17:34:17.027 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:34:16.421+0000 7fc743d1b640 0 -- 172.21.15.119:0/3522203285 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fc72c02a070 msgr2=0x7fc72c039940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:17.027 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:34:16.625+0000 7fc743d1b640 10 monclient: get_auth_request con 0x7fc72c02a070 auth_method 0 2024-09-12T17:34:17.027 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:34:16.629+0000 7fc74351a640 10 monclient: get_auth_request con 0x7fc73c01a040 auth_method 0 2024-09-12T17:34:17.027 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:34:16.637+0000 7fc742d19640 0 -- 172.21.15.119:0/3522203285 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fc73c07f140 msgr2=0x7fc73c05d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:17.027 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:34:16.841+0000 7fc742d19640 10 monclient: get_auth_request con 0x7fc73c07f140 auth_method 0 2024-09-12T17:34:17.027 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:34:16.853+0000 7fc745a149c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:17.027 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:17.027 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:17.027 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:17.027 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:17.027 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:17.027 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.027 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.028 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.028 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:17.028 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.028 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:17.028 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 zone default found 2024-09-12T17:34:17.028 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:34:16.857+0000 7fc745a149c0 4 Realm: () 2024-09-12T17:34:17.028 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:34:16.857+0000 7fc745a149c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:17.028 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:34:16.857+0000 7fc745a149c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:17.028 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:34:16.857+0000 7fc745a149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:17.028 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 zonegroup default 2024-09-12T17:34:17.028 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.028 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.028 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:34:16.857+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.029 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:34:16.861+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.029 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:34:16.861+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.029 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:34:16.861+0000 7fc745a149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.029 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:34:16.861+0000 7fc745a149c0 20 started sync module instance, tier type = 2024-09-12T17:34:17.029 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:34:16.861+0000 7fc745a149c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:17.029 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=0 2024-09-12T17:34:17.029 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=1 2024-09-12T17:34:17.029 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=2 2024-09-12T17:34:17.029 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=3 2024-09-12T17:34:17.029 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=4 2024-09-12T17:34:17.029 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=5 2024-09-12T17:34:17.029 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:34:16.885+0000 7fc745a149c0 20 add_watcher() i=6 2024-09-12T17:34:17.029 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:34:16.889+0000 7fc745a149c0 20 add_watcher() i=7 2024-09-12T17:34:17.029 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:34:16.889+0000 7fc745a149c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:17.030 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding auth protocol: cephx 2024-09-12T17:34:17.030 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding auth protocol: cephx 2024-09-12T17:34:17.030 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding auth protocol: cephx 2024-09-12T17:34:17.030 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: secure 2024-09-12T17:34:17.030 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: crc 2024-09-12T17:34:17.030 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: secure 2024-09-12T17:34:17.030 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: crc 2024-09-12T17:34:17.030 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: secure 2024-09-12T17:34:17.030 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: crc 2024-09-12T17:34:17.030 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: crc 2024-09-12T17:34:17.030 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: secure 2024-09-12T17:34:17.030 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: crc 2024-09-12T17:34:17.030 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: secure 2024-09-12T17:34:17.030 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: crc 2024-09-12T17:34:17.030 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 AuthRegistry(0x7ffe8e6061e0) adding con mode: secure 2024-09-12T17:34:17.031 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:34:16.893+0000 7fc5f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:17.031 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:34:16.893+0000 7fc745a149c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:17.031 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:34:16.893+0000 7fc745a149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:17.031 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:34:16.893+0000 7fc745a149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:17.031 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command cache list hook 0x55693a127100 2024-09-12T17:34:17.031 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command cache inspect hook 0x55693a127100 2024-09-12T17:34:17.031 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command cache erase hook 0x55693a127100 2024-09-12T17:34:17.031 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command cache zap hook 0x55693a127100 2024-09-12T17:34:17.031 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 note: GC not initialized 2024-09-12T17:34:17.031 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:34:16.893+0000 7fc5f8fe1640 20 reqs_thread_entry: start 2024-09-12T17:34:17.031 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command sync trace show hook 0x7fc7340aad90 2024-09-12T17:34:17.031 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command sync trace history hook 0x7fc7340aad90 2024-09-12T17:34:17.031 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command sync trace active hook 0x7fc7340aad90 2024-09-12T17:34:17.031 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:34:16.893+0000 7fc745a149c0 5 asok(0x556939e4f2b0) register_command sync trace active_short hook 0x7fc7340aad90 2024-09-12T17:34:17.032 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:34:16.893+0000 7fc745a149c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:17.032 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:34:16.893+0000 7fc745a149c0 20 Filter name: none 2024-09-12T17:34:17.032 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:34:16.893+0000 7fc5727fc640 20 reqs_thread_entry: start 2024-09-12T17:34:17.032 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:34:16.893+0000 7fc745a149c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:34:17.032 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:34:16.893+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.032 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:34:16.897+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:17.032 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:34:16.897+0000 7fc745a149c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:34:17.032 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:34:16.897+0000 7fc745a149c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:34:17.032 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:34:16.897+0000 7fc745a149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 : miss 2024-09-12T17:34:17.032 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:34:16.897+0000 7fc745a149c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.032 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:34:16.897+0000 7fc745a149c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:17.032 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:34:16.897+0000 7fc745a149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 info.flags=0x17 2024-09-12T17:34:17.032 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:34:16.897+0000 7fc745a149c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 to cache LRU end 2024-09-12T17:34:17.033 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:34:16.897+0000 7fc745a149c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:17.033 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:34:16.897+0000 7fc745a149c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:17.033 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:34:16.897+0000 7fc745a149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 2024-09-12T17:34:17.033 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:34:16.905+0000 7fc745a149c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc745a149c0 time 2024-09-12T17:34:16.910369+0000 2024-09-12T17:34:17.033 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:34:17.033 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:17.033 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:17.033 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc7492ee2eb] 2024-09-12T17:34:17.033 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc7492ee49f] 2024-09-12T17:34:17.033 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5569389e00c1] 2024-09-12T17:34:17.033 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x140f6b8) [0x5569394356b8] 2024-09-12T17:34:17.033 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5569389f218d] 2024-09-12T17:34:17.033 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:34:17.033 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc748154d90] 2024-09-12T17:34:17.034 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:34:17.034 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:34:17.034 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:17.034 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:34:16.905+0000 7fc745a149c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:34:17.034 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fc745a149c0 thread_name:radosgw-admin 2024-09-12T17:34:17.034 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:17.034 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:17.034 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc74816d520] 2024-09-12T17:34:17.034 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:34:17.034 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:34:17.034 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:34:17.034 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc7492ee345] 2024-09-12T17:34:17.034 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc7492ee49f] 2024-09-12T17:34:17.035 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5569389e00c1] 2024-09-12T17:34:17.035 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x140f6b8) [0x5569394356b8] 2024-09-12T17:34:17.035 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5569389f218d] 2024-09-12T17:34:17.035 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:34:17.035 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc748154d90] 2024-09-12T17:34:17.035 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:34:17.035 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:34:17.035 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:34:17.035 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:17.035 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:34:17.035 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:34:17.035 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:34:17.035 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:34:17.036 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:34:17.036 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:34:17.036 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:34:17.036 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:34:17.036 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:34:17.036 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:34:17.036 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:34:17.036 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:34:17.036 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:34:17.036 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:34:17.036 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:34:17.036 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:34:17.036 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:34:17.036 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:34:17.037 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:34:17.037 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:34:17.037 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:34:17.037 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:34:17.037 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:34:17.037 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:34:17.037 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:34:17.037 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:34:17.037 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:34:17.037 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:34:17.037 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:34:17.037 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:34:17.037 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:34:17.037 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:34:17.038 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:34:17.038 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:34:17.038 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:34:17.038 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:34:17.038 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:34:17.038 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:34:17.038 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:34:17.038 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:34:17.038 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:34:17.038 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:34:17.038 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:34:17.038 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:34:17.038 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:34:17.038 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:34:17.038 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:34:17.038 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:34:17.039 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:34:17.039 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:34:17.039 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:34:17.039 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:34:17.039 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:34:17.039 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:34:17.039 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:34:17.039 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:34:17.039 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:34:17.039 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:34:17.039 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:34:17.039 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:34:17.039 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:34:17.039 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:34:17.039 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:34:17.040 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:34:17.040 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:34:17.040 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:34:17.040 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:34:17.040 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:34:17.040 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:34:17.040 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:34:17.040 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:34:17.040 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:34:17.040 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:34:17.040 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:34:17.040 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:34:17.040 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:34:17.040 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:34:17.041 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:34:17.041 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:34:17.041 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:34:17.041 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:34:17.041 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:34:17.041 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:34:17.041 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:34:17.041 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:34:17.041 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:34:17.041 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:34:17.041 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:34:17.041 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:34:17.041 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:34:17.041 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:34:17.042 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:34:17.042 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:34:17.042 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:34:17.042 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc5727fc640 / http_manager 2024-09-12T17:34:17.042 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc5f8fe1640 / http_manager 2024-09-12T17:34:17.042 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc5f9fe3640 / rgw_dt_lg_renew 2024-09-12T17:34:17.042 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc6257fa640 / ms_dispatch 2024-09-12T17:34:17.042 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc626ffd640 / io_context_pool 2024-09-12T17:34:17.042 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc62d602640 / ms_dispatch 2024-09-12T17:34:17.042 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc62fe07640 / ms_dispatch 2024-09-12T17:34:17.042 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc63160a640 / io_context_pool 2024-09-12T17:34:17.042 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc742d19640 / msgr-worker-2 2024-09-12T17:34:17.042 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc74351a640 / msgr-worker-1 2024-09-12T17:34:17.043 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc743d1b640 / msgr-worker-0 2024-09-12T17:34:17.043 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc74451c640 / io_context_pool 2024-09-12T17:34:17.043 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc745a149c0 / radosgw-admin 2024-09-12T17:34:17.043 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:34:17.043 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:34:17.043 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:34:16.912867Z_307e3495-0086-4968-ba68-29d33a68b3c2/log 2024-09-12T17:34:17.043 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:34:17.043 INFO:tasks.workunit.client.0.smithi119.stderr:Aborted 2024-09-12T17:34:17.043 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:34:17.045 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:17.045 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:17.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.989+0000 7f28788ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.993+0000 7f28788ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.993+0000 7f28788ca9c0 20 realm 2024-09-12T17:34:17.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.993+0000 7f28788ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.993+0000 7f28788ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.993+0000 7f28788ca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:17.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.993+0000 7f28788ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.993+0000 7f28788ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.993+0000 7f28788ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.993+0000 7f28788ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:17.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.993+0000 7f28788ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.993+0000 7f28788ca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:17.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.993+0000 7f28788ca9c0 20 searching for the correct realm 2024-09-12T17:34:17.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:16.997+0000 7f2876bd1640 0 -- 172.21.15.119:0/870737000 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55da84407d90 msgr2=0x55da8440a180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:17.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.005+0000 7f2875bcf640 0 -- 172.21.15.119:0/870737000 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f2870039070 msgr2=0x7f2870096970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:17.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.221+0000 7f28788ca9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:17.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.221+0000 7f28788ca9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:17.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.221+0000 7f28788ca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:17.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.221+0000 7f28788ca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:17.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.221+0000 7f28788ca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:17.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.221+0000 7f28788ca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:17.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.221+0000 7f28788ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.221+0000 7f28788ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.221+0000 7f28788ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:17.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:17.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 20 zone default found 2024-09-12T17:34:17.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 4 Realm: () 2024-09-12T17:34:17.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:17.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:17.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:17.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 20 zonegroup default 2024-09-12T17:34:17.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 20 started sync module instance, tier type = 2024-09-12T17:34:17.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.225+0000 7f28788ca9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:17.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.253+0000 7f28788ca9c0 20 add_watcher() i=0 2024-09-12T17:34:17.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.253+0000 7f28788ca9c0 20 add_watcher() i=1 2024-09-12T17:34:17.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.253+0000 7f28788ca9c0 20 add_watcher() i=2 2024-09-12T17:34:17.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.253+0000 7f28788ca9c0 20 add_watcher() i=3 2024-09-12T17:34:17.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.253+0000 7f28788ca9c0 20 add_watcher() i=4 2024-09-12T17:34:17.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.253+0000 7f28788ca9c0 20 add_watcher() i=5 2024-09-12T17:34:17.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.253+0000 7f28788ca9c0 20 add_watcher() i=6 2024-09-12T17:34:17.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.253+0000 7f28788ca9c0 20 add_watcher() i=7 2024-09-12T17:34:17.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.253+0000 7f28788ca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:17.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.257+0000 7f272cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:17.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.257+0000 7f28788ca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:17.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.261+0000 7f28788ca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:17.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.261+0000 7f28788ca9c0 5 note: GC not initialized 2024-09-12T17:34:17.259 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.261+0000 7f26a77fe640 20 reqs_thread_entry: start 2024-09-12T17:34:17.259 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.261+0000 7f28788ca9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:17.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.261+0000 7f28788ca9c0 20 Filter name: none 2024-09-12T17:34:17.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.261+0000 7f26a57fa640 20 reqs_thread_entry: start 2024-09-12T17:34:17.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.261+0000 7f28788ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.261+0000 7f28788ca9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:17.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.261+0000 7f28788ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.265+0000 7f28788ca9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:17.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.265+0000 7f28788ca9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:17.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.265+0000 7f28788ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.263 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.265+0000 7f28788ca9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:17.263 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.265+0000 7f28788ca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.265+0000 7f28788ca9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:17.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.265+0000 7f28788ca9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:17.267 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.269+0000 7f272cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:17.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.273+0000 7f28788ca9c0 20 remove_watcher() i=0 2024-09-12T17:34:17.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.273+0000 7f28788ca9c0 2 removed watcher, disabling cache 2024-09-12T17:34:17.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.277+0000 7f28788ca9c0 20 remove_watcher() i=1 2024-09-12T17:34:17.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.277+0000 7f28788ca9c0 20 remove_watcher() i=2 2024-09-12T17:34:17.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.281+0000 7f28788ca9c0 20 remove_watcher() i=3 2024-09-12T17:34:17.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.281+0000 7f28788ca9c0 20 remove_watcher() i=4 2024-09-12T17:34:17.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.285+0000 7f28788ca9c0 20 remove_watcher() i=5 2024-09-12T17:34:17.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.285+0000 7f28788ca9c0 20 remove_watcher() i=6 2024-09-12T17:34:17.286 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.289+0000 7f28788ca9c0 20 remove_watcher() i=7 2024-09-12T17:34:17.301 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:17.301 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:34:17.301 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-set-target-layout id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:34:17.301 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:17.416 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:34:17.452 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:17.452 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:17.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.497+0000 7f9df17f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.501+0000 7f9df17f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.501+0000 7f9df17f99c0 20 realm 2024-09-12T17:34:17.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.501+0000 7f9df17f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.501+0000 7f9df17f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.501+0000 7f9df17f99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:17.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.501+0000 7f9df17f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.501+0000 7f9df17f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.501+0000 7f9df17f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.501+0000 7f9df17f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:17.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.501+0000 7f9df17f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.505+0000 7f9df17f99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:17.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.505+0000 7f9df17f99c0 20 searching for the correct realm 2024-09-12T17:34:17.506 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.505+0000 7f9defb00640 0 -- 172.21.15.119:0/684038960 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f9de4008050 msgr2=0x7f9de405be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:17.721 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.721+0000 7f9deeafe640 0 -- 172.21.15.119:0/684038960 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f9de006d1e0 msgr2=0x7f9de0092870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:17.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.937+0000 7f9df17f99c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:17.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.937+0000 7f9df17f99c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:17.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.937+0000 7f9df17f99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:17.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.937+0000 7f9df17f99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:17.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.937+0000 7f9df17f99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:17.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.937+0000 7f9df17f99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:17.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.937+0000 7f9df17f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.941+0000 7f9df17f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.941+0000 7f9df17f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.941+0000 7f9df17f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:17.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.941+0000 7f9df17f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.941+0000 7f9df17f99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:17.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.941+0000 7f9df17f99c0 20 zone default found 2024-09-12T17:34:17.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.941+0000 7f9df17f99c0 4 Realm: () 2024-09-12T17:34:17.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.941+0000 7f9df17f99c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:17.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.941+0000 7f9df17f99c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:17.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.941+0000 7f9df17f99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:17.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.941+0000 7f9df17f99c0 20 zonegroup default 2024-09-12T17:34:17.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.941+0000 7f9df17f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.941+0000 7f9df17f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.942 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.941+0000 7f9df17f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.942 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.941+0000 7f9df17f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.942 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.941+0000 7f9df17f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.942 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.945+0000 7f9df17f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:17.942 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.945+0000 7f9df17f99c0 20 started sync module instance, tier type = 2024-09-12T17:34:17.942 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.945+0000 7f9df17f99c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:17.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.965+0000 7f9df17f99c0 20 add_watcher() i=0 2024-09-12T17:34:17.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.965+0000 7f9df17f99c0 20 add_watcher() i=1 2024-09-12T17:34:17.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.965+0000 7f9df17f99c0 20 add_watcher() i=2 2024-09-12T17:34:17.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.965+0000 7f9df17f99c0 20 add_watcher() i=3 2024-09-12T17:34:17.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.965+0000 7f9df17f99c0 20 add_watcher() i=4 2024-09-12T17:34:17.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.965+0000 7f9df17f99c0 20 add_watcher() i=5 2024-09-12T17:34:17.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.965+0000 7f9df17f99c0 20 add_watcher() i=6 2024-09-12T17:34:17.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.965+0000 7f9df17f99c0 20 add_watcher() i=7 2024-09-12T17:34:17.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.965+0000 7f9df17f99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:17.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.969+0000 7f9ca5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:17.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.969+0000 7f9df17f99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:17.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.969+0000 7f9df17f99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:17.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.969+0000 7f9df17f99c0 5 note: GC not initialized 2024-09-12T17:34:17.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.969+0000 7f9ca4fe1640 20 reqs_thread_entry: start 2024-09-12T17:34:17.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.973+0000 7f9df17f99c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:17.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.973+0000 7f9df17f99c0 20 Filter name: none 2024-09-12T17:34:17.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.973+0000 7f9c1e7fc640 20 reqs_thread_entry: start 2024-09-12T17:34:17.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.973+0000 7f9df17f99c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:34:17.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.973+0000 7f9df17f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.973+0000 7f9df17f99c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:17.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.973+0000 7f9df17f99c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:34:17.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.973+0000 7f9df17f99c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:34:17.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.973+0000 7f9df17f99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 : miss 2024-09-12T17:34:17.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.973+0000 7f9df17f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:17.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.973+0000 7f9df17f99c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:17.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.973+0000 7f9df17f99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 info.flags=0x17 2024-09-12T17:34:17.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.973+0000 7f9df17f99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 to cache LRU end 2024-09-12T17:34:17.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.973+0000 7f9df17f99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:17.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.973+0000 7f9df17f99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:17.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.973+0000 7f9df17f99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 2024-09-12T17:34:17.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.977+0000 7f9df17f99c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 to be held by another RGW process; skipping for now 2024-09-12T17:34:17.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.977+0000 7f9ca5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:17.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.981+0000 7f9df17f99c0 20 remove_watcher() i=0 2024-09-12T17:34:17.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.981+0000 7f9df17f99c0 2 removed watcher, disabling cache 2024-09-12T17:34:17.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.985+0000 7f9df17f99c0 20 remove_watcher() i=1 2024-09-12T17:34:17.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.985+0000 7f9df17f99c0 20 remove_watcher() i=2 2024-09-12T17:34:17.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.989+0000 7f9df17f99c0 20 remove_watcher() i=3 2024-09-12T17:34:17.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.989+0000 7f9df17f99c0 20 remove_watcher() i=4 2024-09-12T17:34:17.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.993+0000 7f9df17f99c0 20 remove_watcher() i=5 2024-09-12T17:34:17.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.993+0000 7f9df17f99c0 20 remove_watcher() i=6 2024-09-12T17:34:17.994 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:17.993+0000 7f9df17f99c0 20 remove_watcher() i=7 2024-09-12T17:34:18.009 INFO:tasks.workunit.client.0.smithi119.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:34:48.039 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:34:48.075 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:48.076 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:48.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.128+0000 7f79faabe9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.128+0000 7f79faabe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:48.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.128+0000 7f79faabe9c0 20 realm 2024-09-12T17:34:48.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.128+0000 7f79faabe9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.128+0000 7f79faabe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:48.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.128+0000 7f79faabe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:48.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.128+0000 7f79faabe9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.128+0000 7f79faabe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:48.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.128+0000 7f79faabe9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.126 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.132+0000 7f79faabe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:48.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.132+0000 7f79faabe9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.132+0000 7f79faabe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:48.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.132+0000 7f79faabe9c0 20 searching for the correct realm 2024-09-12T17:34:48.132 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.136+0000 7f79f8dc5640 0 -- 172.21.15.119:0/2001441611 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55cd6e866ce0 msgr2=0x55cd6e8690d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:48.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.140+0000 7f79f7dc3640 0 -- 172.21.15.119:0/2001441611 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f79f006e0d0 msgr2=0x7f79f00636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:48.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.356+0000 7f79faabe9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:48.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.356+0000 7f79faabe9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:48.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.356+0000 7f79faabe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:48.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.356+0000 7f79faabe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:48.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.356+0000 7f79faabe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:48.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.356+0000 7f79faabe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:48.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.356+0000 7f79faabe9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.360+0000 7f79faabe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:48.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.360+0000 7f79faabe9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.360+0000 7f79faabe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:48.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.360+0000 7f79faabe9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.360+0000 7f79faabe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:48.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.360+0000 7f79faabe9c0 20 zone default found 2024-09-12T17:34:48.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.360+0000 7f79faabe9c0 4 Realm: () 2024-09-12T17:34:48.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.360+0000 7f79faabe9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:48.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.360+0000 7f79faabe9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:48.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.360+0000 7f79faabe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:48.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.360+0000 7f79faabe9c0 20 zonegroup default 2024-09-12T17:34:48.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.360+0000 7f79faabe9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.360+0000 7f79faabe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:48.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.360+0000 7f79faabe9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.360+0000 7f79faabe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:48.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.360+0000 7f79faabe9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.364+0000 7f79faabe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:48.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.364+0000 7f79faabe9c0 20 started sync module instance, tier type = 2024-09-12T17:34:48.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.364+0000 7f79faabe9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:48.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.388+0000 7f79faabe9c0 20 add_watcher() i=0 2024-09-12T17:34:48.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.388+0000 7f79faabe9c0 20 add_watcher() i=1 2024-09-12T17:34:48.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.388+0000 7f79faabe9c0 20 add_watcher() i=2 2024-09-12T17:34:48.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.388+0000 7f79faabe9c0 20 add_watcher() i=3 2024-09-12T17:34:48.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.388+0000 7f79faabe9c0 20 add_watcher() i=4 2024-09-12T17:34:48.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.388+0000 7f79faabe9c0 20 add_watcher() i=5 2024-09-12T17:34:48.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.388+0000 7f79faabe9c0 20 add_watcher() i=6 2024-09-12T17:34:48.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.388+0000 7f79faabe9c0 20 add_watcher() i=7 2024-09-12T17:34:48.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.388+0000 7f79faabe9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:48.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.392+0000 7f78ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:48.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:48.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:48.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 5 note: GC not initialized 2024-09-12T17:34:48.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f78ad7e2640 20 reqs_thread_entry: start 2024-09-12T17:34:48.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:48.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 20 Filter name: none 2024-09-12T17:34:48.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f781effd640 20 reqs_thread_entry: start 2024-09-12T17:34:48.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:34:48.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:48.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:34:48.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:34:48.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 : miss 2024-09-12T17:34:48.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:48.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 info.flags=0x17 2024-09-12T17:34:48.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 to cache LRU end 2024-09-12T17:34:48.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:48.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:48.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.396+0000 7f79faabe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 2024-09-12T17:34:48.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.408+0000 7f79faabe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 info.flags=0x17 2024-09-12T17:34:48.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.408+0000 7f79faabe9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 to cache LRU end 2024-09-12T17:34:48.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.408+0000 7f79faabe9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:48.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.408+0000 7f79faabe9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25, ofs0, ns] 2024-09-12T17:34:48.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.408+0000 7f78ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333476 cookie 94340811003536 notifier 6735 bl.length()=1009 2024-09-12T17:34:48.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.408+0000 7f78ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 info.flags=0x17 2024-09-12T17:34:48.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.408+0000 7f78ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 to cache LRU end 2024-09-12T17:34:48.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.408+0000 7f78ceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:48.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.408+0000 7f79faabe9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25]): orig_sources= new_sources= 2024-09-12T17:34:48.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.408+0000 7f79faabe9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25]): potential sources added=[] removed=[] 2024-09-12T17:34:48.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.408+0000 7f79faabe9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25]): orig_dests= new_dests= 2024-09-12T17:34:48.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.408+0000 7f79faabe9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25]): potential dests added=[] removed=[] 2024-09-12T17:34:48.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.0 2024-09-12T17:34:48.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.0 2024-09-12T17:34:48.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.1 2024-09-12T17:34:48.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.1 2024-09-12T17:34:48.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.2 2024-09-12T17:34:48.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.2 2024-09-12T17:34:48.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.3 2024-09-12T17:34:48.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.3 2024-09-12T17:34:48.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.4 2024-09-12T17:34:48.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.4 2024-09-12T17:34:48.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.5 2024-09-12T17:34:48.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.5 2024-09-12T17:34:48.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.6 2024-09-12T17:34:48.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.6 2024-09-12T17:34:48.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.7 2024-09-12T17:34:48.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.7 2024-09-12T17:34:48.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.8 2024-09-12T17:34:48.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.8 2024-09-12T17:34:48.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.9 2024-09-12T17:34:48.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.9 2024-09-12T17:34:48.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.10 2024-09-12T17:34:48.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.10 2024-09-12T17:34:48.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.11 2024-09-12T17:34:48.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1.11 2024-09-12T17:34:48.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.0 2024-09-12T17:34:48.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1 2024-09-12T17:34:48.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.420+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.2 2024-09-12T17:34:48.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.424+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.3 2024-09-12T17:34:48.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.424+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.4 2024-09-12T17:34:48.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.424+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.5 2024-09-12T17:34:48.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.424+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.6 2024-09-12T17:34:48.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.428+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.7 2024-09-12T17:34:48.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.428+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.8 2024-09-12T17:34:48.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.428+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.9 2024-09-12T17:34:48.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.432+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.10 2024-09-12T17:34:48.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.440+0000 7f79faabe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:48.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.440+0000 7f79faabe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 2024-09-12T17:34:48.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.440+0000 7f79faabe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 info.flags=0x17 2024-09-12T17:34:48.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.440+0000 7f79faabe9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 to cache LRU end 2024-09-12T17:34:48.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.440+0000 7f79faabe9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:48.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.440+0000 7f79faabe9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25, ofs0, ns] 2024-09-12T17:34:48.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.440+0000 7f78ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333477 cookie 94340811003536 notifier 6735 bl.length()=1009 2024-09-12T17:34:48.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.440+0000 7f78ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 info.flags=0x17 2024-09-12T17:34:48.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.440+0000 7f78ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 to cache LRU end 2024-09-12T17:34:48.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.440+0000 7f78ceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:48.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.444+0000 7f79faabe9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25]): orig_sources= new_sources= 2024-09-12T17:34:48.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.444+0000 7f79faabe9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25]): potential sources added=[] removed=[] 2024-09-12T17:34:48.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.444+0000 7f79faabe9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25]): orig_dests= new_dests= 2024-09-12T17:34:48.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.444+0000 7f79faabe9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25]): potential dests added=[] removed=[] 2024-09-12T17:34:48.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.448+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.0 2024-09-12T17:34:48.445 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.448+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.1 2024-09-12T17:34:48.446 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.448+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.2 2024-09-12T17:34:48.446 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.452+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.3 2024-09-12T17:34:48.447 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.452+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.4 2024-09-12T17:34:48.448 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.452+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.5 2024-09-12T17:34:48.448 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.452+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.6 2024-09-12T17:34:48.449 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.452+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.7 2024-09-12T17:34:48.450 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.452+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.8 2024-09-12T17:34:48.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.456+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.9 2024-09-12T17:34:48.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.456+0000 7f79faabe9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25.10 2024-09-12T17:34:48.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.456+0000 7f79faabe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:48.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.456+0000 7f79faabe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 2024-09-12T17:34:48.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.460+0000 7f79faabe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 info.flags=0x17 2024-09-12T17:34:48.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.460+0000 7f79faabe9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 to cache LRU end 2024-09-12T17:34:48.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.460+0000 7f79faabe9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:48.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.460+0000 7f79faabe9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25, ofs0, ns] 2024-09-12T17:34:48.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.460+0000 7f78cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333478 cookie 94340811003536 notifier 6735 bl.length()=977 2024-09-12T17:34:48.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.460+0000 7f78cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 info.flags=0x17 2024-09-12T17:34:48.456 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.460+0000 7f78cf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 to cache LRU end 2024-09-12T17:34:48.456 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.460+0000 7f78cf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:48.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.460+0000 7f79faabe9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25]): orig_sources= new_sources= 2024-09-12T17:34:48.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.460+0000 7f79faabe9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25]): potential sources added=[] removed=[] 2024-09-12T17:34:48.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.460+0000 7f79faabe9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25]): orig_dests= new_dests= 2024-09-12T17:34:48.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.460+0000 7f79faabe9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25]): potential dests added=[] removed=[] 2024-09-12T17:34:48.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.464+0000 7f79faabe9c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:34:48.466 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.468+0000 7f78ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:48.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.476+0000 7f79faabe9c0 20 remove_watcher() i=0 2024-09-12T17:34:48.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.476+0000 7f79faabe9c0 2 removed watcher, disabling cache 2024-09-12T17:34:48.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.476+0000 7f79faabe9c0 20 remove_watcher() i=1 2024-09-12T17:34:48.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.480+0000 7f79faabe9c0 20 remove_watcher() i=2 2024-09-12T17:34:48.478 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.480+0000 7f79faabe9c0 20 remove_watcher() i=3 2024-09-12T17:34:48.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.484+0000 7f79faabe9c0 20 remove_watcher() i=4 2024-09-12T17:34:48.481 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.484+0000 7f79faabe9c0 20 remove_watcher() i=5 2024-09-12T17:34:48.483 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.488+0000 7f79faabe9c0 20 remove_watcher() i=6 2024-09-12T17:34:48.484 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.488+0000 7f79faabe9c0 20 remove_watcher() i=7 2024-09-12T17:34:48.500 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:34:48.531 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:48.531 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:48.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.580+0000 7f12b3be49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.580+0000 7f12b3be49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:48.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.580+0000 7f12b3be49c0 20 realm 2024-09-12T17:34:48.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.580+0000 7f12b3be49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.580+0000 7f12b3be49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:48.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.580+0000 7f12b3be49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:48.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.580+0000 7f12b3be49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.584+0000 7f12b3be49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:48.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.584+0000 7f12b3be49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.584+0000 7f12b3be49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:48.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.584+0000 7f12b3be49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.584+0000 7f12b3be49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:48.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.584+0000 7f12b3be49c0 20 searching for the correct realm 2024-09-12T17:34:48.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.588+0000 7f12b1eeb640 0 -- 172.21.15.119:0/2544526488 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f129c008050 msgr2=0x7f129c092410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:48.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.596+0000 7f12b0ee9640 0 -- 172.21.15.119:0/2544526488 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f12ac01e420 msgr2=0x7f12ac01e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:48.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.812+0000 7f12b3be49c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:48.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.812+0000 7f12b3be49c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:48.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.812+0000 7f12b3be49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:48.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.812+0000 7f12b3be49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:48.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.812+0000 7f12b3be49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:48.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.812+0000 7f12b3be49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:48.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.812+0000 7f12b3be49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.812+0000 7f12b3be49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:48.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.812+0000 7f12b3be49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.816+0000 7f12b3be49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:48.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.816+0000 7f12b3be49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.816+0000 7f12b3be49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:48.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.816+0000 7f12b3be49c0 20 zone default found 2024-09-12T17:34:48.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.816+0000 7f12b3be49c0 4 Realm: () 2024-09-12T17:34:48.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.816+0000 7f12b3be49c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:48.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.816+0000 7f12b3be49c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:48.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.816+0000 7f12b3be49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:48.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.816+0000 7f12b3be49c0 20 zonegroup default 2024-09-12T17:34:48.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.816+0000 7f12b3be49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.816+0000 7f12b3be49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:48.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.816+0000 7f12b3be49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.816+0000 7f12b3be49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:48.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.816+0000 7f12b3be49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.820+0000 7f12b3be49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:48.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.820+0000 7f12b3be49c0 20 started sync module instance, tier type = 2024-09-12T17:34:48.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.820+0000 7f12b3be49c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:48.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.844+0000 7f12b3be49c0 20 add_watcher() i=0 2024-09-12T17:34:48.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.844+0000 7f12b3be49c0 20 add_watcher() i=1 2024-09-12T17:34:48.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.844+0000 7f12b3be49c0 20 add_watcher() i=2 2024-09-12T17:34:48.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.844+0000 7f12b3be49c0 20 add_watcher() i=3 2024-09-12T17:34:48.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.844+0000 7f12b3be49c0 20 add_watcher() i=4 2024-09-12T17:34:48.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.844+0000 7f12b3be49c0 20 add_watcher() i=5 2024-09-12T17:34:48.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.844+0000 7f12b3be49c0 20 add_watcher() i=6 2024-09-12T17:34:48.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.844+0000 7f12b3be49c0 20 add_watcher() i=7 2024-09-12T17:34:48.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.844+0000 7f12b3be49c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:48.850 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.852+0000 7f11677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:48.850 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.856+0000 7f12b3be49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:48.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.856+0000 7f12b3be49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:48.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.856+0000 7f12b3be49c0 5 note: GC not initialized 2024-09-12T17:34:48.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.856+0000 7f11667e4640 20 reqs_thread_entry: start 2024-09-12T17:34:48.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.856+0000 7f12b3be49c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:48.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.856+0000 7f12b3be49c0 20 Filter name: none 2024-09-12T17:34:48.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.856+0000 7f10d7fff640 20 reqs_thread_entry: start 2024-09-12T17:34:48.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.856+0000 7f12b3be49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.856+0000 7f12b3be49c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:48.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.856+0000 7f12b3be49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.856+0000 7f12b3be49c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:48.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.856+0000 7f12b3be49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:48.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.856+0000 7f12b3be49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.856 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.860+0000 7f12b3be49c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:34:48.856 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.860+0000 7f12b3be49c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:48.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.860+0000 7f12b3be49c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:34:48.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.860+0000 7f12b3be49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:48.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.864+0000 7f11677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:48.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.868+0000 7f12b3be49c0 20 remove_watcher() i=0 2024-09-12T17:34:48.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.868+0000 7f12b3be49c0 2 removed watcher, disabling cache 2024-09-12T17:34:48.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.872+0000 7f12b3be49c0 20 remove_watcher() i=1 2024-09-12T17:34:48.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.872+0000 7f12b3be49c0 20 remove_watcher() i=2 2024-09-12T17:34:48.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.876+0000 7f12b3be49c0 20 remove_watcher() i=3 2024-09-12T17:34:48.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.876+0000 7f12b3be49c0 20 remove_watcher() i=4 2024-09-12T17:34:48.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.880+0000 7f12b3be49c0 20 remove_watcher() i=5 2024-09-12T17:34:48.876 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.880+0000 7f12b3be49c0 20 remove_watcher() i=6 2024-09-12T17:34:48.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:48.880+0000 7f12b3be49c0 20 remove_watcher() i=7 2024-09-12T17:34:48.893 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:48.893 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:34:48.893 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-set-target-layout id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:34:48.893 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:49.822 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T17:34:49.822 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:52.005 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:34:52.037 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:52.037 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:52.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.088+0000 7f1abc1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.088+0000 7f1abc1709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:52.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.088+0000 7f1abc1709c0 20 realm 2024-09-12T17:34:52.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.088+0000 7f1abc1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.088+0000 7f1abc1709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:52.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.088+0000 7f1abc1709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:52.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.088+0000 7f1abc1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.088+0000 7f1abc1709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:52.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.088+0000 7f1abc1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.092+0000 7f1abc1709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:52.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.092+0000 7f1abc1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.092+0000 7f1abc1709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:52.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.092+0000 7f1abc1709c0 20 searching for the correct realm 2024-09-12T17:34:52.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.096+0000 7f1aba477640 0 -- 172.21.15.119:0/589635079 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55b19e85c5c0 msgr2=0x55b19e85e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:52.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.104+0000 7f1ab9475640 0 -- 172.21.15.119:0/589635079 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f1ab40677f0 msgr2=0x7f1ab4093a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:52.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.320+0000 7f1abc1709c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:52.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.320+0000 7f1abc1709c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:52.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.320+0000 7f1abc1709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:52.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.320+0000 7f1abc1709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:52.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.320+0000 7f1abc1709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:52.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.320+0000 7f1abc1709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:52.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.320+0000 7f1abc1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.324+0000 7f1abc1709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:52.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.324+0000 7f1abc1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.324+0000 7f1abc1709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:52.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.324+0000 7f1abc1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.324+0000 7f1abc1709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:52.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.324+0000 7f1abc1709c0 20 zone default found 2024-09-12T17:34:52.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.324+0000 7f1abc1709c0 4 Realm: () 2024-09-12T17:34:52.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.324+0000 7f1abc1709c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:52.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.324+0000 7f1abc1709c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:52.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.324+0000 7f1abc1709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:52.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.324+0000 7f1abc1709c0 20 zonegroup default 2024-09-12T17:34:52.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.324+0000 7f1abc1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.324+0000 7f1abc1709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:52.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.324+0000 7f1abc1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.328+0000 7f1abc1709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:52.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.328+0000 7f1abc1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.328+0000 7f1abc1709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:52.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.328+0000 7f1abc1709c0 20 started sync module instance, tier type = 2024-09-12T17:34:52.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.328+0000 7f1abc1709c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:52.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.348+0000 7f1abc1709c0 20 add_watcher() i=0 2024-09-12T17:34:52.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.348+0000 7f1abc1709c0 20 add_watcher() i=1 2024-09-12T17:34:52.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.348+0000 7f1abc1709c0 20 add_watcher() i=2 2024-09-12T17:34:52.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.348+0000 7f1abc1709c0 20 add_watcher() i=3 2024-09-12T17:34:52.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.348+0000 7f1abc1709c0 20 add_watcher() i=4 2024-09-12T17:34:52.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.348+0000 7f1abc1709c0 20 add_watcher() i=5 2024-09-12T17:34:52.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.348+0000 7f1abc1709c0 20 add_watcher() i=6 2024-09-12T17:34:52.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.352+0000 7f1abc1709c0 20 add_watcher() i=7 2024-09-12T17:34:52.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.352+0000 7f1abc1709c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:52.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.356+0000 7f196b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:52.353 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.356+0000 7f1abc1709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:52.353 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.356+0000 7f1abc1709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:52.353 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.356+0000 7f1abc1709c0 5 note: GC not initialized 2024-09-12T17:34:52.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.356+0000 7f196a7fc640 20 reqs_thread_entry: start 2024-09-12T17:34:52.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.356+0000 7f1abc1709c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:52.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.356+0000 7f1abc1709c0 20 Filter name: none 2024-09-12T17:34:52.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.356+0000 7f18dbfff640 20 reqs_thread_entry: start 2024-09-12T17:34:52.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.356+0000 7f1abc1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.360+0000 7f1abc1709c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:34:52.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.360+0000 7f1abc1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.360+0000 7f1abc1709c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:34:52.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.360+0000 7f1abc1709c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:52.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.360+0000 7f1abc1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.360+0000 7f1abc1709c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:34:52.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.360+0000 7f1abc1709c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.360+0000 7f1abc1709c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:34:52.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.360+0000 7f1abc1709c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:52.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.364+0000 7f196b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:52.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.368+0000 7f1abc1709c0 20 remove_watcher() i=0 2024-09-12T17:34:52.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.368+0000 7f1abc1709c0 2 removed watcher, disabling cache 2024-09-12T17:34:52.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.372+0000 7f1abc1709c0 20 remove_watcher() i=1 2024-09-12T17:34:52.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.372+0000 7f1abc1709c0 20 remove_watcher() i=2 2024-09-12T17:34:52.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.376+0000 7f1abc1709c0 20 remove_watcher() i=3 2024-09-12T17:34:52.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.376+0000 7f1abc1709c0 20 remove_watcher() i=4 2024-09-12T17:34:52.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.380+0000 7f1abc1709c0 20 remove_watcher() i=5 2024-09-12T17:34:52.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.380+0000 7f1abc1709c0 20 remove_watcher() i=6 2024-09-12T17:34:52.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.384+0000 7f1abc1709c0 20 remove_watcher() i=7 2024-09-12T17:34:52.393 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:52.393 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:34:52.393 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-trim-reshard-log-entries id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:34:52.393 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:52.394 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T17:34:52.427 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:52.427 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:52.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.476+0000 7f37603ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.475 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.480+0000 7f37603ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:52.475 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.480+0000 7f37603ba9c0 20 realm 2024-09-12T17:34:52.475 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.480+0000 7f37603ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.475 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.480+0000 7f37603ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:52.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.480+0000 7f37603ba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:52.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.480+0000 7f37603ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.480+0000 7f37603ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:52.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.480+0000 7f37603ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.477 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.480+0000 7f37603ba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:52.477 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.480+0000 7f37603ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.479 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.480+0000 7f37603ba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:52.479 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.480+0000 7f37603ba9c0 20 searching for the correct realm 2024-09-12T17:34:52.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.484+0000 7f375d6bf640 0 -- 172.21.15.119:0/539381127 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f375001d040 msgr2=0x7f375001d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:52.695 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.700+0000 7f375e6c1640 0 -- 172.21.15.119:0/539381127 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f375404e070 msgr2=0x7f3754043950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:52.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.920+0000 7f37603ba9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:52.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.920+0000 7f37603ba9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:52.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.920+0000 7f37603ba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:52.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.920+0000 7f37603ba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:52.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.920+0000 7f37603ba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:52.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.920+0000 7f37603ba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:52.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.920+0000 7f37603ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.924+0000 7f37603ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:52.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.924+0000 7f37603ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.924+0000 7f37603ba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:52.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.924+0000 7f37603ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.924+0000 7f37603ba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:52.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.924+0000 7f37603ba9c0 20 zone default found 2024-09-12T17:34:52.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.924+0000 7f37603ba9c0 4 Realm: () 2024-09-12T17:34:52.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.924+0000 7f37603ba9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:52.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.924+0000 7f37603ba9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:52.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.924+0000 7f37603ba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:52.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.924+0000 7f37603ba9c0 20 zonegroup default 2024-09-12T17:34:52.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.924+0000 7f37603ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.922 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.924+0000 7f37603ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:52.922 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.924+0000 7f37603ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.922 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.924+0000 7f37603ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:52.922 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.924+0000 7f37603ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.928+0000 7f37603ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:52.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.928+0000 7f37603ba9c0 20 started sync module instance, tier type = 2024-09-12T17:34:52.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.928+0000 7f37603ba9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:52.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.948+0000 7f37603ba9c0 20 add_watcher() i=0 2024-09-12T17:34:52.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.948+0000 7f37603ba9c0 20 add_watcher() i=1 2024-09-12T17:34:52.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.948+0000 7f37603ba9c0 20 add_watcher() i=2 2024-09-12T17:34:52.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.948+0000 7f37603ba9c0 20 add_watcher() i=3 2024-09-12T17:34:52.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.948+0000 7f37603ba9c0 20 add_watcher() i=4 2024-09-12T17:34:52.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.948+0000 7f37603ba9c0 20 add_watcher() i=5 2024-09-12T17:34:52.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.948+0000 7f37603ba9c0 20 add_watcher() i=6 2024-09-12T17:34:52.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.952+0000 7f37603ba9c0 20 add_watcher() i=7 2024-09-12T17:34:52.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.952+0000 7f37603ba9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:52.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.956+0000 7f360f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:52.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.956+0000 7f37603ba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:52.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.956+0000 7f37603ba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:52.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.956+0000 7f37603ba9c0 5 note: GC not initialized 2024-09-12T17:34:52.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.956+0000 7f360e7fc640 20 reqs_thread_entry: start 2024-09-12T17:34:52.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.956+0000 7f37603ba9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:52.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.956+0000 7f37603ba9c0 20 Filter name: none 2024-09-12T17:34:52.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.960+0000 7f357ffff640 20 reqs_thread_entry: start 2024-09-12T17:34:52.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.960+0000 7f37603ba9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:34:52.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.960+0000 7f37603ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.960+0000 7f37603ba9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:34:52.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.960+0000 7f37603ba9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:34:52.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.960+0000 7f37603ba9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:34:52.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.960+0000 7f37603ba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 : miss 2024-09-12T17:34:52.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.960+0000 7f37603ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:52.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.960+0000 7f37603ba9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:34:52.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.960+0000 7f37603ba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 info.flags=0x17 2024-09-12T17:34:52.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.960+0000 7f37603ba9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 to cache LRU end 2024-09-12T17:34:52.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.960+0000 7f37603ba9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:52.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.960+0000 7f37603ba9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:52.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.960+0000 7f37603ba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 2024-09-12T17:34:52.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.968+0000 7f37603ba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 info.flags=0x17 2024-09-12T17:34:52.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.968+0000 7f37603ba9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 to cache LRU end 2024-09-12T17:34:52.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.968+0000 7f37603ba9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:52.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.968+0000 7f37603ba9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26, ofs0, ns] 2024-09-12T17:34:52.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.968+0000 7f36417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333481 cookie 93869000498288 notifier 6792 bl.length()=1023 2024-09-12T17:34:52.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.968+0000 7f36417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 info.flags=0x17 2024-09-12T17:34:52.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.968+0000 7f36417fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 to cache LRU end 2024-09-12T17:34:52.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.968+0000 7f36417fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:52.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.972+0000 7f37603ba9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26]): orig_sources= new_sources= 2024-09-12T17:34:52.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.972+0000 7f37603ba9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26]): potential sources added=[] removed=[] 2024-09-12T17:34:52.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.972+0000 7f37603ba9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26]): orig_dests= new_dests= 2024-09-12T17:34:52.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.972+0000 7f37603ba9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26]): potential dests added=[] removed=[] 2024-09-12T17:34:52.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.972+0000 7f37603ba9c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T17:34:52.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.972+0000 7f37603ba9c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T17:34:52.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.976+0000 7f360f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:52.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.980+0000 7f37603ba9c0 20 remove_watcher() i=0 2024-09-12T17:34:52.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.980+0000 7f37603ba9c0 2 removed watcher, disabling cache 2024-09-12T17:34:52.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.984+0000 7f37603ba9c0 20 remove_watcher() i=1 2024-09-12T17:34:52.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.984+0000 7f37603ba9c0 20 remove_watcher() i=2 2024-09-12T17:34:52.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.988+0000 7f37603ba9c0 20 remove_watcher() i=3 2024-09-12T17:34:52.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.988+0000 7f37603ba9c0 20 remove_watcher() i=4 2024-09-12T17:34:52.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.988+0000 7f37603ba9c0 20 remove_watcher() i=5 2024-09-12T17:34:52.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.992+0000 7f37603ba9c0 20 remove_watcher() i=6 2024-09-12T17:34:52.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:52.992+0000 7f37603ba9c0 20 remove_watcher() i=7 2024-09-12T17:34:53.004 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:34:53.034 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:53.034 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:53.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.084+0000 7fee90d4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.084+0000 7fee90d4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:53.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.084+0000 7fee90d4a9c0 20 realm 2024-09-12T17:34:53.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.084+0000 7fee90d4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.084+0000 7fee90d4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:53.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.084+0000 7fee90d4a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:53.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.084+0000 7fee90d4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.084+0000 7fee90d4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:53.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.084+0000 7fee90d4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.088+0000 7fee90d4a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:53.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.088+0000 7fee90d4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.088+0000 7fee90d4a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:53.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.088+0000 7fee90d4a9c0 20 searching for the correct realm 2024-09-12T17:34:53.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.092+0000 7fee87fff640 0 -- 172.21.15.119:0/324100467 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fee80008050 msgr2=0x7fee8005bf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:53.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.100+0000 7fee87fff640 0 -- 172.21.15.119:0/324100467 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fee880fe6c0 msgr2=0x7fee880b79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:53.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.316+0000 7fee90d4a9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:53.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.316+0000 7fee90d4a9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:53.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.316+0000 7fee90d4a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:53.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.316+0000 7fee90d4a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:53.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.316+0000 7fee90d4a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:53.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.316+0000 7fee90d4a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:53.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.316+0000 7fee90d4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.316+0000 7fee90d4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:53.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.316+0000 7fee90d4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:53.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:53.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 20 zone default found 2024-09-12T17:34:53.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 4 Realm: () 2024-09-12T17:34:53.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:53.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:53.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:53.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 20 zonegroup default 2024-09-12T17:34:53.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:53.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:53.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:53.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 20 started sync module instance, tier type = 2024-09-12T17:34:53.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.320+0000 7fee90d4a9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:53.342 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.344+0000 7fee90d4a9c0 20 add_watcher() i=0 2024-09-12T17:34:53.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.344+0000 7fee90d4a9c0 20 add_watcher() i=1 2024-09-12T17:34:53.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.344+0000 7fee90d4a9c0 20 add_watcher() i=2 2024-09-12T17:34:53.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.344+0000 7fee90d4a9c0 20 add_watcher() i=3 2024-09-12T17:34:53.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.344+0000 7fee90d4a9c0 20 add_watcher() i=4 2024-09-12T17:34:53.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.344+0000 7fee90d4a9c0 20 add_watcher() i=5 2024-09-12T17:34:53.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.348+0000 7fee90d4a9c0 20 add_watcher() i=6 2024-09-12T17:34:53.345 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.348+0000 7fee90d4a9c0 20 add_watcher() i=7 2024-09-12T17:34:53.345 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.348+0000 7fee90d4a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:53.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.352+0000 7fed457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:53.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.352+0000 7fee90d4a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:53.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.352+0000 7fee90d4a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:53.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.352+0000 7fee90d4a9c0 5 note: GC not initialized 2024-09-12T17:34:53.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.356+0000 7fecbffff640 20 reqs_thread_entry: start 2024-09-12T17:34:53.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.356+0000 7fee90d4a9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:53.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.356+0000 7fee90d4a9c0 20 Filter name: none 2024-09-12T17:34:53.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.356+0000 7fecbdffb640 20 reqs_thread_entry: start 2024-09-12T17:34:53.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.356+0000 7fee90d4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.356+0000 7fee90d4a9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:34:53.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.356+0000 7fee90d4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.353 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.356+0000 7fee90d4a9c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:34:53.353 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.356+0000 7fee90d4a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:53.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.356+0000 7fee90d4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.356+0000 7fee90d4a9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:34:53.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.356+0000 7fee90d4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.360+0000 7fee90d4a9c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:34:53.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.360+0000 7fee90d4a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:53.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.360+0000 7fed457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:53.363 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.368+0000 7fee90d4a9c0 20 remove_watcher() i=0 2024-09-12T17:34:53.363 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.368+0000 7fee90d4a9c0 2 removed watcher, disabling cache 2024-09-12T17:34:53.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.368+0000 7fee90d4a9c0 20 remove_watcher() i=1 2024-09-12T17:34:53.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.372+0000 7fee90d4a9c0 20 remove_watcher() i=2 2024-09-12T17:34:53.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.372+0000 7fee90d4a9c0 20 remove_watcher() i=3 2024-09-12T17:34:53.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.376+0000 7fee90d4a9c0 20 remove_watcher() i=4 2024-09-12T17:34:53.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.380+0000 7fee90d4a9c0 20 remove_watcher() i=5 2024-09-12T17:34:53.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.380+0000 7fee90d4a9c0 20 remove_watcher() i=6 2024-09-12T17:34:53.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.380+0000 7fee90d4a9c0 20 remove_watcher() i=7 2024-09-12T17:34:53.395 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:53.395 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:34:53.395 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-trim-reshard-log-entries id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:34:53.395 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:53.549 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:34:53.585 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:53.585 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:53.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.636+0000 7f388255c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.636+0000 7f388255c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:53.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.636+0000 7f388255c9c0 20 realm 2024-09-12T17:34:53.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.636+0000 7f388255c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.636+0000 7f388255c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:53.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.636+0000 7f388255c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:53.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.636+0000 7f388255c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.636+0000 7f388255c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:53.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.636+0000 7f388255c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.640+0000 7f388255c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:53.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.640+0000 7f388255c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.640+0000 7f388255c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:53.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.640+0000 7f388255c9c0 20 searching for the correct realm 2024-09-12T17:34:53.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.644+0000 7f3880863640 0 -- 172.21.15.119:0/1339579587 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f3868046020 msgr2=0x7f386803b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:53.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.652+0000 7f387f861640 0 -- 172.21.15.119:0/1339579587 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f38780ff8a0 msgr2=0x7f3878132230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:53.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.868+0000 7f388255c9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:53.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.868+0000 7f388255c9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:53.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.868+0000 7f388255c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:53.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.868+0000 7f388255c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:53.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.868+0000 7f388255c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:53.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.868+0000 7f388255c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:53.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.868+0000 7f388255c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.868+0000 7f388255c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:53.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.868+0000 7f388255c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:53.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:53.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 20 zone default found 2024-09-12T17:34:53.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 4 Realm: () 2024-09-12T17:34:53.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:53.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:53.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:53.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 20 zonegroup default 2024-09-12T17:34:53.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:53.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.870 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:53.870 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.870 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:53.870 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 20 started sync module instance, tier type = 2024-09-12T17:34:53.870 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.872+0000 7f388255c9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:53.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.896+0000 7f388255c9c0 20 add_watcher() i=0 2024-09-12T17:34:53.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.896+0000 7f388255c9c0 20 add_watcher() i=1 2024-09-12T17:34:53.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.896+0000 7f388255c9c0 20 add_watcher() i=2 2024-09-12T17:34:53.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.896+0000 7f388255c9c0 20 add_watcher() i=3 2024-09-12T17:34:53.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.896+0000 7f388255c9c0 20 add_watcher() i=4 2024-09-12T17:34:53.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.896+0000 7f388255c9c0 20 add_watcher() i=5 2024-09-12T17:34:53.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.896+0000 7f388255c9c0 20 add_watcher() i=6 2024-09-12T17:34:53.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.900+0000 7f388255c9c0 20 add_watcher() i=7 2024-09-12T17:34:53.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.900+0000 7f388255c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:53.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.904+0000 7f37367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:53.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.904+0000 7f388255c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:53.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.904+0000 7f388255c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:53.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.904+0000 7f388255c9c0 5 note: GC not initialized 2024-09-12T17:34:53.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.904+0000 7f37357e2640 20 reqs_thread_entry: start 2024-09-12T17:34:53.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.904+0000 7f388255c9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:53.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.904+0000 7f388255c9c0 20 Filter name: none 2024-09-12T17:34:53.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.904+0000 7f36a6ffd640 20 reqs_thread_entry: start 2024-09-12T17:34:53.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.904+0000 7f388255c9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:34:53.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.904+0000 7f388255c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.908+0000 7f388255c9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:34:53.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.908+0000 7f388255c9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:34:53.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.908+0000 7f388255c9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:34:53.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.908+0000 7f388255c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 : miss 2024-09-12T17:34:53.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.908+0000 7f388255c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:53.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.908+0000 7f388255c9c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:34:53.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.908+0000 7f388255c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 info.flags=0x17 2024-09-12T17:34:53.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.908+0000 7f388255c9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 to cache LRU end 2024-09-12T17:34:53.905 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.908+0000 7f388255c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:53.905 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.908+0000 7f388255c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:53.905 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.908+0000 7f388255c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 2024-09-12T17:34:53.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.908+0000 7f388255c9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:34:53.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.924+0000 7f388255c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 info.flags=0x17 2024-09-12T17:34:53.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.924+0000 7f388255c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 to cache LRU end 2024-09-12T17:34:53.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.924+0000 7f388255c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:53.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.924+0000 7f388255c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26, ofs0, ns] 2024-09-12T17:34:53.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.924+0000 7f375f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333482 cookie 94660017855872 notifier 6461 bl.length()=1023 2024-09-12T17:34:53.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.924+0000 7f375f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 info.flags=0x17 2024-09-12T17:34:53.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.924+0000 7f375f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 to cache LRU end 2024-09-12T17:34:53.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.924+0000 7f375f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:53.922 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.924+0000 7f388255c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26]): orig_sources= new_sources= 2024-09-12T17:34:53.922 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.924+0000 7f388255c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26]): potential sources added=[] removed=[] 2024-09-12T17:34:53.922 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.924+0000 7f388255c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26]): orig_dests= new_dests= 2024-09-12T17:34:53.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.924+0000 7f388255c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26]): potential dests added=[] removed=[] 2024-09-12T17:34:53.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.0 2024-09-12T17:34:53.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.0 2024-09-12T17:34:53.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.1 2024-09-12T17:34:53.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.1 2024-09-12T17:34:53.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.2 2024-09-12T17:34:53.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.2 2024-09-12T17:34:53.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.3 2024-09-12T17:34:53.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.3 2024-09-12T17:34:53.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.4 2024-09-12T17:34:53.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.4 2024-09-12T17:34:53.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.5 2024-09-12T17:34:53.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.5 2024-09-12T17:34:53.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.6 2024-09-12T17:34:53.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.6 2024-09-12T17:34:53.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.7 2024-09-12T17:34:53.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.7 2024-09-12T17:34:53.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.8 2024-09-12T17:34:53.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.8 2024-09-12T17:34:53.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.9 2024-09-12T17:34:53.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.9 2024-09-12T17:34:53.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.10 2024-09-12T17:34:53.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.10 2024-09-12T17:34:53.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.11 2024-09-12T17:34:53.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2.11 2024-09-12T17:34:53.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.0 2024-09-12T17:34:53.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.936+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.1 2024-09-12T17:34:53.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.940+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2 2024-09-12T17:34:53.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.940+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.3 2024-09-12T17:34:53.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.940+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.4 2024-09-12T17:34:53.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.940+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.5 2024-09-12T17:34:53.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.944+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.6 2024-09-12T17:34:53.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.944+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.7 2024-09-12T17:34:53.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.944+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.8 2024-09-12T17:34:53.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.944+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.9 2024-09-12T17:34:53.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.948+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.10 2024-09-12T17:34:53.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.952+0000 7f388255c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:53.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.952+0000 7f388255c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 2024-09-12T17:34:53.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.956+0000 7f388255c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 info.flags=0x17 2024-09-12T17:34:53.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.956+0000 7f388255c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 to cache LRU end 2024-09-12T17:34:53.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.956+0000 7f388255c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:53.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.956+0000 7f388255c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26, ofs0, ns] 2024-09-12T17:34:53.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.956+0000 7f375f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333483 cookie 94660017855872 notifier 6461 bl.length()=1023 2024-09-12T17:34:53.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.956+0000 7f375f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 info.flags=0x17 2024-09-12T17:34:53.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.956+0000 7f375f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 to cache LRU end 2024-09-12T17:34:53.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.956+0000 7f375f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:53.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.956+0000 7f388255c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26]): orig_sources= new_sources= 2024-09-12T17:34:53.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.956+0000 7f388255c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26]): potential sources added=[] removed=[] 2024-09-12T17:34:53.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.956+0000 7f388255c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26]): orig_dests= new_dests= 2024-09-12T17:34:53.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.956+0000 7f388255c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26]): potential dests added=[] removed=[] 2024-09-12T17:34:53.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.964+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.0 2024-09-12T17:34:53.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.964+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.1 2024-09-12T17:34:53.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.964+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.2 2024-09-12T17:34:53.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.964+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.3 2024-09-12T17:34:53.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.964+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.4 2024-09-12T17:34:53.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.968+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.5 2024-09-12T17:34:53.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.968+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.6 2024-09-12T17:34:53.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.968+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.7 2024-09-12T17:34:53.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.968+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.8 2024-09-12T17:34:53.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.968+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.9 2024-09-12T17:34:53.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.968+0000 7f388255c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26.10 2024-09-12T17:34:53.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.968+0000 7f388255c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:53.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.968+0000 7f388255c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 2024-09-12T17:34:53.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.972+0000 7f388255c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 info.flags=0x17 2024-09-12T17:34:53.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.972+0000 7f388255c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 to cache LRU end 2024-09-12T17:34:53.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.972+0000 7f388255c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:53.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.972+0000 7f388255c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26, ofs0, ns] 2024-09-12T17:34:53.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.972+0000 7f375effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333484 cookie 94660017855872 notifier 6461 bl.length()=991 2024-09-12T17:34:53.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.972+0000 7f375effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 info.flags=0x17 2024-09-12T17:34:53.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.972+0000 7f375effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 to cache LRU end 2024-09-12T17:34:53.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.972+0000 7f375effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:53.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.976+0000 7f388255c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26]): orig_sources= new_sources= 2024-09-12T17:34:53.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.976+0000 7f388255c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26]): potential sources added=[] removed=[] 2024-09-12T17:34:53.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.976+0000 7f388255c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26]): orig_dests= new_dests= 2024-09-12T17:34:53.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.976+0000 7f388255c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26]): potential dests added=[] removed=[] 2024-09-12T17:34:53.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.980+0000 7f388255c9c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:34:53.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.984+0000 7f37367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:53.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.988+0000 7f388255c9c0 20 remove_watcher() i=0 2024-09-12T17:34:53.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.988+0000 7f388255c9c0 2 removed watcher, disabling cache 2024-09-12T17:34:53.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.992+0000 7f388255c9c0 20 remove_watcher() i=1 2024-09-12T17:34:53.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.992+0000 7f388255c9c0 20 remove_watcher() i=2 2024-09-12T17:34:53.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.996+0000 7f388255c9c0 20 remove_watcher() i=3 2024-09-12T17:34:53.994 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:53.996+0000 7f388255c9c0 20 remove_watcher() i=4 2024-09-12T17:34:53.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.000+0000 7f388255c9c0 20 remove_watcher() i=5 2024-09-12T17:34:53.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.000+0000 7f388255c9c0 20 remove_watcher() i=6 2024-09-12T17:34:54.000 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.004+0000 7f388255c9c0 20 remove_watcher() i=7 2024-09-12T17:34:54.018 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:34:54.047 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:54.048 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:54.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.096+0000 7f29eb0879c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:54.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.099+0000 7f29eb0879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:54.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.099+0000 7f29eb0879c0 20 realm 2024-09-12T17:34:54.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.099+0000 7f29eb0879c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:54.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.099+0000 7f29eb0879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:54.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.099+0000 7f29eb0879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:54.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.099+0000 7f29eb0879c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:54.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.099+0000 7f29eb0879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:54.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.099+0000 7f29eb0879c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:54.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.099+0000 7f29eb0879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:54.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.099+0000 7f29eb0879c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:54.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.103+0000 7f29eb0879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:54.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.103+0000 7f29eb0879c0 20 searching for the correct realm 2024-09-12T17:34:54.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.103+0000 7f29e938e640 0 -- 172.21.15.119:0/3106242456 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f29dc044040 msgr2=0x7f29dc043960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:54.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.319+0000 7f29e838c640 0 -- 172.21.15.119:0/3106242456 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f29e0107050 msgr2=0x7f29e00ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:54.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.535+0000 7f29eb0879c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:54.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.535+0000 7f29eb0879c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:54.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.535+0000 7f29eb0879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:54.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.535+0000 7f29eb0879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:54.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.535+0000 7f29eb0879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:54.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.535+0000 7f29eb0879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:54.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.535+0000 7f29eb0879c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:54.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.539+0000 7f29eb0879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:54.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.539+0000 7f29eb0879c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:54.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.539+0000 7f29eb0879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:54.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.539+0000 7f29eb0879c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:54.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.539+0000 7f29eb0879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:54.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.539+0000 7f29eb0879c0 20 zone default found 2024-09-12T17:34:54.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.539+0000 7f29eb0879c0 4 Realm: () 2024-09-12T17:34:54.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.539+0000 7f29eb0879c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:54.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.539+0000 7f29eb0879c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:54.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.539+0000 7f29eb0879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:54.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.539+0000 7f29eb0879c0 20 zonegroup default 2024-09-12T17:34:54.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.539+0000 7f29eb0879c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:54.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.539+0000 7f29eb0879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:54.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.539+0000 7f29eb0879c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:54.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.539+0000 7f29eb0879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:54.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.539+0000 7f29eb0879c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:54.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.543+0000 7f29eb0879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:54.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.543+0000 7f29eb0879c0 20 started sync module instance, tier type = 2024-09-12T17:34:54.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.543+0000 7f29eb0879c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:54.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.563+0000 7f29eb0879c0 20 add_watcher() i=0 2024-09-12T17:34:54.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.563+0000 7f29eb0879c0 20 add_watcher() i=1 2024-09-12T17:34:54.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.563+0000 7f29eb0879c0 20 add_watcher() i=2 2024-09-12T17:34:54.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.563+0000 7f29eb0879c0 20 add_watcher() i=3 2024-09-12T17:34:54.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.563+0000 7f29eb0879c0 20 add_watcher() i=4 2024-09-12T17:34:54.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.563+0000 7f29eb0879c0 20 add_watcher() i=5 2024-09-12T17:34:54.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.563+0000 7f29eb0879c0 20 add_watcher() i=6 2024-09-12T17:34:54.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.567+0000 7f29eb0879c0 20 add_watcher() i=7 2024-09-12T17:34:54.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.567+0000 7f29eb0879c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:54.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.567+0000 7f289efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:54.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.571+0000 7f29eb0879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:54.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.571+0000 7f29eb0879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:54.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.571+0000 7f29eb0879c0 5 note: GC not initialized 2024-09-12T17:34:54.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.571+0000 7f289dfe3640 20 reqs_thread_entry: start 2024-09-12T17:34:54.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.571+0000 7f29eb0879c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:54.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.571+0000 7f29eb0879c0 20 Filter name: none 2024-09-12T17:34:54.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.571+0000 7f280f7fe640 20 reqs_thread_entry: start 2024-09-12T17:34:54.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.571+0000 7f29eb0879c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:54.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.571+0000 7f29eb0879c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:34:54.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.571+0000 7f29eb0879c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:54.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.571+0000 7f29eb0879c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:34:54.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.571+0000 7f29eb0879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:54.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.571+0000 7f29eb0879c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:54.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.575+0000 7f29eb0879c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:34:54.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.575+0000 7f29eb0879c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:54.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.575+0000 7f29eb0879c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:34:54.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.575+0000 7f29eb0879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:54.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.575+0000 7f289efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:54.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.583+0000 7f29eb0879c0 20 remove_watcher() i=0 2024-09-12T17:34:54.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.583+0000 7f29eb0879c0 2 removed watcher, disabling cache 2024-09-12T17:34:54.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.583+0000 7f29eb0879c0 20 remove_watcher() i=1 2024-09-12T17:34:54.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.587+0000 7f29eb0879c0 20 remove_watcher() i=2 2024-09-12T17:34:54.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.587+0000 7f29eb0879c0 20 remove_watcher() i=3 2024-09-12T17:34:54.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.591+0000 7f29eb0879c0 20 remove_watcher() i=4 2024-09-12T17:34:54.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.591+0000 7f29eb0879c0 20 remove_watcher() i=5 2024-09-12T17:34:54.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.595+0000 7f29eb0879c0 20 remove_watcher() i=6 2024-09-12T17:34:54.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:54.595+0000 7f29eb0879c0 20 remove_watcher() i=7 2024-09-12T17:34:54.609 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:54.609 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:34:54.609 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-trim-reshard-log-entries id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:34:54.609 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:55.515 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T17:34:55.515 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:57.749 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:34:57.781 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:57.781 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:57.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:57.831+0000 7f457b65e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:57.830 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:57.831+0000 7f457b65e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:57.830 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:57.831+0000 7f457b65e9c0 20 realm 2024-09-12T17:34:57.830 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:57.831+0000 7f457b65e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:57.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:57.835+0000 7f457b65e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:57.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:57.835+0000 7f457b65e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:57.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:57.835+0000 7f457b65e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:57.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:57.835+0000 7f457b65e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:57.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:57.835+0000 7f457b65e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:57.833 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:57.835+0000 7f457b65e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:57.833 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:57.835+0000 7f457b65e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:57.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:57.835+0000 7f457b65e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:57.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:57.835+0000 7f457b65e9c0 20 searching for the correct realm 2024-09-12T17:34:57.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:57.839+0000 7f4579965640 0 -- 172.21.15.119:0/3037750528 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f457008e020 msgr2=0x7f45700581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:58.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.055+0000 7f4578963640 0 -- 172.21.15.119:0/3037750528 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f4574044410 msgr2=0x7f4574044890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:58.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:58.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:58.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:58.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:58.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:58.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:58.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:58.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:58.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:58.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 zone default found 2024-09-12T17:34:58.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 4 Realm: () 2024-09-12T17:34:58.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:58.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:58.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:58.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 zonegroup default 2024-09-12T17:34:58.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:58.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.275+0000 7f457b65e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.279+0000 7f457b65e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:58.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.279+0000 7f457b65e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.279+0000 7f457b65e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:58.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.279+0000 7f457b65e9c0 20 started sync module instance, tier type = 2024-09-12T17:34:58.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.279+0000 7f457b65e9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:58.300 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.303+0000 7f457b65e9c0 20 add_watcher() i=0 2024-09-12T17:34:58.301 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.303+0000 7f457b65e9c0 20 add_watcher() i=1 2024-09-12T17:34:58.301 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.303+0000 7f457b65e9c0 20 add_watcher() i=2 2024-09-12T17:34:58.301 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.303+0000 7f457b65e9c0 20 add_watcher() i=3 2024-09-12T17:34:58.301 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.303+0000 7f457b65e9c0 20 add_watcher() i=4 2024-09-12T17:34:58.301 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.303+0000 7f457b65e9c0 20 add_watcher() i=5 2024-09-12T17:34:58.301 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.303+0000 7f457b65e9c0 20 add_watcher() i=6 2024-09-12T17:34:58.303 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.307+0000 7f457b65e9c0 20 add_watcher() i=7 2024-09-12T17:34:58.303 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.307+0000 7f457b65e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:58.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.311+0000 7f442ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:58.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.311+0000 7f457b65e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:58.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.311+0000 7f457b65e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:58.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.311+0000 7f457b65e9c0 5 note: GC not initialized 2024-09-12T17:34:58.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.311+0000 7f442efe5640 20 reqs_thread_entry: start 2024-09-12T17:34:58.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.311+0000 7f457b65e9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:58.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.311+0000 7f457b65e9c0 20 Filter name: none 2024-09-12T17:34:58.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.311+0000 7f442cfe1640 20 reqs_thread_entry: start 2024-09-12T17:34:58.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.311+0000 7f457b65e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.315+0000 7f457b65e9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:34:58.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.315+0000 7f457b65e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.315+0000 7f457b65e9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:34:58.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.315+0000 7f457b65e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:58.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.315+0000 7f457b65e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.313 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.315+0000 7f457b65e9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:34:58.313 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.315+0000 7f457b65e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.315+0000 7f457b65e9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:34:58.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.315+0000 7f457b65e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:58.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.319+0000 7f442ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:58.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.327+0000 7f457b65e9c0 20 remove_watcher() i=0 2024-09-12T17:34:58.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.327+0000 7f457b65e9c0 2 removed watcher, disabling cache 2024-09-12T17:34:58.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.327+0000 7f457b65e9c0 20 remove_watcher() i=1 2024-09-12T17:34:58.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.331+0000 7f457b65e9c0 20 remove_watcher() i=2 2024-09-12T17:34:58.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.331+0000 7f457b65e9c0 20 remove_watcher() i=3 2024-09-12T17:34:58.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.335+0000 7f457b65e9c0 20 remove_watcher() i=4 2024-09-12T17:34:58.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.335+0000 7f457b65e9c0 20 remove_watcher() i=5 2024-09-12T17:34:58.336 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.339+0000 7f457b65e9c0 20 remove_watcher() i=6 2024-09-12T17:34:58.337 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.339+0000 7f457b65e9c0 20 remove_watcher() i=7 2024-09-12T17:34:58.352 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:58.352 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:34:58.352 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-trim-reshard-log-entries id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:34:58.352 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:58.353 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T17:34:58.389 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:58.389 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:58.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.435+0000 7f4f6295c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.439+0000 7f4f6295c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:58.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.439+0000 7f4f6295c9c0 20 realm 2024-09-12T17:34:58.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.439+0000 7f4f6295c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.439+0000 7f4f6295c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:58.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.439+0000 7f4f6295c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:58.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.439+0000 7f4f6295c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.439+0000 7f4f6295c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:58.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.439+0000 7f4f6295c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.439+0000 7f4f6295c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:58.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.439+0000 7f4f6295c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.443+0000 7f4f6295c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:58.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.443+0000 7f4f6295c9c0 20 searching for the correct realm 2024-09-12T17:34:58.442 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.443+0000 7f4f60c63640 0 -- 172.21.15.119:0/3261335561 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f4f540ba560 msgr2=0x7f4f540e0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:58.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.659+0000 7f4f5fc61640 0 -- 172.21.15.119:0/3261335561 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f4f5006c0b0 msgr2=0x7f4f50067860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:58.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.875+0000 7f4f6295c9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:58.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.875+0000 7f4f6295c9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:58.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.875+0000 7f4f6295c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:58.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.875+0000 7f4f6295c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:58.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.875+0000 7f4f6295c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:58.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.875+0000 7f4f6295c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:58.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.875+0000 7f4f6295c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.875+0000 7f4f6295c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:58.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.875+0000 7f4f6295c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.879+0000 7f4f6295c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:58.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.879+0000 7f4f6295c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.876 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.879+0000 7f4f6295c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:58.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.879+0000 7f4f6295c9c0 20 zone default found 2024-09-12T17:34:58.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.879+0000 7f4f6295c9c0 4 Realm: () 2024-09-12T17:34:58.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.879+0000 7f4f6295c9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:58.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.879+0000 7f4f6295c9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:58.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.879+0000 7f4f6295c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:58.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.879+0000 7f4f6295c9c0 20 zonegroup default 2024-09-12T17:34:58.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.879+0000 7f4f6295c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.879+0000 7f4f6295c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:58.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.879+0000 7f4f6295c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.879+0000 7f4f6295c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:58.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.879+0000 7f4f6295c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.883+0000 7f4f6295c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:58.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.883+0000 7f4f6295c9c0 20 started sync module instance, tier type = 2024-09-12T17:34:58.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.883+0000 7f4f6295c9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:58.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.907+0000 7f4f6295c9c0 20 add_watcher() i=0 2024-09-12T17:34:58.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.907+0000 7f4f6295c9c0 20 add_watcher() i=1 2024-09-12T17:34:58.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.907+0000 7f4f6295c9c0 20 add_watcher() i=2 2024-09-12T17:34:58.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.907+0000 7f4f6295c9c0 20 add_watcher() i=3 2024-09-12T17:34:58.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.907+0000 7f4f6295c9c0 20 add_watcher() i=4 2024-09-12T17:34:58.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.907+0000 7f4f6295c9c0 20 add_watcher() i=5 2024-09-12T17:34:58.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.907+0000 7f4f6295c9c0 20 add_watcher() i=6 2024-09-12T17:34:58.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.907+0000 7f4f6295c9c0 20 add_watcher() i=7 2024-09-12T17:34:58.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.907+0000 7f4f6295c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:58.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.911+0000 7f4e16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:58.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.915+0000 7f4f6295c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:58.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.915+0000 7f4f6295c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:58.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.915+0000 7f4f6295c9c0 5 note: GC not initialized 2024-09-12T17:34:58.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.915+0000 7f4e15fdb640 20 reqs_thread_entry: start 2024-09-12T17:34:58.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.915+0000 7f4f6295c9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:58.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.915+0000 7f4f6295c9c0 20 Filter name: none 2024-09-12T17:34:58.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.915+0000 7f4d877fe640 20 reqs_thread_entry: start 2024-09-12T17:34:58.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.915+0000 7f4f6295c9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:34:58.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.915+0000 7f4f6295c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.914 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.915+0000 7f4f6295c9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:34:58.914 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.915+0000 7f4f6295c9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:34:58.914 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.915+0000 7f4f6295c9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:34:58.914 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.915+0000 7f4f6295c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27 : miss 2024-09-12T17:34:58.914 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.915+0000 7f4f6295c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:58.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.919+0000 7f4f6295c9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:34:58.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.919+0000 7f4f6295c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27 info.flags=0x17 2024-09-12T17:34:58.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.919+0000 7f4f6295c9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27 to cache LRU end 2024-09-12T17:34:58.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.919+0000 7f4f6295c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:58.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.919+0000 7f4f6295c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:58.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.919+0000 7f4f6295c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27 2024-09-12T17:34:58.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.927+0000 7f4f6295c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27 info.flags=0x17 2024-09-12T17:34:58.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.927+0000 7f4f6295c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27 to cache LRU end 2024-09-12T17:34:58.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.927+0000 7f4f6295c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:58.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.927+0000 7f4f6295c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27, ofs0, ns] 2024-09-12T17:34:58.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.927+0000 7f4e377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333487 cookie 94151157137008 notifier 6888 bl.length()=1023 2024-09-12T17:34:58.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.927+0000 7f4e377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27 info.flags=0x17 2024-09-12T17:34:58.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.927+0000 7f4e377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27 to cache LRU end 2024-09-12T17:34:58.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.927+0000 7f4e377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:58.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.931+0000 7f4f6295c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27]): orig_sources= new_sources= 2024-09-12T17:34:58.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.931+0000 7f4f6295c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27]): potential sources added=[] removed=[] 2024-09-12T17:34:58.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.931+0000 7f4f6295c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27]): orig_dests= new_dests= 2024-09-12T17:34:58.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.931+0000 7f4f6295c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27]): potential dests added=[] removed=[] 2024-09-12T17:34:58.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.931+0000 7f4f6295c9c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T17:34:58.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.931+0000 7f4f6295c9c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:34:58.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.0 2024-09-12T17:34:58.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.0 2024-09-12T17:34:58.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.1 2024-09-12T17:34:58.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.1 2024-09-12T17:34:58.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.2 2024-09-12T17:34:58.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.2 2024-09-12T17:34:58.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.3 2024-09-12T17:34:58.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.3 2024-09-12T17:34:58.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.4 2024-09-12T17:34:58.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.4 2024-09-12T17:34:58.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.5 2024-09-12T17:34:58.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.5 2024-09-12T17:34:58.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.6 2024-09-12T17:34:58.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.6 2024-09-12T17:34:58.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.7 2024-09-12T17:34:58.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.7 2024-09-12T17:34:58.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.8 2024-09-12T17:34:58.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.8 2024-09-12T17:34:58.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.9 2024-09-12T17:34:58.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.9 2024-09-12T17:34:58.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.10 2024-09-12T17:34:58.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.10 2024-09-12T17:34:58.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.11 2024-09-12T17:34:58.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1.11 2024-09-12T17:34:58.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.0 2024-09-12T17:34:58.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.935+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.1 2024-09-12T17:34:58.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.939+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.2 2024-09-12T17:34:58.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.939+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.3 2024-09-12T17:34:58.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.939+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.4 2024-09-12T17:34:58.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.939+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.5 2024-09-12T17:34:58.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.939+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.6 2024-09-12T17:34:58.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.939+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.7 2024-09-12T17:34:58.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.943+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.8 2024-09-12T17:34:58.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.943+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.9 2024-09-12T17:34:58.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.943+0000 7f4f6295c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27.10 2024-09-12T17:34:58.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.947+0000 7f4f6295c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:58.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.947+0000 7f4f6295c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27 2024-09-12T17:34:58.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.951+0000 7f4f6295c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27 info.flags=0x17 2024-09-12T17:34:58.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.951+0000 7f4f6295c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27 to cache LRU end 2024-09-12T17:34:58.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.951+0000 7f4f6295c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:58.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.951+0000 7f4f6295c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27, ofs0, ns] 2024-09-12T17:34:58.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.951+0000 7f4e377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333488 cookie 94151157137008 notifier 6888 bl.length()=991 2024-09-12T17:34:58.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.951+0000 7f4e377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27 info.flags=0x17 2024-09-12T17:34:58.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.951+0000 7f4e377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27 to cache LRU end 2024-09-12T17:34:58.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.951+0000 7f4e377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:58.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.955+0000 7f4f6295c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27]): orig_sources= new_sources= 2024-09-12T17:34:58.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.955+0000 7f4f6295c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27]): potential sources added=[] removed=[] 2024-09-12T17:34:58.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.955+0000 7f4f6295c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27]): orig_dests= new_dests= 2024-09-12T17:34:58.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.955+0000 7f4f6295c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27]): potential dests added=[] removed=[] 2024-09-12T17:34:58.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.959+0000 7f4f6295c9c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:34:58.958 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.959+0000 7f4e16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:58.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.963+0000 7f4f6295c9c0 20 remove_watcher() i=0 2024-09-12T17:34:58.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.963+0000 7f4f6295c9c0 2 removed watcher, disabling cache 2024-09-12T17:34:58.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.967+0000 7f4f6295c9c0 20 remove_watcher() i=1 2024-09-12T17:34:58.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.971+0000 7f4f6295c9c0 20 remove_watcher() i=2 2024-09-12T17:34:58.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.971+0000 7f4f6295c9c0 20 remove_watcher() i=3 2024-09-12T17:34:58.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.975+0000 7f4f6295c9c0 20 remove_watcher() i=4 2024-09-12T17:34:58.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.975+0000 7f4f6295c9c0 20 remove_watcher() i=5 2024-09-12T17:34:58.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.975+0000 7f4f6295c9c0 20 remove_watcher() i=6 2024-09-12T17:34:58.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:58.979+0000 7f4f6295c9c0 20 remove_watcher() i=7 2024-09-12T17:34:58.992 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:34:59.025 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:59.025 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:59.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.075+0000 7fb68baca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:59.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.075+0000 7fb68baca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:59.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.075+0000 7fb68baca9c0 20 realm 2024-09-12T17:34:59.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.075+0000 7fb68baca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:59.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.075+0000 7fb68baca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:59.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.075+0000 7fb68baca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:59.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.075+0000 7fb68baca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:59.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.075+0000 7fb68baca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:59.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.075+0000 7fb68baca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:59.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.079+0000 7fb68baca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:59.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.079+0000 7fb68baca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:59.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.079+0000 7fb68baca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:59.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.079+0000 7fb68baca9c0 20 searching for the correct realm 2024-09-12T17:34:59.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.083+0000 7fb689dd1640 0 -- 172.21.15.119:0/2880832715 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fb680024070 msgr2=0x7fb68005d2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:59.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.091+0000 7fb688dcf640 0 -- 172.21.15.119:0/2880832715 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fb6840e7490 msgr2=0x7fb6840e78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:59.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.307+0000 7fb68baca9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:34:59.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.307+0000 7fb68baca9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:34:59.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.307+0000 7fb68baca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:59.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.307+0000 7fb68baca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:59.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.307+0000 7fb68baca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:59.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.307+0000 7fb68baca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:59.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.307+0000 7fb68baca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:59.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.311+0000 7fb68baca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:59.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.311+0000 7fb68baca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:59.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.311+0000 7fb68baca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:59.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.311+0000 7fb68baca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:59.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.311+0000 7fb68baca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:59.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.311+0000 7fb68baca9c0 20 zone default found 2024-09-12T17:34:59.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.311+0000 7fb68baca9c0 4 Realm: () 2024-09-12T17:34:59.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.311+0000 7fb68baca9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:34:59.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.311+0000 7fb68baca9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:34:59.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.311+0000 7fb68baca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:59.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.311+0000 7fb68baca9c0 20 zonegroup default 2024-09-12T17:34:59.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.311+0000 7fb68baca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:59.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.311+0000 7fb68baca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:59.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.311+0000 7fb68baca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:59.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.311+0000 7fb68baca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:59.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.311+0000 7fb68baca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:59.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.315+0000 7fb68baca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:59.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.315+0000 7fb68baca9c0 20 started sync module instance, tier type = 2024-09-12T17:34:59.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.315+0000 7fb68baca9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:34:59.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.339+0000 7fb68baca9c0 20 add_watcher() i=0 2024-09-12T17:34:59.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.339+0000 7fb68baca9c0 20 add_watcher() i=1 2024-09-12T17:34:59.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.339+0000 7fb68baca9c0 20 add_watcher() i=2 2024-09-12T17:34:59.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.339+0000 7fb68baca9c0 20 add_watcher() i=3 2024-09-12T17:34:59.336 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.339+0000 7fb68baca9c0 20 add_watcher() i=4 2024-09-12T17:34:59.336 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.339+0000 7fb68baca9c0 20 add_watcher() i=5 2024-09-12T17:34:59.336 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.339+0000 7fb68baca9c0 20 add_watcher() i=6 2024-09-12T17:34:59.337 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.339+0000 7fb68baca9c0 20 add_watcher() i=7 2024-09-12T17:34:59.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.339+0000 7fb68baca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:59.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.343+0000 7fb53ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:59.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.343+0000 7fb68baca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:59.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.343+0000 7fb68baca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:59.343 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.343+0000 7fb68baca9c0 5 note: GC not initialized 2024-09-12T17:34:59.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.347+0000 7fb53efe5640 20 reqs_thread_entry: start 2024-09-12T17:34:59.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.347+0000 7fb68baca9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:34:59.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.347+0000 7fb68baca9c0 20 Filter name: none 2024-09-12T17:34:59.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.347+0000 7fb53cfe1640 20 reqs_thread_entry: start 2024-09-12T17:34:59.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.347+0000 7fb68baca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:59.345 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.347+0000 7fb68baca9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:34:59.345 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.347+0000 7fb68baca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:59.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.351+0000 7fb68baca9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:34:59.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.351+0000 7fb68baca9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:59.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.351+0000 7fb68baca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:59.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.351+0000 7fb68baca9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:34:59.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.351+0000 7fb68baca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:34:59.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.351+0000 7fb68baca9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:34:59.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.351+0000 7fb68baca9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:59.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.355+0000 7fb53ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:59.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.359+0000 7fb68baca9c0 20 remove_watcher() i=0 2024-09-12T17:34:59.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.359+0000 7fb68baca9c0 2 removed watcher, disabling cache 2024-09-12T17:34:59.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.363+0000 7fb68baca9c0 20 remove_watcher() i=1 2024-09-12T17:34:59.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.363+0000 7fb68baca9c0 20 remove_watcher() i=2 2024-09-12T17:34:59.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.367+0000 7fb68baca9c0 20 remove_watcher() i=3 2024-09-12T17:34:59.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.371+0000 7fb68baca9c0 20 remove_watcher() i=4 2024-09-12T17:34:59.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.371+0000 7fb68baca9c0 20 remove_watcher() i=5 2024-09-12T17:34:59.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.371+0000 7fb68baca9c0 20 remove_watcher() i=6 2024-09-12T17:34:59.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:34:59.375+0000 7fb68baca9c0 20 remove_watcher() i=7 2024-09-12T17:34:59.390 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:34:59.390 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:34:59.390 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-trim-reshard-log-entries id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:34:59.390 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:00.318 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T17:35:00.319 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:02.495 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:35:02.528 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:02.528 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:02.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.579+0000 7f0a2fd389c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.579+0000 7f0a2fd389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:02.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.579+0000 7f0a2fd389c0 20 realm 2024-09-12T17:35:02.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.579+0000 7f0a2fd389c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.579+0000 7f0a2fd389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:02.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.579+0000 7f0a2fd389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:02.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.579+0000 7f0a2fd389c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.579+0000 7f0a2fd389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:02.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.579+0000 7f0a2fd389c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.583+0000 7f0a2fd389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:02.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.583+0000 7f0a2fd389c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.583+0000 7f0a2fd389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:02.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.583+0000 7f0a2fd389c0 20 searching for the correct realm 2024-09-12T17:35:02.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.587+0000 7f0a2d03d640 0 -- 172.21.15.119:0/2169547926 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f0a18002350 msgr2=0x7f0a20062aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:02.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.803+0000 7f0a2e03f640 0 -- 172.21.15.119:0/2169547926 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f0a2411a070 msgr2=0x7f0a240b03d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:02.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.819+0000 7f0a2fd389c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:02.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.819+0000 7f0a2fd389c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:02.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.819+0000 7f0a2fd389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:02.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.819+0000 7f0a2fd389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:02.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.819+0000 7f0a2fd389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:02.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.819+0000 7f0a2fd389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:02.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.819+0000 7f0a2fd389c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.818 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.819+0000 7f0a2fd389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:02.818 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.819+0000 7f0a2fd389c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.818 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.819+0000 7f0a2fd389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:02.818 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.819+0000 7f0a2fd389c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.823+0000 7f0a2fd389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:02.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.823+0000 7f0a2fd389c0 20 zone default found 2024-09-12T17:35:02.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.823+0000 7f0a2fd389c0 4 Realm: () 2024-09-12T17:35:02.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.823+0000 7f0a2fd389c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:02.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.823+0000 7f0a2fd389c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:02.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.823+0000 7f0a2fd389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:02.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.823+0000 7f0a2fd389c0 20 zonegroup default 2024-09-12T17:35:02.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.823+0000 7f0a2fd389c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.823+0000 7f0a2fd389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:02.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.823+0000 7f0a2fd389c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.823+0000 7f0a2fd389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:02.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.823+0000 7f0a2fd389c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.823+0000 7f0a2fd389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:02.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.823+0000 7f0a2fd389c0 20 started sync module instance, tier type = 2024-09-12T17:35:02.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.823+0000 7f0a2fd389c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:02.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.847+0000 7f0a2fd389c0 20 add_watcher() i=0 2024-09-12T17:35:02.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.847+0000 7f0a2fd389c0 20 add_watcher() i=1 2024-09-12T17:35:02.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.847+0000 7f0a2fd389c0 20 add_watcher() i=2 2024-09-12T17:35:02.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.847+0000 7f0a2fd389c0 20 add_watcher() i=3 2024-09-12T17:35:02.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.847+0000 7f0a2fd389c0 20 add_watcher() i=4 2024-09-12T17:35:02.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.851+0000 7f0a2fd389c0 20 add_watcher() i=5 2024-09-12T17:35:02.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.851+0000 7f0a2fd389c0 20 add_watcher() i=6 2024-09-12T17:35:02.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.851+0000 7f0a2fd389c0 20 add_watcher() i=7 2024-09-12T17:35:02.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.851+0000 7f0a2fd389c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:02.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.855+0000 7f08df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:02.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.855+0000 7f0a2fd389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:02.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.855+0000 7f0a2fd389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:02.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.855+0000 7f0a2fd389c0 5 note: GC not initialized 2024-09-12T17:35:02.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.855+0000 7f08de7fc640 20 reqs_thread_entry: start 2024-09-12T17:35:02.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.855+0000 7f0a2fd389c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:02.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.855+0000 7f0a2fd389c0 20 Filter name: none 2024-09-12T17:35:02.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.855+0000 7f084ffff640 20 reqs_thread_entry: start 2024-09-12T17:35:02.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.855+0000 7f0a2fd389c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.859+0000 7f0a2fd389c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:35:02.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.859+0000 7f0a2fd389c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.856 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.859+0000 7f0a2fd389c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:35:02.856 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.859+0000 7f0a2fd389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:02.856 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.859+0000 7f0a2fd389c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.859+0000 7f0a2fd389c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:35:02.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.859+0000 7f0a2fd389c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.859+0000 7f0a2fd389c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:35:02.858 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.859+0000 7f0a2fd389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:02.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.863+0000 7f08df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:02.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.867+0000 7f0a2fd389c0 20 remove_watcher() i=0 2024-09-12T17:35:02.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.867+0000 7f0a2fd389c0 2 removed watcher, disabling cache 2024-09-12T17:35:02.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.871+0000 7f0a2fd389c0 20 remove_watcher() i=1 2024-09-12T17:35:02.870 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.871+0000 7f0a2fd389c0 20 remove_watcher() i=2 2024-09-12T17:35:02.872 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.875+0000 7f0a2fd389c0 20 remove_watcher() i=3 2024-09-12T17:35:02.876 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.879+0000 7f0a2fd389c0 20 remove_watcher() i=4 2024-09-12T17:35:02.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.879+0000 7f0a2fd389c0 20 remove_watcher() i=5 2024-09-12T17:35:02.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.883+0000 7f0a2fd389c0 20 remove_watcher() i=6 2024-09-12T17:35:02.881 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.883+0000 7f0a2fd389c0 20 remove_watcher() i=7 2024-09-12T17:35:02.897 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:02.897 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:35:02.897 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-trim-reshard-log-entries id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:35:02.897 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:02.897 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T17:35:02.930 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:02.930 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:02.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.979+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:02.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.983+0000 7f72b27049c0 20 realm 2024-09-12T17:35:02.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:02.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.983+0000 7f72b27049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:02.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:02.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:02.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:02.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.987+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:02.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.987+0000 7f72b27049c0 20 searching for the correct realm 2024-09-12T17:35:02.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.991+0000 7f72b020a640 0 -- 172.21.15.119:0/2512682063 >> [v2:172.21.15.119:6800/1732749810,v1:172.21.15.119:6801/1732749810] conn(0x55b5f1cf3060 msgr2=0x55b5f1cf5520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:02.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:02.999+0000 7f72afa09640 0 -- 172.21.15.119:0/2512682063 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f72a80c7950 msgr2=0x7f72a80e13f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:03.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:03.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:03.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:03.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:03.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:03.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:03.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:03.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:03.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 zone default found 2024-09-12T17:35:03.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 4 Realm: () 2024-09-12T17:35:03.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:03.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:03.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:03.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 zonegroup default 2024-09-12T17:35:03.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.011+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.011+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.011+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.011+0000 7f72b27049c0 20 started sync module instance, tier type = 2024-09-12T17:35:03.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.011+0000 7f72b27049c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:03.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=0 2024-09-12T17:35:03.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=1 2024-09-12T17:35:03.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=2 2024-09-12T17:35:03.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=3 2024-09-12T17:35:03.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=4 2024-09-12T17:35:03.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=5 2024-09-12T17:35:03.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=6 2024-09-12T17:35:03.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.035+0000 7f72b27049c0 20 add_watcher() i=7 2024-09-12T17:35:03.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.035+0000 7f72b27049c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:03.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.035+0000 7f71677de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:03.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.035+0000 7f72b27049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:03.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.035+0000 7f72b27049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:03.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.035+0000 7f72b27049c0 5 note: GC not initialized 2024-09-12T17:35:03.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f71667dc640 20 reqs_thread_entry: start 2024-09-12T17:35:03.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f72b27049c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:03.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f72b27049c0 20 Filter name: none 2024-09-12T17:35:03.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f715f7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:03.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f72b27049c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:35:03.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:35:03.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f72b27049c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:35:03.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f72b27049c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:35:03.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f72b27049c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 : miss 2024-09-12T17:35:03.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:35:03.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f72b27049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:03.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f72b27049c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:03.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f72b27049c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:03.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f72b27049c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:03.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.039+0000 7f72b27049c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 2024-09-12T17:35:03.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.051+0000 7f72b27049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:03.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.051+0000 7f72b27049c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:03.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.051+0000 7f72b27049c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:03.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.051+0000 7f72b27049c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28, ofs0, ns] 2024-09-12T17:35:03.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.051+0000 7f71877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333491 cookie 94239934348656 notifier 6557 bl.length()=1023 2024-09-12T17:35:03.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.051+0000 7f71877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:03.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.051+0000 7f71877fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:03.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.051+0000 7f71877fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:03.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.051+0000 7f72b27049c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): orig_sources= new_sources= 2024-09-12T17:35:03.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.051+0000 7f72b27049c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): potential sources added=[] removed=[] 2024-09-12T17:35:03.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.051+0000 7f72b27049c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): orig_dests= new_dests= 2024-09-12T17:35:03.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.051+0000 7f72b27049c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): potential dests added=[] removed=[] 2024-09-12T17:35:03.050 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f72b27049c0 time 2024-09-12T17:35:03.056333+0000 2024-09-12T17:35:03.050 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:35:03.051 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:03.051 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f72b5fde2eb] 2024-09-12T17:35:03.051 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f72b5fde49f] 2024-09-12T17:35:03.052 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ef58c0c1] 2024-09-12T17:35:03.052 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x141007e) [0x55b5effe207e] 2024-09-12T17:35:03.052 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b5ef59e18d] 2024-09-12T17:35:03.052 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:35:03.052 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f72b4e44d90] 2024-09-12T17:35:03.052 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:35:03.052 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:35:03.052 INFO:tasks.workunit.client.0.smithi119.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:35:03.052 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f72b27049c0 thread_name:radosgw-admin 2024-09-12T17:35:03.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.055+0000 7f72b27049c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f72b27049c0 time 2024-09-12T17:35:03.056333+0000 2024-09-12T17:35:03.052 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:35:03.052 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.053 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:03.053 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f72b5fde2eb] 2024-09-12T17:35:03.053 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f72b5fde49f] 2024-09-12T17:35:03.053 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ef58c0c1] 2024-09-12T17:35:03.053 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x141007e) [0x55b5effe207e] 2024-09-12T17:35:03.053 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b5ef59e18d] 2024-09-12T17:35:03.053 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:35:03.053 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f72b4e44d90] 2024-09-12T17:35:03.053 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:35:03.053 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:35:03.053 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.065 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:03.065 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f72b4e5d520] 2024-09-12T17:35:03.066 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:35:03.066 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:35:03.066 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:35:03.066 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f72b5fde345] 2024-09-12T17:35:03.066 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f72b5fde49f] 2024-09-12T17:35:03.066 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ef58c0c1] 2024-09-12T17:35:03.066 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x141007e) [0x55b5effe207e] 2024-09-12T17:35:03.066 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b5ef59e18d] 2024-09-12T17:35:03.066 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:35:03.066 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f72b4e44d90] 2024-09-12T17:35:03.066 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:35:03.066 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:35:03.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.055+0000 7f72b27049c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:35:03.067 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f72b27049c0 thread_name:radosgw-admin 2024-09-12T17:35:03.067 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.067 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:03.067 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f72b4e5d520] 2024-09-12T17:35:03.067 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:35:03.067 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:35:03.067 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:35:03.067 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f72b5fde345] 2024-09-12T17:35:03.067 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f72b5fde49f] 2024-09-12T17:35:03.067 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ef58c0c1] 2024-09-12T17:35:03.067 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x141007e) [0x55b5effe207e] 2024-09-12T17:35:03.068 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b5ef59e18d] 2024-09-12T17:35:03.068 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:35:03.068 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f72b4e44d90] 2024-09-12T17:35:03.068 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:35:03.068 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:35:03.068 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:35:03.068 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.068 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:35:03.068 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:35:02.955+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.068 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:35:02.955+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.068 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:35:02.955+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.068 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:35:02.955+0000 7f72b020a640 10 monclient(hunting): handle_auth_done global_id 6933 payload 274 2024-09-12T17:35:03.069 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:35:02.955+0000 7f72b020a640 10 monclient: _finish_hunting 0 2024-09-12T17:35:03.069 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:35:02.955+0000 7f72b020a640 1 monclient: found mon.noname-a 2024-09-12T17:35:03.069 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:35:02.955+0000 7f72b020a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:35:03.069 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:35:02.955+0000 7f72afa09640 10 monclient: get_auth_request con 0x55b5f1b3ff80 auth_method 0 2024-09-12T17:35:03.069 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.069 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:03.069 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: dump: 2024-09-12T17:35:03.069 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.069 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.069 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.069 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.069 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.070 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.070 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.070 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.070 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.070 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.070 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: _finish_auth 0 2024-09-12T17:35:03.070 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: _check_auth_tickets 2024-09-12T17:35:03.070 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:03.070 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.070 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:03.070 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: dump: 2024-09-12T17:35:03.070 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.070 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.070 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.071 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.071 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.071 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.071 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.071 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.071 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.071 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.071 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 monclient: authenticate success, global_id 6933 2024-09-12T17:35:03.071 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient: get_monmap_and_config success 2024-09-12T17:35:03.071 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:35:02.955+0000 7f72b27049c0 4 set_mon_vals no callback set 2024-09-12T17:35:03.071 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient: shutdown 2024-09-12T17:35:03.071 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) unregister_commands rotate-key 2024-09-12T17:35:03.071 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient: build_initial_monmap 2024-09-12T17:35:03.072 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:35:02.955+0000 7f72b27049c0 1 build_initial for_mkfs: 0 2024-09-12T17:35:03.072 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient: monmap: 2024-09-12T17:35:03.072 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:35:03.072 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:03.072 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:35:03.072 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:35:03.072 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:03.072 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.072 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:35:03.072 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:35:03.072 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:35:03.072 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.072 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding auth protocol: cephx 2024-09-12T17:35:03.073 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding auth protocol: cephx 2024-09-12T17:35:03.073 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding auth protocol: cephx 2024-09-12T17:35:03.073 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: secure 2024-09-12T17:35:03.073 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: crc 2024-09-12T17:35:03.073 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: secure 2024-09-12T17:35:03.073 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: crc 2024-09-12T17:35:03.073 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: secure 2024-09-12T17:35:03.073 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: crc 2024-09-12T17:35:03.073 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: crc 2024-09-12T17:35:03.073 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: secure 2024-09-12T17:35:03.073 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: crc 2024-09-12T17:35:03.073 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: secure 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: crc 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: secure 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:35:02.955+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:35:02.955+0000 7f72b27049c0 1 librados: starting msgr at 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:35:02.955+0000 7f72b27049c0 1 librados: starting objecter 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command objecter_requests hook 0x55b5f1ab3b70 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:35:02.955+0000 7f72b27049c0 1 librados: setting wanted keys 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:35:02.955+0000 7f72b27049c0 1 librados: calling monclient init 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient: init 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding auth protocol: cephx 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding auth protocol: cephx 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding auth protocol: cephx 2024-09-12T17:35:03.074 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: secure 2024-09-12T17:35:03.075 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: crc 2024-09-12T17:35:03.075 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: secure 2024-09-12T17:35:03.075 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: crc 2024-09-12T17:35:03.075 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: secure 2024-09-12T17:35:03.075 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: crc 2024-09-12T17:35:03.075 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: crc 2024-09-12T17:35:03.075 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: secure 2024-09-12T17:35:03.075 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: crc 2024-09-12T17:35:03.075 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: secure 2024-09-12T17:35:03.075 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: crc 2024-09-12T17:35:03.075 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: secure 2024-09-12T17:35:03.075 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:35:02.955+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.075 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:35:02.955+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.075 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command rotate-key hook 0x55b5f1bfa1c8 2024-09-12T17:35:03.076 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient: _reopen_session rank -1 2024-09-12T17:35:03.076 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:35:03.076 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-a con 0x55b5f1aaa000 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:35:03.076 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-c con 0x55b5f1b3ff80 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:35:03.076 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-b con 0x55b5f1b40360 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:35:03.076 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.076 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.076 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.076 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient(hunting): _renew_subs 2024-09-12T17:35:03.076 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient(hunting): authenticate will time out at 2470.991860s 2024-09-12T17:35:03.076 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:35:02.955+0000 7f72b020a640 10 monclient(hunting): get_auth_request con 0x55b5f1aaa000 auth_method 0 2024-09-12T17:35:03.076 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:03.077 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:03.077 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:03.077 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:35:02.959+0000 7f72afa09640 10 monclient(hunting): get_auth_request con 0x55b5f1b3ff80 auth_method 0 2024-09-12T17:35:03.077 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:35:02.959+0000 7f72afa09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:03.077 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:35:02.959+0000 7f72afa09640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:03.077 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:35:02.959+0000 7f72afa09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:03.077 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.077 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.077 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.077 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:35:02.959+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.077 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:35:02.959+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.077 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:35:02.959+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.077 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient(hunting): handle_auth_done global_id 6936 payload 824 2024-09-12T17:35:03.077 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient: _finish_hunting 0 2024-09-12T17:35:03.078 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:35:02.959+0000 7f72b020a640 1 monclient: found mon.noname-a 2024-09-12T17:35:03.078 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:35:03.078 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.078 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:03.078 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: dump: 2024-09-12T17:35:03.078 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.078 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.078 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.078 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.078 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.078 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.078 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.078 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.078 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.079 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.079 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: _finish_auth 0 2024-09-12T17:35:03.079 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: _check_auth_tickets 2024-09-12T17:35:03.079 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:03.079 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.079 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:03.079 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: dump: 2024-09-12T17:35:03.079 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.079 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.079 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.079 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.079 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.080 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.080 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.080 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.080 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.080 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.080 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:35:02.959+0000 7f719e60c640 4 set_mon_vals no callback set 2024-09-12T17:35:03.080 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:35:02.959+0000 7f72b27049c0 5 monclient: authenticate success, global_id 6936 2024-09-12T17:35:03.080 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:35:02.959+0000 7f72b27049c0 10 monclient: _renew_subs 2024-09-12T17:35:03.080 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:35:02.959+0000 7f72b27049c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:35:03.080 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:35:02.959+0000 7f72b27049c0 10 monclient: _renew_subs 2024-09-12T17:35:03.080 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:35:02.959+0000 7f72b27049c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:35:03.080 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:35:02.959+0000 7f72b27049c0 1 librados: init done 2024-09-12T17:35:03.080 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:35:02.959+0000 7f719ce09640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:35:03.081 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:35:02.959+0000 7f719ce09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:03.081 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:35:02.959+0000 7f719ce09640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:03.081 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:35:02.959+0000 7f72afa09640 10 monclient: get_auth_request con 0x7f7198070ae0 auth_method 0 2024-09-12T17:35:03.081 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:35:02.959+0000 7f72b0a0b640 10 monclient: get_auth_request con 0x55b5f1c270f0 auth_method 0 2024-09-12T17:35:03.081 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:35:02.963+0000 7f72b020a640 10 monclient: get_auth_request con 0x55b5f1c44b90 auth_method 0 2024-09-12T17:35:03.081 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:35:02.963+0000 7f72afa09640 10 monclient: get_auth_request con 0x55b5f1c48fa0 auth_method 0 2024-09-12T17:35:03.081 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:35:02.967+0000 7f72b0a0b640 10 monclient: get_auth_request con 0x55b5f1c48440 auth_method 0 2024-09-12T17:35:03.081 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: build_initial_monmap 2024-09-12T17:35:03.081 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:35:02.971+0000 7f72b27049c0 1 build_initial for_mkfs: 0 2024-09-12T17:35:03.081 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: monmap: 2024-09-12T17:35:03.081 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:35:03.082 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:03.082 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:35:03.082 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:35:03.082 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:03.082 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.082 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:35:03.082 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:35:03.082 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:35:03.082 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.082 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding auth protocol: cephx 2024-09-12T17:35:03.082 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding auth protocol: cephx 2024-09-12T17:35:03.082 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding auth protocol: cephx 2024-09-12T17:35:03.082 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: secure 2024-09-12T17:35:03.083 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: crc 2024-09-12T17:35:03.083 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: secure 2024-09-12T17:35:03.083 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: crc 2024-09-12T17:35:03.083 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: secure 2024-09-12T17:35:03.083 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: crc 2024-09-12T17:35:03.083 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: crc 2024-09-12T17:35:03.083 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: secure 2024-09-12T17:35:03.083 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: crc 2024-09-12T17:35:03.083 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: secure 2024-09-12T17:35:03.083 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: crc 2024-09-12T17:35:03.083 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: secure 2024-09-12T17:35:03.083 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:35:02.971+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.084 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b5f1c54ac0 EEXIST 2024-09-12T17:35:03.084 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: init 2024-09-12T17:35:03.084 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding auth protocol: cephx 2024-09-12T17:35:03.084 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding auth protocol: cephx 2024-09-12T17:35:03.084 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding auth protocol: cephx 2024-09-12T17:35:03.084 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: secure 2024-09-12T17:35:03.084 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: crc 2024-09-12T17:35:03.084 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: secure 2024-09-12T17:35:03.084 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: crc 2024-09-12T17:35:03.084 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: secure 2024-09-12T17:35:03.084 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: crc 2024-09-12T17:35:03.084 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: crc 2024-09-12T17:35:03.084 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: secure 2024-09-12T17:35:03.085 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: crc 2024-09-12T17:35:03.085 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: secure 2024-09-12T17:35:03.085 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: crc 2024-09-12T17:35:03.085 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: secure 2024-09-12T17:35:03.085 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:35:02.971+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.085 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:35:02.971+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.085 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command rotate-key cmddesc rotate-key hook 0x55b5f1c501a0 EEXIST 2024-09-12T17:35:03.085 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: _reopen_session rank -1 2024-09-12T17:35:03.085 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:35:03.085 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-b con 0x55b5f1c78c70 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:35:03.085 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-a con 0x55b5f1c785a0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:35:03.085 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-c con 0x55b5f1c76f80 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:35:03.086 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.086 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.086 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.086 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient(hunting): _renew_subs 2024-09-12T17:35:03.086 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient(hunting): authenticate will time out at 2471.005863s 2024-09-12T17:35:03.086 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:35:02.971+0000 7f72b0a0b640 10 monclient(hunting): get_auth_request con 0x55b5f1c785a0 auth_method 0 2024-09-12T17:35:03.086 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:35:02.971+0000 7f72b0a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:03.086 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:35:02.971+0000 7f72b0a0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:03.086 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:35:02.971+0000 7f72b0a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:03.086 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient(hunting): get_auth_request con 0x55b5f1c76f80 auth_method 0 2024-09-12T17:35:03.086 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:03.086 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:03.086 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:03.087 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:35:02.971+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.087 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:35:02.971+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.087 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:35:02.971+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.087 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.087 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.087 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.087 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient(hunting): handle_auth_done global_id 6551 payload 824 2024-09-12T17:35:03.087 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient: _finish_hunting 0 2024-09-12T17:35:03.087 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:35:02.971+0000 7f72b020a640 1 monclient: found mon.noname-c 2024-09-12T17:35:03.087 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:35:03.087 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:35:02.971+0000 7f72afa09640 10 monclient: get_auth_request con 0x55b5f1c78c70 auth_method 0 2024-09-12T17:35:03.087 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.087 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:35:03.087 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: dump: 2024-09-12T17:35:03.088 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.088 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.088 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.088 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.088 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.088 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.088 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.088 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.088 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.088 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.088 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: _finish_auth 0 2024-09-12T17:35:03.088 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:35:03.089 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:03.089 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.089 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:35:03.089 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: dump: 2024-09-12T17:35:03.089 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.089 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.089 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.089 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.089 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.089 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.089 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.089 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.089 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.089 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.090 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 monclient: authenticate success, global_id 6551 2024-09-12T17:35:03.090 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:35:02.971+0000 7f72b120c640 4 set_mon_vals no callback set 2024-09-12T17:35:03.090 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: _renew_subs 2024-09-12T17:35:03.090 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:03.090 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: _renew_subs 2024-09-12T17:35:03.090 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:03.090 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:35:02.975+0000 7f7195ffb640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:35:03.090 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:35:02.975+0000 7f7195ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:03.090 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:35:02.975+0000 7f7195ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:03.090 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: get_monmap_and_config 2024-09-12T17:35:03.090 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: build_initial_monmap 2024-09-12T17:35:03.090 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:35:02.975+0000 7f72b27049c0 1 build_initial for_mkfs: 0 2024-09-12T17:35:03.090 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: monmap: 2024-09-12T17:35:03.091 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:35:03.091 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:03.091 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:35:03.091 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:35:03.091 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:03.091 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.091 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:35:03.091 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:35:03.091 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:35:03.091 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.091 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding auth protocol: cephx 2024-09-12T17:35:03.091 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding auth protocol: cephx 2024-09-12T17:35:03.091 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding auth protocol: cephx 2024-09-12T17:35:03.092 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: secure 2024-09-12T17:35:03.092 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: crc 2024-09-12T17:35:03.092 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: secure 2024-09-12T17:35:03.092 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: crc 2024-09-12T17:35:03.092 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: secure 2024-09-12T17:35:03.092 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: crc 2024-09-12T17:35:03.092 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: crc 2024-09-12T17:35:03.092 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: secure 2024-09-12T17:35:03.092 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: crc 2024-09-12T17:35:03.092 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: secure 2024-09-12T17:35:03.092 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: crc 2024-09-12T17:35:03.092 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: secure 2024-09-12T17:35:03.092 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient: get_auth_request con 0x7f7188070a20 auth_method 0 2024-09-12T17:35:03.093 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:35:02.975+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.093 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: init 2024-09-12T17:35:03.093 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding auth protocol: cephx 2024-09-12T17:35:03.093 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding auth protocol: cephx 2024-09-12T17:35:03.093 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding auth protocol: cephx 2024-09-12T17:35:03.093 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: secure 2024-09-12T17:35:03.093 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: crc 2024-09-12T17:35:03.093 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: secure 2024-09-12T17:35:03.093 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: crc 2024-09-12T17:35:03.093 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: secure 2024-09-12T17:35:03.093 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: crc 2024-09-12T17:35:03.093 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: crc 2024-09-12T17:35:03.093 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: secure 2024-09-12T17:35:03.094 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: crc 2024-09-12T17:35:03.094 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: secure 2024-09-12T17:35:03.094 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: crc 2024-09-12T17:35:03.094 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: secure 2024-09-12T17:35:03.094 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:35:02.975+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.094 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:35:02.975+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.094 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd1e5430c8 EEXIST 2024-09-12T17:35:03.094 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: _reopen_session rank -1 2024-09-12T17:35:03.094 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:35:03.094 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-c con 0x55b5f1ccc850 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:35:03.094 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-a con 0x55b5f1cc7ed0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:35:03.094 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-b con 0x55b5f1cd1370 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:35:03.095 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.095 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.095 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.095 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient(hunting): _renew_subs 2024-09-12T17:35:03.095 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient(hunting): authenticate will time out at 2471.009961s 2024-09-12T17:35:03.095 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient(hunting): get_auth_request con 0x55b5f1ccc850 auth_method 0 2024-09-12T17:35:03.095 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:03.095 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:03.095 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:03.095 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:35:02.975+0000 7f72b0a0b640 10 monclient(hunting): get_auth_request con 0x55b5f1cc7ed0 auth_method 0 2024-09-12T17:35:03.095 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:35:02.975+0000 7f72b0a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:03.095 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:35:02.975+0000 7f72b0a0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:03.095 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:35:02.975+0000 7f72b0a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:03.096 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.096 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.096 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.096 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:35:02.975+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.096 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:35:02.975+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.096 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:35:02.975+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.096 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient(hunting): handle_auth_done global_id 6554 payload 274 2024-09-12T17:35:03.096 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient: _finish_hunting 0 2024-09-12T17:35:03.096 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:35:02.975+0000 7f72afa09640 1 monclient: found mon.noname-c 2024-09-12T17:35:03.096 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:35:03.096 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.096 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:35:03.096 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: dump: 2024-09-12T17:35:03.097 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.097 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.097 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.097 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.097 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.097 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.097 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.097 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.097 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.097 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.097 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: _finish_auth 0 2024-09-12T17:35:03.097 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: _check_auth_tickets 2024-09-12T17:35:03.098 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:03.098 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.098 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:35:03.098 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: dump: 2024-09-12T17:35:03.098 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.098 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.098 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.098 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.098 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.098 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.098 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.098 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.098 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.099 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.099 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 monclient: authenticate success, global_id 6554 2024-09-12T17:35:03.099 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: get_monmap_and_config success 2024-09-12T17:35:03.099 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:35:02.975+0000 7f72b27049c0 4 set_mon_vals no callback set 2024-09-12T17:35:03.099 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: shutdown 2024-09-12T17:35:03.099 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: build_initial_monmap 2024-09-12T17:35:03.099 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:35:02.975+0000 7f72b27049c0 1 build_initial for_mkfs: 0 2024-09-12T17:35:03.099 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: monmap: 2024-09-12T17:35:03.099 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:35:03.099 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:03.099 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:35:03.099 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:35:03.099 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:03.099 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.100 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:35:03.100 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:35:03.100 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:35:03.100 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.100 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding auth protocol: cephx 2024-09-12T17:35:03.100 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding auth protocol: cephx 2024-09-12T17:35:03.100 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding auth protocol: cephx 2024-09-12T17:35:03.100 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: secure 2024-09-12T17:35:03.100 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: crc 2024-09-12T17:35:03.100 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: secure 2024-09-12T17:35:03.100 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: crc 2024-09-12T17:35:03.100 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: secure 2024-09-12T17:35:03.100 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: crc 2024-09-12T17:35:03.101 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: crc 2024-09-12T17:35:03.101 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: secure 2024-09-12T17:35:03.101 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: crc 2024-09-12T17:35:03.101 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: secure 2024-09-12T17:35:03.101 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: crc 2024-09-12T17:35:03.101 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: secure 2024-09-12T17:35:03.101 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:35:02.975+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.101 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:35:02.975+0000 7f72b27049c0 1 librados: starting msgr at 2024-09-12T17:35:03.101 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:35:02.975+0000 7f72b27049c0 1 librados: starting objecter 2024-09-12T17:35:03.101 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b5f1c7d880 EEXIST 2024-09-12T17:35:03.101 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:35:02.975+0000 7f72b27049c0 1 librados: setting wanted keys 2024-09-12T17:35:03.101 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:35:02.975+0000 7f72b27049c0 1 librados: calling monclient init 2024-09-12T17:35:03.101 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: init 2024-09-12T17:35:03.101 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding auth protocol: cephx 2024-09-12T17:35:03.102 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding auth protocol: cephx 2024-09-12T17:35:03.102 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding auth protocol: cephx 2024-09-12T17:35:03.102 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: secure 2024-09-12T17:35:03.102 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: crc 2024-09-12T17:35:03.102 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: secure 2024-09-12T17:35:03.102 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: crc 2024-09-12T17:35:03.102 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: secure 2024-09-12T17:35:03.102 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: crc 2024-09-12T17:35:03.102 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: crc 2024-09-12T17:35:03.102 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: secure 2024-09-12T17:35:03.102 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: crc 2024-09-12T17:35:03.102 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: secure 2024-09-12T17:35:03.102 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: crc 2024-09-12T17:35:03.103 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: secure 2024-09-12T17:35:03.103 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:35:02.979+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.103 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:35:02.979+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.103 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:35:02.979+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command rotate-key cmddesc rotate-key hook 0x55b5f1c7abd8 EEXIST 2024-09-12T17:35:03.103 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient: _reopen_session rank -1 2024-09-12T17:35:03.103 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:35:03.103 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-c con 0x55b5f1cc7ed0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:35:03.103 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-b con 0x55b5f1ccc850 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:35:03.103 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-a con 0x55b5f1cd1370 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:35:03.103 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.103 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.103 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.103 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient(hunting): _renew_subs 2024-09-12T17:35:03.104 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient(hunting): authenticate will time out at 2471.012546s 2024-09-12T17:35:03.104 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient(hunting): get_auth_request con 0x55b5f1cc7ed0 auth_method 0 2024-09-12T17:35:03.104 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:03.104 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:03.104 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:03.104 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:35:02.979+0000 7f72b020a640 10 monclient(hunting): get_auth_request con 0x55b5f1cd1370 auth_method 0 2024-09-12T17:35:03.104 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:35:02.979+0000 7f72b020a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:03.104 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:35:02.979+0000 7f72b020a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:03.104 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:35:02.979+0000 7f72b020a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:03.104 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.104 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.104 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.104 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:35:02.979+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.105 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:35:02.979+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.105 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:35:02.979+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.105 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient(hunting): handle_auth_done global_id 6557 payload 824 2024-09-12T17:35:03.105 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient: _finish_hunting 0 2024-09-12T17:35:03.105 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:35:02.979+0000 7f72afa09640 1 monclient: found mon.noname-c 2024-09-12T17:35:03.105 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:35:03.105 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:35:02.979+0000 7f72b0a0b640 10 monclient: get_auth_request con 0x55b5f1ccc850 auth_method 0 2024-09-12T17:35:03.105 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.105 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:35:03.105 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: dump: 2024-09-12T17:35:03.105 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.105 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.106 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.106 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.106 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.106 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.106 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.106 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.106 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.106 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.106 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: _finish_auth 0 2024-09-12T17:35:03.106 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:35:03.106 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:03.106 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.106 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:35:03.107 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: dump: 2024-09-12T17:35:03.107 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.107 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.107 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.107 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.107 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.107 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.107 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.107 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.107 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.107 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.107 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:35:02.979+0000 7f72b27049c0 5 monclient: authenticate success, global_id 6557 2024-09-12T17:35:03.107 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:35:02.979+0000 7f71877fe640 4 set_mon_vals no callback set 2024-09-12T17:35:03.108 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient: _renew_subs 2024-09-12T17:35:03.108 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:03.108 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient: _renew_subs 2024-09-12T17:35:03.108 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:03.108 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:35:02.979+0000 7f72b27049c0 1 librados: init done 2024-09-12T17:35:03.108 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:35:02.979+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command cr dump hook 0x55b5f1cbc918 2024-09-12T17:35:03.108 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:35:02.979+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.108 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:35:02.979+0000 7f7185ffb640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:35:03.108 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:35:02.979+0000 7f7185ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:03.108 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:35:02.979+0000 7f7185ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:03.108 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:35:02.983+0000 7f72b0a0b640 10 monclient: get_auth_request con 0x7f7178070ae0 auth_method 0 2024-09-12T17:35:03.108 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:35:02.983+0000 7f72b020a640 10 monclient: get_auth_request con 0x55b5f1ce6850 auth_method 0 2024-09-12T17:35:03.109 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.109 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 realm 2024-09-12T17:35:03.109 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.109 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.109 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:35:02.983+0000 7f72b27049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:03.109 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.109 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.109 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.109 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:35:02.983+0000 7f72afa09640 10 monclient: get_auth_request con 0x55b5f1ceab80 auth_method 0 2024-09-12T17:35:03.109 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:03.109 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.109 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:35:02.983+0000 7f72b0a0b640 10 monclient: get_auth_request con 0x55b5f1cee2a0 auth_method 0 2024-09-12T17:35:03.109 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:35:02.987+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:03.110 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:35:02.987+0000 7f72b27049c0 20 searching for the correct realm 2024-09-12T17:35:03.110 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:35:02.987+0000 7f72b020a640 10 monclient: get_auth_request con 0x55b5f1cf3060 auth_method 0 2024-09-12T17:35:03.110 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:35:02.987+0000 7f72afa09640 10 monclient: get_auth_request con 0x7f72a0017020 auth_method 0 2024-09-12T17:35:03.110 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:35:02.987+0000 7f72b0a0b640 10 monclient: get_auth_request con 0x7f729802c040 auth_method 0 2024-09-12T17:35:03.110 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:35:02.991+0000 7f72b020a640 0 -- 172.21.15.119:0/2512682063 >> [v2:172.21.15.119:6800/1732749810,v1:172.21.15.119:6801/1732749810] conn(0x55b5f1cf3060 msgr2=0x55b5f1cf5520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:03.110 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:35:02.991+0000 7f7185ffb640 1 client.6557.objecter ms_handle_reset 0x55b5f1cf3060 session 0x55b5f1cf29e0 osd.3 2024-09-12T17:35:03.110 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:35:02.991+0000 7f7185ffb640 10 monclient: _renew_subs 2024-09-12T17:35:03.110 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:35:02.991+0000 7f7185ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:03.110 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:35:02.991+0000 7f72b020a640 10 monclient: get_auth_request con 0x7f7178081290 auth_method 0 2024-09-12T17:35:03.110 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:35:02.995+0000 7f72b020a640 10 monclient: get_auth_request con 0x7f72a80c8040 auth_method 0 2024-09-12T17:35:03.110 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:35:02.999+0000 7f72afa09640 10 monclient: get_auth_request con 0x7f72a80c7950 auth_method 0 2024-09-12T17:35:03.110 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:35:02.999+0000 7f72afa09640 0 -- 172.21.15.119:0/2512682063 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f72a80c7950 msgr2=0x7f72a80e13f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:03.110 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:35:02.999+0000 7f7185ffb640 1 client.6557.objecter ms_handle_reset 0x7f72a80c7950 session 0x7f72a80d4e50 osd.0 2024-09-12T17:35:03.111 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:35:02.999+0000 7f72afa09640 10 monclient: get_auth_request con 0x55b5f1cf3060 auth_method 0 2024-09-12T17:35:03.111 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:03.111 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:03.111 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:03.111 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:03.111 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:03.111 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:03.111 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.111 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.111 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.111 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:03.111 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.111 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:03.112 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 zone default found 2024-09-12T17:35:03.112 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:35:03.007+0000 7f72b27049c0 4 Realm: () 2024-09-12T17:35:03.112 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:35:03.007+0000 7f72b27049c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:03.112 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:35:03.007+0000 7f72b27049c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:03.112 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:35:03.007+0000 7f72b27049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:03.112 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 zonegroup default 2024-09-12T17:35:03.112 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.112 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.112 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.112 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:35:03.011+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.112 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:35:03.011+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.112 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:35:03.011+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.113 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:35:03.011+0000 7f72b27049c0 20 started sync module instance, tier type = 2024-09-12T17:35:03.113 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:35:03.011+0000 7f72b27049c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:03.113 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=0 2024-09-12T17:35:03.113 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=1 2024-09-12T17:35:03.113 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=2 2024-09-12T17:35:03.113 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=3 2024-09-12T17:35:03.113 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=4 2024-09-12T17:35:03.113 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=5 2024-09-12T17:35:03.113 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=6 2024-09-12T17:35:03.113 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:35:03.035+0000 7f72b27049c0 20 add_watcher() i=7 2024-09-12T17:35:03.113 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:35:03.035+0000 7f72b27049c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:03.113 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding auth protocol: cephx 2024-09-12T17:35:03.113 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding auth protocol: cephx 2024-09-12T17:35:03.113 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding auth protocol: cephx 2024-09-12T17:35:03.114 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: secure 2024-09-12T17:35:03.114 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: crc 2024-09-12T17:35:03.114 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: secure 2024-09-12T17:35:03.114 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:35:03.035+0000 7f71677de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:03.114 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: crc 2024-09-12T17:35:03.114 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: secure 2024-09-12T17:35:03.114 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: crc 2024-09-12T17:35:03.114 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: crc 2024-09-12T17:35:03.114 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: secure 2024-09-12T17:35:03.114 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: crc 2024-09-12T17:35:03.114 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: secure 2024-09-12T17:35:03.114 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: crc 2024-09-12T17:35:03.114 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: secure 2024-09-12T17:35:03.115 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:35:03.035+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.115 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:35:03.035+0000 7f72b27049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:03.115 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:35:03.035+0000 7f72b27049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:03.115 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command cache list hook 0x55b5f1cc5170 2024-09-12T17:35:03.115 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command cache inspect hook 0x55b5f1cc5170 2024-09-12T17:35:03.115 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command cache erase hook 0x55b5f1cc5170 2024-09-12T17:35:03.115 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command cache zap hook 0x55b5f1cc5170 2024-09-12T17:35:03.115 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 note: GC not initialized 2024-09-12T17:35:03.115 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:35:03.039+0000 7f71667dc640 20 reqs_thread_entry: start 2024-09-12T17:35:03.115 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:35:03.039+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command sync trace show hook 0x7f729800b880 2024-09-12T17:35:03.115 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:35:03.039+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command sync trace history hook 0x7f729800b880 2024-09-12T17:35:03.115 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:35:03.039+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command sync trace active hook 0x7f729800b880 2024-09-12T17:35:03.115 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:35:03.039+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command sync trace active_short hook 0x7f729800b880 2024-09-12T17:35:03.115 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:35:03.039+0000 7f72b27049c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:03.116 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:35:03.039+0000 7f72b27049c0 20 Filter name: none 2024-09-12T17:35:03.116 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:35:03.039+0000 7f715f7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:03.116 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:35:03.116 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:35:03.039+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.116 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:35:03.039+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:35:03.116 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:35:03.116 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:35:03.116 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 : miss 2024-09-12T17:35:03.116 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:35:03.039+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.116 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:35:03.039+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:35:03.116 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:03.116 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:03.116 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:03.117 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:03.117 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 2024-09-12T17:35:03.117 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:35:03.051+0000 7f72b27049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:03.117 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:35:03.051+0000 7f72b27049c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:03.117 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:35:03.051+0000 7f72b27049c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:03.117 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:35:03.051+0000 7f72b27049c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28, ofs0, ns] 2024-09-12T17:35:03.117 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:35:03.051+0000 7f71877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333491 cookie 94239934348656 notifier 6557 bl.length()=1023 2024-09-12T17:35:03.117 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:35:03.051+0000 7f71877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:03.117 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:35:03.051+0000 7f71877fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:03.117 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:35:03.051+0000 7f71877fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:03.117 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:35:03.051+0000 7f72b27049c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): orig_sources= new_sources= 2024-09-12T17:35:03.117 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:35:03.051+0000 7f72b27049c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): potential sources added=[] removed=[] 2024-09-12T17:35:03.118 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:35:03.051+0000 7f72b27049c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): orig_dests= new_dests= 2024-09-12T17:35:03.118 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:35:03.051+0000 7f72b27049c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): potential dests added=[] removed=[] 2024-09-12T17:35:03.118 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:35:03.055+0000 7f72b27049c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f72b27049c0 time 2024-09-12T17:35:03.056333+0000 2024-09-12T17:35:03.118 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:35:03.118 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.118 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:03.118 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f72b5fde2eb] 2024-09-12T17:35:03.118 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f72b5fde49f] 2024-09-12T17:35:03.118 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ef58c0c1] 2024-09-12T17:35:03.118 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x141007e) [0x55b5effe207e] 2024-09-12T17:35:03.118 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b5ef59e18d] 2024-09-12T17:35:03.119 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:35:03.119 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f72b4e44d90] 2024-09-12T17:35:03.119 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:35:03.119 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:35:03.119 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.119 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:35:03.055+0000 7f72b27049c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:35:03.119 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f72b27049c0 thread_name:radosgw-admin 2024-09-12T17:35:03.119 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.119 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:03.119 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f72b4e5d520] 2024-09-12T17:35:03.119 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:35:03.119 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:35:03.119 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:35:03.119 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f72b5fde345] 2024-09-12T17:35:03.120 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f72b5fde49f] 2024-09-12T17:35:03.120 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ef58c0c1] 2024-09-12T17:35:03.120 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x141007e) [0x55b5effe207e] 2024-09-12T17:35:03.120 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b5ef59e18d] 2024-09-12T17:35:03.120 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:35:03.120 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f72b4e44d90] 2024-09-12T17:35:03.120 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:35:03.120 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:35:03.120 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:35:03.120 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.120 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:35:03.120 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:35:03.120 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:35:03.121 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:35:03.121 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:35:03.121 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:35:03.121 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:35:03.121 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:35:03.121 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:35:03.121 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:35:03.121 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:35:03.121 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:35:03.121 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:35:03.121 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:35:03.121 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:35:03.121 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:35:03.122 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:35:03.122 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:35:03.122 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:35:03.122 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:35:03.122 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:35:03.122 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:35:03.122 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:35:03.122 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:35:03.122 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:35:03.122 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:35:03.122 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:35:03.122 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:35:03.122 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:35:03.123 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:35:03.123 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:35:03.123 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:35:03.123 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:35:03.123 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:35:03.123 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:35:03.123 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:35:03.123 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:35:03.123 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:35:03.123 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:35:03.123 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:35:03.123 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:35:03.123 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:35:03.123 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:35:03.124 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:35:03.124 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:35:03.124 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:35:03.124 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:35:03.124 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:35:03.124 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:35:03.124 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:35:03.124 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:35:03.124 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:35:03.124 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:35:03.124 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:35:03.124 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:35:03.124 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:35:03.125 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:35:03.125 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:35:03.125 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:35:03.125 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:35:03.125 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:35:03.125 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:35:03.125 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:35:03.125 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:35:03.125 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:35:03.125 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:35:03.125 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:35:03.125 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:35:03.125 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:35:03.130 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:35:03.130 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:35:03.130 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:35:03.130 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:35:03.130 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:35:03.130 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:35:03.130 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:35:03.130 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:35:03.130 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:35:03.130 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:35:03.131 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:35:03.131 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:35:03.131 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:35:03.131 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:35:03.131 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:35:03.131 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:35:03.131 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:35:03.131 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:35:03.131 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:35:03.131 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:35:03.131 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:35:03.131 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:35:03.131 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:35:03.132 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:35:03.132 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:35:03.132 INFO:tasks.workunit.client.0.smithi119.stderr: 7f715f7fe640 / http_manager 2024-09-12T17:35:03.132 INFO:tasks.workunit.client.0.smithi119.stderr: 7f71667dc640 / http_manager 2024-09-12T17:35:03.132 INFO:tasks.workunit.client.0.smithi119.stderr: 7f71677de640 / rgw_dt_lg_renew 2024-09-12T17:35:03.132 INFO:tasks.workunit.client.0.smithi119.stderr: 7f7185ffb640 / ms_dispatch 2024-09-12T17:35:03.132 INFO:tasks.workunit.client.0.smithi119.stderr: 7f71877fe640 / io_context_pool 2024-09-12T17:35:03.132 INFO:tasks.workunit.client.0.smithi119.stderr: 7f7195ffb640 / ms_dispatch 2024-09-12T17:35:03.132 INFO:tasks.workunit.client.0.smithi119.stderr: 7f719ce09640 / ms_dispatch 2024-09-12T17:35:03.132 INFO:tasks.workunit.client.0.smithi119.stderr: 7f719e60c640 / io_context_pool 2024-09-12T17:35:03.132 INFO:tasks.workunit.client.0.smithi119.stderr: 7f72afa09640 / msgr-worker-2 2024-09-12T17:35:03.132 INFO:tasks.workunit.client.0.smithi119.stderr: 7f72b020a640 / msgr-worker-1 2024-09-12T17:35:03.133 INFO:tasks.workunit.client.0.smithi119.stderr: 7f72b0a0b640 / msgr-worker-0 2024-09-12T17:35:03.133 INFO:tasks.workunit.client.0.smithi119.stderr: 7f72b120c640 / io_context_pool 2024-09-12T17:35:03.133 INFO:tasks.workunit.client.0.smithi119.stderr: 7f72b27049c0 / radosgw-admin 2024-09-12T17:35:03.133 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:35:03.133 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:35:03.133 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/log/ceph/ceph-client.admin.100321.log 2024-09-12T17:35:03.133 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:35:03.133 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:35:03.133 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:35:02.955+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.133 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:35:02.955+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.133 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:35:02.955+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.133 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:35:02.955+0000 7f72b020a640 10 monclient(hunting): handle_auth_done global_id 6933 payload 274 2024-09-12T17:35:03.133 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:35:02.955+0000 7f72b020a640 10 monclient: _finish_hunting 0 2024-09-12T17:35:03.134 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:35:02.955+0000 7f72b020a640 1 monclient: found mon.noname-a 2024-09-12T17:35:03.134 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:35:02.955+0000 7f72b020a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:35:03.134 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:35:02.955+0000 7f72afa09640 10 monclient: get_auth_request con 0x55b5f1b3ff80 auth_method 0 2024-09-12T17:35:03.134 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.134 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:03.134 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: dump: 2024-09-12T17:35:03.134 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.134 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.134 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.134 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.134 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.134 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.134 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.134 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.135 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.135 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.135 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: _finish_auth 0 2024-09-12T17:35:03.135 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: _check_auth_tickets 2024-09-12T17:35:03.135 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:03.135 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.135 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:03.135 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:35:02.955+0000 7f719e60c640 10 monclient: dump: 2024-09-12T17:35:03.135 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.135 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.135 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.135 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.135 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.136 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.136 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.136 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.136 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.136 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.136 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 monclient: authenticate success, global_id 6933 2024-09-12T17:35:03.136 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient: get_monmap_and_config success 2024-09-12T17:35:03.136 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:35:02.955+0000 7f72b27049c0 4 set_mon_vals no callback set 2024-09-12T17:35:03.136 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient: shutdown 2024-09-12T17:35:03.136 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) unregister_commands rotate-key 2024-09-12T17:35:03.136 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient: build_initial_monmap 2024-09-12T17:35:03.136 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:35:02.955+0000 7f72b27049c0 1 build_initial for_mkfs: 0 2024-09-12T17:35:03.136 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient: monmap: 2024-09-12T17:35:03.136 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:35:03.137 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:03.137 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:35:03.137 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:35:03.137 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:03.137 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.137 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:35:03.137 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:35:03.137 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:35:03.137 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.137 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding auth protocol: cephx 2024-09-12T17:35:03.137 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding auth protocol: cephx 2024-09-12T17:35:03.138 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding auth protocol: cephx 2024-09-12T17:35:03.138 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: secure 2024-09-12T17:35:03.138 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: crc 2024-09-12T17:35:03.138 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: secure 2024-09-12T17:35:03.138 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: crc 2024-09-12T17:35:03.138 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: secure 2024-09-12T17:35:03.138 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: crc 2024-09-12T17:35:03.138 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: crc 2024-09-12T17:35:03.138 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: secure 2024-09-12T17:35:03.138 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: crc 2024-09-12T17:35:03.138 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: secure 2024-09-12T17:35:03.138 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: crc 2024-09-12T17:35:03.138 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c23900) adding con mode: secure 2024-09-12T17:35:03.138 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:35:02.955+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.139 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:35:02.955+0000 7f72b27049c0 1 librados: starting msgr at 2024-09-12T17:35:03.139 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:35:02.955+0000 7f72b27049c0 1 librados: starting objecter 2024-09-12T17:35:03.139 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command objecter_requests hook 0x55b5f1ab3b70 2024-09-12T17:35:03.139 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:35:02.955+0000 7f72b27049c0 1 librados: setting wanted keys 2024-09-12T17:35:03.139 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:35:02.955+0000 7f72b27049c0 1 librados: calling monclient init 2024-09-12T17:35:03.139 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient: init 2024-09-12T17:35:03.139 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding auth protocol: cephx 2024-09-12T17:35:03.139 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding auth protocol: cephx 2024-09-12T17:35:03.139 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding auth protocol: cephx 2024-09-12T17:35:03.139 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: secure 2024-09-12T17:35:03.139 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: crc 2024-09-12T17:35:03.139 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: secure 2024-09-12T17:35:03.139 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: crc 2024-09-12T17:35:03.140 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: secure 2024-09-12T17:35:03.140 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: crc 2024-09-12T17:35:03.140 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: crc 2024-09-12T17:35:03.140 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: secure 2024-09-12T17:35:03.140 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: crc 2024-09-12T17:35:03.140 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: secure 2024-09-12T17:35:03.140 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: crc 2024-09-12T17:35:03.140 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1bfa080) adding con mode: secure 2024-09-12T17:35:03.140 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:35:02.955+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.140 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:35:02.955+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.140 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:35:02.955+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command rotate-key hook 0x55b5f1bfa1c8 2024-09-12T17:35:03.140 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient: _reopen_session rank -1 2024-09-12T17:35:03.140 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:35:03.141 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-a con 0x55b5f1aaa000 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:35:03.141 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-c con 0x55b5f1b3ff80 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:35:03.141 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-b con 0x55b5f1b40360 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:35:03.141 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.141 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.141 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.141 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient(hunting): _renew_subs 2024-09-12T17:35:03.141 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:35:02.955+0000 7f72b27049c0 10 monclient(hunting): authenticate will time out at 2470.991860s 2024-09-12T17:35:03.141 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:35:02.955+0000 7f72b020a640 10 monclient(hunting): get_auth_request con 0x55b5f1aaa000 auth_method 0 2024-09-12T17:35:03.141 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:03.141 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:03.141 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:03.142 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:35:02.959+0000 7f72afa09640 10 monclient(hunting): get_auth_request con 0x55b5f1b3ff80 auth_method 0 2024-09-12T17:35:03.142 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:35:02.959+0000 7f72afa09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:03.142 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:35:02.959+0000 7f72afa09640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:03.142 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:35:02.959+0000 7f72afa09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:03.142 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.142 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.142 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.142 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:35:02.959+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.142 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:35:02.959+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.142 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:35:02.959+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.142 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient(hunting): handle_auth_done global_id 6936 payload 824 2024-09-12T17:35:03.142 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient: _finish_hunting 0 2024-09-12T17:35:03.142 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:35:02.959+0000 7f72b020a640 1 monclient: found mon.noname-a 2024-09-12T17:35:03.143 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:35:02.959+0000 7f72b020a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:35:03.143 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.143 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:03.143 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: dump: 2024-09-12T17:35:03.143 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.143 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.143 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.143 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.143 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.143 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.143 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.143 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.143 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.144 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.144 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: _finish_auth 0 2024-09-12T17:35:03.144 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: _check_auth_tickets 2024-09-12T17:35:03.144 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:03.144 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.144 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:03.144 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:35:02.959+0000 7f719ce09640 10 monclient: dump: 2024-09-12T17:35:03.144 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.144 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.145 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.145 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.145 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.145 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.145 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.145 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.145 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.145 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.145 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:35:02.959+0000 7f719e60c640 4 set_mon_vals no callback set 2024-09-12T17:35:03.145 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:35:02.959+0000 7f72b27049c0 5 monclient: authenticate success, global_id 6936 2024-09-12T17:35:03.145 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:35:02.959+0000 7f72b27049c0 10 monclient: _renew_subs 2024-09-12T17:35:03.145 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:35:02.959+0000 7f72b27049c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:35:03.146 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:35:02.959+0000 7f72b27049c0 10 monclient: _renew_subs 2024-09-12T17:35:03.146 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:35:02.959+0000 7f72b27049c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:35:03.146 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:35:02.959+0000 7f72b27049c0 1 librados: init done 2024-09-12T17:35:03.146 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:35:02.959+0000 7f719ce09640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:35:03.146 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:35:02.959+0000 7f719ce09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:03.146 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:35:02.959+0000 7f719ce09640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:03.146 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:35:02.959+0000 7f72afa09640 10 monclient: get_auth_request con 0x7f7198070ae0 auth_method 0 2024-09-12T17:35:03.146 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:35:02.959+0000 7f72b0a0b640 10 monclient: get_auth_request con 0x55b5f1c270f0 auth_method 0 2024-09-12T17:35:03.146 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:35:02.963+0000 7f72b020a640 10 monclient: get_auth_request con 0x55b5f1c44b90 auth_method 0 2024-09-12T17:35:03.146 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:35:02.963+0000 7f72afa09640 10 monclient: get_auth_request con 0x55b5f1c48fa0 auth_method 0 2024-09-12T17:35:03.146 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:35:02.967+0000 7f72b0a0b640 10 monclient: get_auth_request con 0x55b5f1c48440 auth_method 0 2024-09-12T17:35:03.146 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: build_initial_monmap 2024-09-12T17:35:03.146 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:35:02.971+0000 7f72b27049c0 1 build_initial for_mkfs: 0 2024-09-12T17:35:03.147 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: monmap: 2024-09-12T17:35:03.147 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:35:03.147 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:03.147 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:35:03.147 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:35:03.147 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:03.147 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.147 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:35:03.147 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:35:03.147 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:35:03.147 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.148 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding auth protocol: cephx 2024-09-12T17:35:03.148 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding auth protocol: cephx 2024-09-12T17:35:03.148 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding auth protocol: cephx 2024-09-12T17:35:03.148 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: secure 2024-09-12T17:35:03.148 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: crc 2024-09-12T17:35:03.148 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: secure 2024-09-12T17:35:03.148 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: crc 2024-09-12T17:35:03.148 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: secure 2024-09-12T17:35:03.148 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: crc 2024-09-12T17:35:03.148 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: crc 2024-09-12T17:35:03.148 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: secure 2024-09-12T17:35:03.148 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: crc 2024-09-12T17:35:03.149 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: secure 2024-09-12T17:35:03.149 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: crc 2024-09-12T17:35:03.149 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c51110) adding con mode: secure 2024-09-12T17:35:03.149 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:35:02.971+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.149 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b5f1c54ac0 EEXIST 2024-09-12T17:35:03.149 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: init 2024-09-12T17:35:03.149 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding auth protocol: cephx 2024-09-12T17:35:03.149 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding auth protocol: cephx 2024-09-12T17:35:03.149 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding auth protocol: cephx 2024-09-12T17:35:03.149 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: secure 2024-09-12T17:35:03.149 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: crc 2024-09-12T17:35:03.149 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: secure 2024-09-12T17:35:03.149 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: crc 2024-09-12T17:35:03.150 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: secure 2024-09-12T17:35:03.150 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: crc 2024-09-12T17:35:03.150 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: crc 2024-09-12T17:35:03.150 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: secure 2024-09-12T17:35:03.150 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: crc 2024-09-12T17:35:03.150 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: secure 2024-09-12T17:35:03.150 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: crc 2024-09-12T17:35:03.150 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c50058) adding con mode: secure 2024-09-12T17:35:03.150 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:35:02.971+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.150 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:35:02.971+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.150 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command rotate-key cmddesc rotate-key hook 0x55b5f1c501a0 EEXIST 2024-09-12T17:35:03.150 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: _reopen_session rank -1 2024-09-12T17:35:03.150 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:35:03.151 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-b con 0x55b5f1c78c70 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:35:03.151 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-a con 0x55b5f1c785a0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:35:03.151 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-c con 0x55b5f1c76f80 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:35:03.151 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.151 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.151 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.151 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient(hunting): _renew_subs 2024-09-12T17:35:03.151 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient(hunting): authenticate will time out at 2471.005863s 2024-09-12T17:35:03.151 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:35:02.971+0000 7f72b0a0b640 10 monclient(hunting): get_auth_request con 0x55b5f1c785a0 auth_method 0 2024-09-12T17:35:03.151 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:35:02.971+0000 7f72b0a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:03.151 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:35:02.971+0000 7f72b0a0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:03.151 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:35:02.971+0000 7f72b0a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:03.151 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient(hunting): get_auth_request con 0x55b5f1c76f80 auth_method 0 2024-09-12T17:35:03.152 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:03.152 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:03.152 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:03.152 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:35:02.971+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.152 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:35:02.971+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.152 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:35:02.971+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.152 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.152 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.152 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.152 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient(hunting): handle_auth_done global_id 6551 payload 824 2024-09-12T17:35:03.152 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient: _finish_hunting 0 2024-09-12T17:35:03.152 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:35:02.971+0000 7f72b020a640 1 monclient: found mon.noname-c 2024-09-12T17:35:03.152 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:35:02.971+0000 7f72b020a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:35:03.152 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:35:02.971+0000 7f72afa09640 10 monclient: get_auth_request con 0x55b5f1c78c70 auth_method 0 2024-09-12T17:35:03.153 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.153 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:35:03.153 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: dump: 2024-09-12T17:35:03.153 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.153 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.153 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.153 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.153 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.153 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.153 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.153 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.153 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.154 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.154 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: _finish_auth 0 2024-09-12T17:35:03.154 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:35:03.154 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:03.154 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.154 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:35:03.154 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:35:02.971+0000 7f7195ffb640 10 monclient: dump: 2024-09-12T17:35:03.154 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.154 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.154 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.154 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.154 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.154 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.155 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.155 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.155 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.155 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.155 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:35:02.971+0000 7f72b27049c0 5 monclient: authenticate success, global_id 6551 2024-09-12T17:35:03.155 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:35:02.971+0000 7f72b120c640 4 set_mon_vals no callback set 2024-09-12T17:35:03.155 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: _renew_subs 2024-09-12T17:35:03.155 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:03.155 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: _renew_subs 2024-09-12T17:35:03.155 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:35:02.971+0000 7f72b27049c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:03.155 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:35:02.975+0000 7f7195ffb640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:35:03.155 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:35:02.975+0000 7f7195ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:03.155 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:35:02.975+0000 7f7195ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:03.156 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: get_monmap_and_config 2024-09-12T17:35:03.156 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: build_initial_monmap 2024-09-12T17:35:03.156 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:35:02.975+0000 7f72b27049c0 1 build_initial for_mkfs: 0 2024-09-12T17:35:03.156 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: monmap: 2024-09-12T17:35:03.156 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:35:03.156 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:03.156 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:35:03.156 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:35:03.156 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:03.156 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.156 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:35:03.156 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:35:03.157 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:35:03.157 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.157 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding auth protocol: cephx 2024-09-12T17:35:03.157 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding auth protocol: cephx 2024-09-12T17:35:03.157 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding auth protocol: cephx 2024-09-12T17:35:03.157 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: secure 2024-09-12T17:35:03.157 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: crc 2024-09-12T17:35:03.157 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: secure 2024-09-12T17:35:03.157 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: crc 2024-09-12T17:35:03.157 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: secure 2024-09-12T17:35:03.157 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: crc 2024-09-12T17:35:03.157 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: crc 2024-09-12T17:35:03.157 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: secure 2024-09-12T17:35:03.158 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: crc 2024-09-12T17:35:03.158 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: secure 2024-09-12T17:35:03.158 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: crc 2024-09-12T17:35:03.158 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98350) adding con mode: secure 2024-09-12T17:35:03.158 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient: get_auth_request con 0x7f7188070a20 auth_method 0 2024-09-12T17:35:03.158 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:35:02.975+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.158 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: init 2024-09-12T17:35:03.158 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding auth protocol: cephx 2024-09-12T17:35:03.158 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding auth protocol: cephx 2024-09-12T17:35:03.158 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding auth protocol: cephx 2024-09-12T17:35:03.158 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: secure 2024-09-12T17:35:03.158 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: crc 2024-09-12T17:35:03.158 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: secure 2024-09-12T17:35:03.159 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: crc 2024-09-12T17:35:03.159 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: secure 2024-09-12T17:35:03.159 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: crc 2024-09-12T17:35:03.159 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: crc 2024-09-12T17:35:03.159 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: secure 2024-09-12T17:35:03.159 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: crc 2024-09-12T17:35:03.159 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: secure 2024-09-12T17:35:03.159 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: crc 2024-09-12T17:35:03.159 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e542f80) adding con mode: secure 2024-09-12T17:35:03.159 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:35:02.975+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.159 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:35:02.975+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.159 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd1e5430c8 EEXIST 2024-09-12T17:35:03.159 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: _reopen_session rank -1 2024-09-12T17:35:03.159 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:35:03.160 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-c con 0x55b5f1ccc850 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:35:03.160 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-a con 0x55b5f1cc7ed0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:35:03.160 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-b con 0x55b5f1cd1370 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:35:03.160 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.160 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.160 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.160 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient(hunting): _renew_subs 2024-09-12T17:35:03.160 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient(hunting): authenticate will time out at 2471.009961s 2024-09-12T17:35:03.160 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient(hunting): get_auth_request con 0x55b5f1ccc850 auth_method 0 2024-09-12T17:35:03.160 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:03.160 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:03.160 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:03.160 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:35:02.975+0000 7f72b0a0b640 10 monclient(hunting): get_auth_request con 0x55b5f1cc7ed0 auth_method 0 2024-09-12T17:35:03.160 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:35:02.975+0000 7f72b0a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:03.161 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:35:02.975+0000 7f72b0a0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:03.161 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:35:02.975+0000 7f72b0a0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:03.161 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.161 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.161 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.161 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:35:02.975+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.161 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:35:02.975+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.161 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:35:02.975+0000 7f72b0a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.161 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient(hunting): handle_auth_done global_id 6554 payload 274 2024-09-12T17:35:03.161 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient: _finish_hunting 0 2024-09-12T17:35:03.161 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:35:02.975+0000 7f72afa09640 1 monclient: found mon.noname-c 2024-09-12T17:35:03.161 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:35:02.975+0000 7f72afa09640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:35:03.162 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.162 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:35:03.162 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: dump: 2024-09-12T17:35:03.162 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.162 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.162 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.162 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.162 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.162 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.162 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.162 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.162 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.163 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.163 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: _finish_auth 0 2024-09-12T17:35:03.163 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: _check_auth_tickets 2024-09-12T17:35:03.163 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:03.163 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.163 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:35:03.163 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:35:02.975+0000 7f71877fe640 10 monclient: dump: 2024-09-12T17:35:03.163 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.163 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.163 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.163 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.163 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.163 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.164 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.164 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.164 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.164 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.164 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 monclient: authenticate success, global_id 6554 2024-09-12T17:35:03.164 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: get_monmap_and_config success 2024-09-12T17:35:03.164 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:35:02.975+0000 7f72b27049c0 4 set_mon_vals no callback set 2024-09-12T17:35:03.164 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: shutdown 2024-09-12T17:35:03.164 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: build_initial_monmap 2024-09-12T17:35:03.164 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:35:02.975+0000 7f72b27049c0 1 build_initial for_mkfs: 0 2024-09-12T17:35:03.164 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: monmap: 2024-09-12T17:35:03.164 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:35:03.165 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:03.165 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:35:03.165 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:35:03.165 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:03.165 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.165 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:35:03.165 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:35:03.165 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:35:03.165 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.165 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding auth protocol: cephx 2024-09-12T17:35:03.165 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding auth protocol: cephx 2024-09-12T17:35:03.165 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding auth protocol: cephx 2024-09-12T17:35:03.165 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: secure 2024-09-12T17:35:03.165 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: crc 2024-09-12T17:35:03.166 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: secure 2024-09-12T17:35:03.166 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: crc 2024-09-12T17:35:03.166 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: secure 2024-09-12T17:35:03.166 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: crc 2024-09-12T17:35:03.166 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: crc 2024-09-12T17:35:03.166 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: secure 2024-09-12T17:35:03.166 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: crc 2024-09-12T17:35:03.166 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: secure 2024-09-12T17:35:03.166 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: crc 2024-09-12T17:35:03.166 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c98300) adding con mode: secure 2024-09-12T17:35:03.166 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:35:02.975+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.166 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:35:02.975+0000 7f72b27049c0 1 librados: starting msgr at 2024-09-12T17:35:03.166 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:35:02.975+0000 7f72b27049c0 1 librados: starting objecter 2024-09-12T17:35:03.167 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b5f1c7d880 EEXIST 2024-09-12T17:35:03.167 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:35:02.975+0000 7f72b27049c0 1 librados: setting wanted keys 2024-09-12T17:35:03.167 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:35:02.975+0000 7f72b27049c0 1 librados: calling monclient init 2024-09-12T17:35:03.167 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:35:02.975+0000 7f72b27049c0 10 monclient: init 2024-09-12T17:35:03.167 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding auth protocol: cephx 2024-09-12T17:35:03.167 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding auth protocol: cephx 2024-09-12T17:35:03.167 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding auth protocol: cephx 2024-09-12T17:35:03.167 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: secure 2024-09-12T17:35:03.167 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: crc 2024-09-12T17:35:03.167 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: secure 2024-09-12T17:35:03.167 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: crc 2024-09-12T17:35:03.167 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: secure 2024-09-12T17:35:03.167 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: crc 2024-09-12T17:35:03.167 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: crc 2024-09-12T17:35:03.167 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: secure 2024-09-12T17:35:03.168 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: crc 2024-09-12T17:35:03.168 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: secure 2024-09-12T17:35:03.168 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: crc 2024-09-12T17:35:03.168 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:35:02.975+0000 7f72b27049c0 5 AuthRegistry(0x55b5f1c7aa90) adding con mode: secure 2024-09-12T17:35:03.168 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:35:02.979+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.168 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:35:02.979+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.168 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:35:02.979+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command rotate-key cmddesc rotate-key hook 0x55b5f1c7abd8 EEXIST 2024-09-12T17:35:03.168 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient: _reopen_session rank -1 2024-09-12T17:35:03.168 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:35:03.168 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-c con 0x55b5f1cc7ed0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:35:03.168 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-b con 0x55b5f1ccc850 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:35:03.168 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient(hunting): picked mon.noname-a con 0x55b5f1cd1370 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:35:03.168 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.169 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.169 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:03.169 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient(hunting): _renew_subs 2024-09-12T17:35:03.169 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient(hunting): authenticate will time out at 2471.012546s 2024-09-12T17:35:03.169 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient(hunting): get_auth_request con 0x55b5f1cc7ed0 auth_method 0 2024-09-12T17:35:03.169 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:03.169 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:03.169 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:03.169 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:35:02.979+0000 7f72b020a640 10 monclient(hunting): get_auth_request con 0x55b5f1cd1370 auth_method 0 2024-09-12T17:35:03.169 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:35:02.979+0000 7f72b020a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:03.169 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:35:02.979+0000 7f72b020a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:03.169 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:35:02.979+0000 7f72b020a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:03.170 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.170 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.170 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.170 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:35:02.979+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:03.170 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:35:02.979+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:03.170 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:35:02.979+0000 7f72b020a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:03.170 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient(hunting): handle_auth_done global_id 6557 payload 824 2024-09-12T17:35:03.170 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient: _finish_hunting 0 2024-09-12T17:35:03.170 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:35:02.979+0000 7f72afa09640 1 monclient: found mon.noname-c 2024-09-12T17:35:03.170 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:35:02.979+0000 7f72afa09640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:35:03.170 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:35:02.979+0000 7f72b0a0b640 10 monclient: get_auth_request con 0x55b5f1ccc850 auth_method 0 2024-09-12T17:35:03.170 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.171 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:35:03.171 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: dump: 2024-09-12T17:35:03.171 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.171 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.171 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.171 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.171 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.171 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.171 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.171 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.171 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.171 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.171 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: _finish_auth 0 2024-09-12T17:35:03.172 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:35:03.172 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:03.172 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:03.172 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:35:03.172 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:35:02.979+0000 7f7185ffb640 10 monclient: dump: 2024-09-12T17:35:03.172 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:03.172 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:03.172 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.172 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:03.172 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:03.172 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:03.172 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:03.173 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:03.173 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:03.173 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.173 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:35:02.979+0000 7f72b27049c0 5 monclient: authenticate success, global_id 6557 2024-09-12T17:35:03.173 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:35:02.979+0000 7f71877fe640 4 set_mon_vals no callback set 2024-09-12T17:35:03.173 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient: _renew_subs 2024-09-12T17:35:03.173 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:03.173 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient: _renew_subs 2024-09-12T17:35:03.173 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:35:02.979+0000 7f72b27049c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:03.173 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:35:02.979+0000 7f72b27049c0 1 librados: init done 2024-09-12T17:35:03.173 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:35:02.979+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command cr dump hook 0x55b5f1cbc918 2024-09-12T17:35:03.173 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:35:02.979+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.173 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:35:02.979+0000 7f7185ffb640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:35:03.174 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:35:02.979+0000 7f7185ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:03.174 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:35:02.979+0000 7f7185ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:03.174 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:35:02.983+0000 7f72b0a0b640 10 monclient: get_auth_request con 0x7f7178070ae0 auth_method 0 2024-09-12T17:35:03.174 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:35:02.983+0000 7f72b020a640 10 monclient: get_auth_request con 0x55b5f1ce6850 auth_method 0 2024-09-12T17:35:03.174 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.174 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 realm 2024-09-12T17:35:03.174 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.174 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.174 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:35:02.983+0000 7f72b27049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:03.174 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.174 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.174 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.174 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:35:02.983+0000 7f72afa09640 10 monclient: get_auth_request con 0x55b5f1ceab80 auth_method 0 2024-09-12T17:35:03.175 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:03.175 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:35:02.983+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.175 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:35:02.983+0000 7f72b0a0b640 10 monclient: get_auth_request con 0x55b5f1cee2a0 auth_method 0 2024-09-12T17:35:03.175 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:35:02.987+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:03.175 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:35:02.987+0000 7f72b27049c0 20 searching for the correct realm 2024-09-12T17:35:03.175 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:35:02.987+0000 7f72b020a640 10 monclient: get_auth_request con 0x55b5f1cf3060 auth_method 0 2024-09-12T17:35:03.175 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:35:02.987+0000 7f72afa09640 10 monclient: get_auth_request con 0x7f72a0017020 auth_method 0 2024-09-12T17:35:03.175 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:35:02.987+0000 7f72b0a0b640 10 monclient: get_auth_request con 0x7f729802c040 auth_method 0 2024-09-12T17:35:03.175 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:35:02.991+0000 7f72b020a640 0 -- 172.21.15.119:0/2512682063 >> [v2:172.21.15.119:6800/1732749810,v1:172.21.15.119:6801/1732749810] conn(0x55b5f1cf3060 msgr2=0x55b5f1cf5520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:03.175 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:35:02.991+0000 7f7185ffb640 1 client.6557.objecter ms_handle_reset 0x55b5f1cf3060 session 0x55b5f1cf29e0 osd.3 2024-09-12T17:35:03.175 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:35:02.991+0000 7f7185ffb640 10 monclient: _renew_subs 2024-09-12T17:35:03.175 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:35:02.991+0000 7f7185ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:03.175 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:35:02.991+0000 7f72b020a640 10 monclient: get_auth_request con 0x7f7178081290 auth_method 0 2024-09-12T17:35:03.176 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:35:02.995+0000 7f72b020a640 10 monclient: get_auth_request con 0x7f72a80c8040 auth_method 0 2024-09-12T17:35:03.176 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:35:02.999+0000 7f72afa09640 10 monclient: get_auth_request con 0x7f72a80c7950 auth_method 0 2024-09-12T17:35:03.176 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:35:02.999+0000 7f72afa09640 0 -- 172.21.15.119:0/2512682063 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f72a80c7950 msgr2=0x7f72a80e13f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:03.176 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:35:02.999+0000 7f7185ffb640 1 client.6557.objecter ms_handle_reset 0x7f72a80c7950 session 0x7f72a80d4e50 osd.0 2024-09-12T17:35:03.176 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:35:02.999+0000 7f72afa09640 10 monclient: get_auth_request con 0x55b5f1cf3060 auth_method 0 2024-09-12T17:35:03.176 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:03.176 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:03.176 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:03.176 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:03.176 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:03.176 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:03.176 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.176 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.177 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.177 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:03.177 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.177 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:03.177 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 zone default found 2024-09-12T17:35:03.177 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:35:03.007+0000 7f72b27049c0 4 Realm: () 2024-09-12T17:35:03.177 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:35:03.007+0000 7f72b27049c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:03.177 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:35:03.007+0000 7f72b27049c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:03.177 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:35:03.007+0000 7f72b27049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:03.177 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 zonegroup default 2024-09-12T17:35:03.177 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.177 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.177 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:35:03.007+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.178 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:35:03.011+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.178 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:35:03.011+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.178 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:35:03.011+0000 7f72b27049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.178 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:35:03.011+0000 7f72b27049c0 20 started sync module instance, tier type = 2024-09-12T17:35:03.178 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:35:03.011+0000 7f72b27049c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:03.178 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=0 2024-09-12T17:35:03.178 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=1 2024-09-12T17:35:03.178 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=2 2024-09-12T17:35:03.178 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=3 2024-09-12T17:35:03.178 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=4 2024-09-12T17:35:03.178 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=5 2024-09-12T17:35:03.178 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:35:03.031+0000 7f72b27049c0 20 add_watcher() i=6 2024-09-12T17:35:03.179 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:35:03.035+0000 7f72b27049c0 20 add_watcher() i=7 2024-09-12T17:35:03.179 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:35:03.035+0000 7f72b27049c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:03.179 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding auth protocol: cephx 2024-09-12T17:35:03.179 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding auth protocol: cephx 2024-09-12T17:35:03.179 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding auth protocol: cephx 2024-09-12T17:35:03.179 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: secure 2024-09-12T17:35:03.179 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: crc 2024-09-12T17:35:03.179 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: secure 2024-09-12T17:35:03.179 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:35:03.035+0000 7f71677de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:03.179 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: crc 2024-09-12T17:35:03.179 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: secure 2024-09-12T17:35:03.179 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: crc 2024-09-12T17:35:03.179 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: crc 2024-09-12T17:35:03.180 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: secure 2024-09-12T17:35:03.180 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: crc 2024-09-12T17:35:03.180 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: secure 2024-09-12T17:35:03.180 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: crc 2024-09-12T17:35:03.180 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 AuthRegistry(0x7ffd1e543450) adding con mode: secure 2024-09-12T17:35:03.180 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:35:03.035+0000 7f72b27049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:03.180 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:35:03.035+0000 7f72b27049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:03.180 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:35:03.035+0000 7f72b27049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:03.180 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command cache list hook 0x55b5f1cc5170 2024-09-12T17:35:03.180 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command cache inspect hook 0x55b5f1cc5170 2024-09-12T17:35:03.180 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command cache erase hook 0x55b5f1cc5170 2024-09-12T17:35:03.180 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command cache zap hook 0x55b5f1cc5170 2024-09-12T17:35:03.180 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:35:03.035+0000 7f72b27049c0 5 note: GC not initialized 2024-09-12T17:35:03.180 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:35:03.039+0000 7f71667dc640 20 reqs_thread_entry: start 2024-09-12T17:35:03.181 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:35:03.039+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command sync trace show hook 0x7f729800b880 2024-09-12T17:35:03.181 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:35:03.039+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command sync trace history hook 0x7f729800b880 2024-09-12T17:35:03.181 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:35:03.039+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command sync trace active hook 0x7f729800b880 2024-09-12T17:35:03.181 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:35:03.039+0000 7f72b27049c0 5 asok(0x55b5f19f02b0) register_command sync trace active_short hook 0x7f729800b880 2024-09-12T17:35:03.181 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:35:03.039+0000 7f72b27049c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:03.181 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:35:03.039+0000 7f72b27049c0 20 Filter name: none 2024-09-12T17:35:03.181 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:35:03.039+0000 7f715f7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:03.181 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:35:03.181 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:35:03.039+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.181 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:35:03.039+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:35:03.181 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:35:03.181 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:35:03.181 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 : miss 2024-09-12T17:35:03.182 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:35:03.039+0000 7f72b27049c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.182 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:35:03.039+0000 7f72b27049c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:35:03.182 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:03.182 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:03.182 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:03.182 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:03.182 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:35:03.039+0000 7f72b27049c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 2024-09-12T17:35:03.182 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:35:03.051+0000 7f72b27049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:03.182 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:35:03.051+0000 7f72b27049c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:03.182 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:35:03.051+0000 7f72b27049c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:03.182 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:35:03.051+0000 7f72b27049c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28, ofs0, ns] 2024-09-12T17:35:03.182 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:35:03.051+0000 7f71877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333491 cookie 94239934348656 notifier 6557 bl.length()=1023 2024-09-12T17:35:03.183 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:35:03.051+0000 7f71877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:03.183 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:35:03.051+0000 7f71877fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:03.183 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:35:03.051+0000 7f71877fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:03.183 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:35:03.051+0000 7f72b27049c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): orig_sources= new_sources= 2024-09-12T17:35:03.183 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:35:03.051+0000 7f72b27049c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): potential sources added=[] removed=[] 2024-09-12T17:35:03.183 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:35:03.051+0000 7f72b27049c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): orig_dests= new_dests= 2024-09-12T17:35:03.183 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:35:03.051+0000 7f72b27049c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): potential dests added=[] removed=[] 2024-09-12T17:35:03.183 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:35:03.055+0000 7f72b27049c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f72b27049c0 time 2024-09-12T17:35:03.056333+0000 2024-09-12T17:35:03.183 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:35:03.183 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.183 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:03.183 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f72b5fde2eb] 2024-09-12T17:35:03.184 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f72b5fde49f] 2024-09-12T17:35:03.184 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ef58c0c1] 2024-09-12T17:35:03.184 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x141007e) [0x55b5effe207e] 2024-09-12T17:35:03.184 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b5ef59e18d] 2024-09-12T17:35:03.184 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:35:03.184 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f72b4e44d90] 2024-09-12T17:35:03.184 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:35:03.184 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:35:03.184 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.184 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:35:03.055+0000 7f72b27049c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:35:03.184 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f72b27049c0 thread_name:radosgw-admin 2024-09-12T17:35:03.184 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.185 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:03.185 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f72b4e5d520] 2024-09-12T17:35:03.185 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:35:03.185 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:35:03.185 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:35:03.185 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f72b5fde345] 2024-09-12T17:35:03.185 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f72b5fde49f] 2024-09-12T17:35:03.185 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ef58c0c1] 2024-09-12T17:35:03.185 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x141007e) [0x55b5effe207e] 2024-09-12T17:35:03.185 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b5ef59e18d] 2024-09-12T17:35:03.185 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:35:03.185 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f72b4e44d90] 2024-09-12T17:35:03.185 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:35:03.186 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:35:03.186 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:35:03.186 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.186 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:35:03.186 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:35:03.186 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:35:03.186 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:35:03.186 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:35:03.186 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:35:03.186 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:35:03.186 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:35:03.186 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:35:03.186 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:35:03.187 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:35:03.187 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:35:03.187 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:35:03.187 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:35:03.187 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:35:03.187 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:35:03.187 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:35:03.187 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:35:03.187 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:35:03.187 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:35:03.187 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:35:03.187 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:35:03.187 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:35:03.188 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:35:03.188 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:35:03.188 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:35:03.188 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:35:03.188 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:35:03.188 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:35:03.188 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:35:03.188 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:35:03.188 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:35:03.188 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:35:03.188 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:35:03.188 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:35:03.188 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:35:03.189 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:35:03.189 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:35:03.189 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:35:03.189 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:35:03.189 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:35:03.189 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:35:03.189 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:35:03.189 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:35:03.189 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:35:03.189 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:35:03.189 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:35:03.189 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:35:03.189 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:35:03.189 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:35:03.190 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:35:03.190 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:35:03.190 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:35:03.190 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:35:03.190 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:35:03.190 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:35:03.190 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:35:03.190 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:35:03.190 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:35:03.190 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:35:03.190 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:35:03.190 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:35:03.190 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:35:03.190 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:35:03.191 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:35:03.191 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:35:03.191 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:35:03.191 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:35:03.191 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:35:03.191 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:35:03.191 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:35:03.191 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:35:03.191 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:35:03.191 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:35:03.191 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:35:03.191 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:35:03.191 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:35:03.191 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:35:03.192 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:35:03.192 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:35:03.192 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:35:03.192 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:35:03.192 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:35:03.192 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:35:03.192 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:35:03.192 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:35:03.192 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:35:03.192 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:35:03.192 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:35:03.192 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:35:03.192 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:35:03.193 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:35:03.193 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:35:03.193 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:35:03.193 INFO:tasks.workunit.client.0.smithi119.stderr: 7f715f7fe640 / http_manager 2024-09-12T17:35:03.193 INFO:tasks.workunit.client.0.smithi119.stderr: 7f71667dc640 / http_manager 2024-09-12T17:35:03.193 INFO:tasks.workunit.client.0.smithi119.stderr: 7f71677de640 / rgw_dt_lg_renew 2024-09-12T17:35:03.193 INFO:tasks.workunit.client.0.smithi119.stderr: 7f7185ffb640 / ms_dispatch 2024-09-12T17:35:03.193 INFO:tasks.workunit.client.0.smithi119.stderr: 7f71877fe640 / io_context_pool 2024-09-12T17:35:03.193 INFO:tasks.workunit.client.0.smithi119.stderr: 7f7195ffb640 / ms_dispatch 2024-09-12T17:35:03.193 INFO:tasks.workunit.client.0.smithi119.stderr: 7f719ce09640 / ms_dispatch 2024-09-12T17:35:03.193 INFO:tasks.workunit.client.0.smithi119.stderr: 7f719e60c640 / io_context_pool 2024-09-12T17:35:03.193 INFO:tasks.workunit.client.0.smithi119.stderr: 7f72afa09640 / msgr-worker-2 2024-09-12T17:35:03.193 INFO:tasks.workunit.client.0.smithi119.stderr: 7f72b020a640 / msgr-worker-1 2024-09-12T17:35:03.194 INFO:tasks.workunit.client.0.smithi119.stderr: 7f72b0a0b640 / msgr-worker-0 2024-09-12T17:35:03.194 INFO:tasks.workunit.client.0.smithi119.stderr: 7f72b120c640 / io_context_pool 2024-09-12T17:35:03.194 INFO:tasks.workunit.client.0.smithi119.stderr: 7f72b27049c0 / radosgw-admin 2024-09-12T17:35:03.194 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:35:03.194 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:35:03.194 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:35:03.058963Z_f39d7f30-e4eb-4a26-a3b2-33f648a05971/log 2024-09-12T17:35:03.194 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:35:03.194 INFO:tasks.workunit.client.0.smithi119.stderr:Aborted 2024-09-12T17:35:03.194 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:35:03.196 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:03.196 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:03.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.135+0000 7f908ad609c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.139+0000 7f908ad609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.139+0000 7f908ad609c0 20 realm 2024-09-12T17:35:03.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.139+0000 7f908ad609c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.139+0000 7f908ad609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.139+0000 7f908ad609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:03.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.139+0000 7f908ad609c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.139+0000 7f908ad609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.139+0000 7f908ad609c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.143+0000 7f908ad609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:03.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.143+0000 7f908ad609c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.143+0000 7f908ad609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:03.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.143+0000 7f908ad609c0 20 searching for the correct realm 2024-09-12T17:35:03.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.147+0000 7f9088065640 0 -- 172.21.15.119:0/2292881679 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f90780b63f0 msgr2=0x7f90780b6870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:03.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.155+0000 7f9088065640 0 -- 172.21.15.119:0/2292881679 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f908006e480 msgr2=0x7f908009a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:03.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.371+0000 7f908ad609c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:03.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.371+0000 7f908ad609c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:03.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.371+0000 7f908ad609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:03.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.371+0000 7f908ad609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:03.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.371+0000 7f908ad609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:03.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.371+0000 7f908ad609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:03.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.371+0000 7f908ad609c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.371+0000 7f908ad609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.371+0000 7f908ad609c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:03.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:03.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 20 zone default found 2024-09-12T17:35:03.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 4 Realm: () 2024-09-12T17:35:03.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:03.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:03.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:03.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 20 zonegroup default 2024-09-12T17:35:03.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 20 started sync module instance, tier type = 2024-09-12T17:35:03.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.375+0000 7f908ad609c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:03.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.403+0000 7f908ad609c0 20 add_watcher() i=0 2024-09-12T17:35:03.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.403+0000 7f908ad609c0 20 add_watcher() i=1 2024-09-12T17:35:03.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.403+0000 7f908ad609c0 20 add_watcher() i=2 2024-09-12T17:35:03.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.403+0000 7f908ad609c0 20 add_watcher() i=3 2024-09-12T17:35:03.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.403+0000 7f908ad609c0 20 add_watcher() i=4 2024-09-12T17:35:03.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.403+0000 7f908ad609c0 20 add_watcher() i=5 2024-09-12T17:35:03.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.403+0000 7f908ad609c0 20 add_watcher() i=6 2024-09-12T17:35:03.402 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.403+0000 7f908ad609c0 20 add_watcher() i=7 2024-09-12T17:35:03.402 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.403+0000 7f908ad609c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:03.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.411+0000 7f8f3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:03.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.411+0000 7f908ad609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:03.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.411+0000 7f908ad609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:03.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.411+0000 7f908ad609c0 5 note: GC not initialized 2024-09-12T17:35:03.409 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.411+0000 7f8f3dfe3640 20 reqs_thread_entry: start 2024-09-12T17:35:03.409 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.411+0000 7f908ad609c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:03.409 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.411+0000 7f908ad609c0 20 Filter name: none 2024-09-12T17:35:03.409 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.411+0000 7f8eaf7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:03.409 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.411+0000 7f908ad609c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.410 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.411+0000 7f908ad609c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:35:03.410 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.411+0000 7f908ad609c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.415+0000 7f908ad609c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:35:03.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.415+0000 7f908ad609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:03.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.415+0000 7f908ad609c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.415+0000 7f908ad609c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:35:03.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.415+0000 7f908ad609c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.415+0000 7f908ad609c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:35:03.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.419+0000 7f908ad609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:03.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.419+0000 7f8f3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:03.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.427+0000 7f908ad609c0 20 remove_watcher() i=0 2024-09-12T17:35:03.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.427+0000 7f908ad609c0 2 removed watcher, disabling cache 2024-09-12T17:35:03.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.431+0000 7f908ad609c0 20 remove_watcher() i=1 2024-09-12T17:35:03.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.431+0000 7f908ad609c0 20 remove_watcher() i=2 2024-09-12T17:35:03.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.435+0000 7f908ad609c0 20 remove_watcher() i=3 2024-09-12T17:35:03.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.435+0000 7f908ad609c0 20 remove_watcher() i=4 2024-09-12T17:35:03.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.439+0000 7f908ad609c0 20 remove_watcher() i=5 2024-09-12T17:35:03.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.439+0000 7f908ad609c0 20 remove_watcher() i=6 2024-09-12T17:35:03.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.443+0000 7f908ad609c0 20 remove_watcher() i=7 2024-09-12T17:35:03.454 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.454 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:35:03.454 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-trim-reshard-log-entries id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:35:03.454 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:03.589 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:35:03.625 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:03.625 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:03.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.675+0000 7f18724529c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.676 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.679+0000 7f18724529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.676 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.679+0000 7f18724529c0 20 realm 2024-09-12T17:35:03.676 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.679+0000 7f18724529c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.676 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.679+0000 7f18724529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.676 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.679+0000 7f18724529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:03.676 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.679+0000 7f18724529c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.676 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.679+0000 7f18724529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.676 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.679+0000 7f18724529c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.679+0000 7f18724529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:03.678 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.679+0000 7f18724529c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.683+0000 7f18724529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:03.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.683+0000 7f18724529c0 20 searching for the correct realm 2024-09-12T17:35:03.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.683+0000 7f1870759640 0 -- 172.21.15.119:0/2189753376 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f1864001eb0 msgr2=0x7f1864021460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:03.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.691+0000 7f186f757640 0 -- 172.21.15.119:0/2189753376 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f1868008040 msgr2=0x7f1868019910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:03.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.907+0000 7f18724529c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:03.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.907+0000 7f18724529c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:03.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.907+0000 7f18724529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:03.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.907+0000 7f18724529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:03.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.907+0000 7f18724529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:03.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.907+0000 7f18724529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:03.906 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.907+0000 7f18724529c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.907 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.907+0000 7f18724529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.907 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.907+0000 7f18724529c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.907 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:03.907 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:03.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 20 zone default found 2024-09-12T17:35:03.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 4 Realm: () 2024-09-12T17:35:03.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:03.909 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:03.909 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:03.909 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 20 zonegroup default 2024-09-12T17:35:03.909 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.909 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.909 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:03.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 20 started sync module instance, tier type = 2024-09-12T17:35:03.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.911+0000 7f18724529c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:03.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.935+0000 7f18724529c0 20 add_watcher() i=0 2024-09-12T17:35:03.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.935+0000 7f18724529c0 20 add_watcher() i=1 2024-09-12T17:35:03.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.935+0000 7f18724529c0 20 add_watcher() i=2 2024-09-12T17:35:03.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.935+0000 7f18724529c0 20 add_watcher() i=3 2024-09-12T17:35:03.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.935+0000 7f18724529c0 20 add_watcher() i=4 2024-09-12T17:35:03.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.935+0000 7f18724529c0 20 add_watcher() i=5 2024-09-12T17:35:03.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.935+0000 7f18724529c0 20 add_watcher() i=6 2024-09-12T17:35:03.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.935+0000 7f18724529c0 20 add_watcher() i=7 2024-09-12T17:35:03.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.935+0000 7f18724529c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:03.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.939+0000 7f17267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:03.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.939+0000 7f18724529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:03.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.939+0000 7f18724529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:03.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.939+0000 7f18724529c0 5 note: GC not initialized 2024-09-12T17:35:03.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f17257e2640 20 reqs_thread_entry: start 2024-09-12T17:35:03.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f18724529c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:03.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f18724529c0 20 Filter name: none 2024-09-12T17:35:03.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f171e7fc640 20 reqs_thread_entry: start 2024-09-12T17:35:03.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f18724529c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:35:03.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f18724529c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f18724529c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:35:03.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f18724529c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:35:03.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f18724529c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:35:03.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f18724529c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 : miss 2024-09-12T17:35:03.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f18724529c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:03.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f18724529c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:35:03.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f18724529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:03.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f18724529c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:03.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f18724529c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:03.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f18724529c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:03.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.943+0000 7f18724529c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 2024-09-12T17:35:03.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.947+0000 7f18724529c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to be held by another RGW process; skipping for now 2024-09-12T17:35:03.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.947+0000 7f17267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:03.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.951+0000 7f18724529c0 20 remove_watcher() i=0 2024-09-12T17:35:03.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.951+0000 7f18724529c0 2 removed watcher, disabling cache 2024-09-12T17:35:03.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.955+0000 7f18724529c0 20 remove_watcher() i=1 2024-09-12T17:35:03.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.959+0000 7f18724529c0 20 remove_watcher() i=2 2024-09-12T17:35:03.958 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.959+0000 7f18724529c0 20 remove_watcher() i=3 2024-09-12T17:35:03.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.963+0000 7f18724529c0 20 remove_watcher() i=4 2024-09-12T17:35:03.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.963+0000 7f18724529c0 20 remove_watcher() i=5 2024-09-12T17:35:03.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.967+0000 7f18724529c0 20 remove_watcher() i=6 2024-09-12T17:35:03.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:03.967+0000 7f18724529c0 20 remove_watcher() i=7 2024-09-12T17:35:03.979 INFO:tasks.workunit.client.0.smithi119.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:35:33.996 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:35:34.032 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:34.033 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:34.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.294+0000 7f3c7d9359c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.294+0000 7f3c7d9359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:34.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.294+0000 7f3c7d9359c0 20 realm 2024-09-12T17:35:34.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.294+0000 7f3c7d9359c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.294+0000 7f3c7d9359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:34.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.294+0000 7f3c7d9359c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:34.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.294+0000 7f3c7d9359c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.294+0000 7f3c7d9359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:34.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.294+0000 7f3c7d9359c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.298+0000 7f3c7d9359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:34.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.298+0000 7f3c7d9359c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.297 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.298+0000 7f3c7bc3c640 0 -- 172.21.15.119:0/1492293447 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55ceef7fc3d0 msgr2=0x55ceef7fe7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:34.502 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.502+0000 7f3c7d9359c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:34.502 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.502+0000 7f3c7d9359c0 20 searching for the correct realm 2024-09-12T17:35:34.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.510+0000 7f3c7ac3a640 0 -- 172.21.15.119:0/1492293447 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f3c6c029020 msgr2=0x7f3c6c084900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:34.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.534+0000 7f3c7d9359c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:34.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.534+0000 7f3c7d9359c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:34.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.534+0000 7f3c7d9359c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:34.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.534+0000 7f3c7d9359c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:34.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.534+0000 7f3c7d9359c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:34.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.534+0000 7f3c7d9359c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:34.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.534+0000 7f3c7d9359c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.534+0000 7f3c7d9359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:34.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.534+0000 7f3c7d9359c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.534+0000 7f3c7d9359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:34.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.534+0000 7f3c7d9359c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.538+0000 7f3c7d9359c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:34.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.538+0000 7f3c7d9359c0 20 zone default found 2024-09-12T17:35:34.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.538+0000 7f3c7d9359c0 4 Realm: () 2024-09-12T17:35:34.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.538+0000 7f3c7d9359c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:34.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.538+0000 7f3c7d9359c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:34.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.538+0000 7f3c7d9359c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:34.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.538+0000 7f3c7d9359c0 20 zonegroup default 2024-09-12T17:35:34.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.538+0000 7f3c7d9359c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.538+0000 7f3c7d9359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:34.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.538+0000 7f3c7d9359c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.538+0000 7f3c7d9359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:34.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.538+0000 7f3c7d9359c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.538+0000 7f3c7d9359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:34.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.538+0000 7f3c7d9359c0 20 started sync module instance, tier type = 2024-09-12T17:35:34.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.538+0000 7f3c7d9359c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:34.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.562+0000 7f3c7d9359c0 20 add_watcher() i=0 2024-09-12T17:35:34.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.562+0000 7f3c7d9359c0 20 add_watcher() i=1 2024-09-12T17:35:34.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.562+0000 7f3c7d9359c0 20 add_watcher() i=2 2024-09-12T17:35:34.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.562+0000 7f3c7d9359c0 20 add_watcher() i=3 2024-09-12T17:35:34.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.562+0000 7f3c7d9359c0 20 add_watcher() i=4 2024-09-12T17:35:34.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.562+0000 7f3c7d9359c0 20 add_watcher() i=5 2024-09-12T17:35:34.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.562+0000 7f3c7d9359c0 20 add_watcher() i=6 2024-09-12T17:35:34.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.566+0000 7f3c7d9359c0 20 add_watcher() i=7 2024-09-12T17:35:34.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.566+0000 7f3c7d9359c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:34.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.570+0000 7f3b31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:34.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.570+0000 7f3c7d9359c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:34.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.570+0000 7f3c7d9359c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:34.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.570+0000 7f3c7d9359c0 5 note: GC not initialized 2024-09-12T17:35:34.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.570+0000 7f3b30fe1640 20 reqs_thread_entry: start 2024-09-12T17:35:34.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.570+0000 7f3c7d9359c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:34.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.570+0000 7f3c7d9359c0 20 Filter name: none 2024-09-12T17:35:34.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.570+0000 7f3aaa7fc640 20 reqs_thread_entry: start 2024-09-12T17:35:34.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.570+0000 7f3c7d9359c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:35:34.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.570+0000 7f3c7d9359c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.574+0000 7f3c7d9359c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:35:34.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.574+0000 7f3c7d9359c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:35:34.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.574+0000 7f3c7d9359c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:35:34.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.574+0000 7f3c7d9359c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 : miss 2024-09-12T17:35:34.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.574+0000 7f3c7d9359c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.574+0000 7f3c7d9359c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:35:34.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.574+0000 7f3c7d9359c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:34.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.574+0000 7f3c7d9359c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:34.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.574+0000 7f3c7d9359c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:34.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.574+0000 7f3c7d9359c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:34.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.574+0000 7f3c7d9359c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 2024-09-12T17:35:34.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.578+0000 7f3c7d9359c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:35:34.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.590+0000 7f3c7d9359c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:34.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.590+0000 7f3c7d9359c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:34.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.590+0000 7f3c7d9359c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:34.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.590+0000 7f3c7d9359c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28, ofs0, ns] 2024-09-12T17:35:34.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.590+0000 7f3b5e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333492 cookie 94347269801920 notifier 6602 bl.length()=1023 2024-09-12T17:35:34.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.590+0000 7f3b5e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:34.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.590+0000 7f3b5e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:34.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.590+0000 7f3b5e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:34.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.594+0000 7f3c7d9359c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): orig_sources= new_sources= 2024-09-12T17:35:34.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.594+0000 7f3c7d9359c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): potential sources added=[] removed=[] 2024-09-12T17:35:34.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.594+0000 7f3c7d9359c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): orig_dests= new_dests= 2024-09-12T17:35:34.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.594+0000 7f3c7d9359c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): potential dests added=[] removed=[] 2024-09-12T17:35:34.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.0 2024-09-12T17:35:34.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.0 2024-09-12T17:35:34.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.1 2024-09-12T17:35:34.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.1 2024-09-12T17:35:34.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.2 2024-09-12T17:35:34.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.2 2024-09-12T17:35:34.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.3 2024-09-12T17:35:34.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.3 2024-09-12T17:35:34.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.4 2024-09-12T17:35:34.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.4 2024-09-12T17:35:34.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.5 2024-09-12T17:35:34.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.5 2024-09-12T17:35:34.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.6 2024-09-12T17:35:34.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.6 2024-09-12T17:35:34.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.7 2024-09-12T17:35:34.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.7 2024-09-12T17:35:34.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.8 2024-09-12T17:35:34.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.8 2024-09-12T17:35:34.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.9 2024-09-12T17:35:34.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.9 2024-09-12T17:35:34.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.10 2024-09-12T17:35:34.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.10 2024-09-12T17:35:34.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.11 2024-09-12T17:35:34.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2.11 2024-09-12T17:35:34.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.0 2024-09-12T17:35:34.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.1 2024-09-12T17:35:34.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2 2024-09-12T17:35:34.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.606+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.3 2024-09-12T17:35:34.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.610+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.4 2024-09-12T17:35:34.609 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.610+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.5 2024-09-12T17:35:34.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.610+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.6 2024-09-12T17:35:34.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.614+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.7 2024-09-12T17:35:34.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.614+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.8 2024-09-12T17:35:34.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.614+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.9 2024-09-12T17:35:34.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.614+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.10 2024-09-12T17:35:34.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.622+0000 7f3c7d9359c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:34.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.622+0000 7f3c7d9359c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 2024-09-12T17:35:34.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.626+0000 7f3c7d9359c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:34.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.626+0000 7f3c7d9359c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:34.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.626+0000 7f3c7d9359c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:34.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.626+0000 7f3c7d9359c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28, ofs0, ns] 2024-09-12T17:35:34.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.626+0000 7f3b5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333493 cookie 94347269801920 notifier 6602 bl.length()=1023 2024-09-12T17:35:34.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.626+0000 7f3b5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:34.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.626+0000 7f3b5effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:34.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.626+0000 7f3b5effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:34.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.626+0000 7f3c7d9359c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): orig_sources= new_sources= 2024-09-12T17:35:34.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.626+0000 7f3c7d9359c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): potential sources added=[] removed=[] 2024-09-12T17:35:34.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.626+0000 7f3c7d9359c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): orig_dests= new_dests= 2024-09-12T17:35:34.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.626+0000 7f3c7d9359c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): potential dests added=[] removed=[] 2024-09-12T17:35:34.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.634+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.0 2024-09-12T17:35:34.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.634+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.1 2024-09-12T17:35:34.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.634+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.2 2024-09-12T17:35:34.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.634+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.3 2024-09-12T17:35:34.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.634+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.4 2024-09-12T17:35:34.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.634+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.5 2024-09-12T17:35:34.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.638+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.6 2024-09-12T17:35:34.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.638+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.7 2024-09-12T17:35:34.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.638+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.8 2024-09-12T17:35:34.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.638+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.9 2024-09-12T17:35:34.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.642+0000 7f3c7d9359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28.10 2024-09-12T17:35:34.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.642+0000 7f3c7d9359c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:34.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.642+0000 7f3c7d9359c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 2024-09-12T17:35:34.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.646+0000 7f3c7d9359c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:34.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.646+0000 7f3c7d9359c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:34.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.646+0000 7f3c7d9359c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:34.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.646+0000 7f3c7d9359c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28, ofs0, ns] 2024-09-12T17:35:34.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.646+0000 7f3b5e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333494 cookie 94347269801920 notifier 6602 bl.length()=991 2024-09-12T17:35:34.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.646+0000 7f3b5e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 info.flags=0x17 2024-09-12T17:35:34.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.646+0000 7f3b5e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 to cache LRU end 2024-09-12T17:35:34.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.646+0000 7f3b5e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:34.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.646+0000 7f3c7d9359c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): orig_sources= new_sources= 2024-09-12T17:35:34.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.646+0000 7f3c7d9359c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): potential sources added=[] removed=[] 2024-09-12T17:35:34.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.646+0000 7f3c7d9359c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): orig_dests= new_dests= 2024-09-12T17:35:34.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.646+0000 7f3c7d9359c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28]): potential dests added=[] removed=[] 2024-09-12T17:35:34.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.654+0000 7f3c7d9359c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:35:34.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.658+0000 7f3b31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:34.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.662+0000 7f3c7d9359c0 20 remove_watcher() i=0 2024-09-12T17:35:34.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.662+0000 7f3c7d9359c0 2 removed watcher, disabling cache 2024-09-12T17:35:34.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.666+0000 7f3c7d9359c0 20 remove_watcher() i=1 2024-09-12T17:35:34.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.666+0000 7f3c7d9359c0 20 remove_watcher() i=2 2024-09-12T17:35:34.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.670+0000 7f3c7d9359c0 20 remove_watcher() i=3 2024-09-12T17:35:34.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.670+0000 7f3c7d9359c0 20 remove_watcher() i=4 2024-09-12T17:35:34.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.674+0000 7f3c7d9359c0 20 remove_watcher() i=5 2024-09-12T17:35:34.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.674+0000 7f3c7d9359c0 20 remove_watcher() i=6 2024-09-12T17:35:34.676 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.678+0000 7f3c7d9359c0 20 remove_watcher() i=7 2024-09-12T17:35:34.694 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:35:34.724 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:34.724 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:34.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.770+0000 7f0970d739c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.774+0000 7f0970d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:34.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.774+0000 7f0970d739c0 20 realm 2024-09-12T17:35:34.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.774+0000 7f0970d739c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.774+0000 7f0970d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:34.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.774+0000 7f0970d739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:34.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.774+0000 7f0970d739c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.774+0000 7f0970d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:34.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.774+0000 7f0970d739c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.774+0000 7f0970d739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:34.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.774+0000 7f0970d739c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:34.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.778+0000 7f0970d739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:34.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.778+0000 7f0970d739c0 20 searching for the correct realm 2024-09-12T17:35:34.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.778+0000 7f096f07a640 0 -- 172.21.15.119:0/3286848175 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f0958008040 msgr2=0x7f0958008930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:34.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:34.786+0000 7f096e078640 0 -- 172.21.15.119:0/3286848175 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f0968027030 msgr2=0x7f096802ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:35.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.002+0000 7f0970d739c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:35.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.002+0000 7f0970d739c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:35.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.002+0000 7f0970d739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:35.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.002+0000 7f0970d739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:35.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.002+0000 7f0970d739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:35.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.002+0000 7f0970d739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:35.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.002+0000 7f0970d739c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:35.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.002+0000 7f0970d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:35.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.002+0000 7f0970d739c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:35.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.006+0000 7f0970d739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:35.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.006+0000 7f0970d739c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:35.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.006+0000 7f0970d739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:35.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.006+0000 7f0970d739c0 20 zone default found 2024-09-12T17:35:35.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.006+0000 7f0970d739c0 4 Realm: () 2024-09-12T17:35:35.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.006+0000 7f0970d739c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:35.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.006+0000 7f0970d739c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:35.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.006+0000 7f0970d739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:35.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.006+0000 7f0970d739c0 20 zonegroup default 2024-09-12T17:35:35.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.006+0000 7f0970d739c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:35.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.006+0000 7f0970d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:35.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.006+0000 7f0970d739c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:35.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.006+0000 7f0970d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:35.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.006+0000 7f0970d739c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:35.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.006+0000 7f0970d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:35.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.010+0000 7f0970d739c0 20 started sync module instance, tier type = 2024-09-12T17:35:35.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.010+0000 7f0970d739c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:35.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.030+0000 7f0970d739c0 20 add_watcher() i=0 2024-09-12T17:35:35.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.030+0000 7f0970d739c0 20 add_watcher() i=1 2024-09-12T17:35:35.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.030+0000 7f0970d739c0 20 add_watcher() i=2 2024-09-12T17:35:35.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.030+0000 7f0970d739c0 20 add_watcher() i=3 2024-09-12T17:35:35.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.030+0000 7f0970d739c0 20 add_watcher() i=4 2024-09-12T17:35:35.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.030+0000 7f0970d739c0 20 add_watcher() i=5 2024-09-12T17:35:35.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.030+0000 7f0970d739c0 20 add_watcher() i=6 2024-09-12T17:35:35.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.034+0000 7f0970d739c0 20 add_watcher() i=7 2024-09-12T17:35:35.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.034+0000 7f0970d739c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:35.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.038+0000 7f08257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:35.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.038+0000 7f0970d739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:35.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.038+0000 7f0970d739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:35.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.038+0000 7f0970d739c0 5 note: GC not initialized 2024-09-12T17:35:35.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.038+0000 7f079ffff640 20 reqs_thread_entry: start 2024-09-12T17:35:35.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.038+0000 7f0970d739c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:35.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.038+0000 7f0970d739c0 20 Filter name: none 2024-09-12T17:35:35.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.038+0000 7f079dffb640 20 reqs_thread_entry: start 2024-09-12T17:35:35.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.038+0000 7f0970d739c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:35.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.042+0000 7f0970d739c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:35:35.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.042+0000 7f0970d739c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:35.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.042+0000 7f0970d739c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:35:35.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.042+0000 7f0970d739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:35.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.042+0000 7f0970d739c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:35.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.042+0000 7f0970d739c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:35:35.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.042+0000 7f0970d739c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:35.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.046+0000 7f0970d739c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:35:35.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.046+0000 7f0970d739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:35.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.050+0000 7f08257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:35.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.054+0000 7f0970d739c0 20 remove_watcher() i=0 2024-09-12T17:35:35.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.054+0000 7f0970d739c0 2 removed watcher, disabling cache 2024-09-12T17:35:35.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.054+0000 7f0970d739c0 20 remove_watcher() i=1 2024-09-12T17:35:35.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.058+0000 7f0970d739c0 20 remove_watcher() i=2 2024-09-12T17:35:35.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.058+0000 7f0970d739c0 20 remove_watcher() i=3 2024-09-12T17:35:35.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.062+0000 7f0970d739c0 20 remove_watcher() i=4 2024-09-12T17:35:35.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.062+0000 7f0970d739c0 20 remove_watcher() i=5 2024-09-12T17:35:35.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.066+0000 7f0970d739c0 20 remove_watcher() i=6 2024-09-12T17:35:35.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:35.066+0000 7f0970d739c0 20 remove_watcher() i=7 2024-09-12T17:35:35.084 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:35.084 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:35:35.084 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-trim-reshard-log-entries id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:35:35.084 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:36.061 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T17:35:36.061 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:38.268 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:35:38.301 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:38.301 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:38.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.350+0000 7fbab6ca89c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.350+0000 7fbab6ca89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.350+0000 7fbab6ca89c0 20 realm 2024-09-12T17:35:38.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.350+0000 7fbab6ca89c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.350+0000 7fbab6ca89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.350+0000 7fbab6ca89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:38.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.350+0000 7fbab6ca89c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.350+0000 7fbab6ca89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.350+0000 7fbab6ca89c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.354+0000 7fbab6ca89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:38.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.354+0000 7fbab6ca89c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.354+0000 7fbab6ca89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:38.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.354+0000 7fbab6ca89c0 20 searching for the correct realm 2024-09-12T17:35:38.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.358+0000 7fbab4faf640 0 -- 172.21.15.119:0/3406940940 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x56249b07e490 msgr2=0x56249b080880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:38.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.366+0000 7fbaabfff640 0 -- 172.21.15.119:0/3406940940 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fbaac065480 msgr2=0x7fbaac069120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:38.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.582+0000 7fbab6ca89c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:38.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.582+0000 7fbab6ca89c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:38.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.582+0000 7fbab6ca89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:38.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.582+0000 7fbab6ca89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:38.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.582+0000 7fbab6ca89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:38.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.582+0000 7fbab6ca89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:38.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.582+0000 7fbab6ca89c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.582+0000 7fbab6ca89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.582+0000 7fbab6ca89c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:38.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:38.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 20 zone default found 2024-09-12T17:35:38.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 4 Realm: () 2024-09-12T17:35:38.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:38.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:38.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:38.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 20 zonegroup default 2024-09-12T17:35:38.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 20 started sync module instance, tier type = 2024-09-12T17:35:38.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.586+0000 7fbab6ca89c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:38.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.610+0000 7fbab6ca89c0 20 add_watcher() i=0 2024-09-12T17:35:38.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.610+0000 7fbab6ca89c0 20 add_watcher() i=1 2024-09-12T17:35:38.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.610+0000 7fbab6ca89c0 20 add_watcher() i=2 2024-09-12T17:35:38.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.610+0000 7fbab6ca89c0 20 add_watcher() i=3 2024-09-12T17:35:38.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.610+0000 7fbab6ca89c0 20 add_watcher() i=4 2024-09-12T17:35:38.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.610+0000 7fbab6ca89c0 20 add_watcher() i=5 2024-09-12T17:35:38.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.610+0000 7fbab6ca89c0 20 add_watcher() i=6 2024-09-12T17:35:38.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.614+0000 7fbab6ca89c0 20 add_watcher() i=7 2024-09-12T17:35:38.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.614+0000 7fbab6ca89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:38.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.618+0000 7fb96afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:38.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.618+0000 7fbab6ca89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:38.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.618+0000 7fbab6ca89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:38.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.618+0000 7fbab6ca89c0 5 note: GC not initialized 2024-09-12T17:35:38.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.618+0000 7fb969fdb640 20 reqs_thread_entry: start 2024-09-12T17:35:38.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.618+0000 7fbab6ca89c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:38.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.622+0000 7fbab6ca89c0 20 Filter name: none 2024-09-12T17:35:38.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.622+0000 7fb8db7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:38.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.622+0000 7fbab6ca89c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.622+0000 7fbab6ca89c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:35:38.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.622+0000 7fbab6ca89c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.622+0000 7fbab6ca89c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:35:38.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.622+0000 7fbab6ca89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:38.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.622+0000 7fbab6ca89c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.626+0000 7fbab6ca89c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:35:38.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.626+0000 7fbab6ca89c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.626+0000 7fbab6ca89c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:35:38.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.626+0000 7fbab6ca89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:38.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.630+0000 7fb96afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:38.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.634+0000 7fbab6ca89c0 20 remove_watcher() i=0 2024-09-12T17:35:38.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.634+0000 7fbab6ca89c0 2 removed watcher, disabling cache 2024-09-12T17:35:38.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.638+0000 7fbab6ca89c0 20 remove_watcher() i=1 2024-09-12T17:35:38.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.638+0000 7fbab6ca89c0 20 remove_watcher() i=2 2024-09-12T17:35:38.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.642+0000 7fbab6ca89c0 20 remove_watcher() i=3 2024-09-12T17:35:38.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.642+0000 7fbab6ca89c0 20 remove_watcher() i=4 2024-09-12T17:35:38.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.646+0000 7fbab6ca89c0 20 remove_watcher() i=5 2024-09-12T17:35:38.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.646+0000 7fbab6ca89c0 20 remove_watcher() i=6 2024-09-12T17:35:38.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.646+0000 7fbab6ca89c0 20 remove_watcher() i=7 2024-09-12T17:35:38.663 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:38.663 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:35:38.663 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-block-writes id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:35:38.663 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:38.663 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T17:35:38.700 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:38.701 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:38.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.746+0000 7fe5bba7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.746+0000 7fe5bba7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.746+0000 7fe5bba7d9c0 20 realm 2024-09-12T17:35:38.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.746+0000 7fe5bba7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.750+0000 7fe5bba7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.750+0000 7fe5bba7d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:38.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.750+0000 7fe5bba7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.750+0000 7fe5bba7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.750+0000 7fe5bba7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.750+0000 7fe5bba7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:38.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.750+0000 7fe5bba7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.761 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.754+0000 7fe5bba7d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:38.761 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.754+0000 7fe5bba7d9c0 20 searching for the correct realm 2024-09-12T17:35:38.761 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.754+0000 7fe5b8d82640 0 -- 172.21.15.119:0/3128859793 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fe5ac026070 msgr2=0x7fe5ac05d0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:38.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.762+0000 7fe5b8d82640 0 -- 172.21.15.119:0/3128859793 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x55ad71eb3b10 msgr2=0x7fe484086450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:38.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:38.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:38.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:38.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:38.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:38.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:38.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:38.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:38.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 zone default found 2024-09-12T17:35:38.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 4 Realm: () 2024-09-12T17:35:38.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:38.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:38.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:38.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 zonegroup default 2024-09-12T17:35:38.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 started sync module instance, tier type = 2024-09-12T17:35:38.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.774+0000 7fe5bba7d9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:38.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.790+0000 7fe5bba7d9c0 20 add_watcher() i=0 2024-09-12T17:35:38.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.790+0000 7fe5bba7d9c0 20 add_watcher() i=1 2024-09-12T17:35:38.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.790+0000 7fe5bba7d9c0 20 add_watcher() i=2 2024-09-12T17:35:38.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.790+0000 7fe5bba7d9c0 20 add_watcher() i=3 2024-09-12T17:35:38.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.790+0000 7fe5bba7d9c0 20 add_watcher() i=4 2024-09-12T17:35:38.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.790+0000 7fe5bba7d9c0 20 add_watcher() i=5 2024-09-12T17:35:38.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.790+0000 7fe5bba7d9c0 20 add_watcher() i=6 2024-09-12T17:35:38.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.794+0000 7fe5bba7d9c0 20 add_watcher() i=7 2024-09-12T17:35:38.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.794+0000 7fe5bba7d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:38.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.794+0000 7fe46f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:38.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.794+0000 7fe5bba7d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:38.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.794+0000 7fe5bba7d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:38.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.794+0000 7fe5bba7d9c0 5 note: GC not initialized 2024-09-12T17:35:38.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.794+0000 7fe46e7e4640 20 reqs_thread_entry: start 2024-09-12T17:35:38.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.798+0000 7fe5bba7d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:38.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.798+0000 7fe5bba7d9c0 20 Filter name: none 2024-09-12T17:35:38.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.798+0000 7fe3dffff640 20 reqs_thread_entry: start 2024-09-12T17:35:38.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.798+0000 7fe5bba7d9c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:35:38.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.798+0000 7fe5bba7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.797 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.798+0000 7fe5bba7d9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:35:38.797 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.798+0000 7fe5bba7d9c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:35:38.797 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.798+0000 7fe5bba7d9c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:35:38.797 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.798+0000 7fe5bba7d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 : miss 2024-09-12T17:35:38.797 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.798+0000 7fe5bba7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.798+0000 7fe5bba7d9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:35:38.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.798+0000 7fe5bba7d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 info.flags=0x17 2024-09-12T17:35:38.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.798+0000 7fe5bba7d9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 to cache LRU end 2024-09-12T17:35:38.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.798+0000 7fe5bba7d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:38.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.798+0000 7fe5bba7d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:38.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.798+0000 7fe5bba7d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 2024-09-12T17:35:38.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.810+0000 7fe5bba7d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 info.flags=0x17 2024-09-12T17:35:38.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.810+0000 7fe5bba7d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 to cache LRU end 2024-09-12T17:35:38.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.810+0000 7fe5bba7d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:38.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.810+0000 7fe5bba7d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29, ofs0, ns] 2024-09-12T17:35:38.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.810+0000 7fe49cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333497 cookie 94203428987744 notifier 6656 bl.length()=999 2024-09-12T17:35:38.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.810+0000 7fe49cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 info.flags=0x17 2024-09-12T17:35:38.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.810+0000 7fe49cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 to cache LRU end 2024-09-12T17:35:38.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.810+0000 7fe49cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:38.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.814+0000 7fe5bba7d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): orig_sources= new_sources= 2024-09-12T17:35:38.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.814+0000 7fe5bba7d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): potential sources added=[] removed=[] 2024-09-12T17:35:38.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.814+0000 7fe5bba7d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): orig_dests= new_dests= 2024-09-12T17:35:38.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.814+0000 7fe5bba7d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): potential dests added=[] removed=[] 2024-09-12T17:35:38.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.0 2024-09-12T17:35:38.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.0 2024-09-12T17:35:38.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.1 2024-09-12T17:35:38.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.1 2024-09-12T17:35:38.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.2 2024-09-12T17:35:38.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.2 2024-09-12T17:35:38.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.3 2024-09-12T17:35:38.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.3 2024-09-12T17:35:38.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.4 2024-09-12T17:35:38.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.4 2024-09-12T17:35:38.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.5 2024-09-12T17:35:38.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.5 2024-09-12T17:35:38.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.6 2024-09-12T17:35:38.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.6 2024-09-12T17:35:38.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.7 2024-09-12T17:35:38.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.7 2024-09-12T17:35:38.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.8 2024-09-12T17:35:38.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.8 2024-09-12T17:35:38.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.9 2024-09-12T17:35:38.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.9 2024-09-12T17:35:38.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.10 2024-09-12T17:35:38.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.10 2024-09-12T17:35:38.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.11 2024-09-12T17:35:38.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.11 2024-09-12T17:35:38.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.0 2024-09-12T17:35:38.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1 2024-09-12T17:35:38.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.2 2024-09-12T17:35:38.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.3 2024-09-12T17:35:38.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.4 2024-09-12T17:35:38.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.822+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.5 2024-09-12T17:35:38.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.826+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.6 2024-09-12T17:35:38.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.826+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.7 2024-09-12T17:35:38.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.826+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.8 2024-09-12T17:35:38.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.826+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.9 2024-09-12T17:35:38.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.826+0000 7fe5bba7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.10 2024-09-12T17:35:38.832 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.834+0000 7fe5bba7d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:38.832 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.834+0000 7fe5bba7d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 2024-09-12T17:35:38.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.834+0000 7fe5bba7d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 info.flags=0x17 2024-09-12T17:35:38.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.834+0000 7fe5bba7d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 to cache LRU end 2024-09-12T17:35:38.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.834+0000 7fe5bba7d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:38.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.834+0000 7fe5bba7d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29, ofs0, ns] 2024-09-12T17:35:38.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.834+0000 7fe49cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333498 cookie 94203428987744 notifier 6656 bl.length()=999 2024-09-12T17:35:38.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.838+0000 7fe49cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 info.flags=0x17 2024-09-12T17:35:38.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.838+0000 7fe49cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 to cache LRU end 2024-09-12T17:35:38.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.838+0000 7fe49cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:38.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.838+0000 7fe5bba7d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): orig_sources= new_sources= 2024-09-12T17:35:38.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.838+0000 7fe5bba7d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): potential sources added=[] removed=[] 2024-09-12T17:35:38.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.838+0000 7fe5bba7d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): orig_dests= new_dests= 2024-09-12T17:35:38.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.838+0000 7fe5bba7d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): potential dests added=[] removed=[] 2024-09-12T17:35:38.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.838+0000 7fe5bba7d9c0 -1 Injecting error=-5 at location=block_writes 2024-09-12T17:35:38.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.838+0000 7fe5bba7d9c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:35:38.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.846+0000 7fe5bba7d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:38.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.846+0000 7fe5bba7d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 2024-09-12T17:35:38.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.850+0000 7fe5bba7d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 info.flags=0x17 2024-09-12T17:35:38.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.850+0000 7fe5bba7d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 to cache LRU end 2024-09-12T17:35:38.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.850+0000 7fe5bba7d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:38.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.850+0000 7fe5bba7d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29, ofs0, ns] 2024-09-12T17:35:38.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.850+0000 7fe48bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333499 cookie 94203428987744 notifier 6656 bl.length()=967 2024-09-12T17:35:38.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.850+0000 7fe48bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 info.flags=0x17 2024-09-12T17:35:38.850 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.850+0000 7fe48bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 to cache LRU end 2024-09-12T17:35:38.850 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.850+0000 7fe48bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:38.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.850+0000 7fe5bba7d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): orig_sources= new_sources= 2024-09-12T17:35:38.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.850+0000 7fe5bba7d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): potential sources added=[] removed=[] 2024-09-12T17:35:38.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.850+0000 7fe5bba7d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): orig_dests= new_dests= 2024-09-12T17:35:38.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.850+0000 7fe5bba7d9c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): potential dests added=[] removed=[] 2024-09-12T17:35:38.856 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.858+0000 7fe5bba7d9c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T17:35:38.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.858+0000 7fe46f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:38.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.866+0000 7fe5bba7d9c0 20 remove_watcher() i=0 2024-09-12T17:35:38.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.866+0000 7fe5bba7d9c0 2 removed watcher, disabling cache 2024-09-12T17:35:38.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.866+0000 7fe5bba7d9c0 20 remove_watcher() i=1 2024-09-12T17:35:38.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.870+0000 7fe5bba7d9c0 20 remove_watcher() i=2 2024-09-12T17:35:38.870 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.870+0000 7fe5bba7d9c0 20 remove_watcher() i=3 2024-09-12T17:35:38.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.874+0000 7fe5bba7d9c0 20 remove_watcher() i=4 2024-09-12T17:35:38.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.874+0000 7fe5bba7d9c0 20 remove_watcher() i=5 2024-09-12T17:35:38.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.874+0000 7fe5bba7d9c0 20 remove_watcher() i=6 2024-09-12T17:35:38.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.878+0000 7fe5bba7d9c0 20 remove_watcher() i=7 2024-09-12T17:35:38.889 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:35:38.917 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:38.917 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:38.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.962+0000 7f0be42da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.962+0000 7f0be42da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.962+0000 7f0be42da9c0 20 realm 2024-09-12T17:35:38.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.962+0000 7f0be42da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.962+0000 7f0be42da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.962+0000 7f0be42da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:38.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.962+0000 7f0be42da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.962+0000 7f0be42da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:38.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.962+0000 7f0be42da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.966+0000 7f0be42da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:38.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.966+0000 7f0be42da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:38.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.966+0000 7f0be42da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:38.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.966+0000 7f0be42da9c0 20 searching for the correct realm 2024-09-12T17:35:38.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:38.966+0000 7f0be15df640 0 -- 172.21.15.119:0/3798858532 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f0bd4019040 msgr2=0x7f0bd4063c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:39.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.182+0000 7f0be25e1640 0 -- 172.21.15.119:0/3798858532 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f0bd80cc040 msgr2=0x7f0bd80ae430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:39.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.198+0000 7f0be42da9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:39.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.198+0000 7f0be42da9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:39.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.198+0000 7f0be42da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:39.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.198+0000 7f0be42da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:39.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.198+0000 7f0be42da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:39.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.198+0000 7f0be42da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:39.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.198+0000 7f0be42da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.198+0000 7f0be42da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:39.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.198+0000 7f0be42da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:39.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:39.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 20 zone default found 2024-09-12T17:35:39.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 4 Realm: () 2024-09-12T17:35:39.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:39.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:39.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:39.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 20 zonegroup default 2024-09-12T17:35:39.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:39.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:39.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:39.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 20 started sync module instance, tier type = 2024-09-12T17:35:39.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.202+0000 7f0be42da9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:39.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.226+0000 7f0be42da9c0 20 add_watcher() i=0 2024-09-12T17:35:39.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.226+0000 7f0be42da9c0 20 add_watcher() i=1 2024-09-12T17:35:39.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.226+0000 7f0be42da9c0 20 add_watcher() i=2 2024-09-12T17:35:39.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.226+0000 7f0be42da9c0 20 add_watcher() i=3 2024-09-12T17:35:39.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.226+0000 7f0be42da9c0 20 add_watcher() i=4 2024-09-12T17:35:39.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.226+0000 7f0be42da9c0 20 add_watcher() i=5 2024-09-12T17:35:39.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.226+0000 7f0be42da9c0 20 add_watcher() i=6 2024-09-12T17:35:39.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.226+0000 7f0be42da9c0 20 add_watcher() i=7 2024-09-12T17:35:39.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.226+0000 7f0be42da9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:39.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.230+0000 7f0a937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:39.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.230+0000 7f0be42da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:39.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.230+0000 7f0be42da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:39.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.230+0000 7f0be42da9c0 5 note: GC not initialized 2024-09-12T17:35:39.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.230+0000 7f0a927fc640 20 reqs_thread_entry: start 2024-09-12T17:35:39.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.230+0000 7f0be42da9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:39.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.230+0000 7f0be42da9c0 20 Filter name: none 2024-09-12T17:35:39.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.234+0000 7f0a03fff640 20 reqs_thread_entry: start 2024-09-12T17:35:39.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.234+0000 7f0be42da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.234+0000 7f0be42da9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:35:39.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.234+0000 7f0be42da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.234 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.234+0000 7f0be42da9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:35:39.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.234+0000 7f0be42da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:39.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.234+0000 7f0be42da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.238+0000 7f0be42da9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:35:39.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.238+0000 7f0be42da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.238+0000 7f0be42da9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:35:39.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.238+0000 7f0be42da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:39.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.238+0000 7f0a937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:39.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.246+0000 7f0be42da9c0 20 remove_watcher() i=0 2024-09-12T17:35:39.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.246+0000 7f0be42da9c0 2 removed watcher, disabling cache 2024-09-12T17:35:39.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.246+0000 7f0be42da9c0 20 remove_watcher() i=1 2024-09-12T17:35:39.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.250+0000 7f0be42da9c0 20 remove_watcher() i=2 2024-09-12T17:35:39.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.250+0000 7f0be42da9c0 20 remove_watcher() i=3 2024-09-12T17:35:39.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.254+0000 7f0be42da9c0 20 remove_watcher() i=4 2024-09-12T17:35:39.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.254+0000 7f0be42da9c0 20 remove_watcher() i=5 2024-09-12T17:35:39.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.254+0000 7f0be42da9c0 20 remove_watcher() i=6 2024-09-12T17:35:39.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.258+0000 7f0be42da9c0 20 remove_watcher() i=7 2024-09-12T17:35:39.270 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:39.270 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:35:39.271 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-block-writes id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:35:39.271 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:39.377 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:35:39.413 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:39.413 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:39.458 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.458+0000 7f3f06a159c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.462+0000 7f3f06a159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:39.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.462+0000 7f3f06a159c0 20 realm 2024-09-12T17:35:39.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.462+0000 7f3f06a159c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.462+0000 7f3f06a159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:39.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.462+0000 7f3f06a159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:39.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.462+0000 7f3f06a159c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.462+0000 7f3f06a159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:39.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.462+0000 7f3f06a159c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.462+0000 7f3f06a159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:39.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.462+0000 7f3f06a159c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.466+0000 7f3f06a159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:39.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.466+0000 7f3f06a159c0 20 searching for the correct realm 2024-09-12T17:35:39.467 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.466+0000 7f3f04d1c640 0 -- 172.21.15.119:0/2783619763 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f3ef8018070 msgr2=0x7f3ef8079400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:39.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.682+0000 7f3f03d1a640 0 -- 172.21.15.119:0/2783619763 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f3efc026040 msgr2=0x7f3efc08a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:39.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.898+0000 7f3f06a159c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:39.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.898+0000 7f3f06a159c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:39.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.898+0000 7f3f06a159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:39.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.898+0000 7f3f06a159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:39.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.898+0000 7f3f06a159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:39.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.898+0000 7f3f06a159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:39.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.898+0000 7f3f06a159c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.898+0000 7f3f06a159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:39.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.898+0000 7f3f06a159c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:39.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:39.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 20 zone default found 2024-09-12T17:35:39.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 4 Realm: () 2024-09-12T17:35:39.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:39.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:39.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:39.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 20 zonegroup default 2024-09-12T17:35:39.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:39.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:39.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:39.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 20 started sync module instance, tier type = 2024-09-12T17:35:39.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.902+0000 7f3f06a159c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:39.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.926+0000 7f3f06a159c0 20 add_watcher() i=0 2024-09-12T17:35:39.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.926+0000 7f3f06a159c0 20 add_watcher() i=1 2024-09-12T17:35:39.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.926+0000 7f3f06a159c0 20 add_watcher() i=2 2024-09-12T17:35:39.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.926+0000 7f3f06a159c0 20 add_watcher() i=3 2024-09-12T17:35:39.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.926+0000 7f3f06a159c0 20 add_watcher() i=4 2024-09-12T17:35:39.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.926+0000 7f3f06a159c0 20 add_watcher() i=5 2024-09-12T17:35:39.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.926+0000 7f3f06a159c0 20 add_watcher() i=6 2024-09-12T17:35:39.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.930+0000 7f3f06a159c0 20 add_watcher() i=7 2024-09-12T17:35:39.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.930+0000 7f3f06a159c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:39.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.934+0000 7f3dbafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:39.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.934+0000 7f3f06a159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:39.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.934+0000 7f3f06a159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:39.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.934+0000 7f3f06a159c0 5 note: GC not initialized 2024-09-12T17:35:39.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.934+0000 7f3db9fdb640 20 reqs_thread_entry: start 2024-09-12T17:35:39.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.934+0000 7f3f06a159c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:39.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.934+0000 7f3f06a159c0 20 Filter name: none 2024-09-12T17:35:39.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.934+0000 7f3d2b7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:39.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.934+0000 7f3f06a159c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:35:39.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.934+0000 7f3f06a159c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.938+0000 7f3f06a159c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:35:39.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.938+0000 7f3f06a159c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:35:39.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.938+0000 7f3f06a159c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:35:39.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.938+0000 7f3f06a159c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 : miss 2024-09-12T17:35:39.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.938+0000 7f3f06a159c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:39.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.938+0000 7f3f06a159c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:35:39.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.938+0000 7f3f06a159c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 info.flags=0x17 2024-09-12T17:35:39.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.938+0000 7f3f06a159c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 to cache LRU end 2024-09-12T17:35:39.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.938+0000 7f3f06a159c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:39.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.938+0000 7f3f06a159c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:39.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.938+0000 7f3f06a159c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 2024-09-12T17:35:39.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.950+0000 7f3f06a159c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 info.flags=0x17 2024-09-12T17:35:39.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.950+0000 7f3f06a159c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 to cache LRU end 2024-09-12T17:35:39.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.950+0000 7f3f06a159c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:39.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.950+0000 7f3f06a159c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29, ofs0, ns] 2024-09-12T17:35:39.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.950+0000 7f3ddaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333500 cookie 94493559786160 notifier 6689 bl.length()=999 2024-09-12T17:35:39.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.950+0000 7f3ddaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 info.flags=0x17 2024-09-12T17:35:39.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.950+0000 7f3ddaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 to cache LRU end 2024-09-12T17:35:39.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.950+0000 7f3ddaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:39.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.954+0000 7f3f06a159c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): orig_sources= new_sources= 2024-09-12T17:35:39.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.954+0000 7f3f06a159c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): potential sources added=[] removed=[] 2024-09-12T17:35:39.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.954+0000 7f3f06a159c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): orig_dests= new_dests= 2024-09-12T17:35:39.952 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.954+0000 7f3f06a159c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): potential dests added=[] removed=[] 2024-09-12T17:35:39.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.0 2024-09-12T17:35:39.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.0 2024-09-12T17:35:39.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.1 2024-09-12T17:35:39.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.1 2024-09-12T17:35:39.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.2 2024-09-12T17:35:39.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.2 2024-09-12T17:35:39.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.3 2024-09-12T17:35:39.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.3 2024-09-12T17:35:39.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.4 2024-09-12T17:35:39.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.4 2024-09-12T17:35:39.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.5 2024-09-12T17:35:39.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.5 2024-09-12T17:35:39.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.6 2024-09-12T17:35:39.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.6 2024-09-12T17:35:39.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.7 2024-09-12T17:35:39.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.7 2024-09-12T17:35:39.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.8 2024-09-12T17:35:39.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.8 2024-09-12T17:35:39.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.9 2024-09-12T17:35:39.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.9 2024-09-12T17:35:39.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.10 2024-09-12T17:35:39.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.10 2024-09-12T17:35:39.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.11 2024-09-12T17:35:39.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1.11 2024-09-12T17:35:39.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.0 2024-09-12T17:35:39.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1 2024-09-12T17:35:39.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.2 2024-09-12T17:35:39.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.962+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.3 2024-09-12T17:35:39.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.966+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.4 2024-09-12T17:35:39.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.966+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.5 2024-09-12T17:35:39.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.966+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.6 2024-09-12T17:35:39.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.966+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.7 2024-09-12T17:35:39.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.966+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.8 2024-09-12T17:35:39.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.970+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.9 2024-09-12T17:35:39.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.970+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.10 2024-09-12T17:35:39.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.974+0000 7f3f06a159c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:39.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.974+0000 7f3f06a159c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 2024-09-12T17:35:39.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.978+0000 7f3f06a159c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 info.flags=0x17 2024-09-12T17:35:39.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.978+0000 7f3f06a159c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 to cache LRU end 2024-09-12T17:35:39.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.978+0000 7f3f06a159c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:39.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.978+0000 7f3f06a159c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29, ofs0, ns] 2024-09-12T17:35:39.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.978+0000 7f3ddaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333501 cookie 94493559786160 notifier 6689 bl.length()=999 2024-09-12T17:35:39.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.978+0000 7f3ddaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 info.flags=0x17 2024-09-12T17:35:39.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.978+0000 7f3ddaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 to cache LRU end 2024-09-12T17:35:39.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.978+0000 7f3ddaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:39.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.982+0000 7f3f06a159c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): orig_sources= new_sources= 2024-09-12T17:35:39.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.982+0000 7f3f06a159c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): potential sources added=[] removed=[] 2024-09-12T17:35:39.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.982+0000 7f3f06a159c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): orig_dests= new_dests= 2024-09-12T17:35:39.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.982+0000 7f3f06a159c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): potential dests added=[] removed=[] 2024-09-12T17:35:39.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.986+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.0 2024-09-12T17:35:39.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.986+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.1 2024-09-12T17:35:39.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.986+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.2 2024-09-12T17:35:39.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.986+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.3 2024-09-12T17:35:39.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.990+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.4 2024-09-12T17:35:39.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.990+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.5 2024-09-12T17:35:39.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.990+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.6 2024-09-12T17:35:39.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.990+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.7 2024-09-12T17:35:39.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.990+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.8 2024-09-12T17:35:39.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.990+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.9 2024-09-12T17:35:39.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.990+0000 7f3f06a159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29.10 2024-09-12T17:35:39.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.990+0000 7f3f06a159c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:39.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.994+0000 7f3f06a159c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 2024-09-12T17:35:39.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.994+0000 7f3f06a159c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 info.flags=0x17 2024-09-12T17:35:39.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.994+0000 7f3f06a159c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 to cache LRU end 2024-09-12T17:35:39.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.994+0000 7f3f06a159c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:39.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.994+0000 7f3f06a159c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29, ofs0, ns] 2024-09-12T17:35:39.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.998+0000 7f3ddaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333502 cookie 94493559786160 notifier 6689 bl.length()=967 2024-09-12T17:35:39.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.998+0000 7f3ddaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 info.flags=0x17 2024-09-12T17:35:39.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.998+0000 7f3ddaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 to cache LRU end 2024-09-12T17:35:39.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.998+0000 7f3ddaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:39.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.998+0000 7f3f06a159c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): orig_sources= new_sources= 2024-09-12T17:35:39.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.998+0000 7f3f06a159c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): potential sources added=[] removed=[] 2024-09-12T17:35:39.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.998+0000 7f3f06a159c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): orig_dests= new_dests= 2024-09-12T17:35:39.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:39.998+0000 7f3f06a159c0 20 handle_bi_update(): bucket=:error-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29]): potential dests added=[] removed=[] 2024-09-12T17:35:40.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.002+0000 7f3f06a159c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:35:40.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.006+0000 7f3dbafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:40.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.010+0000 7f3f06a159c0 20 remove_watcher() i=0 2024-09-12T17:35:40.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.010+0000 7f3f06a159c0 2 removed watcher, disabling cache 2024-09-12T17:35:40.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.014+0000 7f3f06a159c0 20 remove_watcher() i=1 2024-09-12T17:35:40.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.014+0000 7f3f06a159c0 20 remove_watcher() i=2 2024-09-12T17:35:40.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.018+0000 7f3f06a159c0 20 remove_watcher() i=3 2024-09-12T17:35:40.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.018+0000 7f3f06a159c0 20 remove_watcher() i=4 2024-09-12T17:35:40.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.022+0000 7f3f06a159c0 20 remove_watcher() i=5 2024-09-12T17:35:40.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.022+0000 7f3f06a159c0 20 remove_watcher() i=6 2024-09-12T17:35:40.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.022+0000 7f3f06a159c0 20 remove_watcher() i=7 2024-09-12T17:35:40.038 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:35:40.068 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:40.068 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:40.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.114+0000 7febe98ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:40.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.118+0000 7febe98ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:40.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.118+0000 7febe98ad9c0 20 realm 2024-09-12T17:35:40.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.118+0000 7febe98ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:40.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.118+0000 7febe98ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:40.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.118+0000 7febe98ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:40.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.118+0000 7febe98ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:40.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.118+0000 7febe98ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:40.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.118+0000 7febe98ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:40.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.118+0000 7febe98ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:40.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.118+0000 7febe98ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:40.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.118+0000 7febe98ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:40.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.118+0000 7febe98ad9c0 20 searching for the correct realm 2024-09-12T17:35:40.124 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.126+0000 7febe6bb2640 0 -- 172.21.15.119:0/4104486934 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7febd801a040 msgr2=0x7febd807f4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:40.130 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.130+0000 7febe6bb2640 0 -- 172.21.15.119:0/4104486934 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7febe0066860 msgr2=0x7febe0094a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:40.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.346+0000 7febe98ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:40.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.346+0000 7febe98ad9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:40.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.346+0000 7febe98ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:40.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.346+0000 7febe98ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:40.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.346+0000 7febe98ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:40.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.346+0000 7febe98ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:40.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.346+0000 7febe98ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:40.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.346+0000 7febe98ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:40.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.346+0000 7febe98ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:40.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:40.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:40.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:40.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 20 zone default found 2024-09-12T17:35:40.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 4 Realm: () 2024-09-12T17:35:40.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:40.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:40.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:40.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 20 zonegroup default 2024-09-12T17:35:40.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:40.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:40.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:40.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:40.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:40.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:40.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 20 started sync module instance, tier type = 2024-09-12T17:35:40.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.350+0000 7febe98ad9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:40.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.374+0000 7febe98ad9c0 20 add_watcher() i=0 2024-09-12T17:35:40.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.374+0000 7febe98ad9c0 20 add_watcher() i=1 2024-09-12T17:35:40.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.374+0000 7febe98ad9c0 20 add_watcher() i=2 2024-09-12T17:35:40.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.374+0000 7febe98ad9c0 20 add_watcher() i=3 2024-09-12T17:35:40.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.374+0000 7febe98ad9c0 20 add_watcher() i=4 2024-09-12T17:35:40.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.374+0000 7febe98ad9c0 20 add_watcher() i=5 2024-09-12T17:35:40.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.374+0000 7febe98ad9c0 20 add_watcher() i=6 2024-09-12T17:35:40.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.374+0000 7febe98ad9c0 20 add_watcher() i=7 2024-09-12T17:35:40.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.374+0000 7febe98ad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:40.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.378+0000 7fea9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:40.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.378+0000 7febe98ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:40.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.378+0000 7febe98ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:40.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.378+0000 7febe98ad9c0 5 note: GC not initialized 2024-09-12T17:35:40.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.378+0000 7fea9cfe1640 20 reqs_thread_entry: start 2024-09-12T17:35:40.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.378+0000 7febe98ad9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:40.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.378+0000 7febe98ad9c0 20 Filter name: none 2024-09-12T17:35:40.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.382+0000 7fea167fc640 20 reqs_thread_entry: start 2024-09-12T17:35:40.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.382+0000 7febe98ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:40.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.382+0000 7febe98ad9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:35:40.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.382+0000 7febe98ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:40.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.382+0000 7febe98ad9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:35:40.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.382+0000 7febe98ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:40.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.382+0000 7febe98ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:40.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.386+0000 7febe98ad9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:35:40.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.386+0000 7febe98ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:40.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.386+0000 7febe98ad9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:35:40.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.386+0000 7febe98ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:40.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.390+0000 7fea9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:40.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.394+0000 7febe98ad9c0 20 remove_watcher() i=0 2024-09-12T17:35:40.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.394+0000 7febe98ad9c0 2 removed watcher, disabling cache 2024-09-12T17:35:40.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.394+0000 7febe98ad9c0 20 remove_watcher() i=1 2024-09-12T17:35:40.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.398+0000 7febe98ad9c0 20 remove_watcher() i=2 2024-09-12T17:35:40.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.402+0000 7febe98ad9c0 20 remove_watcher() i=3 2024-09-12T17:35:40.402 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.402+0000 7febe98ad9c0 20 remove_watcher() i=4 2024-09-12T17:35:40.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.402+0000 7febe98ad9c0 20 remove_watcher() i=5 2024-09-12T17:35:40.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.406+0000 7febe98ad9c0 20 remove_watcher() i=6 2024-09-12T17:35:40.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:40.406+0000 7febe98ad9c0 20 remove_watcher() i=7 2024-09-12T17:35:40.421 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:40.422 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:35:40.422 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-block-writes id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:35:40.422 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:41.373 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T17:35:41.373 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:43.564 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:35:43.597 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:43.597 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:43.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.645+0000 7f1368d909c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:43.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.649+0000 7f1368d909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:43.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.649+0000 7f1368d909c0 20 realm 2024-09-12T17:35:43.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.649+0000 7f1368d909c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:43.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.649+0000 7f1368d909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:43.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.649+0000 7f1368d909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:43.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.649+0000 7f1368d909c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:43.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.649+0000 7f1368d909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:43.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.649+0000 7f1368d909c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:43.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.653+0000 7f1368d909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:43.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.653+0000 7f1368d909c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:43.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.653+0000 7f1368d909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:43.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.653+0000 7f1368d909c0 20 searching for the correct realm 2024-09-12T17:35:43.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.653+0000 7f1366095640 0 -- 172.21.15.119:0/3006543891 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f135803b060 msgr2=0x7f13580638f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:43.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.865+0000 7f1367097640 0 -- 172.21.15.119:0/3006543891 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f135c0d1040 msgr2=0x7f135c0de410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:43.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.885+0000 7f1368d909c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:43.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.885+0000 7f1368d909c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:43.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.885+0000 7f1368d909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:43.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.885+0000 7f1368d909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:43.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.885+0000 7f1368d909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:43.888 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.885+0000 7f1368d909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:43.888 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.885+0000 7f1368d909c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:43.888 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.889+0000 7f1368d909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:43.888 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.889+0000 7f1368d909c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:43.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.889+0000 7f1368d909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:43.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.889+0000 7f1368d909c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:43.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.889+0000 7f1368d909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:43.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.889+0000 7f1368d909c0 20 zone default found 2024-09-12T17:35:43.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.889+0000 7f1368d909c0 4 Realm: () 2024-09-12T17:35:43.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.889+0000 7f1368d909c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:43.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.889+0000 7f1368d909c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:43.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.889+0000 7f1368d909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:43.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.889+0000 7f1368d909c0 20 zonegroup default 2024-09-12T17:35:43.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.889+0000 7f1368d909c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:43.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.889+0000 7f1368d909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:43.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.889+0000 7f1368d909c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:43.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.889+0000 7f1368d909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:43.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.889+0000 7f1368d909c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:43.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.893+0000 7f1368d909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:43.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.893+0000 7f1368d909c0 20 started sync module instance, tier type = 2024-09-12T17:35:43.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.893+0000 7f1368d909c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:43.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.917+0000 7f1368d909c0 20 add_watcher() i=0 2024-09-12T17:35:43.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.917+0000 7f1368d909c0 20 add_watcher() i=1 2024-09-12T17:35:43.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.917+0000 7f1368d909c0 20 add_watcher() i=2 2024-09-12T17:35:43.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.917+0000 7f1368d909c0 20 add_watcher() i=3 2024-09-12T17:35:43.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.917+0000 7f1368d909c0 20 add_watcher() i=4 2024-09-12T17:35:43.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.917+0000 7f1368d909c0 20 add_watcher() i=5 2024-09-12T17:35:43.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.917+0000 7f1368d909c0 20 add_watcher() i=6 2024-09-12T17:35:43.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.917+0000 7f1368d909c0 20 add_watcher() i=7 2024-09-12T17:35:43.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.917+0000 7f1368d909c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:43.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.921+0000 7f121dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:43.922 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.921+0000 7f1368d909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:43.922 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.921+0000 7f1368d909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:43.922 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.921+0000 7f1368d909c0 5 note: GC not initialized 2024-09-12T17:35:43.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.921+0000 7f121cfe1640 20 reqs_thread_entry: start 2024-09-12T17:35:43.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.921+0000 7f1368d909c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:43.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.921+0000 7f1368d909c0 20 Filter name: none 2024-09-12T17:35:43.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.921+0000 7f1215ffb640 20 reqs_thread_entry: start 2024-09-12T17:35:43.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.921+0000 7f1368d909c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:43.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.925+0000 7f1368d909c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:35:43.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.925+0000 7f1368d909c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:43.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.925+0000 7f1368d909c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:35:43.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.925+0000 7f1368d909c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:43.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.925+0000 7f1368d909c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:43.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.925+0000 7f1368d909c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:35:43.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.925+0000 7f1368d909c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:43.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.925+0000 7f1368d909c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:35:43.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.925+0000 7f1368d909c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:43.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.929+0000 7f121dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:43.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.933+0000 7f1368d909c0 20 remove_watcher() i=0 2024-09-12T17:35:43.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.933+0000 7f1368d909c0 2 removed watcher, disabling cache 2024-09-12T17:35:43.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.937+0000 7f1368d909c0 20 remove_watcher() i=1 2024-09-12T17:35:43.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.937+0000 7f1368d909c0 20 remove_watcher() i=2 2024-09-12T17:35:43.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.941+0000 7f1368d909c0 20 remove_watcher() i=3 2024-09-12T17:35:43.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.941+0000 7f1368d909c0 20 remove_watcher() i=4 2024-09-12T17:35:43.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.941+0000 7f1368d909c0 20 remove_watcher() i=5 2024-09-12T17:35:43.944 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.945+0000 7f1368d909c0 20 remove_watcher() i=6 2024-09-12T17:35:43.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:43.945+0000 7f1368d909c0 20 remove_watcher() i=7 2024-09-12T17:35:43.960 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:43.961 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:35:43.961 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-block-writes id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:35:43.961 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:43.961 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T17:35:43.997 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:43.997 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:44.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:44.041+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:44.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:44.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:44.045+0000 7f9333df39c0 20 realm 2024-09-12T17:35:44.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:44.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:44.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:44.045+0000 7f9333df39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:44.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:44.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:44.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:44.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:44.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:44.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:44.253+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:44.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:44.253+0000 7f9333df39c0 20 searching for the correct realm 2024-09-12T17:35:44.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:44.257+0000 7f93310f8640 0 -- 172.21.15.119:0/911672644 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f9324101fc0 msgr2=0x7f93240f7e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:44.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:44.873+0000 7f93318f9640 0 -- 172.21.15.119:0/911672644 >> [v2:172.21.15.194:6824/504391855,v1:172.21.15.194:6825/504391855] conn(0x7f932c046070 msgr2=0x7f932c096700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:45.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.097+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.097+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.097+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:45.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:45.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.101+0000 7f9333df39c0 20 zone default found 2024-09-12T17:35:45.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.101+0000 7f9333df39c0 4 Realm: () 2024-09-12T17:35:45.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.101+0000 7f9333df39c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:45.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.101+0000 7f9333df39c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:45.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.101+0000 7f9333df39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:45.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.101+0000 7f9333df39c0 20 zonegroup default 2024-09-12T17:35:45.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.105+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.105+0000 7f9333df39c0 20 started sync module instance, tier type = 2024-09-12T17:35:45.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.105+0000 7f9333df39c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:45.126 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=0 2024-09-12T17:35:45.126 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=1 2024-09-12T17:35:45.126 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=2 2024-09-12T17:35:45.126 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=3 2024-09-12T17:35:45.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=4 2024-09-12T17:35:45.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=5 2024-09-12T17:35:45.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=6 2024-09-12T17:35:45.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.129+0000 7f9333df39c0 20 add_watcher() i=7 2024-09-12T17:35:45.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.129+0000 7f9333df39c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:45.133 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.133+0000 7f91e3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:45.133 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.133+0000 7f9333df39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:45.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.133+0000 7f9333df39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:45.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.133+0000 7f9333df39c0 5 note: GC not initialized 2024-09-12T17:35:45.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.133+0000 7f91e2ffd640 20 reqs_thread_entry: start 2024-09-12T17:35:45.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.133+0000 7f9333df39c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:45.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.133+0000 7f9333df39c0 20 Filter name: none 2024-09-12T17:35:45.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.133+0000 7f91e0ff9640 20 reqs_thread_entry: start 2024-09-12T17:35:45.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.133+0000 7f9333df39c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:35:45.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.133+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.137+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:35:45.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.137+0000 7f9333df39c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:35:45.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.137+0000 7f9333df39c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:35:45.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.137+0000 7f9333df39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 : miss 2024-09-12T17:35:45.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.137+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.137+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:35:45.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.137+0000 7f9333df39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:35:45.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.137+0000 7f9333df39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:35:45.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.137+0000 7f9333df39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:45.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.137+0000 7f9333df39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:45.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.137+0000 7f9333df39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 2024-09-12T17:35:45.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.149+0000 7f9333df39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:35:45.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.149+0000 7f9333df39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:35:45.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.149+0000 7f9333df39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:45.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.149+0000 7f9333df39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30, ofs0, ns] 2024-09-12T17:35:45.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.149+0000 7f9214ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333505 cookie 94315141915232 notifier 7149 bl.length()=999 2024-09-12T17:35:45.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.149+0000 7f9214ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:35:45.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.149+0000 7f9214ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:35:45.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.149+0000 7f9214ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:45.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.153+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_sources= new_sources= 2024-09-12T17:35:45.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.153+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential sources added=[] removed=[] 2024-09-12T17:35:45.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.153+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_dests= new_dests= 2024-09-12T17:35:45.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.153+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential dests added=[] removed=[] 2024-09-12T17:35:45.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.0 2024-09-12T17:35:45.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.0 2024-09-12T17:35:45.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.1 2024-09-12T17:35:45.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.1 2024-09-12T17:35:45.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.2 2024-09-12T17:35:45.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.2 2024-09-12T17:35:45.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.3 2024-09-12T17:35:45.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.3 2024-09-12T17:35:45.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.4 2024-09-12T17:35:45.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.4 2024-09-12T17:35:45.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.5 2024-09-12T17:35:45.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.5 2024-09-12T17:35:45.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.6 2024-09-12T17:35:45.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.6 2024-09-12T17:35:45.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.7 2024-09-12T17:35:45.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.7 2024-09-12T17:35:45.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.8 2024-09-12T17:35:45.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.8 2024-09-12T17:35:45.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.9 2024-09-12T17:35:45.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.9 2024-09-12T17:35:45.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.10 2024-09-12T17:35:45.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.10 2024-09-12T17:35:45.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.11 2024-09-12T17:35:45.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.11 2024-09-12T17:35:45.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.0 2024-09-12T17:35:45.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1 2024-09-12T17:35:45.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2 2024-09-12T17:35:45.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.3 2024-09-12T17:35:45.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.4 2024-09-12T17:35:45.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.5 2024-09-12T17:35:45.167 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.6 2024-09-12T17:35:45.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.169+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.7 2024-09-12T17:35:45.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.169+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.8 2024-09-12T17:35:45.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.169+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.9 2024-09-12T17:35:45.172 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.173+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.10 2024-09-12T17:35:45.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.181+0000 7f9333df39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:45.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.181+0000 7f9333df39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 2024-09-12T17:35:45.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.181+0000 7f9333df39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:35:45.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.181+0000 7f9333df39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:35:45.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.181+0000 7f9333df39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:45.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.181+0000 7f9333df39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30, ofs0, ns] 2024-09-12T17:35:45.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.181+0000 7f9214ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333506 cookie 94315141915232 notifier 7149 bl.length()=999 2024-09-12T17:35:45.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.181+0000 7f9214ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:35:45.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.181+0000 7f9214ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:35:45.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.181+0000 7f9214ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:45.186 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9333df39c0 time 2024-09-12T17:35:45.191824+0000 2024-09-12T17:35:45.187 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:35:45.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.185+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_sources= new_sources= 2024-09-12T17:35:45.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.185+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential sources added=[] removed=[] 2024-09-12T17:35:45.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.185+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_dests= new_dests= 2024-09-12T17:35:45.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.185+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential dests added=[] removed=[] 2024-09-12T17:35:45.188 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:45.188 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f93376cd2eb] 2024-09-12T17:35:45.188 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f93376cd49f] 2024-09-12T17:35:45.188 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c771bb60c1] 2024-09-12T17:35:45.188 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55c771bc755b] 2024-09-12T17:35:45.188 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c771bc8b44] 2024-09-12T17:35:45.188 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:35:45.188 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9336533d90] 2024-09-12T17:35:45.189 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:35:45.189 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:35:45.189 INFO:tasks.workunit.client.0.smithi119.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:35:45.189 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f9333df39c0 thread_name:radosgw-admin 2024-09-12T17:35:45.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.189+0000 7f9333df39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9333df39c0 time 2024-09-12T17:35:45.191824+0000 2024-09-12T17:35:45.189 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:35:45.189 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.189 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:45.189 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f93376cd2eb] 2024-09-12T17:35:45.190 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f93376cd49f] 2024-09-12T17:35:45.190 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c771bb60c1] 2024-09-12T17:35:45.190 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55c771bc755b] 2024-09-12T17:35:45.190 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c771bc8b44] 2024-09-12T17:35:45.190 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:35:45.190 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9336533d90] 2024-09-12T17:35:45.190 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:35:45.190 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:35:45.190 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.204 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:45.204 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f933654c520] 2024-09-12T17:35:45.204 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:35:45.204 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:35:45.204 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:35:45.205 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f93376cd345] 2024-09-12T17:35:45.205 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f93376cd49f] 2024-09-12T17:35:45.205 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c771bb60c1] 2024-09-12T17:35:45.205 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55c771bc755b] 2024-09-12T17:35:45.205 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c771bc8b44] 2024-09-12T17:35:45.205 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:35:45.205 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9336533d90] 2024-09-12T17:35:45.205 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:35:45.205 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:35:45.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.189+0000 7f9333df39c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:35:45.206 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f9333df39c0 thread_name:radosgw-admin 2024-09-12T17:35:45.206 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.206 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:45.206 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f933654c520] 2024-09-12T17:35:45.206 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:35:45.206 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:35:45.206 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:35:45.206 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f93376cd345] 2024-09-12T17:35:45.206 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f93376cd49f] 2024-09-12T17:35:45.207 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c771bb60c1] 2024-09-12T17:35:45.207 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55c771bc755b] 2024-09-12T17:35:45.207 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c771bc8b44] 2024-09-12T17:35:45.207 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:35:45.207 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9336533d90] 2024-09-12T17:35:45.207 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:35:45.207 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:35:45.207 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:35:45.207 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.207 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:35:45.208 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:35:44.021+0000 7f9333df39c0 5 AuthRegistry(0x55c77477f400) adding con mode: secure 2024-09-12T17:35:45.208 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:35:44.021+0000 7f9333df39c0 5 AuthRegistry(0x55c77477f400) adding con mode: crc 2024-09-12T17:35:45.208 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:35:44.021+0000 7f9333df39c0 5 AuthRegistry(0x55c77477f400) adding con mode: secure 2024-09-12T17:35:45.208 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:35:44.021+0000 7f9333df39c0 5 AuthRegistry(0x55c77477f400) adding con mode: crc 2024-09-12T17:35:45.208 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:35:44.021+0000 7f9333df39c0 5 AuthRegistry(0x55c77477f400) adding con mode: secure 2024-09-12T17:35:45.208 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:35:44.021+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.208 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:35:44.021+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.208 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:35:44.021+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command rotate-key hook 0x55c77477f548 2024-09-12T17:35:45.208 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient: _reopen_session rank -1 2024-09-12T17:35:45.208 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:35:45.209 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-c con 0x55c77462fe30 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:35:45.209 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-b con 0x55c7746c51f0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:35:45.209 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-a con 0x55c7746c55d0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:35:45.209 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.209 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.209 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.209 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient(hunting): _renew_subs 2024-09-12T17:35:45.209 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient(hunting): authenticate will time out at 2512.059240s 2024-09-12T17:35:45.209 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient(hunting): get_auth_request con 0x55c77462fe30 auth_method 0 2024-09-12T17:35:45.209 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.209 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.210 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.210 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:35:44.021+0000 7f93320fa640 10 monclient(hunting): get_auth_request con 0x55c7746c55d0 auth_method 0 2024-09-12T17:35:45.210 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:35:44.021+0000 7f93320fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.210 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:35:44.021+0000 7f93320fa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.210 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:35:44.021+0000 7f93320fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.210 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:45.211 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:45.211 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:45.211 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:35:44.021+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:45.211 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:35:44.021+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:45.211 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:35:44.021+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:45.211 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:35:44.021+0000 7f93310f8640 10 monclient(hunting): get_auth_request con 0x55c7746c51f0 auth_method 0 2024-09-12T17:35:45.211 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:35:44.021+0000 7f93310f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.211 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:35:44.021+0000 7f93310f8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.211 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:35:44.021+0000 7f93310f8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.211 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient(hunting): handle_auth_done global_id 6725 payload 824 2024-09-12T17:35:45.212 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient: _finish_hunting 0 2024-09-12T17:35:45.212 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:35:44.021+0000 7f93318f9640 1 monclient: found mon.noname-c 2024-09-12T17:35:45.212 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:35:45.212 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:35:44.021+0000 7f921e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:45.212 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:35:44.025+0000 7f921e604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:35:45.212 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:35:44.025+0000 7f921e604640 10 monclient: dump: 2024-09-12T17:35:45.212 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:45.212 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:45.212 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.213 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.213 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:45.213 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.213 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:45.213 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:45.213 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:45.213 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.213 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:35:44.025+0000 7f921e604640 10 monclient: _finish_auth 0 2024-09-12T17:35:45.214 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:35:44.025+0000 7f921e604640 10 monclient: _check_auth_tickets 2024-09-12T17:35:45.214 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:35:44.025+0000 7f921e604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:45.214 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:35:44.025+0000 7f921e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:45.214 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:35:44.025+0000 7f921e604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:35:45.214 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:35:44.025+0000 7f921e604640 10 monclient: dump: 2024-09-12T17:35:45.214 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:45.214 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:45.214 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.214 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.215 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:45.215 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.215 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:45.215 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:45.215 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:45.215 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.215 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:35:44.025+0000 7f9333df39c0 5 monclient: authenticate success, global_id 6725 2024-09-12T17:35:45.215 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:35:44.025+0000 7f9333df39c0 10 monclient: _renew_subs 2024-09-12T17:35:45.215 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:35:44.025+0000 7f921fe07640 4 set_mon_vals no callback set 2024-09-12T17:35:45.215 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:35:44.025+0000 7f9333df39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:45.216 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:35:44.025+0000 7f9333df39c0 10 monclient: _renew_subs 2024-09-12T17:35:45.216 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:35:44.025+0000 7f9333df39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:45.216 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:35:44.025+0000 7f9333df39c0 1 librados: init done 2024-09-12T17:35:45.216 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:35:44.025+0000 7f921e604640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:35:45.216 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:35:44.025+0000 7f921e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:45.216 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:35:44.025+0000 7f921e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:45.216 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:35:44.025+0000 7f93310f8640 10 monclient: get_auth_request con 0x7f9218070b10 auth_method 0 2024-09-12T17:35:45.216 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:35:44.025+0000 7f93320fa640 10 monclient: get_auth_request con 0x55c7747c6fe0 auth_method 0 2024-09-12T17:35:45.216 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:35:44.025+0000 7f93318f9640 10 monclient: get_auth_request con 0x55c7747ca1c0 auth_method 0 2024-09-12T17:35:45.217 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:35:44.029+0000 7f93310f8640 10 monclient: get_auth_request con 0x55c7747ce3b0 auth_method 0 2024-09-12T17:35:45.217 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:35:44.029+0000 7f93320fa640 10 monclient: get_auth_request con 0x55c7747d2090 auth_method 0 2024-09-12T17:35:45.217 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: build_initial_monmap 2024-09-12T17:35:45.217 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:35:44.033+0000 7f9333df39c0 1 build_initial for_mkfs: 0 2024-09-12T17:35:45.217 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: monmap: 2024-09-12T17:35:45.217 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:35:45.217 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:45.217 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:35:45.217 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:35:45.217 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:45.217 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.218 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:35:45.218 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:35:45.218 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:35:45.218 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.218 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding auth protocol: cephx 2024-09-12T17:35:45.218 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding auth protocol: cephx 2024-09-12T17:35:45.218 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding auth protocol: cephx 2024-09-12T17:35:45.218 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: secure 2024-09-12T17:35:45.219 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: crc 2024-09-12T17:35:45.219 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: secure 2024-09-12T17:35:45.219 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: crc 2024-09-12T17:35:45.219 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: secure 2024-09-12T17:35:45.219 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: crc 2024-09-12T17:35:45.219 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: crc 2024-09-12T17:35:45.219 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: secure 2024-09-12T17:35:45.219 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: crc 2024-09-12T17:35:45.219 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: secure 2024-09-12T17:35:45.220 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: crc 2024-09-12T17:35:45.220 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: secure 2024-09-12T17:35:45.220 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:35:44.033+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.220 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c7747d9850 EEXIST 2024-09-12T17:35:45.220 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: init 2024-09-12T17:35:45.220 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding auth protocol: cephx 2024-09-12T17:35:45.220 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding auth protocol: cephx 2024-09-12T17:35:45.220 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding auth protocol: cephx 2024-09-12T17:35:45.220 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: secure 2024-09-12T17:35:45.220 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: crc 2024-09-12T17:35:45.221 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: secure 2024-09-12T17:35:45.221 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: crc 2024-09-12T17:35:45.221 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: secure 2024-09-12T17:35:45.221 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: crc 2024-09-12T17:35:45.221 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: crc 2024-09-12T17:35:45.221 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: secure 2024-09-12T17:35:45.221 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: crc 2024-09-12T17:35:45.221 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: secure 2024-09-12T17:35:45.221 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: crc 2024-09-12T17:35:45.221 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: secure 2024-09-12T17:35:45.221 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:35:44.033+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.221 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:35:44.033+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.221 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command rotate-key cmddesc rotate-key hook 0x55c7747d4f20 EEXIST 2024-09-12T17:35:45.222 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: _reopen_session rank -1 2024-09-12T17:35:45.222 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:35:45.222 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-c con 0x55c7747fda00 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:35:45.222 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-b con 0x55c7747fd330 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:35:45.222 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-a con 0x55c7747fbd10 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:35:45.222 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.222 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.222 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.222 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient(hunting): _renew_subs 2024-09-12T17:35:45.222 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient(hunting): authenticate will time out at 2512.070282s 2024-09-12T17:35:45.222 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient(hunting): get_auth_request con 0x55c7747fda00 auth_method 0 2024-09-12T17:35:45.223 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.223 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.223 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.223 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:35:44.033+0000 7f93318f9640 10 monclient(hunting): get_auth_request con 0x55c7747fbd10 auth_method 0 2024-09-12T17:35:45.223 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:35:44.033+0000 7f93318f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.223 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:35:44.033+0000 7f93318f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.223 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:35:44.033+0000 7f93318f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.223 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:45.223 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:45.223 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:45.223 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:35:44.033+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:45.223 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:35:44.033+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:45.223 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:35:44.033+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:45.223 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:35:44.033+0000 7f93320fa640 10 monclient(hunting): get_auth_request con 0x55c7747fd330 auth_method 0 2024-09-12T17:35:45.224 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:35:44.033+0000 7f93320fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.224 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:35:44.033+0000 7f93320fa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.224 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:35:44.033+0000 7f93320fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.224 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient(hunting): handle_auth_done global_id 6728 payload 824 2024-09-12T17:35:45.224 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient: _finish_hunting 0 2024-09-12T17:35:45.224 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:35:44.033+0000 7f93310f8640 1 monclient: found mon.noname-c 2024-09-12T17:35:45.224 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:35:45.224 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:45.224 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:35:45.224 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: dump: 2024-09-12T17:35:45.224 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:45.224 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:45.224 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.225 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.225 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:45.225 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.225 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:45.225 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:45.225 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:45.225 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.225 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: _finish_auth 0 2024-09-12T17:35:45.225 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: _check_auth_tickets 2024-09-12T17:35:45.225 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:45.225 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:45.225 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:35:45.225 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: dump: 2024-09-12T17:35:45.226 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:45.226 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:45.226 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.226 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.226 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:45.226 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.226 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:45.226 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:45.226 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:45.226 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.226 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 monclient: authenticate success, global_id 6728 2024-09-12T17:35:45.226 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:35:44.033+0000 7f93308f7640 4 set_mon_vals no callback set 2024-09-12T17:35:45.227 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: _renew_subs 2024-09-12T17:35:45.227 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:45.227 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: _renew_subs 2024-09-12T17:35:45.227 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:45.227 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:35:44.037+0000 7f92177fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:35:45.227 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:35:44.037+0000 7f92177fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:45.227 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:35:44.037+0000 7f92177fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:45.227 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient: get_monmap_and_config 2024-09-12T17:35:45.227 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient: build_initial_monmap 2024-09-12T17:35:45.227 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:35:44.037+0000 7f9333df39c0 1 build_initial for_mkfs: 0 2024-09-12T17:35:45.227 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient: monmap: 2024-09-12T17:35:45.227 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:35:45.227 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:45.228 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:35:45.228 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:35:45.228 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:45.228 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.228 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:35:45.228 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:35:45.228 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:35:45.228 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.228 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding auth protocol: cephx 2024-09-12T17:35:45.228 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding auth protocol: cephx 2024-09-12T17:35:45.228 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding auth protocol: cephx 2024-09-12T17:35:45.228 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: secure 2024-09-12T17:35:45.228 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: crc 2024-09-12T17:35:45.229 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: secure 2024-09-12T17:35:45.229 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: crc 2024-09-12T17:35:45.229 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: secure 2024-09-12T17:35:45.229 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: crc 2024-09-12T17:35:45.229 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: crc 2024-09-12T17:35:45.229 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: secure 2024-09-12T17:35:45.229 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: crc 2024-09-12T17:35:45.229 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: secure 2024-09-12T17:35:45.229 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: crc 2024-09-12T17:35:45.229 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: secure 2024-09-12T17:35:45.229 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient: get_auth_request con 0x7f920c070a20 auth_method 0 2024-09-12T17:35:45.229 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:35:44.037+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.229 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient: init 2024-09-12T17:35:45.230 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding auth protocol: cephx 2024-09-12T17:35:45.230 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding auth protocol: cephx 2024-09-12T17:35:45.230 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding auth protocol: cephx 2024-09-12T17:35:45.230 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: secure 2024-09-12T17:35:45.230 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: crc 2024-09-12T17:35:45.230 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: secure 2024-09-12T17:35:45.230 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: crc 2024-09-12T17:35:45.230 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: secure 2024-09-12T17:35:45.230 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: crc 2024-09-12T17:35:45.230 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: crc 2024-09-12T17:35:45.230 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: secure 2024-09-12T17:35:45.230 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: crc 2024-09-12T17:35:45.230 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: secure 2024-09-12T17:35:45.231 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: crc 2024-09-12T17:35:45.231 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: secure 2024-09-12T17:35:45.231 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:35:44.037+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.231 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:35:44.037+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.231 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command rotate-key cmddesc rotate-key hook 0x7ffcdbf595c8 EEXIST 2024-09-12T17:35:45.231 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient: _reopen_session rank -1 2024-09-12T17:35:45.231 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:35:45.231 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-a con 0x55c774851960 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:35:45.231 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-c con 0x55c77484cda0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:35:45.231 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-b con 0x55c774843470 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:35:45.231 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.231 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.231 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.232 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient(hunting): _renew_subs 2024-09-12T17:35:45.232 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient(hunting): authenticate will time out at 2512.074541s 2024-09-12T17:35:45.232 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient(hunting): get_auth_request con 0x55c77484cda0 auth_method 0 2024-09-12T17:35:45.232 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.232 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.232 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.232 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:35:44.037+0000 7f93310f8640 10 monclient(hunting): get_auth_request con 0x55c774851960 auth_method 0 2024-09-12T17:35:45.232 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:35:44.037+0000 7f93310f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.232 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:35:44.037+0000 7f93310f8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.232 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:35:44.037+0000 7f93310f8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.232 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:45.232 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:45.233 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:45.233 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:35:44.037+0000 7f93310f8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:45.233 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:35:44.037+0000 7f93310f8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:45.233 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:35:44.037+0000 7f93310f8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:45.233 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient(hunting): handle_auth_done global_id 6731 payload 274 2024-09-12T17:35:45.233 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient: _finish_hunting 0 2024-09-12T17:35:45.233 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:35:44.037+0000 7f93320fa640 1 monclient: found mon.noname-c 2024-09-12T17:35:45.233 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:35:45.233 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:45.233 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:35:45.233 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: dump: 2024-09-12T17:35:45.233 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:45.233 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:45.234 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.234 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.234 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:45.234 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.234 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:45.234 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:45.234 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:45.234 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.234 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: _finish_auth 0 2024-09-12T17:35:45.234 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: _check_auth_tickets 2024-09-12T17:35:45.234 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:45.234 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 monclient: authenticate success, global_id 6731 2024-09-12T17:35:45.234 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient: get_monmap_and_config success 2024-09-12T17:35:45.235 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:35:44.037+0000 7f9333df39c0 4 set_mon_vals no callback set 2024-09-12T17:35:45.235 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:45.235 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:35:45.235 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: dump: 2024-09-12T17:35:45.235 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:45.235 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:45.235 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.235 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.235 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:45.235 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.235 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:45.235 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:45.235 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:45.236 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.236 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient: shutdown 2024-09-12T17:35:45.236 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: build_initial_monmap 2024-09-12T17:35:45.236 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:35:44.041+0000 7f9333df39c0 1 build_initial for_mkfs: 0 2024-09-12T17:35:45.236 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: monmap: 2024-09-12T17:35:45.236 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:35:45.236 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:45.236 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:35:45.236 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:35:45.236 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:45.236 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.236 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:35:45.236 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:35:45.237 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:35:45.237 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.237 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding auth protocol: cephx 2024-09-12T17:35:45.237 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding auth protocol: cephx 2024-09-12T17:35:45.237 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding auth protocol: cephx 2024-09-12T17:35:45.237 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: secure 2024-09-12T17:35:45.237 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: crc 2024-09-12T17:35:45.237 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: secure 2024-09-12T17:35:45.237 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: crc 2024-09-12T17:35:45.238 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: secure 2024-09-12T17:35:45.238 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: crc 2024-09-12T17:35:45.238 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: crc 2024-09-12T17:35:45.238 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: secure 2024-09-12T17:35:45.238 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: crc 2024-09-12T17:35:45.238 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: secure 2024-09-12T17:35:45.238 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: crc 2024-09-12T17:35:45.238 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: secure 2024-09-12T17:35:45.238 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:35:44.041+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.238 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:35:44.041+0000 7f9333df39c0 1 librados: starting msgr at 2024-09-12T17:35:45.239 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:35:44.041+0000 7f9333df39c0 1 librados: starting objecter 2024-09-12T17:35:45.239 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c774820e90 EEXIST 2024-09-12T17:35:45.239 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:35:44.041+0000 7f9333df39c0 1 librados: setting wanted keys 2024-09-12T17:35:45.239 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:35:44.041+0000 7f9333df39c0 1 librados: calling monclient init 2024-09-12T17:35:45.239 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: init 2024-09-12T17:35:45.239 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding auth protocol: cephx 2024-09-12T17:35:45.239 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding auth protocol: cephx 2024-09-12T17:35:45.239 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding auth protocol: cephx 2024-09-12T17:35:45.239 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: secure 2024-09-12T17:35:45.239 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: crc 2024-09-12T17:35:45.240 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: secure 2024-09-12T17:35:45.240 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: crc 2024-09-12T17:35:45.240 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: secure 2024-09-12T17:35:45.240 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: crc 2024-09-12T17:35:45.240 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: crc 2024-09-12T17:35:45.240 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: secure 2024-09-12T17:35:45.240 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: crc 2024-09-12T17:35:45.240 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: secure 2024-09-12T17:35:45.240 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: crc 2024-09-12T17:35:45.240 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: secure 2024-09-12T17:35:45.240 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:35:44.041+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.241 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:35:44.041+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.241 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command rotate-key cmddesc rotate-key hook 0x55c7747ff968 EEXIST 2024-09-12T17:35:45.241 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: _reopen_session rank -1 2024-09-12T17:35:45.241 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:35:45.241 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-b con 0x55c774843470 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:35:45.241 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-a con 0x55c77484cda0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:35:45.241 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-c con 0x55c774851960 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:35:45.241 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.242 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.242 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.242 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient(hunting): _renew_subs 2024-09-12T17:35:45.242 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient(hunting): authenticate will time out at 2512.077090s 2024-09-12T17:35:45.242 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient(hunting): get_auth_request con 0x55c77484cda0 auth_method 0 2024-09-12T17:35:45.242 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.242 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.242 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.242 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:35:44.041+0000 7f93318f9640 10 monclient(hunting): get_auth_request con 0x55c774851960 auth_method 0 2024-09-12T17:35:45.242 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:35:44.041+0000 7f93318f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.242 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:35:44.041+0000 7f93318f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.243 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:35:44.041+0000 7f93318f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.243 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:45.243 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:45.243 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:45.243 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:35:44.041+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:45.243 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:35:44.041+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:45.243 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:35:44.041+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:45.243 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient(hunting): handle_auth_done global_id 7149 payload 824 2024-09-12T17:35:45.243 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient: _finish_hunting 0 2024-09-12T17:35:45.243 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:35:44.041+0000 7f93320fa640 1 monclient: found mon.noname-a 2024-09-12T17:35:45.244 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:35:45.244 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:45.244 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:45.244 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: dump: 2024-09-12T17:35:45.244 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:45.244 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:45.244 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.244 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.244 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:45.244 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.244 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:45.245 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:45.245 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:45.245 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.245 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: _finish_auth 0 2024-09-12T17:35:45.245 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: _check_auth_tickets 2024-09-12T17:35:45.245 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:45.245 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:45.245 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:45.245 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: dump: 2024-09-12T17:35:45.245 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:45.246 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:45.246 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.246 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.246 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:45.246 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.246 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:45.246 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:45.246 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:45.246 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.246 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 monclient: authenticate success, global_id 7149 2024-09-12T17:35:45.246 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:35:44.041+0000 7f92157fa640 4 set_mon_vals no callback set 2024-09-12T17:35:45.246 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: _renew_subs 2024-09-12T17:35:45.247 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:35:45.247 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: _renew_subs 2024-09-12T17:35:45.247 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:35:45.247 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:35:44.041+0000 7f9333df39c0 1 librados: init done 2024-09-12T17:35:45.247 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command cr dump hook 0x55c7748490e8 2024-09-12T17:35:45.247 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:35:44.041+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.247 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:35:44.041+0000 7f92037fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:35:45.247 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:35:44.041+0000 7f92037fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:45.247 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:35:44.045+0000 7f92037fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:45.247 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:35:44.045+0000 7f93318f9640 10 monclient: get_auth_request con 0x55c77486b770 auth_method 0 2024-09-12T17:35:45.248 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:35:44.045+0000 7f93310f8640 10 monclient: get_auth_request con 0x7f91fc070ae0 auth_method 0 2024-09-12T17:35:45.248 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.248 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 realm 2024-09-12T17:35:45.248 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.248 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.248 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:35:44.045+0000 7f9333df39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:45.248 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.248 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:35:44.045+0000 7f92037fe640 1 client.7149.objecter ms_handle_reset 0x55c77486b770 session 0x55c77486b0f0 osd.1 2024-09-12T17:35:45.248 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:35:44.045+0000 7f92037fe640 10 monclient: _renew_subs 2024-09-12T17:35:45.248 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:35:44.045+0000 7f92037fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:35:45.249 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:35:44.045+0000 7f93318f9640 10 monclient: get_auth_request con 0x7f91fc081290 auth_method 0 2024-09-12T17:35:45.249 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.249 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.249 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:35:44.045+0000 7f93310f8640 10 monclient: get_auth_request con 0x55c77486c530 auth_method 0 2024-09-12T17:35:45.249 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:45.249 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.249 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:35:44.049+0000 7f93320fa640 10 monclient: get_auth_request con 0x55c77486dc80 auth_method 0 2024-09-12T17:35:45.249 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:35:44.253+0000 7f93320fa640 10 monclient: get_auth_request con 0x55c77486dc80 auth_method 0 2024-09-12T17:35:45.249 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:35:44.253+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:45.249 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:35:44.253+0000 7f9333df39c0 20 searching for the correct realm 2024-09-12T17:35:45.250 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:35:44.253+0000 7f93318f9640 10 monclient: get_auth_request con 0x55c7748758c0 auth_method 0 2024-09-12T17:35:45.250 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:35:44.257+0000 7f93310f8640 10 monclient: get_auth_request con 0x7f9324101fc0 auth_method 0 2024-09-12T17:35:45.250 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:35:44.257+0000 7f93310f8640 0 -- 172.21.15.119:0/911672644 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f9324101fc0 msgr2=0x7f93240f7e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:45.250 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:35:44.461+0000 7f93310f8640 10 monclient: get_auth_request con 0x7f9324101fc0 auth_method 0 2024-09-12T17:35:45.250 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:35:44.865+0000 7f93310f8640 10 monclient: get_auth_request con 0x7f9324101fc0 auth_method 0 2024-09-12T17:35:45.250 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:35:44.865+0000 7f93320fa640 10 monclient: get_auth_request con 0x7f932806c490 auth_method 0 2024-09-12T17:35:45.250 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:35:44.873+0000 7f93318f9640 10 monclient: get_auth_request con 0x7f932c046070 auth_method 0 2024-09-12T17:35:45.250 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:35:44.873+0000 7f93318f9640 0 -- 172.21.15.119:0/911672644 >> [v2:172.21.15.194:6824/504391855,v1:172.21.15.194:6825/504391855] conn(0x7f932c046070 msgr2=0x7f932c096700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:45.250 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:35:45.077+0000 7f93318f9640 10 monclient: get_auth_request con 0x7f932c046070 auth_method 0 2024-09-12T17:35:45.250 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:35:45.085+0000 7f93310f8640 10 monclient: get_auth_request con 0x7f932c069520 auth_method 0 2024-09-12T17:35:45.251 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:45.251 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:45.251 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:45.251 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:45.251 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:45.251 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:45.251 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.251 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.252 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.252 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:45.252 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.252 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:45.252 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 zone default found 2024-09-12T17:35:45.252 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:35:45.101+0000 7f9333df39c0 4 Realm: () 2024-09-12T17:35:45.252 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:35:45.101+0000 7f9333df39c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:45.252 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:35:45.101+0000 7f9333df39c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:45.252 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:35:45.101+0000 7f9333df39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:45.253 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 zonegroup default 2024-09-12T17:35:45.253 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.253 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.253 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.253 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.253 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.253 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:35:45.105+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.253 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:35:45.105+0000 7f9333df39c0 20 started sync module instance, tier type = 2024-09-12T17:35:45.253 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:35:45.105+0000 7f9333df39c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:45.253 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=0 2024-09-12T17:35:45.253 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=1 2024-09-12T17:35:45.254 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=2 2024-09-12T17:35:45.254 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=3 2024-09-12T17:35:45.254 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=4 2024-09-12T17:35:45.254 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=5 2024-09-12T17:35:45.254 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=6 2024-09-12T17:35:45.254 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:35:45.129+0000 7f9333df39c0 20 add_watcher() i=7 2024-09-12T17:35:45.254 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:35:45.129+0000 7f9333df39c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:45.254 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding auth protocol: cephx 2024-09-12T17:35:45.254 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding auth protocol: cephx 2024-09-12T17:35:45.254 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding auth protocol: cephx 2024-09-12T17:35:45.254 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: secure 2024-09-12T17:35:45.254 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: crc 2024-09-12T17:35:45.254 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: secure 2024-09-12T17:35:45.255 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: crc 2024-09-12T17:35:45.255 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: secure 2024-09-12T17:35:45.255 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: crc 2024-09-12T17:35:45.255 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: crc 2024-09-12T17:35:45.255 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: secure 2024-09-12T17:35:45.255 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:35:45.133+0000 7f91e3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:45.255 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: crc 2024-09-12T17:35:45.255 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: secure 2024-09-12T17:35:45.255 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: crc 2024-09-12T17:35:45.255 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: secure 2024-09-12T17:35:45.255 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:35:45.133+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.255 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:35:45.133+0000 7f9333df39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:45.255 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:35:45.133+0000 7f9333df39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:45.256 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command cache list hook 0x55c774840290 2024-09-12T17:35:45.256 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command cache inspect hook 0x55c774840290 2024-09-12T17:35:45.256 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command cache erase hook 0x55c774840290 2024-09-12T17:35:45.256 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command cache zap hook 0x55c774840290 2024-09-12T17:35:45.256 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 note: GC not initialized 2024-09-12T17:35:45.256 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:35:45.133+0000 7f91e2ffd640 20 reqs_thread_entry: start 2024-09-12T17:35:45.256 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command sync trace show hook 0x7f932c00eea0 2024-09-12T17:35:45.256 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command sync trace history hook 0x7f932c00eea0 2024-09-12T17:35:45.256 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command sync trace active hook 0x7f932c00eea0 2024-09-12T17:35:45.256 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command sync trace active_short hook 0x7f932c00eea0 2024-09-12T17:35:45.256 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:35:45.133+0000 7f9333df39c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:45.256 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:35:45.133+0000 7f9333df39c0 20 Filter name: none 2024-09-12T17:35:45.256 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:35:45.133+0000 7f91e0ff9640 20 reqs_thread_entry: start 2024-09-12T17:35:45.257 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:35:45.133+0000 7f9333df39c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:35:45.257 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:35:45.133+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.257 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:35:45.137+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:35:45.257 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:35:45.137+0000 7f9333df39c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:35:45.257 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:35:45.137+0000 7f9333df39c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:35:45.257 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:35:45.137+0000 7f9333df39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 : miss 2024-09-12T17:35:45.257 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:35:45.137+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.257 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:35:45.137+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:35:45.257 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:35:45.137+0000 7f9333df39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:35:45.257 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:35:45.137+0000 7f9333df39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:35:45.257 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:35:45.137+0000 7f9333df39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:45.257 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:35:45.137+0000 7f9333df39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:45.257 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:35:45.137+0000 7f9333df39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 2024-09-12T17:35:45.258 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:35:45.149+0000 7f9333df39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:35:45.258 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:35:45.149+0000 7f9333df39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:35:45.258 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:35:45.149+0000 7f9333df39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:45.258 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:35:45.149+0000 7f9333df39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30, ofs0, ns] 2024-09-12T17:35:45.258 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:35:45.149+0000 7f9214ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333505 cookie 94315141915232 notifier 7149 bl.length()=999 2024-09-12T17:35:45.258 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:35:45.149+0000 7f9214ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:35:45.258 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:35:45.149+0000 7f9214ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:35:45.258 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:35:45.149+0000 7f9214ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:45.258 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:35:45.153+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_sources= new_sources= 2024-09-12T17:35:45.258 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:35:45.153+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential sources added=[] removed=[] 2024-09-12T17:35:45.258 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:35:45.153+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_dests= new_dests= 2024-09-12T17:35:45.258 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:35:45.153+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential dests added=[] removed=[] 2024-09-12T17:35:45.258 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.0 2024-09-12T17:35:45.259 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.0 2024-09-12T17:35:45.259 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.1 2024-09-12T17:35:45.259 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.1 2024-09-12T17:35:45.259 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.2 2024-09-12T17:35:45.259 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.2 2024-09-12T17:35:45.259 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.3 2024-09-12T17:35:45.259 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.3 2024-09-12T17:35:45.259 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.4 2024-09-12T17:35:45.259 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.4 2024-09-12T17:35:45.259 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.5 2024-09-12T17:35:45.259 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.5 2024-09-12T17:35:45.259 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.6 2024-09-12T17:35:45.259 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.6 2024-09-12T17:35:45.260 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.7 2024-09-12T17:35:45.260 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.7 2024-09-12T17:35:45.260 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.8 2024-09-12T17:35:45.260 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.8 2024-09-12T17:35:45.260 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.9 2024-09-12T17:35:45.260 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.9 2024-09-12T17:35:45.260 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.10 2024-09-12T17:35:45.260 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.10 2024-09-12T17:35:45.260 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.11 2024-09-12T17:35:45.260 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.11 2024-09-12T17:35:45.260 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.0 2024-09-12T17:35:45.260 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1 2024-09-12T17:35:45.260 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2 2024-09-12T17:35:45.261 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.3 2024-09-12T17:35:45.261 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.4 2024-09-12T17:35:45.261 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.5 2024-09-12T17:35:45.261 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.6 2024-09-12T17:35:45.261 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:35:45.169+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.7 2024-09-12T17:35:45.261 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:35:45.169+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.8 2024-09-12T17:35:45.261 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:35:45.169+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.9 2024-09-12T17:35:45.261 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:35:45.173+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.10 2024-09-12T17:35:45.261 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:35:45.181+0000 7f9333df39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:45.261 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:35:45.181+0000 7f9333df39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 2024-09-12T17:35:45.261 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:35:45.181+0000 7f9333df39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:35:45.261 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:35:45.181+0000 7f9333df39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:35:45.262 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:35:45.181+0000 7f9333df39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:45.262 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:35:45.181+0000 7f9333df39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30, ofs0, ns] 2024-09-12T17:35:45.262 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:35:45.181+0000 7f9214ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333506 cookie 94315141915232 notifier 7149 bl.length()=999 2024-09-12T17:35:45.262 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:35:45.181+0000 7f9214ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:35:45.262 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:35:45.181+0000 7f9214ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:35:45.262 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:35:45.181+0000 7f9214ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:45.262 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:35:45.185+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_sources= new_sources= 2024-09-12T17:35:45.262 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:35:45.185+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential sources added=[] removed=[] 2024-09-12T17:35:45.262 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:35:45.185+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_dests= new_dests= 2024-09-12T17:35:45.262 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:35:45.185+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential dests added=[] removed=[] 2024-09-12T17:35:45.263 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:35:45.189+0000 7f9333df39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9333df39c0 time 2024-09-12T17:35:45.191824+0000 2024-09-12T17:35:45.263 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:35:45.263 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.263 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:45.263 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f93376cd2eb] 2024-09-12T17:35:45.263 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f93376cd49f] 2024-09-12T17:35:45.263 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c771bb60c1] 2024-09-12T17:35:45.263 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55c771bc755b] 2024-09-12T17:35:45.263 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c771bc8b44] 2024-09-12T17:35:45.263 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:35:45.264 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9336533d90] 2024-09-12T17:35:45.264 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:35:45.264 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:35:45.264 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.264 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:35:45.189+0000 7f9333df39c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:35:45.264 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f9333df39c0 thread_name:radosgw-admin 2024-09-12T17:35:45.264 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.264 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:45.264 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f933654c520] 2024-09-12T17:35:45.264 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:35:45.264 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:35:45.265 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:35:45.265 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f93376cd345] 2024-09-12T17:35:45.265 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f93376cd49f] 2024-09-12T17:35:45.265 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c771bb60c1] 2024-09-12T17:35:45.265 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55c771bc755b] 2024-09-12T17:35:45.265 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c771bc8b44] 2024-09-12T17:35:45.265 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:35:45.265 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9336533d90] 2024-09-12T17:35:45.265 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:35:45.265 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:35:45.266 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:35:45.266 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.266 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:35:45.266 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:35:45.266 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:35:45.266 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:35:45.266 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:35:45.266 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:35:45.266 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:35:45.266 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:35:45.266 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:35:45.267 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:35:45.267 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:35:45.267 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:35:45.267 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:35:45.267 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:35:45.267 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:35:45.267 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:35:45.267 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:35:45.267 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:35:45.267 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:35:45.267 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:35:45.267 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:35:45.268 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:35:45.268 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:35:45.268 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:35:45.268 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:35:45.268 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:35:45.268 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:35:45.268 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:35:45.268 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:35:45.268 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:35:45.268 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:35:45.268 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:35:45.269 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:35:45.269 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:35:45.269 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:35:45.269 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:35:45.269 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:35:45.269 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:35:45.269 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:35:45.269 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:35:45.269 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:35:45.269 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:35:45.269 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:35:45.269 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:35:45.269 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:35:45.269 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:35:45.269 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:35:45.270 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:35:45.270 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:35:45.270 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:35:45.270 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:35:45.270 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:35:45.270 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:35:45.270 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:35:45.270 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:35:45.270 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:35:45.270 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:35:45.270 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:35:45.270 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:35:45.270 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:35:45.271 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:35:45.271 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:35:45.271 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:35:45.271 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:35:45.271 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:35:45.271 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:35:45.271 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:35:45.271 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:35:45.271 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:35:45.271 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:35:45.271 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:35:45.271 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:35:45.271 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:35:45.271 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:35:45.271 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:35:45.272 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:35:45.272 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:35:45.272 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:35:45.272 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:35:45.272 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:35:45.272 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:35:45.272 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:35:45.272 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:35:45.272 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:35:45.272 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:35:45.272 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:35:45.272 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:35:45.272 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:35:45.273 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:35:45.273 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:35:45.273 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:35:45.273 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:35:45.273 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:35:45.273 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:35:45.273 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91e0ff9640 / http_manager 2024-09-12T17:35:45.274 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91e2ffd640 / http_manager 2024-09-12T17:35:45.274 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91e3fff640 / rgw_dt_lg_renew 2024-09-12T17:35:45.274 INFO:tasks.workunit.client.0.smithi119.stderr: 7f92037fe640 / ms_dispatch 2024-09-12T17:35:45.274 INFO:tasks.workunit.client.0.smithi119.stderr: 7f9214ff9640 / io_context_pool 2024-09-12T17:35:45.274 INFO:tasks.workunit.client.0.smithi119.stderr: 7f92157fa640 / io_context_pool 2024-09-12T17:35:45.274 INFO:tasks.workunit.client.0.smithi119.stderr: 7f92177fe640 / ms_dispatch 2024-09-12T17:35:45.274 INFO:tasks.workunit.client.0.smithi119.stderr: 7f921e604640 / ms_dispatch 2024-09-12T17:35:45.274 INFO:tasks.workunit.client.0.smithi119.stderr: 7f921fe07640 / io_context_pool 2024-09-12T17:35:45.274 INFO:tasks.workunit.client.0.smithi119.stderr: 7f93308f7640 / io_context_pool 2024-09-12T17:35:45.274 INFO:tasks.workunit.client.0.smithi119.stderr: 7f93310f8640 / msgr-worker-2 2024-09-12T17:35:45.274 INFO:tasks.workunit.client.0.smithi119.stderr: 7f93318f9640 / msgr-worker-1 2024-09-12T17:35:45.275 INFO:tasks.workunit.client.0.smithi119.stderr: 7f93320fa640 / msgr-worker-0 2024-09-12T17:35:45.275 INFO:tasks.workunit.client.0.smithi119.stderr: 7f9333df39c0 / radosgw-admin 2024-09-12T17:35:45.275 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:35:45.275 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:35:45.275 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/log/ceph/ceph-client.admin.106811.log 2024-09-12T17:35:45.275 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:35:45.275 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:35:45.275 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:35:44.021+0000 7f9333df39c0 5 AuthRegistry(0x55c77477f400) adding con mode: secure 2024-09-12T17:35:45.275 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:35:44.021+0000 7f9333df39c0 5 AuthRegistry(0x55c77477f400) adding con mode: crc 2024-09-12T17:35:45.275 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:35:44.021+0000 7f9333df39c0 5 AuthRegistry(0x55c77477f400) adding con mode: secure 2024-09-12T17:35:45.275 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:35:44.021+0000 7f9333df39c0 5 AuthRegistry(0x55c77477f400) adding con mode: crc 2024-09-12T17:35:45.276 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:35:44.021+0000 7f9333df39c0 5 AuthRegistry(0x55c77477f400) adding con mode: secure 2024-09-12T17:35:45.276 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:35:44.021+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.276 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:35:44.021+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.276 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:35:44.021+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command rotate-key hook 0x55c77477f548 2024-09-12T17:35:45.276 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient: _reopen_session rank -1 2024-09-12T17:35:45.276 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:35:45.276 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-c con 0x55c77462fe30 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:35:45.276 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-b con 0x55c7746c51f0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:35:45.276 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-a con 0x55c7746c55d0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:35:45.276 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.277 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.277 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.277 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient(hunting): _renew_subs 2024-09-12T17:35:45.277 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:35:44.021+0000 7f9333df39c0 10 monclient(hunting): authenticate will time out at 2512.059240s 2024-09-12T17:35:45.277 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient(hunting): get_auth_request con 0x55c77462fe30 auth_method 0 2024-09-12T17:35:45.277 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.277 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.277 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.277 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:35:44.021+0000 7f93320fa640 10 monclient(hunting): get_auth_request con 0x55c7746c55d0 auth_method 0 2024-09-12T17:35:45.277 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:35:44.021+0000 7f93320fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.277 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:35:44.021+0000 7f93320fa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.278 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:35:44.021+0000 7f93320fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.278 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:45.278 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:45.278 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:45.278 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:35:44.021+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:45.278 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:35:44.021+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:45.278 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:35:44.021+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:45.278 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:35:44.021+0000 7f93310f8640 10 monclient(hunting): get_auth_request con 0x55c7746c51f0 auth_method 0 2024-09-12T17:35:45.278 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:35:44.021+0000 7f93310f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.278 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:35:44.021+0000 7f93310f8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.278 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:35:44.021+0000 7f93310f8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.278 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient(hunting): handle_auth_done global_id 6725 payload 824 2024-09-12T17:35:45.279 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient: _finish_hunting 0 2024-09-12T17:35:45.279 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:35:44.021+0000 7f93318f9640 1 monclient: found mon.noname-c 2024-09-12T17:35:45.279 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:35:44.021+0000 7f93318f9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:35:45.279 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:35:44.021+0000 7f921e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:45.279 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:35:44.025+0000 7f921e604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:35:45.279 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:35:44.025+0000 7f921e604640 10 monclient: dump: 2024-09-12T17:35:45.279 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:45.279 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:45.279 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.279 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.279 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:45.280 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.280 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:45.280 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:45.280 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:45.280 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.280 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:35:44.025+0000 7f921e604640 10 monclient: _finish_auth 0 2024-09-12T17:35:45.280 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:35:44.025+0000 7f921e604640 10 monclient: _check_auth_tickets 2024-09-12T17:35:45.280 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:35:44.025+0000 7f921e604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:45.280 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:35:44.025+0000 7f921e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:45.280 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:35:44.025+0000 7f921e604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:35:45.281 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:35:44.025+0000 7f921e604640 10 monclient: dump: 2024-09-12T17:35:45.281 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:45.281 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:45.281 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.281 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.281 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:45.281 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.281 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:45.281 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:45.281 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:45.281 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.281 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:35:44.025+0000 7f9333df39c0 5 monclient: authenticate success, global_id 6725 2024-09-12T17:35:45.282 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:35:44.025+0000 7f9333df39c0 10 monclient: _renew_subs 2024-09-12T17:35:45.282 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:35:44.025+0000 7f921fe07640 4 set_mon_vals no callback set 2024-09-12T17:35:45.282 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:35:44.025+0000 7f9333df39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:45.282 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:35:44.025+0000 7f9333df39c0 10 monclient: _renew_subs 2024-09-12T17:35:45.282 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:35:44.025+0000 7f9333df39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:45.282 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:35:44.025+0000 7f9333df39c0 1 librados: init done 2024-09-12T17:35:45.282 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:35:44.025+0000 7f921e604640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:35:45.282 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:35:44.025+0000 7f921e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:45.282 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:35:44.025+0000 7f921e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:45.282 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:35:44.025+0000 7f93310f8640 10 monclient: get_auth_request con 0x7f9218070b10 auth_method 0 2024-09-12T17:35:45.282 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:35:44.025+0000 7f93320fa640 10 monclient: get_auth_request con 0x55c7747c6fe0 auth_method 0 2024-09-12T17:35:45.282 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:35:44.025+0000 7f93318f9640 10 monclient: get_auth_request con 0x55c7747ca1c0 auth_method 0 2024-09-12T17:35:45.283 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:35:44.029+0000 7f93310f8640 10 monclient: get_auth_request con 0x55c7747ce3b0 auth_method 0 2024-09-12T17:35:45.283 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:35:44.029+0000 7f93320fa640 10 monclient: get_auth_request con 0x55c7747d2090 auth_method 0 2024-09-12T17:35:45.283 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: build_initial_monmap 2024-09-12T17:35:45.283 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:35:44.033+0000 7f9333df39c0 1 build_initial for_mkfs: 0 2024-09-12T17:35:45.283 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: monmap: 2024-09-12T17:35:45.283 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:35:45.283 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:45.283 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:35:45.283 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:35:45.283 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:45.283 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.283 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:35:45.283 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:35:45.283 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:35:45.284 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.284 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding auth protocol: cephx 2024-09-12T17:35:45.284 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding auth protocol: cephx 2024-09-12T17:35:45.284 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding auth protocol: cephx 2024-09-12T17:35:45.284 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: secure 2024-09-12T17:35:45.284 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: crc 2024-09-12T17:35:45.284 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: secure 2024-09-12T17:35:45.284 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: crc 2024-09-12T17:35:45.284 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: secure 2024-09-12T17:35:45.284 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: crc 2024-09-12T17:35:45.284 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: crc 2024-09-12T17:35:45.284 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: secure 2024-09-12T17:35:45.285 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: crc 2024-09-12T17:35:45.285 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: secure 2024-09-12T17:35:45.285 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: crc 2024-09-12T17:35:45.285 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d5e20) adding con mode: secure 2024-09-12T17:35:45.285 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:35:44.033+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.285 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c7747d9850 EEXIST 2024-09-12T17:35:45.285 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: init 2024-09-12T17:35:45.285 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding auth protocol: cephx 2024-09-12T17:35:45.285 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding auth protocol: cephx 2024-09-12T17:35:45.285 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding auth protocol: cephx 2024-09-12T17:35:45.285 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: secure 2024-09-12T17:35:45.285 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: crc 2024-09-12T17:35:45.286 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: secure 2024-09-12T17:35:45.286 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: crc 2024-09-12T17:35:45.286 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: secure 2024-09-12T17:35:45.286 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: crc 2024-09-12T17:35:45.286 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: crc 2024-09-12T17:35:45.286 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: secure 2024-09-12T17:35:45.286 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: crc 2024-09-12T17:35:45.286 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: secure 2024-09-12T17:35:45.286 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: crc 2024-09-12T17:35:45.286 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 AuthRegistry(0x55c7747d4dd8) adding con mode: secure 2024-09-12T17:35:45.286 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:35:44.033+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.286 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:35:44.033+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.286 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command rotate-key cmddesc rotate-key hook 0x55c7747d4f20 EEXIST 2024-09-12T17:35:45.286 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: _reopen_session rank -1 2024-09-12T17:35:45.287 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:35:45.287 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-c con 0x55c7747fda00 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:35:45.287 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-b con 0x55c7747fd330 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:35:45.287 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-a con 0x55c7747fbd10 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:35:45.287 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.287 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.287 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.287 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient(hunting): _renew_subs 2024-09-12T17:35:45.287 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient(hunting): authenticate will time out at 2512.070282s 2024-09-12T17:35:45.287 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient(hunting): get_auth_request con 0x55c7747fda00 auth_method 0 2024-09-12T17:35:45.287 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.287 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.287 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.288 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:35:44.033+0000 7f93318f9640 10 monclient(hunting): get_auth_request con 0x55c7747fbd10 auth_method 0 2024-09-12T17:35:45.288 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:35:44.033+0000 7f93318f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.288 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:35:44.033+0000 7f93318f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.288 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:35:44.033+0000 7f93318f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.288 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:45.288 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:45.288 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:45.288 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:35:44.033+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:45.288 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:35:44.033+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:45.288 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:35:44.033+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:45.288 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:35:44.033+0000 7f93320fa640 10 monclient(hunting): get_auth_request con 0x55c7747fd330 auth_method 0 2024-09-12T17:35:45.288 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:35:44.033+0000 7f93320fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.288 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:35:44.033+0000 7f93320fa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.289 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:35:44.033+0000 7f93320fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.289 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient(hunting): handle_auth_done global_id 6728 payload 824 2024-09-12T17:35:45.289 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient: _finish_hunting 0 2024-09-12T17:35:45.289 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:35:44.033+0000 7f93310f8640 1 monclient: found mon.noname-c 2024-09-12T17:35:45.289 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:35:44.033+0000 7f93310f8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:35:45.289 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:45.289 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:35:45.289 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: dump: 2024-09-12T17:35:45.289 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:45.289 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:45.289 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.289 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.289 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:45.290 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.290 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:45.290 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:45.290 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:45.290 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.290 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: _finish_auth 0 2024-09-12T17:35:45.290 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: _check_auth_tickets 2024-09-12T17:35:45.290 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:45.290 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:45.291 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:35:45.291 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:35:44.033+0000 7f92177fe640 10 monclient: dump: 2024-09-12T17:35:45.291 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:45.291 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:45.291 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.291 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.291 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:45.291 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.291 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:45.291 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:45.291 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:45.291 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.291 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:35:44.033+0000 7f9333df39c0 5 monclient: authenticate success, global_id 6728 2024-09-12T17:35:45.292 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:35:44.033+0000 7f93308f7640 4 set_mon_vals no callback set 2024-09-12T17:35:45.292 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: _renew_subs 2024-09-12T17:35:45.292 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:45.292 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: _renew_subs 2024-09-12T17:35:45.292 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:35:44.033+0000 7f9333df39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:35:45.292 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:35:44.037+0000 7f92177fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:35:45.292 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:35:44.037+0000 7f92177fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:45.292 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:35:44.037+0000 7f92177fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:45.292 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient: get_monmap_and_config 2024-09-12T17:35:45.292 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient: build_initial_monmap 2024-09-12T17:35:45.292 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:35:44.037+0000 7f9333df39c0 1 build_initial for_mkfs: 0 2024-09-12T17:35:45.292 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient: monmap: 2024-09-12T17:35:45.292 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:35:45.293 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:45.293 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:35:45.293 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:35:45.293 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:45.293 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.293 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:35:45.293 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:35:45.293 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:35:45.293 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.293 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding auth protocol: cephx 2024-09-12T17:35:45.293 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding auth protocol: cephx 2024-09-12T17:35:45.293 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding auth protocol: cephx 2024-09-12T17:35:45.294 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: secure 2024-09-12T17:35:45.294 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: crc 2024-09-12T17:35:45.294 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: secure 2024-09-12T17:35:45.294 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: crc 2024-09-12T17:35:45.294 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: secure 2024-09-12T17:35:45.294 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: crc 2024-09-12T17:35:45.294 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: crc 2024-09-12T17:35:45.294 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: secure 2024-09-12T17:35:45.294 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: crc 2024-09-12T17:35:45.294 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: secure 2024-09-12T17:35:45.294 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: crc 2024-09-12T17:35:45.294 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x55c77481d440) adding con mode: secure 2024-09-12T17:35:45.294 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient: get_auth_request con 0x7f920c070a20 auth_method 0 2024-09-12T17:35:45.295 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:35:44.037+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.295 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient: init 2024-09-12T17:35:45.295 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding auth protocol: cephx 2024-09-12T17:35:45.295 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding auth protocol: cephx 2024-09-12T17:35:45.295 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding auth protocol: cephx 2024-09-12T17:35:45.295 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: secure 2024-09-12T17:35:45.295 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: crc 2024-09-12T17:35:45.295 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: secure 2024-09-12T17:35:45.295 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: crc 2024-09-12T17:35:45.295 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: secure 2024-09-12T17:35:45.295 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: crc 2024-09-12T17:35:45.295 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: crc 2024-09-12T17:35:45.295 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: secure 2024-09-12T17:35:45.295 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: crc 2024-09-12T17:35:45.296 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: secure 2024-09-12T17:35:45.296 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: crc 2024-09-12T17:35:45.296 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59480) adding con mode: secure 2024-09-12T17:35:45.296 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:35:44.037+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.296 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:35:44.037+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.296 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command rotate-key cmddesc rotate-key hook 0x7ffcdbf595c8 EEXIST 2024-09-12T17:35:45.296 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient: _reopen_session rank -1 2024-09-12T17:35:45.296 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:35:45.296 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-a con 0x55c774851960 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:35:45.296 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-c con 0x55c77484cda0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:35:45.296 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-b con 0x55c774843470 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:35:45.296 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.296 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.296 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.297 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient(hunting): _renew_subs 2024-09-12T17:35:45.297 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient(hunting): authenticate will time out at 2512.074541s 2024-09-12T17:35:45.297 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient(hunting): get_auth_request con 0x55c77484cda0 auth_method 0 2024-09-12T17:35:45.297 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.297 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.297 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.297 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:35:44.037+0000 7f93310f8640 10 monclient(hunting): get_auth_request con 0x55c774851960 auth_method 0 2024-09-12T17:35:45.297 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:35:44.037+0000 7f93310f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.297 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:35:44.037+0000 7f93310f8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.297 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:35:44.037+0000 7f93310f8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.297 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:45.297 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:45.297 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:45.297 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:35:44.037+0000 7f93310f8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:45.298 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:35:44.037+0000 7f93310f8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:45.298 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:35:44.037+0000 7f93310f8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:45.298 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient(hunting): handle_auth_done global_id 6731 payload 274 2024-09-12T17:35:45.298 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient: _finish_hunting 0 2024-09-12T17:35:45.298 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:35:44.037+0000 7f93320fa640 1 monclient: found mon.noname-c 2024-09-12T17:35:45.298 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:35:44.037+0000 7f93320fa640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:35:45.298 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:45.298 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:35:45.298 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: dump: 2024-09-12T17:35:45.298 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:45.298 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:45.298 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.298 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.298 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:45.298 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.299 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:45.299 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:45.299 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:45.299 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.299 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: _finish_auth 0 2024-09-12T17:35:45.299 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: _check_auth_tickets 2024-09-12T17:35:45.299 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:45.299 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:35:44.037+0000 7f9333df39c0 5 monclient: authenticate success, global_id 6731 2024-09-12T17:35:45.299 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient: get_monmap_and_config success 2024-09-12T17:35:45.299 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:35:44.037+0000 7f9333df39c0 4 set_mon_vals no callback set 2024-09-12T17:35:45.299 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:45.299 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:35:45.299 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:35:44.037+0000 7f92157fa640 10 monclient: dump: 2024-09-12T17:35:45.299 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:45.300 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:45.300 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.300 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.300 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:45.300 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.300 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:45.300 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:45.300 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:45.300 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.300 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:35:44.037+0000 7f9333df39c0 10 monclient: shutdown 2024-09-12T17:35:45.300 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: build_initial_monmap 2024-09-12T17:35:45.300 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:35:44.041+0000 7f9333df39c0 1 build_initial for_mkfs: 0 2024-09-12T17:35:45.300 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: monmap: 2024-09-12T17:35:45.300 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:35:45.301 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:45.301 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:35:45.301 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:35:45.301 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:45.301 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.301 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:35:45.301 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:35:45.301 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:35:45.301 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.301 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding auth protocol: cephx 2024-09-12T17:35:45.301 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding auth protocol: cephx 2024-09-12T17:35:45.301 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding auth protocol: cephx 2024-09-12T17:35:45.301 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: secure 2024-09-12T17:35:45.302 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: crc 2024-09-12T17:35:45.302 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: secure 2024-09-12T17:35:45.302 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: crc 2024-09-12T17:35:45.302 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: secure 2024-09-12T17:35:45.302 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: crc 2024-09-12T17:35:45.302 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: crc 2024-09-12T17:35:45.302 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: secure 2024-09-12T17:35:45.302 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: crc 2024-09-12T17:35:45.302 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: secure 2024-09-12T17:35:45.302 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: crc 2024-09-12T17:35:45.302 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c774843f30) adding con mode: secure 2024-09-12T17:35:45.302 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:35:44.041+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.303 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:35:44.041+0000 7f9333df39c0 1 librados: starting msgr at 2024-09-12T17:35:45.303 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:35:44.041+0000 7f9333df39c0 1 librados: starting objecter 2024-09-12T17:35:45.303 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c774820e90 EEXIST 2024-09-12T17:35:45.303 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:35:44.041+0000 7f9333df39c0 1 librados: setting wanted keys 2024-09-12T17:35:45.303 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:35:44.041+0000 7f9333df39c0 1 librados: calling monclient init 2024-09-12T17:35:45.303 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: init 2024-09-12T17:35:45.303 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding auth protocol: cephx 2024-09-12T17:35:45.303 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding auth protocol: cephx 2024-09-12T17:35:45.303 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding auth protocol: cephx 2024-09-12T17:35:45.303 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: secure 2024-09-12T17:35:45.303 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: crc 2024-09-12T17:35:45.303 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: secure 2024-09-12T17:35:45.303 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: crc 2024-09-12T17:35:45.304 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: secure 2024-09-12T17:35:45.304 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: crc 2024-09-12T17:35:45.304 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: crc 2024-09-12T17:35:45.304 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: secure 2024-09-12T17:35:45.304 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: crc 2024-09-12T17:35:45.304 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: secure 2024-09-12T17:35:45.304 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: crc 2024-09-12T17:35:45.304 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 AuthRegistry(0x55c7747ff820) adding con mode: secure 2024-09-12T17:35:45.304 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:35:44.041+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.304 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:35:44.041+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.304 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command rotate-key cmddesc rotate-key hook 0x55c7747ff968 EEXIST 2024-09-12T17:35:45.304 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: _reopen_session rank -1 2024-09-12T17:35:45.305 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:35:45.305 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-b con 0x55c774843470 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:35:45.305 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-a con 0x55c77484cda0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:35:45.305 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient(hunting): picked mon.noname-c con 0x55c774851960 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:35:45.305 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.305 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.305 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:45.305 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient(hunting): _renew_subs 2024-09-12T17:35:45.305 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient(hunting): authenticate will time out at 2512.077090s 2024-09-12T17:35:45.305 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient(hunting): get_auth_request con 0x55c77484cda0 auth_method 0 2024-09-12T17:35:45.305 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.305 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.306 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.306 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:35:44.041+0000 7f93318f9640 10 monclient(hunting): get_auth_request con 0x55c774851960 auth_method 0 2024-09-12T17:35:45.306 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:35:44.041+0000 7f93318f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:45.306 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:35:44.041+0000 7f93318f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:45.306 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:35:44.041+0000 7f93318f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:45.306 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:45.306 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:45.306 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:45.306 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:35:44.041+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:45.306 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:35:44.041+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:45.306 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:35:44.041+0000 7f93318f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:45.306 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient(hunting): handle_auth_done global_id 7149 payload 824 2024-09-12T17:35:45.307 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient: _finish_hunting 0 2024-09-12T17:35:45.307 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:35:44.041+0000 7f93320fa640 1 monclient: found mon.noname-a 2024-09-12T17:35:45.307 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:35:44.041+0000 7f93320fa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:35:45.307 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:45.307 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:45.307 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: dump: 2024-09-12T17:35:45.307 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:45.307 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:45.307 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.307 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.307 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:45.307 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.307 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:45.308 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:45.308 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:45.308 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.308 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: _finish_auth 0 2024-09-12T17:35:45.308 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: _check_auth_tickets 2024-09-12T17:35:45.308 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:45.308 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:45.308 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:45.308 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:35:44.041+0000 7f92037fe640 10 monclient: dump: 2024-09-12T17:35:45.308 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:35:45.309 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:35:45.309 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.309 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:35:45.309 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:45.309 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:35:45.309 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:35:45.309 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:35:45.309 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:35:45.309 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.310 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 monclient: authenticate success, global_id 7149 2024-09-12T17:35:45.310 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:35:44.041+0000 7f92157fa640 4 set_mon_vals no callback set 2024-09-12T17:35:45.310 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: _renew_subs 2024-09-12T17:35:45.310 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:35:45.310 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: _renew_subs 2024-09-12T17:35:45.310 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:35:44.041+0000 7f9333df39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:35:45.310 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:35:44.041+0000 7f9333df39c0 1 librados: init done 2024-09-12T17:35:45.310 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:35:44.041+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command cr dump hook 0x55c7748490e8 2024-09-12T17:35:45.310 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:35:44.041+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.310 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:35:44.041+0000 7f92037fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:35:45.311 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:35:44.041+0000 7f92037fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:45.311 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:35:44.045+0000 7f92037fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:35:45.311 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:35:44.045+0000 7f93318f9640 10 monclient: get_auth_request con 0x55c77486b770 auth_method 0 2024-09-12T17:35:45.311 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:35:44.045+0000 7f93310f8640 10 monclient: get_auth_request con 0x7f91fc070ae0 auth_method 0 2024-09-12T17:35:45.311 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.311 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 realm 2024-09-12T17:35:45.311 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.311 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.311 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:35:44.045+0000 7f9333df39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:45.312 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.312 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:35:44.045+0000 7f92037fe640 1 client.7149.objecter ms_handle_reset 0x55c77486b770 session 0x55c77486b0f0 osd.1 2024-09-12T17:35:45.312 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:35:44.045+0000 7f92037fe640 10 monclient: _renew_subs 2024-09-12T17:35:45.312 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:35:44.045+0000 7f92037fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:35:45.312 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:35:44.045+0000 7f93318f9640 10 monclient: get_auth_request con 0x7f91fc081290 auth_method 0 2024-09-12T17:35:45.312 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.312 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.312 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:35:44.045+0000 7f93310f8640 10 monclient: get_auth_request con 0x55c77486c530 auth_method 0 2024-09-12T17:35:45.312 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:45.312 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:35:44.045+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.312 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:35:44.049+0000 7f93320fa640 10 monclient: get_auth_request con 0x55c77486dc80 auth_method 0 2024-09-12T17:35:45.313 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:35:44.253+0000 7f93320fa640 10 monclient: get_auth_request con 0x55c77486dc80 auth_method 0 2024-09-12T17:35:45.313 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:35:44.253+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:45.313 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:35:44.253+0000 7f9333df39c0 20 searching for the correct realm 2024-09-12T17:35:45.313 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:35:44.253+0000 7f93318f9640 10 monclient: get_auth_request con 0x55c7748758c0 auth_method 0 2024-09-12T17:35:45.313 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:35:44.257+0000 7f93310f8640 10 monclient: get_auth_request con 0x7f9324101fc0 auth_method 0 2024-09-12T17:35:45.313 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:35:44.257+0000 7f93310f8640 0 -- 172.21.15.119:0/911672644 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f9324101fc0 msgr2=0x7f93240f7e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:45.313 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:35:44.461+0000 7f93310f8640 10 monclient: get_auth_request con 0x7f9324101fc0 auth_method 0 2024-09-12T17:35:45.313 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:35:44.865+0000 7f93310f8640 10 monclient: get_auth_request con 0x7f9324101fc0 auth_method 0 2024-09-12T17:35:45.313 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:35:44.865+0000 7f93320fa640 10 monclient: get_auth_request con 0x7f932806c490 auth_method 0 2024-09-12T17:35:45.314 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:35:44.873+0000 7f93318f9640 10 monclient: get_auth_request con 0x7f932c046070 auth_method 0 2024-09-12T17:35:45.314 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:35:44.873+0000 7f93318f9640 0 -- 172.21.15.119:0/911672644 >> [v2:172.21.15.194:6824/504391855,v1:172.21.15.194:6825/504391855] conn(0x7f932c046070 msgr2=0x7f932c096700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:45.314 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:35:45.077+0000 7f93318f9640 10 monclient: get_auth_request con 0x7f932c046070 auth_method 0 2024-09-12T17:35:45.314 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:35:45.085+0000 7f93310f8640 10 monclient: get_auth_request con 0x7f932c069520 auth_method 0 2024-09-12T17:35:45.314 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:45.314 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:45.314 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:45.314 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:45.314 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:45.314 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:45.314 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.314 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.315 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:35:45.097+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.315 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:45.315 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.315 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:45.315 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 zone default found 2024-09-12T17:35:45.315 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:35:45.101+0000 7f9333df39c0 4 Realm: () 2024-09-12T17:35:45.315 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:35:45.101+0000 7f9333df39c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:45.315 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:35:45.101+0000 7f9333df39c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:45.315 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:35:45.101+0000 7f9333df39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:45.316 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 zonegroup default 2024-09-12T17:35:45.316 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.316 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.316 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.316 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.316 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:35:45.101+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.316 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:35:45.105+0000 7f9333df39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.316 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:35:45.105+0000 7f9333df39c0 20 started sync module instance, tier type = 2024-09-12T17:35:45.316 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:35:45.105+0000 7f9333df39c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:45.316 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=0 2024-09-12T17:35:45.316 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=1 2024-09-12T17:35:45.316 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=2 2024-09-12T17:35:45.317 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=3 2024-09-12T17:35:45.317 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=4 2024-09-12T17:35:45.317 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=5 2024-09-12T17:35:45.317 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:35:45.125+0000 7f9333df39c0 20 add_watcher() i=6 2024-09-12T17:35:45.317 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:35:45.129+0000 7f9333df39c0 20 add_watcher() i=7 2024-09-12T17:35:45.317 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:35:45.129+0000 7f9333df39c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:45.317 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding auth protocol: cephx 2024-09-12T17:35:45.317 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding auth protocol: cephx 2024-09-12T17:35:45.317 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding auth protocol: cephx 2024-09-12T17:35:45.317 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: secure 2024-09-12T17:35:45.317 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: crc 2024-09-12T17:35:45.317 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: secure 2024-09-12T17:35:45.317 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: crc 2024-09-12T17:35:45.317 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: secure 2024-09-12T17:35:45.318 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: crc 2024-09-12T17:35:45.318 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: crc 2024-09-12T17:35:45.318 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: secure 2024-09-12T17:35:45.318 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:35:45.133+0000 7f91e3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:45.318 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: crc 2024-09-12T17:35:45.318 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: secure 2024-09-12T17:35:45.318 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: crc 2024-09-12T17:35:45.318 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 AuthRegistry(0x7ffcdbf59950) adding con mode: secure 2024-09-12T17:35:45.318 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:35:45.133+0000 7f9333df39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:45.318 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:35:45.133+0000 7f9333df39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:45.318 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:35:45.133+0000 7f9333df39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:45.318 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command cache list hook 0x55c774840290 2024-09-12T17:35:45.319 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command cache inspect hook 0x55c774840290 2024-09-12T17:35:45.319 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command cache erase hook 0x55c774840290 2024-09-12T17:35:45.319 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command cache zap hook 0x55c774840290 2024-09-12T17:35:45.319 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 note: GC not initialized 2024-09-12T17:35:45.319 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:35:45.133+0000 7f91e2ffd640 20 reqs_thread_entry: start 2024-09-12T17:35:45.319 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command sync trace show hook 0x7f932c00eea0 2024-09-12T17:35:45.319 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command sync trace history hook 0x7f932c00eea0 2024-09-12T17:35:45.319 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command sync trace active hook 0x7f932c00eea0 2024-09-12T17:35:45.319 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:35:45.133+0000 7f9333df39c0 5 asok(0x55c7745742b0) register_command sync trace active_short hook 0x7f932c00eea0 2024-09-12T17:35:45.319 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:35:45.133+0000 7f9333df39c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:45.319 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:35:45.133+0000 7f9333df39c0 20 Filter name: none 2024-09-12T17:35:45.319 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:35:45.133+0000 7f91e0ff9640 20 reqs_thread_entry: start 2024-09-12T17:35:45.319 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:35:45.133+0000 7f9333df39c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:35:45.320 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:35:45.133+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.320 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:35:45.137+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:35:45.320 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:35:45.137+0000 7f9333df39c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:35:45.320 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:35:45.137+0000 7f9333df39c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:35:45.320 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:35:45.137+0000 7f9333df39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 : miss 2024-09-12T17:35:45.320 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:35:45.137+0000 7f9333df39c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.320 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:35:45.137+0000 7f9333df39c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:35:45.320 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:35:45.137+0000 7f9333df39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:35:45.320 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:35:45.137+0000 7f9333df39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:35:45.320 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:35:45.137+0000 7f9333df39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:45.320 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:35:45.137+0000 7f9333df39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:45.320 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:35:45.137+0000 7f9333df39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 2024-09-12T17:35:45.320 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:35:45.149+0000 7f9333df39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:35:45.321 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:35:45.149+0000 7f9333df39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:35:45.321 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:35:45.149+0000 7f9333df39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:45.321 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:35:45.149+0000 7f9333df39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30, ofs0, ns] 2024-09-12T17:35:45.321 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:35:45.149+0000 7f9214ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333505 cookie 94315141915232 notifier 7149 bl.length()=999 2024-09-12T17:35:45.321 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:35:45.149+0000 7f9214ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:35:45.321 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:35:45.149+0000 7f9214ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:35:45.321 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:35:45.149+0000 7f9214ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:45.321 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:35:45.153+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_sources= new_sources= 2024-09-12T17:35:45.321 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:35:45.153+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential sources added=[] removed=[] 2024-09-12T17:35:45.321 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:35:45.153+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_dests= new_dests= 2024-09-12T17:35:45.321 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:35:45.153+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential dests added=[] removed=[] 2024-09-12T17:35:45.321 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.0 2024-09-12T17:35:45.322 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.0 2024-09-12T17:35:45.322 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.1 2024-09-12T17:35:45.322 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.1 2024-09-12T17:35:45.322 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.2 2024-09-12T17:35:45.322 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.2 2024-09-12T17:35:45.322 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.3 2024-09-12T17:35:45.322 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.3 2024-09-12T17:35:45.322 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.4 2024-09-12T17:35:45.322 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.4 2024-09-12T17:35:45.322 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.5 2024-09-12T17:35:45.322 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.5 2024-09-12T17:35:45.322 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.6 2024-09-12T17:35:45.322 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.6 2024-09-12T17:35:45.323 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.7 2024-09-12T17:35:45.323 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.7 2024-09-12T17:35:45.323 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.8 2024-09-12T17:35:45.323 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.8 2024-09-12T17:35:45.323 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.9 2024-09-12T17:35:45.323 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.9 2024-09-12T17:35:45.323 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.10 2024-09-12T17:35:45.323 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.10 2024-09-12T17:35:45.323 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:35:45.161+0000 7f9333df39c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.11 2024-09-12T17:35:45.323 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1.11 2024-09-12T17:35:45.323 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:35:45.161+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.0 2024-09-12T17:35:45.323 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1 2024-09-12T17:35:45.323 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2 2024-09-12T17:35:45.324 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.3 2024-09-12T17:35:45.324 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.4 2024-09-12T17:35:45.324 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.5 2024-09-12T17:35:45.324 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:35:45.165+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.6 2024-09-12T17:35:45.324 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:35:45.169+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.7 2024-09-12T17:35:45.324 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:35:45.169+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.8 2024-09-12T17:35:45.324 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:35:45.169+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.9 2024-09-12T17:35:45.324 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:35:45.173+0000 7f9333df39c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.10 2024-09-12T17:35:45.324 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:35:45.181+0000 7f9333df39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:45.324 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:35:45.181+0000 7f9333df39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 2024-09-12T17:35:45.324 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:35:45.181+0000 7f9333df39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:35:45.324 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:35:45.181+0000 7f9333df39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:35:45.324 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:35:45.181+0000 7f9333df39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:45.325 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:35:45.181+0000 7f9333df39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30, ofs0, ns] 2024-09-12T17:35:45.325 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:35:45.181+0000 7f9214ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333506 cookie 94315141915232 notifier 7149 bl.length()=999 2024-09-12T17:35:45.325 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:35:45.181+0000 7f9214ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:35:45.325 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:35:45.181+0000 7f9214ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:35:45.325 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:35:45.181+0000 7f9214ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:45.325 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:35:45.185+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_sources= new_sources= 2024-09-12T17:35:45.325 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:35:45.185+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential sources added=[] removed=[] 2024-09-12T17:35:45.325 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:35:45.185+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_dests= new_dests= 2024-09-12T17:35:45.325 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:35:45.185+0000 7f9333df39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential dests added=[] removed=[] 2024-09-12T17:35:45.325 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:35:45.189+0000 7f9333df39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9333df39c0 time 2024-09-12T17:35:45.191824+0000 2024-09-12T17:35:45.325 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:35:45.325 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.325 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:45.326 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f93376cd2eb] 2024-09-12T17:35:45.326 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f93376cd49f] 2024-09-12T17:35:45.326 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c771bb60c1] 2024-09-12T17:35:45.326 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55c771bc755b] 2024-09-12T17:35:45.326 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c771bc8b44] 2024-09-12T17:35:45.326 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:35:45.326 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9336533d90] 2024-09-12T17:35:45.326 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:35:45.326 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:35:45.326 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.326 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:35:45.189+0000 7f9333df39c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:35:45.326 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f9333df39c0 thread_name:radosgw-admin 2024-09-12T17:35:45.326 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.327 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:45.327 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f933654c520] 2024-09-12T17:35:45.327 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:35:45.327 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:35:45.327 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:35:45.327 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f93376cd345] 2024-09-12T17:35:45.327 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f93376cd49f] 2024-09-12T17:35:45.327 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c771bb60c1] 2024-09-12T17:35:45.327 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55c771bc755b] 2024-09-12T17:35:45.327 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c771bc8b44] 2024-09-12T17:35:45.327 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:35:45.327 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9336533d90] 2024-09-12T17:35:45.328 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:35:45.328 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:35:45.328 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:35:45.328 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.328 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:35:45.328 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:35:45.328 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:35:45.328 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:35:45.328 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:35:45.328 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:35:45.328 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:35:45.328 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:35:45.328 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:35:45.329 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:35:45.329 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:35:45.329 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:35:45.329 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:35:45.329 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:35:45.329 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:35:45.329 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:35:45.329 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:35:45.329 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:35:45.329 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:35:45.329 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:35:45.329 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:35:45.329 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:35:45.330 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:35:45.330 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:35:45.330 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:35:45.330 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:35:45.330 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:35:45.330 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:35:45.330 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:35:45.330 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:35:45.330 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:35:45.330 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:35:45.330 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:35:45.330 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:35:45.330 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:35:45.331 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:35:45.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:35:45.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:35:45.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:35:45.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:35:45.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:35:45.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:35:45.331 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:35:45.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:35:45.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:35:45.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:35:45.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:35:45.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:35:45.332 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:35:45.332 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:35:45.332 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:35:45.332 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:35:45.332 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:35:45.332 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:35:45.332 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:35:45.332 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:35:45.332 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:35:45.332 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:35:45.332 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:35:45.332 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:35:45.332 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:35:45.333 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:35:45.333 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:35:45.333 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:35:45.333 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:35:45.333 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:35:45.333 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:35:45.333 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:35:45.333 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:35:45.333 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:35:45.333 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:35:45.333 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:35:45.333 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:35:45.333 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:35:45.334 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:35:45.334 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:35:45.334 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:35:45.334 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:35:45.334 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:35:45.334 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:35:45.334 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:35:45.334 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:35:45.334 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:35:45.334 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:35:45.334 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:35:45.334 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:35:45.335 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:35:45.335 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:35:45.335 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:35:45.335 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:35:45.335 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:35:45.335 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:35:45.335 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:35:45.335 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:35:45.335 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91e0ff9640 / http_manager 2024-09-12T17:35:45.335 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91e2ffd640 / http_manager 2024-09-12T17:35:45.335 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91e3fff640 / rgw_dt_lg_renew 2024-09-12T17:35:45.335 INFO:tasks.workunit.client.0.smithi119.stderr: 7f92037fe640 / ms_dispatch 2024-09-12T17:35:45.335 INFO:tasks.workunit.client.0.smithi119.stderr: 7f9214ff9640 / io_context_pool 2024-09-12T17:35:45.336 INFO:tasks.workunit.client.0.smithi119.stderr: 7f92157fa640 / io_context_pool 2024-09-12T17:35:45.336 INFO:tasks.workunit.client.0.smithi119.stderr: 7f92177fe640 / ms_dispatch 2024-09-12T17:35:45.336 INFO:tasks.workunit.client.0.smithi119.stderr: 7f921e604640 / ms_dispatch 2024-09-12T17:35:45.336 INFO:tasks.workunit.client.0.smithi119.stderr: 7f921fe07640 / io_context_pool 2024-09-12T17:35:45.336 INFO:tasks.workunit.client.0.smithi119.stderr: 7f93308f7640 / io_context_pool 2024-09-12T17:35:45.336 INFO:tasks.workunit.client.0.smithi119.stderr: 7f93310f8640 / msgr-worker-2 2024-09-12T17:35:45.336 INFO:tasks.workunit.client.0.smithi119.stderr: 7f93318f9640 / msgr-worker-1 2024-09-12T17:35:45.336 INFO:tasks.workunit.client.0.smithi119.stderr: 7f93320fa640 / msgr-worker-0 2024-09-12T17:35:45.336 INFO:tasks.workunit.client.0.smithi119.stderr: 7f9333df39c0 / radosgw-admin 2024-09-12T17:35:45.336 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:35:45.336 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:35:45.336 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:35:45.195089Z_a779d824-39f1-4d86-8d55-923dc5166e5c/log 2024-09-12T17:35:45.336 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:35:45.337 INFO:tasks.workunit.client.0.smithi119.stderr:Aborted 2024-09-12T17:35:45.337 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:35:45.339 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:45.339 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:45.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.277+0000 7f16a3b749c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.281+0000 7f16a3b749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.281+0000 7f16a3b749c0 20 realm 2024-09-12T17:35:45.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.281+0000 7f16a3b749c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.281+0000 7f16a3b749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.281+0000 7f16a3b749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:45.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.281+0000 7f16a3b749c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.281+0000 7f16a3b749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.281+0000 7f16a3b749c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.281+0000 7f16a3b749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:45.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.281+0000 7f16a3b749c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.285+0000 7f16a3b749c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:45.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.285+0000 7f16a3b749c0 20 searching for the correct realm 2024-09-12T17:35:45.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.285+0000 7f16a1e7b640 0 -- 172.21.15.119:0/1982419136 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x5558b783ad30 msgr2=0x5558b783d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:45.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.293+0000 7f16a0e79640 0 -- 172.21.15.119:0/1982419136 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f169c03a940 msgr2=0x7f169c04e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:45.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.509+0000 7f16a3b749c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:45.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.509+0000 7f16a3b749c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:45.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.509+0000 7f16a3b749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:45.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.509+0000 7f16a3b749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:45.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.509+0000 7f16a3b749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:45.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.509+0000 7f16a3b749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:45.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.509+0000 7f16a3b749c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.513+0000 7f16a3b749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.513+0000 7f16a3b749c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.513+0000 7f16a3b749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:45.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.513+0000 7f16a3b749c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.513+0000 7f16a3b749c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:45.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.513+0000 7f16a3b749c0 20 zone default found 2024-09-12T17:35:45.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.513+0000 7f16a3b749c0 4 Realm: () 2024-09-12T17:35:45.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.513+0000 7f16a3b749c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:45.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.513+0000 7f16a3b749c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:45.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.513+0000 7f16a3b749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:45.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.513+0000 7f16a3b749c0 20 zonegroup default 2024-09-12T17:35:45.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.513+0000 7f16a3b749c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.513+0000 7f16a3b749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.515 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.513+0000 7f16a3b749c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.515 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.513+0000 7f16a3b749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.515 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.513+0000 7f16a3b749c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.516 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.517+0000 7f16a3b749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.516 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.517+0000 7f16a3b749c0 20 started sync module instance, tier type = 2024-09-12T17:35:45.516 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.517+0000 7f16a3b749c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:45.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.537+0000 7f16a3b749c0 20 add_watcher() i=0 2024-09-12T17:35:45.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.537+0000 7f16a3b749c0 20 add_watcher() i=1 2024-09-12T17:35:45.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.537+0000 7f16a3b749c0 20 add_watcher() i=2 2024-09-12T17:35:45.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.537+0000 7f16a3b749c0 20 add_watcher() i=3 2024-09-12T17:35:45.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.537+0000 7f16a3b749c0 20 add_watcher() i=4 2024-09-12T17:35:45.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.537+0000 7f16a3b749c0 20 add_watcher() i=5 2024-09-12T17:35:45.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.541+0000 7f16a3b749c0 20 add_watcher() i=6 2024-09-12T17:35:45.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.541+0000 7f16a3b749c0 20 add_watcher() i=7 2024-09-12T17:35:45.542 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.541+0000 7f16a3b749c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:45.545 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.545+0000 7f15577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:45.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.545+0000 7f16a3b749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:45.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.545+0000 7f16a3b749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:45.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.545+0000 7f16a3b749c0 5 note: GC not initialized 2024-09-12T17:35:45.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.545+0000 7f15567e4640 20 reqs_thread_entry: start 2024-09-12T17:35:45.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.549+0000 7f16a3b749c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:45.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.549+0000 7f16a3b749c0 20 Filter name: none 2024-09-12T17:35:45.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.549+0000 7f14c7fff640 20 reqs_thread_entry: start 2024-09-12T17:35:45.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.549+0000 7f16a3b749c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.549+0000 7f16a3b749c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:35:45.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.549+0000 7f16a3b749c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.549+0000 7f16a3b749c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:35:45.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.549+0000 7f16a3b749c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:45.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.549+0000 7f16a3b749c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.549+0000 7f16a3b749c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:35:45.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.549+0000 7f16a3b749c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.549+0000 7f16a3b749c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:35:45.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.549+0000 7f16a3b749c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:45.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.553+0000 7f15577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:45.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.557+0000 7f16a3b749c0 20 remove_watcher() i=0 2024-09-12T17:35:45.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.557+0000 7f16a3b749c0 2 removed watcher, disabling cache 2024-09-12T17:35:45.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.561+0000 7f16a3b749c0 20 remove_watcher() i=1 2024-09-12T17:35:45.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.565+0000 7f16a3b749c0 20 remove_watcher() i=2 2024-09-12T17:35:45.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.565+0000 7f16a3b749c0 20 remove_watcher() i=3 2024-09-12T17:35:45.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.569+0000 7f16a3b749c0 20 remove_watcher() i=4 2024-09-12T17:35:45.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.569+0000 7f16a3b749c0 20 remove_watcher() i=5 2024-09-12T17:35:45.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.573+0000 7f16a3b749c0 20 remove_watcher() i=6 2024-09-12T17:35:45.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.573+0000 7f16a3b749c0 20 remove_watcher() i=7 2024-09-12T17:35:45.597 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.597 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:35:45.597 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-block-writes id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:35:45.597 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:35:45.709 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:35:45.747 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:45.747 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:45.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.793+0000 7fe168d759c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.793+0000 7fe168d759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.793+0000 7fe168d759c0 20 realm 2024-09-12T17:35:45.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.793+0000 7fe168d759c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.793+0000 7fe168d759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.793+0000 7fe168d759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:45.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.793+0000 7fe168d759c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.793+0000 7fe168d759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.793+0000 7fe168d759c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.797+0000 7fe168d759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:45.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.797+0000 7fe168d759c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.797+0000 7fe168d759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:45.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.797+0000 7fe168d759c0 20 searching for the correct realm 2024-09-12T17:35:45.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:45.801+0000 7fe16707c640 0 -- 172.21.15.119:0/905956683 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fe15001f040 msgr2=0x7fe1500413f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:46.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.017+0000 7fe16607a640 0 -- 172.21.15.119:0/905956683 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fe1580e9bb0 msgr2=0x7fe1580e2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:46.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.233+0000 7fe168d759c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:35:46.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.233+0000 7fe168d759c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:35:46.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.233+0000 7fe168d759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:46.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.233+0000 7fe168d759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:46.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.233+0000 7fe168d759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:46.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.233+0000 7fe168d759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:46.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.233+0000 7fe168d759c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.233+0000 7fe168d759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.233+0000 7fe168d759c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.237+0000 7fe168d759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:46.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.237+0000 7fe168d759c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.237+0000 7fe168d759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:46.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.237+0000 7fe168d759c0 20 zone default found 2024-09-12T17:35:46.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.237+0000 7fe168d759c0 4 Realm: () 2024-09-12T17:35:46.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.237+0000 7fe168d759c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:35:46.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.237+0000 7fe168d759c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:35:46.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.237+0000 7fe168d759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:46.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.237+0000 7fe168d759c0 20 zonegroup default 2024-09-12T17:35:46.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.237+0000 7fe168d759c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.237+0000 7fe168d759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.237+0000 7fe168d759c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.237+0000 7fe168d759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.237+0000 7fe168d759c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.241+0000 7fe168d759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.241+0000 7fe168d759c0 20 started sync module instance, tier type = 2024-09-12T17:35:46.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.241+0000 7fe168d759c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:35:46.263 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.261+0000 7fe168d759c0 20 add_watcher() i=0 2024-09-12T17:35:46.263 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.261+0000 7fe168d759c0 20 add_watcher() i=1 2024-09-12T17:35:46.263 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.261+0000 7fe168d759c0 20 add_watcher() i=2 2024-09-12T17:35:46.263 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.261+0000 7fe168d759c0 20 add_watcher() i=3 2024-09-12T17:35:46.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.261+0000 7fe168d759c0 20 add_watcher() i=4 2024-09-12T17:35:46.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.261+0000 7fe168d759c0 20 add_watcher() i=5 2024-09-12T17:35:46.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.261+0000 7fe168d759c0 20 add_watcher() i=6 2024-09-12T17:35:46.266 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.265+0000 7fe168d759c0 20 add_watcher() i=7 2024-09-12T17:35:46.266 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.265+0000 7fe168d759c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:46.270 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.269+0000 7fe01d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:46.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.269+0000 7fe168d759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:46.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.269+0000 7fe168d759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:46.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.269+0000 7fe168d759c0 5 note: GC not initialized 2024-09-12T17:35:46.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fdf97fff640 20 reqs_thread_entry: start 2024-09-12T17:35:46.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fe168d759c0 20 init_complete bucket index max shards: 11 2024-09-12T17:35:46.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fe168d759c0 20 Filter name: none 2024-09-12T17:35:46.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fdf95ffb640 20 reqs_thread_entry: start 2024-09-12T17:35:46.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fe168d759c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:35:46.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fe168d759c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fe168d759c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:35:46.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fe168d759c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:35:46.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fe168d759c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:35:46.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fe168d759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 : miss 2024-09-12T17:35:46.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fe168d759c0 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fe168d759c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:35:46.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fe168d759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:35:46.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fe168d759c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:35:46.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fe168d759c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:46.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fe168d759c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:46.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.273+0000 7fe168d759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 2024-09-12T17:35:46.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.277+0000 7fe168d759c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to be held by another RGW process; skipping for now 2024-09-12T17:35:46.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.277+0000 7fe01d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:46.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.281+0000 7fe168d759c0 20 remove_watcher() i=0 2024-09-12T17:35:46.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.281+0000 7fe168d759c0 2 removed watcher, disabling cache 2024-09-12T17:35:46.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.285+0000 7fe168d759c0 20 remove_watcher() i=1 2024-09-12T17:35:46.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.285+0000 7fe168d759c0 20 remove_watcher() i=2 2024-09-12T17:35:46.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.289+0000 7fe168d759c0 20 remove_watcher() i=3 2024-09-12T17:35:46.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.293+0000 7fe168d759c0 20 remove_watcher() i=4 2024-09-12T17:35:46.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.293+0000 7fe168d759c0 20 remove_watcher() i=5 2024-09-12T17:35:46.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.293+0000 7fe168d759c0 20 remove_watcher() i=6 2024-09-12T17:35:46.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:35:46.297+0000 7fe168d759c0 20 remove_watcher() i=7 2024-09-12T17:35:46.311 INFO:tasks.workunit.client.0.smithi119.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:36:16.332 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:36:16.368 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:16.368 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:16.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.416+0000 7fe8292c69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.420+0000 7fe8292c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:16.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.420+0000 7fe8292c69c0 20 realm 2024-09-12T17:36:16.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.420+0000 7fe8292c69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.420+0000 7fe8292c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:16.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.420+0000 7fe8292c69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:16.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.420+0000 7fe8292c69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.420+0000 7fe8292c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:16.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.420+0000 7fe8292c69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.420+0000 7fe8292c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:16.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.420+0000 7fe8292c69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.424+0000 7fe8292c69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:16.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.424+0000 7fe8292c69c0 20 searching for the correct realm 2024-09-12T17:36:16.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.424+0000 7fe8275cd640 0 -- 172.21.15.119:0/3144276159 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fe8100592f0 msgr2=0x7fe81005c670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:16.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.432+0000 7fe8265cb640 0 -- 172.21.15.119:0/3144276159 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fe82001a040 msgr2=0x7fe820064240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:16.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.648+0000 7fe8292c69c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:36:16.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.648+0000 7fe8292c69c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:36:16.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.648+0000 7fe8292c69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:16.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.648+0000 7fe8292c69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:16.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.648+0000 7fe8292c69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:16.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.648+0000 7fe8292c69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:16.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.648+0000 7fe8292c69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.648+0000 7fe8292c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:16.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.648+0000 7fe8292c69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:16.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:16.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 20 zone default found 2024-09-12T17:36:16.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 4 Realm: () 2024-09-12T17:36:16.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:36:16.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:36:16.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:16.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 20 zonegroup default 2024-09-12T17:36:16.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:16.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:16.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:16.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 20 started sync module instance, tier type = 2024-09-12T17:36:16.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.652+0000 7fe8292c69c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:36:16.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.676+0000 7fe8292c69c0 20 add_watcher() i=0 2024-09-12T17:36:16.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.676+0000 7fe8292c69c0 20 add_watcher() i=1 2024-09-12T17:36:16.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.676+0000 7fe8292c69c0 20 add_watcher() i=2 2024-09-12T17:36:16.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.676+0000 7fe8292c69c0 20 add_watcher() i=3 2024-09-12T17:36:16.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.676+0000 7fe8292c69c0 20 add_watcher() i=4 2024-09-12T17:36:16.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.676+0000 7fe8292c69c0 20 add_watcher() i=5 2024-09-12T17:36:16.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.676+0000 7fe8292c69c0 20 add_watcher() i=6 2024-09-12T17:36:16.675 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.676+0000 7fe8292c69c0 20 add_watcher() i=7 2024-09-12T17:36:16.675 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.676+0000 7fe8292c69c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:16.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.680+0000 7fe6ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:16.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.680+0000 7fe8292c69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:16.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.680+0000 7fe8292c69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:16.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe8292c69c0 5 note: GC not initialized 2024-09-12T17:36:16.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe6dcfe1640 20 reqs_thread_entry: start 2024-09-12T17:36:16.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe8292c69c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:16.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe8292c69c0 20 Filter name: none 2024-09-12T17:36:16.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe6d5ffb640 20 reqs_thread_entry: start 2024-09-12T17:36:16.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe8292c69c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:36:16.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe8292c69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe8292c69c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:36:16.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe8292c69c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:36:16.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe8292c69c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:36:16.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe8292c69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 : miss 2024-09-12T17:36:16.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe8292c69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe8292c69c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:36:16.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe8292c69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:36:16.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe8292c69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:36:16.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe8292c69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:36:16.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe8292c69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:16.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.684+0000 7fe8292c69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 2024-09-12T17:36:16.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.688+0000 7fe8292c69c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:36:16.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.700+0000 7fe8292c69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:36:16.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.700+0000 7fe8292c69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:36:16.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.700+0000 7fe8292c69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:16.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.700+0000 7fe8292c69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30, ofs0, ns] 2024-09-12T17:36:16.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.704+0000 7fe70a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333507 cookie 94772769061792 notifier 7197 bl.length()=999 2024-09-12T17:36:16.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.704+0000 7fe70a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:36:16.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.704+0000 7fe70a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:36:16.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.704+0000 7fe70a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:16.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.704+0000 7fe8292c69c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_sources= new_sources= 2024-09-12T17:36:16.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.704+0000 7fe8292c69c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential sources added=[] removed=[] 2024-09-12T17:36:16.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.704+0000 7fe8292c69c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_dests= new_dests= 2024-09-12T17:36:16.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.704+0000 7fe8292c69c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential dests added=[] removed=[] 2024-09-12T17:36:16.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.0 2024-09-12T17:36:16.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.0 2024-09-12T17:36:16.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.1 2024-09-12T17:36:16.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.1 2024-09-12T17:36:16.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.2 2024-09-12T17:36:16.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.2 2024-09-12T17:36:16.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.3 2024-09-12T17:36:16.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.3 2024-09-12T17:36:16.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.4 2024-09-12T17:36:16.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.4 2024-09-12T17:36:16.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.5 2024-09-12T17:36:16.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.5 2024-09-12T17:36:16.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.6 2024-09-12T17:36:16.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.6 2024-09-12T17:36:16.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.7 2024-09-12T17:36:16.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.7 2024-09-12T17:36:16.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.8 2024-09-12T17:36:16.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.8 2024-09-12T17:36:16.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.9 2024-09-12T17:36:16.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.9 2024-09-12T17:36:16.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.10 2024-09-12T17:36:16.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.10 2024-09-12T17:36:16.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.11 2024-09-12T17:36:16.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2.11 2024-09-12T17:36:16.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.0 2024-09-12T17:36:16.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.716+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1 2024-09-12T17:36:16.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.720+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2 2024-09-12T17:36:16.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.720+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.3 2024-09-12T17:36:16.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.720+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.4 2024-09-12T17:36:16.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.720+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.5 2024-09-12T17:36:16.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.720+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.6 2024-09-12T17:36:16.721 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.724+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.7 2024-09-12T17:36:16.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.724+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.8 2024-09-12T17:36:16.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.724+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.9 2024-09-12T17:36:16.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.724+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.10 2024-09-12T17:36:16.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.732+0000 7fe8292c69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:16.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.732+0000 7fe8292c69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 2024-09-12T17:36:16.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.736+0000 7fe8292c69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:36:16.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.736+0000 7fe8292c69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:36:16.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.736+0000 7fe8292c69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:16.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.736+0000 7fe8292c69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30, ofs0, ns] 2024-09-12T17:36:16.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.736+0000 7fe70a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333508 cookie 94772769061792 notifier 7197 bl.length()=999 2024-09-12T17:36:16.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.736+0000 7fe70a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:36:16.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.736+0000 7fe70a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:36:16.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.736+0000 7fe70a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:16.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.740+0000 7fe8292c69c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_sources= new_sources= 2024-09-12T17:36:16.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.740+0000 7fe8292c69c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential sources added=[] removed=[] 2024-09-12T17:36:16.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.740+0000 7fe8292c69c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_dests= new_dests= 2024-09-12T17:36:16.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.740+0000 7fe8292c69c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential dests added=[] removed=[] 2024-09-12T17:36:16.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.744+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.0 2024-09-12T17:36:16.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.744+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.1 2024-09-12T17:36:16.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.744+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.2 2024-09-12T17:36:16.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.744+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.3 2024-09-12T17:36:16.744 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.744+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.4 2024-09-12T17:36:16.744 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.748+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.5 2024-09-12T17:36:16.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.748+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.6 2024-09-12T17:36:16.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.748+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.7 2024-09-12T17:36:16.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.748+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.8 2024-09-12T17:36:16.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.748+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.9 2024-09-12T17:36:16.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.748+0000 7fe8292c69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30.10 2024-09-12T17:36:16.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.752+0000 7fe8292c69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:16.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.752+0000 7fe8292c69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 2024-09-12T17:36:16.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.752+0000 7fe8292c69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:36:16.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.752+0000 7fe8292c69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:36:16.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.752+0000 7fe8292c69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:16.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.752+0000 7fe8292c69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30, ofs0, ns] 2024-09-12T17:36:16.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.756+0000 7fe70a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333509 cookie 94772769061792 notifier 7197 bl.length()=967 2024-09-12T17:36:16.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.756+0000 7fe70a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 info.flags=0x17 2024-09-12T17:36:16.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.756+0000 7fe70a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 to cache LRU end 2024-09-12T17:36:16.753 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.756+0000 7fe70a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:16.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.756+0000 7fe8292c69c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_sources= new_sources= 2024-09-12T17:36:16.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.756+0000 7fe8292c69c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential sources added=[] removed=[] 2024-09-12T17:36:16.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.756+0000 7fe8292c69c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): orig_dests= new_dests= 2024-09-12T17:36:16.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.756+0000 7fe8292c69c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30]): potential dests added=[] removed=[] 2024-09-12T17:36:16.760 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.760+0000 7fe8292c69c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:36:16.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.764+0000 7fe6ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:16.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.768+0000 7fe8292c69c0 20 remove_watcher() i=0 2024-09-12T17:36:16.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.768+0000 7fe8292c69c0 2 removed watcher, disabling cache 2024-09-12T17:36:16.770 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.772+0000 7fe8292c69c0 20 remove_watcher() i=1 2024-09-12T17:36:16.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.776+0000 7fe8292c69c0 20 remove_watcher() i=2 2024-09-12T17:36:16.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.776+0000 7fe8292c69c0 20 remove_watcher() i=3 2024-09-12T17:36:16.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.780+0000 7fe8292c69c0 20 remove_watcher() i=4 2024-09-12T17:36:16.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.780+0000 7fe8292c69c0 20 remove_watcher() i=5 2024-09-12T17:36:16.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.780+0000 7fe8292c69c0 20 remove_watcher() i=6 2024-09-12T17:36:16.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.784+0000 7fe8292c69c0 20 remove_watcher() i=7 2024-09-12T17:36:16.796 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:36:16.826 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:16.826 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:16.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.872+0000 7f4f160e79c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.876+0000 7f4f160e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:16.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.876+0000 7f4f160e79c0 20 realm 2024-09-12T17:36:16.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.876+0000 7f4f160e79c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.876+0000 7f4f160e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:16.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.876+0000 7f4f160e79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:16.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.876+0000 7f4f160e79c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.876+0000 7f4f160e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:16.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.876+0000 7f4f160e79c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.876+0000 7f4f160e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:16.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.876+0000 7f4f160e79c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:16.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.880+0000 7f4f160e79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:16.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.880+0000 7f4f160e79c0 20 searching for the correct realm 2024-09-12T17:36:16.881 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.884+0000 7f4f143ee640 0 -- 172.21.15.119:0/3529722612 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55b4328aab40 msgr2=0x55b4328acf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:16.888 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:16.888+0000 7f4f133ec640 0 -- 172.21.15.119:0/3529722612 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f4f040a3250 msgr2=0x7f4f04064a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:36:17.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.108+0000 7f4f160e79c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:36:17.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.108+0000 7f4f160e79c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:36:17.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.108+0000 7f4f160e79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:17.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.108+0000 7f4f160e79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:17.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.108+0000 7f4f160e79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:17.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.108+0000 7f4f160e79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:17.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.108+0000 7f4f160e79c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:17.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:17.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:17.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:17.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:17.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:17.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 20 zone default found 2024-09-12T17:36:17.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 4 Realm: () 2024-09-12T17:36:17.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:36:17.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:36:17.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:17.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 20 zonegroup default 2024-09-12T17:36:17.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:17.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:17.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:17.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:17.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:17.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:17.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 20 started sync module instance, tier type = 2024-09-12T17:36:17.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.112+0000 7f4f160e79c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:36:17.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.136+0000 7f4f160e79c0 20 add_watcher() i=0 2024-09-12T17:36:17.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.136+0000 7f4f160e79c0 20 add_watcher() i=1 2024-09-12T17:36:17.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.136+0000 7f4f160e79c0 20 add_watcher() i=2 2024-09-12T17:36:17.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.136+0000 7f4f160e79c0 20 add_watcher() i=3 2024-09-12T17:36:17.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.136+0000 7f4f160e79c0 20 add_watcher() i=4 2024-09-12T17:36:17.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.136+0000 7f4f160e79c0 20 add_watcher() i=5 2024-09-12T17:36:17.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.136+0000 7f4f160e79c0 20 add_watcher() i=6 2024-09-12T17:36:17.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.136+0000 7f4f160e79c0 20 add_watcher() i=7 2024-09-12T17:36:17.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.136+0000 7f4f160e79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:17.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.144+0000 7f4dc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:17.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.144+0000 7f4f160e79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:17.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.144+0000 7f4f160e79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:17.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.144+0000 7f4f160e79c0 5 note: GC not initialized 2024-09-12T17:36:17.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.144+0000 7f4dc8fe1640 20 reqs_thread_entry: start 2024-09-12T17:36:17.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.144+0000 7f4f160e79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:17.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.144+0000 7f4f160e79c0 20 Filter name: none 2024-09-12T17:36:17.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.144+0000 7f4d427fc640 20 reqs_thread_entry: start 2024-09-12T17:36:17.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.144+0000 7f4f160e79c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:17.144 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.144+0000 7f4f160e79c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:36:17.144 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.144+0000 7f4f160e79c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:17.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.144+0000 7f4f160e79c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:36:17.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.148+0000 7f4f160e79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:17.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.148+0000 7f4f160e79c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:17.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.148+0000 7f4f160e79c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:36:17.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.148+0000 7f4f160e79c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:17.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.148+0000 7f4f160e79c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:36:17.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.148+0000 7f4f160e79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:17.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.152+0000 7f4dc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:17.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.156+0000 7f4f160e79c0 20 remove_watcher() i=0 2024-09-12T17:36:17.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.156+0000 7f4f160e79c0 2 removed watcher, disabling cache 2024-09-12T17:36:17.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.156+0000 7f4f160e79c0 20 remove_watcher() i=1 2024-09-12T17:36:17.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.160+0000 7f4f160e79c0 20 remove_watcher() i=2 2024-09-12T17:36:17.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.164+0000 7f4f160e79c0 20 remove_watcher() i=3 2024-09-12T17:36:17.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.164+0000 7f4f160e79c0 20 remove_watcher() i=4 2024-09-12T17:36:17.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.164+0000 7f4f160e79c0 20 remove_watcher() i=5 2024-09-12T17:36:17.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.168+0000 7f4f160e79c0 20 remove_watcher() i=6 2024-09-12T17:36:17.167 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:17.168+0000 7f4f160e79c0 20 remove_watcher() i=7 2024-09-12T17:36:17.181 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:17.181 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:36:17.181 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-block-writes id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:36:17.181 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:18.069 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T17:36:18.069 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:20.271 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:36:20.303 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:20.303 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:20.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.352+0000 7f783948f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.352+0000 7f783948f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:20.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.352+0000 7f783948f9c0 20 realm 2024-09-12T17:36:20.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.352+0000 7f783948f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.352+0000 7f783948f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:20.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.352+0000 7f783948f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:20.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.352+0000 7f783948f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.352+0000 7f783948f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:20.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.352+0000 7f783948f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.352+0000 7f783948f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:20.352 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.352+0000 7f783948f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.356+0000 7f783948f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:20.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.356+0000 7f783948f9c0 20 searching for the correct realm 2024-09-12T17:36:20.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.360+0000 7f7837796640 0 -- 172.21.15.119:0/581482606 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f782c0c0020 msgr2=0x7f782c10e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:20.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.576+0000 7f7836794640 0 -- 172.21.15.119:0/581482606 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f78300958a0 msgr2=0x7f783006b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:20.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.792+0000 7f783948f9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:36:20.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.792+0000 7f783948f9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:36:20.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.792+0000 7f783948f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:20.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.792+0000 7f783948f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:20.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.792+0000 7f783948f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:20.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.792+0000 7f783948f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:20.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.792+0000 7f783948f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.792 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.792+0000 7f783948f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:20.793 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.792+0000 7f783948f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.793 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.796+0000 7f783948f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:20.793 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.796+0000 7f783948f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.796+0000 7f783948f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:20.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.796+0000 7f783948f9c0 20 zone default found 2024-09-12T17:36:20.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.796+0000 7f783948f9c0 4 Realm: () 2024-09-12T17:36:20.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.796+0000 7f783948f9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:36:20.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.796+0000 7f783948f9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:36:20.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.796+0000 7f783948f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:20.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.796+0000 7f783948f9c0 20 zonegroup default 2024-09-12T17:36:20.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.796+0000 7f783948f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.796+0000 7f783948f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:20.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.796+0000 7f783948f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.796+0000 7f783948f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:20.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.796+0000 7f783948f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.800+0000 7f783948f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:20.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.800+0000 7f783948f9c0 20 started sync module instance, tier type = 2024-09-12T17:36:20.797 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.800+0000 7f783948f9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:36:20.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.820+0000 7f783948f9c0 20 add_watcher() i=0 2024-09-12T17:36:20.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.820+0000 7f783948f9c0 20 add_watcher() i=1 2024-09-12T17:36:20.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.820+0000 7f783948f9c0 20 add_watcher() i=2 2024-09-12T17:36:20.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.820+0000 7f783948f9c0 20 add_watcher() i=3 2024-09-12T17:36:20.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.820+0000 7f783948f9c0 20 add_watcher() i=4 2024-09-12T17:36:20.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.820+0000 7f783948f9c0 20 add_watcher() i=5 2024-09-12T17:36:20.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.820+0000 7f783948f9c0 20 add_watcher() i=6 2024-09-12T17:36:20.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.824+0000 7f783948f9c0 20 add_watcher() i=7 2024-09-12T17:36:20.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.824+0000 7f783948f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:20.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.824+0000 7f76edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:20.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.828+0000 7f783948f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:20.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.828+0000 7f783948f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:20.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.828+0000 7f783948f9c0 5 note: GC not initialized 2024-09-12T17:36:20.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.828+0000 7f76ecfe1640 20 reqs_thread_entry: start 2024-09-12T17:36:20.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.828+0000 7f783948f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:20.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.828+0000 7f783948f9c0 20 Filter name: none 2024-09-12T17:36:20.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.828+0000 7f76e5ffb640 20 reqs_thread_entry: start 2024-09-12T17:36:20.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.828+0000 7f783948f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.828+0000 7f783948f9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:20.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.828+0000 7f783948f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.832+0000 7f783948f9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:20.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.832+0000 7f783948f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:20.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.832+0000 7f783948f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.830 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.832+0000 7f783948f9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:20.830 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.832+0000 7f783948f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.832+0000 7f783948f9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:20.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.832+0000 7f783948f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:20.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.836+0000 7f76edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:20.839 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.840+0000 7f783948f9c0 20 remove_watcher() i=0 2024-09-12T17:36:20.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.840+0000 7f783948f9c0 2 removed watcher, disabling cache 2024-09-12T17:36:20.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.844+0000 7f783948f9c0 20 remove_watcher() i=1 2024-09-12T17:36:20.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.848+0000 7f783948f9c0 20 remove_watcher() i=2 2024-09-12T17:36:20.847 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.848+0000 7f783948f9c0 20 remove_watcher() i=3 2024-09-12T17:36:20.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.852+0000 7f783948f9c0 20 remove_watcher() i=4 2024-09-12T17:36:20.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.852+0000 7f783948f9c0 20 remove_watcher() i=5 2024-09-12T17:36:20.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.856+0000 7f783948f9c0 20 remove_watcher() i=6 2024-09-12T17:36:20.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.856+0000 7f783948f9c0 20 remove_watcher() i=7 2024-09-12T17:36:20.870 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:20.870 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:36:20.870 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-commit-target-layout id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:36:20.870 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:20.871 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T17:36:20.903 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:20.903 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:20.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.948+0000 7f156af3e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.952+0000 7f156af3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:20.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.952+0000 7f156af3e9c0 20 realm 2024-09-12T17:36:20.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.952+0000 7f156af3e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.952+0000 7f156af3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:20.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.952+0000 7f156af3e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:20.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.952+0000 7f156af3e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.952+0000 7f156af3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:20.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.952+0000 7f156af3e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.952+0000 7f156af3e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:20.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.952+0000 7f156af3e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:20.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.956+0000 7f156af3e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:20.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.956+0000 7f156af3e9c0 20 searching for the correct realm 2024-09-12T17:36:20.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:20.956+0000 7f1569245640 0 -- 172.21.15.119:0/1035765382 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f1550024040 msgr2=0x7f1550019b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:21.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.372+0000 7f1568243640 0 -- 172.21.15.119:0/1035765382 >> [v2:172.21.15.194:6816/2881805626,v1:172.21.15.194:6817/2881805626] conn(0x558e004646c0 msgr2=0x558e00466af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:21.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.388+0000 7f156af3e9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:36:21.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.388+0000 7f156af3e9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:36:21.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.388+0000 7f156af3e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:21.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.388+0000 7f156af3e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:21.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.388+0000 7f156af3e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:21.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.388+0000 7f156af3e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:21.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.388+0000 7f156af3e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:21.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.388+0000 7f156af3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:21.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.388+0000 7f156af3e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:21.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.388+0000 7f156af3e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:21.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.388+0000 7f156af3e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:21.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.392+0000 7f156af3e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:21.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.392+0000 7f156af3e9c0 20 zone default found 2024-09-12T17:36:21.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.392+0000 7f156af3e9c0 4 Realm: () 2024-09-12T17:36:21.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.392+0000 7f156af3e9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:36:21.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.392+0000 7f156af3e9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:36:21.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.392+0000 7f156af3e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:21.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.392+0000 7f156af3e9c0 20 zonegroup default 2024-09-12T17:36:21.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.392+0000 7f156af3e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:21.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.392+0000 7f156af3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:21.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.392+0000 7f156af3e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:21.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.392+0000 7f156af3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:21.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.392+0000 7f156af3e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:21.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.392+0000 7f156af3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:21.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.392+0000 7f156af3e9c0 20 started sync module instance, tier type = 2024-09-12T17:36:21.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.392+0000 7f156af3e9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:36:21.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.416+0000 7f156af3e9c0 20 add_watcher() i=0 2024-09-12T17:36:21.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.416+0000 7f156af3e9c0 20 add_watcher() i=1 2024-09-12T17:36:21.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.416+0000 7f156af3e9c0 20 add_watcher() i=2 2024-09-12T17:36:21.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.416+0000 7f156af3e9c0 20 add_watcher() i=3 2024-09-12T17:36:21.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.416+0000 7f156af3e9c0 20 add_watcher() i=4 2024-09-12T17:36:21.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.416+0000 7f156af3e9c0 20 add_watcher() i=5 2024-09-12T17:36:21.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.416+0000 7f156af3e9c0 20 add_watcher() i=6 2024-09-12T17:36:21.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.420+0000 7f156af3e9c0 20 add_watcher() i=7 2024-09-12T17:36:21.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.420+0000 7f156af3e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:21.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.420+0000 7f141efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:21.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:21.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:21.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 5 note: GC not initialized 2024-09-12T17:36:21.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f141dfe3640 20 reqs_thread_entry: start 2024-09-12T17:36:21.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:21.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 20 Filter name: none 2024-09-12T17:36:21.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f138f7fe640 20 reqs_thread_entry: start 2024-09-12T17:36:21.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:36:21.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:21.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:21.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:36:21.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:36:21.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 : miss 2024-09-12T17:36:21.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:21.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:21.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 info.flags=0x17 2024-09-12T17:36:21.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 to cache LRU end 2024-09-12T17:36:21.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:36:21.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:21.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.424+0000 7f156af3e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 2024-09-12T17:36:21.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.440+0000 7f156af3e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 info.flags=0x17 2024-09-12T17:36:21.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.440+0000 7f156af3e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 to cache LRU end 2024-09-12T17:36:21.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.440+0000 7f156af3e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:21.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.440+0000 7f156af3e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31, ofs0, ns] 2024-09-12T17:36:21.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.440+0000 7f143ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333502 cookie 94068378328368 notifier 7257 bl.length()=1015 2024-09-12T17:36:21.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.440+0000 7f143ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 info.flags=0x17 2024-09-12T17:36:21.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.440+0000 7f143ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 to cache LRU end 2024-09-12T17:36:21.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.440+0000 7f143ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:21.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.444+0000 7f156af3e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): orig_sources= new_sources= 2024-09-12T17:36:21.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.444+0000 7f156af3e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): potential sources added=[] removed=[] 2024-09-12T17:36:21.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.444+0000 7f156af3e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): orig_dests= new_dests= 2024-09-12T17:36:21.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.444+0000 7f156af3e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): potential dests added=[] removed=[] 2024-09-12T17:36:21.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.0 2024-09-12T17:36:21.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.0 2024-09-12T17:36:21.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.1 2024-09-12T17:36:21.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.1 2024-09-12T17:36:21.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.2 2024-09-12T17:36:21.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.2 2024-09-12T17:36:21.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.3 2024-09-12T17:36:21.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.3 2024-09-12T17:36:21.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.4 2024-09-12T17:36:21.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.4 2024-09-12T17:36:21.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.5 2024-09-12T17:36:21.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.5 2024-09-12T17:36:21.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.6 2024-09-12T17:36:21.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.6 2024-09-12T17:36:21.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.7 2024-09-12T17:36:21.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.7 2024-09-12T17:36:21.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.8 2024-09-12T17:36:21.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.8 2024-09-12T17:36:21.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.9 2024-09-12T17:36:21.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.9 2024-09-12T17:36:21.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.10 2024-09-12T17:36:21.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.10 2024-09-12T17:36:21.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.11 2024-09-12T17:36:21.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1.11 2024-09-12T17:36:21.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.0 2024-09-12T17:36:21.456 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.456+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1 2024-09-12T17:36:21.456 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.460+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2 2024-09-12T17:36:21.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.460+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.3 2024-09-12T17:36:21.458 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.460+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.4 2024-09-12T17:36:21.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.460+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.5 2024-09-12T17:36:21.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.464+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.6 2024-09-12T17:36:21.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.464+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.7 2024-09-12T17:36:21.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.464+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.8 2024-09-12T17:36:21.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.464+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.9 2024-09-12T17:36:21.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.468+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.10 2024-09-12T17:36:21.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.476+0000 7f156af3e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:21.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.476+0000 7f156af3e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 2024-09-12T17:36:21.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.480+0000 7f156af3e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 info.flags=0x17 2024-09-12T17:36:21.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.480+0000 7f156af3e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 to cache LRU end 2024-09-12T17:36:21.476 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.480+0000 7f156af3e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:21.477 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.480+0000 7f156af3e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31, ofs0, ns] 2024-09-12T17:36:21.477 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.480+0000 7f143f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333503 cookie 94068378328368 notifier 7257 bl.length()=1015 2024-09-12T17:36:21.478 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.480+0000 7f143f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 info.flags=0x17 2024-09-12T17:36:21.478 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.480+0000 7f143f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 to cache LRU end 2024-09-12T17:36:21.478 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.480+0000 7f143f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:21.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.480+0000 7f156af3e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): orig_sources= new_sources= 2024-09-12T17:36:21.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.480+0000 7f156af3e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): potential sources added=[] removed=[] 2024-09-12T17:36:21.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.480+0000 7f156af3e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): orig_dests= new_dests= 2024-09-12T17:36:21.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.480+0000 7f156af3e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): potential dests added=[] removed=[] 2024-09-12T17:36:21.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.488+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.0 2024-09-12T17:36:21.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.488+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1 2024-09-12T17:36:21.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.488+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2 2024-09-12T17:36:21.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.492+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.3 2024-09-12T17:36:21.489 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.492+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.4 2024-09-12T17:36:21.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.492+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.5 2024-09-12T17:36:21.491 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.492+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.6 2024-09-12T17:36:21.491 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.492+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.7 2024-09-12T17:36:21.491 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.492+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.8 2024-09-12T17:36:21.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.496+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.9 2024-09-12T17:36:21.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.496+0000 7f156af3e9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.10 2024-09-12T17:36:21.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.496+0000 7f156af3e9c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T17:36:21.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.496+0000 7f156af3e9c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T17:36:21.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.504+0000 7f141efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:21.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.512+0000 7f156af3e9c0 20 remove_watcher() i=0 2024-09-12T17:36:21.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.512+0000 7f156af3e9c0 2 removed watcher, disabling cache 2024-09-12T17:36:21.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.512+0000 7f156af3e9c0 20 remove_watcher() i=1 2024-09-12T17:36:21.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.516+0000 7f156af3e9c0 20 remove_watcher() i=2 2024-09-12T17:36:21.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.516+0000 7f156af3e9c0 20 remove_watcher() i=3 2024-09-12T17:36:21.517 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.520+0000 7f156af3e9c0 20 remove_watcher() i=4 2024-09-12T17:36:21.518 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.520+0000 7f156af3e9c0 20 remove_watcher() i=5 2024-09-12T17:36:21.520 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.520+0000 7f156af3e9c0 20 remove_watcher() i=6 2024-09-12T17:36:21.521 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.524+0000 7f156af3e9c0 20 remove_watcher() i=7 2024-09-12T17:36:21.538 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:36:21.570 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:21.570 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:21.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.616+0000 7feeb7c619c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:21.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.620+0000 7feeb7c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:21.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.620+0000 7feeb7c619c0 20 realm 2024-09-12T17:36:21.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.620+0000 7feeb7c619c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:21.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.620+0000 7feeb7c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:21.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.620+0000 7feeb7c619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:21.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.620+0000 7feeb7c619c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:21.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.620+0000 7feeb7c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:21.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.620+0000 7feeb7c619c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:21.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.620+0000 7feeb7c619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:21.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.620+0000 7feeb7c619c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:21.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.624+0000 7feeb7c619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:21.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.624+0000 7feeb7c619c0 20 searching for the correct realm 2024-09-12T17:36:21.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.628+0000 7feeb5f68640 0 -- 172.21.15.119:0/676314254 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7feeac01f060 msgr2=0x7feeac088880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:36:21.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:21.844+0000 7feeb4f66640 0 -- 172.21.15.119:0/676314254 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7feeb0007d10 msgr2=0x7feeb00d29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:22.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.060+0000 7feeb7c619c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:36:22.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.060+0000 7feeb7c619c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:36:22.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.060+0000 7feeb7c619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:22.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.060+0000 7feeb7c619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:22.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.060+0000 7feeb7c619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:22.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.060+0000 7feeb7c619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:22.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.060+0000 7feeb7c619c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.060+0000 7feeb7c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.060+0000 7feeb7c619c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:22.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:22.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 20 zone default found 2024-09-12T17:36:22.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 4 Realm: () 2024-09-12T17:36:22.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:36:22.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:36:22.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:22.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 20 zonegroup default 2024-09-12T17:36:22.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 20 started sync module instance, tier type = 2024-09-12T17:36:22.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.064+0000 7feeb7c619c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:36:22.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.088+0000 7feeb7c619c0 20 add_watcher() i=0 2024-09-12T17:36:22.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.088+0000 7feeb7c619c0 20 add_watcher() i=1 2024-09-12T17:36:22.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.088+0000 7feeb7c619c0 20 add_watcher() i=2 2024-09-12T17:36:22.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.088+0000 7feeb7c619c0 20 add_watcher() i=3 2024-09-12T17:36:22.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.088+0000 7feeb7c619c0 20 add_watcher() i=4 2024-09-12T17:36:22.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.088+0000 7feeb7c619c0 20 add_watcher() i=5 2024-09-12T17:36:22.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.088+0000 7feeb7c619c0 20 add_watcher() i=6 2024-09-12T17:36:22.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.092+0000 7feeb7c619c0 20 add_watcher() i=7 2024-09-12T17:36:22.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.092+0000 7feeb7c619c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:22.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.096+0000 7fed6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:22.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.096+0000 7feeb7c619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:22.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.096+0000 7feeb7c619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:22.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.096+0000 7feeb7c619c0 5 note: GC not initialized 2024-09-12T17:36:22.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.100+0000 7fed6a7e4640 20 reqs_thread_entry: start 2024-09-12T17:36:22.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.100+0000 7feeb7c619c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:22.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.100+0000 7feeb7c619c0 20 Filter name: none 2024-09-12T17:36:22.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.100+0000 7fecdbfff640 20 reqs_thread_entry: start 2024-09-12T17:36:22.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.100+0000 7feeb7c619c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.100+0000 7feeb7c619c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:22.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.100+0000 7feeb7c619c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.100+0000 7feeb7c619c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:36:22.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.100+0000 7feeb7c619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:22.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.100+0000 7feeb7c619c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.104+0000 7feeb7c619c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:22.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.104+0000 7feeb7c619c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.104+0000 7feeb7c619c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:36:22.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.104+0000 7feeb7c619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:22.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.108+0000 7fed6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:22.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.112+0000 7feeb7c619c0 20 remove_watcher() i=0 2024-09-12T17:36:22.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.112+0000 7feeb7c619c0 2 removed watcher, disabling cache 2024-09-12T17:36:22.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.116+0000 7feeb7c619c0 20 remove_watcher() i=1 2024-09-12T17:36:22.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.116+0000 7feeb7c619c0 20 remove_watcher() i=2 2024-09-12T17:36:22.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.120+0000 7feeb7c619c0 20 remove_watcher() i=3 2024-09-12T17:36:22.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.120+0000 7feeb7c619c0 20 remove_watcher() i=4 2024-09-12T17:36:22.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.124+0000 7feeb7c619c0 20 remove_watcher() i=5 2024-09-12T17:36:22.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.124+0000 7feeb7c619c0 20 remove_watcher() i=6 2024-09-12T17:36:22.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.124+0000 7feeb7c619c0 20 remove_watcher() i=7 2024-09-12T17:36:22.139 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:22.139 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:36:22.139 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-commit-target-layout id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:36:22.139 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:22.241 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:36:22.276 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:22.276 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:22.531 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.532+0000 7fd9ff4949c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.532+0000 7fd9ff4949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.532+0000 7fd9ff4949c0 20 realm 2024-09-12T17:36:22.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.532+0000 7fd9ff4949c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.536+0000 7fd9ff4949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.536+0000 7fd9ff4949c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:22.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.536+0000 7fd9ff4949c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.536+0000 7fd9ff4949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.536+0000 7fd9ff4949c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.536+0000 7fd9ff4949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:22.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.536+0000 7fd9ff4949c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.540+0000 7fd9ff4949c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:22.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.540+0000 7fd9ff4949c0 20 searching for the correct realm 2024-09-12T17:36:22.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.540+0000 7fd9fc799640 0 -- 172.21.15.119:0/2110047198 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fd9ec01a040 msgr2=0x7fd9ec026910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:22.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.548+0000 7fd9fc799640 0 -- 172.21.15.119:0/2110047198 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fd8c8081290 msgr2=0x7fd8c80836c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:22.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:36:22.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:36:22.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:22.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:22.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:22.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:22.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:22.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:22.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 zone default found 2024-09-12T17:36:22.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 4 Realm: () 2024-09-12T17:36:22.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:36:22.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:36:22.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:22.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 zonegroup default 2024-09-12T17:36:22.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 started sync module instance, tier type = 2024-09-12T17:36:22.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.560+0000 7fd9ff4949c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:36:22.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.580+0000 7fd9ff4949c0 20 add_watcher() i=0 2024-09-12T17:36:22.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.580+0000 7fd9ff4949c0 20 add_watcher() i=1 2024-09-12T17:36:22.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.580+0000 7fd9ff4949c0 20 add_watcher() i=2 2024-09-12T17:36:22.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.580+0000 7fd9ff4949c0 20 add_watcher() i=3 2024-09-12T17:36:22.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.580+0000 7fd9ff4949c0 20 add_watcher() i=4 2024-09-12T17:36:22.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.580+0000 7fd9ff4949c0 20 add_watcher() i=5 2024-09-12T17:36:22.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.580+0000 7fd9ff4949c0 20 add_watcher() i=6 2024-09-12T17:36:22.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.580+0000 7fd9ff4949c0 20 add_watcher() i=7 2024-09-12T17:36:22.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.580+0000 7fd9ff4949c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:22.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.584+0000 7fd8b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:22.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.584+0000 7fd9ff4949c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:22.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.584+0000 7fd9ff4949c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:22.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.584+0000 7fd9ff4949c0 5 note: GC not initialized 2024-09-12T17:36:22.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.584+0000 7fd8b1fe3640 20 reqs_thread_entry: start 2024-09-12T17:36:22.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.584+0000 7fd9ff4949c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:22.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.584+0000 7fd9ff4949c0 20 Filter name: none 2024-09-12T17:36:22.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.584+0000 7fd8237fe640 20 reqs_thread_entry: start 2024-09-12T17:36:22.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.584+0000 7fd9ff4949c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:36:22.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.584+0000 7fd9ff4949c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.584+0000 7fd9ff4949c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:22.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.584+0000 7fd9ff4949c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:36:22.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.584+0000 7fd9ff4949c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:36:22.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.584+0000 7fd9ff4949c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 : miss 2024-09-12T17:36:22.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.584+0000 7fd9ff4949c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.588+0000 7fd9ff4949c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:36:22.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.588+0000 7fd9ff4949c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 info.flags=0x17 2024-09-12T17:36:22.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.588+0000 7fd9ff4949c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 to cache LRU end 2024-09-12T17:36:22.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.588+0000 7fd9ff4949c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:36:22.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.588+0000 7fd9ff4949c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:22.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.588+0000 7fd9ff4949c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 2024-09-12T17:36:22.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.588+0000 7fd9ff4949c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:36:22.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.604+0000 7fd9ff4949c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 info.flags=0x17 2024-09-12T17:36:22.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.604+0000 7fd9ff4949c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 to cache LRU end 2024-09-12T17:36:22.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.604+0000 7fd9ff4949c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:22.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.604+0000 7fd9ff4949c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31, ofs0, ns] 2024-09-12T17:36:22.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.604+0000 7fd8d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333504 cookie 93861255006160 notifier 6869 bl.length()=1015 2024-09-12T17:36:22.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.604+0000 7fd8d3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 info.flags=0x17 2024-09-12T17:36:22.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.604+0000 7fd8d3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 to cache LRU end 2024-09-12T17:36:22.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.604+0000 7fd8d3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:22.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.608+0000 7fd9ff4949c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): orig_sources= new_sources= 2024-09-12T17:36:22.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.608+0000 7fd9ff4949c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): potential sources added=[] removed=[] 2024-09-12T17:36:22.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.608+0000 7fd9ff4949c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): orig_dests= new_dests= 2024-09-12T17:36:22.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.608+0000 7fd9ff4949c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): potential dests added=[] removed=[] 2024-09-12T17:36:22.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.0 2024-09-12T17:36:22.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.0 2024-09-12T17:36:22.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.1 2024-09-12T17:36:22.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.1 2024-09-12T17:36:22.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.2 2024-09-12T17:36:22.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.2 2024-09-12T17:36:22.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.3 2024-09-12T17:36:22.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.3 2024-09-12T17:36:22.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.4 2024-09-12T17:36:22.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.4 2024-09-12T17:36:22.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.5 2024-09-12T17:36:22.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.5 2024-09-12T17:36:22.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.6 2024-09-12T17:36:22.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.6 2024-09-12T17:36:22.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.7 2024-09-12T17:36:22.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.7 2024-09-12T17:36:22.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.8 2024-09-12T17:36:22.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.8 2024-09-12T17:36:22.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.9 2024-09-12T17:36:22.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.9 2024-09-12T17:36:22.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.10 2024-09-12T17:36:22.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.10 2024-09-12T17:36:22.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.11 2024-09-12T17:36:22.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2.11 2024-09-12T17:36:22.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.0 2024-09-12T17:36:22.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.620+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1 2024-09-12T17:36:22.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.624+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2 2024-09-12T17:36:22.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.624+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.3 2024-09-12T17:36:22.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.624+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.4 2024-09-12T17:36:22.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.624+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.5 2024-09-12T17:36:22.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.628+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.6 2024-09-12T17:36:22.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.628+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.7 2024-09-12T17:36:22.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.628+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.8 2024-09-12T17:36:22.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.628+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.9 2024-09-12T17:36:22.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.628+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.10 2024-09-12T17:36:22.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.636+0000 7fd9ff4949c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:22.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.636+0000 7fd9ff4949c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 2024-09-12T17:36:22.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.640+0000 7fd9ff4949c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 info.flags=0x17 2024-09-12T17:36:22.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.640+0000 7fd9ff4949c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 to cache LRU end 2024-09-12T17:36:22.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.640+0000 7fd9ff4949c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:22.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.640+0000 7fd9ff4949c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31, ofs0, ns] 2024-09-12T17:36:22.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.640+0000 7fd8d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333505 cookie 93861255006160 notifier 6869 bl.length()=1015 2024-09-12T17:36:22.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.640+0000 7fd8d3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 info.flags=0x17 2024-09-12T17:36:22.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.640+0000 7fd8d3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 to cache LRU end 2024-09-12T17:36:22.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.640+0000 7fd8d3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:22.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.644+0000 7fd9ff4949c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): orig_sources= new_sources= 2024-09-12T17:36:22.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.644+0000 7fd9ff4949c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): potential sources added=[] removed=[] 2024-09-12T17:36:22.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.644+0000 7fd9ff4949c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): orig_dests= new_dests= 2024-09-12T17:36:22.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.644+0000 7fd9ff4949c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): potential dests added=[] removed=[] 2024-09-12T17:36:22.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.652+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.0 2024-09-12T17:36:22.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.652+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.1 2024-09-12T17:36:22.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.652+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.2 2024-09-12T17:36:22.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.652+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.3 2024-09-12T17:36:22.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.652+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.4 2024-09-12T17:36:22.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.656+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.5 2024-09-12T17:36:22.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.656+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.6 2024-09-12T17:36:22.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.656+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.7 2024-09-12T17:36:22.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.656+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.8 2024-09-12T17:36:22.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.656+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.9 2024-09-12T17:36:22.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.660+0000 7fd9ff4949c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31.10 2024-09-12T17:36:22.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.660+0000 7fd9ff4949c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:22.658 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.660+0000 7fd9ff4949c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 2024-09-12T17:36:22.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.664+0000 7fd9ff4949c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 info.flags=0x17 2024-09-12T17:36:22.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.664+0000 7fd9ff4949c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 to cache LRU end 2024-09-12T17:36:22.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.664+0000 7fd9ff4949c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:22.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.664+0000 7fd9ff4949c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31, ofs0, ns] 2024-09-12T17:36:22.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.664+0000 7fd8d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333506 cookie 93861255006160 notifier 6869 bl.length()=983 2024-09-12T17:36:22.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.664+0000 7fd8d37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 info.flags=0x17 2024-09-12T17:36:22.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.664+0000 7fd8d37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 to cache LRU end 2024-09-12T17:36:22.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.664+0000 7fd8d37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:22.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.668+0000 7fd9ff4949c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): orig_sources= new_sources= 2024-09-12T17:36:22.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.668+0000 7fd9ff4949c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): potential sources added=[] removed=[] 2024-09-12T17:36:22.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.668+0000 7fd9ff4949c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): orig_dests= new_dests= 2024-09-12T17:36:22.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.668+0000 7fd9ff4949c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31]): potential dests added=[] removed=[] 2024-09-12T17:36:22.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.672+0000 7fd9ff4949c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:36:22.675 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.676+0000 7fd8b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:22.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.680+0000 7fd9ff4949c0 20 remove_watcher() i=0 2024-09-12T17:36:22.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.680+0000 7fd9ff4949c0 2 removed watcher, disabling cache 2024-09-12T17:36:22.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.684+0000 7fd9ff4949c0 20 remove_watcher() i=1 2024-09-12T17:36:22.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.688+0000 7fd9ff4949c0 20 remove_watcher() i=2 2024-09-12T17:36:22.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.688+0000 7fd9ff4949c0 20 remove_watcher() i=3 2024-09-12T17:36:22.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.692+0000 7fd9ff4949c0 20 remove_watcher() i=4 2024-09-12T17:36:22.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.692+0000 7fd9ff4949c0 20 remove_watcher() i=5 2024-09-12T17:36:22.691 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.692+0000 7fd9ff4949c0 20 remove_watcher() i=6 2024-09-12T17:36:22.693 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.696+0000 7fd9ff4949c0 20 remove_watcher() i=7 2024-09-12T17:36:22.708 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:36:22.736 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:22.736 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:22.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.780+0000 7fcfb20cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.784+0000 7fcfb20cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.784+0000 7fcfb20cd9c0 20 realm 2024-09-12T17:36:22.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.784+0000 7fcfb20cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.784+0000 7fcfb20cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.784+0000 7fcfb20cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:22.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.784+0000 7fcfb20cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.784+0000 7fcfb20cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.784+0000 7fcfb20cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.784+0000 7fcfb20cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:22.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.784+0000 7fcfb20cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.788+0000 7fcfb20cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:22.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.788+0000 7fcfb20cd9c0 20 searching for the correct realm 2024-09-12T17:36:22.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.792+0000 7fcfb03d4640 0 -- 172.21.15.119:0/2479731935 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55bf4bd10b70 msgr2=0x55bf4bd12f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:36:22.797 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:22.800+0000 7fcfaf3d2640 0 -- 172.21.15.119:0/2479731935 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fcfa0124940 msgr2=0x7fcfa0100910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:23.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.016+0000 7fcfb20cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:36:23.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.016+0000 7fcfb20cd9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:36:23.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.016+0000 7fcfb20cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:23.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.016+0000 7fcfb20cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:23.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.016+0000 7fcfb20cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:23.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.016+0000 7fcfb20cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:23.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.016+0000 7fcfb20cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:23.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.016+0000 7fcfb20cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:23.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.016+0000 7fcfb20cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:23.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:23.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:23.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:23.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 20 zone default found 2024-09-12T17:36:23.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 4 Realm: () 2024-09-12T17:36:23.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:36:23.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:36:23.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:23.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 20 zonegroup default 2024-09-12T17:36:23.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:23.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:23.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:23.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:23.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:23.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:23.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 20 started sync module instance, tier type = 2024-09-12T17:36:23.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.020+0000 7fcfb20cd9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:36:23.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.044+0000 7fcfb20cd9c0 20 add_watcher() i=0 2024-09-12T17:36:23.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.044+0000 7fcfb20cd9c0 20 add_watcher() i=1 2024-09-12T17:36:23.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.044+0000 7fcfb20cd9c0 20 add_watcher() i=2 2024-09-12T17:36:23.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.044+0000 7fcfb20cd9c0 20 add_watcher() i=3 2024-09-12T17:36:23.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.044+0000 7fcfb20cd9c0 20 add_watcher() i=4 2024-09-12T17:36:23.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.044+0000 7fcfb20cd9c0 20 add_watcher() i=5 2024-09-12T17:36:23.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.044+0000 7fcfb20cd9c0 20 add_watcher() i=6 2024-09-12T17:36:23.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.048+0000 7fcfb20cd9c0 20 add_watcher() i=7 2024-09-12T17:36:23.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.048+0000 7fcfb20cd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:23.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.052+0000 7fce65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:23.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.052+0000 7fcfb20cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:23.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.052+0000 7fcfb20cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:23.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.052+0000 7fcfb20cd9c0 5 note: GC not initialized 2024-09-12T17:36:23.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.052+0000 7fce64fe1640 20 reqs_thread_entry: start 2024-09-12T17:36:23.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.052+0000 7fcfb20cd9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:23.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.052+0000 7fcfb20cd9c0 20 Filter name: none 2024-09-12T17:36:23.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.052+0000 7fcdde7fc640 20 reqs_thread_entry: start 2024-09-12T17:36:23.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.052+0000 7fcfb20cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:23.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.056+0000 7fcfb20cd9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:23.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.056+0000 7fcfb20cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:23.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.056+0000 7fcfb20cd9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:23.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.056+0000 7fcfb20cd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:23.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.056+0000 7fcfb20cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:23.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.056+0000 7fcfb20cd9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:23.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.056+0000 7fcfb20cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:23.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.060+0000 7fcfb20cd9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:23.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.060+0000 7fcfb20cd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:23.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.064+0000 7fce65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:23.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.068+0000 7fcfb20cd9c0 20 remove_watcher() i=0 2024-09-12T17:36:23.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.068+0000 7fcfb20cd9c0 2 removed watcher, disabling cache 2024-09-12T17:36:23.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.068+0000 7fcfb20cd9c0 20 remove_watcher() i=1 2024-09-12T17:36:23.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.072+0000 7fcfb20cd9c0 20 remove_watcher() i=2 2024-09-12T17:36:23.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.072+0000 7fcfb20cd9c0 20 remove_watcher() i=3 2024-09-12T17:36:23.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.076+0000 7fcfb20cd9c0 20 remove_watcher() i=4 2024-09-12T17:36:23.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.080+0000 7fcfb20cd9c0 20 remove_watcher() i=5 2024-09-12T17:36:23.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.080+0000 7fcfb20cd9c0 20 remove_watcher() i=6 2024-09-12T17:36:23.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:23.080+0000 7fcfb20cd9c0 20 remove_watcher() i=7 2024-09-12T17:36:23.096 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:23.096 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:36:23.097 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-commit-target-layout id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:36:23.097 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:24.036 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T17:36:24.036 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:26.277 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:36:26.311 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:26.311 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:26.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.360+0000 7f8b1f38b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.360+0000 7f8b1f38b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.360+0000 7f8b1f38b9c0 20 realm 2024-09-12T17:36:26.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.360+0000 7f8b1f38b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.360+0000 7f8b1f38b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.360+0000 7f8b1f38b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:26.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.360+0000 7f8b1f38b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.360+0000 7f8b1f38b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.360+0000 7f8b1f38b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.364+0000 7f8b1f38b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:26.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.364+0000 7f8b1f38b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.363 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.364+0000 7f8b1f38b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:26.363 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.364+0000 7f8b1f38b9c0 20 searching for the correct realm 2024-09-12T17:36:26.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.368+0000 7f8b1d692640 0 -- 172.21.15.119:0/383834019 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x560529fc9f10 msgr2=0x560529fcc300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:26.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.376+0000 7f8b1c690640 0 -- 172.21.15.119:0/383834019 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f8b14011a40 msgr2=0x7f8b1402c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:36:26.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.592+0000 7f8b1f38b9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:36:26.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.592+0000 7f8b1f38b9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:36:26.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.592+0000 7f8b1f38b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:26.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.592+0000 7f8b1f38b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:26.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.592+0000 7f8b1f38b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:26.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.592+0000 7f8b1f38b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:26.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.592+0000 7f8b1f38b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.592+0000 7f8b1f38b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.592+0000 7f8b1f38b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.592+0000 7f8b1f38b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:26.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.592+0000 7f8b1f38b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.596+0000 7f8b1f38b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:26.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.596+0000 7f8b1f38b9c0 20 zone default found 2024-09-12T17:36:26.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.596+0000 7f8b1f38b9c0 4 Realm: () 2024-09-12T17:36:26.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.596+0000 7f8b1f38b9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:36:26.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.596+0000 7f8b1f38b9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:36:26.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.596+0000 7f8b1f38b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:26.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.596+0000 7f8b1f38b9c0 20 zonegroup default 2024-09-12T17:36:26.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.596+0000 7f8b1f38b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.596+0000 7f8b1f38b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.596+0000 7f8b1f38b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.596+0000 7f8b1f38b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.596+0000 7f8b1f38b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.596+0000 7f8b1f38b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.596+0000 7f8b1f38b9c0 20 started sync module instance, tier type = 2024-09-12T17:36:26.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.596+0000 7f8b1f38b9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:36:26.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.620+0000 7f8b1f38b9c0 20 add_watcher() i=0 2024-09-12T17:36:26.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.620+0000 7f8b1f38b9c0 20 add_watcher() i=1 2024-09-12T17:36:26.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.620+0000 7f8b1f38b9c0 20 add_watcher() i=2 2024-09-12T17:36:26.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.620+0000 7f8b1f38b9c0 20 add_watcher() i=3 2024-09-12T17:36:26.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.620+0000 7f8b1f38b9c0 20 add_watcher() i=4 2024-09-12T17:36:26.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.620+0000 7f8b1f38b9c0 20 add_watcher() i=5 2024-09-12T17:36:26.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.620+0000 7f8b1f38b9c0 20 add_watcher() i=6 2024-09-12T17:36:26.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.620+0000 7f8b1f38b9c0 20 add_watcher() i=7 2024-09-12T17:36:26.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.620+0000 7f8b1f38b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:26.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.624+0000 7f89d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:26.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.624+0000 7f8b1f38b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:26.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.624+0000 7f8b1f38b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:26.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.628+0000 7f8b1f38b9c0 5 note: GC not initialized 2024-09-12T17:36:26.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.628+0000 7f89d27e4640 20 reqs_thread_entry: start 2024-09-12T17:36:26.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.628+0000 7f8b1f38b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:26.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.628+0000 7f8b1f38b9c0 20 Filter name: none 2024-09-12T17:36:26.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.628+0000 7f89cb7fe640 20 reqs_thread_entry: start 2024-09-12T17:36:26.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.628+0000 7f8b1f38b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.628+0000 7f8b1f38b9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:26.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.628+0000 7f8b1f38b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.628+0000 7f8b1f38b9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:26.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.628+0000 7f8b1f38b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:26.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.628+0000 7f8b1f38b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.632+0000 7f8b1f38b9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:26.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.632+0000 7f8b1f38b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.632+0000 7f8b1f38b9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:26.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.632+0000 7f8b1f38b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:26.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.636+0000 7f89d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:26.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.640+0000 7f8b1f38b9c0 20 remove_watcher() i=0 2024-09-12T17:36:26.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.640+0000 7f8b1f38b9c0 2 removed watcher, disabling cache 2024-09-12T17:36:26.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.644+0000 7f8b1f38b9c0 20 remove_watcher() i=1 2024-09-12T17:36:26.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.644+0000 7f8b1f38b9c0 20 remove_watcher() i=2 2024-09-12T17:36:26.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.648+0000 7f8b1f38b9c0 20 remove_watcher() i=3 2024-09-12T17:36:26.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.648+0000 7f8b1f38b9c0 20 remove_watcher() i=4 2024-09-12T17:36:26.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.648+0000 7f8b1f38b9c0 20 remove_watcher() i=5 2024-09-12T17:36:26.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.652+0000 7f8b1f38b9c0 20 remove_watcher() i=6 2024-09-12T17:36:26.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.652+0000 7f8b1f38b9c0 20 remove_watcher() i=7 2024-09-12T17:36:26.665 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:26.665 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:36:26.665 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-commit-target-layout id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:36:26.665 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:26.665 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T17:36:26.704 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:26.704 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:26.748 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.752+0000 7ff48a05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.752+0000 7ff48a05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.752+0000 7ff48a05b9c0 20 realm 2024-09-12T17:36:26.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.752+0000 7ff48a05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.752+0000 7ff48a05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.752+0000 7ff48a05b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:26.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.752+0000 7ff48a05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.752+0000 7ff48a05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.752+0000 7ff48a05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.756+0000 7ff48a05b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:26.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.756+0000 7ff48a05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.756+0000 7ff48a05b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:26.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.756+0000 7ff48a05b9c0 20 searching for the correct realm 2024-09-12T17:36:26.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.760+0000 7ff488362640 0 -- 172.21.15.119:0/3159524631 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7ff47c0a0ad0 msgr2=0x7ff47c003690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:36:26.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.768+0000 7ff487360640 0 -- 172.21.15.119:0/3159524631 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7ff4800699a0 msgr2=0x7ff48004e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:26.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.984+0000 7ff48a05b9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:36:26.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.984+0000 7ff48a05b9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:36:26.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.984+0000 7ff48a05b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:26.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.984+0000 7ff48a05b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:26.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.984+0000 7ff48a05b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:26.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.984+0000 7ff48a05b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:26.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.984+0000 7ff48a05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.987+0000 7ff48a05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.987+0000 7ff48a05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.987+0000 7ff48a05b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:26.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.987+0000 7ff48a05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.987+0000 7ff48a05b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:26.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.987+0000 7ff48a05b9c0 20 zone default found 2024-09-12T17:36:26.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.987+0000 7ff48a05b9c0 4 Realm: () 2024-09-12T17:36:26.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.987+0000 7ff48a05b9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:36:26.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.987+0000 7ff48a05b9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:36:26.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.987+0000 7ff48a05b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:26.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.987+0000 7ff48a05b9c0 20 zonegroup default 2024-09-12T17:36:26.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.987+0000 7ff48a05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.987+0000 7ff48a05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.987+0000 7ff48a05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.987+0000 7ff48a05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.987+0000 7ff48a05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.991+0000 7ff48a05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.991+0000 7ff48a05b9c0 20 started sync module instance, tier type = 2024-09-12T17:36:26.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:26.991+0000 7ff48a05b9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:36:27.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.015+0000 7ff48a05b9c0 20 add_watcher() i=0 2024-09-12T17:36:27.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.015+0000 7ff48a05b9c0 20 add_watcher() i=1 2024-09-12T17:36:27.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.015+0000 7ff48a05b9c0 20 add_watcher() i=2 2024-09-12T17:36:27.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.015+0000 7ff48a05b9c0 20 add_watcher() i=3 2024-09-12T17:36:27.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.015+0000 7ff48a05b9c0 20 add_watcher() i=4 2024-09-12T17:36:27.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.015+0000 7ff48a05b9c0 20 add_watcher() i=5 2024-09-12T17:36:27.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.015+0000 7ff48a05b9c0 20 add_watcher() i=6 2024-09-12T17:36:27.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.019+0000 7ff48a05b9c0 20 add_watcher() i=7 2024-09-12T17:36:27.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.019+0000 7ff48a05b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:27.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.023+0000 7ff33dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:27.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.023+0000 7ff48a05b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:27.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.023+0000 7ff48a05b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:27.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.023+0000 7ff48a05b9c0 5 note: GC not initialized 2024-09-12T17:36:27.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.023+0000 7ff33cfe1640 20 reqs_thread_entry: start 2024-09-12T17:36:27.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.023+0000 7ff48a05b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:27.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.023+0000 7ff48a05b9c0 20 Filter name: none 2024-09-12T17:36:27.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.023+0000 7ff2b67fc640 20 reqs_thread_entry: start 2024-09-12T17:36:27.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.023+0000 7ff48a05b9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:36:27.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.023+0000 7ff48a05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.027+0000 7ff48a05b9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:27.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.027+0000 7ff48a05b9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:36:27.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.027+0000 7ff48a05b9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:36:27.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.027+0000 7ff48a05b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 : miss 2024-09-12T17:36:27.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.027+0000 7ff48a05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.027+0000 7ff48a05b9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:27.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.027+0000 7ff48a05b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 info.flags=0x17 2024-09-12T17:36:27.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.027+0000 7ff48a05b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 to cache LRU end 2024-09-12T17:36:27.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.027+0000 7ff48a05b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:36:27.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.027+0000 7ff48a05b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:27.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.027+0000 7ff48a05b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 2024-09-12T17:36:27.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.035+0000 7ff48a05b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 info.flags=0x17 2024-09-12T17:36:27.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.035+0000 7ff48a05b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 to cache LRU end 2024-09-12T17:36:27.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.035+0000 7ff48a05b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:27.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.035+0000 7ff48a05b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32, ofs0, ns] 2024-09-12T17:36:27.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.039+0000 7ff366ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333509 cookie 94311992349552 notifier 6920 bl.length()=1015 2024-09-12T17:36:27.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.039+0000 7ff366ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 info.flags=0x17 2024-09-12T17:36:27.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.039+0000 7ff366ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 to cache LRU end 2024-09-12T17:36:27.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.039+0000 7ff366ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:27.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.039+0000 7ff48a05b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32]): orig_sources= new_sources= 2024-09-12T17:36:27.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.039+0000 7ff48a05b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32]): potential sources added=[] removed=[] 2024-09-12T17:36:27.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.039+0000 7ff48a05b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32]): orig_dests= new_dests= 2024-09-12T17:36:27.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.039+0000 7ff48a05b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32]): potential dests added=[] removed=[] 2024-09-12T17:36:27.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.0 2024-09-12T17:36:27.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.0 2024-09-12T17:36:27.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.1 2024-09-12T17:36:27.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.1 2024-09-12T17:36:27.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.2 2024-09-12T17:36:27.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.2 2024-09-12T17:36:27.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.3 2024-09-12T17:36:27.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.3 2024-09-12T17:36:27.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.4 2024-09-12T17:36:27.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.4 2024-09-12T17:36:27.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.5 2024-09-12T17:36:27.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.5 2024-09-12T17:36:27.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.6 2024-09-12T17:36:27.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.6 2024-09-12T17:36:27.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.7 2024-09-12T17:36:27.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.7 2024-09-12T17:36:27.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.8 2024-09-12T17:36:27.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.8 2024-09-12T17:36:27.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.9 2024-09-12T17:36:27.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.9 2024-09-12T17:36:27.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.10 2024-09-12T17:36:27.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.10 2024-09-12T17:36:27.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.11 2024-09-12T17:36:27.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1.11 2024-09-12T17:36:27.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.051+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.0 2024-09-12T17:36:27.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.055+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1 2024-09-12T17:36:27.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.055+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.2 2024-09-12T17:36:27.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.055+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.3 2024-09-12T17:36:27.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.059+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.4 2024-09-12T17:36:27.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.059+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.5 2024-09-12T17:36:27.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.059+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.6 2024-09-12T17:36:27.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.063+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.7 2024-09-12T17:36:27.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.063+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.8 2024-09-12T17:36:27.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.063+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.9 2024-09-12T17:36:27.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.067+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.10 2024-09-12T17:36:27.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.071+0000 7ff48a05b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:27.070 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.071+0000 7ff48a05b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 2024-09-12T17:36:27.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.071+0000 7ff48a05b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 info.flags=0x17 2024-09-12T17:36:27.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.071+0000 7ff48a05b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 to cache LRU end 2024-09-12T17:36:27.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.071+0000 7ff48a05b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:27.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.071+0000 7ff48a05b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32, ofs0, ns] 2024-09-12T17:36:27.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.071+0000 7ff366ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333510 cookie 94311992349552 notifier 6920 bl.length()=1015 2024-09-12T17:36:27.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.071+0000 7ff366ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 info.flags=0x17 2024-09-12T17:36:27.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.071+0000 7ff366ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 to cache LRU end 2024-09-12T17:36:27.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.071+0000 7ff366ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:27.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.075+0000 7ff48a05b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32]): orig_sources= new_sources= 2024-09-12T17:36:27.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.075+0000 7ff48a05b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32]): potential sources added=[] removed=[] 2024-09-12T17:36:27.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.075+0000 7ff48a05b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32]): orig_dests= new_dests= 2024-09-12T17:36:27.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.075+0000 7ff48a05b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32]): potential dests added=[] removed=[] 2024-09-12T17:36:27.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.083+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.0 2024-09-12T17:36:27.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.083+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.1 2024-09-12T17:36:27.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.083+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.2 2024-09-12T17:36:27.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.087+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.3 2024-09-12T17:36:27.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.087+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.4 2024-09-12T17:36:27.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.087+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.5 2024-09-12T17:36:27.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.087+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.6 2024-09-12T17:36:27.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.087+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.7 2024-09-12T17:36:27.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.087+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.8 2024-09-12T17:36:27.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.091+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.9 2024-09-12T17:36:27.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.091+0000 7ff48a05b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32.10 2024-09-12T17:36:27.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.091+0000 7ff48a05b9c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T17:36:27.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.091+0000 7ff48a05b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:27.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.091+0000 7ff48a05b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 2024-09-12T17:36:27.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.095+0000 7ff48a05b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 info.flags=0x17 2024-09-12T17:36:27.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.095+0000 7ff48a05b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 to cache LRU end 2024-09-12T17:36:27.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.095+0000 7ff48a05b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:27.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.095+0000 7ff48a05b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32, ofs0, ns] 2024-09-12T17:36:27.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.095+0000 7ff366ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333511 cookie 94311992349552 notifier 6920 bl.length()=983 2024-09-12T17:36:27.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.095+0000 7ff366ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 info.flags=0x17 2024-09-12T17:36:27.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.095+0000 7ff366ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 to cache LRU end 2024-09-12T17:36:27.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.095+0000 7ff366ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:27.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.099+0000 7ff48a05b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32]): orig_sources= new_sources= 2024-09-12T17:36:27.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.099+0000 7ff48a05b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32]): potential sources added=[] removed=[] 2024-09-12T17:36:27.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.099+0000 7ff48a05b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32]): orig_dests= new_dests= 2024-09-12T17:36:27.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.099+0000 7ff48a05b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32]): potential dests added=[] removed=[] 2024-09-12T17:36:27.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.103+0000 7ff48a05b9c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:36:27.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.107+0000 7ff33dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:27.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.115+0000 7ff48a05b9c0 20 remove_watcher() i=0 2024-09-12T17:36:27.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.115+0000 7ff48a05b9c0 2 removed watcher, disabling cache 2024-09-12T17:36:27.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.115+0000 7ff48a05b9c0 20 remove_watcher() i=1 2024-09-12T17:36:27.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.119+0000 7ff48a05b9c0 20 remove_watcher() i=2 2024-09-12T17:36:27.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.123+0000 7ff48a05b9c0 20 remove_watcher() i=3 2024-09-12T17:36:27.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.123+0000 7ff48a05b9c0 20 remove_watcher() i=4 2024-09-12T17:36:27.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.127+0000 7ff48a05b9c0 20 remove_watcher() i=5 2024-09-12T17:36:27.126 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.127+0000 7ff48a05b9c0 20 remove_watcher() i=6 2024-09-12T17:36:27.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.127+0000 7ff48a05b9c0 20 remove_watcher() i=7 2024-09-12T17:36:27.147 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:36:27.178 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:27.178 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:27.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.227+0000 7f297cd5f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.227+0000 7f297cd5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.227+0000 7f297cd5f9c0 20 realm 2024-09-12T17:36:27.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.227+0000 7f297cd5f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.227+0000 7f297cd5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.227+0000 7f297cd5f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:27.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.227+0000 7f297cd5f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.227+0000 7f297cd5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.227+0000 7f297cd5f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.231+0000 7f297cd5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:27.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.231+0000 7f297cd5f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.231+0000 7f297cd5f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:27.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.231+0000 7f297cd5f9c0 20 searching for the correct realm 2024-09-12T17:36:27.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.235+0000 7f297b066640 0 -- 172.21.15.119:0/1350799951 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f29640d2070 msgr2=0x7f2964124170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:27.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.243+0000 7f297a064640 0 -- 172.21.15.119:0/1350799951 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f296c09a040 msgr2=0x7f296c058430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:27.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.459+0000 7f297cd5f9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:36:27.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.459+0000 7f297cd5f9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:36:27.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.459+0000 7f297cd5f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:27.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.459+0000 7f297cd5f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:27.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.459+0000 7f297cd5f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:27.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.459+0000 7f297cd5f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:27.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.459+0000 7f297cd5f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.463+0000 7f297cd5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.463+0000 7f297cd5f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.463+0000 7f297cd5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:27.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.463+0000 7f297cd5f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.463+0000 7f297cd5f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:27.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.463+0000 7f297cd5f9c0 20 zone default found 2024-09-12T17:36:27.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.463+0000 7f297cd5f9c0 4 Realm: () 2024-09-12T17:36:27.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.463+0000 7f297cd5f9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:36:27.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.463+0000 7f297cd5f9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:36:27.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.463+0000 7f297cd5f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:27.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.463+0000 7f297cd5f9c0 20 zonegroup default 2024-09-12T17:36:27.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.463+0000 7f297cd5f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.463+0000 7f297cd5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.463+0000 7f297cd5f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.463+0000 7f297cd5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.463+0000 7f297cd5f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.465 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.467+0000 7f297cd5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.465 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.467+0000 7f297cd5f9c0 20 started sync module instance, tier type = 2024-09-12T17:36:27.465 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.467+0000 7f297cd5f9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:36:27.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.487+0000 7f297cd5f9c0 20 add_watcher() i=0 2024-09-12T17:36:27.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.487+0000 7f297cd5f9c0 20 add_watcher() i=1 2024-09-12T17:36:27.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.487+0000 7f297cd5f9c0 20 add_watcher() i=2 2024-09-12T17:36:27.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.487+0000 7f297cd5f9c0 20 add_watcher() i=3 2024-09-12T17:36:27.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.487+0000 7f297cd5f9c0 20 add_watcher() i=4 2024-09-12T17:36:27.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.487+0000 7f297cd5f9c0 20 add_watcher() i=5 2024-09-12T17:36:27.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.487+0000 7f297cd5f9c0 20 add_watcher() i=6 2024-09-12T17:36:27.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.491+0000 7f297cd5f9c0 20 add_watcher() i=7 2024-09-12T17:36:27.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.491+0000 7f297cd5f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:27.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.495+0000 7f28317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:27.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.495+0000 7f297cd5f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:27.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.495+0000 7f297cd5f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:27.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.495+0000 7f297cd5f9c0 5 note: GC not initialized 2024-09-12T17:36:27.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.495+0000 7f27abfff640 20 reqs_thread_entry: start 2024-09-12T17:36:27.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.499+0000 7f297cd5f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:27.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.499+0000 7f297cd5f9c0 20 Filter name: none 2024-09-12T17:36:27.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.499+0000 7f27a9ffb640 20 reqs_thread_entry: start 2024-09-12T17:36:27.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.499+0000 7f297cd5f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.499+0000 7f297cd5f9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:27.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.499+0000 7f297cd5f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.499+0000 7f297cd5f9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:27.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.499+0000 7f297cd5f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:27.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.499+0000 7f297cd5f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.499+0000 7f297cd5f9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:27.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.499+0000 7f297cd5f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.503+0000 7f297cd5f9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:27.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.503+0000 7f297cd5f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:27.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.503+0000 7f28317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:27.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.507+0000 7f297cd5f9c0 20 remove_watcher() i=0 2024-09-12T17:36:27.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.507+0000 7f297cd5f9c0 2 removed watcher, disabling cache 2024-09-12T17:36:27.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.511+0000 7f297cd5f9c0 20 remove_watcher() i=1 2024-09-12T17:36:27.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.515+0000 7f297cd5f9c0 20 remove_watcher() i=2 2024-09-12T17:36:27.515 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.515+0000 7f297cd5f9c0 20 remove_watcher() i=3 2024-09-12T17:36:27.517 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.519+0000 7f297cd5f9c0 20 remove_watcher() i=4 2024-09-12T17:36:27.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.519+0000 7f297cd5f9c0 20 remove_watcher() i=5 2024-09-12T17:36:27.520 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.523+0000 7f297cd5f9c0 20 remove_watcher() i=6 2024-09-12T17:36:27.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:27.523+0000 7f297cd5f9c0 20 remove_watcher() i=7 2024-09-12T17:36:27.537 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:27.537 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:36:27.537 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-commit-target-layout id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:36:27.537 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:28.484 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T17:36:28.484 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:30.696 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:36:30.730 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:30.730 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:30.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:30.779+0000 7fcd95ccc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:30.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:30.779+0000 7fcd95ccc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:30.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:30.779+0000 7fcd95ccc9c0 20 realm 2024-09-12T17:36:30.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:30.779+0000 7fcd95ccc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:30.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:30.779+0000 7fcd95ccc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:30.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:30.779+0000 7fcd95ccc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:30.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:30.779+0000 7fcd95ccc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:30.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:30.779+0000 7fcd95ccc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:30.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:30.779+0000 7fcd95ccc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:30.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:30.783+0000 7fcd95ccc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:30.782 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:30.783+0000 7fcd95ccc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:30.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:30.783+0000 7fcd95ccc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:30.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:30.783+0000 7fcd95ccc9c0 20 searching for the correct realm 2024-09-12T17:36:30.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:30.787+0000 7fcd93fd3640 0 -- 172.21.15.119:0/2468800669 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fcd88032060 msgr2=0x7fcd88062a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:31.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.003+0000 7fcd92fd1640 0 -- 172.21.15.119:0/2468800669 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fcd8c0f6920 msgr2=0x7fcd8c0cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:31.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.219+0000 7fcd95ccc9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:36:31.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.219+0000 7fcd95ccc9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:36:31.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.219+0000 7fcd95ccc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:31.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.219+0000 7fcd95ccc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:31.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.219+0000 7fcd95ccc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:31.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.219+0000 7fcd95ccc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:31.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.219+0000 7fcd95ccc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.223+0000 7fcd95ccc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.223+0000 7fcd95ccc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.223+0000 7fcd95ccc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:31.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.223+0000 7fcd95ccc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.223+0000 7fcd95ccc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:31.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.223+0000 7fcd95ccc9c0 20 zone default found 2024-09-12T17:36:31.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.223+0000 7fcd95ccc9c0 4 Realm: () 2024-09-12T17:36:31.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.223+0000 7fcd95ccc9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:36:31.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.223+0000 7fcd95ccc9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:36:31.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.223+0000 7fcd95ccc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:31.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.223+0000 7fcd95ccc9c0 20 zonegroup default 2024-09-12T17:36:31.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.223+0000 7fcd95ccc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.223+0000 7fcd95ccc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.223+0000 7fcd95ccc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.223+0000 7fcd95ccc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.223+0000 7fcd95ccc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.227+0000 7fcd95ccc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.227+0000 7fcd95ccc9c0 20 started sync module instance, tier type = 2024-09-12T17:36:31.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.227+0000 7fcd95ccc9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:36:31.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.247+0000 7fcd95ccc9c0 20 add_watcher() i=0 2024-09-12T17:36:31.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.247+0000 7fcd95ccc9c0 20 add_watcher() i=1 2024-09-12T17:36:31.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.247+0000 7fcd95ccc9c0 20 add_watcher() i=2 2024-09-12T17:36:31.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.247+0000 7fcd95ccc9c0 20 add_watcher() i=3 2024-09-12T17:36:31.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.247+0000 7fcd95ccc9c0 20 add_watcher() i=4 2024-09-12T17:36:31.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.247+0000 7fcd95ccc9c0 20 add_watcher() i=5 2024-09-12T17:36:31.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.247+0000 7fcd95ccc9c0 20 add_watcher() i=6 2024-09-12T17:36:31.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.247+0000 7fcd95ccc9c0 20 add_watcher() i=7 2024-09-12T17:36:31.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.247+0000 7fcd95ccc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:31.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.251+0000 7fcc49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:31.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.251+0000 7fcd95ccc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:31.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.251+0000 7fcd95ccc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:31.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.251+0000 7fcd95ccc9c0 5 note: GC not initialized 2024-09-12T17:36:31.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.251+0000 7fcc48fe1640 20 reqs_thread_entry: start 2024-09-12T17:36:31.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.251+0000 7fcd95ccc9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:31.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.251+0000 7fcd95ccc9c0 20 Filter name: none 2024-09-12T17:36:31.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.251+0000 7fcbc27fc640 20 reqs_thread_entry: start 2024-09-12T17:36:31.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.251+0000 7fcd95ccc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.255+0000 7fcd95ccc9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:31.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.255+0000 7fcd95ccc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.255+0000 7fcd95ccc9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:31.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.255+0000 7fcd95ccc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:31.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.255+0000 7fcd95ccc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.255+0000 7fcd95ccc9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:31.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.255+0000 7fcd95ccc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.255+0000 7fcd95ccc9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:31.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.255+0000 7fcd95ccc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:31.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.259+0000 7fcc49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:31.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.263+0000 7fcd95ccc9c0 20 remove_watcher() i=0 2024-09-12T17:36:31.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.263+0000 7fcd95ccc9c0 2 removed watcher, disabling cache 2024-09-12T17:36:31.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.267+0000 7fcd95ccc9c0 20 remove_watcher() i=1 2024-09-12T17:36:31.267 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.267+0000 7fcd95ccc9c0 20 remove_watcher() i=2 2024-09-12T17:36:31.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.271+0000 7fcd95ccc9c0 20 remove_watcher() i=3 2024-09-12T17:36:31.271 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.271+0000 7fcd95ccc9c0 20 remove_watcher() i=4 2024-09-12T17:36:31.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.271+0000 7fcd95ccc9c0 20 remove_watcher() i=5 2024-09-12T17:36:31.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.275+0000 7fcd95ccc9c0 20 remove_watcher() i=6 2024-09-12T17:36:31.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.275+0000 7fcd95ccc9c0 20 remove_watcher() i=7 2024-09-12T17:36:31.291 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.291 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:36:31.291 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-commit-target-layout id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:36:31.291 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.292 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T17:36:31.327 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:31.327 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:31.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.371+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 realm 2024-09-12T17:36:31.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.375+0000 7fdd0560b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:31.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:31.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.379+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:31.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.379+0000 7fdd0560b9c0 20 searching for the correct realm 2024-09-12T17:36:31.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.383+0000 7fdd02910640 0 -- 172.21.15.119:0/4137269762 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fdcfc0b8930 msgr2=0x7fdcfc0d2410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:31.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.387+0000 7fdd02910640 0 -- 172.21.15.119:0/4137269762 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fdcf406d200 msgr2=0x7fdcf40879e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:31.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:36:31.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:36:31.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:31.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:31.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:31.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:31.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:31.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:31.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 zone default found 2024-09-12T17:36:31.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.607+0000 7fdd0560b9c0 4 Realm: () 2024-09-12T17:36:31.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.607+0000 7fdd0560b9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:36:31.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.607+0000 7fdd0560b9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:36:31.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.607+0000 7fdd0560b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:31.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 zonegroup default 2024-09-12T17:36:31.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.611+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.611+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.609 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.611+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.609 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.611+0000 7fdd0560b9c0 20 started sync module instance, tier type = 2024-09-12T17:36:31.609 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.611+0000 7fdd0560b9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:36:31.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=0 2024-09-12T17:36:31.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=1 2024-09-12T17:36:31.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=2 2024-09-12T17:36:31.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=3 2024-09-12T17:36:31.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=4 2024-09-12T17:36:31.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=5 2024-09-12T17:36:31.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=6 2024-09-12T17:36:31.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=7 2024-09-12T17:36:31.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.635+0000 7fdd0560b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:31.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.639+0000 7fdbb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:31.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:31.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:31.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 note: GC not initialized 2024-09-12T17:36:31.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdbb8fe1640 20 reqs_thread_entry: start 2024-09-12T17:36:31.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:31.642 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 Filter name: none 2024-09-12T17:36:31.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdb327fc640 20 reqs_thread_entry: start 2024-09-12T17:36:31.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:36:31.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:31.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:36:31.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:36:31.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 : miss 2024-09-12T17:36:31.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:31.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:36:31.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:36:31.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:36:31.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:31.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 2024-09-12T17:36:31.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.655+0000 7fdd0560b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:36:31.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.655+0000 7fdd0560b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:36:31.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.655+0000 7fdd0560b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:31.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.655+0000 7fdd0560b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33, ofs0, ns] 2024-09-12T17:36:31.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.655+0000 7fdbe6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333501 cookie 94217290910800 notifier 6974 bl.length()=1015 2024-09-12T17:36:31.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.655+0000 7fdbe6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:36:31.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.655+0000 7fdbe6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:36:31.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.655+0000 7fdbe6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:31.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.659+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_sources= new_sources= 2024-09-12T17:36:31.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.659+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential sources added=[] removed=[] 2024-09-12T17:36:31.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.659+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_dests= new_dests= 2024-09-12T17:36:31.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.659+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential dests added=[] removed=[] 2024-09-12T17:36:31.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.0 2024-09-12T17:36:31.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.0 2024-09-12T17:36:31.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.1 2024-09-12T17:36:31.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.1 2024-09-12T17:36:31.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.2 2024-09-12T17:36:31.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.2 2024-09-12T17:36:31.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.3 2024-09-12T17:36:31.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.3 2024-09-12T17:36:31.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.4 2024-09-12T17:36:31.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.4 2024-09-12T17:36:31.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.5 2024-09-12T17:36:31.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.5 2024-09-12T17:36:31.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.6 2024-09-12T17:36:31.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.6 2024-09-12T17:36:31.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.7 2024-09-12T17:36:31.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.7 2024-09-12T17:36:31.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.8 2024-09-12T17:36:31.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.8 2024-09-12T17:36:31.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.9 2024-09-12T17:36:31.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.9 2024-09-12T17:36:31.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.10 2024-09-12T17:36:31.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.10 2024-09-12T17:36:31.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.11 2024-09-12T17:36:31.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.11 2024-09-12T17:36:31.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.0 2024-09-12T17:36:31.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.671+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1 2024-09-12T17:36:31.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.671+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.2 2024-09-12T17:36:31.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.671+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.3 2024-09-12T17:36:31.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.671+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.4 2024-09-12T17:36:31.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.675+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.5 2024-09-12T17:36:31.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.675+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.6 2024-09-12T17:36:31.675 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.675+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.7 2024-09-12T17:36:31.676 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.675+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.8 2024-09-12T17:36:31.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.679+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.9 2024-09-12T17:36:31.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.679+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.10 2024-09-12T17:36:31.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:31.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 2024-09-12T17:36:31.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:36:31.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:36:31.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:31.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33, ofs0, ns] 2024-09-12T17:36:31.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.687+0000 7fdbe6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333502 cookie 94217290910800 notifier 6974 bl.length()=1015 2024-09-12T17:36:31.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.687+0000 7fdbe6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:36:31.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.687+0000 7fdbe6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:36:31.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.687+0000 7fdbe6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:31.691 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.691+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_sources= new_sources= 2024-09-12T17:36:31.691 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.691+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential sources added=[] removed=[] 2024-09-12T17:36:31.691 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.691+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_dests= new_dests= 2024-09-12T17:36:31.691 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.691+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential dests added=[] removed=[] 2024-09-12T17:36:31.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.0 2024-09-12T17:36:31.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1 2024-09-12T17:36:31.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.2 2024-09-12T17:36:31.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.3 2024-09-12T17:36:31.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.4 2024-09-12T17:36:31.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.5 2024-09-12T17:36:31.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.703+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.6 2024-09-12T17:36:31.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.703+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.7 2024-09-12T17:36:31.702 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.703+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.8 2024-09-12T17:36:31.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.703+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.9 2024-09-12T17:36:31.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.703+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.10 2024-09-12T17:36:31.704 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdd0560b9c0 time 2024-09-12T17:36:31.708761+0000 2024-09-12T17:36:31.704 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:36:31.705 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:36:31.705 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdd08ee52eb] 2024-09-12T17:36:31.705 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdd08ee549f] 2024-09-12T17:36:31.705 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0aae540c1] 2024-09-12T17:36:31.705 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55b0aae66467] 2024-09-12T17:36:31.705 INFO:tasks.workunit.client.0.smithi119.stderr: 5: main() 2024-09-12T17:36:31.705 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdd07d4bd90] 2024-09-12T17:36:31.705 INFO:tasks.workunit.client.0.smithi119.stderr: 7: __libc_start_main() 2024-09-12T17:36:31.705 INFO:tasks.workunit.client.0.smithi119.stderr: 8: _start() 2024-09-12T17:36:31.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.707+0000 7fdd0560b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdd0560b9c0 time 2024-09-12T17:36:31.708761+0000 2024-09-12T17:36:31.705 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:36:31.706 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.706 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:36:31.706 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdd08ee52eb] 2024-09-12T17:36:31.706 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdd08ee549f] 2024-09-12T17:36:31.706 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0aae540c1] 2024-09-12T17:36:31.706 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55b0aae66467] 2024-09-12T17:36:31.706 INFO:tasks.workunit.client.0.smithi119.stderr: 5: main() 2024-09-12T17:36:31.706 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdd07d4bd90] 2024-09-12T17:36:31.706 INFO:tasks.workunit.client.0.smithi119.stderr: 7: __libc_start_main() 2024-09-12T17:36:31.706 INFO:tasks.workunit.client.0.smithi119.stderr: 8: _start() 2024-09-12T17:36:31.706 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.706 INFO:tasks.workunit.client.0.smithi119.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:36:31.706 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fdd0560b9c0 thread_name:radosgw-admin 2024-09-12T17:36:31.712 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:36:31.712 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdd07d64520] 2024-09-12T17:36:31.712 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:36:31.712 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:36:31.712 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:36:31.712 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdd08ee5345] 2024-09-12T17:36:31.712 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdd08ee549f] 2024-09-12T17:36:31.712 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0aae540c1] 2024-09-12T17:36:31.712 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55b0aae66467] 2024-09-12T17:36:31.712 INFO:tasks.workunit.client.0.smithi119.stderr: 9: main() 2024-09-12T17:36:31.713 INFO:tasks.workunit.client.0.smithi119.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdd07d4bd90] 2024-09-12T17:36:31.713 INFO:tasks.workunit.client.0.smithi119.stderr: 11: __libc_start_main() 2024-09-12T17:36:31.713 INFO:tasks.workunit.client.0.smithi119.stderr: 12: _start() 2024-09-12T17:36:31.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.707+0000 7fdd0560b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:36:31.713 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fdd0560b9c0 thread_name:radosgw-admin 2024-09-12T17:36:31.713 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.713 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:36:31.713 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdd07d64520] 2024-09-12T17:36:31.713 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:36:31.713 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:36:31.713 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:36:31.713 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdd08ee5345] 2024-09-12T17:36:31.713 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdd08ee549f] 2024-09-12T17:36:31.714 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0aae540c1] 2024-09-12T17:36:31.714 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55b0aae66467] 2024-09-12T17:36:31.714 INFO:tasks.workunit.client.0.smithi119.stderr: 9: main() 2024-09-12T17:36:31.714 INFO:tasks.workunit.client.0.smithi119.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdd07d4bd90] 2024-09-12T17:36:31.714 INFO:tasks.workunit.client.0.smithi119.stderr: 11: __libc_start_main() 2024-09-12T17:36:31.714 INFO:tasks.workunit.client.0.smithi119.stderr: 12: _start() 2024-09-12T17:36:31.714 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:36:31.714 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.714 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:36:31.714 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac182f80) adding con mode: secure 2024-09-12T17:36:31.714 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.714 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.714 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command rotate-key hook 0x55b0ac1830c8 2024-09-12T17:36:31.715 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:36:31.715 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:36:31.715 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-b con 0x55b0ac032000 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:36:31.715 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-a con 0x55b0ac0c7f80 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:36:31.715 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-c con 0x55b0ac0c8360 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:36:31.715 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.715 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.715 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.715 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:36:31.715 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient(hunting): authenticate will time out at 2559.386895s 2024-09-12T17:36:31.715 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient(hunting): get_auth_request con 0x55b0ac0c7f80 auth_method 0 2024-09-12T17:36:31.715 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.715 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.715 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.716 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:36:31.351+0000 7fdd03912640 10 monclient(hunting): get_auth_request con 0x55b0ac0c8360 auth_method 0 2024-09-12T17:36:31.716 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:36:31.351+0000 7fdd03912640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.716 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:36:31.351+0000 7fdd03912640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.716 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:36:31.351+0000 7fdd03912640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.716 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:31.716 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:31.716 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:31.716 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:36:31.351+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:31.716 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:36:31.351+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:31.716 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:36:31.351+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:31.716 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient(hunting): handle_auth_done global_id 7386 payload 824 2024-09-12T17:36:31.716 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient: _finish_hunting 0 2024-09-12T17:36:31.717 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:36:31.351+0000 7fdd02910640 1 monclient: found mon.noname-a 2024-09-12T17:36:31.717 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:36:31.717 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:31.717 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:36:31.717 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: dump: 2024-09-12T17:36:31.717 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:36:31.717 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:36:31.717 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.717 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.717 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:31.717 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.717 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:36:31.717 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:36:31.718 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:36:31.718 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.718 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: _finish_auth 0 2024-09-12T17:36:31.718 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: _check_auth_tickets 2024-09-12T17:36:31.718 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:36:31.718 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:31.718 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:36:31.718 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: dump: 2024-09-12T17:36:31.718 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:36:31.718 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:36:31.718 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.718 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.718 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:31.719 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.719 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:36:31.719 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:36:31.719 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:36:31.719 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.719 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 5 monclient: authenticate success, global_id 7386 2024-09-12T17:36:31.719 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient: _renew_subs 2024-09-12T17:36:31.719 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:36:31.351+0000 7fdbf160a640 4 set_mon_vals no callback set 2024-09-12T17:36:31.719 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:36:31.719 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient: _renew_subs 2024-09-12T17:36:31.719 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:36:31.719 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 1 librados: init done 2024-09-12T17:36:31.719 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:36:31.355+0000 7fdbefe07640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:36:31.720 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:36:31.355+0000 7fdbefe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:36:31.720 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:36:31.355+0000 7fdbefe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:36:31.720 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:36:31.355+0000 7fdd03111640 10 monclient: get_auth_request con 0x7fdbe8070ae0 auth_method 0 2024-09-12T17:36:31.720 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:36:31.355+0000 7fdd03912640 10 monclient: get_auth_request con 0x55b0ac1b5c00 auth_method 0 2024-09-12T17:36:31.720 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:36:31.355+0000 7fdd03111640 10 monclient: get_auth_request con 0x55b0ac1cdd10 auth_method 0 2024-09-12T17:36:31.720 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:36:31.359+0000 7fdd02910640 10 monclient: get_auth_request con 0x55b0ac1d2070 auth_method 0 2024-09-12T17:36:31.720 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:36:31.359+0000 7fdd03912640 10 monclient: get_auth_request con 0x55b0ac1d63a0 auth_method 0 2024-09-12T17:36:31.720 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: build_initial_monmap 2024-09-12T17:36:31.720 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:36:31.720 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: monmap: 2024-09-12T17:36:31.720 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:36:31.720 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:36:31.720 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:36:31.721 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:36:31.721 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:36:31.721 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.721 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:36:31.721 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:36:31.721 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:36:31.721 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.721 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding auth protocol: cephx 2024-09-12T17:36:31.721 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding auth protocol: cephx 2024-09-12T17:36:31.721 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding auth protocol: cephx 2024-09-12T17:36:31.721 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: secure 2024-09-12T17:36:31.721 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: crc 2024-09-12T17:36:31.721 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: secure 2024-09-12T17:36:31.722 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: crc 2024-09-12T17:36:31.722 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: secure 2024-09-12T17:36:31.722 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: crc 2024-09-12T17:36:31.722 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: crc 2024-09-12T17:36:31.722 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: secure 2024-09-12T17:36:31.722 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: crc 2024-09-12T17:36:31.722 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: secure 2024-09-12T17:36:31.722 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: crc 2024-09-12T17:36:31.722 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: secure 2024-09-12T17:36:31.722 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.722 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b0ac1ddaf0 EEXIST 2024-09-12T17:36:31.722 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: init 2024-09-12T17:36:31.722 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding auth protocol: cephx 2024-09-12T17:36:31.723 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding auth protocol: cephx 2024-09-12T17:36:31.723 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding auth protocol: cephx 2024-09-12T17:36:31.723 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: secure 2024-09-12T17:36:31.723 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: crc 2024-09-12T17:36:31.723 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: secure 2024-09-12T17:36:31.723 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: crc 2024-09-12T17:36:31.723 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: secure 2024-09-12T17:36:31.723 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: crc 2024-09-12T17:36:31.723 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: crc 2024-09-12T17:36:31.723 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: secure 2024-09-12T17:36:31.724 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: crc 2024-09-12T17:36:31.724 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: secure 2024-09-12T17:36:31.724 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: crc 2024-09-12T17:36:31.724 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: secure 2024-09-12T17:36:31.724 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.724 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.724 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command rotate-key cmddesc rotate-key hook 0x55b0ac1d9230 EEXIST 2024-09-12T17:36:31.725 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:36:31.725 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:36:31.725 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-c con 0x55b0ac201ca0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:36:31.725 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-a con 0x55b0ac2015d0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:36:31.725 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-b con 0x55b0ac1fffb0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:36:31.725 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.725 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.725 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.726 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:36:31.726 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient(hunting): authenticate will time out at 2559.398564s 2024-09-12T17:36:31.726 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient(hunting): get_auth_request con 0x55b0ac201ca0 auth_method 0 2024-09-12T17:36:31.726 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.726 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.726 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.726 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:36:31.363+0000 7fdd03912640 10 monclient(hunting): get_auth_request con 0x55b0ac2015d0 auth_method 0 2024-09-12T17:36:31.726 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:36:31.363+0000 7fdd03912640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.726 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:36:31.363+0000 7fdd03912640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.726 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:36:31.363+0000 7fdd03912640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.727 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:31.727 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:31.727 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:31.727 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:36:31.363+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:31.727 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:36:31.363+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:31.728 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:36:31.363+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:31.728 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:36:31.363+0000 7fdd03111640 10 monclient(hunting): get_auth_request con 0x55b0ac1fffb0 auth_method 0 2024-09-12T17:36:31.728 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:36:31.363+0000 7fdd03111640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.728 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:36:31.363+0000 7fdd03111640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.728 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:36:31.363+0000 7fdd03111640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.729 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient(hunting): handle_auth_done global_id 6968 payload 824 2024-09-12T17:36:31.729 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient: _finish_hunting 0 2024-09-12T17:36:31.729 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:36:31.363+0000 7fdd02910640 1 monclient: found mon.noname-c 2024-09-12T17:36:31.729 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:36:31.729 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:31.729 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:36:31.730 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: dump: 2024-09-12T17:36:31.730 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:36:31.730 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:36:31.730 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.730 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.730 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:31.731 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.731 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:36:31.731 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:36:31.731 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:36:31.731 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.731 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: _finish_auth 0 2024-09-12T17:36:31.732 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: _check_auth_tickets 2024-09-12T17:36:31.732 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 monclient: authenticate success, global_id 6968 2024-09-12T17:36:31.732 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: _renew_subs 2024-09-12T17:36:31.732 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:36:31.732 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:36:31.732 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:31.733 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:36:31.733 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: dump: 2024-09-12T17:36:31.733 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:36:31.733 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:36:31.733 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.733 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.734 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:31.734 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.734 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:36:31.734 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:36:31.734 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:36:31.734 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.735 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:36:31.363+0000 7fdd04113640 4 set_mon_vals no callback set 2024-09-12T17:36:31.735 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: _renew_subs 2024-09-12T17:36:31.735 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:36:31.735 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:36:31.367+0000 7fdbed602640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:36:31.735 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:36:31.367+0000 7fdbed602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:36:31.735 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:36:31.367+0000 7fdbed602640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:36:31.736 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: get_monmap_and_config 2024-09-12T17:36:31.736 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: build_initial_monmap 2024-09-12T17:36:31.736 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:36:31.736 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: monmap: 2024-09-12T17:36:31.736 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:36:31.737 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:36:31.737 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:36:31.737 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:36:31.737 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:36:31.737 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.737 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:36:31.738 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:36:31.738 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:36:31.738 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.738 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding auth protocol: cephx 2024-09-12T17:36:31.738 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding auth protocol: cephx 2024-09-12T17:36:31.739 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding auth protocol: cephx 2024-09-12T17:36:31.739 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: secure 2024-09-12T17:36:31.739 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: crc 2024-09-12T17:36:31.739 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: secure 2024-09-12T17:36:31.739 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: crc 2024-09-12T17:36:31.739 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: secure 2024-09-12T17:36:31.740 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: crc 2024-09-12T17:36:31.740 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: crc 2024-09-12T17:36:31.740 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: secure 2024-09-12T17:36:31.740 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: crc 2024-09-12T17:36:31.740 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: secure 2024-09-12T17:36:31.741 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: crc 2024-09-12T17:36:31.741 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: secure 2024-09-12T17:36:31.741 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.741 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: init 2024-09-12T17:36:31.741 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding auth protocol: cephx 2024-09-12T17:36:31.741 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding auth protocol: cephx 2024-09-12T17:36:31.742 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding auth protocol: cephx 2024-09-12T17:36:31.742 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: secure 2024-09-12T17:36:31.742 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: crc 2024-09-12T17:36:31.742 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: secure 2024-09-12T17:36:31.742 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: crc 2024-09-12T17:36:31.743 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: secure 2024-09-12T17:36:31.743 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: crc 2024-09-12T17:36:31.743 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: crc 2024-09-12T17:36:31.743 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: secure 2024-09-12T17:36:31.743 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: crc 2024-09-12T17:36:31.743 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: secure 2024-09-12T17:36:31.743 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: crc 2024-09-12T17:36:31.744 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: secure 2024-09-12T17:36:31.744 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.744 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.744 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command rotate-key cmddesc rotate-key hook 0x7fff8ab9d208 EEXIST 2024-09-12T17:36:31.744 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:36:31.744 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:36:31.745 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-b con 0x55b0ac24f630 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:36:31.745 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-c con 0x55b0ac24fa10 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:36:31.745 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-a con 0x55b0ac250ed0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:36:31.745 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.745 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.745 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.746 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:36:31.746 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient(hunting): authenticate will time out at 2559.402359s 2024-09-12T17:36:31.746 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient(hunting): get_auth_request con 0x55b0ac24fa10 auth_method 0 2024-09-12T17:36:31.746 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.746 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.746 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.746 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:36:31.367+0000 7fdd03111640 10 monclient(hunting): get_auth_request con 0x55b0ac250ed0 auth_method 0 2024-09-12T17:36:31.746 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:36:31.367+0000 7fdd03111640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.746 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:36:31.367+0000 7fdd03111640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.747 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:36:31.367+0000 7fdd03111640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.747 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:31.747 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:31.747 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:31.747 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:36:31.367+0000 7fdd03111640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:31.747 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:36:31.367+0000 7fdd03111640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:31.747 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:36:31.367+0000 7fdd03111640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:31.747 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient(hunting): handle_auth_done global_id 6971 payload 274 2024-09-12T17:36:31.747 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient: _finish_hunting 0 2024-09-12T17:36:31.747 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:36:31.367+0000 7fdd03912640 1 monclient: found mon.noname-c 2024-09-12T17:36:31.747 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:36:31.747 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:31.747 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:36:31.748 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: dump: 2024-09-12T17:36:31.748 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:36:31.748 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:36:31.748 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.748 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.748 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:31.748 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.748 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:36:31.748 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:36:31.748 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:36:31.748 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.748 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: _finish_auth 0 2024-09-12T17:36:31.748 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:36:31.749 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 monclient: authenticate success, global_id 6971 2024-09-12T17:36:31.749 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:36:31.749 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:36:31.749 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 4 set_mon_vals no callback set 2024-09-12T17:36:31.749 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:31.749 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:36:31.749 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: dump: 2024-09-12T17:36:31.749 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:36:31.749 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:36:31.749 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.749 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.749 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:31.749 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.750 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:36:31.750 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:36:31.750 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:36:31.750 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.750 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: shutdown 2024-09-12T17:36:31.750 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: build_initial_monmap 2024-09-12T17:36:31.750 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:36:31.750 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: monmap: 2024-09-12T17:36:31.750 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:36:31.750 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:36:31.750 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:36:31.750 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:36:31.750 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:36:31.750 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.751 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:36:31.751 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:36:31.751 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:36:31.751 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.751 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding auth protocol: cephx 2024-09-12T17:36:31.751 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding auth protocol: cephx 2024-09-12T17:36:31.751 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding auth protocol: cephx 2024-09-12T17:36:31.751 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: secure 2024-09-12T17:36:31.751 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: crc 2024-09-12T17:36:31.751 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: secure 2024-09-12T17:36:31.751 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: crc 2024-09-12T17:36:31.751 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: secure 2024-09-12T17:36:31.751 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: crc 2024-09-12T17:36:31.752 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: crc 2024-09-12T17:36:31.752 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: secure 2024-09-12T17:36:31.752 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: crc 2024-09-12T17:36:31.752 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: secure 2024-09-12T17:36:31.752 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: crc 2024-09-12T17:36:31.752 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: secure 2024-09-12T17:36:31.752 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.752 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 1 librados: starting msgr at 2024-09-12T17:36:31.752 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 1 librados: starting objecter 2024-09-12T17:36:31.752 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b0ac2271f0 EEXIST 2024-09-12T17:36:31.752 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 1 librados: setting wanted keys 2024-09-12T17:36:31.752 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 1 librados: calling monclient init 2024-09-12T17:36:31.752 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient: init 2024-09-12T17:36:31.753 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding auth protocol: cephx 2024-09-12T17:36:31.753 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding auth protocol: cephx 2024-09-12T17:36:31.753 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding auth protocol: cephx 2024-09-12T17:36:31.753 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: secure 2024-09-12T17:36:31.753 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: crc 2024-09-12T17:36:31.753 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: secure 2024-09-12T17:36:31.753 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: crc 2024-09-12T17:36:31.753 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: secure 2024-09-12T17:36:31.753 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: crc 2024-09-12T17:36:31.753 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: crc 2024-09-12T17:36:31.753 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: secure 2024-09-12T17:36:31.754 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: crc 2024-09-12T17:36:31.754 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: secure 2024-09-12T17:36:31.754 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: crc 2024-09-12T17:36:31.754 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: secure 2024-09-12T17:36:31.754 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.754 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.754 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command rotate-key cmddesc rotate-key hook 0x55b0ac203c08 EEXIST 2024-09-12T17:36:31.754 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:36:31.754 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:36:31.754 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-b con 0x55b0ac24f630 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:36:31.754 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-c con 0x55b0ac250ed0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:36:31.754 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-a con 0x55b0ac249730 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:36:31.754 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.755 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.755 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.755 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:36:31.755 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient(hunting): authenticate will time out at 2559.404881s 2024-09-12T17:36:31.755 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient(hunting): get_auth_request con 0x55b0ac250ed0 auth_method 0 2024-09-12T17:36:31.755 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.755 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.755 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.755 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:36:31.371+0000 7fdd03111640 10 monclient(hunting): get_auth_request con 0x55b0ac249730 auth_method 0 2024-09-12T17:36:31.755 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:36:31.371+0000 7fdd03111640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.755 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:36:31.371+0000 7fdd03111640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.756 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:36:31.371+0000 7fdd03111640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.756 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:31.756 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:31.756 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:31.756 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:36:31.371+0000 7fdd03111640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:31.756 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:36:31.371+0000 7fdd03111640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:31.756 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:36:31.371+0000 7fdd03111640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:31.756 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient(hunting): handle_auth_done global_id 6974 payload 824 2024-09-12T17:36:31.756 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient: _finish_hunting 0 2024-09-12T17:36:31.756 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:36:31.371+0000 7fdd03912640 1 monclient: found mon.noname-c 2024-09-12T17:36:31.756 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:36:31.757 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:31.757 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:36:31.757 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: dump: 2024-09-12T17:36:31.757 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:36:31.757 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:36:31.757 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.757 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.757 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:31.757 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.757 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:36:31.757 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:36:31.758 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:36:31.758 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.758 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: _finish_auth 0 2024-09-12T17:36:31.758 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: _check_auth_tickets 2024-09-12T17:36:31.758 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:36:31.758 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:31.758 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:36:31.758 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: dump: 2024-09-12T17:36:31.758 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:36:31.758 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:36:31.758 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.758 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.758 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:31.759 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.759 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:36:31.759 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:36:31.759 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:36:31.759 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.759 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 monclient: authenticate success, global_id 6974 2024-09-12T17:36:31.759 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient: _renew_subs 2024-09-12T17:36:31.759 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:36:31.371+0000 7fdbe6ffd640 4 set_mon_vals no callback set 2024-09-12T17:36:31.759 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:36:31.759 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient: _renew_subs 2024-09-12T17:36:31.759 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:36:31.759 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 1 librados: init done 2024-09-12T17:36:31.759 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command cr dump hook 0x55b0ac24a018 2024-09-12T17:36:31.760 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.760 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:36:31.760 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:36:31.760 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:36:31.760 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:36:31.375+0000 7fdd02910640 10 monclient: get_auth_request con 0x7fdbcc070b10 auth_method 0 2024-09-12T17:36:31.760 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:36:31.375+0000 7fdd03111640 10 monclient: get_auth_request con 0x55b0ac26f800 auth_method 0 2024-09-12T17:36:31.760 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.760 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 realm 2024-09-12T17:36:31.760 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.760 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.760 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:31.760 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.760 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.761 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.761 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:36:31.375+0000 7fdd02910640 10 monclient: get_auth_request con 0x55b0ac2737f0 auth_method 0 2024-09-12T17:36:31.761 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:31.761 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.761 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:36:31.375+0000 7fdd03912640 10 monclient: get_auth_request con 0x55b0ac2770e0 auth_method 0 2024-09-12T17:36:31.761 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:36:31.379+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:31.761 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:36:31.379+0000 7fdd0560b9c0 20 searching for the correct realm 2024-09-12T17:36:31.761 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:36:31.379+0000 7fdd03111640 10 monclient: get_auth_request con 0x55b0ac27be60 auth_method 0 2024-09-12T17:36:31.761 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:36:31.379+0000 7fdd02910640 10 monclient: get_auth_request con 0x7fdcfc0b8930 auth_method 0 2024-09-12T17:36:31.761 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:36:31.379+0000 7fdd03912640 10 monclient: get_auth_request con 0x7fdcec024070 auth_method 0 2024-09-12T17:36:31.762 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:36:31.383+0000 7fdd02910640 0 -- 172.21.15.119:0/4137269762 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fdcfc0b8930 msgr2=0x7fdcfc0d2410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:31.762 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:36:31.383+0000 7fdbe57fa640 1 client.6974.objecter ms_handle_reset 0x7fdcfc0b8930 session 0x7fdcfc0ca040 osd.7 2024-09-12T17:36:31.762 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:36:31.383+0000 7fdbe57fa640 10 monclient: _renew_subs 2024-09-12T17:36:31.762 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:36:31.383+0000 7fdbe57fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:36:31.762 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:36:31.383+0000 7fdd02910640 10 monclient: get_auth_request con 0x7fdbcc0812c0 auth_method 0 2024-09-12T17:36:31.762 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:36:31.383+0000 7fdd03111640 10 monclient: get_auth_request con 0x7fdcf4092b00 auth_method 0 2024-09-12T17:36:31.762 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:36:31.387+0000 7fdd02910640 10 monclient: get_auth_request con 0x7fdcf406d200 auth_method 0 2024-09-12T17:36:31.762 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:36:31.387+0000 7fdd02910640 0 -- 172.21.15.119:0/4137269762 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fdcf406d200 msgr2=0x7fdcf40879e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:31.762 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:36:31.571+0000 7fdd03912640 10 monclient: get_auth_request con 0x7fdbdc070a20 auth_method 0 2024-09-12T17:36:31.762 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:36:31.591+0000 7fdd02910640 10 monclient: get_auth_request con 0x7fdcf406d200 auth_method 0 2024-09-12T17:36:31.762 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:36:31.762 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:36:31.763 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:31.763 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:31.763 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:31.763 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:31.763 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.763 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.763 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.763 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:31.763 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.763 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:31.763 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 zone default found 2024-09-12T17:36:31.763 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 4 Realm: () 2024-09-12T17:36:31.763 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:36:31.764 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:36:31.764 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:31.764 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 zonegroup default 2024-09-12T17:36:31.764 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.764 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.764 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.764 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:36:31.611+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.764 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:36:31.611+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.764 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:36:31.611+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.764 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:36:31.611+0000 7fdd0560b9c0 20 started sync module instance, tier type = 2024-09-12T17:36:31.764 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:36:31.611+0000 7fdd0560b9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:36:31.765 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=0 2024-09-12T17:36:31.765 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=1 2024-09-12T17:36:31.765 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=2 2024-09-12T17:36:31.765 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=3 2024-09-12T17:36:31.765 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=4 2024-09-12T17:36:31.765 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=5 2024-09-12T17:36:31.765 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=6 2024-09-12T17:36:31.765 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=7 2024-09-12T17:36:31.765 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:31.765 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding auth protocol: cephx 2024-09-12T17:36:31.765 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding auth protocol: cephx 2024-09-12T17:36:31.766 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding auth protocol: cephx 2024-09-12T17:36:31.766 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: secure 2024-09-12T17:36:31.766 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: crc 2024-09-12T17:36:31.766 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: secure 2024-09-12T17:36:31.766 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: crc 2024-09-12T17:36:31.766 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: secure 2024-09-12T17:36:31.766 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: crc 2024-09-12T17:36:31.766 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: crc 2024-09-12T17:36:31.766 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: secure 2024-09-12T17:36:31.766 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: crc 2024-09-12T17:36:31.766 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: secure 2024-09-12T17:36:31.766 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: crc 2024-09-12T17:36:31.766 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:36:31.639+0000 7fdbb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:31.767 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: secure 2024-09-12T17:36:31.767 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.767 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:31.767 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:31.767 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command cache list hook 0x55b0ac249b90 2024-09-12T17:36:31.767 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command cache inspect hook 0x55b0ac249b90 2024-09-12T17:36:31.767 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command cache erase hook 0x55b0ac249b90 2024-09-12T17:36:31.767 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command cache zap hook 0x55b0ac249b90 2024-09-12T17:36:31.767 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 note: GC not initialized 2024-09-12T17:36:31.767 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:36:31.643+0000 7fdbb8fe1640 20 reqs_thread_entry: start 2024-09-12T17:36:31.767 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command sync trace show hook 0x7fdcf400f710 2024-09-12T17:36:31.767 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command sync trace history hook 0x7fdcf400f710 2024-09-12T17:36:31.768 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command sync trace active hook 0x7fdcf400f710 2024-09-12T17:36:31.768 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command sync trace active_short hook 0x7fdcf400f710 2024-09-12T17:36:31.768 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:31.768 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 Filter name: none 2024-09-12T17:36:31.768 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:36:31.643+0000 7fdb327fc640 20 reqs_thread_entry: start 2024-09-12T17:36:31.768 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:36:31.768 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.768 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:31.768 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:36:31.768 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:36:31.769 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 : miss 2024-09-12T17:36:31.769 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.769 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:31.769 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:36:31.769 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:36:31.769 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:36:31.769 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:31.769 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 2024-09-12T17:36:31.769 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:36:31.655+0000 7fdd0560b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:36:31.769 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:36:31.655+0000 7fdd0560b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:36:31.769 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:36:31.655+0000 7fdd0560b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:31.770 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:36:31.655+0000 7fdd0560b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33, ofs0, ns] 2024-09-12T17:36:31.770 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:36:31.655+0000 7fdbe6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333501 cookie 94217290910800 notifier 6974 bl.length()=1015 2024-09-12T17:36:31.770 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:36:31.655+0000 7fdbe6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:36:31.770 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:36:31.655+0000 7fdbe6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:36:31.770 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:36:31.655+0000 7fdbe6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:31.770 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:36:31.659+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_sources= new_sources= 2024-09-12T17:36:31.770 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:36:31.659+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential sources added=[] removed=[] 2024-09-12T17:36:31.770 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:36:31.659+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_dests= new_dests= 2024-09-12T17:36:31.770 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:36:31.659+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential dests added=[] removed=[] 2024-09-12T17:36:31.770 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.0 2024-09-12T17:36:31.770 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.0 2024-09-12T17:36:31.770 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.1 2024-09-12T17:36:31.771 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.1 2024-09-12T17:36:31.771 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.2 2024-09-12T17:36:31.771 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.2 2024-09-12T17:36:31.771 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.3 2024-09-12T17:36:31.771 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.3 2024-09-12T17:36:31.771 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.4 2024-09-12T17:36:31.771 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.4 2024-09-12T17:36:31.771 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.5 2024-09-12T17:36:31.771 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.5 2024-09-12T17:36:31.771 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.6 2024-09-12T17:36:31.771 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.6 2024-09-12T17:36:31.771 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.7 2024-09-12T17:36:31.771 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.7 2024-09-12T17:36:31.772 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.8 2024-09-12T17:36:31.772 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.8 2024-09-12T17:36:31.772 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.9 2024-09-12T17:36:31.772 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.9 2024-09-12T17:36:31.772 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.10 2024-09-12T17:36:31.772 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.10 2024-09-12T17:36:31.772 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.11 2024-09-12T17:36:31.772 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.11 2024-09-12T17:36:31.772 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.0 2024-09-12T17:36:31.772 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:36:31.671+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1 2024-09-12T17:36:31.772 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:36:31.671+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.2 2024-09-12T17:36:31.772 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:36:31.671+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.3 2024-09-12T17:36:31.772 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:36:31.671+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.4 2024-09-12T17:36:31.773 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:36:31.675+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.5 2024-09-12T17:36:31.773 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:36:31.675+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.6 2024-09-12T17:36:31.773 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:36:31.675+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.7 2024-09-12T17:36:31.773 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:36:31.675+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.8 2024-09-12T17:36:31.773 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:36:31.679+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.9 2024-09-12T17:36:31.773 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:36:31.679+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.10 2024-09-12T17:36:31.773 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:31.773 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 2024-09-12T17:36:31.773 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:36:31.773 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:36:31.773 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:31.773 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33, ofs0, ns] 2024-09-12T17:36:31.773 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:36:31.687+0000 7fdbe6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333502 cookie 94217290910800 notifier 6974 bl.length()=1015 2024-09-12T17:36:31.774 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:36:31.687+0000 7fdbe6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:36:31.774 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:36:31.687+0000 7fdbe6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:36:31.774 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:36:31.687+0000 7fdbe6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:31.774 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:36:31.691+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_sources= new_sources= 2024-09-12T17:36:31.774 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:36:31.691+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential sources added=[] removed=[] 2024-09-12T17:36:31.774 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:36:31.691+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_dests= new_dests= 2024-09-12T17:36:31.774 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:36:31.691+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential dests added=[] removed=[] 2024-09-12T17:36:31.774 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.0 2024-09-12T17:36:31.774 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1 2024-09-12T17:36:31.774 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.2 2024-09-12T17:36:31.775 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.3 2024-09-12T17:36:31.775 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.4 2024-09-12T17:36:31.775 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.5 2024-09-12T17:36:31.775 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:36:31.703+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.6 2024-09-12T17:36:31.775 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:36:31.703+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.7 2024-09-12T17:36:31.775 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:36:31.703+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.8 2024-09-12T17:36:31.775 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:36:31.703+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.9 2024-09-12T17:36:31.775 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:36:31.703+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.10 2024-09-12T17:36:31.775 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:36:31.707+0000 7fdd0560b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdd0560b9c0 time 2024-09-12T17:36:31.708761+0000 2024-09-12T17:36:31.775 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:36:31.775 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.775 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:36:31.775 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdd08ee52eb] 2024-09-12T17:36:31.776 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdd08ee549f] 2024-09-12T17:36:31.776 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0aae540c1] 2024-09-12T17:36:31.776 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55b0aae66467] 2024-09-12T17:36:31.776 INFO:tasks.workunit.client.0.smithi119.stderr: 5: main() 2024-09-12T17:36:31.776 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdd07d4bd90] 2024-09-12T17:36:31.776 INFO:tasks.workunit.client.0.smithi119.stderr: 7: __libc_start_main() 2024-09-12T17:36:31.776 INFO:tasks.workunit.client.0.smithi119.stderr: 8: _start() 2024-09-12T17:36:31.776 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.776 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:36:31.707+0000 7fdd0560b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:36:31.776 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fdd0560b9c0 thread_name:radosgw-admin 2024-09-12T17:36:31.776 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.776 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:36:31.776 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdd07d64520] 2024-09-12T17:36:31.777 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:36:31.777 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:36:31.777 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:36:31.777 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdd08ee5345] 2024-09-12T17:36:31.777 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdd08ee549f] 2024-09-12T17:36:31.777 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0aae540c1] 2024-09-12T17:36:31.777 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55b0aae66467] 2024-09-12T17:36:31.777 INFO:tasks.workunit.client.0.smithi119.stderr: 9: main() 2024-09-12T17:36:31.777 INFO:tasks.workunit.client.0.smithi119.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdd07d4bd90] 2024-09-12T17:36:31.777 INFO:tasks.workunit.client.0.smithi119.stderr: 11: __libc_start_main() 2024-09-12T17:36:31.777 INFO:tasks.workunit.client.0.smithi119.stderr: 12: _start() 2024-09-12T17:36:31.777 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:36:31.778 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.778 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:36:31.778 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:36:31.778 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:36:31.778 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:36:31.778 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:36:31.778 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:36:31.778 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:36:31.778 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:36:31.778 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:36:31.779 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:36:31.779 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:36:31.779 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:36:31.779 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:36:31.779 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:36:31.779 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:36:31.779 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:36:31.779 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:36:31.779 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:36:31.779 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:36:31.779 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:36:31.779 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:36:31.779 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:36:31.780 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:36:31.780 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:36:31.780 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:36:31.780 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:36:31.780 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:36:31.780 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:36:31.780 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:36:31.780 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:36:31.780 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:36:31.780 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:36:31.780 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:36:31.780 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:36:31.781 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:36:31.781 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:36:31.781 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:36:31.781 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:36:31.781 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:36:31.781 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:36:31.781 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:36:31.781 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:36:31.781 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:36:31.781 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:36:31.782 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:36:31.782 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:36:31.782 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:36:31.782 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:36:31.782 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:36:31.782 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:36:31.782 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:36:31.782 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:36:31.782 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:36:31.782 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:36:31.782 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:36:31.782 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:36:31.782 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:36:31.783 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:36:31.783 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:36:31.783 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:36:31.783 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:36:31.783 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:36:31.783 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:36:31.783 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:36:31.783 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:36:31.783 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:36:31.783 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:36:31.784 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:36:31.784 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:36:31.784 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:36:31.784 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:36:31.784 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:36:31.784 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:36:31.784 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:36:31.784 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:36:31.784 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:36:31.785 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:36:31.785 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:36:31.785 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:36:31.785 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:36:31.785 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:36:31.785 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:36:31.785 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:36:31.785 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:36:31.786 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:36:31.786 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:36:31.786 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:36:31.786 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:36:31.786 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:36:31.786 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:36:31.786 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:36:31.786 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:36:31.786 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:36:31.787 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:36:31.787 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdb327fc640 / http_manager 2024-09-12T17:36:31.787 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdbb8fe1640 / http_manager 2024-09-12T17:36:31.787 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdbb9fe3640 / rgw_dt_lg_renew 2024-09-12T17:36:31.787 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdbe57fa640 / ms_dispatch 2024-09-12T17:36:31.787 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdbe6ffd640 / io_context_pool 2024-09-12T17:36:31.787 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdbed602640 / ms_dispatch 2024-09-12T17:36:31.787 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdbefe07640 / ms_dispatch 2024-09-12T17:36:31.787 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdbf160a640 / io_context_pool 2024-09-12T17:36:31.787 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdd02910640 / msgr-worker-2 2024-09-12T17:36:31.787 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdd03111640 / msgr-worker-1 2024-09-12T17:36:31.787 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdd03912640 / msgr-worker-0 2024-09-12T17:36:31.787 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdd04113640 / io_context_pool 2024-09-12T17:36:31.788 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdd0560b9c0 / radosgw-admin 2024-09-12T17:36:31.788 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:36:31.788 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:36:31.788 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/log/ceph/ceph-client.admin.115072.log 2024-09-12T17:36:31.788 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:36:31.788 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:36:31.788 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac182f80) adding con mode: secure 2024-09-12T17:36:31.788 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.788 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.788 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command rotate-key hook 0x55b0ac1830c8 2024-09-12T17:36:31.788 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:36:31.788 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:36:31.789 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-b con 0x55b0ac032000 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:36:31.789 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-a con 0x55b0ac0c7f80 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:36:31.789 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-c con 0x55b0ac0c8360 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:36:31.789 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.789 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.789 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.789 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:36:31.789 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient(hunting): authenticate will time out at 2559.386895s 2024-09-12T17:36:31.789 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient(hunting): get_auth_request con 0x55b0ac0c7f80 auth_method 0 2024-09-12T17:36:31.789 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.789 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.789 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.789 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:36:31.351+0000 7fdd03912640 10 monclient(hunting): get_auth_request con 0x55b0ac0c8360 auth_method 0 2024-09-12T17:36:31.790 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:36:31.351+0000 7fdd03912640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.790 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:36:31.351+0000 7fdd03912640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.790 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:36:31.351+0000 7fdd03912640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.790 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:31.790 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:31.790 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:31.790 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:36:31.351+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:31.790 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:36:31.351+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:31.790 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:36:31.351+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:31.790 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient(hunting): handle_auth_done global_id 7386 payload 824 2024-09-12T17:36:31.790 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient: _finish_hunting 0 2024-09-12T17:36:31.790 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:36:31.351+0000 7fdd02910640 1 monclient: found mon.noname-a 2024-09-12T17:36:31.790 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:36:31.351+0000 7fdd02910640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:36:31.791 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:31.791 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:36:31.791 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: dump: 2024-09-12T17:36:31.791 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:36:31.791 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:36:31.791 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.791 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.791 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:31.791 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.791 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:36:31.791 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:36:31.791 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:36:31.791 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.792 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: _finish_auth 0 2024-09-12T17:36:31.792 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: _check_auth_tickets 2024-09-12T17:36:31.792 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:36:31.792 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:31.792 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:36:31.792 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:36:31.351+0000 7fdbefe07640 10 monclient: dump: 2024-09-12T17:36:31.792 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:36:31.792 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:36:31.792 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.792 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.792 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:31.792 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.792 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:36:31.793 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:36:31.793 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:36:31.793 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.793 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 5 monclient: authenticate success, global_id 7386 2024-09-12T17:36:31.793 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient: _renew_subs 2024-09-12T17:36:31.793 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:36:31.351+0000 7fdbf160a640 4 set_mon_vals no callback set 2024-09-12T17:36:31.793 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:36:31.793 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient: _renew_subs 2024-09-12T17:36:31.793 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:36:31.793 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:36:31.351+0000 7fdd0560b9c0 1 librados: init done 2024-09-12T17:36:31.793 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:36:31.355+0000 7fdbefe07640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:36:31.793 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:36:31.355+0000 7fdbefe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:36:31.793 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:36:31.355+0000 7fdbefe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:36:31.794 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:36:31.355+0000 7fdd03111640 10 monclient: get_auth_request con 0x7fdbe8070ae0 auth_method 0 2024-09-12T17:36:31.794 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:36:31.355+0000 7fdd03912640 10 monclient: get_auth_request con 0x55b0ac1b5c00 auth_method 0 2024-09-12T17:36:31.794 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:36:31.355+0000 7fdd03111640 10 monclient: get_auth_request con 0x55b0ac1cdd10 auth_method 0 2024-09-12T17:36:31.794 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:36:31.359+0000 7fdd02910640 10 monclient: get_auth_request con 0x55b0ac1d2070 auth_method 0 2024-09-12T17:36:31.794 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:36:31.359+0000 7fdd03912640 10 monclient: get_auth_request con 0x55b0ac1d63a0 auth_method 0 2024-09-12T17:36:31.794 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: build_initial_monmap 2024-09-12T17:36:31.794 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:36:31.794 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: monmap: 2024-09-12T17:36:31.794 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:36:31.794 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:36:31.794 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:36:31.794 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:36:31.795 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:36:31.795 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.795 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:36:31.795 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:36:31.795 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:36:31.795 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.795 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding auth protocol: cephx 2024-09-12T17:36:31.795 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding auth protocol: cephx 2024-09-12T17:36:31.795 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding auth protocol: cephx 2024-09-12T17:36:31.795 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: secure 2024-09-12T17:36:31.795 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: crc 2024-09-12T17:36:31.795 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: secure 2024-09-12T17:36:31.795 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: crc 2024-09-12T17:36:31.796 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: secure 2024-09-12T17:36:31.796 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: crc 2024-09-12T17:36:31.796 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: crc 2024-09-12T17:36:31.796 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: secure 2024-09-12T17:36:31.796 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: crc 2024-09-12T17:36:31.796 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: secure 2024-09-12T17:36:31.796 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: crc 2024-09-12T17:36:31.796 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1da1f0) adding con mode: secure 2024-09-12T17:36:31.796 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.796 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b0ac1ddaf0 EEXIST 2024-09-12T17:36:31.796 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: init 2024-09-12T17:36:31.796 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding auth protocol: cephx 2024-09-12T17:36:31.796 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding auth protocol: cephx 2024-09-12T17:36:31.797 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding auth protocol: cephx 2024-09-12T17:36:31.797 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: secure 2024-09-12T17:36:31.797 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: crc 2024-09-12T17:36:31.797 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: secure 2024-09-12T17:36:31.797 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: crc 2024-09-12T17:36:31.797 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: secure 2024-09-12T17:36:31.797 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: crc 2024-09-12T17:36:31.797 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: crc 2024-09-12T17:36:31.797 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: secure 2024-09-12T17:36:31.797 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: crc 2024-09-12T17:36:31.797 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: secure 2024-09-12T17:36:31.797 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: crc 2024-09-12T17:36:31.797 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac1d90e8) adding con mode: secure 2024-09-12T17:36:31.798 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.798 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.798 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command rotate-key cmddesc rotate-key hook 0x55b0ac1d9230 EEXIST 2024-09-12T17:36:31.798 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:36:31.798 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:36:31.798 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-c con 0x55b0ac201ca0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:36:31.798 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-a con 0x55b0ac2015d0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:36:31.798 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-b con 0x55b0ac1fffb0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:36:31.798 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.798 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.798 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.798 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:36:31.798 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient(hunting): authenticate will time out at 2559.398564s 2024-09-12T17:36:31.799 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient(hunting): get_auth_request con 0x55b0ac201ca0 auth_method 0 2024-09-12T17:36:31.799 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.799 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.799 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.799 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:36:31.363+0000 7fdd03912640 10 monclient(hunting): get_auth_request con 0x55b0ac2015d0 auth_method 0 2024-09-12T17:36:31.799 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:36:31.363+0000 7fdd03912640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.799 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:36:31.363+0000 7fdd03912640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.799 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:36:31.363+0000 7fdd03912640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.799 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:31.799 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:31.799 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:31.799 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:36:31.363+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:31.799 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:36:31.363+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:31.800 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:36:31.363+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:31.800 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:36:31.363+0000 7fdd03111640 10 monclient(hunting): get_auth_request con 0x55b0ac1fffb0 auth_method 0 2024-09-12T17:36:31.800 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:36:31.363+0000 7fdd03111640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.800 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:36:31.363+0000 7fdd03111640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.800 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:36:31.363+0000 7fdd03111640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.800 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient(hunting): handle_auth_done global_id 6968 payload 824 2024-09-12T17:36:31.800 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient: _finish_hunting 0 2024-09-12T17:36:31.800 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:36:31.363+0000 7fdd02910640 1 monclient: found mon.noname-c 2024-09-12T17:36:31.800 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:36:31.363+0000 7fdd02910640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:36:31.800 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:31.800 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:36:31.800 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: dump: 2024-09-12T17:36:31.800 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:36:31.801 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:36:31.801 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.801 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.801 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:31.801 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.801 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:36:31.801 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:36:31.801 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:36:31.801 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.801 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: _finish_auth 0 2024-09-12T17:36:31.801 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: _check_auth_tickets 2024-09-12T17:36:31.801 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 5 monclient: authenticate success, global_id 6968 2024-09-12T17:36:31.801 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: _renew_subs 2024-09-12T17:36:31.802 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:36:31.802 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:36:31.802 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:31.802 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:36:31.802 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:36:31.363+0000 7fdbed602640 10 monclient: dump: 2024-09-12T17:36:31.802 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:36:31.802 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:36:31.802 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.802 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.802 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:31.802 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.802 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:36:31.803 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:36:31.803 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:36:31.803 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.803 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:36:31.363+0000 7fdd04113640 4 set_mon_vals no callback set 2024-09-12T17:36:31.803 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: _renew_subs 2024-09-12T17:36:31.803 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:36:31.363+0000 7fdd0560b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:36:31.803 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:36:31.367+0000 7fdbed602640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:36:31.803 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:36:31.367+0000 7fdbed602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:36:31.803 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:36:31.367+0000 7fdbed602640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:36:31.803 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: get_monmap_and_config 2024-09-12T17:36:31.803 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: build_initial_monmap 2024-09-12T17:36:31.804 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:36:31.804 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: monmap: 2024-09-12T17:36:31.804 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:36:31.804 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:36:31.804 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:36:31.804 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:36:31.804 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:36:31.804 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.804 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:36:31.804 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:36:31.804 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:36:31.804 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.804 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding auth protocol: cephx 2024-09-12T17:36:31.805 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding auth protocol: cephx 2024-09-12T17:36:31.805 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding auth protocol: cephx 2024-09-12T17:36:31.805 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: secure 2024-09-12T17:36:31.805 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: crc 2024-09-12T17:36:31.805 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: secure 2024-09-12T17:36:31.805 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: crc 2024-09-12T17:36:31.805 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: secure 2024-09-12T17:36:31.805 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: crc 2024-09-12T17:36:31.805 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: crc 2024-09-12T17:36:31.805 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: secure 2024-09-12T17:36:31.805 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: crc 2024-09-12T17:36:31.805 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: secure 2024-09-12T17:36:31.805 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: crc 2024-09-12T17:36:31.806 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac2210c0) adding con mode: secure 2024-09-12T17:36:31.806 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.806 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: init 2024-09-12T17:36:31.806 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding auth protocol: cephx 2024-09-12T17:36:31.806 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding auth protocol: cephx 2024-09-12T17:36:31.806 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding auth protocol: cephx 2024-09-12T17:36:31.806 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: secure 2024-09-12T17:36:31.806 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: crc 2024-09-12T17:36:31.806 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: secure 2024-09-12T17:36:31.806 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: crc 2024-09-12T17:36:31.806 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: secure 2024-09-12T17:36:31.806 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: crc 2024-09-12T17:36:31.806 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: crc 2024-09-12T17:36:31.806 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: secure 2024-09-12T17:36:31.807 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: crc 2024-09-12T17:36:31.807 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: secure 2024-09-12T17:36:31.807 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: crc 2024-09-12T17:36:31.807 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d0c0) adding con mode: secure 2024-09-12T17:36:31.807 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.807 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.807 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command rotate-key cmddesc rotate-key hook 0x7fff8ab9d208 EEXIST 2024-09-12T17:36:31.807 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:36:31.807 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:36:31.807 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-b con 0x55b0ac24f630 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:36:31.807 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-c con 0x55b0ac24fa10 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:36:31.807 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-a con 0x55b0ac250ed0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:36:31.807 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.808 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.808 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.808 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:36:31.808 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient(hunting): authenticate will time out at 2559.402359s 2024-09-12T17:36:31.808 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient(hunting): get_auth_request con 0x55b0ac24fa10 auth_method 0 2024-09-12T17:36:31.808 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.808 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.808 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.808 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:36:31.367+0000 7fdd03111640 10 monclient(hunting): get_auth_request con 0x55b0ac250ed0 auth_method 0 2024-09-12T17:36:31.808 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:36:31.367+0000 7fdd03111640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.809 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:36:31.367+0000 7fdd03111640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.809 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:36:31.367+0000 7fdd03111640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.809 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:31.809 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:31.809 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:31.809 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:36:31.367+0000 7fdd03111640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:31.809 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:36:31.367+0000 7fdd03111640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:31.809 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:36:31.367+0000 7fdd03111640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:31.809 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient(hunting): handle_auth_done global_id 6971 payload 274 2024-09-12T17:36:31.809 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient: _finish_hunting 0 2024-09-12T17:36:31.809 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:36:31.367+0000 7fdd03912640 1 monclient: found mon.noname-c 2024-09-12T17:36:31.809 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:36:31.367+0000 7fdd03912640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:36:31.809 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:31.810 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:36:31.810 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: dump: 2024-09-12T17:36:31.810 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:36:31.810 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:36:31.810 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.810 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.810 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:31.810 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.810 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:36:31.810 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:36:31.810 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:36:31.810 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.810 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: _finish_auth 0 2024-09-12T17:36:31.811 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:36:31.811 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 monclient: authenticate success, global_id 6971 2024-09-12T17:36:31.811 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:36:31.811 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:36:31.811 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 4 set_mon_vals no callback set 2024-09-12T17:36:31.811 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:31.811 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:36:31.811 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:36:31.367+0000 7fdbe6ffd640 10 monclient: dump: 2024-09-12T17:36:31.811 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:36:31.811 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:36:31.811 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.811 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.811 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:31.812 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.812 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:36:31.812 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:36:31.812 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:36:31.812 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.812 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: shutdown 2024-09-12T17:36:31.812 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: build_initial_monmap 2024-09-12T17:36:31.812 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:36:31.812 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 10 monclient: monmap: 2024-09-12T17:36:31.812 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:36:31.812 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:36:31.812 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:36:31.812 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:36:31.813 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:36:31.813 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.813 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:36:31.813 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:36:31.813 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:36:31.813 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.813 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding auth protocol: cephx 2024-09-12T17:36:31.813 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding auth protocol: cephx 2024-09-12T17:36:31.813 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding auth protocol: cephx 2024-09-12T17:36:31.813 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: secure 2024-09-12T17:36:31.813 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: crc 2024-09-12T17:36:31.813 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: secure 2024-09-12T17:36:31.813 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: crc 2024-09-12T17:36:31.814 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: secure 2024-09-12T17:36:31.814 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: crc 2024-09-12T17:36:31.814 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: crc 2024-09-12T17:36:31.814 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: secure 2024-09-12T17:36:31.814 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: crc 2024-09-12T17:36:31.814 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: secure 2024-09-12T17:36:31.814 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: crc 2024-09-12T17:36:31.814 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:36:31.367+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac247b60) adding con mode: secure 2024-09-12T17:36:31.814 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.814 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 1 librados: starting msgr at 2024-09-12T17:36:31.814 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 1 librados: starting objecter 2024-09-12T17:36:31.814 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b0ac2271f0 EEXIST 2024-09-12T17:36:31.814 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 1 librados: setting wanted keys 2024-09-12T17:36:31.814 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 1 librados: calling monclient init 2024-09-12T17:36:31.815 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient: init 2024-09-12T17:36:31.815 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding auth protocol: cephx 2024-09-12T17:36:31.815 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding auth protocol: cephx 2024-09-12T17:36:31.815 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding auth protocol: cephx 2024-09-12T17:36:31.815 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: secure 2024-09-12T17:36:31.815 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: crc 2024-09-12T17:36:31.815 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: secure 2024-09-12T17:36:31.815 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: crc 2024-09-12T17:36:31.815 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: secure 2024-09-12T17:36:31.815 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: crc 2024-09-12T17:36:31.815 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: crc 2024-09-12T17:36:31.815 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: secure 2024-09-12T17:36:31.815 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: crc 2024-09-12T17:36:31.816 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: secure 2024-09-12T17:36:31.816 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: crc 2024-09-12T17:36:31.816 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 AuthRegistry(0x55b0ac203ac0) adding con mode: secure 2024-09-12T17:36:31.816 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.816 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.816 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command rotate-key cmddesc rotate-key hook 0x55b0ac203c08 EEXIST 2024-09-12T17:36:31.816 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:36:31.816 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:36:31.816 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-b con 0x55b0ac24f630 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:36:31.816 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-c con 0x55b0ac250ed0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:36:31.816 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient(hunting): picked mon.noname-a con 0x55b0ac249730 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:36:31.816 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.816 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.817 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:31.817 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:36:31.817 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient(hunting): authenticate will time out at 2559.404881s 2024-09-12T17:36:31.817 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient(hunting): get_auth_request con 0x55b0ac250ed0 auth_method 0 2024-09-12T17:36:31.817 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.817 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.817 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.817 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:36:31.371+0000 7fdd03111640 10 monclient(hunting): get_auth_request con 0x55b0ac249730 auth_method 0 2024-09-12T17:36:31.817 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:36:31.371+0000 7fdd03111640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:31.817 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:36:31.371+0000 7fdd03111640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:31.817 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:36:31.371+0000 7fdd03111640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:31.817 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:31.817 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:31.818 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:31.818 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:36:31.371+0000 7fdd03111640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:31.818 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:36:31.371+0000 7fdd03111640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:31.818 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:36:31.371+0000 7fdd03111640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:31.818 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient(hunting): handle_auth_done global_id 6974 payload 824 2024-09-12T17:36:31.818 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient: _finish_hunting 0 2024-09-12T17:36:31.818 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:36:31.371+0000 7fdd03912640 1 monclient: found mon.noname-c 2024-09-12T17:36:31.818 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:36:31.371+0000 7fdd03912640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:36:31.818 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:31.818 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:36:31.818 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: dump: 2024-09-12T17:36:31.818 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:36:31.818 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:36:31.818 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.819 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.819 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:31.819 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.819 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:36:31.819 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:36:31.819 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:36:31.819 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.819 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: _finish_auth 0 2024-09-12T17:36:31.819 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: _check_auth_tickets 2024-09-12T17:36:31.819 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:36:31.819 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:31.819 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:36:31.819 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 10 monclient: dump: 2024-09-12T17:36:31.820 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:36:31.820 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:36:31.820 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.820 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:36:31.820 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:31.820 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:36:31.820 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:36:31.820 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:36:31.820 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:36:31.820 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.820 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 monclient: authenticate success, global_id 6974 2024-09-12T17:36:31.820 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient: _renew_subs 2024-09-12T17:36:31.820 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:36:31.371+0000 7fdbe6ffd640 4 set_mon_vals no callback set 2024-09-12T17:36:31.820 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:36:31.821 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient: _renew_subs 2024-09-12T17:36:31.821 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:36:31.821 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 1 librados: init done 2024-09-12T17:36:31.821 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command cr dump hook 0x55b0ac24a018 2024-09-12T17:36:31.821 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:36:31.371+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.821 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:36:31.821 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:36:31.821 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:36:31.371+0000 7fdbe57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:36:31.821 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:36:31.375+0000 7fdd02910640 10 monclient: get_auth_request con 0x7fdbcc070b10 auth_method 0 2024-09-12T17:36:31.821 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:36:31.375+0000 7fdd03111640 10 monclient: get_auth_request con 0x55b0ac26f800 auth_method 0 2024-09-12T17:36:31.821 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.821 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 realm 2024-09-12T17:36:31.822 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.822 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.822 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:31.822 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.822 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.823 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.823 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:36:31.375+0000 7fdd02910640 10 monclient: get_auth_request con 0x55b0ac2737f0 auth_method 0 2024-09-12T17:36:31.823 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:31.823 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:36:31.375+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.823 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:36:31.375+0000 7fdd03912640 10 monclient: get_auth_request con 0x55b0ac2770e0 auth_method 0 2024-09-12T17:36:31.823 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:36:31.379+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:31.823 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:36:31.379+0000 7fdd0560b9c0 20 searching for the correct realm 2024-09-12T17:36:31.824 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:36:31.379+0000 7fdd03111640 10 monclient: get_auth_request con 0x55b0ac27be60 auth_method 0 2024-09-12T17:36:31.824 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:36:31.379+0000 7fdd02910640 10 monclient: get_auth_request con 0x7fdcfc0b8930 auth_method 0 2024-09-12T17:36:31.824 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:36:31.379+0000 7fdd03912640 10 monclient: get_auth_request con 0x7fdcec024070 auth_method 0 2024-09-12T17:36:31.824 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:36:31.383+0000 7fdd02910640 0 -- 172.21.15.119:0/4137269762 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fdcfc0b8930 msgr2=0x7fdcfc0d2410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:31.824 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:36:31.383+0000 7fdbe57fa640 1 client.6974.objecter ms_handle_reset 0x7fdcfc0b8930 session 0x7fdcfc0ca040 osd.7 2024-09-12T17:36:31.824 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:36:31.383+0000 7fdbe57fa640 10 monclient: _renew_subs 2024-09-12T17:36:31.825 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:36:31.383+0000 7fdbe57fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:36:31.825 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:36:31.383+0000 7fdd02910640 10 monclient: get_auth_request con 0x7fdbcc0812c0 auth_method 0 2024-09-12T17:36:31.825 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:36:31.383+0000 7fdd03111640 10 monclient: get_auth_request con 0x7fdcf4092b00 auth_method 0 2024-09-12T17:36:31.825 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:36:31.387+0000 7fdd02910640 10 monclient: get_auth_request con 0x7fdcf406d200 auth_method 0 2024-09-12T17:36:31.825 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:36:31.387+0000 7fdd02910640 0 -- 172.21.15.119:0/4137269762 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fdcf406d200 msgr2=0x7fdcf40879e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:31.825 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:36:31.571+0000 7fdd03912640 10 monclient: get_auth_request con 0x7fdbdc070a20 auth_method 0 2024-09-12T17:36:31.826 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:36:31.591+0000 7fdd02910640 10 monclient: get_auth_request con 0x7fdcf406d200 auth_method 0 2024-09-12T17:36:31.826 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:36:31.826 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:36:31.826 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:31.826 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:31.826 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:31.826 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:31.826 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:36:31.603+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.827 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.827 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.827 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:31.827 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.827 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:31.827 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 zone default found 2024-09-12T17:36:31.827 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 4 Realm: () 2024-09-12T17:36:31.828 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:36:31.828 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:36:31.828 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:31.828 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 zonegroup default 2024-09-12T17:36:31.828 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.828 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.829 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:36:31.607+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.829 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:36:31.611+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.829 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:36:31.611+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.829 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:36:31.611+0000 7fdd0560b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.829 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:36:31.611+0000 7fdd0560b9c0 20 started sync module instance, tier type = 2024-09-12T17:36:31.829 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:36:31.611+0000 7fdd0560b9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:36:31.830 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=0 2024-09-12T17:36:31.830 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=1 2024-09-12T17:36:31.830 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=2 2024-09-12T17:36:31.830 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=3 2024-09-12T17:36:31.830 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=4 2024-09-12T17:36:31.830 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=5 2024-09-12T17:36:31.830 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=6 2024-09-12T17:36:31.830 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 20 add_watcher() i=7 2024-09-12T17:36:31.830 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:36:31.635+0000 7fdd0560b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:31.830 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding auth protocol: cephx 2024-09-12T17:36:31.831 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding auth protocol: cephx 2024-09-12T17:36:31.831 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding auth protocol: cephx 2024-09-12T17:36:31.831 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: secure 2024-09-12T17:36:31.831 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: crc 2024-09-12T17:36:31.831 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: secure 2024-09-12T17:36:31.831 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: crc 2024-09-12T17:36:31.831 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: secure 2024-09-12T17:36:31.831 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: crc 2024-09-12T17:36:31.831 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: crc 2024-09-12T17:36:31.831 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: secure 2024-09-12T17:36:31.831 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: crc 2024-09-12T17:36:31.831 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: secure 2024-09-12T17:36:31.831 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: crc 2024-09-12T17:36:31.832 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:36:31.639+0000 7fdbb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:31.832 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:36:31.639+0000 7fdd0560b9c0 5 AuthRegistry(0x7fff8ab9d590) adding con mode: secure 2024-09-12T17:36:31.832 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:31.832 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:31.832 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:31.832 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command cache list hook 0x55b0ac249b90 2024-09-12T17:36:31.832 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command cache inspect hook 0x55b0ac249b90 2024-09-12T17:36:31.832 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command cache erase hook 0x55b0ac249b90 2024-09-12T17:36:31.832 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command cache zap hook 0x55b0ac249b90 2024-09-12T17:36:31.832 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 note: GC not initialized 2024-09-12T17:36:31.832 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:36:31.643+0000 7fdbb8fe1640 20 reqs_thread_entry: start 2024-09-12T17:36:31.832 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command sync trace show hook 0x7fdcf400f710 2024-09-12T17:36:31.832 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command sync trace history hook 0x7fdcf400f710 2024-09-12T17:36:31.833 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command sync trace active hook 0x7fdcf400f710 2024-09-12T17:36:31.833 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 5 asok(0x55b0abf782b0) register_command sync trace active_short hook 0x7fdcf400f710 2024-09-12T17:36:31.833 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:31.833 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 Filter name: none 2024-09-12T17:36:31.833 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:36:31.643+0000 7fdb327fc640 20 reqs_thread_entry: start 2024-09-12T17:36:31.833 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:36:31.833 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.833 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:31.833 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:36:31.833 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:36:31.833 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 : miss 2024-09-12T17:36:31.833 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.833 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:31.834 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:36:31.834 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:36:31.834 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:36:31.834 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:31.834 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:36:31.643+0000 7fdd0560b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 2024-09-12T17:36:31.834 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:36:31.655+0000 7fdd0560b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:36:31.834 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:36:31.655+0000 7fdd0560b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:36:31.834 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:36:31.655+0000 7fdd0560b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:31.834 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:36:31.655+0000 7fdd0560b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33, ofs0, ns] 2024-09-12T17:36:31.834 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:36:31.655+0000 7fdbe6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333501 cookie 94217290910800 notifier 6974 bl.length()=1015 2024-09-12T17:36:31.834 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:36:31.655+0000 7fdbe6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:36:31.834 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:36:31.655+0000 7fdbe6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:36:31.834 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:36:31.655+0000 7fdbe6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:31.835 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:36:31.659+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_sources= new_sources= 2024-09-12T17:36:31.835 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:36:31.659+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential sources added=[] removed=[] 2024-09-12T17:36:31.835 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:36:31.659+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_dests= new_dests= 2024-09-12T17:36:31.835 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:36:31.659+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential dests added=[] removed=[] 2024-09-12T17:36:31.835 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.0 2024-09-12T17:36:31.835 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.0 2024-09-12T17:36:31.835 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.1 2024-09-12T17:36:31.835 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.1 2024-09-12T17:36:31.835 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.2 2024-09-12T17:36:31.835 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.2 2024-09-12T17:36:31.835 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.3 2024-09-12T17:36:31.835 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.3 2024-09-12T17:36:31.835 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.4 2024-09-12T17:36:31.835 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.4 2024-09-12T17:36:31.836 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.5 2024-09-12T17:36:31.836 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.5 2024-09-12T17:36:31.836 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.6 2024-09-12T17:36:31.836 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.6 2024-09-12T17:36:31.836 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.7 2024-09-12T17:36:31.836 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.7 2024-09-12T17:36:31.836 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.8 2024-09-12T17:36:31.836 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.8 2024-09-12T17:36:31.836 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.9 2024-09-12T17:36:31.836 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.9 2024-09-12T17:36:31.836 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.10 2024-09-12T17:36:31.836 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.10 2024-09-12T17:36:31.836 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.11 2024-09-12T17:36:31.837 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.11 2024-09-12T17:36:31.837 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:36:31.667+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.0 2024-09-12T17:36:31.837 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:36:31.671+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1 2024-09-12T17:36:31.837 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:36:31.671+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.2 2024-09-12T17:36:31.837 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:36:31.671+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.3 2024-09-12T17:36:31.837 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:36:31.671+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.4 2024-09-12T17:36:31.837 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:36:31.675+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.5 2024-09-12T17:36:31.837 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:36:31.675+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.6 2024-09-12T17:36:31.837 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:36:31.675+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.7 2024-09-12T17:36:31.837 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:36:31.675+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.8 2024-09-12T17:36:31.837 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:36:31.679+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.9 2024-09-12T17:36:31.837 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:36:31.679+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.10 2024-09-12T17:36:31.837 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:31.838 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 2024-09-12T17:36:31.838 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:36:31.838 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:36:31.838 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:31.838 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:36:31.687+0000 7fdd0560b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33, ofs0, ns] 2024-09-12T17:36:31.838 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:36:31.687+0000 7fdbe6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333502 cookie 94217290910800 notifier 6974 bl.length()=1015 2024-09-12T17:36:31.838 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:36:31.687+0000 7fdbe6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:36:31.838 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:36:31.687+0000 7fdbe6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:36:31.838 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:36:31.687+0000 7fdbe6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:31.838 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:36:31.691+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_sources= new_sources= 2024-09-12T17:36:31.838 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:36:31.691+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential sources added=[] removed=[] 2024-09-12T17:36:31.838 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:36:31.691+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_dests= new_dests= 2024-09-12T17:36:31.838 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:36:31.691+0000 7fdd0560b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential dests added=[] removed=[] 2024-09-12T17:36:31.839 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.0 2024-09-12T17:36:31.839 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1 2024-09-12T17:36:31.839 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.2 2024-09-12T17:36:31.839 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.3 2024-09-12T17:36:31.839 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.4 2024-09-12T17:36:31.839 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:36:31.699+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.5 2024-09-12T17:36:31.839 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:36:31.703+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.6 2024-09-12T17:36:31.839 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:36:31.703+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.7 2024-09-12T17:36:31.839 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:36:31.703+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.8 2024-09-12T17:36:31.839 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:36:31.703+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.9 2024-09-12T17:36:31.839 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:36:31.703+0000 7fdd0560b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.10 2024-09-12T17:36:31.839 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:36:31.707+0000 7fdd0560b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdd0560b9c0 time 2024-09-12T17:36:31.708761+0000 2024-09-12T17:36:31.839 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:36:31.840 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.840 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:36:31.840 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdd08ee52eb] 2024-09-12T17:36:31.840 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdd08ee549f] 2024-09-12T17:36:31.840 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0aae540c1] 2024-09-12T17:36:31.840 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55b0aae66467] 2024-09-12T17:36:31.840 INFO:tasks.workunit.client.0.smithi119.stderr: 5: main() 2024-09-12T17:36:31.840 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdd07d4bd90] 2024-09-12T17:36:31.840 INFO:tasks.workunit.client.0.smithi119.stderr: 7: __libc_start_main() 2024-09-12T17:36:31.840 INFO:tasks.workunit.client.0.smithi119.stderr: 8: _start() 2024-09-12T17:36:31.840 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.840 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:36:31.707+0000 7fdd0560b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:36:31.840 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fdd0560b9c0 thread_name:radosgw-admin 2024-09-12T17:36:31.841 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.841 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:36:31.841 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdd07d64520] 2024-09-12T17:36:31.841 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:36:31.841 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:36:31.841 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:36:31.841 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdd08ee5345] 2024-09-12T17:36:31.841 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdd08ee549f] 2024-09-12T17:36:31.841 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0aae540c1] 2024-09-12T17:36:31.841 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55b0aae66467] 2024-09-12T17:36:31.841 INFO:tasks.workunit.client.0.smithi119.stderr: 9: main() 2024-09-12T17:36:31.841 INFO:tasks.workunit.client.0.smithi119.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdd07d4bd90] 2024-09-12T17:36:31.841 INFO:tasks.workunit.client.0.smithi119.stderr: 11: __libc_start_main() 2024-09-12T17:36:31.841 INFO:tasks.workunit.client.0.smithi119.stderr: 12: _start() 2024-09-12T17:36:31.842 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:36:31.842 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:31.842 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:36:31.842 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:36:31.842 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:36:31.842 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:36:31.842 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:36:31.842 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:36:31.842 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:36:31.842 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:36:31.842 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:36:31.842 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:36:31.842 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:36:31.843 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:36:31.843 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:36:31.843 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:36:31.843 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:36:31.843 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:36:31.843 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:36:31.843 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:36:31.843 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:36:31.843 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:36:31.843 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:36:31.843 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:36:31.844 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:36:31.844 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:36:31.844 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:36:31.844 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:36:31.844 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:36:31.844 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:36:31.844 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:36:31.844 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:36:31.844 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:36:31.844 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:36:31.845 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:36:31.845 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:36:31.845 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:36:31.845 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:36:31.845 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:36:31.845 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:36:31.845 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:36:31.845 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:36:31.845 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:36:31.845 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:36:31.845 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:36:31.845 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:36:31.846 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:36:31.846 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:36:31.846 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:36:31.846 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:36:31.846 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:36:31.846 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:36:31.846 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:36:31.846 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:36:31.846 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:36:31.846 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:36:31.846 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:36:31.846 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:36:31.846 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:36:31.847 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:36:31.847 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:36:31.847 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:36:31.847 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:36:31.847 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:36:31.847 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:36:31.847 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:36:31.847 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:36:31.847 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:36:31.847 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:36:31.847 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:36:31.847 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:36:31.847 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:36:31.847 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:36:31.848 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:36:31.848 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:36:31.848 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:36:31.848 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:36:31.848 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:36:31.848 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:36:31.848 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:36:31.848 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:36:31.848 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:36:31.848 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:36:31.848 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:36:31.848 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:36:31.848 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:36:31.848 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:36:31.849 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:36:31.849 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:36:31.849 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:36:31.849 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:36:31.849 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:36:31.849 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:36:31.849 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:36:31.849 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:36:31.849 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:36:31.849 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdb327fc640 / http_manager 2024-09-12T17:36:31.849 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdbb8fe1640 / http_manager 2024-09-12T17:36:31.849 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdbb9fe3640 / rgw_dt_lg_renew 2024-09-12T17:36:31.849 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdbe57fa640 / ms_dispatch 2024-09-12T17:36:31.850 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdbe6ffd640 / io_context_pool 2024-09-12T17:36:31.850 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdbed602640 / ms_dispatch 2024-09-12T17:36:31.850 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdbefe07640 / ms_dispatch 2024-09-12T17:36:31.850 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdbf160a640 / io_context_pool 2024-09-12T17:36:31.850 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdd02910640 / msgr-worker-2 2024-09-12T17:36:31.850 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdd03111640 / msgr-worker-1 2024-09-12T17:36:31.850 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdd03912640 / msgr-worker-0 2024-09-12T17:36:31.850 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdd04113640 / io_context_pool 2024-09-12T17:36:31.850 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdd0560b9c0 / radosgw-admin 2024-09-12T17:36:31.850 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:36:31.850 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:36:31.850 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:36:31.710765Z_4c5bbe30-b8c4-4ef3-8ebe-1f320eb56af5/log 2024-09-12T17:36:31.850 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:36:31.852 INFO:tasks.workunit.client.0.smithi119.stderr:Aborted 2024-09-12T17:36:31.852 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:36:31.853 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:31.853 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:31.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.787+0000 7f7abb9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.791+0000 7f7abb9b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.791+0000 7f7abb9b69c0 20 realm 2024-09-12T17:36:31.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.791+0000 7f7abb9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.791+0000 7f7abb9b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.791+0000 7f7abb9b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:31.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.791+0000 7f7abb9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.791+0000 7f7abb9b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:31.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.791+0000 7f7abb9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.791+0000 7f7abb9b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:31.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.791+0000 7f7abb9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:31.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.795+0000 7f7abb9b69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:31.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.795+0000 7f7abb9b69c0 20 searching for the correct realm 2024-09-12T17:36:31.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.799+0000 7f7ab9cbd640 0 -- 172.21.15.119:0/1977421453 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55a973986610 msgr2=0x55a973988a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:31.854 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:31.803+0000 7f7ab8cbb640 0 -- 172.21.15.119:0/1977421453 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f7ab4090820 msgr2=0x7f7ab4061040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:32.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:36:32.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:36:32.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:32.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:32.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:32.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:32.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:32.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:32.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:32.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:32.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:32.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:32.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 zone default found 2024-09-12T17:36:32.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 4 Realm: () 2024-09-12T17:36:32.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:36:32.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:36:32.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:32.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 zonegroup default 2024-09-12T17:36:32.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:32.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:32.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.023+0000 7f7abb9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:32.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.027+0000 7f7abb9b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:32.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.027+0000 7f7abb9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:32.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.027+0000 7f7abb9b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:32.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.027+0000 7f7abb9b69c0 20 started sync module instance, tier type = 2024-09-12T17:36:32.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.027+0000 7f7abb9b69c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:36:32.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.051+0000 7f7abb9b69c0 20 add_watcher() i=0 2024-09-12T17:36:32.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.051+0000 7f7abb9b69c0 20 add_watcher() i=1 2024-09-12T17:36:32.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.051+0000 7f7abb9b69c0 20 add_watcher() i=2 2024-09-12T17:36:32.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.051+0000 7f7abb9b69c0 20 add_watcher() i=3 2024-09-12T17:36:32.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.051+0000 7f7abb9b69c0 20 add_watcher() i=4 2024-09-12T17:36:32.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.051+0000 7f7abb9b69c0 20 add_watcher() i=5 2024-09-12T17:36:32.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.051+0000 7f7abb9b69c0 20 add_watcher() i=6 2024-09-12T17:36:32.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.051+0000 7f7abb9b69c0 20 add_watcher() i=7 2024-09-12T17:36:32.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.051+0000 7f7abb9b69c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:32.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.055+0000 7f796ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:32.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.059+0000 7f7abb9b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:32.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.059+0000 7f7abb9b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:32.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.059+0000 7f7abb9b69c0 5 note: GC not initialized 2024-09-12T17:36:32.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.059+0000 7f796efe5640 20 reqs_thread_entry: start 2024-09-12T17:36:32.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.059+0000 7f7abb9b69c0 20 init_complete bucket index max shards: 11 2024-09-12T17:36:32.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.059+0000 7f7abb9b69c0 20 Filter name: none 2024-09-12T17:36:32.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.059+0000 7f796cfe1640 20 reqs_thread_entry: start 2024-09-12T17:36:32.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.059+0000 7f7abb9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:32.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.059+0000 7f7abb9b69c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:32.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.059+0000 7f7abb9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:32.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.059+0000 7f7abb9b69c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:36:32.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.059+0000 7f7abb9b69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:32.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.059+0000 7f7abb9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:32.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.063+0000 7f7abb9b69c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:32.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.063+0000 7f7abb9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:36:32.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.063+0000 7f7abb9b69c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:36:32.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.063+0000 7f7abb9b69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:32.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.063+0000 7f796ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:32.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.071+0000 7f7abb9b69c0 20 remove_watcher() i=0 2024-09-12T17:36:32.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.071+0000 7f7abb9b69c0 2 removed watcher, disabling cache 2024-09-12T17:36:32.071 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.071+0000 7f7abb9b69c0 20 remove_watcher() i=1 2024-09-12T17:36:32.074 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.075+0000 7f7abb9b69c0 20 remove_watcher() i=2 2024-09-12T17:36:32.076 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.075+0000 7f7abb9b69c0 20 remove_watcher() i=3 2024-09-12T17:36:32.078 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.079+0000 7f7abb9b69c0 20 remove_watcher() i=4 2024-09-12T17:36:32.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.079+0000 7f7abb9b69c0 20 remove_watcher() i=5 2024-09-12T17:36:32.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.083+0000 7f7abb9b69c0 20 remove_watcher() i=6 2024-09-12T17:36:32.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:36:32.083+0000 7f7abb9b69c0 20 remove_watcher() i=7 2024-09-12T17:36:32.100 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:36:32.100 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:36:32.100 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-commit-target-layout id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:36:32.100 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:02.548 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:37:02.584 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:02.585 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:02.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.630+0000 7f43810ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.634+0000 7f43810ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:02.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.634+0000 7f43810ee9c0 20 realm 2024-09-12T17:37:02.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.634+0000 7f43810ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.634+0000 7f43810ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:02.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.634+0000 7f43810ee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:02.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.634+0000 7f43810ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.634+0000 7f43810ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:02.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.634+0000 7f43810ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.634+0000 7f43810ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:02.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.634+0000 7f43810ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.634+0000 7f43810ee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:02.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.634+0000 7f43810ee9c0 20 searching for the correct realm 2024-09-12T17:37:02.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.642+0000 7f437e3f3640 0 -- 172.21.15.119:0/3239444038 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f43700de040 msgr2=0x7f43700ce410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:02.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.646+0000 7f437e3f3640 0 -- 172.21.15.119:0/3239444038 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f4378056040 msgr2=0x7f4378076a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:02.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.862+0000 7f43810ee9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:02.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.862+0000 7f43810ee9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:02.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.862+0000 7f43810ee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:02.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.862+0000 7f43810ee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:02.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.862+0000 7f43810ee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:02.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.862+0000 7f43810ee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:02.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.862+0000 7f43810ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.866+0000 7f43810ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:02.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.866+0000 7f43810ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.866+0000 7f43810ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:02.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.866+0000 7f43810ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.866+0000 7f43810ee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:02.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.866+0000 7f43810ee9c0 20 zone default found 2024-09-12T17:37:02.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.866+0000 7f43810ee9c0 4 Realm: () 2024-09-12T17:37:02.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.866+0000 7f43810ee9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:02.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.866+0000 7f43810ee9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:02.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.866+0000 7f43810ee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:02.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.866+0000 7f43810ee9c0 20 zonegroup default 2024-09-12T17:37:02.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.866+0000 7f43810ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.866+0000 7f43810ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:02.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.866+0000 7f43810ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.870+0000 7f43810ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:02.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.870+0000 7f43810ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.870+0000 7f43810ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:02.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.870+0000 7f43810ee9c0 20 started sync module instance, tier type = 2024-09-12T17:37:02.870 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.870+0000 7f43810ee9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:02.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.890+0000 7f43810ee9c0 20 add_watcher() i=0 2024-09-12T17:37:02.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.890+0000 7f43810ee9c0 20 add_watcher() i=1 2024-09-12T17:37:02.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.890+0000 7f43810ee9c0 20 add_watcher() i=2 2024-09-12T17:37:02.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.890+0000 7f43810ee9c0 20 add_watcher() i=3 2024-09-12T17:37:02.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.890+0000 7f43810ee9c0 20 add_watcher() i=4 2024-09-12T17:37:02.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.890+0000 7f43810ee9c0 20 add_watcher() i=5 2024-09-12T17:37:02.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.890+0000 7f43810ee9c0 20 add_watcher() i=6 2024-09-12T17:37:02.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.894+0000 7f43810ee9c0 20 add_watcher() i=7 2024-09-12T17:37:02.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.894+0000 7f43810ee9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:02.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.898+0000 7f4235fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:02.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.898+0000 7f43810ee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:02.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.898+0000 7f43810ee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:02.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.898+0000 7f43810ee9c0 5 note: GC not initialized 2024-09-12T17:37:02.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.898+0000 7f4234fe1640 20 reqs_thread_entry: start 2024-09-12T17:37:02.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.902+0000 7f43810ee9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:02.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.902+0000 7f43810ee9c0 20 Filter name: none 2024-09-12T17:37:02.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.902+0000 7f422dffb640 20 reqs_thread_entry: start 2024-09-12T17:37:02.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.902+0000 7f43810ee9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:37:02.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.902+0000 7f43810ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.902+0000 7f43810ee9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:37:02.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.902+0000 7f43810ee9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:37:02.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.902+0000 7f43810ee9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:37:02.902 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.902+0000 7f43810ee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 : miss 2024-09-12T17:37:02.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.902+0000 7f43810ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.902+0000 7f43810ee9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:37:02.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.902+0000 7f43810ee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:37:02.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.902+0000 7f43810ee9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:37:02.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.902+0000 7f43810ee9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:02.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.902+0000 7f43810ee9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:02.904 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.902+0000 7f43810ee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 2024-09-12T17:37:02.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.910+0000 7f43810ee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:37:02.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.910+0000 7f43810ee9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:37:02.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.910+0000 7f43810ee9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:02.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.910+0000 7f43810ee9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33, ofs0, ns] 2024-09-12T17:37:02.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.910+0000 7f42627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333504 cookie 94078364268720 notifier 7004 bl.length()=1015 2024-09-12T17:37:02.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.910+0000 7f42627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:37:02.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.910+0000 7f42627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:37:02.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.910+0000 7f42627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:02.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.914+0000 7f43810ee9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_sources= new_sources= 2024-09-12T17:37:02.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.914+0000 7f43810ee9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential sources added=[] removed=[] 2024-09-12T17:37:02.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.914+0000 7f43810ee9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_dests= new_dests= 2024-09-12T17:37:02.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.914+0000 7f43810ee9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential dests added=[] removed=[] 2024-09-12T17:37:02.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.0 2024-09-12T17:37:02.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.0 2024-09-12T17:37:02.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.1 2024-09-12T17:37:02.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.1 2024-09-12T17:37:02.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.2 2024-09-12T17:37:02.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.2 2024-09-12T17:37:02.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.3 2024-09-12T17:37:02.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.3 2024-09-12T17:37:02.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.4 2024-09-12T17:37:02.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.4 2024-09-12T17:37:02.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.5 2024-09-12T17:37:02.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.5 2024-09-12T17:37:02.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.6 2024-09-12T17:37:02.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.6 2024-09-12T17:37:02.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.7 2024-09-12T17:37:02.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.7 2024-09-12T17:37:02.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.8 2024-09-12T17:37:02.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.8 2024-09-12T17:37:02.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.9 2024-09-12T17:37:02.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.9 2024-09-12T17:37:02.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.10 2024-09-12T17:37:02.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.10 2024-09-12T17:37:02.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.11 2024-09-12T17:37:02.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1.11 2024-09-12T17:37:02.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.0 2024-09-12T17:37:02.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.926+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1 2024-09-12T17:37:02.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.930+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.2 2024-09-12T17:37:02.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.930+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.3 2024-09-12T17:37:02.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.930+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.4 2024-09-12T17:37:02.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.930+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.5 2024-09-12T17:37:02.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.930+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.6 2024-09-12T17:37:02.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.934+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.7 2024-09-12T17:37:02.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.934+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.8 2024-09-12T17:37:02.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.934+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.9 2024-09-12T17:37:02.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.938+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.10 2024-09-12T17:37:02.944 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.942+0000 7f43810ee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:37:02.944 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.942+0000 7f43810ee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 2024-09-12T17:37:02.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.946+0000 7f43810ee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:37:02.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.946+0000 7f43810ee9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:37:02.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.946+0000 7f43810ee9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:02.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.946+0000 7f43810ee9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33, ofs0, ns] 2024-09-12T17:37:02.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.946+0000 7f4261ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333505 cookie 94078364268720 notifier 7004 bl.length()=1015 2024-09-12T17:37:02.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.946+0000 7f4261ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:37:02.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.946+0000 7f4261ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:37:02.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.946+0000 7f4261ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:02.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.950+0000 7f43810ee9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_sources= new_sources= 2024-09-12T17:37:02.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.950+0000 7f43810ee9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential sources added=[] removed=[] 2024-09-12T17:37:02.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.950+0000 7f43810ee9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_dests= new_dests= 2024-09-12T17:37:02.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.950+0000 7f43810ee9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential dests added=[] removed=[] 2024-09-12T17:37:02.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.954+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.0 2024-09-12T17:37:02.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.954+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.1 2024-09-12T17:37:02.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.954+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.2 2024-09-12T17:37:02.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.958+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.3 2024-09-12T17:37:02.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.958+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.4 2024-09-12T17:37:02.958 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.958+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.5 2024-09-12T17:37:02.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.958+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.6 2024-09-12T17:37:02.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.958+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.7 2024-09-12T17:37:02.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.958+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.8 2024-09-12T17:37:02.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.962+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.9 2024-09-12T17:37:02.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.962+0000 7f43810ee9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33.10 2024-09-12T17:37:02.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.962+0000 7f43810ee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:37:02.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.962+0000 7f43810ee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 2024-09-12T17:37:02.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.962+0000 7f43810ee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:37:02.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.962+0000 7f43810ee9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:37:02.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.962+0000 7f43810ee9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:02.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.962+0000 7f43810ee9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33, ofs0, ns] 2024-09-12T17:37:02.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.966+0000 7f4261ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333506 cookie 94078364268720 notifier 7004 bl.length()=983 2024-09-12T17:37:02.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.966+0000 7f4261ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 info.flags=0x17 2024-09-12T17:37:02.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.966+0000 7f4261ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 to cache LRU end 2024-09-12T17:37:02.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.966+0000 7f4261ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:02.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.966+0000 7f43810ee9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_sources= new_sources= 2024-09-12T17:37:02.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.966+0000 7f43810ee9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential sources added=[] removed=[] 2024-09-12T17:37:02.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.966+0000 7f43810ee9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): orig_dests= new_dests= 2024-09-12T17:37:02.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.966+0000 7f43810ee9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33]): potential dests added=[] removed=[] 2024-09-12T17:37:02.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.974+0000 7f43810ee9c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:37:02.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.974+0000 7f4235fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:02.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.978+0000 7f43810ee9c0 20 remove_watcher() i=0 2024-09-12T17:37:02.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.978+0000 7f43810ee9c0 2 removed watcher, disabling cache 2024-09-12T17:37:02.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.982+0000 7f43810ee9c0 20 remove_watcher() i=1 2024-09-12T17:37:02.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.986+0000 7f43810ee9c0 20 remove_watcher() i=2 2024-09-12T17:37:02.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.986+0000 7f43810ee9c0 20 remove_watcher() i=3 2024-09-12T17:37:02.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.990+0000 7f43810ee9c0 20 remove_watcher() i=4 2024-09-12T17:37:02.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.990+0000 7f43810ee9c0 20 remove_watcher() i=5 2024-09-12T17:37:02.993 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.994+0000 7f43810ee9c0 20 remove_watcher() i=6 2024-09-12T17:37:02.994 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:02.994+0000 7f43810ee9c0 20 remove_watcher() i=7 2024-09-12T17:37:03.009 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:37:03.040 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:03.041 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:03.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.086+0000 7fcb61a369c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:03.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.086+0000 7fcb61a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:03.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.086+0000 7fcb61a369c0 20 realm 2024-09-12T17:37:03.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.086+0000 7fcb61a369c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:03.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.086+0000 7fcb61a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:03.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.086+0000 7fcb61a369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:03.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.086+0000 7fcb61a369c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:03.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.086+0000 7fcb61a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:03.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.086+0000 7fcb61a369c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:03.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.090+0000 7fcb61a369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:03.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.090+0000 7fcb61a369c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:03.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.090+0000 7fcb61a369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:03.092 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.090+0000 7fcb61a369c0 20 searching for the correct realm 2024-09-12T17:37:03.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.094+0000 7fcb57fff640 0 -- 172.21.15.119:0/1720911973 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fcb5010eb90 msgr2=0x7fcb500f7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:03.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.102+0000 7fcb57fff640 0 -- 172.21.15.119:0/1720911973 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fcb5803eb00 msgr2=0x7fcb58033920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:03.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.318+0000 7fcb61a369c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:03.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.318+0000 7fcb61a369c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:03.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.318+0000 7fcb61a369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:03.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.318+0000 7fcb61a369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:03.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.318+0000 7fcb61a369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:03.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.318+0000 7fcb61a369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:03.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.318+0000 7fcb61a369c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:03.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.318+0000 7fcb61a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:03.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.318+0000 7fcb61a369c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:03.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:03.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:03.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:03.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 20 zone default found 2024-09-12T17:37:03.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 4 Realm: () 2024-09-12T17:37:03.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:03.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:03.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:03.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 20 zonegroup default 2024-09-12T17:37:03.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:03.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:03.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:03.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:03.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:03.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:03.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 20 started sync module instance, tier type = 2024-09-12T17:37:03.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.322+0000 7fcb61a369c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:03.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.346+0000 7fcb61a369c0 20 add_watcher() i=0 2024-09-12T17:37:03.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.346+0000 7fcb61a369c0 20 add_watcher() i=1 2024-09-12T17:37:03.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.346+0000 7fcb61a369c0 20 add_watcher() i=2 2024-09-12T17:37:03.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.346+0000 7fcb61a369c0 20 add_watcher() i=3 2024-09-12T17:37:03.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.346+0000 7fcb61a369c0 20 add_watcher() i=4 2024-09-12T17:37:03.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.346+0000 7fcb61a369c0 20 add_watcher() i=5 2024-09-12T17:37:03.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.346+0000 7fcb61a369c0 20 add_watcher() i=6 2024-09-12T17:37:03.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.350+0000 7fcb61a369c0 20 add_watcher() i=7 2024-09-12T17:37:03.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.350+0000 7fcb61a369c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:03.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.354+0000 7fca15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:03.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.354+0000 7fcb61a369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:03.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.354+0000 7fcb61a369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:03.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.354+0000 7fcb61a369c0 5 note: GC not initialized 2024-09-12T17:37:03.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.354+0000 7fca14fe1640 20 reqs_thread_entry: start 2024-09-12T17:37:03.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.358+0000 7fcb61a369c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:03.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.358+0000 7fcb61a369c0 20 Filter name: none 2024-09-12T17:37:03.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.358+0000 7fc98e7fc640 20 reqs_thread_entry: start 2024-09-12T17:37:03.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.358+0000 7fcb61a369c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:03.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.358+0000 7fcb61a369c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:37:03.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.358+0000 7fcb61a369c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:03.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.358+0000 7fcb61a369c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:37:03.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.358+0000 7fcb61a369c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:03.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.358+0000 7fcb61a369c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:03.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.358+0000 7fcb61a369c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:37:03.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.358+0000 7fcb61a369c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:03.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.358+0000 7fcb61a369c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:37:03.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.358+0000 7fcb61a369c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:03.363 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.362+0000 7fca15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:03.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.366+0000 7fcb61a369c0 20 remove_watcher() i=0 2024-09-12T17:37:03.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.366+0000 7fcb61a369c0 2 removed watcher, disabling cache 2024-09-12T17:37:03.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.370+0000 7fcb61a369c0 20 remove_watcher() i=1 2024-09-12T17:37:03.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.374+0000 7fcb61a369c0 20 remove_watcher() i=2 2024-09-12T17:37:03.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.374+0000 7fcb61a369c0 20 remove_watcher() i=3 2024-09-12T17:37:03.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.378+0000 7fcb61a369c0 20 remove_watcher() i=4 2024-09-12T17:37:03.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.378+0000 7fcb61a369c0 20 remove_watcher() i=5 2024-09-12T17:37:03.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.382+0000 7fcb61a369c0 20 remove_watcher() i=6 2024-09-12T17:37:03.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:03.382+0000 7fcb61a369c0 20 remove_watcher() i=7 2024-09-12T17:37:03.398 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:03.398 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:37:03.398 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-commit-target-layout id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:37:03.398 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:04.440 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T17:37:04.440 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:06.693 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:37:06.722 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:06.722 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:06.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:06.770+0000 7fc1320ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:06.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:06.770+0000 7fc1320ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:06.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:06.770+0000 7fc1320ad9c0 20 realm 2024-09-12T17:37:06.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:06.770+0000 7fc1320ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:06.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:06.770+0000 7fc1320ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:06.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:06.770+0000 7fc1320ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:06.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:06.770+0000 7fc1320ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:06.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:06.770+0000 7fc1320ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:06.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:06.770+0000 7fc1320ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:06.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:06.774+0000 7fc1320ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:06.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:06.774+0000 7fc1320ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:06.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:06.774+0000 7fc1320ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:06.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:06.774+0000 7fc1320ad9c0 20 searching for the correct realm 2024-09-12T17:37:06.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:06.778+0000 7fc1303b4640 0 -- 172.21.15.119:0/316294205 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x5654e03cae50 msgr2=0x5654e03cd240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:06.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:06.786+0000 7fc12f3b2640 0 -- 172.21.15.119:0/316294205 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fc120071100 msgr2=0x7fc120094780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:07.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.002+0000 7fc1320ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:07.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.002+0000 7fc1320ad9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:07.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.002+0000 7fc1320ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:07.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.002+0000 7fc1320ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:07.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.002+0000 7fc1320ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:07.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.002+0000 7fc1320ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:07.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.002+0000 7fc1320ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.002+0000 7fc1320ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:07.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.002+0000 7fc1320ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:07.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:07.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 20 zone default found 2024-09-12T17:37:07.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 4 Realm: () 2024-09-12T17:37:07.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:07.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:07.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:07.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 20 zonegroup default 2024-09-12T17:37:07.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:07.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:07.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:07.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 20 started sync module instance, tier type = 2024-09-12T17:37:07.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.006+0000 7fc1320ad9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:07.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.030+0000 7fc1320ad9c0 20 add_watcher() i=0 2024-09-12T17:37:07.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.030+0000 7fc1320ad9c0 20 add_watcher() i=1 2024-09-12T17:37:07.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.030+0000 7fc1320ad9c0 20 add_watcher() i=2 2024-09-12T17:37:07.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.030+0000 7fc1320ad9c0 20 add_watcher() i=3 2024-09-12T17:37:07.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.030+0000 7fc1320ad9c0 20 add_watcher() i=4 2024-09-12T17:37:07.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.030+0000 7fc1320ad9c0 20 add_watcher() i=5 2024-09-12T17:37:07.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.030+0000 7fc1320ad9c0 20 add_watcher() i=6 2024-09-12T17:37:07.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.034+0000 7fc1320ad9c0 20 add_watcher() i=7 2024-09-12T17:37:07.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.034+0000 7fc1320ad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:07.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.038+0000 7fbfe5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:07.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.038+0000 7fc1320ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:07.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.038+0000 7fc1320ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:07.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.038+0000 7fc1320ad9c0 5 note: GC not initialized 2024-09-12T17:37:07.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.038+0000 7fbfe4fe1640 20 reqs_thread_entry: start 2024-09-12T17:37:07.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.042+0000 7fc1320ad9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:07.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.042+0000 7fc1320ad9c0 20 Filter name: none 2024-09-12T17:37:07.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.042+0000 7fbf5e7fc640 20 reqs_thread_entry: start 2024-09-12T17:37:07.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.042+0000 7fc1320ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.042+0000 7fc1320ad9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:07.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.042+0000 7fc1320ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.042+0000 7fc1320ad9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:37:07.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.042+0000 7fc1320ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:07.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.042+0000 7fc1320ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.042+0000 7fc1320ad9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:07.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.042+0000 7fc1320ad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.042+0000 7fc1320ad9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:37:07.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.042+0000 7fc1320ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:07.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.046+0000 7fbfe5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:07.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.054+0000 7fc1320ad9c0 20 remove_watcher() i=0 2024-09-12T17:37:07.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.054+0000 7fc1320ad9c0 2 removed watcher, disabling cache 2024-09-12T17:37:07.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.054+0000 7fc1320ad9c0 20 remove_watcher() i=1 2024-09-12T17:37:07.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.058+0000 7fc1320ad9c0 20 remove_watcher() i=2 2024-09-12T17:37:07.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.058+0000 7fc1320ad9c0 20 remove_watcher() i=3 2024-09-12T17:37:07.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.062+0000 7fc1320ad9c0 20 remove_watcher() i=4 2024-09-12T17:37:07.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.066+0000 7fc1320ad9c0 20 remove_watcher() i=5 2024-09-12T17:37:07.067 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.066+0000 7fc1320ad9c0 20 remove_watcher() i=6 2024-09-12T17:37:07.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.070+0000 7fc1320ad9c0 20 remove_watcher() i=7 2024-09-12T17:37:07.094 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:07.094 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:37:07.094 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-do-reshard id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:37:07.094 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:07.094 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T17:37:07.132 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:07.132 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:07.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.178+0000 7f8f2b8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.178+0000 7f8f2b8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:07.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.178+0000 7f8f2b8189c0 20 realm 2024-09-12T17:37:07.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.178+0000 7f8f2b8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.178+0000 7f8f2b8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:07.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.178+0000 7f8f2b8189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:07.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.178+0000 7f8f2b8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.178+0000 7f8f2b8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:07.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.178+0000 7f8f2b8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.182+0000 7f8f2b8189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:07.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.182+0000 7f8f2b8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.182+0000 7f8f2b8189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:07.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.182+0000 7f8f2b8189c0 20 searching for the correct realm 2024-09-12T17:37:07.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.186+0000 7f8f29b1f640 0 -- 172.21.15.119:0/748706764 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f8f20008030 msgr2=0x7f8f20091ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:07.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.402+0000 7f8f28b1d640 0 -- 172.21.15.119:0/748706764 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f8f24056410 msgr2=0x7f8f24056870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:07.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.618+0000 7f8f2b8189c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:07.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.618+0000 7f8f2b8189c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:07.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.618+0000 7f8f2b8189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:07.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.618+0000 7f8f2b8189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:07.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.618+0000 7f8f2b8189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:07.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.618+0000 7f8f2b8189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:07.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.618+0000 7f8f2b8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.618+0000 7f8f2b8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:07.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.618+0000 7f8f2b8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:07.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:07.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 20 zone default found 2024-09-12T17:37:07.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 4 Realm: () 2024-09-12T17:37:07.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:07.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:07.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:07.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 20 zonegroup default 2024-09-12T17:37:07.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:07.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:07.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:07.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 20 started sync module instance, tier type = 2024-09-12T17:37:07.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.622+0000 7f8f2b8189c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:07.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.646+0000 7f8f2b8189c0 20 add_watcher() i=0 2024-09-12T17:37:07.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.646+0000 7f8f2b8189c0 20 add_watcher() i=1 2024-09-12T17:37:07.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.646+0000 7f8f2b8189c0 20 add_watcher() i=2 2024-09-12T17:37:07.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.646+0000 7f8f2b8189c0 20 add_watcher() i=3 2024-09-12T17:37:07.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.646+0000 7f8f2b8189c0 20 add_watcher() i=4 2024-09-12T17:37:07.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.646+0000 7f8f2b8189c0 20 add_watcher() i=5 2024-09-12T17:37:07.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.646+0000 7f8f2b8189c0 20 add_watcher() i=6 2024-09-12T17:37:07.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.650+0000 7f8f2b8189c0 20 add_watcher() i=7 2024-09-12T17:37:07.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.650+0000 7f8f2b8189c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:07.653 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8ddf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:07.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:07.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:07.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 5 note: GC not initialized 2024-09-12T17:37:07.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8dde7e4640 20 reqs_thread_entry: start 2024-09-12T17:37:07.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:07.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 20 Filter name: none 2024-09-12T17:37:07.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8d4ffff640 20 reqs_thread_entry: start 2024-09-12T17:37:07.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:37:07.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:07.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:37:07.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:37:07.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 : miss 2024-09-12T17:37:07.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:07.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:37:07.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 info.flags=0x17 2024-09-12T17:37:07.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 to cache LRU end 2024-09-12T17:37:07.658 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:07.658 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.654+0000 7f8f2b8189c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:07.658 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.658+0000 7f8f2b8189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 2024-09-12T17:37:07.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.666+0000 7f8f2b8189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 info.flags=0x17 2024-09-12T17:37:07.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.666+0000 7f8f2b8189c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 to cache LRU end 2024-09-12T17:37:07.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.666+0000 7f8f2b8189c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:07.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.666+0000 7f8f2b8189c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34, ofs0, ns] 2024-09-12T17:37:07.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.666+0000 7f8e0cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333512 cookie 94554382292800 notifier 7479 bl.length()=995 2024-09-12T17:37:07.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.666+0000 7f8e0cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 info.flags=0x17 2024-09-12T17:37:07.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.666+0000 7f8e0cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 to cache LRU end 2024-09-12T17:37:07.668 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.666+0000 7f8e0cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:07.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.670+0000 7f8f2b8189c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): orig_sources= new_sources= 2024-09-12T17:37:07.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.670+0000 7f8f2b8189c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): potential sources added=[] removed=[] 2024-09-12T17:37:07.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.670+0000 7f8f2b8189c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): orig_dests= new_dests= 2024-09-12T17:37:07.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.670+0000 7f8f2b8189c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): potential dests added=[] removed=[] 2024-09-12T17:37:07.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.682+0000 7f8f2b8189c0 -1 Injecting error=-5 at location=do_reshard 2024-09-12T17:37:07.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.702+0000 7f8f2b8189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:37:07.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.702+0000 7f8f2b8189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 2024-09-12T17:37:07.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.702+0000 7f8f2b8189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 info.flags=0x17 2024-09-12T17:37:07.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.702+0000 7f8f2b8189c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 to cache LRU end 2024-09-12T17:37:07.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.702+0000 7f8f2b8189c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:07.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.702+0000 7f8f2b8189c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34, ofs0, ns] 2024-09-12T17:37:07.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.702+0000 7f8dfbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333513 cookie 94554382292800 notifier 7479 bl.length()=963 2024-09-12T17:37:07.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.702+0000 7f8dfbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 info.flags=0x17 2024-09-12T17:37:07.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.702+0000 7f8dfbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 to cache LRU end 2024-09-12T17:37:07.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.702+0000 7f8dfbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:07.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.706+0000 7f8f2b8189c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): orig_sources= new_sources= 2024-09-12T17:37:07.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.706+0000 7f8f2b8189c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): potential sources added=[] removed=[] 2024-09-12T17:37:07.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.706+0000 7f8f2b8189c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): orig_dests= new_dests= 2024-09-12T17:37:07.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.706+0000 7f8f2b8189c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): potential dests added=[] removed=[] 2024-09-12T17:37:07.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.706+0000 7f8f2b8189c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T17:37:07.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.710+0000 7f8ddf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:07.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.714+0000 7f8f2b8189c0 20 remove_watcher() i=0 2024-09-12T17:37:07.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.714+0000 7f8f2b8189c0 2 removed watcher, disabling cache 2024-09-12T17:37:07.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.714+0000 7f8f2b8189c0 20 remove_watcher() i=1 2024-09-12T17:37:07.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.718+0000 7f8f2b8189c0 20 remove_watcher() i=2 2024-09-12T17:37:07.720 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.718+0000 7f8f2b8189c0 20 remove_watcher() i=3 2024-09-12T17:37:07.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.722+0000 7f8f2b8189c0 20 remove_watcher() i=4 2024-09-12T17:37:07.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.722+0000 7f8f2b8189c0 20 remove_watcher() i=5 2024-09-12T17:37:07.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.726+0000 7f8f2b8189c0 20 remove_watcher() i=6 2024-09-12T17:37:07.727 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:07.726+0000 7f8f2b8189c0 20 remove_watcher() i=7 2024-09-12T17:37:07.741 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:37:07.768 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:07.768 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:08.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.018+0000 7fc23534a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.022+0000 7fc23534a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:08.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.022+0000 7fc23534a9c0 20 realm 2024-09-12T17:37:08.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.022+0000 7fc23534a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.022+0000 7fc23534a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:08.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.022+0000 7fc23534a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:08.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.022+0000 7fc23534a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.022+0000 7fc23534a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:08.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.022+0000 7fc23534a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.022+0000 7fc23534a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:08.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.022+0000 7fc23534a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.026+0000 7fc23534a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:08.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.026+0000 7fc23534a9c0 20 searching for the correct realm 2024-09-12T17:37:08.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.026+0000 7fc233651640 0 -- 172.21.15.119:0/2035345084 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fc2280d1030 msgr2=0x7fc2280fcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:08.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.242+0000 7fc23264f640 0 -- 172.21.15.119:0/2035345084 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fc22c02b070 msgr2=0x7fc22c0667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:08.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.458+0000 7fc23534a9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:08.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.458+0000 7fc23534a9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:08.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.458+0000 7fc23534a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:08.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.458+0000 7fc23534a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:08.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.458+0000 7fc23534a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:08.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.458+0000 7fc23534a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:08.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.458+0000 7fc23534a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.458+0000 7fc23534a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:08.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.458+0000 7fc23534a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.458+0000 7fc23534a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:08.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.458+0000 7fc23534a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.462+0000 7fc23534a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:08.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.462+0000 7fc23534a9c0 20 zone default found 2024-09-12T17:37:08.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.462+0000 7fc23534a9c0 4 Realm: () 2024-09-12T17:37:08.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.462+0000 7fc23534a9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:08.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.462+0000 7fc23534a9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:08.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.462+0000 7fc23534a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:08.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.462+0000 7fc23534a9c0 20 zonegroup default 2024-09-12T17:37:08.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.462+0000 7fc23534a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.462+0000 7fc23534a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:08.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.462+0000 7fc23534a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.462+0000 7fc23534a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:08.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.462+0000 7fc23534a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.462+0000 7fc23534a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:08.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.462+0000 7fc23534a9c0 20 started sync module instance, tier type = 2024-09-12T17:37:08.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.462+0000 7fc23534a9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:08.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.486+0000 7fc23534a9c0 20 add_watcher() i=0 2024-09-12T17:37:08.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.486+0000 7fc23534a9c0 20 add_watcher() i=1 2024-09-12T17:37:08.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.486+0000 7fc23534a9c0 20 add_watcher() i=2 2024-09-12T17:37:08.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.486+0000 7fc23534a9c0 20 add_watcher() i=3 2024-09-12T17:37:08.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.486+0000 7fc23534a9c0 20 add_watcher() i=4 2024-09-12T17:37:08.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.486+0000 7fc23534a9c0 20 add_watcher() i=5 2024-09-12T17:37:08.489 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.486+0000 7fc23534a9c0 20 add_watcher() i=6 2024-09-12T17:37:08.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.490+0000 7fc23534a9c0 20 add_watcher() i=7 2024-09-12T17:37:08.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.490+0000 7fc23534a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:08.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.494+0000 7fc0e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:08.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.494+0000 7fc23534a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:08.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.494+0000 7fc23534a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:08.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.494+0000 7fc23534a9c0 5 note: GC not initialized 2024-09-12T17:37:08.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.494+0000 7fc063fff640 20 reqs_thread_entry: start 2024-09-12T17:37:08.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.494+0000 7fc23534a9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:08.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.494+0000 7fc23534a9c0 20 Filter name: none 2024-09-12T17:37:08.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.494+0000 7fc061ffb640 20 reqs_thread_entry: start 2024-09-12T17:37:08.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.494+0000 7fc23534a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.498+0000 7fc23534a9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:08.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.498+0000 7fc23534a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.498+0000 7fc23534a9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:37:08.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.498+0000 7fc23534a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:08.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.498+0000 7fc23534a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.498+0000 7fc23534a9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:08.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.498+0000 7fc23534a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.498+0000 7fc23534a9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:37:08.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.498+0000 7fc23534a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:08.502 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.502+0000 7fc0e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:08.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.506+0000 7fc23534a9c0 20 remove_watcher() i=0 2024-09-12T17:37:08.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.506+0000 7fc23534a9c0 2 removed watcher, disabling cache 2024-09-12T17:37:08.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.510+0000 7fc23534a9c0 20 remove_watcher() i=1 2024-09-12T17:37:08.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.510+0000 7fc23534a9c0 20 remove_watcher() i=2 2024-09-12T17:37:08.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.514+0000 7fc23534a9c0 20 remove_watcher() i=3 2024-09-12T17:37:08.516 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.514+0000 7fc23534a9c0 20 remove_watcher() i=4 2024-09-12T17:37:08.517 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.518+0000 7fc23534a9c0 20 remove_watcher() i=5 2024-09-12T17:37:08.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.518+0000 7fc23534a9c0 20 remove_watcher() i=6 2024-09-12T17:37:08.521 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.518+0000 7fc23534a9c0 20 remove_watcher() i=7 2024-09-12T17:37:08.540 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:08.540 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:37:08.540 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-do-reshard id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:37:08.540 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:08.667 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:37:08.702 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:08.702 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:08.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.750+0000 7f5639c659c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.750+0000 7f5639c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:08.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.750+0000 7f5639c659c0 20 realm 2024-09-12T17:37:08.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.750+0000 7f5639c659c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.750+0000 7f5639c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:08.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.750+0000 7f5639c659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:08.752 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.750+0000 7f5639c659c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.753 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.750+0000 7f5639c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:08.753 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.750+0000 7f5639c659c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.754+0000 7f5639c659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:08.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.754+0000 7f5639c659c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:08.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.754+0000 7f5639c659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:08.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.754+0000 7f5639c659c0 20 searching for the correct realm 2024-09-12T17:37:08.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.758+0000 7f5637f6c640 0 -- 172.21.15.119:0/3390135063 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f562c0553c0 msgr2=0x7f562c08aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:08.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:08.974+0000 7f5636f6a640 0 -- 172.21.15.119:0/3390135063 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f5630120240 msgr2=0x7f56300e09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:09.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:09.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:09.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:09.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:09.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:09.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:09.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:09.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:09.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:09.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 zone default found 2024-09-12T17:37:09.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 4 Realm: () 2024-09-12T17:37:09.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:09.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:09.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:09.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 zonegroup default 2024-09-12T17:37:09.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:09.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.194+0000 7f5639c659c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.198+0000 7f5639c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:09.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.198+0000 7f5639c659c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.198+0000 7f5639c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:09.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.198+0000 7f5639c659c0 20 started sync module instance, tier type = 2024-09-12T17:37:09.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.198+0000 7f5639c659c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:09.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.222+0000 7f5639c659c0 20 add_watcher() i=0 2024-09-12T17:37:09.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.222+0000 7f5639c659c0 20 add_watcher() i=1 2024-09-12T17:37:09.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.222+0000 7f5639c659c0 20 add_watcher() i=2 2024-09-12T17:37:09.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.222+0000 7f5639c659c0 20 add_watcher() i=3 2024-09-12T17:37:09.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.222+0000 7f5639c659c0 20 add_watcher() i=4 2024-09-12T17:37:09.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.222+0000 7f5639c659c0 20 add_watcher() i=5 2024-09-12T17:37:09.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.222+0000 7f5639c659c0 20 add_watcher() i=6 2024-09-12T17:37:09.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.222+0000 7f5639c659c0 20 add_watcher() i=7 2024-09-12T17:37:09.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.222+0000 7f5639c659c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:09.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.226+0000 7f54edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:09.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:09.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:09.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 5 note: GC not initialized 2024-09-12T17:37:09.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f54ecfe1640 20 reqs_thread_entry: start 2024-09-12T17:37:09.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:09.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 20 Filter name: none 2024-09-12T17:37:09.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f54667fc640 20 reqs_thread_entry: start 2024-09-12T17:37:09.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:37:09.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:09.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:37:09.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:37:09.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 : miss 2024-09-12T17:37:09.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:37:09.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 info.flags=0x17 2024-09-12T17:37:09.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 to cache LRU end 2024-09-12T17:37:09.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:09.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:09.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.230+0000 7f5639c659c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 2024-09-12T17:37:09.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.238+0000 7f5639c659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 info.flags=0x17 2024-09-12T17:37:09.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.238+0000 7f5639c659c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 to cache LRU end 2024-09-12T17:37:09.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.238+0000 7f5639c659c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:09.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.238+0000 7f5639c659c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34, ofs0, ns] 2024-09-12T17:37:09.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.242+0000 7f551a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333514 cookie 94112606114064 notifier 7088 bl.length()=995 2024-09-12T17:37:09.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.242+0000 7f551a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 info.flags=0x17 2024-09-12T17:37:09.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.242+0000 7f551a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 to cache LRU end 2024-09-12T17:37:09.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.242+0000 7f551a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:09.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.242+0000 7f5639c659c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): orig_sources= new_sources= 2024-09-12T17:37:09.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.242+0000 7f5639c659c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): potential sources added=[] removed=[] 2024-09-12T17:37:09.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.242+0000 7f5639c659c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): orig_dests= new_dests= 2024-09-12T17:37:09.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.242+0000 7f5639c659c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): potential dests added=[] removed=[] 2024-09-12T17:37:09.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.0 2024-09-12T17:37:09.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.0 2024-09-12T17:37:09.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.1 2024-09-12T17:37:09.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.1 2024-09-12T17:37:09.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.2 2024-09-12T17:37:09.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.2 2024-09-12T17:37:09.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.3 2024-09-12T17:37:09.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.3 2024-09-12T17:37:09.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.4 2024-09-12T17:37:09.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.4 2024-09-12T17:37:09.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.5 2024-09-12T17:37:09.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.5 2024-09-12T17:37:09.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.6 2024-09-12T17:37:09.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.6 2024-09-12T17:37:09.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.7 2024-09-12T17:37:09.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.7 2024-09-12T17:37:09.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.8 2024-09-12T17:37:09.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.8 2024-09-12T17:37:09.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.9 2024-09-12T17:37:09.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.9 2024-09-12T17:37:09.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.10 2024-09-12T17:37:09.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.10 2024-09-12T17:37:09.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.11 2024-09-12T17:37:09.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1.11 2024-09-12T17:37:09.257 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.0 2024-09-12T17:37:09.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.254+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1 2024-09-12T17:37:09.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.258+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.2 2024-09-12T17:37:09.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.258+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.3 2024-09-12T17:37:09.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.258+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.4 2024-09-12T17:37:09.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.258+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.5 2024-09-12T17:37:09.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.262+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.6 2024-09-12T17:37:09.262 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.262+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.7 2024-09-12T17:37:09.263 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.262+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.8 2024-09-12T17:37:09.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.262+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.9 2024-09-12T17:37:09.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.262+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.10 2024-09-12T17:37:09.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.270+0000 7f5639c659c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:37:09.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.270+0000 7f5639c659c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 2024-09-12T17:37:09.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.274+0000 7f5639c659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 info.flags=0x17 2024-09-12T17:37:09.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.274+0000 7f5639c659c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 to cache LRU end 2024-09-12T17:37:09.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.274+0000 7f5639c659c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:09.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.274+0000 7f5639c659c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34, ofs0, ns] 2024-09-12T17:37:09.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.274+0000 7f551affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333515 cookie 94112606114064 notifier 7088 bl.length()=995 2024-09-12T17:37:09.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.274+0000 7f551affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 info.flags=0x17 2024-09-12T17:37:09.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.274+0000 7f551affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 to cache LRU end 2024-09-12T17:37:09.275 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.274+0000 7f551affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:09.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.274+0000 7f5639c659c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): orig_sources= new_sources= 2024-09-12T17:37:09.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.274+0000 7f5639c659c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): potential sources added=[] removed=[] 2024-09-12T17:37:09.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.274+0000 7f5639c659c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): orig_dests= new_dests= 2024-09-12T17:37:09.276 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.274+0000 7f5639c659c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): potential dests added=[] removed=[] 2024-09-12T17:37:09.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.282+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.0 2024-09-12T17:37:09.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.282+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.1 2024-09-12T17:37:09.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.282+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.2 2024-09-12T17:37:09.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.282+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.3 2024-09-12T17:37:09.284 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.282+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.4 2024-09-12T17:37:09.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.286+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.5 2024-09-12T17:37:09.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.286+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.6 2024-09-12T17:37:09.286 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.286+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.7 2024-09-12T17:37:09.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.286+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.8 2024-09-12T17:37:09.288 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.286+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.9 2024-09-12T17:37:09.289 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.286+0000 7f5639c659c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34.10 2024-09-12T17:37:09.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.290+0000 7f5639c659c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:37:09.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.290+0000 7f5639c659c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 2024-09-12T17:37:09.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.290+0000 7f5639c659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 info.flags=0x17 2024-09-12T17:37:09.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.290+0000 7f5639c659c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 to cache LRU end 2024-09-12T17:37:09.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.290+0000 7f5639c659c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:09.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.290+0000 7f5639c659c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34, ofs0, ns] 2024-09-12T17:37:09.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.290+0000 7f551affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333516 cookie 94112606114064 notifier 7088 bl.length()=963 2024-09-12T17:37:09.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.290+0000 7f551affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 info.flags=0x17 2024-09-12T17:37:09.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.290+0000 7f551affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 to cache LRU end 2024-09-12T17:37:09.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.290+0000 7f551affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:09.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.294+0000 7f5639c659c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): orig_sources= new_sources= 2024-09-12T17:37:09.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.294+0000 7f5639c659c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): potential sources added=[] removed=[] 2024-09-12T17:37:09.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.294+0000 7f5639c659c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): orig_dests= new_dests= 2024-09-12T17:37:09.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.294+0000 7f5639c659c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34]): potential dests added=[] removed=[] 2024-09-12T17:37:09.300 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.298+0000 7f5639c659c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T17:37:09.303 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.302+0000 7f54edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:09.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.310+0000 7f5639c659c0 20 remove_watcher() i=0 2024-09-12T17:37:09.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.310+0000 7f5639c659c0 2 removed watcher, disabling cache 2024-09-12T17:37:09.313 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.314+0000 7f5639c659c0 20 remove_watcher() i=1 2024-09-12T17:37:09.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.318+0000 7f5639c659c0 20 remove_watcher() i=2 2024-09-12T17:37:09.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.318+0000 7f5639c659c0 20 remove_watcher() i=3 2024-09-12T17:37:09.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.322+0000 7f5639c659c0 20 remove_watcher() i=4 2024-09-12T17:37:09.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.326+0000 7f5639c659c0 20 remove_watcher() i=5 2024-09-12T17:37:09.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.330+0000 7f5639c659c0 20 remove_watcher() i=6 2024-09-12T17:37:09.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.330+0000 7f5639c659c0 20 remove_watcher() i=7 2024-09-12T17:37:09.349 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:37:09.382 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:09.382 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:09.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.426+0000 7f51c3f319c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.430+0000 7f51c3f319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:09.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.430+0000 7f51c3f319c0 20 realm 2024-09-12T17:37:09.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.430+0000 7f51c3f319c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.430+0000 7f51c3f319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:09.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.430+0000 7f51c3f319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:09.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.430+0000 7f51c3f319c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.430+0000 7f51c3f319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:09.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.430+0000 7f51c3f319c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.430+0000 7f51c3f319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:09.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.430+0000 7f51c3f319c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.434+0000 7f51c3f319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:09.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.434+0000 7f51c3f319c0 20 searching for the correct realm 2024-09-12T17:37:09.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.434+0000 7f51c2238640 0 -- 172.21.15.119:0/328187303 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f51b8092070 msgr2=0x7f51b807f090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:09.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.442+0000 7f51c1236640 0 -- 172.21.15.119:0/328187303 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f51bc05b6a0 msgr2=0x7f51bc066700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:09.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.658+0000 7f51c3f319c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:09.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.658+0000 7f51c3f319c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:09.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.658+0000 7f51c3f319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:09.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.658+0000 7f51c3f319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:09.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.658+0000 7f51c3f319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:09.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.658+0000 7f51c3f319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:09.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.658+0000 7f51c3f319c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.661 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:09.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:09.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:09.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 20 zone default found 2024-09-12T17:37:09.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 4 Realm: () 2024-09-12T17:37:09.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:09.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:09.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:09.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 20 zonegroup default 2024-09-12T17:37:09.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:09.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:09.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:09.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.662+0000 7f51c3f319c0 20 started sync module instance, tier type = 2024-09-12T17:37:09.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.666+0000 7f51c3f319c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:09.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.694+0000 7f51c3f319c0 20 add_watcher() i=0 2024-09-12T17:37:09.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.694+0000 7f51c3f319c0 20 add_watcher() i=1 2024-09-12T17:37:09.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.694+0000 7f51c3f319c0 20 add_watcher() i=2 2024-09-12T17:37:09.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.694+0000 7f51c3f319c0 20 add_watcher() i=3 2024-09-12T17:37:09.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.694+0000 7f51c3f319c0 20 add_watcher() i=4 2024-09-12T17:37:09.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.694+0000 7f51c3f319c0 20 add_watcher() i=5 2024-09-12T17:37:09.697 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.694+0000 7f51c3f319c0 20 add_watcher() i=6 2024-09-12T17:37:09.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.698+0000 7f51c3f319c0 20 add_watcher() i=7 2024-09-12T17:37:09.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.698+0000 7f51c3f319c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:09.703 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.702+0000 7f50737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:09.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.702+0000 7f51c3f319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:09.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.702+0000 7f51c3f319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:09.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.702+0000 7f51c3f319c0 5 note: GC not initialized 2024-09-12T17:37:09.704 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.702+0000 7f50727fc640 20 reqs_thread_entry: start 2024-09-12T17:37:09.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.702+0000 7f51c3f319c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:09.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.702+0000 7f51c3f319c0 20 Filter name: none 2024-09-12T17:37:09.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.702+0000 7f4fe3fff640 20 reqs_thread_entry: start 2024-09-12T17:37:09.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.702+0000 7f51c3f319c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.706+0000 7f51c3f319c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:09.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.706+0000 7f51c3f319c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.706+0000 7f51c3f319c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:37:09.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.706+0000 7f51c3f319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:09.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.706+0000 7f51c3f319c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.706+0000 7f51c3f319c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:09.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.706+0000 7f51c3f319c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:09.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.706+0000 7f51c3f319c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:37:09.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.706+0000 7f51c3f319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:09.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.710+0000 7f50737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:09.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.714+0000 7f51c3f319c0 20 remove_watcher() i=0 2024-09-12T17:37:09.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.714+0000 7f51c3f319c0 2 removed watcher, disabling cache 2024-09-12T17:37:09.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.718+0000 7f51c3f319c0 20 remove_watcher() i=1 2024-09-12T17:37:09.720 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.718+0000 7f51c3f319c0 20 remove_watcher() i=2 2024-09-12T17:37:09.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.722+0000 7f51c3f319c0 20 remove_watcher() i=3 2024-09-12T17:37:09.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.722+0000 7f51c3f319c0 20 remove_watcher() i=4 2024-09-12T17:37:09.726 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.726+0000 7f51c3f319c0 20 remove_watcher() i=5 2024-09-12T17:37:09.727 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.726+0000 7f51c3f319c0 20 remove_watcher() i=6 2024-09-12T17:37:09.729 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:09.730+0000 7f51c3f319c0 20 remove_watcher() i=7 2024-09-12T17:37:09.744 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:09.745 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:37:09.745 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-do-reshard id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:37:09.745 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:10.668 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T17:37:10.669 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:12.848 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:37:12.881 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:12.881 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:12.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:12.926+0000 7fd84fc899c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:12.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:12.926+0000 7fd84fc899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:12.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:12.926+0000 7fd84fc899c0 20 realm 2024-09-12T17:37:12.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:12.926+0000 7fd84fc899c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:12.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:12.930+0000 7fd84fc899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:12.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:12.930+0000 7fd84fc899c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:12.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:12.930+0000 7fd84fc899c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:12.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:12.930+0000 7fd84fc899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:12.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:12.930+0000 7fd84fc899c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:12.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:12.930+0000 7fd84fc899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:12.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:12.930+0000 7fd84fc899c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:12.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:12.934+0000 7fd84fc899c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:12.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:12.934+0000 7fd84fc899c0 20 searching for the correct realm 2024-09-12T17:37:12.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:12.934+0000 7fd84df90640 0 -- 172.21.15.119:0/632065825 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fd838008040 msgr2=0x7fd838062b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:12.943 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:12.942+0000 7fd84cf8e640 0 -- 172.21.15.119:0/632065825 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fd84810b5c0 msgr2=0x7fd8480b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:13.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.158+0000 7fd84fc899c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:13.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.158+0000 7fd84fc899c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:13.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.158+0000 7fd84fc899c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:13.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.158+0000 7fd84fc899c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:13.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.158+0000 7fd84fc899c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:13.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.158+0000 7fd84fc899c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:13.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.158+0000 7fd84fc899c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.162+0000 7fd84fc899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.162+0000 7fd84fc899c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.162+0000 7fd84fc899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:13.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.162+0000 7fd84fc899c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.162+0000 7fd84fc899c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:13.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.162+0000 7fd84fc899c0 20 zone default found 2024-09-12T17:37:13.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.162+0000 7fd84fc899c0 4 Realm: () 2024-09-12T17:37:13.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.162+0000 7fd84fc899c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:13.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.162+0000 7fd84fc899c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:13.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.162+0000 7fd84fc899c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:13.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.162+0000 7fd84fc899c0 20 zonegroup default 2024-09-12T17:37:13.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.162+0000 7fd84fc899c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.162+0000 7fd84fc899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.162+0000 7fd84fc899c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.162+0000 7fd84fc899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.162+0000 7fd84fc899c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.166+0000 7fd84fc899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.166+0000 7fd84fc899c0 20 started sync module instance, tier type = 2024-09-12T17:37:13.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.166+0000 7fd84fc899c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:13.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.190+0000 7fd84fc899c0 20 add_watcher() i=0 2024-09-12T17:37:13.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.190+0000 7fd84fc899c0 20 add_watcher() i=1 2024-09-12T17:37:13.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.190+0000 7fd84fc899c0 20 add_watcher() i=2 2024-09-12T17:37:13.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.190+0000 7fd84fc899c0 20 add_watcher() i=3 2024-09-12T17:37:13.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.190+0000 7fd84fc899c0 20 add_watcher() i=4 2024-09-12T17:37:13.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.190+0000 7fd84fc899c0 20 add_watcher() i=5 2024-09-12T17:37:13.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.190+0000 7fd84fc899c0 20 add_watcher() i=6 2024-09-12T17:37:13.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.194+0000 7fd84fc899c0 20 add_watcher() i=7 2024-09-12T17:37:13.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.194+0000 7fd84fc899c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:13.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.198+0000 7fd7037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:13.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.198+0000 7fd84fc899c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:13.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.198+0000 7fd84fc899c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:13.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.198+0000 7fd84fc899c0 5 note: GC not initialized 2024-09-12T17:37:13.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.198+0000 7fd7027e4640 20 reqs_thread_entry: start 2024-09-12T17:37:13.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.198+0000 7fd84fc899c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:13.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.198+0000 7fd84fc899c0 20 Filter name: none 2024-09-12T17:37:13.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.198+0000 7fd673fff640 20 reqs_thread_entry: start 2024-09-12T17:37:13.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.198+0000 7fd84fc899c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.198+0000 7fd84fc899c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:13.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.198+0000 7fd84fc899c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.202+0000 7fd84fc899c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:37:13.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.202+0000 7fd84fc899c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:13.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.202+0000 7fd84fc899c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.202+0000 7fd84fc899c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:13.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.202+0000 7fd84fc899c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.202+0000 7fd84fc899c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:37:13.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.202+0000 7fd84fc899c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:13.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.206+0000 7fd7037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:13.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.210+0000 7fd84fc899c0 20 remove_watcher() i=0 2024-09-12T17:37:13.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.210+0000 7fd84fc899c0 2 removed watcher, disabling cache 2024-09-12T17:37:13.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.214+0000 7fd84fc899c0 20 remove_watcher() i=1 2024-09-12T17:37:13.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.214+0000 7fd84fc899c0 20 remove_watcher() i=2 2024-09-12T17:37:13.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.218+0000 7fd84fc899c0 20 remove_watcher() i=3 2024-09-12T17:37:13.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.218+0000 7fd84fc899c0 20 remove_watcher() i=4 2024-09-12T17:37:13.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.222+0000 7fd84fc899c0 20 remove_watcher() i=5 2024-09-12T17:37:13.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.222+0000 7fd84fc899c0 20 remove_watcher() i=6 2024-09-12T17:37:13.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.222+0000 7fd84fc899c0 20 remove_watcher() i=7 2024-09-12T17:37:13.238 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.238 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:37:13.239 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-do-reshard id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:37:13.239 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.239 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:37:13.275 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:13.275 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:13.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 realm 2024-09-12T17:37:13.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.322+0000 7fe14bc099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:13.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.326+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:13.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.326+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.326+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:13.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.326+0000 7fe14bc099c0 20 searching for the correct realm 2024-09-12T17:37:13.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.326+0000 7fe148f0e640 0 -- 172.21.15.119:0/3641355234 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fe13c008050 msgr2=0x7fe13c07cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:13.541 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.542+0000 7fe149f10640 0 -- 172.21.15.119:0/3641355234 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fe14004d060 msgr2=0x7fe14004f780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:13.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:13.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:13.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:13.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:13.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:13.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:13.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:13.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:13.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 zone default found 2024-09-12T17:37:13.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 4 Realm: () 2024-09-12T17:37:13.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:13.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:13.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.558+0000 7fe14bc099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:13.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 zonegroup default 2024-09-12T17:37:13.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 started sync module instance, tier type = 2024-09-12T17:37:13.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:13.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=0 2024-09-12T17:37:13.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=1 2024-09-12T17:37:13.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=2 2024-09-12T17:37:13.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=3 2024-09-12T17:37:13.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=4 2024-09-12T17:37:13.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=5 2024-09-12T17:37:13.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=6 2024-09-12T17:37:13.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.586+0000 7fe14bc099c0 20 add_watcher() i=7 2024-09-12T17:37:13.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.586+0000 7fe14bc099c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:13.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.590+0000 7fdffffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:13.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:13.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:13.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 note: GC not initialized 2024-09-12T17:37:13.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.590+0000 7fdffefe5640 20 reqs_thread_entry: start 2024-09-12T17:37:13.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:13.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 Filter name: none 2024-09-12T17:37:13.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.590+0000 7fdffcfe1640 20 reqs_thread_entry: start 2024-09-12T17:37:13.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.590+0000 7fe14bc099c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:37:13.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:13.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.590+0000 7fe14bc099c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:37:13.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.590+0000 7fe14bc099c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:37:13.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.590+0000 7fe14bc099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 : miss 2024-09-12T17:37:13.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.594+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:37:13.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.594+0000 7fe14bc099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:13.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.594+0000 7fe14bc099c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:13.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.594+0000 7fe14bc099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:13.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.594+0000 7fe14bc099c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:13.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.594+0000 7fe14bc099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 2024-09-12T17:37:13.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.602+0000 7fe14bc099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:13.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.602+0000 7fe14bc099c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:13.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.602+0000 7fe14bc099c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:13.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.602+0000 7fe14bc099c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35, ofs0, ns] 2024-09-12T17:37:13.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.602+0000 7fe02cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333511 cookie 94808148727440 notifier 7572 bl.length()=995 2024-09-12T17:37:13.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.602+0000 7fe02cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:13.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.602+0000 7fe02cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:13.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.602+0000 7fe02cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:13.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.606+0000 7fe14bc099c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): orig_sources= new_sources= 2024-09-12T17:37:13.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.606+0000 7fe14bc099c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): potential sources added=[] removed=[] 2024-09-12T17:37:13.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.606+0000 7fe14bc099c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): orig_dests= new_dests= 2024-09-12T17:37:13.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.606+0000 7fe14bc099c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): potential dests added=[] removed=[] 2024-09-12T17:37:13.615 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe14bc099c0 time 2024-09-12T17:37:13.619903+0000 2024-09-12T17:37:13.616 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:37:13.618 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:13.618 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe14f4e32eb] 2024-09-12T17:37:13.618 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe14f4e349f] 2024-09-12T17:37:13.618 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a3b9210c1] 2024-09-12T17:37:13.619 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563a3b9331fa] 2024-09-12T17:37:13.619 INFO:tasks.workunit.client.0.smithi119.stderr: 5: main() 2024-09-12T17:37:13.619 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe14e349d90] 2024-09-12T17:37:13.619 INFO:tasks.workunit.client.0.smithi119.stderr: 7: __libc_start_main() 2024-09-12T17:37:13.619 INFO:tasks.workunit.client.0.smithi119.stderr: 8: _start() 2024-09-12T17:37:13.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.618+0000 7fe14bc099c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe14bc099c0 time 2024-09-12T17:37:13.619903+0000 2024-09-12T17:37:13.619 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:37:13.620 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.620 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:13.620 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe14f4e32eb] 2024-09-12T17:37:13.620 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe14f4e349f] 2024-09-12T17:37:13.620 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a3b9210c1] 2024-09-12T17:37:13.620 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563a3b9331fa] 2024-09-12T17:37:13.620 INFO:tasks.workunit.client.0.smithi119.stderr: 5: main() 2024-09-12T17:37:13.620 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe14e349d90] 2024-09-12T17:37:13.620 INFO:tasks.workunit.client.0.smithi119.stderr: 7: __libc_start_main() 2024-09-12T17:37:13.620 INFO:tasks.workunit.client.0.smithi119.stderr: 8: _start() 2024-09-12T17:37:13.620 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.620 INFO:tasks.workunit.client.0.smithi119.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:37:13.620 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fe14bc099c0 thread_name:radosgw-admin 2024-09-12T17:37:13.621 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:13.621 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe14e362520] 2024-09-12T17:37:13.622 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:37:13.622 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:37:13.622 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:37:13.622 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe14f4e3345] 2024-09-12T17:37:13.622 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe14f4e349f] 2024-09-12T17:37:13.623 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a3b9210c1] 2024-09-12T17:37:13.623 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563a3b9331fa] 2024-09-12T17:37:13.623 INFO:tasks.workunit.client.0.smithi119.stderr: 9: main() 2024-09-12T17:37:13.623 INFO:tasks.workunit.client.0.smithi119.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe14e349d90] 2024-09-12T17:37:13.623 INFO:tasks.workunit.client.0.smithi119.stderr: 11: __libc_start_main() 2024-09-12T17:37:13.624 INFO:tasks.workunit.client.0.smithi119.stderr: 12: _start() 2024-09-12T17:37:13.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.622+0000 7fe14bc099c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:37:13.624 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fe14bc099c0 thread_name:radosgw-admin 2024-09-12T17:37:13.624 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.624 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:13.624 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe14e362520] 2024-09-12T17:37:13.625 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:37:13.625 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:37:13.625 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:37:13.625 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe14f4e3345] 2024-09-12T17:37:13.625 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe14f4e349f] 2024-09-12T17:37:13.625 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a3b9210c1] 2024-09-12T17:37:13.626 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563a3b9331fa] 2024-09-12T17:37:13.626 INFO:tasks.workunit.client.0.smithi119.stderr: 9: main() 2024-09-12T17:37:13.626 INFO:tasks.workunit.client.0.smithi119.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe14e349d90] 2024-09-12T17:37:13.626 INFO:tasks.workunit.client.0.smithi119.stderr: 11: __libc_start_main() 2024-09-12T17:37:13.626 INFO:tasks.workunit.client.0.smithi119.stderr: 12: _start() 2024-09-12T17:37:13.626 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:37:13.627 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.627 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:37:13.674 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:37:13.298+0000 7fe037606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:37:13.674 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:37:13.298+0000 7fe037606640 10 monclient: dump: 2024-09-12T17:37:13.674 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.674 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.674 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.674 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.674 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.674 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.674 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.675 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.675 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.675 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.675 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:37:13.298+0000 7fe037606640 10 monclient: _finish_auth 0 2024-09-12T17:37:13.675 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:37:13.298+0000 7fe037606640 10 monclient: _check_auth_tickets 2024-09-12T17:37:13.675 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 monclient: authenticate success, global_id 7124 2024-09-12T17:37:13.675 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:37:13.298+0000 7fe037606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:13.675 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:37:13.298+0000 7fe037606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.675 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:37:13.298+0000 7fe037606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:37:13.675 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:37:13.298+0000 7fe037606640 10 monclient: dump: 2024-09-12T17:37:13.675 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.675 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.675 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.676 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.676 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.676 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.676 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.676 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.676 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.676 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.676 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient: get_monmap_and_config success 2024-09-12T17:37:13.676 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 4 set_mon_vals no callback set 2024-09-12T17:37:13.676 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient: shutdown 2024-09-12T17:37:13.676 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) unregister_commands rotate-key 2024-09-12T17:37:13.677 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient: build_initial_monmap 2024-09-12T17:37:13.677 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 1 build_initial for_mkfs: 0 2024-09-12T17:37:13.677 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient: monmap: 2024-09-12T17:37:13.677 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:37:13.677 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:13.677 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:37:13.677 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:37:13.677 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:13.677 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.677 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:37:13.677 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:37:13.677 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:37:13.678 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.678 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding auth protocol: cephx 2024-09-12T17:37:13.678 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding auth protocol: cephx 2024-09-12T17:37:13.678 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding auth protocol: cephx 2024-09-12T17:37:13.678 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: secure 2024-09-12T17:37:13.678 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: crc 2024-09-12T17:37:13.678 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: secure 2024-09-12T17:37:13.678 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: crc 2024-09-12T17:37:13.678 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: secure 2024-09-12T17:37:13.678 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: crc 2024-09-12T17:37:13.678 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: crc 2024-09-12T17:37:13.678 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: secure 2024-09-12T17:37:13.679 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: crc 2024-09-12T17:37:13.679 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: secure 2024-09-12T17:37:13.679 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: crc 2024-09-12T17:37:13.679 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: secure 2024-09-12T17:37:13.679 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.679 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 1 librados: starting msgr at 2024-09-12T17:37:13.679 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 1 librados: starting objecter 2024-09-12T17:37:13.679 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command objecter_requests hook 0x563a3dd909d0 2024-09-12T17:37:13.679 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 1 librados: setting wanted keys 2024-09-12T17:37:13.679 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 1 librados: calling monclient init 2024-09-12T17:37:13.679 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient: init 2024-09-12T17:37:13.679 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding auth protocol: cephx 2024-09-12T17:37:13.679 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding auth protocol: cephx 2024-09-12T17:37:13.680 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding auth protocol: cephx 2024-09-12T17:37:13.680 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: secure 2024-09-12T17:37:13.680 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: crc 2024-09-12T17:37:13.680 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: secure 2024-09-12T17:37:13.680 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: crc 2024-09-12T17:37:13.680 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: secure 2024-09-12T17:37:13.680 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: crc 2024-09-12T17:37:13.680 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: crc 2024-09-12T17:37:13.680 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: secure 2024-09-12T17:37:13.680 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: crc 2024-09-12T17:37:13.680 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: secure 2024-09-12T17:37:13.680 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: crc 2024-09-12T17:37:13.680 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: secure 2024-09-12T17:37:13.681 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.681 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.681 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command rotate-key hook 0x563a3df6d418 2024-09-12T17:37:13.681 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient: _reopen_session rank -1 2024-09-12T17:37:13.681 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:37:13.681 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-a con 0x563a3df708d0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:37:13.681 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-b con 0x563a3df71650 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:37:13.681 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-c con 0x7fe134003be0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:37:13.681 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.681 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.681 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.681 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient(hunting): _renew_subs 2024-09-12T17:37:13.681 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient(hunting): authenticate will time out at 2601.335521s 2024-09-12T17:37:13.681 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient(hunting): get_auth_request con 0x563a3df708d0 auth_method 0 2024-09-12T17:37:13.682 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.682 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.682 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.682 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:37:13.298+0000 7fe149f10640 10 monclient(hunting): get_auth_request con 0x7fe134003be0 auth_method 0 2024-09-12T17:37:13.682 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:37:13.298+0000 7fe149f10640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.682 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:37:13.298+0000 7fe149f10640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.682 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:37:13.298+0000 7fe149f10640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.682 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:13.682 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:13.682 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:13.682 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:37:13.298+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:13.682 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:37:13.298+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:13.682 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:37:13.298+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:13.683 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient(hunting): handle_auth_done global_id 7563 payload 824 2024-09-12T17:37:13.683 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient: _finish_hunting 0 2024-09-12T17:37:13.683 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:37:13.298+0000 7fe14970f640 1 monclient: found mon.noname-a 2024-09-12T17:37:13.683 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.683 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:37:13.298+0000 7fe148f0e640 10 monclient: get_auth_request con 0x563a3df71650 auth_method 0 2024-09-12T17:37:13.683 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.683 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:13.683 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: dump: 2024-09-12T17:37:13.683 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.684 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.684 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.684 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.684 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.684 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.684 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.684 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.685 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.685 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.685 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: _finish_auth 0 2024-09-12T17:37:13.685 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: _check_auth_tickets 2024-09-12T17:37:13.685 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:13.685 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.685 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:13.685 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: dump: 2024-09-12T17:37:13.685 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.685 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.685 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.686 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.686 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.686 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.686 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.686 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.686 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.686 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.686 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:37:13.302+0000 7fe14bc099c0 5 monclient: authenticate success, global_id 7563 2024-09-12T17:37:13.686 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:37:13.302+0000 7fe14bc099c0 10 monclient: _renew_subs 2024-09-12T17:37:13.686 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:37:13.302+0000 7fe14bc099c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.686 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:37:13.302+0000 7fe037606640 4 set_mon_vals no callback set 2024-09-12T17:37:13.687 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:37:13.302+0000 7fe14bc099c0 10 monclient: _renew_subs 2024-09-12T17:37:13.687 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:37:13.302+0000 7fe14bc099c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.687 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:37:13.302+0000 7fe14bc099c0 1 librados: init done 2024-09-12T17:37:13.687 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:37:13.302+0000 7fe035e03640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:37:13.687 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:37:13.302+0000 7fe035e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:13.687 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:37:13.302+0000 7fe035e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:13.687 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:37:13.302+0000 7fe148f0e640 10 monclient: get_auth_request con 0x7fe030070ae0 auth_method 0 2024-09-12T17:37:13.687 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:37:13.302+0000 7fe149f10640 10 monclient: get_auth_request con 0x563a3df959b0 auth_method 0 2024-09-12T17:37:13.687 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:37:13.302+0000 7fe14970f640 10 monclient: get_auth_request con 0x563a3dfb8680 auth_method 0 2024-09-12T17:37:13.687 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:37:13.306+0000 7fe148f0e640 10 monclient: get_auth_request con 0x563a3dfbc900 auth_method 0 2024-09-12T17:37:13.687 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:37:13.310+0000 7fe149f10640 10 monclient: get_auth_request con 0x563a3dfbbf30 auth_method 0 2024-09-12T17:37:13.687 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: build_initial_monmap 2024-09-12T17:37:13.687 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 1 build_initial for_mkfs: 0 2024-09-12T17:37:13.688 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: monmap: 2024-09-12T17:37:13.688 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:37:13.688 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:13.688 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:37:13.688 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:37:13.688 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:13.688 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.688 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:37:13.688 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:37:13.688 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:37:13.688 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.688 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding auth protocol: cephx 2024-09-12T17:37:13.689 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding auth protocol: cephx 2024-09-12T17:37:13.689 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding auth protocol: cephx 2024-09-12T17:37:13.689 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: secure 2024-09-12T17:37:13.689 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: crc 2024-09-12T17:37:13.689 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: secure 2024-09-12T17:37:13.689 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: crc 2024-09-12T17:37:13.689 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: secure 2024-09-12T17:37:13.689 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: crc 2024-09-12T17:37:13.689 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: crc 2024-09-12T17:37:13.689 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: secure 2024-09-12T17:37:13.689 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: crc 2024-09-12T17:37:13.689 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: secure 2024-09-12T17:37:13.689 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: crc 2024-09-12T17:37:13.690 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: secure 2024-09-12T17:37:13.690 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.690 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command objecter_requests cmddesc objecter_requests hook 0x563a3dfc8480 EEXIST 2024-09-12T17:37:13.690 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: init 2024-09-12T17:37:13.690 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding auth protocol: cephx 2024-09-12T17:37:13.690 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding auth protocol: cephx 2024-09-12T17:37:13.690 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding auth protocol: cephx 2024-09-12T17:37:13.690 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: secure 2024-09-12T17:37:13.690 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: crc 2024-09-12T17:37:13.690 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: secure 2024-09-12T17:37:13.690 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: crc 2024-09-12T17:37:13.690 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: secure 2024-09-12T17:37:13.690 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: crc 2024-09-12T17:37:13.691 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: crc 2024-09-12T17:37:13.691 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: secure 2024-09-12T17:37:13.691 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: crc 2024-09-12T17:37:13.691 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: secure 2024-09-12T17:37:13.691 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: crc 2024-09-12T17:37:13.691 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: secure 2024-09-12T17:37:13.691 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.691 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.691 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command rotate-key cmddesc rotate-key hook 0x563a3dfc3b50 EEXIST 2024-09-12T17:37:13.691 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: _reopen_session rank -1 2024-09-12T17:37:13.691 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:37:13.691 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-b con 0x563a3dfec630 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:37:13.691 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-c con 0x563a3dfebf60 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:37:13.692 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-a con 0x563a3dfea940 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:37:13.692 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.692 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.692 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.692 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient(hunting): _renew_subs 2024-09-12T17:37:13.692 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient(hunting): authenticate will time out at 2601.346947s 2024-09-12T17:37:13.692 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:37:13.310+0000 7fe149f10640 10 monclient(hunting): get_auth_request con 0x563a3dfebf60 auth_method 0 2024-09-12T17:37:13.692 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:37:13.310+0000 7fe149f10640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.692 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:37:13.310+0000 7fe149f10640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.692 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:37:13.310+0000 7fe149f10640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.692 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient(hunting): get_auth_request con 0x563a3dfea940 auth_method 0 2024-09-12T17:37:13.692 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.692 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.693 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.693 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:13.693 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:13.693 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:13.693 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:37:13.310+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:13.693 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:37:13.310+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:13.693 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:37:13.310+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:13.693 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:37:13.310+0000 7fe148f0e640 10 monclient(hunting): get_auth_request con 0x563a3dfec630 auth_method 0 2024-09-12T17:37:13.693 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:37:13.310+0000 7fe148f0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.693 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:37:13.310+0000 7fe148f0e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.693 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:37:13.310+0000 7fe148f0e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.693 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient(hunting): handle_auth_done global_id 7566 payload 824 2024-09-12T17:37:13.694 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient: _finish_hunting 0 2024-09-12T17:37:13.694 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:37:13.310+0000 7fe14970f640 1 monclient: found mon.noname-a 2024-09-12T17:37:13.694 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.694 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.694 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:13.694 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: dump: 2024-09-12T17:37:13.694 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.694 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.694 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.694 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.694 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.694 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.694 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.695 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.695 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.695 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.695 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: _finish_auth 0 2024-09-12T17:37:13.695 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: _check_auth_tickets 2024-09-12T17:37:13.695 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:13.695 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.695 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:13.695 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: dump: 2024-09-12T17:37:13.695 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.695 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.695 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.695 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.696 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.696 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.696 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.696 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.696 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.696 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.696 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 monclient: authenticate success, global_id 7566 2024-09-12T17:37:13.696 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:37:13.310+0000 7fe14a711640 4 set_mon_vals no callback set 2024-09-12T17:37:13.696 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: _renew_subs 2024-09-12T17:37:13.696 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.696 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: _renew_subs 2024-09-12T17:37:13.697 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.697 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:37:13.314+0000 7fe02effd640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:37:13.697 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:37:13.314+0000 7fe02effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:13.697 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:37:13.314+0000 7fe02effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:13.697 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient: get_monmap_and_config 2024-09-12T17:37:13.697 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient: build_initial_monmap 2024-09-12T17:37:13.697 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 1 build_initial for_mkfs: 0 2024-09-12T17:37:13.697 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient: monmap: 2024-09-12T17:37:13.697 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:37:13.697 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:13.697 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:37:13.697 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:37:13.697 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:13.698 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.698 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:37:13.698 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:37:13.698 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:37:13.698 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.698 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding auth protocol: cephx 2024-09-12T17:37:13.698 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding auth protocol: cephx 2024-09-12T17:37:13.698 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding auth protocol: cephx 2024-09-12T17:37:13.698 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: secure 2024-09-12T17:37:13.698 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: crc 2024-09-12T17:37:13.698 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: secure 2024-09-12T17:37:13.698 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: crc 2024-09-12T17:37:13.698 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: secure 2024-09-12T17:37:13.699 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: crc 2024-09-12T17:37:13.699 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: crc 2024-09-12T17:37:13.699 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: secure 2024-09-12T17:37:13.699 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: crc 2024-09-12T17:37:13.699 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: secure 2024-09-12T17:37:13.699 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: crc 2024-09-12T17:37:13.699 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:37:13.314+0000 7fe148f0e640 10 monclient: get_auth_request con 0x7fe024070a20 auth_method 0 2024-09-12T17:37:13.699 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: secure 2024-09-12T17:37:13.699 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.699 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient: init 2024-09-12T17:37:13.699 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding auth protocol: cephx 2024-09-12T17:37:13.699 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding auth protocol: cephx 2024-09-12T17:37:13.699 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding auth protocol: cephx 2024-09-12T17:37:13.700 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: secure 2024-09-12T17:37:13.700 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: crc 2024-09-12T17:37:13.700 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: secure 2024-09-12T17:37:13.700 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: crc 2024-09-12T17:37:13.700 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: secure 2024-09-12T17:37:13.700 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: crc 2024-09-12T17:37:13.700 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: crc 2024-09-12T17:37:13.700 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: secure 2024-09-12T17:37:13.700 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: crc 2024-09-12T17:37:13.700 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: secure 2024-09-12T17:37:13.700 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: crc 2024-09-12T17:37:13.700 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: secure 2024-09-12T17:37:13.700 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.701 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.701 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command rotate-key cmddesc rotate-key hook 0x7ffec837c158 EEXIST 2024-09-12T17:37:13.701 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient: _reopen_session rank -1 2024-09-12T17:37:13.701 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:37:13.701 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-b con 0x563a3e0402d0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:37:13.701 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-a con 0x563a3e00fcf0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:37:13.701 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-c con 0x563a3e03baa0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:37:13.701 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.701 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.701 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.701 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient(hunting): _renew_subs 2024-09-12T17:37:13.701 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient(hunting): authenticate will time out at 2601.351319s 2024-09-12T17:37:13.701 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient(hunting): get_auth_request con 0x563a3e00fcf0 auth_method 0 2024-09-12T17:37:13.702 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.702 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.702 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.702 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:37:13.314+0000 7fe14970f640 10 monclient(hunting): get_auth_request con 0x563a3e03baa0 auth_method 0 2024-09-12T17:37:13.702 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:37:13.314+0000 7fe14970f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.702 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:37:13.314+0000 7fe14970f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.702 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:37:13.314+0000 7fe14970f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.702 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:13.702 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:13.702 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:13.702 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:37:13.314+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:13.702 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:37:13.314+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:13.702 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:37:13.314+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:13.702 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:37:13.314+0000 7fe148f0e640 10 monclient(hunting): get_auth_request con 0x563a3e0402d0 auth_method 0 2024-09-12T17:37:13.703 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:37:13.314+0000 7fe148f0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.703 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:37:13.314+0000 7fe148f0e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.703 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:37:13.314+0000 7fe148f0e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.703 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient(hunting): handle_auth_done global_id 7569 payload 274 2024-09-12T17:37:13.703 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient: _finish_hunting 0 2024-09-12T17:37:13.703 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:37:13.314+0000 7fe149f10640 1 monclient: found mon.noname-a 2024-09-12T17:37:13.703 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.703 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.703 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:13.703 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: dump: 2024-09-12T17:37:13.703 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.703 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.703 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.704 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.704 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.704 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.704 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.704 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.704 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.704 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.704 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: _finish_auth 0 2024-09-12T17:37:13.704 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: _check_auth_tickets 2024-09-12T17:37:13.704 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:13.704 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 monclient: authenticate success, global_id 7569 2024-09-12T17:37:13.704 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: get_monmap_and_config success 2024-09-12T17:37:13.704 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 4 set_mon_vals no callback set 2024-09-12T17:37:13.705 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.705 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:13.705 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: dump: 2024-09-12T17:37:13.705 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.705 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.705 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.705 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.705 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.705 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.705 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.705 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.705 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.705 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.706 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: shutdown 2024-09-12T17:37:13.706 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: build_initial_monmap 2024-09-12T17:37:13.706 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 1 build_initial for_mkfs: 0 2024-09-12T17:37:13.706 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: monmap: 2024-09-12T17:37:13.706 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:37:13.706 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:13.706 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:37:13.706 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:37:13.706 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:13.706 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.706 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:37:13.706 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:37:13.706 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:37:13.706 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.707 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding auth protocol: cephx 2024-09-12T17:37:13.707 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding auth protocol: cephx 2024-09-12T17:37:13.707 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding auth protocol: cephx 2024-09-12T17:37:13.707 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: secure 2024-09-12T17:37:13.707 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: crc 2024-09-12T17:37:13.707 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: secure 2024-09-12T17:37:13.707 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: crc 2024-09-12T17:37:13.707 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: secure 2024-09-12T17:37:13.707 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: crc 2024-09-12T17:37:13.707 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: crc 2024-09-12T17:37:13.707 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: secure 2024-09-12T17:37:13.707 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: crc 2024-09-12T17:37:13.707 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: secure 2024-09-12T17:37:13.708 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: crc 2024-09-12T17:37:13.708 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: secure 2024-09-12T17:37:13.708 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.708 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 1 librados: starting msgr at 2024-09-12T17:37:13.708 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 1 librados: starting objecter 2024-09-12T17:37:13.708 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command objecter_requests cmddesc objecter_requests hook 0x563a3dff2170 EEXIST 2024-09-12T17:37:13.708 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 1 librados: setting wanted keys 2024-09-12T17:37:13.708 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 1 librados: calling monclient init 2024-09-12T17:37:13.708 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: init 2024-09-12T17:37:13.708 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding auth protocol: cephx 2024-09-12T17:37:13.708 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding auth protocol: cephx 2024-09-12T17:37:13.709 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding auth protocol: cephx 2024-09-12T17:37:13.709 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: secure 2024-09-12T17:37:13.709 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: crc 2024-09-12T17:37:13.709 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: secure 2024-09-12T17:37:13.709 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: crc 2024-09-12T17:37:13.709 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: secure 2024-09-12T17:37:13.709 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: crc 2024-09-12T17:37:13.709 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: crc 2024-09-12T17:37:13.709 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: secure 2024-09-12T17:37:13.709 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: crc 2024-09-12T17:37:13.709 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: secure 2024-09-12T17:37:13.709 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: crc 2024-09-12T17:37:13.709 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: secure 2024-09-12T17:37:13.710 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.710 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.710 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command rotate-key cmddesc rotate-key hook 0x563a3dfee598 EEXIST 2024-09-12T17:37:13.710 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: _reopen_session rank -1 2024-09-12T17:37:13.710 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:37:13.710 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-a con 0x563a3e00fcf0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:37:13.710 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-b con 0x563a3e03baa0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:37:13.710 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-c con 0x563a3e0402d0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:37:13.710 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.710 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.710 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.710 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient(hunting): _renew_subs 2024-09-12T17:37:13.711 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient(hunting): authenticate will time out at 2601.353921s 2024-09-12T17:37:13.711 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient(hunting): get_auth_request con 0x563a3e00fcf0 auth_method 0 2024-09-12T17:37:13.711 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.711 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.711 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.711 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:37:13.318+0000 7fe14970f640 10 monclient(hunting): get_auth_request con 0x563a3e0402d0 auth_method 0 2024-09-12T17:37:13.711 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:37:13.318+0000 7fe14970f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.711 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:37:13.318+0000 7fe14970f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.711 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:37:13.318+0000 7fe14970f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.711 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:37:13.318+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:13.711 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:37:13.318+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:13.712 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:37:13.318+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:13.712 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:13.712 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:13.712 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:13.712 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:37:13.318+0000 7fe149f10640 10 monclient(hunting): get_auth_request con 0x563a3e03baa0 auth_method 0 2024-09-12T17:37:13.712 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:37:13.318+0000 7fe149f10640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.712 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:37:13.318+0000 7fe149f10640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.712 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:37:13.318+0000 7fe149f10640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.712 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient(hunting): handle_auth_done global_id 7572 payload 824 2024-09-12T17:37:13.712 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient: _finish_hunting 0 2024-09-12T17:37:13.712 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:37:13.318+0000 7fe148f0e640 1 monclient: found mon.noname-a 2024-09-12T17:37:13.713 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.713 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.713 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:13.713 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: dump: 2024-09-12T17:37:13.713 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.713 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.713 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.713 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.713 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.713 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.713 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.714 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.714 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.714 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.714 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: _finish_auth 0 2024-09-12T17:37:13.714 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: _check_auth_tickets 2024-09-12T17:37:13.714 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:13.714 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.714 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:13.714 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: dump: 2024-09-12T17:37:13.714 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.714 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.714 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.714 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.715 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.715 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.715 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.715 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.715 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.715 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.715 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:37:13.318+0000 7fe02cff9640 4 set_mon_vals no callback set 2024-09-12T17:37:13.715 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 monclient: authenticate success, global_id 7572 2024-09-12T17:37:13.715 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: _renew_subs 2024-09-12T17:37:13.715 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.715 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: _renew_subs 2024-09-12T17:37:13.716 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.716 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 1 librados: init done 2024-09-12T17:37:13.716 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command cr dump hook 0x563a3e038d58 2024-09-12T17:37:13.716 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.716 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:37:13.322+0000 7fe01affd640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:37:13.716 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:37:13.322+0000 7fe01affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:13.716 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:37:13.322+0000 7fe01affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:13.716 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:37:13.322+0000 7fe149f10640 10 monclient: get_auth_request con 0x7fe014070b10 auth_method 0 2024-09-12T17:37:13.716 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:37:13.322+0000 7fe14970f640 10 monclient: get_auth_request con 0x563a3e05a240 auth_method 0 2024-09-12T17:37:13.716 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.716 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 realm 2024-09-12T17:37:13.717 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.717 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.717 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:13.717 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.717 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.717 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.717 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:37:13.322+0000 7fe148f0e640 10 monclient: get_auth_request con 0x563a3e05e450 auth_method 0 2024-09-12T17:37:13.717 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:37:13.326+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:13.717 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:37:13.326+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.717 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:37:13.326+0000 7fe149f10640 10 monclient: get_auth_request con 0x563a3e061cb0 auth_method 0 2024-09-12T17:37:13.717 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:37:13.326+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:13.717 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:37:13.326+0000 7fe14bc099c0 20 searching for the correct realm 2024-09-12T17:37:13.718 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:37:13.326+0000 7fe14970f640 10 monclient: get_auth_request con 0x563a3e066a70 auth_method 0 2024-09-12T17:37:13.718 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:37:13.326+0000 7fe148f0e640 0 -- 172.21.15.119:0/3641355234 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fe13c008050 msgr2=0x7fe13c07cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:13.718 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:37:13.530+0000 7fe148f0e640 10 monclient: get_auth_request con 0x7fe13c008050 auth_method 0 2024-09-12T17:37:13.718 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:37:13.530+0000 7fe149f10640 10 monclient: get_auth_request con 0x7fe14004d060 auth_method 0 2024-09-12T17:37:13.718 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:37:13.538+0000 7fe14970f640 10 monclient: get_auth_request con 0x7fe1440db040 auth_method 0 2024-09-12T17:37:13.718 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:37:13.542+0000 7fe149f10640 0 -- 172.21.15.119:0/3641355234 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fe14004d060 msgr2=0x7fe14004f780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:13.718 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:37:13.542+0000 7fe01affd640 1 client.7572.objecter ms_handle_reset 0x7fe14004d060 session 0x7fe14003f040 osd.2 2024-09-12T17:37:13.718 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:37:13.542+0000 7fe01affd640 10 monclient: _renew_subs 2024-09-12T17:37:13.718 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:37:13.542+0000 7fe01affd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.718 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:37:13.542+0000 7fe149f10640 10 monclient: get_auth_request con 0x7fe0140812c0 auth_method 0 2024-09-12T17:37:13.718 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:37:13.546+0000 7fe148f0e640 10 monclient: get_auth_request con 0x563a3de2c900 auth_method 0 2024-09-12T17:37:13.718 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:13.719 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:13.719 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:13.719 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:13.719 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:13.719 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:13.719 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.719 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.719 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.719 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:13.719 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.719 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:13.719 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 zone default found 2024-09-12T17:37:13.719 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 4 Realm: () 2024-09-12T17:37:13.720 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:13.720 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:13.720 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:13.720 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 zonegroup default 2024-09-12T17:37:13.720 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.720 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.720 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.720 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.720 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.720 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.720 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 started sync module instance, tier type = 2024-09-12T17:37:13.721 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:13.721 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=0 2024-09-12T17:37:13.721 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=1 2024-09-12T17:37:13.721 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=2 2024-09-12T17:37:13.721 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=3 2024-09-12T17:37:13.721 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=4 2024-09-12T17:37:13.721 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=5 2024-09-12T17:37:13.721 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=6 2024-09-12T17:37:13.721 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:37:13.586+0000 7fe14bc099c0 20 add_watcher() i=7 2024-09-12T17:37:13.721 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:37:13.586+0000 7fe14bc099c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:13.721 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding auth protocol: cephx 2024-09-12T17:37:13.721 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding auth protocol: cephx 2024-09-12T17:37:13.721 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding auth protocol: cephx 2024-09-12T17:37:13.722 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: secure 2024-09-12T17:37:13.722 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: crc 2024-09-12T17:37:13.722 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: secure 2024-09-12T17:37:13.722 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: crc 2024-09-12T17:37:13.722 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: secure 2024-09-12T17:37:13.722 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: crc 2024-09-12T17:37:13.722 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: crc 2024-09-12T17:37:13.722 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: secure 2024-09-12T17:37:13.723 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: crc 2024-09-12T17:37:13.723 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: secure 2024-09-12T17:37:13.723 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: crc 2024-09-12T17:37:13.723 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: secure 2024-09-12T17:37:13.723 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:37:13.590+0000 7fdffffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:13.723 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.723 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:13.724 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:13.724 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command cache list hook 0x563a3e0397a0 2024-09-12T17:37:13.724 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command cache inspect hook 0x563a3e0397a0 2024-09-12T17:37:13.724 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command cache erase hook 0x563a3e0397a0 2024-09-12T17:37:13.724 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command cache zap hook 0x563a3e0397a0 2024-09-12T17:37:13.724 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 note: GC not initialized 2024-09-12T17:37:13.724 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:37:13.590+0000 7fdffefe5640 20 reqs_thread_entry: start 2024-09-12T17:37:13.724 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command sync trace show hook 0x7fe1400013e0 2024-09-12T17:37:13.724 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command sync trace history hook 0x7fe1400013e0 2024-09-12T17:37:13.724 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command sync trace active hook 0x7fe1400013e0 2024-09-12T17:37:13.724 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command sync trace active_short hook 0x7fe1400013e0 2024-09-12T17:37:13.724 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:13.725 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 Filter name: none 2024-09-12T17:37:13.725 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:37:13.590+0000 7fdffcfe1640 20 reqs_thread_entry: start 2024-09-12T17:37:13.725 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:37:13.725 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.725 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:13.725 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:37:13.725 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:37:13.725 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 : miss 2024-09-12T17:37:13.725 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.725 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:37:13.594+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:37:13.725 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:37:13.594+0000 7fe14bc099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:13.725 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:37:13.594+0000 7fe14bc099c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:13.726 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:37:13.594+0000 7fe14bc099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:13.726 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:37:13.594+0000 7fe14bc099c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:13.726 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:37:13.594+0000 7fe14bc099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 2024-09-12T17:37:13.726 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:37:13.602+0000 7fe14bc099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:13.726 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:37:13.602+0000 7fe14bc099c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:13.726 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:37:13.602+0000 7fe14bc099c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:13.726 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:37:13.602+0000 7fe14bc099c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35, ofs0, ns] 2024-09-12T17:37:13.726 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:37:13.602+0000 7fe02cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333511 cookie 94808148727440 notifier 7572 bl.length()=995 2024-09-12T17:37:13.726 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:37:13.602+0000 7fe02cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:13.726 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:37:13.602+0000 7fe02cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:13.726 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:37:13.602+0000 7fe02cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:13.726 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:37:13.606+0000 7fe14bc099c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): orig_sources= new_sources= 2024-09-12T17:37:13.727 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:37:13.606+0000 7fe14bc099c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): potential sources added=[] removed=[] 2024-09-12T17:37:13.727 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:37:13.606+0000 7fe14bc099c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): orig_dests= new_dests= 2024-09-12T17:37:13.727 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:37:13.606+0000 7fe14bc099c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): potential dests added=[] removed=[] 2024-09-12T17:37:13.727 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:37:13.618+0000 7fe14bc099c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe14bc099c0 time 2024-09-12T17:37:13.619903+0000 2024-09-12T17:37:13.727 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:37:13.727 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.727 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:13.727 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe14f4e32eb] 2024-09-12T17:37:13.727 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe14f4e349f] 2024-09-12T17:37:13.727 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a3b9210c1] 2024-09-12T17:37:13.727 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563a3b9331fa] 2024-09-12T17:37:13.727 INFO:tasks.workunit.client.0.smithi119.stderr: 5: main() 2024-09-12T17:37:13.728 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe14e349d90] 2024-09-12T17:37:13.728 INFO:tasks.workunit.client.0.smithi119.stderr: 7: __libc_start_main() 2024-09-12T17:37:13.728 INFO:tasks.workunit.client.0.smithi119.stderr: 8: _start() 2024-09-12T17:37:13.728 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.728 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:37:13.622+0000 7fe14bc099c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:37:13.728 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fe14bc099c0 thread_name:radosgw-admin 2024-09-12T17:37:13.728 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.728 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:13.728 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe14e362520] 2024-09-12T17:37:13.728 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:37:13.728 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:37:13.728 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:37:13.729 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe14f4e3345] 2024-09-12T17:37:13.729 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe14f4e349f] 2024-09-12T17:37:13.729 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a3b9210c1] 2024-09-12T17:37:13.729 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563a3b9331fa] 2024-09-12T17:37:13.729 INFO:tasks.workunit.client.0.smithi119.stderr: 9: main() 2024-09-12T17:37:13.729 INFO:tasks.workunit.client.0.smithi119.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe14e349d90] 2024-09-12T17:37:13.729 INFO:tasks.workunit.client.0.smithi119.stderr: 11: __libc_start_main() 2024-09-12T17:37:13.729 INFO:tasks.workunit.client.0.smithi119.stderr: 12: _start() 2024-09-12T17:37:13.729 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:37:13.729 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.729 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:37:13.729 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:37:13.729 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:37:13.730 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:37:13.730 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:37:13.730 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:37:13.730 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:37:13.730 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:37:13.730 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:37:13.730 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:37:13.730 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:37:13.730 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:37:13.730 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:37:13.730 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:37:13.730 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:37:13.730 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:37:13.731 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:37:13.731 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:37:13.731 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:37:13.731 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:37:13.731 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:37:13.731 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:37:13.731 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:37:13.731 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:37:13.731 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:37:13.731 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:37:13.731 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:37:13.731 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:37:13.731 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:37:13.732 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:37:13.732 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:37:13.732 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:37:13.732 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:37:13.732 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:37:13.732 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:37:13.732 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:37:13.732 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:37:13.732 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:37:13.732 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:37:13.732 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:37:13.732 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:37:13.732 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:37:13.733 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:37:13.733 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:37:13.733 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:37:13.733 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:37:13.733 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:37:13.733 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:37:13.733 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:37:13.733 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:37:13.733 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:37:13.733 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:37:13.733 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:37:13.733 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:37:13.734 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:37:13.734 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:37:13.734 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:37:13.734 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:37:13.734 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:37:13.734 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:37:13.734 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:37:13.734 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:37:13.734 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:37:13.734 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:37:13.734 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:37:13.734 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:37:13.734 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:37:13.734 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:37:13.735 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:37:13.735 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:37:13.735 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:37:13.735 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:37:13.735 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:37:13.735 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:37:13.735 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:37:13.735 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:37:13.735 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:37:13.735 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:37:13.735 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:37:13.735 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:37:13.735 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:37:13.735 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:37:13.736 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:37:13.736 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:37:13.736 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:37:13.736 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:37:13.736 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:37:13.736 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:37:13.736 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:37:13.736 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:37:13.736 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:37:13.736 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:37:13.736 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:37:13.736 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:37:13.736 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdffcfe1640 / http_manager 2024-09-12T17:37:13.737 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdffefe5640 / http_manager 2024-09-12T17:37:13.737 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdffffe7640 / rgw_dt_lg_renew 2024-09-12T17:37:13.737 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe01affd640 / ms_dispatch 2024-09-12T17:37:13.737 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe02cff9640 / io_context_pool 2024-09-12T17:37:13.737 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe02effd640 / ms_dispatch 2024-09-12T17:37:13.737 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe035e03640 / ms_dispatch 2024-09-12T17:37:13.737 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe037606640 / io_context_pool 2024-09-12T17:37:13.737 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe148f0e640 / msgr-worker-2 2024-09-12T17:37:13.737 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe14970f640 / msgr-worker-1 2024-09-12T17:37:13.737 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe149f10640 / msgr-worker-0 2024-09-12T17:37:13.737 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe14a711640 / io_context_pool 2024-09-12T17:37:13.737 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe14bc099c0 / radosgw-admin 2024-09-12T17:37:13.737 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:37:13.738 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:37:13.738 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/log/ceph/ceph-client.admin.120973.log 2024-09-12T17:37:13.738 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:37:13.738 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:37:13.738 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:37:13.298+0000 7fe037606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:37:13.738 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:37:13.298+0000 7fe037606640 10 monclient: dump: 2024-09-12T17:37:13.738 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.738 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.738 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.738 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.738 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.738 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.738 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.738 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.739 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.739 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.739 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:37:13.298+0000 7fe037606640 10 monclient: _finish_auth 0 2024-09-12T17:37:13.739 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:37:13.298+0000 7fe037606640 10 monclient: _check_auth_tickets 2024-09-12T17:37:13.739 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 monclient: authenticate success, global_id 7124 2024-09-12T17:37:13.739 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:37:13.298+0000 7fe037606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:13.739 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:37:13.298+0000 7fe037606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.739 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:37:13.298+0000 7fe037606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:37:13.739 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:37:13.298+0000 7fe037606640 10 monclient: dump: 2024-09-12T17:37:13.739 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.739 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.739 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.739 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.739 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.740 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.740 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.740 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.740 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.740 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.740 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient: get_monmap_and_config success 2024-09-12T17:37:13.740 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 4 set_mon_vals no callback set 2024-09-12T17:37:13.740 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient: shutdown 2024-09-12T17:37:13.740 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) unregister_commands rotate-key 2024-09-12T17:37:13.740 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient: build_initial_monmap 2024-09-12T17:37:13.740 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 1 build_initial for_mkfs: 0 2024-09-12T17:37:13.740 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient: monmap: 2024-09-12T17:37:13.741 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:37:13.741 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:13.741 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:37:13.741 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:37:13.741 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:13.741 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.741 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:37:13.741 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:37:13.741 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:37:13.741 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.741 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding auth protocol: cephx 2024-09-12T17:37:13.741 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding auth protocol: cephx 2024-09-12T17:37:13.741 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding auth protocol: cephx 2024-09-12T17:37:13.742 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: secure 2024-09-12T17:37:13.742 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: crc 2024-09-12T17:37:13.742 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: secure 2024-09-12T17:37:13.742 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: crc 2024-09-12T17:37:13.742 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: secure 2024-09-12T17:37:13.742 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: crc 2024-09-12T17:37:13.742 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: crc 2024-09-12T17:37:13.742 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: secure 2024-09-12T17:37:13.742 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: crc 2024-09-12T17:37:13.742 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: secure 2024-09-12T17:37:13.742 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: crc 2024-09-12T17:37:13.742 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df734f0) adding con mode: secure 2024-09-12T17:37:13.742 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.742 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 1 librados: starting msgr at 2024-09-12T17:37:13.743 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 1 librados: starting objecter 2024-09-12T17:37:13.743 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command objecter_requests hook 0x563a3dd909d0 2024-09-12T17:37:13.743 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 1 librados: setting wanted keys 2024-09-12T17:37:13.743 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 1 librados: calling monclient init 2024-09-12T17:37:13.743 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient: init 2024-09-12T17:37:13.743 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding auth protocol: cephx 2024-09-12T17:37:13.743 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding auth protocol: cephx 2024-09-12T17:37:13.743 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding auth protocol: cephx 2024-09-12T17:37:13.743 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: secure 2024-09-12T17:37:13.743 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: crc 2024-09-12T17:37:13.743 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: secure 2024-09-12T17:37:13.743 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: crc 2024-09-12T17:37:13.744 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: secure 2024-09-12T17:37:13.744 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: crc 2024-09-12T17:37:13.744 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: crc 2024-09-12T17:37:13.744 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: secure 2024-09-12T17:37:13.744 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: crc 2024-09-12T17:37:13.744 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: secure 2024-09-12T17:37:13.744 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: crc 2024-09-12T17:37:13.744 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 AuthRegistry(0x563a3df6d2d0) adding con mode: secure 2024-09-12T17:37:13.744 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.744 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.744 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command rotate-key hook 0x563a3df6d418 2024-09-12T17:37:13.744 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient: _reopen_session rank -1 2024-09-12T17:37:13.745 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:37:13.745 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-a con 0x563a3df708d0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:37:13.745 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-b con 0x563a3df71650 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:37:13.745 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-c con 0x7fe134003be0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:37:13.745 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.745 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.745 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.745 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient(hunting): _renew_subs 2024-09-12T17:37:13.745 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:37:13.298+0000 7fe14bc099c0 10 monclient(hunting): authenticate will time out at 2601.335521s 2024-09-12T17:37:13.745 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient(hunting): get_auth_request con 0x563a3df708d0 auth_method 0 2024-09-12T17:37:13.745 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.745 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.745 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.745 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:37:13.298+0000 7fe149f10640 10 monclient(hunting): get_auth_request con 0x7fe134003be0 auth_method 0 2024-09-12T17:37:13.746 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:37:13.298+0000 7fe149f10640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.746 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:37:13.298+0000 7fe149f10640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.746 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:37:13.298+0000 7fe149f10640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.746 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:13.746 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:13.746 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:13.746 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:37:13.298+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:13.746 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:37:13.298+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:13.746 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:37:13.298+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:13.746 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient(hunting): handle_auth_done global_id 7563 payload 824 2024-09-12T17:37:13.746 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient: _finish_hunting 0 2024-09-12T17:37:13.746 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:37:13.298+0000 7fe14970f640 1 monclient: found mon.noname-a 2024-09-12T17:37:13.746 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:37:13.298+0000 7fe14970f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.747 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:37:13.298+0000 7fe148f0e640 10 monclient: get_auth_request con 0x563a3df71650 auth_method 0 2024-09-12T17:37:13.747 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.747 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:13.747 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: dump: 2024-09-12T17:37:13.747 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.747 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.747 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.747 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.747 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.747 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.747 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.747 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.747 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.748 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.748 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: _finish_auth 0 2024-09-12T17:37:13.748 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: _check_auth_tickets 2024-09-12T17:37:13.748 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:13.748 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.748 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:13.748 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:37:13.302+0000 7fe035e03640 10 monclient: dump: 2024-09-12T17:37:13.748 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.748 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.748 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.748 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.748 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.748 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.748 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.749 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.749 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.749 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.749 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:37:13.302+0000 7fe14bc099c0 5 monclient: authenticate success, global_id 7563 2024-09-12T17:37:13.749 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:37:13.302+0000 7fe14bc099c0 10 monclient: _renew_subs 2024-09-12T17:37:13.749 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:37:13.302+0000 7fe14bc099c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.749 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:37:13.302+0000 7fe037606640 4 set_mon_vals no callback set 2024-09-12T17:37:13.749 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:37:13.302+0000 7fe14bc099c0 10 monclient: _renew_subs 2024-09-12T17:37:13.749 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:37:13.302+0000 7fe14bc099c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.749 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:37:13.302+0000 7fe14bc099c0 1 librados: init done 2024-09-12T17:37:13.749 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:37:13.302+0000 7fe035e03640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:37:13.749 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:37:13.302+0000 7fe035e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:13.749 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:37:13.302+0000 7fe035e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:13.750 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:37:13.302+0000 7fe148f0e640 10 monclient: get_auth_request con 0x7fe030070ae0 auth_method 0 2024-09-12T17:37:13.750 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:37:13.302+0000 7fe149f10640 10 monclient: get_auth_request con 0x563a3df959b0 auth_method 0 2024-09-12T17:37:13.750 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:37:13.302+0000 7fe14970f640 10 monclient: get_auth_request con 0x563a3dfb8680 auth_method 0 2024-09-12T17:37:13.750 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:37:13.306+0000 7fe148f0e640 10 monclient: get_auth_request con 0x563a3dfbc900 auth_method 0 2024-09-12T17:37:13.750 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:37:13.310+0000 7fe149f10640 10 monclient: get_auth_request con 0x563a3dfbbf30 auth_method 0 2024-09-12T17:37:13.750 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: build_initial_monmap 2024-09-12T17:37:13.750 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 1 build_initial for_mkfs: 0 2024-09-12T17:37:13.750 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: monmap: 2024-09-12T17:37:13.750 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:37:13.750 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:13.750 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:37:13.750 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:37:13.750 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:13.750 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.750 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:37:13.751 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:37:13.751 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:37:13.751 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.751 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding auth protocol: cephx 2024-09-12T17:37:13.751 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding auth protocol: cephx 2024-09-12T17:37:13.751 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding auth protocol: cephx 2024-09-12T17:37:13.751 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: secure 2024-09-12T17:37:13.751 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: crc 2024-09-12T17:37:13.751 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: secure 2024-09-12T17:37:13.751 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: crc 2024-09-12T17:37:13.751 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: secure 2024-09-12T17:37:13.751 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: crc 2024-09-12T17:37:13.751 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: crc 2024-09-12T17:37:13.751 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: secure 2024-09-12T17:37:13.752 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: crc 2024-09-12T17:37:13.752 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: secure 2024-09-12T17:37:13.752 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: crc 2024-09-12T17:37:13.752 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc4a50) adding con mode: secure 2024-09-12T17:37:13.752 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.752 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command objecter_requests cmddesc objecter_requests hook 0x563a3dfc8480 EEXIST 2024-09-12T17:37:13.752 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: init 2024-09-12T17:37:13.752 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding auth protocol: cephx 2024-09-12T17:37:13.752 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding auth protocol: cephx 2024-09-12T17:37:13.752 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding auth protocol: cephx 2024-09-12T17:37:13.752 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: secure 2024-09-12T17:37:13.752 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: crc 2024-09-12T17:37:13.752 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: secure 2024-09-12T17:37:13.753 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: crc 2024-09-12T17:37:13.753 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: secure 2024-09-12T17:37:13.753 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: crc 2024-09-12T17:37:13.753 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: crc 2024-09-12T17:37:13.753 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: secure 2024-09-12T17:37:13.753 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: crc 2024-09-12T17:37:13.753 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: secure 2024-09-12T17:37:13.753 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: crc 2024-09-12T17:37:13.753 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfc3a08) adding con mode: secure 2024-09-12T17:37:13.753 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.753 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.753 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command rotate-key cmddesc rotate-key hook 0x563a3dfc3b50 EEXIST 2024-09-12T17:37:13.753 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: _reopen_session rank -1 2024-09-12T17:37:13.754 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:37:13.754 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-b con 0x563a3dfec630 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:37:13.754 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-c con 0x563a3dfebf60 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:37:13.754 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-a con 0x563a3dfea940 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:37:13.754 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.754 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.754 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.754 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient(hunting): _renew_subs 2024-09-12T17:37:13.754 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient(hunting): authenticate will time out at 2601.346947s 2024-09-12T17:37:13.754 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:37:13.310+0000 7fe149f10640 10 monclient(hunting): get_auth_request con 0x563a3dfebf60 auth_method 0 2024-09-12T17:37:13.754 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:37:13.310+0000 7fe149f10640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.754 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:37:13.310+0000 7fe149f10640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.754 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:37:13.310+0000 7fe149f10640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.755 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient(hunting): get_auth_request con 0x563a3dfea940 auth_method 0 2024-09-12T17:37:13.755 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.755 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.755 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.755 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:13.755 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:13.755 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:13.755 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:37:13.310+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:13.755 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:37:13.310+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:13.755 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:37:13.310+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:13.755 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:37:13.310+0000 7fe148f0e640 10 monclient(hunting): get_auth_request con 0x563a3dfec630 auth_method 0 2024-09-12T17:37:13.755 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:37:13.310+0000 7fe148f0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.756 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:37:13.310+0000 7fe148f0e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.756 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:37:13.310+0000 7fe148f0e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.756 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient(hunting): handle_auth_done global_id 7566 payload 824 2024-09-12T17:37:13.756 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient: _finish_hunting 0 2024-09-12T17:37:13.756 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:37:13.310+0000 7fe14970f640 1 monclient: found mon.noname-a 2024-09-12T17:37:13.756 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:37:13.310+0000 7fe14970f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.756 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.756 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:13.757 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: dump: 2024-09-12T17:37:13.757 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.757 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.757 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.757 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.757 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.757 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.757 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.757 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.757 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.757 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.757 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: _finish_auth 0 2024-09-12T17:37:13.757 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: _check_auth_tickets 2024-09-12T17:37:13.758 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:13.758 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.758 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:13.758 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:37:13.310+0000 7fe02effd640 10 monclient: dump: 2024-09-12T17:37:13.758 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.758 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.758 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.758 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.758 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.758 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.758 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.758 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.759 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.759 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.759 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 5 monclient: authenticate success, global_id 7566 2024-09-12T17:37:13.759 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:37:13.310+0000 7fe14a711640 4 set_mon_vals no callback set 2024-09-12T17:37:13.759 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: _renew_subs 2024-09-12T17:37:13.759 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.759 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: _renew_subs 2024-09-12T17:37:13.759 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:37:13.310+0000 7fe14bc099c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.759 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:37:13.314+0000 7fe02effd640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:37:13.759 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:37:13.314+0000 7fe02effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:13.759 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:37:13.314+0000 7fe02effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:13.759 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient: get_monmap_and_config 2024-09-12T17:37:13.760 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient: build_initial_monmap 2024-09-12T17:37:13.760 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 1 build_initial for_mkfs: 0 2024-09-12T17:37:13.760 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient: monmap: 2024-09-12T17:37:13.760 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:37:13.760 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:13.760 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:37:13.760 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:37:13.760 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:13.760 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.760 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:37:13.760 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:37:13.760 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:37:13.760 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.761 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding auth protocol: cephx 2024-09-12T17:37:13.761 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding auth protocol: cephx 2024-09-12T17:37:13.761 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding auth protocol: cephx 2024-09-12T17:37:13.761 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: secure 2024-09-12T17:37:13.761 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: crc 2024-09-12T17:37:13.761 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: secure 2024-09-12T17:37:13.761 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: crc 2024-09-12T17:37:13.761 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: secure 2024-09-12T17:37:13.761 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: crc 2024-09-12T17:37:13.761 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: crc 2024-09-12T17:37:13.761 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: secure 2024-09-12T17:37:13.761 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: crc 2024-09-12T17:37:13.761 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: secure 2024-09-12T17:37:13.761 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: crc 2024-09-12T17:37:13.762 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:37:13.314+0000 7fe148f0e640 10 monclient: get_auth_request con 0x7fe024070a20 auth_method 0 2024-09-12T17:37:13.762 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e00bdd0) adding con mode: secure 2024-09-12T17:37:13.762 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.762 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient: init 2024-09-12T17:37:13.762 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding auth protocol: cephx 2024-09-12T17:37:13.762 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding auth protocol: cephx 2024-09-12T17:37:13.762 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding auth protocol: cephx 2024-09-12T17:37:13.762 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: secure 2024-09-12T17:37:13.762 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: crc 2024-09-12T17:37:13.762 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: secure 2024-09-12T17:37:13.762 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: crc 2024-09-12T17:37:13.762 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: secure 2024-09-12T17:37:13.762 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: crc 2024-09-12T17:37:13.763 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: crc 2024-09-12T17:37:13.763 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: secure 2024-09-12T17:37:13.763 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: crc 2024-09-12T17:37:13.763 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: secure 2024-09-12T17:37:13.763 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: crc 2024-09-12T17:37:13.763 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c010) adding con mode: secure 2024-09-12T17:37:13.763 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.763 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.763 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command rotate-key cmddesc rotate-key hook 0x7ffec837c158 EEXIST 2024-09-12T17:37:13.763 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient: _reopen_session rank -1 2024-09-12T17:37:13.763 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:37:13.763 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-b con 0x563a3e0402d0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:37:13.763 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-a con 0x563a3e00fcf0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:37:13.764 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-c con 0x563a3e03baa0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:37:13.764 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.764 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.764 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.764 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient(hunting): _renew_subs 2024-09-12T17:37:13.764 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:37:13.314+0000 7fe14bc099c0 10 monclient(hunting): authenticate will time out at 2601.351319s 2024-09-12T17:37:13.764 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient(hunting): get_auth_request con 0x563a3e00fcf0 auth_method 0 2024-09-12T17:37:13.764 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.764 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.764 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.764 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:37:13.314+0000 7fe14970f640 10 monclient(hunting): get_auth_request con 0x563a3e03baa0 auth_method 0 2024-09-12T17:37:13.764 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:37:13.314+0000 7fe14970f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.764 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:37:13.314+0000 7fe14970f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.765 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:37:13.314+0000 7fe14970f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.765 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:13.765 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:13.765 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:13.765 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:37:13.314+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:13.765 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:37:13.314+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:13.765 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:37:13.314+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:13.765 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:37:13.314+0000 7fe148f0e640 10 monclient(hunting): get_auth_request con 0x563a3e0402d0 auth_method 0 2024-09-12T17:37:13.765 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:37:13.314+0000 7fe148f0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.765 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:37:13.314+0000 7fe148f0e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.765 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:37:13.314+0000 7fe148f0e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.765 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient(hunting): handle_auth_done global_id 7569 payload 274 2024-09-12T17:37:13.765 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient: _finish_hunting 0 2024-09-12T17:37:13.766 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:37:13.314+0000 7fe149f10640 1 monclient: found mon.noname-a 2024-09-12T17:37:13.766 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:37:13.314+0000 7fe149f10640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.766 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.766 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:13.766 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: dump: 2024-09-12T17:37:13.766 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.766 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.766 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.766 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.766 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.766 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.767 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.767 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.767 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.767 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.767 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: _finish_auth 0 2024-09-12T17:37:13.767 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: _check_auth_tickets 2024-09-12T17:37:13.767 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:13.767 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 monclient: authenticate success, global_id 7569 2024-09-12T17:37:13.767 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: get_monmap_and_config success 2024-09-12T17:37:13.767 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 4 set_mon_vals no callback set 2024-09-12T17:37:13.767 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.767 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:13.767 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:37:13.318+0000 7fe02cff9640 10 monclient: dump: 2024-09-12T17:37:13.768 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.768 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.768 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.768 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.768 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.768 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.768 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.768 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.768 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.768 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.768 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: shutdown 2024-09-12T17:37:13.768 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: build_initial_monmap 2024-09-12T17:37:13.768 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 1 build_initial for_mkfs: 0 2024-09-12T17:37:13.768 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: monmap: 2024-09-12T17:37:13.768 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:37:13.769 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:13.769 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:37:13.769 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:37:13.769 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:13.769 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.769 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:37:13.769 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:37:13.769 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:37:13.769 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.769 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding auth protocol: cephx 2024-09-12T17:37:13.769 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding auth protocol: cephx 2024-09-12T17:37:13.770 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding auth protocol: cephx 2024-09-12T17:37:13.770 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: secure 2024-09-12T17:37:13.770 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: crc 2024-09-12T17:37:13.770 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: secure 2024-09-12T17:37:13.770 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: crc 2024-09-12T17:37:13.770 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: secure 2024-09-12T17:37:13.770 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: crc 2024-09-12T17:37:13.770 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: crc 2024-09-12T17:37:13.770 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: secure 2024-09-12T17:37:13.770 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: crc 2024-09-12T17:37:13.770 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: secure 2024-09-12T17:37:13.770 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: crc 2024-09-12T17:37:13.770 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3e032810) adding con mode: secure 2024-09-12T17:37:13.771 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.771 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 1 librados: starting msgr at 2024-09-12T17:37:13.771 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 1 librados: starting objecter 2024-09-12T17:37:13.771 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command objecter_requests cmddesc objecter_requests hook 0x563a3dff2170 EEXIST 2024-09-12T17:37:13.771 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 1 librados: setting wanted keys 2024-09-12T17:37:13.771 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 1 librados: calling monclient init 2024-09-12T17:37:13.771 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: init 2024-09-12T17:37:13.771 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding auth protocol: cephx 2024-09-12T17:37:13.771 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding auth protocol: cephx 2024-09-12T17:37:13.771 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding auth protocol: cephx 2024-09-12T17:37:13.771 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: secure 2024-09-12T17:37:13.771 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: crc 2024-09-12T17:37:13.772 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: secure 2024-09-12T17:37:13.772 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: crc 2024-09-12T17:37:13.772 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: secure 2024-09-12T17:37:13.772 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: crc 2024-09-12T17:37:13.772 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: crc 2024-09-12T17:37:13.772 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: secure 2024-09-12T17:37:13.772 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: crc 2024-09-12T17:37:13.772 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: secure 2024-09-12T17:37:13.772 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: crc 2024-09-12T17:37:13.772 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 AuthRegistry(0x563a3dfee450) adding con mode: secure 2024-09-12T17:37:13.772 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.773 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.773 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command rotate-key cmddesc rotate-key hook 0x563a3dfee598 EEXIST 2024-09-12T17:37:13.773 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: _reopen_session rank -1 2024-09-12T17:37:13.773 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:37:13.773 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-a con 0x563a3e00fcf0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:37:13.773 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-b con 0x563a3e03baa0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:37:13.773 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient(hunting): picked mon.noname-c con 0x563a3e0402d0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:37:13.773 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.773 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.773 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:13.773 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient(hunting): _renew_subs 2024-09-12T17:37:13.773 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient(hunting): authenticate will time out at 2601.353921s 2024-09-12T17:37:13.773 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient(hunting): get_auth_request con 0x563a3e00fcf0 auth_method 0 2024-09-12T17:37:13.774 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.774 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.774 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.774 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:37:13.318+0000 7fe14970f640 10 monclient(hunting): get_auth_request con 0x563a3e0402d0 auth_method 0 2024-09-12T17:37:13.774 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:37:13.318+0000 7fe14970f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.774 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:37:13.318+0000 7fe14970f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.774 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:37:13.318+0000 7fe14970f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.774 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:37:13.318+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:13.774 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:37:13.318+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:13.774 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:37:13.318+0000 7fe14970f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:13.774 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:13.774 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:13.774 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:13.775 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:37:13.318+0000 7fe149f10640 10 monclient(hunting): get_auth_request con 0x563a3e03baa0 auth_method 0 2024-09-12T17:37:13.775 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:37:13.318+0000 7fe149f10640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:13.775 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:37:13.318+0000 7fe149f10640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:13.775 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:37:13.318+0000 7fe149f10640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:13.775 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient(hunting): handle_auth_done global_id 7572 payload 824 2024-09-12T17:37:13.775 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient: _finish_hunting 0 2024-09-12T17:37:13.775 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:37:13.318+0000 7fe148f0e640 1 monclient: found mon.noname-a 2024-09-12T17:37:13.775 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:37:13.318+0000 7fe148f0e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.775 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.775 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:13.775 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: dump: 2024-09-12T17:37:13.775 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.775 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.775 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.776 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.776 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.776 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.776 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.776 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.776 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.776 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.776 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: _finish_auth 0 2024-09-12T17:37:13.776 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: _check_auth_tickets 2024-09-12T17:37:13.776 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:13.776 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:13.776 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:13.776 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:37:13.318+0000 7fe01affd640 10 monclient: dump: 2024-09-12T17:37:13.776 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:13.777 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:13.777 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.777 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:13.777 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:13.777 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:13.777 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:13.777 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:13.777 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:13.777 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.777 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:37:13.318+0000 7fe02cff9640 4 set_mon_vals no callback set 2024-09-12T17:37:13.777 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 monclient: authenticate success, global_id 7572 2024-09-12T17:37:13.777 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: _renew_subs 2024-09-12T17:37:13.778 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.778 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: _renew_subs 2024-09-12T17:37:13.778 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.778 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 1 librados: init done 2024-09-12T17:37:13.778 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:37:13.318+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command cr dump hook 0x563a3e038d58 2024-09-12T17:37:13.778 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.778 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:37:13.322+0000 7fe01affd640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:37:13.778 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:37:13.322+0000 7fe01affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:13.778 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:37:13.322+0000 7fe01affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:13.778 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:37:13.322+0000 7fe149f10640 10 monclient: get_auth_request con 0x7fe014070b10 auth_method 0 2024-09-12T17:37:13.778 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:37:13.322+0000 7fe14970f640 10 monclient: get_auth_request con 0x563a3e05a240 auth_method 0 2024-09-12T17:37:13.778 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.778 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 realm 2024-09-12T17:37:13.778 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.779 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.779 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:13.779 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.779 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.779 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:37:13.322+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.779 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:37:13.322+0000 7fe148f0e640 10 monclient: get_auth_request con 0x563a3e05e450 auth_method 0 2024-09-12T17:37:13.779 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:37:13.326+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:13.779 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:37:13.326+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.779 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:37:13.326+0000 7fe149f10640 10 monclient: get_auth_request con 0x563a3e061cb0 auth_method 0 2024-09-12T17:37:13.779 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:37:13.326+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:13.779 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:37:13.326+0000 7fe14bc099c0 20 searching for the correct realm 2024-09-12T17:37:13.780 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:37:13.326+0000 7fe14970f640 10 monclient: get_auth_request con 0x563a3e066a70 auth_method 0 2024-09-12T17:37:13.780 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:37:13.326+0000 7fe148f0e640 0 -- 172.21.15.119:0/3641355234 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fe13c008050 msgr2=0x7fe13c07cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:13.780 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:37:13.530+0000 7fe148f0e640 10 monclient: get_auth_request con 0x7fe13c008050 auth_method 0 2024-09-12T17:37:13.780 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:37:13.530+0000 7fe149f10640 10 monclient: get_auth_request con 0x7fe14004d060 auth_method 0 2024-09-12T17:37:13.780 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:37:13.538+0000 7fe14970f640 10 monclient: get_auth_request con 0x7fe1440db040 auth_method 0 2024-09-12T17:37:13.780 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:37:13.542+0000 7fe149f10640 0 -- 172.21.15.119:0/3641355234 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fe14004d060 msgr2=0x7fe14004f780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:13.780 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:37:13.542+0000 7fe01affd640 1 client.7572.objecter ms_handle_reset 0x7fe14004d060 session 0x7fe14003f040 osd.2 2024-09-12T17:37:13.780 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:37:13.542+0000 7fe01affd640 10 monclient: _renew_subs 2024-09-12T17:37:13.780 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:37:13.542+0000 7fe01affd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:13.780 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:37:13.542+0000 7fe149f10640 10 monclient: get_auth_request con 0x7fe0140812c0 auth_method 0 2024-09-12T17:37:13.780 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:37:13.546+0000 7fe148f0e640 10 monclient: get_auth_request con 0x563a3de2c900 auth_method 0 2024-09-12T17:37:13.780 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:13.780 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:13.780 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:13.781 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:13.781 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:13.781 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:13.781 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.781 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.781 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.781 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:13.781 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.781 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:13.781 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 20 zone default found 2024-09-12T17:37:13.781 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 4 Realm: () 2024-09-12T17:37:13.781 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:13.781 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:13.781 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:37:13.558+0000 7fe14bc099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:13.782 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 zonegroup default 2024-09-12T17:37:13.782 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.782 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.782 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.782 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.782 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.782 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.782 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 started sync module instance, tier type = 2024-09-12T17:37:13.782 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:37:13.562+0000 7fe14bc099c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:13.782 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=0 2024-09-12T17:37:13.782 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=1 2024-09-12T17:37:13.782 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=2 2024-09-12T17:37:13.782 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=3 2024-09-12T17:37:13.782 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=4 2024-09-12T17:37:13.783 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=5 2024-09-12T17:37:13.783 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:37:13.582+0000 7fe14bc099c0 20 add_watcher() i=6 2024-09-12T17:37:13.783 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:37:13.586+0000 7fe14bc099c0 20 add_watcher() i=7 2024-09-12T17:37:13.783 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:37:13.586+0000 7fe14bc099c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:13.783 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding auth protocol: cephx 2024-09-12T17:37:13.783 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding auth protocol: cephx 2024-09-12T17:37:13.783 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding auth protocol: cephx 2024-09-12T17:37:13.783 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: secure 2024-09-12T17:37:13.783 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: crc 2024-09-12T17:37:13.783 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: secure 2024-09-12T17:37:13.783 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: crc 2024-09-12T17:37:13.783 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: secure 2024-09-12T17:37:13.783 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: crc 2024-09-12T17:37:13.784 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: crc 2024-09-12T17:37:13.784 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: secure 2024-09-12T17:37:13.784 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: crc 2024-09-12T17:37:13.784 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: secure 2024-09-12T17:37:13.784 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: crc 2024-09-12T17:37:13.784 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 AuthRegistry(0x7ffec837c4e0) adding con mode: secure 2024-09-12T17:37:13.784 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:37:13.590+0000 7fdffffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:13.784 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:13.784 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:13.784 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:13.784 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command cache list hook 0x563a3e0397a0 2024-09-12T17:37:13.784 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command cache inspect hook 0x563a3e0397a0 2024-09-12T17:37:13.784 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command cache erase hook 0x563a3e0397a0 2024-09-12T17:37:13.784 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command cache zap hook 0x563a3e0397a0 2024-09-12T17:37:13.785 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 note: GC not initialized 2024-09-12T17:37:13.785 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:37:13.590+0000 7fdffefe5640 20 reqs_thread_entry: start 2024-09-12T17:37:13.785 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command sync trace show hook 0x7fe1400013e0 2024-09-12T17:37:13.785 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command sync trace history hook 0x7fe1400013e0 2024-09-12T17:37:13.785 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command sync trace active hook 0x7fe1400013e0 2024-09-12T17:37:13.785 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 5 asok(0x563a3dd632b0) register_command sync trace active_short hook 0x7fe1400013e0 2024-09-12T17:37:13.785 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:13.785 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 Filter name: none 2024-09-12T17:37:13.785 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:37:13.590+0000 7fdffcfe1640 20 reqs_thread_entry: start 2024-09-12T17:37:13.785 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:37:13.785 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.785 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:13.786 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:37:13.786 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:37:13.786 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 : miss 2024-09-12T17:37:13.786 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:37:13.590+0000 7fe14bc099c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.786 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:37:13.594+0000 7fe14bc099c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:37:13.786 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:37:13.594+0000 7fe14bc099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:13.786 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:37:13.594+0000 7fe14bc099c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:13.786 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:37:13.594+0000 7fe14bc099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:13.786 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:37:13.594+0000 7fe14bc099c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:13.786 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:37:13.594+0000 7fe14bc099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 2024-09-12T17:37:13.786 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:37:13.602+0000 7fe14bc099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:13.786 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:37:13.602+0000 7fe14bc099c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:13.786 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:37:13.602+0000 7fe14bc099c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:13.786 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:37:13.602+0000 7fe14bc099c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35, ofs0, ns] 2024-09-12T17:37:13.787 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:37:13.602+0000 7fe02cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333511 cookie 94808148727440 notifier 7572 bl.length()=995 2024-09-12T17:37:13.787 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:37:13.602+0000 7fe02cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:13.787 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:37:13.602+0000 7fe02cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:13.787 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:37:13.602+0000 7fe02cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:13.787 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:37:13.606+0000 7fe14bc099c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): orig_sources= new_sources= 2024-09-12T17:37:13.787 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:37:13.606+0000 7fe14bc099c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): potential sources added=[] removed=[] 2024-09-12T17:37:13.787 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:37:13.606+0000 7fe14bc099c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): orig_dests= new_dests= 2024-09-12T17:37:13.787 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:37:13.606+0000 7fe14bc099c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): potential dests added=[] removed=[] 2024-09-12T17:37:13.787 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:37:13.618+0000 7fe14bc099c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe14bc099c0 time 2024-09-12T17:37:13.619903+0000 2024-09-12T17:37:13.787 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:37:13.787 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.787 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:13.787 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe14f4e32eb] 2024-09-12T17:37:13.788 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe14f4e349f] 2024-09-12T17:37:13.788 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a3b9210c1] 2024-09-12T17:37:13.788 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563a3b9331fa] 2024-09-12T17:37:13.788 INFO:tasks.workunit.client.0.smithi119.stderr: 5: main() 2024-09-12T17:37:13.788 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe14e349d90] 2024-09-12T17:37:13.788 INFO:tasks.workunit.client.0.smithi119.stderr: 7: __libc_start_main() 2024-09-12T17:37:13.788 INFO:tasks.workunit.client.0.smithi119.stderr: 8: _start() 2024-09-12T17:37:13.788 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.788 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:37:13.622+0000 7fe14bc099c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:37:13.788 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fe14bc099c0 thread_name:radosgw-admin 2024-09-12T17:37:13.789 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.789 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:13.789 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe14e362520] 2024-09-12T17:37:13.789 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:37:13.789 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:37:13.789 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:37:13.789 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe14f4e3345] 2024-09-12T17:37:13.789 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe14f4e349f] 2024-09-12T17:37:13.789 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a3b9210c1] 2024-09-12T17:37:13.789 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563a3b9331fa] 2024-09-12T17:37:13.789 INFO:tasks.workunit.client.0.smithi119.stderr: 9: main() 2024-09-12T17:37:13.789 INFO:tasks.workunit.client.0.smithi119.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe14e349d90] 2024-09-12T17:37:13.789 INFO:tasks.workunit.client.0.smithi119.stderr: 11: __libc_start_main() 2024-09-12T17:37:13.789 INFO:tasks.workunit.client.0.smithi119.stderr: 12: _start() 2024-09-12T17:37:13.790 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:37:13.790 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:13.790 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:37:13.790 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:37:13.790 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:37:13.790 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:37:13.790 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:37:13.790 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:37:13.790 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:37:13.790 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:37:13.790 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:37:13.790 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:37:13.790 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:37:13.790 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:37:13.790 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:37:13.791 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:37:13.791 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:37:13.791 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:37:13.791 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:37:13.791 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:37:13.791 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:37:13.791 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:37:13.791 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:37:13.791 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:37:13.791 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:37:13.791 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:37:13.791 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:37:13.791 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:37:13.791 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:37:13.792 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:37:13.792 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:37:13.792 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:37:13.792 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:37:13.792 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:37:13.792 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:37:13.792 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:37:13.792 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:37:13.792 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:37:13.792 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:37:13.792 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:37:13.792 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:37:13.792 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:37:13.792 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:37:13.793 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:37:13.793 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:37:13.793 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:37:13.793 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:37:13.793 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:37:13.793 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:37:13.793 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:37:13.793 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:37:13.793 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:37:13.794 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:37:13.794 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:37:13.794 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:37:13.794 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:37:13.794 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:37:13.794 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:37:13.794 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:37:13.794 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:37:13.794 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:37:13.794 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:37:13.794 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:37:13.794 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:37:13.794 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:37:13.794 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:37:13.795 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:37:13.795 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:37:13.795 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:37:13.795 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:37:13.795 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:37:13.795 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:37:13.795 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:37:13.795 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:37:13.795 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:37:13.795 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:37:13.795 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:37:13.795 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:37:13.795 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:37:13.795 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:37:13.796 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:37:13.796 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:37:13.796 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:37:13.796 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:37:13.796 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:37:13.796 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:37:13.796 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:37:13.796 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:37:13.796 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:37:13.796 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:37:13.796 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:37:13.796 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:37:13.796 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:37:13.796 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:37:13.797 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:37:13.797 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:37:13.797 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdffcfe1640 / http_manager 2024-09-12T17:37:13.797 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdffefe5640 / http_manager 2024-09-12T17:37:13.797 INFO:tasks.workunit.client.0.smithi119.stderr: 7fdffffe7640 / rgw_dt_lg_renew 2024-09-12T17:37:13.797 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe01affd640 / ms_dispatch 2024-09-12T17:37:13.797 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe02cff9640 / io_context_pool 2024-09-12T17:37:13.797 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe02effd640 / ms_dispatch 2024-09-12T17:37:13.797 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe035e03640 / ms_dispatch 2024-09-12T17:37:13.797 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe037606640 / io_context_pool 2024-09-12T17:37:13.797 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe148f0e640 / msgr-worker-2 2024-09-12T17:37:13.797 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe14970f640 / msgr-worker-1 2024-09-12T17:37:13.797 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe149f10640 / msgr-worker-0 2024-09-12T17:37:13.797 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe14a711640 / io_context_pool 2024-09-12T17:37:13.797 INFO:tasks.workunit.client.0.smithi119.stderr: 7fe14bc099c0 / radosgw-admin 2024-09-12T17:37:13.798 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:37:13.798 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:37:13.798 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:37:13.625498Z_d5d0841b-00c8-4c16-9298-d94868caa63d/log 2024-09-12T17:37:13.798 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:37:13.798 INFO:tasks.workunit.client.0.smithi119.stderr:Aborted 2024-09-12T17:37:13.798 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:37:13.798 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:13.798 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:13.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.710+0000 7fa7d48f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.714+0000 7fa7d48f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.714+0000 7fa7d48f79c0 20 realm 2024-09-12T17:37:13.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.714+0000 7fa7d48f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.714+0000 7fa7d48f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.714+0000 7fa7d48f79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:13.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.714+0000 7fa7d48f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.714+0000 7fa7d48f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.714+0000 7fa7d48f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.714+0000 7fa7d48f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:13.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.714+0000 7fa7d48f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.718+0000 7fa7d48f79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:13.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.718+0000 7fa7d48f79c0 20 searching for the correct realm 2024-09-12T17:37:13.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.718+0000 7fa7d2bfe640 0 -- 172.21.15.119:0/3116122727 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fa7c802c040 msgr2=0x7fa7c8067010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:13.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.726+0000 7fa7d1bfc640 0 -- 172.21.15.119:0/3116122727 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fa7cc0f3040 msgr2=0x7fa7cc112ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:13.944 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.942+0000 7fa7d48f79c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:13.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.942+0000 7fa7d48f79c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:13.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.942+0000 7fa7d48f79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:13.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.942+0000 7fa7d48f79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:13.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.942+0000 7fa7d48f79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:13.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.942+0000 7fa7d48f79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:13.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.942+0000 7fa7d48f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.942+0000 7fa7d48f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.942+0000 7fa7d48f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.946+0000 7fa7d48f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:13.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.946+0000 7fa7d48f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.946+0000 7fa7d48f79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:13.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.946+0000 7fa7d48f79c0 20 zone default found 2024-09-12T17:37:13.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.946+0000 7fa7d48f79c0 4 Realm: () 2024-09-12T17:37:13.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.946+0000 7fa7d48f79c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:13.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.946+0000 7fa7d48f79c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:13.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.946+0000 7fa7d48f79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:13.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.946+0000 7fa7d48f79c0 20 zonegroup default 2024-09-12T17:37:13.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.946+0000 7fa7d48f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.946+0000 7fa7d48f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.946+0000 7fa7d48f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.946+0000 7fa7d48f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.946+0000 7fa7d48f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.950+0000 7fa7d48f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:13.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.950+0000 7fa7d48f79c0 20 started sync module instance, tier type = 2024-09-12T17:37:13.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.950+0000 7fa7d48f79c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:13.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.970+0000 7fa7d48f79c0 20 add_watcher() i=0 2024-09-12T17:37:13.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.970+0000 7fa7d48f79c0 20 add_watcher() i=1 2024-09-12T17:37:13.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.970+0000 7fa7d48f79c0 20 add_watcher() i=2 2024-09-12T17:37:13.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.970+0000 7fa7d48f79c0 20 add_watcher() i=3 2024-09-12T17:37:13.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.970+0000 7fa7d48f79c0 20 add_watcher() i=4 2024-09-12T17:37:13.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.970+0000 7fa7d48f79c0 20 add_watcher() i=5 2024-09-12T17:37:13.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.970+0000 7fa7d48f79c0 20 add_watcher() i=6 2024-09-12T17:37:13.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.974+0000 7fa7d48f79c0 20 add_watcher() i=7 2024-09-12T17:37:13.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.974+0000 7fa7d48f79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:13.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.978+0000 7fa688fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:13.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.978+0000 7fa7d48f79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:13.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.978+0000 7fa7d48f79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:13.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.978+0000 7fa7d48f79c0 5 note: GC not initialized 2024-09-12T17:37:13.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.978+0000 7fa6037fe640 20 reqs_thread_entry: start 2024-09-12T17:37:13.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.978+0000 7fa7d48f79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:13.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.978+0000 7fa7d48f79c0 20 Filter name: none 2024-09-12T17:37:13.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.978+0000 7fa6017fa640 20 reqs_thread_entry: start 2024-09-12T17:37:13.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.978+0000 7fa7d48f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.982+0000 7fa7d48f79c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:13.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.982+0000 7fa7d48f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.982+0000 7fa7d48f79c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:37:13.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.982+0000 7fa7d48f79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:13.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.982+0000 7fa7d48f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.982+0000 7fa7d48f79c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:13.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.982+0000 7fa7d48f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:13.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.982+0000 7fa7d48f79c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:37:13.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.982+0000 7fa7d48f79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:13.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.986+0000 7fa688fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:13.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.990+0000 7fa7d48f79c0 20 remove_watcher() i=0 2024-09-12T17:37:13.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.990+0000 7fa7d48f79c0 2 removed watcher, disabling cache 2024-09-12T17:37:13.994 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.994+0000 7fa7d48f79c0 20 remove_watcher() i=1 2024-09-12T17:37:13.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.994+0000 7fa7d48f79c0 20 remove_watcher() i=2 2024-09-12T17:37:13.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.998+0000 7fa7d48f79c0 20 remove_watcher() i=3 2024-09-12T17:37:14.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:13.998+0000 7fa7d48f79c0 20 remove_watcher() i=4 2024-09-12T17:37:14.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.002+0000 7fa7d48f79c0 20 remove_watcher() i=5 2024-09-12T17:37:14.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.002+0000 7fa7d48f79c0 20 remove_watcher() i=6 2024-09-12T17:37:14.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.002+0000 7fa7d48f79c0 20 remove_watcher() i=7 2024-09-12T17:37:14.019 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:14.019 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:37:14.019 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-do-reshard id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:37:14.020 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:14.159 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:37:14.197 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:14.197 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:14.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.242+0000 7fd215fbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:14.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.242+0000 7fd215fbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:14.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.242+0000 7fd215fbf9c0 20 realm 2024-09-12T17:37:14.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.242+0000 7fd215fbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:14.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.242+0000 7fd215fbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:14.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.242+0000 7fd215fbf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:14.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.242+0000 7fd215fbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:14.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.242+0000 7fd215fbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:14.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.242+0000 7fd215fbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:14.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.246+0000 7fd215fbf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:14.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.246+0000 7fd215fbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:14.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.246+0000 7fd215fbf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:14.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.246+0000 7fd215fbf9c0 20 searching for the correct realm 2024-09-12T17:37:14.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.250+0000 7fd2142c6640 0 -- 172.21.15.119:0/2443927190 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fd2080edb10 msgr2=0x7fd2080d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:14.468 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.466+0000 7fd2132c4640 0 -- 172.21.15.119:0/2443927190 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fd20c066b50 msgr2=0x7fd20c078980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:14.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.682+0000 7fd215fbf9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:14.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.682+0000 7fd215fbf9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:14.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.682+0000 7fd215fbf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:14.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.682+0000 7fd215fbf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:14.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.682+0000 7fd215fbf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:14.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.682+0000 7fd215fbf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:14.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.682+0000 7fd215fbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:14.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.682+0000 7fd215fbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:14.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.682+0000 7fd215fbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:14.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:14.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:14.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:14.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 20 zone default found 2024-09-12T17:37:14.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 4 Realm: () 2024-09-12T17:37:14.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:14.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:14.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:14.686 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 20 zonegroup default 2024-09-12T17:37:14.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:14.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:14.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:14.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:14.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:14.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:14.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 20 started sync module instance, tier type = 2024-09-12T17:37:14.688 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.686+0000 7fd215fbf9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:14.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.710+0000 7fd215fbf9c0 20 add_watcher() i=0 2024-09-12T17:37:14.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.710+0000 7fd215fbf9c0 20 add_watcher() i=1 2024-09-12T17:37:14.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.710+0000 7fd215fbf9c0 20 add_watcher() i=2 2024-09-12T17:37:14.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.710+0000 7fd215fbf9c0 20 add_watcher() i=3 2024-09-12T17:37:14.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.710+0000 7fd215fbf9c0 20 add_watcher() i=4 2024-09-12T17:37:14.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.710+0000 7fd215fbf9c0 20 add_watcher() i=5 2024-09-12T17:37:14.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.710+0000 7fd215fbf9c0 20 add_watcher() i=6 2024-09-12T17:37:14.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.710+0000 7fd215fbf9c0 20 add_watcher() i=7 2024-09-12T17:37:14.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.710+0000 7fd215fbf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:14.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.714+0000 7fd0c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:14.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.714+0000 7fd215fbf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:14.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.714+0000 7fd215fbf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:14.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.714+0000 7fd215fbf9c0 5 note: GC not initialized 2024-09-12T17:37:14.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.714+0000 7fd0c8fe1640 20 reqs_thread_entry: start 2024-09-12T17:37:14.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.714+0000 7fd215fbf9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:14.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.714+0000 7fd215fbf9c0 20 Filter name: none 2024-09-12T17:37:14.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.714+0000 7fd0427fc640 20 reqs_thread_entry: start 2024-09-12T17:37:14.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.714+0000 7fd215fbf9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:37:14.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.714+0000 7fd215fbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:14.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.714+0000 7fd215fbf9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:14.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.714+0000 7fd215fbf9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:37:14.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.714+0000 7fd215fbf9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:37:14.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.714+0000 7fd215fbf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 : miss 2024-09-12T17:37:14.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.714+0000 7fd215fbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:14.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.718+0000 7fd215fbf9c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:37:14.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.718+0000 7fd215fbf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:14.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.718+0000 7fd215fbf9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:14.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.718+0000 7fd215fbf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:14.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.718+0000 7fd215fbf9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:14.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.718+0000 7fd215fbf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 2024-09-12T17:37:14.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.718+0000 7fd215fbf9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to be held by another RGW process; skipping for now 2024-09-12T17:37:14.721 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.718+0000 7fd0c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:14.726 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.726+0000 7fd215fbf9c0 20 remove_watcher() i=0 2024-09-12T17:37:14.726 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.726+0000 7fd215fbf9c0 2 removed watcher, disabling cache 2024-09-12T17:37:14.728 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.726+0000 7fd215fbf9c0 20 remove_watcher() i=1 2024-09-12T17:37:14.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.730+0000 7fd215fbf9c0 20 remove_watcher() i=2 2024-09-12T17:37:14.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.730+0000 7fd215fbf9c0 20 remove_watcher() i=3 2024-09-12T17:37:14.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.734+0000 7fd215fbf9c0 20 remove_watcher() i=4 2024-09-12T17:37:14.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.734+0000 7fd215fbf9c0 20 remove_watcher() i=5 2024-09-12T17:37:14.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.738+0000 7fd215fbf9c0 20 remove_watcher() i=6 2024-09-12T17:37:14.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:14.738+0000 7fd215fbf9c0 20 remove_watcher() i=7 2024-09-12T17:37:14.755 INFO:tasks.workunit.client.0.smithi119.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:37:44.777 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:37:44.814 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:44.814 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:44.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:44.864+0000 7fc5fc73d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:44.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:44.864+0000 7fc5fc73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:44.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:44.864+0000 7fc5fc73d9c0 20 realm 2024-09-12T17:37:44.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:44.864+0000 7fc5fc73d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:44.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:44.864+0000 7fc5fc73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:44.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:44.864+0000 7fc5fc73d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:44.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:44.864+0000 7fc5fc73d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:44.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:44.864+0000 7fc5fc73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:44.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:44.864+0000 7fc5fc73d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:44.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:44.868+0000 7fc5fc73d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:44.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:44.868+0000 7fc5fc73d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:44.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:44.868+0000 7fc5fc73d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:44.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:44.868+0000 7fc5fc73d9c0 20 searching for the correct realm 2024-09-12T17:37:44.868 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:44.868+0000 7fc5f9a42640 0 -- 172.21.15.119:0/1143313007 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fc5ec1060b0 msgr2=0x7fc5ec0dd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:45.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.080+0000 7fc5f9a42640 0 -- 172.21.15.119:0/1143313007 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fc5ec1060b0 msgr2=0x7fc5ec0dd040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.100+0000 7fc5fc73d9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.100+0000 7fc5fc73d9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.100+0000 7fc5fc73d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.100+0000 7fc5fc73d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.100+0000 7fc5fc73d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.100+0000 7fc5fc73d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:45.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.100+0000 7fc5fc73d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.100+0000 7fc5fc73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.100+0000 7fc5fc73d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.100+0000 7fc5fc73d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:45.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.100+0000 7fc5fc73d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.104+0000 7fc5fc73d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:45.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.104+0000 7fc5fc73d9c0 20 zone default found 2024-09-12T17:37:45.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.104+0000 7fc5fc73d9c0 4 Realm: () 2024-09-12T17:37:45.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.104+0000 7fc5fc73d9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:45.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.104+0000 7fc5fc73d9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:45.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.104+0000 7fc5fc73d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:45.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.104+0000 7fc5fc73d9c0 20 zonegroup default 2024-09-12T17:37:45.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.104+0000 7fc5fc73d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.104+0000 7fc5fc73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.104+0000 7fc5fc73d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.104+0000 7fc5fc73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.104+0000 7fc5fc73d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.104+0000 7fc5fc73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.104+0000 7fc5fc73d9c0 20 started sync module instance, tier type = 2024-09-12T17:37:45.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.104+0000 7fc5fc73d9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:45.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.128+0000 7fc5fc73d9c0 20 add_watcher() i=0 2024-09-12T17:37:45.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.128+0000 7fc5fc73d9c0 20 add_watcher() i=1 2024-09-12T17:37:45.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.128+0000 7fc5fc73d9c0 20 add_watcher() i=2 2024-09-12T17:37:45.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.128+0000 7fc5fc73d9c0 20 add_watcher() i=3 2024-09-12T17:37:45.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.128+0000 7fc5fc73d9c0 20 add_watcher() i=4 2024-09-12T17:37:45.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.128+0000 7fc5fc73d9c0 20 add_watcher() i=5 2024-09-12T17:37:45.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.128+0000 7fc5fc73d9c0 20 add_watcher() i=6 2024-09-12T17:37:45.130 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.132+0000 7fc5fc73d9c0 20 add_watcher() i=7 2024-09-12T17:37:45.130 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.132+0000 7fc5fc73d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:45.134 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.136+0000 7fc4b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:45.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.136+0000 7fc5fc73d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:45.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.136+0000 7fc5fc73d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:45.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.136+0000 7fc5fc73d9c0 5 note: GC not initialized 2024-09-12T17:37:45.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.136+0000 7fc42b7fe640 20 reqs_thread_entry: start 2024-09-12T17:37:45.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.136+0000 7fc5fc73d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:45.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.136+0000 7fc5fc73d9c0 20 Filter name: none 2024-09-12T17:37:45.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.136+0000 7fc4297fa640 20 reqs_thread_entry: start 2024-09-12T17:37:45.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.136+0000 7fc5fc73d9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:37:45.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.136+0000 7fc5fc73d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.136+0000 7fc5fc73d9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:45.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.136+0000 7fc5fc73d9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:37:45.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.136+0000 7fc5fc73d9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:37:45.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.136+0000 7fc5fc73d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 : miss 2024-09-12T17:37:45.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.136+0000 7fc5fc73d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.140+0000 7fc5fc73d9c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:37:45.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.140+0000 7fc5fc73d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:45.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.140+0000 7fc5fc73d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:45.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.140+0000 7fc5fc73d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:45.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.140+0000 7fc5fc73d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:45.138 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.140+0000 7fc5fc73d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 2024-09-12T17:37:45.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.140+0000 7fc5fc73d9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:37:45.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.156+0000 7fc5fc73d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:45.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.156+0000 7fc5fc73d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:45.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.156+0000 7fc5fc73d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:45.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.156+0000 7fc5fc73d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35, ofs0, ns] 2024-09-12T17:37:45.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.156+0000 7fc4dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333512 cookie 93831540914976 notifier 7184 bl.length()=995 2024-09-12T17:37:45.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.156+0000 7fc4dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:45.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.156+0000 7fc4dd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:45.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.156+0000 7fc4dd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:45.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.160+0000 7fc5fc73d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): orig_sources= new_sources= 2024-09-12T17:37:45.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.160+0000 7fc5fc73d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): potential sources added=[] removed=[] 2024-09-12T17:37:45.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.160+0000 7fc5fc73d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): orig_dests= new_dests= 2024-09-12T17:37:45.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.160+0000 7fc5fc73d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): potential dests added=[] removed=[] 2024-09-12T17:37:45.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.0 2024-09-12T17:37:45.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.0 2024-09-12T17:37:45.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.1 2024-09-12T17:37:45.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.1 2024-09-12T17:37:45.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.2 2024-09-12T17:37:45.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.2 2024-09-12T17:37:45.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.3 2024-09-12T17:37:45.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.3 2024-09-12T17:37:45.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.4 2024-09-12T17:37:45.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.4 2024-09-12T17:37:45.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.5 2024-09-12T17:37:45.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.5 2024-09-12T17:37:45.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.6 2024-09-12T17:37:45.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.6 2024-09-12T17:37:45.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.7 2024-09-12T17:37:45.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.7 2024-09-12T17:37:45.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.8 2024-09-12T17:37:45.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.8 2024-09-12T17:37:45.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.9 2024-09-12T17:37:45.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.9 2024-09-12T17:37:45.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.10 2024-09-12T17:37:45.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.10 2024-09-12T17:37:45.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.11 2024-09-12T17:37:45.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2.11 2024-09-12T17:37:45.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.0 2024-09-12T17:37:45.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.168+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.1 2024-09-12T17:37:45.171 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.172+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2 2024-09-12T17:37:45.171 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.172+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.3 2024-09-12T17:37:45.171 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.172+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.4 2024-09-12T17:37:45.173 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.172+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.5 2024-09-12T17:37:45.174 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.176+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.6 2024-09-12T17:37:45.174 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.176+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.7 2024-09-12T17:37:45.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.176+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.8 2024-09-12T17:37:45.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.176+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.9 2024-09-12T17:37:45.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.176+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.10 2024-09-12T17:37:45.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.184+0000 7fc5fc73d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:37:45.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.184+0000 7fc5fc73d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 2024-09-12T17:37:45.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.184+0000 7fc5fc73d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:45.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.184+0000 7fc5fc73d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:45.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.184+0000 7fc5fc73d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:45.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.184+0000 7fc5fc73d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35, ofs0, ns] 2024-09-12T17:37:45.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.184+0000 7fc4ddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333513 cookie 93831540914976 notifier 7184 bl.length()=995 2024-09-12T17:37:45.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.188+0000 7fc4ddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:45.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.188+0000 7fc4ddffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:45.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.188+0000 7fc4ddffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:45.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.188+0000 7fc5fc73d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): orig_sources= new_sources= 2024-09-12T17:37:45.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.188+0000 7fc5fc73d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): potential sources added=[] removed=[] 2024-09-12T17:37:45.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.188+0000 7fc5fc73d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): orig_dests= new_dests= 2024-09-12T17:37:45.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.188+0000 7fc5fc73d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): potential dests added=[] removed=[] 2024-09-12T17:37:45.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.192+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.0 2024-09-12T17:37:45.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.192+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.1 2024-09-12T17:37:45.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.196+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.2 2024-09-12T17:37:45.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.196+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.3 2024-09-12T17:37:45.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.196+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.4 2024-09-12T17:37:45.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.196+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.5 2024-09-12T17:37:45.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.196+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.6 2024-09-12T17:37:45.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.196+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.7 2024-09-12T17:37:45.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.196+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.8 2024-09-12T17:37:45.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.200+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.9 2024-09-12T17:37:45.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.200+0000 7fc5fc73d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35.10 2024-09-12T17:37:45.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.200+0000 7fc5fc73d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:37:45.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.200+0000 7fc5fc73d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 2024-09-12T17:37:45.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.200+0000 7fc5fc73d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:45.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.200+0000 7fc5fc73d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:45.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.200+0000 7fc5fc73d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:45.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.200+0000 7fc5fc73d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35, ofs0, ns] 2024-09-12T17:37:45.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.200+0000 7fc4ddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333514 cookie 93831540914976 notifier 7184 bl.length()=963 2024-09-12T17:37:45.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.200+0000 7fc4ddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 info.flags=0x17 2024-09-12T17:37:45.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.200+0000 7fc4ddffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 to cache LRU end 2024-09-12T17:37:45.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.200+0000 7fc4ddffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:45.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.204+0000 7fc5fc73d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): orig_sources= new_sources= 2024-09-12T17:37:45.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.204+0000 7fc5fc73d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): potential sources added=[] removed=[] 2024-09-12T17:37:45.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.204+0000 7fc5fc73d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): orig_dests= new_dests= 2024-09-12T17:37:45.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.204+0000 7fc5fc73d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35]): potential dests added=[] removed=[] 2024-09-12T17:37:45.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.208+0000 7fc5fc73d9c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T17:37:45.211 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.212+0000 7fc4b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:45.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.216+0000 7fc5fc73d9c0 20 remove_watcher() i=0 2024-09-12T17:37:45.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.216+0000 7fc5fc73d9c0 2 removed watcher, disabling cache 2024-09-12T17:37:45.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.220+0000 7fc5fc73d9c0 20 remove_watcher() i=1 2024-09-12T17:37:45.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.220+0000 7fc5fc73d9c0 20 remove_watcher() i=2 2024-09-12T17:37:45.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.224+0000 7fc5fc73d9c0 20 remove_watcher() i=3 2024-09-12T17:37:45.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.224+0000 7fc5fc73d9c0 20 remove_watcher() i=4 2024-09-12T17:37:45.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.228+0000 7fc5fc73d9c0 20 remove_watcher() i=5 2024-09-12T17:37:45.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.228+0000 7fc5fc73d9c0 20 remove_watcher() i=6 2024-09-12T17:37:45.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.228+0000 7fc5fc73d9c0 20 remove_watcher() i=7 2024-09-12T17:37:45.243 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:37:45.273 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:45.273 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:45.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.320+0000 7fa5a4e069c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.320+0000 7fa5a4e069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.320+0000 7fa5a4e069c0 20 realm 2024-09-12T17:37:45.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.320+0000 7fa5a4e069c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.320+0000 7fa5a4e069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.320+0000 7fa5a4e069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:45.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.320+0000 7fa5a4e069c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.320+0000 7fa5a4e069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.320+0000 7fa5a4e069c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.324+0000 7fa5a4e069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:45.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.324+0000 7fa5a4e069c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.324+0000 7fa5a4e069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:45.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.324+0000 7fa5a4e069c0 20 searching for the correct realm 2024-09-12T17:37:45.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.328+0000 7fa5a310d640 0 -- 172.21.15.119:0/1297230103 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fa59801a040 msgr2=0x7fa59808b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:45.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.336+0000 7fa5a210b640 0 -- 172.21.15.119:0/1297230103 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fa59c0cb920 msgr2=0x7fa59c0df410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:45.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.552+0000 7fa5a4e069c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:45.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.552+0000 7fa5a4e069c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:45.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.552+0000 7fa5a4e069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:45.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.552+0000 7fa5a4e069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:45.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.552+0000 7fa5a4e069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:45.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.552+0000 7fa5a4e069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:45.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.552+0000 7fa5a4e069c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:45.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:45.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 20 zone default found 2024-09-12T17:37:45.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 4 Realm: () 2024-09-12T17:37:45.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:45.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:45.556 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:45.556 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 20 zonegroup default 2024-09-12T17:37:45.556 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.556 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.556 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:45.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 20 started sync module instance, tier type = 2024-09-12T17:37:45.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.556+0000 7fa5a4e069c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:45.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.580+0000 7fa5a4e069c0 20 add_watcher() i=0 2024-09-12T17:37:45.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.580+0000 7fa5a4e069c0 20 add_watcher() i=1 2024-09-12T17:37:45.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.580+0000 7fa5a4e069c0 20 add_watcher() i=2 2024-09-12T17:37:45.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.580+0000 7fa5a4e069c0 20 add_watcher() i=3 2024-09-12T17:37:45.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.580+0000 7fa5a4e069c0 20 add_watcher() i=4 2024-09-12T17:37:45.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.580+0000 7fa5a4e069c0 20 add_watcher() i=5 2024-09-12T17:37:45.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.580+0000 7fa5a4e069c0 20 add_watcher() i=6 2024-09-12T17:37:45.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.584+0000 7fa5a4e069c0 20 add_watcher() i=7 2024-09-12T17:37:45.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.584+0000 7fa5a4e069c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:45.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.588+0000 7fa4597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:45.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.588+0000 7fa5a4e069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:45.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.588+0000 7fa5a4e069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:45.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.588+0000 7fa5a4e069c0 5 note: GC not initialized 2024-09-12T17:37:45.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.588+0000 7fa3d3fff640 20 reqs_thread_entry: start 2024-09-12T17:37:45.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.592+0000 7fa5a4e069c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:45.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.592+0000 7fa5a4e069c0 20 Filter name: none 2024-09-12T17:37:45.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.592+0000 7fa3d1ffb640 20 reqs_thread_entry: start 2024-09-12T17:37:45.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.592+0000 7fa5a4e069c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.592+0000 7fa5a4e069c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:45.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.592+0000 7fa5a4e069c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.592+0000 7fa5a4e069c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:37:45.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.592+0000 7fa5a4e069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:45.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.592+0000 7fa5a4e069c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.596+0000 7fa5a4e069c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:37:45.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.596+0000 7fa5a4e069c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:45.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.596+0000 7fa5a4e069c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:37:45.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.596+0000 7fa5a4e069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:45.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.600+0000 7fa4597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:45.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.604+0000 7fa5a4e069c0 20 remove_watcher() i=0 2024-09-12T17:37:45.603 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.604+0000 7fa5a4e069c0 2 removed watcher, disabling cache 2024-09-12T17:37:45.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.604+0000 7fa5a4e069c0 20 remove_watcher() i=1 2024-09-12T17:37:45.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.608+0000 7fa5a4e069c0 20 remove_watcher() i=2 2024-09-12T17:37:45.609 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.608+0000 7fa5a4e069c0 20 remove_watcher() i=3 2024-09-12T17:37:45.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.612+0000 7fa5a4e069c0 20 remove_watcher() i=4 2024-09-12T17:37:45.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.612+0000 7fa5a4e069c0 20 remove_watcher() i=5 2024-09-12T17:37:45.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.616+0000 7fa5a4e069c0 20 remove_watcher() i=6 2024-09-12T17:37:45.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:45.616+0000 7fa5a4e069c0 20 remove_watcher() i=7 2024-09-12T17:37:45.630 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:45.630 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:37:45.630 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-do-reshard id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:37:45.631 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:46.576 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T17:37:46.576 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:48.798 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:37:48.831 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:48.832 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:48.879 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:48.880+0000 7fb75ef409c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.881 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:48.880+0000 7fb75ef409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.881 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:48.880+0000 7fb75ef409c0 20 realm 2024-09-12T17:37:48.881 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:48.880+0000 7fb75ef409c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.881 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:48.880+0000 7fb75ef409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.881 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:48.880+0000 7fb75ef409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:48.882 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:48.880+0000 7fb75ef409c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.882 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:48.880+0000 7fb75ef409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:48.882 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:48.880+0000 7fb75ef409c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.883 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:48.884+0000 7fb75ef409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:48.883 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:48.884+0000 7fb75ef409c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:48.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:48.884+0000 7fb75ef409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:48.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:48.884+0000 7fb75ef409c0 20 searching for the correct realm 2024-09-12T17:37:48.886 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:48.888+0000 7fb757fff640 0 -- 172.21.15.119:0/4179466398 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fb74c0023a0 msgr2=0x7fb75005b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:49.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.104+0000 7fb75d247640 0 -- 172.21.15.119:0/4179466398 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fb7480da060 msgr2=0x7fb7480d0950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:49.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.120+0000 7fb75ef409c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:49.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.120+0000 7fb75ef409c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:49.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.120+0000 7fb75ef409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:49.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.120+0000 7fb75ef409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:49.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.120+0000 7fb75ef409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:49.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.120+0000 7fb75ef409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:49.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.120+0000 7fb75ef409c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.120+0000 7fb75ef409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.120+0000 7fb75ef409c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.120+0000 7fb75ef409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:49.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.120+0000 7fb75ef409c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.124+0000 7fb75ef409c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:49.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.124+0000 7fb75ef409c0 20 zone default found 2024-09-12T17:37:49.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.124+0000 7fb75ef409c0 4 Realm: () 2024-09-12T17:37:49.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.124+0000 7fb75ef409c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:49.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.124+0000 7fb75ef409c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:49.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.124+0000 7fb75ef409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:49.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.124+0000 7fb75ef409c0 20 zonegroup default 2024-09-12T17:37:49.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.124+0000 7fb75ef409c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.124+0000 7fb75ef409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.124+0000 7fb75ef409c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.124+0000 7fb75ef409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.124+0000 7fb75ef409c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.124 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.124+0000 7fb75ef409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.124 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.124+0000 7fb75ef409c0 20 started sync module instance, tier type = 2024-09-12T17:37:49.124 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.124+0000 7fb75ef409c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:49.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.148+0000 7fb75ef409c0 20 add_watcher() i=0 2024-09-12T17:37:49.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.148+0000 7fb75ef409c0 20 add_watcher() i=1 2024-09-12T17:37:49.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.148+0000 7fb75ef409c0 20 add_watcher() i=2 2024-09-12T17:37:49.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.148+0000 7fb75ef409c0 20 add_watcher() i=3 2024-09-12T17:37:49.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.148+0000 7fb75ef409c0 20 add_watcher() i=4 2024-09-12T17:37:49.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.148+0000 7fb75ef409c0 20 add_watcher() i=5 2024-09-12T17:37:49.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.148+0000 7fb75ef409c0 20 add_watcher() i=6 2024-09-12T17:37:49.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.148+0000 7fb75ef409c0 20 add_watcher() i=7 2024-09-12T17:37:49.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.148+0000 7fb75ef409c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:49.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.152+0000 7fb6137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:49.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.152+0000 7fb75ef409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:49.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.152+0000 7fb75ef409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:49.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.152+0000 7fb75ef409c0 5 note: GC not initialized 2024-09-12T17:37:49.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.152+0000 7fb6127e4640 20 reqs_thread_entry: start 2024-09-12T17:37:49.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.152+0000 7fb75ef409c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:49.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.152+0000 7fb75ef409c0 20 Filter name: none 2024-09-12T17:37:49.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.152+0000 7fb60b7fe640 20 reqs_thread_entry: start 2024-09-12T17:37:49.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.152+0000 7fb75ef409c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.156+0000 7fb75ef409c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:37:49.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.156+0000 7fb75ef409c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.156+0000 7fb75ef409c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:37:49.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.156+0000 7fb75ef409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:49.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.156+0000 7fb75ef409c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.156+0000 7fb75ef409c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:37:49.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.156+0000 7fb75ef409c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.160+0000 7fb75ef409c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:37:49.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.160+0000 7fb75ef409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:49.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.160+0000 7fb6137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:49.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.168+0000 7fb75ef409c0 20 remove_watcher() i=0 2024-09-12T17:37:49.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.168+0000 7fb75ef409c0 2 removed watcher, disabling cache 2024-09-12T17:37:49.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.168+0000 7fb75ef409c0 20 remove_watcher() i=1 2024-09-12T17:37:49.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.172+0000 7fb75ef409c0 20 remove_watcher() i=2 2024-09-12T17:37:49.172 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.172+0000 7fb75ef409c0 20 remove_watcher() i=3 2024-09-12T17:37:49.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.176+0000 7fb75ef409c0 20 remove_watcher() i=4 2024-09-12T17:37:49.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.176+0000 7fb75ef409c0 20 remove_watcher() i=5 2024-09-12T17:37:49.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.180+0000 7fb75ef409c0 20 remove_watcher() i=6 2024-09-12T17:37:49.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.180+0000 7fb75ef409c0 20 remove_watcher() i=7 2024-09-12T17:37:49.203 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:49.203 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:37:49.203 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-logrecord-writes id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:37:49.203 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:49.203 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T17:37:49.242 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:49.242 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:49.288 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.288+0000 7f6d63c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.292+0000 7f6d63c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.292+0000 7f6d63c6b9c0 20 realm 2024-09-12T17:37:49.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.292+0000 7f6d63c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.292+0000 7f6d63c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.292+0000 7f6d63c6b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:49.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.292+0000 7f6d63c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.292+0000 7f6d63c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.292+0000 7f6d63c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.292+0000 7f6d63c6b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:49.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.292+0000 7f6d63c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.296+0000 7f6d63c6b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:49.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.296+0000 7f6d63c6b9c0 20 searching for the correct realm 2024-09-12T17:37:49.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.296+0000 7f6d61f72640 0 -- 172.21.15.119:0/291247446 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f6d4c01f060 msgr2=0x7f6d4c05b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:49.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.512+0000 7f6d60f70640 0 -- 172.21.15.119:0/291247446 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f6d5c0df940 msgr2=0x7f6d5c0b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:49.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.728+0000 7f6d63c6b9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:49.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.728+0000 7f6d63c6b9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:49.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.728+0000 7f6d63c6b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:49.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.728+0000 7f6d63c6b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:49.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.728+0000 7f6d63c6b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:49.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.728+0000 7f6d63c6b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:49.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.732+0000 7f6d63c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.732+0000 7f6d63c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.732+0000 7f6d63c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.732+0000 7f6d63c6b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:49.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.732+0000 7f6d63c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.732+0000 7f6d63c6b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:49.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.732+0000 7f6d63c6b9c0 20 zone default found 2024-09-12T17:37:49.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.732+0000 7f6d63c6b9c0 4 Realm: () 2024-09-12T17:37:49.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.732+0000 7f6d63c6b9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:49.732 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.732+0000 7f6d63c6b9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:49.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.732+0000 7f6d63c6b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:49.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.732+0000 7f6d63c6b9c0 20 zonegroup default 2024-09-12T17:37:49.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.732+0000 7f6d63c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.732+0000 7f6d63c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.732+0000 7f6d63c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.736+0000 7f6d63c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.736+0000 7f6d63c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.736+0000 7f6d63c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.736+0000 7f6d63c6b9c0 20 started sync module instance, tier type = 2024-09-12T17:37:49.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.736+0000 7f6d63c6b9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:49.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.760+0000 7f6d63c6b9c0 20 add_watcher() i=0 2024-09-12T17:37:49.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.760+0000 7f6d63c6b9c0 20 add_watcher() i=1 2024-09-12T17:37:49.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.760+0000 7f6d63c6b9c0 20 add_watcher() i=2 2024-09-12T17:37:49.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.760+0000 7f6d63c6b9c0 20 add_watcher() i=3 2024-09-12T17:37:49.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.760+0000 7f6d63c6b9c0 20 add_watcher() i=4 2024-09-12T17:37:49.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.760+0000 7f6d63c6b9c0 20 add_watcher() i=5 2024-09-12T17:37:49.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.760+0000 7f6d63c6b9c0 20 add_watcher() i=6 2024-09-12T17:37:49.760 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.760+0000 7f6d63c6b9c0 20 add_watcher() i=7 2024-09-12T17:37:49.760 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.760+0000 7f6d63c6b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:49.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.764+0000 7f6c17fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:49.765 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.764+0000 7f6d63c6b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:49.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.764+0000 7f6d63c6b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:49.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6d63c6b9c0 5 note: GC not initialized 2024-09-12T17:37:49.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6c16fe5640 20 reqs_thread_entry: start 2024-09-12T17:37:49.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6d63c6b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:49.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6d63c6b9c0 20 Filter name: none 2024-09-12T17:37:49.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6c14fe1640 20 reqs_thread_entry: start 2024-09-12T17:37:49.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6d63c6b9c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:37:49.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6d63c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6d63c6b9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:37:49.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6d63c6b9c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:37:49.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6d63c6b9c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:37:49.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6d63c6b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 : miss 2024-09-12T17:37:49.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6d63c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6d63c6b9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:37:49.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6d63c6b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 info.flags=0x17 2024-09-12T17:37:49.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6d63c6b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 to cache LRU end 2024-09-12T17:37:49.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6d63c6b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:49.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6d63c6b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:49.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.768+0000 7f6d63c6b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 2024-09-12T17:37:49.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.780+0000 7f6d63c6b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 info.flags=0x17 2024-09-12T17:37:49.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.780+0000 7f6d63c6b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 to cache LRU end 2024-09-12T17:37:49.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.780+0000 7f6d63c6b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:49.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.780+0000 7f6d63c6b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36, ofs0, ns] 2024-09-12T17:37:49.782 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.780+0000 7f6c33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333517 cookie 94776445179104 notifier 7235 bl.length()=1007 2024-09-12T17:37:49.782 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.780+0000 7f6c33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 info.flags=0x17 2024-09-12T17:37:49.782 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.780+0000 7f6c33fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 to cache LRU end 2024-09-12T17:37:49.782 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.780+0000 7f6c33fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:49.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.784+0000 7f6d63c6b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): orig_sources= new_sources= 2024-09-12T17:37:49.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.784+0000 7f6d63c6b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): potential sources added=[] removed=[] 2024-09-12T17:37:49.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.784+0000 7f6d63c6b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): orig_dests= new_dests= 2024-09-12T17:37:49.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.784+0000 7f6d63c6b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): potential dests added=[] removed=[] 2024-09-12T17:37:49.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.792+0000 7f6d63c6b9c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T17:37:49.790 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.792+0000 7f6d63c6b9c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:37:49.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.800+0000 7f6d63c6b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:37:49.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.800+0000 7f6d63c6b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 2024-09-12T17:37:49.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.804+0000 7f6d63c6b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 info.flags=0x17 2024-09-12T17:37:49.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.804+0000 7f6d63c6b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 to cache LRU end 2024-09-12T17:37:49.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.804+0000 7f6d63c6b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:49.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.804+0000 7f6d63c6b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36, ofs0, ns] 2024-09-12T17:37:49.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.804+0000 7f6c33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333518 cookie 94776445179104 notifier 7235 bl.length()=975 2024-09-12T17:37:49.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.804+0000 7f6c33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 info.flags=0x17 2024-09-12T17:37:49.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.804+0000 7f6c33fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 to cache LRU end 2024-09-12T17:37:49.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.804+0000 7f6c33fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:49.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.808+0000 7f6d63c6b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): orig_sources= new_sources= 2024-09-12T17:37:49.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.808+0000 7f6d63c6b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): potential sources added=[] removed=[] 2024-09-12T17:37:49.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.808+0000 7f6d63c6b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): orig_dests= new_dests= 2024-09-12T17:37:49.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.808+0000 7f6d63c6b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): potential dests added=[] removed=[] 2024-09-12T17:37:49.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.808+0000 7f6c17fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:49.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.816+0000 7f6d63c6b9c0 20 remove_watcher() i=0 2024-09-12T17:37:49.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.816+0000 7f6d63c6b9c0 2 removed watcher, disabling cache 2024-09-12T17:37:49.816 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.816+0000 7f6d63c6b9c0 20 remove_watcher() i=1 2024-09-12T17:37:49.818 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.820+0000 7f6d63c6b9c0 20 remove_watcher() i=2 2024-09-12T17:37:49.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.820+0000 7f6d63c6b9c0 20 remove_watcher() i=3 2024-09-12T17:37:49.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.824+0000 7f6d63c6b9c0 20 remove_watcher() i=4 2024-09-12T17:37:49.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.824+0000 7f6d63c6b9c0 20 remove_watcher() i=5 2024-09-12T17:37:49.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.824+0000 7f6d63c6b9c0 20 remove_watcher() i=6 2024-09-12T17:37:49.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.828+0000 7f6d63c6b9c0 20 remove_watcher() i=7 2024-09-12T17:37:49.841 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:37:49.871 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:49.871 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:49.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.916+0000 7f65f57919c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.917 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.916+0000 7f65f57919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.916+0000 7f65f57919c0 20 realm 2024-09-12T17:37:49.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.916+0000 7f65f57919c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.920+0000 7f65f57919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.920+0000 7f65f57919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:49.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.920+0000 7f65f57919c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.920+0000 7f65f57919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:49.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.920+0000 7f65f57919c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.919 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.920+0000 7f65f57919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:49.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.920+0000 7f65f57919c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:49.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.920+0000 7f65f57919c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:49.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.920+0000 7f65f57919c0 20 searching for the correct realm 2024-09-12T17:37:49.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.924+0000 7f65f3a98640 0 -- 172.21.15.119:0/1296524704 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f65e81050b0 msgr2=0x7f65e80fd390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:49.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:49.932+0000 7f65f2a96640 0 -- 172.21.15.119:0/1296524704 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f65ec042c20 msgr2=0x7f65ec09d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:50.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.148+0000 7f65f57919c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:50.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.148+0000 7f65f57919c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:50.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.148+0000 7f65f57919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:50.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.148+0000 7f65f57919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:50.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.148+0000 7f65f57919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:50.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.148+0000 7f65f57919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:50.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.148+0000 7f65f57919c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.148+0000 7f65f57919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.148+0000 7f65f57919c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.148+0000 7f65f57919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:50.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.148+0000 7f65f57919c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.152+0000 7f65f57919c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:50.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.152+0000 7f65f57919c0 20 zone default found 2024-09-12T17:37:50.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.152+0000 7f65f57919c0 4 Realm: () 2024-09-12T17:37:50.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.152+0000 7f65f57919c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:50.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.152+0000 7f65f57919c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:50.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.152+0000 7f65f57919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:50.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.152+0000 7f65f57919c0 20 zonegroup default 2024-09-12T17:37:50.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.152+0000 7f65f57919c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.152+0000 7f65f57919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.152+0000 7f65f57919c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.152+0000 7f65f57919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.152+0000 7f65f57919c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.152+0000 7f65f57919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.152+0000 7f65f57919c0 20 started sync module instance, tier type = 2024-09-12T17:37:50.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.152+0000 7f65f57919c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:50.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.176+0000 7f65f57919c0 20 add_watcher() i=0 2024-09-12T17:37:50.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.176+0000 7f65f57919c0 20 add_watcher() i=1 2024-09-12T17:37:50.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.176+0000 7f65f57919c0 20 add_watcher() i=2 2024-09-12T17:37:50.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.176+0000 7f65f57919c0 20 add_watcher() i=3 2024-09-12T17:37:50.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.176+0000 7f65f57919c0 20 add_watcher() i=4 2024-09-12T17:37:50.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.176+0000 7f65f57919c0 20 add_watcher() i=5 2024-09-12T17:37:50.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.176+0000 7f65f57919c0 20 add_watcher() i=6 2024-09-12T17:37:50.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.180+0000 7f65f57919c0 20 add_watcher() i=7 2024-09-12T17:37:50.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.180+0000 7f65f57919c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:50.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.184+0000 7f64a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:50.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.184+0000 7f65f57919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:50.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.184+0000 7f65f57919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:50.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.184+0000 7f65f57919c0 5 note: GC not initialized 2024-09-12T17:37:50.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.184+0000 7f64a8fe1640 20 reqs_thread_entry: start 2024-09-12T17:37:50.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.184+0000 7f65f57919c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:50.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.184+0000 7f65f57919c0 20 Filter name: none 2024-09-12T17:37:50.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.184+0000 7f64227fc640 20 reqs_thread_entry: start 2024-09-12T17:37:50.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.184+0000 7f65f57919c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.188+0000 7f65f57919c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:37:50.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.188+0000 7f65f57919c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.188+0000 7f65f57919c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:37:50.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.188+0000 7f65f57919c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:50.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.188+0000 7f65f57919c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.188+0000 7f65f57919c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:37:50.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.188+0000 7f65f57919c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.188+0000 7f65f57919c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:37:50.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.188+0000 7f65f57919c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:50.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.192+0000 7f64a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:50.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.200+0000 7f65f57919c0 20 remove_watcher() i=0 2024-09-12T17:37:50.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.200+0000 7f65f57919c0 2 removed watcher, disabling cache 2024-09-12T17:37:50.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.200+0000 7f65f57919c0 20 remove_watcher() i=1 2024-09-12T17:37:50.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.204+0000 7f65f57919c0 20 remove_watcher() i=2 2024-09-12T17:37:50.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.204+0000 7f65f57919c0 20 remove_watcher() i=3 2024-09-12T17:37:50.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.208+0000 7f65f57919c0 20 remove_watcher() i=4 2024-09-12T17:37:50.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.208+0000 7f65f57919c0 20 remove_watcher() i=5 2024-09-12T17:37:50.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.208+0000 7f65f57919c0 20 remove_watcher() i=6 2024-09-12T17:37:50.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.212+0000 7f65f57919c0 20 remove_watcher() i=7 2024-09-12T17:37:50.223 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:50.224 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:37:50.224 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-logrecord-writes id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:37:50.224 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:50.335 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:37:50.371 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:50.371 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:50.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.420+0000 7f4a10d4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.420+0000 7f4a10d4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.420+0000 7f4a10d4b9c0 20 realm 2024-09-12T17:37:50.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.420+0000 7f4a10d4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.420+0000 7f4a10d4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.420+0000 7f4a10d4b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:50.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.420+0000 7f4a10d4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.420+0000 7f4a10d4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.420+0000 7f4a10d4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.424+0000 7f4a10d4b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:50.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.424+0000 7f4a10d4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.424+0000 7f4a10d4b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:50.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.424+0000 7f4a10d4b9c0 20 searching for the correct realm 2024-09-12T17:37:50.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.428+0000 7f4a0f052640 0 -- 172.21.15.119:0/1231833158 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f4a0400e070 msgr2=0x7f4a04063240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:50.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.644+0000 7f4a0e050640 0 -- 172.21.15.119:0/1231833158 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f4a000bf040 msgr2=0x7f4a000bf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:50.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.860+0000 7f4a10d4b9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:50.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.860+0000 7f4a10d4b9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:50.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.860+0000 7f4a10d4b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:50.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.860+0000 7f4a10d4b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:50.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.860+0000 7f4a10d4b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:50.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.860+0000 7f4a10d4b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:50.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.860+0000 7f4a10d4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.860+0000 7f4a10d4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.860+0000 7f4a10d4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.864+0000 7f4a10d4b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:50.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.864+0000 7f4a10d4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.864+0000 7f4a10d4b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:50.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.864+0000 7f4a10d4b9c0 20 zone default found 2024-09-12T17:37:50.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.864+0000 7f4a10d4b9c0 4 Realm: () 2024-09-12T17:37:50.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.864+0000 7f4a10d4b9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:50.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.864+0000 7f4a10d4b9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:50.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.864+0000 7f4a10d4b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:50.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.864+0000 7f4a10d4b9c0 20 zonegroup default 2024-09-12T17:37:50.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.864+0000 7f4a10d4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.864+0000 7f4a10d4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.864+0000 7f4a10d4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.864+0000 7f4a10d4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.864+0000 7f4a10d4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.868+0000 7f4a10d4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:50.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.868+0000 7f4a10d4b9c0 20 started sync module instance, tier type = 2024-09-12T17:37:50.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.868+0000 7f4a10d4b9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:50.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.888+0000 7f4a10d4b9c0 20 add_watcher() i=0 2024-09-12T17:37:50.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.888+0000 7f4a10d4b9c0 20 add_watcher() i=1 2024-09-12T17:37:50.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.888+0000 7f4a10d4b9c0 20 add_watcher() i=2 2024-09-12T17:37:50.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.888+0000 7f4a10d4b9c0 20 add_watcher() i=3 2024-09-12T17:37:50.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.888+0000 7f4a10d4b9c0 20 add_watcher() i=4 2024-09-12T17:37:50.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.888+0000 7f4a10d4b9c0 20 add_watcher() i=5 2024-09-12T17:37:50.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.888+0000 7f4a10d4b9c0 20 add_watcher() i=6 2024-09-12T17:37:50.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.892+0000 7f4a10d4b9c0 20 add_watcher() i=7 2024-09-12T17:37:50.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.892+0000 7f4a10d4b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:50.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.896+0000 7f48c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:50.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.896+0000 7f4a10d4b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:50.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.896+0000 7f4a10d4b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:50.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.896+0000 7f4a10d4b9c0 5 note: GC not initialized 2024-09-12T17:37:50.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.896+0000 7f483ffff640 20 reqs_thread_entry: start 2024-09-12T17:37:50.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.900+0000 7f4a10d4b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:50.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.900+0000 7f4a10d4b9c0 20 Filter name: none 2024-09-12T17:37:50.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.900+0000 7f483dffb640 20 reqs_thread_entry: start 2024-09-12T17:37:50.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.900+0000 7f4a10d4b9c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:37:50.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.900+0000 7f4a10d4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.900+0000 7f4a10d4b9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:37:50.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.900+0000 7f4a10d4b9c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:37:50.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.900+0000 7f4a10d4b9c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:37:50.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.900+0000 7f4a10d4b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 : miss 2024-09-12T17:37:50.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.900+0000 7f4a10d4b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:50.900 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.900+0000 7f4a10d4b9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:37:50.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.900+0000 7f4a10d4b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 info.flags=0x17 2024-09-12T17:37:50.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.900+0000 7f4a10d4b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 to cache LRU end 2024-09-12T17:37:50.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.900+0000 7f4a10d4b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:50.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.900+0000 7f4a10d4b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:50.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.900+0000 7f4a10d4b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 2024-09-12T17:37:50.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.912+0000 7f4a10d4b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 info.flags=0x17 2024-09-12T17:37:50.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.912+0000 7f4a10d4b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 to cache LRU end 2024-09-12T17:37:50.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.912+0000 7f4a10d4b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:50.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.912+0000 7f4a10d4b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36, ofs0, ns] 2024-09-12T17:37:50.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.912+0000 7f48f1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333519 cookie 94430757019264 notifier 7722 bl.length()=1007 2024-09-12T17:37:50.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.912+0000 7f48f1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 info.flags=0x17 2024-09-12T17:37:50.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.912+0000 7f48f1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 to cache LRU end 2024-09-12T17:37:50.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.912+0000 7f48f1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:50.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.916+0000 7f4a10d4b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): orig_sources= new_sources= 2024-09-12T17:37:50.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.916+0000 7f4a10d4b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): potential sources added=[] removed=[] 2024-09-12T17:37:50.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.916+0000 7f4a10d4b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): orig_dests= new_dests= 2024-09-12T17:37:50.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.916+0000 7f4a10d4b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): potential dests added=[] removed=[] 2024-09-12T17:37:50.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.0 2024-09-12T17:37:50.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.0 2024-09-12T17:37:50.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.1 2024-09-12T17:37:50.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.1 2024-09-12T17:37:50.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.2 2024-09-12T17:37:50.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.2 2024-09-12T17:37:50.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.3 2024-09-12T17:37:50.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.3 2024-09-12T17:37:50.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.4 2024-09-12T17:37:50.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.4 2024-09-12T17:37:50.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.5 2024-09-12T17:37:50.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.5 2024-09-12T17:37:50.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.6 2024-09-12T17:37:50.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.6 2024-09-12T17:37:50.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.7 2024-09-12T17:37:50.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.7 2024-09-12T17:37:50.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.8 2024-09-12T17:37:50.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.8 2024-09-12T17:37:50.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.9 2024-09-12T17:37:50.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.9 2024-09-12T17:37:50.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.10 2024-09-12T17:37:50.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.10 2024-09-12T17:37:50.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.11 2024-09-12T17:37:50.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1.11 2024-09-12T17:37:50.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.924+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.0 2024-09-12T17:37:50.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.928+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1 2024-09-12T17:37:50.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.928+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.2 2024-09-12T17:37:50.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.928+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.3 2024-09-12T17:37:50.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.928+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.4 2024-09-12T17:37:50.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.932+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.5 2024-09-12T17:37:50.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.932+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.6 2024-09-12T17:37:50.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.932+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.7 2024-09-12T17:37:50.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.932+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.8 2024-09-12T17:37:50.933 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.936+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.9 2024-09-12T17:37:50.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.936+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.10 2024-09-12T17:37:50.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.940+0000 7f4a10d4b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:37:50.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.940+0000 7f4a10d4b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 2024-09-12T17:37:50.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.944+0000 7f4a10d4b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 info.flags=0x17 2024-09-12T17:37:50.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.944+0000 7f4a10d4b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 to cache LRU end 2024-09-12T17:37:50.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.944+0000 7f4a10d4b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:50.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.944+0000 7f4a10d4b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36, ofs0, ns] 2024-09-12T17:37:50.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.948+0000 7f48f1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333520 cookie 94430757019264 notifier 7722 bl.length()=1007 2024-09-12T17:37:50.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.948+0000 7f48f1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 info.flags=0x17 2024-09-12T17:37:50.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.948+0000 7f48f1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 to cache LRU end 2024-09-12T17:37:50.946 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.948+0000 7f48f1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:50.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.948+0000 7f4a10d4b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): orig_sources= new_sources= 2024-09-12T17:37:50.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.948+0000 7f4a10d4b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): potential sources added=[] removed=[] 2024-09-12T17:37:50.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.948+0000 7f4a10d4b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): orig_dests= new_dests= 2024-09-12T17:37:50.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.948+0000 7f4a10d4b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): potential dests added=[] removed=[] 2024-09-12T17:37:50.954 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.956+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.0 2024-09-12T17:37:50.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.956+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.1 2024-09-12T17:37:50.956 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.956+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.2 2024-09-12T17:37:50.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.956+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.3 2024-09-12T17:37:50.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.956+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.4 2024-09-12T17:37:50.958 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.960+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.5 2024-09-12T17:37:50.958 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.960+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.6 2024-09-12T17:37:50.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.960+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.7 2024-09-12T17:37:50.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.960+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.8 2024-09-12T17:37:50.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.960+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.9 2024-09-12T17:37:50.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.960+0000 7f4a10d4b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36.10 2024-09-12T17:37:50.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.964+0000 7f4a10d4b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:37:50.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.964+0000 7f4a10d4b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 2024-09-12T17:37:50.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.968+0000 7f4a10d4b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 info.flags=0x17 2024-09-12T17:37:50.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.968+0000 7f4a10d4b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 to cache LRU end 2024-09-12T17:37:50.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.968+0000 7f4a10d4b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:50.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.968+0000 7f4a10d4b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36, ofs0, ns] 2024-09-12T17:37:50.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.968+0000 7f48f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333521 cookie 94430757019264 notifier 7722 bl.length()=975 2024-09-12T17:37:50.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.968+0000 7f48f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 info.flags=0x17 2024-09-12T17:37:50.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.968+0000 7f48f27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 to cache LRU end 2024-09-12T17:37:50.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.968+0000 7f48f27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:50.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.972+0000 7f4a10d4b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): orig_sources= new_sources= 2024-09-12T17:37:50.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.972+0000 7f4a10d4b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): potential sources added=[] removed=[] 2024-09-12T17:37:50.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.972+0000 7f4a10d4b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): orig_dests= new_dests= 2024-09-12T17:37:50.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.972+0000 7f4a10d4b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36]): potential dests added=[] removed=[] 2024-09-12T17:37:50.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.976+0000 7f4a10d4b9c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:37:50.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.980+0000 7f48c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:50.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.984+0000 7f4a10d4b9c0 20 remove_watcher() i=0 2024-09-12T17:37:50.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.984+0000 7f4a10d4b9c0 2 removed watcher, disabling cache 2024-09-12T17:37:50.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.984+0000 7f4a10d4b9c0 20 remove_watcher() i=1 2024-09-12T17:37:50.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.988+0000 7f4a10d4b9c0 20 remove_watcher() i=2 2024-09-12T17:37:50.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.992+0000 7f4a10d4b9c0 20 remove_watcher() i=3 2024-09-12T17:37:50.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.992+0000 7f4a10d4b9c0 20 remove_watcher() i=4 2024-09-12T17:37:50.994 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.996+0000 7f4a10d4b9c0 20 remove_watcher() i=5 2024-09-12T17:37:50.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.996+0000 7f4a10d4b9c0 20 remove_watcher() i=6 2024-09-12T17:37:50.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:50.996+0000 7f4a10d4b9c0 20 remove_watcher() i=7 2024-09-12T17:37:51.012 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:37:51.041 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:51.041 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:51.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.084+0000 7fe6426349c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.088+0000 7fe6426349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.088+0000 7fe6426349c0 20 realm 2024-09-12T17:37:51.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.088+0000 7fe6426349c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.088+0000 7fe6426349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.088+0000 7fe6426349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:51.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.088+0000 7fe6426349c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.088+0000 7fe6426349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.088+0000 7fe6426349c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.088+0000 7fe6426349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:51.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.088+0000 7fe6426349c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.092+0000 7fe6426349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:51.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.092+0000 7fe6426349c0 20 searching for the correct realm 2024-09-12T17:37:51.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.096+0000 7fe64093b640 0 -- 172.21.15.119:0/3309610937 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x560996473060 msgr2=0x560996475450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:51.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.100+0000 7fe63f939640 0 -- 172.21.15.119:0/3309610937 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fe638062a50 msgr2=0x7fe638063a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:51.721 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.720+0000 7fe6426349c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:51.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.720+0000 7fe6426349c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:51.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.720+0000 7fe6426349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:51.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.720+0000 7fe6426349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:51.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.720+0000 7fe6426349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:51.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.720+0000 7fe6426349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:51.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.720+0000 7fe6426349c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.724+0000 7fe6426349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.724+0000 7fe6426349c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.723 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.724+0000 7fe6426349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:51.723 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.724+0000 7fe6426349c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.724+0000 7fe6426349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:51.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.724+0000 7fe6426349c0 20 zone default found 2024-09-12T17:37:51.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.724+0000 7fe6426349c0 4 Realm: () 2024-09-12T17:37:51.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.724+0000 7fe6426349c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:51.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.724+0000 7fe6426349c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:51.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.724+0000 7fe6426349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:51.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.724+0000 7fe6426349c0 20 zonegroup default 2024-09-12T17:37:51.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.724+0000 7fe6426349c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.724+0000 7fe6426349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.724+0000 7fe6426349c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.728+0000 7fe6426349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.728+0000 7fe6426349c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.726 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.728+0000 7fe6426349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:51.726 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.728+0000 7fe6426349c0 20 started sync module instance, tier type = 2024-09-12T17:37:51.726 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.728+0000 7fe6426349c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:51.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.752+0000 7fe6426349c0 20 add_watcher() i=0 2024-09-12T17:37:51.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.752+0000 7fe6426349c0 20 add_watcher() i=1 2024-09-12T17:37:51.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.752+0000 7fe6426349c0 20 add_watcher() i=2 2024-09-12T17:37:51.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.752+0000 7fe6426349c0 20 add_watcher() i=3 2024-09-12T17:37:51.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.752+0000 7fe6426349c0 20 add_watcher() i=4 2024-09-12T17:37:51.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.752+0000 7fe6426349c0 20 add_watcher() i=5 2024-09-12T17:37:51.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.752+0000 7fe6426349c0 20 add_watcher() i=6 2024-09-12T17:37:51.753 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.752+0000 7fe6426349c0 20 add_watcher() i=7 2024-09-12T17:37:51.753 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.752+0000 7fe6426349c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:51.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.756+0000 7fe4f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:51.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.760+0000 7fe6426349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:51.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.760+0000 7fe6426349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:51.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.760+0000 7fe6426349c0 5 note: GC not initialized 2024-09-12T17:37:51.759 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.760+0000 7fe4f5fdb640 20 reqs_thread_entry: start 2024-09-12T17:37:51.759 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.760+0000 7fe6426349c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:51.759 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.760+0000 7fe6426349c0 20 Filter name: none 2024-09-12T17:37:51.759 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.760+0000 7fe4677fe640 20 reqs_thread_entry: start 2024-09-12T17:37:51.759 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.760+0000 7fe6426349c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.760 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.760+0000 7fe6426349c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:37:51.760 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.760+0000 7fe6426349c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.764+0000 7fe6426349c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:37:51.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.764+0000 7fe6426349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:51.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.764+0000 7fe6426349c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.764+0000 7fe6426349c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:37:51.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.764+0000 7fe6426349c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:51.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.764+0000 7fe6426349c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:37:51.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.764+0000 7fe6426349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:51.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.768+0000 7fe4f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:51.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.772+0000 7fe6426349c0 20 remove_watcher() i=0 2024-09-12T17:37:51.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.772+0000 7fe6426349c0 2 removed watcher, disabling cache 2024-09-12T17:37:51.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.776+0000 7fe6426349c0 20 remove_watcher() i=1 2024-09-12T17:37:51.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.780+0000 7fe6426349c0 20 remove_watcher() i=2 2024-09-12T17:37:51.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.780+0000 7fe6426349c0 20 remove_watcher() i=3 2024-09-12T17:37:51.782 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.784+0000 7fe6426349c0 20 remove_watcher() i=4 2024-09-12T17:37:51.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.784+0000 7fe6426349c0 20 remove_watcher() i=5 2024-09-12T17:37:51.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.784+0000 7fe6426349c0 20 remove_watcher() i=6 2024-09-12T17:37:51.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:51.788+0000 7fe6426349c0 20 remove_watcher() i=7 2024-09-12T17:37:51.801 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:51.801 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:37:51.801 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-logrecord-writes id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:37:51.801 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:52.722 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T17:37:52.723 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:54.968 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:37:54.999 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:54.999 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:55.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.044+0000 7f829eb4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.048+0000 7f829eb4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.048+0000 7f829eb4f9c0 20 realm 2024-09-12T17:37:55.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.048+0000 7f829eb4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.048+0000 7f829eb4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.048+0000 7f829eb4f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:55.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.048+0000 7f829eb4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.048+0000 7f829eb4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.048+0000 7f829eb4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.048+0000 7f829eb4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:55.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.048+0000 7f829eb4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.052+0000 7f829eb4f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:55.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.052+0000 7f829eb4f9c0 20 searching for the correct realm 2024-09-12T17:37:55.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.056+0000 7f829ce56640 0 -- 172.21.15.119:0/2069074762 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f8290034070 msgr2=0x7f8290040950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:55.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.064+0000 7f829be54640 0 -- 172.21.15.119:0/2069074762 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f82940e3430 msgr2=0x7f8294111510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:55.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.280+0000 7f829eb4f9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:55.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.280+0000 7f829eb4f9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:55.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.280+0000 7f829eb4f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:55.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.280+0000 7f829eb4f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:55.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.280+0000 7f829eb4f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:55.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.280+0000 7f829eb4f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:55.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.280+0000 7f829eb4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.280+0000 7f829eb4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.280+0000 7f829eb4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:55.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:55.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 20 zone default found 2024-09-12T17:37:55.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 4 Realm: () 2024-09-12T17:37:55.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:55.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:55.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:55.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 20 zonegroup default 2024-09-12T17:37:55.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.284 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.284 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.286 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 20 started sync module instance, tier type = 2024-09-12T17:37:55.286 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.284+0000 7f829eb4f9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:55.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.308+0000 7f829eb4f9c0 20 add_watcher() i=0 2024-09-12T17:37:55.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.308+0000 7f829eb4f9c0 20 add_watcher() i=1 2024-09-12T17:37:55.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.308+0000 7f829eb4f9c0 20 add_watcher() i=2 2024-09-12T17:37:55.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.308+0000 7f829eb4f9c0 20 add_watcher() i=3 2024-09-12T17:37:55.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.308+0000 7f829eb4f9c0 20 add_watcher() i=4 2024-09-12T17:37:55.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.308+0000 7f829eb4f9c0 20 add_watcher() i=5 2024-09-12T17:37:55.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.308+0000 7f829eb4f9c0 20 add_watcher() i=6 2024-09-12T17:37:55.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.312+0000 7f829eb4f9c0 20 add_watcher() i=7 2024-09-12T17:37:55.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.312+0000 7f829eb4f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:55.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.316+0000 7f81537de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:55.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.316+0000 7f829eb4f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:55.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.316+0000 7f829eb4f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:55.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.316+0000 7f829eb4f9c0 5 note: GC not initialized 2024-09-12T17:37:55.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.316+0000 7f81527dc640 20 reqs_thread_entry: start 2024-09-12T17:37:55.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.316+0000 7f829eb4f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:55.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.316+0000 7f829eb4f9c0 20 Filter name: none 2024-09-12T17:37:55.317 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.316+0000 7f814b7fe640 20 reqs_thread_entry: start 2024-09-12T17:37:55.318 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.320+0000 7f829eb4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.320+0000 7f829eb4f9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:37:55.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.320+0000 7f829eb4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.320+0000 7f829eb4f9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:37:55.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.320+0000 7f829eb4f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:55.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.320+0000 7f829eb4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.320+0000 7f829eb4f9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:37:55.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.320+0000 7f829eb4f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.320+0000 7f829eb4f9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:37:55.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.320+0000 7f829eb4f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:55.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.324+0000 7f81537de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:55.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.328+0000 7f829eb4f9c0 20 remove_watcher() i=0 2024-09-12T17:37:55.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.328+0000 7f829eb4f9c0 2 removed watcher, disabling cache 2024-09-12T17:37:55.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.332+0000 7f829eb4f9c0 20 remove_watcher() i=1 2024-09-12T17:37:55.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.332+0000 7f829eb4f9c0 20 remove_watcher() i=2 2024-09-12T17:37:55.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.336+0000 7f829eb4f9c0 20 remove_watcher() i=3 2024-09-12T17:37:55.337 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.336+0000 7f829eb4f9c0 20 remove_watcher() i=4 2024-09-12T17:37:55.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.340+0000 7f829eb4f9c0 20 remove_watcher() i=5 2024-09-12T17:37:55.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.340+0000 7f829eb4f9c0 20 remove_watcher() i=6 2024-09-12T17:37:55.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.340+0000 7f829eb4f9c0 20 remove_watcher() i=7 2024-09-12T17:37:55.357 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.357 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:37:55.357 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-logrecord-writes id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:37:55.357 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.358 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T17:37:55.395 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:55.395 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:55.441 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.440+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 realm 2024-09-12T17:37:55.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.444+0000 7f3ba53b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:55.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.445 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:55.445 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.446 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.448+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:55.446 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.448+0000 7f3ba53b49c0 20 searching for the correct realm 2024-09-12T17:37:55.447 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.448+0000 7f3ba26b9640 0 -- 172.21.15.119:0/512277809 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f3b9405bbe0 msgr2=0x7f3b9407cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:55.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.664+0000 7f3ba36bb640 0 -- 172.21.15.119:0/512277809 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f3b980ad930 msgr2=0x7f3b980ef410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:55.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:55.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:55.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:55.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:55.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:55.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:55.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:55.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:55.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 zone default found 2024-09-12T17:37:55.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 4 Realm: () 2024-09-12T17:37:55.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:55.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:55.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:55.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 zonegroup default 2024-09-12T17:37:55.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.684 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 started sync module instance, tier type = 2024-09-12T17:37:55.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:55.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=0 2024-09-12T17:37:55.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=1 2024-09-12T17:37:55.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=2 2024-09-12T17:37:55.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=3 2024-09-12T17:37:55.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=4 2024-09-12T17:37:55.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=5 2024-09-12T17:37:55.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=6 2024-09-12T17:37:55.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=7 2024-09-12T17:37:55.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.708+0000 7f3ba53b49c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:55.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.712+0000 7f3a597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:55.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.712+0000 7f3ba53b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:55.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.712+0000 7f3ba53b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:55.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f3ba53b49c0 5 note: GC not initialized 2024-09-12T17:37:55.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f39d3fff640 20 reqs_thread_entry: start 2024-09-12T17:37:55.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:55.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 Filter name: none 2024-09-12T17:37:55.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f39d1ffb640 20 reqs_thread_entry: start 2024-09-12T17:37:55.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:37:55.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:37:55.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:37:55.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:37:55.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 : miss 2024-09-12T17:37:55.716 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:37:55.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:37:55.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:37:55.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:55.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:55.717 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 2024-09-12T17:37:55.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.732+0000 7f3ba53b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:37:55.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.732+0000 7f3ba53b49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:37:55.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.732+0000 7f3ba53b49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:55.730 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.732+0000 7f3ba53b49c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37, ofs0, ns] 2024-09-12T17:37:55.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.732+0000 7f3a867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333453 cookie 94308077482096 notifier 7773 bl.length()=1007 2024-09-12T17:37:55.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.732+0000 7f3a867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:37:55.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.732+0000 7f3a867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:37:55.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.732+0000 7f3a867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:55.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.732+0000 7f3ba53b49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): orig_sources= new_sources= 2024-09-12T17:37:55.733 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.736+0000 7f3ba53b49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): potential sources added=[] removed=[] 2024-09-12T17:37:55.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.736+0000 7f3ba53b49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): orig_dests= new_dests= 2024-09-12T17:37:55.734 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.736+0000 7f3ba53b49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): potential dests added=[] removed=[] 2024-09-12T17:37:55.738 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3ba53b49c0 time 2024-09-12T17:37:55.742000+0000 2024-09-12T17:37:55.738 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:37:55.739 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:55.740 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3ba8c8e2eb] 2024-09-12T17:37:55.740 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3ba8c8e49f] 2024-09-12T17:37:55.740 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5cc7530c1] 2024-09-12T17:37:55.740 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x14100ec) [0x55c5cd1a90ec] 2024-09-12T17:37:55.740 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c5cc76518d] 2024-09-12T17:37:55.740 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:37:55.740 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3ba7af4d90] 2024-09-12T17:37:55.740 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:37:55.740 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:37:55.740 INFO:tasks.workunit.client.0.smithi119.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:37:55.740 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f3ba53b49c0 thread_name:radosgw-admin 2024-09-12T17:37:55.740 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.740+0000 7f3ba53b49c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3ba53b49c0 time 2024-09-12T17:37:55.742000+0000 2024-09-12T17:37:55.740 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:37:55.741 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.741 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:55.741 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3ba8c8e2eb] 2024-09-12T17:37:55.741 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3ba8c8e49f] 2024-09-12T17:37:55.741 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5cc7530c1] 2024-09-12T17:37:55.741 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x14100ec) [0x55c5cd1a90ec] 2024-09-12T17:37:55.741 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c5cc76518d] 2024-09-12T17:37:55.741 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:37:55.741 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3ba7af4d90] 2024-09-12T17:37:55.741 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:37:55.741 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:37:55.741 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.750 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:55.750 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3ba7b0d520] 2024-09-12T17:37:55.750 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:37:55.750 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:37:55.750 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:37:55.750 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3ba8c8e345] 2024-09-12T17:37:55.750 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3ba8c8e49f] 2024-09-12T17:37:55.751 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5cc7530c1] 2024-09-12T17:37:55.751 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x14100ec) [0x55c5cd1a90ec] 2024-09-12T17:37:55.751 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c5cc76518d] 2024-09-12T17:37:55.751 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:37:55.751 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3ba7af4d90] 2024-09-12T17:37:55.751 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:37:55.751 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:37:55.751 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.740+0000 7f3ba53b49c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:37:55.751 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f3ba53b49c0 thread_name:radosgw-admin 2024-09-12T17:37:55.751 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.751 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:55.751 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3ba7b0d520] 2024-09-12T17:37:55.751 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:37:55.751 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:37:55.752 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:37:55.752 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3ba8c8e345] 2024-09-12T17:37:55.752 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3ba8c8e49f] 2024-09-12T17:37:55.752 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5cc7530c1] 2024-09-12T17:37:55.752 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x14100ec) [0x55c5cd1a90ec] 2024-09-12T17:37:55.752 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c5cc76518d] 2024-09-12T17:37:55.752 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:37:55.752 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3ba7af4d90] 2024-09-12T17:37:55.752 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:37:55.752 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:37:55.752 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:37:55.752 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.753 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:37:55.753 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.753 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:55.753 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: dump: 2024-09-12T17:37:55.753 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.753 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.753 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.753 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.753 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.753 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.753 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.753 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.754 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.754 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.754 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: _finish_auth 0 2024-09-12T17:37:55.754 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: _check_auth_tickets 2024-09-12T17:37:55.754 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:55.754 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 monclient: authenticate success, global_id 7761 2024-09-12T17:37:55.754 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: get_monmap_and_config success 2024-09-12T17:37:55.754 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 4 set_mon_vals no callback set 2024-09-12T17:37:55.754 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.754 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:55.754 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: dump: 2024-09-12T17:37:55.754 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.754 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.754 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.755 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.755 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.755 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.755 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.755 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.755 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.755 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.755 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: shutdown 2024-09-12T17:37:55.755 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) unregister_commands rotate-key 2024-09-12T17:37:55.755 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: build_initial_monmap 2024-09-12T17:37:55.755 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 1 build_initial for_mkfs: 0 2024-09-12T17:37:55.755 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: monmap: 2024-09-12T17:37:55.755 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:37:55.755 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:55.755 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:37:55.755 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:37:55.756 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:55.756 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.756 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:37:55.756 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:37:55.756 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:37:55.756 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.756 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding auth protocol: cephx 2024-09-12T17:37:55.756 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding auth protocol: cephx 2024-09-12T17:37:55.756 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding auth protocol: cephx 2024-09-12T17:37:55.756 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: secure 2024-09-12T17:37:55.756 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: crc 2024-09-12T17:37:55.756 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: secure 2024-09-12T17:37:55.756 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: crc 2024-09-12T17:37:55.756 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: secure 2024-09-12T17:37:55.757 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: crc 2024-09-12T17:37:55.757 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: crc 2024-09-12T17:37:55.757 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: secure 2024-09-12T17:37:55.757 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: crc 2024-09-12T17:37:55.757 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: secure 2024-09-12T17:37:55.757 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: crc 2024-09-12T17:37:55.757 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: secure 2024-09-12T17:37:55.757 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.757 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 1 librados: starting msgr at 2024-09-12T17:37:55.757 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 1 librados: starting objecter 2024-09-12T17:37:55.758 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command objecter_requests hook 0x55c5cf653dc0 2024-09-12T17:37:55.758 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 1 librados: setting wanted keys 2024-09-12T17:37:55.758 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 1 librados: calling monclient init 2024-09-12T17:37:55.758 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: init 2024-09-12T17:37:55.758 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding auth protocol: cephx 2024-09-12T17:37:55.758 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding auth protocol: cephx 2024-09-12T17:37:55.758 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding auth protocol: cephx 2024-09-12T17:37:55.758 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: secure 2024-09-12T17:37:55.758 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: crc 2024-09-12T17:37:55.758 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: secure 2024-09-12T17:37:55.758 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: crc 2024-09-12T17:37:55.759 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: secure 2024-09-12T17:37:55.759 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: crc 2024-09-12T17:37:55.759 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: crc 2024-09-12T17:37:55.759 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: secure 2024-09-12T17:37:55.759 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: crc 2024-09-12T17:37:55.759 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: secure 2024-09-12T17:37:55.759 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: crc 2024-09-12T17:37:55.759 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: secure 2024-09-12T17:37:55.759 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.759 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.759 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command rotate-key hook 0x55c5cf64f718 2024-09-12T17:37:55.759 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: _reopen_session rank -1 2024-09-12T17:37:55.759 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:37:55.760 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-a con 0x55c5cf655760 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:37:55.760 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-b con 0x55c5cf655b40 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:37:55.760 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-c con 0x7f3b8c003100 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:37:55.760 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.760 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.760 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.760 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient(hunting): _renew_subs 2024-09-12T17:37:55.760 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient(hunting): authenticate will time out at 2643.454733s 2024-09-12T17:37:55.760 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient(hunting): get_auth_request con 0x55c5cf655760 auth_method 0 2024-09-12T17:37:55.761 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.761 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.761 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.761 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:37:55.420+0000 7f3ba36bb640 10 monclient(hunting): get_auth_request con 0x7f3b8c003100 auth_method 0 2024-09-12T17:37:55.761 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:37:55.420+0000 7f3ba36bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.761 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:37:55.420+0000 7f3ba36bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.761 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:37:55.420+0000 7f3ba36bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.761 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:55.761 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:55.761 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:55.762 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:37:55.420+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:55.762 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:37:55.420+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:55.762 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:37:55.420+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:55.762 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_done global_id 7764 payload 824 2024-09-12T17:37:55.762 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient: _finish_hunting 0 2024-09-12T17:37:55.762 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 1 monclient: found mon.noname-a 2024-09-12T17:37:55.762 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.762 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.762 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:55.762 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: dump: 2024-09-12T17:37:55.762 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.762 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.763 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.763 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.763 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.763 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.763 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.763 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.763 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.763 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.763 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: _finish_auth 0 2024-09-12T17:37:55.763 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: _check_auth_tickets 2024-09-12T17:37:55.764 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:55.764 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.764 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:55.764 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: dump: 2024-09-12T17:37:55.764 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.764 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.764 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.764 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.764 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.764 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.764 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.764 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.764 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.765 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.765 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 monclient: authenticate success, global_id 7764 2024-09-12T17:37:55.765 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: _renew_subs 2024-09-12T17:37:55.765 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:37:55.420+0000 7f3a90e09640 4 set_mon_vals no callback set 2024-09-12T17:37:55.765 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.765 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: _renew_subs 2024-09-12T17:37:55.765 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.765 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 1 librados: init done 2024-09-12T17:37:55.765 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:37:55.424+0000 7f3a8f606640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:37:55.765 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:37:55.424+0000 7f3a8f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:55.765 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:37:55.424+0000 7f3a8f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:55.765 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:37:55.424+0000 7f3ba26b9640 10 monclient: get_auth_request con 0x7f3a88070ae0 auth_method 0 2024-09-12T17:37:55.765 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:37:55.424+0000 7f3ba36bb640 10 monclient: get_auth_request con 0x55c5cf67d2b0 auth_method 0 2024-09-12T17:37:55.766 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:37:55.424+0000 7f3ba2eba640 10 monclient: get_auth_request con 0x55c5cf69aec0 auth_method 0 2024-09-12T17:37:55.766 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:37:55.428+0000 7f3ba26b9640 10 monclient: get_auth_request con 0x55c5cf69f220 auth_method 0 2024-09-12T17:37:55.766 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:37:55.428+0000 7f3ba36bb640 10 monclient: get_auth_request con 0x55c5cf69e790 auth_method 0 2024-09-12T17:37:55.766 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: build_initial_monmap 2024-09-12T17:37:55.766 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 1 build_initial for_mkfs: 0 2024-09-12T17:37:55.766 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: monmap: 2024-09-12T17:37:55.766 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:37:55.766 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:55.766 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:37:55.766 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:37:55.766 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:55.766 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.766 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:37:55.767 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:37:55.767 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:37:55.767 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.767 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding auth protocol: cephx 2024-09-12T17:37:55.767 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding auth protocol: cephx 2024-09-12T17:37:55.767 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding auth protocol: cephx 2024-09-12T17:37:55.767 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: secure 2024-09-12T17:37:55.767 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: crc 2024-09-12T17:37:55.767 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: secure 2024-09-12T17:37:55.767 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: crc 2024-09-12T17:37:55.767 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: secure 2024-09-12T17:37:55.767 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: crc 2024-09-12T17:37:55.768 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: crc 2024-09-12T17:37:55.768 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: secure 2024-09-12T17:37:55.768 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: crc 2024-09-12T17:37:55.768 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: secure 2024-09-12T17:37:55.768 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: crc 2024-09-12T17:37:55.768 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: secure 2024-09-12T17:37:55.768 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.768 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c5cf6aadc0 EEXIST 2024-09-12T17:37:55.768 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: init 2024-09-12T17:37:55.768 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding auth protocol: cephx 2024-09-12T17:37:55.768 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding auth protocol: cephx 2024-09-12T17:37:55.768 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding auth protocol: cephx 2024-09-12T17:37:55.769 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: secure 2024-09-12T17:37:55.769 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: crc 2024-09-12T17:37:55.769 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: secure 2024-09-12T17:37:55.769 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: crc 2024-09-12T17:37:55.769 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: secure 2024-09-12T17:37:55.769 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: crc 2024-09-12T17:37:55.769 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: crc 2024-09-12T17:37:55.769 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: secure 2024-09-12T17:37:55.769 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: crc 2024-09-12T17:37:55.769 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: secure 2024-09-12T17:37:55.769 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: crc 2024-09-12T17:37:55.769 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: secure 2024-09-12T17:37:55.770 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.770 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.770 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command rotate-key cmddesc rotate-key hook 0x55c5cf6a6460 EEXIST 2024-09-12T17:37:55.770 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: _reopen_session rank -1 2024-09-12T17:37:55.770 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:37:55.770 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-b con 0x55c5cf6cef70 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:37:55.770 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-c con 0x55c5cf6ce8a0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:37:55.770 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-a con 0x55c5cf6cd280 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:37:55.770 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.770 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.770 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.770 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient(hunting): _renew_subs 2024-09-12T17:37:55.770 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient(hunting): authenticate will time out at 2643.466137s 2024-09-12T17:37:55.770 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:37:55.432+0000 7f3ba36bb640 10 monclient(hunting): get_auth_request con 0x55c5cf6ce8a0 auth_method 0 2024-09-12T17:37:55.771 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:37:55.432+0000 7f3ba36bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.771 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:37:55.432+0000 7f3ba36bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.771 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:37:55.432+0000 7f3ba36bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.771 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient(hunting): get_auth_request con 0x55c5cf6cd280 auth_method 0 2024-09-12T17:37:55.771 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.771 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.771 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.771 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:37:55.432+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:55.771 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:37:55.432+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:55.771 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:37:55.432+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:55.771 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:55.771 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:55.771 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:55.771 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:37:55.432+0000 7f3ba26b9640 10 monclient(hunting): get_auth_request con 0x55c5cf6cef70 auth_method 0 2024-09-12T17:37:55.772 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:37:55.432+0000 7f3ba26b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.772 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:37:55.432+0000 7f3ba26b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.772 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:37:55.432+0000 7f3ba26b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.772 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_done global_id 7767 payload 824 2024-09-12T17:37:55.772 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient: _finish_hunting 0 2024-09-12T17:37:55.772 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 1 monclient: found mon.noname-a 2024-09-12T17:37:55.772 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.772 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.772 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:55.772 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: dump: 2024-09-12T17:37:55.772 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.772 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.772 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.772 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.773 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.773 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.773 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.773 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.773 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.773 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.773 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: _finish_auth 0 2024-09-12T17:37:55.773 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: _check_auth_tickets 2024-09-12T17:37:55.773 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:55.773 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.773 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:55.773 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: dump: 2024-09-12T17:37:55.774 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.774 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.774 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.774 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.774 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.774 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.774 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.774 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.774 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.774 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.774 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 monclient: authenticate success, global_id 7767 2024-09-12T17:37:55.774 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: _renew_subs 2024-09-12T17:37:55.774 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:37:55.432+0000 7f3ba3ebc640 4 set_mon_vals no callback set 2024-09-12T17:37:55.774 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.774 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: _renew_subs 2024-09-12T17:37:55.775 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.775 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:37:55.436+0000 7f3a8ce01640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:37:55.775 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:37:55.436+0000 7f3a8ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:55.775 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:37:55.436+0000 7f3a8ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:55.775 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: get_monmap_and_config 2024-09-12T17:37:55.775 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: build_initial_monmap 2024-09-12T17:37:55.775 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 1 build_initial for_mkfs: 0 2024-09-12T17:37:55.775 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: monmap: 2024-09-12T17:37:55.775 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:37:55.775 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:55.775 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:37:55.775 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:37:55.775 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:55.776 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.776 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:37:55.776 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:37:55.776 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:37:55.776 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.776 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding auth protocol: cephx 2024-09-12T17:37:55.776 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding auth protocol: cephx 2024-09-12T17:37:55.776 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding auth protocol: cephx 2024-09-12T17:37:55.776 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: secure 2024-09-12T17:37:55.776 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: crc 2024-09-12T17:37:55.776 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: secure 2024-09-12T17:37:55.776 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: crc 2024-09-12T17:37:55.777 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: secure 2024-09-12T17:37:55.777 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: crc 2024-09-12T17:37:55.777 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: crc 2024-09-12T17:37:55.777 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: secure 2024-09-12T17:37:55.777 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: crc 2024-09-12T17:37:55.777 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: secure 2024-09-12T17:37:55.777 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: crc 2024-09-12T17:37:55.777 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: secure 2024-09-12T17:37:55.777 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:37:55.436+0000 7f3ba26b9640 10 monclient: get_auth_request con 0x7f3a7c070a20 auth_method 0 2024-09-12T17:37:55.777 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.777 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: init 2024-09-12T17:37:55.777 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding auth protocol: cephx 2024-09-12T17:37:55.777 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding auth protocol: cephx 2024-09-12T17:37:55.778 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding auth protocol: cephx 2024-09-12T17:37:55.778 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: secure 2024-09-12T17:37:55.778 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: crc 2024-09-12T17:37:55.778 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: secure 2024-09-12T17:37:55.778 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: crc 2024-09-12T17:37:55.778 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: secure 2024-09-12T17:37:55.778 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: crc 2024-09-12T17:37:55.778 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: crc 2024-09-12T17:37:55.778 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: secure 2024-09-12T17:37:55.778 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: crc 2024-09-12T17:37:55.778 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: secure 2024-09-12T17:37:55.778 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: crc 2024-09-12T17:37:55.778 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: secure 2024-09-12T17:37:55.779 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.779 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.779 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdb6061118 EEXIST 2024-09-12T17:37:55.779 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: _reopen_session rank -1 2024-09-12T17:37:55.779 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:37:55.779 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-a con 0x55c5cf725020 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:37:55.779 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-b con 0x55c5cf6f4a40 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:37:55.779 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-c con 0x55c5cf715dc0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:37:55.779 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.779 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.779 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.779 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient(hunting): _renew_subs 2024-09-12T17:37:55.779 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient(hunting): authenticate will time out at 2643.470314s 2024-09-12T17:37:55.779 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:37:55.436+0000 7f3ba26b9640 10 monclient(hunting): get_auth_request con 0x55c5cf725020 auth_method 0 2024-09-12T17:37:55.779 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:37:55.436+0000 7f3ba26b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.780 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:37:55.436+0000 7f3ba26b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.780 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:37:55.436+0000 7f3ba26b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.780 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient(hunting): get_auth_request con 0x55c5cf715dc0 auth_method 0 2024-09-12T17:37:55.780 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.780 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.780 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.780 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:37:55.436+0000 7f3ba26b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:55.780 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:37:55.436+0000 7f3ba26b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:55.780 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:37:55.436+0000 7f3ba26b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:55.780 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:55.780 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:55.780 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:55.780 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:37:55.436+0000 7f3ba36bb640 10 monclient(hunting): get_auth_request con 0x55c5cf6f4a40 auth_method 0 2024-09-12T17:37:55.781 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:37:55.436+0000 7f3ba36bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.781 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:37:55.436+0000 7f3ba36bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.781 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:37:55.436+0000 7f3ba36bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.781 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_done global_id 7313 payload 274 2024-09-12T17:37:55.781 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient: _finish_hunting 0 2024-09-12T17:37:55.781 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 1 monclient: found mon.noname-c 2024-09-12T17:37:55.781 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:37:55.781 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.781 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:37:55.781 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: dump: 2024-09-12T17:37:55.781 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.781 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.781 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.781 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.782 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.782 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.782 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.782 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.782 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.782 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.782 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: _finish_auth 0 2024-09-12T17:37:55.782 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: _check_auth_tickets 2024-09-12T17:37:55.782 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:55.782 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 monclient: authenticate success, global_id 7313 2024-09-12T17:37:55.782 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: get_monmap_and_config success 2024-09-12T17:37:55.782 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 4 set_mon_vals no callback set 2024-09-12T17:37:55.782 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.783 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:37:55.783 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: dump: 2024-09-12T17:37:55.783 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.783 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.783 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.783 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.783 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.783 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.783 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.783 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.783 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.783 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.783 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: shutdown 2024-09-12T17:37:55.783 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: build_initial_monmap 2024-09-12T17:37:55.784 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 1 build_initial for_mkfs: 0 2024-09-12T17:37:55.784 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: monmap: 2024-09-12T17:37:55.784 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:37:55.784 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:55.784 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:37:55.784 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:37:55.784 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:55.784 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.784 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:37:55.784 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:37:55.784 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:37:55.784 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.784 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding auth protocol: cephx 2024-09-12T17:37:55.784 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding auth protocol: cephx 2024-09-12T17:37:55.785 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding auth protocol: cephx 2024-09-12T17:37:55.785 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: secure 2024-09-12T17:37:55.785 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: crc 2024-09-12T17:37:55.785 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: secure 2024-09-12T17:37:55.785 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: crc 2024-09-12T17:37:55.785 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: secure 2024-09-12T17:37:55.785 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: crc 2024-09-12T17:37:55.785 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: crc 2024-09-12T17:37:55.785 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: secure 2024-09-12T17:37:55.785 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: crc 2024-09-12T17:37:55.785 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: secure 2024-09-12T17:37:55.785 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: crc 2024-09-12T17:37:55.785 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: secure 2024-09-12T17:37:55.785 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.786 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 1 librados: starting msgr at 2024-09-12T17:37:55.786 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 1 librados: starting objecter 2024-09-12T17:37:55.786 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c5cf6d5360 EEXIST 2024-09-12T17:37:55.786 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 1 librados: setting wanted keys 2024-09-12T17:37:55.786 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 1 librados: calling monclient init 2024-09-12T17:37:55.786 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient: init 2024-09-12T17:37:55.786 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding auth protocol: cephx 2024-09-12T17:37:55.786 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding auth protocol: cephx 2024-09-12T17:37:55.786 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding auth protocol: cephx 2024-09-12T17:37:55.786 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: secure 2024-09-12T17:37:55.786 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: crc 2024-09-12T17:37:55.786 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: secure 2024-09-12T17:37:55.786 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: crc 2024-09-12T17:37:55.786 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: secure 2024-09-12T17:37:55.786 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: crc 2024-09-12T17:37:55.787 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: crc 2024-09-12T17:37:55.787 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: secure 2024-09-12T17:37:55.787 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: crc 2024-09-12T17:37:55.787 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: secure 2024-09-12T17:37:55.787 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: crc 2024-09-12T17:37:55.787 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: secure 2024-09-12T17:37:55.787 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.787 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.787 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command rotate-key cmddesc rotate-key hook 0x55c5cf6d0ed8 EEXIST 2024-09-12T17:37:55.787 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient: _reopen_session rank -1 2024-09-12T17:37:55.787 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:37:55.787 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-b con 0x55c5cf6f4a40 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:37:55.787 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-a con 0x55c5cf715dc0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:37:55.787 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-c con 0x55c5cf725020 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:37:55.788 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.788 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.788 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.788 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient(hunting): _renew_subs 2024-09-12T17:37:55.788 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient(hunting): authenticate will time out at 2643.472972s 2024-09-12T17:37:55.788 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:37:55.440+0000 7f3ba2eba640 10 monclient(hunting): get_auth_request con 0x55c5cf725020 auth_method 0 2024-09-12T17:37:55.788 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:37:55.440+0000 7f3ba2eba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.788 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:37:55.440+0000 7f3ba2eba640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.788 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:37:55.440+0000 7f3ba2eba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.788 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient(hunting): get_auth_request con 0x55c5cf715dc0 auth_method 0 2024-09-12T17:37:55.788 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.788 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.788 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.789 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:37:55.440+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:55.789 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:37:55.440+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:55.789 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:37:55.440+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:55.789 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:55.789 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:55.789 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:55.789 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:37:55.440+0000 7f3ba26b9640 10 monclient(hunting): get_auth_request con 0x55c5cf6f4a40 auth_method 0 2024-09-12T17:37:55.789 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:37:55.440+0000 7f3ba26b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.789 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:37:55.440+0000 7f3ba26b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.789 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:37:55.440+0000 7f3ba26b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.789 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_done global_id 7773 payload 824 2024-09-12T17:37:55.789 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient: _finish_hunting 0 2024-09-12T17:37:55.789 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 1 monclient: found mon.noname-a 2024-09-12T17:37:55.790 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.790 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.790 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:55.790 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: dump: 2024-09-12T17:37:55.790 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.790 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.790 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.790 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.790 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.790 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.790 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.790 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.790 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.790 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.791 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: _finish_auth 0 2024-09-12T17:37:55.791 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:37:55.791 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:55.791 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.791 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:55.791 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: dump: 2024-09-12T17:37:55.791 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.791 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.791 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.791 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.791 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.791 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.791 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.791 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.791 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.792 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.792 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:37:55.440+0000 7f3a867fc640 4 set_mon_vals no callback set 2024-09-12T17:37:55.792 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 monclient: authenticate success, global_id 7773 2024-09-12T17:37:55.792 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient: _renew_subs 2024-09-12T17:37:55.792 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.792 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient: _renew_subs 2024-09-12T17:37:55.792 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.792 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 1 librados: init done 2024-09-12T17:37:55.792 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command cr dump hook 0x55c5cf722708 2024-09-12T17:37:55.792 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.792 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:37:55.444+0000 7f3a84ff9640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:37:55.792 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:37:55.444+0000 7f3a84ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:55.792 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:37:55.444+0000 7f3a84ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:55.793 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:37:55.444+0000 7f3ba26b9640 10 monclient: get_auth_request con 0x7f3a6c070ae0 auth_method 0 2024-09-12T17:37:55.793 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:37:55.444+0000 7f3ba2eba640 10 monclient: get_auth_request con 0x55c5cf73ed20 auth_method 0 2024-09-12T17:37:55.793 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.793 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 realm 2024-09-12T17:37:55.793 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.793 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.793 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:55.793 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.793 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.793 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.793 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:37:55.444+0000 7f3ba26b9640 10 monclient: get_auth_request con 0x55c5cf742f60 auth_method 0 2024-09-12T17:37:55.793 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:55.794 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.794 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:37:55.444+0000 7f3ba36bb640 10 monclient: get_auth_request con 0x55c5cf7467c0 auth_method 0 2024-09-12T17:37:55.794 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:37:55.448+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:55.794 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:37:55.448+0000 7f3ba53b49c0 20 searching for the correct realm 2024-09-12T17:37:55.794 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:37:55.448+0000 7f3ba2eba640 10 monclient: get_auth_request con 0x55c5cf74b540 auth_method 0 2024-09-12T17:37:55.794 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:37:55.448+0000 7f3ba26b9640 0 -- 172.21.15.119:0/512277809 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f3b9405bbe0 msgr2=0x7f3b9407cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:55.794 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:37:55.652+0000 7f3ba26b9640 10 monclient: get_auth_request con 0x7f3b9405bbe0 auth_method 0 2024-09-12T17:37:55.794 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:37:55.652+0000 7f3ba36bb640 10 monclient: get_auth_request con 0x7f3b980ad930 auth_method 0 2024-09-12T17:37:55.794 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:37:55.660+0000 7f3ba2eba640 10 monclient: get_auth_request con 0x55c5cf4dcd40 auth_method 0 2024-09-12T17:37:55.794 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:37:55.664+0000 7f3ba36bb640 0 -- 172.21.15.119:0/512277809 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f3b980ad930 msgr2=0x7f3b980ef410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:55.794 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:37:55.664+0000 7f3a84ff9640 1 client.7773.objecter ms_handle_reset 0x7f3b980ad930 session 0x7f3b980e7040 osd.2 2024-09-12T17:37:55.794 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:37:55.664+0000 7f3a84ff9640 10 monclient: _renew_subs 2024-09-12T17:37:55.794 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:37:55.664+0000 7f3a84ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.794 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:37:55.664+0000 7f3ba36bb640 10 monclient: get_auth_request con 0x7f3a6c081290 auth_method 0 2024-09-12T17:37:55.794 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:37:55.664+0000 7f3ba26b9640 10 monclient: get_auth_request con 0x55c5cf594ce0 auth_method 0 2024-09-12T17:37:55.795 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:55.795 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:55.795 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:55.795 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:55.795 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:55.795 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:55.795 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.795 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.795 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.795 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:55.795 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.795 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:55.795 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 zone default found 2024-09-12T17:37:55.795 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 4 Realm: () 2024-09-12T17:37:55.796 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:55.796 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:55.796 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:55.796 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 zonegroup default 2024-09-12T17:37:55.796 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.796 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.796 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.796 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.796 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.796 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.796 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 started sync module instance, tier type = 2024-09-12T17:37:55.796 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:55.796 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=0 2024-09-12T17:37:55.796 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=1 2024-09-12T17:37:55.797 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=2 2024-09-12T17:37:55.797 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=3 2024-09-12T17:37:55.797 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=4 2024-09-12T17:37:55.797 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=5 2024-09-12T17:37:55.797 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=6 2024-09-12T17:37:55.797 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=7 2024-09-12T17:37:55.797 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:55.797 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding auth protocol: cephx 2024-09-12T17:37:55.797 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding auth protocol: cephx 2024-09-12T17:37:55.797 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding auth protocol: cephx 2024-09-12T17:37:55.797 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: secure 2024-09-12T17:37:55.797 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: crc 2024-09-12T17:37:55.798 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: secure 2024-09-12T17:37:55.798 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: crc 2024-09-12T17:37:55.798 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: secure 2024-09-12T17:37:55.798 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: crc 2024-09-12T17:37:55.798 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: crc 2024-09-12T17:37:55.798 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: secure 2024-09-12T17:37:55.798 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: crc 2024-09-12T17:37:55.798 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: secure 2024-09-12T17:37:55.798 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: crc 2024-09-12T17:37:55.798 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:37:55.712+0000 7f3a597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:55.798 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: secure 2024-09-12T17:37:55.798 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.798 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:55.798 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:55.799 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command cache list hook 0x55c5cf71e110 2024-09-12T17:37:55.799 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command cache inspect hook 0x55c5cf71e110 2024-09-12T17:37:55.799 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command cache erase hook 0x55c5cf71e110 2024-09-12T17:37:55.799 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command cache zap hook 0x55c5cf71e110 2024-09-12T17:37:55.799 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 5 note: GC not initialized 2024-09-12T17:37:55.799 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:37:55.716+0000 7f39d3fff640 20 reqs_thread_entry: start 2024-09-12T17:37:55.799 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command sync trace show hook 0x7f3b8c001d40 2024-09-12T17:37:55.799 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command sync trace history hook 0x7f3b8c001d40 2024-09-12T17:37:55.799 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command sync trace active hook 0x7f3b8c001d40 2024-09-12T17:37:55.799 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command sync trace active_short hook 0x7f3b8c001d40 2024-09-12T17:37:55.799 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:55.799 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 Filter name: none 2024-09-12T17:37:55.799 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:37:55.716+0000 7f39d1ffb640 20 reqs_thread_entry: start 2024-09-12T17:37:55.799 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:37:55.799 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.800 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:37:55.800 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:37:55.800 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:37:55.800 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 : miss 2024-09-12T17:37:55.800 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.800 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:37:55.800 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:37:55.800 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:37:55.800 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:55.800 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:55.800 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 2024-09-12T17:37:55.800 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:37:55.732+0000 7f3ba53b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:37:55.800 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:37:55.732+0000 7f3ba53b49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:37:55.800 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:37:55.732+0000 7f3ba53b49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:55.801 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:37:55.732+0000 7f3ba53b49c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37, ofs0, ns] 2024-09-12T17:37:55.801 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:37:55.732+0000 7f3a867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333453 cookie 94308077482096 notifier 7773 bl.length()=1007 2024-09-12T17:37:55.801 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:37:55.732+0000 7f3a867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:37:55.801 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:37:55.732+0000 7f3a867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:37:55.801 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:37:55.732+0000 7f3a867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:55.801 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:37:55.732+0000 7f3ba53b49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): orig_sources= new_sources= 2024-09-12T17:37:55.801 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:37:55.736+0000 7f3ba53b49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): potential sources added=[] removed=[] 2024-09-12T17:37:55.801 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:37:55.736+0000 7f3ba53b49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): orig_dests= new_dests= 2024-09-12T17:37:55.801 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:37:55.736+0000 7f3ba53b49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): potential dests added=[] removed=[] 2024-09-12T17:37:55.801 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:37:55.740+0000 7f3ba53b49c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3ba53b49c0 time 2024-09-12T17:37:55.742000+0000 2024-09-12T17:37:55.801 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:37:55.801 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.801 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:55.802 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3ba8c8e2eb] 2024-09-12T17:37:55.802 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3ba8c8e49f] 2024-09-12T17:37:55.802 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5cc7530c1] 2024-09-12T17:37:55.802 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x14100ec) [0x55c5cd1a90ec] 2024-09-12T17:37:55.802 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c5cc76518d] 2024-09-12T17:37:55.802 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:37:55.802 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3ba7af4d90] 2024-09-12T17:37:55.802 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:37:55.802 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:37:55.802 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.802 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:37:55.740+0000 7f3ba53b49c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:37:55.802 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f3ba53b49c0 thread_name:radosgw-admin 2024-09-12T17:37:55.802 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.802 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:55.803 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3ba7b0d520] 2024-09-12T17:37:55.803 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:37:55.803 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:37:55.803 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:37:55.803 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3ba8c8e345] 2024-09-12T17:37:55.803 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3ba8c8e49f] 2024-09-12T17:37:55.803 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5cc7530c1] 2024-09-12T17:37:55.803 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x14100ec) [0x55c5cd1a90ec] 2024-09-12T17:37:55.803 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c5cc76518d] 2024-09-12T17:37:55.803 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:37:55.803 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3ba7af4d90] 2024-09-12T17:37:55.803 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:37:55.803 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:37:55.804 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:37:55.804 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.804 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:37:55.804 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:37:55.804 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:37:55.804 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:37:55.804 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:37:55.804 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:37:55.804 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:37:55.804 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:37:55.804 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:37:55.804 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:37:55.804 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:37:55.805 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:37:55.805 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:37:55.805 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:37:55.805 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:37:55.805 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:37:55.805 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:37:55.805 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:37:55.805 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:37:55.805 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:37:55.805 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:37:55.805 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:37:55.805 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:37:55.805 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:37:55.806 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:37:55.806 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:37:55.806 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:37:55.806 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:37:55.806 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:37:55.806 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:37:55.806 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:37:55.806 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:37:55.806 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:37:55.806 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:37:55.806 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:37:55.806 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:37:55.806 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:37:55.807 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:37:55.807 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:37:55.807 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:37:55.807 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:37:55.807 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:37:55.807 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:37:55.807 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:37:55.807 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:37:55.807 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:37:55.807 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:37:55.807 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:37:55.808 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:37:55.808 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:37:55.808 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:37:55.808 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:37:55.808 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:37:55.808 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:37:55.808 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:37:55.808 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:37:55.808 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:37:55.808 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:37:55.808 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:37:55.808 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:37:55.809 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:37:55.809 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:37:55.809 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:37:55.809 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:37:55.809 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:37:55.809 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:37:55.809 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:37:55.809 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:37:55.809 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:37:55.809 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:37:55.809 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:37:55.809 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:37:55.809 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:37:55.810 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:37:55.810 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:37:55.810 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:37:55.810 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:37:55.810 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:37:55.810 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:37:55.810 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:37:55.810 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:37:55.810 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:37:55.810 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:37:55.810 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:37:55.810 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:37:55.811 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:37:55.811 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:37:55.811 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:37:55.811 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:37:55.811 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:37:55.811 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:37:55.811 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:37:55.811 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:37:55.811 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:37:55.811 INFO:tasks.workunit.client.0.smithi119.stderr: 7f39d1ffb640 / http_manager 2024-09-12T17:37:55.811 INFO:tasks.workunit.client.0.smithi119.stderr: 7f39d3fff640 / http_manager 2024-09-12T17:37:55.811 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3a597e2640 / rgw_dt_lg_renew 2024-09-12T17:37:55.811 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3a84ff9640 / ms_dispatch 2024-09-12T17:37:55.812 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3a867fc640 / io_context_pool 2024-09-12T17:37:55.812 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3a8ce01640 / ms_dispatch 2024-09-12T17:37:55.812 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3a8f606640 / ms_dispatch 2024-09-12T17:37:55.812 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3a90e09640 / io_context_pool 2024-09-12T17:37:55.812 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3ba26b9640 / msgr-worker-2 2024-09-12T17:37:55.812 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3ba2eba640 / msgr-worker-1 2024-09-12T17:37:55.812 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3ba36bb640 / msgr-worker-0 2024-09-12T17:37:55.812 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3ba3ebc640 / io_context_pool 2024-09-12T17:37:55.812 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3ba53b49c0 / radosgw-admin 2024-09-12T17:37:55.812 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:37:55.812 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:37:55.812 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/log/ceph/ceph-client.admin.127463.log 2024-09-12T17:37:55.812 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:37:55.813 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:37:55.813 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.813 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:55.813 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: dump: 2024-09-12T17:37:55.813 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.813 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.813 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.813 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.813 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.813 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.813 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.813 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.814 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.814 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.814 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: _finish_auth 0 2024-09-12T17:37:55.814 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: _check_auth_tickets 2024-09-12T17:37:55.814 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:55.814 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 monclient: authenticate success, global_id 7761 2024-09-12T17:37:55.814 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: get_monmap_and_config success 2024-09-12T17:37:55.814 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 4 set_mon_vals no callback set 2024-09-12T17:37:55.814 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.814 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:55.814 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:37:55.420+0000 7f3a90e09640 10 monclient: dump: 2024-09-12T17:37:55.814 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.814 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.815 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.815 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.815 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.815 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.815 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.815 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.815 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.815 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.815 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: shutdown 2024-09-12T17:37:55.815 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) unregister_commands rotate-key 2024-09-12T17:37:55.815 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: build_initial_monmap 2024-09-12T17:37:55.815 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 1 build_initial for_mkfs: 0 2024-09-12T17:37:55.815 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: monmap: 2024-09-12T17:37:55.816 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:37:55.816 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:55.816 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:37:55.816 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:37:55.816 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:55.816 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.816 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:37:55.816 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:37:55.816 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:37:55.816 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.816 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding auth protocol: cephx 2024-09-12T17:37:55.816 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding auth protocol: cephx 2024-09-12T17:37:55.816 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding auth protocol: cephx 2024-09-12T17:37:55.816 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: secure 2024-09-12T17:37:55.817 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: crc 2024-09-12T17:37:55.817 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: secure 2024-09-12T17:37:55.817 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: crc 2024-09-12T17:37:55.817 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: secure 2024-09-12T17:37:55.817 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: crc 2024-09-12T17:37:55.817 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: crc 2024-09-12T17:37:55.817 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: secure 2024-09-12T17:37:55.817 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: crc 2024-09-12T17:37:55.817 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: secure 2024-09-12T17:37:55.817 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: crc 2024-09-12T17:37:55.817 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf654b70) adding con mode: secure 2024-09-12T17:37:55.817 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.818 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 1 librados: starting msgr at 2024-09-12T17:37:55.818 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 1 librados: starting objecter 2024-09-12T17:37:55.818 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command objecter_requests hook 0x55c5cf653dc0 2024-09-12T17:37:55.818 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 1 librados: setting wanted keys 2024-09-12T17:37:55.818 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 1 librados: calling monclient init 2024-09-12T17:37:55.818 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: init 2024-09-12T17:37:55.818 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding auth protocol: cephx 2024-09-12T17:37:55.818 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding auth protocol: cephx 2024-09-12T17:37:55.818 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding auth protocol: cephx 2024-09-12T17:37:55.818 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: secure 2024-09-12T17:37:55.818 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: crc 2024-09-12T17:37:55.818 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: secure 2024-09-12T17:37:55.818 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: crc 2024-09-12T17:37:55.818 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: secure 2024-09-12T17:37:55.818 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: crc 2024-09-12T17:37:55.818 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: crc 2024-09-12T17:37:55.819 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: secure 2024-09-12T17:37:55.819 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: crc 2024-09-12T17:37:55.819 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: secure 2024-09-12T17:37:55.819 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: crc 2024-09-12T17:37:55.819 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf64f5d0) adding con mode: secure 2024-09-12T17:37:55.819 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.819 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.819 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command rotate-key hook 0x55c5cf64f718 2024-09-12T17:37:55.819 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: _reopen_session rank -1 2024-09-12T17:37:55.819 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:37:55.819 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-a con 0x55c5cf655760 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:37:55.819 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-b con 0x55c5cf655b40 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:37:55.819 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-c con 0x7f3b8c003100 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:37:55.819 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.820 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.820 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.820 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient(hunting): _renew_subs 2024-09-12T17:37:55.820 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient(hunting): authenticate will time out at 2643.454733s 2024-09-12T17:37:55.820 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient(hunting): get_auth_request con 0x55c5cf655760 auth_method 0 2024-09-12T17:37:55.820 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.820 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.820 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.820 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:37:55.420+0000 7f3ba36bb640 10 monclient(hunting): get_auth_request con 0x7f3b8c003100 auth_method 0 2024-09-12T17:37:55.820 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:37:55.420+0000 7f3ba36bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.820 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:37:55.420+0000 7f3ba36bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.820 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:37:55.420+0000 7f3ba36bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.820 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:55.820 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:55.820 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:55.821 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:37:55.420+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:55.821 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:37:55.420+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:55.821 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:37:55.420+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:55.821 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_done global_id 7764 payload 824 2024-09-12T17:37:55.821 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient: _finish_hunting 0 2024-09-12T17:37:55.821 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 1 monclient: found mon.noname-a 2024-09-12T17:37:55.821 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:37:55.420+0000 7f3ba2eba640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.821 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.821 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:55.821 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: dump: 2024-09-12T17:37:55.821 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.821 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.821 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.822 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.822 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.822 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.822 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.822 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.822 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.822 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.822 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: _finish_auth 0 2024-09-12T17:37:55.822 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: _check_auth_tickets 2024-09-12T17:37:55.822 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:55.822 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.822 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:55.822 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:37:55.420+0000 7f3a8f606640 10 monclient: dump: 2024-09-12T17:37:55.822 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.823 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.823 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.823 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.823 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.823 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.823 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.823 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.823 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.823 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.823 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 5 monclient: authenticate success, global_id 7764 2024-09-12T17:37:55.823 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: _renew_subs 2024-09-12T17:37:55.823 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:37:55.420+0000 7f3a90e09640 4 set_mon_vals no callback set 2024-09-12T17:37:55.824 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.824 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: _renew_subs 2024-09-12T17:37:55.824 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.824 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:37:55.420+0000 7f3ba53b49c0 1 librados: init done 2024-09-12T17:37:55.824 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:37:55.424+0000 7f3a8f606640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:37:55.824 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:37:55.424+0000 7f3a8f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:55.824 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:37:55.424+0000 7f3a8f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:55.824 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:37:55.424+0000 7f3ba26b9640 10 monclient: get_auth_request con 0x7f3a88070ae0 auth_method 0 2024-09-12T17:37:55.824 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:37:55.424+0000 7f3ba36bb640 10 monclient: get_auth_request con 0x55c5cf67d2b0 auth_method 0 2024-09-12T17:37:55.824 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:37:55.424+0000 7f3ba2eba640 10 monclient: get_auth_request con 0x55c5cf69aec0 auth_method 0 2024-09-12T17:37:55.824 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:37:55.428+0000 7f3ba26b9640 10 monclient: get_auth_request con 0x55c5cf69f220 auth_method 0 2024-09-12T17:37:55.824 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:37:55.428+0000 7f3ba36bb640 10 monclient: get_auth_request con 0x55c5cf69e790 auth_method 0 2024-09-12T17:37:55.825 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: build_initial_monmap 2024-09-12T17:37:55.825 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 1 build_initial for_mkfs: 0 2024-09-12T17:37:55.825 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: monmap: 2024-09-12T17:37:55.825 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:37:55.825 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:55.825 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:37:55.825 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:37:55.825 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:55.825 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.825 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:37:55.825 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:37:55.825 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:37:55.825 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.825 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding auth protocol: cephx 2024-09-12T17:37:55.826 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding auth protocol: cephx 2024-09-12T17:37:55.826 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding auth protocol: cephx 2024-09-12T17:37:55.826 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: secure 2024-09-12T17:37:55.826 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: crc 2024-09-12T17:37:55.826 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: secure 2024-09-12T17:37:55.826 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: crc 2024-09-12T17:37:55.826 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: secure 2024-09-12T17:37:55.826 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: crc 2024-09-12T17:37:55.826 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: crc 2024-09-12T17:37:55.826 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: secure 2024-09-12T17:37:55.826 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: crc 2024-09-12T17:37:55.826 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: secure 2024-09-12T17:37:55.826 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: crc 2024-09-12T17:37:55.827 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a73d0) adding con mode: secure 2024-09-12T17:37:55.827 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.827 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c5cf6aadc0 EEXIST 2024-09-12T17:37:55.827 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: init 2024-09-12T17:37:55.827 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding auth protocol: cephx 2024-09-12T17:37:55.827 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding auth protocol: cephx 2024-09-12T17:37:55.827 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding auth protocol: cephx 2024-09-12T17:37:55.827 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: secure 2024-09-12T17:37:55.827 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: crc 2024-09-12T17:37:55.827 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: secure 2024-09-12T17:37:55.827 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: crc 2024-09-12T17:37:55.827 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: secure 2024-09-12T17:37:55.827 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: crc 2024-09-12T17:37:55.827 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: crc 2024-09-12T17:37:55.828 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: secure 2024-09-12T17:37:55.828 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: crc 2024-09-12T17:37:55.828 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: secure 2024-09-12T17:37:55.828 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: crc 2024-09-12T17:37:55.828 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6a6318) adding con mode: secure 2024-09-12T17:37:55.828 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.828 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.828 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command rotate-key cmddesc rotate-key hook 0x55c5cf6a6460 EEXIST 2024-09-12T17:37:55.828 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: _reopen_session rank -1 2024-09-12T17:37:55.828 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:37:55.828 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-b con 0x55c5cf6cef70 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:37:55.828 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-c con 0x55c5cf6ce8a0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:37:55.828 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-a con 0x55c5cf6cd280 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:37:55.828 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.829 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.829 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.829 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient(hunting): _renew_subs 2024-09-12T17:37:55.829 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient(hunting): authenticate will time out at 2643.466137s 2024-09-12T17:37:55.829 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:37:55.432+0000 7f3ba36bb640 10 monclient(hunting): get_auth_request con 0x55c5cf6ce8a0 auth_method 0 2024-09-12T17:37:55.829 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:37:55.432+0000 7f3ba36bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.829 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:37:55.432+0000 7f3ba36bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.829 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:37:55.432+0000 7f3ba36bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.829 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient(hunting): get_auth_request con 0x55c5cf6cd280 auth_method 0 2024-09-12T17:37:55.829 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.829 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.829 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.829 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:37:55.432+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:55.830 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:37:55.432+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:55.830 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:37:55.432+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:55.830 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:55.830 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:55.830 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:55.830 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:37:55.432+0000 7f3ba26b9640 10 monclient(hunting): get_auth_request con 0x55c5cf6cef70 auth_method 0 2024-09-12T17:37:55.830 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:37:55.432+0000 7f3ba26b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.830 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:37:55.432+0000 7f3ba26b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.830 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:37:55.432+0000 7f3ba26b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.830 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_done global_id 7767 payload 824 2024-09-12T17:37:55.830 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient: _finish_hunting 0 2024-09-12T17:37:55.830 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 1 monclient: found mon.noname-a 2024-09-12T17:37:55.830 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:37:55.432+0000 7f3ba2eba640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.830 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.831 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:55.831 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: dump: 2024-09-12T17:37:55.831 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.831 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.831 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.831 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.831 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.831 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.831 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.831 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.831 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.831 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.831 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: _finish_auth 0 2024-09-12T17:37:55.831 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: _check_auth_tickets 2024-09-12T17:37:55.832 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:55.832 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.832 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:55.832 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:37:55.432+0000 7f3a8ce01640 10 monclient: dump: 2024-09-12T17:37:55.832 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.832 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.832 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.832 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.832 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.832 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.832 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.832 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.832 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.833 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.833 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 5 monclient: authenticate success, global_id 7767 2024-09-12T17:37:55.833 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: _renew_subs 2024-09-12T17:37:55.833 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:37:55.432+0000 7f3ba3ebc640 4 set_mon_vals no callback set 2024-09-12T17:37:55.833 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.833 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: _renew_subs 2024-09-12T17:37:55.833 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:37:55.432+0000 7f3ba53b49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.833 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:37:55.436+0000 7f3a8ce01640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:37:55.833 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:37:55.436+0000 7f3a8ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:55.833 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:37:55.436+0000 7f3a8ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:55.834 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: get_monmap_and_config 2024-09-12T17:37:55.834 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: build_initial_monmap 2024-09-12T17:37:55.834 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 1 build_initial for_mkfs: 0 2024-09-12T17:37:55.834 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: monmap: 2024-09-12T17:37:55.834 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:37:55.834 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:55.834 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:37:55.834 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:37:55.834 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:55.834 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.834 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:37:55.834 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:37:55.834 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:37:55.834 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.835 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding auth protocol: cephx 2024-09-12T17:37:55.835 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding auth protocol: cephx 2024-09-12T17:37:55.835 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding auth protocol: cephx 2024-09-12T17:37:55.835 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: secure 2024-09-12T17:37:55.835 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: crc 2024-09-12T17:37:55.835 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: secure 2024-09-12T17:37:55.835 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: crc 2024-09-12T17:37:55.835 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: secure 2024-09-12T17:37:55.835 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: crc 2024-09-12T17:37:55.835 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: crc 2024-09-12T17:37:55.835 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: secure 2024-09-12T17:37:55.835 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: crc 2024-09-12T17:37:55.836 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: secure 2024-09-12T17:37:55.836 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: crc 2024-09-12T17:37:55.836 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6ee8a0) adding con mode: secure 2024-09-12T17:37:55.836 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:37:55.436+0000 7f3ba26b9640 10 monclient: get_auth_request con 0x7f3a7c070a20 auth_method 0 2024-09-12T17:37:55.836 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.836 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: init 2024-09-12T17:37:55.836 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding auth protocol: cephx 2024-09-12T17:37:55.836 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding auth protocol: cephx 2024-09-12T17:37:55.836 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding auth protocol: cephx 2024-09-12T17:37:55.836 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: secure 2024-09-12T17:37:55.836 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: crc 2024-09-12T17:37:55.837 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: secure 2024-09-12T17:37:55.837 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: crc 2024-09-12T17:37:55.837 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: secure 2024-09-12T17:37:55.837 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: crc 2024-09-12T17:37:55.837 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: crc 2024-09-12T17:37:55.837 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: secure 2024-09-12T17:37:55.837 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: crc 2024-09-12T17:37:55.837 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: secure 2024-09-12T17:37:55.837 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: crc 2024-09-12T17:37:55.837 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb6060fd0) adding con mode: secure 2024-09-12T17:37:55.837 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.837 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.837 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdb6061118 EEXIST 2024-09-12T17:37:55.838 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: _reopen_session rank -1 2024-09-12T17:37:55.838 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:37:55.838 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-a con 0x55c5cf725020 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:37:55.838 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-b con 0x55c5cf6f4a40 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:37:55.838 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-c con 0x55c5cf715dc0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:37:55.838 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.838 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.838 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.838 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient(hunting): _renew_subs 2024-09-12T17:37:55.838 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient(hunting): authenticate will time out at 2643.470314s 2024-09-12T17:37:55.839 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:37:55.436+0000 7f3ba26b9640 10 monclient(hunting): get_auth_request con 0x55c5cf725020 auth_method 0 2024-09-12T17:37:55.839 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:37:55.436+0000 7f3ba26b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.839 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:37:55.436+0000 7f3ba26b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.839 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:37:55.436+0000 7f3ba26b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.839 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient(hunting): get_auth_request con 0x55c5cf715dc0 auth_method 0 2024-09-12T17:37:55.839 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.839 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.839 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.839 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:37:55.436+0000 7f3ba26b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:55.839 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:37:55.436+0000 7f3ba26b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:55.839 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:37:55.436+0000 7f3ba26b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:55.839 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:55.839 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:55.840 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:55.840 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:37:55.436+0000 7f3ba36bb640 10 monclient(hunting): get_auth_request con 0x55c5cf6f4a40 auth_method 0 2024-09-12T17:37:55.840 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:37:55.436+0000 7f3ba36bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.840 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:37:55.436+0000 7f3ba36bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.840 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:37:55.436+0000 7f3ba36bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.840 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_done global_id 7313 payload 274 2024-09-12T17:37:55.840 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient: _finish_hunting 0 2024-09-12T17:37:55.840 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 1 monclient: found mon.noname-c 2024-09-12T17:37:55.840 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:37:55.436+0000 7f3ba2eba640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:37:55.840 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.840 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:37:55.840 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: dump: 2024-09-12T17:37:55.841 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.841 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.841 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.841 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.841 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.841 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.841 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.841 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.841 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.841 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.841 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: _finish_auth 0 2024-09-12T17:37:55.841 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: _check_auth_tickets 2024-09-12T17:37:55.841 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:55.842 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 monclient: authenticate success, global_id 7313 2024-09-12T17:37:55.842 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: get_monmap_and_config success 2024-09-12T17:37:55.842 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 4 set_mon_vals no callback set 2024-09-12T17:37:55.842 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.842 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:37:55.842 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:37:55.436+0000 7f3a867fc640 10 monclient: dump: 2024-09-12T17:37:55.842 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.842 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.842 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.842 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.842 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.842 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.842 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.843 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.843 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.843 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.843 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: shutdown 2024-09-12T17:37:55.843 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: build_initial_monmap 2024-09-12T17:37:55.843 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 1 build_initial for_mkfs: 0 2024-09-12T17:37:55.843 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 10 monclient: monmap: 2024-09-12T17:37:55.843 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:37:55.843 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:55.843 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:37:55.843 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:37:55.843 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:55.843 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.843 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:37:55.844 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:37:55.844 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:37:55.844 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.844 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding auth protocol: cephx 2024-09-12T17:37:55.844 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding auth protocol: cephx 2024-09-12T17:37:55.844 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding auth protocol: cephx 2024-09-12T17:37:55.844 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: secure 2024-09-12T17:37:55.844 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: crc 2024-09-12T17:37:55.844 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: secure 2024-09-12T17:37:55.844 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: crc 2024-09-12T17:37:55.844 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: secure 2024-09-12T17:37:55.844 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: crc 2024-09-12T17:37:55.844 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: crc 2024-09-12T17:37:55.844 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: secure 2024-09-12T17:37:55.844 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: crc 2024-09-12T17:37:55.845 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: secure 2024-09-12T17:37:55.845 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: crc 2024-09-12T17:37:55.845 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:37:55.436+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf716290) adding con mode: secure 2024-09-12T17:37:55.845 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.845 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 1 librados: starting msgr at 2024-09-12T17:37:55.845 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 1 librados: starting objecter 2024-09-12T17:37:55.845 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c5cf6d5360 EEXIST 2024-09-12T17:37:55.845 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 1 librados: setting wanted keys 2024-09-12T17:37:55.845 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 1 librados: calling monclient init 2024-09-12T17:37:55.845 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient: init 2024-09-12T17:37:55.845 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding auth protocol: cephx 2024-09-12T17:37:55.845 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding auth protocol: cephx 2024-09-12T17:37:55.845 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding auth protocol: cephx 2024-09-12T17:37:55.846 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: secure 2024-09-12T17:37:55.846 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: crc 2024-09-12T17:37:55.846 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: secure 2024-09-12T17:37:55.846 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: crc 2024-09-12T17:37:55.846 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: secure 2024-09-12T17:37:55.846 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: crc 2024-09-12T17:37:55.846 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: crc 2024-09-12T17:37:55.846 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: secure 2024-09-12T17:37:55.846 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: crc 2024-09-12T17:37:55.846 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: secure 2024-09-12T17:37:55.846 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: crc 2024-09-12T17:37:55.846 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 AuthRegistry(0x55c5cf6d0d90) adding con mode: secure 2024-09-12T17:37:55.846 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.847 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.847 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command rotate-key cmddesc rotate-key hook 0x55c5cf6d0ed8 EEXIST 2024-09-12T17:37:55.847 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient: _reopen_session rank -1 2024-09-12T17:37:55.847 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:37:55.847 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-b con 0x55c5cf6f4a40 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:37:55.847 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-a con 0x55c5cf715dc0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:37:55.847 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient(hunting): picked mon.noname-c con 0x55c5cf725020 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:37:55.847 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.847 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.847 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:55.847 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient(hunting): _renew_subs 2024-09-12T17:37:55.847 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient(hunting): authenticate will time out at 2643.472972s 2024-09-12T17:37:55.847 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:37:55.440+0000 7f3ba2eba640 10 monclient(hunting): get_auth_request con 0x55c5cf725020 auth_method 0 2024-09-12T17:37:55.847 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:37:55.440+0000 7f3ba2eba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.848 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:37:55.440+0000 7f3ba2eba640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.848 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:37:55.440+0000 7f3ba2eba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.848 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient(hunting): get_auth_request con 0x55c5cf715dc0 auth_method 0 2024-09-12T17:37:55.848 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.848 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.848 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.848 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:37:55.440+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:55.848 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:37:55.440+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:55.848 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:37:55.440+0000 7f3ba2eba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:55.848 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:55.848 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:55.848 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:55.848 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:37:55.440+0000 7f3ba26b9640 10 monclient(hunting): get_auth_request con 0x55c5cf6f4a40 auth_method 0 2024-09-12T17:37:55.849 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:37:55.440+0000 7f3ba26b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:55.849 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:37:55.440+0000 7f3ba26b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:55.849 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:37:55.440+0000 7f3ba26b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:55.849 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient(hunting): handle_auth_done global_id 7773 payload 824 2024-09-12T17:37:55.849 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient: _finish_hunting 0 2024-09-12T17:37:55.849 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 1 monclient: found mon.noname-a 2024-09-12T17:37:55.849 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:37:55.440+0000 7f3ba36bb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.849 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.849 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:55.849 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: dump: 2024-09-12T17:37:55.849 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.849 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.849 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.850 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.850 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.850 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.850 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.850 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.850 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.850 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.850 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: _finish_auth 0 2024-09-12T17:37:55.850 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:37:55.850 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:55.850 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:55.850 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:55.850 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:37:55.440+0000 7f3a84ff9640 10 monclient: dump: 2024-09-12T17:37:55.851 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:37:55.851 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:37:55.851 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.851 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:37:55.851 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:55.851 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:37:55.851 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:37:55.851 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:37:55.851 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:37:55.851 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.851 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:37:55.440+0000 7f3a867fc640 4 set_mon_vals no callback set 2024-09-12T17:37:55.851 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 monclient: authenticate success, global_id 7773 2024-09-12T17:37:55.851 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient: _renew_subs 2024-09-12T17:37:55.852 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.852 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient: _renew_subs 2024-09-12T17:37:55.852 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.852 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 1 librados: init done 2024-09-12T17:37:55.852 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command cr dump hook 0x55c5cf722708 2024-09-12T17:37:55.852 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:37:55.440+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.852 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:37:55.444+0000 7f3a84ff9640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:37:55.852 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:37:55.444+0000 7f3a84ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:55.852 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:37:55.444+0000 7f3a84ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:37:55.852 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:37:55.444+0000 7f3ba26b9640 10 monclient: get_auth_request con 0x7f3a6c070ae0 auth_method 0 2024-09-12T17:37:55.852 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:37:55.444+0000 7f3ba2eba640 10 monclient: get_auth_request con 0x55c5cf73ed20 auth_method 0 2024-09-12T17:37:55.852 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.852 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 realm 2024-09-12T17:37:55.853 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.853 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.853 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:55.853 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.853 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.853 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.853 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:37:55.444+0000 7f3ba26b9640 10 monclient: get_auth_request con 0x55c5cf742f60 auth_method 0 2024-09-12T17:37:55.853 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:55.853 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:37:55.444+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.853 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:37:55.444+0000 7f3ba36bb640 10 monclient: get_auth_request con 0x55c5cf7467c0 auth_method 0 2024-09-12T17:37:55.853 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:37:55.448+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:55.853 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:37:55.448+0000 7f3ba53b49c0 20 searching for the correct realm 2024-09-12T17:37:55.853 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:37:55.448+0000 7f3ba2eba640 10 monclient: get_auth_request con 0x55c5cf74b540 auth_method 0 2024-09-12T17:37:55.854 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:37:55.448+0000 7f3ba26b9640 0 -- 172.21.15.119:0/512277809 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f3b9405bbe0 msgr2=0x7f3b9407cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:55.854 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:37:55.652+0000 7f3ba26b9640 10 monclient: get_auth_request con 0x7f3b9405bbe0 auth_method 0 2024-09-12T17:37:55.854 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:37:55.652+0000 7f3ba36bb640 10 monclient: get_auth_request con 0x7f3b980ad930 auth_method 0 2024-09-12T17:37:55.854 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:37:55.660+0000 7f3ba2eba640 10 monclient: get_auth_request con 0x55c5cf4dcd40 auth_method 0 2024-09-12T17:37:55.854 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:37:55.664+0000 7f3ba36bb640 0 -- 172.21.15.119:0/512277809 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f3b980ad930 msgr2=0x7f3b980ef410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:55.854 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:37:55.664+0000 7f3a84ff9640 1 client.7773.objecter ms_handle_reset 0x7f3b980ad930 session 0x7f3b980e7040 osd.2 2024-09-12T17:37:55.854 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:37:55.664+0000 7f3a84ff9640 10 monclient: _renew_subs 2024-09-12T17:37:55.854 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:37:55.664+0000 7f3a84ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:37:55.854 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:37:55.664+0000 7f3ba36bb640 10 monclient: get_auth_request con 0x7f3a6c081290 auth_method 0 2024-09-12T17:37:55.854 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:37:55.664+0000 7f3ba26b9640 10 monclient: get_auth_request con 0x55c5cf594ce0 auth_method 0 2024-09-12T17:37:55.854 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:55.855 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:55.855 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:55.855 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:55.855 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:55.855 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:55.855 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.855 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.855 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:37:55.680+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.855 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:55.855 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.855 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:55.855 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 zone default found 2024-09-12T17:37:55.855 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 4 Realm: () 2024-09-12T17:37:55.856 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:55.856 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:55.856 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:55.856 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 zonegroup default 2024-09-12T17:37:55.856 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.856 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.856 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.856 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.856 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.856 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.856 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 started sync module instance, tier type = 2024-09-12T17:37:55.856 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:37:55.684+0000 7f3ba53b49c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:55.856 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=0 2024-09-12T17:37:55.856 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=1 2024-09-12T17:37:55.857 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=2 2024-09-12T17:37:55.857 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=3 2024-09-12T17:37:55.857 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=4 2024-09-12T17:37:55.857 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=5 2024-09-12T17:37:55.857 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=6 2024-09-12T17:37:55.857 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 20 add_watcher() i=7 2024-09-12T17:37:55.857 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:37:55.708+0000 7f3ba53b49c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:55.857 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding auth protocol: cephx 2024-09-12T17:37:55.857 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding auth protocol: cephx 2024-09-12T17:37:55.857 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding auth protocol: cephx 2024-09-12T17:37:55.857 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: secure 2024-09-12T17:37:55.857 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: crc 2024-09-12T17:37:55.857 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: secure 2024-09-12T17:37:55.857 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: crc 2024-09-12T17:37:55.858 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: secure 2024-09-12T17:37:55.858 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: crc 2024-09-12T17:37:55.858 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: crc 2024-09-12T17:37:55.858 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: secure 2024-09-12T17:37:55.858 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: crc 2024-09-12T17:37:55.858 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: secure 2024-09-12T17:37:55.858 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: crc 2024-09-12T17:37:55.858 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:37:55.712+0000 7f3a597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:55.858 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 AuthRegistry(0x7ffdb60614a0) adding con mode: secure 2024-09-12T17:37:55.858 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:55.858 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:55.858 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:55.858 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command cache list hook 0x55c5cf71e110 2024-09-12T17:37:55.858 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command cache inspect hook 0x55c5cf71e110 2024-09-12T17:37:55.858 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command cache erase hook 0x55c5cf71e110 2024-09-12T17:37:55.859 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:37:55.712+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command cache zap hook 0x55c5cf71e110 2024-09-12T17:37:55.859 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 5 note: GC not initialized 2024-09-12T17:37:55.859 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:37:55.716+0000 7f39d3fff640 20 reqs_thread_entry: start 2024-09-12T17:37:55.859 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command sync trace show hook 0x7f3b8c001d40 2024-09-12T17:37:55.859 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command sync trace history hook 0x7f3b8c001d40 2024-09-12T17:37:55.859 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command sync trace active hook 0x7f3b8c001d40 2024-09-12T17:37:55.859 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 5 asok(0x55c5cf4442b0) register_command sync trace active_short hook 0x7f3b8c001d40 2024-09-12T17:37:55.859 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:55.859 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 Filter name: none 2024-09-12T17:37:55.859 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:37:55.716+0000 7f39d1ffb640 20 reqs_thread_entry: start 2024-09-12T17:37:55.859 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:37:55.859 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.859 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:37:55.859 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:37:55.860 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:37:55.860 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 : miss 2024-09-12T17:37:55.860 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.860 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:37:55.860 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:37:55.860 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:37:55.860 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:55.860 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:55.860 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:37:55.716+0000 7f3ba53b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 2024-09-12T17:37:55.860 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:37:55.732+0000 7f3ba53b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:37:55.860 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:37:55.732+0000 7f3ba53b49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:37:55.860 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:37:55.732+0000 7f3ba53b49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:55.860 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:37:55.732+0000 7f3ba53b49c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37, ofs0, ns] 2024-09-12T17:37:55.860 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:37:55.732+0000 7f3a867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333453 cookie 94308077482096 notifier 7773 bl.length()=1007 2024-09-12T17:37:55.861 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:37:55.732+0000 7f3a867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:37:55.861 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:37:55.732+0000 7f3a867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:37:55.861 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:37:55.732+0000 7f3a867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:55.861 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:37:55.732+0000 7f3ba53b49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): orig_sources= new_sources= 2024-09-12T17:37:55.861 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:37:55.736+0000 7f3ba53b49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): potential sources added=[] removed=[] 2024-09-12T17:37:55.861 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:37:55.736+0000 7f3ba53b49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): orig_dests= new_dests= 2024-09-12T17:37:55.861 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:37:55.736+0000 7f3ba53b49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): potential dests added=[] removed=[] 2024-09-12T17:37:55.861 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:37:55.740+0000 7f3ba53b49c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3ba53b49c0 time 2024-09-12T17:37:55.742000+0000 2024-09-12T17:37:55.861 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:37:55.861 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.861 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:55.861 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3ba8c8e2eb] 2024-09-12T17:37:55.861 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3ba8c8e49f] 2024-09-12T17:37:55.862 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5cc7530c1] 2024-09-12T17:37:55.862 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x14100ec) [0x55c5cd1a90ec] 2024-09-12T17:37:55.862 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c5cc76518d] 2024-09-12T17:37:55.862 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:37:55.862 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3ba7af4d90] 2024-09-12T17:37:55.862 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:37:55.862 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:37:55.862 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.862 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:37:55.740+0000 7f3ba53b49c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:37:55.862 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f3ba53b49c0 thread_name:radosgw-admin 2024-09-12T17:37:55.862 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.862 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:55.862 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3ba7b0d520] 2024-09-12T17:37:55.862 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:37:55.863 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:37:55.863 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:37:55.863 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3ba8c8e345] 2024-09-12T17:37:55.863 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3ba8c8e49f] 2024-09-12T17:37:55.863 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5cc7530c1] 2024-09-12T17:37:55.863 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x14100ec) [0x55c5cd1a90ec] 2024-09-12T17:37:55.863 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c5cc76518d] 2024-09-12T17:37:55.863 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:37:55.863 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3ba7af4d90] 2024-09-12T17:37:55.863 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:37:55.863 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:37:55.863 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:37:55.863 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:55.864 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:37:55.864 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:37:55.864 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:37:55.864 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:37:55.864 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:37:55.864 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:37:55.864 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:37:55.864 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:37:55.864 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:37:55.864 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:37:55.864 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:37:55.864 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:37:55.864 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:37:55.864 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:37:55.865 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:37:55.865 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:37:55.865 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:37:55.865 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:37:55.865 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:37:55.865 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:37:55.865 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:37:55.865 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:37:55.865 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:37:55.865 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:37:55.865 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:37:55.865 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:37:55.865 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:37:55.866 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:37:55.866 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:37:55.866 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:37:55.866 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:37:55.866 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:37:55.866 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:37:55.866 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:37:55.866 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:37:55.866 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:37:55.866 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:37:55.866 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:37:55.866 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:37:55.866 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:37:55.866 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:37:55.867 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:37:55.867 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:37:55.867 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:37:55.867 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:37:55.867 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:37:55.867 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:37:55.867 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:37:55.867 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:37:55.867 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:37:55.867 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:37:55.867 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:37:55.867 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:37:55.867 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:37:55.867 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:37:55.868 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:37:55.868 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:37:55.868 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:37:55.868 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:37:55.868 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:37:55.868 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:37:55.868 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:37:55.868 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:37:55.868 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:37:55.868 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:37:55.868 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:37:55.868 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:37:55.868 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:37:55.868 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:37:55.869 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:37:55.869 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:37:55.869 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:37:55.869 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:37:55.869 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:37:55.869 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:37:55.869 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:37:55.869 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:37:55.869 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:37:55.869 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:37:55.869 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:37:55.869 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:37:55.869 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:37:55.869 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:37:55.870 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:37:55.870 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:37:55.870 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:37:55.870 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:37:55.870 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:37:55.870 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:37:55.870 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:37:55.870 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:37:55.870 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:37:55.870 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:37:55.870 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:37:55.870 INFO:tasks.workunit.client.0.smithi119.stderr: 7f39d1ffb640 / http_manager 2024-09-12T17:37:55.870 INFO:tasks.workunit.client.0.smithi119.stderr: 7f39d3fff640 / http_manager 2024-09-12T17:37:55.870 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3a597e2640 / rgw_dt_lg_renew 2024-09-12T17:37:55.870 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3a84ff9640 / ms_dispatch 2024-09-12T17:37:55.871 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3a867fc640 / io_context_pool 2024-09-12T17:37:55.871 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3a8ce01640 / ms_dispatch 2024-09-12T17:37:55.871 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3a8f606640 / ms_dispatch 2024-09-12T17:37:55.871 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3a90e09640 / io_context_pool 2024-09-12T17:37:55.871 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3ba26b9640 / msgr-worker-2 2024-09-12T17:37:55.871 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3ba2eba640 / msgr-worker-1 2024-09-12T17:37:55.871 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3ba36bb640 / msgr-worker-0 2024-09-12T17:37:55.871 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3ba3ebc640 / io_context_pool 2024-09-12T17:37:55.871 INFO:tasks.workunit.client.0.smithi119.stderr: 7f3ba53b49c0 / radosgw-admin 2024-09-12T17:37:55.871 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:37:55.871 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:37:55.871 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:37:55.744480Z_3dc67191-3c68-49b8-adf4-ed9d7a527309/log 2024-09-12T17:37:55.871 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:37:55.873 INFO:tasks.workunit.client.0.smithi119.stderr:Aborted 2024-09-12T17:37:55.873 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:37:55.873 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:55.873 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:55.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.828+0000 7f40f9d0a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.832+0000 7f40f9d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.832+0000 7f40f9d0a9c0 20 realm 2024-09-12T17:37:55.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.832+0000 7f40f9d0a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.832+0000 7f40f9d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.832+0000 7f40f9d0a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:55.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.832+0000 7f40f9d0a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.832+0000 7f40f9d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:55.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.832+0000 7f40f9d0a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.832+0000 7f40f9d0a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:55.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.832+0000 7f40f9d0a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:55.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.836+0000 7f40f9d0a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:55.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.836+0000 7f40f9d0a9c0 20 searching for the correct realm 2024-09-12T17:37:55.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.840+0000 7f40f8011640 0 -- 172.21.15.119:0/3356874219 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f40ec10b6a0 msgr2=0x7f40ec1092b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:55.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:55.848+0000 7f40f700f640 0 -- 172.21.15.119:0/3356874219 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f40f0032040 msgr2=0x7f40f003e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:56.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.064+0000 7f40f9d0a9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:56.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.064+0000 7f40f9d0a9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:56.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.064+0000 7f40f9d0a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:56.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.064+0000 7f40f9d0a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:56.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.064+0000 7f40f9d0a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:56.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.064+0000 7f40f9d0a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:56.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.064+0000 7f40f9d0a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.064+0000 7f40f9d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.064+0000 7f40f9d0a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.064+0000 7f40f9d0a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:56.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.064+0000 7f40f9d0a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.068+0000 7f40f9d0a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:56.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.068+0000 7f40f9d0a9c0 20 zone default found 2024-09-12T17:37:56.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.068+0000 7f40f9d0a9c0 4 Realm: () 2024-09-12T17:37:56.100 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.068+0000 7f40f9d0a9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:56.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.068+0000 7f40f9d0a9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:56.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.068+0000 7f40f9d0a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:56.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.068+0000 7f40f9d0a9c0 20 zonegroup default 2024-09-12T17:37:56.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.068+0000 7f40f9d0a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.068+0000 7f40f9d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.068+0000 7f40f9d0a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.068+0000 7f40f9d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.068+0000 7f40f9d0a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.068+0000 7f40f9d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.068+0000 7f40f9d0a9c0 20 started sync module instance, tier type = 2024-09-12T17:37:56.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.068+0000 7f40f9d0a9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:56.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.088+0000 7f40f9d0a9c0 20 add_watcher() i=0 2024-09-12T17:37:56.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.088+0000 7f40f9d0a9c0 20 add_watcher() i=1 2024-09-12T17:37:56.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.088+0000 7f40f9d0a9c0 20 add_watcher() i=2 2024-09-12T17:37:56.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.088+0000 7f40f9d0a9c0 20 add_watcher() i=3 2024-09-12T17:37:56.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.088+0000 7f40f9d0a9c0 20 add_watcher() i=4 2024-09-12T17:37:56.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.088+0000 7f40f9d0a9c0 20 add_watcher() i=5 2024-09-12T17:37:56.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.088+0000 7f40f9d0a9c0 20 add_watcher() i=6 2024-09-12T17:37:56.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.092+0000 7f40f9d0a9c0 20 add_watcher() i=7 2024-09-12T17:37:56.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.092+0000 7f40f9d0a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:56.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.096+0000 7f3fadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:56.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.096+0000 7f40f9d0a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:56.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.096+0000 7f40f9d0a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:56.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.096+0000 7f40f9d0a9c0 5 note: GC not initialized 2024-09-12T17:37:56.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.096+0000 7f3facfe1640 20 reqs_thread_entry: start 2024-09-12T17:37:56.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.096+0000 7f40f9d0a9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:56.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.096+0000 7f40f9d0a9c0 20 Filter name: none 2024-09-12T17:37:56.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.096+0000 7f3f267fc640 20 reqs_thread_entry: start 2024-09-12T17:37:56.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.096+0000 7f40f9d0a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.100+0000 7f40f9d0a9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:37:56.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.100+0000 7f40f9d0a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.100+0000 7f40f9d0a9c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:37:56.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.100+0000 7f40f9d0a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:56.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.100+0000 7f40f9d0a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.100+0000 7f40f9d0a9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:37:56.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.100+0000 7f40f9d0a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.100+0000 7f40f9d0a9c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:37:56.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.100+0000 7f40f9d0a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:56.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.104+0000 7f3fadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:56.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.108+0000 7f40f9d0a9c0 20 remove_watcher() i=0 2024-09-12T17:37:56.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.108+0000 7f40f9d0a9c0 2 removed watcher, disabling cache 2024-09-12T17:37:56.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.112+0000 7f40f9d0a9c0 20 remove_watcher() i=1 2024-09-12T17:37:56.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.112+0000 7f40f9d0a9c0 20 remove_watcher() i=2 2024-09-12T17:37:56.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.116+0000 7f40f9d0a9c0 20 remove_watcher() i=3 2024-09-12T17:37:56.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.120+0000 7f40f9d0a9c0 20 remove_watcher() i=4 2024-09-12T17:37:56.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.120+0000 7f40f9d0a9c0 20 remove_watcher() i=5 2024-09-12T17:37:56.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.120+0000 7f40f9d0a9c0 20 remove_watcher() i=6 2024-09-12T17:37:56.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.124+0000 7f40f9d0a9c0 20 remove_watcher() i=7 2024-09-12T17:37:56.140 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:56.140 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:37:56.140 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-logrecord-writes id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:37:56.140 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:37:56.272 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:37:56.308 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:56.308 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:56.354 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.356+0000 7f79fc51f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.356+0000 7f79fc51f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.356+0000 7f79fc51f9c0 20 realm 2024-09-12T17:37:56.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.356+0000 7f79fc51f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.356+0000 7f79fc51f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.356+0000 7f79fc51f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:56.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.356+0000 7f79fc51f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.356+0000 7f79fc51f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.356+0000 7f79fc51f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.360+0000 7f79fc51f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:56.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.360+0000 7f79fc51f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.360+0000 7f79fc51f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:56.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.360+0000 7f79fc51f9c0 20 searching for the correct realm 2024-09-12T17:37:56.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.364+0000 7f79fa826640 0 -- 172.21.15.119:0/3206361684 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f79f0036070 msgr2=0x7f79f0045420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:56.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.580+0000 7f79f9824640 0 -- 172.21.15.119:0/3206361684 >> [v2:172.21.15.194:6816/2881805626,v1:172.21.15.194:6817/2881805626] conn(0x7f78c4081290 msgr2=0x7f78c40836c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:56.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.800+0000 7f79fc51f9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:37:56.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.800+0000 7f79fc51f9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:37:56.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.800+0000 7f79fc51f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:56.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.800+0000 7f79fc51f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:56.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.800+0000 7f79fc51f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:56.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.800+0000 7f79fc51f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:56.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.800+0000 7f79fc51f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.800+0000 7f79fc51f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.800+0000 7f79fc51f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.800+0000 7f79fc51f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:56.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.800+0000 7f79fc51f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.804+0000 7f79fc51f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:56.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.804+0000 7f79fc51f9c0 20 zone default found 2024-09-12T17:37:56.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.804+0000 7f79fc51f9c0 4 Realm: () 2024-09-12T17:37:56.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.804+0000 7f79fc51f9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:37:56.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.804+0000 7f79fc51f9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:37:56.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.804+0000 7f79fc51f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:56.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.804+0000 7f79fc51f9c0 20 zonegroup default 2024-09-12T17:37:56.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.804+0000 7f79fc51f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.804+0000 7f79fc51f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.804+0000 7f79fc51f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.804+0000 7f79fc51f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.804+0000 7f79fc51f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.805 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.804+0000 7f79fc51f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:56.805 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.804+0000 7f79fc51f9c0 20 started sync module instance, tier type = 2024-09-12T17:37:56.805 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.804+0000 7f79fc51f9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:37:56.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.828+0000 7f79fc51f9c0 20 add_watcher() i=0 2024-09-12T17:37:56.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.828+0000 7f79fc51f9c0 20 add_watcher() i=1 2024-09-12T17:37:56.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.828+0000 7f79fc51f9c0 20 add_watcher() i=2 2024-09-12T17:37:56.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.828+0000 7f79fc51f9c0 20 add_watcher() i=3 2024-09-12T17:37:56.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.828+0000 7f79fc51f9c0 20 add_watcher() i=4 2024-09-12T17:37:56.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.828+0000 7f79fc51f9c0 20 add_watcher() i=5 2024-09-12T17:37:56.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.828+0000 7f79fc51f9c0 20 add_watcher() i=6 2024-09-12T17:37:56.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.832+0000 7f79fc51f9c0 20 add_watcher() i=7 2024-09-12T17:37:56.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.832+0000 7f79fc51f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:56.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.836+0000 7f78b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:56.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.836+0000 7f79fc51f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:56.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.836+0000 7f79fc51f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:56.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.836+0000 7f79fc51f9c0 5 note: GC not initialized 2024-09-12T17:37:56.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.836+0000 7f782b7fe640 20 reqs_thread_entry: start 2024-09-12T17:37:56.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.836+0000 7f79fc51f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:37:56.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.836+0000 7f79fc51f9c0 20 Filter name: none 2024-09-12T17:37:56.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.836+0000 7f78297fa640 20 reqs_thread_entry: start 2024-09-12T17:37:56.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.836+0000 7f79fc51f9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:37:56.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.836+0000 7f79fc51f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.836+0000 7f79fc51f9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:37:56.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.836+0000 7f79fc51f9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:37:56.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.836+0000 7f79fc51f9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:37:56.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.836+0000 7f79fc51f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 : miss 2024-09-12T17:37:56.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.836+0000 7f79fc51f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:37:56.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.840+0000 7f79fc51f9c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:37:56.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.840+0000 7f79fc51f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:37:56.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.840+0000 7f79fc51f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:37:56.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.840+0000 7f79fc51f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:56.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.840+0000 7f79fc51f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:56.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.840+0000 7f79fc51f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 2024-09-12T17:37:56.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.840+0000 7f79fc51f9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to be held by another RGW process; skipping for now 2024-09-12T17:37:56.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.844+0000 7f78b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:56.847 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.848+0000 7f79fc51f9c0 20 remove_watcher() i=0 2024-09-12T17:37:56.847 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.848+0000 7f79fc51f9c0 2 removed watcher, disabling cache 2024-09-12T17:37:56.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.852+0000 7f79fc51f9c0 20 remove_watcher() i=1 2024-09-12T17:37:56.852 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.852+0000 7f79fc51f9c0 20 remove_watcher() i=2 2024-09-12T17:37:56.855 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.856+0000 7f79fc51f9c0 20 remove_watcher() i=3 2024-09-12T17:37:56.857 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.856+0000 7f79fc51f9c0 20 remove_watcher() i=4 2024-09-12T17:37:56.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.860+0000 7f79fc51f9c0 20 remove_watcher() i=5 2024-09-12T17:37:56.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.860+0000 7f79fc51f9c0 20 remove_watcher() i=6 2024-09-12T17:37:56.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:37:56.864+0000 7f79fc51f9c0 20 remove_watcher() i=7 2024-09-12T17:37:56.879 INFO:tasks.workunit.client.0.smithi119.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:38:26.891 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:38:26.927 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:26.927 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:27.190 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.187+0000 7f18b42869c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.191+0000 7f18b42869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.191+0000 7f18b42869c0 20 realm 2024-09-12T17:38:27.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.191+0000 7f18b42869c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.191+0000 7f18b42869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.191+0000 7f18b42869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:27.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.191+0000 7f18b42869c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.191+0000 7f18b42869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.191+0000 7f18b42869c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.191+0000 7f18b42869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:27.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.191+0000 7f18b42869c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.195+0000 7f18b42869c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:27.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.195+0000 7f18b42869c0 20 searching for the correct realm 2024-09-12T17:38:27.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.199+0000 7f18b158b640 0 -- 172.21.15.119:0/817425695 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f18ac036070 msgr2=0x7f18ac0645a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:27.204 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.203+0000 7f18b258d640 0 -- 172.21.15.119:0/817425695 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x559514f62380 msgr2=0x7f189c1103b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:27.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.215+0000 7f18b42869c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:38:27.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.215+0000 7f18b42869c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:38:27.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.215+0000 7f18b42869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:27.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.215+0000 7f18b42869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:27.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.215+0000 7f18b42869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:27.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.215+0000 7f18b42869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:27.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.215+0000 7f18b42869c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.215+0000 7f18b42869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.215+0000 7f18b42869c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.215+0000 7f18b42869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:27.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.215+0000 7f18b42869c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.219+0000 7f18b42869c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:27.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.219+0000 7f18b42869c0 20 zone default found 2024-09-12T17:38:27.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.219+0000 7f18b42869c0 4 Realm: () 2024-09-12T17:38:27.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.219+0000 7f18b42869c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:38:27.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.219+0000 7f18b42869c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:38:27.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.219+0000 7f18b42869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:27.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.219+0000 7f18b42869c0 20 zonegroup default 2024-09-12T17:38:27.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.219+0000 7f18b42869c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.219+0000 7f18b42869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.219+0000 7f18b42869c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.219+0000 7f18b42869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.219+0000 7f18b42869c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.219+0000 7f18b42869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.219+0000 7f18b42869c0 20 started sync module instance, tier type = 2024-09-12T17:38:27.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.219+0000 7f18b42869c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:38:27.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.239+0000 7f18b42869c0 20 add_watcher() i=0 2024-09-12T17:38:27.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.239+0000 7f18b42869c0 20 add_watcher() i=1 2024-09-12T17:38:27.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.239+0000 7f18b42869c0 20 add_watcher() i=2 2024-09-12T17:38:27.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.239+0000 7f18b42869c0 20 add_watcher() i=3 2024-09-12T17:38:27.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.239+0000 7f18b42869c0 20 add_watcher() i=4 2024-09-12T17:38:27.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.239+0000 7f18b42869c0 20 add_watcher() i=5 2024-09-12T17:38:27.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.239+0000 7f18b42869c0 20 add_watcher() i=6 2024-09-12T17:38:27.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.239+0000 7f18b42869c0 20 add_watcher() i=7 2024-09-12T17:38:27.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.239+0000 7f18b42869c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:27.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f17637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:27.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:27.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:27.243 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 5 note: GC not initialized 2024-09-12T17:38:27.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f17627fc640 20 reqs_thread_entry: start 2024-09-12T17:38:27.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:27.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 20 Filter name: none 2024-09-12T17:38:27.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f16d3fff640 20 reqs_thread_entry: start 2024-09-12T17:38:27.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:38:27.244 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:38:27.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:38:27.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:38:27.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 : miss 2024-09-12T17:38:27.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:38:27.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:38:27.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:38:27.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:27.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:27.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.243+0000 7f18b42869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 2024-09-12T17:38:27.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.247+0000 7f18b42869c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:38:27.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.263+0000 7f18b42869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:38:27.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.263+0000 7f18b42869c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:38:27.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.263+0000 7f18b42869c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:27.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.263+0000 7f18b42869c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37, ofs0, ns] 2024-09-12T17:38:27.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.263+0000 7f1794ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333454 cookie 94098791974448 notifier 7370 bl.length()=1007 2024-09-12T17:38:27.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.263+0000 7f1794ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:38:27.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.263+0000 7f1794ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:38:27.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.263+0000 7f1794ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:27.268 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.267+0000 7f18b42869c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): orig_sources= new_sources= 2024-09-12T17:38:27.268 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.267+0000 7f18b42869c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): potential sources added=[] removed=[] 2024-09-12T17:38:27.268 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.267+0000 7f18b42869c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): orig_dests= new_dests= 2024-09-12T17:38:27.268 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.267+0000 7f18b42869c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): potential dests added=[] removed=[] 2024-09-12T17:38:27.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.0 2024-09-12T17:38:27.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.0 2024-09-12T17:38:27.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.1 2024-09-12T17:38:27.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.1 2024-09-12T17:38:27.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.2 2024-09-12T17:38:27.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.2 2024-09-12T17:38:27.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.3 2024-09-12T17:38:27.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.3 2024-09-12T17:38:27.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.4 2024-09-12T17:38:27.278 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.4 2024-09-12T17:38:27.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.5 2024-09-12T17:38:27.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.5 2024-09-12T17:38:27.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.6 2024-09-12T17:38:27.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.6 2024-09-12T17:38:27.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.7 2024-09-12T17:38:27.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.7 2024-09-12T17:38:27.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.8 2024-09-12T17:38:27.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.8 2024-09-12T17:38:27.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.9 2024-09-12T17:38:27.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.9 2024-09-12T17:38:27.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.10 2024-09-12T17:38:27.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.10 2024-09-12T17:38:27.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.11 2024-09-12T17:38:27.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2.11 2024-09-12T17:38:27.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.275+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.0 2024-09-12T17:38:27.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.279+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.1 2024-09-12T17:38:27.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.279+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2 2024-09-12T17:38:27.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.279+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.3 2024-09-12T17:38:27.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.279+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.4 2024-09-12T17:38:27.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.283+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.5 2024-09-12T17:38:27.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.283+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.6 2024-09-12T17:38:27.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.283+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.7 2024-09-12T17:38:27.284 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.283+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.8 2024-09-12T17:38:27.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.283+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.9 2024-09-12T17:38:27.286 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.287+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.10 2024-09-12T17:38:27.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.291+0000 7f18b42869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:38:27.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.291+0000 7f18b42869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 2024-09-12T17:38:27.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.295+0000 7f18b42869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:38:27.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.295+0000 7f18b42869c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:38:27.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.295+0000 7f18b42869c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:27.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.295+0000 7f18b42869c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37, ofs0, ns] 2024-09-12T17:38:27.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.295+0000 7f17957fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333455 cookie 94098791974448 notifier 7370 bl.length()=1007 2024-09-12T17:38:27.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.295+0000 7f17957fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:38:27.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.295+0000 7f17957fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:38:27.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.295+0000 7f17957fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:27.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.299+0000 7f18b42869c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): orig_sources= new_sources= 2024-09-12T17:38:27.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.299+0000 7f18b42869c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): potential sources added=[] removed=[] 2024-09-12T17:38:27.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.299+0000 7f18b42869c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): orig_dests= new_dests= 2024-09-12T17:38:27.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.299+0000 7f18b42869c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): potential dests added=[] removed=[] 2024-09-12T17:38:27.303 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.303+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.0 2024-09-12T17:38:27.303 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.303+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.1 2024-09-12T17:38:27.304 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.303+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.2 2024-09-12T17:38:27.305 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.303+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.3 2024-09-12T17:38:27.306 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.307+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.4 2024-09-12T17:38:27.306 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.307+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.5 2024-09-12T17:38:27.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.307+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.6 2024-09-12T17:38:27.307 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.307+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.7 2024-09-12T17:38:27.308 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.307+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.8 2024-09-12T17:38:27.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.307+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.9 2024-09-12T17:38:27.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.307+0000 7f18b42869c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37.10 2024-09-12T17:38:27.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.311+0000 7f18b42869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:38:27.310 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.311+0000 7f18b42869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 2024-09-12T17:38:27.313 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.311+0000 7f18b42869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:38:27.313 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.311+0000 7f18b42869c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:38:27.313 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.311+0000 7f18b42869c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:27.313 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.311+0000 7f18b42869c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37, ofs0, ns] 2024-09-12T17:38:27.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.311+0000 7f17957fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333456 cookie 94098791974448 notifier 7370 bl.length()=975 2024-09-12T17:38:27.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.311+0000 7f17957fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 info.flags=0x17 2024-09-12T17:38:27.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.311+0000 7f17957fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 to cache LRU end 2024-09-12T17:38:27.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.311+0000 7f17957fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:27.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.315+0000 7f18b42869c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): orig_sources= new_sources= 2024-09-12T17:38:27.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.315+0000 7f18b42869c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): potential sources added=[] removed=[] 2024-09-12T17:38:27.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.315+0000 7f18b42869c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): orig_dests= new_dests= 2024-09-12T17:38:27.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.315+0000 7f18b42869c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37]): potential dests added=[] removed=[] 2024-09-12T17:38:27.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.319+0000 7f18b42869c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:38:27.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.323+0000 7f17637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:27.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.327+0000 7f18b42869c0 20 remove_watcher() i=0 2024-09-12T17:38:27.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.327+0000 7f18b42869c0 2 removed watcher, disabling cache 2024-09-12T17:38:27.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.331+0000 7f18b42869c0 20 remove_watcher() i=1 2024-09-12T17:38:27.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.331+0000 7f18b42869c0 20 remove_watcher() i=2 2024-09-12T17:38:27.335 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.335+0000 7f18b42869c0 20 remove_watcher() i=3 2024-09-12T17:38:27.337 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.335+0000 7f18b42869c0 20 remove_watcher() i=4 2024-09-12T17:38:27.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.339+0000 7f18b42869c0 20 remove_watcher() i=5 2024-09-12T17:38:27.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.339+0000 7f18b42869c0 20 remove_watcher() i=6 2024-09-12T17:38:27.342 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.339+0000 7f18b42869c0 20 remove_watcher() i=7 2024-09-12T17:38:27.357 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:38:27.388 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:27.388 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:27.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.435+0000 7f09d40309c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.435+0000 7f09d40309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.435+0000 7f09d40309c0 20 realm 2024-09-12T17:38:27.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.435+0000 7f09d40309c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.435+0000 7f09d40309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.435+0000 7f09d40309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:27.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.435+0000 7f09d40309c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.435+0000 7f09d40309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.435+0000 7f09d40309c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.439+0000 7f09d40309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:27.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.439+0000 7f09d40309c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.439+0000 7f09d40309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:27.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.439+0000 7f09d40309c0 20 searching for the correct realm 2024-09-12T17:38:27.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.443+0000 7f09d2337640 0 -- 172.21.15.119:0/408957706 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f09c803b060 msgr2=0x7f09c8063c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:27.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.451+0000 7f09d1335640 0 -- 172.21.15.119:0/408957706 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f09cc118040 msgr2=0x7f09cc0b9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:27.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.667+0000 7f09d40309c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:38:27.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.667+0000 7f09d40309c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:38:27.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.667+0000 7f09d40309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:27.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.667+0000 7f09d40309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:27.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.667+0000 7f09d40309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:27.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.667+0000 7f09d40309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:27.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.667+0000 7f09d40309c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.667+0000 7f09d40309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.667+0000 7f09d40309c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.671+0000 7f09d40309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:27.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.671+0000 7f09d40309c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.671+0000 7f09d40309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:27.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.671+0000 7f09d40309c0 20 zone default found 2024-09-12T17:38:27.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.671+0000 7f09d40309c0 4 Realm: () 2024-09-12T17:38:27.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.671+0000 7f09d40309c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:38:27.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.671+0000 7f09d40309c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:38:27.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.671+0000 7f09d40309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:27.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.671+0000 7f09d40309c0 20 zonegroup default 2024-09-12T17:38:27.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.671+0000 7f09d40309c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.671+0000 7f09d40309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.671+0000 7f09d40309c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.671+0000 7f09d40309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.671+0000 7f09d40309c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.675+0000 7f09d40309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:27.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.675+0000 7f09d40309c0 20 started sync module instance, tier type = 2024-09-12T17:38:27.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.675+0000 7f09d40309c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:38:27.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.699+0000 7f09d40309c0 20 add_watcher() i=0 2024-09-12T17:38:27.698 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.699+0000 7f09d40309c0 20 add_watcher() i=1 2024-09-12T17:38:27.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.699+0000 7f09d40309c0 20 add_watcher() i=2 2024-09-12T17:38:27.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.699+0000 7f09d40309c0 20 add_watcher() i=3 2024-09-12T17:38:27.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.699+0000 7f09d40309c0 20 add_watcher() i=4 2024-09-12T17:38:27.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.699+0000 7f09d40309c0 20 add_watcher() i=5 2024-09-12T17:38:27.699 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.699+0000 7f09d40309c0 20 add_watcher() i=6 2024-09-12T17:38:27.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.699+0000 7f09d40309c0 20 add_watcher() i=7 2024-09-12T17:38:27.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.699+0000 7f09d40309c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:27.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.703+0000 7f08837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:27.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.707+0000 7f09d40309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:27.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.707+0000 7f09d40309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:27.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.707+0000 7f09d40309c0 5 note: GC not initialized 2024-09-12T17:38:27.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.707+0000 7f08827fc640 20 reqs_thread_entry: start 2024-09-12T17:38:27.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.707+0000 7f09d40309c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:27.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.707+0000 7f09d40309c0 20 Filter name: none 2024-09-12T17:38:27.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.707+0000 7f07f3fff640 20 reqs_thread_entry: start 2024-09-12T17:38:27.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.707+0000 7f09d40309c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.708 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.707+0000 7f09d40309c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:38:27.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.707+0000 7f09d40309c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.707+0000 7f09d40309c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:38:27.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.707+0000 7f09d40309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:27.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.707+0000 7f09d40309c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.711+0000 7f09d40309c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:38:27.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.711+0000 7f09d40309c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:27.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.711+0000 7f09d40309c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:38:27.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.711+0000 7f09d40309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:27.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.715+0000 7f08837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:27.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.719+0000 7f09d40309c0 20 remove_watcher() i=0 2024-09-12T17:38:27.719 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.719+0000 7f09d40309c0 2 removed watcher, disabling cache 2024-09-12T17:38:27.721 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.719+0000 7f09d40309c0 20 remove_watcher() i=1 2024-09-12T17:38:27.723 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.723+0000 7f09d40309c0 20 remove_watcher() i=2 2024-09-12T17:38:27.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.723+0000 7f09d40309c0 20 remove_watcher() i=3 2024-09-12T17:38:27.727 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.727+0000 7f09d40309c0 20 remove_watcher() i=4 2024-09-12T17:38:27.728 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.727+0000 7f09d40309c0 20 remove_watcher() i=5 2024-09-12T17:38:27.729 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.727+0000 7f09d40309c0 20 remove_watcher() i=6 2024-09-12T17:38:27.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:27.731+0000 7f09d40309c0 20 remove_watcher() i=7 2024-09-12T17:38:27.745 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:27.745 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:38:27.745 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-logrecord-writes id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:38:27.745 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:28.604 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T17:38:28.604 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:30.881 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:38:30.915 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:30.915 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:30.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:30.959+0000 7fa3d53109c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:30.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:30.963+0000 7fa3d53109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:30.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:30.963+0000 7fa3d53109c0 20 realm 2024-09-12T17:38:30.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:30.963+0000 7fa3d53109c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:30.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:30.963+0000 7fa3d53109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:30.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:30.963+0000 7fa3d53109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:30.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:30.963+0000 7fa3d53109c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:30.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:30.963+0000 7fa3d53109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:30.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:30.963+0000 7fa3d53109c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:30.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:30.967+0000 7fa3d53109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:30.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:30.967+0000 7fa3d53109c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:30.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:30.967+0000 7fa3d53109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:30.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:30.967+0000 7fa3d53109c0 20 searching for the correct realm 2024-09-12T17:38:30.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:30.971+0000 7fa3d3617640 0 -- 172.21.15.119:0/3126102536 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fa3bc0e4060 msgr2=0x7fa3bc1220c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:30.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:30.979+0000 7fa3d2615640 0 -- 172.21.15.119:0/3126102536 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fa3cc06d570 msgr2=0x7fa3cc067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:31.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.195+0000 7fa3d53109c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:38:31.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.195+0000 7fa3d53109c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:38:31.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.195+0000 7fa3d53109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:31.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.195+0000 7fa3d53109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:31.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.195+0000 7fa3d53109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:31.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.195+0000 7fa3d53109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:31.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.195+0000 7fa3d53109c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.195+0000 7fa3d53109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:31.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.195+0000 7fa3d53109c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.195+0000 7fa3d53109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:31.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.199+0000 7fa3d53109c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.199+0000 7fa3d53109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:31.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.199+0000 7fa3d53109c0 20 zone default found 2024-09-12T17:38:31.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.199+0000 7fa3d53109c0 4 Realm: () 2024-09-12T17:38:31.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.199+0000 7fa3d53109c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:38:31.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.199+0000 7fa3d53109c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:38:31.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.199+0000 7fa3d53109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:31.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.199+0000 7fa3d53109c0 20 zonegroup default 2024-09-12T17:38:31.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.199+0000 7fa3d53109c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.199+0000 7fa3d53109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:31.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.199+0000 7fa3d53109c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.199+0000 7fa3d53109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:31.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.199+0000 7fa3d53109c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.199+0000 7fa3d53109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:31.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.199+0000 7fa3d53109c0 20 started sync module instance, tier type = 2024-09-12T17:38:31.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.199+0000 7fa3d53109c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:38:31.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.223+0000 7fa3d53109c0 20 add_watcher() i=0 2024-09-12T17:38:31.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.223+0000 7fa3d53109c0 20 add_watcher() i=1 2024-09-12T17:38:31.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.223+0000 7fa3d53109c0 20 add_watcher() i=2 2024-09-12T17:38:31.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.223+0000 7fa3d53109c0 20 add_watcher() i=3 2024-09-12T17:38:31.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.223+0000 7fa3d53109c0 20 add_watcher() i=4 2024-09-12T17:38:31.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.223+0000 7fa3d53109c0 20 add_watcher() i=5 2024-09-12T17:38:31.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.223+0000 7fa3d53109c0 20 add_watcher() i=6 2024-09-12T17:38:31.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.227+0000 7fa3d53109c0 20 add_watcher() i=7 2024-09-12T17:38:31.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.227+0000 7fa3d53109c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:31.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.231+0000 7fa2897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:31.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.231+0000 7fa3d53109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:31.234 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.231+0000 7fa3d53109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:31.234 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.231+0000 7fa3d53109c0 5 note: GC not initialized 2024-09-12T17:38:31.234 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.235+0000 7fa203fff640 20 reqs_thread_entry: start 2024-09-12T17:38:31.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.235+0000 7fa3d53109c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:31.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.235+0000 7fa3d53109c0 20 Filter name: none 2024-09-12T17:38:31.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.235+0000 7fa201ffb640 20 reqs_thread_entry: start 2024-09-12T17:38:31.235 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.235+0000 7fa3d53109c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.235+0000 7fa3d53109c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:31.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.235+0000 7fa3d53109c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.235+0000 7fa3d53109c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:31.237 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.235+0000 7fa3d53109c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:31.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.235+0000 7fa3d53109c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.239+0000 7fa3d53109c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:31.238 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.239+0000 7fa3d53109c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.239+0000 7fa3d53109c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:31.239 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.239+0000 7fa3d53109c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:31.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.243+0000 7fa2897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:31.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.247+0000 7fa3d53109c0 20 remove_watcher() i=0 2024-09-12T17:38:31.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.247+0000 7fa3d53109c0 2 removed watcher, disabling cache 2024-09-12T17:38:31.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.247+0000 7fa3d53109c0 20 remove_watcher() i=1 2024-09-12T17:38:31.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.251+0000 7fa3d53109c0 20 remove_watcher() i=2 2024-09-12T17:38:31.254 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.251+0000 7fa3d53109c0 20 remove_watcher() i=3 2024-09-12T17:38:31.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.255+0000 7fa3d53109c0 20 remove_watcher() i=4 2024-09-12T17:38:31.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.259+0000 7fa3d53109c0 20 remove_watcher() i=5 2024-09-12T17:38:31.260 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.259+0000 7fa3d53109c0 20 remove_watcher() i=6 2024-09-12T17:38:31.261 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.259+0000 7fa3d53109c0 20 remove_watcher() i=7 2024-09-12T17:38:31.278 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:31.279 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:38:31.279 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-change-reshard-state id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:38:31.279 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:31.279 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T17:38:31.316 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:31.316 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:31.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.359+0000 7f65478e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.359+0000 7f65478e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:31.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.359+0000 7f65478e09c0 20 realm 2024-09-12T17:38:31.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.359+0000 7f65478e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.359+0000 7f65478e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:31.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.359+0000 7f65478e09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:31.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.363+0000 7f65478e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.363+0000 7f65478e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:31.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.363+0000 7f65478e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.363+0000 7f65478e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:31.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.363+0000 7f65478e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.363+0000 7f65478e09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:31.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.363+0000 7f65478e09c0 20 searching for the correct realm 2024-09-12T17:38:31.369 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.367+0000 7f6545be7640 0 -- 172.21.15.119:0/1785064004 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x558089cec6e0 msgr2=0x558089ceeb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:31.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.375+0000 7f6544be5640 0 -- 172.21.15.119:0/1785064004 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f65400c2410 msgr2=0x7f65400c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:31.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.591+0000 7f65478e09c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:38:31.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.591+0000 7f65478e09c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:38:31.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.591+0000 7f65478e09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:31.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.591+0000 7f65478e09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:31.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.591+0000 7f65478e09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:31.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.591+0000 7f65478e09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:31.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.591+0000 7f65478e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.591+0000 7f65478e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:31.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.591+0000 7f65478e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.595+0000 7f65478e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:31.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.595+0000 7f65478e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.595+0000 7f65478e09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:31.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.595+0000 7f65478e09c0 20 zone default found 2024-09-12T17:38:31.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.595+0000 7f65478e09c0 4 Realm: () 2024-09-12T17:38:31.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.595+0000 7f65478e09c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:38:31.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.595+0000 7f65478e09c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:38:31.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.595+0000 7f65478e09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:31.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.595+0000 7f65478e09c0 20 zonegroup default 2024-09-12T17:38:31.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.595+0000 7f65478e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.595+0000 7f65478e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:31.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.595+0000 7f65478e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.595+0000 7f65478e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:31.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.595+0000 7f65478e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.599+0000 7f65478e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:31.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.599+0000 7f65478e09c0 20 started sync module instance, tier type = 2024-09-12T17:38:31.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.599+0000 7f65478e09c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:38:31.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.623+0000 7f65478e09c0 20 add_watcher() i=0 2024-09-12T17:38:31.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.623+0000 7f65478e09c0 20 add_watcher() i=1 2024-09-12T17:38:31.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.623+0000 7f65478e09c0 20 add_watcher() i=2 2024-09-12T17:38:31.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.623+0000 7f65478e09c0 20 add_watcher() i=3 2024-09-12T17:38:31.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.623+0000 7f65478e09c0 20 add_watcher() i=4 2024-09-12T17:38:31.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.623+0000 7f65478e09c0 20 add_watcher() i=5 2024-09-12T17:38:31.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.623+0000 7f65478e09c0 20 add_watcher() i=6 2024-09-12T17:38:31.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.623+0000 7f65478e09c0 20 add_watcher() i=7 2024-09-12T17:38:31.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.623+0000 7f65478e09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:31.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.627+0000 7f63fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:31.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:31.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:31.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 5 note: GC not initialized 2024-09-12T17:38:31.631 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f63fafe5640 20 reqs_thread_entry: start 2024-09-12T17:38:31.631 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:31.631 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 20 Filter name: none 2024-09-12T17:38:31.631 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f63f8fe1640 20 reqs_thread_entry: start 2024-09-12T17:38:31.631 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:38:31.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:31.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:38:31.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:38:31.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 : miss 2024-09-12T17:38:31.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:31.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 info.flags=0x17 2024-09-12T17:38:31.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 to cache LRU end 2024-09-12T17:38:31.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:31.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:31.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.631+0000 7f65478e09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 2024-09-12T17:38:31.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.647+0000 7f65478e09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 info.flags=0x17 2024-09-12T17:38:31.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.647+0000 7f65478e09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 to cache LRU end 2024-09-12T17:38:31.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.647+0000 7f65478e09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:31.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.647+0000 7f65478e09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38, ofs0, ns] 2024-09-12T17:38:31.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.647+0000 7f6417fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333524 cookie 94010556212672 notifier 7881 bl.length()=1015 2024-09-12T17:38:31.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.647+0000 7f6417fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 info.flags=0x17 2024-09-12T17:38:31.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.647+0000 7f6417fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 to cache LRU end 2024-09-12T17:38:31.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.647+0000 7f6417fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:31.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.651+0000 7f65478e09c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): orig_sources= new_sources= 2024-09-12T17:38:31.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.651+0000 7f65478e09c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): potential sources added=[] removed=[] 2024-09-12T17:38:31.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.651+0000 7f65478e09c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): orig_dests= new_dests= 2024-09-12T17:38:31.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.651+0000 7f65478e09c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): potential dests added=[] removed=[] 2024-09-12T17:38:31.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.0 2024-09-12T17:38:31.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.0 2024-09-12T17:38:31.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.1 2024-09-12T17:38:31.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.1 2024-09-12T17:38:31.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.2 2024-09-12T17:38:31.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.2 2024-09-12T17:38:31.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.3 2024-09-12T17:38:31.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.3 2024-09-12T17:38:31.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.4 2024-09-12T17:38:31.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.4 2024-09-12T17:38:31.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.5 2024-09-12T17:38:31.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.5 2024-09-12T17:38:31.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.6 2024-09-12T17:38:31.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.6 2024-09-12T17:38:31.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.7 2024-09-12T17:38:31.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.7 2024-09-12T17:38:31.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.8 2024-09-12T17:38:31.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.8 2024-09-12T17:38:31.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.9 2024-09-12T17:38:31.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.9 2024-09-12T17:38:31.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.10 2024-09-12T17:38:31.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.10 2024-09-12T17:38:31.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.11 2024-09-12T17:38:31.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.11 2024-09-12T17:38:31.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.659+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.0 2024-09-12T17:38:31.664 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.663+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1 2024-09-12T17:38:31.665 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.663+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.2 2024-09-12T17:38:31.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.663+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.3 2024-09-12T17:38:31.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.667+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.4 2024-09-12T17:38:31.667 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.667+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.5 2024-09-12T17:38:31.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.667+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.6 2024-09-12T17:38:31.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.667+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.7 2024-09-12T17:38:31.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.671+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.8 2024-09-12T17:38:31.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.671+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.9 2024-09-12T17:38:31.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.671+0000 7f65478e09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.10 2024-09-12T17:38:31.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.679+0000 7f65478e09c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T17:38:31.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.679+0000 7f65478e09c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T17:38:31.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.703+0000 7f65478e09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:38:31.705 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.703+0000 7f65478e09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 2024-09-12T17:38:31.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.707+0000 7f65478e09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 info.flags=0x17 2024-09-12T17:38:31.706 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.707+0000 7f65478e09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 to cache LRU end 2024-09-12T17:38:31.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.707+0000 7f65478e09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:31.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.707+0000 7f65478e09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38, ofs0, ns] 2024-09-12T17:38:31.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.707+0000 7f6417fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333525 cookie 94010556212672 notifier 7881 bl.length()=983 2024-09-12T17:38:31.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.707+0000 7f6417fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 info.flags=0x17 2024-09-12T17:38:31.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.707+0000 7f6417fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 to cache LRU end 2024-09-12T17:38:31.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.707+0000 7f6417fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:31.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.711+0000 7f65478e09c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): orig_sources= new_sources= 2024-09-12T17:38:31.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.711+0000 7f65478e09c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): potential sources added=[] removed=[] 2024-09-12T17:38:31.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.711+0000 7f65478e09c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): orig_dests= new_dests= 2024-09-12T17:38:31.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.711+0000 7f65478e09c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): potential dests added=[] removed=[] 2024-09-12T17:38:31.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.711+0000 7f65478e09c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T17:38:31.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.711+0000 7f63fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:31.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.719+0000 7f65478e09c0 20 remove_watcher() i=0 2024-09-12T17:38:31.718 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.719+0000 7f65478e09c0 2 removed watcher, disabling cache 2024-09-12T17:38:31.720 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.719+0000 7f65478e09c0 20 remove_watcher() i=1 2024-09-12T17:38:31.722 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.723+0000 7f65478e09c0 20 remove_watcher() i=2 2024-09-12T17:38:31.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.723+0000 7f65478e09c0 20 remove_watcher() i=3 2024-09-12T17:38:31.726 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.727+0000 7f65478e09c0 20 remove_watcher() i=4 2024-09-12T17:38:31.728 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.727+0000 7f65478e09c0 20 remove_watcher() i=5 2024-09-12T17:38:31.729 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.727+0000 7f65478e09c0 20 remove_watcher() i=6 2024-09-12T17:38:31.731 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.731+0000 7f65478e09c0 20 remove_watcher() i=7 2024-09-12T17:38:31.746 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:38:31.776 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:31.776 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:31.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.819+0000 7f01619739c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.823+0000 7f01619739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:31.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.823+0000 7f01619739c0 20 realm 2024-09-12T17:38:31.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.823+0000 7f01619739c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.823+0000 7f01619739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:31.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.823+0000 7f01619739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:31.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.823+0000 7f01619739c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.823+0000 7f01619739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:31.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.823+0000 7f01619739c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.823+0000 7f01619739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:31.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.823+0000 7f01619739c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:31.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.827+0000 7f01619739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:31.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.827+0000 7f01619739c0 20 searching for the correct realm 2024-09-12T17:38:31.832 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.831+0000 7f015ec78640 0 -- 172.21.15.119:0/1950776261 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f0150017070 msgr2=0x7f015000f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:31.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:31.839+0000 7f015ec78640 0 -- 172.21.15.119:0/1950776261 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f01580c9bc0 msgr2=0x7f01580ef980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:32.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.055+0000 7f01619739c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:38:32.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.055+0000 7f01619739c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:38:32.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.055+0000 7f01619739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:32.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.055+0000 7f01619739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:32.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.055+0000 7f01619739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:32.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.055+0000 7f01619739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:32.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.055+0000 7f01619739c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.055+0000 7f01619739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:32.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.055+0000 7f01619739c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.059+0000 7f01619739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:32.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.059+0000 7f01619739c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.059+0000 7f01619739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:32.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.059+0000 7f01619739c0 20 zone default found 2024-09-12T17:38:32.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.059+0000 7f01619739c0 4 Realm: () 2024-09-12T17:38:32.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.059+0000 7f01619739c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:38:32.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.059+0000 7f01619739c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:38:32.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.059+0000 7f01619739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:32.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.059+0000 7f01619739c0 20 zonegroup default 2024-09-12T17:38:32.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.059+0000 7f01619739c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.059+0000 7f01619739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:32.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.059+0000 7f01619739c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.059+0000 7f01619739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:32.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.059+0000 7f01619739c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.063+0000 7f01619739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:32.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.063+0000 7f01619739c0 20 started sync module instance, tier type = 2024-09-12T17:38:32.062 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.063+0000 7f01619739c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:38:32.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.087+0000 7f01619739c0 20 add_watcher() i=0 2024-09-12T17:38:32.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.087+0000 7f01619739c0 20 add_watcher() i=1 2024-09-12T17:38:32.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.087+0000 7f01619739c0 20 add_watcher() i=2 2024-09-12T17:38:32.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.087+0000 7f01619739c0 20 add_watcher() i=3 2024-09-12T17:38:32.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.087+0000 7f01619739c0 20 add_watcher() i=4 2024-09-12T17:38:32.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.087+0000 7f01619739c0 20 add_watcher() i=5 2024-09-12T17:38:32.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.087+0000 7f01619739c0 20 add_watcher() i=6 2024-09-12T17:38:32.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.087+0000 7f01619739c0 20 add_watcher() i=7 2024-09-12T17:38:32.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.087+0000 7f01619739c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:32.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.091+0000 7f00167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:32.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.091+0000 7f01619739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:32.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.091+0000 7f01619739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:32.094 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.091+0000 7f01619739c0 5 note: GC not initialized 2024-09-12T17:38:32.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.095+0000 7f00157e2640 20 reqs_thread_entry: start 2024-09-12T17:38:32.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.095+0000 7f01619739c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:32.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.095+0000 7f01619739c0 20 Filter name: none 2024-09-12T17:38:32.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.095+0000 7f000e7fc640 20 reqs_thread_entry: start 2024-09-12T17:38:32.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.095+0000 7f01619739c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.095+0000 7f01619739c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:32.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.095+0000 7f01619739c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.095+0000 7f01619739c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:32.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.095+0000 7f01619739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:32.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.095+0000 7f01619739c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.099+0000 7f01619739c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:32.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.099+0000 7f01619739c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.098 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.099+0000 7f01619739c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:32.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.099+0000 7f01619739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:32.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.099+0000 7f00167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:32.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.107+0000 7f01619739c0 20 remove_watcher() i=0 2024-09-12T17:38:32.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.107+0000 7f01619739c0 2 removed watcher, disabling cache 2024-09-12T17:38:32.108 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.107+0000 7f01619739c0 20 remove_watcher() i=1 2024-09-12T17:38:32.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.111+0000 7f01619739c0 20 remove_watcher() i=2 2024-09-12T17:38:32.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.111+0000 7f01619739c0 20 remove_watcher() i=3 2024-09-12T17:38:32.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.115+0000 7f01619739c0 20 remove_watcher() i=4 2024-09-12T17:38:32.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.115+0000 7f01619739c0 20 remove_watcher() i=5 2024-09-12T17:38:32.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.115+0000 7f01619739c0 20 remove_watcher() i=6 2024-09-12T17:38:32.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.119+0000 7f01619739c0 20 remove_watcher() i=7 2024-09-12T17:38:32.133 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:32.133 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:38:32.133 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-change-reshard-state id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:38:32.133 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:32.240 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:38:32.276 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:32.276 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:32.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.323+0000 7f0b154779c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.323+0000 7f0b154779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:32.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.323+0000 7f0b154779c0 20 realm 2024-09-12T17:38:32.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.323+0000 7f0b154779c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.323+0000 7f0b154779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:32.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.323+0000 7f0b154779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:32.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.323+0000 7f0b154779c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.323+0000 7f0b154779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:32.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.323+0000 7f0b154779c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.327+0000 7f0b154779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:32.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.327+0000 7f0b154779c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.327+0000 7f0b154779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:32.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.327+0000 7f0b154779c0 20 searching for the correct realm 2024-09-12T17:38:32.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.331+0000 7f0b1377e640 0 -- 172.21.15.119:0/374132238 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f0b04066a20 msgr2=0x7f0b0407e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:32.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.339+0000 7f0b1277c640 0 -- 172.21.15.119:0/374132238 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f0b0c0d0bb0 msgr2=0x7f0b0c0093d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:32.556 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.555+0000 7f0b154779c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:38:32.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.555+0000 7f0b154779c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:38:32.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.555+0000 7f0b154779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:32.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.555+0000 7f0b154779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:32.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.555+0000 7f0b154779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:32.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.555+0000 7f0b154779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:32.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.555+0000 7f0b154779c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.555+0000 7f0b154779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:32.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.555+0000 7f0b154779c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.555+0000 7f0b154779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:32.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.555+0000 7f0b154779c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.559+0000 7f0b154779c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:32.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.559+0000 7f0b154779c0 20 zone default found 2024-09-12T17:38:32.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.559+0000 7f0b154779c0 4 Realm: () 2024-09-12T17:38:32.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.559+0000 7f0b154779c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:38:32.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.559+0000 7f0b154779c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:38:32.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.559+0000 7f0b154779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:32.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.559+0000 7f0b154779c0 20 zonegroup default 2024-09-12T17:38:32.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.559+0000 7f0b154779c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.559+0000 7f0b154779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:32.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.559+0000 7f0b154779c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.559+0000 7f0b154779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:32.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.559+0000 7f0b154779c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.559+0000 7f0b154779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:32.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.559+0000 7f0b154779c0 20 started sync module instance, tier type = 2024-09-12T17:38:32.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.559+0000 7f0b154779c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:38:32.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.583+0000 7f0b154779c0 20 add_watcher() i=0 2024-09-12T17:38:32.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.583+0000 7f0b154779c0 20 add_watcher() i=1 2024-09-12T17:38:32.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.583+0000 7f0b154779c0 20 add_watcher() i=2 2024-09-12T17:38:32.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.583+0000 7f0b154779c0 20 add_watcher() i=3 2024-09-12T17:38:32.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.583+0000 7f0b154779c0 20 add_watcher() i=4 2024-09-12T17:38:32.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.583+0000 7f0b154779c0 20 add_watcher() i=5 2024-09-12T17:38:32.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.583+0000 7f0b154779c0 20 add_watcher() i=6 2024-09-12T17:38:32.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.587+0000 7f0b154779c0 20 add_watcher() i=7 2024-09-12T17:38:32.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.587+0000 7f0b154779c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:32.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.591+0000 7f09c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:32.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.591+0000 7f0b154779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:32.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.591+0000 7f0b154779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:32.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.591+0000 7f0b154779c0 5 note: GC not initialized 2024-09-12T17:38:32.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.591+0000 7f0943fff640 20 reqs_thread_entry: start 2024-09-12T17:38:32.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.591+0000 7f0b154779c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:32.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.591+0000 7f0b154779c0 20 Filter name: none 2024-09-12T17:38:32.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.591+0000 7f0941ffb640 20 reqs_thread_entry: start 2024-09-12T17:38:32.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.595+0000 7f0b154779c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:38:32.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.595+0000 7f0b154779c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.595+0000 7f0b154779c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:32.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.595+0000 7f0b154779c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:38:32.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.595+0000 7f0b154779c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:38:32.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.595+0000 7f0b154779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 : miss 2024-09-12T17:38:32.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.595+0000 7f0b154779c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.595+0000 7f0b154779c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:32.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.595+0000 7f0b154779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 info.flags=0x17 2024-09-12T17:38:32.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.595+0000 7f0b154779c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 to cache LRU end 2024-09-12T17:38:32.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.595+0000 7f0b154779c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:32.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.595+0000 7f0b154779c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:32.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.595+0000 7f0b154779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 2024-09-12T17:38:32.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.607+0000 7f0b154779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 info.flags=0x17 2024-09-12T17:38:32.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.607+0000 7f0b154779c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 to cache LRU end 2024-09-12T17:38:32.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.607+0000 7f0b154779c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:32.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.607+0000 7f0b154779c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38, ofs0, ns] 2024-09-12T17:38:32.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.607+0000 7f09f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333526 cookie 94356637692960 notifier 7460 bl.length()=1015 2024-09-12T17:38:32.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.607+0000 7f09f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 info.flags=0x17 2024-09-12T17:38:32.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.607+0000 7f09f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 to cache LRU end 2024-09-12T17:38:32.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.607+0000 7f09f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:32.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.611+0000 7f0b154779c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): orig_sources= new_sources= 2024-09-12T17:38:32.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.611+0000 7f0b154779c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): potential sources added=[] removed=[] 2024-09-12T17:38:32.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.611+0000 7f0b154779c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): orig_dests= new_dests= 2024-09-12T17:38:32.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.611+0000 7f0b154779c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): potential dests added=[] removed=[] 2024-09-12T17:38:32.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.0 2024-09-12T17:38:32.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.0 2024-09-12T17:38:32.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.1 2024-09-12T17:38:32.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.1 2024-09-12T17:38:32.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.2 2024-09-12T17:38:32.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.2 2024-09-12T17:38:32.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.3 2024-09-12T17:38:32.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.3 2024-09-12T17:38:32.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.4 2024-09-12T17:38:32.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.4 2024-09-12T17:38:32.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.5 2024-09-12T17:38:32.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.5 2024-09-12T17:38:32.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.6 2024-09-12T17:38:32.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.6 2024-09-12T17:38:32.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.7 2024-09-12T17:38:32.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.7 2024-09-12T17:38:32.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.8 2024-09-12T17:38:32.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.8 2024-09-12T17:38:32.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.9 2024-09-12T17:38:32.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.9 2024-09-12T17:38:32.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.10 2024-09-12T17:38:32.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.10 2024-09-12T17:38:32.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.11 2024-09-12T17:38:32.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1.11 2024-09-12T17:38:32.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.619+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.0 2024-09-12T17:38:32.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.623+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1 2024-09-12T17:38:32.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.623+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.2 2024-09-12T17:38:32.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.623+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.3 2024-09-12T17:38:32.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.623+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.4 2024-09-12T17:38:32.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.623+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.5 2024-09-12T17:38:32.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.627+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.6 2024-09-12T17:38:32.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.627+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.7 2024-09-12T17:38:32.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.627+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.8 2024-09-12T17:38:32.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.627+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.9 2024-09-12T17:38:32.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.627+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.10 2024-09-12T17:38:32.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.635+0000 7f0b154779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:38:32.637 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.635+0000 7f0b154779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 2024-09-12T17:38:32.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.639+0000 7f0b154779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 info.flags=0x17 2024-09-12T17:38:32.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.639+0000 7f0b154779c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 to cache LRU end 2024-09-12T17:38:32.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.639+0000 7f0b154779c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:32.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.639+0000 7f0b154779c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38, ofs0, ns] 2024-09-12T17:38:32.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.639+0000 7f09f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333527 cookie 94356637692960 notifier 7460 bl.length()=1015 2024-09-12T17:38:32.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.639+0000 7f09f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 info.flags=0x17 2024-09-12T17:38:32.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.639+0000 7f09f67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 to cache LRU end 2024-09-12T17:38:32.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.639+0000 7f09f67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:32.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.639+0000 7f0b154779c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): orig_sources= new_sources= 2024-09-12T17:38:32.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.639+0000 7f0b154779c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): potential sources added=[] removed=[] 2024-09-12T17:38:32.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.639+0000 7f0b154779c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): orig_dests= new_dests= 2024-09-12T17:38:32.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.639+0000 7f0b154779c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): potential dests added=[] removed=[] 2024-09-12T17:38:32.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.643+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.0 2024-09-12T17:38:32.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.647+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.1 2024-09-12T17:38:32.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.647+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.2 2024-09-12T17:38:32.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.647+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.3 2024-09-12T17:38:32.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.647+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.4 2024-09-12T17:38:32.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.647+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.5 2024-09-12T17:38:32.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.647+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.6 2024-09-12T17:38:32.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.651+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.7 2024-09-12T17:38:32.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.651+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.8 2024-09-12T17:38:32.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.651+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.9 2024-09-12T17:38:32.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.651+0000 7f0b154779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38.10 2024-09-12T17:38:32.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.651+0000 7f0b154779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:38:32.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.651+0000 7f0b154779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 2024-09-12T17:38:32.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.655+0000 7f0b154779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 info.flags=0x17 2024-09-12T17:38:32.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.655+0000 7f0b154779c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 to cache LRU end 2024-09-12T17:38:32.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.655+0000 7f0b154779c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:32.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.655+0000 7f0b154779c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38, ofs0, ns] 2024-09-12T17:38:32.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.655+0000 7f09f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 94356637692960 notifier 7460 bl.length()=983 2024-09-12T17:38:32.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.655+0000 7f09f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 info.flags=0x17 2024-09-12T17:38:32.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.655+0000 7f09f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 to cache LRU end 2024-09-12T17:38:32.655 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.655+0000 7f09f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:32.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.655+0000 7f0b154779c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): orig_sources= new_sources= 2024-09-12T17:38:32.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.655+0000 7f0b154779c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): potential sources added=[] removed=[] 2024-09-12T17:38:32.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.655+0000 7f0b154779c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): orig_dests= new_dests= 2024-09-12T17:38:32.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.655+0000 7f0b154779c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38]): potential dests added=[] removed=[] 2024-09-12T17:38:32.662 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.663+0000 7f0b154779c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T17:38:32.666 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.663+0000 7f09c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:32.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.671+0000 7f0b154779c0 20 remove_watcher() i=0 2024-09-12T17:38:32.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.671+0000 7f0b154779c0 2 removed watcher, disabling cache 2024-09-12T17:38:32.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.671+0000 7f0b154779c0 20 remove_watcher() i=1 2024-09-12T17:38:32.675 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.675+0000 7f0b154779c0 20 remove_watcher() i=2 2024-09-12T17:38:32.677 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.675+0000 7f0b154779c0 20 remove_watcher() i=3 2024-09-12T17:38:32.679 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.679+0000 7f0b154779c0 20 remove_watcher() i=4 2024-09-12T17:38:32.680 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.679+0000 7f0b154779c0 20 remove_watcher() i=5 2024-09-12T17:38:32.681 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.679+0000 7f0b154779c0 20 remove_watcher() i=6 2024-09-12T17:38:32.683 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.683+0000 7f0b154779c0 20 remove_watcher() i=7 2024-09-12T17:38:32.697 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:38:32.724 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:32.724 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:32.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.771+0000 7f4760fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.771+0000 7f4760fdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:32.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.771+0000 7f4760fdc9c0 20 realm 2024-09-12T17:38:32.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.771+0000 7f4760fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.771+0000 7f4760fdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:32.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.771+0000 7f4760fdc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:32.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.771+0000 7f4760fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.771+0000 7f4760fdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:32.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.771+0000 7f4760fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.775+0000 7f4760fdc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:32.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.775+0000 7f4760fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:32.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.775+0000 7f4760fdc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:32.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.775+0000 7f4760fdc9c0 20 searching for the correct realm 2024-09-12T17:38:32.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.779+0000 7f475e2e1640 0 -- 172.21.15.119:0/1886834101 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f47500c0020 msgr2=0x7f47500f7390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:32.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:32.787+0000 7f475e2e1640 0 -- 172.21.15.119:0/1886834101 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f4758026040 msgr2=0x7f4758027730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:38:33.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.003+0000 7f4760fdc9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:38:33.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.003+0000 7f4760fdc9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:38:33.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.003+0000 7f4760fdc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:33.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.003+0000 7f4760fdc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:33.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.003+0000 7f4760fdc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:33.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.003+0000 7f4760fdc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:33.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.003+0000 7f4760fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:33.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.007+0000 7f4760fdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:33.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.007+0000 7f4760fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:33.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.007+0000 7f4760fdc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:33.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.007+0000 7f4760fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:33.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.007+0000 7f4760fdc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:33.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.007+0000 7f4760fdc9c0 20 zone default found 2024-09-12T17:38:33.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.007+0000 7f4760fdc9c0 4 Realm: () 2024-09-12T17:38:33.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.007+0000 7f4760fdc9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:38:33.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.007+0000 7f4760fdc9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:38:33.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.007+0000 7f4760fdc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:33.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.007+0000 7f4760fdc9c0 20 zonegroup default 2024-09-12T17:38:33.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.007+0000 7f4760fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:33.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.007+0000 7f4760fdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:33.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.007+0000 7f4760fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:33.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.011+0000 7f4760fdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:33.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.011+0000 7f4760fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:33.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.011+0000 7f4760fdc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:33.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.011+0000 7f4760fdc9c0 20 started sync module instance, tier type = 2024-09-12T17:38:33.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.011+0000 7f4760fdc9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:38:33.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.031+0000 7f4760fdc9c0 20 add_watcher() i=0 2024-09-12T17:38:33.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.031+0000 7f4760fdc9c0 20 add_watcher() i=1 2024-09-12T17:38:33.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.031+0000 7f4760fdc9c0 20 add_watcher() i=2 2024-09-12T17:38:33.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.031+0000 7f4760fdc9c0 20 add_watcher() i=3 2024-09-12T17:38:33.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.031+0000 7f4760fdc9c0 20 add_watcher() i=4 2024-09-12T17:38:33.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.031+0000 7f4760fdc9c0 20 add_watcher() i=5 2024-09-12T17:38:33.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.031+0000 7f4760fdc9c0 20 add_watcher() i=6 2024-09-12T17:38:33.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.035+0000 7f4760fdc9c0 20 add_watcher() i=7 2024-09-12T17:38:33.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.035+0000 7f4760fdc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:33.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.039+0000 7f46157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:33.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.039+0000 7f4760fdc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:33.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.039+0000 7f4760fdc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:33.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.039+0000 7f4760fdc9c0 5 note: GC not initialized 2024-09-12T17:38:33.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.039+0000 7f458ffff640 20 reqs_thread_entry: start 2024-09-12T17:38:33.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.039+0000 7f4760fdc9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:33.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.039+0000 7f4760fdc9c0 20 Filter name: none 2024-09-12T17:38:33.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.039+0000 7f458dffb640 20 reqs_thread_entry: start 2024-09-12T17:38:33.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.043+0000 7f4760fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:33.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.043+0000 7f4760fdc9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:33.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.043+0000 7f4760fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:33.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.043+0000 7f4760fdc9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:33.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.043+0000 7f4760fdc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:33.044 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.043+0000 7f4760fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:33.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.043+0000 7f4760fdc9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:33.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.043+0000 7f4760fdc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:33.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.043+0000 7f4760fdc9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:33.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.043+0000 7f4760fdc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:33.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.047+0000 7f46157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:33.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.051+0000 7f4760fdc9c0 20 remove_watcher() i=0 2024-09-12T17:38:33.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.051+0000 7f4760fdc9c0 2 removed watcher, disabling cache 2024-09-12T17:38:33.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.055+0000 7f4760fdc9c0 20 remove_watcher() i=1 2024-09-12T17:38:33.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.055+0000 7f4760fdc9c0 20 remove_watcher() i=2 2024-09-12T17:38:33.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.059+0000 7f4760fdc9c0 20 remove_watcher() i=3 2024-09-12T17:38:33.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.059+0000 7f4760fdc9c0 20 remove_watcher() i=4 2024-09-12T17:38:33.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.063+0000 7f4760fdc9c0 20 remove_watcher() i=5 2024-09-12T17:38:33.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.063+0000 7f4760fdc9c0 20 remove_watcher() i=6 2024-09-12T17:38:33.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:33.063+0000 7f4760fdc9c0 20 remove_watcher() i=7 2024-09-12T17:38:33.079 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:33.080 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:38:33.080 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-change-reshard-state id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:38:33.080 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:33.985 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T17:38:33.985 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:36.147 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:38:36.178 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:36.179 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:36.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.223+0000 7f9cfdec89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.227+0000 7f9cfdec89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.227+0000 7f9cfdec89c0 20 realm 2024-09-12T17:38:36.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.227+0000 7f9cfdec89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.227+0000 7f9cfdec89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.227+0000 7f9cfdec89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:36.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.227+0000 7f9cfdec89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.227+0000 7f9cfdec89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.227+0000 7f9cfdec89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.227+0000 7f9cfdec89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:36.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.227+0000 7f9cfdec89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.231+0000 7f9cfdec89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:36.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.231+0000 7f9cfdec89c0 20 searching for the correct realm 2024-09-12T17:38:36.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.235+0000 7f9cfc1cf640 0 -- 172.21.15.119:0/469745704 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f9cf010c680 msgr2=0x7f9cf00e5a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:36.241 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.239+0000 7f9cfb1cd640 0 -- 172.21.15.119:0/469745704 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f9cec01e430 msgr2=0x7f9cec01e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:38:36.458 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.455+0000 7f9cfdec89c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:38:36.458 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.455+0000 7f9cfdec89c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:38:36.458 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.455+0000 7f9cfdec89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:36.458 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.455+0000 7f9cfdec89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:36.458 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.455+0000 7f9cfdec89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:36.458 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.455+0000 7f9cfdec89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:36.458 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.455+0000 7f9cfdec89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.459+0000 7f9cfdec89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.459+0000 7f9cfdec89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.459+0000 7f9cfdec89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:36.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.459+0000 7f9cfdec89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.459+0000 7f9cfdec89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:36.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.459+0000 7f9cfdec89c0 20 zone default found 2024-09-12T17:38:36.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.459+0000 7f9cfdec89c0 4 Realm: () 2024-09-12T17:38:36.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.459+0000 7f9cfdec89c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:38:36.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.459+0000 7f9cfdec89c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:38:36.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.459+0000 7f9cfdec89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:36.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.459+0000 7f9cfdec89c0 20 zonegroup default 2024-09-12T17:38:36.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.459+0000 7f9cfdec89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.459+0000 7f9cfdec89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.459+0000 7f9cfdec89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.463+0000 7f9cfdec89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.463+0000 7f9cfdec89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.463+0000 7f9cfdec89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.463+0000 7f9cfdec89c0 20 started sync module instance, tier type = 2024-09-12T17:38:36.463 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.463+0000 7f9cfdec89c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:38:36.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.487+0000 7f9cfdec89c0 20 add_watcher() i=0 2024-09-12T17:38:36.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.487+0000 7f9cfdec89c0 20 add_watcher() i=1 2024-09-12T17:38:36.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.487+0000 7f9cfdec89c0 20 add_watcher() i=2 2024-09-12T17:38:36.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.487+0000 7f9cfdec89c0 20 add_watcher() i=3 2024-09-12T17:38:36.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.487+0000 7f9cfdec89c0 20 add_watcher() i=4 2024-09-12T17:38:36.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.487+0000 7f9cfdec89c0 20 add_watcher() i=5 2024-09-12T17:38:36.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.487+0000 7f9cfdec89c0 20 add_watcher() i=6 2024-09-12T17:38:36.488 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.487+0000 7f9cfdec89c0 20 add_watcher() i=7 2024-09-12T17:38:36.489 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.487+0000 7f9cfdec89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:36.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.491+0000 7f9bb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:36.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.491+0000 7f9cfdec89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:36.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.491+0000 7f9cfdec89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:36.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.495+0000 7f9cfdec89c0 5 note: GC not initialized 2024-09-12T17:38:36.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.495+0000 7f9bb0fe1640 20 reqs_thread_entry: start 2024-09-12T17:38:36.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.495+0000 7f9cfdec89c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:36.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.495+0000 7f9cfdec89c0 20 Filter name: none 2024-09-12T17:38:36.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.495+0000 7f9b2a7fc640 20 reqs_thread_entry: start 2024-09-12T17:38:36.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.495+0000 7f9cfdec89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.495+0000 7f9cfdec89c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:36.497 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.495+0000 7f9cfdec89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.499+0000 7f9cfdec89c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:36.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.499+0000 7f9cfdec89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:36.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.499+0000 7f9cfdec89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.499+0000 7f9cfdec89c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:36.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.499+0000 7f9cfdec89c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.499+0000 7f9cfdec89c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:36.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.499+0000 7f9cfdec89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:36.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.503+0000 7f9bb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:36.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.507+0000 7f9cfdec89c0 20 remove_watcher() i=0 2024-09-12T17:38:36.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.507+0000 7f9cfdec89c0 2 removed watcher, disabling cache 2024-09-12T17:38:36.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.511+0000 7f9cfdec89c0 20 remove_watcher() i=1 2024-09-12T17:38:36.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.511+0000 7f9cfdec89c0 20 remove_watcher() i=2 2024-09-12T17:38:36.515 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.515+0000 7f9cfdec89c0 20 remove_watcher() i=3 2024-09-12T17:38:36.518 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.515+0000 7f9cfdec89c0 20 remove_watcher() i=4 2024-09-12T17:38:36.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.519+0000 7f9cfdec89c0 20 remove_watcher() i=5 2024-09-12T17:38:36.521 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.519+0000 7f9cfdec89c0 20 remove_watcher() i=6 2024-09-12T17:38:36.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.523+0000 7f9cfdec89c0 20 remove_watcher() i=7 2024-09-12T17:38:36.536 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:36.536 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:38:36.536 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-change-reshard-state id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:38:36.536 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:36.537 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T17:38:36.575 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:36.575 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:36.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.619+0000 7fac6f3d29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.619+0000 7fac6f3d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.619+0000 7fac6f3d29c0 20 realm 2024-09-12T17:38:36.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.619+0000 7fac6f3d29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.619+0000 7fac6f3d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.619+0000 7fac6f3d29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:36.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.619+0000 7fac6f3d29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.619+0000 7fac6f3d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.622 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.619+0000 7fac6f3d29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.623+0000 7fac6f3d29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:36.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.623+0000 7fac6f3d29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.623+0000 7fac6f3d29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:36.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.623+0000 7fac6f3d29c0 20 searching for the correct realm 2024-09-12T17:38:36.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.627+0000 7fac6c6d7640 0 -- 172.21.15.119:0/196200509 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fac5c018070 msgr2=0x7fac5c05d100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:38:36.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.839+0000 7fac6d6d9640 0 -- 172.21.15.119:0/196200509 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fac600bb040 msgr2=0x7fac600fb860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:36.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:38:36.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:38:36.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:36.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:36.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:36.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:36.859 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:36.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:36.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 20 zone default found 2024-09-12T17:38:36.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 4 Realm: () 2024-09-12T17:38:36.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:38:36.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:38:36.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.859+0000 7fac6f3d29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:36.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.863+0000 7fac6f3d29c0 20 zonegroup default 2024-09-12T17:38:36.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.863+0000 7fac6f3d29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.863+0000 7fac6f3d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.863+0000 7fac6f3d29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.863+0000 7fac6f3d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.863+0000 7fac6f3d29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.863+0000 7fac6f3d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.863+0000 7fac6f3d29c0 20 started sync module instance, tier type = 2024-09-12T17:38:36.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.863+0000 7fac6f3d29c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:38:36.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.883+0000 7fac6f3d29c0 20 add_watcher() i=0 2024-09-12T17:38:36.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.883+0000 7fac6f3d29c0 20 add_watcher() i=1 2024-09-12T17:38:36.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.883+0000 7fac6f3d29c0 20 add_watcher() i=2 2024-09-12T17:38:36.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.883+0000 7fac6f3d29c0 20 add_watcher() i=3 2024-09-12T17:38:36.886 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.883+0000 7fac6f3d29c0 20 add_watcher() i=4 2024-09-12T17:38:36.886 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.883+0000 7fac6f3d29c0 20 add_watcher() i=5 2024-09-12T17:38:36.886 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.883+0000 7fac6f3d29c0 20 add_watcher() i=6 2024-09-12T17:38:36.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.887+0000 7fac6f3d29c0 20 add_watcher() i=7 2024-09-12T17:38:36.887 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.887+0000 7fac6f3d29c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:36.891 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.891+0000 7fab237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:36.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.891+0000 7fac6f3d29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:36.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.891+0000 7fac6f3d29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:36.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.891+0000 7fac6f3d29c0 5 note: GC not initialized 2024-09-12T17:38:36.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.891+0000 7fab227e4640 20 reqs_thread_entry: start 2024-09-12T17:38:36.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.891+0000 7fac6f3d29c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:36.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.891+0000 7fac6f3d29c0 20 Filter name: none 2024-09-12T17:38:36.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.891+0000 7fab1b7fe640 20 reqs_thread_entry: start 2024-09-12T17:38:36.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.891+0000 7fac6f3d29c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:38:36.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.891+0000 7fac6f3d29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.895+0000 7fac6f3d29c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:36.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.895+0000 7fac6f3d29c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:38:36.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.895+0000 7fac6f3d29c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:38:36.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.895+0000 7fac6f3d29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 : miss 2024-09-12T17:38:36.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.895+0000 7fac6f3d29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.895+0000 7fac6f3d29c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:36.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.895+0000 7fac6f3d29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 info.flags=0x17 2024-09-12T17:38:36.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.895+0000 7fac6f3d29c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 to cache LRU end 2024-09-12T17:38:36.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.895+0000 7fac6f3d29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:36.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.895+0000 7fac6f3d29c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:36.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.895+0000 7fac6f3d29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 2024-09-12T17:38:36.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.907+0000 7fac6f3d29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 info.flags=0x17 2024-09-12T17:38:36.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.907+0000 7fac6f3d29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 to cache LRU end 2024-09-12T17:38:36.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.907+0000 7fac6f3d29c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:36.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.907+0000 7fac6f3d29c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39, ofs0, ns] 2024-09-12T17:38:36.909 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.907+0000 7fab43fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333531 cookie 94461723580096 notifier 7968 bl.length()=1015 2024-09-12T17:38:36.909 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.907+0000 7fab43fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 info.flags=0x17 2024-09-12T17:38:36.909 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.907+0000 7fab43fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 to cache LRU end 2024-09-12T17:38:36.909 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.907+0000 7fab43fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:36.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.911+0000 7fac6f3d29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39]): orig_sources= new_sources= 2024-09-12T17:38:36.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.911+0000 7fac6f3d29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39]): potential sources added=[] removed=[] 2024-09-12T17:38:36.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.911+0000 7fac6f3d29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39]): orig_dests= new_dests= 2024-09-12T17:38:36.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.911+0000 7fac6f3d29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39]): potential dests added=[] removed=[] 2024-09-12T17:38:36.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.0 2024-09-12T17:38:36.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.0 2024-09-12T17:38:36.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.1 2024-09-12T17:38:36.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.1 2024-09-12T17:38:36.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.2 2024-09-12T17:38:36.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.2 2024-09-12T17:38:36.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.3 2024-09-12T17:38:36.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.3 2024-09-12T17:38:36.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.4 2024-09-12T17:38:36.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.4 2024-09-12T17:38:36.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.5 2024-09-12T17:38:36.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.5 2024-09-12T17:38:36.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.6 2024-09-12T17:38:36.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.6 2024-09-12T17:38:36.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.7 2024-09-12T17:38:36.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.7 2024-09-12T17:38:36.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.8 2024-09-12T17:38:36.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.8 2024-09-12T17:38:36.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.9 2024-09-12T17:38:36.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.9 2024-09-12T17:38:36.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.10 2024-09-12T17:38:36.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.10 2024-09-12T17:38:36.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.11 2024-09-12T17:38:36.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1.11 2024-09-12T17:38:36.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.0 2024-09-12T17:38:36.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.923+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1 2024-09-12T17:38:36.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.927+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.2 2024-09-12T17:38:36.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.927+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.3 2024-09-12T17:38:36.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.927+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.4 2024-09-12T17:38:36.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.927+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.5 2024-09-12T17:38:36.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.931+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.6 2024-09-12T17:38:36.932 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.931+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.7 2024-09-12T17:38:36.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.931+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.8 2024-09-12T17:38:36.934 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.935+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.9 2024-09-12T17:38:36.936 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.935+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.10 2024-09-12T17:38:36.944 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.943+0000 7fac6f3d29c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T17:38:36.944 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.943+0000 7fac6f3d29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 : hit (requested=0x17, cached=0x17) 2024-09-12T17:38:36.944 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.943+0000 7fac6f3d29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 2024-09-12T17:38:36.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.947+0000 7fac6f3d29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 info.flags=0x17 2024-09-12T17:38:36.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.947+0000 7fac6f3d29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 to cache LRU end 2024-09-12T17:38:36.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.947+0000 7fac6f3d29c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:36.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.947+0000 7fac6f3d29c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39, ofs0, ns] 2024-09-12T17:38:36.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.947+0000 7fab43fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333532 cookie 94461723580096 notifier 7968 bl.length()=1015 2024-09-12T17:38:36.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.947+0000 7fab43fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 info.flags=0x17 2024-09-12T17:38:36.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.947+0000 7fab43fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 to cache LRU end 2024-09-12T17:38:36.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.947+0000 7fab43fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:36.950 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.951+0000 7fac6f3d29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39]): orig_sources= new_sources= 2024-09-12T17:38:36.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.951+0000 7fac6f3d29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39]): potential sources added=[] removed=[] 2024-09-12T17:38:36.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.951+0000 7fac6f3d29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39]): orig_dests= new_dests= 2024-09-12T17:38:36.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.951+0000 7fac6f3d29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39]): potential dests added=[] removed=[] 2024-09-12T17:38:36.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.955+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.0 2024-09-12T17:38:36.958 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.959+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.1 2024-09-12T17:38:36.958 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.959+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.2 2024-09-12T17:38:36.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.959+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.3 2024-09-12T17:38:36.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.959+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.4 2024-09-12T17:38:36.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.959+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.5 2024-09-12T17:38:36.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.959+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.6 2024-09-12T17:38:36.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.959+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.7 2024-09-12T17:38:36.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.963+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.8 2024-09-12T17:38:36.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.963+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.9 2024-09-12T17:38:36.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.963+0000 7fac6f3d29c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39.10 2024-09-12T17:38:36.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.963+0000 7fac6f3d29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 : hit (requested=0x17, cached=0x17) 2024-09-12T17:38:36.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.963+0000 7fac6f3d29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 2024-09-12T17:38:36.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.967+0000 7fac6f3d29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 info.flags=0x17 2024-09-12T17:38:36.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.967+0000 7fac6f3d29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 to cache LRU end 2024-09-12T17:38:36.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.967+0000 7fac6f3d29c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:36.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.967+0000 7fac6f3d29c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39, ofs0, ns] 2024-09-12T17:38:36.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.967+0000 7fab43fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333533 cookie 94461723580096 notifier 7968 bl.length()=983 2024-09-12T17:38:36.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.967+0000 7fab43fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 info.flags=0x17 2024-09-12T17:38:36.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.967+0000 7fab43fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 to cache LRU end 2024-09-12T17:38:36.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.967+0000 7fab43fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:36.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.971+0000 7fac6f3d29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39]): orig_sources= new_sources= 2024-09-12T17:38:36.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.971+0000 7fac6f3d29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39]): potential sources added=[] removed=[] 2024-09-12T17:38:36.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.971+0000 7fac6f3d29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39]): orig_dests= new_dests= 2024-09-12T17:38:36.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.971+0000 7fac6f3d29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39]): potential dests added=[] removed=[] 2024-09-12T17:38:36.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.979+0000 7fac6f3d29c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T17:38:36.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.979+0000 7fab237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:36.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.987+0000 7fac6f3d29c0 20 remove_watcher() i=0 2024-09-12T17:38:36.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.987+0000 7fac6f3d29c0 2 removed watcher, disabling cache 2024-09-12T17:38:36.988 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.987+0000 7fac6f3d29c0 20 remove_watcher() i=1 2024-09-12T17:38:36.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.991+0000 7fac6f3d29c0 20 remove_watcher() i=2 2024-09-12T17:38:36.993 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.991+0000 7fac6f3d29c0 20 remove_watcher() i=3 2024-09-12T17:38:36.995 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.995+0000 7fac6f3d29c0 20 remove_watcher() i=4 2024-09-12T17:38:36.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.995+0000 7fac6f3d29c0 20 remove_watcher() i=5 2024-09-12T17:38:36.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.999+0000 7fac6f3d29c0 20 remove_watcher() i=6 2024-09-12T17:38:36.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:36.999+0000 7fac6f3d29c0 20 remove_watcher() i=7 2024-09-12T17:38:37.015 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:38:37.046 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:37.047 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:37.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.091+0000 7f4c88dd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.095+0000 7f4c88dd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.095+0000 7f4c88dd09c0 20 realm 2024-09-12T17:38:37.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.095+0000 7f4c88dd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.095+0000 7f4c88dd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.095+0000 7f4c88dd09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:37.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.095+0000 7f4c88dd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.095 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.095+0000 7f4c88dd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.095+0000 7f4c88dd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.095+0000 7f4c88dd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:37.097 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.095+0000 7f4c88dd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.099+0000 7f4c88dd09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:37.099 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.099+0000 7f4c88dd09c0 20 searching for the correct realm 2024-09-12T17:38:37.103 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.103+0000 7f4c860d5640 0 -- 172.21.15.119:0/3825233925 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f4c78008410 msgr2=0x7f4c78008890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:38:37.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.111+0000 7f4c860d5640 0 -- 172.21.15.119:0/3825233925 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f4c80105c40 msgr2=0x7f4c80119040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:38:37.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.327+0000 7f4c88dd09c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:38:37.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.327+0000 7f4c88dd09c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:38:37.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.327+0000 7f4c88dd09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:37.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.327+0000 7f4c88dd09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:37.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.327+0000 7f4c88dd09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:37.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.327+0000 7f4c88dd09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:37.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.327+0000 7f4c88dd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.331+0000 7f4c88dd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.331+0000 7f4c88dd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.331+0000 7f4c88dd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:37.331 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.331+0000 7f4c88dd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.331+0000 7f4c88dd09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:37.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.331+0000 7f4c88dd09c0 20 zone default found 2024-09-12T17:38:37.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.331+0000 7f4c88dd09c0 4 Realm: () 2024-09-12T17:38:37.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.331+0000 7f4c88dd09c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:38:37.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.331+0000 7f4c88dd09c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:38:37.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.331+0000 7f4c88dd09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:37.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.331+0000 7f4c88dd09c0 20 zonegroup default 2024-09-12T17:38:37.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.331+0000 7f4c88dd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.331+0000 7f4c88dd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.331+0000 7f4c88dd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.331+0000 7f4c88dd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.331+0000 7f4c88dd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.335+0000 7f4c88dd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:37.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.335+0000 7f4c88dd09c0 20 started sync module instance, tier type = 2024-09-12T17:38:37.334 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.335+0000 7f4c88dd09c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:38:37.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.355+0000 7f4c88dd09c0 20 add_watcher() i=0 2024-09-12T17:38:37.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.355+0000 7f4c88dd09c0 20 add_watcher() i=1 2024-09-12T17:38:37.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.355+0000 7f4c88dd09c0 20 add_watcher() i=2 2024-09-12T17:38:37.355 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.355+0000 7f4c88dd09c0 20 add_watcher() i=3 2024-09-12T17:38:37.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.355+0000 7f4c88dd09c0 20 add_watcher() i=4 2024-09-12T17:38:37.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.355+0000 7f4c88dd09c0 20 add_watcher() i=5 2024-09-12T17:38:37.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.355+0000 7f4c88dd09c0 20 add_watcher() i=6 2024-09-12T17:38:37.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.355+0000 7f4c88dd09c0 20 add_watcher() i=7 2024-09-12T17:38:37.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.355+0000 7f4c88dd09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:37.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.359+0000 7f4b3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:37.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.363+0000 7f4c88dd09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:37.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.363+0000 7f4c88dd09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:37.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.363+0000 7f4c88dd09c0 5 note: GC not initialized 2024-09-12T17:38:37.363 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.363+0000 7f4ab7fff640 20 reqs_thread_entry: start 2024-09-12T17:38:37.363 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.363+0000 7f4c88dd09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:37.363 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.363+0000 7f4c88dd09c0 20 Filter name: none 2024-09-12T17:38:37.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.363+0000 7f4ab5ffb640 20 reqs_thread_entry: start 2024-09-12T17:38:37.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.363+0000 7f4c88dd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.363+0000 7f4c88dd09c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:37.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.363+0000 7f4c88dd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.363+0000 7f4c88dd09c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:37.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.367+0000 7f4c88dd09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:37.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.367+0000 7f4c88dd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.367+0000 7f4c88dd09c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:37.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.367+0000 7f4c88dd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:37.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.367+0000 7f4c88dd09c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:37.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.367+0000 7f4c88dd09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:37.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.371+0000 7f4b3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:37.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.375+0000 7f4c88dd09c0 20 remove_watcher() i=0 2024-09-12T17:38:37.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.375+0000 7f4c88dd09c0 2 removed watcher, disabling cache 2024-09-12T17:38:37.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.379+0000 7f4c88dd09c0 20 remove_watcher() i=1 2024-09-12T17:38:37.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.379+0000 7f4c88dd09c0 20 remove_watcher() i=2 2024-09-12T17:38:37.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.383+0000 7f4c88dd09c0 20 remove_watcher() i=3 2024-09-12T17:38:37.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.383+0000 7f4c88dd09c0 20 remove_watcher() i=4 2024-09-12T17:38:37.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.387+0000 7f4c88dd09c0 20 remove_watcher() i=5 2024-09-12T17:38:37.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.387+0000 7f4c88dd09c0 20 remove_watcher() i=6 2024-09-12T17:38:37.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:37.387+0000 7f4c88dd09c0 20 remove_watcher() i=7 2024-09-12T17:38:37.404 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:37.404 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:38:37.404 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: error-at-change-reshard-state id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:38:37.404 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:38.370 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T17:38:38.370 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:40.589 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:38:40.623 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:40.624 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:40.669 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:40.666+0000 7f5dd5f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:40.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:40.670+0000 7f5dd5f6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:40.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:40.670+0000 7f5dd5f6d9c0 20 realm 2024-09-12T17:38:40.671 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:40.670+0000 7f5dd5f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:40.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:40.670+0000 7f5dd5f6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:40.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:40.670+0000 7f5dd5f6d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:40.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:40.670+0000 7f5dd5f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:40.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:40.670+0000 7f5dd5f6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:40.672 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:40.670+0000 7f5dd5f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:40.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:40.670+0000 7f5dd5f6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:40.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:40.670+0000 7f5dd5f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:40.876 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:40.874+0000 7f5dd5f6d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:40.876 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:40.874+0000 7f5dd5f6d9c0 20 searching for the correct realm 2024-09-12T17:38:40.881 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:40.878+0000 7f5dd4274640 0 -- 172.21.15.119:0/3691594627 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f5dc8027040 msgr2=0x7f5dc802b390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:40.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:40.890+0000 7f5dd3272640 0 -- 172.21.15.119:0/3691594627 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f5dcc0e7bf0 msgr2=0x7f5dcc0de990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:41.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.106+0000 7f5dd5f6d9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:38:41.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.106+0000 7f5dd5f6d9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:38:41.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.106+0000 7f5dd5f6d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:41.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.106+0000 7f5dd5f6d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:41.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.106+0000 7f5dd5f6d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:41.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.106+0000 7f5dd5f6d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:41.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.106+0000 7f5dd5f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.110+0000 7f5dd5f6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.110+0000 7f5dd5f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.110+0000 7f5dd5f6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:41.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.110+0000 7f5dd5f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.110+0000 7f5dd5f6d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:41.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.110+0000 7f5dd5f6d9c0 20 zone default found 2024-09-12T17:38:41.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.110+0000 7f5dd5f6d9c0 4 Realm: () 2024-09-12T17:38:41.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.110+0000 7f5dd5f6d9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:38:41.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.110+0000 7f5dd5f6d9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:38:41.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.110+0000 7f5dd5f6d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:41.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.110+0000 7f5dd5f6d9c0 20 zonegroup default 2024-09-12T17:38:41.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.110+0000 7f5dd5f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.110+0000 7f5dd5f6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.110+0000 7f5dd5f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.114+0000 7f5dd5f6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.114+0000 7f5dd5f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.114+0000 7f5dd5f6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.114+0000 7f5dd5f6d9c0 20 started sync module instance, tier type = 2024-09-12T17:38:41.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.114+0000 7f5dd5f6d9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:38:41.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.138+0000 7f5dd5f6d9c0 20 add_watcher() i=0 2024-09-12T17:38:41.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.138+0000 7f5dd5f6d9c0 20 add_watcher() i=1 2024-09-12T17:38:41.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.138+0000 7f5dd5f6d9c0 20 add_watcher() i=2 2024-09-12T17:38:41.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.138+0000 7f5dd5f6d9c0 20 add_watcher() i=3 2024-09-12T17:38:41.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.138+0000 7f5dd5f6d9c0 20 add_watcher() i=4 2024-09-12T17:38:41.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.138+0000 7f5dd5f6d9c0 20 add_watcher() i=5 2024-09-12T17:38:41.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.138+0000 7f5dd5f6d9c0 20 add_watcher() i=6 2024-09-12T17:38:41.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.138+0000 7f5dd5f6d9c0 20 add_watcher() i=7 2024-09-12T17:38:41.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.138+0000 7f5dd5f6d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:41.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.142+0000 7f5c89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:41.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.142+0000 7f5dd5f6d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:41.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.142+0000 7f5dd5f6d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:41.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.142+0000 7f5dd5f6d9c0 5 note: GC not initialized 2024-09-12T17:38:41.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.146+0000 7f5c88fe1640 20 reqs_thread_entry: start 2024-09-12T17:38:41.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.146+0000 7f5dd5f6d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:41.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.146+0000 7f5dd5f6d9c0 20 Filter name: none 2024-09-12T17:38:41.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.146+0000 7f5c027fc640 20 reqs_thread_entry: start 2024-09-12T17:38:41.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.146+0000 7f5dd5f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.146+0000 7f5dd5f6d9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:41.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.146+0000 7f5dd5f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.146+0000 7f5dd5f6d9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:41.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.146+0000 7f5dd5f6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:41.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.146+0000 7f5dd5f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.150+0000 7f5dd5f6d9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:41.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.150+0000 7f5dd5f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.150+0000 7f5dd5f6d9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:41.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.150+0000 7f5dd5f6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:41.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.154+0000 7f5c89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:41.159 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.158+0000 7f5dd5f6d9c0 20 remove_watcher() i=0 2024-09-12T17:38:41.159 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.158+0000 7f5dd5f6d9c0 2 removed watcher, disabling cache 2024-09-12T17:38:41.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.158+0000 7f5dd5f6d9c0 20 remove_watcher() i=1 2024-09-12T17:38:41.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.162+0000 7f5dd5f6d9c0 20 remove_watcher() i=2 2024-09-12T17:38:41.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.162+0000 7f5dd5f6d9c0 20 remove_watcher() i=3 2024-09-12T17:38:41.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.166+0000 7f5dd5f6d9c0 20 remove_watcher() i=4 2024-09-12T17:38:41.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.166+0000 7f5dd5f6d9c0 20 remove_watcher() i=5 2024-09-12T17:38:41.171 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.170+0000 7f5dd5f6d9c0 20 remove_watcher() i=6 2024-09-12T17:38:41.173 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.170+0000 7f5dd5f6d9c0 20 remove_watcher() i=7 2024-09-12T17:38:41.188 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.188 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:38:41.188 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-change-reshard-state id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:38:41.188 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.188 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T17:38:41.221 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:41.221 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:41.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.262+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.262+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.266 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.262+0000 7f930fcec9c0 20 realm 2024-09-12T17:38:41.266 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.262+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.266 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.266 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.266+0000 7f930fcec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:41.266 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.266 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.267 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.267 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:41.268 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:41.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 searching for the correct realm 2024-09-12T17:38:41.272 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.270+0000 7f930dff3640 0 -- 172.21.15.119:0/723721776 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f92f8040070 msgr2=0x7f92f804e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:41.280 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.278+0000 7f930cff1640 0 -- 172.21.15.119:0/723721776 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f930007f950 msgr2=0x7f930006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:41.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:38:41.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:38:41.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:41.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:41.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:41.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:41.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.499 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:41.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.500 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:41.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 zone default found 2024-09-12T17:38:41.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 4 Realm: () 2024-09-12T17:38:41.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:38:41.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:38:41.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:41.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 zonegroup default 2024-09-12T17:38:41.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.502 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.502 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.502 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.502+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.502 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.502+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.502+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.502+0000 7f930fcec9c0 20 started sync module instance, tier type = 2024-09-12T17:38:41.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.502+0000 7f930fcec9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:38:41.527 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=0 2024-09-12T17:38:41.527 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=1 2024-09-12T17:38:41.527 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=2 2024-09-12T17:38:41.527 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=3 2024-09-12T17:38:41.527 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=4 2024-09-12T17:38:41.527 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=5 2024-09-12T17:38:41.527 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=6 2024-09-12T17:38:41.529 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=7 2024-09-12T17:38:41.529 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.526+0000 7f930fcec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:41.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.534+0000 7f91c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:41.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:41.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:41.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 note: GC not initialized 2024-09-12T17:38:41.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.534+0000 7f91c27e4640 20 reqs_thread_entry: start 2024-09-12T17:38:41.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:41.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 Filter name: none 2024-09-12T17:38:41.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.534+0000 7f9133fff640 20 reqs_thread_entry: start 2024-09-12T17:38:41.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.534+0000 7f930fcec9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:38:41.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:41.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.534+0000 7f930fcec9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:38:41.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.534+0000 7f930fcec9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:38:41.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.534+0000 7f930fcec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 : miss 2024-09-12T17:38:41.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.538+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:41.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.538+0000 7f930fcec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:38:41.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.538+0000 7f930fcec9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:38:41.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.538+0000 7f930fcec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:41.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.538+0000 7f930fcec9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:41.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.538+0000 7f930fcec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 2024-09-12T17:38:41.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.546+0000 7f930fcec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:38:41.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.546+0000 7f930fcec9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:38:41.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.546+0000 7f930fcec9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:41.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.546+0000 7f930fcec9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40, ofs0, ns] 2024-09-12T17:38:41.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.546+0000 7f91f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333459 cookie 94484063493776 notifier 8022 bl.length()=1015 2024-09-12T17:38:41.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.546+0000 7f91f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:38:41.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.546+0000 7f91f0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:38:41.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.546+0000 7f91f0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:41.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.550+0000 7f930fcec9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): orig_sources= new_sources= 2024-09-12T17:38:41.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.550+0000 7f930fcec9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): potential sources added=[] removed=[] 2024-09-12T17:38:41.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.550+0000 7f930fcec9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): orig_dests= new_dests= 2024-09-12T17:38:41.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.550+0000 7f930fcec9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): potential dests added=[] removed=[] 2024-09-12T17:38:41.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.0 2024-09-12T17:38:41.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.0 2024-09-12T17:38:41.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.1 2024-09-12T17:38:41.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.1 2024-09-12T17:38:41.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.2 2024-09-12T17:38:41.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.2 2024-09-12T17:38:41.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.3 2024-09-12T17:38:41.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.3 2024-09-12T17:38:41.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.4 2024-09-12T17:38:41.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.4 2024-09-12T17:38:41.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.5 2024-09-12T17:38:41.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.5 2024-09-12T17:38:41.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.6 2024-09-12T17:38:41.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.6 2024-09-12T17:38:41.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.7 2024-09-12T17:38:41.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.7 2024-09-12T17:38:41.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.8 2024-09-12T17:38:41.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.8 2024-09-12T17:38:41.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.9 2024-09-12T17:38:41.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.9 2024-09-12T17:38:41.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.10 2024-09-12T17:38:41.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.10 2024-09-12T17:38:41.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.11 2024-09-12T17:38:41.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.11 2024-09-12T17:38:41.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.0 2024-09-12T17:38:41.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1 2024-09-12T17:38:41.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2 2024-09-12T17:38:41.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.570+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.3 2024-09-12T17:38:41.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.570+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.4 2024-09-12T17:38:41.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.570+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.5 2024-09-12T17:38:41.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.574+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.6 2024-09-12T17:38:41.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.574+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.7 2024-09-12T17:38:41.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.574+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.8 2024-09-12T17:38:41.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.574+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.9 2024-09-12T17:38:41.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.578+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.10 2024-09-12T17:38:41.585 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f930fcec9c0 time 2024-09-12T17:38:41.588761+0000 2024-09-12T17:38:41.585 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:38:41.587 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:41.587 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f93135c62eb] 2024-09-12T17:38:41.587 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f93135c649f] 2024-09-12T17:38:41.587 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55eec70470c1] 2024-09-12T17:38:41.587 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55eec70584f1] 2024-09-12T17:38:41.587 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55eec7059b44] 2024-09-12T17:38:41.587 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:38:41.587 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f931242cd90] 2024-09-12T17:38:41.587 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:38:41.587 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:38:41.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.586+0000 7f930fcec9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f930fcec9c0 time 2024-09-12T17:38:41.588761+0000 2024-09-12T17:38:41.588 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:38:41.588 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.588 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:41.588 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f93135c62eb] 2024-09-12T17:38:41.588 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f93135c649f] 2024-09-12T17:38:41.588 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55eec70470c1] 2024-09-12T17:38:41.588 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55eec70584f1] 2024-09-12T17:38:41.588 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55eec7059b44] 2024-09-12T17:38:41.588 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:38:41.588 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f931242cd90] 2024-09-12T17:38:41.588 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:38:41.588 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:38:41.589 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.589 INFO:tasks.workunit.client.0.smithi119.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:38:41.589 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f930fcec9c0 thread_name:radosgw-admin 2024-09-12T17:38:41.606 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:41.606 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9312445520] 2024-09-12T17:38:41.606 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:38:41.606 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:38:41.606 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:38:41.607 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f93135c6345] 2024-09-12T17:38:41.607 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f93135c649f] 2024-09-12T17:38:41.607 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55eec70470c1] 2024-09-12T17:38:41.607 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55eec70584f1] 2024-09-12T17:38:41.607 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55eec7059b44] 2024-09-12T17:38:41.607 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:38:41.607 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f931242cd90] 2024-09-12T17:38:41.607 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:38:41.607 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:38:41.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.586+0000 7f930fcec9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:38:41.607 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f930fcec9c0 thread_name:radosgw-admin 2024-09-12T17:38:41.607 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.608 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:41.608 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9312445520] 2024-09-12T17:38:41.608 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:38:41.608 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:38:41.608 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:38:41.608 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f93135c6345] 2024-09-12T17:38:41.608 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f93135c649f] 2024-09-12T17:38:41.608 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55eec70470c1] 2024-09-12T17:38:41.608 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55eec70584f1] 2024-09-12T17:38:41.608 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55eec7059b44] 2024-09-12T17:38:41.608 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:38:41.608 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f931242cd90] 2024-09-12T17:38:41.609 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:38:41.609 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:38:41.609 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:38:41.609 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.609 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:38:41.609 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fac3f0) adding con mode: crc 2024-09-12T17:38:41.609 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fac3f0) adding con mode: secure 2024-09-12T17:38:41.609 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.609 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 1 librados: starting msgr at 2024-09-12T17:38:41.609 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 1 librados: starting objecter 2024-09-12T17:38:41.609 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command objecter_requests hook 0x55eec8fae6a0 2024-09-12T17:38:41.609 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 1 librados: setting wanted keys 2024-09-12T17:38:41.609 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 1 librados: calling monclient init 2024-09-12T17:38:41.610 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient: init 2024-09-12T17:38:41.610 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding auth protocol: cephx 2024-09-12T17:38:41.610 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding auth protocol: cephx 2024-09-12T17:38:41.610 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding auth protocol: cephx 2024-09-12T17:38:41.610 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: secure 2024-09-12T17:38:41.610 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: crc 2024-09-12T17:38:41.610 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: secure 2024-09-12T17:38:41.610 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: crc 2024-09-12T17:38:41.610 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: secure 2024-09-12T17:38:41.610 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: crc 2024-09-12T17:38:41.610 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: crc 2024-09-12T17:38:41.610 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: secure 2024-09-12T17:38:41.610 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: crc 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: secure 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: crc 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: secure 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command rotate-key hook 0x55eec8fa6f28 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-a con 0x55eec8e34d40 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-b con 0x55eec8eecce0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-c con 0x55eec8ef0730 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.611 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.612 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:38:41.612 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient(hunting): authenticate will time out at 2689.278317s 2024-09-12T17:38:41.612 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient(hunting): get_auth_request con 0x55eec8e34d40 auth_method 0 2024-09-12T17:38:41.612 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.612 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.612 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.612 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:38:41.242+0000 7f930dff3640 10 monclient(hunting): get_auth_request con 0x55eec8ef0730 auth_method 0 2024-09-12T17:38:41.612 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:38:41.242+0000 7f930dff3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.612 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:38:41.242+0000 7f930dff3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.612 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:38:41.242+0000 7f930dff3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.612 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:41.612 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:41.613 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:41.613 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:38:41.242+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:41.613 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:38:41.242+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:41.613 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:38:41.242+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:41.613 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient(hunting): handle_auth_done global_id 8013 payload 824 2024-09-12T17:38:41.613 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient: _finish_hunting 0 2024-09-12T17:38:41.613 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:38:41.242+0000 7f930d7f2640 1 monclient: found mon.noname-a 2024-09-12T17:38:41.613 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:38:41.613 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:38:41.242+0000 7f930cff1640 10 monclient: get_auth_request con 0x55eec8eecce0 auth_method 0 2024-09-12T17:38:41.613 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:41.613 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:38:41.613 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: dump: 2024-09-12T17:38:41.613 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:38:41.613 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:38:41.614 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.614 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.614 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:41.614 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.614 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:38:41.614 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:38:41.614 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:38:41.614 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.614 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: _finish_auth 0 2024-09-12T17:38:41.614 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: _check_auth_tickets 2024-09-12T17:38:41.614 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:41.614 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:41.614 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:38:41.615 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: dump: 2024-09-12T17:38:41.615 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:38:41.615 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:38:41.615 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.615 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.615 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:41.615 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.615 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:38:41.615 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:38:41.615 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:38:41.615 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.615 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 monclient: authenticate success, global_id 8013 2024-09-12T17:38:41.615 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient: _renew_subs 2024-09-12T17:38:41.616 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:38:41.242+0000 7f91fb606640 4 set_mon_vals no callback set 2024-09-12T17:38:41.616 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:38:41.616 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient: _renew_subs 2024-09-12T17:38:41.616 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:38:41.616 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 1 librados: init done 2024-09-12T17:38:41.616 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:38:41.246+0000 7f91f9e03640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:38:41.616 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:38:41.246+0000 7f91f9e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:38:41.616 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:38:41.246+0000 7f91f9e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:38:41.616 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:38:41.246+0000 7f930cff1640 10 monclient: get_auth_request con 0x7f91f4070ae0 auth_method 0 2024-09-12T17:38:41.616 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:38:41.246+0000 7f930dff3640 10 monclient: get_auth_request con 0x55eec8feed80 auth_method 0 2024-09-12T17:38:41.616 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:38:41.246+0000 7f930d7f2640 10 monclient: get_auth_request con 0x55eec8ff1f60 auth_method 0 2024-09-12T17:38:41.616 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:38:41.250+0000 7f930cff1640 10 monclient: get_auth_request con 0x55eec8ff6150 auth_method 0 2024-09-12T17:38:41.616 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:38:41.250+0000 7f930dff3640 10 monclient: get_auth_request con 0x55eec8ff9e30 auth_method 0 2024-09-12T17:38:41.617 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 10 monclient: build_initial_monmap 2024-09-12T17:38:41.617 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 1 build_initial for_mkfs: 0 2024-09-12T17:38:41.617 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 10 monclient: monmap: 2024-09-12T17:38:41.617 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:38:41.617 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:41.617 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:38:41.617 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:38:41.617 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:41.617 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.617 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:38:41.617 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:38:41.617 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:38:41.617 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.618 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding auth protocol: cephx 2024-09-12T17:38:41.618 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding auth protocol: cephx 2024-09-12T17:38:41.618 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding auth protocol: cephx 2024-09-12T17:38:41.618 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: secure 2024-09-12T17:38:41.618 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: crc 2024-09-12T17:38:41.618 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: secure 2024-09-12T17:38:41.618 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: crc 2024-09-12T17:38:41.618 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: secure 2024-09-12T17:38:41.618 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: crc 2024-09-12T17:38:41.618 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: crc 2024-09-12T17:38:41.618 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: secure 2024-09-12T17:38:41.618 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: crc 2024-09-12T17:38:41.618 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: secure 2024-09-12T17:38:41.619 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: crc 2024-09-12T17:38:41.619 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: secure 2024-09-12T17:38:41.619 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.619 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55eec90016a0 EEXIST 2024-09-12T17:38:41.619 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient: init 2024-09-12T17:38:41.619 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding auth protocol: cephx 2024-09-12T17:38:41.619 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding auth protocol: cephx 2024-09-12T17:38:41.619 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding auth protocol: cephx 2024-09-12T17:38:41.619 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: secure 2024-09-12T17:38:41.619 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: crc 2024-09-12T17:38:41.619 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: secure 2024-09-12T17:38:41.619 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: crc 2024-09-12T17:38:41.619 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: secure 2024-09-12T17:38:41.620 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: crc 2024-09-12T17:38:41.620 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: crc 2024-09-12T17:38:41.620 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: secure 2024-09-12T17:38:41.620 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: crc 2024-09-12T17:38:41.620 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: secure 2024-09-12T17:38:41.620 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: crc 2024-09-12T17:38:41.620 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: secure 2024-09-12T17:38:41.620 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.620 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.620 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command rotate-key cmddesc rotate-key hook 0x55eec8ffcd50 EEXIST 2024-09-12T17:38:41.620 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:38:41.621 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:38:41.621 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-a con 0x55eec9025850 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:38:41.621 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-c con 0x55eec9025180 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:38:41.621 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-b con 0x55eec9023b60 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:38:41.621 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.621 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.621 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.621 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:38:41.621 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient(hunting): authenticate will time out at 2689.289007s 2024-09-12T17:38:41.621 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient(hunting): get_auth_request con 0x55eec9025180 auth_method 0 2024-09-12T17:38:41.621 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.621 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.621 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.622 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:38:41.254+0000 7f930cff1640 10 monclient(hunting): get_auth_request con 0x55eec9025850 auth_method 0 2024-09-12T17:38:41.622 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:38:41.254+0000 7f930cff1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.622 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:38:41.254+0000 7f930cff1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.622 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:38:41.254+0000 7f930cff1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.622 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:41.622 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:41.622 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:41.622 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:38:41.254+0000 7f930cff1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:41.622 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:38:41.254+0000 7f930cff1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:41.622 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:38:41.254+0000 7f930cff1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:41.622 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient(hunting): handle_auth_done global_id 7556 payload 824 2024-09-12T17:38:41.622 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient: _finish_hunting 0 2024-09-12T17:38:41.622 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:38:41.254+0000 7f930dff3640 1 monclient: found mon.noname-c 2024-09-12T17:38:41.622 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:38:41.623 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:38:41.254+0000 7f930d7f2640 10 monclient: get_auth_request con 0x55eec9023b60 auth_method 0 2024-09-12T17:38:41.623 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:41.623 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:38:41.623 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: dump: 2024-09-12T17:38:41.623 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:38:41.623 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:38:41.623 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.623 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.623 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:41.623 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.623 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:38:41.623 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:38:41.623 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:38:41.624 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.624 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: _finish_auth 0 2024-09-12T17:38:41.624 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:38:41.624 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:41.624 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:41.624 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:38:41.624 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: dump: 2024-09-12T17:38:41.624 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:38:41.624 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:38:41.624 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.624 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.624 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:41.624 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.625 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:38:41.625 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:38:41.625 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:38:41.625 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.625 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 monclient: authenticate success, global_id 7556 2024-09-12T17:38:41.625 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient: _renew_subs 2024-09-12T17:38:41.625 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:38:41.254+0000 7f930e7f4640 4 set_mon_vals no callback set 2024-09-12T17:38:41.625 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:38:41.625 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient: _renew_subs 2024-09-12T17:38:41.625 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:38:41.625 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:38:41.625 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:38:41.625 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:38:41.625 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: get_monmap_and_config 2024-09-12T17:38:41.626 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: build_initial_monmap 2024-09-12T17:38:41.626 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 1 build_initial for_mkfs: 0 2024-09-12T17:38:41.626 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: monmap: 2024-09-12T17:38:41.626 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:38:41.626 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:41.626 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:38:41.626 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:38:41.626 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:41.626 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.626 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:38:41.626 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:38:41.626 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:38:41.626 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.627 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding auth protocol: cephx 2024-09-12T17:38:41.627 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding auth protocol: cephx 2024-09-12T17:38:41.627 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding auth protocol: cephx 2024-09-12T17:38:41.627 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: secure 2024-09-12T17:38:41.627 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: crc 2024-09-12T17:38:41.627 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: secure 2024-09-12T17:38:41.627 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: crc 2024-09-12T17:38:41.627 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: secure 2024-09-12T17:38:41.627 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: crc 2024-09-12T17:38:41.627 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: crc 2024-09-12T17:38:41.627 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: secure 2024-09-12T17:38:41.627 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: crc 2024-09-12T17:38:41.627 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: secure 2024-09-12T17:38:41.628 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: crc 2024-09-12T17:38:41.628 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: secure 2024-09-12T17:38:41.628 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient: get_auth_request con 0x7f91e8070a20 auth_method 0 2024-09-12T17:38:41.628 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.628 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: init 2024-09-12T17:38:41.628 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding auth protocol: cephx 2024-09-12T17:38:41.628 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding auth protocol: cephx 2024-09-12T17:38:41.628 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding auth protocol: cephx 2024-09-12T17:38:41.628 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: secure 2024-09-12T17:38:41.628 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: crc 2024-09-12T17:38:41.628 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: secure 2024-09-12T17:38:41.628 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: crc 2024-09-12T17:38:41.628 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: secure 2024-09-12T17:38:41.629 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: crc 2024-09-12T17:38:41.629 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: crc 2024-09-12T17:38:41.629 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: secure 2024-09-12T17:38:41.629 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: crc 2024-09-12T17:38:41.629 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: secure 2024-09-12T17:38:41.629 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: crc 2024-09-12T17:38:41.629 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: secure 2024-09-12T17:38:41.629 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.629 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.629 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffce7a5ab08 EEXIST 2024-09-12T17:38:41.629 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:38:41.629 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:38:41.629 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-c con 0x55eec90492b0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:38:41.630 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-b con 0x55eec9073900 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:38:41.630 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-a con 0x55eec9074b10 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:38:41.630 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.630 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.630 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.630 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:38:41.630 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): authenticate will time out at 2689.293078s 2024-09-12T17:38:41.630 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient(hunting): get_auth_request con 0x55eec90492b0 auth_method 0 2024-09-12T17:38:41.630 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.630 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.630 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.630 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): get_auth_request con 0x55eec9074b10 auth_method 0 2024-09-12T17:38:41.630 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.631 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.631 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.631 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:41.631 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:41.631 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:41.631 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:41.631 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:41.631 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:41.631 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): get_auth_request con 0x55eec9073900 auth_method 0 2024-09-12T17:38:41.631 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.631 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.631 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.631 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient(hunting): handle_auth_done global_id 7559 payload 274 2024-09-12T17:38:41.632 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient: _finish_hunting 0 2024-09-12T17:38:41.632 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:38:41.258+0000 7f930cff1640 1 monclient: found mon.noname-c 2024-09-12T17:38:41.632 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:38:41.632 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:41.632 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:38:41.632 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: dump: 2024-09-12T17:38:41.632 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:38:41.632 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:38:41.632 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.632 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.632 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:41.632 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.632 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: _finish_auth 0 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: dump: 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.633 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 monclient: authenticate success, global_id 7559 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 4 set_mon_vals no callback set 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: shutdown 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: build_initial_monmap 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 1 build_initial for_mkfs: 0 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: monmap: 2024-09-12T17:38:41.634 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding auth protocol: cephx 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding auth protocol: cephx 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding auth protocol: cephx 2024-09-12T17:38:41.635 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: secure 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: crc 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: secure 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: crc 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: secure 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: crc 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: crc 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: secure 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: crc 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: secure 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: crc 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: secure 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.636 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 1 librados: starting msgr at 2024-09-12T17:38:41.637 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 1 librados: starting objecter 2024-09-12T17:38:41.637 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55eec9047140 EEXIST 2024-09-12T17:38:41.637 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 1 librados: setting wanted keys 2024-09-12T17:38:41.637 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 1 librados: calling monclient init 2024-09-12T17:38:41.637 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: init 2024-09-12T17:38:41.637 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding auth protocol: cephx 2024-09-12T17:38:41.637 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding auth protocol: cephx 2024-09-12T17:38:41.637 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding auth protocol: cephx 2024-09-12T17:38:41.637 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: secure 2024-09-12T17:38:41.637 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: crc 2024-09-12T17:38:41.637 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: secure 2024-09-12T17:38:41.637 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: crc 2024-09-12T17:38:41.637 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: secure 2024-09-12T17:38:41.638 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: crc 2024-09-12T17:38:41.638 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: crc 2024-09-12T17:38:41.638 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: secure 2024-09-12T17:38:41.638 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: crc 2024-09-12T17:38:41.638 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: secure 2024-09-12T17:38:41.638 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: crc 2024-09-12T17:38:41.638 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: secure 2024-09-12T17:38:41.638 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.638 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.638 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command rotate-key cmddesc rotate-key hook 0x55eec90277b8 EEXIST 2024-09-12T17:38:41.638 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:38:41.638 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:38:41.638 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-b con 0x55eec90492b0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:38:41.639 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-a con 0x55eec9073900 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:38:41.639 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-c con 0x55eec9074b10 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:38:41.639 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.639 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.639 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.639 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:38:41.639 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): authenticate will time out at 2689.295657s 2024-09-12T17:38:41.639 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): get_auth_request con 0x55eec9073900 auth_method 0 2024-09-12T17:38:41.639 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.639 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.639 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.639 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): get_auth_request con 0x55eec9074b10 auth_method 0 2024-09-12T17:38:41.639 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.639 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.640 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.640 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:41.640 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:41.640 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:41.640 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:41.640 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:41.640 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:41.640 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): handle_auth_done global_id 8022 payload 824 2024-09-12T17:38:41.640 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:38:41.262+0000 7f930dff3640 10 monclient: _finish_hunting 0 2024-09-12T17:38:41.640 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:38:41.262+0000 7f930dff3640 1 monclient: found mon.noname-a 2024-09-12T17:38:41.640 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:38:41.262+0000 7f930dff3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:38:41.640 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:38:41.262+0000 7f930cff1640 10 monclient: get_auth_request con 0x55eec90492b0 auth_method 0 2024-09-12T17:38:41.640 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:41.641 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:38:41.641 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: dump: 2024-09-12T17:38:41.641 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:38:41.641 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:38:41.641 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.641 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.641 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:41.641 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.641 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:38:41.641 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:38:41.641 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:38:41.641 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.641 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: _finish_auth 0 2024-09-12T17:38:41.642 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: _check_auth_tickets 2024-09-12T17:38:41.642 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:41.642 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:41.642 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:38:41.642 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: dump: 2024-09-12T17:38:41.642 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:38:41.642 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:38:41.642 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.642 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.642 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:41.642 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.642 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:38:41.642 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:38:41.642 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:38:41.643 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.643 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 5 monclient: authenticate success, global_id 8022 2024-09-12T17:38:41.643 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 10 monclient: _renew_subs 2024-09-12T17:38:41.643 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:38:41.643 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:38:41.262+0000 7f91f0ff9640 4 set_mon_vals no callback set 2024-09-12T17:38:41.643 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 10 monclient: _renew_subs 2024-09-12T17:38:41.643 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:38:41.643 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 1 librados: init done 2024-09-12T17:38:41.643 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command cr dump hook 0x55eec9071d08 2024-09-12T17:38:41.643 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.643 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:38:41.262+0000 7f91deffd640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:38:41.643 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:38:41.262+0000 7f91deffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:38:41.643 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:38:41.262+0000 7f91deffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:38:41.644 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:38:41.262+0000 7f930cff1640 10 monclient: get_auth_request con 0x7f91d8070ae0 auth_method 0 2024-09-12T17:38:41.644 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:38:41.262+0000 7f930d7f2640 10 monclient: get_auth_request con 0x55eec90935b0 auth_method 0 2024-09-12T17:38:41.644 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.644 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 20 realm 2024-09-12T17:38:41.644 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.644 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.644 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:41.644 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.644 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.644 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.644 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:38:41.266+0000 7f930cff1640 10 monclient: get_auth_request con 0x55eec9097930 auth_method 0 2024-09-12T17:38:41.644 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:41.644 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.645 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:38:41.266+0000 7f930dff3640 10 monclient: get_auth_request con 0x55eec909b050 auth_method 0 2024-09-12T17:38:41.645 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:41.645 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 searching for the correct realm 2024-09-12T17:38:41.645 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:38:41.266+0000 7f930d7f2640 10 monclient: get_auth_request con 0x55eec909fdd0 auth_method 0 2024-09-12T17:38:41.645 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:38:41.270+0000 7f930cff1640 10 monclient: get_auth_request con 0x7f93080ca070 auth_method 0 2024-09-12T17:38:41.645 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:38:41.270+0000 7f930dff3640 10 monclient: get_auth_request con 0x7f92f8040070 auth_method 0 2024-09-12T17:38:41.645 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:38:41.270+0000 7f930dff3640 0 -- 172.21.15.119:0/723721776 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f92f8040070 msgr2=0x7f92f804e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:41.645 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:38:41.270+0000 7f91deffd640 1 client.8022.objecter ms_handle_reset 0x7f92f8040070 session 0x7f92f8047040 osd.2 2024-09-12T17:38:41.645 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:38:41.270+0000 7f91deffd640 10 monclient: _renew_subs 2024-09-12T17:38:41.645 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:38:41.270+0000 7f91deffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:38:41.645 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:38:41.270+0000 7f930dff3640 10 monclient: get_auth_request con 0x7f91d8081290 auth_method 0 2024-09-12T17:38:41.645 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:38:41.274+0000 7f930d7f2640 10 monclient: get_auth_request con 0x7f93000894f0 auth_method 0 2024-09-12T17:38:41.645 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:38:41.278+0000 7f930cff1640 0 -- 172.21.15.119:0/723721776 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f930007f950 msgr2=0x7f930006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:41.646 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:38:41.482+0000 7f930cff1640 10 monclient: get_auth_request con 0x7f930007f950 auth_method 0 2024-09-12T17:38:41.646 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:38:41.646 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:38:41.646 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:41.646 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:41.646 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:41.646 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:41.646 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.646 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.646 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.646 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:41.646 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.646 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:41.647 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 zone default found 2024-09-12T17:38:41.647 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 4 Realm: () 2024-09-12T17:38:41.647 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:38:41.647 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:38:41.647 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:41.647 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 zonegroup default 2024-09-12T17:38:41.647 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.647 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.647 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.647 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:38:41.502+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.647 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:38:41.502+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.647 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:38:41.502+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.647 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:38:41.502+0000 7f930fcec9c0 20 started sync module instance, tier type = 2024-09-12T17:38:41.647 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:38:41.502+0000 7f930fcec9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:38:41.648 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=0 2024-09-12T17:38:41.648 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=1 2024-09-12T17:38:41.648 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=2 2024-09-12T17:38:41.648 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=3 2024-09-12T17:38:41.648 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=4 2024-09-12T17:38:41.648 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=5 2024-09-12T17:38:41.648 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=6 2024-09-12T17:38:41.648 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=7 2024-09-12T17:38:41.648 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:41.648 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding auth protocol: cephx 2024-09-12T17:38:41.648 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding auth protocol: cephx 2024-09-12T17:38:41.648 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding auth protocol: cephx 2024-09-12T17:38:41.649 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: secure 2024-09-12T17:38:41.649 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: crc 2024-09-12T17:38:41.649 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: secure 2024-09-12T17:38:41.649 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: crc 2024-09-12T17:38:41.649 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: secure 2024-09-12T17:38:41.649 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: crc 2024-09-12T17:38:41.649 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: crc 2024-09-12T17:38:41.649 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: secure 2024-09-12T17:38:41.649 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: crc 2024-09-12T17:38:41.649 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: secure 2024-09-12T17:38:41.649 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: crc 2024-09-12T17:38:41.649 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:38:41.534+0000 7f91c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:41.649 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: secure 2024-09-12T17:38:41.650 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.650 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:41.650 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:41.650 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command cache list hook 0x55eec9077c70 2024-09-12T17:38:41.650 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command cache inspect hook 0x55eec9077c70 2024-09-12T17:38:41.650 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command cache erase hook 0x55eec9077c70 2024-09-12T17:38:41.650 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command cache zap hook 0x55eec9077c70 2024-09-12T17:38:41.650 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 note: GC not initialized 2024-09-12T17:38:41.650 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:38:41.534+0000 7f91c27e4640 20 reqs_thread_entry: start 2024-09-12T17:38:41.650 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command sync trace show hook 0x7f92f8001d00 2024-09-12T17:38:41.650 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command sync trace history hook 0x7f92f8001d00 2024-09-12T17:38:41.650 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command sync trace active hook 0x7f92f8001d00 2024-09-12T17:38:41.650 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command sync trace active_short hook 0x7f92f8001d00 2024-09-12T17:38:41.650 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:41.651 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 Filter name: none 2024-09-12T17:38:41.651 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:38:41.534+0000 7f9133fff640 20 reqs_thread_entry: start 2024-09-12T17:38:41.651 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:38:41.651 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.651 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:41.651 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:38:41.651 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:38:41.651 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 : miss 2024-09-12T17:38:41.651 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.651 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:38:41.538+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:41.651 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:38:41.538+0000 7f930fcec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:38:41.651 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:38:41.538+0000 7f930fcec9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:38:41.651 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:38:41.538+0000 7f930fcec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:41.652 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:38:41.538+0000 7f930fcec9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:41.652 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:38:41.538+0000 7f930fcec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 2024-09-12T17:38:41.652 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:38:41.546+0000 7f930fcec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:38:41.652 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:38:41.546+0000 7f930fcec9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:38:41.652 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:38:41.546+0000 7f930fcec9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:41.652 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:38:41.546+0000 7f930fcec9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40, ofs0, ns] 2024-09-12T17:38:41.652 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:38:41.546+0000 7f91f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333459 cookie 94484063493776 notifier 8022 bl.length()=1015 2024-09-12T17:38:41.652 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:38:41.546+0000 7f91f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:38:41.652 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:38:41.546+0000 7f91f0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:38:41.652 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:38:41.546+0000 7f91f0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:41.652 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:38:41.550+0000 7f930fcec9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): orig_sources= new_sources= 2024-09-12T17:38:41.652 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:38:41.550+0000 7f930fcec9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): potential sources added=[] removed=[] 2024-09-12T17:38:41.652 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:38:41.550+0000 7f930fcec9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): orig_dests= new_dests= 2024-09-12T17:38:41.653 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:38:41.550+0000 7f930fcec9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): potential dests added=[] removed=[] 2024-09-12T17:38:41.653 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.0 2024-09-12T17:38:41.653 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.0 2024-09-12T17:38:41.653 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.1 2024-09-12T17:38:41.653 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.1 2024-09-12T17:38:41.653 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.2 2024-09-12T17:38:41.653 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.2 2024-09-12T17:38:41.653 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.3 2024-09-12T17:38:41.653 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.3 2024-09-12T17:38:41.654 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.4 2024-09-12T17:38:41.654 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.4 2024-09-12T17:38:41.654 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.5 2024-09-12T17:38:41.654 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.5 2024-09-12T17:38:41.654 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.6 2024-09-12T17:38:41.654 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.6 2024-09-12T17:38:41.654 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.7 2024-09-12T17:38:41.654 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.7 2024-09-12T17:38:41.654 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.8 2024-09-12T17:38:41.654 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.8 2024-09-12T17:38:41.654 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.9 2024-09-12T17:38:41.654 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.9 2024-09-12T17:38:41.654 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.10 2024-09-12T17:38:41.655 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.10 2024-09-12T17:38:41.655 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.11 2024-09-12T17:38:41.655 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.11 2024-09-12T17:38:41.655 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.0 2024-09-12T17:38:41.655 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1 2024-09-12T17:38:41.655 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2 2024-09-12T17:38:41.655 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:38:41.570+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.3 2024-09-12T17:38:41.655 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:38:41.570+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.4 2024-09-12T17:38:41.655 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:38:41.570+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.5 2024-09-12T17:38:41.655 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:38:41.574+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.6 2024-09-12T17:38:41.655 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:38:41.574+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.7 2024-09-12T17:38:41.655 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:38:41.574+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.8 2024-09-12T17:38:41.655 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:38:41.574+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.9 2024-09-12T17:38:41.656 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:38:41.578+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.10 2024-09-12T17:38:41.656 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:38:41.586+0000 7f930fcec9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f930fcec9c0 time 2024-09-12T17:38:41.588761+0000 2024-09-12T17:38:41.656 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:38:41.656 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.656 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:41.656 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f93135c62eb] 2024-09-12T17:38:41.656 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f93135c649f] 2024-09-12T17:38:41.656 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55eec70470c1] 2024-09-12T17:38:41.656 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55eec70584f1] 2024-09-12T17:38:41.656 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55eec7059b44] 2024-09-12T17:38:41.656 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:38:41.656 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f931242cd90] 2024-09-12T17:38:41.656 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:38:41.586+0000 7f930fcec9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f930fcec9c0 thread_name:radosgw-admin 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9312445520] 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f93135c6345] 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f93135c649f] 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55eec70470c1] 2024-09-12T17:38:41.657 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55eec70584f1] 2024-09-12T17:38:41.658 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55eec7059b44] 2024-09-12T17:38:41.658 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:38:41.658 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f931242cd90] 2024-09-12T17:38:41.658 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:38:41.658 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:38:41.658 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:38:41.658 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.658 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:38:41.658 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:38:41.658 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:38:41.658 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:38:41.658 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:38:41.658 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:38:41.659 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:38:41.659 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:38:41.659 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:38:41.659 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:38:41.659 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:38:41.659 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:38:41.659 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:38:41.659 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:38:41.659 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:38:41.659 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:38:41.659 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:38:41.659 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:38:41.659 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:38:41.660 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:38:41.660 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:38:41.660 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:38:41.660 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:38:41.660 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:38:41.660 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:38:41.660 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:38:41.660 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:38:41.660 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:38:41.660 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:38:41.660 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:38:41.660 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:38:41.660 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:38:41.661 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:38:41.661 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:38:41.661 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:38:41.661 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:38:41.661 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:38:41.661 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:38:41.661 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:38:41.661 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:38:41.661 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:38:41.661 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:38:41.661 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:38:41.661 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:38:41.661 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:38:41.662 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:38:41.662 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:38:41.662 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:38:41.662 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:38:41.662 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:38:41.662 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:38:41.662 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:38:41.662 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:38:41.662 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:38:41.662 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:38:41.662 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:38:41.662 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:38:41.662 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:38:41.663 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:38:41.664 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:38:41.665 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:38:41.665 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:38:41.665 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:38:41.665 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:38:41.665 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:38:41.665 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:38:41.665 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:38:41.665 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:38:41.665 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:38:41.665 INFO:tasks.workunit.client.0.smithi119.stderr: 7f9133fff640 / http_manager 2024-09-12T17:38:41.665 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91c27e4640 / http_manager 2024-09-12T17:38:41.665 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91c37e6640 / rgw_dt_lg_renew 2024-09-12T17:38:41.665 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91deffd640 / ms_dispatch 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91f0ff9640 / io_context_pool 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91f2ffd640 / ms_dispatch 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91f9e03640 / ms_dispatch 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91fb606640 / io_context_pool 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi119.stderr: 7f930cff1640 / msgr-worker-2 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi119.stderr: 7f930d7f2640 / msgr-worker-1 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi119.stderr: 7f930dff3640 / msgr-worker-0 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi119.stderr: 7f930e7f4640 / io_context_pool 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi119.stderr: 7f930fcec9c0 / radosgw-admin 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/log/ceph/ceph-client.admin.135723.log 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:38:41.666 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fac3f0) adding con mode: crc 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fac3f0) adding con mode: secure 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 1 librados: starting msgr at 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 1 librados: starting objecter 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command objecter_requests hook 0x55eec8fae6a0 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 1 librados: setting wanted keys 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 1 librados: calling monclient init 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient: init 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding auth protocol: cephx 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding auth protocol: cephx 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding auth protocol: cephx 2024-09-12T17:38:41.667 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: secure 2024-09-12T17:38:41.668 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: crc 2024-09-12T17:38:41.668 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: secure 2024-09-12T17:38:41.668 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: crc 2024-09-12T17:38:41.668 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: secure 2024-09-12T17:38:41.668 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: crc 2024-09-12T17:38:41.668 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: crc 2024-09-12T17:38:41.668 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: secure 2024-09-12T17:38:41.668 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: crc 2024-09-12T17:38:41.668 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: secure 2024-09-12T17:38:41.668 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: crc 2024-09-12T17:38:41.668 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8fa6de0) adding con mode: secure 2024-09-12T17:38:41.668 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.668 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.669 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command rotate-key hook 0x55eec8fa6f28 2024-09-12T17:38:41.669 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:38:41.669 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:38:41.669 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-a con 0x55eec8e34d40 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:38:41.669 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-b con 0x55eec8eecce0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:38:41.669 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-c con 0x55eec8ef0730 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:38:41.669 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.669 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.669 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.669 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:38:41.669 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient(hunting): authenticate will time out at 2689.278317s 2024-09-12T17:38:41.669 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient(hunting): get_auth_request con 0x55eec8e34d40 auth_method 0 2024-09-12T17:38:41.669 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.669 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.670 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.670 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:38:41.242+0000 7f930dff3640 10 monclient(hunting): get_auth_request con 0x55eec8ef0730 auth_method 0 2024-09-12T17:38:41.670 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:38:41.242+0000 7f930dff3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.670 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:38:41.242+0000 7f930dff3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.670 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:38:41.242+0000 7f930dff3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.670 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:41.670 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:41.670 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:41.670 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:38:41.242+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:41.670 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:38:41.242+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:41.670 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:38:41.242+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:41.670 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient(hunting): handle_auth_done global_id 8013 payload 824 2024-09-12T17:38:41.670 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient: _finish_hunting 0 2024-09-12T17:38:41.671 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:38:41.242+0000 7f930d7f2640 1 monclient: found mon.noname-a 2024-09-12T17:38:41.671 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:38:41.242+0000 7f930d7f2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:38:41.671 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:38:41.242+0000 7f930cff1640 10 monclient: get_auth_request con 0x55eec8eecce0 auth_method 0 2024-09-12T17:38:41.671 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:41.671 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:38:41.671 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: dump: 2024-09-12T17:38:41.671 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:38:41.671 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:38:41.671 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.671 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.671 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:41.671 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.671 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:38:41.672 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:38:41.672 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:38:41.672 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.672 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: _finish_auth 0 2024-09-12T17:38:41.672 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: _check_auth_tickets 2024-09-12T17:38:41.672 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:41.672 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:41.672 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:38:41.672 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:38:41.242+0000 7f91f9e03640 10 monclient: dump: 2024-09-12T17:38:41.672 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:38:41.672 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:38:41.672 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.672 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.672 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:41.673 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.673 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:38:41.673 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:38:41.673 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:38:41.673 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.673 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 5 monclient: authenticate success, global_id 8013 2024-09-12T17:38:41.673 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient: _renew_subs 2024-09-12T17:38:41.673 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:38:41.242+0000 7f91fb606640 4 set_mon_vals no callback set 2024-09-12T17:38:41.673 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:38:41.673 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient: _renew_subs 2024-09-12T17:38:41.673 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:38:41.673 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:38:41.242+0000 7f930fcec9c0 1 librados: init done 2024-09-12T17:38:41.673 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:38:41.246+0000 7f91f9e03640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:38:41.674 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:38:41.246+0000 7f91f9e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:38:41.674 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:38:41.246+0000 7f91f9e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:38:41.674 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:38:41.246+0000 7f930cff1640 10 monclient: get_auth_request con 0x7f91f4070ae0 auth_method 0 2024-09-12T17:38:41.674 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:38:41.246+0000 7f930dff3640 10 monclient: get_auth_request con 0x55eec8feed80 auth_method 0 2024-09-12T17:38:41.674 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:38:41.246+0000 7f930d7f2640 10 monclient: get_auth_request con 0x55eec8ff1f60 auth_method 0 2024-09-12T17:38:41.674 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:38:41.250+0000 7f930cff1640 10 monclient: get_auth_request con 0x55eec8ff6150 auth_method 0 2024-09-12T17:38:41.674 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:38:41.250+0000 7f930dff3640 10 monclient: get_auth_request con 0x55eec8ff9e30 auth_method 0 2024-09-12T17:38:41.674 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 10 monclient: build_initial_monmap 2024-09-12T17:38:41.674 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 1 build_initial for_mkfs: 0 2024-09-12T17:38:41.674 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 10 monclient: monmap: 2024-09-12T17:38:41.674 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:38:41.674 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:41.674 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:38:41.675 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:38:41.675 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:41.675 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.675 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:38:41.675 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:38:41.675 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:38:41.675 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.675 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding auth protocol: cephx 2024-09-12T17:38:41.675 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding auth protocol: cephx 2024-09-12T17:38:41.675 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding auth protocol: cephx 2024-09-12T17:38:41.675 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: secure 2024-09-12T17:38:41.675 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: crc 2024-09-12T17:38:41.675 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: secure 2024-09-12T17:38:41.675 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: crc 2024-09-12T17:38:41.676 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: secure 2024-09-12T17:38:41.676 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: crc 2024-09-12T17:38:41.676 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: crc 2024-09-12T17:38:41.676 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: secure 2024-09-12T17:38:41.676 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: crc 2024-09-12T17:38:41.676 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: secure 2024-09-12T17:38:41.676 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: crc 2024-09-12T17:38:41.676 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:38:41.250+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffdc50) adding con mode: secure 2024-09-12T17:38:41.676 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.676 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55eec90016a0 EEXIST 2024-09-12T17:38:41.676 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient: init 2024-09-12T17:38:41.676 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding auth protocol: cephx 2024-09-12T17:38:41.676 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding auth protocol: cephx 2024-09-12T17:38:41.677 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding auth protocol: cephx 2024-09-12T17:38:41.677 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: secure 2024-09-12T17:38:41.677 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: crc 2024-09-12T17:38:41.677 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: secure 2024-09-12T17:38:41.677 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: crc 2024-09-12T17:38:41.677 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: secure 2024-09-12T17:38:41.677 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: crc 2024-09-12T17:38:41.677 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: crc 2024-09-12T17:38:41.677 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: secure 2024-09-12T17:38:41.677 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: crc 2024-09-12T17:38:41.677 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: secure 2024-09-12T17:38:41.677 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: crc 2024-09-12T17:38:41.677 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 AuthRegistry(0x55eec8ffcc08) adding con mode: secure 2024-09-12T17:38:41.677 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.678 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.678 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command rotate-key cmddesc rotate-key hook 0x55eec8ffcd50 EEXIST 2024-09-12T17:38:41.678 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:38:41.678 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:38:41.678 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-a con 0x55eec9025850 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:38:41.678 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-c con 0x55eec9025180 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:38:41.678 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-b con 0x55eec9023b60 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:38:41.678 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.678 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.678 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.678 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:38:41.678 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient(hunting): authenticate will time out at 2689.289007s 2024-09-12T17:38:41.678 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient(hunting): get_auth_request con 0x55eec9025180 auth_method 0 2024-09-12T17:38:41.679 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.679 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.679 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.679 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:38:41.254+0000 7f930cff1640 10 monclient(hunting): get_auth_request con 0x55eec9025850 auth_method 0 2024-09-12T17:38:41.679 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:38:41.254+0000 7f930cff1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.679 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:38:41.254+0000 7f930cff1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.679 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:38:41.254+0000 7f930cff1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.679 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:41.679 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:41.679 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:41.679 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:38:41.254+0000 7f930cff1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:41.679 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:38:41.254+0000 7f930cff1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:41.679 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:38:41.254+0000 7f930cff1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:41.680 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient(hunting): handle_auth_done global_id 7556 payload 824 2024-09-12T17:38:41.680 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient: _finish_hunting 0 2024-09-12T17:38:41.680 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:38:41.254+0000 7f930dff3640 1 monclient: found mon.noname-c 2024-09-12T17:38:41.680 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:38:41.254+0000 7f930dff3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:38:41.680 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:38:41.254+0000 7f930d7f2640 10 monclient: get_auth_request con 0x55eec9023b60 auth_method 0 2024-09-12T17:38:41.680 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:41.680 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:38:41.680 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: dump: 2024-09-12T17:38:41.680 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:38:41.680 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:38:41.680 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.680 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.680 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:41.680 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.681 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:38:41.681 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:38:41.681 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:38:41.681 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.681 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: _finish_auth 0 2024-09-12T17:38:41.681 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:38:41.681 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:41.681 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:41.681 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:38:41.681 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 10 monclient: dump: 2024-09-12T17:38:41.681 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:38:41.681 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:38:41.681 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.682 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.682 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:41.682 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.682 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:38:41.682 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:38:41.682 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:38:41.682 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.682 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 5 monclient: authenticate success, global_id 7556 2024-09-12T17:38:41.682 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient: _renew_subs 2024-09-12T17:38:41.682 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:38:41.254+0000 7f930e7f4640 4 set_mon_vals no callback set 2024-09-12T17:38:41.682 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:38:41.682 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient: _renew_subs 2024-09-12T17:38:41.682 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:38:41.254+0000 7f930fcec9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:38:41.682 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:38:41.683 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:38:41.683 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:38:41.254+0000 7f91f2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:38:41.683 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: get_monmap_and_config 2024-09-12T17:38:41.683 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: build_initial_monmap 2024-09-12T17:38:41.683 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 1 build_initial for_mkfs: 0 2024-09-12T17:38:41.683 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: monmap: 2024-09-12T17:38:41.683 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:38:41.683 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:41.683 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:38:41.683 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:38:41.683 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:41.683 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.683 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:38:41.683 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:38:41.684 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:38:41.684 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.684 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding auth protocol: cephx 2024-09-12T17:38:41.684 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding auth protocol: cephx 2024-09-12T17:38:41.684 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding auth protocol: cephx 2024-09-12T17:38:41.684 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: secure 2024-09-12T17:38:41.684 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: crc 2024-09-12T17:38:41.684 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: secure 2024-09-12T17:38:41.684 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: crc 2024-09-12T17:38:41.684 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: secure 2024-09-12T17:38:41.684 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: crc 2024-09-12T17:38:41.684 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: crc 2024-09-12T17:38:41.684 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: secure 2024-09-12T17:38:41.685 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: crc 2024-09-12T17:38:41.685 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: secure 2024-09-12T17:38:41.685 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: crc 2024-09-12T17:38:41.685 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec90451f0) adding con mode: secure 2024-09-12T17:38:41.685 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient: get_auth_request con 0x7f91e8070a20 auth_method 0 2024-09-12T17:38:41.685 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.685 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: init 2024-09-12T17:38:41.685 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding auth protocol: cephx 2024-09-12T17:38:41.685 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding auth protocol: cephx 2024-09-12T17:38:41.685 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding auth protocol: cephx 2024-09-12T17:38:41.685 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: secure 2024-09-12T17:38:41.685 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: crc 2024-09-12T17:38:41.686 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: secure 2024-09-12T17:38:41.686 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: crc 2024-09-12T17:38:41.686 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: secure 2024-09-12T17:38:41.686 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: crc 2024-09-12T17:38:41.686 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: crc 2024-09-12T17:38:41.686 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: secure 2024-09-12T17:38:41.686 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: crc 2024-09-12T17:38:41.686 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: secure 2024-09-12T17:38:41.686 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: crc 2024-09-12T17:38:41.686 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5a9c0) adding con mode: secure 2024-09-12T17:38:41.686 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.686 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.686 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffce7a5ab08 EEXIST 2024-09-12T17:38:41.687 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:38:41.687 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:38:41.687 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-c con 0x55eec90492b0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:38:41.687 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-b con 0x55eec9073900 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:38:41.687 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-a con 0x55eec9074b10 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:38:41.687 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.687 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.687 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.687 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:38:41.687 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): authenticate will time out at 2689.293078s 2024-09-12T17:38:41.687 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient(hunting): get_auth_request con 0x55eec90492b0 auth_method 0 2024-09-12T17:38:41.687 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.687 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.687 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.688 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): get_auth_request con 0x55eec9074b10 auth_method 0 2024-09-12T17:38:41.688 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.688 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.688 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.688 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:41.688 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:41.688 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:41.688 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:41.688 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:41.688 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:41.688 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): get_auth_request con 0x55eec9073900 auth_method 0 2024-09-12T17:38:41.688 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.689 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.689 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.689 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient(hunting): handle_auth_done global_id 7559 payload 274 2024-09-12T17:38:41.689 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient: _finish_hunting 0 2024-09-12T17:38:41.689 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:38:41.258+0000 7f930cff1640 1 monclient: found mon.noname-c 2024-09-12T17:38:41.689 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:38:41.258+0000 7f930cff1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:38:41.689 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:41.689 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:38:41.689 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: dump: 2024-09-12T17:38:41.689 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:38:41.689 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:38:41.689 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.689 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.689 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:41.690 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.690 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:38:41.690 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:38:41.690 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:38:41.690 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.690 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: _finish_auth 0 2024-09-12T17:38:41.690 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:38:41.690 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:41.690 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:41.690 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:38:41.690 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:38:41.258+0000 7f91f0ff9640 10 monclient: dump: 2024-09-12T17:38:41.690 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:38:41.690 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:38:41.691 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.691 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.691 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:41.691 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.691 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:38:41.691 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:38:41.691 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:38:41.691 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.691 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 monclient: authenticate success, global_id 7559 2024-09-12T17:38:41.691 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:38:41.691 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 4 set_mon_vals no callback set 2024-09-12T17:38:41.691 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: shutdown 2024-09-12T17:38:41.691 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: build_initial_monmap 2024-09-12T17:38:41.691 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 1 build_initial for_mkfs: 0 2024-09-12T17:38:41.692 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: monmap: 2024-09-12T17:38:41.692 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:38:41.692 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:41.692 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:38:41.692 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:38:41.692 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:41.692 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.692 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:38:41.692 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:38:41.692 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:38:41.692 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.692 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding auth protocol: cephx 2024-09-12T17:38:41.692 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding auth protocol: cephx 2024-09-12T17:38:41.693 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding auth protocol: cephx 2024-09-12T17:38:41.693 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: secure 2024-09-12T17:38:41.693 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: crc 2024-09-12T17:38:41.693 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: secure 2024-09-12T17:38:41.693 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: crc 2024-09-12T17:38:41.693 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: secure 2024-09-12T17:38:41.693 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: crc 2024-09-12T17:38:41.693 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: crc 2024-09-12T17:38:41.693 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: secure 2024-09-12T17:38:41.693 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: crc 2024-09-12T17:38:41.693 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: secure 2024-09-12T17:38:41.693 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: crc 2024-09-12T17:38:41.693 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9069f60) adding con mode: secure 2024-09-12T17:38:41.694 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.694 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 1 librados: starting msgr at 2024-09-12T17:38:41.694 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 1 librados: starting objecter 2024-09-12T17:38:41.694 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55eec9047140 EEXIST 2024-09-12T17:38:41.694 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 1 librados: setting wanted keys 2024-09-12T17:38:41.694 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 1 librados: calling monclient init 2024-09-12T17:38:41.694 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: init 2024-09-12T17:38:41.694 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding auth protocol: cephx 2024-09-12T17:38:41.694 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding auth protocol: cephx 2024-09-12T17:38:41.694 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding auth protocol: cephx 2024-09-12T17:38:41.694 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: secure 2024-09-12T17:38:41.694 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: crc 2024-09-12T17:38:41.694 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: secure 2024-09-12T17:38:41.695 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: crc 2024-09-12T17:38:41.695 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: secure 2024-09-12T17:38:41.695 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: crc 2024-09-12T17:38:41.695 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: crc 2024-09-12T17:38:41.695 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: secure 2024-09-12T17:38:41.695 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: crc 2024-09-12T17:38:41.695 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: secure 2024-09-12T17:38:41.695 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: crc 2024-09-12T17:38:41.695 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 AuthRegistry(0x55eec9027670) adding con mode: secure 2024-09-12T17:38:41.695 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.695 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.695 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command rotate-key cmddesc rotate-key hook 0x55eec90277b8 EEXIST 2024-09-12T17:38:41.695 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:38:41.695 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:38:41.696 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-b con 0x55eec90492b0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:38:41.696 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-a con 0x55eec9073900 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:38:41.696 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): picked mon.noname-c con 0x55eec9074b10 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:38:41.696 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.696 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.696 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:41.696 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:38:41.696 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:38:41.258+0000 7f930fcec9c0 10 monclient(hunting): authenticate will time out at 2689.295657s 2024-09-12T17:38:41.696 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): get_auth_request con 0x55eec9073900 auth_method 0 2024-09-12T17:38:41.696 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.696 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.696 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.696 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): get_auth_request con 0x55eec9074b10 auth_method 0 2024-09-12T17:38:41.697 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:41.697 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:41.697 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:41.697 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:41.697 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:41.697 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:41.697 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:41.697 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:41.697 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:38:41.258+0000 7f930d7f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:41.697 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:38:41.258+0000 7f930dff3640 10 monclient(hunting): handle_auth_done global_id 8022 payload 824 2024-09-12T17:38:41.697 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:38:41.262+0000 7f930dff3640 10 monclient: _finish_hunting 0 2024-09-12T17:38:41.697 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:38:41.262+0000 7f930dff3640 1 monclient: found mon.noname-a 2024-09-12T17:38:41.697 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:38:41.262+0000 7f930dff3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:38:41.697 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:38:41.262+0000 7f930cff1640 10 monclient: get_auth_request con 0x55eec90492b0 auth_method 0 2024-09-12T17:38:41.698 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:41.698 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:38:41.698 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: dump: 2024-09-12T17:38:41.698 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:38:41.698 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:38:41.698 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.698 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.698 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:41.698 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.698 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:38:41.698 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:38:41.698 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:38:41.698 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.699 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: _finish_auth 0 2024-09-12T17:38:41.699 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: _check_auth_tickets 2024-09-12T17:38:41.699 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:41.699 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:41.699 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:38:41.699 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:38:41.262+0000 7f91deffd640 10 monclient: dump: 2024-09-12T17:38:41.699 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:38:41.699 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:38:41.699 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.699 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:38:41.699 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:41.699 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:38:41.699 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:38:41.699 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:38:41.700 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:38:41.700 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.700 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 5 monclient: authenticate success, global_id 8022 2024-09-12T17:38:41.700 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 10 monclient: _renew_subs 2024-09-12T17:38:41.700 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:38:41.700 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:38:41.262+0000 7f91f0ff9640 4 set_mon_vals no callback set 2024-09-12T17:38:41.700 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 10 monclient: _renew_subs 2024-09-12T17:38:41.700 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:38:41.700 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 1 librados: init done 2024-09-12T17:38:41.700 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command cr dump hook 0x55eec9071d08 2024-09-12T17:38:41.700 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.700 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:38:41.262+0000 7f91deffd640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:38:41.700 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:38:41.262+0000 7f91deffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:38:41.701 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:38:41.262+0000 7f91deffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:38:41.701 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:38:41.262+0000 7f930cff1640 10 monclient: get_auth_request con 0x7f91d8070ae0 auth_method 0 2024-09-12T17:38:41.701 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:38:41.262+0000 7f930d7f2640 10 monclient: get_auth_request con 0x55eec90935b0 auth_method 0 2024-09-12T17:38:41.701 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.701 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 20 realm 2024-09-12T17:38:41.701 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:38:41.262+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.701 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.701 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:41.701 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.701 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.701 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.701 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:38:41.266+0000 7f930cff1640 10 monclient: get_auth_request con 0x55eec9097930 auth_method 0 2024-09-12T17:38:41.701 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:41.702 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.702 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:38:41.266+0000 7f930dff3640 10 monclient: get_auth_request con 0x55eec909b050 auth_method 0 2024-09-12T17:38:41.702 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:41.702 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:38:41.266+0000 7f930fcec9c0 20 searching for the correct realm 2024-09-12T17:38:41.702 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:38:41.266+0000 7f930d7f2640 10 monclient: get_auth_request con 0x55eec909fdd0 auth_method 0 2024-09-12T17:38:41.702 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:38:41.270+0000 7f930cff1640 10 monclient: get_auth_request con 0x7f93080ca070 auth_method 0 2024-09-12T17:38:41.702 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:38:41.270+0000 7f930dff3640 10 monclient: get_auth_request con 0x7f92f8040070 auth_method 0 2024-09-12T17:38:41.702 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:38:41.270+0000 7f930dff3640 0 -- 172.21.15.119:0/723721776 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f92f8040070 msgr2=0x7f92f804e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:41.702 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:38:41.270+0000 7f91deffd640 1 client.8022.objecter ms_handle_reset 0x7f92f8040070 session 0x7f92f8047040 osd.2 2024-09-12T17:38:41.702 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:38:41.270+0000 7f91deffd640 10 monclient: _renew_subs 2024-09-12T17:38:41.702 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:38:41.270+0000 7f91deffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:38:41.702 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:38:41.270+0000 7f930dff3640 10 monclient: get_auth_request con 0x7f91d8081290 auth_method 0 2024-09-12T17:38:41.702 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:38:41.274+0000 7f930d7f2640 10 monclient: get_auth_request con 0x7f93000894f0 auth_method 0 2024-09-12T17:38:41.702 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:38:41.278+0000 7f930cff1640 0 -- 172.21.15.119:0/723721776 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f930007f950 msgr2=0x7f930006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:41.703 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:38:41.482+0000 7f930cff1640 10 monclient: get_auth_request con 0x7f930007f950 auth_method 0 2024-09-12T17:38:41.703 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:38:41.703 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:38:41.703 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:41.703 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:41.703 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:41.703 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:41.703 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.703 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.703 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.703 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:41.703 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.703 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:41.704 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 zone default found 2024-09-12T17:38:41.704 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 4 Realm: () 2024-09-12T17:38:41.704 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:38:41.704 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:38:41.704 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:41.704 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 zonegroup default 2024-09-12T17:38:41.704 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.704 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.704 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:38:41.498+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.704 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:38:41.502+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.704 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:38:41.502+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.704 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:38:41.502+0000 7f930fcec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.704 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:38:41.502+0000 7f930fcec9c0 20 started sync module instance, tier type = 2024-09-12T17:38:41.704 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:38:41.502+0000 7f930fcec9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:38:41.705 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=0 2024-09-12T17:38:41.705 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=1 2024-09-12T17:38:41.705 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=2 2024-09-12T17:38:41.705 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=3 2024-09-12T17:38:41.705 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=4 2024-09-12T17:38:41.705 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=5 2024-09-12T17:38:41.705 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=6 2024-09-12T17:38:41.705 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 20 add_watcher() i=7 2024-09-12T17:38:41.705 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:38:41.526+0000 7f930fcec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:41.705 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding auth protocol: cephx 2024-09-12T17:38:41.705 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding auth protocol: cephx 2024-09-12T17:38:41.705 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding auth protocol: cephx 2024-09-12T17:38:41.705 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: secure 2024-09-12T17:38:41.706 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: crc 2024-09-12T17:38:41.706 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: secure 2024-09-12T17:38:41.706 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: crc 2024-09-12T17:38:41.706 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: secure 2024-09-12T17:38:41.706 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: crc 2024-09-12T17:38:41.706 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: crc 2024-09-12T17:38:41.706 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: secure 2024-09-12T17:38:41.706 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: crc 2024-09-12T17:38:41.706 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: secure 2024-09-12T17:38:41.706 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: crc 2024-09-12T17:38:41.706 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:38:41.534+0000 7f91c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:41.706 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 AuthRegistry(0x7ffce7a5ae90) adding con mode: secure 2024-09-12T17:38:41.706 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:41.706 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:41.707 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:41.707 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command cache list hook 0x55eec9077c70 2024-09-12T17:38:41.707 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command cache inspect hook 0x55eec9077c70 2024-09-12T17:38:41.707 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command cache erase hook 0x55eec9077c70 2024-09-12T17:38:41.707 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command cache zap hook 0x55eec9077c70 2024-09-12T17:38:41.707 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 note: GC not initialized 2024-09-12T17:38:41.707 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:38:41.534+0000 7f91c27e4640 20 reqs_thread_entry: start 2024-09-12T17:38:41.707 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command sync trace show hook 0x7f92f8001d00 2024-09-12T17:38:41.707 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command sync trace history hook 0x7f92f8001d00 2024-09-12T17:38:41.707 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command sync trace active hook 0x7f92f8001d00 2024-09-12T17:38:41.707 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 5 asok(0x55eec8d9c2b0) register_command sync trace active_short hook 0x7f92f8001d00 2024-09-12T17:38:41.707 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:41.707 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 Filter name: none 2024-09-12T17:38:41.708 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:38:41.534+0000 7f9133fff640 20 reqs_thread_entry: start 2024-09-12T17:38:41.708 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:38:41.708 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.708 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:41.708 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:38:41.708 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:38:41.708 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 : miss 2024-09-12T17:38:41.708 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:38:41.534+0000 7f930fcec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.708 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:38:41.538+0000 7f930fcec9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:38:41.708 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:38:41.538+0000 7f930fcec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:38:41.708 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:38:41.538+0000 7f930fcec9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:38:41.708 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:38:41.538+0000 7f930fcec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:41.708 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:38:41.538+0000 7f930fcec9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:41.709 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:38:41.538+0000 7f930fcec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 2024-09-12T17:38:41.709 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:38:41.546+0000 7f930fcec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:38:41.709 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:38:41.546+0000 7f930fcec9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:38:41.709 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:38:41.546+0000 7f930fcec9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:41.709 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:38:41.546+0000 7f930fcec9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40, ofs0, ns] 2024-09-12T17:38:41.709 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:38:41.546+0000 7f91f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333459 cookie 94484063493776 notifier 8022 bl.length()=1015 2024-09-12T17:38:41.709 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:38:41.546+0000 7f91f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:38:41.709 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:38:41.546+0000 7f91f0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:38:41.709 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:38:41.546+0000 7f91f0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:41.709 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:38:41.550+0000 7f930fcec9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): orig_sources= new_sources= 2024-09-12T17:38:41.709 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:38:41.550+0000 7f930fcec9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): potential sources added=[] removed=[] 2024-09-12T17:38:41.709 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:38:41.550+0000 7f930fcec9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): orig_dests= new_dests= 2024-09-12T17:38:41.709 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:38:41.550+0000 7f930fcec9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): potential dests added=[] removed=[] 2024-09-12T17:38:41.710 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.0 2024-09-12T17:38:41.710 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.0 2024-09-12T17:38:41.710 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.1 2024-09-12T17:38:41.710 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.1 2024-09-12T17:38:41.710 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.2 2024-09-12T17:38:41.710 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.2 2024-09-12T17:38:41.710 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.3 2024-09-12T17:38:41.710 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.3 2024-09-12T17:38:41.710 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.4 2024-09-12T17:38:41.710 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.4 2024-09-12T17:38:41.710 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.5 2024-09-12T17:38:41.710 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.5 2024-09-12T17:38:41.710 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.6 2024-09-12T17:38:41.710 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.6 2024-09-12T17:38:41.711 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.7 2024-09-12T17:38:41.711 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.7 2024-09-12T17:38:41.711 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.8 2024-09-12T17:38:41.711 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.8 2024-09-12T17:38:41.711 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.9 2024-09-12T17:38:41.711 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.9 2024-09-12T17:38:41.711 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.10 2024-09-12T17:38:41.711 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.10 2024-09-12T17:38:41.711 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.11 2024-09-12T17:38:41.711 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1.11 2024-09-12T17:38:41.711 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.0 2024-09-12T17:38:41.711 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1 2024-09-12T17:38:41.711 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:38:41.566+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2 2024-09-12T17:38:41.712 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:38:41.570+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.3 2024-09-12T17:38:41.712 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:38:41.570+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.4 2024-09-12T17:38:41.712 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:38:41.570+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.5 2024-09-12T17:38:41.712 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:38:41.574+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.6 2024-09-12T17:38:41.712 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:38:41.574+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.7 2024-09-12T17:38:41.712 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:38:41.574+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.8 2024-09-12T17:38:41.712 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:38:41.574+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.9 2024-09-12T17:38:41.712 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:38:41.578+0000 7f930fcec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.10 2024-09-12T17:38:41.712 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:38:41.586+0000 7f930fcec9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f930fcec9c0 time 2024-09-12T17:38:41.588761+0000 2024-09-12T17:38:41.712 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:38:41.712 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.712 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:41.712 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f93135c62eb] 2024-09-12T17:38:41.712 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f93135c649f] 2024-09-12T17:38:41.713 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55eec70470c1] 2024-09-12T17:38:41.713 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55eec70584f1] 2024-09-12T17:38:41.713 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55eec7059b44] 2024-09-12T17:38:41.713 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:38:41.713 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f931242cd90] 2024-09-12T17:38:41.713 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:38:41.713 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:38:41.713 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.713 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:38:41.586+0000 7f930fcec9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:38:41.713 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f930fcec9c0 thread_name:radosgw-admin 2024-09-12T17:38:41.713 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.713 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:41.713 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9312445520] 2024-09-12T17:38:41.714 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:38:41.714 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:38:41.714 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:38:41.714 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f93135c6345] 2024-09-12T17:38:41.714 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f93135c649f] 2024-09-12T17:38:41.714 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55eec70470c1] 2024-09-12T17:38:41.714 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55eec70584f1] 2024-09-12T17:38:41.714 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55eec7059b44] 2024-09-12T17:38:41.714 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:38:41.714 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f931242cd90] 2024-09-12T17:38:41.714 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:38:41.714 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:38:41.714 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:38:41.715 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:41.715 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:38:41.715 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:38:41.715 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:38:41.715 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:38:41.715 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:38:41.715 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:38:41.715 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:38:41.715 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:38:41.715 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:38:41.715 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:38:41.715 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:38:41.715 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:38:41.715 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:38:41.716 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:38:41.716 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:38:41.716 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:38:41.716 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:38:41.716 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:38:41.716 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:38:41.716 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:38:41.716 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:38:41.716 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:38:41.716 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:38:41.716 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:38:41.716 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:38:41.716 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:38:41.716 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:38:41.717 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:38:41.717 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:38:41.717 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:38:41.717 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:38:41.717 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:38:41.717 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:38:41.717 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:38:41.717 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:38:41.717 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:38:41.717 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:38:41.717 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:38:41.717 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:38:41.717 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:38:41.717 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:38:41.718 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:38:41.718 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:38:41.718 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:38:41.718 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:38:41.718 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:38:41.718 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:38:41.718 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:38:41.718 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:38:41.718 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:38:41.718 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:38:41.718 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:38:41.718 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:38:41.718 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:38:41.719 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:38:41.719 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:38:41.719 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:38:41.719 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:38:41.719 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:38:41.719 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:38:41.719 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:38:41.719 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:38:41.719 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:38:41.719 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:38:41.719 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:38:41.719 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:38:41.719 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:38:41.719 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:38:41.720 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:38:41.720 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:38:41.720 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:38:41.720 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:38:41.720 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:38:41.720 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:38:41.720 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:38:41.720 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:38:41.720 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:38:41.720 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:38:41.720 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:38:41.720 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:38:41.720 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:38:41.720 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:38:41.721 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:38:41.721 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:38:41.721 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:38:41.721 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:38:41.721 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:38:41.721 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:38:41.721 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:38:41.721 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:38:41.721 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:38:41.721 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:38:41.721 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:38:41.721 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:38:41.721 INFO:tasks.workunit.client.0.smithi119.stderr: 7f9133fff640 / http_manager 2024-09-12T17:38:41.721 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91c27e4640 / http_manager 2024-09-12T17:38:41.722 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91c37e6640 / rgw_dt_lg_renew 2024-09-12T17:38:41.722 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91deffd640 / ms_dispatch 2024-09-12T17:38:41.722 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91f0ff9640 / io_context_pool 2024-09-12T17:38:41.722 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91f2ffd640 / ms_dispatch 2024-09-12T17:38:41.722 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91f9e03640 / ms_dispatch 2024-09-12T17:38:41.722 INFO:tasks.workunit.client.0.smithi119.stderr: 7f91fb606640 / io_context_pool 2024-09-12T17:38:41.722 INFO:tasks.workunit.client.0.smithi119.stderr: 7f930cff1640 / msgr-worker-2 2024-09-12T17:38:41.722 INFO:tasks.workunit.client.0.smithi119.stderr: 7f930d7f2640 / msgr-worker-1 2024-09-12T17:38:41.722 INFO:tasks.workunit.client.0.smithi119.stderr: 7f930dff3640 / msgr-worker-0 2024-09-12T17:38:41.722 INFO:tasks.workunit.client.0.smithi119.stderr: 7f930e7f4640 / io_context_pool 2024-09-12T17:38:41.722 INFO:tasks.workunit.client.0.smithi119.stderr: 7f930fcec9c0 / radosgw-admin 2024-09-12T17:38:41.722 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:38:41.722 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:38:41.722 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:38:41.591172Z_23cdd97d-5dc2-4423-912c-5ab0f1b13b66/log 2024-09-12T17:38:41.723 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:38:41.723 INFO:tasks.workunit.client.0.smithi119.stderr:Aborted 2024-09-12T17:38:41.723 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:38:41.724 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:41.724 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:41.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.674+0000 7f3f6655f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.674+0000 7f3f6655f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.674+0000 7f3f6655f9c0 20 realm 2024-09-12T17:38:41.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.674+0000 7f3f6655f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.724 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.674+0000 7f3f6655f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.674+0000 7f3f6655f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:41.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.674+0000 7f3f6655f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.678+0000 7f3f6655f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:41.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.678+0000 7f3f6655f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.678+0000 7f3f6655f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:41.725 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.678+0000 7f3f6655f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:41.884 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.882+0000 7f3f6655f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:41.884 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.882+0000 7f3f6655f9c0 20 searching for the correct realm 2024-09-12T17:38:41.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:41.886+0000 7f3f64866640 0 -- 172.21.15.119:0/4269493755 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f3f5812bb60 msgr2=0x7f3f580fd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:42.104 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.102+0000 7f3f63864640 0 -- 172.21.15.119:0/4269493755 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f3f5c033040 msgr2=0x7f3f5c054970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:42.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.318+0000 7f3f6655f9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:38:42.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.318+0000 7f3f6655f9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:38:42.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.318+0000 7f3f6655f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:42.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.318+0000 7f3f6655f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:42.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.318+0000 7f3f6655f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:42.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.318+0000 7f3f6655f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:42.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.318+0000 7f3f6655f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.322+0000 7f3f6655f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.322+0000 7f3f6655f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.322+0000 7f3f6655f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:42.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.322+0000 7f3f6655f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.322+0000 7f3f6655f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:42.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.322+0000 7f3f6655f9c0 20 zone default found 2024-09-12T17:38:42.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.322+0000 7f3f6655f9c0 4 Realm: () 2024-09-12T17:38:42.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.322+0000 7f3f6655f9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:38:42.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.322+0000 7f3f6655f9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:38:42.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.322+0000 7f3f6655f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:42.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.322+0000 7f3f6655f9c0 20 zonegroup default 2024-09-12T17:38:42.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.322+0000 7f3f6655f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.322+0000 7f3f6655f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.322+0000 7f3f6655f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.322+0000 7f3f6655f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.322+0000 7f3f6655f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.326+0000 7f3f6655f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.326+0000 7f3f6655f9c0 20 started sync module instance, tier type = 2024-09-12T17:38:42.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.326+0000 7f3f6655f9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:38:42.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.350+0000 7f3f6655f9c0 20 add_watcher() i=0 2024-09-12T17:38:42.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.350+0000 7f3f6655f9c0 20 add_watcher() i=1 2024-09-12T17:38:42.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.350+0000 7f3f6655f9c0 20 add_watcher() i=2 2024-09-12T17:38:42.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.350+0000 7f3f6655f9c0 20 add_watcher() i=3 2024-09-12T17:38:42.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.350+0000 7f3f6655f9c0 20 add_watcher() i=4 2024-09-12T17:38:42.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.350+0000 7f3f6655f9c0 20 add_watcher() i=5 2024-09-12T17:38:42.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.350+0000 7f3f6655f9c0 20 add_watcher() i=6 2024-09-12T17:38:42.353 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.350+0000 7f3f6655f9c0 20 add_watcher() i=7 2024-09-12T17:38:42.353 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.350+0000 7f3f6655f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:42.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.354+0000 7f3e1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:42.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.358+0000 7f3f6655f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:42.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.358+0000 7f3f6655f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:42.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.358+0000 7f3f6655f9c0 5 note: GC not initialized 2024-09-12T17:38:42.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.358+0000 7f3e19fdb640 20 reqs_thread_entry: start 2024-09-12T17:38:42.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.358+0000 7f3f6655f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:42.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.358+0000 7f3f6655f9c0 20 Filter name: none 2024-09-12T17:38:42.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.358+0000 7f3d8b7fe640 20 reqs_thread_entry: start 2024-09-12T17:38:42.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.358+0000 7f3f6655f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.358+0000 7f3f6655f9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:42.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.358+0000 7f3f6655f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.358+0000 7f3f6655f9c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:38:42.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.358+0000 7f3f6655f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:42.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.362+0000 7f3f6655f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.362+0000 7f3f6655f9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:42.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.362+0000 7f3f6655f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.362+0000 7f3f6655f9c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:38:42.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.362+0000 7f3f6655f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:42.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.366+0000 7f3e1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:42.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.370+0000 7f3f6655f9c0 20 remove_watcher() i=0 2024-09-12T17:38:42.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.370+0000 7f3f6655f9c0 2 removed watcher, disabling cache 2024-09-12T17:38:42.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.374+0000 7f3f6655f9c0 20 remove_watcher() i=1 2024-09-12T17:38:42.376 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.374+0000 7f3f6655f9c0 20 remove_watcher() i=2 2024-09-12T17:38:42.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.378+0000 7f3f6655f9c0 20 remove_watcher() i=3 2024-09-12T17:38:42.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.378+0000 7f3f6655f9c0 20 remove_watcher() i=4 2024-09-12T17:38:42.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.382+0000 7f3f6655f9c0 20 remove_watcher() i=5 2024-09-12T17:38:42.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.382+0000 7f3f6655f9c0 20 remove_watcher() i=6 2024-09-12T17:38:42.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.382+0000 7f3f6655f9c0 20 remove_watcher() i=7 2024-09-12T17:38:42.401 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:42.401 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:38:42.401 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-change-reshard-state id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:38:42.401 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:38:42.548 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:38:42.584 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:42.584 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:42.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.630+0000 7fc46c3b29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.630+0000 7fc46c3b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.630+0000 7fc46c3b29c0 20 realm 2024-09-12T17:38:42.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.630+0000 7fc46c3b29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.630+0000 7fc46c3b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.630+0000 7fc46c3b29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:42.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.630+0000 7fc46c3b29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.630+0000 7fc46c3b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.630+0000 7fc46c3b29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.630+0000 7fc46c3b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:42.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.630+0000 7fc46c3b29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.634+0000 7fc46c3b29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:42.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.634+0000 7fc46c3b29c0 20 searching for the correct realm 2024-09-12T17:38:42.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.638+0000 7fc46a6b9640 0 -- 172.21.15.119:0/829091283 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x562c2146cde0 msgr2=0x562c2146f1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:42.646 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.642+0000 7fc4696b7640 0 -- 172.21.15.119:0/829091283 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fc4640e0410 msgr2=0x7fc4640e0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:42.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.858+0000 7fc46c3b29c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:38:42.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.858+0000 7fc46c3b29c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:38:42.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.858+0000 7fc46c3b29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:42.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.858+0000 7fc46c3b29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:42.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.858+0000 7fc46c3b29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:42.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.858+0000 7fc46c3b29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:42.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.858+0000 7fc46c3b29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.862+0000 7fc46c3b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.862 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.862+0000 7fc46c3b29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.862+0000 7fc46c3b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:42.863 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.862+0000 7fc46c3b29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.862+0000 7fc46c3b29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:42.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.862+0000 7fc46c3b29c0 20 zone default found 2024-09-12T17:38:42.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.862+0000 7fc46c3b29c0 4 Realm: () 2024-09-12T17:38:42.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.862+0000 7fc46c3b29c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:38:42.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.862+0000 7fc46c3b29c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:38:42.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.862+0000 7fc46c3b29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:42.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.862+0000 7fc46c3b29c0 20 zonegroup default 2024-09-12T17:38:42.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.862+0000 7fc46c3b29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.862+0000 7fc46c3b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.862+0000 7fc46c3b29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.862+0000 7fc46c3b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.862+0000 7fc46c3b29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.866+0000 7fc46c3b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.866+0000 7fc46c3b29c0 20 started sync module instance, tier type = 2024-09-12T17:38:42.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.866+0000 7fc46c3b29c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:38:42.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.886+0000 7fc46c3b29c0 20 add_watcher() i=0 2024-09-12T17:38:42.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.886+0000 7fc46c3b29c0 20 add_watcher() i=1 2024-09-12T17:38:42.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.886+0000 7fc46c3b29c0 20 add_watcher() i=2 2024-09-12T17:38:42.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.886+0000 7fc46c3b29c0 20 add_watcher() i=3 2024-09-12T17:38:42.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.886+0000 7fc46c3b29c0 20 add_watcher() i=4 2024-09-12T17:38:42.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.886+0000 7fc46c3b29c0 20 add_watcher() i=5 2024-09-12T17:38:42.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.886+0000 7fc46c3b29c0 20 add_watcher() i=6 2024-09-12T17:38:42.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.890+0000 7fc46c3b29c0 20 add_watcher() i=7 2024-09-12T17:38:42.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.890+0000 7fc46c3b29c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:42.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.894+0000 7fc31b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:42.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.894+0000 7fc46c3b29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:42.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.894+0000 7fc46c3b29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:42.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.894+0000 7fc46c3b29c0 5 note: GC not initialized 2024-09-12T17:38:42.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.894+0000 7fc31a7fc640 20 reqs_thread_entry: start 2024-09-12T17:38:42.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.894+0000 7fc46c3b29c0 20 init_complete bucket index max shards: 11 2024-09-12T17:38:42.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.894+0000 7fc46c3b29c0 20 Filter name: none 2024-09-12T17:38:42.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.894+0000 7fc28bfff640 20 reqs_thread_entry: start 2024-09-12T17:38:42.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.894+0000 7fc46c3b29c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:38:42.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.894+0000 7fc46c3b29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.894+0000 7fc46c3b29c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:38:42.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.894+0000 7fc46c3b29c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:38:42.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.894+0000 7fc46c3b29c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:38:42.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.894+0000 7fc46c3b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 : miss 2024-09-12T17:38:42.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.894+0000 7fc46c3b29c0 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.898+0000 7fc46c3b29c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:38:42.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.898+0000 7fc46c3b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:38:42.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.898+0000 7fc46c3b29c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:38:42.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.898+0000 7fc46c3b29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:42.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.898+0000 7fc46c3b29c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:38:42.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.898+0000 7fc46c3b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 2024-09-12T17:38:42.901 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.898+0000 7fc46c3b29c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to be held by another RGW process; skipping for now 2024-09-12T17:38:42.903 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.902+0000 7fc31b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:42.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.906+0000 7fc46c3b29c0 20 remove_watcher() i=0 2024-09-12T17:38:42.908 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.906+0000 7fc46c3b29c0 2 removed watcher, disabling cache 2024-09-12T17:38:42.910 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.910+0000 7fc46c3b29c0 20 remove_watcher() i=1 2024-09-12T17:38:42.912 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.910+0000 7fc46c3b29c0 20 remove_watcher() i=2 2024-09-12T17:38:42.914 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.914+0000 7fc46c3b29c0 20 remove_watcher() i=3 2024-09-12T17:38:42.916 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.914+0000 7fc46c3b29c0 20 remove_watcher() i=4 2024-09-12T17:38:42.918 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.918+0000 7fc46c3b29c0 20 remove_watcher() i=5 2024-09-12T17:38:42.920 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.918+0000 7fc46c3b29c0 20 remove_watcher() i=6 2024-09-12T17:38:42.922 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:38:42.918+0000 7fc46c3b29c0 20 remove_watcher() i=7 2024-09-12T17:38:42.939 INFO:tasks.workunit.client.0.smithi119.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:39:12.971 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:39:13.009 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:13.009 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:13.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.053+0000 7fb5f2f999c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.053+0000 7fb5f2f999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:13.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.053+0000 7fb5f2f999c0 20 realm 2024-09-12T17:39:13.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.053+0000 7fb5f2f999c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.053+0000 7fb5f2f999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:13.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.053+0000 7fb5f2f999c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:13.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.053+0000 7fb5f2f999c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.053+0000 7fb5f2f999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:13.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.053+0000 7fb5f2f999c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.057+0000 7fb5f2f999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:13.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.057+0000 7fb5f2f999c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.057+0000 7fb5f2f999c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:13.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.057+0000 7fb5f2f999c0 20 searching for the correct realm 2024-09-12T17:39:13.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.061+0000 7fb5f029e640 0 -- 172.21.15.119:0/3791397387 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fb5e0118040 msgr2=0x7fb5e0007730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:13.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.069+0000 7fb5f029e640 0 -- 172.21.15.119:0/3791397387 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fb5e8030020 msgr2=0x7fb5e80279f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:13.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.285+0000 7fb5f2f999c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:13.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.285+0000 7fb5f2f999c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:13.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.285+0000 7fb5f2f999c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:13.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.285+0000 7fb5f2f999c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:13.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.285+0000 7fb5f2f999c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:13.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.285+0000 7fb5f2f999c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:13.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.289+0000 7fb5f2f999c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.289+0000 7fb5f2f999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:13.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.289+0000 7fb5f2f999c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.289+0000 7fb5f2f999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:13.292 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.289+0000 7fb5f2f999c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.289+0000 7fb5f2f999c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:13.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.289+0000 7fb5f2f999c0 20 zone default found 2024-09-12T17:39:13.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.289+0000 7fb5f2f999c0 4 Realm: () 2024-09-12T17:39:13.293 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.289+0000 7fb5f2f999c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:13.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.289+0000 7fb5f2f999c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:13.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.289+0000 7fb5f2f999c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:13.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.289+0000 7fb5f2f999c0 20 zonegroup default 2024-09-12T17:39:13.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.289+0000 7fb5f2f999c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.289+0000 7fb5f2f999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:13.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.289+0000 7fb5f2f999c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.293+0000 7fb5f2f999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:13.295 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.293+0000 7fb5f2f999c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.293+0000 7fb5f2f999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:13.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.293+0000 7fb5f2f999c0 20 started sync module instance, tier type = 2024-09-12T17:39:13.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.293+0000 7fb5f2f999c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:13.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.317+0000 7fb5f2f999c0 20 add_watcher() i=0 2024-09-12T17:39:13.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.317+0000 7fb5f2f999c0 20 add_watcher() i=1 2024-09-12T17:39:13.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.317+0000 7fb5f2f999c0 20 add_watcher() i=2 2024-09-12T17:39:13.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.317+0000 7fb5f2f999c0 20 add_watcher() i=3 2024-09-12T17:39:13.319 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.317+0000 7fb5f2f999c0 20 add_watcher() i=4 2024-09-12T17:39:13.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.317+0000 7fb5f2f999c0 20 add_watcher() i=5 2024-09-12T17:39:13.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.317+0000 7fb5f2f999c0 20 add_watcher() i=6 2024-09-12T17:39:13.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.317+0000 7fb5f2f999c0 20 add_watcher() i=7 2024-09-12T17:39:13.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.317+0000 7fb5f2f999c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:13.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.321+0000 7fb4a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:13.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:13.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:13.327 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 5 note: GC not initialized 2024-09-12T17:39:13.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb4a5fe3640 20 reqs_thread_entry: start 2024-09-12T17:39:13.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:13.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 20 Filter name: none 2024-09-12T17:39:13.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb4177fe640 20 reqs_thread_entry: start 2024-09-12T17:39:13.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:39:13.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:39:13.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:39:13.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:39:13.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 : miss 2024-09-12T17:39:13.329 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:39:13.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:39:13.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:39:13.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:13.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:39:13.330 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.325+0000 7fb5f2f999c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 2024-09-12T17:39:13.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.329+0000 7fb5f2f999c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:39:13.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.345+0000 7fb5f2f999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:39:13.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.345+0000 7fb5f2f999c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:39:13.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.345+0000 7fb5f2f999c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:39:13.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.345+0000 7fb5f2f999c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40, ofs0, ns] 2024-09-12T17:39:13.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.345+0000 7fb4c77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333460 cookie 94195184766528 notifier 7610 bl.length()=1015 2024-09-12T17:39:13.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.345+0000 7fb4c77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:39:13.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.345+0000 7fb4c77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:39:13.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.345+0000 7fb4c77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:39:13.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.349+0000 7fb5f2f999c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): orig_sources= new_sources= 2024-09-12T17:39:13.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.349+0000 7fb5f2f999c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): potential sources added=[] removed=[] 2024-09-12T17:39:13.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.349+0000 7fb5f2f999c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): orig_dests= new_dests= 2024-09-12T17:39:13.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.349+0000 7fb5f2f999c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): potential dests added=[] removed=[] 2024-09-12T17:39:13.363 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.0 2024-09-12T17:39:13.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.0 2024-09-12T17:39:13.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.1 2024-09-12T17:39:13.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.1 2024-09-12T17:39:13.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.2 2024-09-12T17:39:13.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.2 2024-09-12T17:39:13.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.3 2024-09-12T17:39:13.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.3 2024-09-12T17:39:13.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.4 2024-09-12T17:39:13.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.4 2024-09-12T17:39:13.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.5 2024-09-12T17:39:13.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.5 2024-09-12T17:39:13.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.6 2024-09-12T17:39:13.364 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.6 2024-09-12T17:39:13.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.7 2024-09-12T17:39:13.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.7 2024-09-12T17:39:13.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.8 2024-09-12T17:39:13.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.8 2024-09-12T17:39:13.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.9 2024-09-12T17:39:13.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.9 2024-09-12T17:39:13.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.10 2024-09-12T17:39:13.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.10 2024-09-12T17:39:13.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.11 2024-09-12T17:39:13.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2.11 2024-09-12T17:39:13.365 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.0 2024-09-12T17:39:13.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1 2024-09-12T17:39:13.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.361+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2 2024-09-12T17:39:13.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.365+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.3 2024-09-12T17:39:13.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.365+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.4 2024-09-12T17:39:13.369 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.365+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.5 2024-09-12T17:39:13.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.369+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.6 2024-09-12T17:39:13.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.369+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.7 2024-09-12T17:39:13.372 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.369+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.8 2024-09-12T17:39:13.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.369+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.9 2024-09-12T17:39:13.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.373+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.10 2024-09-12T17:39:13.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.377+0000 7fb5f2f999c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 : hit (requested=0x17, cached=0x17) 2024-09-12T17:39:13.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.377+0000 7fb5f2f999c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 2024-09-12T17:39:13.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.381+0000 7fb5f2f999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:39:13.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.381+0000 7fb5f2f999c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:39:13.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.381+0000 7fb5f2f999c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:39:13.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.381+0000 7fb5f2f999c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40, ofs0, ns] 2024-09-12T17:39:13.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.381+0000 7fb4c77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333461 cookie 94195184766528 notifier 7610 bl.length()=1015 2024-09-12T17:39:13.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.381+0000 7fb4c77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:39:13.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.381+0000 7fb4c77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:39:13.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.381+0000 7fb4c77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:39:13.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.385+0000 7fb5f2f999c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): orig_sources= new_sources= 2024-09-12T17:39:13.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.385+0000 7fb5f2f999c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): potential sources added=[] removed=[] 2024-09-12T17:39:13.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.385+0000 7fb5f2f999c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): orig_dests= new_dests= 2024-09-12T17:39:13.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.385+0000 7fb5f2f999c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): potential dests added=[] removed=[] 2024-09-12T17:39:13.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.389+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.0 2024-09-12T17:39:13.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.393+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.1 2024-09-12T17:39:13.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.393+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.2 2024-09-12T17:39:13.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.393+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.3 2024-09-12T17:39:13.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.393+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.4 2024-09-12T17:39:13.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.393+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.5 2024-09-12T17:39:13.399 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.397+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.6 2024-09-12T17:39:13.399 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.397+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.7 2024-09-12T17:39:13.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.397+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.8 2024-09-12T17:39:13.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.397+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.9 2024-09-12T17:39:13.402 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.397+0000 7fb5f2f999c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40.10 2024-09-12T17:39:13.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.401+0000 7fb5f2f999c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 : hit (requested=0x17, cached=0x17) 2024-09-12T17:39:13.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.401+0000 7fb5f2f999c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 2024-09-12T17:39:13.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.405+0000 7fb5f2f999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:39:13.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.405+0000 7fb5f2f999c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:39:13.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.405+0000 7fb5f2f999c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:39:13.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.405+0000 7fb5f2f999c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40, ofs0, ns] 2024-09-12T17:39:13.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.405+0000 7fb4c77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333462 cookie 94195184766528 notifier 7610 bl.length()=983 2024-09-12T17:39:13.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.405+0000 7fb4c77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 info.flags=0x17 2024-09-12T17:39:13.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.405+0000 7fb4c77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 to cache LRU end 2024-09-12T17:39:13.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.405+0000 7fb4c77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:39:13.410 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.409+0000 7fb5f2f999c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): orig_sources= new_sources= 2024-09-12T17:39:13.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.409+0000 7fb5f2f999c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): potential sources added=[] removed=[] 2024-09-12T17:39:13.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.409+0000 7fb5f2f999c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): orig_dests= new_dests= 2024-09-12T17:39:13.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.409+0000 7fb5f2f999c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40]): potential dests added=[] removed=[] 2024-09-12T17:39:13.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.413+0000 7fb5f2f999c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T17:39:13.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.417+0000 7fb4a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:13.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.421+0000 7fb5f2f999c0 20 remove_watcher() i=0 2024-09-12T17:39:13.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.421+0000 7fb5f2f999c0 2 removed watcher, disabling cache 2024-09-12T17:39:13.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.425+0000 7fb5f2f999c0 20 remove_watcher() i=1 2024-09-12T17:39:13.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.425+0000 7fb5f2f999c0 20 remove_watcher() i=2 2024-09-12T17:39:13.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.429+0000 7fb5f2f999c0 20 remove_watcher() i=3 2024-09-12T17:39:13.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.429+0000 7fb5f2f999c0 20 remove_watcher() i=4 2024-09-12T17:39:13.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.433+0000 7fb5f2f999c0 20 remove_watcher() i=5 2024-09-12T17:39:13.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.433+0000 7fb5f2f999c0 20 remove_watcher() i=6 2024-09-12T17:39:13.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.433+0000 7fb5f2f999c0 20 remove_watcher() i=7 2024-09-12T17:39:13.454 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:39:13.484 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:13.484 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:13.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.525+0000 7f40652009c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.529+0000 7f40652009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:13.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.529+0000 7f40652009c0 20 realm 2024-09-12T17:39:13.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.529+0000 7f40652009c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.529+0000 7f40652009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:13.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.529+0000 7f40652009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:13.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.529+0000 7f40652009c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.529+0000 7f40652009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:13.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.529+0000 7f40652009c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.529+0000 7f40652009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:13.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.529+0000 7f40652009c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.533+0000 7f40652009c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:13.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.533+0000 7f40652009c0 20 searching for the correct realm 2024-09-12T17:39:13.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.533+0000 7f4063507640 0 -- 172.21.15.119:0/2880315962 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f404c03e060 msgr2=0x7f404c0633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:13.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.753+0000 7f4062505640 0 -- 172.21.15.119:0/2880315962 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f405410a4b0 msgr2=0x7f40540cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:13.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.969+0000 7f40652009c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:13.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.969+0000 7f40652009c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:13.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.969+0000 7f40652009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:13.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.969+0000 7f40652009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:13.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.969+0000 7f40652009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:13.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.969+0000 7f40652009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:13.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.969+0000 7f40652009c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.969+0000 7f40652009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:13.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.969+0000 7f40652009c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.973+0000 7f40652009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:13.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.973+0000 7f40652009c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.973+0000 7f40652009c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:13.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.973+0000 7f40652009c0 20 zone default found 2024-09-12T17:39:13.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.973+0000 7f40652009c0 4 Realm: () 2024-09-12T17:39:13.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.973+0000 7f40652009c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:13.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.973+0000 7f40652009c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:13.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.973+0000 7f40652009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:13.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.973+0000 7f40652009c0 20 zonegroup default 2024-09-12T17:39:13.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.973+0000 7f40652009c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.973+0000 7f40652009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:13.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.973+0000 7f40652009c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.973+0000 7f40652009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:13.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.973+0000 7f40652009c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:13.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.977+0000 7f40652009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:13.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.977+0000 7f40652009c0 20 started sync module instance, tier type = 2024-09-12T17:39:13.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:13.977+0000 7f40652009c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:14.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.001+0000 7f40652009c0 20 add_watcher() i=0 2024-09-12T17:39:14.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.001+0000 7f40652009c0 20 add_watcher() i=1 2024-09-12T17:39:14.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.001+0000 7f40652009c0 20 add_watcher() i=2 2024-09-12T17:39:14.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.001+0000 7f40652009c0 20 add_watcher() i=3 2024-09-12T17:39:14.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.001+0000 7f40652009c0 20 add_watcher() i=4 2024-09-12T17:39:14.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.001+0000 7f40652009c0 20 add_watcher() i=5 2024-09-12T17:39:14.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.001+0000 7f40652009c0 20 add_watcher() i=6 2024-09-12T17:39:14.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.001+0000 7f40652009c0 20 add_watcher() i=7 2024-09-12T17:39:14.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.001+0000 7f40652009c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:14.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.005+0000 7f3f197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:14.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.005+0000 7f40652009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:14.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.005+0000 7f40652009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:14.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.005+0000 7f40652009c0 5 note: GC not initialized 2024-09-12T17:39:14.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.009+0000 7f3e93fff640 20 reqs_thread_entry: start 2024-09-12T17:39:14.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.009+0000 7f40652009c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:14.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.009+0000 7f40652009c0 20 Filter name: none 2024-09-12T17:39:14.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.009+0000 7f3e91ffb640 20 reqs_thread_entry: start 2024-09-12T17:39:14.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.009+0000 7f40652009c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:14.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.009+0000 7f40652009c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:39:14.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.009+0000 7f40652009c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:14.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.009+0000 7f40652009c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:39:14.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.009+0000 7f40652009c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:14.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.009+0000 7f40652009c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:14.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.009+0000 7f40652009c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:39:14.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.009+0000 7f40652009c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:14.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.013+0000 7f40652009c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:39:14.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.013+0000 7f40652009c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:14.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.013+0000 7f3f197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:14.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.021+0000 7f40652009c0 20 remove_watcher() i=0 2024-09-12T17:39:14.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.021+0000 7f40652009c0 2 removed watcher, disabling cache 2024-09-12T17:39:14.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.021+0000 7f40652009c0 20 remove_watcher() i=1 2024-09-12T17:39:14.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.025+0000 7f40652009c0 20 remove_watcher() i=2 2024-09-12T17:39:14.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.025+0000 7f40652009c0 20 remove_watcher() i=3 2024-09-12T17:39:14.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.029+0000 7f40652009c0 20 remove_watcher() i=4 2024-09-12T17:39:14.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.029+0000 7f40652009c0 20 remove_watcher() i=5 2024-09-12T17:39:14.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.033+0000 7f40652009c0 20 remove_watcher() i=6 2024-09-12T17:39:14.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:14.033+0000 7f40652009c0 20 remove_watcher() i=7 2024-09-12T17:39:14.051 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:14.051 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:39:14.051 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: abort-at-change-reshard-state id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:39:14.051 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:15.005 INFO:tasks.workunit.client.0.smithi119.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T17:39:15.006 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:39:15.039 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:15.039 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:15.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.085+0000 7f2563e239c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.085+0000 7f2563e239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.085+0000 7f2563e239c0 20 realm 2024-09-12T17:39:15.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.085+0000 7f2563e239c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.085+0000 7f2563e239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.085+0000 7f2563e239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:15.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.085+0000 7f2563e239c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.085+0000 7f2563e239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.085+0000 7f2563e239c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.089+0000 7f2563e239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:15.091 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.089+0000 7f2563e239c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.089+0000 7f2563e239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:15.093 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.089+0000 7f2563e239c0 20 searching for the correct realm 2024-09-12T17:39:15.096 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.093+0000 7f256212a640 0 -- 172.21.15.119:0/1059726829 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f2558047030 msgr2=0x7f25580903d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:15.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.101+0000 7f2561128640 0 -- 172.21.15.119:0/1059726829 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f255c03d440 msgr2=0x7f255c03d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:15.321 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.317+0000 7f2563e239c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:15.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.317+0000 7f2563e239c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:15.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.317+0000 7f2563e239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:15.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.317+0000 7f2563e239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:15.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.317+0000 7f2563e239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:15.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.317+0000 7f2563e239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:15.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.317+0000 7f2563e239c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.317+0000 7f2563e239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.317+0000 7f2563e239c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:15.323 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:15.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 20 zone default found 2024-09-12T17:39:15.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 4 Realm: () 2024-09-12T17:39:15.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:15.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:15.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:15.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 20 zonegroup default 2024-09-12T17:39:15.324 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.325 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 20 started sync module instance, tier type = 2024-09-12T17:39:15.326 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.321+0000 7f2563e239c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:15.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.345+0000 7f2563e239c0 20 add_watcher() i=0 2024-09-12T17:39:15.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.345+0000 7f2563e239c0 20 add_watcher() i=1 2024-09-12T17:39:15.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.345+0000 7f2563e239c0 20 add_watcher() i=2 2024-09-12T17:39:15.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.345+0000 7f2563e239c0 20 add_watcher() i=3 2024-09-12T17:39:15.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.345+0000 7f2563e239c0 20 add_watcher() i=4 2024-09-12T17:39:15.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.345+0000 7f2563e239c0 20 add_watcher() i=5 2024-09-12T17:39:15.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.345+0000 7f2563e239c0 20 add_watcher() i=6 2024-09-12T17:39:15.353 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.349+0000 7f2563e239c0 20 add_watcher() i=7 2024-09-12T17:39:15.353 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.349+0000 7f2563e239c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:15.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.353+0000 7f24137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:15.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.353+0000 7f2563e239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:15.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.353+0000 7f2563e239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:15.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.353+0000 7f2563e239c0 5 note: GC not initialized 2024-09-12T17:39:15.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.357+0000 7f24127fc640 20 reqs_thread_entry: start 2024-09-12T17:39:15.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.357+0000 7f2563e239c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:15.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.357+0000 7f2563e239c0 20 Filter name: none 2024-09-12T17:39:15.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.357+0000 7f2383fff640 20 reqs_thread_entry: start 2024-09-12T17:39:15.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.357+0000 7f2563e239c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.357+0000 7f2563e239c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:15.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.357+0000 7f2563e239c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.357+0000 7f2563e239c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:15.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.357+0000 7f2563e239c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:15.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.357+0000 7f2563e239c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.357+0000 7f2563e239c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:15.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.357+0000 7f2563e239c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.357+0000 7f2563e239c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:15.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.357+0000 7f2563e239c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:15.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.361+0000 7f24137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:15.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.369+0000 7f2563e239c0 20 remove_watcher() i=0 2024-09-12T17:39:15.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.369+0000 7f2563e239c0 2 removed watcher, disabling cache 2024-09-12T17:39:15.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.369+0000 7f2563e239c0 20 remove_watcher() i=1 2024-09-12T17:39:15.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.373+0000 7f2563e239c0 20 remove_watcher() i=2 2024-09-12T17:39:15.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.373+0000 7f2563e239c0 20 remove_watcher() i=3 2024-09-12T17:39:15.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.377+0000 7f2563e239c0 20 remove_watcher() i=4 2024-09-12T17:39:15.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.381+0000 7f2563e239c0 20 remove_watcher() i=5 2024-09-12T17:39:15.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.381+0000 7f2563e239c0 20 remove_watcher() i=6 2024-09-12T17:39:15.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.385+0000 7f2563e239c0 20 remove_watcher() i=7 2024-09-12T17:39:15.402 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:15.402 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:39:15.402 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: a-bucket id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T17:39:15.402 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:15.402 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:39:15.432 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:15.432 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:15.477 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.473+0000 7f872d6f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.478 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.473+0000 7f872d6f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.478 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.473+0000 7f872d6f99c0 20 realm 2024-09-12T17:39:15.479 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.473+0000 7f872d6f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.479 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.477+0000 7f872d6f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.479 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.477+0000 7f872d6f99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:15.479 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.477+0000 7f872d6f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.479 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.477+0000 7f872d6f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.479 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.477+0000 7f872d6f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.477+0000 7f872d6f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:15.480 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.477+0000 7f872d6f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.482 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.477+0000 7f872d6f99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:15.482 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.477+0000 7f872d6f99c0 20 searching for the correct realm 2024-09-12T17:39:15.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.481+0000 7f872a9fe640 0 -- 172.21.15.119:0/2093841741 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f871c025020 msgr2=0x7f871c05ce40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:15.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.489+0000 7f872a9fe640 0 -- 172.21.15.119:0/2093841741 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f87240f1b10 msgr2=0x7f87240ff980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:15.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.705+0000 7f872d6f99c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:15.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.705+0000 7f872d6f99c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:15.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.705+0000 7f872d6f99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:15.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.705+0000 7f872d6f99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:15.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.705+0000 7f872d6f99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:15.710 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.705+0000 7f872d6f99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:15.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.705+0000 7f872d6f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.709+0000 7f872d6f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.709+0000 7f872d6f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.711 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.709+0000 7f872d6f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:15.712 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.709+0000 7f872d6f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.709+0000 7f872d6f99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:15.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.709+0000 7f872d6f99c0 20 zone default found 2024-09-12T17:39:15.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.709+0000 7f872d6f99c0 4 Realm: () 2024-09-12T17:39:15.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.709+0000 7f872d6f99c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:15.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.709+0000 7f872d6f99c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:15.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.709+0000 7f872d6f99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:15.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.709+0000 7f872d6f99c0 20 zonegroup default 2024-09-12T17:39:15.713 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.709+0000 7f872d6f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.709+0000 7f872d6f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.709+0000 7f872d6f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.713+0000 7f872d6f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.714 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.713+0000 7f872d6f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.713+0000 7f872d6f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.713+0000 7f872d6f99c0 20 started sync module instance, tier type = 2024-09-12T17:39:15.715 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.713+0000 7f872d6f99c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:15.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.741+0000 7f872d6f99c0 20 add_watcher() i=0 2024-09-12T17:39:15.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.741+0000 7f872d6f99c0 20 add_watcher() i=1 2024-09-12T17:39:15.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.741+0000 7f872d6f99c0 20 add_watcher() i=2 2024-09-12T17:39:15.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.741+0000 7f872d6f99c0 20 add_watcher() i=3 2024-09-12T17:39:15.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.741+0000 7f872d6f99c0 20 add_watcher() i=4 2024-09-12T17:39:15.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.741+0000 7f872d6f99c0 20 add_watcher() i=5 2024-09-12T17:39:15.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.741+0000 7f872d6f99c0 20 add_watcher() i=6 2024-09-12T17:39:15.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.745+0000 7f872d6f99c0 20 add_watcher() i=7 2024-09-12T17:39:15.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.745+0000 7f872d6f99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:15.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.749+0000 7f85e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:15.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.753+0000 7f872d6f99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:15.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.753+0000 7f872d6f99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:15.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.753+0000 7f872d6f99c0 5 note: GC not initialized 2024-09-12T17:39:15.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.753+0000 7f85e0fe1640 20 reqs_thread_entry: start 2024-09-12T17:39:15.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.753+0000 7f872d6f99c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:15.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.753+0000 7f872d6f99c0 20 Filter name: none 2024-09-12T17:39:15.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.753+0000 7f855a7fc640 20 reqs_thread_entry: start 2024-09-12T17:39:15.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.753+0000 7f872d6f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.753+0000 7f872d6f99c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:15.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.753+0000 7f872d6f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.753+0000 7f872d6f99c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:15.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.753+0000 7f872d6f99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:15.758 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.753+0000 7f872d6f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.759 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.757+0000 7f872d6f99c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:15.759 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.757+0000 7f872d6f99c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.760 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.757+0000 7f872d6f99c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:15.760 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.757+0000 7f872d6f99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:15.763 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.761+0000 7f85e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:15.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.765+0000 7f872d6f99c0 20 remove_watcher() i=0 2024-09-12T17:39:15.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.765+0000 7f872d6f99c0 2 removed watcher, disabling cache 2024-09-12T17:39:15.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.765+0000 7f872d6f99c0 20 remove_watcher() i=1 2024-09-12T17:39:15.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.769+0000 7f872d6f99c0 20 remove_watcher() i=2 2024-09-12T17:39:15.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.769+0000 7f872d6f99c0 20 remove_watcher() i=3 2024-09-12T17:39:15.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.773+0000 7f872d6f99c0 20 remove_watcher() i=4 2024-09-12T17:39:15.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.773+0000 7f872d6f99c0 20 remove_watcher() i=5 2024-09-12T17:39:15.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.773+0000 7f872d6f99c0 20 remove_watcher() i=6 2024-09-12T17:39:15.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.777+0000 7f872d6f99c0 20 remove_watcher() i=7 2024-09-12T17:39:15.794 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T17:39:15.827 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:15.827 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:15.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.869+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 realm 2024-09-12T17:39:15.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.873+0000 7fc0878ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:15.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.875 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:15.876 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:15.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:15.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.877+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:15.878 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.877+0000 7fc0878ec9c0 20 searching for the correct realm 2024-09-12T17:39:15.881 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.877+0000 7fc085bf3640 0 -- 172.21.15.119:0/3301801206 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fc07c129040 msgr2=0x7fc07c0fe900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:15.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:15.885+0000 7fc084bf1640 0 -- 172.21.15.119:0/3301801206 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fc08009b050 msgr2=0x7fc08008a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:16.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:16.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:16.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:16.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:16.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:16.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:16.106 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:16.107 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:16.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 zone default found 2024-09-12T17:39:16.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.105+0000 7fc0878ec9c0 4 Realm: () 2024-09-12T17:39:16.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.105+0000 7fc0878ec9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:16.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.105+0000 7fc0878ec9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:16.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.105+0000 7fc0878ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:16.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 zonegroup default 2024-09-12T17:39:16.109 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.110 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.109+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.109+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.109+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.109+0000 7fc0878ec9c0 20 started sync module instance, tier type = 2024-09-12T17:39:16.111 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.109+0000 7fc0878ec9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:16.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=0 2024-09-12T17:39:16.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=1 2024-09-12T17:39:16.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=2 2024-09-12T17:39:16.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=3 2024-09-12T17:39:16.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=4 2024-09-12T17:39:16.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=5 2024-09-12T17:39:16.135 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=6 2024-09-12T17:39:16.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=7 2024-09-12T17:39:16.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.133+0000 7fc0878ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:16.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.137+0000 7fbf3bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:16.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.137+0000 7fc0878ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:16.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.137+0000 7fc0878ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:16.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 note: GC not initialized 2024-09-12T17:39:16.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.137+0000 7fbf3afe5640 20 reqs_thread_entry: start 2024-09-12T17:39:16.142 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:16.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 Filter name: none 2024-09-12T17:39:16.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.141+0000 7fbf38fe1640 20 reqs_thread_entry: start 2024-09-12T17:39:16.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:39:16.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:16.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:39:16.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:39:16.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:39:16.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:16.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:16.145 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:16.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:16.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:16.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:39:16.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.153+0000 7fc0878ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:16.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.153+0000 7fc0878ec9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:16.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.153+0000 7fc0878ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:16.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.153+0000 7fc0878ec9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:39:16.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.153+0000 7fbf57fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333535 cookie 94282847897184 notifier 8148 bl.length()=911 2024-09-12T17:39:16.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.153+0000 7fbf57fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:16.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.153+0000 7fbf57fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:16.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.153+0000 7fbf57fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:16.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.157+0000 7fc0878ec9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:39:16.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.157+0000 7fc0878ec9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:39:16.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.157+0000 7fc0878ec9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:39:16.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.157+0000 7fc0878ec9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:39:16.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.169+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.0 2024-09-12T17:39:16.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.169+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.0 2024-09-12T17:39:16.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.169+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.1 2024-09-12T17:39:16.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.169+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.1 2024-09-12T17:39:16.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.169+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.2 2024-09-12T17:39:16.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.169+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.2 2024-09-12T17:39:16.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.169+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.3 2024-09-12T17:39:16.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.3 2024-09-12T17:39:16.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.4 2024-09-12T17:39:16.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.4 2024-09-12T17:39:16.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.5 2024-09-12T17:39:16.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.5 2024-09-12T17:39:16.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.6 2024-09-12T17:39:16.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.6 2024-09-12T17:39:16.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.7 2024-09-12T17:39:16.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.7 2024-09-12T17:39:16.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.8 2024-09-12T17:39:16.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.8 2024-09-12T17:39:16.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.9 2024-09-12T17:39:16.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.9 2024-09-12T17:39:16.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.10 2024-09-12T17:39:16.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.10 2024-09-12T17:39:16.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.11 2024-09-12T17:39:16.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.11 2024-09-12T17:39:16.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.12 2024-09-12T17:39:16.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.12 2024-09-12T17:39:16.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.13 2024-09-12T17:39:16.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.13 2024-09-12T17:39:16.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:39:16.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:39:16.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:39:16.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:39:16.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:39:16.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:39:16.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:39:16.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:39:16.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.177+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:39:16.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.177+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:39:16.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.177+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:39:16.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.177+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:39:16.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.177+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:39:16.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.177+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:39:16.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.181+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:39:16.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.181+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:39:16.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.181+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:39:16.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.181+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:39:16.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.181+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:39:16.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.181+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:39:16.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.181+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:39:16.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.181+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:39:16.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.185+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:39:16.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.185+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:39:16.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.185+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:39:16.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.185+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:39:16.193 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc0878ec9c0 time 2024-09-12T17:39:16.196360+0000 2024-09-12T17:39:16.193 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:39:16.197 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:39:16.197 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc08b1c62eb] 2024-09-12T17:39:16.197 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc08b1c649f] 2024-09-12T17:39:16.197 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bfed6500c1] 2024-09-12T17:39:16.197 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55bfed6614f1] 2024-09-12T17:39:16.198 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55bfed662b44] 2024-09-12T17:39:16.198 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:39:16.198 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc08a02cd90] 2024-09-12T17:39:16.198 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:39:16.198 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:39:16.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.193+0000 7fc0878ec9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc0878ec9c0 time 2024-09-12T17:39:16.196360+0000 2024-09-12T17:39:16.198 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:39:16.198 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.198 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:39:16.198 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc08b1c62eb] 2024-09-12T17:39:16.198 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc08b1c649f] 2024-09-12T17:39:16.198 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bfed6500c1] 2024-09-12T17:39:16.199 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55bfed6614f1] 2024-09-12T17:39:16.199 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55bfed662b44] 2024-09-12T17:39:16.199 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:39:16.199 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc08a02cd90] 2024-09-12T17:39:16.199 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:39:16.199 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:39:16.199 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.199 INFO:tasks.workunit.client.0.smithi119.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:39:16.199 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fc0878ec9c0 thread_name:radosgw-admin 2024-09-12T17:39:16.201 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:39:16.201 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc08a045520] 2024-09-12T17:39:16.201 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:39:16.201 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:39:16.201 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:39:16.201 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc08b1c6345] 2024-09-12T17:39:16.201 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc08b1c649f] 2024-09-12T17:39:16.201 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bfed6500c1] 2024-09-12T17:39:16.201 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55bfed6614f1] 2024-09-12T17:39:16.202 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55bfed662b44] 2024-09-12T17:39:16.202 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:39:16.202 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc08a02cd90] 2024-09-12T17:39:16.202 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:39:16.202 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:39:16.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.197+0000 7fc0878ec9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:39:16.202 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fc0878ec9c0 thread_name:radosgw-admin 2024-09-12T17:39:16.202 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.202 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:39:16.202 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc08a045520] 2024-09-12T17:39:16.202 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:39:16.202 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:39:16.202 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:39:16.203 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc08b1c6345] 2024-09-12T17:39:16.203 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc08b1c649f] 2024-09-12T17:39:16.203 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bfed6500c1] 2024-09-12T17:39:16.203 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55bfed6614f1] 2024-09-12T17:39:16.203 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55bfed662b44] 2024-09-12T17:39:16.203 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:39:16.203 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc08a02cd90] 2024-09-12T17:39:16.203 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:39:16.203 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:39:16.203 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:39:16.203 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.203 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:39:16.209 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9870c0) adding con mode: secure 2024-09-12T17:39:16.209 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9870c0) adding con mode: crc 2024-09-12T17:39:16.209 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9870c0) adding con mode: secure 2024-09-12T17:39:16.209 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.209 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.209 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command rotate-key hook 0x55bfef987208 2024-09-12T17:39:16.209 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:39:16.209 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:39:16.209 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-a con 0x55bfef843900 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:39:16.209 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-c con 0x55bfef8d0390 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:39:16.210 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-b con 0x55bfef9b4460 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:39:16.210 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.210 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.210 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.210 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:39:16.210 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient(hunting): authenticate will time out at 2723.885122s 2024-09-12T17:39:16.210 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient(hunting): get_auth_request con 0x55bfef8d0390 auth_method 0 2024-09-12T17:39:16.210 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.210 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.210 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.210 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:39:15.849+0000 7fc0853f2640 10 monclient(hunting): get_auth_request con 0x55bfef843900 auth_method 0 2024-09-12T17:39:16.210 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:39:15.849+0000 7fc0853f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.211 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:39:15.849+0000 7fc0853f2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.211 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:39:15.849+0000 7fc0853f2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.211 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:16.211 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:16.211 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:16.211 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:39:15.849+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:16.211 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:39:15.849+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:16.211 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:39:15.849+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:16.211 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient(hunting): handle_auth_done global_id 7664 payload 824 2024-09-12T17:39:16.211 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient: _finish_hunting 0 2024-09-12T17:39:16.211 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:39:15.849+0000 7fc084bf1640 1 monclient: found mon.noname-c 2024-09-12T17:39:16.211 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:39:16.211 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:39:15.849+0000 7fc085bf3640 10 monclient: get_auth_request con 0x55bfef9b4460 auth_method 0 2024-09-12T17:39:16.211 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:16.212 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:39:16.212 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: dump: 2024-09-12T17:39:16.212 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:16.212 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:16.212 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.212 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.212 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:16.212 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.212 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:16.212 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:16.212 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:16.212 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.213 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: _finish_auth 0 2024-09-12T17:39:16.213 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: _check_auth_tickets 2024-09-12T17:39:16.213 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:16.213 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:16.213 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:39:16.213 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: dump: 2024-09-12T17:39:16.213 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:16.213 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:16.213 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.213 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.213 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:16.213 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.213 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:16.214 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:16.214 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:16.214 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.214 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:39:15.849+0000 7fbf73606640 4 set_mon_vals no callback set 2024-09-12T17:39:16.214 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 5 monclient: authenticate success, global_id 7664 2024-09-12T17:39:16.214 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient: _renew_subs 2024-09-12T17:39:16.214 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:39:16.214 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient: _renew_subs 2024-09-12T17:39:16.214 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:39:16.214 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 1 librados: init done 2024-09-12T17:39:16.214 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:39:15.853+0000 7fbf71e03640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:39:16.214 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:39:15.853+0000 7fbf71e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:16.214 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:39:15.853+0000 7fbf71e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:16.215 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:39:15.853+0000 7fc0853f2640 10 monclient: get_auth_request con 0x7fbf6c070b10 auth_method 0 2024-09-12T17:39:16.215 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:39:15.853+0000 7fc085bf3640 10 monclient: get_auth_request con 0x55bfef9b10b0 auth_method 0 2024-09-12T17:39:16.215 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:39:15.853+0000 7fc0853f2640 10 monclient: get_auth_request con 0x55bfef9d1ea0 auth_method 0 2024-09-12T17:39:16.215 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:39:15.853+0000 7fc084bf1640 10 monclient: get_auth_request con 0x55bfef9d6200 auth_method 0 2024-09-12T17:39:16.215 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:39:15.857+0000 7fc085bf3640 10 monclient: get_auth_request con 0x55bfef9d5760 auth_method 0 2024-09-12T17:39:16.215 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 10 monclient: build_initial_monmap 2024-09-12T17:39:16.215 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 1 build_initial for_mkfs: 0 2024-09-12T17:39:16.215 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 10 monclient: monmap: 2024-09-12T17:39:16.215 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:39:16.215 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:39:16.215 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:39:16.215 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:39:16.215 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:39:16.215 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.216 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:39:16.216 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:39:16.216 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:39:16.216 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.216 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding auth protocol: cephx 2024-09-12T17:39:16.216 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding auth protocol: cephx 2024-09-12T17:39:16.216 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding auth protocol: cephx 2024-09-12T17:39:16.216 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: secure 2024-09-12T17:39:16.216 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: crc 2024-09-12T17:39:16.216 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: secure 2024-09-12T17:39:16.216 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: crc 2024-09-12T17:39:16.216 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: secure 2024-09-12T17:39:16.217 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: crc 2024-09-12T17:39:16.217 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: crc 2024-09-12T17:39:16.217 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: secure 2024-09-12T17:39:16.217 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: crc 2024-09-12T17:39:16.217 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: secure 2024-09-12T17:39:16.217 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: crc 2024-09-12T17:39:16.217 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: secure 2024-09-12T17:39:16.217 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.217 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55bfef9e1ce0 EEXIST 2024-09-12T17:39:16.217 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient: init 2024-09-12T17:39:16.217 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding auth protocol: cephx 2024-09-12T17:39:16.217 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding auth protocol: cephx 2024-09-12T17:39:16.217 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding auth protocol: cephx 2024-09-12T17:39:16.217 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: secure 2024-09-12T17:39:16.218 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: crc 2024-09-12T17:39:16.218 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: secure 2024-09-12T17:39:16.218 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: crc 2024-09-12T17:39:16.218 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: secure 2024-09-12T17:39:16.218 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: crc 2024-09-12T17:39:16.218 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: crc 2024-09-12T17:39:16.218 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: secure 2024-09-12T17:39:16.218 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: crc 2024-09-12T17:39:16.218 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: secure 2024-09-12T17:39:16.218 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: crc 2024-09-12T17:39:16.218 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: secure 2024-09-12T17:39:16.218 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.219 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.219 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command rotate-key cmddesc rotate-key hook 0x55bfef9dd3c0 EEXIST 2024-09-12T17:39:16.219 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:39:16.219 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:39:16.219 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-b con 0x55bfefa05e90 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:39:16.219 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-a con 0x55bfefa057c0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:39:16.219 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-c con 0x55bfefa041a0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:39:16.219 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.219 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.219 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.219 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:39:16.219 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient(hunting): authenticate will time out at 2723.897085s 2024-09-12T17:39:16.219 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient(hunting): get_auth_request con 0x55bfefa057c0 auth_method 0 2024-09-12T17:39:16.220 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.220 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.220 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.220 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:39:15.861+0000 7fc0853f2640 10 monclient(hunting): get_auth_request con 0x55bfefa041a0 auth_method 0 2024-09-12T17:39:16.220 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:39:15.861+0000 7fc0853f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.220 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:39:15.861+0000 7fc0853f2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.220 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:39:15.861+0000 7fc0853f2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.220 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:16.220 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:16.220 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:16.220 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:39:15.861+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:16.220 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:39:15.861+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:16.220 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:39:15.861+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:16.221 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:39:15.861+0000 7fc084bf1640 10 monclient(hunting): get_auth_request con 0x55bfefa05e90 auth_method 0 2024-09-12T17:39:16.221 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:39:15.861+0000 7fc084bf1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.221 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:39:15.861+0000 7fc084bf1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.221 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:39:15.861+0000 7fc084bf1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.221 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient(hunting): handle_auth_done global_id 8142 payload 824 2024-09-12T17:39:16.221 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient: _finish_hunting 0 2024-09-12T17:39:16.221 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:39:15.861+0000 7fc085bf3640 1 monclient: found mon.noname-a 2024-09-12T17:39:16.221 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:39:16.221 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:16.221 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:39:16.221 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: dump: 2024-09-12T17:39:16.221 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:16.221 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:16.221 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.222 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.222 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:16.222 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.222 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:16.222 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:16.222 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:16.222 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.222 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: _finish_auth 0 2024-09-12T17:39:16.222 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: _check_auth_tickets 2024-09-12T17:39:16.222 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 monclient: authenticate success, global_id 8142 2024-09-12T17:39:16.222 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient: _renew_subs 2024-09-12T17:39:16.222 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:39:16.222 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:16.223 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:16.223 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:39:16.223 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: dump: 2024-09-12T17:39:16.223 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:16.223 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:16.223 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.223 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.223 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:16.223 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.223 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:16.223 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:16.224 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:16.224 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.224 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:39:15.861+0000 7fc0863f4640 4 set_mon_vals no callback set 2024-09-12T17:39:16.224 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient: _renew_subs 2024-09-12T17:39:16.224 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:39:16.224 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:39:15.865+0000 7fbf6affd640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:39:16.224 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:39:15.865+0000 7fbf6affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:16.224 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:39:15.865+0000 7fbf6affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:16.224 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: get_monmap_and_config 2024-09-12T17:39:16.224 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: build_initial_monmap 2024-09-12T17:39:16.224 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 1 build_initial for_mkfs: 0 2024-09-12T17:39:16.224 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: monmap: 2024-09-12T17:39:16.224 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:39:16.225 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:39:16.225 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:39:16.225 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:39:16.225 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:39:16.225 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.225 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:39:16.225 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:39:16.225 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:39:16.225 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.225 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding auth protocol: cephx 2024-09-12T17:39:16.225 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding auth protocol: cephx 2024-09-12T17:39:16.225 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding auth protocol: cephx 2024-09-12T17:39:16.225 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: secure 2024-09-12T17:39:16.226 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: crc 2024-09-12T17:39:16.226 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: secure 2024-09-12T17:39:16.226 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: crc 2024-09-12T17:39:16.226 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: secure 2024-09-12T17:39:16.226 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: crc 2024-09-12T17:39:16.226 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: crc 2024-09-12T17:39:16.226 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: secure 2024-09-12T17:39:16.226 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: crc 2024-09-12T17:39:16.226 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: secure 2024-09-12T17:39:16.226 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: crc 2024-09-12T17:39:16.226 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: secure 2024-09-12T17:39:16.226 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient: get_auth_request con 0x7fbf60070a20 auth_method 0 2024-09-12T17:39:16.226 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.227 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: init 2024-09-12T17:39:16.227 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding auth protocol: cephx 2024-09-12T17:39:16.227 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding auth protocol: cephx 2024-09-12T17:39:16.227 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding auth protocol: cephx 2024-09-12T17:39:16.227 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: secure 2024-09-12T17:39:16.227 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: crc 2024-09-12T17:39:16.227 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: secure 2024-09-12T17:39:16.227 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: crc 2024-09-12T17:39:16.227 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: secure 2024-09-12T17:39:16.227 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: crc 2024-09-12T17:39:16.227 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: crc 2024-09-12T17:39:16.227 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: secure 2024-09-12T17:39:16.227 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: crc 2024-09-12T17:39:16.227 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: secure 2024-09-12T17:39:16.228 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: crc 2024-09-12T17:39:16.228 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: secure 2024-09-12T17:39:16.228 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.228 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.228 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc41fc00e8 EEXIST 2024-09-12T17:39:16.228 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:39:16.228 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:39:16.228 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-c con 0x55bfefa59af0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:39:16.228 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-b con 0x55bfefa59ed0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:39:16.228 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-a con 0x55bfefa556b0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:39:16.228 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.228 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.228 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.229 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:39:16.229 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient(hunting): authenticate will time out at 2723.901546s 2024-09-12T17:39:16.229 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient(hunting): get_auth_request con 0x55bfefa59af0 auth_method 0 2024-09-12T17:39:16.229 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.229 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.229 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.229 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:39:15.865+0000 7fc0853f2640 10 monclient(hunting): get_auth_request con 0x55bfefa556b0 auth_method 0 2024-09-12T17:39:16.229 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:39:15.865+0000 7fc0853f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.229 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:39:15.865+0000 7fc0853f2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.229 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:39:15.865+0000 7fc0853f2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.229 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:16.229 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:16.229 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:16.230 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:39:15.865+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:16.230 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:39:15.865+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:16.230 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:39:15.865+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:16.230 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient(hunting): handle_auth_done global_id 7670 payload 274 2024-09-12T17:39:16.230 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient: _finish_hunting 0 2024-09-12T17:39:16.230 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:39:15.865+0000 7fc084bf1640 1 monclient: found mon.noname-c 2024-09-12T17:39:16.230 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:39:16.230 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:16.230 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:39:16.230 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: dump: 2024-09-12T17:39:16.230 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:16.230 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:16.230 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.230 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.231 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:16.231 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.231 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:16.231 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:16.231 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:16.231 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.231 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: _finish_auth 0 2024-09-12T17:39:16.231 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:39:16.231 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:16.231 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:16.231 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:39:16.231 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: dump: 2024-09-12T17:39:16.231 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:16.232 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:16.232 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.232 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.232 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:16.232 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.232 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:16.232 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:16.232 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:16.232 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.232 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 monclient: authenticate success, global_id 7670 2024-09-12T17:39:16.232 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:39:16.232 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 4 set_mon_vals no callback set 2024-09-12T17:39:16.233 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: shutdown 2024-09-12T17:39:16.233 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: build_initial_monmap 2024-09-12T17:39:16.233 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 1 build_initial for_mkfs: 0 2024-09-12T17:39:16.233 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: monmap: 2024-09-12T17:39:16.233 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:39:16.233 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:39:16.233 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:39:16.233 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:39:16.233 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:39:16.233 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.233 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:39:16.233 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:39:16.233 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:39:16.234 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.234 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding auth protocol: cephx 2024-09-12T17:39:16.234 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding auth protocol: cephx 2024-09-12T17:39:16.234 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding auth protocol: cephx 2024-09-12T17:39:16.234 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: secure 2024-09-12T17:39:16.234 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: crc 2024-09-12T17:39:16.234 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: secure 2024-09-12T17:39:16.234 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: crc 2024-09-12T17:39:16.234 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: secure 2024-09-12T17:39:16.234 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: crc 2024-09-12T17:39:16.234 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: crc 2024-09-12T17:39:16.234 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: secure 2024-09-12T17:39:16.234 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: crc 2024-09-12T17:39:16.234 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: secure 2024-09-12T17:39:16.235 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: crc 2024-09-12T17:39:16.235 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: secure 2024-09-12T17:39:16.235 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.235 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 1 librados: starting msgr at 2024-09-12T17:39:16.235 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 1 librados: starting objecter 2024-09-12T17:39:16.235 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55bfefa27fd0 EEXIST 2024-09-12T17:39:16.235 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 1 librados: setting wanted keys 2024-09-12T17:39:16.235 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 1 librados: calling monclient init 2024-09-12T17:39:16.235 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: init 2024-09-12T17:39:16.235 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding auth protocol: cephx 2024-09-12T17:39:16.235 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding auth protocol: cephx 2024-09-12T17:39:16.235 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding auth protocol: cephx 2024-09-12T17:39:16.236 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: secure 2024-09-12T17:39:16.236 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: crc 2024-09-12T17:39:16.236 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: secure 2024-09-12T17:39:16.236 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: crc 2024-09-12T17:39:16.236 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: secure 2024-09-12T17:39:16.236 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: crc 2024-09-12T17:39:16.236 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: crc 2024-09-12T17:39:16.236 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: secure 2024-09-12T17:39:16.236 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: crc 2024-09-12T17:39:16.236 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: secure 2024-09-12T17:39:16.236 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: crc 2024-09-12T17:39:16.236 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: secure 2024-09-12T17:39:16.236 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.237 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.237 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command rotate-key cmddesc rotate-key hook 0x55bfefa07df8 EEXIST 2024-09-12T17:39:16.237 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:39:16.237 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:39:16.237 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-b con 0x55bfefa556b0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:39:16.237 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-c con 0x55bfefa59af0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:39:16.237 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-a con 0x55bfefa499d0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:39:16.237 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.237 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.237 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.237 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:39:16.237 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient(hunting): authenticate will time out at 2723.904172s 2024-09-12T17:39:16.237 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:39:15.869+0000 7fc085bf3640 10 monclient(hunting): get_auth_request con 0x55bfefa59af0 auth_method 0 2024-09-12T17:39:16.238 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:39:15.869+0000 7fc085bf3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.238 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:39:15.869+0000 7fc085bf3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.238 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:39:15.869+0000 7fc085bf3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.238 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient(hunting): get_auth_request con 0x55bfefa499d0 auth_method 0 2024-09-12T17:39:16.238 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.238 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.238 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.238 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:39:15.869+0000 7fc085bf3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:16.238 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:39:15.869+0000 7fc085bf3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:16.238 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:39:15.869+0000 7fc085bf3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:16.238 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:16.238 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:16.238 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:16.239 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:39:15.869+0000 7fc084bf1640 10 monclient(hunting): get_auth_request con 0x55bfefa556b0 auth_method 0 2024-09-12T17:39:16.239 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:39:15.869+0000 7fc084bf1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.239 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:39:15.869+0000 7fc084bf1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.239 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:39:15.869+0000 7fc084bf1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.239 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient(hunting): handle_auth_done global_id 8148 payload 824 2024-09-12T17:39:16.239 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient: _finish_hunting 0 2024-09-12T17:39:16.239 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:39:15.869+0000 7fc0853f2640 1 monclient: found mon.noname-a 2024-09-12T17:39:16.239 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:39:16.239 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:16.239 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:39:16.239 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: dump: 2024-09-12T17:39:16.239 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:16.239 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:16.240 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.240 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.240 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:16.240 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.240 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:16.240 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:16.240 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:16.240 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.240 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: _finish_auth 0 2024-09-12T17:39:16.240 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:39:16.240 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 5 monclient: authenticate success, global_id 8148 2024-09-12T17:39:16.240 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient: _renew_subs 2024-09-12T17:39:16.240 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:39:16.241 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:16.241 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:16.241 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:39:16.241 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: dump: 2024-09-12T17:39:16.241 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:16.241 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:16.241 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.241 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.241 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:16.241 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.241 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:16.241 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:16.241 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:16.242 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.242 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:39:15.869+0000 7fbf68ff9640 4 set_mon_vals no callback set 2024-09-12T17:39:16.242 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient: _renew_subs 2024-09-12T17:39:16.242 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:39:16.242 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 1 librados: init done 2024-09-12T17:39:16.242 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command cr dump hook 0x55bfefa4fbc8 2024-09-12T17:39:16.242 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.242 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:39:16.242 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:16.242 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:16.242 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:39:15.869+0000 7fc084bf1640 10 monclient: get_auth_request con 0x7fbf50070ae0 auth_method 0 2024-09-12T17:39:16.242 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:39:15.869+0000 7fc085bf3640 10 monclient: get_auth_request con 0x55bfefa739b0 auth_method 0 2024-09-12T17:39:16.242 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.243 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 realm 2024-09-12T17:39:16.243 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.243 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.243 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:16.243 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.243 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.243 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.243 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:39:15.873+0000 7fc084bf1640 10 monclient: get_auth_request con 0x55bfefa77a70 auth_method 0 2024-09-12T17:39:16.243 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:16.243 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.243 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:39:15.873+0000 7fc085bf3640 10 monclient: get_auth_request con 0x55bfefa7b360 auth_method 0 2024-09-12T17:39:16.243 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:39:15.877+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:16.243 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:39:15.877+0000 7fc0878ec9c0 20 searching for the correct realm 2024-09-12T17:39:16.244 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:39:15.877+0000 7fc0853f2640 10 monclient: get_auth_request con 0x55bfefa80060 auth_method 0 2024-09-12T17:39:16.244 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:39:15.877+0000 7fc084bf1640 10 monclient: get_auth_request con 0x7fc0780657b0 auth_method 0 2024-09-12T17:39:16.244 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:39:15.877+0000 7fc085bf3640 10 monclient: get_auth_request con 0x7fc07c129040 auth_method 0 2024-09-12T17:39:16.244 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:39:15.877+0000 7fc085bf3640 0 -- 172.21.15.119:0/3301801206 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fc07c129040 msgr2=0x7fc07c0fe900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:16.244 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:39:15.877+0000 7fbf56ffd640 1 client.8148.objecter ms_handle_reset 0x7fc07c129040 session 0x7fc07c118040 osd.2 2024-09-12T17:39:16.244 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:39:15.877+0000 7fbf56ffd640 10 monclient: _renew_subs 2024-09-12T17:39:16.244 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:39:15.877+0000 7fbf56ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:39:16.244 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:39:15.877+0000 7fc085bf3640 10 monclient: get_auth_request con 0x7fbf50081290 auth_method 0 2024-09-12T17:39:16.244 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:39:15.881+0000 7fc0853f2640 10 monclient: get_auth_request con 0x7fc080017020 auth_method 0 2024-09-12T17:39:16.244 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:39:15.885+0000 7fc084bf1640 0 -- 172.21.15.119:0/3301801206 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fc08009b050 msgr2=0x7fc08008a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:16.244 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:39:16.089+0000 7fc084bf1640 10 monclient: get_auth_request con 0x7fc08009b050 auth_method 0 2024-09-12T17:39:16.244 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:16.245 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:16.245 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:16.245 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:16.245 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:16.245 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:16.245 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.245 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.245 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.245 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:16.245 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.245 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:16.245 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 zone default found 2024-09-12T17:39:16.245 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 4 Realm: () 2024-09-12T17:39:16.246 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:16.246 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:16.246 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:16.246 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 zonegroup default 2024-09-12T17:39:16.246 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.246 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.246 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.246 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:39:16.109+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.246 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:39:16.109+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.246 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:39:16.109+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.246 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:39:16.109+0000 7fc0878ec9c0 20 started sync module instance, tier type = 2024-09-12T17:39:16.246 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:39:16.109+0000 7fc0878ec9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:16.246 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=0 2024-09-12T17:39:16.246 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=1 2024-09-12T17:39:16.247 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=2 2024-09-12T17:39:16.247 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=3 2024-09-12T17:39:16.247 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=4 2024-09-12T17:39:16.247 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=5 2024-09-12T17:39:16.247 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=6 2024-09-12T17:39:16.247 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=7 2024-09-12T17:39:16.247 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:16.247 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding auth protocol: cephx 2024-09-12T17:39:16.247 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding auth protocol: cephx 2024-09-12T17:39:16.247 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding auth protocol: cephx 2024-09-12T17:39:16.247 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: secure 2024-09-12T17:39:16.247 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: crc 2024-09-12T17:39:16.247 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: secure 2024-09-12T17:39:16.248 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: crc 2024-09-12T17:39:16.248 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: secure 2024-09-12T17:39:16.248 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: crc 2024-09-12T17:39:16.248 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: crc 2024-09-12T17:39:16.248 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:39:16.137+0000 7fbf3bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:16.248 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: secure 2024-09-12T17:39:16.248 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: crc 2024-09-12T17:39:16.248 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: secure 2024-09-12T17:39:16.248 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: crc 2024-09-12T17:39:16.248 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: secure 2024-09-12T17:39:16.248 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.248 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:16.248 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:16.249 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command cache list hook 0x55bfefa54f70 2024-09-12T17:39:16.249 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command cache inspect hook 0x55bfefa54f70 2024-09-12T17:39:16.249 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command cache erase hook 0x55bfefa54f70 2024-09-12T17:39:16.249 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command cache zap hook 0x55bfefa54f70 2024-09-12T17:39:16.249 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 note: GC not initialized 2024-09-12T17:39:16.249 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:39:16.137+0000 7fbf3afe5640 20 reqs_thread_entry: start 2024-09-12T17:39:16.249 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command sync trace show hook 0x7fc07c0f7a20 2024-09-12T17:39:16.249 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command sync trace history hook 0x7fc07c0f7a20 2024-09-12T17:39:16.249 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command sync trace active hook 0x7fc07c0f7a20 2024-09-12T17:39:16.249 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command sync trace active_short hook 0x7fc07c0f7a20 2024-09-12T17:39:16.249 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:16.249 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 Filter name: none 2024-09-12T17:39:16.249 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:39:16.141+0000 7fbf38fe1640 20 reqs_thread_entry: start 2024-09-12T17:39:16.250 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:39:16.250 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.250 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:16.250 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:39:16.250 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:39:16.250 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:39:16.250 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.250 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:16.250 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:16.250 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:16.250 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:16.250 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:16.250 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:39:16.251 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:39:16.153+0000 7fc0878ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:16.251 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:39:16.153+0000 7fc0878ec9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:16.251 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:39:16.153+0000 7fc0878ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:16.251 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:39:16.153+0000 7fc0878ec9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:39:16.251 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:39:16.153+0000 7fbf57fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333535 cookie 94282847897184 notifier 8148 bl.length()=911 2024-09-12T17:39:16.251 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:39:16.153+0000 7fbf57fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:16.251 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:39:16.153+0000 7fbf57fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:16.251 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:39:16.153+0000 7fbf57fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:16.251 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:39:16.157+0000 7fc0878ec9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:39:16.251 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:39:16.157+0000 7fc0878ec9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:39:16.251 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:39:16.157+0000 7fc0878ec9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:39:16.251 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:39:16.157+0000 7fc0878ec9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:39:16.251 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:39:16.169+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.0 2024-09-12T17:39:16.252 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:39:16.169+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.0 2024-09-12T17:39:16.252 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:39:16.169+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.1 2024-09-12T17:39:16.252 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:39:16.169+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.1 2024-09-12T17:39:16.252 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:39:16.169+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.2 2024-09-12T17:39:16.252 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:39:16.169+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.2 2024-09-12T17:39:16.252 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:39:16.169+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.3 2024-09-12T17:39:16.252 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.3 2024-09-12T17:39:16.252 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.4 2024-09-12T17:39:16.252 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.4 2024-09-12T17:39:16.252 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.5 2024-09-12T17:39:16.252 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.5 2024-09-12T17:39:16.252 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.6 2024-09-12T17:39:16.252 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.6 2024-09-12T17:39:16.253 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.7 2024-09-12T17:39:16.253 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.7 2024-09-12T17:39:16.253 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.8 2024-09-12T17:39:16.253 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.8 2024-09-12T17:39:16.253 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.9 2024-09-12T17:39:16.253 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.9 2024-09-12T17:39:16.253 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.10 2024-09-12T17:39:16.253 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.10 2024-09-12T17:39:16.253 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.11 2024-09-12T17:39:16.253 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.11 2024-09-12T17:39:16.253 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.12 2024-09-12T17:39:16.253 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.12 2024-09-12T17:39:16.253 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.13 2024-09-12T17:39:16.254 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.13 2024-09-12T17:39:16.254 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:39:16.254 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:39:16.254 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:39:16.254 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:39:16.254 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:39:16.254 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:39:16.254 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:39:16.254 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:39:16.254 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:39:16.177+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:39:16.254 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:39:16.177+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:39:16.254 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:39:16.177+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:39:16.255 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:39:16.177+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:39:16.255 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:39:16.177+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:39:16.255 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:39:16.177+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:39:16.255 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:39:16.181+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:39:16.255 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:39:16.181+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:39:16.255 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:39:16.181+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:39:16.255 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:39:16.181+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:39:16.255 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:39:16.181+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:39:16.255 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:39:16.181+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:39:16.255 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:39:16.181+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:39:16.255 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:39:16.181+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:39:16.255 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:39:16.185+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:39:16.255 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:39:16.185+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:39:16.256 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:39:16.185+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:39:16.256 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:39:16.185+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:39:16.256 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:39:16.193+0000 7fc0878ec9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc0878ec9c0 time 2024-09-12T17:39:16.196360+0000 2024-09-12T17:39:16.256 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:39:16.256 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.256 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:39:16.256 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc08b1c62eb] 2024-09-12T17:39:16.256 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc08b1c649f] 2024-09-12T17:39:16.256 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bfed6500c1] 2024-09-12T17:39:16.256 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55bfed6614f1] 2024-09-12T17:39:16.256 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55bfed662b44] 2024-09-12T17:39:16.256 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:39:16.256 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc08a02cd90] 2024-09-12T17:39:16.257 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:39:16.257 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:39:16.257 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.257 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:39:16.197+0000 7fc0878ec9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:39:16.257 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fc0878ec9c0 thread_name:radosgw-admin 2024-09-12T17:39:16.257 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.257 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:39:16.257 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc08a045520] 2024-09-12T17:39:16.257 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:39:16.257 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:39:16.257 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:39:16.257 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc08b1c6345] 2024-09-12T17:39:16.257 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc08b1c649f] 2024-09-12T17:39:16.258 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bfed6500c1] 2024-09-12T17:39:16.258 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55bfed6614f1] 2024-09-12T17:39:16.258 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55bfed662b44] 2024-09-12T17:39:16.258 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:39:16.258 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc08a02cd90] 2024-09-12T17:39:16.258 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:39:16.258 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:39:16.258 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:39:16.258 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.258 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:39:16.258 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:39:16.258 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:39:16.258 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:39:16.259 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:39:16.259 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:39:16.259 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:39:16.259 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:39:16.259 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:39:16.259 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:39:16.259 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:39:16.259 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:39:16.259 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:39:16.259 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:39:16.259 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:39:16.259 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:39:16.259 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:39:16.259 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:39:16.260 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:39:16.260 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:39:16.260 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:39:16.260 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:39:16.260 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:39:16.260 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:39:16.260 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:39:16.260 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:39:16.260 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:39:16.260 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:39:16.260 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:39:16.260 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:39:16.260 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:39:16.261 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:39:16.261 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:39:16.261 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:39:16.261 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:39:16.261 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:39:16.261 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:39:16.261 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:39:16.261 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:39:16.261 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:39:16.261 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:39:16.261 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:39:16.261 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:39:16.271 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:39:16.271 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:39:16.271 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:39:16.271 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:39:16.271 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:39:16.272 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:39:16.272 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:39:16.272 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:39:16.272 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:39:16.272 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:39:16.272 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:39:16.272 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:39:16.272 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:39:16.272 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:39:16.272 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:39:16.272 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:39:16.272 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:39:16.272 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:39:16.273 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:39:16.273 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:39:16.273 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:39:16.273 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:39:16.273 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:39:16.273 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:39:16.273 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:39:16.276 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:39:16.276 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:39:16.277 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:39:16.277 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:39:16.277 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:39:16.277 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:39:16.277 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:39:16.277 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:39:16.277 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:39:16.277 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:39:16.277 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:39:16.277 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:39:16.277 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:39:16.277 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:39:16.277 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:39:16.278 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:39:16.278 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:39:16.278 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:39:16.278 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:39:16.278 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:39:16.278 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:39:16.278 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:39:16.278 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:39:16.278 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:39:16.278 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:39:16.278 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:39:16.278 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf38fe1640 / http_manager 2024-09-12T17:39:16.278 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf3afe5640 / http_manager 2024-09-12T17:39:16.279 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf3bfe7640 / rgw_dt_lg_renew 2024-09-12T17:39:16.279 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf56ffd640 / ms_dispatch 2024-09-12T17:39:16.279 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf57fff640 / io_context_pool 2024-09-12T17:39:16.279 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf68ff9640 / io_context_pool 2024-09-12T17:39:16.279 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf6affd640 / ms_dispatch 2024-09-12T17:39:16.279 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf71e03640 / ms_dispatch 2024-09-12T17:39:16.279 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf73606640 / io_context_pool 2024-09-12T17:39:16.279 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc084bf1640 / msgr-worker-2 2024-09-12T17:39:16.279 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc0853f2640 / msgr-worker-1 2024-09-12T17:39:16.279 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc085bf3640 / msgr-worker-0 2024-09-12T17:39:16.279 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc0863f4640 / io_context_pool 2024-09-12T17:39:16.279 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc0878ec9c0 / radosgw-admin 2024-09-12T17:39:16.279 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:39:16.279 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:39:16.280 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/log/ceph/ceph-client.admin.139853.log 2024-09-12T17:39:16.280 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:39:16.280 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:39:16.280 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9870c0) adding con mode: secure 2024-09-12T17:39:16.280 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9870c0) adding con mode: crc 2024-09-12T17:39:16.280 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9870c0) adding con mode: secure 2024-09-12T17:39:16.280 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.280 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.280 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command rotate-key hook 0x55bfef987208 2024-09-12T17:39:16.280 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:39:16.280 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:39:16.280 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-a con 0x55bfef843900 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:39:16.281 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-c con 0x55bfef8d0390 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:39:16.281 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-b con 0x55bfef9b4460 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:39:16.281 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.281 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.281 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.281 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:39:16.281 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient(hunting): authenticate will time out at 2723.885122s 2024-09-12T17:39:16.281 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient(hunting): get_auth_request con 0x55bfef8d0390 auth_method 0 2024-09-12T17:39:16.281 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.281 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.281 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.281 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:39:15.849+0000 7fc0853f2640 10 monclient(hunting): get_auth_request con 0x55bfef843900 auth_method 0 2024-09-12T17:39:16.281 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:39:15.849+0000 7fc0853f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.282 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:39:15.849+0000 7fc0853f2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.282 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:39:15.849+0000 7fc0853f2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.282 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:16.282 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:16.282 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:16.282 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:39:15.849+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:16.282 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:39:15.849+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:16.282 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:39:15.849+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:16.282 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient(hunting): handle_auth_done global_id 7664 payload 824 2024-09-12T17:39:16.282 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient: _finish_hunting 0 2024-09-12T17:39:16.282 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:39:15.849+0000 7fc084bf1640 1 monclient: found mon.noname-c 2024-09-12T17:39:16.282 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:39:15.849+0000 7fc084bf1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:39:16.283 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:39:15.849+0000 7fc085bf3640 10 monclient: get_auth_request con 0x55bfef9b4460 auth_method 0 2024-09-12T17:39:16.283 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:16.283 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:39:16.283 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: dump: 2024-09-12T17:39:16.283 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:16.283 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:16.283 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.283 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.283 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:16.284 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.284 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:16.284 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:16.284 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:16.284 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.284 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: _finish_auth 0 2024-09-12T17:39:16.284 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: _check_auth_tickets 2024-09-12T17:39:16.284 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:16.284 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:16.284 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:39:16.284 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:39:15.849+0000 7fbf71e03640 10 monclient: dump: 2024-09-12T17:39:16.284 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:16.284 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:16.284 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.285 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.285 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:16.285 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.285 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:16.285 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:16.285 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:16.285 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.285 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:39:15.849+0000 7fbf73606640 4 set_mon_vals no callback set 2024-09-12T17:39:16.285 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 5 monclient: authenticate success, global_id 7664 2024-09-12T17:39:16.285 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient: _renew_subs 2024-09-12T17:39:16.285 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:39:16.285 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient: _renew_subs 2024-09-12T17:39:16.285 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:39:16.286 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:39:15.849+0000 7fc0878ec9c0 1 librados: init done 2024-09-12T17:39:16.286 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:39:15.853+0000 7fbf71e03640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:39:16.286 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:39:15.853+0000 7fbf71e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:16.286 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:39:15.853+0000 7fbf71e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:16.286 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:39:15.853+0000 7fc0853f2640 10 monclient: get_auth_request con 0x7fbf6c070b10 auth_method 0 2024-09-12T17:39:16.286 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:39:15.853+0000 7fc085bf3640 10 monclient: get_auth_request con 0x55bfef9b10b0 auth_method 0 2024-09-12T17:39:16.286 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:39:15.853+0000 7fc0853f2640 10 monclient: get_auth_request con 0x55bfef9d1ea0 auth_method 0 2024-09-12T17:39:16.286 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:39:15.853+0000 7fc084bf1640 10 monclient: get_auth_request con 0x55bfef9d6200 auth_method 0 2024-09-12T17:39:16.286 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:39:15.857+0000 7fc085bf3640 10 monclient: get_auth_request con 0x55bfef9d5760 auth_method 0 2024-09-12T17:39:16.286 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 10 monclient: build_initial_monmap 2024-09-12T17:39:16.286 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 1 build_initial for_mkfs: 0 2024-09-12T17:39:16.286 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 10 monclient: monmap: 2024-09-12T17:39:16.286 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:39:16.287 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:39:16.287 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:39:16.287 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:39:16.287 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:39:16.287 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.287 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:39:16.287 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:39:16.287 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:39:16.287 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.287 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding auth protocol: cephx 2024-09-12T17:39:16.287 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding auth protocol: cephx 2024-09-12T17:39:16.287 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding auth protocol: cephx 2024-09-12T17:39:16.287 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: secure 2024-09-12T17:39:16.288 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: crc 2024-09-12T17:39:16.288 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: secure 2024-09-12T17:39:16.288 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: crc 2024-09-12T17:39:16.288 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: secure 2024-09-12T17:39:16.288 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: crc 2024-09-12T17:39:16.288 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: crc 2024-09-12T17:39:16.288 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: secure 2024-09-12T17:39:16.288 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: crc 2024-09-12T17:39:16.288 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: secure 2024-09-12T17:39:16.288 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: crc 2024-09-12T17:39:16.288 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:39:15.857+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9de330) adding con mode: secure 2024-09-12T17:39:16.288 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.288 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55bfef9e1ce0 EEXIST 2024-09-12T17:39:16.289 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient: init 2024-09-12T17:39:16.289 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding auth protocol: cephx 2024-09-12T17:39:16.289 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding auth protocol: cephx 2024-09-12T17:39:16.289 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding auth protocol: cephx 2024-09-12T17:39:16.289 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: secure 2024-09-12T17:39:16.289 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: crc 2024-09-12T17:39:16.289 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: secure 2024-09-12T17:39:16.289 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: crc 2024-09-12T17:39:16.289 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: secure 2024-09-12T17:39:16.289 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: crc 2024-09-12T17:39:16.289 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: crc 2024-09-12T17:39:16.289 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: secure 2024-09-12T17:39:16.289 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: crc 2024-09-12T17:39:16.290 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: secure 2024-09-12T17:39:16.290 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: crc 2024-09-12T17:39:16.290 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfef9dd278) adding con mode: secure 2024-09-12T17:39:16.290 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.290 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.290 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command rotate-key cmddesc rotate-key hook 0x55bfef9dd3c0 EEXIST 2024-09-12T17:39:16.290 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:39:16.290 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:39:16.290 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-b con 0x55bfefa05e90 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:39:16.290 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-a con 0x55bfefa057c0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:39:16.290 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-c con 0x55bfefa041a0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:39:16.290 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.290 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.291 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.291 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:39:16.291 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient(hunting): authenticate will time out at 2723.897085s 2024-09-12T17:39:16.291 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient(hunting): get_auth_request con 0x55bfefa057c0 auth_method 0 2024-09-12T17:39:16.291 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.291 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.291 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.291 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:39:15.861+0000 7fc0853f2640 10 monclient(hunting): get_auth_request con 0x55bfefa041a0 auth_method 0 2024-09-12T17:39:16.291 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:39:15.861+0000 7fc0853f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.291 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:39:15.861+0000 7fc0853f2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.291 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:39:15.861+0000 7fc0853f2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.291 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:16.291 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:16.291 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:16.292 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:39:15.861+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:16.292 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:39:15.861+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:16.292 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:39:15.861+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:16.292 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:39:15.861+0000 7fc084bf1640 10 monclient(hunting): get_auth_request con 0x55bfefa05e90 auth_method 0 2024-09-12T17:39:16.292 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:39:15.861+0000 7fc084bf1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.292 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:39:15.861+0000 7fc084bf1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.292 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:39:15.861+0000 7fc084bf1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.292 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient(hunting): handle_auth_done global_id 8142 payload 824 2024-09-12T17:39:16.292 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient: _finish_hunting 0 2024-09-12T17:39:16.292 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:39:15.861+0000 7fc085bf3640 1 monclient: found mon.noname-a 2024-09-12T17:39:16.292 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:39:15.861+0000 7fc085bf3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:39:16.292 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:16.292 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:39:16.293 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: dump: 2024-09-12T17:39:16.293 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:16.293 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:16.293 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.293 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.293 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:16.293 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.293 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:16.293 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:16.293 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:16.293 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.293 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: _finish_auth 0 2024-09-12T17:39:16.293 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: _check_auth_tickets 2024-09-12T17:39:16.294 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 5 monclient: authenticate success, global_id 8142 2024-09-12T17:39:16.294 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient: _renew_subs 2024-09-12T17:39:16.294 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:39:16.294 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:16.294 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:16.294 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:39:16.294 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:39:15.861+0000 7fbf6affd640 10 monclient: dump: 2024-09-12T17:39:16.294 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:16.294 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:16.294 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.294 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.294 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:16.294 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.294 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:16.295 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:16.295 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:16.295 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.295 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:39:15.861+0000 7fc0863f4640 4 set_mon_vals no callback set 2024-09-12T17:39:16.295 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient: _renew_subs 2024-09-12T17:39:16.295 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:39:15.861+0000 7fc0878ec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:39:16.295 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:39:15.865+0000 7fbf6affd640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:39:16.295 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:39:15.865+0000 7fbf6affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:16.295 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:39:15.865+0000 7fbf6affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:16.295 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: get_monmap_and_config 2024-09-12T17:39:16.295 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: build_initial_monmap 2024-09-12T17:39:16.295 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 1 build_initial for_mkfs: 0 2024-09-12T17:39:16.295 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: monmap: 2024-09-12T17:39:16.296 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:39:16.296 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:39:16.296 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:39:16.296 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:39:16.296 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:39:16.296 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.296 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:39:16.296 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:39:16.296 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:39:16.296 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.296 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding auth protocol: cephx 2024-09-12T17:39:16.296 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding auth protocol: cephx 2024-09-12T17:39:16.296 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding auth protocol: cephx 2024-09-12T17:39:16.296 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: secure 2024-09-12T17:39:16.297 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: crc 2024-09-12T17:39:16.297 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: secure 2024-09-12T17:39:16.297 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: crc 2024-09-12T17:39:16.297 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: secure 2024-09-12T17:39:16.297 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: crc 2024-09-12T17:39:16.297 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: crc 2024-09-12T17:39:16.297 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: secure 2024-09-12T17:39:16.297 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: crc 2024-09-12T17:39:16.297 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: secure 2024-09-12T17:39:16.297 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: crc 2024-09-12T17:39:16.297 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa25780) adding con mode: secure 2024-09-12T17:39:16.297 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient: get_auth_request con 0x7fbf60070a20 auth_method 0 2024-09-12T17:39:16.297 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.298 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: init 2024-09-12T17:39:16.298 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding auth protocol: cephx 2024-09-12T17:39:16.298 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding auth protocol: cephx 2024-09-12T17:39:16.298 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding auth protocol: cephx 2024-09-12T17:39:16.298 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: secure 2024-09-12T17:39:16.298 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: crc 2024-09-12T17:39:16.298 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: secure 2024-09-12T17:39:16.298 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: crc 2024-09-12T17:39:16.298 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: secure 2024-09-12T17:39:16.298 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: crc 2024-09-12T17:39:16.298 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: crc 2024-09-12T17:39:16.298 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: secure 2024-09-12T17:39:16.298 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: crc 2024-09-12T17:39:16.298 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: secure 2024-09-12T17:39:16.299 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: crc 2024-09-12T17:39:16.299 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fbffa0) adding con mode: secure 2024-09-12T17:39:16.299 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.299 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.299 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc41fc00e8 EEXIST 2024-09-12T17:39:16.299 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:39:16.299 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:39:16.299 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-c con 0x55bfefa59af0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:39:16.299 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-b con 0x55bfefa59ed0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:39:16.299 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-a con 0x55bfefa556b0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:39:16.299 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.299 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.299 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.300 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:39:16.300 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient(hunting): authenticate will time out at 2723.901546s 2024-09-12T17:39:16.300 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient(hunting): get_auth_request con 0x55bfefa59af0 auth_method 0 2024-09-12T17:39:16.300 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.300 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.300 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.300 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:39:15.865+0000 7fc0853f2640 10 monclient(hunting): get_auth_request con 0x55bfefa556b0 auth_method 0 2024-09-12T17:39:16.300 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:39:15.865+0000 7fc0853f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.300 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:39:15.865+0000 7fc0853f2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.300 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:39:15.865+0000 7fc0853f2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.300 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:16.300 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:16.300 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:16.301 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:39:15.865+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:16.301 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:39:15.865+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:16.301 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:39:15.865+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:16.301 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient(hunting): handle_auth_done global_id 7670 payload 274 2024-09-12T17:39:16.301 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient: _finish_hunting 0 2024-09-12T17:39:16.301 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:39:15.865+0000 7fc084bf1640 1 monclient: found mon.noname-c 2024-09-12T17:39:16.301 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:39:15.865+0000 7fc084bf1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:39:16.301 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:16.301 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:39:16.301 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: dump: 2024-09-12T17:39:16.301 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:16.301 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:16.301 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.302 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.302 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:16.302 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.302 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:16.302 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:16.302 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:16.302 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.302 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: _finish_auth 0 2024-09-12T17:39:16.302 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:39:16.302 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:16.302 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:16.302 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:39:16.302 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:39:15.865+0000 7fbf68ff9640 10 monclient: dump: 2024-09-12T17:39:16.302 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:16.303 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:16.303 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.303 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.303 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:16.303 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.303 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:16.303 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:16.303 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:16.303 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.303 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 monclient: authenticate success, global_id 7670 2024-09-12T17:39:16.303 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:39:16.303 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 4 set_mon_vals no callback set 2024-09-12T17:39:16.303 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: shutdown 2024-09-12T17:39:16.304 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: build_initial_monmap 2024-09-12T17:39:16.304 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 1 build_initial for_mkfs: 0 2024-09-12T17:39:16.304 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: monmap: 2024-09-12T17:39:16.304 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:39:16.304 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:39:16.304 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:39:16.304 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:39:16.304 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:39:16.304 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.304 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:39:16.304 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:39:16.304 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:39:16.304 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.304 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding auth protocol: cephx 2024-09-12T17:39:16.305 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding auth protocol: cephx 2024-09-12T17:39:16.305 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding auth protocol: cephx 2024-09-12T17:39:16.305 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: secure 2024-09-12T17:39:16.305 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: crc 2024-09-12T17:39:16.305 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: secure 2024-09-12T17:39:16.305 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: crc 2024-09-12T17:39:16.305 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: secure 2024-09-12T17:39:16.305 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: crc 2024-09-12T17:39:16.305 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: crc 2024-09-12T17:39:16.305 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: secure 2024-09-12T17:39:16.305 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: crc 2024-09-12T17:39:16.305 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: secure 2024-09-12T17:39:16.305 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: crc 2024-09-12T17:39:16.305 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa4c2b0) adding con mode: secure 2024-09-12T17:39:16.306 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.306 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 1 librados: starting msgr at 2024-09-12T17:39:16.306 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 1 librados: starting objecter 2024-09-12T17:39:16.306 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55bfefa27fd0 EEXIST 2024-09-12T17:39:16.306 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 1 librados: setting wanted keys 2024-09-12T17:39:16.306 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 1 librados: calling monclient init 2024-09-12T17:39:16.306 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 10 monclient: init 2024-09-12T17:39:16.306 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding auth protocol: cephx 2024-09-12T17:39:16.308 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding auth protocol: cephx 2024-09-12T17:39:16.308 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding auth protocol: cephx 2024-09-12T17:39:16.308 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: secure 2024-09-12T17:39:16.308 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: crc 2024-09-12T17:39:16.308 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: secure 2024-09-12T17:39:16.308 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: crc 2024-09-12T17:39:16.308 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: secure 2024-09-12T17:39:16.308 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: crc 2024-09-12T17:39:16.308 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: crc 2024-09-12T17:39:16.309 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: secure 2024-09-12T17:39:16.309 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: crc 2024-09-12T17:39:16.309 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: secure 2024-09-12T17:39:16.309 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: crc 2024-09-12T17:39:16.309 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 5 AuthRegistry(0x55bfefa07cb0) adding con mode: secure 2024-09-12T17:39:16.309 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:39:15.865+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.309 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.309 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command rotate-key cmddesc rotate-key hook 0x55bfefa07df8 EEXIST 2024-09-12T17:39:16.309 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:39:16.309 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:39:16.309 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-b con 0x55bfefa556b0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:39:16.309 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-c con 0x55bfefa59af0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:39:16.309 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient(hunting): picked mon.noname-a con 0x55bfefa499d0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:39:16.310 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.310 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.310 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:16.310 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:39:16.310 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient(hunting): authenticate will time out at 2723.904172s 2024-09-12T17:39:16.310 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:39:15.869+0000 7fc085bf3640 10 monclient(hunting): get_auth_request con 0x55bfefa59af0 auth_method 0 2024-09-12T17:39:16.310 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:39:15.869+0000 7fc085bf3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.310 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:39:15.869+0000 7fc085bf3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.310 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:39:15.869+0000 7fc085bf3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.310 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient(hunting): get_auth_request con 0x55bfefa499d0 auth_method 0 2024-09-12T17:39:16.310 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.310 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.310 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.311 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:39:15.869+0000 7fc085bf3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:16.311 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:39:15.869+0000 7fc085bf3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:16.311 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:39:15.869+0000 7fc085bf3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:16.311 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:16.311 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:16.311 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:16.311 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:39:15.869+0000 7fc084bf1640 10 monclient(hunting): get_auth_request con 0x55bfefa556b0 auth_method 0 2024-09-12T17:39:16.311 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:39:15.869+0000 7fc084bf1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:16.311 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:39:15.869+0000 7fc084bf1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:16.311 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:39:15.869+0000 7fc084bf1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:16.311 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient(hunting): handle_auth_done global_id 8148 payload 824 2024-09-12T17:39:16.311 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient: _finish_hunting 0 2024-09-12T17:39:16.311 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:39:15.869+0000 7fc0853f2640 1 monclient: found mon.noname-a 2024-09-12T17:39:16.311 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:39:15.869+0000 7fc0853f2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:39:16.312 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:16.312 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:39:16.312 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: dump: 2024-09-12T17:39:16.312 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:16.312 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:16.312 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.312 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.312 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:16.312 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.312 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:16.312 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:16.312 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:16.312 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.313 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: _finish_auth 0 2024-09-12T17:39:16.313 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:39:16.313 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 5 monclient: authenticate success, global_id 8148 2024-09-12T17:39:16.313 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient: _renew_subs 2024-09-12T17:39:16.313 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:39:16.313 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:16.313 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:16.313 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:39:16.313 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 10 monclient: dump: 2024-09-12T17:39:16.313 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:16.313 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:16.313 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.313 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:16.313 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:16.314 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:16.314 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:16.314 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:16.314 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:16.314 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.314 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:39:15.869+0000 7fbf68ff9640 4 set_mon_vals no callback set 2024-09-12T17:39:16.314 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient: _renew_subs 2024-09-12T17:39:16.314 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:39:16.314 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 1 librados: init done 2024-09-12T17:39:16.314 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command cr dump hook 0x55bfefa4fbc8 2024-09-12T17:39:16.314 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:39:15.869+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.314 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:39:16.314 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:16.315 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:39:15.869+0000 7fbf56ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:16.315 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:39:15.869+0000 7fc084bf1640 10 monclient: get_auth_request con 0x7fbf50070ae0 auth_method 0 2024-09-12T17:39:16.315 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:39:15.869+0000 7fc085bf3640 10 monclient: get_auth_request con 0x55bfefa739b0 auth_method 0 2024-09-12T17:39:16.315 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.315 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 realm 2024-09-12T17:39:16.315 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.315 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.315 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:16.315 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.315 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.315 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.315 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:39:15.873+0000 7fc084bf1640 10 monclient: get_auth_request con 0x55bfefa77a70 auth_method 0 2024-09-12T17:39:16.315 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:16.316 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:39:15.873+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.316 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:39:15.873+0000 7fc085bf3640 10 monclient: get_auth_request con 0x55bfefa7b360 auth_method 0 2024-09-12T17:39:16.316 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:39:15.877+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:16.316 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:39:15.877+0000 7fc0878ec9c0 20 searching for the correct realm 2024-09-12T17:39:16.316 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:39:15.877+0000 7fc0853f2640 10 monclient: get_auth_request con 0x55bfefa80060 auth_method 0 2024-09-12T17:39:16.316 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:39:15.877+0000 7fc084bf1640 10 monclient: get_auth_request con 0x7fc0780657b0 auth_method 0 2024-09-12T17:39:16.316 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:39:15.877+0000 7fc085bf3640 10 monclient: get_auth_request con 0x7fc07c129040 auth_method 0 2024-09-12T17:39:16.316 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:39:15.877+0000 7fc085bf3640 0 -- 172.21.15.119:0/3301801206 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fc07c129040 msgr2=0x7fc07c0fe900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:16.316 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:39:15.877+0000 7fbf56ffd640 1 client.8148.objecter ms_handle_reset 0x7fc07c129040 session 0x7fc07c118040 osd.2 2024-09-12T17:39:16.316 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:39:15.877+0000 7fbf56ffd640 10 monclient: _renew_subs 2024-09-12T17:39:16.316 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:39:15.877+0000 7fbf56ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:39:16.316 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:39:15.877+0000 7fc085bf3640 10 monclient: get_auth_request con 0x7fbf50081290 auth_method 0 2024-09-12T17:39:16.316 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:39:15.881+0000 7fc0853f2640 10 monclient: get_auth_request con 0x7fc080017020 auth_method 0 2024-09-12T17:39:16.317 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:39:15.885+0000 7fc084bf1640 0 -- 172.21.15.119:0/3301801206 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fc08009b050 msgr2=0x7fc08008a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:16.317 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:39:16.089+0000 7fc084bf1640 10 monclient: get_auth_request con 0x7fc08009b050 auth_method 0 2024-09-12T17:39:16.317 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:16.317 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:16.317 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:16.317 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:16.317 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:16.317 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:16.317 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:39:16.101+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.317 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.317 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.317 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:16.317 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.318 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:16.318 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 zone default found 2024-09-12T17:39:16.318 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 4 Realm: () 2024-09-12T17:39:16.318 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:16.318 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:16.318 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:16.318 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 zonegroup default 2024-09-12T17:39:16.318 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.318 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.318 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:39:16.105+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.318 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:39:16.109+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.318 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:39:16.109+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.318 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:39:16.109+0000 7fc0878ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.318 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:39:16.109+0000 7fc0878ec9c0 20 started sync module instance, tier type = 2024-09-12T17:39:16.319 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:39:16.109+0000 7fc0878ec9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:16.319 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=0 2024-09-12T17:39:16.319 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=1 2024-09-12T17:39:16.319 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=2 2024-09-12T17:39:16.319 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=3 2024-09-12T17:39:16.319 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=4 2024-09-12T17:39:16.319 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=5 2024-09-12T17:39:16.319 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=6 2024-09-12T17:39:16.319 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 20 add_watcher() i=7 2024-09-12T17:39:16.319 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:39:16.133+0000 7fc0878ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:16.319 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding auth protocol: cephx 2024-09-12T17:39:16.319 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding auth protocol: cephx 2024-09-12T17:39:16.319 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding auth protocol: cephx 2024-09-12T17:39:16.320 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: secure 2024-09-12T17:39:16.320 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: crc 2024-09-12T17:39:16.320 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: secure 2024-09-12T17:39:16.320 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: crc 2024-09-12T17:39:16.320 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: secure 2024-09-12T17:39:16.320 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: crc 2024-09-12T17:39:16.320 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: crc 2024-09-12T17:39:16.320 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:39:16.137+0000 7fbf3bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:16.320 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: secure 2024-09-12T17:39:16.320 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: crc 2024-09-12T17:39:16.320 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: secure 2024-09-12T17:39:16.320 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: crc 2024-09-12T17:39:16.320 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 AuthRegistry(0x7ffc41fc0470) adding con mode: secure 2024-09-12T17:39:16.321 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:16.321 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:16.321 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:16.321 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command cache list hook 0x55bfefa54f70 2024-09-12T17:39:16.321 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command cache inspect hook 0x55bfefa54f70 2024-09-12T17:39:16.321 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command cache erase hook 0x55bfefa54f70 2024-09-12T17:39:16.321 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command cache zap hook 0x55bfefa54f70 2024-09-12T17:39:16.321 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:39:16.137+0000 7fc0878ec9c0 5 note: GC not initialized 2024-09-12T17:39:16.321 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:39:16.137+0000 7fbf3afe5640 20 reqs_thread_entry: start 2024-09-12T17:39:16.321 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command sync trace show hook 0x7fc07c0f7a20 2024-09-12T17:39:16.321 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command sync trace history hook 0x7fc07c0f7a20 2024-09-12T17:39:16.321 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command sync trace active hook 0x7fc07c0f7a20 2024-09-12T17:39:16.321 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 5 asok(0x55bfef77a2b0) register_command sync trace active_short hook 0x7fc07c0f7a20 2024-09-12T17:39:16.322 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:16.322 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 Filter name: none 2024-09-12T17:39:16.322 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:39:16.141+0000 7fbf38fe1640 20 reqs_thread_entry: start 2024-09-12T17:39:16.322 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:39:16.322 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.322 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:16.322 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:39:16.322 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:39:16.322 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:39:16.322 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.322 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:16.322 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:16.322 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:16.322 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:16.323 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:16.323 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:39:16.141+0000 7fc0878ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:39:16.323 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:39:16.153+0000 7fc0878ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:16.323 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:39:16.153+0000 7fc0878ec9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:16.323 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:39:16.153+0000 7fc0878ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:16.323 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:39:16.153+0000 7fc0878ec9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:39:16.323 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:39:16.153+0000 7fbf57fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333535 cookie 94282847897184 notifier 8148 bl.length()=911 2024-09-12T17:39:16.323 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:39:16.153+0000 7fbf57fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:16.323 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:39:16.153+0000 7fbf57fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:16.323 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:39:16.153+0000 7fbf57fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:16.323 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:39:16.157+0000 7fc0878ec9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:39:16.323 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:39:16.157+0000 7fc0878ec9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:39:16.323 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:39:16.157+0000 7fc0878ec9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:39:16.324 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:39:16.157+0000 7fc0878ec9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:39:16.324 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:39:16.169+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.0 2024-09-12T17:39:16.324 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:39:16.169+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.0 2024-09-12T17:39:16.324 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:39:16.169+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.1 2024-09-12T17:39:16.324 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:39:16.169+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.1 2024-09-12T17:39:16.324 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:39:16.169+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.2 2024-09-12T17:39:16.324 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:39:16.169+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.2 2024-09-12T17:39:16.324 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:39:16.169+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.3 2024-09-12T17:39:16.324 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.3 2024-09-12T17:39:16.324 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.4 2024-09-12T17:39:16.324 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.4 2024-09-12T17:39:16.324 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.5 2024-09-12T17:39:16.324 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.5 2024-09-12T17:39:16.325 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.6 2024-09-12T17:39:16.325 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.6 2024-09-12T17:39:16.325 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.7 2024-09-12T17:39:16.325 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.7 2024-09-12T17:39:16.325 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.8 2024-09-12T17:39:16.325 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.8 2024-09-12T17:39:16.325 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.9 2024-09-12T17:39:16.325 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.9 2024-09-12T17:39:16.325 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.10 2024-09-12T17:39:16.325 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.10 2024-09-12T17:39:16.325 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.11 2024-09-12T17:39:16.325 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.11 2024-09-12T17:39:16.325 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.12 2024-09-12T17:39:16.325 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.12 2024-09-12T17:39:16.326 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.13 2024-09-12T17:39:16.326 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.13 2024-09-12T17:39:16.326 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:39:16.326 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:39:16.326 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:39:16.326 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:39:16.326 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:39:16.326 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:39:16.326 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:39:16.326 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:39:16.173+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:39:16.326 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:39:16.177+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:39:16.326 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:39:16.177+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:39:16.326 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:39:16.177+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:39:16.327 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:39:16.177+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:39:16.327 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:39:16.177+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:39:16.327 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:39:16.177+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:39:16.327 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:39:16.181+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:39:16.327 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:39:16.181+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:39:16.327 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:39:16.181+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:39:16.327 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:39:16.181+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:39:16.327 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:39:16.181+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:39:16.327 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:39:16.181+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:39:16.327 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:39:16.181+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:39:16.327 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:39:16.181+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:39:16.327 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:39:16.185+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:39:16.327 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:39:16.185+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:39:16.327 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:39:16.185+0000 7fc0878ec9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:39:16.328 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:39:16.185+0000 7fc0878ec9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:39:16.328 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:39:16.193+0000 7fc0878ec9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc0878ec9c0 time 2024-09-12T17:39:16.196360+0000 2024-09-12T17:39:16.328 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:39:16.328 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.328 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:39:16.328 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc08b1c62eb] 2024-09-12T17:39:16.328 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc08b1c649f] 2024-09-12T17:39:16.328 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bfed6500c1] 2024-09-12T17:39:16.328 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55bfed6614f1] 2024-09-12T17:39:16.328 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55bfed662b44] 2024-09-12T17:39:16.328 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:39:16.328 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc08a02cd90] 2024-09-12T17:39:16.329 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:39:16.329 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:39:16.329 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.329 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:39:16.197+0000 7fc0878ec9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:39:16.329 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7fc0878ec9c0 thread_name:radosgw-admin 2024-09-12T17:39:16.329 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.329 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:39:16.329 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc08a045520] 2024-09-12T17:39:16.329 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:39:16.329 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:39:16.329 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:39:16.329 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc08b1c6345] 2024-09-12T17:39:16.329 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc08b1c649f] 2024-09-12T17:39:16.329 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bfed6500c1] 2024-09-12T17:39:16.330 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55bfed6614f1] 2024-09-12T17:39:16.330 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55bfed662b44] 2024-09-12T17:39:16.330 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:39:16.330 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc08a02cd90] 2024-09-12T17:39:16.330 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:39:16.330 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:39:16.330 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:39:16.330 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:16.330 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:39:16.330 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:39:16.330 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:39:16.330 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:39:16.330 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:39:16.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:39:16.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:39:16.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:39:16.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:39:16.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:39:16.331 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:39:16.331 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:39:16.331 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:39:16.331 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:39:16.331 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:39:16.331 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:39:16.331 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:39:16.331 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:39:16.331 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:39:16.332 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:39:16.332 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:39:16.332 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:39:16.332 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:39:16.332 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:39:16.332 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:39:16.332 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:39:16.332 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:39:16.332 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:39:16.332 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:39:16.332 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:39:16.332 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:39:16.332 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:39:16.332 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:39:16.333 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:39:16.333 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:39:16.333 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:39:16.333 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:39:16.333 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:39:16.333 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:39:16.333 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:39:16.333 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:39:16.333 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:39:16.333 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:39:16.333 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:39:16.333 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:39:16.333 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:39:16.334 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:39:16.334 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:39:16.334 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:39:16.334 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:39:16.334 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:39:16.334 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:39:16.334 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:39:16.334 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:39:16.334 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:39:16.334 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:39:16.334 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:39:16.334 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:39:16.334 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:39:16.334 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:39:16.334 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:39:16.335 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:39:16.335 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:39:16.335 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:39:16.335 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:39:16.335 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:39:16.335 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:39:16.335 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:39:16.335 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:39:16.335 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:39:16.335 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:39:16.335 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:39:16.335 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:39:16.335 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:39:16.335 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:39:16.336 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:39:16.336 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:39:16.336 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:39:16.336 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:39:16.336 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:39:16.336 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:39:16.336 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:39:16.336 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:39:16.336 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:39:16.336 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:39:16.336 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:39:16.336 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:39:16.336 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:39:16.337 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:39:16.337 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:39:16.337 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:39:16.337 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:39:16.337 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:39:16.337 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:39:16.337 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf38fe1640 / http_manager 2024-09-12T17:39:16.337 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf3afe5640 / http_manager 2024-09-12T17:39:16.337 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf3bfe7640 / rgw_dt_lg_renew 2024-09-12T17:39:16.337 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf56ffd640 / ms_dispatch 2024-09-12T17:39:16.337 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf57fff640 / io_context_pool 2024-09-12T17:39:16.337 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf68ff9640 / io_context_pool 2024-09-12T17:39:16.337 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf6affd640 / ms_dispatch 2024-09-12T17:39:16.337 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf71e03640 / ms_dispatch 2024-09-12T17:39:16.338 INFO:tasks.workunit.client.0.smithi119.stderr: 7fbf73606640 / io_context_pool 2024-09-12T17:39:16.338 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc084bf1640 / msgr-worker-2 2024-09-12T17:39:16.338 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc0853f2640 / msgr-worker-1 2024-09-12T17:39:16.338 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc085bf3640 / msgr-worker-0 2024-09-12T17:39:16.338 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc0863f4640 / io_context_pool 2024-09-12T17:39:16.338 INFO:tasks.workunit.client.0.smithi119.stderr: 7fc0878ec9c0 / radosgw-admin 2024-09-12T17:39:16.338 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:39:16.338 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:39:16.338 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:39:16.203543Z_06d0818f-d209-4d1c-b06b-cc9c987007d3/log 2024-09-12T17:39:16.338 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:39:16.338 INFO:tasks.workunit.client.0.smithi119.stderr:Aborted 2024-09-12T17:39:16.338 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:39:16.338 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:16.339 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:16.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.301+0000 7feed94f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.301+0000 7feed94f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.301+0000 7feed94f89c0 20 realm 2024-09-12T17:39:16.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.301+0000 7feed94f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.301+0000 7feed94f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.301+0000 7feed94f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:16.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.301+0000 7feed94f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.301+0000 7feed94f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.301+0000 7feed94f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.301+0000 7feed94f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:16.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.301+0000 7feed94f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.305+0000 7feed94f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:16.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.305+0000 7feed94f89c0 20 searching for the correct realm 2024-09-12T17:39:16.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.309+0000 7feed77ff640 0 -- 172.21.15.119:0/809007948 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7feecc0c7040 msgr2=0x7feecc0b9710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:16.341 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.313+0000 7feed67fd640 0 -- 172.21.15.119:0/809007948 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7feed0083b10 msgr2=0x7feed00653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:16.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:16.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:16.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:16.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:16.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:16.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:16.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:16.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:16.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 zone default found 2024-09-12T17:39:16.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 4 Realm: () 2024-09-12T17:39:16.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:16.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:16.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:16.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 zonegroup default 2024-09-12T17:39:16.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.533+0000 7feed94f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.537+0000 7feed94f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.537+0000 7feed94f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.537+0000 7feed94f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.537+0000 7feed94f89c0 20 started sync module instance, tier type = 2024-09-12T17:39:16.541 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.537+0000 7feed94f89c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:16.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.561+0000 7feed94f89c0 20 add_watcher() i=0 2024-09-12T17:39:16.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.561+0000 7feed94f89c0 20 add_watcher() i=1 2024-09-12T17:39:16.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.561+0000 7feed94f89c0 20 add_watcher() i=2 2024-09-12T17:39:16.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.561+0000 7feed94f89c0 20 add_watcher() i=3 2024-09-12T17:39:16.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.561+0000 7feed94f89c0 20 add_watcher() i=4 2024-09-12T17:39:16.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.561+0000 7feed94f89c0 20 add_watcher() i=5 2024-09-12T17:39:16.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.561+0000 7feed94f89c0 20 add_watcher() i=6 2024-09-12T17:39:16.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.565+0000 7feed94f89c0 20 add_watcher() i=7 2024-09-12T17:39:16.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.565+0000 7feed94f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:16.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.569+0000 7fed8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:16.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.569+0000 7feed94f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:16.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.569+0000 7feed94f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:16.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.569+0000 7feed94f89c0 5 note: GC not initialized 2024-09-12T17:39:16.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.569+0000 7fed07fff640 20 reqs_thread_entry: start 2024-09-12T17:39:16.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.569+0000 7feed94f89c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:16.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.569+0000 7feed94f89c0 20 Filter name: none 2024-09-12T17:39:16.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.569+0000 7fed05ffb640 20 reqs_thread_entry: start 2024-09-12T17:39:16.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.569+0000 7feed94f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.573+0000 7feed94f89c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:16.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.573+0000 7feed94f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.573+0000 7feed94f89c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:39:16.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.573+0000 7feed94f89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:16.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.573+0000 7feed94f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.573+0000 7feed94f89c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:16.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.573+0000 7feed94f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.573+0000 7feed94f89c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:39:16.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.573+0000 7feed94f89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:16.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.577+0000 7fed8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:16.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.581+0000 7feed94f89c0 20 remove_watcher() i=0 2024-09-12T17:39:16.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.581+0000 7feed94f89c0 2 removed watcher, disabling cache 2024-09-12T17:39:16.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.585+0000 7feed94f89c0 20 remove_watcher() i=1 2024-09-12T17:39:16.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.589+0000 7feed94f89c0 20 remove_watcher() i=2 2024-09-12T17:39:16.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.589+0000 7feed94f89c0 20 remove_watcher() i=3 2024-09-12T17:39:16.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.593+0000 7feed94f89c0 20 remove_watcher() i=4 2024-09-12T17:39:16.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.593+0000 7feed94f89c0 20 remove_watcher() i=5 2024-09-12T17:39:16.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.593+0000 7feed94f89c0 20 remove_watcher() i=6 2024-09-12T17:39:16.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.597+0000 7feed94f89c0 20 remove_watcher() i=7 2024-09-12T17:39:16.666 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:39:16.695 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:16.696 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:16.741 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.737+0000 7fec0b54d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.737+0000 7fec0b54d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.737+0000 7fec0b54d9c0 20 realm 2024-09-12T17:39:16.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.737+0000 7fec0b54d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.737+0000 7fec0b54d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.737+0000 7fec0b54d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:16.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.737+0000 7fec0b54d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.741+0000 7fec0b54d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.743 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.741+0000 7fec0b54d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.744 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.741+0000 7fec0b54d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:16.744 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.741+0000 7fec0b54d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.741+0000 7fec0b54d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:16.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.741+0000 7fec0b54d9c0 20 searching for the correct realm 2024-09-12T17:39:16.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.745+0000 7fec09854640 0 -- 172.21.15.119:0/3176652329 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x5561615f33f0 msgr2=0x5561615f5800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:16.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.753+0000 7fec08852640 0 -- 172.21.15.119:0/3176652329 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fec04106480 msgr2=0x7fec041299f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:16.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.969+0000 7fec0b54d9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:16.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.969+0000 7fec0b54d9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:16.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.969+0000 7fec0b54d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:16.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.969+0000 7fec0b54d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:16.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.969+0000 7fec0b54d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:16.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.969+0000 7fec0b54d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:16.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.969+0000 7fec0b54d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.969+0000 7fec0b54d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.969+0000 7fec0b54d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.973+0000 7fec0b54d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:16.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.973+0000 7fec0b54d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.973+0000 7fec0b54d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:16.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.973+0000 7fec0b54d9c0 20 zone default found 2024-09-12T17:39:16.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.973+0000 7fec0b54d9c0 4 Realm: () 2024-09-12T17:39:16.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.973+0000 7fec0b54d9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:16.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.973+0000 7fec0b54d9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:16.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.973+0000 7fec0b54d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:16.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.973+0000 7fec0b54d9c0 20 zonegroup default 2024-09-12T17:39:16.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.973+0000 7fec0b54d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.973+0000 7fec0b54d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.973+0000 7fec0b54d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.973+0000 7fec0b54d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.973+0000 7fec0b54d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:16.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.977+0000 7fec0b54d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:16.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.977+0000 7fec0b54d9c0 20 started sync module instance, tier type = 2024-09-12T17:39:16.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.977+0000 7fec0b54d9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:17.001 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.997+0000 7fec0b54d9c0 20 add_watcher() i=0 2024-09-12T17:39:17.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.997+0000 7fec0b54d9c0 20 add_watcher() i=1 2024-09-12T17:39:17.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.997+0000 7fec0b54d9c0 20 add_watcher() i=2 2024-09-12T17:39:17.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.997+0000 7fec0b54d9c0 20 add_watcher() i=3 2024-09-12T17:39:17.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.997+0000 7fec0b54d9c0 20 add_watcher() i=4 2024-09-12T17:39:17.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.997+0000 7fec0b54d9c0 20 add_watcher() i=5 2024-09-12T17:39:17.002 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:16.997+0000 7fec0b54d9c0 20 add_watcher() i=6 2024-09-12T17:39:17.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.001+0000 7fec0b54d9c0 20 add_watcher() i=7 2024-09-12T17:39:17.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.001+0000 7fec0b54d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:17.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.005+0000 7feabffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:17.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.005+0000 7fec0b54d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:17.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.005+0000 7fec0b54d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:17.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.005+0000 7fec0b54d9c0 5 note: GC not initialized 2024-09-12T17:39:17.009 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.005+0000 7feabefe5640 20 reqs_thread_entry: start 2024-09-12T17:39:17.010 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.005+0000 7fec0b54d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:17.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.005+0000 7fec0b54d9c0 20 Filter name: none 2024-09-12T17:39:17.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.005+0000 7feabcfe1640 20 reqs_thread_entry: start 2024-09-12T17:39:17.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.005+0000 7fec0b54d9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:39:17.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.005+0000 7fec0b54d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:17.011 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:17.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:39:17.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:39:17.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:39:17.012 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:39:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:39:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:39:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:39:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:39:17.013 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:39:17.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:39:17.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.009+0000 7fec0b54d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:39:17.014 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.013+0000 7fec0b54d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:39:17.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.013+0000 7fec0b54d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:39:17.015 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.013+0000 7fec0b54d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:39:17.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.013+0000 7fec0b54d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:39:17.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.013+0000 7fec0b54d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:39:17.016 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.013+0000 7fec0b54d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:39:17.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.013+0000 7fec0b54d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:39:17.017 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.013+0000 7fec0b54d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:39:17.018 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.013+0000 7fec0b54d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:39:17.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.013+0000 7fec0b54d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:39:17.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.017+0000 7fec0b54d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:39:17.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.017+0000 7fec0b54d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:39:17.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.017+0000 7fec0b54d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:39:17.019 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.017+0000 7fec0b54d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:39:17.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.017+0000 7fec0b54d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:39:17.020 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.017+0000 7fec0b54d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:39:17.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.017+0000 7fec0b54d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:39:17.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.017+0000 7fec0b54d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:39:17.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.017+0000 7fec0b54d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:39:17.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.017+0000 7fec0b54d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:39:17.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.021+0000 7feabffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:17.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.025+0000 7fec0b54d9c0 20 remove_watcher() i=0 2024-09-12T17:39:17.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.025+0000 7fec0b54d9c0 2 removed watcher, disabling cache 2024-09-12T17:39:17.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.029+0000 7fec0b54d9c0 20 remove_watcher() i=1 2024-09-12T17:39:17.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.029+0000 7fec0b54d9c0 20 remove_watcher() i=2 2024-09-12T17:39:17.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.033+0000 7fec0b54d9c0 20 remove_watcher() i=3 2024-09-12T17:39:17.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.033+0000 7fec0b54d9c0 20 remove_watcher() i=4 2024-09-12T17:39:17.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.037+0000 7fec0b54d9c0 20 remove_watcher() i=5 2024-09-12T17:39:17.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.037+0000 7fec0b54d9c0 20 remove_watcher() i=6 2024-09-12T17:39:17.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:17.037+0000 7fec0b54d9c0 20 remove_watcher() i=7 2024-09-12T17:39:47.082 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:39:47.114 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:47.114 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:47.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.160+0000 7fd6ed5fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.160+0000 7fd6ed5fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.160+0000 7fd6ed5fd9c0 20 realm 2024-09-12T17:39:47.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.160+0000 7fd6ed5fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.160+0000 7fd6ed5fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.160+0000 7fd6ed5fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:47.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.160+0000 7fd6ed5fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.160+0000 7fd6ed5fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.160+0000 7fd6ed5fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.164+0000 7fd6ed5fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:47.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.164+0000 7fd6ed5fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.164+0000 7fd6ed5fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:47.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.164+0000 7fd6ed5fd9c0 20 searching for the correct realm 2024-09-12T17:39:47.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.168+0000 7fd6eb904640 0 -- 172.21.15.119:0/3066559556 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fd6e0109050 msgr2=0x7fd6e0102440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:47.176 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.176+0000 7fd6ea902640 0 -- 172.21.15.119:0/3066559556 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fd6e4008050 msgr2=0x7fd6e4014900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:47.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.392+0000 7fd6ed5fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:47.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.392+0000 7fd6ed5fd9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:47.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.392+0000 7fd6ed5fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:47.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.392+0000 7fd6ed5fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:47.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.392+0000 7fd6ed5fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:47.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.392+0000 7fd6ed5fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:47.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.392+0000 7fd6ed5fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.396+0000 7fd6ed5fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.396+0000 7fd6ed5fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.396+0000 7fd6ed5fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:47.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.396+0000 7fd6ed5fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.396+0000 7fd6ed5fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:47.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.396+0000 7fd6ed5fd9c0 20 zone default found 2024-09-12T17:39:47.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.396+0000 7fd6ed5fd9c0 4 Realm: () 2024-09-12T17:39:47.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.396+0000 7fd6ed5fd9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:47.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.396+0000 7fd6ed5fd9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:47.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.396+0000 7fd6ed5fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:47.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.396+0000 7fd6ed5fd9c0 20 zonegroup default 2024-09-12T17:39:47.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.396+0000 7fd6ed5fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.396+0000 7fd6ed5fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.396+0000 7fd6ed5fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.396+0000 7fd6ed5fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.396+0000 7fd6ed5fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.400+0000 7fd6ed5fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.400+0000 7fd6ed5fd9c0 20 started sync module instance, tier type = 2024-09-12T17:39:47.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.400+0000 7fd6ed5fd9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:47.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.420+0000 7fd6ed5fd9c0 20 add_watcher() i=0 2024-09-12T17:39:47.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.420+0000 7fd6ed5fd9c0 20 add_watcher() i=1 2024-09-12T17:39:47.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.420+0000 7fd6ed5fd9c0 20 add_watcher() i=2 2024-09-12T17:39:47.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.420+0000 7fd6ed5fd9c0 20 add_watcher() i=3 2024-09-12T17:39:47.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.420+0000 7fd6ed5fd9c0 20 add_watcher() i=4 2024-09-12T17:39:47.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.420+0000 7fd6ed5fd9c0 20 add_watcher() i=5 2024-09-12T17:39:47.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.420+0000 7fd6ed5fd9c0 20 add_watcher() i=6 2024-09-12T17:39:47.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.420+0000 7fd6ed5fd9c0 20 add_watcher() i=7 2024-09-12T17:39:47.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.420+0000 7fd6ed5fd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:47.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.424+0000 7fd5a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:47.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.424+0000 7fd6ed5fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:47.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.424+0000 7fd6ed5fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:47.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.424+0000 7fd6ed5fd9c0 5 note: GC not initialized 2024-09-12T17:39:47.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.424+0000 7fd5a0fe1640 20 reqs_thread_entry: start 2024-09-12T17:39:47.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.424+0000 7fd6ed5fd9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:47.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.424+0000 7fd6ed5fd9c0 20 Filter name: none 2024-09-12T17:39:47.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.428+0000 7fd51a7fc640 20 reqs_thread_entry: start 2024-09-12T17:39:47.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.428+0000 7fd6ed5fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.428+0000 7fd6ed5fd9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:47.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.428+0000 7fd6ed5fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.428+0000 7fd6ed5fd9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:39:47.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.428+0000 7fd6ed5fd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:47.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.428+0000 7fd6ed5fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.429 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.428+0000 7fd6ed5fd9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:47.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.428+0000 7fd6ed5fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.428+0000 7fd6ed5fd9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:39:47.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.428+0000 7fd6ed5fd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:47.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.432+0000 7fd5a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:47.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.436+0000 7fd6ed5fd9c0 20 remove_watcher() i=0 2024-09-12T17:39:47.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.436+0000 7fd6ed5fd9c0 2 removed watcher, disabling cache 2024-09-12T17:39:47.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.440+0000 7fd6ed5fd9c0 20 remove_watcher() i=1 2024-09-12T17:39:47.442 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.440+0000 7fd6ed5fd9c0 20 remove_watcher() i=2 2024-09-12T17:39:47.445 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.444+0000 7fd6ed5fd9c0 20 remove_watcher() i=3 2024-09-12T17:39:47.447 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.448+0000 7fd6ed5fd9c0 20 remove_watcher() i=4 2024-09-12T17:39:47.448 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.448+0000 7fd6ed5fd9c0 20 remove_watcher() i=5 2024-09-12T17:39:47.449 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.448+0000 7fd6ed5fd9c0 20 remove_watcher() i=6 2024-09-12T17:39:47.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.452+0000 7fd6ed5fd9c0 20 remove_watcher() i=7 2024-09-12T17:39:47.665 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:39:47.698 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:47.698 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:47.745 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.744+0000 7fe52a8cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.744+0000 7fe52a8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.744+0000 7fe52a8cc9c0 20 realm 2024-09-12T17:39:47.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.744+0000 7fe52a8cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.746 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.744+0000 7fe52a8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.744+0000 7fe52a8cc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:47.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.744+0000 7fe52a8cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.748+0000 7fe52a8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.747 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.748+0000 7fe52a8cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.748+0000 7fe52a8cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:47.749 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.748+0000 7fe52a8cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.748+0000 7fe52a8cc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:47.750 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.748+0000 7fe52a8cc9c0 20 searching for the correct realm 2024-09-12T17:39:47.753 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.752+0000 7fe528bd3640 0 -- 172.21.15.119:0/2877213441 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fe5100cf040 msgr2=0x7fe5100ee410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:47.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:47.968+0000 7fe527bd1640 0 -- 172.21.15.119:0/2877213441 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fe52007b860 msgr2=0x7fe52005ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:48.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.184+0000 7fe52a8cc9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:48.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.188+0000 7fe52a8cc9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:48.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.188+0000 7fe52a8cc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:48.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.188+0000 7fe52a8cc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:48.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.188+0000 7fe52a8cc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:48.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.188+0000 7fe52a8cc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:48.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.188+0000 7fe52a8cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.188+0000 7fe52a8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:48.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.188+0000 7fe52a8cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.190 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.188+0000 7fe52a8cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:48.190 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.188+0000 7fe52a8cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.192+0000 7fe52a8cc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:48.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.192+0000 7fe52a8cc9c0 20 zone default found 2024-09-12T17:39:48.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.192+0000 7fe52a8cc9c0 4 Realm: () 2024-09-12T17:39:48.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.192+0000 7fe52a8cc9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:48.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.192+0000 7fe52a8cc9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:48.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.192+0000 7fe52a8cc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:48.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.192+0000 7fe52a8cc9c0 20 zonegroup default 2024-09-12T17:39:48.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.192+0000 7fe52a8cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.192+0000 7fe52a8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:48.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.192+0000 7fe52a8cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.192+0000 7fe52a8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:48.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.192+0000 7fe52a8cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.192+0000 7fe52a8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:48.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.192+0000 7fe52a8cc9c0 20 started sync module instance, tier type = 2024-09-12T17:39:48.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.192+0000 7fe52a8cc9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:48.215 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.216+0000 7fe52a8cc9c0 20 add_watcher() i=0 2024-09-12T17:39:48.215 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.216+0000 7fe52a8cc9c0 20 add_watcher() i=1 2024-09-12T17:39:48.215 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.216+0000 7fe52a8cc9c0 20 add_watcher() i=2 2024-09-12T17:39:48.215 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.216+0000 7fe52a8cc9c0 20 add_watcher() i=3 2024-09-12T17:39:48.215 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.216+0000 7fe52a8cc9c0 20 add_watcher() i=4 2024-09-12T17:39:48.215 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.216+0000 7fe52a8cc9c0 20 add_watcher() i=5 2024-09-12T17:39:48.215 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.216+0000 7fe52a8cc9c0 20 add_watcher() i=6 2024-09-12T17:39:48.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.216+0000 7fe52a8cc9c0 20 add_watcher() i=7 2024-09-12T17:39:48.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.216+0000 7fe52a8cc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:48.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.220+0000 7fe3defdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:48.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.220+0000 7fe52a8cc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:48.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.220+0000 7fe52a8cc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:48.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.220+0000 7fe52a8cc9c0 5 note: GC not initialized 2024-09-12T17:39:48.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.220+0000 7fe3ddfdb640 20 reqs_thread_entry: start 2024-09-12T17:39:48.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.220+0000 7fe52a8cc9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:48.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.220+0000 7fe52a8cc9c0 20 Filter name: none 2024-09-12T17:39:48.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.220+0000 7fe34f7fe640 20 reqs_thread_entry: start 2024-09-12T17:39:48.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.220+0000 7fe52a8cc9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:39:48.222 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.220+0000 7fe52a8cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:48.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:39:48.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:39:48.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:39:48.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:48.224 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:48.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:48.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:48.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:48.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:39:48.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:39:48.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:39:48.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:39:48.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:39:48.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:39:48.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.224+0000 7fe52a8cc9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:39:48.226 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.228+0000 7fe52a8cc9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:39:48.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.228+0000 7fe52a8cc9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:39:48.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.228+0000 7fe52a8cc9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:39:48.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.228+0000 7fe52a8cc9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:39:48.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.228+0000 7fe52a8cc9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:39:48.228 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.228+0000 7fe52a8cc9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:39:48.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.228+0000 7fe52a8cc9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:39:48.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.228+0000 7fe52a8cc9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:39:48.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.228+0000 7fe52a8cc9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:39:48.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.228+0000 7fe52a8cc9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:39:48.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.228+0000 7fe52a8cc9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:39:48.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.228+0000 7fe52a8cc9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:39:48.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.232+0000 7fe52a8cc9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:39:48.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.232+0000 7fe52a8cc9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:39:48.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.232+0000 7fe52a8cc9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:39:48.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.232+0000 7fe52a8cc9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:39:48.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.232+0000 7fe52a8cc9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:39:48.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.232+0000 7fe52a8cc9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:39:48.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.232+0000 7fe52a8cc9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:39:48.233 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.232+0000 7fe52a8cc9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:39:48.236 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.236+0000 7fe3defdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:48.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.240+0000 7fe52a8cc9c0 20 remove_watcher() i=0 2024-09-12T17:39:48.240 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.240+0000 7fe52a8cc9c0 2 removed watcher, disabling cache 2024-09-12T17:39:48.242 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.240+0000 7fe52a8cc9c0 20 remove_watcher() i=1 2024-09-12T17:39:48.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.244+0000 7fe52a8cc9c0 20 remove_watcher() i=2 2024-09-12T17:39:48.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.248+0000 7fe52a8cc9c0 20 remove_watcher() i=3 2024-09-12T17:39:48.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.248+0000 7fe52a8cc9c0 20 remove_watcher() i=4 2024-09-12T17:39:48.250 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.252+0000 7fe52a8cc9c0 20 remove_watcher() i=5 2024-09-12T17:39:48.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.252+0000 7fe52a8cc9c0 20 remove_watcher() i=6 2024-09-12T17:39:48.253 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.252+0000 7fe52a8cc9c0 20 remove_watcher() i=7 2024-09-12T17:39:48.270 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:39:48.296 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:48.296 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:48.342 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.340+0000 7fe6988c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.344+0000 7fe6988c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:48.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.344+0000 7fe6988c79c0 20 realm 2024-09-12T17:39:48.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.344+0000 7fe6988c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.344+0000 7fe6988c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:48.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.344+0000 7fe6988c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:48.344 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.344+0000 7fe6988c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.345 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.344+0000 7fe6988c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:48.345 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.344+0000 7fe6988c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.344+0000 7fe6988c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:48.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.344+0000 7fe6988c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.348+0000 7fe6988c79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:48.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.348+0000 7fe6988c79c0 20 searching for the correct realm 2024-09-12T17:39:48.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.348+0000 7fe695bcc640 0 -- 172.21.15.119:0/234636216 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7fe68802d060 msgr2=0x7fe68805c3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:48.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.560+0000 7fe696bce640 0 -- 172.21.15.119:0/234636216 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fe68c027040 msgr2=0x7fe68c063a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:48.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:48.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:48.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:48.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:48.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:48.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:48.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:48.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:48.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:48.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 zone default found 2024-09-12T17:39:48.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 4 Realm: () 2024-09-12T17:39:48.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:48.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:48.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:48.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 zonegroup default 2024-09-12T17:39:48.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:48.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.580+0000 7fe6988c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.584+0000 7fe6988c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:48.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.584+0000 7fe6988c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.584+0000 7fe6988c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:48.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.584+0000 7fe6988c79c0 20 started sync module instance, tier type = 2024-09-12T17:39:48.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.584+0000 7fe6988c79c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:48.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.604+0000 7fe6988c79c0 20 add_watcher() i=0 2024-09-12T17:39:48.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.604+0000 7fe6988c79c0 20 add_watcher() i=1 2024-09-12T17:39:48.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.604+0000 7fe6988c79c0 20 add_watcher() i=2 2024-09-12T17:39:48.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.604+0000 7fe6988c79c0 20 add_watcher() i=3 2024-09-12T17:39:48.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.604+0000 7fe6988c79c0 20 add_watcher() i=4 2024-09-12T17:39:48.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.604+0000 7fe6988c79c0 20 add_watcher() i=5 2024-09-12T17:39:48.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.604+0000 7fe6988c79c0 20 add_watcher() i=6 2024-09-12T17:39:48.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.604+0000 7fe6988c79c0 20 add_watcher() i=7 2024-09-12T17:39:48.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.604+0000 7fe6988c79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:48.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.612+0000 7fe54cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:48.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.612+0000 7fe6988c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:48.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.612+0000 7fe6988c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:48.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.612+0000 7fe6988c79c0 5 note: GC not initialized 2024-09-12T17:39:48.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.612+0000 7fe4c77fe640 20 reqs_thread_entry: start 2024-09-12T17:39:48.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.612+0000 7fe6988c79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:48.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.612+0000 7fe6988c79c0 20 Filter name: none 2024-09-12T17:39:48.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.612+0000 7fe4c57fa640 20 reqs_thread_entry: start 2024-09-12T17:39:48.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.612+0000 7fe6988c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.615 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.616+0000 7fe6988c79c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:48.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.616+0000 7fe6988c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.616+0000 7fe6988c79c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:48.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.616+0000 7fe6988c79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:48.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.616+0000 7fe6988c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.616+0000 7fe6988c79c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:48.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.616+0000 7fe6988c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.616+0000 7fe6988c79c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:48.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.616+0000 7fe6988c79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:48.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.620+0000 7fe54cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:48.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.624+0000 7fe6988c79c0 20 remove_watcher() i=0 2024-09-12T17:39:48.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.624+0000 7fe6988c79c0 2 removed watcher, disabling cache 2024-09-12T17:39:48.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.624+0000 7fe6988c79c0 20 remove_watcher() i=1 2024-09-12T17:39:48.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.628+0000 7fe6988c79c0 20 remove_watcher() i=2 2024-09-12T17:39:48.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.628+0000 7fe6988c79c0 20 remove_watcher() i=3 2024-09-12T17:39:48.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.632+0000 7fe6988c79c0 20 remove_watcher() i=4 2024-09-12T17:39:48.634 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.632+0000 7fe6988c79c0 20 remove_watcher() i=5 2024-09-12T17:39:48.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.636+0000 7fe6988c79c0 20 remove_watcher() i=6 2024-09-12T17:39:48.636 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.636+0000 7fe6988c79c0 20 remove_watcher() i=7 2024-09-12T17:39:48.650 INFO:tasks.workunit.client.0.smithi119.stderr: test: duplicated entries should be purged before reshard 2024-09-12T17:39:48.650 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:39:48.678 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:48.678 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:48.935 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.936+0000 7f6c82d3d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.936+0000 7f6c82d3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:48.937 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.936+0000 7f6c82d3d9c0 20 realm 2024-09-12T17:39:48.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.936+0000 7f6c82d3d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.936+0000 7f6c82d3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:48.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.936+0000 7f6c82d3d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:48.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.936+0000 7f6c82d3d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.936+0000 7f6c82d3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:48.938 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.936+0000 7f6c82d3d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.939 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.940+0000 7f6c82d3d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:48.940 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.940+0000 7f6c82d3d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:48.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.940+0000 7f6c82d3d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:48.941 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.940+0000 7f6c82d3d9c0 20 searching for the correct realm 2024-09-12T17:39:48.944 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:48.944+0000 7f6c81044640 0 -- 172.21.15.119:0/4055755375 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f6c740c8020 msgr2=0x7f6c740ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:49.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.160+0000 7f6c80042640 0 -- 172.21.15.119:0/4055755375 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f6c78059040 msgr2=0x7f6c78018950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:49.377 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.376+0000 7f6c82d3d9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:49.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.376+0000 7f6c82d3d9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:49.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.376+0000 7f6c82d3d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:49.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.376+0000 7f6c82d3d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:49.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.376+0000 7f6c82d3d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:49.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.376+0000 7f6c82d3d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:49.378 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.376+0000 7f6c82d3d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.376+0000 7f6c82d3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.376+0000 7f6c82d3d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.376+0000 7f6c82d3d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:49.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.376+0000 7f6c82d3d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.380+0000 7f6c82d3d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:49.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.380+0000 7f6c82d3d9c0 20 zone default found 2024-09-12T17:39:49.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.380+0000 7f6c82d3d9c0 4 Realm: () 2024-09-12T17:39:49.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.380+0000 7f6c82d3d9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:49.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.380+0000 7f6c82d3d9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:49.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.380+0000 7f6c82d3d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:49.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.380+0000 7f6c82d3d9c0 20 zonegroup default 2024-09-12T17:39:49.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.380+0000 7f6c82d3d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.380+0000 7f6c82d3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.380+0000 7f6c82d3d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.380+0000 7f6c82d3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.380+0000 7f6c82d3d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.380+0000 7f6c82d3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.380+0000 7f6c82d3d9c0 20 started sync module instance, tier type = 2024-09-12T17:39:49.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.380+0000 7f6c82d3d9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:49.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.404+0000 7f6c82d3d9c0 20 add_watcher() i=0 2024-09-12T17:39:49.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.404+0000 7f6c82d3d9c0 20 add_watcher() i=1 2024-09-12T17:39:49.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.404+0000 7f6c82d3d9c0 20 add_watcher() i=2 2024-09-12T17:39:49.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.404+0000 7f6c82d3d9c0 20 add_watcher() i=3 2024-09-12T17:39:49.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.404+0000 7f6c82d3d9c0 20 add_watcher() i=4 2024-09-12T17:39:49.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.404+0000 7f6c82d3d9c0 20 add_watcher() i=5 2024-09-12T17:39:49.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.404+0000 7f6c82d3d9c0 20 add_watcher() i=6 2024-09-12T17:39:49.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.408+0000 7f6c82d3d9c0 20 add_watcher() i=7 2024-09-12T17:39:49.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.408+0000 7f6c82d3d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:49.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.412+0000 7f6b36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:49.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.412+0000 7f6c82d3d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:49.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.412+0000 7f6c82d3d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:49.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.412+0000 7f6c82d3d9c0 5 note: GC not initialized 2024-09-12T17:39:49.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.412+0000 7f6b35fe3640 20 reqs_thread_entry: start 2024-09-12T17:39:49.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.412+0000 7f6c82d3d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:49.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.416+0000 7f6c82d3d9c0 20 Filter name: none 2024-09-12T17:39:49.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.416+0000 7f6aa77fe640 20 reqs_thread_entry: start 2024-09-12T17:39:49.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.416+0000 7f6c82d3d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.416+0000 7f6c82d3d9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:49.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.416+0000 7f6c82d3d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.416+0000 7f6c82d3d9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:49.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.416+0000 7f6c82d3d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:49.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.416+0000 7f6c82d3d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.416+0000 7f6c82d3d9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:49.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.416+0000 7f6c82d3d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.420+0000 7f6c82d3d9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:49.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.420+0000 7f6c82d3d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:49.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.424+0000 7f6b36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:49.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.428+0000 7f6c82d3d9c0 20 remove_watcher() i=0 2024-09-12T17:39:49.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.428+0000 7f6c82d3d9c0 2 removed watcher, disabling cache 2024-09-12T17:39:49.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.428+0000 7f6c82d3d9c0 20 remove_watcher() i=1 2024-09-12T17:39:49.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.432+0000 7f6c82d3d9c0 20 remove_watcher() i=2 2024-09-12T17:39:49.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.432+0000 7f6c82d3d9c0 20 remove_watcher() i=3 2024-09-12T17:39:49.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.436+0000 7f6c82d3d9c0 20 remove_watcher() i=4 2024-09-12T17:39:49.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.436+0000 7f6c82d3d9c0 20 remove_watcher() i=5 2024-09-12T17:39:49.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.440+0000 7f6c82d3d9c0 20 remove_watcher() i=6 2024-09-12T17:39:49.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.440+0000 7f6c82d3d9c0 20 remove_watcher() i=7 2024-09-12T17:39:49.455 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.455 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:39:49.455 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: a-bucket id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-12T17:39:49.455 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.455 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:39:49.487 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:49.487 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:49.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.532+0000 7f54083559c0 20 realm 2024-09-12T17:39:49.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.532+0000 7f54083559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:49.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.536+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:49.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.536+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.536+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:49.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.536+0000 7f54083559c0 20 searching for the correct realm 2024-09-12T17:39:49.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.540+0000 7f540565a640 0 -- 172.21.15.119:0/3525528362 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f53f8017070 msgr2=0x7f53f8017960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:49.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.548+0000 7f540565a640 0 -- 172.21.15.119:0/3525528362 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f5400023040 msgr2=0x7f540006a630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:49.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:49.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:49.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:49.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:49.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:49.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:49.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.764+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.764+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.764+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:49.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:49.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.768+0000 7f54083559c0 20 zone default found 2024-09-12T17:39:49.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.768+0000 7f54083559c0 4 Realm: () 2024-09-12T17:39:49.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.768+0000 7f54083559c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:49.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.768+0000 7f54083559c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:49.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.768+0000 7f54083559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:49.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.768+0000 7f54083559c0 20 zonegroup default 2024-09-12T17:39:49.769 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.770 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.770 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.770 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.770 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.772+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.772+0000 7f54083559c0 20 started sync module instance, tier type = 2024-09-12T17:39:49.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.772+0000 7f54083559c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:49.793 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=0 2024-09-12T17:39:49.793 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=1 2024-09-12T17:39:49.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=2 2024-09-12T17:39:49.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=3 2024-09-12T17:39:49.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=4 2024-09-12T17:39:49.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=5 2024-09-12T17:39:49.794 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=6 2024-09-12T17:39:49.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.796+0000 7f54083559c0 20 add_watcher() i=7 2024-09-12T17:39:49.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.796+0000 7f54083559c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:49.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.800+0000 7f52bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:49.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.800+0000 7f54083559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:49.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.800+0000 7f54083559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:49.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.800+0000 7f54083559c0 5 note: GC not initialized 2024-09-12T17:39:49.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.800+0000 7f52bafe5640 20 reqs_thread_entry: start 2024-09-12T17:39:49.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.800+0000 7f54083559c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:49.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.800+0000 7f54083559c0 20 Filter name: none 2024-09-12T17:39:49.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.800+0000 7f52b8fe1640 20 reqs_thread_entry: start 2024-09-12T17:39:49.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.800+0000 7f54083559c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:39:49.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.800+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.800+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:49.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.800+0000 7f54083559c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:39:49.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.800+0000 7f54083559c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:39:49.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.800+0000 7f54083559c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:39:49.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.804+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.803 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.804+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:49.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.804+0000 7f54083559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:49.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.804+0000 7f54083559c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:49.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.804+0000 7f54083559c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:49.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.804+0000 7f54083559c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:49.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.804+0000 7f54083559c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:39:49.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.812+0000 7f54083559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:49.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.812+0000 7f54083559c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:49.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.812+0000 7f54083559c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:49.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.812+0000 7f54083559c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:39:49.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.812+0000 7f52e8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333537 cookie 94741418042208 notifier 7796 bl.length()=911 2024-09-12T17:39:49.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.812+0000 7f52e8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:49.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.812+0000 7f52e8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:49.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.812+0000 7f52e8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:49.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.816+0000 7f54083559c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:39:49.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.816+0000 7f54083559c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:39:49.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.816+0000 7f54083559c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:39:49.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.816+0000 7f54083559c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:39:49.827 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f54083559c0 time 2024-09-12T17:39:49.829731+0000 2024-09-12T17:39:49.827 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:39:49.828 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:39:49.828 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f540bc2f2eb] 2024-09-12T17:39:49.828 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f540bc2f49f] 2024-09-12T17:39:49.828 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562ab17ca0c1] 2024-09-12T17:39:49.828 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562ab17dc1fa] 2024-09-12T17:39:49.829 INFO:tasks.workunit.client.0.smithi119.stderr: 5: main() 2024-09-12T17:39:49.829 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f540aa95d90] 2024-09-12T17:39:49.829 INFO:tasks.workunit.client.0.smithi119.stderr: 7: __libc_start_main() 2024-09-12T17:39:49.829 INFO:tasks.workunit.client.0.smithi119.stderr: 8: _start() 2024-09-12T17:39:49.829 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.828+0000 7f54083559c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f54083559c0 time 2024-09-12T17:39:49.829731+0000 2024-09-12T17:39:49.829 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:39:49.829 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.829 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:39:49.829 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f540bc2f2eb] 2024-09-12T17:39:49.829 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f540bc2f49f] 2024-09-12T17:39:49.829 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562ab17ca0c1] 2024-09-12T17:39:49.829 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562ab17dc1fa] 2024-09-12T17:39:49.829 INFO:tasks.workunit.client.0.smithi119.stderr: 5: main() 2024-09-12T17:39:49.830 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f540aa95d90] 2024-09-12T17:39:49.830 INFO:tasks.workunit.client.0.smithi119.stderr: 7: __libc_start_main() 2024-09-12T17:39:49.830 INFO:tasks.workunit.client.0.smithi119.stderr: 8: _start() 2024-09-12T17:39:49.830 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.830 INFO:tasks.workunit.client.0.smithi119.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:39:49.830 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f54083559c0 thread_name:radosgw-admin 2024-09-12T17:39:49.842 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:39:49.842 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f540aaae520] 2024-09-12T17:39:49.842 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:39:49.843 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:39:49.843 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:39:49.843 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f540bc2f345] 2024-09-12T17:39:49.843 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f540bc2f49f] 2024-09-12T17:39:49.843 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562ab17ca0c1] 2024-09-12T17:39:49.843 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562ab17dc1fa] 2024-09-12T17:39:49.843 INFO:tasks.workunit.client.0.smithi119.stderr: 9: main() 2024-09-12T17:39:49.843 INFO:tasks.workunit.client.0.smithi119.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f540aa95d90] 2024-09-12T17:39:49.843 INFO:tasks.workunit.client.0.smithi119.stderr: 11: __libc_start_main() 2024-09-12T17:39:49.843 INFO:tasks.workunit.client.0.smithi119.stderr: 12: _start() 2024-09-12T17:39:49.843 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.828+0000 7f54083559c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:39:49.843 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f54083559c0 thread_name:radosgw-admin 2024-09-12T17:39:49.843 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.844 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:39:49.844 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f540aaae520] 2024-09-12T17:39:49.844 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:39:49.844 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:39:49.844 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:39:49.844 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f540bc2f345] 2024-09-12T17:39:49.844 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f540bc2f49f] 2024-09-12T17:39:49.844 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562ab17ca0c1] 2024-09-12T17:39:49.844 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562ab17dc1fa] 2024-09-12T17:39:49.844 INFO:tasks.workunit.client.0.smithi119.stderr: 9: main() 2024-09-12T17:39:49.845 INFO:tasks.workunit.client.0.smithi119.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f540aa95d90] 2024-09-12T17:39:49.845 INFO:tasks.workunit.client.0.smithi119.stderr: 11: __libc_start_main() 2024-09-12T17:39:49.845 INFO:tasks.workunit.client.0.smithi119.stderr: 12: _start() 2024-09-12T17:39:49.845 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:39:49.845 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.845 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:39:49.845 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:39:49.508+0000 7f5405e5b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:39:49.845 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.845 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:39:49.845 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: dump: 2024-09-12T17:39:49.845 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.845 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.846 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.846 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.846 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.846 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.846 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.846 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.847 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.847 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.847 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: _finish_auth 0 2024-09-12T17:39:49.847 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: _check_auth_tickets 2024-09-12T17:39:49.847 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:49.847 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.847 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:39:49.847 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: dump: 2024-09-12T17:39:49.847 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.847 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.847 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.847 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.848 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.848 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.848 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.848 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.848 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.848 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.848 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 monclient: authenticate success, global_id 8259 2024-09-12T17:39:49.848 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:39:49.508+0000 7f54083559c0 10 monclient: get_monmap_and_config success 2024-09-12T17:39:49.849 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:39:49.508+0000 7f54083559c0 4 set_mon_vals no callback set 2024-09-12T17:39:49.849 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:39:49.508+0000 7f54083559c0 10 monclient: shutdown 2024-09-12T17:39:49.849 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 asok(0x562ab460d2b0) unregister_commands rotate-key 2024-09-12T17:39:49.849 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:39:49.508+0000 7f54083559c0 10 monclient: build_initial_monmap 2024-09-12T17:39:49.849 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:39:49.508+0000 7f54083559c0 1 build_initial for_mkfs: 0 2024-09-12T17:39:49.849 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:39:49.508+0000 7f54083559c0 10 monclient: monmap: 2024-09-12T17:39:49.849 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:39:49.849 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:39:49.849 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:39:49.849 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:39:49.849 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:39:49.849 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.849 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:39:49.850 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:39:49.850 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:39:49.850 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.850 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding auth protocol: cephx 2024-09-12T17:39:49.850 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding auth protocol: cephx 2024-09-12T17:39:49.850 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding auth protocol: cephx 2024-09-12T17:39:49.850 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: secure 2024-09-12T17:39:49.850 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: crc 2024-09-12T17:39:49.850 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: secure 2024-09-12T17:39:49.850 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: crc 2024-09-12T17:39:49.850 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: secure 2024-09-12T17:39:49.850 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: crc 2024-09-12T17:39:49.850 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: crc 2024-09-12T17:39:49.850 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: secure 2024-09-12T17:39:49.851 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: crc 2024-09-12T17:39:49.851 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: secure 2024-09-12T17:39:49.851 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: crc 2024-09-12T17:39:49.851 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: secure 2024-09-12T17:39:49.851 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:39:49.508+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.851 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:39:49.508+0000 7f54083559c0 1 librados: starting msgr at 2024-09-12T17:39:49.851 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:39:49.508+0000 7f54083559c0 1 librados: starting objecter 2024-09-12T17:39:49.851 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command objecter_requests hook 0x562ab4843710 2024-09-12T17:39:49.851 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:39:49.512+0000 7f54083559c0 1 librados: setting wanted keys 2024-09-12T17:39:49.851 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:39:49.512+0000 7f54083559c0 1 librados: calling monclient init 2024-09-12T17:39:49.851 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient: init 2024-09-12T17:39:49.851 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding auth protocol: cephx 2024-09-12T17:39:49.851 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding auth protocol: cephx 2024-09-12T17:39:49.852 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding auth protocol: cephx 2024-09-12T17:39:49.852 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: secure 2024-09-12T17:39:49.852 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: crc 2024-09-12T17:39:49.852 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: secure 2024-09-12T17:39:49.852 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: crc 2024-09-12T17:39:49.852 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: secure 2024-09-12T17:39:49.852 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: crc 2024-09-12T17:39:49.852 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: crc 2024-09-12T17:39:49.852 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: secure 2024-09-12T17:39:49.852 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: crc 2024-09-12T17:39:49.852 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: secure 2024-09-12T17:39:49.852 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: crc 2024-09-12T17:39:49.853 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: secure 2024-09-12T17:39:49.853 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:39:49.512+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.853 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:39:49.512+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.853 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command rotate-key hook 0x562ab4818678 2024-09-12T17:39:49.853 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient: _reopen_session rank -1 2024-09-12T17:39:49.853 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:39:49.853 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-b con 0x562ab46c8e30 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:39:49.853 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-c con 0x562ab475e1f0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:39:49.853 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-a con 0x562ab475e5d0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:39:49.853 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.853 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.853 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.853 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient(hunting): _renew_subs 2024-09-12T17:39:49.854 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient(hunting): authenticate will time out at 2757.544646s 2024-09-12T17:39:49.854 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient(hunting): get_auth_request con 0x562ab475e1f0 auth_method 0 2024-09-12T17:39:49.854 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.854 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.854 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.854 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:39:49.512+0000 7f540665c640 10 monclient(hunting): get_auth_request con 0x562ab475e5d0 auth_method 0 2024-09-12T17:39:49.854 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:39:49.512+0000 7f540665c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.854 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:39:49.512+0000 7f540665c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.854 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:39:49.512+0000 7f540665c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.854 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:49.854 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:49.854 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:49.854 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:39:49.512+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:49.855 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:39:49.512+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:49.855 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:39:49.512+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:49.855 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:39:49.512+0000 7f5405e5b640 10 monclient(hunting): get_auth_request con 0x562ab46c8e30 auth_method 0 2024-09-12T17:39:49.855 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:39:49.512+0000 7f5405e5b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.855 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:39:49.512+0000 7f5405e5b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.855 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:39:49.512+0000 7f5405e5b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.855 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient(hunting): handle_auth_done global_id 7787 payload 824 2024-09-12T17:39:49.855 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient: _finish_hunting 0 2024-09-12T17:39:49.855 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:39:49.512+0000 7f540565a640 1 monclient: found mon.noname-c 2024-09-12T17:39:49.855 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:39:49.855 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.855 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:39:49.855 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: dump: 2024-09-12T17:39:49.856 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.856 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.856 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.856 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.856 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.856 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.856 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.856 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.856 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.856 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.856 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: _finish_auth 0 2024-09-12T17:39:49.856 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: _check_auth_tickets 2024-09-12T17:39:49.856 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:49.856 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.857 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:39:49.857 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: dump: 2024-09-12T17:39:49.857 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.857 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.857 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.857 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.857 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.857 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.857 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.857 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.857 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.857 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.857 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:39:49.512+0000 7f52f3e07640 4 set_mon_vals no callback set 2024-09-12T17:39:49.857 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 monclient: authenticate success, global_id 7787 2024-09-12T17:39:49.858 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient: _renew_subs 2024-09-12T17:39:49.858 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:39:49.858 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient: _renew_subs 2024-09-12T17:39:49.858 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:39:49.858 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:39:49.512+0000 7f54083559c0 1 librados: init done 2024-09-12T17:39:49.858 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:39:49.512+0000 7f52f2604640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:39:49.858 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:39:49.512+0000 7f52f2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:49.858 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:39:49.512+0000 7f52f2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:49.858 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:39:49.516+0000 7f5405e5b640 10 monclient: get_auth_request con 0x7f52ec070ae0 auth_method 0 2024-09-12T17:39:49.858 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:39:49.516+0000 7f540665c640 10 monclient: get_auth_request con 0x562ab4860510 auth_method 0 2024-09-12T17:39:49.858 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:39:49.516+0000 7f5405e5b640 10 monclient: get_auth_request con 0x562ab48636f0 auth_method 0 2024-09-12T17:39:49.858 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:39:49.516+0000 7f540565a640 10 monclient: get_auth_request con 0x562ab48678e0 auth_method 0 2024-09-12T17:39:49.858 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:39:49.520+0000 7f540665c640 10 monclient: get_auth_request con 0x562ab4866f70 auth_method 0 2024-09-12T17:39:49.859 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient: build_initial_monmap 2024-09-12T17:39:49.859 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:39:49.520+0000 7f54083559c0 1 build_initial for_mkfs: 0 2024-09-12T17:39:49.859 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient: monmap: 2024-09-12T17:39:49.859 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:39:49.859 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:39:49.859 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:39:49.859 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:39:49.859 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:39:49.859 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.859 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:39:49.859 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:39:49.859 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:39:49.859 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.859 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding auth protocol: cephx 2024-09-12T17:39:49.860 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding auth protocol: cephx 2024-09-12T17:39:49.860 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding auth protocol: cephx 2024-09-12T17:39:49.860 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: secure 2024-09-12T17:39:49.860 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: crc 2024-09-12T17:39:49.860 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: secure 2024-09-12T17:39:49.860 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: crc 2024-09-12T17:39:49.860 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: secure 2024-09-12T17:39:49.860 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: crc 2024-09-12T17:39:49.860 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: crc 2024-09-12T17:39:49.860 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: secure 2024-09-12T17:39:49.860 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: crc 2024-09-12T17:39:49.860 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: secure 2024-09-12T17:39:49.860 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: crc 2024-09-12T17:39:49.861 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: secure 2024-09-12T17:39:49.861 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:39:49.520+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.861 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562ab4873140 EEXIST 2024-09-12T17:39:49.861 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient: init 2024-09-12T17:39:49.861 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding auth protocol: cephx 2024-09-12T17:39:49.861 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding auth protocol: cephx 2024-09-12T17:39:49.861 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding auth protocol: cephx 2024-09-12T17:39:49.861 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: secure 2024-09-12T17:39:49.861 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: crc 2024-09-12T17:39:49.861 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: secure 2024-09-12T17:39:49.861 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: crc 2024-09-12T17:39:49.861 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: secure 2024-09-12T17:39:49.861 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: crc 2024-09-12T17:39:49.861 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: crc 2024-09-12T17:39:49.862 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: secure 2024-09-12T17:39:49.862 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: crc 2024-09-12T17:39:49.862 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: secure 2024-09-12T17:39:49.862 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: crc 2024-09-12T17:39:49.862 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: secure 2024-09-12T17:39:49.862 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:39:49.520+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.862 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:39:49.520+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.862 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command rotate-key cmddesc rotate-key hook 0x562ab486e7e0 EEXIST 2024-09-12T17:39:49.862 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient: _reopen_session rank -1 2024-09-12T17:39:49.862 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:39:49.862 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-a con 0x562ab48972f0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:39:49.862 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-c con 0x562ab4896c20 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:39:49.862 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-b con 0x562ab4895600 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:39:49.863 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.863 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.863 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.863 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient(hunting): _renew_subs 2024-09-12T17:39:49.863 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient(hunting): authenticate will time out at 2757.555966s 2024-09-12T17:39:49.863 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient(hunting): get_auth_request con 0x562ab48972f0 auth_method 0 2024-09-12T17:39:49.863 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.863 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.863 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.863 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:39:49.524+0000 7f540665c640 10 monclient(hunting): get_auth_request con 0x562ab4896c20 auth_method 0 2024-09-12T17:39:49.863 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:39:49.524+0000 7f540665c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.863 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:39:49.524+0000 7f540665c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.863 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:39:49.524+0000 7f540665c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.863 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:49.864 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:49.864 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:49.864 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:39:49.524+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:49.864 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:39:49.524+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:49.864 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:39:49.524+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:49.864 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:39:49.524+0000 7f5405e5b640 10 monclient(hunting): get_auth_request con 0x562ab4895600 auth_method 0 2024-09-12T17:39:49.864 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:39:49.524+0000 7f5405e5b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.864 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:39:49.524+0000 7f5405e5b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.864 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:39:49.524+0000 7f5405e5b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.864 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient(hunting): handle_auth_done global_id 8265 payload 824 2024-09-12T17:39:49.864 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient: _finish_hunting 0 2024-09-12T17:39:49.864 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:39:49.524+0000 7f540565a640 1 monclient: found mon.noname-a 2024-09-12T17:39:49.865 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:39:49.865 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.865 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:39:49.865 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: dump: 2024-09-12T17:39:49.865 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.865 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.865 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.865 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.865 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.865 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.865 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.865 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.865 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.865 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.866 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: _finish_auth 0 2024-09-12T17:39:49.866 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:39:49.866 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:49.866 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.866 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:39:49.866 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: dump: 2024-09-12T17:39:49.866 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.866 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.866 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.866 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.866 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.866 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.866 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.866 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.867 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.867 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.867 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:39:49.524+0000 7f5406e5d640 4 set_mon_vals no callback set 2024-09-12T17:39:49.867 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 monclient: authenticate success, global_id 8265 2024-09-12T17:39:49.867 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:39:49.524+0000 7f54083559c0 10 monclient: _renew_subs 2024-09-12T17:39:49.867 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:39:49.524+0000 7f54083559c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:39:49.867 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:39:49.524+0000 7f54083559c0 10 monclient: _renew_subs 2024-09-12T17:39:49.867 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:39:49.524+0000 7f54083559c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:39:49.867 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:39:49.867 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:49.867 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:49.867 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:39:49.524+0000 7f54083559c0 10 monclient: get_monmap_and_config 2024-09-12T17:39:49.867 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:39:49.524+0000 7f54083559c0 10 monclient: build_initial_monmap 2024-09-12T17:39:49.868 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:39:49.524+0000 7f54083559c0 1 build_initial for_mkfs: 0 2024-09-12T17:39:49.868 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:39:49.524+0000 7f54083559c0 10 monclient: monmap: 2024-09-12T17:39:49.868 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:39:49.868 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:39:49.868 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:39:49.868 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:39:49.868 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:39:49.868 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.868 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:39:49.868 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:39:49.868 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:39:49.868 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.868 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding auth protocol: cephx 2024-09-12T17:39:49.869 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding auth protocol: cephx 2024-09-12T17:39:49.869 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding auth protocol: cephx 2024-09-12T17:39:49.869 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: secure 2024-09-12T17:39:49.869 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: crc 2024-09-12T17:39:49.869 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: secure 2024-09-12T17:39:49.869 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: crc 2024-09-12T17:39:49.869 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: secure 2024-09-12T17:39:49.869 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: crc 2024-09-12T17:39:49.869 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: crc 2024-09-12T17:39:49.869 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: secure 2024-09-12T17:39:49.869 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: crc 2024-09-12T17:39:49.869 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: secure 2024-09-12T17:39:49.869 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: crc 2024-09-12T17:39:49.869 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: secure 2024-09-12T17:39:49.870 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:39:49.524+0000 7f540665c640 10 monclient: get_auth_request con 0x7f52e0070a20 auth_method 0 2024-09-12T17:39:49.870 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:39:49.524+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.870 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:39:49.524+0000 7f54083559c0 10 monclient: init 2024-09-12T17:39:49.870 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding auth protocol: cephx 2024-09-12T17:39:49.870 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding auth protocol: cephx 2024-09-12T17:39:49.870 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding auth protocol: cephx 2024-09-12T17:39:49.870 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: secure 2024-09-12T17:39:49.870 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: crc 2024-09-12T17:39:49.870 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: secure 2024-09-12T17:39:49.870 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: crc 2024-09-12T17:39:49.870 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: secure 2024-09-12T17:39:49.870 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: crc 2024-09-12T17:39:49.870 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: crc 2024-09-12T17:39:49.870 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: secure 2024-09-12T17:39:49.871 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: crc 2024-09-12T17:39:49.871 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: secure 2024-09-12T17:39:49.871 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: crc 2024-09-12T17:39:49.871 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: secure 2024-09-12T17:39:49.871 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:39:49.528+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.871 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:39:49.528+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.871 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe8b55fbe8 EEXIST 2024-09-12T17:39:49.871 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: _reopen_session rank -1 2024-09-12T17:39:49.871 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:39:49.871 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-a con 0x562ab48ead30 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:39:49.871 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-c con 0x562ab48eb110 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:39:49.871 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-b con 0x562ab48e54b0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:39:49.871 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.872 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.872 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.872 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): _renew_subs 2024-09-12T17:39:49.872 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): authenticate will time out at 2757.560578s 2024-09-12T17:39:49.872 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): get_auth_request con 0x562ab48ead30 auth_method 0 2024-09-12T17:39:49.872 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.872 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.872 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.872 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): get_auth_request con 0x562ab48eb110 auth_method 0 2024-09-12T17:39:49.872 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.872 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.872 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.872 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:49.873 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:49.873 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:49.873 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:49.873 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:49.873 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:49.873 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): handle_auth_done global_id 7793 payload 274 2024-09-12T17:39:49.873 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient: _finish_hunting 0 2024-09-12T17:39:49.873 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:39:49.528+0000 7f540665c640 1 monclient: found mon.noname-c 2024-09-12T17:39:49.873 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:39:49.873 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:39:49.528+0000 7f5405e5b640 10 monclient: get_auth_request con 0x562ab48e54b0 auth_method 0 2024-09-12T17:39:49.873 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.873 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:39:49.873 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: dump: 2024-09-12T17:39:49.874 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.874 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.874 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.874 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.874 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.874 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.874 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.874 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.874 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.874 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.874 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: _finish_auth 0 2024-09-12T17:39:49.874 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: _check_auth_tickets 2024-09-12T17:39:49.874 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:49.874 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.875 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:39:49.875 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: dump: 2024-09-12T17:39:49.875 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.875 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.875 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.875 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.875 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.875 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.875 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.875 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.875 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.875 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.875 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 monclient: authenticate success, global_id 7793 2024-09-12T17:39:49.875 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: get_monmap_and_config success 2024-09-12T17:39:49.876 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:39:49.528+0000 7f54083559c0 4 set_mon_vals no callback set 2024-09-12T17:39:49.876 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: shutdown 2024-09-12T17:39:49.876 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: build_initial_monmap 2024-09-12T17:39:49.876 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:39:49.528+0000 7f54083559c0 1 build_initial for_mkfs: 0 2024-09-12T17:39:49.876 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: monmap: 2024-09-12T17:39:49.876 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:39:49.876 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:39:49.876 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:39:49.876 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:39:49.876 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:39:49.876 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.876 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:39:49.876 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:39:49.877 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:39:49.877 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.877 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding auth protocol: cephx 2024-09-12T17:39:49.877 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding auth protocol: cephx 2024-09-12T17:39:49.877 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding auth protocol: cephx 2024-09-12T17:39:49.877 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: secure 2024-09-12T17:39:49.877 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: crc 2024-09-12T17:39:49.877 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: secure 2024-09-12T17:39:49.877 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: crc 2024-09-12T17:39:49.877 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: secure 2024-09-12T17:39:49.877 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: crc 2024-09-12T17:39:49.877 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: crc 2024-09-12T17:39:49.877 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: secure 2024-09-12T17:39:49.877 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: crc 2024-09-12T17:39:49.878 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: secure 2024-09-12T17:39:49.878 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: crc 2024-09-12T17:39:49.878 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: secure 2024-09-12T17:39:49.878 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:39:49.528+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.878 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:39:49.528+0000 7f54083559c0 1 librados: starting msgr at 2024-09-12T17:39:49.878 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:39:49.528+0000 7f54083559c0 1 librados: starting objecter 2024-09-12T17:39:49.878 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562ab48ddee0 EEXIST 2024-09-12T17:39:49.878 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:39:49.528+0000 7f54083559c0 1 librados: setting wanted keys 2024-09-12T17:39:49.878 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:39:49.528+0000 7f54083559c0 1 librados: calling monclient init 2024-09-12T17:39:49.878 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: init 2024-09-12T17:39:49.878 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding auth protocol: cephx 2024-09-12T17:39:49.878 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding auth protocol: cephx 2024-09-12T17:39:49.878 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding auth protocol: cephx 2024-09-12T17:39:49.879 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: secure 2024-09-12T17:39:49.879 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: crc 2024-09-12T17:39:49.879 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: secure 2024-09-12T17:39:49.879 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: crc 2024-09-12T17:39:49.879 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: secure 2024-09-12T17:39:49.879 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: crc 2024-09-12T17:39:49.879 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: crc 2024-09-12T17:39:49.879 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: secure 2024-09-12T17:39:49.879 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: crc 2024-09-12T17:39:49.879 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: secure 2024-09-12T17:39:49.880 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: crc 2024-09-12T17:39:49.880 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: secure 2024-09-12T17:39:49.880 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:39:49.528+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.880 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:39:49.528+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.880 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command rotate-key cmddesc rotate-key hook 0x562ab4899258 EEXIST 2024-09-12T17:39:49.880 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: _reopen_session rank -1 2024-09-12T17:39:49.880 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:39:49.880 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-a con 0x562ab48e54b0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:39:49.880 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-c con 0x562ab48ead30 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:39:49.880 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-b con 0x562ab48e26b0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:39:49.880 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.880 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.880 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.881 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): _renew_subs 2024-09-12T17:39:49.881 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): authenticate will time out at 2757.563337s 2024-09-12T17:39:49.881 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): get_auth_request con 0x562ab48e54b0 auth_method 0 2024-09-12T17:39:49.881 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.881 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.881 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.881 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): get_auth_request con 0x562ab48ead30 auth_method 0 2024-09-12T17:39:49.881 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.881 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.881 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.881 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:49.881 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:49.881 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:49.882 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:49.882 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:49.882 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:49.882 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): handle_auth_done global_id 7796 payload 824 2024-09-12T17:39:49.882 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient: _finish_hunting 0 2024-09-12T17:39:49.882 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:39:49.528+0000 7f540665c640 1 monclient: found mon.noname-c 2024-09-12T17:39:49.882 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:39:49.882 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:39:49.528+0000 7f5405e5b640 10 monclient: get_auth_request con 0x562ab48e26b0 auth_method 0 2024-09-12T17:39:49.882 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.882 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:39:49.882 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: dump: 2024-09-12T17:39:49.882 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.882 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.882 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.883 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.883 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.883 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.883 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.883 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.883 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.883 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.883 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: _finish_auth 0 2024-09-12T17:39:49.883 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: _check_auth_tickets 2024-09-12T17:39:49.883 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:49.883 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:39:49.532+0000 7f54083559c0 5 monclient: authenticate success, global_id 7796 2024-09-12T17:39:49.883 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:39:49.532+0000 7f54083559c0 10 monclient: _renew_subs 2024-09-12T17:39:49.883 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:39:49.532+0000 7f54083559c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:39:49.884 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.884 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:39:49.532+0000 7f52e97fa640 4 set_mon_vals no callback set 2024-09-12T17:39:49.884 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:39:49.884 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: dump: 2024-09-12T17:39:49.884 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.884 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.884 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.884 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.884 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.884 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.884 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.884 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.884 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.884 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.885 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:39:49.532+0000 7f54083559c0 10 monclient: _renew_subs 2024-09-12T17:39:49.885 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:39:49.532+0000 7f54083559c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:39:49.885 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:39:49.532+0000 7f54083559c0 1 librados: init done 2024-09-12T17:39:49.885 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:39:49.532+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command cr dump hook 0x562ab48df568 2024-09-12T17:39:49.885 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.885 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:39:49.532+0000 7f52d77fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:39:49.885 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:39:49.532+0000 7f52d77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:49.885 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:39:49.532+0000 7f52d77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:49.885 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:39:49.532+0000 7f5405e5b640 10 monclient: get_auth_request con 0x562ab4905230 auth_method 0 2024-09-12T17:39:49.885 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:39:49.532+0000 7f540565a640 10 monclient: get_auth_request con 0x7f52d0070ae0 auth_method 0 2024-09-12T17:39:49.885 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.885 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:39:49.532+0000 7f54083559c0 20 realm 2024-09-12T17:39:49.885 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.885 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.886 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:39:49.532+0000 7f54083559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:49.886 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.886 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.886 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.886 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:39:49.536+0000 7f540565a640 10 monclient: get_auth_request con 0x562ab49092d0 auth_method 0 2024-09-12T17:39:49.886 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:39:49.536+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:49.886 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:39:49.536+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.886 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:39:49.536+0000 7f540665c640 10 monclient: get_auth_request con 0x562ab490cbc0 auth_method 0 2024-09-12T17:39:49.886 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:39:49.536+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:49.886 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:39:49.536+0000 7f54083559c0 20 searching for the correct realm 2024-09-12T17:39:49.886 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:39:49.536+0000 7f5405e5b640 10 monclient: get_auth_request con 0x562ab4911910 auth_method 0 2024-09-12T17:39:49.886 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:39:49.540+0000 7f540565a640 10 monclient: get_auth_request con 0x7f53f8017070 auth_method 0 2024-09-12T17:39:49.886 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:39:49.540+0000 7f540665c640 10 monclient: get_auth_request con 0x7f53f0102040 auth_method 0 2024-09-12T17:39:49.887 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:39:49.540+0000 7f540565a640 0 -- 172.21.15.119:0/3525528362 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f53f8017070 msgr2=0x7f53f8017960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:49.887 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:39:49.540+0000 7f52d77fe640 1 client.7796.objecter ms_handle_reset 0x7f53f8017070 session 0x7f53f8029040 osd.7 2024-09-12T17:39:49.887 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:39:49.540+0000 7f52d77fe640 10 monclient: _renew_subs 2024-09-12T17:39:49.887 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:39:49.540+0000 7f52d77fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:39:49.887 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:39:49.540+0000 7f540565a640 10 monclient: get_auth_request con 0x7f52d0081290 auth_method 0 2024-09-12T17:39:49.887 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:39:49.544+0000 7f5405e5b640 10 monclient: get_auth_request con 0x7f540003d040 auth_method 0 2024-09-12T17:39:49.887 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:39:49.548+0000 7f540565a640 10 monclient: get_auth_request con 0x7f5400023040 auth_method 0 2024-09-12T17:39:49.887 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:39:49.548+0000 7f540565a640 0 -- 172.21.15.119:0/3525528362 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f5400023040 msgr2=0x7f540006a630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:49.887 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:39:49.752+0000 7f540565a640 10 monclient: get_auth_request con 0x7f5400023040 auth_method 0 2024-09-12T17:39:49.887 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:49.887 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:49.887 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:49.887 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:49.888 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:49.888 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:49.888 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.888 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.888 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.888 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:49.888 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.888 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:49.888 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 zone default found 2024-09-12T17:39:49.888 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:39:49.768+0000 7f54083559c0 4 Realm: () 2024-09-12T17:39:49.888 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:39:49.768+0000 7f54083559c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:49.888 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:39:49.768+0000 7f54083559c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:49.888 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:39:49.768+0000 7f54083559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:49.889 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 zonegroup default 2024-09-12T17:39:49.889 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.889 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.889 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.889 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.889 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.889 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:39:49.772+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.889 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:39:49.772+0000 7f54083559c0 20 started sync module instance, tier type = 2024-09-12T17:39:49.889 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:39:49.772+0000 7f54083559c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:49.889 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=0 2024-09-12T17:39:49.889 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=1 2024-09-12T17:39:49.889 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=2 2024-09-12T17:39:49.889 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=3 2024-09-12T17:39:49.889 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=4 2024-09-12T17:39:49.890 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=5 2024-09-12T17:39:49.890 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=6 2024-09-12T17:39:49.890 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:39:49.796+0000 7f54083559c0 20 add_watcher() i=7 2024-09-12T17:39:49.890 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:39:49.796+0000 7f54083559c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:49.890 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding auth protocol: cephx 2024-09-12T17:39:49.890 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding auth protocol: cephx 2024-09-12T17:39:49.890 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding auth protocol: cephx 2024-09-12T17:39:49.890 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: secure 2024-09-12T17:39:49.890 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: crc 2024-09-12T17:39:49.890 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: secure 2024-09-12T17:39:49.890 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: crc 2024-09-12T17:39:49.890 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: secure 2024-09-12T17:39:49.890 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: crc 2024-09-12T17:39:49.890 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: crc 2024-09-12T17:39:49.891 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: secure 2024-09-12T17:39:49.891 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: crc 2024-09-12T17:39:49.891 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: secure 2024-09-12T17:39:49.891 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: crc 2024-09-12T17:39:49.891 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: secure 2024-09-12T17:39:49.891 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:39:49.800+0000 7f52bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:49.891 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:39:49.800+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.891 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:39:49.800+0000 7f54083559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:49.891 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:39:49.800+0000 7f54083559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:49.891 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command cache list hook 0x562ab48e2af0 2024-09-12T17:39:49.891 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command cache inspect hook 0x562ab48e2af0 2024-09-12T17:39:49.891 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command cache erase hook 0x562ab48e2af0 2024-09-12T17:39:49.891 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command cache zap hook 0x562ab48e2af0 2024-09-12T17:39:49.891 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 note: GC not initialized 2024-09-12T17:39:49.892 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:39:49.800+0000 7f52bafe5640 20 reqs_thread_entry: start 2024-09-12T17:39:49.892 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command sync trace show hook 0x7f5400008620 2024-09-12T17:39:49.892 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command sync trace history hook 0x7f5400008620 2024-09-12T17:39:49.892 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command sync trace active hook 0x7f5400008620 2024-09-12T17:39:49.892 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command sync trace active_short hook 0x7f5400008620 2024-09-12T17:39:49.892 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:39:49.800+0000 7f54083559c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:49.892 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:39:49.800+0000 7f54083559c0 20 Filter name: none 2024-09-12T17:39:49.892 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:39:49.800+0000 7f52b8fe1640 20 reqs_thread_entry: start 2024-09-12T17:39:49.892 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:39:49.800+0000 7f54083559c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:39:49.892 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:39:49.800+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.892 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:39:49.800+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:49.892 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:39:49.800+0000 7f54083559c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:39:49.892 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:39:49.800+0000 7f54083559c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:39:49.893 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:39:49.800+0000 7f54083559c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:39:49.893 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:39:49.804+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.893 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:39:49.804+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:49.893 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:39:49.804+0000 7f54083559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:49.893 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:39:49.804+0000 7f54083559c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:49.893 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:39:49.804+0000 7f54083559c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:49.893 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:39:49.804+0000 7f54083559c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:49.893 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:39:49.804+0000 7f54083559c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:39:49.893 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:39:49.812+0000 7f54083559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:49.893 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:39:49.812+0000 7f54083559c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:49.893 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:39:49.812+0000 7f54083559c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:49.893 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:39:49.812+0000 7f54083559c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:39:49.893 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:39:49.812+0000 7f52e8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333537 cookie 94741418042208 notifier 7796 bl.length()=911 2024-09-12T17:39:49.894 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:39:49.812+0000 7f52e8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:49.894 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:39:49.812+0000 7f52e8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:49.894 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:39:49.812+0000 7f52e8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:49.894 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:39:49.816+0000 7f54083559c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:39:49.894 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:39:49.816+0000 7f54083559c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:39:49.894 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:39:49.816+0000 7f54083559c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:39:49.894 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:39:49.816+0000 7f54083559c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:39:49.894 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:39:49.828+0000 7f54083559c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f54083559c0 time 2024-09-12T17:39:49.829731+0000 2024-09-12T17:39:49.894 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:39:49.894 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.894 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:39:49.894 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f540bc2f2eb] 2024-09-12T17:39:49.894 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f540bc2f49f] 2024-09-12T17:39:49.894 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562ab17ca0c1] 2024-09-12T17:39:49.895 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562ab17dc1fa] 2024-09-12T17:39:49.895 INFO:tasks.workunit.client.0.smithi119.stderr: 5: main() 2024-09-12T17:39:49.895 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f540aa95d90] 2024-09-12T17:39:49.895 INFO:tasks.workunit.client.0.smithi119.stderr: 7: __libc_start_main() 2024-09-12T17:39:49.895 INFO:tasks.workunit.client.0.smithi119.stderr: 8: _start() 2024-09-12T17:39:49.895 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.895 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:39:49.828+0000 7f54083559c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:39:49.895 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f54083559c0 thread_name:radosgw-admin 2024-09-12T17:39:49.895 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.895 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:39:49.895 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f540aaae520] 2024-09-12T17:39:49.895 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:39:49.895 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:39:49.896 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:39:49.896 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f540bc2f345] 2024-09-12T17:39:49.896 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f540bc2f49f] 2024-09-12T17:39:49.896 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562ab17ca0c1] 2024-09-12T17:39:49.896 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562ab17dc1fa] 2024-09-12T17:39:49.896 INFO:tasks.workunit.client.0.smithi119.stderr: 9: main() 2024-09-12T17:39:49.896 INFO:tasks.workunit.client.0.smithi119.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f540aa95d90] 2024-09-12T17:39:49.896 INFO:tasks.workunit.client.0.smithi119.stderr: 11: __libc_start_main() 2024-09-12T17:39:49.896 INFO:tasks.workunit.client.0.smithi119.stderr: 12: _start() 2024-09-12T17:39:49.896 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:39:49.896 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.896 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:39:49.896 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:39:49.896 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:39:49.897 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:39:49.897 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:39:49.897 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:39:49.897 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:39:49.897 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:39:49.897 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:39:49.897 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:39:49.897 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:39:49.897 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:39:49.897 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:39:49.897 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:39:49.897 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:39:49.897 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:39:49.898 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:39:49.898 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:39:49.898 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:39:49.898 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:39:49.898 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:39:49.898 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:39:49.898 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:39:49.898 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:39:49.898 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:39:49.898 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:39:49.898 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:39:49.898 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:39:49.898 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:39:49.898 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:39:49.899 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:39:49.899 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:39:49.899 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:39:49.899 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:39:49.899 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:39:49.899 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:39:49.899 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:39:49.899 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:39:49.899 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:39:49.899 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:39:49.899 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:39:49.899 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:39:49.899 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:39:49.900 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:39:49.900 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:39:49.900 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:39:49.900 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:39:49.900 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:39:49.900 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:39:49.900 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:39:49.900 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:39:49.900 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:39:49.900 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:39:49.900 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:39:49.900 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:39:49.900 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:39:49.900 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:39:49.901 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:39:49.901 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:39:49.901 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:39:49.901 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:39:49.901 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:39:49.901 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:39:49.901 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:39:49.901 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:39:49.901 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:39:49.901 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:39:49.901 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:39:49.901 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:39:49.901 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:39:49.901 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:39:49.902 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:39:49.902 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:39:49.902 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:39:49.902 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:39:49.902 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:39:49.902 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:39:49.902 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:39:49.902 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:39:49.902 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:39:49.902 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:39:49.902 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:39:49.902 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:39:49.902 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:39:49.903 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:39:49.903 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:39:49.903 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:39:49.903 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:39:49.903 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:39:49.903 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:39:49.903 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:39:49.903 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:39:49.903 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:39:49.903 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:39:49.903 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52b8fe1640 / http_manager 2024-09-12T17:39:49.903 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52bafe5640 / http_manager 2024-09-12T17:39:49.903 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52bbfe7640 / rgw_dt_lg_renew 2024-09-12T17:39:49.903 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52d77fe640 / ms_dispatch 2024-09-12T17:39:49.904 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52e8ff9640 / io_context_pool 2024-09-12T17:39:49.904 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52e97fa640 / io_context_pool 2024-09-12T17:39:49.904 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52eb7fe640 / ms_dispatch 2024-09-12T17:39:49.904 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52f2604640 / ms_dispatch 2024-09-12T17:39:49.904 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52f3e07640 / io_context_pool 2024-09-12T17:39:49.904 INFO:tasks.workunit.client.0.smithi119.stderr: 7f540565a640 / msgr-worker-2 2024-09-12T17:39:49.904 INFO:tasks.workunit.client.0.smithi119.stderr: 7f5405e5b640 / msgr-worker-1 2024-09-12T17:39:49.904 INFO:tasks.workunit.client.0.smithi119.stderr: 7f540665c640 / msgr-worker-0 2024-09-12T17:39:49.904 INFO:tasks.workunit.client.0.smithi119.stderr: 7f5406e5d640 / io_context_pool 2024-09-12T17:39:49.904 INFO:tasks.workunit.client.0.smithi119.stderr: 7f54083559c0 / radosgw-admin 2024-09-12T17:39:49.904 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:39:49.904 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:39:49.904 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/log/ceph/ceph-client.admin.143984.log 2024-09-12T17:39:49.905 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:39:49.905 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:39:49.905 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:39:49.508+0000 7f5405e5b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:39:49.905 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.905 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:39:49.905 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: dump: 2024-09-12T17:39:49.905 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.905 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.905 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.905 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.905 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.905 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.905 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.905 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.906 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.906 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.906 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: _finish_auth 0 2024-09-12T17:39:49.906 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: _check_auth_tickets 2024-09-12T17:39:49.906 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:49.906 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.906 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:39:49.906 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:39:49.508+0000 7f52f3e07640 10 monclient: dump: 2024-09-12T17:39:49.906 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.906 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.906 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.906 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.906 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.907 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.907 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.907 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.907 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.907 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.907 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 monclient: authenticate success, global_id 8259 2024-09-12T17:39:49.907 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:39:49.508+0000 7f54083559c0 10 monclient: get_monmap_and_config success 2024-09-12T17:39:49.907 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:39:49.508+0000 7f54083559c0 4 set_mon_vals no callback set 2024-09-12T17:39:49.907 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:39:49.508+0000 7f54083559c0 10 monclient: shutdown 2024-09-12T17:39:49.907 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 asok(0x562ab460d2b0) unregister_commands rotate-key 2024-09-12T17:39:49.907 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:39:49.508+0000 7f54083559c0 10 monclient: build_initial_monmap 2024-09-12T17:39:49.907 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:39:49.508+0000 7f54083559c0 1 build_initial for_mkfs: 0 2024-09-12T17:39:49.907 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:39:49.508+0000 7f54083559c0 10 monclient: monmap: 2024-09-12T17:39:49.907 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:39:49.908 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:39:49.908 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:39:49.908 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:39:49.908 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:39:49.908 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.908 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:39:49.908 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:39:49.908 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:39:49.908 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.908 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding auth protocol: cephx 2024-09-12T17:39:49.908 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding auth protocol: cephx 2024-09-12T17:39:49.909 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding auth protocol: cephx 2024-09-12T17:39:49.909 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: secure 2024-09-12T17:39:49.909 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: crc 2024-09-12T17:39:49.909 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: secure 2024-09-12T17:39:49.909 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: crc 2024-09-12T17:39:49.909 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: secure 2024-09-12T17:39:49.909 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: crc 2024-09-12T17:39:49.909 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: crc 2024-09-12T17:39:49.910 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: secure 2024-09-12T17:39:49.910 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: crc 2024-09-12T17:39:49.910 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: secure 2024-09-12T17:39:49.910 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: crc 2024-09-12T17:39:49.910 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 AuthRegistry(0x562ab481a610) adding con mode: secure 2024-09-12T17:39:49.910 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:39:49.508+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.910 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:39:49.508+0000 7f54083559c0 1 librados: starting msgr at 2024-09-12T17:39:49.910 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:39:49.508+0000 7f54083559c0 1 librados: starting objecter 2024-09-12T17:39:49.910 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:39:49.508+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command objecter_requests hook 0x562ab4843710 2024-09-12T17:39:49.910 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:39:49.512+0000 7f54083559c0 1 librados: setting wanted keys 2024-09-12T17:39:49.911 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:39:49.512+0000 7f54083559c0 1 librados: calling monclient init 2024-09-12T17:39:49.911 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient: init 2024-09-12T17:39:49.911 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding auth protocol: cephx 2024-09-12T17:39:49.911 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding auth protocol: cephx 2024-09-12T17:39:49.911 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding auth protocol: cephx 2024-09-12T17:39:49.911 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: secure 2024-09-12T17:39:49.911 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: crc 2024-09-12T17:39:49.911 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: secure 2024-09-12T17:39:49.911 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: crc 2024-09-12T17:39:49.911 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: secure 2024-09-12T17:39:49.911 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: crc 2024-09-12T17:39:49.911 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: crc 2024-09-12T17:39:49.911 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: secure 2024-09-12T17:39:49.912 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: crc 2024-09-12T17:39:49.912 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: secure 2024-09-12T17:39:49.912 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: crc 2024-09-12T17:39:49.912 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 AuthRegistry(0x562ab4818530) adding con mode: secure 2024-09-12T17:39:49.912 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:39:49.512+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.912 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:39:49.512+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.912 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command rotate-key hook 0x562ab4818678 2024-09-12T17:39:49.912 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient: _reopen_session rank -1 2024-09-12T17:39:49.912 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:39:49.912 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-b con 0x562ab46c8e30 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:39:49.912 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-c con 0x562ab475e1f0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:39:49.912 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-a con 0x562ab475e5d0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:39:49.913 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.913 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.913 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.913 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient(hunting): _renew_subs 2024-09-12T17:39:49.913 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient(hunting): authenticate will time out at 2757.544646s 2024-09-12T17:39:49.913 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient(hunting): get_auth_request con 0x562ab475e1f0 auth_method 0 2024-09-12T17:39:49.913 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.913 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.913 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.913 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:39:49.512+0000 7f540665c640 10 monclient(hunting): get_auth_request con 0x562ab475e5d0 auth_method 0 2024-09-12T17:39:49.913 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:39:49.512+0000 7f540665c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.913 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:39:49.512+0000 7f540665c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.914 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:39:49.512+0000 7f540665c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.914 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:49.914 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:49.914 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:49.914 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:39:49.512+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:49.914 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:39:49.512+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:49.914 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:39:49.512+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:49.914 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:39:49.512+0000 7f5405e5b640 10 monclient(hunting): get_auth_request con 0x562ab46c8e30 auth_method 0 2024-09-12T17:39:49.914 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:39:49.512+0000 7f5405e5b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.914 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:39:49.512+0000 7f5405e5b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.914 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:39:49.512+0000 7f5405e5b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.914 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient(hunting): handle_auth_done global_id 7787 payload 824 2024-09-12T17:39:49.914 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient: _finish_hunting 0 2024-09-12T17:39:49.914 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:39:49.512+0000 7f540565a640 1 monclient: found mon.noname-c 2024-09-12T17:39:49.915 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:39:49.512+0000 7f540565a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:39:49.915 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.915 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:39:49.915 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: dump: 2024-09-12T17:39:49.915 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.915 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.915 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.915 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.915 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.915 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.915 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.915 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.915 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.916 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.916 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: _finish_auth 0 2024-09-12T17:39:49.916 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: _check_auth_tickets 2024-09-12T17:39:49.916 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:49.916 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.916 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:39:49.916 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:39:49.512+0000 7f52f2604640 10 monclient: dump: 2024-09-12T17:39:49.916 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.916 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.916 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.916 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.916 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.916 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.917 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.917 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.917 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.917 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.917 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:39:49.512+0000 7f52f3e07640 4 set_mon_vals no callback set 2024-09-12T17:39:49.917 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:39:49.512+0000 7f54083559c0 5 monclient: authenticate success, global_id 7787 2024-09-12T17:39:49.917 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient: _renew_subs 2024-09-12T17:39:49.917 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:39:49.917 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient: _renew_subs 2024-09-12T17:39:49.917 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:39:49.512+0000 7f54083559c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:39:49.917 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:39:49.512+0000 7f54083559c0 1 librados: init done 2024-09-12T17:39:49.917 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:39:49.512+0000 7f52f2604640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:39:49.917 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:39:49.512+0000 7f52f2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:49.918 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:39:49.512+0000 7f52f2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:49.918 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:39:49.516+0000 7f5405e5b640 10 monclient: get_auth_request con 0x7f52ec070ae0 auth_method 0 2024-09-12T17:39:49.918 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:39:49.516+0000 7f540665c640 10 monclient: get_auth_request con 0x562ab4860510 auth_method 0 2024-09-12T17:39:49.918 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:39:49.516+0000 7f5405e5b640 10 monclient: get_auth_request con 0x562ab48636f0 auth_method 0 2024-09-12T17:39:49.918 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:39:49.516+0000 7f540565a640 10 monclient: get_auth_request con 0x562ab48678e0 auth_method 0 2024-09-12T17:39:49.918 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:39:49.520+0000 7f540665c640 10 monclient: get_auth_request con 0x562ab4866f70 auth_method 0 2024-09-12T17:39:49.918 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient: build_initial_monmap 2024-09-12T17:39:49.918 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:39:49.520+0000 7f54083559c0 1 build_initial for_mkfs: 0 2024-09-12T17:39:49.918 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient: monmap: 2024-09-12T17:39:49.918 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:39:49.918 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:39:49.918 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:39:49.918 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:39:49.918 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:39:49.919 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.919 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:39:49.919 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:39:49.919 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:39:49.919 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.919 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding auth protocol: cephx 2024-09-12T17:39:49.919 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding auth protocol: cephx 2024-09-12T17:39:49.919 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding auth protocol: cephx 2024-09-12T17:39:49.919 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: secure 2024-09-12T17:39:49.919 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: crc 2024-09-12T17:39:49.919 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: secure 2024-09-12T17:39:49.919 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: crc 2024-09-12T17:39:49.919 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: secure 2024-09-12T17:39:49.920 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: crc 2024-09-12T17:39:49.920 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: crc 2024-09-12T17:39:49.920 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: secure 2024-09-12T17:39:49.920 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: crc 2024-09-12T17:39:49.920 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: secure 2024-09-12T17:39:49.920 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: crc 2024-09-12T17:39:49.920 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486f750) adding con mode: secure 2024-09-12T17:39:49.920 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:39:49.520+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.920 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562ab4873140 EEXIST 2024-09-12T17:39:49.920 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient: init 2024-09-12T17:39:49.920 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding auth protocol: cephx 2024-09-12T17:39:49.920 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding auth protocol: cephx 2024-09-12T17:39:49.920 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding auth protocol: cephx 2024-09-12T17:39:49.921 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: secure 2024-09-12T17:39:49.921 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: crc 2024-09-12T17:39:49.921 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: secure 2024-09-12T17:39:49.921 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: crc 2024-09-12T17:39:49.921 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: secure 2024-09-12T17:39:49.921 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: crc 2024-09-12T17:39:49.921 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: crc 2024-09-12T17:39:49.921 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: secure 2024-09-12T17:39:49.921 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: crc 2024-09-12T17:39:49.921 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: secure 2024-09-12T17:39:49.921 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: crc 2024-09-12T17:39:49.922 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 AuthRegistry(0x562ab486e698) adding con mode: secure 2024-09-12T17:39:49.922 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:39:49.520+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.922 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:39:49.520+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.922 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:39:49.520+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command rotate-key cmddesc rotate-key hook 0x562ab486e7e0 EEXIST 2024-09-12T17:39:49.922 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient: _reopen_session rank -1 2024-09-12T17:39:49.922 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:39:49.922 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-a con 0x562ab48972f0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:39:49.922 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-c con 0x562ab4896c20 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:39:49.922 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-b con 0x562ab4895600 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:39:49.922 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.922 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.923 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.923 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient(hunting): _renew_subs 2024-09-12T17:39:49.923 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:39:49.520+0000 7f54083559c0 10 monclient(hunting): authenticate will time out at 2757.555966s 2024-09-12T17:39:49.923 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient(hunting): get_auth_request con 0x562ab48972f0 auth_method 0 2024-09-12T17:39:49.923 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.923 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.923 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.923 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:39:49.524+0000 7f540665c640 10 monclient(hunting): get_auth_request con 0x562ab4896c20 auth_method 0 2024-09-12T17:39:49.923 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:39:49.524+0000 7f540665c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.924 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:39:49.524+0000 7f540665c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.924 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:39:49.524+0000 7f540665c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.924 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:49.924 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:49.924 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:49.924 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:39:49.524+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:49.924 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:39:49.524+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:49.924 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:39:49.524+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:49.924 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:39:49.524+0000 7f5405e5b640 10 monclient(hunting): get_auth_request con 0x562ab4895600 auth_method 0 2024-09-12T17:39:49.925 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:39:49.524+0000 7f5405e5b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.925 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:39:49.524+0000 7f5405e5b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.925 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:39:49.524+0000 7f5405e5b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.925 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient(hunting): handle_auth_done global_id 8265 payload 824 2024-09-12T17:39:49.925 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient: _finish_hunting 0 2024-09-12T17:39:49.925 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:39:49.524+0000 7f540565a640 1 monclient: found mon.noname-a 2024-09-12T17:39:49.925 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:39:49.524+0000 7f540565a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:39:49.925 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.925 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:39:49.925 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: dump: 2024-09-12T17:39:49.925 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.925 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.926 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.926 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.926 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.926 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.926 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.926 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.926 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.926 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.926 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: _finish_auth 0 2024-09-12T17:39:49.926 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:39:49.926 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:49.926 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.926 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:39:49.927 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 10 monclient: dump: 2024-09-12T17:39:49.927 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.927 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.927 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.927 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.927 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.927 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.927 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.927 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.927 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.927 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.928 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:39:49.524+0000 7f5406e5d640 4 set_mon_vals no callback set 2024-09-12T17:39:49.929 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 monclient: authenticate success, global_id 8265 2024-09-12T17:39:49.929 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:39:49.524+0000 7f54083559c0 10 monclient: _renew_subs 2024-09-12T17:39:49.929 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:39:49.524+0000 7f54083559c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:39:49.929 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:39:49.524+0000 7f54083559c0 10 monclient: _renew_subs 2024-09-12T17:39:49.929 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:39:49.524+0000 7f54083559c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:39:49.929 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:39:49.929 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:49.930 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:39:49.524+0000 7f52eb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:49.930 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:39:49.524+0000 7f54083559c0 10 monclient: get_monmap_and_config 2024-09-12T17:39:49.930 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:39:49.524+0000 7f54083559c0 10 monclient: build_initial_monmap 2024-09-12T17:39:49.930 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:39:49.524+0000 7f54083559c0 1 build_initial for_mkfs: 0 2024-09-12T17:39:49.930 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:39:49.524+0000 7f54083559c0 10 monclient: monmap: 2024-09-12T17:39:49.930 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:39:49.930 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:39:49.930 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:39:49.930 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:39:49.930 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:39:49.930 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.930 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:39:49.931 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:39:49.931 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:39:49.931 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.931 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding auth protocol: cephx 2024-09-12T17:39:49.931 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding auth protocol: cephx 2024-09-12T17:39:49.931 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding auth protocol: cephx 2024-09-12T17:39:49.931 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: secure 2024-09-12T17:39:49.931 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: crc 2024-09-12T17:39:49.931 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: secure 2024-09-12T17:39:49.931 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: crc 2024-09-12T17:39:49.931 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: secure 2024-09-12T17:39:49.931 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: crc 2024-09-12T17:39:49.931 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: crc 2024-09-12T17:39:49.932 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: secure 2024-09-12T17:39:49.932 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: crc 2024-09-12T17:39:49.932 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: secure 2024-09-12T17:39:49.932 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: crc 2024-09-12T17:39:49.932 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x562ab48b6a70) adding con mode: secure 2024-09-12T17:39:49.932 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:39:49.524+0000 7f540665c640 10 monclient: get_auth_request con 0x7f52e0070a20 auth_method 0 2024-09-12T17:39:49.932 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:39:49.524+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.932 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:39:49.524+0000 7f54083559c0 10 monclient: init 2024-09-12T17:39:49.932 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding auth protocol: cephx 2024-09-12T17:39:49.932 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding auth protocol: cephx 2024-09-12T17:39:49.932 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding auth protocol: cephx 2024-09-12T17:39:49.932 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: secure 2024-09-12T17:39:49.932 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: crc 2024-09-12T17:39:49.933 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: secure 2024-09-12T17:39:49.933 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: crc 2024-09-12T17:39:49.933 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: secure 2024-09-12T17:39:49.933 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: crc 2024-09-12T17:39:49.933 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: crc 2024-09-12T17:39:49.933 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: secure 2024-09-12T17:39:49.933 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: crc 2024-09-12T17:39:49.933 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: secure 2024-09-12T17:39:49.933 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: crc 2024-09-12T17:39:49.934 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:39:49.524+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55faa0) adding con mode: secure 2024-09-12T17:39:49.934 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:39:49.528+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.934 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:39:49.528+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.934 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe8b55fbe8 EEXIST 2024-09-12T17:39:49.934 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: _reopen_session rank -1 2024-09-12T17:39:49.934 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:39:49.934 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-a con 0x562ab48ead30 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:39:49.934 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-c con 0x562ab48eb110 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:39:49.934 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-b con 0x562ab48e54b0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:39:49.934 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.934 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.934 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.934 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): _renew_subs 2024-09-12T17:39:49.935 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): authenticate will time out at 2757.560578s 2024-09-12T17:39:49.935 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): get_auth_request con 0x562ab48ead30 auth_method 0 2024-09-12T17:39:49.935 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.935 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.935 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.935 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): get_auth_request con 0x562ab48eb110 auth_method 0 2024-09-12T17:39:49.935 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.935 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.935 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.935 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:49.935 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:49.935 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:49.935 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:49.935 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:49.936 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:49.936 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): handle_auth_done global_id 7793 payload 274 2024-09-12T17:39:49.936 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient: _finish_hunting 0 2024-09-12T17:39:49.936 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:39:49.528+0000 7f540665c640 1 monclient: found mon.noname-c 2024-09-12T17:39:49.936 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:39:49.936 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:39:49.528+0000 7f5405e5b640 10 monclient: get_auth_request con 0x562ab48e54b0 auth_method 0 2024-09-12T17:39:49.936 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.936 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:39:49.936 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: dump: 2024-09-12T17:39:49.936 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.936 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.936 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.937 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.937 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.937 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.937 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.937 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.937 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.937 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.937 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: _finish_auth 0 2024-09-12T17:39:49.937 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: _check_auth_tickets 2024-09-12T17:39:49.937 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:49.937 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.937 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:39:49.938 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:39:49.528+0000 7f52e97fa640 10 monclient: dump: 2024-09-12T17:39:49.938 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.938 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.938 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.938 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.938 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.938 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.938 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.938 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.938 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.938 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.938 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 monclient: authenticate success, global_id 7793 2024-09-12T17:39:49.938 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: get_monmap_and_config success 2024-09-12T17:39:49.938 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:39:49.528+0000 7f54083559c0 4 set_mon_vals no callback set 2024-09-12T17:39:49.939 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: shutdown 2024-09-12T17:39:49.939 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: build_initial_monmap 2024-09-12T17:39:49.939 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:39:49.528+0000 7f54083559c0 1 build_initial for_mkfs: 0 2024-09-12T17:39:49.939 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: monmap: 2024-09-12T17:39:49.939 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:39:49.939 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:39:49.939 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:39:49.939 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:39:49.939 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:39:49.939 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.939 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:39:49.939 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:39:49.940 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:39:49.940 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.940 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding auth protocol: cephx 2024-09-12T17:39:49.940 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding auth protocol: cephx 2024-09-12T17:39:49.940 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding auth protocol: cephx 2024-09-12T17:39:49.940 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: secure 2024-09-12T17:39:49.940 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: crc 2024-09-12T17:39:49.940 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: secure 2024-09-12T17:39:49.940 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: crc 2024-09-12T17:39:49.940 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: secure 2024-09-12T17:39:49.940 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: crc 2024-09-12T17:39:49.940 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: crc 2024-09-12T17:39:49.940 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: secure 2024-09-12T17:39:49.941 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: crc 2024-09-12T17:39:49.941 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: secure 2024-09-12T17:39:49.941 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: crc 2024-09-12T17:39:49.941 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab48e7060) adding con mode: secure 2024-09-12T17:39:49.941 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:39:49.528+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.941 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:39:49.528+0000 7f54083559c0 1 librados: starting msgr at 2024-09-12T17:39:49.941 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:39:49.528+0000 7f54083559c0 1 librados: starting objecter 2024-09-12T17:39:49.941 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562ab48ddee0 EEXIST 2024-09-12T17:39:49.941 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:39:49.528+0000 7f54083559c0 1 librados: setting wanted keys 2024-09-12T17:39:49.941 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:39:49.528+0000 7f54083559c0 1 librados: calling monclient init 2024-09-12T17:39:49.941 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: init 2024-09-12T17:39:49.941 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding auth protocol: cephx 2024-09-12T17:39:49.941 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding auth protocol: cephx 2024-09-12T17:39:49.941 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding auth protocol: cephx 2024-09-12T17:39:49.942 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: secure 2024-09-12T17:39:49.942 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: crc 2024-09-12T17:39:49.942 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: secure 2024-09-12T17:39:49.942 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: crc 2024-09-12T17:39:49.942 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: secure 2024-09-12T17:39:49.942 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: crc 2024-09-12T17:39:49.942 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: crc 2024-09-12T17:39:49.942 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: secure 2024-09-12T17:39:49.942 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: crc 2024-09-12T17:39:49.942 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: secure 2024-09-12T17:39:49.942 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: crc 2024-09-12T17:39:49.942 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 AuthRegistry(0x562ab4899110) adding con mode: secure 2024-09-12T17:39:49.942 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:39:49.528+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.943 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:39:49.528+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.943 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:39:49.528+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command rotate-key cmddesc rotate-key hook 0x562ab4899258 EEXIST 2024-09-12T17:39:49.943 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: _reopen_session rank -1 2024-09-12T17:39:49.943 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:39:49.943 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-a con 0x562ab48e54b0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:39:49.943 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-c con 0x562ab48ead30 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:39:49.943 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): picked mon.noname-b con 0x562ab48e26b0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:39:49.943 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.943 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.943 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:39:49.943 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): _renew_subs 2024-09-12T17:39:49.943 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:39:49.528+0000 7f54083559c0 10 monclient(hunting): authenticate will time out at 2757.563337s 2024-09-12T17:39:49.943 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): get_auth_request con 0x562ab48e54b0 auth_method 0 2024-09-12T17:39:49.943 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.944 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.944 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.944 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): get_auth_request con 0x562ab48ead30 auth_method 0 2024-09-12T17:39:49.944 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:39:49.944 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:39:49.944 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:39:49.944 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:49.944 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:49.944 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:49.944 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:39:49.944 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:39:49.944 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:39:49.528+0000 7f540565a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:39:49.944 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient(hunting): handle_auth_done global_id 7796 payload 824 2024-09-12T17:39:49.945 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient: _finish_hunting 0 2024-09-12T17:39:49.945 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:39:49.528+0000 7f540665c640 1 monclient: found mon.noname-c 2024-09-12T17:39:49.945 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:39:49.528+0000 7f540665c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:39:49.945 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:39:49.528+0000 7f5405e5b640 10 monclient: get_auth_request con 0x562ab48e26b0 auth_method 0 2024-09-12T17:39:49.945 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.945 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:39:49.945 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: dump: 2024-09-12T17:39:49.945 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.945 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.945 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.945 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.946 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.946 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.946 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.946 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.947 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.947 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.947 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: _finish_auth 0 2024-09-12T17:39:49.947 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: _check_auth_tickets 2024-09-12T17:39:49.947 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:39:49.947 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:39:49.532+0000 7f54083559c0 5 monclient: authenticate success, global_id 7796 2024-09-12T17:39:49.947 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:39:49.532+0000 7f54083559c0 10 monclient: _renew_subs 2024-09-12T17:39:49.947 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:39:49.532+0000 7f54083559c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:39:49.947 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:39:49.947 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:39:49.532+0000 7f52e97fa640 4 set_mon_vals no callback set 2024-09-12T17:39:49.947 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:39:49.947 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:39:49.532+0000 7f52d77fe640 10 monclient: dump: 2024-09-12T17:39:49.948 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:39:49.948 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:39:49.948 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.948 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:39:49.948 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:39:49.948 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:39:49.948 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:39:49.948 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:39:49.948 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:39:49.948 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.948 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:39:49.532+0000 7f54083559c0 10 monclient: _renew_subs 2024-09-12T17:39:49.948 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:39:49.532+0000 7f54083559c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:39:49.948 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:39:49.532+0000 7f54083559c0 1 librados: init done 2024-09-12T17:39:49.949 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:39:49.532+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command cr dump hook 0x562ab48df568 2024-09-12T17:39:49.949 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.949 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:39:49.532+0000 7f52d77fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:39:49.949 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:39:49.532+0000 7f52d77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:49.949 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:39:49.532+0000 7f52d77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:39:49.949 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:39:49.532+0000 7f5405e5b640 10 monclient: get_auth_request con 0x562ab4905230 auth_method 0 2024-09-12T17:39:49.949 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:39:49.532+0000 7f540565a640 10 monclient: get_auth_request con 0x7f52d0070ae0 auth_method 0 2024-09-12T17:39:49.949 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.949 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:39:49.532+0000 7f54083559c0 20 realm 2024-09-12T17:39:49.949 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.950 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.950 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:39:49.532+0000 7f54083559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:49.950 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.950 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.950 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:39:49.532+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.950 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:39:49.536+0000 7f540565a640 10 monclient: get_auth_request con 0x562ab49092d0 auth_method 0 2024-09-12T17:39:49.950 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:39:49.536+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:49.950 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:39:49.536+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.950 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:39:49.536+0000 7f540665c640 10 monclient: get_auth_request con 0x562ab490cbc0 auth_method 0 2024-09-12T17:39:49.950 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:39:49.536+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:49.950 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:39:49.536+0000 7f54083559c0 20 searching for the correct realm 2024-09-12T17:39:49.950 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:39:49.536+0000 7f5405e5b640 10 monclient: get_auth_request con 0x562ab4911910 auth_method 0 2024-09-12T17:39:49.950 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:39:49.540+0000 7f540565a640 10 monclient: get_auth_request con 0x7f53f8017070 auth_method 0 2024-09-12T17:39:49.950 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:39:49.540+0000 7f540665c640 10 monclient: get_auth_request con 0x7f53f0102040 auth_method 0 2024-09-12T17:39:49.951 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:39:49.540+0000 7f540565a640 0 -- 172.21.15.119:0/3525528362 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f53f8017070 msgr2=0x7f53f8017960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:49.951 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:39:49.540+0000 7f52d77fe640 1 client.7796.objecter ms_handle_reset 0x7f53f8017070 session 0x7f53f8029040 osd.7 2024-09-12T17:39:49.951 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:39:49.540+0000 7f52d77fe640 10 monclient: _renew_subs 2024-09-12T17:39:49.951 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:39:49.540+0000 7f52d77fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:39:49.951 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:39:49.540+0000 7f540565a640 10 monclient: get_auth_request con 0x7f52d0081290 auth_method 0 2024-09-12T17:39:49.951 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:39:49.544+0000 7f5405e5b640 10 monclient: get_auth_request con 0x7f540003d040 auth_method 0 2024-09-12T17:39:49.951 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:39:49.548+0000 7f540565a640 10 monclient: get_auth_request con 0x7f5400023040 auth_method 0 2024-09-12T17:39:49.951 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:39:49.548+0000 7f540565a640 0 -- 172.21.15.119:0/3525528362 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f5400023040 msgr2=0x7f540006a630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:49.951 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:39:49.752+0000 7f540565a640 10 monclient: get_auth_request con 0x7f5400023040 auth_method 0 2024-09-12T17:39:49.951 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:49.951 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:49.951 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:49.951 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:49.952 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:49.952 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:49.952 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.952 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.952 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:39:49.764+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.952 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:49.952 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.952 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:49.952 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 zone default found 2024-09-12T17:39:49.952 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:39:49.768+0000 7f54083559c0 4 Realm: () 2024-09-12T17:39:49.952 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:39:49.768+0000 7f54083559c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:49.952 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:39:49.768+0000 7f54083559c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:49.952 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:39:49.768+0000 7f54083559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:49.953 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 zonegroup default 2024-09-12T17:39:49.953 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.953 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.953 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.953 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.953 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:39:49.768+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.953 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:39:49.772+0000 7f54083559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.953 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:39:49.772+0000 7f54083559c0 20 started sync module instance, tier type = 2024-09-12T17:39:49.953 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:39:49.772+0000 7f54083559c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:49.953 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=0 2024-09-12T17:39:49.953 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=1 2024-09-12T17:39:49.953 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=2 2024-09-12T17:39:49.953 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=3 2024-09-12T17:39:49.954 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=4 2024-09-12T17:39:49.954 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=5 2024-09-12T17:39:49.954 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:39:49.792+0000 7f54083559c0 20 add_watcher() i=6 2024-09-12T17:39:49.954 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:39:49.796+0000 7f54083559c0 20 add_watcher() i=7 2024-09-12T17:39:49.954 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:39:49.796+0000 7f54083559c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:49.954 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding auth protocol: cephx 2024-09-12T17:39:49.954 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding auth protocol: cephx 2024-09-12T17:39:49.954 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding auth protocol: cephx 2024-09-12T17:39:49.954 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: secure 2024-09-12T17:39:49.954 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: crc 2024-09-12T17:39:49.954 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: secure 2024-09-12T17:39:49.954 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: crc 2024-09-12T17:39:49.954 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: secure 2024-09-12T17:39:49.954 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: crc 2024-09-12T17:39:49.955 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: crc 2024-09-12T17:39:49.955 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: secure 2024-09-12T17:39:49.955 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: crc 2024-09-12T17:39:49.955 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: secure 2024-09-12T17:39:49.955 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: crc 2024-09-12T17:39:49.955 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 AuthRegistry(0x7ffe8b55ff70) adding con mode: secure 2024-09-12T17:39:49.955 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:39:49.800+0000 7f52bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:49.955 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:39:49.800+0000 7f54083559c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:39:49.955 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:39:49.800+0000 7f54083559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:49.955 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:39:49.800+0000 7f54083559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:49.955 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command cache list hook 0x562ab48e2af0 2024-09-12T17:39:49.955 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command cache inspect hook 0x562ab48e2af0 2024-09-12T17:39:49.955 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command cache erase hook 0x562ab48e2af0 2024-09-12T17:39:49.955 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command cache zap hook 0x562ab48e2af0 2024-09-12T17:39:49.956 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 note: GC not initialized 2024-09-12T17:39:49.956 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:39:49.800+0000 7f52bafe5640 20 reqs_thread_entry: start 2024-09-12T17:39:49.956 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command sync trace show hook 0x7f5400008620 2024-09-12T17:39:49.956 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command sync trace history hook 0x7f5400008620 2024-09-12T17:39:49.956 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command sync trace active hook 0x7f5400008620 2024-09-12T17:39:49.956 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:39:49.800+0000 7f54083559c0 5 asok(0x562ab460d2b0) register_command sync trace active_short hook 0x7f5400008620 2024-09-12T17:39:49.956 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:39:49.800+0000 7f54083559c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:49.956 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:39:49.800+0000 7f54083559c0 20 Filter name: none 2024-09-12T17:39:49.956 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:39:49.800+0000 7f52b8fe1640 20 reqs_thread_entry: start 2024-09-12T17:39:49.956 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:39:49.800+0000 7f54083559c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:39:49.956 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:39:49.800+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.956 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:39:49.800+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:49.957 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:39:49.800+0000 7f54083559c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:39:49.957 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:39:49.800+0000 7f54083559c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:39:49.957 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:39:49.800+0000 7f54083559c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:39:49.957 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:39:49.804+0000 7f54083559c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.957 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:39:49.804+0000 7f54083559c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:49.957 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:39:49.804+0000 7f54083559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:49.957 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:39:49.804+0000 7f54083559c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:49.957 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:39:49.804+0000 7f54083559c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:49.957 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:39:49.804+0000 7f54083559c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:49.957 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:39:49.804+0000 7f54083559c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:39:49.957 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:39:49.812+0000 7f54083559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:49.957 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:39:49.812+0000 7f54083559c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:49.957 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:39:49.812+0000 7f54083559c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:49.958 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:39:49.812+0000 7f54083559c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:39:49.958 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:39:49.812+0000 7f52e8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333537 cookie 94741418042208 notifier 7796 bl.length()=911 2024-09-12T17:39:49.958 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:39:49.812+0000 7f52e8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:49.958 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:39:49.812+0000 7f52e8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:49.958 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:39:49.812+0000 7f52e8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:49.958 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:39:49.816+0000 7f54083559c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:39:49.958 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:39:49.816+0000 7f54083559c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:39:49.958 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:39:49.816+0000 7f54083559c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:39:49.958 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:39:49.816+0000 7f54083559c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:39:49.958 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:39:49.828+0000 7f54083559c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f54083559c0 time 2024-09-12T17:39:49.829731+0000 2024-09-12T17:39:49.958 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:39:49.958 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.958 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:39:49.959 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f540bc2f2eb] 2024-09-12T17:39:49.959 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f540bc2f49f] 2024-09-12T17:39:49.959 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562ab17ca0c1] 2024-09-12T17:39:49.959 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562ab17dc1fa] 2024-09-12T17:39:49.959 INFO:tasks.workunit.client.0.smithi119.stderr: 5: main() 2024-09-12T17:39:49.959 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f540aa95d90] 2024-09-12T17:39:49.959 INFO:tasks.workunit.client.0.smithi119.stderr: 7: __libc_start_main() 2024-09-12T17:39:49.959 INFO:tasks.workunit.client.0.smithi119.stderr: 8: _start() 2024-09-12T17:39:49.959 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.959 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:39:49.828+0000 7f54083559c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:39:49.959 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f54083559c0 thread_name:radosgw-admin 2024-09-12T17:39:49.959 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.959 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:39:49.959 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f540aaae520] 2024-09-12T17:39:49.960 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:39:49.960 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:39:49.960 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:39:49.960 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f540bc2f345] 2024-09-12T17:39:49.960 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f540bc2f49f] 2024-09-12T17:39:49.960 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562ab17ca0c1] 2024-09-12T17:39:49.960 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562ab17dc1fa] 2024-09-12T17:39:49.960 INFO:tasks.workunit.client.0.smithi119.stderr: 9: main() 2024-09-12T17:39:49.960 INFO:tasks.workunit.client.0.smithi119.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f540aa95d90] 2024-09-12T17:39:49.960 INFO:tasks.workunit.client.0.smithi119.stderr: 11: __libc_start_main() 2024-09-12T17:39:49.960 INFO:tasks.workunit.client.0.smithi119.stderr: 12: _start() 2024-09-12T17:39:49.960 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:39:49.960 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:39:49.961 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:39:49.961 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:39:49.961 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:39:49.961 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:39:49.961 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:39:49.961 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:39:49.961 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:39:49.961 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:39:49.961 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:39:49.961 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:39:49.961 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:39:49.961 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:39:49.961 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:39:49.962 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:39:49.962 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:39:49.962 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:39:49.962 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:39:49.962 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:39:49.962 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:39:49.962 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:39:49.962 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:39:49.962 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:39:49.962 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:39:49.962 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:39:49.962 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:39:49.962 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:39:49.963 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:39:49.963 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:39:49.963 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:39:49.963 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:39:49.963 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:39:49.963 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:39:49.963 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:39:49.963 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:39:49.963 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:39:49.963 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:39:49.963 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:39:49.963 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:39:49.963 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:39:49.963 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:39:49.964 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:39:49.964 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:39:49.964 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:39:49.964 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:39:49.964 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:39:49.964 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:39:49.964 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:39:49.964 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:39:49.964 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:39:49.964 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:39:49.964 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:39:49.964 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:39:49.964 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:39:49.964 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:39:49.965 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:39:49.965 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:39:49.965 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:39:49.965 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:39:49.965 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:39:49.965 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:39:49.965 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:39:49.965 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:39:49.965 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:39:49.965 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:39:49.965 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:39:49.965 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:39:49.965 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:39:49.966 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:39:49.966 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:39:49.966 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:39:49.966 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:39:49.966 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:39:49.966 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:39:49.966 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:39:49.966 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:39:49.966 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:39:49.966 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:39:49.966 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:39:49.966 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:39:49.966 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:39:49.966 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:39:49.967 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:39:49.967 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:39:49.967 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:39:49.967 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:39:49.967 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:39:49.967 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:39:49.967 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:39:49.967 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:39:49.967 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:39:49.967 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:39:49.967 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:39:49.967 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:39:49.967 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:39:49.967 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52b8fe1640 / http_manager 2024-09-12T17:39:49.968 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52bafe5640 / http_manager 2024-09-12T17:39:49.968 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52bbfe7640 / rgw_dt_lg_renew 2024-09-12T17:39:49.968 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52d77fe640 / ms_dispatch 2024-09-12T17:39:49.968 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52e8ff9640 / io_context_pool 2024-09-12T17:39:49.968 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52e97fa640 / io_context_pool 2024-09-12T17:39:49.968 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52eb7fe640 / ms_dispatch 2024-09-12T17:39:49.968 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52f2604640 / ms_dispatch 2024-09-12T17:39:49.968 INFO:tasks.workunit.client.0.smithi119.stderr: 7f52f3e07640 / io_context_pool 2024-09-12T17:39:49.968 INFO:tasks.workunit.client.0.smithi119.stderr: 7f540565a640 / msgr-worker-2 2024-09-12T17:39:49.968 INFO:tasks.workunit.client.0.smithi119.stderr: 7f5405e5b640 / msgr-worker-1 2024-09-12T17:39:49.968 INFO:tasks.workunit.client.0.smithi119.stderr: 7f540665c640 / msgr-worker-0 2024-09-12T17:39:49.968 INFO:tasks.workunit.client.0.smithi119.stderr: 7f5406e5d640 / io_context_pool 2024-09-12T17:39:49.968 INFO:tasks.workunit.client.0.smithi119.stderr: 7f54083559c0 / radosgw-admin 2024-09-12T17:39:49.969 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:39:49.969 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:39:49.969 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:39:49.831768Z_c4bca24b-a1e7-43b7-b2c8-e8be6f91de13/log 2024-09-12T17:39:49.969 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:39:49.969 INFO:tasks.workunit.client.0.smithi119.stderr:Aborted 2024-09-12T17:39:49.969 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:39:49.973 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:49.973 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:49.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.916+0000 7fd2c14249c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.916+0000 7fd2c14249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.916+0000 7fd2c14249c0 20 realm 2024-09-12T17:39:49.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.916+0000 7fd2c14249c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.916+0000 7fd2c14249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.916+0000 7fd2c14249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:49.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.916+0000 7fd2c14249c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.920+0000 7fd2c14249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.920+0000 7fd2c14249c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.920+0000 7fd2c14249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:49.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.920+0000 7fd2c14249c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.920+0000 7fd2c14249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:49.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.920+0000 7fd2c14249c0 20 searching for the correct realm 2024-09-12T17:39:49.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.928+0000 7fd2bef2a640 0 -- 172.21.15.119:0/2529854384 >> [v2:172.21.15.119:6800/1732749810,v1:172.21.15.119:6801/1732749810] conn(0x561b75a73e90 msgr2=0x561b75a76350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:49.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.932+0000 7fd2be729640 0 -- 172.21.15.119:0/2529854384 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fd2b8010040 msgr2=0x7fd2b808a970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:49.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.940+0000 7fd2c14249c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:49.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.940+0000 7fd2c14249c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:49.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.940+0000 7fd2c14249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:49.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.940+0000 7fd2c14249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:49.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.940+0000 7fd2c14249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:49.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.940+0000 7fd2c14249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:49.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.940+0000 7fd2c14249c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.940+0000 7fd2c14249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.940+0000 7fd2c14249c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.940+0000 7fd2c14249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:49.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.940+0000 7fd2c14249c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.944+0000 7fd2c14249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:49.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.944+0000 7fd2c14249c0 20 zone default found 2024-09-12T17:39:49.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.944+0000 7fd2c14249c0 4 Realm: () 2024-09-12T17:39:49.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.944+0000 7fd2c14249c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:49.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.944+0000 7fd2c14249c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:49.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.944+0000 7fd2c14249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:49.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.944+0000 7fd2c14249c0 20 zonegroup default 2024-09-12T17:39:49.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.944+0000 7fd2c14249c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.944+0000 7fd2c14249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.944+0000 7fd2c14249c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.944+0000 7fd2c14249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.944+0000 7fd2c14249c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.944+0000 7fd2c14249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:49.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.944+0000 7fd2c14249c0 20 started sync module instance, tier type = 2024-09-12T17:39:49.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.944+0000 7fd2c14249c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:49.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.960+0000 7fd2c14249c0 20 add_watcher() i=0 2024-09-12T17:39:49.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.960+0000 7fd2c14249c0 20 add_watcher() i=1 2024-09-12T17:39:49.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.960+0000 7fd2c14249c0 20 add_watcher() i=2 2024-09-12T17:39:49.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.960+0000 7fd2c14249c0 20 add_watcher() i=3 2024-09-12T17:39:49.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.960+0000 7fd2c14249c0 20 add_watcher() i=4 2024-09-12T17:39:49.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.960+0000 7fd2c14249c0 20 add_watcher() i=5 2024-09-12T17:39:49.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.960+0000 7fd2c14249c0 20 add_watcher() i=6 2024-09-12T17:39:49.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.960+0000 7fd2c14249c0 20 add_watcher() i=7 2024-09-12T17:39:49.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.960+0000 7fd2c14249c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:49.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.964+0000 7fd1757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:49.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.964+0000 7fd2c14249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:49.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.964+0000 7fd2c14249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:49.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.964+0000 7fd2c14249c0 5 note: GC not initialized 2024-09-12T17:39:49.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.964+0000 7fd0effff640 20 reqs_thread_entry: start 2024-09-12T17:39:49.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.964+0000 7fd2c14249c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:49.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.964+0000 7fd2c14249c0 20 Filter name: none 2024-09-12T17:39:49.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.964+0000 7fd0edffb640 20 reqs_thread_entry: start 2024-09-12T17:39:49.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.964+0000 7fd2c14249c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.968+0000 7fd2c14249c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:49.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.968+0000 7fd2c14249c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.968+0000 7fd2c14249c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:39:49.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.968+0000 7fd2c14249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:49.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.968+0000 7fd2c14249c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.968+0000 7fd2c14249c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:49.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.968+0000 7fd2c14249c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:49.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.968+0000 7fd2c14249c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:39:49.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.968+0000 7fd2c14249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:49.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.972+0000 7fd1757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:49.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.976+0000 7fd2c14249c0 20 remove_watcher() i=0 2024-09-12T17:39:49.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.976+0000 7fd2c14249c0 2 removed watcher, disabling cache 2024-09-12T17:39:49.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.976+0000 7fd2c14249c0 20 remove_watcher() i=1 2024-09-12T17:39:49.980 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.980+0000 7fd2c14249c0 20 remove_watcher() i=2 2024-09-12T17:39:49.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.980+0000 7fd2c14249c0 20 remove_watcher() i=3 2024-09-12T17:39:49.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.984+0000 7fd2c14249c0 20 remove_watcher() i=4 2024-09-12T17:39:49.985 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.984+0000 7fd2c14249c0 20 remove_watcher() i=5 2024-09-12T17:39:49.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.984+0000 7fd2c14249c0 20 remove_watcher() i=6 2024-09-12T17:39:49.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:49.988+0000 7fd2c14249c0 20 remove_watcher() i=7 2024-09-12T17:39:50.047 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:39:50.072 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:50.072 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:50.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.112+0000 7f5d57d7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:50.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.116+0000 7f5d57d7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:50.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.116+0000 7f5d57d7f9c0 20 realm 2024-09-12T17:39:50.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.116+0000 7f5d57d7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:50.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.116+0000 7f5d57d7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:50.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.116+0000 7f5d57d7f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:50.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.116+0000 7f5d57d7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:50.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.116+0000 7f5d57d7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:50.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.116+0000 7f5d57d7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:50.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.116+0000 7f5d57d7f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:50.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.116+0000 7f5d57d7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:50.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.120+0000 7f5d57d7f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:50.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.120+0000 7f5d57d7f9c0 20 searching for the correct realm 2024-09-12T17:39:50.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.120+0000 7f5d56086640 0 -- 172.21.15.119:0/4206595675 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f5d4c05bc60 msgr2=0x7f5d4c05b6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:50.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.128+0000 7f5d55084640 0 -- 172.21.15.119:0/4206595675 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f5d50107510 msgr2=0x7f5d501230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:50.346 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.344+0000 7f5d57d7f9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:39:50.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.344+0000 7f5d57d7f9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:39:50.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.344+0000 7f5d57d7f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:50.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.344+0000 7f5d57d7f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:50.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.344+0000 7f5d57d7f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:50.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.344+0000 7f5d57d7f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:50.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.344+0000 7f5d57d7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:50.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.344+0000 7f5d57d7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:50.347 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.344+0000 7f5d57d7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:50.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:50.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:50.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:50.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 20 zone default found 2024-09-12T17:39:50.348 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 4 Realm: () 2024-09-12T17:39:50.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:39:50.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:39:50.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:50.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 20 zonegroup default 2024-09-12T17:39:50.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:50.349 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:50.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:50.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:50.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:50.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:50.350 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 20 started sync module instance, tier type = 2024-09-12T17:39:50.351 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.348+0000 7f5d57d7f9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:39:50.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.372+0000 7f5d57d7f9c0 20 add_watcher() i=0 2024-09-12T17:39:50.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.372+0000 7f5d57d7f9c0 20 add_watcher() i=1 2024-09-12T17:39:50.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.372+0000 7f5d57d7f9c0 20 add_watcher() i=2 2024-09-12T17:39:50.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.372+0000 7f5d57d7f9c0 20 add_watcher() i=3 2024-09-12T17:39:50.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.372+0000 7f5d57d7f9c0 20 add_watcher() i=4 2024-09-12T17:39:50.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.372+0000 7f5d57d7f9c0 20 add_watcher() i=5 2024-09-12T17:39:50.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.372+0000 7f5d57d7f9c0 20 add_watcher() i=6 2024-09-12T17:39:50.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.376+0000 7f5d57d7f9c0 20 add_watcher() i=7 2024-09-12T17:39:50.375 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.376+0000 7f5d57d7f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:50.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.380+0000 7f5c077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:50.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.380+0000 7f5d57d7f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:50.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.380+0000 7f5d57d7f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:50.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.380+0000 7f5d57d7f9c0 5 note: GC not initialized 2024-09-12T17:39:50.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.380+0000 7f5c067fc640 20 reqs_thread_entry: start 2024-09-12T17:39:50.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.380+0000 7f5d57d7f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:50.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.380+0000 7f5d57d7f9c0 20 Filter name: none 2024-09-12T17:39:50.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.380+0000 7f5b77fff640 20 reqs_thread_entry: start 2024-09-12T17:39:50.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.380+0000 7f5d57d7f9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:39:50.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.380+0000 7f5d57d7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:50.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:50.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:39:50.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:39:50.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:39:50.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:50.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:39:50.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:39:50.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:39:50.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:50.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:50.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:39:50.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:39:50.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:39:50.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:39:50.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:39:50.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:39:50.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:39:50.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:39:50.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.384+0000 7f5d57d7f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:39:50.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.388+0000 7f5d57d7f9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:39:50.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.388+0000 7f5d57d7f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:39:50.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.388+0000 7f5d57d7f9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:39:50.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.388+0000 7f5d57d7f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:39:50.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.388+0000 7f5d57d7f9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:39:50.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.388+0000 7f5d57d7f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:39:50.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.388+0000 7f5d57d7f9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:39:50.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.388+0000 7f5d57d7f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:39:50.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.392+0000 7f5d57d7f9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:39:50.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.392+0000 7f5d57d7f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:39:50.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.392+0000 7f5d57d7f9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:39:50.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.392+0000 7f5d57d7f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:39:50.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.392+0000 7f5d57d7f9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:39:50.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.392+0000 7f5d57d7f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:39:50.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.392+0000 7f5d57d7f9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:39:50.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.392+0000 7f5d57d7f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:39:50.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.392+0000 7f5d57d7f9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:39:50.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.392+0000 7f5d57d7f9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:39:50.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.396+0000 7f5c077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:50.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.400+0000 7f5d57d7f9c0 20 remove_watcher() i=0 2024-09-12T17:39:50.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.400+0000 7f5d57d7f9c0 2 removed watcher, disabling cache 2024-09-12T17:39:50.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.404+0000 7f5d57d7f9c0 20 remove_watcher() i=1 2024-09-12T17:39:50.405 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.404+0000 7f5d57d7f9c0 20 remove_watcher() i=2 2024-09-12T17:39:50.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.408+0000 7f5d57d7f9c0 20 remove_watcher() i=3 2024-09-12T17:39:50.410 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.408+0000 7f5d57d7f9c0 20 remove_watcher() i=4 2024-09-12T17:39:50.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.412+0000 7f5d57d7f9c0 20 remove_watcher() i=5 2024-09-12T17:39:50.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.412+0000 7f5d57d7f9c0 20 remove_watcher() i=6 2024-09-12T17:39:50.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:39:50.416+0000 7f5d57d7f9c0 20 remove_watcher() i=7 2024-09-12T17:40:20.456 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T17:40:20.495 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:20.495 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:20.541 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 realm 2024-09-12T17:40:20.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.539+0000 7f890bc5d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:20.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.543 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.545 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:20.545 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:20.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 searching for the correct realm 2024-09-12T17:40:20.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.551+0000 7f8908f62640 0 -- 172.21.15.119:0/2325088499 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f88fc00e050 msgr2=0x7f88fc036400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:20.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.555+0000 7f8908f62640 0 -- 172.21.15.119:0/2325088499 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f890404cc40 msgr2=0x7f89040653c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:20.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:40:20.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:40:20.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:20.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:20.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:20.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:20.774 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:20.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:20.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 zone default found 2024-09-12T17:40:20.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 4 Realm: () 2024-09-12T17:40:20.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:40:20.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:40:20.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:20.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 zonegroup default 2024-09-12T17:40:20.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 started sync module instance, tier type = 2024-09-12T17:40:20.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:40:20.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=0 2024-09-12T17:40:20.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=1 2024-09-12T17:40:20.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=2 2024-09-12T17:40:20.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=3 2024-09-12T17:40:20.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=4 2024-09-12T17:40:20.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=5 2024-09-12T17:40:20.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=6 2024-09-12T17:40:20.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.803+0000 7f890bc5d9c0 20 add_watcher() i=7 2024-09-12T17:40:20.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.803+0000 7f890bc5d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:20.808 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.807+0000 7f87bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:20.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.807+0000 7f890bc5d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:20.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.807+0000 7f890bc5d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:20.809 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 note: GC not initialized 2024-09-12T17:40:20.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.807+0000 7f87be7e4640 20 reqs_thread_entry: start 2024-09-12T17:40:20.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.807+0000 7f890bc5d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:40:20.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.807+0000 7f890bc5d9c0 20 Filter name: none 2024-09-12T17:40:20.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.807+0000 7f872ffff640 20 reqs_thread_entry: start 2024-09-12T17:40:20.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.807+0000 7f890bc5d9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:40:20.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.807+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.811+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:20.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:40:20.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:40:20.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:40:20.812 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.811+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.811+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:40:20.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:20.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:20.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:20.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:20.813 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:40:20.814 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:40:20.830 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.827+0000 7f890bc5d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:20.830 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.827+0000 7f890bc5d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:20.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.827+0000 7f890bc5d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:20.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.827+0000 7f890bc5d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:40:20.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.831+0000 7f87ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333538 cookie 94321101891536 notifier 7844 bl.length()=911 2024-09-12T17:40:20.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.831+0000 7f87ecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:20.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.831+0000 7f87ecff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:20.831 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.831+0000 7f87ecff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:20.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.831+0000 7f890bc5d9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:40:20.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.831+0000 7f890bc5d9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:40:20.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.831+0000 7f890bc5d9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:40:20.834 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.831+0000 7f890bc5d9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:40:20.840 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f890bc5d9c0 time 2024-09-12T17:40:20.842186+0000 2024-09-12T17:40:20.840 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:40:20.841 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:20.841 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f890f5372eb] 2024-09-12T17:40:20.841 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f890f53749f] 2024-09-12T17:40:20.841 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c8d4c600c1] 2024-09-12T17:40:20.841 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x14100ec) [0x55c8d56b60ec] 2024-09-12T17:40:20.841 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c8d4c7218d] 2024-09-12T17:40:20.841 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:40:20.842 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f890e39dd90] 2024-09-12T17:40:20.842 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:40:20.842 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:40:20.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.839+0000 7f890bc5d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f890bc5d9c0 time 2024-09-12T17:40:20.842186+0000 2024-09-12T17:40:20.842 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:40:20.842 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.842 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:20.842 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f890f5372eb] 2024-09-12T17:40:20.842 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f890f53749f] 2024-09-12T17:40:20.842 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c8d4c600c1] 2024-09-12T17:40:20.842 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x14100ec) [0x55c8d56b60ec] 2024-09-12T17:40:20.842 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c8d4c7218d] 2024-09-12T17:40:20.843 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:40:20.843 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f890e39dd90] 2024-09-12T17:40:20.843 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:40:20.843 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:40:20.843 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.843 INFO:tasks.workunit.client.0.smithi119.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:40:20.843 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f890bc5d9c0 thread_name:radosgw-admin 2024-09-12T17:40:20.852 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:20.852 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f890e3b6520] 2024-09-12T17:40:20.852 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:40:20.853 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:40:20.853 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:40:20.853 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f890f537345] 2024-09-12T17:40:20.853 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f890f53749f] 2024-09-12T17:40:20.853 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c8d4c600c1] 2024-09-12T17:40:20.853 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x14100ec) [0x55c8d56b60ec] 2024-09-12T17:40:20.853 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c8d4c7218d] 2024-09-12T17:40:20.853 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:40:20.853 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f890e39dd90] 2024-09-12T17:40:20.853 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:40:20.853 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:40:20.853 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.839+0000 7f890bc5d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:40:20.853 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f890bc5d9c0 thread_name:radosgw-admin 2024-09-12T17:40:20.854 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.854 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:20.854 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f890e3b6520] 2024-09-12T17:40:20.854 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:40:20.854 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:40:20.854 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:40:20.854 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f890f537345] 2024-09-12T17:40:20.854 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f890f53749f] 2024-09-12T17:40:20.854 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c8d4c600c1] 2024-09-12T17:40:20.854 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x14100ec) [0x55c8d56b60ec] 2024-09-12T17:40:20.854 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c8d4c7218d] 2024-09-12T17:40:20.854 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:40:20.854 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f890e39dd90] 2024-09-12T17:40:20.855 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:40:20.855 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:40:20.855 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:40:20.855 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.855 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:40:20.855 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:40:20.515+0000 7f87f7606640 10 monclient: dump: 2024-09-12T17:40:20.855 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.855 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.855 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.855 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.855 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.855 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.855 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.856 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.856 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.856 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.856 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:40:20.515+0000 7f87f7606640 10 monclient: _finish_auth 0 2024-09-12T17:40:20.856 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:40:20.515+0000 7f87f7606640 10 monclient: _check_auth_tickets 2024-09-12T17:40:20.856 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:40:20.515+0000 7f87f7606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:20.856 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:40:20.515+0000 7f87f7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.856 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:40:20.515+0000 7f87f7606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:20.856 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:40:20.515+0000 7f87f7606640 10 monclient: dump: 2024-09-12T17:40:20.856 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.856 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.856 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.856 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.857 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.857 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.857 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.857 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.857 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.857 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.857 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:40:20.515+0000 7f890bc5d9c0 5 monclient: authenticate success, global_id 7832 2024-09-12T17:40:20.857 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:40:20.515+0000 7f890bc5d9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:40:20.857 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:40:20.515+0000 7f890bc5d9c0 4 set_mon_vals no callback set 2024-09-12T17:40:20.857 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:40:20.515+0000 7f890bc5d9c0 10 monclient: shutdown 2024-09-12T17:40:20.857 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:40:20.515+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) unregister_commands rotate-key 2024-09-12T17:40:20.858 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:40:20.515+0000 7f890bc5d9c0 10 monclient: build_initial_monmap 2024-09-12T17:40:20.858 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:40:20.515+0000 7f890bc5d9c0 1 build_initial for_mkfs: 0 2024-09-12T17:40:20.858 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:40:20.515+0000 7f890bc5d9c0 10 monclient: monmap: 2024-09-12T17:40:20.858 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:40:20.858 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:20.858 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:40:20.858 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:40:20.859 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:20.859 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.859 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:40:20.859 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:40:20.859 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:40:20.859 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.859 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding auth protocol: cephx 2024-09-12T17:40:20.859 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding auth protocol: cephx 2024-09-12T17:40:20.859 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding auth protocol: cephx 2024-09-12T17:40:20.859 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: secure 2024-09-12T17:40:20.860 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: crc 2024-09-12T17:40:20.860 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: secure 2024-09-12T17:40:20.860 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: crc 2024-09-12T17:40:20.860 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: secure 2024-09-12T17:40:20.860 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: crc 2024-09-12T17:40:20.860 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: crc 2024-09-12T17:40:20.860 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: secure 2024-09-12T17:40:20.860 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: crc 2024-09-12T17:40:20.860 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: secure 2024-09-12T17:40:20.860 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: crc 2024-09-12T17:40:20.860 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: secure 2024-09-12T17:40:20.860 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.860 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 1 librados: starting msgr at 2024-09-12T17:40:20.861 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 1 librados: starting objecter 2024-09-12T17:40:20.861 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command objecter_requests hook 0x55c8d7b65360 2024-09-12T17:40:20.861 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 1 librados: setting wanted keys 2024-09-12T17:40:20.861 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 1 librados: calling monclient init 2024-09-12T17:40:20.861 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient: init 2024-09-12T17:40:20.861 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding auth protocol: cephx 2024-09-12T17:40:20.861 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding auth protocol: cephx 2024-09-12T17:40:20.861 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding auth protocol: cephx 2024-09-12T17:40:20.861 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: secure 2024-09-12T17:40:20.861 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: crc 2024-09-12T17:40:20.861 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: secure 2024-09-12T17:40:20.861 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: crc 2024-09-12T17:40:20.862 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: secure 2024-09-12T17:40:20.862 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: crc 2024-09-12T17:40:20.862 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: crc 2024-09-12T17:40:20.862 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: secure 2024-09-12T17:40:20.862 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: crc 2024-09-12T17:40:20.862 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: secure 2024-09-12T17:40:20.862 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: crc 2024-09-12T17:40:20.862 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: secure 2024-09-12T17:40:20.862 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.862 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.862 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command rotate-key hook 0x55c8d7b62568 2024-09-12T17:40:20.862 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:40:20.862 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:40:20.863 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-a con 0x55c8d7a12e30 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:40:20.863 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-b con 0x55c8d7aa81f0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:40:20.863 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-c con 0x55c8d7aa85d0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:40:20.863 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.863 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.863 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.863 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:40:20.863 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient(hunting): authenticate will time out at 2788.553107s 2024-09-12T17:40:20.863 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient(hunting): get_auth_request con 0x55c8d7aa85d0 auth_method 0 2024-09-12T17:40:20.863 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.863 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.863 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.863 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:40:20.519+0000 7f8909763640 10 monclient(hunting): get_auth_request con 0x55c8d7a12e30 auth_method 0 2024-09-12T17:40:20.864 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:40:20.519+0000 7f8909763640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.864 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:40:20.519+0000 7f8909763640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.864 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:40:20.519+0000 7f8909763640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.864 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:20.864 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:20.864 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:20.864 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:40:20.519+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:20.864 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:40:20.519+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:20.864 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:40:20.519+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:20.865 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:40:20.519+0000 7f8908f62640 10 monclient(hunting): get_auth_request con 0x55c8d7aa81f0 auth_method 0 2024-09-12T17:40:20.865 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:40:20.519+0000 7f8908f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.865 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:40:20.519+0000 7f8908f62640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.865 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:40:20.519+0000 7f8908f62640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.865 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient(hunting): handle_auth_done global_id 7835 payload 824 2024-09-12T17:40:20.865 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient: _finish_hunting 0 2024-09-12T17:40:20.865 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:40:20.519+0000 7f8909f64640 1 monclient: found mon.noname-c 2024-09-12T17:40:20.865 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.865 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.865 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:20.865 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: dump: 2024-09-12T17:40:20.865 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.866 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.866 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.866 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.866 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.866 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.866 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.866 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.866 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.866 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.866 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: _finish_auth 0 2024-09-12T17:40:20.867 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: _check_auth_tickets 2024-09-12T17:40:20.867 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:20.867 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.867 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:20.867 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: dump: 2024-09-12T17:40:20.867 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.867 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.867 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.867 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.867 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.867 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.867 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.867 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.867 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.868 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.868 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 monclient: authenticate success, global_id 7835 2024-09-12T17:40:20.868 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:40:20.519+0000 7f87f7606640 4 set_mon_vals no callback set 2024-09-12T17:40:20.868 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient: _renew_subs 2024-09-12T17:40:20.868 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.868 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient: _renew_subs 2024-09-12T17:40:20.868 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.868 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 1 librados: init done 2024-09-12T17:40:20.868 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:40:20.523+0000 7f87f5e03640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:40:20.868 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:40:20.523+0000 7f87f5e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:20.868 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:40:20.523+0000 7f87f5e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:20.868 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:40:20.523+0000 7f8909763640 10 monclient: get_auth_request con 0x7f87f0070ae0 auth_method 0 2024-09-12T17:40:20.868 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:40:20.523+0000 7f8908f62640 10 monclient: get_auth_request con 0x55c8d7baa060 auth_method 0 2024-09-12T17:40:20.869 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:40:20.523+0000 7f8909763640 10 monclient: get_auth_request con 0x55c8d7bad240 auth_method 0 2024-09-12T17:40:20.869 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:40:20.523+0000 7f8908f62640 10 monclient: get_auth_request con 0x55c8d7bb1430 auth_method 0 2024-09-12T17:40:20.869 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:40:20.527+0000 7f8909f64640 10 monclient: get_auth_request con 0x55c8d7bb5160 auth_method 0 2024-09-12T17:40:20.869 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 10 monclient: build_initial_monmap 2024-09-12T17:40:20.869 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 1 build_initial for_mkfs: 0 2024-09-12T17:40:20.869 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 10 monclient: monmap: 2024-09-12T17:40:20.869 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:40:20.869 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:20.869 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:40:20.869 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:40:20.869 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:20.869 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.869 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:40:20.870 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:40:20.870 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:40:20.870 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.870 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding auth protocol: cephx 2024-09-12T17:40:20.870 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding auth protocol: cephx 2024-09-12T17:40:20.870 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding auth protocol: cephx 2024-09-12T17:40:20.870 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: secure 2024-09-12T17:40:20.870 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: crc 2024-09-12T17:40:20.870 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: secure 2024-09-12T17:40:20.870 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: crc 2024-09-12T17:40:20.870 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: secure 2024-09-12T17:40:20.870 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: crc 2024-09-12T17:40:20.870 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: crc 2024-09-12T17:40:20.871 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: secure 2024-09-12T17:40:20.871 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: crc 2024-09-12T17:40:20.871 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: secure 2024-09-12T17:40:20.871 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: crc 2024-09-12T17:40:20.871 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: secure 2024-09-12T17:40:20.871 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.871 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c8d7bbcc50 EEXIST 2024-09-12T17:40:20.871 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: init 2024-09-12T17:40:20.871 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding auth protocol: cephx 2024-09-12T17:40:20.871 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding auth protocol: cephx 2024-09-12T17:40:20.872 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding auth protocol: cephx 2024-09-12T17:40:20.872 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: secure 2024-09-12T17:40:20.872 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: crc 2024-09-12T17:40:20.872 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: secure 2024-09-12T17:40:20.872 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: crc 2024-09-12T17:40:20.872 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: secure 2024-09-12T17:40:20.872 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: crc 2024-09-12T17:40:20.872 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: crc 2024-09-12T17:40:20.872 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: secure 2024-09-12T17:40:20.872 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: crc 2024-09-12T17:40:20.872 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: secure 2024-09-12T17:40:20.873 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: crc 2024-09-12T17:40:20.873 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: secure 2024-09-12T17:40:20.873 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.873 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.873 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command rotate-key cmddesc rotate-key hook 0x55c8d7bb8300 EEXIST 2024-09-12T17:40:20.873 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:40:20.873 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:40:20.873 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-a con 0x55c8d7be0e00 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:40:20.873 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-c con 0x55c8d7be0730 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:40:20.873 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-b con 0x55c8d7bdf110 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:40:20.873 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.873 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.873 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.874 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:40:20.874 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient(hunting): authenticate will time out at 2788.564863s 2024-09-12T17:40:20.874 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:40:20.531+0000 7f8908f62640 10 monclient(hunting): get_auth_request con 0x55c8d7be0e00 auth_method 0 2024-09-12T17:40:20.874 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:40:20.531+0000 7f8908f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.874 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:40:20.531+0000 7f8908f62640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.874 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:40:20.531+0000 7f8908f62640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.874 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient(hunting): get_auth_request con 0x55c8d7be0730 auth_method 0 2024-09-12T17:40:20.874 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.874 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.874 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.874 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:20.874 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:20.874 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:20.874 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:40:20.531+0000 7f8908f62640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:20.875 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:40:20.531+0000 7f8908f62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:20.875 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:40:20.531+0000 7f8908f62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:20.875 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient(hunting): handle_auth_done global_id 7838 payload 824 2024-09-12T17:40:20.875 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient: _finish_hunting 0 2024-09-12T17:40:20.875 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:40:20.531+0000 7f8909f64640 1 monclient: found mon.noname-c 2024-09-12T17:40:20.875 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.875 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.875 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:20.875 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: dump: 2024-09-12T17:40:20.876 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.876 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.876 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.876 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.876 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.876 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.876 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.876 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.876 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.876 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.876 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: _finish_auth 0 2024-09-12T17:40:20.876 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: _check_auth_tickets 2024-09-12T17:40:20.877 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 monclient: authenticate success, global_id 7838 2024-09-12T17:40:20.877 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: _renew_subs 2024-09-12T17:40:20.877 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.877 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:20.877 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.877 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:20.877 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: dump: 2024-09-12T17:40:20.877 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.877 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.877 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.878 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.878 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.878 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.878 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.878 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.878 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.878 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.878 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:40:20.531+0000 7f88fbfff640 4 set_mon_vals no callback set 2024-09-12T17:40:20.878 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: _renew_subs 2024-09-12T17:40:20.878 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.878 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:40:20.531+0000 7f87eeffd640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:40:20.878 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:40:20.531+0000 7f87eeffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:20.878 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:40:20.531+0000 7f87eeffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:20.879 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: get_monmap_and_config 2024-09-12T17:40:20.879 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: build_initial_monmap 2024-09-12T17:40:20.879 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 1 build_initial for_mkfs: 0 2024-09-12T17:40:20.879 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: monmap: 2024-09-12T17:40:20.879 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:40:20.879 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:20.879 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:40:20.879 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:40:20.879 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:20.879 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.880 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:40:20.880 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:40:20.880 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:40:20.880 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.880 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding auth protocol: cephx 2024-09-12T17:40:20.880 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding auth protocol: cephx 2024-09-12T17:40:20.880 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding auth protocol: cephx 2024-09-12T17:40:20.880 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: secure 2024-09-12T17:40:20.880 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: crc 2024-09-12T17:40:20.880 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: secure 2024-09-12T17:40:20.880 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: crc 2024-09-12T17:40:20.880 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: secure 2024-09-12T17:40:20.881 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: crc 2024-09-12T17:40:20.881 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: crc 2024-09-12T17:40:20.881 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: secure 2024-09-12T17:40:20.881 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: crc 2024-09-12T17:40:20.881 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: secure 2024-09-12T17:40:20.881 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: crc 2024-09-12T17:40:20.881 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: secure 2024-09-12T17:40:20.881 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:40:20.531+0000 7f8908f62640 10 monclient: get_auth_request con 0x7f87e4070a20 auth_method 0 2024-09-12T17:40:20.881 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.881 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: init 2024-09-12T17:40:20.881 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding auth protocol: cephx 2024-09-12T17:40:20.881 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding auth protocol: cephx 2024-09-12T17:40:20.882 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding auth protocol: cephx 2024-09-12T17:40:20.882 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: secure 2024-09-12T17:40:20.882 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: crc 2024-09-12T17:40:20.882 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: secure 2024-09-12T17:40:20.882 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: crc 2024-09-12T17:40:20.882 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: secure 2024-09-12T17:40:20.882 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: crc 2024-09-12T17:40:20.882 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: crc 2024-09-12T17:40:20.882 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: secure 2024-09-12T17:40:20.882 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: crc 2024-09-12T17:40:20.882 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: secure 2024-09-12T17:40:20.882 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: crc 2024-09-12T17:40:20.882 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: secure 2024-09-12T17:40:20.883 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.883 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.883 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command rotate-key cmddesc rotate-key hook 0x7fff30b95db8 EEXIST 2024-09-12T17:40:20.883 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:40:20.883 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:40:20.883 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-b con 0x55c8d7c34820 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:40:20.883 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-c con 0x55c8d7c04240 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:40:20.883 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-a con 0x55c8d7c2fff0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:40:20.883 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.883 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.883 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.883 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:40:20.883 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): authenticate will time out at 2788.568895s 2024-09-12T17:40:20.883 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): get_auth_request con 0x55c8d7c04240 auth_method 0 2024-09-12T17:40:20.884 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.884 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.884 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.884 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): get_auth_request con 0x55c8d7c2fff0 auth_method 0 2024-09-12T17:40:20.884 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.884 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.884 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.884 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:20.884 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:20.885 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:20.885 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:20.885 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:20.885 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:20.885 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:40:20.535+0000 7f8908f62640 10 monclient(hunting): get_auth_request con 0x55c8d7c34820 auth_method 0 2024-09-12T17:40:20.885 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:40:20.535+0000 7f8908f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.885 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:40:20.535+0000 7f8908f62640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.885 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:40:20.535+0000 7f8908f62640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.885 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): handle_auth_done global_id 7841 payload 274 2024-09-12T17:40:20.885 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient: _finish_hunting 0 2024-09-12T17:40:20.885 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:40:20.535+0000 7f8909f64640 1 monclient: found mon.noname-c 2024-09-12T17:40:20.886 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.886 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.886 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:20.886 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: dump: 2024-09-12T17:40:20.886 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.886 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.886 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.886 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.886 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.886 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.886 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.886 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.886 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.887 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.887 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: _finish_auth 0 2024-09-12T17:40:20.887 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: _check_auth_tickets 2024-09-12T17:40:20.887 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 monclient: authenticate success, global_id 7841 2024-09-12T17:40:20.887 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:20.887 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.887 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:20.887 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: dump: 2024-09-12T17:40:20.887 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.887 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.887 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.887 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.888 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.888 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.888 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.888 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.888 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.888 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.888 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:40:20.889 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 4 set_mon_vals no callback set 2024-09-12T17:40:20.889 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: shutdown 2024-09-12T17:40:20.889 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: build_initial_monmap 2024-09-12T17:40:20.889 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 1 build_initial for_mkfs: 0 2024-09-12T17:40:20.889 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: monmap: 2024-09-12T17:40:20.889 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:40:20.890 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:20.890 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:40:20.890 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:40:20.890 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:20.890 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.890 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:40:20.890 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:40:20.890 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:40:20.890 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.890 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding auth protocol: cephx 2024-09-12T17:40:20.890 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding auth protocol: cephx 2024-09-12T17:40:20.890 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding auth protocol: cephx 2024-09-12T17:40:20.891 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: secure 2024-09-12T17:40:20.891 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: crc 2024-09-12T17:40:20.891 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: secure 2024-09-12T17:40:20.891 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: crc 2024-09-12T17:40:20.891 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: secure 2024-09-12T17:40:20.891 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: crc 2024-09-12T17:40:20.891 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: crc 2024-09-12T17:40:20.891 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: secure 2024-09-12T17:40:20.891 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: crc 2024-09-12T17:40:20.891 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: secure 2024-09-12T17:40:20.891 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: crc 2024-09-12T17:40:20.891 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: secure 2024-09-12T17:40:20.891 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.892 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 1 librados: starting msgr at 2024-09-12T17:40:20.892 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 1 librados: starting objecter 2024-09-12T17:40:20.892 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c8d7c27530 EEXIST 2024-09-12T17:40:20.892 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 1 librados: setting wanted keys 2024-09-12T17:40:20.892 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 1 librados: calling monclient init 2024-09-12T17:40:20.892 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: init 2024-09-12T17:40:20.892 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding auth protocol: cephx 2024-09-12T17:40:20.892 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding auth protocol: cephx 2024-09-12T17:40:20.892 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding auth protocol: cephx 2024-09-12T17:40:20.892 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: secure 2024-09-12T17:40:20.892 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: crc 2024-09-12T17:40:20.893 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: secure 2024-09-12T17:40:20.893 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: crc 2024-09-12T17:40:20.893 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: secure 2024-09-12T17:40:20.893 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: crc 2024-09-12T17:40:20.893 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: crc 2024-09-12T17:40:20.893 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: secure 2024-09-12T17:40:20.893 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: crc 2024-09-12T17:40:20.893 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: secure 2024-09-12T17:40:20.894 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: crc 2024-09-12T17:40:20.894 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: secure 2024-09-12T17:40:20.894 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.894 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.894 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command rotate-key cmddesc rotate-key hook 0x55c8d7be2d68 EEXIST 2024-09-12T17:40:20.894 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:40:20.894 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:40:20.894 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-b con 0x55c8d7c04240 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:40:20.894 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-c con 0x55c8d7c2fff0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:40:20.894 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-a con 0x55c8d7c34820 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:40:20.894 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.894 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.894 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.895 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:40:20.895 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): authenticate will time out at 2788.571550s 2024-09-12T17:40:20.895 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): get_auth_request con 0x55c8d7c2fff0 auth_method 0 2024-09-12T17:40:20.895 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.895 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.895 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.895 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): get_auth_request con 0x55c8d7c34820 auth_method 0 2024-09-12T17:40:20.895 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.895 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.895 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.895 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:20.895 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:20.896 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:20.896 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:20.896 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:20.896 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:20.896 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:40:20.535+0000 7f8908f62640 10 monclient(hunting): get_auth_request con 0x55c8d7c04240 auth_method 0 2024-09-12T17:40:20.896 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:40:20.535+0000 7f8908f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.896 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:40:20.535+0000 7f8908f62640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.896 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:40:20.535+0000 7f8908f62640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.896 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): handle_auth_done global_id 7844 payload 824 2024-09-12T17:40:20.896 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient: _finish_hunting 0 2024-09-12T17:40:20.896 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:40:20.535+0000 7f8909f64640 1 monclient: found mon.noname-c 2024-09-12T17:40:20.896 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.896 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.897 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:20.897 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: dump: 2024-09-12T17:40:20.897 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.897 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.897 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.897 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.897 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.897 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.897 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.897 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.897 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.897 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.897 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: _finish_auth 0 2024-09-12T17:40:20.898 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: _check_auth_tickets 2024-09-12T17:40:20.898 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:20.898 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.898 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:20.898 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: dump: 2024-09-12T17:40:20.898 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.898 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.898 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.898 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.898 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.898 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.898 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.898 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.899 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.899 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.899 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 5 monclient: authenticate success, global_id 7844 2024-09-12T17:40:20.899 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 10 monclient: _renew_subs 2024-09-12T17:40:20.899 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.899 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:40:20.539+0000 7f87ecff9640 4 set_mon_vals no callback set 2024-09-12T17:40:20.899 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 10 monclient: _renew_subs 2024-09-12T17:40:20.899 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.899 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 1 librados: init done 2024-09-12T17:40:20.899 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command cr dump hook 0x55c8d7c32ff8 2024-09-12T17:40:20.899 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.899 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:40:20.539+0000 7f87daffd640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:40:20.899 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:40:20.539+0000 7f87daffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:20.899 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:40:20.539+0000 7f87daffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:20.900 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:40:20.539+0000 7f8908f62640 10 monclient: get_auth_request con 0x7f87d4070b10 auth_method 0 2024-09-12T17:40:20.900 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:40:20.539+0000 7f8909763640 10 monclient: get_auth_request con 0x55c8d7c4d890 auth_method 0 2024-09-12T17:40:20.900 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.900 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 realm 2024-09-12T17:40:20.900 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.900 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.900 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:20.900 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.900 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.900 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.900 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:40:20.543+0000 7f8908f62640 10 monclient: get_auth_request con 0x55c8d7c51a10 auth_method 0 2024-09-12T17:40:20.900 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:20.900 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.901 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:40:20.543+0000 7f8909f64640 10 monclient: get_auth_request con 0x55c8d7c55270 auth_method 0 2024-09-12T17:40:20.901 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:20.901 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 searching for the correct realm 2024-09-12T17:40:20.901 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:40:20.543+0000 7f8909763640 10 monclient: get_auth_request con 0x55c8d7c59ff0 auth_method 0 2024-09-12T17:40:20.901 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:40:20.547+0000 7f8908f62640 10 monclient: get_auth_request con 0x7f88fc00e050 auth_method 0 2024-09-12T17:40:20.901 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:40:20.547+0000 7f8909f64640 10 monclient: get_auth_request con 0x7f89000c0b20 auth_method 0 2024-09-12T17:40:20.901 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:40:20.551+0000 7f8908f62640 0 -- 172.21.15.119:0/2325088499 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f88fc00e050 msgr2=0x7f88fc036400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:20.901 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:40:20.551+0000 7f87daffd640 1 client.7844.objecter ms_handle_reset 0x7f88fc00e050 session 0x7f88fc02f040 osd.7 2024-09-12T17:40:20.901 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:40:20.551+0000 7f87daffd640 10 monclient: _renew_subs 2024-09-12T17:40:20.901 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:40:20.551+0000 7f87daffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.902 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:40:20.551+0000 7f8908f62640 10 monclient: get_auth_request con 0x7f87d40812c0 auth_method 0 2024-09-12T17:40:20.902 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:40:20.551+0000 7f8909763640 10 monclient: get_auth_request con 0x7f890401a040 auth_method 0 2024-09-12T17:40:20.902 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:40:20.555+0000 7f8908f62640 10 monclient: get_auth_request con 0x7f890404cc40 auth_method 0 2024-09-12T17:40:20.902 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:40:20.555+0000 7f8908f62640 0 -- 172.21.15.119:0/2325088499 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f890404cc40 msgr2=0x7f89040653c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:20.902 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:40:20.759+0000 7f8908f62640 10 monclient: get_auth_request con 0x7f890404cc40 auth_method 0 2024-09-12T17:40:20.902 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:40:20.902 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:40:20.902 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:20.902 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:20.902 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:20.902 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:20.902 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.902 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.903 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.903 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:20.903 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.903 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:20.903 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 zone default found 2024-09-12T17:40:20.903 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 4 Realm: () 2024-09-12T17:40:20.903 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:40:20.903 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:40:20.903 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:20.903 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 zonegroup default 2024-09-12T17:40:20.903 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.903 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.903 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.903 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.904 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.904 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.904 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 started sync module instance, tier type = 2024-09-12T17:40:20.904 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:40:20.904 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=0 2024-09-12T17:40:20.904 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=1 2024-09-12T17:40:20.904 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=2 2024-09-12T17:40:20.904 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=3 2024-09-12T17:40:20.904 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=4 2024-09-12T17:40:20.904 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=5 2024-09-12T17:40:20.904 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=6 2024-09-12T17:40:20.904 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:40:20.803+0000 7f890bc5d9c0 20 add_watcher() i=7 2024-09-12T17:40:20.905 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:40:20.803+0000 7f890bc5d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:20.905 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding auth protocol: cephx 2024-09-12T17:40:20.905 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding auth protocol: cephx 2024-09-12T17:40:20.905 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding auth protocol: cephx 2024-09-12T17:40:20.905 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: secure 2024-09-12T17:40:20.905 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: crc 2024-09-12T17:40:20.905 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: secure 2024-09-12T17:40:20.905 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: crc 2024-09-12T17:40:20.905 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: secure 2024-09-12T17:40:20.905 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: crc 2024-09-12T17:40:20.905 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: crc 2024-09-12T17:40:20.905 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: secure 2024-09-12T17:40:20.905 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: crc 2024-09-12T17:40:20.906 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: secure 2024-09-12T17:40:20.906 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:40:20.807+0000 7f87bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:20.906 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: crc 2024-09-12T17:40:20.906 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: secure 2024-09-12T17:40:20.906 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.906 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:20.906 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:20.906 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command cache list hook 0x55c8d7c22ef0 2024-09-12T17:40:20.906 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command cache inspect hook 0x55c8d7c22ef0 2024-09-12T17:40:20.906 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command cache erase hook 0x55c8d7c22ef0 2024-09-12T17:40:20.906 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command cache zap hook 0x55c8d7c22ef0 2024-09-12T17:40:20.907 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 note: GC not initialized 2024-09-12T17:40:20.907 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:40:20.807+0000 7f87be7e4640 20 reqs_thread_entry: start 2024-09-12T17:40:20.907 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command sync trace show hook 0x7f89000ab6d0 2024-09-12T17:40:20.907 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command sync trace history hook 0x7f89000ab6d0 2024-09-12T17:40:20.907 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command sync trace active hook 0x7f89000ab6d0 2024-09-12T17:40:20.907 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command sync trace active_short hook 0x7f89000ab6d0 2024-09-12T17:40:20.907 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:40:20.908 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 20 Filter name: none 2024-09-12T17:40:20.908 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:40:20.807+0000 7f872ffff640 20 reqs_thread_entry: start 2024-09-12T17:40:20.908 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:40:20.908 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.908 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:20.908 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:40:20.908 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:40:20.908 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:40:20.908 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.908 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:40:20.908 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:20.908 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:20.908 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:20.909 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:20.909 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:40:20.909 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:40:20.909 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:40:20.827+0000 7f890bc5d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:20.909 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:40:20.827+0000 7f890bc5d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:20.909 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:40:20.827+0000 7f890bc5d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:20.909 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:40:20.827+0000 7f890bc5d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:40:20.909 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:40:20.831+0000 7f87ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333538 cookie 94321101891536 notifier 7844 bl.length()=911 2024-09-12T17:40:20.909 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:40:20.831+0000 7f87ecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:20.910 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:40:20.831+0000 7f87ecff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:20.910 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:40:20.831+0000 7f87ecff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:20.910 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:40:20.831+0000 7f890bc5d9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:40:20.910 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:40:20.831+0000 7f890bc5d9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:40:20.910 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:40:20.831+0000 7f890bc5d9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:40:20.910 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:40:20.831+0000 7f890bc5d9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:40:20.910 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:40:20.839+0000 7f890bc5d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f890bc5d9c0 time 2024-09-12T17:40:20.842186+0000 2024-09-12T17:40:20.910 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:40:20.910 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.910 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:20.910 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f890f5372eb] 2024-09-12T17:40:20.910 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f890f53749f] 2024-09-12T17:40:20.910 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c8d4c600c1] 2024-09-12T17:40:20.911 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x14100ec) [0x55c8d56b60ec] 2024-09-12T17:40:20.911 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c8d4c7218d] 2024-09-12T17:40:20.911 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:40:20.911 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f890e39dd90] 2024-09-12T17:40:20.911 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:40:20.911 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:40:20.911 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.911 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:40:20.839+0000 7f890bc5d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:40:20.911 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f890bc5d9c0 thread_name:radosgw-admin 2024-09-12T17:40:20.911 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.911 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:20.911 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f890e3b6520] 2024-09-12T17:40:20.911 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:40:20.912 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:40:20.912 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:40:20.912 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f890f537345] 2024-09-12T17:40:20.912 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f890f53749f] 2024-09-12T17:40:20.912 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c8d4c600c1] 2024-09-12T17:40:20.912 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x14100ec) [0x55c8d56b60ec] 2024-09-12T17:40:20.912 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c8d4c7218d] 2024-09-12T17:40:20.912 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:40:20.912 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f890e39dd90] 2024-09-12T17:40:20.912 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:40:20.912 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:40:20.912 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:40:20.912 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.913 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:40:20.913 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:40:20.913 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:40:20.913 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:40:20.913 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:40:20.913 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:40:20.913 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:40:20.913 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:40:20.913 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:40:20.913 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:40:20.914 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:40:20.914 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:40:20.914 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:40:20.914 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:40:20.914 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:40:20.914 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:40:20.914 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:40:20.914 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:40:20.914 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:40:20.914 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:40:20.914 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:40:20.914 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:40:20.914 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:40:20.914 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:40:20.915 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:40:20.915 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:40:20.915 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:40:20.915 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:40:20.915 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:40:20.915 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:40:20.915 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:40:20.915 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:40:20.915 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:40:20.915 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:40:20.915 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:40:20.915 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:40:20.915 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:40:20.916 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:40:20.916 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:40:20.916 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:40:20.916 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:40:20.916 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:40:20.916 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:40:20.916 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:40:20.916 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:40:20.916 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:40:20.916 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:40:20.916 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:40:20.917 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:40:20.917 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:40:20.917 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:40:20.917 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:40:20.917 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:40:20.917 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:40:20.917 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:40:20.917 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:40:20.917 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:40:20.917 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:40:20.917 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:40:20.917 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:40:20.918 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:40:20.918 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:40:20.918 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:40:20.918 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:40:20.918 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:40:20.918 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:40:20.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:40:20.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:40:20.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:40:20.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:40:20.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:40:20.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:40:20.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:40:20.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:40:20.919 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:40:20.919 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:40:20.919 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:40:20.919 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:40:20.919 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:40:20.919 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:40:20.919 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:40:20.919 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:40:20.919 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:40:20.919 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:40:20.919 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:40:20.919 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:40:20.919 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:40:20.920 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:40:20.920 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:40:20.920 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:40:20.920 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:40:20.920 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:40:20.920 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:40:20.920 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:40:20.920 INFO:tasks.workunit.client.0.smithi119.stderr: 7f872ffff640 / http_manager 2024-09-12T17:40:20.920 INFO:tasks.workunit.client.0.smithi119.stderr: 7f87be7e4640 / http_manager 2024-09-12T17:40:20.920 INFO:tasks.workunit.client.0.smithi119.stderr: 7f87bf7e6640 / rgw_dt_lg_renew 2024-09-12T17:40:20.920 INFO:tasks.workunit.client.0.smithi119.stderr: 7f87daffd640 / ms_dispatch 2024-09-12T17:40:20.920 INFO:tasks.workunit.client.0.smithi119.stderr: 7f87ecff9640 / io_context_pool 2024-09-12T17:40:20.920 INFO:tasks.workunit.client.0.smithi119.stderr: 7f87eeffd640 / ms_dispatch 2024-09-12T17:40:20.920 INFO:tasks.workunit.client.0.smithi119.stderr: 7f87f5e03640 / ms_dispatch 2024-09-12T17:40:20.921 INFO:tasks.workunit.client.0.smithi119.stderr: 7f87f7606640 / io_context_pool 2024-09-12T17:40:20.921 INFO:tasks.workunit.client.0.smithi119.stderr: 7f88fbfff640 / io_context_pool 2024-09-12T17:40:20.921 INFO:tasks.workunit.client.0.smithi119.stderr: 7f8908f62640 / msgr-worker-2 2024-09-12T17:40:20.921 INFO:tasks.workunit.client.0.smithi119.stderr: 7f8909763640 / msgr-worker-1 2024-09-12T17:40:20.921 INFO:tasks.workunit.client.0.smithi119.stderr: 7f8909f64640 / msgr-worker-0 2024-09-12T17:40:20.921 INFO:tasks.workunit.client.0.smithi119.stderr: 7f890bc5d9c0 / radosgw-admin 2024-09-12T17:40:20.921 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:40:20.921 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:40:20.921 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/log/ceph/ceph-client.admin.145754.log 2024-09-12T17:40:20.921 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:40:20.921 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:40:20.921 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:40:20.515+0000 7f87f7606640 10 monclient: dump: 2024-09-12T17:40:20.921 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.922 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.922 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.922 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.922 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.922 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.922 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.922 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.922 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.922 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.922 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:40:20.515+0000 7f87f7606640 10 monclient: _finish_auth 0 2024-09-12T17:40:20.922 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:40:20.515+0000 7f87f7606640 10 monclient: _check_auth_tickets 2024-09-12T17:40:20.922 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:40:20.515+0000 7f87f7606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:20.922 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:40:20.515+0000 7f87f7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.923 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:40:20.515+0000 7f87f7606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:20.923 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:40:20.515+0000 7f87f7606640 10 monclient: dump: 2024-09-12T17:40:20.923 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.923 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.923 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.923 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.923 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.923 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.923 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.923 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.923 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.923 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.923 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:40:20.515+0000 7f890bc5d9c0 5 monclient: authenticate success, global_id 7832 2024-09-12T17:40:20.923 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:40:20.515+0000 7f890bc5d9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:40:20.924 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:40:20.515+0000 7f890bc5d9c0 4 set_mon_vals no callback set 2024-09-12T17:40:20.924 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:40:20.515+0000 7f890bc5d9c0 10 monclient: shutdown 2024-09-12T17:40:20.924 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:40:20.515+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) unregister_commands rotate-key 2024-09-12T17:40:20.924 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:40:20.515+0000 7f890bc5d9c0 10 monclient: build_initial_monmap 2024-09-12T17:40:20.924 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:40:20.515+0000 7f890bc5d9c0 1 build_initial for_mkfs: 0 2024-09-12T17:40:20.924 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:40:20.515+0000 7f890bc5d9c0 10 monclient: monmap: 2024-09-12T17:40:20.924 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:40:20.924 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:20.924 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:40:20.924 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:40:20.924 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:20.924 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.925 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:40:20.925 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:40:20.925 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:40:20.925 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.925 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding auth protocol: cephx 2024-09-12T17:40:20.925 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding auth protocol: cephx 2024-09-12T17:40:20.925 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding auth protocol: cephx 2024-09-12T17:40:20.925 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: secure 2024-09-12T17:40:20.925 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: crc 2024-09-12T17:40:20.925 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: secure 2024-09-12T17:40:20.925 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: crc 2024-09-12T17:40:20.925 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: secure 2024-09-12T17:40:20.925 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: crc 2024-09-12T17:40:20.926 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: crc 2024-09-12T17:40:20.926 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: secure 2024-09-12T17:40:20.926 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: crc 2024-09-12T17:40:20.926 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: secure 2024-09-12T17:40:20.926 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: crc 2024-09-12T17:40:20.926 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b64500) adding con mode: secure 2024-09-12T17:40:20.926 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.926 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 1 librados: starting msgr at 2024-09-12T17:40:20.926 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 1 librados: starting objecter 2024-09-12T17:40:20.926 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command objecter_requests hook 0x55c8d7b65360 2024-09-12T17:40:20.926 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 1 librados: setting wanted keys 2024-09-12T17:40:20.926 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 1 librados: calling monclient init 2024-09-12T17:40:20.926 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient: init 2024-09-12T17:40:20.927 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding auth protocol: cephx 2024-09-12T17:40:20.927 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding auth protocol: cephx 2024-09-12T17:40:20.927 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding auth protocol: cephx 2024-09-12T17:40:20.927 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: secure 2024-09-12T17:40:20.927 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: crc 2024-09-12T17:40:20.927 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: secure 2024-09-12T17:40:20.927 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: crc 2024-09-12T17:40:20.927 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: secure 2024-09-12T17:40:20.927 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: crc 2024-09-12T17:40:20.927 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: crc 2024-09-12T17:40:20.927 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: secure 2024-09-12T17:40:20.927 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: crc 2024-09-12T17:40:20.927 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: secure 2024-09-12T17:40:20.927 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: crc 2024-09-12T17:40:20.928 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7b62420) adding con mode: secure 2024-09-12T17:40:20.928 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.928 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.928 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command rotate-key hook 0x55c8d7b62568 2024-09-12T17:40:20.928 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:40:20.928 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:40:20.928 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-a con 0x55c8d7a12e30 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:40:20.928 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-b con 0x55c8d7aa81f0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:40:20.928 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-c con 0x55c8d7aa85d0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:40:20.928 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.928 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.928 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.928 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:40:20.929 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient(hunting): authenticate will time out at 2788.553107s 2024-09-12T17:40:20.929 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient(hunting): get_auth_request con 0x55c8d7aa85d0 auth_method 0 2024-09-12T17:40:20.929 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.929 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.929 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.929 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:40:20.519+0000 7f8909763640 10 monclient(hunting): get_auth_request con 0x55c8d7a12e30 auth_method 0 2024-09-12T17:40:20.929 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:40:20.519+0000 7f8909763640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.929 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:40:20.519+0000 7f8909763640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.929 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:40:20.519+0000 7f8909763640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.929 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:20.929 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:20.929 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:20.929 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:40:20.519+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:20.930 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:40:20.519+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:20.930 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:40:20.519+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:20.930 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:40:20.519+0000 7f8908f62640 10 monclient(hunting): get_auth_request con 0x55c8d7aa81f0 auth_method 0 2024-09-12T17:40:20.930 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:40:20.519+0000 7f8908f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.930 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:40:20.519+0000 7f8908f62640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.930 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:40:20.519+0000 7f8908f62640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.930 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient(hunting): handle_auth_done global_id 7835 payload 824 2024-09-12T17:40:20.930 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient: _finish_hunting 0 2024-09-12T17:40:20.930 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:40:20.519+0000 7f8909f64640 1 monclient: found mon.noname-c 2024-09-12T17:40:20.930 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:40:20.519+0000 7f8909f64640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.930 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.930 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:20.930 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: dump: 2024-09-12T17:40:20.930 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.931 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.931 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.931 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.931 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.931 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.931 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.931 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.931 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.931 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.931 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: _finish_auth 0 2024-09-12T17:40:20.931 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: _check_auth_tickets 2024-09-12T17:40:20.931 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:20.931 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.932 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:20.932 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:40:20.519+0000 7f87f5e03640 10 monclient: dump: 2024-09-12T17:40:20.932 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.932 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.932 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.932 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.932 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.932 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.932 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.932 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.932 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.932 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.932 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 5 monclient: authenticate success, global_id 7835 2024-09-12T17:40:20.933 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:40:20.519+0000 7f87f7606640 4 set_mon_vals no callback set 2024-09-12T17:40:20.933 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient: _renew_subs 2024-09-12T17:40:20.933 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.933 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient: _renew_subs 2024-09-12T17:40:20.933 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.933 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:40:20.519+0000 7f890bc5d9c0 1 librados: init done 2024-09-12T17:40:20.933 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:40:20.523+0000 7f87f5e03640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:40:20.933 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:40:20.523+0000 7f87f5e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:20.933 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:40:20.523+0000 7f87f5e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:20.933 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:40:20.523+0000 7f8909763640 10 monclient: get_auth_request con 0x7f87f0070ae0 auth_method 0 2024-09-12T17:40:20.933 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:40:20.523+0000 7f8908f62640 10 monclient: get_auth_request con 0x55c8d7baa060 auth_method 0 2024-09-12T17:40:20.933 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:40:20.523+0000 7f8909763640 10 monclient: get_auth_request con 0x55c8d7bad240 auth_method 0 2024-09-12T17:40:20.933 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:40:20.523+0000 7f8908f62640 10 monclient: get_auth_request con 0x55c8d7bb1430 auth_method 0 2024-09-12T17:40:20.933 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:40:20.527+0000 7f8909f64640 10 monclient: get_auth_request con 0x55c8d7bb5160 auth_method 0 2024-09-12T17:40:20.934 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 10 monclient: build_initial_monmap 2024-09-12T17:40:20.934 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 1 build_initial for_mkfs: 0 2024-09-12T17:40:20.934 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 10 monclient: monmap: 2024-09-12T17:40:20.934 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:40:20.934 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:20.934 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:40:20.934 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:40:20.934 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:20.934 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.934 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:40:20.934 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:40:20.934 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:40:20.934 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.934 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding auth protocol: cephx 2024-09-12T17:40:20.935 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding auth protocol: cephx 2024-09-12T17:40:20.935 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding auth protocol: cephx 2024-09-12T17:40:20.935 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: secure 2024-09-12T17:40:20.935 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: crc 2024-09-12T17:40:20.935 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: secure 2024-09-12T17:40:20.935 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: crc 2024-09-12T17:40:20.935 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: secure 2024-09-12T17:40:20.935 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: crc 2024-09-12T17:40:20.935 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: crc 2024-09-12T17:40:20.935 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: secure 2024-09-12T17:40:20.935 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: crc 2024-09-12T17:40:20.935 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: secure 2024-09-12T17:40:20.935 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: crc 2024-09-12T17:40:20.936 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb9200) adding con mode: secure 2024-09-12T17:40:20.936 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:40:20.527+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.936 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c8d7bbcc50 EEXIST 2024-09-12T17:40:20.936 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: init 2024-09-12T17:40:20.936 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding auth protocol: cephx 2024-09-12T17:40:20.936 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding auth protocol: cephx 2024-09-12T17:40:20.936 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding auth protocol: cephx 2024-09-12T17:40:20.936 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: secure 2024-09-12T17:40:20.936 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: crc 2024-09-12T17:40:20.936 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: secure 2024-09-12T17:40:20.936 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: crc 2024-09-12T17:40:20.936 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: secure 2024-09-12T17:40:20.937 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: crc 2024-09-12T17:40:20.937 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: crc 2024-09-12T17:40:20.937 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: secure 2024-09-12T17:40:20.937 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: crc 2024-09-12T17:40:20.937 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: secure 2024-09-12T17:40:20.937 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: crc 2024-09-12T17:40:20.937 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7bb81b8) adding con mode: secure 2024-09-12T17:40:20.937 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.937 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.937 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command rotate-key cmddesc rotate-key hook 0x55c8d7bb8300 EEXIST 2024-09-12T17:40:20.937 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:40:20.937 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:40:20.937 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-a con 0x55c8d7be0e00 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:40:20.938 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-c con 0x55c8d7be0730 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:40:20.938 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-b con 0x55c8d7bdf110 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:40:20.938 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.938 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.938 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.938 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:40:20.938 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient(hunting): authenticate will time out at 2788.564863s 2024-09-12T17:40:20.938 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:40:20.531+0000 7f8908f62640 10 monclient(hunting): get_auth_request con 0x55c8d7be0e00 auth_method 0 2024-09-12T17:40:20.938 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:40:20.531+0000 7f8908f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.938 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:40:20.531+0000 7f8908f62640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.938 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:40:20.531+0000 7f8908f62640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.938 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient(hunting): get_auth_request con 0x55c8d7be0730 auth_method 0 2024-09-12T17:40:20.938 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.938 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.939 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.939 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:20.939 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:20.939 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:20.939 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:40:20.531+0000 7f8908f62640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:20.939 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:40:20.531+0000 7f8908f62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:20.939 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:40:20.531+0000 7f8908f62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:20.939 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient(hunting): handle_auth_done global_id 7838 payload 824 2024-09-12T17:40:20.939 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient: _finish_hunting 0 2024-09-12T17:40:20.939 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:40:20.531+0000 7f8909f64640 1 monclient: found mon.noname-c 2024-09-12T17:40:20.939 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:40:20.531+0000 7f8909f64640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.939 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.939 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:20.940 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: dump: 2024-09-12T17:40:20.940 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.940 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.940 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.940 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.940 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.940 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.940 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.940 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.940 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.940 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.940 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: _finish_auth 0 2024-09-12T17:40:20.940 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: _check_auth_tickets 2024-09-12T17:40:20.941 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 monclient: authenticate success, global_id 7838 2024-09-12T17:40:20.941 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: _renew_subs 2024-09-12T17:40:20.941 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.941 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:20.941 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.941 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:20.941 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:40:20.531+0000 7f87eeffd640 10 monclient: dump: 2024-09-12T17:40:20.941 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.941 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.941 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.941 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.941 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.941 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.941 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.942 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.942 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.942 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.942 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:40:20.531+0000 7f88fbfff640 4 set_mon_vals no callback set 2024-09-12T17:40:20.942 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: _renew_subs 2024-09-12T17:40:20.942 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.942 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:40:20.531+0000 7f87eeffd640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:40:20.942 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:40:20.531+0000 7f87eeffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:20.942 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:40:20.531+0000 7f87eeffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:20.942 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: get_monmap_and_config 2024-09-12T17:40:20.942 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: build_initial_monmap 2024-09-12T17:40:20.942 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 1 build_initial for_mkfs: 0 2024-09-12T17:40:20.942 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 10 monclient: monmap: 2024-09-12T17:40:20.943 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:40:20.943 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:20.943 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:40:20.943 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:40:20.943 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:20.943 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.943 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:40:20.943 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:40:20.943 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:40:20.943 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.943 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding auth protocol: cephx 2024-09-12T17:40:20.943 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding auth protocol: cephx 2024-09-12T17:40:20.943 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding auth protocol: cephx 2024-09-12T17:40:20.943 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: secure 2024-09-12T17:40:20.944 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: crc 2024-09-12T17:40:20.944 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: secure 2024-09-12T17:40:20.944 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: crc 2024-09-12T17:40:20.944 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: secure 2024-09-12T17:40:20.944 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: crc 2024-09-12T17:40:20.944 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: crc 2024-09-12T17:40:20.944 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: secure 2024-09-12T17:40:20.944 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: crc 2024-09-12T17:40:20.944 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: secure 2024-09-12T17:40:20.944 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: crc 2024-09-12T17:40:20.944 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:40:20.531+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c002c0) adding con mode: secure 2024-09-12T17:40:20.944 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:40:20.531+0000 7f8908f62640 10 monclient: get_auth_request con 0x7f87e4070a20 auth_method 0 2024-09-12T17:40:20.945 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.945 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: init 2024-09-12T17:40:20.945 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding auth protocol: cephx 2024-09-12T17:40:20.945 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding auth protocol: cephx 2024-09-12T17:40:20.945 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding auth protocol: cephx 2024-09-12T17:40:20.945 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: secure 2024-09-12T17:40:20.945 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: crc 2024-09-12T17:40:20.945 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: secure 2024-09-12T17:40:20.945 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: crc 2024-09-12T17:40:20.945 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: secure 2024-09-12T17:40:20.945 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: crc 2024-09-12T17:40:20.945 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: crc 2024-09-12T17:40:20.945 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: secure 2024-09-12T17:40:20.945 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: crc 2024-09-12T17:40:20.946 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: secure 2024-09-12T17:40:20.946 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: crc 2024-09-12T17:40:20.946 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b95c70) adding con mode: secure 2024-09-12T17:40:20.946 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.946 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.946 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command rotate-key cmddesc rotate-key hook 0x7fff30b95db8 EEXIST 2024-09-12T17:40:20.946 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:40:20.946 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:40:20.946 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-b con 0x55c8d7c34820 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:40:20.946 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-c con 0x55c8d7c04240 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:40:20.946 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-a con 0x55c8d7c2fff0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:40:20.946 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.946 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.946 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.947 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:40:20.947 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): authenticate will time out at 2788.568895s 2024-09-12T17:40:20.947 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): get_auth_request con 0x55c8d7c04240 auth_method 0 2024-09-12T17:40:20.947 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.947 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.947 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.947 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): get_auth_request con 0x55c8d7c2fff0 auth_method 0 2024-09-12T17:40:20.947 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.947 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.947 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.947 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:20.947 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:20.947 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:20.948 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:20.948 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:20.948 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:20.948 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:40:20.535+0000 7f8908f62640 10 monclient(hunting): get_auth_request con 0x55c8d7c34820 auth_method 0 2024-09-12T17:40:20.948 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:40:20.535+0000 7f8908f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.948 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:40:20.535+0000 7f8908f62640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.948 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:40:20.535+0000 7f8908f62640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.948 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): handle_auth_done global_id 7841 payload 274 2024-09-12T17:40:20.948 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient: _finish_hunting 0 2024-09-12T17:40:20.948 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:40:20.535+0000 7f8909f64640 1 monclient: found mon.noname-c 2024-09-12T17:40:20.949 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.949 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.949 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:20.949 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: dump: 2024-09-12T17:40:20.949 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.949 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.949 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.949 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.949 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.949 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.949 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.949 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.949 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.949 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.950 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: _finish_auth 0 2024-09-12T17:40:20.950 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: _check_auth_tickets 2024-09-12T17:40:20.950 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 monclient: authenticate success, global_id 7841 2024-09-12T17:40:20.950 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:20.950 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.950 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:20.950 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:40:20.535+0000 7f87ecff9640 10 monclient: dump: 2024-09-12T17:40:20.950 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.950 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.950 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.950 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.950 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.950 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.951 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.951 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.951 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.951 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.951 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:40:20.951 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 4 set_mon_vals no callback set 2024-09-12T17:40:20.951 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: shutdown 2024-09-12T17:40:20.951 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: build_initial_monmap 2024-09-12T17:40:20.951 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 1 build_initial for_mkfs: 0 2024-09-12T17:40:20.951 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: monmap: 2024-09-12T17:40:20.951 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:40:20.951 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:20.951 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:40:20.951 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:40:20.952 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:20.952 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.952 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:40:20.952 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:40:20.952 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:40:20.952 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.952 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding auth protocol: cephx 2024-09-12T17:40:20.952 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding auth protocol: cephx 2024-09-12T17:40:20.952 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding auth protocol: cephx 2024-09-12T17:40:20.952 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: secure 2024-09-12T17:40:20.952 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: crc 2024-09-12T17:40:20.952 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: secure 2024-09-12T17:40:20.952 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: crc 2024-09-12T17:40:20.953 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: secure 2024-09-12T17:40:20.953 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: crc 2024-09-12T17:40:20.953 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: crc 2024-09-12T17:40:20.953 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: secure 2024-09-12T17:40:20.953 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: crc 2024-09-12T17:40:20.953 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: secure 2024-09-12T17:40:20.953 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: crc 2024-09-12T17:40:20.953 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7c25240) adding con mode: secure 2024-09-12T17:40:20.953 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.953 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 1 librados: starting msgr at 2024-09-12T17:40:20.953 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 1 librados: starting objecter 2024-09-12T17:40:20.953 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c8d7c27530 EEXIST 2024-09-12T17:40:20.953 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 1 librados: setting wanted keys 2024-09-12T17:40:20.953 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 1 librados: calling monclient init 2024-09-12T17:40:20.954 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: init 2024-09-12T17:40:20.954 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding auth protocol: cephx 2024-09-12T17:40:20.954 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding auth protocol: cephx 2024-09-12T17:40:20.954 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding auth protocol: cephx 2024-09-12T17:40:20.954 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: secure 2024-09-12T17:40:20.954 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: crc 2024-09-12T17:40:20.954 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: secure 2024-09-12T17:40:20.954 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: crc 2024-09-12T17:40:20.954 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: secure 2024-09-12T17:40:20.954 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: crc 2024-09-12T17:40:20.954 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: crc 2024-09-12T17:40:20.954 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: secure 2024-09-12T17:40:20.954 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: crc 2024-09-12T17:40:20.954 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: secure 2024-09-12T17:40:20.955 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: crc 2024-09-12T17:40:20.955 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 AuthRegistry(0x55c8d7be2c20) adding con mode: secure 2024-09-12T17:40:20.955 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.955 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.955 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command rotate-key cmddesc rotate-key hook 0x55c8d7be2d68 EEXIST 2024-09-12T17:40:20.955 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:40:20.955 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:40:20.955 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-b con 0x55c8d7c04240 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:40:20.955 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-c con 0x55c8d7c2fff0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:40:20.955 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): picked mon.noname-a con 0x55c8d7c34820 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:40:20.955 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.955 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.955 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:20.955 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:40:20.956 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:40:20.535+0000 7f890bc5d9c0 10 monclient(hunting): authenticate will time out at 2788.571550s 2024-09-12T17:40:20.956 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): get_auth_request con 0x55c8d7c2fff0 auth_method 0 2024-09-12T17:40:20.956 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.956 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.956 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.956 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): get_auth_request con 0x55c8d7c34820 auth_method 0 2024-09-12T17:40:20.956 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.956 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.956 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.956 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:20.956 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:20.956 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:20.956 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:20.957 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:20.957 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:40:20.535+0000 7f8909763640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:20.957 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:40:20.535+0000 7f8908f62640 10 monclient(hunting): get_auth_request con 0x55c8d7c04240 auth_method 0 2024-09-12T17:40:20.957 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:40:20.535+0000 7f8908f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:20.957 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:40:20.535+0000 7f8908f62640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:20.957 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:40:20.535+0000 7f8908f62640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:20.957 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient(hunting): handle_auth_done global_id 7844 payload 824 2024-09-12T17:40:20.957 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient: _finish_hunting 0 2024-09-12T17:40:20.957 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:40:20.535+0000 7f8909f64640 1 monclient: found mon.noname-c 2024-09-12T17:40:20.957 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:40:20.535+0000 7f8909f64640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.957 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.957 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:20.957 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: dump: 2024-09-12T17:40:20.958 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.958 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.958 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.958 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.958 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.958 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.958 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.958 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.958 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.958 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.958 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: _finish_auth 0 2024-09-12T17:40:20.958 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: _check_auth_tickets 2024-09-12T17:40:20.958 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:20.958 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:20.959 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:20.959 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:40:20.539+0000 7f87daffd640 10 monclient: dump: 2024-09-12T17:40:20.959 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:20.959 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:20.959 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.959 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:20.959 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:20.959 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:20.959 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:20.959 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:20.959 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:20.959 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.959 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 5 monclient: authenticate success, global_id 7844 2024-09-12T17:40:20.959 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 10 monclient: _renew_subs 2024-09-12T17:40:20.960 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.960 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:40:20.539+0000 7f87ecff9640 4 set_mon_vals no callback set 2024-09-12T17:40:20.960 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 10 monclient: _renew_subs 2024-09-12T17:40:20.960 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.960 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 1 librados: init done 2024-09-12T17:40:20.960 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command cr dump hook 0x55c8d7c32ff8 2024-09-12T17:40:20.960 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.960 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:40:20.539+0000 7f87daffd640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:40:20.960 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:40:20.539+0000 7f87daffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:20.960 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:40:20.539+0000 7f87daffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:20.960 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:40:20.539+0000 7f8908f62640 10 monclient: get_auth_request con 0x7f87d4070b10 auth_method 0 2024-09-12T17:40:20.960 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:40:20.539+0000 7f8909763640 10 monclient: get_auth_request con 0x55c8d7c4d890 auth_method 0 2024-09-12T17:40:20.960 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.961 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 realm 2024-09-12T17:40:20.961 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.961 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.961 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:20.961 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:40:20.539+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.961 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.961 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.961 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:40:20.543+0000 7f8908f62640 10 monclient: get_auth_request con 0x55c8d7c51a10 auth_method 0 2024-09-12T17:40:20.961 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:20.961 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.961 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:40:20.543+0000 7f8909f64640 10 monclient: get_auth_request con 0x55c8d7c55270 auth_method 0 2024-09-12T17:40:20.961 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:20.961 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:40:20.543+0000 7f890bc5d9c0 20 searching for the correct realm 2024-09-12T17:40:20.961 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:40:20.543+0000 7f8909763640 10 monclient: get_auth_request con 0x55c8d7c59ff0 auth_method 0 2024-09-12T17:40:20.962 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:40:20.547+0000 7f8908f62640 10 monclient: get_auth_request con 0x7f88fc00e050 auth_method 0 2024-09-12T17:40:20.962 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:40:20.547+0000 7f8909f64640 10 monclient: get_auth_request con 0x7f89000c0b20 auth_method 0 2024-09-12T17:40:20.962 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:40:20.551+0000 7f8908f62640 0 -- 172.21.15.119:0/2325088499 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f88fc00e050 msgr2=0x7f88fc036400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:20.962 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:40:20.551+0000 7f87daffd640 1 client.7844.objecter ms_handle_reset 0x7f88fc00e050 session 0x7f88fc02f040 osd.7 2024-09-12T17:40:20.962 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:40:20.551+0000 7f87daffd640 10 monclient: _renew_subs 2024-09-12T17:40:20.962 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:40:20.551+0000 7f87daffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:20.962 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:40:20.551+0000 7f8908f62640 10 monclient: get_auth_request con 0x7f87d40812c0 auth_method 0 2024-09-12T17:40:20.962 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:40:20.551+0000 7f8909763640 10 monclient: get_auth_request con 0x7f890401a040 auth_method 0 2024-09-12T17:40:20.962 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:40:20.555+0000 7f8908f62640 10 monclient: get_auth_request con 0x7f890404cc40 auth_method 0 2024-09-12T17:40:20.962 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:40:20.555+0000 7f8908f62640 0 -- 172.21.15.119:0/2325088499 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f890404cc40 msgr2=0x7f89040653c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:20.962 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:40:20.759+0000 7f8908f62640 10 monclient: get_auth_request con 0x7f890404cc40 auth_method 0 2024-09-12T17:40:20.962 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:40:20.962 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:40:20.962 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:20.963 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:20.963 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:20.963 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:20.963 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.963 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.963 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:40:20.771+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.963 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:20.963 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.963 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:20.963 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 zone default found 2024-09-12T17:40:20.963 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 4 Realm: () 2024-09-12T17:40:20.963 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:40:20.963 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:40:20.964 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:20.964 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 zonegroup default 2024-09-12T17:40:20.964 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.964 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.964 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.964 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.964 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.964 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.964 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 started sync module instance, tier type = 2024-09-12T17:40:20.964 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:40:20.775+0000 7f890bc5d9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:40:20.964 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=0 2024-09-12T17:40:20.964 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=1 2024-09-12T17:40:20.964 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=2 2024-09-12T17:40:20.965 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=3 2024-09-12T17:40:20.965 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=4 2024-09-12T17:40:20.965 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=5 2024-09-12T17:40:20.965 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:40:20.799+0000 7f890bc5d9c0 20 add_watcher() i=6 2024-09-12T17:40:20.965 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:40:20.803+0000 7f890bc5d9c0 20 add_watcher() i=7 2024-09-12T17:40:20.965 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:40:20.803+0000 7f890bc5d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:20.965 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding auth protocol: cephx 2024-09-12T17:40:20.965 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding auth protocol: cephx 2024-09-12T17:40:20.965 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding auth protocol: cephx 2024-09-12T17:40:20.965 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: secure 2024-09-12T17:40:20.965 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: crc 2024-09-12T17:40:20.965 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: secure 2024-09-12T17:40:20.965 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: crc 2024-09-12T17:40:20.965 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: secure 2024-09-12T17:40:20.966 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: crc 2024-09-12T17:40:20.966 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: crc 2024-09-12T17:40:20.966 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: secure 2024-09-12T17:40:20.966 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: crc 2024-09-12T17:40:20.966 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: secure 2024-09-12T17:40:20.966 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:40:20.807+0000 7f87bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:20.966 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: crc 2024-09-12T17:40:20.966 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 AuthRegistry(0x7fff30b96140) adding con mode: secure 2024-09-12T17:40:20.966 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:20.966 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:20.966 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:20.966 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command cache list hook 0x55c8d7c22ef0 2024-09-12T17:40:20.966 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command cache inspect hook 0x55c8d7c22ef0 2024-09-12T17:40:20.967 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command cache erase hook 0x55c8d7c22ef0 2024-09-12T17:40:20.967 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command cache zap hook 0x55c8d7c22ef0 2024-09-12T17:40:20.967 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 note: GC not initialized 2024-09-12T17:40:20.967 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:40:20.807+0000 7f87be7e4640 20 reqs_thread_entry: start 2024-09-12T17:40:20.967 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command sync trace show hook 0x7f89000ab6d0 2024-09-12T17:40:20.967 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command sync trace history hook 0x7f89000ab6d0 2024-09-12T17:40:20.967 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command sync trace active hook 0x7f89000ab6d0 2024-09-12T17:40:20.967 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 5 asok(0x55c8d79572b0) register_command sync trace active_short hook 0x7f89000ab6d0 2024-09-12T17:40:20.967 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:40:20.967 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 20 Filter name: none 2024-09-12T17:40:20.967 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:40:20.807+0000 7f872ffff640 20 reqs_thread_entry: start 2024-09-12T17:40:20.967 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:40:20.967 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:40:20.807+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.967 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:20.968 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:40:20.968 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:40:20.968 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:40:20.968 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.968 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:40:20.968 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:20.968 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:20.968 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:20.968 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:20.968 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:40:20.968 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:40:20.811+0000 7f890bc5d9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:40:20.968 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:40:20.827+0000 7f890bc5d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:20.968 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:40:20.827+0000 7f890bc5d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:20.969 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:40:20.827+0000 7f890bc5d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:20.969 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:40:20.827+0000 7f890bc5d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:40:20.969 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:40:20.831+0000 7f87ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333538 cookie 94321101891536 notifier 7844 bl.length()=911 2024-09-12T17:40:20.969 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:40:20.831+0000 7f87ecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:20.969 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:40:20.831+0000 7f87ecff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:20.969 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:40:20.831+0000 7f87ecff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:20.969 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:40:20.831+0000 7f890bc5d9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:40:20.969 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:40:20.831+0000 7f890bc5d9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:40:20.969 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:40:20.831+0000 7f890bc5d9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:40:20.969 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:40:20.831+0000 7f890bc5d9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:40:20.969 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:40:20.839+0000 7f890bc5d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f890bc5d9c0 time 2024-09-12T17:40:20.842186+0000 2024-09-12T17:40:20.969 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:40:20.969 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.969 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:20.970 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f890f5372eb] 2024-09-12T17:40:20.970 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f890f53749f] 2024-09-12T17:40:20.970 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c8d4c600c1] 2024-09-12T17:40:20.970 INFO:tasks.workunit.client.0.smithi119.stderr: 4: radosgw-admin(+0x14100ec) [0x55c8d56b60ec] 2024-09-12T17:40:20.970 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c8d4c7218d] 2024-09-12T17:40:20.970 INFO:tasks.workunit.client.0.smithi119.stderr: 6: main() 2024-09-12T17:40:20.970 INFO:tasks.workunit.client.0.smithi119.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f890e39dd90] 2024-09-12T17:40:20.970 INFO:tasks.workunit.client.0.smithi119.stderr: 8: __libc_start_main() 2024-09-12T17:40:20.970 INFO:tasks.workunit.client.0.smithi119.stderr: 9: _start() 2024-09-12T17:40:20.970 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.970 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:40:20.839+0000 7f890bc5d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:40:20.970 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f890bc5d9c0 thread_name:radosgw-admin 2024-09-12T17:40:20.970 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.971 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:20.971 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f890e3b6520] 2024-09-12T17:40:20.971 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:40:20.971 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:40:20.971 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:40:20.971 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f890f537345] 2024-09-12T17:40:20.971 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f890f53749f] 2024-09-12T17:40:20.971 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c8d4c600c1] 2024-09-12T17:40:20.971 INFO:tasks.workunit.client.0.smithi119.stderr: 8: radosgw-admin(+0x14100ec) [0x55c8d56b60ec] 2024-09-12T17:40:20.971 INFO:tasks.workunit.client.0.smithi119.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c8d4c7218d] 2024-09-12T17:40:20.971 INFO:tasks.workunit.client.0.smithi119.stderr: 10: main() 2024-09-12T17:40:20.971 INFO:tasks.workunit.client.0.smithi119.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f890e39dd90] 2024-09-12T17:40:20.971 INFO:tasks.workunit.client.0.smithi119.stderr: 12: __libc_start_main() 2024-09-12T17:40:20.972 INFO:tasks.workunit.client.0.smithi119.stderr: 13: _start() 2024-09-12T17:40:20.972 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:40:20.972 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:20.972 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:40:20.972 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:40:20.972 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:40:20.972 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:40:20.972 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:40:20.972 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:40:20.972 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:40:20.972 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:40:20.972 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:40:20.972 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:40:20.972 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:40:20.973 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:40:20.973 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:40:20.973 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:40:20.973 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:40:20.973 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:40:20.973 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:40:20.973 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:40:20.973 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:40:20.973 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:40:20.973 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:40:20.973 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:40:20.973 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:40:20.973 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:40:20.974 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:40:20.974 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:40:20.974 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:40:20.974 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:40:20.974 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:40:20.974 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:40:20.974 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:40:20.974 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:40:20.974 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:40:20.974 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:40:20.974 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:40:20.974 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:40:20.974 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:40:20.974 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:40:20.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:40:20.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:40:20.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:40:20.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:40:20.975 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:40:20.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:40:20.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:40:20.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:40:20.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:40:20.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:40:20.975 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:40:20.975 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:40:20.976 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:40:20.976 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:40:20.976 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:40:20.976 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:40:20.976 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:40:20.976 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:40:20.976 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:40:20.976 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:40:20.976 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:40:20.976 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:40:20.976 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:40:20.976 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:40:20.976 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:40:20.976 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:40:20.977 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:40:20.977 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:40:20.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:40:20.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:40:20.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:40:20.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:40:20.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:40:20.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:40:20.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:40:20.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:40:20.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:40:20.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:40:20.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:40:20.977 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:40:20.978 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:40:20.978 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:40:20.978 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:40:20.978 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:40:20.978 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:40:20.978 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:40:20.978 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:40:20.978 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:40:20.978 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:40:20.978 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:40:20.978 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:40:20.978 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:40:20.978 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:40:20.978 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:40:20.979 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:40:20.979 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:40:20.979 INFO:tasks.workunit.client.0.smithi119.stderr: 7f872ffff640 / http_manager 2024-09-12T17:40:20.979 INFO:tasks.workunit.client.0.smithi119.stderr: 7f87be7e4640 / http_manager 2024-09-12T17:40:20.979 INFO:tasks.workunit.client.0.smithi119.stderr: 7f87bf7e6640 / rgw_dt_lg_renew 2024-09-12T17:40:20.979 INFO:tasks.workunit.client.0.smithi119.stderr: 7f87daffd640 / ms_dispatch 2024-09-12T17:40:20.979 INFO:tasks.workunit.client.0.smithi119.stderr: 7f87ecff9640 / io_context_pool 2024-09-12T17:40:20.979 INFO:tasks.workunit.client.0.smithi119.stderr: 7f87eeffd640 / ms_dispatch 2024-09-12T17:40:20.979 INFO:tasks.workunit.client.0.smithi119.stderr: 7f87f5e03640 / ms_dispatch 2024-09-12T17:40:20.979 INFO:tasks.workunit.client.0.smithi119.stderr: 7f87f7606640 / io_context_pool 2024-09-12T17:40:20.979 INFO:tasks.workunit.client.0.smithi119.stderr: 7f88fbfff640 / io_context_pool 2024-09-12T17:40:20.979 INFO:tasks.workunit.client.0.smithi119.stderr: 7f8908f62640 / msgr-worker-2 2024-09-12T17:40:20.979 INFO:tasks.workunit.client.0.smithi119.stderr: 7f8909763640 / msgr-worker-1 2024-09-12T17:40:20.979 INFO:tasks.workunit.client.0.smithi119.stderr: 7f8909f64640 / msgr-worker-0 2024-09-12T17:40:20.980 INFO:tasks.workunit.client.0.smithi119.stderr: 7f890bc5d9c0 / radosgw-admin 2024-09-12T17:40:20.980 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:40:20.980 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:40:20.980 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:40:20.844676Z_5046ee0b-e920-4d98-8733-fd11a8e51c07/log 2024-09-12T17:40:20.980 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:40:20.981 INFO:tasks.workunit.client.0.smithi119.stderr:Aborted 2024-09-12T17:40:20.981 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:40:20.981 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:20.982 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:20.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.923+0000 7f945e0249c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.927+0000 7f945e0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.927+0000 7f945e0249c0 20 realm 2024-09-12T17:40:20.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.927+0000 7f945e0249c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.927+0000 7f945e0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.927+0000 7f945e0249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:20.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.927+0000 7f945e0249c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.927+0000 7f945e0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:20.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.927+0000 7f945e0249c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.927+0000 7f945e0249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:20.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.927+0000 7f945e0249c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:20.982 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.931+0000 7f945e0249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:20.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.931+0000 7f945e0249c0 20 searching for the correct realm 2024-09-12T17:40:20.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.935+0000 7f945c32b640 0 -- 172.21.15.119:0/1745818769 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55a4a3c5aa30 msgr2=0x55a4a3c5ce40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:20.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:20.943+0000 7f945b329640 0 -- 172.21.15.119:0/1745818769 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f944c04d920 msgr2=0x7f944c01b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:21.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.159+0000 7f945e0249c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:40:21.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.159+0000 7f945e0249c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:40:21.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.159+0000 7f945e0249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:21.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.159+0000 7f945e0249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:21.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.159+0000 7f945e0249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:21.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.159+0000 7f945e0249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:21.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.159+0000 7f945e0249c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:21.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.159+0000 7f945e0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:21.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.159+0000 7f945e0249c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:21.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.163+0000 7f945e0249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:21.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.163+0000 7f945e0249c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:21.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.163+0000 7f945e0249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:21.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.163+0000 7f945e0249c0 20 zone default found 2024-09-12T17:40:21.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.163+0000 7f945e0249c0 4 Realm: () 2024-09-12T17:40:21.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.163+0000 7f945e0249c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:40:21.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.163+0000 7f945e0249c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:40:21.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.163+0000 7f945e0249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:21.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.163+0000 7f945e0249c0 20 zonegroup default 2024-09-12T17:40:21.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.163+0000 7f945e0249c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:21.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.163+0000 7f945e0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:21.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.163+0000 7f945e0249c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:21.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.163+0000 7f945e0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:21.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.163+0000 7f945e0249c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:21.167 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.167+0000 7f945e0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:21.167 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.167+0000 7f945e0249c0 20 started sync module instance, tier type = 2024-09-12T17:40:21.167 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.167+0000 7f945e0249c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:40:21.190 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.187+0000 7f945e0249c0 20 add_watcher() i=0 2024-09-12T17:40:21.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.187+0000 7f945e0249c0 20 add_watcher() i=1 2024-09-12T17:40:21.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.187+0000 7f945e0249c0 20 add_watcher() i=2 2024-09-12T17:40:21.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.187+0000 7f945e0249c0 20 add_watcher() i=3 2024-09-12T17:40:21.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.187+0000 7f945e0249c0 20 add_watcher() i=4 2024-09-12T17:40:21.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.187+0000 7f945e0249c0 20 add_watcher() i=5 2024-09-12T17:40:21.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.187+0000 7f945e0249c0 20 add_watcher() i=6 2024-09-12T17:40:21.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.191+0000 7f945e0249c0 20 add_watcher() i=7 2024-09-12T17:40:21.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.191+0000 7f945e0249c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:21.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.195+0000 7f9311fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:21.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.195+0000 7f945e0249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:21.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.195+0000 7f945e0249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:21.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.195+0000 7f945e0249c0 5 note: GC not initialized 2024-09-12T17:40:21.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.195+0000 7f9310fe1640 20 reqs_thread_entry: start 2024-09-12T17:40:21.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.195+0000 7f945e0249c0 20 init_complete bucket index max shards: 11 2024-09-12T17:40:21.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 20 Filter name: none 2024-09-12T17:40:21.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f928a7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:21.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:40:21.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:21.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:21.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:40:21.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:40:21.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:40:21.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:21.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:40:21.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:21.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:21.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:21.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:21.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:40:21.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:40:21.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:40:21.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:40:21.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:40:21.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:40:21.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.199+0000 7f945e0249c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:40:21.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.203+0000 7f945e0249c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:40:21.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.203+0000 7f945e0249c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:40:21.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.203+0000 7f945e0249c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:40:21.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.203+0000 7f945e0249c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:40:21.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.203+0000 7f945e0249c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:40:21.205 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.203+0000 7f945e0249c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:40:21.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.203+0000 7f945e0249c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:40:21.206 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.203+0000 7f945e0249c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:40:21.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.203+0000 7f945e0249c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:40:21.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.203+0000 7f945e0249c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:40:21.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.207+0000 7f945e0249c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:40:21.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.207+0000 7f945e0249c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:40:21.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.207+0000 7f945e0249c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:40:21.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.207+0000 7f945e0249c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:40:21.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.207+0000 7f945e0249c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:40:21.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.207+0000 7f945e0249c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:40:21.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.207+0000 7f945e0249c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:40:21.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.207+0000 7f945e0249c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:40:21.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.207+0000 7f945e0249c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:40:21.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.207+0000 7f945e0249c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:40:21.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.211+0000 7f9311fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:21.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.215+0000 7f945e0249c0 20 remove_watcher() i=0 2024-09-12T17:40:21.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.215+0000 7f945e0249c0 2 removed watcher, disabling cache 2024-09-12T17:40:21.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.219+0000 7f945e0249c0 20 remove_watcher() i=1 2024-09-12T17:40:21.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.219+0000 7f945e0249c0 20 remove_watcher() i=2 2024-09-12T17:40:21.225 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.223+0000 7f945e0249c0 20 remove_watcher() i=3 2024-09-12T17:40:21.227 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.227+0000 7f945e0249c0 20 remove_watcher() i=4 2024-09-12T17:40:21.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.227+0000 7f945e0249c0 20 remove_watcher() i=5 2024-09-12T17:40:21.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.227+0000 7f945e0249c0 20 remove_watcher() i=6 2024-09-12T17:40:21.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:21.231+0000 7f945e0249c0 20 remove_watcher() i=7 2024-09-12T17:40:21.246 INFO:tasks.workunit.client.0.smithi119.stderr: test: duplicated entries can be purged manually 2024-09-12T17:40:51.278 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:40:51.311 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:51.311 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:51.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.354+0000 7f20daa299c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.354+0000 7f20daa299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.354+0000 7f20daa299c0 20 realm 2024-09-12T17:40:51.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.354+0000 7f20daa299c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.354+0000 7f20daa299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.354+0000 7f20daa299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:51.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.354+0000 7f20daa299c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.354+0000 7f20daa299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.354+0000 7f20daa299c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.358+0000 7f20daa299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:51.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.358+0000 7f20daa299c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.358+0000 7f20daa299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:51.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.358+0000 7f20daa299c0 20 searching for the correct realm 2024-09-12T17:40:51.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.362+0000 7f20d8d30640 0 -- 172.21.15.119:0/3725458432 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x564f0746dc10 msgr2=0x564f07470000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:51.373 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.370+0000 7f20d7d2e640 0 -- 172.21.15.119:0/3725458432 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f20d00830a0 msgr2=0x7f20d0089810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:51.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.586+0000 7f20daa299c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:40:51.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.586+0000 7f20daa299c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:40:51.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.586+0000 7f20daa299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:51.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.586+0000 7f20daa299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:51.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.586+0000 7f20daa299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:51.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.586+0000 7f20daa299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:51.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.586+0000 7f20daa299c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.590+0000 7f20daa299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.590+0000 7f20daa299c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.590+0000 7f20daa299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:51.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.590+0000 7f20daa299c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.590+0000 7f20daa299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:51.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.590+0000 7f20daa299c0 20 zone default found 2024-09-12T17:40:51.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.590+0000 7f20daa299c0 4 Realm: () 2024-09-12T17:40:51.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.590+0000 7f20daa299c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:40:51.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.590+0000 7f20daa299c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:40:51.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.590+0000 7f20daa299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:51.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.590+0000 7f20daa299c0 20 zonegroup default 2024-09-12T17:40:51.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.590+0000 7f20daa299c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.590+0000 7f20daa299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.590+0000 7f20daa299c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.590+0000 7f20daa299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.590+0000 7f20daa299c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.594+0000 7f20daa299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.594+0000 7f20daa299c0 20 started sync module instance, tier type = 2024-09-12T17:40:51.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.594+0000 7f20daa299c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:40:51.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.614+0000 7f20daa299c0 20 add_watcher() i=0 2024-09-12T17:40:51.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.614+0000 7f20daa299c0 20 add_watcher() i=1 2024-09-12T17:40:51.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.614+0000 7f20daa299c0 20 add_watcher() i=2 2024-09-12T17:40:51.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.614+0000 7f20daa299c0 20 add_watcher() i=3 2024-09-12T17:40:51.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.614+0000 7f20daa299c0 20 add_watcher() i=4 2024-09-12T17:40:51.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.614+0000 7f20daa299c0 20 add_watcher() i=5 2024-09-12T17:40:51.620 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.614+0000 7f20daa299c0 20 add_watcher() i=6 2024-09-12T17:40:51.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.618+0000 7f20daa299c0 20 add_watcher() i=7 2024-09-12T17:40:51.621 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.618+0000 7f20daa299c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:51.625 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.622+0000 7f1f8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:51.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.622+0000 7f20daa299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:51.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.622+0000 7f20daa299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:51.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.622+0000 7f20daa299c0 5 note: GC not initialized 2024-09-12T17:40:51.627 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.626+0000 7f1f8dfdb640 20 reqs_thread_entry: start 2024-09-12T17:40:51.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.626+0000 7f20daa299c0 20 init_complete bucket index max shards: 11 2024-09-12T17:40:51.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.626+0000 7f20daa299c0 20 Filter name: none 2024-09-12T17:40:51.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.626+0000 7f1eff7fe640 20 reqs_thread_entry: start 2024-09-12T17:40:51.628 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.626+0000 7f20daa299c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.626+0000 7f20daa299c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:51.629 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.626+0000 7f20daa299c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.626+0000 7f20daa299c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:40:51.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.626+0000 7f20daa299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:51.630 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.626+0000 7f20daa299c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.631 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.630+0000 7f20daa299c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:51.631 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.630+0000 7f20daa299c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.630+0000 7f20daa299c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:40:51.632 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.630+0000 7f20daa299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:51.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.634+0000 7f1f8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:51.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.638+0000 7f20daa299c0 20 remove_watcher() i=0 2024-09-12T17:40:51.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.638+0000 7f20daa299c0 2 removed watcher, disabling cache 2024-09-12T17:40:51.643 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.638+0000 7f20daa299c0 20 remove_watcher() i=1 2024-09-12T17:40:51.645 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.642+0000 7f20daa299c0 20 remove_watcher() i=2 2024-09-12T17:40:51.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.646+0000 7f20daa299c0 20 remove_watcher() i=3 2024-09-12T17:40:51.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.646+0000 7f20daa299c0 20 remove_watcher() i=4 2024-09-12T17:40:51.651 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.650+0000 7f20daa299c0 20 remove_watcher() i=5 2024-09-12T17:40:51.652 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.650+0000 7f20daa299c0 20 remove_watcher() i=6 2024-09-12T17:40:51.654 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.650+0000 7f20daa299c0 20 remove_watcher() i=7 2024-09-12T17:40:51.668 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.668 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:40:51.668 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: a-bucket id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-12T17:40:51.668 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.669 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:40:51.705 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:51.706 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:51.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.754 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 realm 2024-09-12T17:40:51.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:51.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.755 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.754+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:51.756 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.754+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.754+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:51.757 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.754+0000 7f2f8bdab9c0 20 searching for the correct realm 2024-09-12T17:40:51.762 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.758+0000 7f2f898b1640 0 -- 172.21.15.119:0/3747197001 >> [v2:172.21.15.119:6800/1732749810,v1:172.21.15.119:6801/1732749810] conn(0x55d4a28abbc0 msgr2=0x55d4a28ae080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:51.768 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.766+0000 7f2f890b0640 0 -- 172.21.15.119:0/3747197001 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f2f7c01a040 msgr2=0x7f2f7c063600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:51.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:40:51.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:40:51.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:51.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:51.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:51.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:51.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.778 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:51.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:51.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 zone default found 2024-09-12T17:40:51.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 4 Realm: () 2024-09-12T17:40:51.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:40:51.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:40:51.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:51.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 zonegroup default 2024-09-12T17:40:51.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.778+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.778+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.778+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.778+0000 7f2f8bdab9c0 20 started sync module instance, tier type = 2024-09-12T17:40:51.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.778+0000 7f2f8bdab9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:40:51.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=0 2024-09-12T17:40:51.795 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=1 2024-09-12T17:40:51.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=2 2024-09-12T17:40:51.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=3 2024-09-12T17:40:51.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=4 2024-09-12T17:40:51.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=5 2024-09-12T17:40:51.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=6 2024-09-12T17:40:51.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=7 2024-09-12T17:40:51.796 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:51.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.794+0000 7f2e3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:51.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:51.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:51.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 note: GC not initialized 2024-09-12T17:40:51.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2e3a7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:51.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:40:51.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 Filter name: none 2024-09-12T17:40:51.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2dabfff640 20 reqs_thread_entry: start 2024-09-12T17:40:51.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:40:51.800 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:51.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:40:51.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:40:51.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:40:51.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:40:51.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:51.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:51.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:51.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:51.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:40:51.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.802+0000 7f2f8bdab9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:40:51.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.818+0000 7f2f8bdab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:51.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.818+0000 7f2f8bdab9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:51.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.818+0000 7f2f8bdab9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:51.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.818+0000 7f2f8bdab9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:40:51.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.818+0000 7f2e6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333539 cookie 94371748437184 notifier 8382 bl.length()=911 2024-09-12T17:40:51.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.818+0000 7f2e6d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:51.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.818+0000 7f2e6d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:51.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.818+0000 7f2e6d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:51.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.822+0000 7f2f8bdab9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:40:51.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.822+0000 7f2f8bdab9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:40:51.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.822+0000 7f2f8bdab9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:40:51.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.822+0000 7f2f8bdab9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:40:51.838 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2f8bdab9c0 time 2024-09-12T17:40:51.840031+0000 2024-09-12T17:40:51.838 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:40:51.839 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:51.839 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2f8f6852eb] 2024-09-12T17:40:51.839 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2f8f68549f] 2024-09-12T17:40:51.839 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d49f8840c1] 2024-09-12T17:40:51.839 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d49f8961fa] 2024-09-12T17:40:51.839 INFO:tasks.workunit.client.0.smithi119.stderr: 5: main() 2024-09-12T17:40:51.839 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2f8e4ebd90] 2024-09-12T17:40:51.839 INFO:tasks.workunit.client.0.smithi119.stderr: 7: __libc_start_main() 2024-09-12T17:40:51.839 INFO:tasks.workunit.client.0.smithi119.stderr: 8: _start() 2024-09-12T17:40:51.840 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.834+0000 7f2f8bdab9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2f8bdab9c0 time 2024-09-12T17:40:51.840031+0000 2024-09-12T17:40:51.840 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:40:51.840 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.840 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:51.840 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2f8f6852eb] 2024-09-12T17:40:51.840 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2f8f68549f] 2024-09-12T17:40:51.840 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d49f8840c1] 2024-09-12T17:40:51.840 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d49f8961fa] 2024-09-12T17:40:51.840 INFO:tasks.workunit.client.0.smithi119.stderr: 5: main() 2024-09-12T17:40:51.840 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2f8e4ebd90] 2024-09-12T17:40:51.840 INFO:tasks.workunit.client.0.smithi119.stderr: 7: __libc_start_main() 2024-09-12T17:40:51.841 INFO:tasks.workunit.client.0.smithi119.stderr: 8: _start() 2024-09-12T17:40:51.841 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.841 INFO:tasks.workunit.client.0.smithi119.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:40:51.841 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f2f8bdab9c0 thread_name:radosgw-admin 2024-09-12T17:40:51.860 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:51.860 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2f8e504520] 2024-09-12T17:40:51.860 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:40:51.860 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:40:51.861 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:40:51.861 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2f8f685345] 2024-09-12T17:40:51.861 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2f8f68549f] 2024-09-12T17:40:51.861 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d49f8840c1] 2024-09-12T17:40:51.861 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d49f8961fa] 2024-09-12T17:40:51.861 INFO:tasks.workunit.client.0.smithi119.stderr: 9: main() 2024-09-12T17:40:51.861 INFO:tasks.workunit.client.0.smithi119.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2f8e4ebd90] 2024-09-12T17:40:51.861 INFO:tasks.workunit.client.0.smithi119.stderr: 11: __libc_start_main() 2024-09-12T17:40:51.861 INFO:tasks.workunit.client.0.smithi119.stderr: 12: _start() 2024-09-12T17:40:51.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.838+0000 7f2f8bdab9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:40:51.862 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f2f8bdab9c0 thread_name:radosgw-admin 2024-09-12T17:40:51.862 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.862 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:51.862 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2f8e504520] 2024-09-12T17:40:51.862 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:40:51.862 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:40:51.862 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:40:51.862 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2f8f685345] 2024-09-12T17:40:51.862 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2f8f68549f] 2024-09-12T17:40:51.862 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d49f8840c1] 2024-09-12T17:40:51.862 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d49f8961fa] 2024-09-12T17:40:51.863 INFO:tasks.workunit.client.0.smithi119.stderr: 9: main() 2024-09-12T17:40:51.863 INFO:tasks.workunit.client.0.smithi119.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2f8e4ebd90] 2024-09-12T17:40:51.863 INFO:tasks.workunit.client.0.smithi119.stderr: 11: __libc_start_main() 2024-09-12T17:40:51.863 INFO:tasks.workunit.client.0.smithi119.stderr: 12: _start() 2024-09-12T17:40:51.863 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:40:51.863 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.863 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:40:51.863 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient: _finish_hunting 0 2024-09-12T17:40:51.863 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 1 monclient: found mon.noname-c 2024-09-12T17:40:51.863 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:40:51.863 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.864 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:51.864 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: dump: 2024-09-12T17:40:51.864 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.864 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.864 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.864 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.864 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.864 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.864 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.864 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.864 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.864 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.865 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: _finish_auth 0 2024-09-12T17:40:51.865 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: _check_auth_tickets 2024-09-12T17:40:51.865 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:51.865 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.865 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:51.865 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: dump: 2024-09-12T17:40:51.865 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.865 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.865 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.865 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.865 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.865 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.866 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.866 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.866 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.866 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.866 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 monclient: authenticate success, global_id 7880 2024-09-12T17:40:51.866 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:40:51.866 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 4 set_mon_vals no callback set 2024-09-12T17:40:51.866 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient: shutdown 2024-09-12T17:40:51.866 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) unregister_commands rotate-key 2024-09-12T17:40:51.866 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient: build_initial_monmap 2024-09-12T17:40:51.866 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 1 build_initial for_mkfs: 0 2024-09-12T17:40:51.867 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient: monmap: 2024-09-12T17:40:51.867 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:40:51.867 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:51.867 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:40:51.867 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:40:51.867 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:51.867 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.867 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:40:51.867 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:40:51.867 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:40:51.867 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.867 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding auth protocol: cephx 2024-09-12T17:40:51.868 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding auth protocol: cephx 2024-09-12T17:40:51.868 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding auth protocol: cephx 2024-09-12T17:40:51.868 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: secure 2024-09-12T17:40:51.868 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: crc 2024-09-12T17:40:51.868 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: secure 2024-09-12T17:40:51.868 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: crc 2024-09-12T17:40:51.868 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: secure 2024-09-12T17:40:51.868 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: crc 2024-09-12T17:40:51.868 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: crc 2024-09-12T17:40:51.868 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: secure 2024-09-12T17:40:51.868 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: crc 2024-09-12T17:40:51.868 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: secure 2024-09-12T17:40:51.869 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: crc 2024-09-12T17:40:51.869 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: secure 2024-09-12T17:40:51.869 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.869 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 1 librados: starting msgr at 2024-09-12T17:40:51.869 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 1 librados: starting objecter 2024-09-12T17:40:51.869 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command objecter_requests hook 0x55d4a27b7b50 2024-09-12T17:40:51.869 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 1 librados: setting wanted keys 2024-09-12T17:40:51.869 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 1 librados: calling monclient init 2024-09-12T17:40:51.869 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient: init 2024-09-12T17:40:51.869 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding auth protocol: cephx 2024-09-12T17:40:51.869 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding auth protocol: cephx 2024-09-12T17:40:51.870 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding auth protocol: cephx 2024-09-12T17:40:51.870 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: secure 2024-09-12T17:40:51.870 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: crc 2024-09-12T17:40:51.870 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: secure 2024-09-12T17:40:51.870 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: crc 2024-09-12T17:40:51.870 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: secure 2024-09-12T17:40:51.870 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: crc 2024-09-12T17:40:51.870 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: crc 2024-09-12T17:40:51.870 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: secure 2024-09-12T17:40:51.870 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: crc 2024-09-12T17:40:51.870 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: secure 2024-09-12T17:40:51.871 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: crc 2024-09-12T17:40:51.871 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: secure 2024-09-12T17:40:51.871 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.871 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.871 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command rotate-key hook 0x55d4a27b1538 2024-09-12T17:40:51.871 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:40:51.871 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:40:51.871 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-b con 0x55d4a2661e30 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:40:51.871 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-c con 0x55d4a26f71f0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:40:51.871 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-a con 0x55d4a26f75d0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:40:51.871 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.871 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.872 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.872 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:40:51.872 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient(hunting): authenticate will time out at 2819.763305s 2024-09-12T17:40:51.872 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient(hunting): get_auth_request con 0x55d4a26f71f0 auth_method 0 2024-09-12T17:40:51.872 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.872 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.872 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.872 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient(hunting): get_auth_request con 0x55d4a26f75d0 auth_method 0 2024-09-12T17:40:51.872 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.872 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.872 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.872 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:51.873 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:51.873 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:51.873 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:51.873 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:51.873 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:51.873 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient(hunting): handle_auth_done global_id 7883 payload 824 2024-09-12T17:40:51.873 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient: _finish_hunting 0 2024-09-12T17:40:51.873 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:40:51.726+0000 7f2f890b0640 1 monclient: found mon.noname-c 2024-09-12T17:40:51.873 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:40:51.873 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.874 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:51.874 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: dump: 2024-09-12T17:40:51.874 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.874 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.874 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.874 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.874 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.874 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.874 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.874 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.874 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.874 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.875 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: _finish_auth 0 2024-09-12T17:40:51.875 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: _check_auth_tickets 2024-09-12T17:40:51.875 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:51.875 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.875 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:51.875 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: dump: 2024-09-12T17:40:51.875 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.875 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.875 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.875 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.875 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.875 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.875 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.876 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.876 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.876 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.876 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:40:51.730+0000 7f2f8bdab9c0 5 monclient: authenticate success, global_id 7883 2024-09-12T17:40:51.876 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:40:51.730+0000 7f2f8bdab9c0 10 monclient: _renew_subs 2024-09-12T17:40:51.876 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:40:51.730+0000 7f2e77e07640 4 set_mon_vals no callback set 2024-09-12T17:40:51.876 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:40:51.730+0000 7f2f8bdab9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:51.876 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:40:51.730+0000 7f2f8bdab9c0 10 monclient: _renew_subs 2024-09-12T17:40:51.876 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:40:51.730+0000 7f2f8bdab9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:51.876 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:40:51.730+0000 7f2f8bdab9c0 1 librados: init done 2024-09-12T17:40:51.876 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:40:51.730+0000 7f2e76604640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:40:51.876 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:40:51.730+0000 7f2e76604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:51.876 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:40:51.730+0000 7f2e76604640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:51.877 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:40:51.730+0000 7f2f898b1640 10 monclient: get_auth_request con 0x7f2e70070b10 auth_method 0 2024-09-12T17:40:51.877 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:40:51.730+0000 7f2f8a0b2640 10 monclient: get_auth_request con 0x55d4a27d9bd0 auth_method 0 2024-09-12T17:40:51.877 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:40:51.730+0000 7f2f898b1640 10 monclient: get_auth_request con 0x55d4a27fc3e0 auth_method 0 2024-09-12T17:40:51.877 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:40:51.734+0000 7f2f890b0640 10 monclient: get_auth_request con 0x55d4a28005d0 auth_method 0 2024-09-12T17:40:51.877 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:40:51.734+0000 7f2f8a0b2640 10 monclient: get_auth_request con 0x55d4a2804990 auth_method 0 2024-09-12T17:40:51.877 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: build_initial_monmap 2024-09-12T17:40:51.877 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 1 build_initial for_mkfs: 0 2024-09-12T17:40:51.877 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: monmap: 2024-09-12T17:40:51.877 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:40:51.877 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:51.877 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:40:51.877 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:40:51.877 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:51.878 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.878 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:40:51.878 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:40:51.878 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:40:51.878 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.878 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding auth protocol: cephx 2024-09-12T17:40:51.878 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding auth protocol: cephx 2024-09-12T17:40:51.878 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding auth protocol: cephx 2024-09-12T17:40:51.878 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: secure 2024-09-12T17:40:51.878 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: crc 2024-09-12T17:40:51.878 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: secure 2024-09-12T17:40:51.878 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: crc 2024-09-12T17:40:51.879 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: secure 2024-09-12T17:40:51.879 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: crc 2024-09-12T17:40:51.879 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: crc 2024-09-12T17:40:51.879 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: secure 2024-09-12T17:40:51.879 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: crc 2024-09-12T17:40:51.879 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: secure 2024-09-12T17:40:51.879 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: crc 2024-09-12T17:40:51.879 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: secure 2024-09-12T17:40:51.879 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.879 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d4a280c090 EEXIST 2024-09-12T17:40:51.879 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: init 2024-09-12T17:40:51.879 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding auth protocol: cephx 2024-09-12T17:40:51.879 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding auth protocol: cephx 2024-09-12T17:40:51.880 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding auth protocol: cephx 2024-09-12T17:40:51.880 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: secure 2024-09-12T17:40:51.880 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: crc 2024-09-12T17:40:51.880 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: secure 2024-09-12T17:40:51.880 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: crc 2024-09-12T17:40:51.880 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: secure 2024-09-12T17:40:51.880 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: crc 2024-09-12T17:40:51.880 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: crc 2024-09-12T17:40:51.880 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: secure 2024-09-12T17:40:51.880 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: crc 2024-09-12T17:40:51.880 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: secure 2024-09-12T17:40:51.880 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: crc 2024-09-12T17:40:51.880 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: secure 2024-09-12T17:40:51.881 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.881 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.881 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command rotate-key cmddesc rotate-key hook 0x55d4a2807820 EEXIST 2024-09-12T17:40:51.881 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:40:51.881 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:40:51.881 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-a con 0x55d4a2830240 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:40:51.881 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-c con 0x55d4a282fb70 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:40:51.881 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-b con 0x55d4a282e550 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:40:51.881 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.881 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.881 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.881 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:40:51.881 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient(hunting): authenticate will time out at 2819.774616s 2024-09-12T17:40:51.882 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient(hunting): get_auth_request con 0x55d4a282fb70 auth_method 0 2024-09-12T17:40:51.882 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.882 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.882 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.882 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:40:51.738+0000 7f2f890b0640 10 monclient(hunting): get_auth_request con 0x55d4a2830240 auth_method 0 2024-09-12T17:40:51.882 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:40:51.738+0000 7f2f890b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.882 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:40:51.738+0000 7f2f890b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.882 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:40:51.738+0000 7f2f890b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.882 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:51.882 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:51.882 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:51.882 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:40:51.738+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:51.882 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:40:51.738+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:51.882 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:40:51.738+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:51.883 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:40:51.738+0000 7f2f898b1640 10 monclient(hunting): get_auth_request con 0x55d4a282e550 auth_method 0 2024-09-12T17:40:51.883 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:40:51.738+0000 7f2f898b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.883 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:40:51.738+0000 7f2f898b1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.883 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:40:51.738+0000 7f2f898b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.883 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_done global_id 7886 payload 824 2024-09-12T17:40:51.883 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient: _finish_hunting 0 2024-09-12T17:40:51.883 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 1 monclient: found mon.noname-c 2024-09-12T17:40:51.883 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:40:51.883 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.883 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:51.883 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: dump: 2024-09-12T17:40:51.883 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.883 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.884 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.884 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.884 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.884 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.884 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.884 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.884 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.884 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.884 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: _finish_auth 0 2024-09-12T17:40:51.884 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:40:51.884 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:51.884 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.885 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:51.885 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: dump: 2024-09-12T17:40:51.885 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.885 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.885 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.885 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.885 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.885 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.885 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.886 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.886 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.886 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.886 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 monclient: authenticate success, global_id 7886 2024-09-12T17:40:51.886 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:40:51.738+0000 7f2f8a8b3640 4 set_mon_vals no callback set 2024-09-12T17:40:51.886 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: _renew_subs 2024-09-12T17:40:51.886 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:51.886 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: _renew_subs 2024-09-12T17:40:51.886 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:51.886 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:40:51.742+0000 7f2e6f7fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:40:51.886 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:40:51.742+0000 7f2e6f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:51.886 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:40:51.742+0000 7f2e6f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:51.887 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient: get_monmap_and_config 2024-09-12T17:40:51.887 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient: build_initial_monmap 2024-09-12T17:40:51.887 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 1 build_initial for_mkfs: 0 2024-09-12T17:40:51.887 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient: monmap: 2024-09-12T17:40:51.887 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:40:51.887 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:51.887 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:40:51.887 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:40:51.887 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:51.887 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.887 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:40:51.887 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:40:51.887 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:40:51.888 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.888 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding auth protocol: cephx 2024-09-12T17:40:51.888 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding auth protocol: cephx 2024-09-12T17:40:51.888 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding auth protocol: cephx 2024-09-12T17:40:51.888 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: secure 2024-09-12T17:40:51.888 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: crc 2024-09-12T17:40:51.888 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: secure 2024-09-12T17:40:51.888 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: crc 2024-09-12T17:40:51.888 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: secure 2024-09-12T17:40:51.888 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: crc 2024-09-12T17:40:51.888 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: crc 2024-09-12T17:40:51.888 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: secure 2024-09-12T17:40:51.888 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: crc 2024-09-12T17:40:51.889 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: secure 2024-09-12T17:40:51.889 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: crc 2024-09-12T17:40:51.889 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: secure 2024-09-12T17:40:51.889 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient: get_auth_request con 0x7f2e64070a20 auth_method 0 2024-09-12T17:40:51.889 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.889 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient: init 2024-09-12T17:40:51.889 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding auth protocol: cephx 2024-09-12T17:40:51.889 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding auth protocol: cephx 2024-09-12T17:40:51.889 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding auth protocol: cephx 2024-09-12T17:40:51.889 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: secure 2024-09-12T17:40:51.889 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: crc 2024-09-12T17:40:51.889 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: secure 2024-09-12T17:40:51.890 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: crc 2024-09-12T17:40:51.890 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: secure 2024-09-12T17:40:51.890 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: crc 2024-09-12T17:40:51.890 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: crc 2024-09-12T17:40:51.890 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: secure 2024-09-12T17:40:51.890 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: crc 2024-09-12T17:40:51.890 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: secure 2024-09-12T17:40:51.890 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: crc 2024-09-12T17:40:51.890 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: secure 2024-09-12T17:40:51.890 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.890 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.890 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command rotate-key cmddesc rotate-key hook 0x7fff18c6e858 EEXIST 2024-09-12T17:40:51.890 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:40:51.890 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:40:51.891 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-c con 0x55d4a287e2a0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:40:51.891 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-b con 0x55d4a2851fd0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:40:51.891 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-a con 0x55d4a287f830 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:40:51.891 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.891 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.891 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.891 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:40:51.891 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient(hunting): authenticate will time out at 2819.778885s 2024-09-12T17:40:51.891 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient(hunting): get_auth_request con 0x55d4a287e2a0 auth_method 0 2024-09-12T17:40:51.891 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.891 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.891 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.891 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:40:51.742+0000 7f2f898b1640 10 monclient(hunting): get_auth_request con 0x55d4a287f830 auth_method 0 2024-09-12T17:40:51.892 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:40:51.742+0000 7f2f898b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.892 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:40:51.742+0000 7f2f898b1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.892 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:40:51.742+0000 7f2f898b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.892 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:51.892 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:51.892 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:51.892 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:40:51.742+0000 7f2f898b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:51.892 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:40:51.742+0000 7f2f898b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:51.892 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:40:51.742+0000 7f2f898b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:51.892 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient(hunting): handle_auth_done global_id 7889 payload 274 2024-09-12T17:40:51.892 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient: _finish_hunting 0 2024-09-12T17:40:51.892 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:40:51.742+0000 7f2f890b0640 1 monclient: found mon.noname-c 2024-09-12T17:40:51.892 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:40:51.893 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.893 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:51.893 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: dump: 2024-09-12T17:40:51.893 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.893 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.893 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.893 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.893 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.893 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.893 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.893 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.893 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.893 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.894 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: _finish_auth 0 2024-09-12T17:40:51.894 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: _check_auth_tickets 2024-09-12T17:40:51.894 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:51.894 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.894 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:51.894 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: dump: 2024-09-12T17:40:51.894 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.894 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.894 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.894 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.894 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.894 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.894 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.895 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.895 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.895 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.895 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 monclient: authenticate success, global_id 7889 2024-09-12T17:40:51.895 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:40:51.895 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 4 set_mon_vals no callback set 2024-09-12T17:40:51.895 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: shutdown 2024-09-12T17:40:51.895 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: build_initial_monmap 2024-09-12T17:40:51.895 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 1 build_initial for_mkfs: 0 2024-09-12T17:40:51.895 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: monmap: 2024-09-12T17:40:51.895 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:40:51.895 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:51.895 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:40:51.895 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:40:51.896 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:51.896 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.896 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:40:51.896 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:40:51.896 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:40:51.896 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.896 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding auth protocol: cephx 2024-09-12T17:40:51.896 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding auth protocol: cephx 2024-09-12T17:40:51.896 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding auth protocol: cephx 2024-09-12T17:40:51.896 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: secure 2024-09-12T17:40:51.896 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: crc 2024-09-12T17:40:51.896 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: secure 2024-09-12T17:40:51.896 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: crc 2024-09-12T17:40:51.897 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: secure 2024-09-12T17:40:51.897 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: crc 2024-09-12T17:40:51.897 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: crc 2024-09-12T17:40:51.897 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: secure 2024-09-12T17:40:51.897 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: crc 2024-09-12T17:40:51.897 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: secure 2024-09-12T17:40:51.897 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: crc 2024-09-12T17:40:51.897 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: secure 2024-09-12T17:40:51.897 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.897 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 1 librados: starting msgr at 2024-09-12T17:40:51.897 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 1 librados: starting objecter 2024-09-12T17:40:51.897 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d4a2854090 EEXIST 2024-09-12T17:40:51.897 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 1 librados: setting wanted keys 2024-09-12T17:40:51.897 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 1 librados: calling monclient init 2024-09-12T17:40:51.898 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: init 2024-09-12T17:40:51.898 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding auth protocol: cephx 2024-09-12T17:40:51.898 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding auth protocol: cephx 2024-09-12T17:40:51.898 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding auth protocol: cephx 2024-09-12T17:40:51.898 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: secure 2024-09-12T17:40:51.898 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: crc 2024-09-12T17:40:51.898 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: secure 2024-09-12T17:40:51.898 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: crc 2024-09-12T17:40:51.898 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: secure 2024-09-12T17:40:51.898 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: crc 2024-09-12T17:40:51.898 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: crc 2024-09-12T17:40:51.898 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: secure 2024-09-12T17:40:51.898 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: crc 2024-09-12T17:40:51.898 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: secure 2024-09-12T17:40:51.899 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: crc 2024-09-12T17:40:51.899 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: secure 2024-09-12T17:40:51.899 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.899 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.899 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command rotate-key cmddesc rotate-key hook 0x55d4a28321a8 EEXIST 2024-09-12T17:40:51.899 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:40:51.899 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:40:51.899 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-b con 0x55d4a2851fd0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:40:51.899 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-a con 0x55d4a287e2a0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:40:51.899 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-c con 0x55d4a287f830 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:40:51.899 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.899 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.899 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.899 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:40:51.900 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient(hunting): authenticate will time out at 2819.781550s 2024-09-12T17:40:51.900 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient(hunting): get_auth_request con 0x55d4a287e2a0 auth_method 0 2024-09-12T17:40:51.900 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.900 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.900 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.900 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:40:51.746+0000 7f2f898b1640 10 monclient(hunting): get_auth_request con 0x55d4a287f830 auth_method 0 2024-09-12T17:40:51.900 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:40:51.746+0000 7f2f898b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.900 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:40:51.746+0000 7f2f898b1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.900 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:40:51.746+0000 7f2f898b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.900 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:51.900 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:51.900 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:51.900 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:40:51.746+0000 7f2f898b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:51.901 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:40:51.746+0000 7f2f898b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:51.901 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:40:51.746+0000 7f2f898b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:51.901 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_done global_id 8382 payload 824 2024-09-12T17:40:51.901 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient: _finish_hunting 0 2024-09-12T17:40:51.901 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 1 monclient: found mon.noname-a 2024-09-12T17:40:51.901 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:40:51.901 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.901 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:40:51.901 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: dump: 2024-09-12T17:40:51.901 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.901 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.901 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.901 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.902 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.902 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.902 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.902 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.902 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.902 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.902 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: _finish_auth 0 2024-09-12T17:40:51.902 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:40:51.902 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:51.902 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.902 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:40:51.902 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: dump: 2024-09-12T17:40:51.902 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.902 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.903 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.903 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.903 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.903 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.903 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.903 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.903 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.903 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.903 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:40:51.746+0000 7f2e6d7fa640 4 set_mon_vals no callback set 2024-09-12T17:40:51.903 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 monclient: authenticate success, global_id 8382 2024-09-12T17:40:51.903 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: _renew_subs 2024-09-12T17:40:51.903 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:40:51.903 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: _renew_subs 2024-09-12T17:40:51.903 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:40:51.904 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 1 librados: init done 2024-09-12T17:40:51.904 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command cr dump hook 0x55d4a288d698 2024-09-12T17:40:51.904 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.904 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:40:51.750+0000 7f2e5b7fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:40:51.904 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:40:51.750+0000 7f2e5b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:51.904 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:40:51.750+0000 7f2e5b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:51.904 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:40:51.750+0000 7f2f890b0640 10 monclient: get_auth_request con 0x7f2e54070ae0 auth_method 0 2024-09-12T17:40:51.904 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:40:51.750+0000 7f2f898b1640 10 monclient: get_auth_request con 0x55d4a289f370 auth_method 0 2024-09-12T17:40:51.904 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.904 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 realm 2024-09-12T17:40:51.904 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.904 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.904 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:51.905 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.905 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.905 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.905 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:40:51.750+0000 7f2f890b0640 10 monclient: get_auth_request con 0x55d4a28a36f0 auth_method 0 2024-09-12T17:40:51.905 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:40:51.754+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:51.905 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:40:51.754+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.905 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:40:51.754+0000 7f2f8a0b2640 10 monclient: get_auth_request con 0x55d4a28a6e70 auth_method 0 2024-09-12T17:40:51.905 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:40:51.754+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:51.905 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:40:51.754+0000 7f2f8bdab9c0 20 searching for the correct realm 2024-09-12T17:40:51.905 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:40:51.754+0000 7f2f898b1640 10 monclient: get_auth_request con 0x55d4a28abbc0 auth_method 0 2024-09-12T17:40:51.905 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:40:51.754+0000 7f2f890b0640 10 monclient: get_auth_request con 0x7f2f8402e040 auth_method 0 2024-09-12T17:40:51.905 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:40:51.758+0000 7f2f8a0b2640 10 monclient: get_auth_request con 0x7f2f740bf020 auth_method 0 2024-09-12T17:40:51.905 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:40:51.758+0000 7f2f898b1640 0 -- 172.21.15.119:0/3747197001 >> [v2:172.21.15.119:6800/1732749810,v1:172.21.15.119:6801/1732749810] conn(0x55d4a28abbc0 msgr2=0x55d4a28ae080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:51.905 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:40:51.758+0000 7f2e5b7fe640 1 client.8382.objecter ms_handle_reset 0x55d4a28abbc0 session 0x55d4a28ab540 osd.3 2024-09-12T17:40:51.906 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:40:51.758+0000 7f2e5b7fe640 10 monclient: _renew_subs 2024-09-12T17:40:51.906 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:40:51.758+0000 7f2e5b7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:40:51.906 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:40:51.758+0000 7f2f898b1640 10 monclient: get_auth_request con 0x7f2e54081290 auth_method 0 2024-09-12T17:40:51.906 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:40:51.762+0000 7f2f898b1640 10 monclient: get_auth_request con 0x7f2f7c03d060 auth_method 0 2024-09-12T17:40:51.906 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:40:51.766+0000 7f2f890b0640 10 monclient: get_auth_request con 0x7f2f7c01a040 auth_method 0 2024-09-12T17:40:51.906 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:40:51.766+0000 7f2f890b0640 0 -- 172.21.15.119:0/3747197001 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f2f7c01a040 msgr2=0x7f2f7c063600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:51.906 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:40:51.766+0000 7f2e5b7fe640 1 client.8382.objecter ms_handle_reset 0x7f2f7c01a040 session 0x7f2f7c03ef00 osd.0 2024-09-12T17:40:51.906 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:40:51.766+0000 7f2f890b0640 10 monclient: get_auth_request con 0x55d4a28abbc0 auth_method 0 2024-09-12T17:40:51.906 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:40:51.906 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:40:51.906 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:51.906 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:51.907 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:51.907 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:51.907 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.907 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.907 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.907 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:51.907 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.907 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:51.907 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 zone default found 2024-09-12T17:40:51.907 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 4 Realm: () 2024-09-12T17:40:51.907 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:40:51.907 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:40:51.907 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:51.907 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 zonegroup default 2024-09-12T17:40:51.908 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.908 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.908 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.908 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:40:51.778+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.908 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:40:51.778+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.908 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:40:51.778+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.908 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:40:51.778+0000 7f2f8bdab9c0 20 started sync module instance, tier type = 2024-09-12T17:40:51.908 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:40:51.778+0000 7f2f8bdab9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:40:51.908 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=0 2024-09-12T17:40:51.908 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=1 2024-09-12T17:40:51.908 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=2 2024-09-12T17:40:51.908 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=3 2024-09-12T17:40:51.908 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=4 2024-09-12T17:40:51.909 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=5 2024-09-12T17:40:51.909 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=6 2024-09-12T17:40:51.909 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=7 2024-09-12T17:40:51.909 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:51.909 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding auth protocol: cephx 2024-09-12T17:40:51.909 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding auth protocol: cephx 2024-09-12T17:40:51.909 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding auth protocol: cephx 2024-09-12T17:40:51.909 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: secure 2024-09-12T17:40:51.909 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: crc 2024-09-12T17:40:51.909 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: secure 2024-09-12T17:40:51.909 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: crc 2024-09-12T17:40:51.909 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: secure 2024-09-12T17:40:51.910 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: crc 2024-09-12T17:40:51.910 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: crc 2024-09-12T17:40:51.910 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: secure 2024-09-12T17:40:51.910 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:40:51.794+0000 7f2e3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:51.910 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: crc 2024-09-12T17:40:51.910 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: secure 2024-09-12T17:40:51.910 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: crc 2024-09-12T17:40:51.910 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: secure 2024-09-12T17:40:51.910 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.910 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:51.910 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:51.910 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command cache list hook 0x55d4a287a760 2024-09-12T17:40:51.910 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command cache inspect hook 0x55d4a287a760 2024-09-12T17:40:51.910 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command cache erase hook 0x55d4a287a760 2024-09-12T17:40:51.911 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command cache zap hook 0x55d4a287a760 2024-09-12T17:40:51.911 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 note: GC not initialized 2024-09-12T17:40:51.911 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:40:51.798+0000 7f2e3a7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:51.911 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command sync trace show hook 0x7f2f7c002f20 2024-09-12T17:40:51.911 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command sync trace history hook 0x7f2f7c002f20 2024-09-12T17:40:51.911 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command sync trace active hook 0x7f2f7c002f20 2024-09-12T17:40:51.911 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command sync trace active_short hook 0x7f2f7c002f20 2024-09-12T17:40:51.911 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:40:51.911 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 Filter name: none 2024-09-12T17:40:51.911 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:40:51.798+0000 7f2dabfff640 20 reqs_thread_entry: start 2024-09-12T17:40:51.911 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:40:51.911 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.911 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:51.912 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:40:51.912 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:40:51.912 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:40:51.912 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.912 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:40:51.912 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:51.912 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:51.912 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:51.912 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:51.912 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:40:51.912 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:40:51.802+0000 7f2f8bdab9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:40:51.912 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:40:51.818+0000 7f2f8bdab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:51.912 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:40:51.818+0000 7f2f8bdab9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:51.913 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:40:51.818+0000 7f2f8bdab9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:51.913 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:40:51.818+0000 7f2f8bdab9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:40:51.913 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:40:51.818+0000 7f2e6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333539 cookie 94371748437184 notifier 8382 bl.length()=911 2024-09-12T17:40:51.913 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:40:51.818+0000 7f2e6d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:51.913 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:40:51.818+0000 7f2e6d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:51.913 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:40:51.818+0000 7f2e6d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:51.913 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:40:51.822+0000 7f2f8bdab9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:40:51.913 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:40:51.822+0000 7f2f8bdab9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:40:51.913 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:40:51.822+0000 7f2f8bdab9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:40:51.913 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:40:51.822+0000 7f2f8bdab9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:40:51.913 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:40:51.826+0000 7f2e5b7fe640 1 client.8382.objecter ms_handle_reset 0x55d4a28a36f0 session 0x55d4a28a25a0 osd.5 2024-09-12T17:40:51.914 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:40:51.826+0000 7f2f890b0640 10 monclient: get_auth_request con 0x7f2f7c01a040 auth_method 0 2024-09-12T17:40:51.914 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:40:51.834+0000 7f2f8bdab9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2f8bdab9c0 time 2024-09-12T17:40:51.840031+0000 2024-09-12T17:40:51.914 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:40:51.914 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.914 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:51.914 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2f8f6852eb] 2024-09-12T17:40:51.914 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2f8f68549f] 2024-09-12T17:40:51.914 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d49f8840c1] 2024-09-12T17:40:51.914 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d49f8961fa] 2024-09-12T17:40:51.914 INFO:tasks.workunit.client.0.smithi119.stderr: 5: main() 2024-09-12T17:40:51.914 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2f8e4ebd90] 2024-09-12T17:40:51.914 INFO:tasks.workunit.client.0.smithi119.stderr: 7: __libc_start_main() 2024-09-12T17:40:51.914 INFO:tasks.workunit.client.0.smithi119.stderr: 8: _start() 2024-09-12T17:40:51.915 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.915 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:40:51.838+0000 7f2f8bdab9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:40:51.915 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f2f8bdab9c0 thread_name:radosgw-admin 2024-09-12T17:40:51.915 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.915 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:51.915 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2f8e504520] 2024-09-12T17:40:51.915 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:40:51.915 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:40:51.915 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:40:51.915 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2f8f685345] 2024-09-12T17:40:51.915 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2f8f68549f] 2024-09-12T17:40:51.915 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d49f8840c1] 2024-09-12T17:40:51.915 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d49f8961fa] 2024-09-12T17:40:51.916 INFO:tasks.workunit.client.0.smithi119.stderr: 9: main() 2024-09-12T17:40:51.916 INFO:tasks.workunit.client.0.smithi119.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2f8e4ebd90] 2024-09-12T17:40:51.916 INFO:tasks.workunit.client.0.smithi119.stderr: 11: __libc_start_main() 2024-09-12T17:40:51.916 INFO:tasks.workunit.client.0.smithi119.stderr: 12: _start() 2024-09-12T17:40:51.916 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:40:51.916 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.916 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:40:51.916 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:40:51.916 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:40:51.916 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:40:51.916 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:40:51.916 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:40:51.916 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:40:51.917 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:40:51.917 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:40:51.917 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:40:51.917 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:40:51.917 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:40:51.917 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:40:51.917 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:40:51.917 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:40:51.917 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:40:51.917 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:40:51.917 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:40:51.917 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:40:51.917 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:40:51.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:40:51.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:40:51.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:40:51.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:40:51.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:40:51.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:40:51.918 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:40:51.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:40:51.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:40:51.918 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:40:51.918 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:40:51.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:40:51.918 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:40:51.918 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:40:51.919 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:40:51.919 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:40:51.919 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:40:51.919 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:40:51.919 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:40:51.919 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:40:51.919 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:40:51.919 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:40:51.919 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:40:51.919 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:40:51.919 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:40:51.919 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:40:51.919 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:40:51.920 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:40:51.920 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:40:51.920 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:40:51.920 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:40:51.920 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:40:51.920 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:40:51.920 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:40:51.920 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:40:51.920 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:40:51.920 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:40:51.920 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:40:51.920 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:40:51.920 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:40:51.921 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:40:51.921 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:40:51.921 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:40:51.921 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:40:51.921 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:40:51.921 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:40:51.921 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:40:51.921 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:40:51.921 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:40:51.921 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:40:51.921 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:40:51.922 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:40:51.922 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:40:51.922 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:40:51.922 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:40:51.922 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:40:51.922 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:40:51.922 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:40:51.922 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:40:51.922 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:40:51.922 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:40:51.922 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:40:51.922 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:40:51.922 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:40:51.923 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:40:51.923 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:40:51.923 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:40:51.923 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:40:51.923 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:40:51.923 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:40:51.923 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:40:51.923 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:40:51.923 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:40:51.923 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:40:51.923 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2dabfff640 / http_manager 2024-09-12T17:40:51.923 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2e3a7fc640 / http_manager 2024-09-12T17:40:51.923 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2e3b7fe640 / rgw_dt_lg_renew 2024-09-12T17:40:51.924 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2e5b7fe640 / ms_dispatch 2024-09-12T17:40:51.924 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2e6d7fa640 / io_context_pool 2024-09-12T17:40:51.924 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2e6f7fe640 / ms_dispatch 2024-09-12T17:40:51.924 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2e76604640 / ms_dispatch 2024-09-12T17:40:51.924 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2e77e07640 / io_context_pool 2024-09-12T17:40:51.924 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2f890b0640 / msgr-worker-2 2024-09-12T17:40:51.924 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2f898b1640 / msgr-worker-1 2024-09-12T17:40:51.924 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2f8a0b2640 / msgr-worker-0 2024-09-12T17:40:51.924 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2f8a8b3640 / io_context_pool 2024-09-12T17:40:51.924 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2f8bdab9c0 / radosgw-admin 2024-09-12T17:40:51.924 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:40:51.924 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:40:51.925 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/log/ceph/ceph-client.admin.147524.log 2024-09-12T17:40:51.925 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:40:51.925 INFO:tasks.workunit.client.0.smithi119.stderr:--- begin dump of recent events --- 2024-09-12T17:40:51.925 INFO:tasks.workunit.client.0.smithi119.stderr: -499> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient: _finish_hunting 0 2024-09-12T17:40:51.925 INFO:tasks.workunit.client.0.smithi119.stderr: -498> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 1 monclient: found mon.noname-c 2024-09-12T17:40:51.925 INFO:tasks.workunit.client.0.smithi119.stderr: -497> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:40:51.925 INFO:tasks.workunit.client.0.smithi119.stderr: -496> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.925 INFO:tasks.workunit.client.0.smithi119.stderr: -495> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:51.925 INFO:tasks.workunit.client.0.smithi119.stderr: -494> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: dump: 2024-09-12T17:40:51.925 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.925 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.925 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.926 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.926 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.926 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.926 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.926 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.926 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.926 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.926 INFO:tasks.workunit.client.0.smithi119.stderr: -493> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: _finish_auth 0 2024-09-12T17:40:51.926 INFO:tasks.workunit.client.0.smithi119.stderr: -492> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: _check_auth_tickets 2024-09-12T17:40:51.926 INFO:tasks.workunit.client.0.smithi119.stderr: -491> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:51.926 INFO:tasks.workunit.client.0.smithi119.stderr: -490> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.926 INFO:tasks.workunit.client.0.smithi119.stderr: -489> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:51.926 INFO:tasks.workunit.client.0.smithi119.stderr: -488> 2024-09-12T17:40:51.726+0000 7f2e77e07640 10 monclient: dump: 2024-09-12T17:40:51.927 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.927 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.927 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.927 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.927 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.927 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.927 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.927 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.927 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.927 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.928 INFO:tasks.workunit.client.0.smithi119.stderr: -487> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 monclient: authenticate success, global_id 7880 2024-09-12T17:40:51.928 INFO:tasks.workunit.client.0.smithi119.stderr: -486> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:40:51.928 INFO:tasks.workunit.client.0.smithi119.stderr: -485> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 4 set_mon_vals no callback set 2024-09-12T17:40:51.928 INFO:tasks.workunit.client.0.smithi119.stderr: -484> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient: shutdown 2024-09-12T17:40:51.928 INFO:tasks.workunit.client.0.smithi119.stderr: -483> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) unregister_commands rotate-key 2024-09-12T17:40:51.928 INFO:tasks.workunit.client.0.smithi119.stderr: -482> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient: build_initial_monmap 2024-09-12T17:40:51.928 INFO:tasks.workunit.client.0.smithi119.stderr: -481> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 1 build_initial for_mkfs: 0 2024-09-12T17:40:51.928 INFO:tasks.workunit.client.0.smithi119.stderr: -480> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient: monmap: 2024-09-12T17:40:51.928 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:40:51.929 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:51.929 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:40:51.929 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:40:51.929 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:51.929 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.929 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:40:51.929 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:40:51.929 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:40:51.929 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.929 INFO:tasks.workunit.client.0.smithi119.stderr: -479> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding auth protocol: cephx 2024-09-12T17:40:51.929 INFO:tasks.workunit.client.0.smithi119.stderr: -478> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding auth protocol: cephx 2024-09-12T17:40:51.929 INFO:tasks.workunit.client.0.smithi119.stderr: -477> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding auth protocol: cephx 2024-09-12T17:40:51.929 INFO:tasks.workunit.client.0.smithi119.stderr: -476> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: secure 2024-09-12T17:40:51.930 INFO:tasks.workunit.client.0.smithi119.stderr: -475> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: crc 2024-09-12T17:40:51.930 INFO:tasks.workunit.client.0.smithi119.stderr: -474> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: secure 2024-09-12T17:40:51.930 INFO:tasks.workunit.client.0.smithi119.stderr: -473> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: crc 2024-09-12T17:40:51.930 INFO:tasks.workunit.client.0.smithi119.stderr: -472> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: secure 2024-09-12T17:40:51.930 INFO:tasks.workunit.client.0.smithi119.stderr: -471> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: crc 2024-09-12T17:40:51.930 INFO:tasks.workunit.client.0.smithi119.stderr: -470> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: crc 2024-09-12T17:40:51.930 INFO:tasks.workunit.client.0.smithi119.stderr: -469> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: secure 2024-09-12T17:40:51.930 INFO:tasks.workunit.client.0.smithi119.stderr: -468> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: crc 2024-09-12T17:40:51.930 INFO:tasks.workunit.client.0.smithi119.stderr: -467> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: secure 2024-09-12T17:40:51.930 INFO:tasks.workunit.client.0.smithi119.stderr: -466> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: crc 2024-09-12T17:40:51.930 INFO:tasks.workunit.client.0.smithi119.stderr: -465> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b34d0) adding con mode: secure 2024-09-12T17:40:51.930 INFO:tasks.workunit.client.0.smithi119.stderr: -464> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.930 INFO:tasks.workunit.client.0.smithi119.stderr: -463> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 1 librados: starting msgr at 2024-09-12T17:40:51.931 INFO:tasks.workunit.client.0.smithi119.stderr: -462> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 1 librados: starting objecter 2024-09-12T17:40:51.931 INFO:tasks.workunit.client.0.smithi119.stderr: -461> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command objecter_requests hook 0x55d4a27b7b50 2024-09-12T17:40:51.931 INFO:tasks.workunit.client.0.smithi119.stderr: -460> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 1 librados: setting wanted keys 2024-09-12T17:40:51.931 INFO:tasks.workunit.client.0.smithi119.stderr: -459> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 1 librados: calling monclient init 2024-09-12T17:40:51.931 INFO:tasks.workunit.client.0.smithi119.stderr: -458> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient: init 2024-09-12T17:40:51.931 INFO:tasks.workunit.client.0.smithi119.stderr: -457> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding auth protocol: cephx 2024-09-12T17:40:51.931 INFO:tasks.workunit.client.0.smithi119.stderr: -456> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding auth protocol: cephx 2024-09-12T17:40:51.931 INFO:tasks.workunit.client.0.smithi119.stderr: -455> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding auth protocol: cephx 2024-09-12T17:40:51.931 INFO:tasks.workunit.client.0.smithi119.stderr: -454> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: secure 2024-09-12T17:40:51.931 INFO:tasks.workunit.client.0.smithi119.stderr: -453> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: crc 2024-09-12T17:40:51.931 INFO:tasks.workunit.client.0.smithi119.stderr: -452> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: secure 2024-09-12T17:40:51.931 INFO:tasks.workunit.client.0.smithi119.stderr: -451> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: crc 2024-09-12T17:40:51.931 INFO:tasks.workunit.client.0.smithi119.stderr: -450> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: secure 2024-09-12T17:40:51.931 INFO:tasks.workunit.client.0.smithi119.stderr: -449> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: crc 2024-09-12T17:40:51.932 INFO:tasks.workunit.client.0.smithi119.stderr: -448> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: crc 2024-09-12T17:40:51.932 INFO:tasks.workunit.client.0.smithi119.stderr: -447> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: secure 2024-09-12T17:40:51.932 INFO:tasks.workunit.client.0.smithi119.stderr: -446> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: crc 2024-09-12T17:40:51.932 INFO:tasks.workunit.client.0.smithi119.stderr: -445> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: secure 2024-09-12T17:40:51.932 INFO:tasks.workunit.client.0.smithi119.stderr: -444> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: crc 2024-09-12T17:40:51.932 INFO:tasks.workunit.client.0.smithi119.stderr: -443> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a27b13f0) adding con mode: secure 2024-09-12T17:40:51.932 INFO:tasks.workunit.client.0.smithi119.stderr: -442> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.932 INFO:tasks.workunit.client.0.smithi119.stderr: -441> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.932 INFO:tasks.workunit.client.0.smithi119.stderr: -440> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command rotate-key hook 0x55d4a27b1538 2024-09-12T17:40:51.932 INFO:tasks.workunit.client.0.smithi119.stderr: -439> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:40:51.932 INFO:tasks.workunit.client.0.smithi119.stderr: -438> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:40:51.932 INFO:tasks.workunit.client.0.smithi119.stderr: -437> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-b con 0x55d4a2661e30 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:40:51.932 INFO:tasks.workunit.client.0.smithi119.stderr: -436> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-c con 0x55d4a26f71f0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:40:51.933 INFO:tasks.workunit.client.0.smithi119.stderr: -435> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-a con 0x55d4a26f75d0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:40:51.933 INFO:tasks.workunit.client.0.smithi119.stderr: -434> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.933 INFO:tasks.workunit.client.0.smithi119.stderr: -433> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.933 INFO:tasks.workunit.client.0.smithi119.stderr: -432> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.933 INFO:tasks.workunit.client.0.smithi119.stderr: -431> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:40:51.933 INFO:tasks.workunit.client.0.smithi119.stderr: -430> 2024-09-12T17:40:51.726+0000 7f2f8bdab9c0 10 monclient(hunting): authenticate will time out at 2819.763305s 2024-09-12T17:40:51.933 INFO:tasks.workunit.client.0.smithi119.stderr: -429> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient(hunting): get_auth_request con 0x55d4a26f71f0 auth_method 0 2024-09-12T17:40:51.933 INFO:tasks.workunit.client.0.smithi119.stderr: -428> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.933 INFO:tasks.workunit.client.0.smithi119.stderr: -427> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.933 INFO:tasks.workunit.client.0.smithi119.stderr: -426> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.933 INFO:tasks.workunit.client.0.smithi119.stderr: -425> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient(hunting): get_auth_request con 0x55d4a26f75d0 auth_method 0 2024-09-12T17:40:51.933 INFO:tasks.workunit.client.0.smithi119.stderr: -424> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.933 INFO:tasks.workunit.client.0.smithi119.stderr: -423> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.934 INFO:tasks.workunit.client.0.smithi119.stderr: -422> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.934 INFO:tasks.workunit.client.0.smithi119.stderr: -421> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:51.934 INFO:tasks.workunit.client.0.smithi119.stderr: -420> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:51.934 INFO:tasks.workunit.client.0.smithi119.stderr: -419> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:51.934 INFO:tasks.workunit.client.0.smithi119.stderr: -418> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:51.934 INFO:tasks.workunit.client.0.smithi119.stderr: -417> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:51.934 INFO:tasks.workunit.client.0.smithi119.stderr: -416> 2024-09-12T17:40:51.726+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:51.934 INFO:tasks.workunit.client.0.smithi119.stderr: -415> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient(hunting): handle_auth_done global_id 7883 payload 824 2024-09-12T17:40:51.934 INFO:tasks.workunit.client.0.smithi119.stderr: -414> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient: _finish_hunting 0 2024-09-12T17:40:51.934 INFO:tasks.workunit.client.0.smithi119.stderr: -413> 2024-09-12T17:40:51.726+0000 7f2f890b0640 1 monclient: found mon.noname-c 2024-09-12T17:40:51.934 INFO:tasks.workunit.client.0.smithi119.stderr: -412> 2024-09-12T17:40:51.726+0000 7f2f890b0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:40:51.934 INFO:tasks.workunit.client.0.smithi119.stderr: -411> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.934 INFO:tasks.workunit.client.0.smithi119.stderr: -410> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:51.934 INFO:tasks.workunit.client.0.smithi119.stderr: -409> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: dump: 2024-09-12T17:40:51.935 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.935 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.935 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.935 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.935 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.935 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.935 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.935 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.935 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.935 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.935 INFO:tasks.workunit.client.0.smithi119.stderr: -408> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: _finish_auth 0 2024-09-12T17:40:51.935 INFO:tasks.workunit.client.0.smithi119.stderr: -407> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: _check_auth_tickets 2024-09-12T17:40:51.935 INFO:tasks.workunit.client.0.smithi119.stderr: -406> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:51.935 INFO:tasks.workunit.client.0.smithi119.stderr: -405> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.936 INFO:tasks.workunit.client.0.smithi119.stderr: -404> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:51.936 INFO:tasks.workunit.client.0.smithi119.stderr: -403> 2024-09-12T17:40:51.730+0000 7f2e76604640 10 monclient: dump: 2024-09-12T17:40:51.936 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.936 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.936 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.936 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.936 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.936 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.936 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.936 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.936 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.936 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.936 INFO:tasks.workunit.client.0.smithi119.stderr: -402> 2024-09-12T17:40:51.730+0000 7f2f8bdab9c0 5 monclient: authenticate success, global_id 7883 2024-09-12T17:40:51.937 INFO:tasks.workunit.client.0.smithi119.stderr: -401> 2024-09-12T17:40:51.730+0000 7f2f8bdab9c0 10 monclient: _renew_subs 2024-09-12T17:40:51.937 INFO:tasks.workunit.client.0.smithi119.stderr: -400> 2024-09-12T17:40:51.730+0000 7f2e77e07640 4 set_mon_vals no callback set 2024-09-12T17:40:51.937 INFO:tasks.workunit.client.0.smithi119.stderr: -399> 2024-09-12T17:40:51.730+0000 7f2f8bdab9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:51.937 INFO:tasks.workunit.client.0.smithi119.stderr: -398> 2024-09-12T17:40:51.730+0000 7f2f8bdab9c0 10 monclient: _renew_subs 2024-09-12T17:40:51.937 INFO:tasks.workunit.client.0.smithi119.stderr: -397> 2024-09-12T17:40:51.730+0000 7f2f8bdab9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:51.937 INFO:tasks.workunit.client.0.smithi119.stderr: -396> 2024-09-12T17:40:51.730+0000 7f2f8bdab9c0 1 librados: init done 2024-09-12T17:40:51.937 INFO:tasks.workunit.client.0.smithi119.stderr: -395> 2024-09-12T17:40:51.730+0000 7f2e76604640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:40:51.937 INFO:tasks.workunit.client.0.smithi119.stderr: -394> 2024-09-12T17:40:51.730+0000 7f2e76604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:51.937 INFO:tasks.workunit.client.0.smithi119.stderr: -393> 2024-09-12T17:40:51.730+0000 7f2e76604640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:51.937 INFO:tasks.workunit.client.0.smithi119.stderr: -392> 2024-09-12T17:40:51.730+0000 7f2f898b1640 10 monclient: get_auth_request con 0x7f2e70070b10 auth_method 0 2024-09-12T17:40:51.937 INFO:tasks.workunit.client.0.smithi119.stderr: -391> 2024-09-12T17:40:51.730+0000 7f2f8a0b2640 10 monclient: get_auth_request con 0x55d4a27d9bd0 auth_method 0 2024-09-12T17:40:51.937 INFO:tasks.workunit.client.0.smithi119.stderr: -390> 2024-09-12T17:40:51.730+0000 7f2f898b1640 10 monclient: get_auth_request con 0x55d4a27fc3e0 auth_method 0 2024-09-12T17:40:51.937 INFO:tasks.workunit.client.0.smithi119.stderr: -389> 2024-09-12T17:40:51.734+0000 7f2f890b0640 10 monclient: get_auth_request con 0x55d4a28005d0 auth_method 0 2024-09-12T17:40:51.938 INFO:tasks.workunit.client.0.smithi119.stderr: -388> 2024-09-12T17:40:51.734+0000 7f2f8a0b2640 10 monclient: get_auth_request con 0x55d4a2804990 auth_method 0 2024-09-12T17:40:51.938 INFO:tasks.workunit.client.0.smithi119.stderr: -387> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: build_initial_monmap 2024-09-12T17:40:51.938 INFO:tasks.workunit.client.0.smithi119.stderr: -386> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 1 build_initial for_mkfs: 0 2024-09-12T17:40:51.938 INFO:tasks.workunit.client.0.smithi119.stderr: -385> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: monmap: 2024-09-12T17:40:51.938 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:40:51.938 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:51.938 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:40:51.938 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:40:51.938 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:51.938 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.938 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:40:51.938 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:40:51.938 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:40:51.938 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.939 INFO:tasks.workunit.client.0.smithi119.stderr: -384> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding auth protocol: cephx 2024-09-12T17:40:51.939 INFO:tasks.workunit.client.0.smithi119.stderr: -383> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding auth protocol: cephx 2024-09-12T17:40:51.939 INFO:tasks.workunit.client.0.smithi119.stderr: -382> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding auth protocol: cephx 2024-09-12T17:40:51.939 INFO:tasks.workunit.client.0.smithi119.stderr: -381> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: secure 2024-09-12T17:40:51.939 INFO:tasks.workunit.client.0.smithi119.stderr: -380> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: crc 2024-09-12T17:40:51.939 INFO:tasks.workunit.client.0.smithi119.stderr: -379> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: secure 2024-09-12T17:40:51.939 INFO:tasks.workunit.client.0.smithi119.stderr: -378> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: crc 2024-09-12T17:40:51.939 INFO:tasks.workunit.client.0.smithi119.stderr: -377> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: secure 2024-09-12T17:40:51.939 INFO:tasks.workunit.client.0.smithi119.stderr: -376> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: crc 2024-09-12T17:40:51.939 INFO:tasks.workunit.client.0.smithi119.stderr: -375> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: crc 2024-09-12T17:40:51.939 INFO:tasks.workunit.client.0.smithi119.stderr: -374> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: secure 2024-09-12T17:40:51.939 INFO:tasks.workunit.client.0.smithi119.stderr: -373> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: crc 2024-09-12T17:40:51.939 INFO:tasks.workunit.client.0.smithi119.stderr: -372> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: secure 2024-09-12T17:40:51.939 INFO:tasks.workunit.client.0.smithi119.stderr: -371> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: crc 2024-09-12T17:40:51.940 INFO:tasks.workunit.client.0.smithi119.stderr: -370> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2808720) adding con mode: secure 2024-09-12T17:40:51.940 INFO:tasks.workunit.client.0.smithi119.stderr: -369> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.940 INFO:tasks.workunit.client.0.smithi119.stderr: -368> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d4a280c090 EEXIST 2024-09-12T17:40:51.940 INFO:tasks.workunit.client.0.smithi119.stderr: -367> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: init 2024-09-12T17:40:51.940 INFO:tasks.workunit.client.0.smithi119.stderr: -366> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding auth protocol: cephx 2024-09-12T17:40:51.940 INFO:tasks.workunit.client.0.smithi119.stderr: -365> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding auth protocol: cephx 2024-09-12T17:40:51.940 INFO:tasks.workunit.client.0.smithi119.stderr: -364> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding auth protocol: cephx 2024-09-12T17:40:51.940 INFO:tasks.workunit.client.0.smithi119.stderr: -363> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: secure 2024-09-12T17:40:51.940 INFO:tasks.workunit.client.0.smithi119.stderr: -362> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: crc 2024-09-12T17:40:51.940 INFO:tasks.workunit.client.0.smithi119.stderr: -361> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: secure 2024-09-12T17:40:51.940 INFO:tasks.workunit.client.0.smithi119.stderr: -360> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: crc 2024-09-12T17:40:51.940 INFO:tasks.workunit.client.0.smithi119.stderr: -359> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: secure 2024-09-12T17:40:51.940 INFO:tasks.workunit.client.0.smithi119.stderr: -358> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: crc 2024-09-12T17:40:51.941 INFO:tasks.workunit.client.0.smithi119.stderr: -357> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: crc 2024-09-12T17:40:51.941 INFO:tasks.workunit.client.0.smithi119.stderr: -356> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: secure 2024-09-12T17:40:51.941 INFO:tasks.workunit.client.0.smithi119.stderr: -355> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: crc 2024-09-12T17:40:51.941 INFO:tasks.workunit.client.0.smithi119.stderr: -354> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: secure 2024-09-12T17:40:51.941 INFO:tasks.workunit.client.0.smithi119.stderr: -353> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: crc 2024-09-12T17:40:51.941 INFO:tasks.workunit.client.0.smithi119.stderr: -352> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a28076d8) adding con mode: secure 2024-09-12T17:40:51.941 INFO:tasks.workunit.client.0.smithi119.stderr: -351> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.941 INFO:tasks.workunit.client.0.smithi119.stderr: -350> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.941 INFO:tasks.workunit.client.0.smithi119.stderr: -349> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command rotate-key cmddesc rotate-key hook 0x55d4a2807820 EEXIST 2024-09-12T17:40:51.941 INFO:tasks.workunit.client.0.smithi119.stderr: -348> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:40:51.941 INFO:tasks.workunit.client.0.smithi119.stderr: -347> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:40:51.941 INFO:tasks.workunit.client.0.smithi119.stderr: -346> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-a con 0x55d4a2830240 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:40:51.941 INFO:tasks.workunit.client.0.smithi119.stderr: -345> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-c con 0x55d4a282fb70 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:40:51.941 INFO:tasks.workunit.client.0.smithi119.stderr: -344> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-b con 0x55d4a282e550 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:40:51.942 INFO:tasks.workunit.client.0.smithi119.stderr: -343> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.942 INFO:tasks.workunit.client.0.smithi119.stderr: -342> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.942 INFO:tasks.workunit.client.0.smithi119.stderr: -341> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.942 INFO:tasks.workunit.client.0.smithi119.stderr: -340> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:40:51.942 INFO:tasks.workunit.client.0.smithi119.stderr: -339> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient(hunting): authenticate will time out at 2819.774616s 2024-09-12T17:40:51.942 INFO:tasks.workunit.client.0.smithi119.stderr: -338> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient(hunting): get_auth_request con 0x55d4a282fb70 auth_method 0 2024-09-12T17:40:51.942 INFO:tasks.workunit.client.0.smithi119.stderr: -337> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.942 INFO:tasks.workunit.client.0.smithi119.stderr: -336> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.942 INFO:tasks.workunit.client.0.smithi119.stderr: -335> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.942 INFO:tasks.workunit.client.0.smithi119.stderr: -334> 2024-09-12T17:40:51.738+0000 7f2f890b0640 10 monclient(hunting): get_auth_request con 0x55d4a2830240 auth_method 0 2024-09-12T17:40:51.942 INFO:tasks.workunit.client.0.smithi119.stderr: -333> 2024-09-12T17:40:51.738+0000 7f2f890b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.942 INFO:tasks.workunit.client.0.smithi119.stderr: -332> 2024-09-12T17:40:51.738+0000 7f2f890b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.942 INFO:tasks.workunit.client.0.smithi119.stderr: -331> 2024-09-12T17:40:51.738+0000 7f2f890b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.943 INFO:tasks.workunit.client.0.smithi119.stderr: -330> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:51.943 INFO:tasks.workunit.client.0.smithi119.stderr: -329> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:51.943 INFO:tasks.workunit.client.0.smithi119.stderr: -328> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:51.943 INFO:tasks.workunit.client.0.smithi119.stderr: -327> 2024-09-12T17:40:51.738+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:51.943 INFO:tasks.workunit.client.0.smithi119.stderr: -326> 2024-09-12T17:40:51.738+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:51.943 INFO:tasks.workunit.client.0.smithi119.stderr: -325> 2024-09-12T17:40:51.738+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:51.943 INFO:tasks.workunit.client.0.smithi119.stderr: -324> 2024-09-12T17:40:51.738+0000 7f2f898b1640 10 monclient(hunting): get_auth_request con 0x55d4a282e550 auth_method 0 2024-09-12T17:40:51.943 INFO:tasks.workunit.client.0.smithi119.stderr: -323> 2024-09-12T17:40:51.738+0000 7f2f898b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.943 INFO:tasks.workunit.client.0.smithi119.stderr: -322> 2024-09-12T17:40:51.738+0000 7f2f898b1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.943 INFO:tasks.workunit.client.0.smithi119.stderr: -321> 2024-09-12T17:40:51.738+0000 7f2f898b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.943 INFO:tasks.workunit.client.0.smithi119.stderr: -320> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_done global_id 7886 payload 824 2024-09-12T17:40:51.943 INFO:tasks.workunit.client.0.smithi119.stderr: -319> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient: _finish_hunting 0 2024-09-12T17:40:51.943 INFO:tasks.workunit.client.0.smithi119.stderr: -318> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 1 monclient: found mon.noname-c 2024-09-12T17:40:51.944 INFO:tasks.workunit.client.0.smithi119.stderr: -317> 2024-09-12T17:40:51.738+0000 7f2f8a0b2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:40:51.944 INFO:tasks.workunit.client.0.smithi119.stderr: -316> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.944 INFO:tasks.workunit.client.0.smithi119.stderr: -315> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:51.944 INFO:tasks.workunit.client.0.smithi119.stderr: -314> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: dump: 2024-09-12T17:40:51.944 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.944 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.944 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.944 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.944 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.944 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.944 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.944 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.944 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.945 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.945 INFO:tasks.workunit.client.0.smithi119.stderr: -313> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: _finish_auth 0 2024-09-12T17:40:51.945 INFO:tasks.workunit.client.0.smithi119.stderr: -312> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:40:51.945 INFO:tasks.workunit.client.0.smithi119.stderr: -311> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:51.945 INFO:tasks.workunit.client.0.smithi119.stderr: -310> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.945 INFO:tasks.workunit.client.0.smithi119.stderr: -309> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:51.945 INFO:tasks.workunit.client.0.smithi119.stderr: -308> 2024-09-12T17:40:51.738+0000 7f2e6f7fe640 10 monclient: dump: 2024-09-12T17:40:51.945 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.945 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.945 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.945 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.945 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.945 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.946 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.946 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.946 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.946 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.946 INFO:tasks.workunit.client.0.smithi119.stderr: -307> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 5 monclient: authenticate success, global_id 7886 2024-09-12T17:40:51.946 INFO:tasks.workunit.client.0.smithi119.stderr: -306> 2024-09-12T17:40:51.738+0000 7f2f8a8b3640 4 set_mon_vals no callback set 2024-09-12T17:40:51.946 INFO:tasks.workunit.client.0.smithi119.stderr: -305> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: _renew_subs 2024-09-12T17:40:51.946 INFO:tasks.workunit.client.0.smithi119.stderr: -304> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:51.946 INFO:tasks.workunit.client.0.smithi119.stderr: -303> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: _renew_subs 2024-09-12T17:40:51.946 INFO:tasks.workunit.client.0.smithi119.stderr: -302> 2024-09-12T17:40:51.738+0000 7f2f8bdab9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.119:3301/0 2024-09-12T17:40:51.946 INFO:tasks.workunit.client.0.smithi119.stderr: -301> 2024-09-12T17:40:51.742+0000 7f2e6f7fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:40:51.946 INFO:tasks.workunit.client.0.smithi119.stderr: -300> 2024-09-12T17:40:51.742+0000 7f2e6f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:51.946 INFO:tasks.workunit.client.0.smithi119.stderr: -299> 2024-09-12T17:40:51.742+0000 7f2e6f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:51.947 INFO:tasks.workunit.client.0.smithi119.stderr: -298> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient: get_monmap_and_config 2024-09-12T17:40:51.947 INFO:tasks.workunit.client.0.smithi119.stderr: -297> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient: build_initial_monmap 2024-09-12T17:40:51.947 INFO:tasks.workunit.client.0.smithi119.stderr: -296> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 1 build_initial for_mkfs: 0 2024-09-12T17:40:51.947 INFO:tasks.workunit.client.0.smithi119.stderr: -295> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient: monmap: 2024-09-12T17:40:51.947 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:40:51.947 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:51.947 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:40:51.947 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:40:51.947 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:51.947 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.947 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:40:51.947 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:40:51.947 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:40:51.948 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.948 INFO:tasks.workunit.client.0.smithi119.stderr: -294> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding auth protocol: cephx 2024-09-12T17:40:51.948 INFO:tasks.workunit.client.0.smithi119.stderr: -293> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding auth protocol: cephx 2024-09-12T17:40:51.948 INFO:tasks.workunit.client.0.smithi119.stderr: -292> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding auth protocol: cephx 2024-09-12T17:40:51.948 INFO:tasks.workunit.client.0.smithi119.stderr: -291> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: secure 2024-09-12T17:40:51.948 INFO:tasks.workunit.client.0.smithi119.stderr: -290> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: crc 2024-09-12T17:40:51.948 INFO:tasks.workunit.client.0.smithi119.stderr: -289> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: secure 2024-09-12T17:40:51.948 INFO:tasks.workunit.client.0.smithi119.stderr: -288> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: crc 2024-09-12T17:40:51.948 INFO:tasks.workunit.client.0.smithi119.stderr: -287> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: secure 2024-09-12T17:40:51.948 INFO:tasks.workunit.client.0.smithi119.stderr: -286> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: crc 2024-09-12T17:40:51.948 INFO:tasks.workunit.client.0.smithi119.stderr: -285> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: crc 2024-09-12T17:40:51.948 INFO:tasks.workunit.client.0.smithi119.stderr: -284> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: secure 2024-09-12T17:40:51.949 INFO:tasks.workunit.client.0.smithi119.stderr: -283> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: crc 2024-09-12T17:40:51.949 INFO:tasks.workunit.client.0.smithi119.stderr: -282> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: secure 2024-09-12T17:40:51.949 INFO:tasks.workunit.client.0.smithi119.stderr: -281> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: crc 2024-09-12T17:40:51.949 INFO:tasks.workunit.client.0.smithi119.stderr: -280> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a284fb50) adding con mode: secure 2024-09-12T17:40:51.949 INFO:tasks.workunit.client.0.smithi119.stderr: -279> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient: get_auth_request con 0x7f2e64070a20 auth_method 0 2024-09-12T17:40:51.949 INFO:tasks.workunit.client.0.smithi119.stderr: -278> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.949 INFO:tasks.workunit.client.0.smithi119.stderr: -277> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient: init 2024-09-12T17:40:51.949 INFO:tasks.workunit.client.0.smithi119.stderr: -276> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding auth protocol: cephx 2024-09-12T17:40:51.949 INFO:tasks.workunit.client.0.smithi119.stderr: -275> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding auth protocol: cephx 2024-09-12T17:40:51.949 INFO:tasks.workunit.client.0.smithi119.stderr: -274> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding auth protocol: cephx 2024-09-12T17:40:51.949 INFO:tasks.workunit.client.0.smithi119.stderr: -273> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: secure 2024-09-12T17:40:51.949 INFO:tasks.workunit.client.0.smithi119.stderr: -272> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: crc 2024-09-12T17:40:51.949 INFO:tasks.workunit.client.0.smithi119.stderr: -271> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: secure 2024-09-12T17:40:51.950 INFO:tasks.workunit.client.0.smithi119.stderr: -270> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: crc 2024-09-12T17:40:51.950 INFO:tasks.workunit.client.0.smithi119.stderr: -269> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: secure 2024-09-12T17:40:51.950 INFO:tasks.workunit.client.0.smithi119.stderr: -268> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: crc 2024-09-12T17:40:51.950 INFO:tasks.workunit.client.0.smithi119.stderr: -267> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: crc 2024-09-12T17:40:51.950 INFO:tasks.workunit.client.0.smithi119.stderr: -266> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: secure 2024-09-12T17:40:51.950 INFO:tasks.workunit.client.0.smithi119.stderr: -265> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: crc 2024-09-12T17:40:51.950 INFO:tasks.workunit.client.0.smithi119.stderr: -264> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: secure 2024-09-12T17:40:51.950 INFO:tasks.workunit.client.0.smithi119.stderr: -263> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: crc 2024-09-12T17:40:51.950 INFO:tasks.workunit.client.0.smithi119.stderr: -262> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6e710) adding con mode: secure 2024-09-12T17:40:51.950 INFO:tasks.workunit.client.0.smithi119.stderr: -261> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.950 INFO:tasks.workunit.client.0.smithi119.stderr: -260> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.950 INFO:tasks.workunit.client.0.smithi119.stderr: -259> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command rotate-key cmddesc rotate-key hook 0x7fff18c6e858 EEXIST 2024-09-12T17:40:51.950 INFO:tasks.workunit.client.0.smithi119.stderr: -258> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:40:51.951 INFO:tasks.workunit.client.0.smithi119.stderr: -257> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:40:51.951 INFO:tasks.workunit.client.0.smithi119.stderr: -256> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-c con 0x55d4a287e2a0 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:40:51.951 INFO:tasks.workunit.client.0.smithi119.stderr: -255> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-b con 0x55d4a2851fd0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:40:51.951 INFO:tasks.workunit.client.0.smithi119.stderr: -254> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-a con 0x55d4a287f830 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:40:51.951 INFO:tasks.workunit.client.0.smithi119.stderr: -253> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.951 INFO:tasks.workunit.client.0.smithi119.stderr: -252> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.951 INFO:tasks.workunit.client.0.smithi119.stderr: -251> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.951 INFO:tasks.workunit.client.0.smithi119.stderr: -250> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:40:51.951 INFO:tasks.workunit.client.0.smithi119.stderr: -249> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient(hunting): authenticate will time out at 2819.778885s 2024-09-12T17:40:51.951 INFO:tasks.workunit.client.0.smithi119.stderr: -248> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient(hunting): get_auth_request con 0x55d4a287e2a0 auth_method 0 2024-09-12T17:40:51.951 INFO:tasks.workunit.client.0.smithi119.stderr: -247> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.951 INFO:tasks.workunit.client.0.smithi119.stderr: -246> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.951 INFO:tasks.workunit.client.0.smithi119.stderr: -245> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.952 INFO:tasks.workunit.client.0.smithi119.stderr: -244> 2024-09-12T17:40:51.742+0000 7f2f898b1640 10 monclient(hunting): get_auth_request con 0x55d4a287f830 auth_method 0 2024-09-12T17:40:51.952 INFO:tasks.workunit.client.0.smithi119.stderr: -243> 2024-09-12T17:40:51.742+0000 7f2f898b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.952 INFO:tasks.workunit.client.0.smithi119.stderr: -242> 2024-09-12T17:40:51.742+0000 7f2f898b1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.952 INFO:tasks.workunit.client.0.smithi119.stderr: -241> 2024-09-12T17:40:51.742+0000 7f2f898b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.952 INFO:tasks.workunit.client.0.smithi119.stderr: -240> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:51.952 INFO:tasks.workunit.client.0.smithi119.stderr: -239> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:51.952 INFO:tasks.workunit.client.0.smithi119.stderr: -238> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:51.952 INFO:tasks.workunit.client.0.smithi119.stderr: -237> 2024-09-12T17:40:51.742+0000 7f2f898b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:51.952 INFO:tasks.workunit.client.0.smithi119.stderr: -236> 2024-09-12T17:40:51.742+0000 7f2f898b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:51.952 INFO:tasks.workunit.client.0.smithi119.stderr: -235> 2024-09-12T17:40:51.742+0000 7f2f898b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:51.952 INFO:tasks.workunit.client.0.smithi119.stderr: -234> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient(hunting): handle_auth_done global_id 7889 payload 274 2024-09-12T17:40:51.952 INFO:tasks.workunit.client.0.smithi119.stderr: -233> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient: _finish_hunting 0 2024-09-12T17:40:51.953 INFO:tasks.workunit.client.0.smithi119.stderr: -232> 2024-09-12T17:40:51.742+0000 7f2f890b0640 1 monclient: found mon.noname-c 2024-09-12T17:40:51.953 INFO:tasks.workunit.client.0.smithi119.stderr: -231> 2024-09-12T17:40:51.742+0000 7f2f890b0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.119:3301/0 2024-09-12T17:40:51.953 INFO:tasks.workunit.client.0.smithi119.stderr: -230> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.953 INFO:tasks.workunit.client.0.smithi119.stderr: -229> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:40:51.957 INFO:tasks.workunit.client.0.smithi119.stderr: -228> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: dump: 2024-09-12T17:40:51.957 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.957 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.957 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.957 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.957 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.957 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.958 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.958 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.958 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.958 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.958 INFO:tasks.workunit.client.0.smithi119.stderr: -227> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: _finish_auth 0 2024-09-12T17:40:51.958 INFO:tasks.workunit.client.0.smithi119.stderr: -226> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: _check_auth_tickets 2024-09-12T17:40:51.958 INFO:tasks.workunit.client.0.smithi119.stderr: -225> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:51.958 INFO:tasks.workunit.client.0.smithi119.stderr: -224> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.958 INFO:tasks.workunit.client.0.smithi119.stderr: -223> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:40:51.958 INFO:tasks.workunit.client.0.smithi119.stderr: -222> 2024-09-12T17:40:51.742+0000 7f2e6d7fa640 10 monclient: dump: 2024-09-12T17:40:51.958 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.958 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.958 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.959 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.959 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.959 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.959 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.959 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.959 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.959 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.959 INFO:tasks.workunit.client.0.smithi119.stderr: -221> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 5 monclient: authenticate success, global_id 7889 2024-09-12T17:40:51.959 INFO:tasks.workunit.client.0.smithi119.stderr: -220> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:40:51.959 INFO:tasks.workunit.client.0.smithi119.stderr: -219> 2024-09-12T17:40:51.742+0000 7f2f8bdab9c0 4 set_mon_vals no callback set 2024-09-12T17:40:51.959 INFO:tasks.workunit.client.0.smithi119.stderr: -218> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: shutdown 2024-09-12T17:40:51.959 INFO:tasks.workunit.client.0.smithi119.stderr: -217> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: build_initial_monmap 2024-09-12T17:40:51.959 INFO:tasks.workunit.client.0.smithi119.stderr: -216> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 1 build_initial for_mkfs: 0 2024-09-12T17:40:51.960 INFO:tasks.workunit.client.0.smithi119.stderr: -215> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: monmap: 2024-09-12T17:40:51.960 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 0 2024-09-12T17:40:51.960 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:40:51.960 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 0.000000 2024-09-12T17:40:51.960 INFO:tasks.workunit.client.0.smithi119.stderr:created 0.000000 2024-09-12T17:40:51.960 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 0 (unknown) 2024-09-12T17:40:51.960 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.960 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.noname-a 2024-09-12T17:40:51.960 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.noname-b 2024-09-12T17:40:51.960 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.noname-c 2024-09-12T17:40:51.960 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.960 INFO:tasks.workunit.client.0.smithi119.stderr: -214> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding auth protocol: cephx 2024-09-12T17:40:51.960 INFO:tasks.workunit.client.0.smithi119.stderr: -213> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding auth protocol: cephx 2024-09-12T17:40:51.961 INFO:tasks.workunit.client.0.smithi119.stderr: -212> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding auth protocol: cephx 2024-09-12T17:40:51.961 INFO:tasks.workunit.client.0.smithi119.stderr: -211> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: secure 2024-09-12T17:40:51.961 INFO:tasks.workunit.client.0.smithi119.stderr: -210> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: crc 2024-09-12T17:40:51.961 INFO:tasks.workunit.client.0.smithi119.stderr: -209> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: secure 2024-09-12T17:40:51.961 INFO:tasks.workunit.client.0.smithi119.stderr: -208> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: crc 2024-09-12T17:40:51.961 INFO:tasks.workunit.client.0.smithi119.stderr: -207> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: secure 2024-09-12T17:40:51.961 INFO:tasks.workunit.client.0.smithi119.stderr: -206> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: crc 2024-09-12T17:40:51.961 INFO:tasks.workunit.client.0.smithi119.stderr: -205> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: crc 2024-09-12T17:40:51.961 INFO:tasks.workunit.client.0.smithi119.stderr: -204> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: secure 2024-09-12T17:40:51.961 INFO:tasks.workunit.client.0.smithi119.stderr: -203> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: crc 2024-09-12T17:40:51.961 INFO:tasks.workunit.client.0.smithi119.stderr: -202> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: secure 2024-09-12T17:40:51.961 INFO:tasks.workunit.client.0.smithi119.stderr: -201> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: crc 2024-09-12T17:40:51.961 INFO:tasks.workunit.client.0.smithi119.stderr: -200> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2883780) adding con mode: secure 2024-09-12T17:40:51.962 INFO:tasks.workunit.client.0.smithi119.stderr: -199> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.962 INFO:tasks.workunit.client.0.smithi119.stderr: -198> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 1 librados: starting msgr at 2024-09-12T17:40:51.962 INFO:tasks.workunit.client.0.smithi119.stderr: -197> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 1 librados: starting objecter 2024-09-12T17:40:51.962 INFO:tasks.workunit.client.0.smithi119.stderr: -196> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d4a2854090 EEXIST 2024-09-12T17:40:51.962 INFO:tasks.workunit.client.0.smithi119.stderr: -195> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 1 librados: setting wanted keys 2024-09-12T17:40:51.962 INFO:tasks.workunit.client.0.smithi119.stderr: -194> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 1 librados: calling monclient init 2024-09-12T17:40:51.962 INFO:tasks.workunit.client.0.smithi119.stderr: -193> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: init 2024-09-12T17:40:51.962 INFO:tasks.workunit.client.0.smithi119.stderr: -192> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding auth protocol: cephx 2024-09-12T17:40:51.962 INFO:tasks.workunit.client.0.smithi119.stderr: -191> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding auth protocol: cephx 2024-09-12T17:40:51.962 INFO:tasks.workunit.client.0.smithi119.stderr: -190> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding auth protocol: cephx 2024-09-12T17:40:51.962 INFO:tasks.workunit.client.0.smithi119.stderr: -189> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: secure 2024-09-12T17:40:51.962 INFO:tasks.workunit.client.0.smithi119.stderr: -188> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: crc 2024-09-12T17:40:51.962 INFO:tasks.workunit.client.0.smithi119.stderr: -187> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: secure 2024-09-12T17:40:51.962 INFO:tasks.workunit.client.0.smithi119.stderr: -186> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: crc 2024-09-12T17:40:51.963 INFO:tasks.workunit.client.0.smithi119.stderr: -185> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: secure 2024-09-12T17:40:51.963 INFO:tasks.workunit.client.0.smithi119.stderr: -184> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: crc 2024-09-12T17:40:51.963 INFO:tasks.workunit.client.0.smithi119.stderr: -183> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: crc 2024-09-12T17:40:51.963 INFO:tasks.workunit.client.0.smithi119.stderr: -182> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: secure 2024-09-12T17:40:51.963 INFO:tasks.workunit.client.0.smithi119.stderr: -181> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: crc 2024-09-12T17:40:51.963 INFO:tasks.workunit.client.0.smithi119.stderr: -180> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: secure 2024-09-12T17:40:51.963 INFO:tasks.workunit.client.0.smithi119.stderr: -179> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: crc 2024-09-12T17:40:51.963 INFO:tasks.workunit.client.0.smithi119.stderr: -178> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 AuthRegistry(0x55d4a2832060) adding con mode: secure 2024-09-12T17:40:51.963 INFO:tasks.workunit.client.0.smithi119.stderr: -177> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.963 INFO:tasks.workunit.client.0.smithi119.stderr: -176> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.963 INFO:tasks.workunit.client.0.smithi119.stderr: -175> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command rotate-key cmddesc rotate-key hook 0x55d4a28321a8 EEXIST 2024-09-12T17:40:51.963 INFO:tasks.workunit.client.0.smithi119.stderr: -174> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:40:51.963 INFO:tasks.workunit.client.0.smithi119.stderr: -173> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:40:51.963 INFO:tasks.workunit.client.0.smithi119.stderr: -172> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-b con 0x55d4a2851fd0 addr [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-12T17:40:51.964 INFO:tasks.workunit.client.0.smithi119.stderr: -171> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-a con 0x55d4a287e2a0 addr [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-12T17:40:51.964 INFO:tasks.workunit.client.0.smithi119.stderr: -170> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient(hunting): picked mon.noname-c con 0x55d4a287f830 addr [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] 2024-09-12T17:40:51.964 INFO:tasks.workunit.client.0.smithi119.stderr: -169> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.964 INFO:tasks.workunit.client.0.smithi119.stderr: -168> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.964 INFO:tasks.workunit.client.0.smithi119.stderr: -167> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:40:51.964 INFO:tasks.workunit.client.0.smithi119.stderr: -166> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:40:51.964 INFO:tasks.workunit.client.0.smithi119.stderr: -165> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient(hunting): authenticate will time out at 2819.781550s 2024-09-12T17:40:51.964 INFO:tasks.workunit.client.0.smithi119.stderr: -164> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient(hunting): get_auth_request con 0x55d4a287e2a0 auth_method 0 2024-09-12T17:40:51.964 INFO:tasks.workunit.client.0.smithi119.stderr: -163> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.964 INFO:tasks.workunit.client.0.smithi119.stderr: -162> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.964 INFO:tasks.workunit.client.0.smithi119.stderr: -161> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.964 INFO:tasks.workunit.client.0.smithi119.stderr: -160> 2024-09-12T17:40:51.746+0000 7f2f898b1640 10 monclient(hunting): get_auth_request con 0x55d4a287f830 auth_method 0 2024-09-12T17:40:51.964 INFO:tasks.workunit.client.0.smithi119.stderr: -159> 2024-09-12T17:40:51.746+0000 7f2f898b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:40:51.965 INFO:tasks.workunit.client.0.smithi119.stderr: -158> 2024-09-12T17:40:51.746+0000 7f2f898b1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:40:51.965 INFO:tasks.workunit.client.0.smithi119.stderr: -157> 2024-09-12T17:40:51.746+0000 7f2f898b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:40:51.965 INFO:tasks.workunit.client.0.smithi119.stderr: -156> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:51.965 INFO:tasks.workunit.client.0.smithi119.stderr: -155> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:51.965 INFO:tasks.workunit.client.0.smithi119.stderr: -154> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:51.965 INFO:tasks.workunit.client.0.smithi119.stderr: -153> 2024-09-12T17:40:51.746+0000 7f2f898b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:40:51.965 INFO:tasks.workunit.client.0.smithi119.stderr: -152> 2024-09-12T17:40:51.746+0000 7f2f898b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:40:51.965 INFO:tasks.workunit.client.0.smithi119.stderr: -151> 2024-09-12T17:40:51.746+0000 7f2f898b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:40:51.965 INFO:tasks.workunit.client.0.smithi119.stderr: -150> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient(hunting): handle_auth_done global_id 8382 payload 824 2024-09-12T17:40:51.965 INFO:tasks.workunit.client.0.smithi119.stderr: -149> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient: _finish_hunting 0 2024-09-12T17:40:51.965 INFO:tasks.workunit.client.0.smithi119.stderr: -148> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 1 monclient: found mon.noname-a 2024-09-12T17:40:51.965 INFO:tasks.workunit.client.0.smithi119.stderr: -147> 2024-09-12T17:40:51.746+0000 7f2f8a0b2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.119:3300/0 2024-09-12T17:40:51.965 INFO:tasks.workunit.client.0.smithi119.stderr: -146> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.965 INFO:tasks.workunit.client.0.smithi119.stderr: -145> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:40:51.966 INFO:tasks.workunit.client.0.smithi119.stderr: -144> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: dump: 2024-09-12T17:40:51.966 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.966 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.966 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.966 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.966 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.966 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.966 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.966 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.966 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.966 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.966 INFO:tasks.workunit.client.0.smithi119.stderr: -143> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: _finish_auth 0 2024-09-12T17:40:51.966 INFO:tasks.workunit.client.0.smithi119.stderr: -142> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:40:51.967 INFO:tasks.workunit.client.0.smithi119.stderr: -141> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:40:51.967 INFO:tasks.workunit.client.0.smithi119.stderr: -140> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:40:51.967 INFO:tasks.workunit.client.0.smithi119.stderr: -139> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:40:51.967 INFO:tasks.workunit.client.0.smithi119.stderr: -138> 2024-09-12T17:40:51.746+0000 7f2e5b7fe640 10 monclient: dump: 2024-09-12T17:40:51.967 INFO:tasks.workunit.client.0.smithi119.stderr:epoch 1 2024-09-12T17:40:51.967 INFO:tasks.workunit.client.0.smithi119.stderr:fsid 4b851e18-22ea-4fa8-b208-1609edc12f85 2024-09-12T17:40:51.967 INFO:tasks.workunit.client.0.smithi119.stderr:last_changed 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.967 INFO:tasks.workunit.client.0.smithi119.stderr:created 2024-09-12T17:09:17.564392+0000 2024-09-12T17:40:51.967 INFO:tasks.workunit.client.0.smithi119.stderr:min_mon_release 19 (squid) 2024-09-12T17:40:51.967 INFO:tasks.workunit.client.0.smithi119.stderr:election_strategy: 1 2024-09-12T17:40:51.967 INFO:tasks.workunit.client.0.smithi119.stderr:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-09-12T17:40:51.967 INFO:tasks.workunit.client.0.smithi119.stderr:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-12T17:40:51.967 INFO:tasks.workunit.client.0.smithi119.stderr:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T17:40:51.967 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.968 INFO:tasks.workunit.client.0.smithi119.stderr: -137> 2024-09-12T17:40:51.746+0000 7f2e6d7fa640 4 set_mon_vals no callback set 2024-09-12T17:40:51.968 INFO:tasks.workunit.client.0.smithi119.stderr: -136> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 monclient: authenticate success, global_id 8382 2024-09-12T17:40:51.968 INFO:tasks.workunit.client.0.smithi119.stderr: -135> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: _renew_subs 2024-09-12T17:40:51.968 INFO:tasks.workunit.client.0.smithi119.stderr: -134> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:40:51.968 INFO:tasks.workunit.client.0.smithi119.stderr: -133> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: _renew_subs 2024-09-12T17:40:51.968 INFO:tasks.workunit.client.0.smithi119.stderr: -132> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:40:51.968 INFO:tasks.workunit.client.0.smithi119.stderr: -131> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 1 librados: init done 2024-09-12T17:40:51.968 INFO:tasks.workunit.client.0.smithi119.stderr: -130> 2024-09-12T17:40:51.746+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command cr dump hook 0x55d4a288d698 2024-09-12T17:40:51.968 INFO:tasks.workunit.client.0.smithi119.stderr: -129> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.968 INFO:tasks.workunit.client.0.smithi119.stderr: -128> 2024-09-12T17:40:51.750+0000 7f2e5b7fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T17:40:51.968 INFO:tasks.workunit.client.0.smithi119.stderr: -127> 2024-09-12T17:40:51.750+0000 7f2e5b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:51.968 INFO:tasks.workunit.client.0.smithi119.stderr: -126> 2024-09-12T17:40:51.750+0000 7f2e5b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.194:6832/4256577502,v1:172.21.15.194:6833/4256577502] 2024-09-12T17:40:51.968 INFO:tasks.workunit.client.0.smithi119.stderr: -125> 2024-09-12T17:40:51.750+0000 7f2f890b0640 10 monclient: get_auth_request con 0x7f2e54070ae0 auth_method 0 2024-09-12T17:40:51.969 INFO:tasks.workunit.client.0.smithi119.stderr: -124> 2024-09-12T17:40:51.750+0000 7f2f898b1640 10 monclient: get_auth_request con 0x55d4a289f370 auth_method 0 2024-09-12T17:40:51.969 INFO:tasks.workunit.client.0.smithi119.stderr: -123> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.969 INFO:tasks.workunit.client.0.smithi119.stderr: -122> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 realm 2024-09-12T17:40:51.969 INFO:tasks.workunit.client.0.smithi119.stderr: -121> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.969 INFO:tasks.workunit.client.0.smithi119.stderr: -120> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.969 INFO:tasks.workunit.client.0.smithi119.stderr: -119> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:51.969 INFO:tasks.workunit.client.0.smithi119.stderr: -118> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.969 INFO:tasks.workunit.client.0.smithi119.stderr: -117> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.969 INFO:tasks.workunit.client.0.smithi119.stderr: -116> 2024-09-12T17:40:51.750+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.969 INFO:tasks.workunit.client.0.smithi119.stderr: -115> 2024-09-12T17:40:51.750+0000 7f2f890b0640 10 monclient: get_auth_request con 0x55d4a28a36f0 auth_method 0 2024-09-12T17:40:51.969 INFO:tasks.workunit.client.0.smithi119.stderr: -114> 2024-09-12T17:40:51.754+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:51.969 INFO:tasks.workunit.client.0.smithi119.stderr: -113> 2024-09-12T17:40:51.754+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.969 INFO:tasks.workunit.client.0.smithi119.stderr: -112> 2024-09-12T17:40:51.754+0000 7f2f8a0b2640 10 monclient: get_auth_request con 0x55d4a28a6e70 auth_method 0 2024-09-12T17:40:51.969 INFO:tasks.workunit.client.0.smithi119.stderr: -111> 2024-09-12T17:40:51.754+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:51.970 INFO:tasks.workunit.client.0.smithi119.stderr: -110> 2024-09-12T17:40:51.754+0000 7f2f8bdab9c0 20 searching for the correct realm 2024-09-12T17:40:51.970 INFO:tasks.workunit.client.0.smithi119.stderr: -109> 2024-09-12T17:40:51.754+0000 7f2f898b1640 10 monclient: get_auth_request con 0x55d4a28abbc0 auth_method 0 2024-09-12T17:40:51.970 INFO:tasks.workunit.client.0.smithi119.stderr: -108> 2024-09-12T17:40:51.754+0000 7f2f890b0640 10 monclient: get_auth_request con 0x7f2f8402e040 auth_method 0 2024-09-12T17:40:51.970 INFO:tasks.workunit.client.0.smithi119.stderr: -107> 2024-09-12T17:40:51.758+0000 7f2f8a0b2640 10 monclient: get_auth_request con 0x7f2f740bf020 auth_method 0 2024-09-12T17:40:51.970 INFO:tasks.workunit.client.0.smithi119.stderr: -106> 2024-09-12T17:40:51.758+0000 7f2f898b1640 0 -- 172.21.15.119:0/3747197001 >> [v2:172.21.15.119:6800/1732749810,v1:172.21.15.119:6801/1732749810] conn(0x55d4a28abbc0 msgr2=0x55d4a28ae080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:51.970 INFO:tasks.workunit.client.0.smithi119.stderr: -105> 2024-09-12T17:40:51.758+0000 7f2e5b7fe640 1 client.8382.objecter ms_handle_reset 0x55d4a28abbc0 session 0x55d4a28ab540 osd.3 2024-09-12T17:40:51.970 INFO:tasks.workunit.client.0.smithi119.stderr: -104> 2024-09-12T17:40:51.758+0000 7f2e5b7fe640 10 monclient: _renew_subs 2024-09-12T17:40:51.970 INFO:tasks.workunit.client.0.smithi119.stderr: -103> 2024-09-12T17:40:51.758+0000 7f2e5b7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.119:3300/0 2024-09-12T17:40:51.970 INFO:tasks.workunit.client.0.smithi119.stderr: -102> 2024-09-12T17:40:51.758+0000 7f2f898b1640 10 monclient: get_auth_request con 0x7f2e54081290 auth_method 0 2024-09-12T17:40:51.970 INFO:tasks.workunit.client.0.smithi119.stderr: -101> 2024-09-12T17:40:51.762+0000 7f2f898b1640 10 monclient: get_auth_request con 0x7f2f7c03d060 auth_method 0 2024-09-12T17:40:51.970 INFO:tasks.workunit.client.0.smithi119.stderr: -100> 2024-09-12T17:40:51.766+0000 7f2f890b0640 10 monclient: get_auth_request con 0x7f2f7c01a040 auth_method 0 2024-09-12T17:40:51.970 INFO:tasks.workunit.client.0.smithi119.stderr: -99> 2024-09-12T17:40:51.766+0000 7f2f890b0640 0 -- 172.21.15.119:0/3747197001 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f2f7c01a040 msgr2=0x7f2f7c063600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:51.970 INFO:tasks.workunit.client.0.smithi119.stderr: -98> 2024-09-12T17:40:51.766+0000 7f2e5b7fe640 1 client.8382.objecter ms_handle_reset 0x7f2f7c01a040 session 0x7f2f7c03ef00 osd.0 2024-09-12T17:40:51.971 INFO:tasks.workunit.client.0.smithi119.stderr: -97> 2024-09-12T17:40:51.766+0000 7f2f890b0640 10 monclient: get_auth_request con 0x55d4a28abbc0 auth_method 0 2024-09-12T17:40:51.971 INFO:tasks.workunit.client.0.smithi119.stderr: -96> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:40:51.971 INFO:tasks.workunit.client.0.smithi119.stderr: -95> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:40:51.971 INFO:tasks.workunit.client.0.smithi119.stderr: -94> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:51.971 INFO:tasks.workunit.client.0.smithi119.stderr: -93> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:51.971 INFO:tasks.workunit.client.0.smithi119.stderr: -92> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:51.971 INFO:tasks.workunit.client.0.smithi119.stderr: -91> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:51.971 INFO:tasks.workunit.client.0.smithi119.stderr: -90> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.971 INFO:tasks.workunit.client.0.smithi119.stderr: -89> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.971 INFO:tasks.workunit.client.0.smithi119.stderr: -88> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.971 INFO:tasks.workunit.client.0.smithi119.stderr: -87> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:51.971 INFO:tasks.workunit.client.0.smithi119.stderr: -86> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.971 INFO:tasks.workunit.client.0.smithi119.stderr: -85> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:51.971 INFO:tasks.workunit.client.0.smithi119.stderr: -84> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 zone default found 2024-09-12T17:40:51.972 INFO:tasks.workunit.client.0.smithi119.stderr: -83> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 4 Realm: () 2024-09-12T17:40:51.972 INFO:tasks.workunit.client.0.smithi119.stderr: -82> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:40:51.972 INFO:tasks.workunit.client.0.smithi119.stderr: -81> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:40:51.972 INFO:tasks.workunit.client.0.smithi119.stderr: -80> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:51.972 INFO:tasks.workunit.client.0.smithi119.stderr: -79> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 zonegroup default 2024-09-12T17:40:51.972 INFO:tasks.workunit.client.0.smithi119.stderr: -78> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.972 INFO:tasks.workunit.client.0.smithi119.stderr: -77> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.972 INFO:tasks.workunit.client.0.smithi119.stderr: -76> 2024-09-12T17:40:51.774+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.972 INFO:tasks.workunit.client.0.smithi119.stderr: -75> 2024-09-12T17:40:51.778+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.972 INFO:tasks.workunit.client.0.smithi119.stderr: -74> 2024-09-12T17:40:51.778+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.972 INFO:tasks.workunit.client.0.smithi119.stderr: -73> 2024-09-12T17:40:51.778+0000 7f2f8bdab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.972 INFO:tasks.workunit.client.0.smithi119.stderr: -72> 2024-09-12T17:40:51.778+0000 7f2f8bdab9c0 20 started sync module instance, tier type = 2024-09-12T17:40:51.972 INFO:tasks.workunit.client.0.smithi119.stderr: -71> 2024-09-12T17:40:51.778+0000 7f2f8bdab9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:40:51.973 INFO:tasks.workunit.client.0.smithi119.stderr: -70> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=0 2024-09-12T17:40:51.973 INFO:tasks.workunit.client.0.smithi119.stderr: -69> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=1 2024-09-12T17:40:51.973 INFO:tasks.workunit.client.0.smithi119.stderr: -68> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=2 2024-09-12T17:40:51.973 INFO:tasks.workunit.client.0.smithi119.stderr: -67> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=3 2024-09-12T17:40:51.973 INFO:tasks.workunit.client.0.smithi119.stderr: -66> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=4 2024-09-12T17:40:51.973 INFO:tasks.workunit.client.0.smithi119.stderr: -65> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=5 2024-09-12T17:40:51.973 INFO:tasks.workunit.client.0.smithi119.stderr: -64> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=6 2024-09-12T17:40:51.973 INFO:tasks.workunit.client.0.smithi119.stderr: -63> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 20 add_watcher() i=7 2024-09-12T17:40:51.973 INFO:tasks.workunit.client.0.smithi119.stderr: -62> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:51.973 INFO:tasks.workunit.client.0.smithi119.stderr: -61> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding auth protocol: cephx 2024-09-12T17:40:51.973 INFO:tasks.workunit.client.0.smithi119.stderr: -60> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding auth protocol: cephx 2024-09-12T17:40:51.973 INFO:tasks.workunit.client.0.smithi119.stderr: -59> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding auth protocol: cephx 2024-09-12T17:40:51.973 INFO:tasks.workunit.client.0.smithi119.stderr: -58> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: secure 2024-09-12T17:40:51.974 INFO:tasks.workunit.client.0.smithi119.stderr: -57> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: crc 2024-09-12T17:40:51.974 INFO:tasks.workunit.client.0.smithi119.stderr: -56> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: secure 2024-09-12T17:40:51.974 INFO:tasks.workunit.client.0.smithi119.stderr: -55> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: crc 2024-09-12T17:40:51.974 INFO:tasks.workunit.client.0.smithi119.stderr: -54> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: secure 2024-09-12T17:40:51.974 INFO:tasks.workunit.client.0.smithi119.stderr: -53> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: crc 2024-09-12T17:40:51.974 INFO:tasks.workunit.client.0.smithi119.stderr: -52> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: crc 2024-09-12T17:40:51.974 INFO:tasks.workunit.client.0.smithi119.stderr: -51> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: secure 2024-09-12T17:40:51.974 INFO:tasks.workunit.client.0.smithi119.stderr: -50> 2024-09-12T17:40:51.794+0000 7f2e3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:51.974 INFO:tasks.workunit.client.0.smithi119.stderr: -49> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: crc 2024-09-12T17:40:51.974 INFO:tasks.workunit.client.0.smithi119.stderr: -48> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: secure 2024-09-12T17:40:51.974 INFO:tasks.workunit.client.0.smithi119.stderr: -47> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: crc 2024-09-12T17:40:51.974 INFO:tasks.workunit.client.0.smithi119.stderr: -46> 2024-09-12T17:40:51.794+0000 7f2f8bdab9c0 5 AuthRegistry(0x7fff18c6ebe0) adding con mode: secure 2024-09-12T17:40:51.974 INFO:tasks.workunit.client.0.smithi119.stderr: -45> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:40:51.974 INFO:tasks.workunit.client.0.smithi119.stderr: -44> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:51.975 INFO:tasks.workunit.client.0.smithi119.stderr: -43> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:51.975 INFO:tasks.workunit.client.0.smithi119.stderr: -42> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command cache list hook 0x55d4a287a760 2024-09-12T17:40:51.975 INFO:tasks.workunit.client.0.smithi119.stderr: -41> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command cache inspect hook 0x55d4a287a760 2024-09-12T17:40:51.975 INFO:tasks.workunit.client.0.smithi119.stderr: -40> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command cache erase hook 0x55d4a287a760 2024-09-12T17:40:51.975 INFO:tasks.workunit.client.0.smithi119.stderr: -39> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command cache zap hook 0x55d4a287a760 2024-09-12T17:40:51.975 INFO:tasks.workunit.client.0.smithi119.stderr: -38> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 note: GC not initialized 2024-09-12T17:40:51.975 INFO:tasks.workunit.client.0.smithi119.stderr: -37> 2024-09-12T17:40:51.798+0000 7f2e3a7fc640 20 reqs_thread_entry: start 2024-09-12T17:40:51.975 INFO:tasks.workunit.client.0.smithi119.stderr: -36> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command sync trace show hook 0x7f2f7c002f20 2024-09-12T17:40:51.975 INFO:tasks.workunit.client.0.smithi119.stderr: -35> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command sync trace history hook 0x7f2f7c002f20 2024-09-12T17:40:51.975 INFO:tasks.workunit.client.0.smithi119.stderr: -34> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command sync trace active hook 0x7f2f7c002f20 2024-09-12T17:40:51.975 INFO:tasks.workunit.client.0.smithi119.stderr: -33> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 5 asok(0x55d4a25a62b0) register_command sync trace active_short hook 0x7f2f7c002f20 2024-09-12T17:40:51.975 INFO:tasks.workunit.client.0.smithi119.stderr: -32> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:40:51.975 INFO:tasks.workunit.client.0.smithi119.stderr: -31> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 Filter name: none 2024-09-12T17:40:51.976 INFO:tasks.workunit.client.0.smithi119.stderr: -30> 2024-09-12T17:40:51.798+0000 7f2dabfff640 20 reqs_thread_entry: start 2024-09-12T17:40:51.976 INFO:tasks.workunit.client.0.smithi119.stderr: -29> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:40:51.976 INFO:tasks.workunit.client.0.smithi119.stderr: -28> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.976 INFO:tasks.workunit.client.0.smithi119.stderr: -27> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:51.976 INFO:tasks.workunit.client.0.smithi119.stderr: -26> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:40:51.976 INFO:tasks.workunit.client.0.smithi119.stderr: -25> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:40:51.976 INFO:tasks.workunit.client.0.smithi119.stderr: -24> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:40:51.976 INFO:tasks.workunit.client.0.smithi119.stderr: -23> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.976 INFO:tasks.workunit.client.0.smithi119.stderr: -22> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:40:51.976 INFO:tasks.workunit.client.0.smithi119.stderr: -21> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:51.976 INFO:tasks.workunit.client.0.smithi119.stderr: -20> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:51.976 INFO:tasks.workunit.client.0.smithi119.stderr: -19> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:51.976 INFO:tasks.workunit.client.0.smithi119.stderr: -18> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:51.977 INFO:tasks.workunit.client.0.smithi119.stderr: -17> 2024-09-12T17:40:51.798+0000 7f2f8bdab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:40:51.977 INFO:tasks.workunit.client.0.smithi119.stderr: -16> 2024-09-12T17:40:51.802+0000 7f2f8bdab9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:40:51.977 INFO:tasks.workunit.client.0.smithi119.stderr: -15> 2024-09-12T17:40:51.818+0000 7f2f8bdab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:51.977 INFO:tasks.workunit.client.0.smithi119.stderr: -14> 2024-09-12T17:40:51.818+0000 7f2f8bdab9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:51.977 INFO:tasks.workunit.client.0.smithi119.stderr: -13> 2024-09-12T17:40:51.818+0000 7f2f8bdab9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:51.977 INFO:tasks.workunit.client.0.smithi119.stderr: -12> 2024-09-12T17:40:51.818+0000 7f2f8bdab9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:40:51.977 INFO:tasks.workunit.client.0.smithi119.stderr: -11> 2024-09-12T17:40:51.818+0000 7f2e6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333539 cookie 94371748437184 notifier 8382 bl.length()=911 2024-09-12T17:40:51.977 INFO:tasks.workunit.client.0.smithi119.stderr: -10> 2024-09-12T17:40:51.818+0000 7f2e6d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:51.977 INFO:tasks.workunit.client.0.smithi119.stderr: -9> 2024-09-12T17:40:51.818+0000 7f2e6d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:51.977 INFO:tasks.workunit.client.0.smithi119.stderr: -8> 2024-09-12T17:40:51.818+0000 7f2e6d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:51.977 INFO:tasks.workunit.client.0.smithi119.stderr: -7> 2024-09-12T17:40:51.822+0000 7f2f8bdab9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:40:51.977 INFO:tasks.workunit.client.0.smithi119.stderr: -6> 2024-09-12T17:40:51.822+0000 7f2f8bdab9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:40:51.978 INFO:tasks.workunit.client.0.smithi119.stderr: -5> 2024-09-12T17:40:51.822+0000 7f2f8bdab9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:40:51.978 INFO:tasks.workunit.client.0.smithi119.stderr: -4> 2024-09-12T17:40:51.822+0000 7f2f8bdab9c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:40:51.978 INFO:tasks.workunit.client.0.smithi119.stderr: -3> 2024-09-12T17:40:51.826+0000 7f2e5b7fe640 1 client.8382.objecter ms_handle_reset 0x55d4a28a36f0 session 0x55d4a28a25a0 osd.5 2024-09-12T17:40:51.978 INFO:tasks.workunit.client.0.smithi119.stderr: -2> 2024-09-12T17:40:51.826+0000 7f2f890b0640 10 monclient: get_auth_request con 0x7f2f7c01a040 auth_method 0 2024-09-12T17:40:51.978 INFO:tasks.workunit.client.0.smithi119.stderr: -1> 2024-09-12T17:40:51.834+0000 7f2f8bdab9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2f8bdab9c0 time 2024-09-12T17:40:51.840031+0000 2024-09-12T17:40:51.978 INFO:tasks.workunit.client.0.smithi119.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:40:51.978 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.978 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:51.978 INFO:tasks.workunit.client.0.smithi119.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2f8f6852eb] 2024-09-12T17:40:51.978 INFO:tasks.workunit.client.0.smithi119.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2f8f68549f] 2024-09-12T17:40:51.978 INFO:tasks.workunit.client.0.smithi119.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d49f8840c1] 2024-09-12T17:40:51.978 INFO:tasks.workunit.client.0.smithi119.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d49f8961fa] 2024-09-12T17:40:51.978 INFO:tasks.workunit.client.0.smithi119.stderr: 5: main() 2024-09-12T17:40:51.979 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2f8e4ebd90] 2024-09-12T17:40:51.979 INFO:tasks.workunit.client.0.smithi119.stderr: 7: __libc_start_main() 2024-09-12T17:40:51.979 INFO:tasks.workunit.client.0.smithi119.stderr: 8: _start() 2024-09-12T17:40:51.979 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.979 INFO:tasks.workunit.client.0.smithi119.stderr: 0> 2024-09-12T17:40:51.838+0000 7f2f8bdab9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:40:51.979 INFO:tasks.workunit.client.0.smithi119.stderr: in thread 7f2f8bdab9c0 thread_name:radosgw-admin 2024-09-12T17:40:51.979 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.979 INFO:tasks.workunit.client.0.smithi119.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:40:51.979 INFO:tasks.workunit.client.0.smithi119.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2f8e504520] 2024-09-12T17:40:51.979 INFO:tasks.workunit.client.0.smithi119.stderr: 2: pthread_kill() 2024-09-12T17:40:51.979 INFO:tasks.workunit.client.0.smithi119.stderr: 3: raise() 2024-09-12T17:40:51.979 INFO:tasks.workunit.client.0.smithi119.stderr: 4: abort() 2024-09-12T17:40:51.980 INFO:tasks.workunit.client.0.smithi119.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2f8f685345] 2024-09-12T17:40:51.980 INFO:tasks.workunit.client.0.smithi119.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2f8f68549f] 2024-09-12T17:40:51.980 INFO:tasks.workunit.client.0.smithi119.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d49f8840c1] 2024-09-12T17:40:51.980 INFO:tasks.workunit.client.0.smithi119.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d49f8961fa] 2024-09-12T17:40:51.980 INFO:tasks.workunit.client.0.smithi119.stderr: 9: main() 2024-09-12T17:40:51.980 INFO:tasks.workunit.client.0.smithi119.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2f8e4ebd90] 2024-09-12T17:40:51.980 INFO:tasks.workunit.client.0.smithi119.stderr: 11: __libc_start_main() 2024-09-12T17:40:51.980 INFO:tasks.workunit.client.0.smithi119.stderr: 12: _start() 2024-09-12T17:40:51.980 INFO:tasks.workunit.client.0.smithi119.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:40:51.980 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:40:51.980 INFO:tasks.workunit.client.0.smithi119.stderr:--- logging levels --- 2024-09-12T17:40:51.980 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 none 2024-09-12T17:40:51.980 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 lockdep 2024-09-12T17:40:51.981 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 context 2024-09-12T17:40:51.981 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 crush 2024-09-12T17:40:51.981 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds 2024-09-12T17:40:51.981 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_balancer 2024-09-12T17:40:51.981 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_locker 2024-09-12T17:40:51.981 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log 2024-09-12T17:40:51.981 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_log_expire 2024-09-12T17:40:51.981 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mds_migrator 2024-09-12T17:40:51.981 INFO:tasks.workunit.client.0.smithi119.stderr: 3/ 5 mds_quiesce 2024-09-12T17:40:51.981 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 buffer 2024-09-12T17:40:51.981 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 timer 2024-09-12T17:40:51.981 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 filer 2024-09-12T17:40:51.981 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 striper 2024-09-12T17:40:51.982 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 1 objecter 2024-09-12T17:40:51.982 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rados 2024-09-12T17:40:51.982 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd 2024-09-12T17:40:51.982 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_mirror 2024-09-12T17:40:51.982 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_replay 2024-09-12T17:40:51.982 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 rbd_pwl 2024-09-12T17:40:51.982 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 journaler 2024-09-12T17:40:51.982 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objectcacher 2024-09-12T17:40:51.982 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:40:51.982 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 client 2024-09-12T17:40:51.982 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 osd 2024-09-12T17:40:51.982 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 optracker 2024-09-12T17:40:51.982 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 objclass 2024-09-12T17:40:51.983 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 filestore 2024-09-12T17:40:51.983 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 journal 2024-09-12T17:40:51.983 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 ms 2024-09-12T17:40:51.983 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mon 2024-09-12T17:40:51.983 INFO:tasks.workunit.client.0.smithi119.stderr: 0/10 monc 2024-09-12T17:40:51.983 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 paxos 2024-09-12T17:40:51.983 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 tp 2024-09-12T17:40:51.983 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 auth 2024-09-12T17:40:51.983 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 crypto 2024-09-12T17:40:51.983 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 finisher 2024-09-12T17:40:51.983 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 reserver 2024-09-12T17:40:51.983 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 heartbeatmap 2024-09-12T17:40:51.983 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 perfcounter 2024-09-12T17:40:51.983 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw 2024-09-12T17:40:51.984 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_sync 2024-09-12T17:40:51.984 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_datacache 2024-09-12T17:40:51.984 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_access 2024-09-12T17:40:51.984 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:40:51.984 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_flight 2024-09-12T17:40:51.984 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:40:51.984 INFO:tasks.workunit.client.0.smithi119.stderr: 20/20 rgw_notification 2024-09-12T17:40:51.984 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 javaclient 2024-09-12T17:40:51.984 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 asok 2024-09-12T17:40:51.984 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 1 throttle 2024-09-12T17:40:51.984 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 0 refs 2024-09-12T17:40:51.984 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 compressor 2024-09-12T17:40:51.984 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluestore 2024-09-12T17:40:51.984 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 bluefs 2024-09-12T17:40:51.985 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 3 bdev 2024-09-12T17:40:51.985 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 kstore 2024-09-12T17:40:51.985 INFO:tasks.workunit.client.0.smithi119.stderr: 4/ 5 rocksdb 2024-09-12T17:40:51.985 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 fuse 2024-09-12T17:40:51.985 INFO:tasks.workunit.client.0.smithi119.stderr: 2/ 5 mgr 2024-09-12T17:40:51.985 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mgrc 2024-09-12T17:40:51.985 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 dpdk 2024-09-12T17:40:51.985 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 eventtrace 2024-09-12T17:40:51.985 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 prioritycache 2024-09-12T17:40:51.985 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 test 2024-09-12T17:40:51.985 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:40:51.985 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cephsqlite 2024-09-12T17:40:51.985 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:40:51.986 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore 2024-09-12T17:40:51.986 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_onode 2024-09-12T17:40:51.986 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_odata 2024-09-12T17:40:51.986 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_omap 2024-09-12T17:40:51.986 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_tm 2024-09-12T17:40:51.986 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_t 2024-09-12T17:40:51.986 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:40:51.986 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_epm 2024-09-12T17:40:51.986 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_lba 2024-09-12T17:40:51.986 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:40:51.986 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_cache 2024-09-12T17:40:51.986 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_journal 2024-09-12T17:40:51.986 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_device 2024-09-12T17:40:51.986 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 seastore_backref 2024-09-12T17:40:51.987 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 alienstore 2024-09-12T17:40:51.987 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 mclock 2024-09-12T17:40:51.987 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 cyanstore 2024-09-12T17:40:51.987 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 ceph_exporter 2024-09-12T17:40:51.987 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 memstore 2024-09-12T17:40:51.987 INFO:tasks.workunit.client.0.smithi119.stderr: 1/ 5 trace 2024-09-12T17:40:51.987 INFO:tasks.workunit.client.0.smithi119.stderr: 0/ 5 ceph_dedup 2024-09-12T17:40:51.987 INFO:tasks.workunit.client.0.smithi119.stderr: -2/-2 (syslog threshold) 2024-09-12T17:40:51.987 INFO:tasks.workunit.client.0.smithi119.stderr: 99/99 (stderr threshold) 2024-09-12T17:40:51.987 INFO:tasks.workunit.client.0.smithi119.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:40:51.987 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2dabfff640 / http_manager 2024-09-12T17:40:51.988 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2e3a7fc640 / http_manager 2024-09-12T17:40:51.988 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2e3b7fe640 / rgw_dt_lg_renew 2024-09-12T17:40:51.988 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2e5b7fe640 / ms_dispatch 2024-09-12T17:40:51.988 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2e6d7fa640 / io_context_pool 2024-09-12T17:40:51.988 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2e6f7fe640 / ms_dispatch 2024-09-12T17:40:51.988 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2e76604640 / ms_dispatch 2024-09-12T17:40:51.988 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2e77e07640 / io_context_pool 2024-09-12T17:40:51.988 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2f890b0640 / msgr-worker-2 2024-09-12T17:40:51.988 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2f898b1640 / msgr-worker-1 2024-09-12T17:40:51.988 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2f8a0b2640 / msgr-worker-0 2024-09-12T17:40:51.988 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2f8a8b3640 / io_context_pool 2024-09-12T17:40:51.989 INFO:tasks.workunit.client.0.smithi119.stderr: 7f2f8bdab9c0 / radosgw-admin 2024-09-12T17:40:51.989 INFO:tasks.workunit.client.0.smithi119.stderr: max_recent 500 2024-09-12T17:40:51.989 INFO:tasks.workunit.client.0.smithi119.stderr: max_new 1000 2024-09-12T17:40:51.989 INFO:tasks.workunit.client.0.smithi119.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:40:51.842051Z_b3609cf6-5cd2-49b5-a665-24993202e1dc/log 2024-09-12T17:40:51.989 INFO:tasks.workunit.client.0.smithi119.stderr:--- end dump of recent events --- 2024-09-12T17:40:51.989 INFO:tasks.workunit.client.0.smithi119.stderr:Aborted 2024-09-12T17:40:51.989 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:40:51.990 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:51.991 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:51.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.918+0000 7ffa367a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.922+0000 7ffa367a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.922+0000 7ffa367a19c0 20 realm 2024-09-12T17:40:51.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.922+0000 7ffa367a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.922+0000 7ffa367a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.922+0000 7ffa367a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:51.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.922+0000 7ffa367a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.922+0000 7ffa367a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:51.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.922+0000 7ffa367a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.991 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.922+0000 7ffa367a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:51.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.922+0000 7ffa367a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:51.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.922+0000 7ffa367a19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:51.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.922+0000 7ffa367a19c0 20 searching for the correct realm 2024-09-12T17:40:51.992 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:51.926+0000 7ffa33aa6640 0 -- 172.21.15.119:0/1184553082 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7ffa24108600 msgr2=0x7ffa240bd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:52.144 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.142+0000 7ffa34aa8640 0 -- 172.21.15.119:0/1184553082 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7ffa1c003100 msgr2=0x7ffa2804b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:52.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.158+0000 7ffa367a19c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:40:52.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.158+0000 7ffa367a19c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:40:52.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.158+0000 7ffa367a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:52.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.158+0000 7ffa367a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:52.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.158+0000 7ffa367a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:52.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.158+0000 7ffa367a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:52.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.158+0000 7ffa367a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.158+0000 7ffa367a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.158+0000 7ffa367a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.162+0000 7ffa367a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:52.164 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.162+0000 7ffa367a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.162+0000 7ffa367a19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:52.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.162+0000 7ffa367a19c0 20 zone default found 2024-09-12T17:40:52.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.162+0000 7ffa367a19c0 4 Realm: () 2024-09-12T17:40:52.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.162+0000 7ffa367a19c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:40:52.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.162+0000 7ffa367a19c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:40:52.165 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.162+0000 7ffa367a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:52.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.162+0000 7ffa367a19c0 20 zonegroup default 2024-09-12T17:40:52.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.162+0000 7ffa367a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.162+0000 7ffa367a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.162+0000 7ffa367a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.166 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.162+0000 7ffa367a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.167 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.162+0000 7ffa367a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.167 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.166+0000 7ffa367a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.166+0000 7ffa367a19c0 20 started sync module instance, tier type = 2024-09-12T17:40:52.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.166+0000 7ffa367a19c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.186+0000 7ffa367a19c0 20 add_watcher() i=0 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.186+0000 7ffa367a19c0 20 add_watcher() i=1 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.186+0000 7ffa367a19c0 20 add_watcher() i=2 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.186+0000 7ffa367a19c0 20 add_watcher() i=3 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.186+0000 7ffa367a19c0 20 add_watcher() i=4 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.186+0000 7ffa367a19c0 20 add_watcher() i=5 2024-09-12T17:40:52.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.186+0000 7ffa367a19c0 20 add_watcher() i=6 2024-09-12T17:40:52.190 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.186+0000 7ffa367a19c0 20 add_watcher() i=7 2024-09-12T17:40:52.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.186+0000 7ffa367a19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:52.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.190+0000 7ff8eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.190+0000 7ffa367a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.190+0000 7ffa367a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:52.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.190+0000 7ffa367a19c0 5 note: GC not initialized 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.194+0000 7ff8e9fdb640 20 reqs_thread_entry: start 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.194+0000 7ffa367a19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.194+0000 7ffa367a19c0 20 Filter name: none 2024-09-12T17:40:52.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.194+0000 7ff85b7fe640 20 reqs_thread_entry: start 2024-09-12T17:40:52.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.194+0000 7ffa367a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.194+0000 7ffa367a19c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:52.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.194+0000 7ffa367a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.194+0000 7ffa367a19c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.194+0000 7ffa367a19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:52.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.194+0000 7ffa367a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.194+0000 7ffa367a19c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.194+0000 7ffa367a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.198+0000 7ffa367a19c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:40:52.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.198+0000 7ffa367a19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:40:52.203 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.198+0000 7ff8eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:52.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.206+0000 7ffa367a19c0 20 remove_watcher() i=0 2024-09-12T17:40:52.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.206+0000 7ffa367a19c0 2 removed watcher, disabling cache 2024-09-12T17:40:52.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.206+0000 7ffa367a19c0 20 remove_watcher() i=1 2024-09-12T17:40:52.212 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.210+0000 7ffa367a19c0 20 remove_watcher() i=2 2024-09-12T17:40:52.214 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.210+0000 7ffa367a19c0 20 remove_watcher() i=3 2024-09-12T17:40:52.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.214+0000 7ffa367a19c0 20 remove_watcher() i=4 2024-09-12T17:40:52.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.214+0000 7ffa367a19c0 20 remove_watcher() i=5 2024-09-12T17:40:52.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.214+0000 7ffa367a19c0 20 remove_watcher() i=6 2024-09-12T17:40:52.220 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.218+0000 7ffa367a19c0 20 remove_watcher() i=7 2024-09-12T17:40:52.286 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:40:52.317 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:52.317 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:52.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.362+0000 7f80b06159c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.362+0000 7f80b06159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.362+0000 7f80b06159c0 20 realm 2024-09-12T17:40:52.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.362+0000 7f80b06159c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.362+0000 7f80b06159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.362+0000 7f80b06159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:40:52.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.362+0000 7f80b06159c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.362+0000 7f80b06159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.362+0000 7f80b06159c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.366+0000 7f80b06159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:52.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.366+0000 7f80b06159c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.369 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.366+0000 7f80b06159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:40:52.369 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.366+0000 7f80b06159c0 20 searching for the correct realm 2024-09-12T17:40:52.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.370+0000 7f80ae11b640 0 -- 172.21.15.119:0/3684242200 >> [v2:172.21.15.119:6816/4034469375,v1:172.21.15.119:6818/4034469375] conn(0x555b887c5080 msgr2=0x555b887c7520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:40:52.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.378+0000 7f80ad91a640 0 -- 172.21.15.119:0/3684242200 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f80a806b140 msgr2=0x7f80a8090a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:40:52.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:40:52.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:40:52.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:40:52.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:40:52.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:40:52.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:40:52.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:40:52.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:40:52.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 zone default found 2024-09-12T17:40:52.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 4 Realm: () 2024-09-12T17:40:52.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:40:52.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:40:52.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:40:52.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 zonegroup default 2024-09-12T17:40:52.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.386+0000 7f80b06159c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.390+0000 7f80b06159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:40:52.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.390+0000 7f80b06159c0 20 started sync module instance, tier type = 2024-09-12T17:40:52.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.390+0000 7f80b06159c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:40:52.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.402+0000 7f80b06159c0 20 add_watcher() i=0 2024-09-12T17:40:52.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.402+0000 7f80b06159c0 20 add_watcher() i=1 2024-09-12T17:40:52.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.402+0000 7f80b06159c0 20 add_watcher() i=2 2024-09-12T17:40:52.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.402+0000 7f80b06159c0 20 add_watcher() i=3 2024-09-12T17:40:52.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.402+0000 7f80b06159c0 20 add_watcher() i=4 2024-09-12T17:40:52.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.402+0000 7f80b06159c0 20 add_watcher() i=5 2024-09-12T17:40:52.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.402+0000 7f80b06159c0 20 add_watcher() i=6 2024-09-12T17:40:52.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.402+0000 7f80b06159c0 20 add_watcher() i=7 2024-09-12T17:40:52.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.402+0000 7f80b06159c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:40:52.409 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.406+0000 7f7f64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:52.410 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.406+0000 7f80b06159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:40:52.410 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.406+0000 7f80b06159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:40:52.410 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.406+0000 7f80b06159c0 5 note: GC not initialized 2024-09-12T17:40:52.410 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.406+0000 7f7edf7fe640 20 reqs_thread_entry: start 2024-09-12T17:40:52.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.406+0000 7f80b06159c0 20 init_complete bucket index max shards: 11 2024-09-12T17:40:52.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.406+0000 7f80b06159c0 20 Filter name: none 2024-09-12T17:40:52.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.406+0000 7f7edd7fa640 20 reqs_thread_entry: start 2024-09-12T17:40:52.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.406+0000 7f80b06159c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:40:52.411 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.406+0000 7f80b06159c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:40:52.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:40:52.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:40:52.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:40:52.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 20 rados->read ofs=0 len=0 2024-09-12T17:40:52.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:40:52.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:40:52.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:40:52.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:40:52.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:40:52.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:40:52.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:40:52.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:40:52.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:40:52.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:40:52.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:40:52.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:40:52.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:40:52.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:40:52.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:40:52.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:40:52.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:40:52.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.410+0000 7f80b06159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:40:52.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.414+0000 7f80b06159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:40:52.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.414+0000 7f80b06159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:40:52.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.414+0000 7f80b06159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:40:52.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.414+0000 7f80b06159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:40:52.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.414+0000 7f80b06159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:40:52.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.414+0000 7f80b06159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:40:52.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.414+0000 7f80b06159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:40:52.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.414+0000 7f80b06159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:40:52.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.414+0000 7f80b06159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:40:52.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.414+0000 7f80b06159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:40:52.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.414+0000 7f80b06159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:40:52.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.414+0000 7f80b06159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:40:52.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.414+0000 7f80b06159c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:40:52.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.414+0000 7f80b06159c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:40:52.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.418+0000 7f7f64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:40:52.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.422+0000 7f80b06159c0 20 remove_watcher() i=0 2024-09-12T17:40:52.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.422+0000 7f80b06159c0 2 removed watcher, disabling cache 2024-09-12T17:40:52.427 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.426+0000 7f80b06159c0 20 remove_watcher() i=1 2024-09-12T17:40:52.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.426+0000 7f80b06159c0 20 remove_watcher() i=2 2024-09-12T17:40:52.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.430+0000 7f80b06159c0 20 remove_watcher() i=3 2024-09-12T17:40:52.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.430+0000 7f80b06159c0 20 remove_watcher() i=4 2024-09-12T17:40:52.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.430+0000 7f80b06159c0 20 remove_watcher() i=5 2024-09-12T17:40:52.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.434+0000 7f80b06159c0 20 remove_watcher() i=6 2024-09-12T17:40:52.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:40:52.434+0000 7f80b06159c0 20 remove_watcher() i=7 2024-09-12T17:41:22.481 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T17:41:22.514 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:22.515 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:22.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.557+0000 7fe286dc59c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:22.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.561+0000 7fe286dc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:22.563 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.561+0000 7fe286dc59c0 20 realm 2024-09-12T17:41:22.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.561+0000 7fe286dc59c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:22.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.561+0000 7fe286dc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:22.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.561+0000 7fe286dc59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:22.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.561+0000 7fe286dc59c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:22.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.561+0000 7fe286dc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:22.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.561+0000 7fe286dc59c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:22.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.561+0000 7fe286dc59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:22.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.561+0000 7fe286dc59c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:22.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.565+0000 7fe286dc59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:22.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.565+0000 7fe286dc59c0 20 searching for the correct realm 2024-09-12T17:41:22.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.565+0000 7fe2850cc640 0 -- 172.21.15.119:0/3376121943 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fe26c043060 msgr2=0x7fe26c081120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:22.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.781+0000 7fe27c0ca640 0 -- 172.21.15.119:0/3376121943 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fe2800e4420 msgr2=0x7fe2800e48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:23.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.997+0000 7fe286dc59c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:23.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.997+0000 7fe286dc59c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:23.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.997+0000 7fe286dc59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:23.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.997+0000 7fe286dc59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:23.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.997+0000 7fe286dc59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:23.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.997+0000 7fe286dc59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:23.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.997+0000 7fe286dc59c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.997+0000 7fe286dc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:22.997+0000 7fe286dc59c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.001+0000 7fe286dc59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:23.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.001+0000 7fe286dc59c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.001+0000 7fe286dc59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:23.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.001+0000 7fe286dc59c0 20 zone default found 2024-09-12T17:41:23.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.001+0000 7fe286dc59c0 4 Realm: () 2024-09-12T17:41:23.005 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.001+0000 7fe286dc59c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:23.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.001+0000 7fe286dc59c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:23.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.001+0000 7fe286dc59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:23.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.001+0000 7fe286dc59c0 20 zonegroup default 2024-09-12T17:41:23.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.001+0000 7fe286dc59c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.001+0000 7fe286dc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.006 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.001+0000 7fe286dc59c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.001+0000 7fe286dc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.001+0000 7fe286dc59c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.005+0000 7fe286dc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.005+0000 7fe286dc59c0 20 started sync module instance, tier type = 2024-09-12T17:41:23.008 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.005+0000 7fe286dc59c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:23.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.025+0000 7fe286dc59c0 20 add_watcher() i=0 2024-09-12T17:41:23.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.025+0000 7fe286dc59c0 20 add_watcher() i=1 2024-09-12T17:41:23.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.025+0000 7fe286dc59c0 20 add_watcher() i=2 2024-09-12T17:41:23.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.025+0000 7fe286dc59c0 20 add_watcher() i=3 2024-09-12T17:41:23.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.025+0000 7fe286dc59c0 20 add_watcher() i=4 2024-09-12T17:41:23.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.025+0000 7fe286dc59c0 20 add_watcher() i=5 2024-09-12T17:41:23.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.029+0000 7fe286dc59c0 20 add_watcher() i=6 2024-09-12T17:41:23.033 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.029+0000 7fe286dc59c0 20 add_watcher() i=7 2024-09-12T17:41:23.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.029+0000 7fe286dc59c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:23.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.033+0000 7fe13afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:23.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.033+0000 7fe286dc59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:23.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.033+0000 7fe286dc59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:23.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.033+0000 7fe286dc59c0 5 note: GC not initialized 2024-09-12T17:41:23.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe139fe3640 20 reqs_thread_entry: start 2024-09-12T17:41:23.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe286dc59c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:23.040 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe286dc59c0 20 Filter name: none 2024-09-12T17:41:23.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe0ab7fe640 20 reqs_thread_entry: start 2024-09-12T17:41:23.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe286dc59c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:41:23.041 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe286dc59c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe286dc59c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:23.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe286dc59c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:41:23.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe286dc59c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:41:23.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe286dc59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:41:23.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe286dc59c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.042 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe286dc59c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:41:23.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe286dc59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:41:23.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe286dc59c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:41:23.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe286dc59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:23.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe286dc59c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:23.043 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.037+0000 7fe286dc59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:41:23.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.049+0000 7fe13afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:23.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.053+0000 7fe286dc59c0 20 remove_watcher() i=0 2024-09-12T17:41:23.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.053+0000 7fe286dc59c0 2 removed watcher, disabling cache 2024-09-12T17:41:23.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.053+0000 7fe286dc59c0 20 remove_watcher() i=1 2024-09-12T17:41:23.061 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.057+0000 7fe286dc59c0 20 remove_watcher() i=2 2024-09-12T17:41:23.063 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.057+0000 7fe286dc59c0 20 remove_watcher() i=3 2024-09-12T17:41:23.065 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.061+0000 7fe286dc59c0 20 remove_watcher() i=4 2024-09-12T17:41:23.066 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.061+0000 7fe286dc59c0 20 remove_watcher() i=5 2024-09-12T17:41:23.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.065+0000 7fe286dc59c0 20 remove_watcher() i=6 2024-09-12T17:41:23.069 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.065+0000 7fe286dc59c0 20 remove_watcher() i=7 2024-09-12T17:41:23.083 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:41:23.109 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:23.109 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:23.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.149+0000 7fd27c2f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.149+0000 7fd27c2f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.149+0000 7fd27c2f09c0 20 realm 2024-09-12T17:41:23.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.149+0000 7fd27c2f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.149+0000 7fd27c2f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.149+0000 7fd27c2f09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:23.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.149+0000 7fd27c2f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.149+0000 7fd27c2f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.149+0000 7fd27c2f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.153+0000 7fd27c2f09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:23.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.153+0000 7fd27c2f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.153+0000 7fd27c2f09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:23.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.153+0000 7fd27c2f09c0 20 searching for the correct realm 2024-09-12T17:41:23.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.157+0000 7fd27a5f7640 0 -- 172.21.15.119:0/4293073214 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x563c371399e0 msgr2=0x7fd264106980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:23.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.165+0000 7fd2795f5640 0 -- 172.21.15.119:0/4293073214 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fd27403a040 msgr2=0x7fd27404b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:23.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.381+0000 7fd27c2f09c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:23.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.381+0000 7fd27c2f09c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:23.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.381+0000 7fd27c2f09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:23.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.381+0000 7fd27c2f09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:23.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.381+0000 7fd27c2f09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:23.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.381+0000 7fd27c2f09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:23.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.381+0000 7fd27c2f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.385+0000 7fd27c2f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.385+0000 7fd27c2f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.385+0000 7fd27c2f09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:23.388 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.385+0000 7fd27c2f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.385+0000 7fd27c2f09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:23.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.385+0000 7fd27c2f09c0 20 zone default found 2024-09-12T17:41:23.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.385+0000 7fd27c2f09c0 4 Realm: () 2024-09-12T17:41:23.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.385+0000 7fd27c2f09c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:23.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.385+0000 7fd27c2f09c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:23.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.385+0000 7fd27c2f09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:23.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.385+0000 7fd27c2f09c0 20 zonegroup default 2024-09-12T17:41:23.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.385+0000 7fd27c2f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.385+0000 7fd27c2f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.385+0000 7fd27c2f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.385+0000 7fd27c2f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.385+0000 7fd27c2f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.389+0000 7fd27c2f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.389+0000 7fd27c2f09c0 20 started sync module instance, tier type = 2024-09-12T17:41:23.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.389+0000 7fd27c2f09c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:23.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.413+0000 7fd27c2f09c0 20 add_watcher() i=0 2024-09-12T17:41:23.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.413+0000 7fd27c2f09c0 20 add_watcher() i=1 2024-09-12T17:41:23.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.413+0000 7fd27c2f09c0 20 add_watcher() i=2 2024-09-12T17:41:23.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.413+0000 7fd27c2f09c0 20 add_watcher() i=3 2024-09-12T17:41:23.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.413+0000 7fd27c2f09c0 20 add_watcher() i=4 2024-09-12T17:41:23.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.413+0000 7fd27c2f09c0 20 add_watcher() i=5 2024-09-12T17:41:23.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.413+0000 7fd27c2f09c0 20 add_watcher() i=6 2024-09-12T17:41:23.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.413+0000 7fd27c2f09c0 20 add_watcher() i=7 2024-09-12T17:41:23.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.413+0000 7fd27c2f09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:23.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.417+0000 7fd12bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:23.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:23.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:23.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 5 note: GC not initialized 2024-09-12T17:41:23.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd12affd640 20 reqs_thread_entry: start 2024-09-12T17:41:23.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:23.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 20 Filter name: none 2024-09-12T17:41:23.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd128ff9640 20 reqs_thread_entry: start 2024-09-12T17:41:23.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:41:23.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:23.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:41:23.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:41:23.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:41:23.430 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:41:23.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:41:23.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:41:23.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:23.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:23.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:41:23.431 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:41:23.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.421+0000 7fd27c2f09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:41:23.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.425+0000 7fd27c2f09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:41:23.432 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.425+0000 7fd27c2f09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:41:23.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.425+0000 7fd27c2f09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:41:23.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.425+0000 7fd27c2f09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:41:23.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.425+0000 7fd27c2f09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:41:23.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.425+0000 7fd27c2f09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:41:23.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.425+0000 7fd27c2f09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:41:23.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.425+0000 7fd27c2f09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:41:23.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.425+0000 7fd27c2f09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:41:23.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.425+0000 7fd27c2f09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:41:23.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.425+0000 7fd27c2f09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:41:23.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.425+0000 7fd27c2f09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:41:23.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.429+0000 7fd27c2f09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:41:23.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.429+0000 7fd27c2f09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:41:23.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.429+0000 7fd27c2f09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:41:23.434 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.429+0000 7fd27c2f09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:41:23.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.429+0000 7fd27c2f09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:41:23.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.429+0000 7fd27c2f09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:41:23.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.429+0000 7fd27c2f09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:41:23.435 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.429+0000 7fd27c2f09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:41:23.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.433+0000 7fd27c2f09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:41:23.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.433+0000 7fd27c2f09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:41:23.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.433+0000 7fd27c2f09c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:41:23.437 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.433+0000 7fd27c2f09c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:41:23.439 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.433+0000 7fd12bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:23.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.441+0000 7fd27c2f09c0 20 remove_watcher() i=0 2024-09-12T17:41:23.445 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.441+0000 7fd27c2f09c0 2 removed watcher, disabling cache 2024-09-12T17:41:23.447 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.441+0000 7fd27c2f09c0 20 remove_watcher() i=1 2024-09-12T17:41:23.450 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.445+0000 7fd27c2f09c0 20 remove_watcher() i=2 2024-09-12T17:41:23.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.449+0000 7fd27c2f09c0 20 remove_watcher() i=3 2024-09-12T17:41:23.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.449+0000 7fd27c2f09c0 20 remove_watcher() i=4 2024-09-12T17:41:23.455 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.449+0000 7fd27c2f09c0 20 remove_watcher() i=5 2024-09-12T17:41:23.456 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.453+0000 7fd27c2f09c0 20 remove_watcher() i=6 2024-09-12T17:41:23.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.453+0000 7fd27c2f09c0 20 remove_watcher() i=7 2024-09-12T17:41:23.473 INFO:tasks.workunit.client.0.smithi119.stderr:check reshard logrecord successfully 2024-09-12T17:41:23.473 INFO:tasks.workunit.client.0.smithi119.stderr: test: reshard versioned bucket 2024-09-12T17:41:23.473 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:41:23.500 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:23.500 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:23.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.541+0000 7f335b0849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.545+0000 7f335b0849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.545+0000 7f335b0849c0 20 realm 2024-09-12T17:41:23.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.545+0000 7f335b0849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.545+0000 7f335b0849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.545+0000 7f335b0849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:23.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.545+0000 7f335b0849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.545+0000 7f335b0849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.545+0000 7f335b0849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.549+0000 7f335b0849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:23.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.549+0000 7f335b0849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.549+0000 7f335b0849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:23.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.549+0000 7f335b0849c0 20 searching for the correct realm 2024-09-12T17:41:23.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.549+0000 7f3358389640 0 -- 172.21.15.119:0/124191303 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f33480cc910 msgr2=0x7f33480db400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:23.767 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.765+0000 7f335938b640 0 -- 172.21.15.119:0/124191303 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f334c030060 msgr2=0x7f334c062840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:23.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.781+0000 7f335b0849c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:23.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.781+0000 7f335b0849c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:23.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.781+0000 7f335b0849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:23.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.781+0000 7f335b0849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:23.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.781+0000 7f335b0849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:23.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.781+0000 7f335b0849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:23.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.781+0000 7f335b0849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.781+0000 7f335b0849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.781+0000 7f335b0849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:23.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:23.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 20 zone default found 2024-09-12T17:41:23.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 4 Realm: () 2024-09-12T17:41:23.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:23.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:23.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:23.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 20 zonegroup default 2024-09-12T17:41:23.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.790 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.790 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 20 started sync module instance, tier type = 2024-09-12T17:41:23.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.785+0000 7f335b0849c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:23.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.809+0000 7f335b0849c0 20 add_watcher() i=0 2024-09-12T17:41:23.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.809+0000 7f335b0849c0 20 add_watcher() i=1 2024-09-12T17:41:23.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.809+0000 7f335b0849c0 20 add_watcher() i=2 2024-09-12T17:41:23.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.809+0000 7f335b0849c0 20 add_watcher() i=3 2024-09-12T17:41:23.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.809+0000 7f335b0849c0 20 add_watcher() i=4 2024-09-12T17:41:23.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.809+0000 7f335b0849c0 20 add_watcher() i=5 2024-09-12T17:41:23.815 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.809+0000 7f335b0849c0 20 add_watcher() i=6 2024-09-12T17:41:23.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.813+0000 7f335b0849c0 20 add_watcher() i=7 2024-09-12T17:41:23.817 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.813+0000 7f335b0849c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:23.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.817+0000 7f320efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:23.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.817+0000 7f335b0849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:23.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.817+0000 7f335b0849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:23.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.817+0000 7f335b0849c0 5 note: GC not initialized 2024-09-12T17:41:23.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.817+0000 7f320dfe3640 20 reqs_thread_entry: start 2024-09-12T17:41:23.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.821+0000 7f335b0849c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:23.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.821+0000 7f335b0849c0 20 Filter name: none 2024-09-12T17:41:23.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.821+0000 7f317b7fe640 20 reqs_thread_entry: start 2024-09-12T17:41:23.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.821+0000 7f335b0849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.821+0000 7f335b0849c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:41:23.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.821+0000 7f335b0849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.821+0000 7f335b0849c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:41:23.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.821+0000 7f335b0849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:23.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.821+0000 7f335b0849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.821+0000 7f335b0849c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:41:23.827 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.821+0000 7f335b0849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.825+0000 7f335b0849c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:41:23.828 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.825+0000 7f335b0849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:23.832 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.829+0000 7f320efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:23.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.833+0000 7f335b0849c0 20 remove_watcher() i=0 2024-09-12T17:41:23.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.833+0000 7f335b0849c0 2 removed watcher, disabling cache 2024-09-12T17:41:23.839 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.833+0000 7f335b0849c0 20 remove_watcher() i=1 2024-09-12T17:41:23.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.837+0000 7f335b0849c0 20 remove_watcher() i=2 2024-09-12T17:41:23.844 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.841+0000 7f335b0849c0 20 remove_watcher() i=3 2024-09-12T17:41:23.846 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.841+0000 7f335b0849c0 20 remove_watcher() i=4 2024-09-12T17:41:23.848 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.845+0000 7f335b0849c0 20 remove_watcher() i=5 2024-09-12T17:41:23.849 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.845+0000 7f335b0849c0 20 remove_watcher() i=6 2024-09-12T17:41:23.851 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.845+0000 7f335b0849c0 20 remove_watcher() i=7 2024-09-12T17:41:23.868 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:41:23.868 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:41:23.868 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: myver id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T17:41:23.868 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:41:23.868 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-12T17:41:23.901 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:23.901 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:23.945 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.941+0000 7f9b136be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.941+0000 7f9b136be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.941+0000 7f9b136be9c0 20 realm 2024-09-12T17:41:23.947 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.941+0000 7f9b136be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.945+0000 7f9b136be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.945+0000 7f9b136be9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:23.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.945+0000 7f9b136be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.945+0000 7f9b136be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.948 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.945+0000 7f9b136be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.945+0000 7f9b136be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:23.949 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.945+0000 7f9b136be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.945+0000 7f9b136be9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:23.951 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.945+0000 7f9b136be9c0 20 searching for the correct realm 2024-09-12T17:41:23.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.949+0000 7f9b119c5640 0 -- 172.21.15.119:0/2277040250 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x559342ffa4c0 msgr2=0x559342ffc8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:23.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:23.957+0000 7f9b109c3640 0 -- 172.21.15.119:0/2277040250 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f9b0c02f060 msgr2=0x7f9b0c01ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:24.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.173+0000 7f9b136be9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:24.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.173+0000 7f9b136be9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:24.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.173+0000 7f9b136be9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:24.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.173+0000 7f9b136be9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:24.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.173+0000 7f9b136be9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:24.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.173+0000 7f9b136be9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:24.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.173+0000 7f9b136be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.177+0000 7f9b136be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.177+0000 7f9b136be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.177+0000 7f9b136be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:24.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.177+0000 7f9b136be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.177+0000 7f9b136be9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:24.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.177+0000 7f9b136be9c0 20 zone default found 2024-09-12T17:41:24.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.177+0000 7f9b136be9c0 4 Realm: () 2024-09-12T17:41:24.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.177+0000 7f9b136be9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:24.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.177+0000 7f9b136be9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:24.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.177+0000 7f9b136be9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:24.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.177+0000 7f9b136be9c0 20 zonegroup default 2024-09-12T17:41:24.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.177+0000 7f9b136be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.177+0000 7f9b136be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.177+0000 7f9b136be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.177+0000 7f9b136be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.177+0000 7f9b136be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.181+0000 7f9b136be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.181+0000 7f9b136be9c0 20 started sync module instance, tier type = 2024-09-12T17:41:24.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.181+0000 7f9b136be9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:24.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.201+0000 7f9b136be9c0 20 add_watcher() i=0 2024-09-12T17:41:24.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.201+0000 7f9b136be9c0 20 add_watcher() i=1 2024-09-12T17:41:24.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.201+0000 7f9b136be9c0 20 add_watcher() i=2 2024-09-12T17:41:24.207 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.201+0000 7f9b136be9c0 20 add_watcher() i=3 2024-09-12T17:41:24.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.201+0000 7f9b136be9c0 20 add_watcher() i=4 2024-09-12T17:41:24.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.201+0000 7f9b136be9c0 20 add_watcher() i=5 2024-09-12T17:41:24.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.201+0000 7f9b136be9c0 20 add_watcher() i=6 2024-09-12T17:41:24.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.205+0000 7f9b136be9c0 20 add_watcher() i=7 2024-09-12T17:41:24.209 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.205+0000 7f9b136be9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:24.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.209+0000 7f99c7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:24.214 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.209+0000 7f9b136be9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:24.214 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.209+0000 7f9b136be9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:24.214 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.209+0000 7f9b136be9c0 5 note: GC not initialized 2024-09-12T17:41:24.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.209+0000 7f99c6fe5640 20 reqs_thread_entry: start 2024-09-12T17:41:24.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.209+0000 7f9b136be9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:24.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.209+0000 7f9b136be9c0 20 Filter name: none 2024-09-12T17:41:24.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.213+0000 7f99c4fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:24.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.213+0000 7f9b136be9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:41:24.216 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.213+0000 7f9b136be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.213+0000 7f9b136be9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:41:24.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.213+0000 7f9b136be9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:41:24.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.213+0000 7f9b136be9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:41:24.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.213+0000 7f9b136be9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 : miss 2024-09-12T17:41:24.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.213+0000 7f9b136be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.213+0000 7f9b136be9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:41:24.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.213+0000 7f9b136be9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:24.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.213+0000 7f9b136be9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:24.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.213+0000 7f9b136be9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:24.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.213+0000 7f9b136be9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:24.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.213+0000 7f9b136be9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 2024-09-12T17:41:24.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.225+0000 7f9b136be9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:24.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.225+0000 7f9b136be9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:24.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.225+0000 7f9b136be9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:24.229 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.225+0000 7f9b136be9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19, ofs0, ns] 2024-09-12T17:41:24.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.225+0000 7f99e3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333521 cookie 94090972608144 notifier 8490 bl.length()=905 2024-09-12T17:41:24.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.225+0000 7f99e3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:24.230 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.225+0000 7f99e3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:24.231 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.225+0000 7f99e3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:24.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.229+0000 7f9b136be9c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_sources= new_sources= 2024-09-12T17:41:24.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.229+0000 7f9b136be9c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential sources added=[] removed=[] 2024-09-12T17:41:24.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.229+0000 7f9b136be9c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_dests= new_dests= 2024-09-12T17:41:24.232 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.229+0000 7f9b136be9c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential dests added=[] removed=[] 2024-09-12T17:41:24.245 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.0 2024-09-12T17:41:24.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.0 2024-09-12T17:41:24.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.1 2024-09-12T17:41:24.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.1 2024-09-12T17:41:24.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.2 2024-09-12T17:41:24.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.2 2024-09-12T17:41:24.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.3 2024-09-12T17:41:24.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.3 2024-09-12T17:41:24.246 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.4 2024-09-12T17:41:24.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.4 2024-09-12T17:41:24.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.5 2024-09-12T17:41:24.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.5 2024-09-12T17:41:24.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.6 2024-09-12T17:41:24.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.6 2024-09-12T17:41:24.247 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.7 2024-09-12T17:41:24.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.7 2024-09-12T17:41:24.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.8 2024-09-12T17:41:24.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.8 2024-09-12T17:41:24.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.9 2024-09-12T17:41:24.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.9 2024-09-12T17:41:24.248 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.10 2024-09-12T17:41:24.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.10 2024-09-12T17:41:24.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.11 2024-09-12T17:41:24.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.11 2024-09-12T17:41:24.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.237+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.0 2024-09-12T17:41:24.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.241+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1 2024-09-12T17:41:24.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.241+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2 2024-09-12T17:41:24.249 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.241+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3 2024-09-12T17:41:24.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.241+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.4 2024-09-12T17:41:24.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.241+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.5 2024-09-12T17:41:24.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.245+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.6 2024-09-12T17:41:24.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.245+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.7 2024-09-12T17:41:24.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.245+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.8 2024-09-12T17:41:24.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.245+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.9 2024-09-12T17:41:24.251 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.245+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.10 2024-09-12T17:41:24.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.249+0000 7f9b136be9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:24.252 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.249+0000 7f9b136be9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 2024-09-12T17:41:24.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.249+0000 7f9b136be9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:24.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.249+0000 7f9b136be9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:24.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.249+0000 7f9b136be9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:24.255 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.249+0000 7f9b136be9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19, ofs0, ns] 2024-09-12T17:41:24.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.253+0000 7f99e3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333522 cookie 94090972608144 notifier 8490 bl.length()=905 2024-09-12T17:41:24.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.253+0000 7f99e3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:24.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.253+0000 7f99e3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:24.256 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.253+0000 7f99e3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:24.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.253+0000 7f9b136be9c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_sources= new_sources= 2024-09-12T17:41:24.258 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.253+0000 7f9b136be9c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential sources added=[] removed=[] 2024-09-12T17:41:24.259 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.253+0000 7f9b136be9c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_dests= new_dests= 2024-09-12T17:41:24.259 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.253+0000 7f9b136be9c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential dests added=[] removed=[] 2024-09-12T17:41:24.263 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.257+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.0 2024-09-12T17:41:24.264 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.261+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1 2024-09-12T17:41:24.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.261+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2 2024-09-12T17:41:24.265 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.261+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3 2024-09-12T17:41:24.266 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.261+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.4 2024-09-12T17:41:24.266 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.261+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.5 2024-09-12T17:41:24.267 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.261+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.6 2024-09-12T17:41:24.267 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.261+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.7 2024-09-12T17:41:24.267 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.265+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.8 2024-09-12T17:41:24.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.265+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.9 2024-09-12T17:41:24.269 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.265+0000 7f9b136be9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.10 2024-09-12T17:41:24.270 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.265+0000 7f9b136be9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:24.270 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.265+0000 7f9b136be9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 2024-09-12T17:41:24.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.269+0000 7f9b136be9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:24.273 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.269+0000 7f9b136be9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:24.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.269+0000 7f9b136be9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:24.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.269+0000 7f9b136be9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19, ofs0, ns] 2024-09-12T17:41:24.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.269+0000 7f99e3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333523 cookie 94090972608144 notifier 8490 bl.length()=873 2024-09-12T17:41:24.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.269+0000 7f99e3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:24.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.269+0000 7f99e3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:24.274 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.269+0000 7f99e3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:24.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.273+0000 7f9b136be9c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_sources= new_sources= 2024-09-12T17:41:24.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.273+0000 7f9b136be9c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential sources added=[] removed=[] 2024-09-12T17:41:24.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.273+0000 7f9b136be9c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_dests= new_dests= 2024-09-12T17:41:24.277 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.273+0000 7f9b136be9c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential dests added=[] removed=[] 2024-09-12T17:41:24.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.277+0000 7f9b136be9c0 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-12T17:41:24.284 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.281+0000 7f99c7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:24.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.285+0000 7f9b136be9c0 20 remove_watcher() i=0 2024-09-12T17:41:24.290 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.285+0000 7f9b136be9c0 2 removed watcher, disabling cache 2024-09-12T17:41:24.291 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.289+0000 7f9b136be9c0 20 remove_watcher() i=1 2024-09-12T17:41:24.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.289+0000 7f9b136be9c0 20 remove_watcher() i=2 2024-09-12T17:41:24.296 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.293+0000 7f9b136be9c0 20 remove_watcher() i=3 2024-09-12T17:41:24.298 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.293+0000 7f9b136be9c0 20 remove_watcher() i=4 2024-09-12T17:41:24.300 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.297+0000 7f9b136be9c0 20 remove_watcher() i=5 2024-09-12T17:41:24.302 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.297+0000 7f9b136be9c0 20 remove_watcher() i=6 2024-09-12T17:41:24.303 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.301+0000 7f9b136be9c0 20 remove_watcher() i=7 2024-09-12T17:41:24.318 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:41:24.348 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:24.348 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:24.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.389+0000 7f46d15849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.389+0000 7f46d15849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.389+0000 7f46d15849c0 20 realm 2024-09-12T17:41:24.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.389+0000 7f46d15849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.389+0000 7f46d15849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.389+0000 7f46d15849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:24.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.389+0000 7f46d15849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.389+0000 7f46d15849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.389+0000 7f46d15849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.393+0000 7f46d15849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:24.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.393+0000 7f46d15849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.393+0000 7f46d15849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:24.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.393+0000 7f46d15849c0 20 searching for the correct realm 2024-09-12T17:41:24.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.397+0000 7f46cf88b640 0 -- 172.21.15.119:0/196252598 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f46c41290b0 msgr2=0x7f46c40fc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:24.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.613+0000 7f46ce889640 0 -- 172.21.15.119:0/196252598 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f46c805db30 msgr2=0x7f46c8083a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:24.835 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.829+0000 7f46d15849c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:24.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:24.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:24.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:24.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:24.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:24.836 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:24.837 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:24.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 20 zone default found 2024-09-12T17:41:24.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 4 Realm: () 2024-09-12T17:41:24.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:24.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:24.838 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:24.839 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 20 zonegroup default 2024-09-12T17:41:24.839 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.839 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.839 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.833+0000 7f46d15849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.837+0000 7f46d15849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.837+0000 7f46d15849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.837+0000 7f46d15849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.837+0000 7f46d15849c0 20 started sync module instance, tier type = 2024-09-12T17:41:24.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.837+0000 7f46d15849c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:24.864 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.861+0000 7f46d15849c0 20 add_watcher() i=0 2024-09-12T17:41:24.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.861+0000 7f46d15849c0 20 add_watcher() i=1 2024-09-12T17:41:24.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.861+0000 7f46d15849c0 20 add_watcher() i=2 2024-09-12T17:41:24.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.861+0000 7f46d15849c0 20 add_watcher() i=3 2024-09-12T17:41:24.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.861+0000 7f46d15849c0 20 add_watcher() i=4 2024-09-12T17:41:24.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.861+0000 7f46d15849c0 20 add_watcher() i=5 2024-09-12T17:41:24.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.861+0000 7f46d15849c0 20 add_watcher() i=6 2024-09-12T17:41:24.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.865+0000 7f46d15849c0 20 add_watcher() i=7 2024-09-12T17:41:24.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.865+0000 7f46d15849c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:24.871 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.869+0000 7f4585fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:24.872 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.869+0000 7f46d15849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:24.872 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.869+0000 7f46d15849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:24.872 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.869+0000 7f46d15849c0 5 note: GC not initialized 2024-09-12T17:41:24.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.869+0000 7f4584fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:24.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.869+0000 7f46d15849c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:24.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.869+0000 7f46d15849c0 20 Filter name: none 2024-09-12T17:41:24.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.869+0000 7f44fe7fc640 20 reqs_thread_entry: start 2024-09-12T17:41:24.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.869+0000 7f46d15849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.869+0000 7f46d15849c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:41:24.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.869+0000 7f46d15849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.876 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.873+0000 7f46d15849c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:41:24.876 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.873+0000 7f46d15849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:24.876 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.873+0000 7f46d15849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.876 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.873+0000 7f46d15849c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:41:24.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.873+0000 7f46d15849c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.873+0000 7f46d15849c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:41:24.877 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.873+0000 7f46d15849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:24.881 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.877+0000 7f4585fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:24.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.881+0000 7f46d15849c0 20 remove_watcher() i=0 2024-09-12T17:41:24.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.881+0000 7f46d15849c0 2 removed watcher, disabling cache 2024-09-12T17:41:24.888 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.885+0000 7f46d15849c0 20 remove_watcher() i=1 2024-09-12T17:41:24.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.885+0000 7f46d15849c0 20 remove_watcher() i=2 2024-09-12T17:41:24.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.889+0000 7f46d15849c0 20 remove_watcher() i=3 2024-09-12T17:41:24.895 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.889+0000 7f46d15849c0 20 remove_watcher() i=4 2024-09-12T17:41:24.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.893+0000 7f46d15849c0 20 remove_watcher() i=5 2024-09-12T17:41:24.898 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.893+0000 7f46d15849c0 20 remove_watcher() i=6 2024-09-12T17:41:24.899 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:24.897+0000 7f46d15849c0 20 remove_watcher() i=7 2024-09-12T17:41:24.914 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:41:24.914 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:41:24.914 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: myver id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T17:41:24.914 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:41:25.000 INFO:tasks.workunit.client.0.smithi119.stderr: test: reshard removes olh entries with empty name 2024-09-12T17:41:25.808 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:41:25.840 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:25.840 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:25.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:25.885+0000 7f0b63b069c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:25.885+0000 7f0b63b069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:25.885+0000 7f0b63b069c0 20 realm 2024-09-12T17:41:25.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:25.885+0000 7f0b63b069c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:25.885+0000 7f0b63b069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:25.885+0000 7f0b63b069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:25.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:25.885+0000 7f0b63b069c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:25.885+0000 7f0b63b069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:25.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:25.885+0000 7f0b63b069c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:25.889+0000 7f0b63b069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:25.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:25.889+0000 7f0b63b069c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:25.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:25.889+0000 7f0b63b069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:25.894 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:25.889+0000 7f0b63b069c0 20 searching for the correct realm 2024-09-12T17:41:25.897 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:25.893+0000 7f0b61e0d640 0 -- 172.21.15.119:0/584318795 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f0b580ca030 msgr2=0x7f0b5810e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:26.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.109+0000 7f0b60e0b640 0 -- 172.21.15.119:0/584318795 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f0b5c02cbf0 msgr2=0x7f0b5c037440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:26.332 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:26.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:26.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:26.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:26.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:26.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:26.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.333 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:26.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:26.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 zone default found 2024-09-12T17:41:26.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 4 Realm: () 2024-09-12T17:41:26.338 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:26.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:26.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:26.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 zonegroup default 2024-09-12T17:41:26.339 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.329+0000 7f0b63b069c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.333+0000 7f0b63b069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.333+0000 7f0b63b069c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.333+0000 7f0b63b069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.333+0000 7f0b63b069c0 20 started sync module instance, tier type = 2024-09-12T17:41:26.340 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.333+0000 7f0b63b069c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:26.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.357+0000 7f0b63b069c0 20 add_watcher() i=0 2024-09-12T17:41:26.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.357+0000 7f0b63b069c0 20 add_watcher() i=1 2024-09-12T17:41:26.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.357+0000 7f0b63b069c0 20 add_watcher() i=2 2024-09-12T17:41:26.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.357+0000 7f0b63b069c0 20 add_watcher() i=3 2024-09-12T17:41:26.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.357+0000 7f0b63b069c0 20 add_watcher() i=4 2024-09-12T17:41:26.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.357+0000 7f0b63b069c0 20 add_watcher() i=5 2024-09-12T17:41:26.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.357+0000 7f0b63b069c0 20 add_watcher() i=6 2024-09-12T17:41:26.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.357+0000 7f0b63b069c0 20 add_watcher() i=7 2024-09-12T17:41:26.362 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.357+0000 7f0b63b069c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:26.366 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.361+0000 7f0a17fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:26.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.361+0000 7f0b63b069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:26.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.361+0000 7f0b63b069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:26.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.361+0000 7f0b63b069c0 5 note: GC not initialized 2024-09-12T17:41:26.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.365+0000 7f0a16fe5640 20 reqs_thread_entry: start 2024-09-12T17:41:26.367 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.365+0000 7f0b63b069c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:26.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.365+0000 7f0b63b069c0 20 Filter name: none 2024-09-12T17:41:26.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.365+0000 7f0a14fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:26.368 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.365+0000 7f0b63b069c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.369 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.365+0000 7f0b63b069c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:26.369 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.365+0000 7f0b63b069c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.365+0000 7f0b63b069c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:26.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.365+0000 7f0b63b069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:26.370 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.365+0000 7f0b63b069c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.365+0000 7f0b63b069c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:26.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.365+0000 7f0b63b069c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.369+0000 7f0b63b069c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:26.371 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.369+0000 7f0b63b069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:26.374 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.369+0000 7f0a17fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:26.379 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.377+0000 7f0b63b069c0 20 remove_watcher() i=0 2024-09-12T17:41:26.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.377+0000 7f0b63b069c0 2 removed watcher, disabling cache 2024-09-12T17:41:26.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.377+0000 7f0b63b069c0 20 remove_watcher() i=1 2024-09-12T17:41:26.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.381+0000 7f0b63b069c0 20 remove_watcher() i=2 2024-09-12T17:41:26.387 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.381+0000 7f0b63b069c0 20 remove_watcher() i=3 2024-09-12T17:41:26.389 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.385+0000 7f0b63b069c0 20 remove_watcher() i=4 2024-09-12T17:41:26.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.385+0000 7f0b63b069c0 20 remove_watcher() i=5 2024-09-12T17:41:26.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.389+0000 7f0b63b069c0 20 remove_watcher() i=6 2024-09-12T17:41:26.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.389+0000 7f0b63b069c0 20 remove_watcher() i=7 2024-09-12T17:41:26.409 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:41:26.409 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:41:26.410 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: a-bucket id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-12T17:41:26.410 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:41:26.410 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T17:41:26.437 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:26.438 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:26.482 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.477+0000 7faab04c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.484 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.481+0000 7faab04c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.484 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.481+0000 7faab04c79c0 20 realm 2024-09-12T17:41:26.484 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.481+0000 7faab04c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.484 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.481+0000 7faab04c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.484 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.481+0000 7faab04c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:26.484 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.481+0000 7faab04c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.484 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.481+0000 7faab04c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.485 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.481+0000 7faab04c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.481+0000 7faab04c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:26.486 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.481+0000 7faab04c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.485+0000 7faab04c79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:26.487 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.485+0000 7faab04c79c0 20 searching for the correct realm 2024-09-12T17:41:26.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.485+0000 7faaae7ce640 0 -- 172.21.15.119:0/4241538891 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7faaa40dbfa0 msgr2=0x7faaa40c4040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:26.709 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.701+0000 7faaad7cc640 0 -- 172.21.15.119:0/4241538891 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7faaa8064ff0 msgr2=0x7faaa8090910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:26.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.917+0000 7faab04c79c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:26.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.917+0000 7faab04c79c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:26.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.917+0000 7faab04c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:26.923 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.917+0000 7faab04c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:26.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.917+0000 7faab04c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:26.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.917+0000 7faab04c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:26.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.917+0000 7faab04c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.921+0000 7faab04c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.924 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.921+0000 7faab04c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.921+0000 7faab04c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:26.925 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.921+0000 7faab04c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.921+0000 7faab04c79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:26.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.921+0000 7faab04c79c0 20 zone default found 2024-09-12T17:41:26.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.921+0000 7faab04c79c0 4 Realm: () 2024-09-12T17:41:26.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.921+0000 7faab04c79c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:26.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.921+0000 7faab04c79c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:26.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.921+0000 7faab04c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:26.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.921+0000 7faab04c79c0 20 zonegroup default 2024-09-12T17:41:26.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.921+0000 7faab04c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.921+0000 7faab04c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.921+0000 7faab04c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.925+0000 7faab04c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.925+0000 7faab04c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.925+0000 7faab04c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:26.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.925+0000 7faab04c79c0 20 started sync module instance, tier type = 2024-09-12T17:41:26.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.925+0000 7faab04c79c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:26.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.949+0000 7faab04c79c0 20 add_watcher() i=0 2024-09-12T17:41:26.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.949+0000 7faab04c79c0 20 add_watcher() i=1 2024-09-12T17:41:26.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.949+0000 7faab04c79c0 20 add_watcher() i=2 2024-09-12T17:41:26.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.949+0000 7faab04c79c0 20 add_watcher() i=3 2024-09-12T17:41:26.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.949+0000 7faab04c79c0 20 add_watcher() i=4 2024-09-12T17:41:26.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.949+0000 7faab04c79c0 20 add_watcher() i=5 2024-09-12T17:41:26.953 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.949+0000 7faab04c79c0 20 add_watcher() i=6 2024-09-12T17:41:26.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.949+0000 7faab04c79c0 20 add_watcher() i=7 2024-09-12T17:41:26.955 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.949+0000 7faab04c79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:26.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.953+0000 7fa95f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:26.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.957+0000 7faab04c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:26.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.957+0000 7faab04c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:26.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.957+0000 7faab04c79c0 5 note: GC not initialized 2024-09-12T17:41:26.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.957+0000 7fa95e7fc640 20 reqs_thread_entry: start 2024-09-12T17:41:26.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.957+0000 7faab04c79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:26.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.957+0000 7faab04c79c0 20 Filter name: none 2024-09-12T17:41:26.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.957+0000 7fa8cffff640 20 reqs_thread_entry: start 2024-09-12T17:41:26.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.957+0000 7faab04c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.957+0000 7faab04c79c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:26.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.957+0000 7faab04c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:26.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.961+0000 7faab04c79c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:26.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.961+0000 7faab04c79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:26.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.961+0000 7fa95f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:26.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.965+0000 7faab04c79c0 20 remove_watcher() i=0 2024-09-12T17:41:26.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.965+0000 7faab04c79c0 2 removed watcher, disabling cache 2024-09-12T17:41:26.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.969+0000 7faab04c79c0 20 remove_watcher() i=1 2024-09-12T17:41:26.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.969+0000 7faab04c79c0 20 remove_watcher() i=2 2024-09-12T17:41:26.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.973+0000 7faab04c79c0 20 remove_watcher() i=3 2024-09-12T17:41:26.979 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.973+0000 7faab04c79c0 20 remove_watcher() i=4 2024-09-12T17:41:26.981 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.977+0000 7faab04c79c0 20 remove_watcher() i=5 2024-09-12T17:41:26.983 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.977+0000 7faab04c79c0 20 remove_watcher() i=6 2024-09-12T17:41:26.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:26.981+0000 7faab04c79c0 20 remove_watcher() i=7 2024-09-12T17:41:26.999 INFO:tasks.workunit.client.0.smithi119.stderr:rados -p default.rgw.buckets.index setomapval .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T17:41:27.031 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:27.031 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:27.051 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T17:41:27.077 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:27.077 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:27.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.117+0000 7f8f75a7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.117+0000 7f8f75a7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.117+0000 7f8f75a7d9c0 20 realm 2024-09-12T17:41:27.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.117+0000 7f8f75a7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.117+0000 7f8f75a7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.117+0000 7f8f75a7d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:27.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.117+0000 7f8f75a7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.117+0000 7f8f75a7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.117+0000 7f8f75a7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.123 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.121+0000 7f8f75a7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:27.124 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.121+0000 7f8f75a7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.121+0000 7f8f75a7d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:27.126 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.121+0000 7f8f75a7d9c0 20 searching for the correct realm 2024-09-12T17:41:27.129 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.125+0000 7f8f73d84640 0 -- 172.21.15.119:0/890418061 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f8f68027040 msgr2=0x7f8f6808e130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:27.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.133+0000 7f8f72d82640 0 -- 172.21.15.119:0/890418061 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f8f6c033410 msgr2=0x7f8f6c033870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:27.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:27.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:27.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:27.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:27.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:27.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:27.356 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:27.357 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:27.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 zone default found 2024-09-12T17:41:27.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 4 Realm: () 2024-09-12T17:41:27.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:27.358 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:27.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:27.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 zonegroup default 2024-09-12T17:41:27.359 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.353+0000 7f8f75a7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.357+0000 7f8f75a7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.357+0000 7f8f75a7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.360 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.357+0000 7f8f75a7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.357+0000 7f8f75a7d9c0 20 started sync module instance, tier type = 2024-09-12T17:41:27.361 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.357+0000 7f8f75a7d9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:27.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.381+0000 7f8f75a7d9c0 20 add_watcher() i=0 2024-09-12T17:41:27.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.381+0000 7f8f75a7d9c0 20 add_watcher() i=1 2024-09-12T17:41:27.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.381+0000 7f8f75a7d9c0 20 add_watcher() i=2 2024-09-12T17:41:27.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.381+0000 7f8f75a7d9c0 20 add_watcher() i=3 2024-09-12T17:41:27.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.381+0000 7f8f75a7d9c0 20 add_watcher() i=4 2024-09-12T17:41:27.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.381+0000 7f8f75a7d9c0 20 add_watcher() i=5 2024-09-12T17:41:27.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.381+0000 7f8f75a7d9c0 20 add_watcher() i=6 2024-09-12T17:41:27.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.381+0000 7f8f75a7d9c0 20 add_watcher() i=7 2024-09-12T17:41:27.386 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.381+0000 7f8f75a7d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:27.390 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.385+0000 7f8e29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:27.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:27.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:27.391 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 5 note: GC not initialized 2024-09-12T17:41:27.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8e28fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:27.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:27.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 20 Filter name: none 2024-09-12T17:41:27.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8da27fc640 20 reqs_thread_entry: start 2024-09-12T17:41:27.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:27.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:27.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:27.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T17:41:27.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 20 INFO: main: starting shard=0 2024-09-12T17:41:27.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:41:27.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:41:27.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:41:27.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 20 INFO: main: starting shard=1 2024-09-12T17:41:27.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:41:27.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.389+0000 7f8f75a7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:41:27.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.393+0000 7f8f75a7d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:27.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.393+0000 7f8f75a7d9c0 20 INFO: main: starting shard=2 2024-09-12T17:41:27.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.393+0000 7f8f75a7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:41:27.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.393+0000 7f8f75a7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:41:27.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.393+0000 7f8f75a7d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:27.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.393+0000 7f8f75a7d9c0 20 INFO: main: starting shard=3 2024-09-12T17:41:27.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.393+0000 7f8f75a7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:41:27.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.393+0000 7f8f75a7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:41:27.399 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.393+0000 7f8f75a7d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:27.399 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.393+0000 7f8f75a7d9c0 20 INFO: main: starting shard=4 2024-09-12T17:41:27.399 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.393+0000 7f8f75a7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:41:27.399 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.393+0000 7f8f75a7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:41:27.399 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:27.399 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 20 INFO: main: starting shard=5 2024-09-12T17:41:27.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:41:27.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:41:27.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:27.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 20 INFO: main: starting shard=6 2024-09-12T17:41:27.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:41:27.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:41:27.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:27.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 20 INFO: main: starting shard=7 2024-09-12T17:41:27.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:41:27.401 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:41:27.402 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:27.402 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 20 INFO: main: starting shard=8 2024-09-12T17:41:27.402 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:41:27.402 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:41:27.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:27.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 20 INFO: main: starting shard=9 2024-09-12T17:41:27.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:41:27.403 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.397+0000 7f8f75a7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:41:27.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.401+0000 7f8f75a7d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:27.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.401+0000 7f8f75a7d9c0 20 INFO: main: starting shard=10 2024-09-12T17:41:27.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.401+0000 7f8f75a7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:41:27.404 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.401+0000 7f8f75a7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:41:27.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.401+0000 7f8f75a7d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:27.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.401+0000 7f8f75a7d9c0 20 INFO: main: starting shard=11 2024-09-12T17:41:27.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.401+0000 7f8f75a7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:41:27.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.401+0000 7f8f75a7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:41:27.406 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.401+0000 7f8f75a7d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:27.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.401+0000 7f8f75a7d9c0 20 INFO: main: starting shard=12 2024-09-12T17:41:27.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.401+0000 7f8f75a7d9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:41:27.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.401+0000 7f8f75a7d9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:41:27.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.405+0000 7f8f75a7d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:27.407 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.405+0000 7f8f75a7d9c0 20 INFO: main: done 2024-09-12T17:41:27.408 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.405+0000 7f8e29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:27.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.409+0000 7f8f75a7d9c0 20 remove_watcher() i=0 2024-09-12T17:41:27.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.409+0000 7f8f75a7d9c0 2 removed watcher, disabling cache 2024-09-12T17:41:27.415 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.413+0000 7f8f75a7d9c0 20 remove_watcher() i=1 2024-09-12T17:41:27.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.413+0000 7f8f75a7d9c0 20 remove_watcher() i=2 2024-09-12T17:41:27.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.417+0000 7f8f75a7d9c0 20 remove_watcher() i=3 2024-09-12T17:41:27.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.417+0000 7f8f75a7d9c0 20 remove_watcher() i=4 2024-09-12T17:41:27.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.417+0000 7f8f75a7d9c0 20 remove_watcher() i=5 2024-09-12T17:41:27.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.421+0000 7f8f75a7d9c0 20 remove_watcher() i=6 2024-09-12T17:41:27.426 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.421+0000 7f8f75a7d9c0 20 remove_watcher() i=7 2024-09-12T17:41:27.441 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T17:41:27.472 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:27.472 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:27.517 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.513+0000 7f1f716129c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.513+0000 7f1f716129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.513+0000 7f1f716129c0 20 realm 2024-09-12T17:41:27.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.513+0000 7f1f716129c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.513+0000 7f1f716129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.513+0000 7f1f716129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:27.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.513+0000 7f1f716129c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.513+0000 7f1f716129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.513+0000 7f1f716129c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.520 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.517+0000 7f1f716129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:27.520 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.517+0000 7f1f716129c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.525 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.517+0000 7f1f716129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:27.525 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.517+0000 7f1f716129c0 20 searching for the correct realm 2024-09-12T17:41:27.526 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.521+0000 7f1f6f919640 0 -- 172.21.15.119:0/2145455927 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f1f58048040 msgr2=0x7f1f58048930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:27.742 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.737+0000 7f1f6e917640 0 -- 172.21.15.119:0/2145455927 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f1f600e4910 msgr2=0x7f1f600b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:27.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:27.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:27.960 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:27.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:27.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:27.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:27.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.961 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:27.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:27.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 zone default found 2024-09-12T17:41:27.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 4 Realm: () 2024-09-12T17:41:27.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:27.962 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:27.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:27.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 zonegroup default 2024-09-12T17:41:27.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.957+0000 7f1f716129c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.961+0000 7f1f716129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.961+0000 7f1f716129c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.961+0000 7f1f716129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:27.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.961+0000 7f1f716129c0 20 started sync module instance, tier type = 2024-09-12T17:41:27.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.961+0000 7f1f716129c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:27.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.981+0000 7f1f716129c0 20 add_watcher() i=0 2024-09-12T17:41:27.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.981+0000 7f1f716129c0 20 add_watcher() i=1 2024-09-12T17:41:27.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.981+0000 7f1f716129c0 20 add_watcher() i=2 2024-09-12T17:41:27.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.981+0000 7f1f716129c0 20 add_watcher() i=3 2024-09-12T17:41:27.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.981+0000 7f1f716129c0 20 add_watcher() i=4 2024-09-12T17:41:27.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.981+0000 7f1f716129c0 20 add_watcher() i=5 2024-09-12T17:41:27.987 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.981+0000 7f1f716129c0 20 add_watcher() i=6 2024-09-12T17:41:27.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.985+0000 7f1f716129c0 20 add_watcher() i=7 2024-09-12T17:41:27.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.985+0000 7f1f716129c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:27.993 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.989+0000 7f1e25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:27.994 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.989+0000 7f1f716129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:27.994 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.989+0000 7f1f716129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:27.994 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.989+0000 7f1f716129c0 5 note: GC not initialized 2024-09-12T17:41:27.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.989+0000 7f1e24fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:27.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.989+0000 7f1f716129c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:27.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.989+0000 7f1f716129c0 20 Filter name: none 2024-09-12T17:41:27.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.993+0000 7f1d9e7fc640 20 reqs_thread_entry: start 2024-09-12T17:41:27.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.993+0000 7f1f716129c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:41:27.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.993+0000 7f1f716129c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.993+0000 7f1f716129c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:27.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.993+0000 7f1f716129c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:41:27.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.993+0000 7f1f716129c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:41:27.997 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.993+0000 7f1f716129c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : miss 2024-09-12T17:41:27.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.993+0000 7f1f716129c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:27.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.993+0000 7f1f716129c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:27.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.993+0000 7f1f716129c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:41:27.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.993+0000 7f1f716129c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:41:27.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.993+0000 7f1f716129c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:27.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.993+0000 7f1f716129c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:27.999 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.993+0000 7f1f716129c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:41:28.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.997+0000 7f1f716129c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:41:28.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.997+0000 7f1f716129c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:41:28.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.997+0000 7f1f716129c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:28.003 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:27.997+0000 7f1f716129c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:41:28.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.001+0000 7f1e527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333541 cookie 94323445265440 notifier 8598 bl.length()=911 2024-09-12T17:41:28.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.001+0000 7f1e527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:41:28.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.001+0000 7f1e527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:41:28.004 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.001+0000 7f1e527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:28.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.001+0000 7f1f716129c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:41:28.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.001+0000 7f1f716129c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:41:28.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.001+0000 7f1f716129c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:41:28.007 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.001+0000 7f1f716129c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:41:28.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.017+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.0 2024-09-12T17:41:28.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.017+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.0 2024-09-12T17:41:28.021 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.017+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:41:28.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.017+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:41:28.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.017+0000 7f1f716129c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T17:41:28.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.017+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:41:28.022 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.017+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:41:28.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.017+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:41:28.023 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.017+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:41:28.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.021+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:41:28.024 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.021+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:41:28.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.021+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:41:28.025 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.021+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:41:28.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.021+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:41:28.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.021+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:41:28.026 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.021+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:41:28.027 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.021+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:41:28.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.025+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:41:28.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.025+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:41:28.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.025+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:41:28.028 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.025+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:41:28.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.025+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:41:28.029 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.025+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:41:28.030 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.025+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:41:28.031 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.025+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:41:28.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.029+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:41:28.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.029+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:41:28.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.029+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:41:28.032 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.029+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:41:28.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.029+0000 7f1f716129c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:28.034 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.029+0000 7f1f716129c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:41:28.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.033+0000 7f1f716129c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:41:28.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.033+0000 7f1f716129c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:41:28.035 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.033+0000 7f1f716129c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:28.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.033+0000 7f1f716129c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:41:28.036 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.033+0000 7f1e52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333542 cookie 94323445265440 notifier 8598 bl.length()=911 2024-09-12T17:41:28.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.033+0000 7f1e52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:41:28.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.033+0000 7f1e52ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:41:28.037 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.033+0000 7f1e52ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:28.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.033+0000 7f1f716129c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:41:28.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.033+0000 7f1f716129c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:41:28.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.033+0000 7f1f716129c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:41:28.039 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.033+0000 7f1f716129c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:41:28.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.041+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:41:28.045 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.041+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.0 2024-09-12T17:41:28.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.041+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:41:28.046 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.041+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.1 2024-09-12T17:41:28.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.041+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:41:28.047 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.041+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.2 2024-09-12T17:41:28.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.045+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:41:28.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.045+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.3 2024-09-12T17:41:28.048 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.045+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:41:28.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.045+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.4 2024-09-12T17:41:28.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.045+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:41:28.049 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.045+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.5 2024-09-12T17:41:28.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.045+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:41:28.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.045+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.6 2024-09-12T17:41:28.050 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.045+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:41:28.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.045+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.7 2024-09-12T17:41:28.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.045+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:41:28.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.045+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.8 2024-09-12T17:41:28.051 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.045+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:41:28.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.045+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.9 2024-09-12T17:41:28.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.049+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:41:28.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.049+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.10 2024-09-12T17:41:28.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.049+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:41:28.052 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.049+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.11 2024-09-12T17:41:28.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.049+0000 7f1f716129c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:41:28.053 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.049+0000 7f1f716129c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.2.12 2024-09-12T17:41:28.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.049+0000 7f1f716129c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:28.054 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.049+0000 7f1f716129c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 2024-09-12T17:41:28.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.053+0000 7f1f716129c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:41:28.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.053+0000 7f1f716129c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:41:28.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.053+0000 7f1f716129c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:28.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.053+0000 7f1f716129c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18, ofs0, ns] 2024-09-12T17:41:28.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.053+0000 7f1e527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333543 cookie 94323445265440 notifier 8598 bl.length()=879 2024-09-12T17:41:28.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.053+0000 7f1e527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 info.flags=0x17 2024-09-12T17:41:28.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.053+0000 7f1e527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18 to cache LRU end 2024-09-12T17:41:28.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.053+0000 7f1e527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:28.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.057+0000 7f1f716129c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_sources= new_sources= 2024-09-12T17:41:28.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.057+0000 7f1f716129c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential sources added=[] removed=[] 2024-09-12T17:41:28.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.057+0000 7f1f716129c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): orig_dests= new_dests= 2024-09-12T17:41:28.060 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.057+0000 7f1f716129c0 20 handle_bi_update(): bucket=:a-bucket[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18]): potential dests added=[] removed=[] 2024-09-12T17:41:28.064 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.061+0000 7f1f716129c0 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-12T17:41:28.068 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.065+0000 7f1e25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:28.072 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.069+0000 7f1f716129c0 20 remove_watcher() i=0 2024-09-12T17:41:28.073 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.069+0000 7f1f716129c0 2 removed watcher, disabling cache 2024-09-12T17:41:28.075 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.069+0000 7f1f716129c0 20 remove_watcher() i=1 2024-09-12T17:41:28.077 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.073+0000 7f1f716129c0 20 remove_watcher() i=2 2024-09-12T17:41:28.079 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.077+0000 7f1f716129c0 20 remove_watcher() i=3 2024-09-12T17:41:28.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.077+0000 7f1f716129c0 20 remove_watcher() i=4 2024-09-12T17:41:28.083 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.077+0000 7f1f716129c0 20 remove_watcher() i=5 2024-09-12T17:41:28.084 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.081+0000 7f1f716129c0 20 remove_watcher() i=6 2024-09-12T17:41:28.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.081+0000 7f1f716129c0 20 remove_watcher() i=7 2024-09-12T17:41:28.101 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T17:41:28.131 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:28.131 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:28.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.173+0000 7f025dd169c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.173+0000 7f025dd169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.173+0000 7f025dd169c0 20 realm 2024-09-12T17:41:28.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.173+0000 7f025dd169c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.177+0000 7f025dd169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.177+0000 7f025dd169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:28.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.177+0000 7f025dd169c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.177+0000 7f025dd169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.180 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.177+0000 7f025dd169c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.177+0000 7f025dd169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:28.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.177+0000 7f025dd169c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.177+0000 7f025dd169c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:28.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.177+0000 7f025dd169c0 20 searching for the correct realm 2024-09-12T17:41:28.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.181+0000 7f025b01b640 0 -- 172.21.15.119:0/3714311714 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f024c06d2d0 msgr2=0x7f024c0631a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:28.400 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.397+0000 7f025c01d640 0 -- 172.21.15.119:0/3714311714 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f025010b910 msgr2=0x7f02500f4510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:28.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:28.416 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:28.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:28.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:28.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:28.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:28.417 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:28.418 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:28.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 20 zone default found 2024-09-12T17:41:28.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 4 Realm: () 2024-09-12T17:41:28.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:28.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:28.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:28.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 20 zonegroup default 2024-09-12T17:41:28.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.413+0000 7f025dd169c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.417+0000 7f025dd169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.417+0000 7f025dd169c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.417+0000 7f025dd169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.417+0000 7f025dd169c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.417+0000 7f025dd169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.417+0000 7f025dd169c0 20 started sync module instance, tier type = 2024-09-12T17:41:28.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.417+0000 7f025dd169c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:28.442 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.437+0000 7f025dd169c0 20 add_watcher() i=0 2024-09-12T17:41:28.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.437+0000 7f025dd169c0 20 add_watcher() i=1 2024-09-12T17:41:28.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.437+0000 7f025dd169c0 20 add_watcher() i=2 2024-09-12T17:41:28.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.437+0000 7f025dd169c0 20 add_watcher() i=3 2024-09-12T17:41:28.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.437+0000 7f025dd169c0 20 add_watcher() i=4 2024-09-12T17:41:28.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.437+0000 7f025dd169c0 20 add_watcher() i=5 2024-09-12T17:41:28.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.437+0000 7f025dd169c0 20 add_watcher() i=6 2024-09-12T17:41:28.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.441+0000 7f025dd169c0 20 add_watcher() i=7 2024-09-12T17:41:28.444 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.441+0000 7f025dd169c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:28.448 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.445+0000 7f0111fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:28.450 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.445+0000 7f025dd169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:28.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.445+0000 7f025dd169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:28.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.445+0000 7f025dd169c0 5 note: GC not initialized 2024-09-12T17:41:28.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.445+0000 7f0110fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:28.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.445+0000 7f025dd169c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:28.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.445+0000 7f025dd169c0 20 Filter name: none 2024-09-12T17:41:28.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.445+0000 7f008a7fc640 20 reqs_thread_entry: start 2024-09-12T17:41:28.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.445+0000 7f025dd169c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.449+0000 7f025dd169c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:41:28.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.449+0000 7f025dd169c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.449+0000 7f025dd169c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:41:28.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.449+0000 7f025dd169c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:28.452 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.449+0000 7f025dd169c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T17:41:28.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.449+0000 7f025dd169c0 20 INFO: main: starting shard=0 2024-09-12T17:41:28.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.449+0000 7f025dd169c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.0 2024-09-12T17:41:28.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.449+0000 7f025dd169c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18.3.0 2024-09-12T17:41:28.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.449+0000 7f025dd169c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:28.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.449+0000 7f025dd169c0 20 INFO: main: done 2024-09-12T17:41:28.454 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.449+0000 7f0111fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:28.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.457+0000 7f025dd169c0 20 remove_watcher() i=0 2024-09-12T17:41:28.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.457+0000 7f025dd169c0 2 removed watcher, disabling cache 2024-09-12T17:41:28.462 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.457+0000 7f025dd169c0 20 remove_watcher() i=1 2024-09-12T17:41:28.464 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.461+0000 7f025dd169c0 20 remove_watcher() i=2 2024-09-12T17:41:28.467 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.461+0000 7f025dd169c0 20 remove_watcher() i=3 2024-09-12T17:41:28.469 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.465+0000 7f025dd169c0 20 remove_watcher() i=4 2024-09-12T17:41:28.471 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.465+0000 7f025dd169c0 20 remove_watcher() i=5 2024-09-12T17:41:28.472 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.469+0000 7f025dd169c0 20 remove_watcher() i=6 2024-09-12T17:41:28.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.469+0000 7f025dd169c0 20 remove_watcher() i=7 2024-09-12T17:41:28.498 INFO:tasks.workunit.client.0.smithi119.stderr: test: PUT succeeds during reshard 2024-09-12T17:41:28.498 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:41:28.529 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:28.529 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:28.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.573+0000 7f8bd9fcd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.573+0000 7f8bd9fcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.573+0000 7f8bd9fcd9c0 20 realm 2024-09-12T17:41:28.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.573+0000 7f8bd9fcd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.573+0000 7f8bd9fcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.573+0000 7f8bd9fcd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:28.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.573+0000 7f8bd9fcd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.573+0000 7f8bd9fcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:28.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.573+0000 7f8bd9fcd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.577+0000 7f8bd9fcd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:28.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.577+0000 7f8bd9fcd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:28.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.577+0000 7f8bd9fcd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:28.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.577+0000 7f8bd9fcd9c0 20 searching for the correct realm 2024-09-12T17:41:28.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.581+0000 7f8bd82d4640 0 -- 172.21.15.119:0/4215151824 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f8bc0028070 msgr2=0x7f8bc0043920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:28.801 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:28.797+0000 7f8bd72d2640 0 -- 172.21.15.119:0/4215151824 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f8bd010daf0 msgr2=0x7f8bd00fd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.013+0000 7f8bd9fcd9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.013+0000 7f8bd9fcd9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.013+0000 7f8bd9fcd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.013+0000 7f8bd9fcd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.013+0000 7f8bd9fcd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.013+0000 7f8bd9fcd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.013+0000 7f8bd9fcd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.392 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.013+0000 7f8bd9fcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.013+0000 7f8bd9fcd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.017+0000 7f8bd9fcd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.017+0000 7f8bd9fcd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.017+0000 7f8bd9fcd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.017+0000 7f8bd9fcd9c0 20 zone default found 2024-09-12T17:41:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.017+0000 7f8bd9fcd9c0 4 Realm: () 2024-09-12T17:41:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.017+0000 7f8bd9fcd9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.017+0000 7f8bd9fcd9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.017+0000 7f8bd9fcd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.017+0000 7f8bd9fcd9c0 20 zonegroup default 2024-09-12T17:41:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.017+0000 7f8bd9fcd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.393 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.017+0000 7f8bd9fcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:29.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.017+0000 7f8bd9fcd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.017+0000 7f8bd9fcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:29.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.017+0000 7f8bd9fcd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.021+0000 7f8bd9fcd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:29.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.021+0000 7f8bd9fcd9c0 20 started sync module instance, tier type = 2024-09-12T17:41:29.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.021+0000 7f8bd9fcd9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:29.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.041+0000 7f8bd9fcd9c0 20 add_watcher() i=0 2024-09-12T17:41:29.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.041+0000 7f8bd9fcd9c0 20 add_watcher() i=1 2024-09-12T17:41:29.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.041+0000 7f8bd9fcd9c0 20 add_watcher() i=2 2024-09-12T17:41:29.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.041+0000 7f8bd9fcd9c0 20 add_watcher() i=3 2024-09-12T17:41:29.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.041+0000 7f8bd9fcd9c0 20 add_watcher() i=4 2024-09-12T17:41:29.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.041+0000 7f8bd9fcd9c0 20 add_watcher() i=5 2024-09-12T17:41:29.394 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.041+0000 7f8bd9fcd9c0 20 add_watcher() i=6 2024-09-12T17:41:29.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.045+0000 7f8bd9fcd9c0 20 add_watcher() i=7 2024-09-12T17:41:29.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.045+0000 7f8bd9fcd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:29.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.049+0000 7f8a8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:29.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.049+0000 7f8bd9fcd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:29.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.049+0000 7f8bd9fcd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:29.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.049+0000 7f8bd9fcd9c0 5 note: GC not initialized 2024-09-12T17:41:29.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.049+0000 7f8a8cfe1640 20 reqs_thread_entry: start 2024-09-12T17:41:29.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.049+0000 7f8bd9fcd9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:29.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.049+0000 7f8bd9fcd9c0 20 Filter name: none 2024-09-12T17:41:29.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.053+0000 7f8a067fc640 20 reqs_thread_entry: start 2024-09-12T17:41:29.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.053+0000 7f8bd9fcd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.395 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.053+0000 7f8bd9fcd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:41:29.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.053+0000 7f8bd9fcd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.053+0000 7f8bd9fcd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:41:29.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.053+0000 7f8bd9fcd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:29.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.053+0000 7f8bd9fcd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.053+0000 7f8bd9fcd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:41:29.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.053+0000 7f8bd9fcd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.053+0000 7f8bd9fcd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:41:29.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.053+0000 7f8bd9fcd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:29.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.057+0000 7f8a8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:29.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.065+0000 7f8bd9fcd9c0 20 remove_watcher() i=0 2024-09-12T17:41:29.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.065+0000 7f8bd9fcd9c0 2 removed watcher, disabling cache 2024-09-12T17:41:29.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.065+0000 7f8bd9fcd9c0 20 remove_watcher() i=1 2024-09-12T17:41:29.396 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.069+0000 7f8bd9fcd9c0 20 remove_watcher() i=2 2024-09-12T17:41:29.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.069+0000 7f8bd9fcd9c0 20 remove_watcher() i=3 2024-09-12T17:41:29.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.073+0000 7f8bd9fcd9c0 20 remove_watcher() i=4 2024-09-12T17:41:29.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.073+0000 7f8bd9fcd9c0 20 remove_watcher() i=5 2024-09-12T17:41:29.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.077+0000 7f8bd9fcd9c0 20 remove_watcher() i=6 2024-09-12T17:41:29.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.077+0000 7f8bd9fcd9c0 20 remove_watcher() i=7 2024-09-12T17:41:29.397 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:41:29.397 INFO:tasks.workunit.client.0.smithi119.stderr:BUCKET_STATS: 2024-09-12T17:41:29.397 INFO:tasks.workunit.client.0.smithi119.stderr:bucket: myver id: 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T17:41:29.397 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:41:29.397 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-12T17:41:29.397 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:29.397 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:29.397 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.185+0000 7fc0884f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.185+0000 7fc0884f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:29.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.185+0000 7fc0884f69c0 20 realm 2024-09-12T17:41:29.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.185+0000 7fc0884f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.185+0000 7fc0884f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:29.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.185+0000 7fc0884f69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:29.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.185+0000 7fc0884f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.185+0000 7fc0884f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:29.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.185+0000 7fc0884f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.189+0000 7fc0884f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:29.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.189+0000 7fc0884f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.189+0000 7fc0884f69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:29.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.189+0000 7fc0884f69c0 20 searching for the correct realm 2024-09-12T17:41:29.398 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.193+0000 7fc0867fd640 0 -- 172.21.15.119:0/2965411860 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fc07c097040 msgr2=0x7fc07c06e860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:29.399 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.201+0000 7fc0857fb640 0 -- 172.21.15.119:0/2965411860 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fc0800f7440 msgr2=0x7fc08012b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:29.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:29.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:29.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:29.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:29.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:29.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:29.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:29.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:29.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:29.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 zone default found 2024-09-12T17:41:29.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 4 Realm: () 2024-09-12T17:41:29.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:29.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:29.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:29.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 zonegroup default 2024-09-12T17:41:29.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:29.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:29.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:29.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 started sync module instance, tier type = 2024-09-12T17:41:29.425 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.421+0000 7fc0884f69c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:29.450 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.445+0000 7fc0884f69c0 20 add_watcher() i=0 2024-09-12T17:41:29.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.445+0000 7fc0884f69c0 20 add_watcher() i=1 2024-09-12T17:41:29.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.445+0000 7fc0884f69c0 20 add_watcher() i=2 2024-09-12T17:41:29.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.445+0000 7fc0884f69c0 20 add_watcher() i=3 2024-09-12T17:41:29.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.445+0000 7fc0884f69c0 20 add_watcher() i=4 2024-09-12T17:41:29.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.445+0000 7fc0884f69c0 20 add_watcher() i=5 2024-09-12T17:41:29.451 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.445+0000 7fc0884f69c0 20 add_watcher() i=6 2024-09-12T17:41:29.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.449+0000 7fc0884f69c0 20 add_watcher() i=7 2024-09-12T17:41:29.453 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.449+0000 7fc0884f69c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:29.456 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.453+0000 7fbf3bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:29.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.453+0000 7fc0884f69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:29.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.453+0000 7fc0884f69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:29.457 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.453+0000 7fc0884f69c0 5 note: GC not initialized 2024-09-12T17:41:29.458 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.453+0000 7fbf3afe5640 20 reqs_thread_entry: start 2024-09-12T17:41:29.458 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.453+0000 7fc0884f69c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:29.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.453+0000 7fc0884f69c0 20 Filter name: none 2024-09-12T17:41:29.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.453+0000 7fbf38fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:29.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.453+0000 7fc0884f69c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:41:29.459 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.453+0000 7fc0884f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.457+0000 7fc0884f69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:41:29.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.457+0000 7fc0884f69c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:41:29.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.457+0000 7fc0884f69c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:41:29.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.457+0000 7fc0884f69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 : miss 2024-09-12T17:41:29.460 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.457+0000 7fc0884f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:29.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.457+0000 7fc0884f69c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:41:29.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.457+0000 7fc0884f69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:29.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.457+0000 7fc0884f69c0 10 adding default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:29.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.457+0000 7fc0884f69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:29.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.457+0000 7fc0884f69c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:29.461 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.457+0000 7fc0884f69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 2024-09-12T17:41:29.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.469+0000 7fc0884f69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:29.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.469+0000 7fc0884f69c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:29.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.469+0000 7fc0884f69c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:29.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.469+0000 7fc0884f69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19, ofs0, ns] 2024-09-12T17:41:29.473 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.469+0000 7fbf68ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333524 cookie 94849570536928 notifier 8126 bl.length()=905 2024-09-12T17:41:29.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.469+0000 7fbf68ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:29.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.469+0000 7fbf68ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:29.474 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.469+0000 7fbf68ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:29.477 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.473+0000 7fc0884f69c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_sources= new_sources= 2024-09-12T17:41:29.477 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.473+0000 7fc0884f69c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential sources added=[] removed=[] 2024-09-12T17:41:29.477 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.473+0000 7fc0884f69c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_dests= new_dests= 2024-09-12T17:41:29.478 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.473+0000 7fc0884f69c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential dests added=[] removed=[] 2024-09-12T17:41:29.490 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:29.485+0000 7fc0884f69c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T17:41:30.264 INFO:tasks.workunit.client.0.smithi119.stderr:put object successful 2024-09-12T17:41:34.491 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.0 2024-09-12T17:41:34.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.0 2024-09-12T17:41:34.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.1 2024-09-12T17:41:34.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.1 2024-09-12T17:41:34.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.2 2024-09-12T17:41:34.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.2 2024-09-12T17:41:34.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.3 2024-09-12T17:41:34.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.3 2024-09-12T17:41:34.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.4 2024-09-12T17:41:34.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.4 2024-09-12T17:41:34.492 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.5 2024-09-12T17:41:34.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.5 2024-09-12T17:41:34.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.6 2024-09-12T17:41:34.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.6 2024-09-12T17:41:34.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.7 2024-09-12T17:41:34.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.7 2024-09-12T17:41:34.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.8 2024-09-12T17:41:34.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.8 2024-09-12T17:41:34.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.9 2024-09-12T17:41:34.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.9 2024-09-12T17:41:34.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.10 2024-09-12T17:41:34.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.10 2024-09-12T17:41:34.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.11 2024-09-12T17:41:34.493 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.11 2024-09-12T17:41:34.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.12 2024-09-12T17:41:34.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.12 2024-09-12T17:41:34.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.0 2024-09-12T17:41:34.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.489+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.0 2024-09-12T17:41:34.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.493+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.1 2024-09-12T17:41:34.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.493+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.1 2024-09-12T17:41:34.494 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.493+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.2 2024-09-12T17:41:34.495 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.493+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.2 2024-09-12T17:41:34.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.497+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.3 2024-09-12T17:41:34.496 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.497+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.3 2024-09-12T17:41:34.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.497+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.4 2024-09-12T17:41:34.498 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.497+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.4 2024-09-12T17:41:34.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.501+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.5 2024-09-12T17:41:34.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.501+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.5 2024-09-12T17:41:34.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.501+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.6 2024-09-12T17:41:34.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.501+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.6 2024-09-12T17:41:34.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.501+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.7 2024-09-12T17:41:34.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.501+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.7 2024-09-12T17:41:34.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.505+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.8 2024-09-12T17:41:34.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.505+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.8 2024-09-12T17:41:34.505 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.505+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.9 2024-09-12T17:41:34.505 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.505+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.9 2024-09-12T17:41:34.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.505+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.10 2024-09-12T17:41:34.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.505+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.10 2024-09-12T17:41:34.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.509+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.11 2024-09-12T17:41:34.508 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.509+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.11 2024-09-12T17:41:34.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.513+0000 7fc0884f69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:34.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.513+0000 7fc0884f69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 2024-09-12T17:41:34.517 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.517+0000 7fc0884f69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:34.517 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.517+0000 7fc0884f69c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:34.518 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.517+0000 7fc0884f69c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:34.518 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.517+0000 7fc0884f69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19, ofs0, ns] 2024-09-12T17:41:34.518 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.517+0000 7fbf697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333525 cookie 94849570536928 notifier 8126 bl.length()=905 2024-09-12T17:41:34.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.517+0000 7fbf697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:34.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.517+0000 7fbf697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:34.519 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.517+0000 7fbf697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:34.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.521+0000 7fc0884f69c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_sources= new_sources= 2024-09-12T17:41:34.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.521+0000 7fc0884f69c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential sources added=[] removed=[] 2024-09-12T17:41:34.522 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.521+0000 7fc0884f69c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_dests= new_dests= 2024-09-12T17:41:34.523 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.521+0000 7fc0884f69c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential dests added=[] removed=[] 2024-09-12T17:41:34.529 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.529+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.0 2024-09-12T17:41:34.530 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.529+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.0 2024-09-12T17:41:34.531 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.529+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.1 2024-09-12T17:41:34.531 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.529+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.1 2024-09-12T17:41:34.531 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.529+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.2 2024-09-12T17:41:34.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.529+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.2 2024-09-12T17:41:34.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.533+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.3 2024-09-12T17:41:34.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.533+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.3 2024-09-12T17:41:34.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.533+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.4 2024-09-12T17:41:34.533 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.533+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.4 2024-09-12T17:41:34.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.533+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.5 2024-09-12T17:41:34.534 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.533+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.5 2024-09-12T17:41:34.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.537+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.6 2024-09-12T17:41:34.535 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.537+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.6 2024-09-12T17:41:34.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.537+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.7 2024-09-12T17:41:34.536 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.537+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.7 2024-09-12T17:41:34.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.537+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.8 2024-09-12T17:41:34.537 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.537+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.8 2024-09-12T17:41:34.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.537+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.9 2024-09-12T17:41:34.538 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.537+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.9 2024-09-12T17:41:34.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.537+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.10 2024-09-12T17:41:34.539 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.537+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.10 2024-09-12T17:41:34.540 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.541+0000 7fc0884f69c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.11 2024-09-12T17:41:34.541 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.541+0000 7fc0884f69c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.1.11 2024-09-12T17:41:34.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.545+0000 7fc0884f69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:34.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.545+0000 7fc0884f69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 2024-09-12T17:41:34.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.549+0000 7fc0884f69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:34.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.549+0000 7fc0884f69c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:34.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.549+0000 7fc0884f69c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:34.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.549+0000 7fc0884f69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19, ofs0, ns] 2024-09-12T17:41:34.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.549+0000 7fbf697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333526 cookie 94849570536928 notifier 8126 bl.length()=873 2024-09-12T17:41:34.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.549+0000 7fbf697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:34.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.549+0000 7fbf697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:34.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.549+0000 7fbf697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:34.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.553+0000 7fc0884f69c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_sources= new_sources= 2024-09-12T17:41:34.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.553+0000 7fc0884f69c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential sources added=[] removed=[] 2024-09-12T17:41:34.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.553+0000 7fc0884f69c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_dests= new_dests= 2024-09-12T17:41:34.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.553+0000 7fc0884f69c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential dests added=[] removed=[] 2024-09-12T17:41:34.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.561+0000 7fc0884f69c0 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-12T17:41:34.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.565+0000 7fbf3bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:34.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.569+0000 7fc0884f69c0 20 remove_watcher() i=0 2024-09-12T17:41:34.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.569+0000 7fc0884f69c0 2 removed watcher, disabling cache 2024-09-12T17:41:34.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.573+0000 7fc0884f69c0 20 remove_watcher() i=1 2024-09-12T17:41:34.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.577+0000 7fc0884f69c0 20 remove_watcher() i=2 2024-09-12T17:41:34.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.577+0000 7fc0884f69c0 20 remove_watcher() i=3 2024-09-12T17:41:34.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.581+0000 7fc0884f69c0 20 remove_watcher() i=4 2024-09-12T17:41:34.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.585+0000 7fc0884f69c0 20 remove_watcher() i=5 2024-09-12T17:41:34.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.585+0000 7fc0884f69c0 20 remove_watcher() i=6 2024-09-12T17:41:34.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:34.589+0000 7fc0884f69c0 20 remove_watcher() i=7 2024-09-12T17:41:35.270 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T17:41:35.270 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T17:41:36.174 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:41:36.621 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:41:38.225 INFO:tasks.workunit.client.0.smithi119.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:41:38.225 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T17:41:38.260 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:38.260 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:38.309 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.308+0000 7f19ab63b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.308+0000 7f19ab63b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:38.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.308+0000 7f19ab63b9c0 20 realm 2024-09-12T17:41:38.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.308+0000 7f19ab63b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.308+0000 7f19ab63b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:38.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.308+0000 7f19ab63b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:38.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.308+0000 7f19ab63b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.308+0000 7f19ab63b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:38.311 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.308+0000 7f19ab63b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.312+0000 7f19ab63b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:38.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.312+0000 7f19ab63b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.312+0000 7f19ab63b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:38.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.312+0000 7f19ab63b9c0 20 searching for the correct realm 2024-09-12T17:41:38.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.316+0000 7f19a8940640 0 -- 172.21.15.119:0/1068095895 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f1994002350 msgr2=0x7f199c0641c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:38.532 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.532+0000 7f19a9942640 0 -- 172.21.15.119:0/1068095895 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f19a011dc20 msgr2=0x7f19a011bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:38.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.548+0000 7f19ab63b9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:38.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.548+0000 7f19ab63b9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:38.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.548+0000 7f19ab63b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:38.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.548+0000 7f19ab63b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:38.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.548+0000 7f19ab63b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:38.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.548+0000 7f19ab63b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:38.551 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.548+0000 7f19ab63b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.548+0000 7f19ab63b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:38.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.548+0000 7f19ab63b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:38.552 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:38.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 20 zone default found 2024-09-12T17:41:38.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 4 Realm: () 2024-09-12T17:41:38.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:38.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:38.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:38.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 20 zonegroup default 2024-09-12T17:41:38.553 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:38.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:38.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:38.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 20 started sync module instance, tier type = 2024-09-12T17:41:38.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.552+0000 7f19ab63b9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:38.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.576+0000 7f19ab63b9c0 20 add_watcher() i=0 2024-09-12T17:41:38.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.576+0000 7f19ab63b9c0 20 add_watcher() i=1 2024-09-12T17:41:38.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.576+0000 7f19ab63b9c0 20 add_watcher() i=2 2024-09-12T17:41:38.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.576+0000 7f19ab63b9c0 20 add_watcher() i=3 2024-09-12T17:41:38.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.576+0000 7f19ab63b9c0 20 add_watcher() i=4 2024-09-12T17:41:38.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.576+0000 7f19ab63b9c0 20 add_watcher() i=5 2024-09-12T17:41:38.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.576+0000 7f19ab63b9c0 20 add_watcher() i=6 2024-09-12T17:41:38.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.576+0000 7f19ab63b9c0 20 add_watcher() i=7 2024-09-12T17:41:38.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.576+0000 7f19ab63b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:38.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.580+0000 7f185f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:38.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.580+0000 7f19ab63b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:38.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.580+0000 7f19ab63b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:38.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.580+0000 7f19ab63b9c0 5 note: GC not initialized 2024-09-12T17:41:38.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.580+0000 7f185e7e4640 20 reqs_thread_entry: start 2024-09-12T17:41:38.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.580+0000 7f19ab63b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:38.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.580+0000 7f19ab63b9c0 20 Filter name: none 2024-09-12T17:41:38.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.580+0000 7f17cffff640 20 reqs_thread_entry: start 2024-09-12T17:41:38.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.584+0000 7f19ab63b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.584+0000 7f19ab63b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:41:38.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.584+0000 7f19ab63b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.584+0000 7f19ab63b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:41:38.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.584+0000 7f19ab63b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:38.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.584+0000 7f19ab63b9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T17:41:38.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.584+0000 7f19ab63b9c0 20 INFO: main: starting shard=0 2024-09-12T17:41:38.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.584+0000 7f19ab63b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.0 2024-09-12T17:41:38.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.584+0000 7f19ab63b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.0 2024-09-12T17:41:38.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.584+0000 7f19ab63b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:38.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.584+0000 7f19ab63b9c0 20 INFO: main: starting shard=1 2024-09-12T17:41:38.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.584+0000 7f19ab63b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.1 2024-09-12T17:41:38.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.584+0000 7f19ab63b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.1 2024-09-12T17:41:38.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.588+0000 7f19ab63b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:38.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.588+0000 7f19ab63b9c0 20 INFO: main: starting shard=2 2024-09-12T17:41:38.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.588+0000 7f19ab63b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.2 2024-09-12T17:41:38.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.588+0000 7f19ab63b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.2 2024-09-12T17:41:38.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.588+0000 7f19ab63b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:38.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.588+0000 7f19ab63b9c0 20 INFO: main: starting shard=3 2024-09-12T17:41:38.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.588+0000 7f19ab63b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.3 2024-09-12T17:41:38.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.588+0000 7f19ab63b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.3 2024-09-12T17:41:38.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.588+0000 7f19ab63b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:38.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.588+0000 7f19ab63b9c0 20 INFO: main: starting shard=4 2024-09-12T17:41:38.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.588+0000 7f19ab63b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.4 2024-09-12T17:41:38.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.588+0000 7f19ab63b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.4 2024-09-12T17:41:38.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.588+0000 7f19ab63b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:38.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.588+0000 7f19ab63b9c0 20 INFO: main: starting shard=5 2024-09-12T17:41:38.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.588+0000 7f19ab63b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.5 2024-09-12T17:41:38.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.588+0000 7f19ab63b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.5 2024-09-12T17:41:38.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.592+0000 7f19ab63b9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:41:38.592 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.592+0000 7f19ab63b9c0 20 INFO: main: starting shard=6 2024-09-12T17:41:38.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.592+0000 7f19ab63b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.6 2024-09-12T17:41:38.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.592+0000 7f19ab63b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.6 2024-09-12T17:41:38.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.592+0000 7f19ab63b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:38.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.592+0000 7f19ab63b9c0 20 INFO: main: starting shard=7 2024-09-12T17:41:38.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.592+0000 7f19ab63b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.7 2024-09-12T17:41:38.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.592+0000 7f19ab63b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.7 2024-09-12T17:41:38.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.592+0000 7f19ab63b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:38.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.592+0000 7f19ab63b9c0 20 INFO: main: starting shard=8 2024-09-12T17:41:38.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.592+0000 7f19ab63b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.8 2024-09-12T17:41:38.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.592+0000 7f19ab63b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.8 2024-09-12T17:41:38.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.592+0000 7f19ab63b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:38.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.592+0000 7f19ab63b9c0 20 INFO: main: starting shard=9 2024-09-12T17:41:38.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.592+0000 7f19ab63b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.9 2024-09-12T17:41:38.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.592+0000 7f19ab63b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.9 2024-09-12T17:41:38.595 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.596+0000 7f19ab63b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:38.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.596+0000 7f19ab63b9c0 20 INFO: main: starting shard=10 2024-09-12T17:41:38.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.596+0000 7f19ab63b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.10 2024-09-12T17:41:38.596 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.596+0000 7f19ab63b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.10 2024-09-12T17:41:38.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.596+0000 7f19ab63b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:38.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.596+0000 7f19ab63b9c0 20 INFO: main: starting shard=11 2024-09-12T17:41:38.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.596+0000 7f19ab63b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.11 2024-09-12T17:41:38.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.596+0000 7f19ab63b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.11 2024-09-12T17:41:38.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.596+0000 7f19ab63b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:38.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.596+0000 7f19ab63b9c0 20 INFO: main: starting shard=12 2024-09-12T17:41:38.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.596+0000 7f19ab63b9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.12 2024-09-12T17:41:38.598 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.596+0000 7f19ab63b9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.12 2024-09-12T17:41:38.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.596+0000 7f19ab63b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:38.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.596+0000 7f19ab63b9c0 20 INFO: main: done 2024-09-12T17:41:38.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.600+0000 7f185f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:38.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.604+0000 7f19ab63b9c0 20 remove_watcher() i=0 2024-09-12T17:41:38.605 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.604+0000 7f19ab63b9c0 2 removed watcher, disabling cache 2024-09-12T17:41:38.607 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.608+0000 7f19ab63b9c0 20 remove_watcher() i=1 2024-09-12T17:41:38.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.608+0000 7f19ab63b9c0 20 remove_watcher() i=2 2024-09-12T17:41:38.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.612+0000 7f19ab63b9c0 20 remove_watcher() i=3 2024-09-12T17:41:38.614 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.612+0000 7f19ab63b9c0 20 remove_watcher() i=4 2024-09-12T17:41:38.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.616+0000 7f19ab63b9c0 20 remove_watcher() i=5 2024-09-12T17:41:38.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.616+0000 7f19ab63b9c0 20 remove_watcher() i=6 2024-09-12T17:41:38.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.616+0000 7f19ab63b9c0 20 remove_watcher() i=7 2024-09-12T17:41:38.828 INFO:tasks.workunit.client.0.smithi119.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:41:38.829 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T17:41:38.865 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:38.865 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:38.911 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.912+0000 7fdb82d339c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.912+0000 7fdb82d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:38.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.912+0000 7fdb82d339c0 20 realm 2024-09-12T17:41:38.913 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.912+0000 7fdb82d339c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.914 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.912+0000 7fdb82d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:38.914 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.912+0000 7fdb82d339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:38.914 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.912+0000 7fdb82d339c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.914 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.912+0000 7fdb82d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:38.914 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.912+0000 7fdb82d339c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.916+0000 7fdb82d339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:38.915 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.916+0000 7fdb82d339c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:38.917 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.916+0000 7fdb82d339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:38.917 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.916+0000 7fdb82d339c0 20 searching for the correct realm 2024-09-12T17:41:38.921 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.920+0000 7fdb8103a640 0 -- 172.21.15.119:0/2132508824 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55673cd90010 msgr2=0x55673cd92400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:38.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:38.928+0000 7fdb80038640 0 -- 172.21.15.119:0/2132508824 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fdb78062b30 msgr2=0x7fdb78083280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:39.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.144+0000 7fdb82d339c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:39.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.144+0000 7fdb82d339c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:39.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.144+0000 7fdb82d339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:39.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.144+0000 7fdb82d339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:39.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.144+0000 7fdb82d339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:39.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.144+0000 7fdb82d339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:39.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.144+0000 7fdb82d339c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.144+0000 7fdb82d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:39.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.144+0000 7fdb82d339c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.148+0000 7fdb82d339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:39.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.148+0000 7fdb82d339c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.148+0000 7fdb82d339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:39.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.148+0000 7fdb82d339c0 20 zone default found 2024-09-12T17:41:39.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.148+0000 7fdb82d339c0 4 Realm: () 2024-09-12T17:41:39.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.148+0000 7fdb82d339c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:39.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.148+0000 7fdb82d339c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:39.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.148+0000 7fdb82d339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:39.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.148+0000 7fdb82d339c0 20 zonegroup default 2024-09-12T17:41:39.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.148+0000 7fdb82d339c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.148+0000 7fdb82d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:39.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.148+0000 7fdb82d339c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.148+0000 7fdb82d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:39.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.148+0000 7fdb82d339c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.152+0000 7fdb82d339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:39.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.152+0000 7fdb82d339c0 20 started sync module instance, tier type = 2024-09-12T17:41:39.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.152+0000 7fdb82d339c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:39.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.172+0000 7fdb82d339c0 20 add_watcher() i=0 2024-09-12T17:41:39.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.172+0000 7fdb82d339c0 20 add_watcher() i=1 2024-09-12T17:41:39.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.172+0000 7fdb82d339c0 20 add_watcher() i=2 2024-09-12T17:41:39.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.172+0000 7fdb82d339c0 20 add_watcher() i=3 2024-09-12T17:41:39.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.172+0000 7fdb82d339c0 20 add_watcher() i=4 2024-09-12T17:41:39.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.172+0000 7fdb82d339c0 20 add_watcher() i=5 2024-09-12T17:41:39.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.172+0000 7fdb82d339c0 20 add_watcher() i=6 2024-09-12T17:41:39.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.176+0000 7fdb82d339c0 20 add_watcher() i=7 2024-09-12T17:41:39.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.176+0000 7fdb82d339c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:39.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.180+0000 7fda36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:39.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.180+0000 7fdb82d339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:39.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.180+0000 7fdb82d339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:39.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.180+0000 7fdb82d339c0 5 note: GC not initialized 2024-09-12T17:41:39.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.184+0000 7fda35fe3640 20 reqs_thread_entry: start 2024-09-12T17:41:39.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.184+0000 7fdb82d339c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:39.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.184+0000 7fdb82d339c0 20 Filter name: none 2024-09-12T17:41:39.184 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.184+0000 7fd9a77fe640 20 reqs_thread_entry: start 2024-09-12T17:41:39.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.184+0000 7fdb82d339c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.184+0000 7fdb82d339c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:41:39.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.184+0000 7fdb82d339c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.184+0000 7fdb82d339c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:41:39.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.184+0000 7fdb82d339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:39.186 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.184+0000 7fdb82d339c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T17:41:39.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.184+0000 7fdb82d339c0 20 INFO: main: starting shard=0 2024-09-12T17:41:39.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.184+0000 7fdb82d339c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.0 2024-09-12T17:41:39.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.184+0000 7fdb82d339c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.0 2024-09-12T17:41:39.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.188+0000 7fdb82d339c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.188+0000 7fdb82d339c0 20 INFO: main: starting shard=1 2024-09-12T17:41:39.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.188+0000 7fdb82d339c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.1 2024-09-12T17:41:39.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.188+0000 7fdb82d339c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.1 2024-09-12T17:41:39.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.188+0000 7fdb82d339c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.188+0000 7fdb82d339c0 20 INFO: main: starting shard=2 2024-09-12T17:41:39.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.188+0000 7fdb82d339c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.2 2024-09-12T17:41:39.189 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.188+0000 7fdb82d339c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.2 2024-09-12T17:41:39.190 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.188+0000 7fdb82d339c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.188+0000 7fdb82d339c0 20 INFO: main: starting shard=3 2024-09-12T17:41:39.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.188+0000 7fdb82d339c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.3 2024-09-12T17:41:39.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.188+0000 7fdb82d339c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.3 2024-09-12T17:41:39.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.192+0000 7fdb82d339c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.192+0000 7fdb82d339c0 20 INFO: main: starting shard=4 2024-09-12T17:41:39.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.192+0000 7fdb82d339c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.4 2024-09-12T17:41:39.192 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.192+0000 7fdb82d339c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.4 2024-09-12T17:41:39.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.192+0000 7fdb82d339c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.192+0000 7fdb82d339c0 20 INFO: main: starting shard=5 2024-09-12T17:41:39.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.192+0000 7fdb82d339c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.5 2024-09-12T17:41:39.193 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.192+0000 7fdb82d339c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.5 2024-09-12T17:41:39.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.192+0000 7fdb82d339c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.192+0000 7fdb82d339c0 20 INFO: main: starting shard=6 2024-09-12T17:41:39.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.192+0000 7fdb82d339c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.6 2024-09-12T17:41:39.194 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.192+0000 7fdb82d339c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.6 2024-09-12T17:41:39.195 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 20 INFO: main: starting shard=7 2024-09-12T17:41:39.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.7 2024-09-12T17:41:39.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.7 2024-09-12T17:41:39.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.196 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 20 INFO: main: starting shard=8 2024-09-12T17:41:39.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.8 2024-09-12T17:41:39.197 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.8 2024-09-12T17:41:39.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 20 INFO: main: starting shard=9 2024-09-12T17:41:39.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.9 2024-09-12T17:41:39.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.9 2024-09-12T17:41:39.198 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:41:39.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 20 INFO: main: starting shard=10 2024-09-12T17:41:39.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.10 2024-09-12T17:41:39.199 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.10 2024-09-12T17:41:39.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 20 INFO: main: starting shard=11 2024-09-12T17:41:39.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.11 2024-09-12T17:41:39.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.196+0000 7fdb82d339c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.11 2024-09-12T17:41:39.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.200+0000 7fdb82d339c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.200 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.200+0000 7fdb82d339c0 20 INFO: main: starting shard=12 2024-09-12T17:41:39.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.200+0000 7fdb82d339c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.12 2024-09-12T17:41:39.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.200+0000 7fdb82d339c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.12 2024-09-12T17:41:39.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.200+0000 7fdb82d339c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.201 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.200+0000 7fdb82d339c0 20 INFO: main: done 2024-09-12T17:41:39.202 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.200+0000 7fda36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:39.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.208+0000 7fdb82d339c0 20 remove_watcher() i=0 2024-09-12T17:41:39.208 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.208+0000 7fdb82d339c0 2 removed watcher, disabling cache 2024-09-12T17:41:39.210 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.208+0000 7fdb82d339c0 20 remove_watcher() i=1 2024-09-12T17:41:39.213 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.212+0000 7fdb82d339c0 20 remove_watcher() i=2 2024-09-12T17:41:39.215 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.212+0000 7fdb82d339c0 20 remove_watcher() i=3 2024-09-12T17:41:39.217 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.216+0000 7fdb82d339c0 20 remove_watcher() i=4 2024-09-12T17:41:39.219 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.220+0000 7fdb82d339c0 20 remove_watcher() i=5 2024-09-12T17:41:39.221 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.220+0000 7fdb82d339c0 20 remove_watcher() i=6 2024-09-12T17:41:39.223 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.220+0000 7fdb82d339c0 20 remove_watcher() i=7 2024-09-12T17:41:39.416 INFO:tasks.workunit.client.0.smithi119.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:41:39.417 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T17:41:39.454 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:39.454 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:39.501 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.500+0000 7f98352359c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.500+0000 7f98352359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:39.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.500+0000 7f98352359c0 20 realm 2024-09-12T17:41:39.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.500+0000 7f98352359c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.504+0000 7f98352359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:39.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.504+0000 7f98352359c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:39.503 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.504+0000 7f98352359c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.504+0000 7f98352359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:39.504 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.504+0000 7f98352359c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.505 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.504+0000 7f98352359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:39.505 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.504+0000 7f98352359c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.504+0000 7f98352359c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:39.507 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.504+0000 7f98352359c0 20 searching for the correct realm 2024-09-12T17:41:39.509 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.508+0000 7f983353c640 0 -- 172.21.15.119:0/3045243894 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f9828026070 msgr2=0x7f982808c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:39.517 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.516+0000 7f983253a640 0 -- 172.21.15.119:0/3045243894 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f982c132400 msgr2=0x7f982c1160d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:39.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.732+0000 7f98352359c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:39.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.732+0000 7f98352359c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:39.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.732+0000 7f98352359c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:39.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.732+0000 7f98352359c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:39.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.732+0000 7f98352359c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:39.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.732+0000 7f98352359c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:39.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.732+0000 7f98352359c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.732+0000 7f98352359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:39.735 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.732+0000 7f98352359c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:39.736 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:39.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 20 zone default found 2024-09-12T17:41:39.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 4 Realm: () 2024-09-12T17:41:39.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:39.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:39.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:39.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 20 zonegroup default 2024-09-12T17:41:39.737 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:39.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:39.738 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:39.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 20 started sync module instance, tier type = 2024-09-12T17:41:39.739 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.736+0000 7f98352359c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:39.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.764+0000 7f98352359c0 20 add_watcher() i=0 2024-09-12T17:41:39.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.764+0000 7f98352359c0 20 add_watcher() i=1 2024-09-12T17:41:39.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.764+0000 7f98352359c0 20 add_watcher() i=2 2024-09-12T17:41:39.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.764+0000 7f98352359c0 20 add_watcher() i=3 2024-09-12T17:41:39.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.764+0000 7f98352359c0 20 add_watcher() i=4 2024-09-12T17:41:39.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.764+0000 7f98352359c0 20 add_watcher() i=5 2024-09-12T17:41:39.764 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.764+0000 7f98352359c0 20 add_watcher() i=6 2024-09-12T17:41:39.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.764+0000 7f98352359c0 20 add_watcher() i=7 2024-09-12T17:41:39.766 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.764+0000 7f98352359c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:39.770 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.768+0000 7f96e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:39.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.768+0000 7f98352359c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:39.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.768+0000 7f98352359c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:39.771 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.772+0000 7f98352359c0 5 note: GC not initialized 2024-09-12T17:41:39.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.772+0000 7f9663fff640 20 reqs_thread_entry: start 2024-09-12T17:41:39.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.772+0000 7f98352359c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:39.772 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.772+0000 7f98352359c0 20 Filter name: none 2024-09-12T17:41:39.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.772+0000 7f9661ffb640 20 reqs_thread_entry: start 2024-09-12T17:41:39.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.772+0000 7f98352359c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.772+0000 7f98352359c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:41:39.773 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.772+0000 7f98352359c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:39.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.772+0000 7f98352359c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:41:39.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.772+0000 7f98352359c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:39.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.772+0000 7f98352359c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T17:41:39.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.772+0000 7f98352359c0 20 INFO: main: starting shard=0 2024-09-12T17:41:39.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.772+0000 7f98352359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.0 2024-09-12T17:41:39.775 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.772+0000 7f98352359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.0 2024-09-12T17:41:39.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.776+0000 7f98352359c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:41:39.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.776+0000 7f98352359c0 20 INFO: main: starting shard=1 2024-09-12T17:41:39.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.776+0000 7f98352359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.1 2024-09-12T17:41:39.776 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.776+0000 7f98352359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.1 2024-09-12T17:41:39.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.776+0000 7f98352359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.776+0000 7f98352359c0 20 INFO: main: starting shard=2 2024-09-12T17:41:39.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.776+0000 7f98352359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.2 2024-09-12T17:41:39.777 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.776+0000 7f98352359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.2 2024-09-12T17:41:39.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.776+0000 7f98352359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.776+0000 7f98352359c0 20 INFO: main: starting shard=3 2024-09-12T17:41:39.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.776+0000 7f98352359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.3 2024-09-12T17:41:39.779 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.776+0000 7f98352359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.3 2024-09-12T17:41:39.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.780+0000 7f98352359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.780+0000 7f98352359c0 20 INFO: main: starting shard=4 2024-09-12T17:41:39.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.780+0000 7f98352359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.4 2024-09-12T17:41:39.780 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.780+0000 7f98352359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.4 2024-09-12T17:41:39.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.780+0000 7f98352359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.780+0000 7f98352359c0 20 INFO: main: starting shard=5 2024-09-12T17:41:39.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.780+0000 7f98352359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.5 2024-09-12T17:41:39.781 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.780+0000 7f98352359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.5 2024-09-12T17:41:39.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.780+0000 7f98352359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.780+0000 7f98352359c0 20 INFO: main: starting shard=6 2024-09-12T17:41:39.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.780+0000 7f98352359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.6 2024-09-12T17:41:39.783 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.780+0000 7f98352359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.6 2024-09-12T17:41:39.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.784+0000 7f98352359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.784 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.784+0000 7f98352359c0 20 INFO: main: starting shard=7 2024-09-12T17:41:39.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.784+0000 7f98352359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.7 2024-09-12T17:41:39.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.784+0000 7f98352359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.7 2024-09-12T17:41:39.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.784+0000 7f98352359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.784+0000 7f98352359c0 20 INFO: main: starting shard=8 2024-09-12T17:41:39.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.784+0000 7f98352359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.8 2024-09-12T17:41:39.785 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.784+0000 7f98352359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.8 2024-09-12T17:41:39.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.784+0000 7f98352359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.784+0000 7f98352359c0 20 INFO: main: starting shard=9 2024-09-12T17:41:39.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.784+0000 7f98352359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.9 2024-09-12T17:41:39.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.784+0000 7f98352359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.9 2024-09-12T17:41:39.786 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.784+0000 7f98352359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.784+0000 7f98352359c0 20 INFO: main: starting shard=10 2024-09-12T17:41:39.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.784+0000 7f98352359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.10 2024-09-12T17:41:39.787 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.784+0000 7f98352359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.10 2024-09-12T17:41:39.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.788+0000 7f98352359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.788+0000 7f98352359c0 20 INFO: main: starting shard=11 2024-09-12T17:41:39.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.788+0000 7f98352359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.11 2024-09-12T17:41:39.788 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.788+0000 7f98352359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.11 2024-09-12T17:41:39.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.788+0000 7f98352359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.788+0000 7f98352359c0 20 INFO: main: starting shard=12 2024-09-12T17:41:39.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.788+0000 7f98352359c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.12 2024-09-12T17:41:39.789 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.788+0000 7f98352359c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.12 2024-09-12T17:41:39.790 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.788+0000 7f98352359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:39.790 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.788+0000 7f98352359c0 20 INFO: main: done 2024-09-12T17:41:39.791 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.792+0000 7f96e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:39.797 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.796+0000 7f98352359c0 20 remove_watcher() i=0 2024-09-12T17:41:39.798 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.796+0000 7f98352359c0 2 removed watcher, disabling cache 2024-09-12T17:41:39.799 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.796+0000 7f98352359c0 20 remove_watcher() i=1 2024-09-12T17:41:39.802 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.800+0000 7f98352359c0 20 remove_watcher() i=2 2024-09-12T17:41:39.804 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.804+0000 7f98352359c0 20 remove_watcher() i=3 2024-09-12T17:41:39.806 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.804+0000 7f98352359c0 20 remove_watcher() i=4 2024-09-12T17:41:39.808 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.808+0000 7f98352359c0 20 remove_watcher() i=5 2024-09-12T17:41:39.810 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.808+0000 7f98352359c0 20 remove_watcher() i=6 2024-09-12T17:41:39.811 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:39.808+0000 7f98352359c0 20 remove_watcher() i=7 2024-09-12T17:41:39.861 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:41:40.299 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:41:40.741 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T17:41:40.775 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:40.775 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:40.819 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:40.816+0000 7f48617179c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:40.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:40.820+0000 7f48617179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:40.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:40.820+0000 7f48617179c0 20 realm 2024-09-12T17:41:40.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:40.820+0000 7f48617179c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:40.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:40.820+0000 7f48617179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:40.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:40.820+0000 7f48617179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:40.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:40.820+0000 7f48617179c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:40.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:40.820+0000 7f48617179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:40.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:40.820+0000 7f48617179c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:40.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:40.820+0000 7f48617179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:40.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:40.820+0000 7f48617179c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:40.824 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:40.824+0000 7f48617179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:40.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:40.824+0000 7f48617179c0 20 searching for the correct realm 2024-09-12T17:41:40.826 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:40.824+0000 7f485ea1c640 0 -- 172.21.15.119:0/435645166 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f48500e3020 msgr2=0x7f48500e3b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:41.038 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.036+0000 7f485fa1e640 0 -- 172.21.15.119:0/435645166 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f4848003100 msgr2=0x7f485405c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:41.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.052+0000 7f48617179c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:41.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.052+0000 7f48617179c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:41.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.052+0000 7f48617179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:41.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.052+0000 7f48617179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:41.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.052+0000 7f48617179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:41.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.052+0000 7f48617179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:41.055 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.052+0000 7f48617179c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.056+0000 7f48617179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:41.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.056+0000 7f48617179c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.056+0000 7f48617179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:41.056 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.056+0000 7f48617179c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.056+0000 7f48617179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:41.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.056+0000 7f48617179c0 20 zone default found 2024-09-12T17:41:41.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.056+0000 7f48617179c0 4 Realm: () 2024-09-12T17:41:41.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.056+0000 7f48617179c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:41.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.056+0000 7f48617179c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:41.057 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.056+0000 7f48617179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:41.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.056+0000 7f48617179c0 20 zonegroup default 2024-09-12T17:41:41.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.056+0000 7f48617179c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.056+0000 7f48617179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:41.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.056+0000 7f48617179c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.056+0000 7f48617179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:41.058 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.056+0000 7f48617179c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.060+0000 7f48617179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:41.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.060+0000 7f48617179c0 20 started sync module instance, tier type = 2024-09-12T17:41:41.059 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.060+0000 7f48617179c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:41.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.080+0000 7f48617179c0 20 add_watcher() i=0 2024-09-12T17:41:41.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.080+0000 7f48617179c0 20 add_watcher() i=1 2024-09-12T17:41:41.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.080+0000 7f48617179c0 20 add_watcher() i=2 2024-09-12T17:41:41.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.080+0000 7f48617179c0 20 add_watcher() i=3 2024-09-12T17:41:41.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.080+0000 7f48617179c0 20 add_watcher() i=4 2024-09-12T17:41:41.080 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.080+0000 7f48617179c0 20 add_watcher() i=5 2024-09-12T17:41:41.081 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.080+0000 7f48617179c0 20 add_watcher() i=6 2024-09-12T17:41:41.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.080+0000 7f48617179c0 20 add_watcher() i=7 2024-09-12T17:41:41.082 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.080+0000 7f48617179c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:41.085 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.084+0000 7f4715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:41.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.084+0000 7f48617179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:41.086 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.084+0000 7f48617179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:41.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.084+0000 7f48617179c0 5 note: GC not initialized 2024-09-12T17:41:41.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.084+0000 7f4714fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:41.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.088+0000 7f48617179c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:41.087 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.088+0000 7f48617179c0 20 Filter name: none 2024-09-12T17:41:41.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.088+0000 7f468e7fc640 20 reqs_thread_entry: start 2024-09-12T17:41:41.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.088+0000 7f48617179c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:41:41.088 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.088+0000 7f48617179c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.088+0000 7f48617179c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:41:41.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.088+0000 7f48617179c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:41:41.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.088+0000 7f48617179c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:41:41.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.088+0000 7f48617179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 : miss 2024-09-12T17:41:41.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.088+0000 7f48617179c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.089 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.088+0000 7f48617179c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:41:41.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.088+0000 7f48617179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:41.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.088+0000 7f48617179c0 10 adding default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:41.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.088+0000 7f48617179c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:41.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.088+0000 7f48617179c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:41.090 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.088+0000 7f48617179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 2024-09-12T17:41:41.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.100+0000 7f48617179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:41.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.100+0000 7f48617179c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:41.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.100+0000 7f48617179c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:41.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.100+0000 7f48617179c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19, ofs0, ns] 2024-09-12T17:41:41.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.100+0000 7f4742ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333527 cookie 94742420453712 notifier 8754 bl.length()=905 2024-09-12T17:41:41.101 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.100+0000 7f4742ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:41.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.100+0000 7f4742ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:41.102 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.100+0000 7f4742ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:41.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.104+0000 7f48617179c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_sources= new_sources= 2024-09-12T17:41:41.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.104+0000 7f48617179c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential sources added=[] removed=[] 2024-09-12T17:41:41.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.104+0000 7f48617179c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_dests= new_dests= 2024-09-12T17:41:41.105 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.104+0000 7f48617179c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential dests added=[] removed=[] 2024-09-12T17:41:41.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.0 2024-09-12T17:41:41.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.0 2024-09-12T17:41:41.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.1 2024-09-12T17:41:41.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.1 2024-09-12T17:41:41.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.2 2024-09-12T17:41:41.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.2 2024-09-12T17:41:41.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.3 2024-09-12T17:41:41.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.3 2024-09-12T17:41:41.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.4 2024-09-12T17:41:41.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.4 2024-09-12T17:41:41.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.5 2024-09-12T17:41:41.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.5 2024-09-12T17:41:41.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.6 2024-09-12T17:41:41.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.6 2024-09-12T17:41:41.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.7 2024-09-12T17:41:41.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.7 2024-09-12T17:41:41.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.8 2024-09-12T17:41:41.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.8 2024-09-12T17:41:41.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.118 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.10 2024-09-12T17:41:41.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.10 2024-09-12T17:41:41.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.11 2024-09-12T17:41:41.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.11 2024-09-12T17:41:41.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.12 2024-09-12T17:41:41.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.12 2024-09-12T17:41:41.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.13 2024-09-12T17:41:41.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.13 2024-09-12T17:41:41.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.14 2024-09-12T17:41:41.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.14 2024-09-12T17:41:41.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.15 2024-09-12T17:41:41.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.15 2024-09-12T17:41:41.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.16 2024-09-12T17:41:41.119 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.16 2024-09-12T17:41:41.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.0 2024-09-12T17:41:41.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.0 2024-09-12T17:41:41.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.1 2024-09-12T17:41:41.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.1 2024-09-12T17:41:41.120 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.2 2024-09-12T17:41:41.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.116+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.2 2024-09-12T17:41:41.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.120+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.3 2024-09-12T17:41:41.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.120+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.3 2024-09-12T17:41:41.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.120+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.4 2024-09-12T17:41:41.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.120+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.4 2024-09-12T17:41:41.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.120+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.5 2024-09-12T17:41:41.121 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.120+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.5 2024-09-12T17:41:41.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.120+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.6 2024-09-12T17:41:41.122 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.120+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.6 2024-09-12T17:41:41.124 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.124+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.7 2024-09-12T17:41:41.124 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.124+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.7 2024-09-12T17:41:41.124 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.124+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.8 2024-09-12T17:41:41.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.124+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.8 2024-09-12T17:41:41.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.124+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.9 2024-09-12T17:41:41.125 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.124+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.9 2024-09-12T17:41:41.126 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.124+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.10 2024-09-12T17:41:41.126 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.124+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.10 2024-09-12T17:41:41.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.128+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.11 2024-09-12T17:41:41.127 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.128+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.11 2024-09-12T17:41:41.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.128+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.12 2024-09-12T17:41:41.128 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.128+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.12 2024-09-12T17:41:41.132 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.132+0000 7f48617179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:41.133 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.132+0000 7f48617179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 2024-09-12T17:41:41.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.136+0000 7f48617179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:41.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.136+0000 7f48617179c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:41.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.136+0000 7f48617179c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:41.136 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.136+0000 7f48617179c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19, ofs0, ns] 2024-09-12T17:41:41.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.136+0000 7f4742ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 94742420453712 notifier 8754 bl.length()=905 2024-09-12T17:41:41.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.136+0000 7f4742ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:41.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.136+0000 7f4742ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:41.137 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.136+0000 7f4742ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:41.139 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.140+0000 7f48617179c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_sources= new_sources= 2024-09-12T17:41:41.139 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.140+0000 7f48617179c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential sources added=[] removed=[] 2024-09-12T17:41:41.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.140+0000 7f48617179c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_dests= new_dests= 2024-09-12T17:41:41.140 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.140+0000 7f48617179c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential dests added=[] removed=[] 2024-09-12T17:41:41.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.144+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.0 2024-09-12T17:41:41.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.144+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.0 2024-09-12T17:41:41.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.144+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.1 2024-09-12T17:41:41.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.144+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.1 2024-09-12T17:41:41.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.144+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.2 2024-09-12T17:41:41.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.144+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.2 2024-09-12T17:41:41.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.148+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.3 2024-09-12T17:41:41.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.148+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.3 2024-09-12T17:41:41.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.148+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.4 2024-09-12T17:41:41.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.148+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.4 2024-09-12T17:41:41.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.148+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.5 2024-09-12T17:41:41.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.148+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.5 2024-09-12T17:41:41.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.148+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.6 2024-09-12T17:41:41.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.148+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.6 2024-09-12T17:41:41.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.148+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.7 2024-09-12T17:41:41.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.148+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.7 2024-09-12T17:41:41.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.152+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.8 2024-09-12T17:41:41.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.152+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.8 2024-09-12T17:41:41.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.152+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.9 2024-09-12T17:41:41.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.152+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.9 2024-09-12T17:41:41.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.152+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.10 2024-09-12T17:41:41.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.152+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.10 2024-09-12T17:41:41.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.152+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.11 2024-09-12T17:41:41.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.152+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.11 2024-09-12T17:41:41.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.152+0000 7f48617179c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.12 2024-09-12T17:41:41.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.152+0000 7f48617179c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.2.12 2024-09-12T17:41:41.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.152+0000 7f48617179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:41:41.155 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.152+0000 7f48617179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 2024-09-12T17:41:41.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.156+0000 7f48617179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:41.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.156+0000 7f48617179c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:41.159 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.156+0000 7f48617179c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:41.159 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.156+0000 7f48617179c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19, ofs0, ns] 2024-09-12T17:41:41.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.160+0000 7f47427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333529 cookie 94742420453712 notifier 8754 bl.length()=873 2024-09-12T17:41:41.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.160+0000 7f47427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:41.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.160+0000 7f47427fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:41.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.160+0000 7f47427fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:41.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.160+0000 7f48617179c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_sources= new_sources= 2024-09-12T17:41:41.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.160+0000 7f48617179c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential sources added=[] removed=[] 2024-09-12T17:41:41.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.160+0000 7f48617179c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): orig_dests= new_dests= 2024-09-12T17:41:41.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.160+0000 7f48617179c0 20 handle_bi_update(): bucket=:myver[4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19]): potential dests added=[] removed=[] 2024-09-12T17:41:41.169 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.168+0000 7f48617179c0 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-12T17:41:41.174 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.172+0000 7f4715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:41.178 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.176+0000 7f48617179c0 20 remove_watcher() i=0 2024-09-12T17:41:41.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.176+0000 7f48617179c0 2 removed watcher, disabling cache 2024-09-12T17:41:41.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.180+0000 7f48617179c0 20 remove_watcher() i=1 2024-09-12T17:41:41.183 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.180+0000 7f48617179c0 20 remove_watcher() i=2 2024-09-12T17:41:41.185 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.184+0000 7f48617179c0 20 remove_watcher() i=3 2024-09-12T17:41:41.187 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.188+0000 7f48617179c0 20 remove_watcher() i=4 2024-09-12T17:41:41.188 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.188+0000 7f48617179c0 20 remove_watcher() i=5 2024-09-12T17:41:41.190 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.188+0000 7f48617179c0 20 remove_watcher() i=6 2024-09-12T17:41:41.191 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.192+0000 7f48617179c0 20 remove_watcher() i=7 2024-09-12T17:41:41.206 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:41:41.237 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:41.237 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:41.279 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.276+0000 7f61fa95c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.281 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.280+0000 7f61fa95c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:41.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.280+0000 7f61fa95c9c0 20 realm 2024-09-12T17:41:41.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.280+0000 7f61fa95c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.280+0000 7f61fa95c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:41.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.280+0000 7f61fa95c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:41.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.280+0000 7f61fa95c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.280+0000 7f61fa95c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:41.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.280+0000 7f61fa95c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.282 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.280+0000 7f61fa95c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:41.283 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.280+0000 7f61fa95c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.284+0000 7f61fa95c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:41.285 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.284+0000 7f61fa95c9c0 20 searching for the correct realm 2024-09-12T17:41:41.287 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.284+0000 7f61f8c63640 0 -- 172.21.15.119:0/739781809 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f61e0090b90 msgr2=0x7f61e005b140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:41.294 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.292+0000 7f61efc61640 0 -- 172.21.15.119:0/739781809 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f61f01080b0 msgr2=0x7f61f00fd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:41.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.508+0000 7f61fa95c9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:41.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.508+0000 7f61fa95c9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:41.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.508+0000 7f61fa95c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:41.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.508+0000 7f61fa95c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:41.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.508+0000 7f61fa95c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:41.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.508+0000 7f61fa95c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:41.510 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.508+0000 7f61fa95c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.508+0000 7f61fa95c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:41.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.508+0000 7f61fa95c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.508+0000 7f61fa95c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:41.511 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.508+0000 7f61fa95c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.512+0000 7f61fa95c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:41.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.512+0000 7f61fa95c9c0 20 zone default found 2024-09-12T17:41:41.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.512+0000 7f61fa95c9c0 4 Realm: () 2024-09-12T17:41:41.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.512+0000 7f61fa95c9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:41.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.512+0000 7f61fa95c9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:41.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.512+0000 7f61fa95c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:41.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.512+0000 7f61fa95c9c0 20 zonegroup default 2024-09-12T17:41:41.512 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.512+0000 7f61fa95c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.512+0000 7f61fa95c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:41.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.512+0000 7f61fa95c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.512+0000 7f61fa95c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:41.513 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.512+0000 7f61fa95c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.512+0000 7f61fa95c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:41.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.512+0000 7f61fa95c9c0 20 started sync module instance, tier type = 2024-09-12T17:41:41.514 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.512+0000 7f61fa95c9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:41.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.548+0000 7f61fa95c9c0 20 add_watcher() i=0 2024-09-12T17:41:41.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.548+0000 7f61fa95c9c0 20 add_watcher() i=1 2024-09-12T17:41:41.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.548+0000 7f61fa95c9c0 20 add_watcher() i=2 2024-09-12T17:41:41.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.548+0000 7f61fa95c9c0 20 add_watcher() i=3 2024-09-12T17:41:41.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.548+0000 7f61fa95c9c0 20 add_watcher() i=4 2024-09-12T17:41:41.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.548+0000 7f61fa95c9c0 20 add_watcher() i=5 2024-09-12T17:41:41.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.548+0000 7f61fa95c9c0 20 add_watcher() i=6 2024-09-12T17:41:41.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.548+0000 7f61fa95c9c0 20 add_watcher() i=7 2024-09-12T17:41:41.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.548+0000 7f61fa95c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:41.554 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.552+0000 7f60af7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:41.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.552+0000 7f61fa95c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:41.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.552+0000 7f61fa95c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:41.555 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 5 note: GC not initialized 2024-09-12T17:41:41.556 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f60ae7dc640 20 reqs_thread_entry: start 2024-09-12T17:41:41.556 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:41.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 20 Filter name: none 2024-09-12T17:41:41.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f60a77fe640 20 reqs_thread_entry: start 2024-09-12T17:41:41.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:41:41.557 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:41:41.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:41:41.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:41:41.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 : miss 2024-09-12T17:41:41.558 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:41.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:41:41.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 info.flags=0x17 2024-09-12T17:41:41.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 to cache LRU end 2024-09-12T17:41:41.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:41.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:41:41.559 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19 2024-09-12T17:41:41.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.0 2024-09-12T17:41:41.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.556+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.0 2024-09-12T17:41:41.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.560+0000 7f61fa95c9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:41:41.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.560+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.1 2024-09-12T17:41:41.560 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.560+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.1 2024-09-12T17:41:41.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.560+0000 7f61fa95c9c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T17:41:41.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.560+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.2 2024-09-12T17:41:41.561 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.560+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.2 2024-09-12T17:41:41.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.560+0000 7f61fa95c9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:41:41.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.560+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.3 2024-09-12T17:41:41.562 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.560+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.3 2024-09-12T17:41:41.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.564+0000 7f61fa95c9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:41:41.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.564+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.4 2024-09-12T17:41:41.564 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.564+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.4 2024-09-12T17:41:41.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.564+0000 7f61fa95c9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:41:41.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.564+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.5 2024-09-12T17:41:41.565 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.564+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.5 2024-09-12T17:41:41.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.564+0000 7f61fa95c9c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T17:41:41.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.564+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.6 2024-09-12T17:41:41.566 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.564+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.6 2024-09-12T17:41:41.567 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.568+0000 7f61fa95c9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:41:41.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.568+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.7 2024-09-12T17:41:41.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.568+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.7 2024-09-12T17:41:41.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.568+0000 7f61fa95c9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:41:41.568 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.568+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.8 2024-09-12T17:41:41.569 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.568+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.8 2024-09-12T17:41:41.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.568+0000 7f61fa95c9c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T17:41:41.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.568+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.570 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.568+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.568+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.10 2024-09-12T17:41:41.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.568+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.10 2024-09-12T17:41:41.571 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.572+0000 7f61fa95c9c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T17:41:41.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.572+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.11 2024-09-12T17:41:41.572 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.572+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.11 2024-09-12T17:41:41.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.572+0000 7f61fa95c9c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T17:41:41.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.572+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.12 2024-09-12T17:41:41.573 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.572+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.12 2024-09-12T17:41:41.574 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.572+0000 7f61fa95c9c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T17:41:41.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.572+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.13 2024-09-12T17:41:41.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.572+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.13 2024-09-12T17:41:41.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.572+0000 7f61fa95c9c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T17:41:41.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.572+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.14 2024-09-12T17:41:41.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.572+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.14 2024-09-12T17:41:41.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.576+0000 7f61fa95c9c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T17:41:41.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.576+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.15 2024-09-12T17:41:41.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.576+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.15 2024-09-12T17:41:41.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.576+0000 7f61fa95c9c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T17:41:41.576 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.576+0000 7f61fa95c9c0 10 bucket_obj is .dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.16 2024-09-12T17:41:41.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.576+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.16 2024-09-12T17:41:41.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.576+0000 7f61fa95c9c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T17:41:41.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.576+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.578 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.576+0000 7f61fa95c9c0 20 get_obj_state: octx=0x55849550b970 obj=myver:x state=0x5584957c60e8 s->prefetch_data=0 2024-09-12T17:41:41.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.576+0000 7f61fa95c9c0 20 get_obj_state: setting s->obj_tag to fgkuzz6qv82jw0dscr97i15eoekyl5o3 2024-09-12T17:41:41.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.576+0000 7f61fa95c9c0 20 get_obj_state_impl: setting s->olh_tag to qhm2zvo3b5fpp75118ve0qj1hfj918jy 2024-09-12T17:41:41.579 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.576+0000 7f61fa95c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qhm2zvo3b5fpp75118ve0qj1hfj918jy 2024-09-12T17:41:41.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.580+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.584+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.584+0000 7f61fa95c9c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T17:41:41.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.584+0000 7f61fa95c9c0 20 olh_log_entry: epoch=2 op=3 key=x[4vyVnH9eEaCeRg13bEc33EmytRBgzzh] 2024-09-12T17:41:41.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.584+0000 7f61fa95c9c0 20 get_obj_state: octx=0x55849550b970 obj=myver:_:4vyVnH9eEaCeRg13bEc33EmytRBgzzh_x state=0x5584957bcf78 s->prefetch_data=0 2024-09-12T17:41:41.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.584+0000 7f61fa95c9c0 10 manifest: total_size = 22 2024-09-12T17:41:41.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.584+0000 7f61fa95c9c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4200955794731666941 2024-09-12T17:41:41.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.584+0000 7f61fa95c9c0 20 get_obj_state: octx=0x55849550b970 obj=myver:_:4vyVnH9eEaCeRg13bEc33EmytRBgzzh_x state=0x5584957bcf78 s->prefetch_data=0 2024-09-12T17:41:41.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.584+0000 7f61fa95c9c0 20 prepare_atomic_modification: state is not atomic. state=0x5584957bcf78 2024-09-12T17:41:41.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.588+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.592+0000 7f61fa95c9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:41:41.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.592+0000 7f61fa95c9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:41:41.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.592+0000 7f61fa95c9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:41:41.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.592+0000 7f61fa95c9c0 5 delete_objs_inline: removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19__shadow:4vyVnH9eEaCeRg13bEc33EmytRBgzzh_._gr46BgDYWlnzPs7HJSt4p-uoVN05sz_0 2024-09-12T17:41:41.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.596+0000 7f60cf7fe640 20 handle_completion(): completion ok for obj=x[4vyVnH9eEaCeRg13bEc33EmytRBgzzh] 2024-09-12T17:41:41.597 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.596+0000 7f61fa95c9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:41:41.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.600+0000 7f61fa95c9c0 20 get_obj_state: octx=0x55849550b970 obj=myver:x state=0x5584957c60e8 s->prefetch_data=0 2024-09-12T17:41:41.600 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.600+0000 7f61fa95c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qhm2zvo3b5fpp75118ve0qj1hfj918jy 2024-09-12T17:41:41.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.604+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.608 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.608+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.609 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.608+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.608+0000 7f61fa95c9c0 20 get_obj_state: octx=0x55849550b970 obj=myver:y state=0x5584957eecf8 s->prefetch_data=0 2024-09-12T17:41:41.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.608+0000 7f61fa95c9c0 20 get_obj_state: setting s->obj_tag to onoy9uyffnzpiteisjamaclrk1c4a38d 2024-09-12T17:41:41.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.608+0000 7f61fa95c9c0 20 get_obj_state_impl: setting s->olh_tag to 8kcmg2c0tr0pq94jdort11jezyalulp6 2024-09-12T17:41:41.611 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.608+0000 7f61fa95c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8kcmg2c0tr0pq94jdort11jezyalulp6 2024-09-12T17:41:41.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.612+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.616 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.616+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.616+0000 7f61fa95c9c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T17:41:41.617 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.616+0000 7f61fa95c9c0 20 olh_log_entry: epoch=2 op=3 key=y[i169RRo9NNQPt2KRwRzQNAkS76-b9bR] 2024-09-12T17:41:41.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.616+0000 7f61fa95c9c0 20 get_obj_state: octx=0x55849550b970 obj=myver:_:i169RRo9NNQPt2KRwRzQNAkS76-b9bR_y state=0x5584957c5fb8 s->prefetch_data=0 2024-09-12T17:41:41.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.616+0000 7f61fa95c9c0 10 manifest: total_size = 12 2024-09-12T17:41:41.618 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.616+0000 7f61fa95c9c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3484679586671897052 2024-09-12T17:41:41.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.616+0000 7f61fa95c9c0 20 get_obj_state: octx=0x55849550b970 obj=myver:_:i169RRo9NNQPt2KRwRzQNAkS76-b9bR_y state=0x5584957c5fb8 s->prefetch_data=0 2024-09-12T17:41:41.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.616+0000 7f61fa95c9c0 20 prepare_atomic_modification: state is not atomic. state=0x5584957c5fb8 2024-09-12T17:41:41.619 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.616+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.624+0000 7f61fa95c9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:41:41.623 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.624+0000 7f61fa95c9c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:41:41.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.624+0000 7f61fa95c9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:41:41.624 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.624+0000 7f61fa95c9c0 5 delete_objs_inline: removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19__shadow:i169RRo9NNQPt2KRwRzQNAkS76-b9bR_.k_44MHqi9AIuirKkIwJSEoTpe0ZJdwn_0 2024-09-12T17:41:41.626 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.624+0000 7f61fa95c9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:41:41.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.628+0000 7f60ceffd640 20 handle_completion(): completion ok for obj=y[i169RRo9NNQPt2KRwRzQNAkS76-b9bR] 2024-09-12T17:41:41.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.628+0000 7f61fa95c9c0 20 get_obj_state: octx=0x55849550b970 obj=myver:y state=0x5584957eecf8 s->prefetch_data=0 2024-09-12T17:41:41.633 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.628+0000 7f61fa95c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8kcmg2c0tr0pq94jdort11jezyalulp6 2024-09-12T17:41:41.635 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.636+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.638 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.636+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.639 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.640+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.640 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.640+0000 7f61fa95c9c0 20 get_obj_state: octx=0x55849550b970 obj=myver:z state=0x5584957c5f08 s->prefetch_data=0 2024-09-12T17:41:41.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.640+0000 7f61fa95c9c0 20 get_obj_state: setting s->obj_tag to j1842qtclt9p0lno8e98sildlgh8qxmm 2024-09-12T17:41:41.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.640+0000 7f61fa95c9c0 20 get_obj_state_impl: setting s->olh_tag to 1dzt9n1xhwsichsj1xy9ehzw40tcb03w 2024-09-12T17:41:41.641 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.640+0000 7f61fa95c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1dzt9n1xhwsichsj1xy9ehzw40tcb03w 2024-09-12T17:41:41.644 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.644+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.647 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.648+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.648 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.648+0000 7f61fa95c9c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T17:41:41.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.648+0000 7f61fa95c9c0 20 olh_log_entry: epoch=2 op=3 key=z[4EP118WL2MEAnzVccOH.-GI1GO4Ctco] 2024-09-12T17:41:41.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.648+0000 7f61fa95c9c0 20 get_obj_state: octx=0x55849550b970 obj=myver:_:4EP118WL2MEAnzVccOH.-GI1GO4Ctco_z state=0x5584957f7108 s->prefetch_data=0 2024-09-12T17:41:41.649 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.648+0000 7f61fa95c9c0 10 manifest: total_size = 12 2024-09-12T17:41:41.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.648+0000 7f61fa95c9c0 20 get_obj_state: setting s->obj_tag to 4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14120218505044919403 2024-09-12T17:41:41.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.648+0000 7f61fa95c9c0 20 get_obj_state: octx=0x55849550b970 obj=myver:_:4EP118WL2MEAnzVccOH.-GI1GO4Ctco_z state=0x5584957f7108 s->prefetch_data=0 2024-09-12T17:41:41.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.648+0000 7f61fa95c9c0 20 prepare_atomic_modification: state is not atomic. state=0x5584957f7108 2024-09-12T17:41:41.650 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.648+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.656+0000 7f61fa95c9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:41:41.656 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.656+0000 7f61fa95c9c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:41:41.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.656+0000 7f61fa95c9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:41:41.657 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.656+0000 7f61fa95c9c0 5 delete_objs_inline: removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19__shadow:4EP118WL2MEAnzVccOH.-GI1GO4Ctco_.SYTFOs_Y4JYlQOfSYK2osjV7MsTXRG1_0 2024-09-12T17:41:41.660 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.660+0000 7f60cf7fe640 20 handle_completion(): completion ok for obj=z[4EP118WL2MEAnzVccOH.-GI1GO4Ctco] 2024-09-12T17:41:41.660 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.660+0000 7f61fa95c9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:41:41.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.660+0000 7f61fa95c9c0 20 get_obj_state: octx=0x55849550b970 obj=myver:z state=0x5584957c5f08 s->prefetch_data=0 2024-09-12T17:41:41.663 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.660+0000 7f61fa95c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1dzt9n1xhwsichsj1xy9ehzw40tcb03w 2024-09-12T17:41:41.670 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.668+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.673 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.672+0000 7f61fa95c9c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19.3.9 2024-09-12T17:41:41.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.672+0000 7f61fa95c9c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T17:41:41.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.672+0000 7f61fa95c9c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T17:41:41.674 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.672+0000 7f60af7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:41.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.680+0000 7f61fa95c9c0 20 remove_watcher() i=0 2024-09-12T17:41:41.682 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.680+0000 7f61fa95c9c0 2 removed watcher, disabling cache 2024-09-12T17:41:41.685 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.684+0000 7f61fa95c9c0 20 remove_watcher() i=1 2024-09-12T17:41:41.687 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.684+0000 7f61fa95c9c0 20 remove_watcher() i=2 2024-09-12T17:41:41.689 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.688+0000 7f61fa95c9c0 20 remove_watcher() i=3 2024-09-12T17:41:41.692 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.692+0000 7f61fa95c9c0 20 remove_watcher() i=4 2024-09-12T17:41:41.694 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.692+0000 7f61fa95c9c0 20 remove_watcher() i=5 2024-09-12T17:41:41.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.696+0000 7f61fa95c9c0 20 remove_watcher() i=6 2024-09-12T17:41:41.701 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:41.700+0000 7f61fa95c9c0 20 remove_watcher() i=7 2024-09-12T17:41:42.066 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:41:42.097 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:42.097 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:42.144 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.144+0000 7f0bd865f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:42.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.144+0000 7f0bd865f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:42.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.144+0000 7f0bd865f9c0 20 realm 2024-09-12T17:41:42.146 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.144+0000 7f0bd865f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:42.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.144+0000 7f0bd865f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:42.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.144+0000 7f0bd865f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:42.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.144+0000 7f0bd865f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:42.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.144+0000 7f0bd865f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:42.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.144+0000 7f0bd865f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:42.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.148+0000 7f0bd865f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:42.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.148+0000 7f0bd865f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:42.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.148+0000 7f0bd865f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:42.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.148+0000 7f0bd865f9c0 20 searching for the correct realm 2024-09-12T17:41:42.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.152+0000 7f0bd6966640 0 -- 172.21.15.119:0/1814812198 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f0bcc0c0020 msgr2=0x7f0bcc1209e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:42.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.160+0000 7f0bd5964640 0 -- 172.21.15.119:0/1814812198 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f0bd0023040 msgr2=0x7f0bd0014420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:42.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:41:42.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:41:42.380 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:42.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:42.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:42.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:42.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:42.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:42.381 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:42.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:42.382 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:42.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:42.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 20 zone default found 2024-09-12T17:41:42.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 4 Realm: () 2024-09-12T17:41:42.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:41:42.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:41:42.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:42.383 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 20 zonegroup default 2024-09-12T17:41:42.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:42.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.380+0000 7f0bd865f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:42.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.384+0000 7f0bd865f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:42.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.384+0000 7f0bd865f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:42.384 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.384+0000 7f0bd865f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:42.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.384+0000 7f0bd865f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:42.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.384+0000 7f0bd865f9c0 20 started sync module instance, tier type = 2024-09-12T17:41:42.385 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.384+0000 7f0bd865f9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:41:42.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.412+0000 7f0bd865f9c0 20 add_watcher() i=0 2024-09-12T17:41:42.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.412+0000 7f0bd865f9c0 20 add_watcher() i=1 2024-09-12T17:41:42.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.412+0000 7f0bd865f9c0 20 add_watcher() i=2 2024-09-12T17:41:42.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.412+0000 7f0bd865f9c0 20 add_watcher() i=3 2024-09-12T17:41:42.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.412+0000 7f0bd865f9c0 20 add_watcher() i=4 2024-09-12T17:41:42.412 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.412+0000 7f0bd865f9c0 20 add_watcher() i=5 2024-09-12T17:41:42.413 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.412+0000 7f0bd865f9c0 20 add_watcher() i=6 2024-09-12T17:41:42.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.412+0000 7f0bd865f9c0 20 add_watcher() i=7 2024-09-12T17:41:42.414 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.412+0000 7f0bd865f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:42.419 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.416+0000 7f0a8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:42.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.420+0000 7f0bd865f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:42.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.420+0000 7f0bd865f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:42.420 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.420+0000 7f0bd865f9c0 5 note: GC not initialized 2024-09-12T17:41:42.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.420+0000 7f0a877fe640 20 reqs_thread_entry: start 2024-09-12T17:41:42.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.420+0000 7f0bd865f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:41:42.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.420+0000 7f0bd865f9c0 20 Filter name: none 2024-09-12T17:41:42.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.420+0000 7f0a857fa640 20 reqs_thread_entry: start 2024-09-12T17:41:42.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.420+0000 7f0bd865f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:42.421 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.420+0000 7f0bd865f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:41:42.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.420+0000 7f0bd865f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:42.422 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.420+0000 7f0bd865f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:41:42.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.420+0000 7f0bd865f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:42.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.420+0000 7f0bd865f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:42.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.424+0000 7f0bd865f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:41:42.423 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.424+0000 7f0bd865f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:42.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.424+0000 7f0bd865f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:41:42.424 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.424+0000 7f0bd865f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:42.428 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.428+0000 7f0a8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:42.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.432+0000 7f0bd865f9c0 20 remove_watcher() i=0 2024-09-12T17:41:42.433 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.432+0000 7f0bd865f9c0 2 removed watcher, disabling cache 2024-09-12T17:41:42.436 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.436+0000 7f0bd865f9c0 20 remove_watcher() i=1 2024-09-12T17:41:42.438 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.436+0000 7f0bd865f9c0 20 remove_watcher() i=2 2024-09-12T17:41:42.440 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.440+0000 7f0bd865f9c0 20 remove_watcher() i=3 2024-09-12T17:41:42.442 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.440+0000 7f0bd865f9c0 20 remove_watcher() i=4 2024-09-12T17:41:42.443 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.444+0000 7f0bd865f9c0 20 remove_watcher() i=5 2024-09-12T17:41:42.445 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.444+0000 7f0bd865f9c0 20 remove_watcher() i=6 2024-09-12T17:41:42.449 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T17:41:42.444+0000 7f0bd865f9c0 20 remove_watcher() i=7 2024-09-12T17:41:42.461 INFO:tasks.workunit.client.0.smithi119.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:41:42.461 INFO:tasks.workunit.client.0.smithi119.stderr:Deleting bucket a-bucket 2024-09-12T17:41:42.568 INFO:tasks.workunit.client.0.smithi119.stderr:Deleting bucket myver 2024-09-12T17:41:43.134 INFO:tasks.workunit.client.0.smithi119.stderr:Completed resharding tests 2024-09-12T17:41:43.134 INFO:tasks.workunit.client.0.smithi119.stdout:connected to http://localhost:80 2024-09-12T17:41:43.255 INFO:tasks.workunit.client.0.smithi119.stderr:+ deactivate 2024-09-12T17:41:43.255 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T17:41:43.256 INFO:tasks.workunit.client.0.smithi119.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:41:43.256 INFO:tasks.workunit.client.0.smithi119.stderr:+ export PATH 2024-09-12T17:41:43.256 INFO:tasks.workunit.client.0.smithi119.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:41:43.256 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' -n '' ']' 2024-09-12T17:41:43.256 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:41:43.256 INFO:tasks.workunit.client.0.smithi119.stderr:+ hash -r 2024-09-12T17:41:43.256 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' -n '' ']' 2024-09-12T17:41:43.256 INFO:tasks.workunit.client.0.smithi119.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:41:43.256 INFO:tasks.workunit.client.0.smithi119.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:41:43.256 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:41:43.256 INFO:tasks.workunit.client.0.smithi119.stderr:+ unset -f deactivate 2024-09-12T17:41:43.256 INFO:tasks.workunit.client.0.smithi119.stderr:+ echo OK. 2024-09-12T17:41:43.257 INFO:tasks.workunit.client.0.smithi119.stdout:OK. 2024-09-12T17:41:43.258 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:41:43.258 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:41:43.310 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T17:41:43.310 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:41:43.732 DEBUG:teuthology.parallel:result is None 2024-09-12T17:41:43.733 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:41:43.746 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:41:43.747 DEBUG:teuthology.orchestra.run.smithi119:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:41:43.796 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:41:43.796 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T17:41:43.815 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T17:41:43.816 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T17:41:43.816 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T17:41:43.816 DEBUG:teuthology.orchestra.run.smithi119:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T17:41:43.844 INFO:teuthology.orchestra.run.smithi119.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T17:41:48.394 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T17:41:48.394 DEBUG:teuthology.orchestra.run.smithi119:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T17:41:48.484 INFO:teuthology.orchestra.run.smithi119.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-12T17:41:48.544 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-09-12T17:41:48.756 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2024-09-12T17:41:48.757 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2024-09-12T17:41:48.962 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:41:48.962 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:41:48.962 INFO:teuthology.orchestra.run.smithi119.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:41:48.962 INFO:teuthology.orchestra.run.smithi119.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:41:48.963 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:41:48.963 INFO:teuthology.orchestra.run.smithi119.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:41:48.963 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:41:48.963 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2024-09-12T17:41:48.964 INFO:teuthology.orchestra.run.smithi119.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T17:41:48.964 INFO:teuthology.orchestra.run.smithi119.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T17:41:48.966 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2024-09-12T17:41:48.966 INFO:teuthology.orchestra.run.smithi119.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-12T17:41:48.966 INFO:teuthology.orchestra.run.smithi119.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-12T17:41:48.966 INFO:teuthology.orchestra.run.smithi119.stdout: fonts-wqy-zenhei fonts-indic 2024-09-12T17:41:49.001 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2024-09-12T17:41:49.002 INFO:teuthology.orchestra.run.smithi119.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T17:41:49.002 INFO:teuthology.orchestra.run.smithi119.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T17:41:49.073 INFO:teuthology.orchestra.run.smithi119.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:41:49.073 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 46.0 MB of archives. 2024-09-12T17:41:49.073 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-12T17:41:49.073 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-12T17:41:49.149 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-12T17:41:49.231 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-12T17:41:49.232 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-12T17:41:49.235 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-12T17:41:49.235 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-12T17:41:49.683 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-12T17:41:49.685 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-12T17:41:49.781 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-12T17:41:50.149 INFO:teuthology.orchestra.run.smithi119.stderr:debconf: unable to initialize frontend: Dialog 2024-09-12T17:41:50.150 INFO:teuthology.orchestra.run.smithi119.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-12T17:41:50.150 INFO:teuthology.orchestra.run.smithi119.stderr:debconf: falling back to frontend: Readline 2024-09-12T17:41:50.162 INFO:teuthology.orchestra.run.smithi119.stderr:debconf: unable to initialize frontend: Readline 2024-09-12T17:41:50.162 INFO:teuthology.orchestra.run.smithi119.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-12T17:41:50.162 INFO:teuthology.orchestra.run.smithi119.stderr:debconf: falling back to frontend: Teletype 2024-09-12T17:41:50.165 INFO:teuthology.orchestra.run.smithi119.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-12T17:41:50.201 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 46.0 MB in 1s (57.5 MB/s) 2024-09-12T17:41:50.317 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-12T17:41:50.413 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177243 files and directories currently installed.) 2024-09-12T17:41:50.418 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-12T17:41:50.467 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T17:41:50.853 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-12T17:41:50.882 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T17:41:50.961 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T17:41:51.399 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-12T17:41:51.428 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T17:41:51.466 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T17:41:51.719 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-12T17:41:51.735 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T17:41:51.777 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T17:41:52.046 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-12T17:41:52.062 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T17:41:52.124 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T17:41:52.500 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-12T17:41:52.529 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T17:41:52.586 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T17:41:54.205 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-12T17:41:54.233 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T17:41:54.292 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T17:41:54.760 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-12T17:41:54.788 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T17:41:54.829 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T17:41:55.614 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-12T17:41:55.643 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T17:41:55.684 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T17:41:56.059 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T17:41:57.163 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-12T17:41:57.189 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-12T17:41:57.214 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-12T17:41:57.580 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T17:41:57.723 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T17:41:58.084 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T17:41:58.176 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-12T17:41:58.235 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T17:41:58.327 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-12T17:41:58.357 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-12T17:41:58.381 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-12T17:41:58.406 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-12T17:41:58.567 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-12T17:41:58.702 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-12T17:41:59.114 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-12T17:41:59.206 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-12T17:41:59.257 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-12T17:41:59.310 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-12T17:41:59.334 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-12T17:41:59.351 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-12T17:41:59.416 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T17:41:59.542 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T17:41:59.659 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T17:41:59.736 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-12T17:41:59.828 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T17:41:59.955 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:42:01.031 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T17:42:01.132 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T17:42:01.417 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T17:42:01.859 INFO:teuthology.orchestra.run.smithi119.stdout: Gradle will be installed under /opt/gradle 2024-09-12T17:42:01.892 INFO:teuthology.orchestra.run.smithi119.stderr:--2024-09-12 17:42:01-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T17:42:01.903 INFO:teuthology.orchestra.run.smithi119.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4965, ... 2024-09-12T17:42:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-12T17:42:01.947 INFO:teuthology.orchestra.run.smithi119.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T17:42:01.947 INFO:teuthology.orchestra.run.smithi119.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T17:42:01.947 INFO:teuthology.orchestra.run.smithi119.stderr:--2024-09-12 17:42:01-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T17:42:01.947 INFO:teuthology.orchestra.run.smithi119.stderr:Resolving github.com (github.com)... 140.82.113.4 2024-09-12T17:42:01.956 INFO:teuthology.orchestra.run.smithi119.stderr:Connecting to github.com (github.com)|140.82.113.4|:443... connected. 2024-09-12T17:42:01.988 INFO:teuthology.orchestra.run.smithi119.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T17:42:01.988 INFO:teuthology.orchestra.run.smithi119.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T174120Z&X-Amz-Expires=300&X-Amz-Signature=a30602ff9fc1ac6a72b005b4fe4150a4cc3b7b49cf58cacc4364b15c3188081d&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T17:42:01.988 INFO:teuthology.orchestra.run.smithi119.stderr:--2024-09-12 17:42:01-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T174120Z&X-Amz-Expires=300&X-Amz-Signature=a30602ff9fc1ac6a72b005b4fe4150a4cc3b7b49cf58cacc4364b15c3188081d&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T17:42:01.990 INFO:teuthology.orchestra.run.smithi119.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.109.133, 185.199.110.133, ... 2024-09-12T17:42:02.002 INFO:teuthology.orchestra.run.smithi119.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected. 2024-09-12T17:42:02.084 INFO:teuthology.orchestra.run.smithi119.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T17:42:02.084 INFO:teuthology.orchestra.run.smithi119.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T17:42:02.084 INFO:teuthology.orchestra.run.smithi119.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-12T17:42:02.084 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-12T17:42:02.097 INFO:teuthology.orchestra.run.smithi119.stderr: 0K .......... .......... .......... .......... .......... 0% 4.03M 23s 2024-09-12T17:42:02.107 INFO:teuthology.orchestra.run.smithi119.stderr: 50K .......... .......... .......... .......... .......... 0% 4.13M 22s 2024-09-12T17:42:02.110 INFO:teuthology.orchestra.run.smithi119.stderr: 100K .......... .......... .......... .......... .......... 0% 23.7M 16s 2024-09-12T17:42:02.112 INFO:teuthology.orchestra.run.smithi119.stderr: 150K .......... .......... .......... .......... .......... 0% 19.4M 13s 2024-09-12T17:42:02.119 INFO:teuthology.orchestra.run.smithi119.stderr: 200K .......... .......... .......... .......... .......... 0% 6.68M 13s 2024-09-12T17:42:02.121 INFO:teuthology.orchestra.run.smithi119.stderr: 250K .......... .......... .......... .......... .......... 0% 38.0M 11s 2024-09-12T17:42:02.123 INFO:teuthology.orchestra.run.smithi119.stderr: 300K .......... .......... .......... .......... .......... 0% 24.1M 10s 2024-09-12T17:42:02.124 INFO:teuthology.orchestra.run.smithi119.stderr: 350K .......... .......... .......... .......... .......... 0% 27.6M 9s 2024-09-12T17:42:02.125 INFO:teuthology.orchestra.run.smithi119.stderr: 400K .......... .......... .......... .......... .......... 0% 57.1M 9s 2024-09-12T17:42:02.138 INFO:teuthology.orchestra.run.smithi119.stderr: 450K .......... .......... .......... .......... .......... 0% 8.50M 9s 2024-09-12T17:42:02.138 INFO:teuthology.orchestra.run.smithi119.stderr: 500K .......... .......... .......... .......... .......... 0% 108M 8s 2024-09-12T17:42:02.138 INFO:teuthology.orchestra.run.smithi119.stderr: 550K .......... .......... .......... .......... .......... 0% 49.1M 8s 2024-09-12T17:42:02.138 INFO:teuthology.orchestra.run.smithi119.stderr: 600K .......... .......... .......... .......... .......... 0% 56.5M 7s 2024-09-12T17:42:02.138 INFO:teuthology.orchestra.run.smithi119.stderr: 650K .......... .......... .......... .......... .......... 0% 47.2M 7s 2024-09-12T17:42:02.138 INFO:teuthology.orchestra.run.smithi119.stderr: 700K .......... .......... .......... .......... .......... 0% 60.5M 6s 2024-09-12T17:42:02.139 INFO:teuthology.orchestra.run.smithi119.stderr: 750K .......... .......... .......... .......... .......... 0% 119M 6s 2024-09-12T17:42:02.139 INFO:teuthology.orchestra.run.smithi119.stderr: 800K .......... .......... .......... .......... .......... 0% 62.3M 6s 2024-09-12T17:42:02.139 INFO:teuthology.orchestra.run.smithi119.stderr: 850K .......... .......... .......... .......... .......... 0% 117M 5s 2024-09-12T17:42:03.301 INFO:teuthology.orchestra.run.smithi119.stderr: 900K .......... .......... .......... .......... .......... 1% 10.2M 6s 2024-09-12T17:42:03.301 INFO:teuthology.orchestra.run.smithi119.stderr: 950K .......... .......... .......... .......... .......... 1% 125M 5s 2024-09-12T17:42:03.302 INFO:teuthology.orchestra.run.smithi119.stderr: 1000K .......... .......... .......... .......... .......... 1% 45.8M 5s 2024-09-12T17:42:03.302 INFO:teuthology.orchestra.run.smithi119.stderr: 1050K .......... .......... .......... .......... .......... 1% 140M 5s 2024-09-12T17:42:03.302 INFO:teuthology.orchestra.run.smithi119.stderr: 1100K .......... .......... .......... .......... .......... 1% 72.3M 5s 2024-09-12T17:42:03.302 INFO:teuthology.orchestra.run.smithi119.stderr: 1150K .......... .......... .......... .......... .......... 1% 108M 5s 2024-09-12T17:42:03.302 INFO:teuthology.orchestra.run.smithi119.stderr: 1200K .......... .......... .......... .......... .......... 1% 123M 5s 2024-09-12T17:42:03.302 INFO:teuthology.orchestra.run.smithi119.stderr: 1250K .......... .......... .......... .......... .......... 1% 92.6M 4s 2024-09-12T17:42:03.302 INFO:teuthology.orchestra.run.smithi119.stderr: 1300K .......... .......... .......... .......... .......... 1% 99.8M 4s 2024-09-12T17:42:03.302 INFO:teuthology.orchestra.run.smithi119.stderr: 1350K .......... .......... .......... .......... .......... 1% 106M 4s 2024-09-12T17:42:03.302 INFO:teuthology.orchestra.run.smithi119.stderr: 1400K .......... .......... .......... .......... .......... 1% 148M 4s 2024-09-12T17:42:03.302 INFO:teuthology.orchestra.run.smithi119.stderr: 1450K .......... .......... .......... .......... .......... 1% 86.9M 4s 2024-09-12T17:42:03.302 INFO:teuthology.orchestra.run.smithi119.stderr: 1500K .......... .......... .......... .......... .......... 1% 114M 4s 2024-09-12T17:42:03.302 INFO:teuthology.orchestra.run.smithi119.stderr: 1550K .......... .......... .......... .......... .......... 1% 115M 4s 2024-09-12T17:42:03.303 INFO:teuthology.orchestra.run.smithi119.stderr: 1600K .......... .......... .......... .......... .......... 1% 91.4M 4s 2024-09-12T17:42:03.303 INFO:teuthology.orchestra.run.smithi119.stderr: 1650K .......... .......... .......... .......... .......... 1% 113M 4s 2024-09-12T17:42:03.303 INFO:teuthology.orchestra.run.smithi119.stderr: 1700K .......... .......... .......... .......... .......... 1% 133M 3s 2024-09-12T17:42:03.303 INFO:teuthology.orchestra.run.smithi119.stderr: 1750K .......... .......... .......... .......... .......... 1% 150M 3s 2024-09-12T17:42:03.303 INFO:teuthology.orchestra.run.smithi119.stderr: 1800K .......... .......... .......... .......... .......... 1% 151M 3s 2024-09-12T17:42:03.303 INFO:teuthology.orchestra.run.smithi119.stderr: 1850K .......... .......... .......... .......... .......... 2% 151M 3s 2024-09-12T17:42:03.303 INFO:teuthology.orchestra.run.smithi119.stderr: 1900K .......... .......... .......... .......... .......... 2% 15.1M 3s 2024-09-12T17:42:03.303 INFO:teuthology.orchestra.run.smithi119.stderr: 1950K .......... .......... .......... .......... .......... 2% 148M 3s 2024-09-12T17:42:03.303 INFO:teuthology.orchestra.run.smithi119.stderr: 2000K .......... .......... .......... .......... .......... 2% 90.9M 3s 2024-09-12T17:42:03.303 INFO:teuthology.orchestra.run.smithi119.stderr: 2050K .......... .......... .......... .......... .......... 2% 113M 3s 2024-09-12T17:42:03.303 INFO:teuthology.orchestra.run.smithi119.stderr: 2100K .......... .......... .......... .......... .......... 2% 95.8M 3s 2024-09-12T17:42:03.303 INFO:teuthology.orchestra.run.smithi119.stderr: 2150K .......... .......... .......... .......... .......... 2% 73.6M 3s 2024-09-12T17:42:03.304 INFO:teuthology.orchestra.run.smithi119.stderr: 2200K .......... .......... .......... .......... .......... 2% 91.9M 3s 2024-09-12T17:42:03.304 INFO:teuthology.orchestra.run.smithi119.stderr: 2250K .......... .......... .......... .......... .......... 2% 94.0M 3s 2024-09-12T17:42:03.304 INFO:teuthology.orchestra.run.smithi119.stderr: 2300K .......... .......... .......... .......... .......... 2% 83.3M 3s 2024-09-12T17:42:03.304 INFO:teuthology.orchestra.run.smithi119.stderr: 2350K .......... .......... .......... .......... .......... 2% 87.2M 3s 2024-09-12T17:42:03.304 INFO:teuthology.orchestra.run.smithi119.stderr: 2400K .......... .......... .......... .......... .......... 2% 79.1M 3s 2024-09-12T17:42:03.304 INFO:teuthology.orchestra.run.smithi119.stderr: 2450K .......... .......... .......... .......... .......... 2% 82.1M 3s 2024-09-12T17:42:03.304 INFO:teuthology.orchestra.run.smithi119.stderr: 2500K .......... .......... .......... .......... .......... 2% 56.2M 3s 2024-09-12T17:42:03.304 INFO:teuthology.orchestra.run.smithi119.stderr: 2550K .......... .......... .......... .......... .......... 2% 63.2M 3s 2024-09-12T17:42:03.304 INFO:teuthology.orchestra.run.smithi119.stderr: 2600K .......... .......... .......... .......... .......... 2% 136M 3s 2024-09-12T17:42:03.304 INFO:teuthology.orchestra.run.smithi119.stderr: 2650K .......... .......... .......... .......... .......... 2% 148M 3s 2024-09-12T17:42:03.304 INFO:teuthology.orchestra.run.smithi119.stderr: 2700K .......... .......... .......... .......... .......... 2% 123M 3s 2024-09-12T17:42:03.304 INFO:teuthology.orchestra.run.smithi119.stderr: 2750K .......... .......... .......... .......... .......... 3% 147M 3s 2024-09-12T17:42:03.304 INFO:teuthology.orchestra.run.smithi119.stderr: 2800K .......... .......... .......... .......... .......... 3% 150M 3s 2024-09-12T17:42:03.305 INFO:teuthology.orchestra.run.smithi119.stderr: 2850K .......... .......... .......... .......... .......... 3% 149M 2s 2024-09-12T17:42:03.305 INFO:teuthology.orchestra.run.smithi119.stderr: 2900K .......... .......... .......... .......... .......... 3% 133M 2s 2024-09-12T17:42:03.305 INFO:teuthology.orchestra.run.smithi119.stderr: 2950K .......... .......... .......... .......... .......... 3% 142M 2s 2024-09-12T17:42:03.305 INFO:teuthology.orchestra.run.smithi119.stderr: 3000K .......... .......... .......... .......... .......... 3% 151M 2s 2024-09-12T17:42:03.305 INFO:teuthology.orchestra.run.smithi119.stderr: 3050K .......... .......... .......... .......... .......... 3% 151M 2s 2024-09-12T17:42:03.305 INFO:teuthology.orchestra.run.smithi119.stderr: 3100K .......... .......... .......... .......... .......... 3% 66.6M 2s 2024-09-12T17:42:03.305 INFO:teuthology.orchestra.run.smithi119.stderr: 3150K .......... .......... .......... .......... .......... 3% 142M 2s 2024-09-12T17:42:03.305 INFO:teuthology.orchestra.run.smithi119.stderr: 3200K .......... .......... .......... .......... .......... 3% 92.5M 2s 2024-09-12T17:42:03.305 INFO:teuthology.orchestra.run.smithi119.stderr: 3250K .......... .......... .......... .......... .......... 3% 93.7M 2s 2024-09-12T17:42:03.305 INFO:teuthology.orchestra.run.smithi119.stderr: 3300K .......... .......... .......... .......... .......... 3% 67.6M 2s 2024-09-12T17:42:03.305 INFO:teuthology.orchestra.run.smithi119.stderr: 3350K .......... .......... .......... .......... .......... 3% 55.7M 2s 2024-09-12T17:42:03.305 INFO:teuthology.orchestra.run.smithi119.stderr: 3400K .......... .......... .......... .......... .......... 3% 75.9M 2s 2024-09-12T17:42:03.305 INFO:teuthology.orchestra.run.smithi119.stderr: 3450K .......... .......... .......... .......... .......... 3% 52.0M 2s 2024-09-12T17:42:03.306 INFO:teuthology.orchestra.run.smithi119.stderr: 3500K .......... .......... .......... .......... .......... 3% 82.8M 2s 2024-09-12T17:42:03.306 INFO:teuthology.orchestra.run.smithi119.stderr: 3550K .......... .......... .......... .......... .......... 3% 108M 2s 2024-09-12T17:42:03.306 INFO:teuthology.orchestra.run.smithi119.stderr: 3600K .......... .......... .......... .......... .......... 3% 97.4M 2s 2024-09-12T17:42:03.306 INFO:teuthology.orchestra.run.smithi119.stderr: 3650K .......... .......... .......... .......... .......... 3% 91.7M 2s 2024-09-12T17:42:03.306 INFO:teuthology.orchestra.run.smithi119.stderr: 3700K .......... .......... .......... .......... .......... 4% 121M 2s 2024-09-12T17:42:03.306 INFO:teuthology.orchestra.run.smithi119.stderr: 3750K .......... .......... .......... .......... .......... 4% 109M 2s 2024-09-12T17:42:03.306 INFO:teuthology.orchestra.run.smithi119.stderr: 3800K .......... .......... .......... .......... .......... 4% 139M 2s 2024-09-12T17:42:03.306 INFO:teuthology.orchestra.run.smithi119.stderr: 3850K .......... .......... .......... .......... .......... 4% 136M 2s 2024-09-12T17:42:03.306 INFO:teuthology.orchestra.run.smithi119.stderr: 3900K .......... .......... .......... .......... .......... 4% 92.1M 2s 2024-09-12T17:42:03.306 INFO:teuthology.orchestra.run.smithi119.stderr: 3950K .......... .......... .......... .......... .......... 4% 151M 2s 2024-09-12T17:42:03.306 INFO:teuthology.orchestra.run.smithi119.stderr: 4000K .......... .......... .......... .......... .......... 4% 151M 2s 2024-09-12T17:42:03.306 INFO:teuthology.orchestra.run.smithi119.stderr: 4050K .......... .......... .......... .......... .......... 4% 151M 2s 2024-09-12T17:42:03.306 INFO:teuthology.orchestra.run.smithi119.stderr: 4100K .......... .......... .......... .......... .......... 4% 134M 2s 2024-09-12T17:42:03.306 INFO:teuthology.orchestra.run.smithi119.stderr: 4150K .......... .......... .......... .......... .......... 4% 143M 2s 2024-09-12T17:42:03.307 INFO:teuthology.orchestra.run.smithi119.stderr: 4200K .......... .......... .......... .......... .......... 4% 132M 2s 2024-09-12T17:42:03.307 INFO:teuthology.orchestra.run.smithi119.stderr: 4250K .......... .......... .......... .......... .......... 4% 83.7M 2s 2024-09-12T17:42:03.307 INFO:teuthology.orchestra.run.smithi119.stderr: 4300K .......... .......... .......... .......... .......... 4% 49.4M 2s 2024-09-12T17:42:03.307 INFO:teuthology.orchestra.run.smithi119.stderr: 4350K .......... .......... .......... .......... .......... 4% 92.0M 2s 2024-09-12T17:42:03.307 INFO:teuthology.orchestra.run.smithi119.stderr: 4400K .......... .......... .......... .......... .......... 4% 147M 2s 2024-09-12T17:42:03.307 INFO:teuthology.orchestra.run.smithi119.stderr: 4450K .......... .......... .......... .......... .......... 4% 86.5M 2s 2024-09-12T17:42:03.307 INFO:teuthology.orchestra.run.smithi119.stderr: 4500K .......... .......... .......... .......... .......... 4% 129M 2s 2024-09-12T17:42:03.307 INFO:teuthology.orchestra.run.smithi119.stderr: 4550K .......... .......... .......... .......... .......... 4% 108M 2s 2024-09-12T17:42:03.307 INFO:teuthology.orchestra.run.smithi119.stderr: 4600K .......... .......... .......... .......... .......... 5% 148M 2s 2024-09-12T17:42:03.307 INFO:teuthology.orchestra.run.smithi119.stderr: 4650K .......... .......... .......... .......... .......... 5% 114M 2s 2024-09-12T17:42:03.307 INFO:teuthology.orchestra.run.smithi119.stderr: 4700K .......... .......... .......... .......... .......... 5% 114M 2s 2024-09-12T17:42:03.307 INFO:teuthology.orchestra.run.smithi119.stderr: 4750K .......... .......... .......... .......... .......... 5% 109M 2s 2024-09-12T17:42:03.307 INFO:teuthology.orchestra.run.smithi119.stderr: 4800K .......... .......... .......... .......... .......... 5% 101M 2s 2024-09-12T17:42:03.307 INFO:teuthology.orchestra.run.smithi119.stderr: 4850K .......... .......... .......... .......... .......... 5% 90.4M 2s 2024-09-12T17:42:03.308 INFO:teuthology.orchestra.run.smithi119.stderr: 4900K .......... .......... .......... .......... .......... 5% 91.8M 2s 2024-09-12T17:42:03.308 INFO:teuthology.orchestra.run.smithi119.stderr: 4950K .......... .......... .......... .......... .......... 5% 120M 2s 2024-09-12T17:42:03.308 INFO:teuthology.orchestra.run.smithi119.stderr: 5000K .......... .......... .......... .......... .......... 5% 93.1M 2s 2024-09-12T17:42:03.308 INFO:teuthology.orchestra.run.smithi119.stderr: 5050K .......... .......... .......... .......... .......... 5% 148M 2s 2024-09-12T17:42:03.308 INFO:teuthology.orchestra.run.smithi119.stderr: 5100K .......... .......... .......... .......... .......... 5% 95.8M 2s 2024-09-12T17:42:03.308 INFO:teuthology.orchestra.run.smithi119.stderr: 5150K .......... .......... .......... .......... .......... 5% 109M 2s 2024-09-12T17:42:03.308 INFO:teuthology.orchestra.run.smithi119.stderr: 5200K .......... .......... .......... .......... .......... 5% 97.9M 2s 2024-09-12T17:42:03.308 INFO:teuthology.orchestra.run.smithi119.stderr: 5250K .......... .......... .......... .......... .......... 5% 151M 2s 2024-09-12T17:42:03.308 INFO:teuthology.orchestra.run.smithi119.stderr: 5300K .......... .......... .......... .......... .......... 5% 145M 2s 2024-09-12T17:42:03.308 INFO:teuthology.orchestra.run.smithi119.stderr: 5350K .......... .......... .......... .......... .......... 5% 159M 2s 2024-09-12T17:42:03.308 INFO:teuthology.orchestra.run.smithi119.stderr: 5400K .......... .......... .......... .......... .......... 5% 159M 2s 2024-09-12T17:42:03.308 INFO:teuthology.orchestra.run.smithi119.stderr: 5450K .......... .......... .......... .......... .......... 5% 162M 2s 2024-09-12T17:42:03.308 INFO:teuthology.orchestra.run.smithi119.stderr: 5500K .......... .......... .......... .......... .......... 5% 122M 2s 2024-09-12T17:42:03.309 INFO:teuthology.orchestra.run.smithi119.stderr: 5550K .......... .......... .......... .......... .......... 6% 153M 2s 2024-09-12T17:42:03.309 INFO:teuthology.orchestra.run.smithi119.stderr: 5600K .......... .......... .......... .......... .......... 6% 117M 2s 2024-09-12T17:42:03.309 INFO:teuthology.orchestra.run.smithi119.stderr: 5650K .......... .......... .......... .......... .......... 6% 84.1M 2s 2024-09-12T17:42:03.309 INFO:teuthology.orchestra.run.smithi119.stderr: 5700K .......... .......... .......... .......... .......... 6% 79.1M 2s 2024-09-12T17:42:03.309 INFO:teuthology.orchestra.run.smithi119.stderr: 5750K .......... .......... .......... .......... .......... 6% 165M 2s 2024-09-12T17:42:03.309 INFO:teuthology.orchestra.run.smithi119.stderr: 5800K .......... .......... .......... .......... .......... 6% 126M 2s 2024-09-12T17:42:03.309 INFO:teuthology.orchestra.run.smithi119.stderr: 5850K .......... .......... .......... .......... .......... 6% 152M 2s 2024-09-12T17:42:03.309 INFO:teuthology.orchestra.run.smithi119.stderr: 5900K .......... .......... .......... .......... .......... 6% 99.9M 2s 2024-09-12T17:42:03.309 INFO:teuthology.orchestra.run.smithi119.stderr: 5950K .......... .......... .......... .......... .......... 6% 149M 2s 2024-09-12T17:42:03.309 INFO:teuthology.orchestra.run.smithi119.stderr: 6000K .......... .......... .......... .......... .......... 6% 159M 2s 2024-09-12T17:42:03.309 INFO:teuthology.orchestra.run.smithi119.stderr: 6050K .......... .......... .......... .......... .......... 6% 176M 2s 2024-09-12T17:42:03.309 INFO:teuthology.orchestra.run.smithi119.stderr: 6100K .......... .......... .......... .......... .......... 6% 163M 2s 2024-09-12T17:42:03.309 INFO:teuthology.orchestra.run.smithi119.stderr: 6150K .......... .......... .......... .......... .......... 6% 116M 2s 2024-09-12T17:42:03.309 INFO:teuthology.orchestra.run.smithi119.stderr: 6200K .......... .......... .......... .......... .......... 6% 120M 2s 2024-09-12T17:42:03.310 INFO:teuthology.orchestra.run.smithi119.stderr: 6250K .......... .......... .......... .......... .......... 6% 131M 2s 2024-09-12T17:42:03.310 INFO:teuthology.orchestra.run.smithi119.stderr: 6300K .......... .......... .......... .......... .......... 6% 149M 2s 2024-09-12T17:42:03.310 INFO:teuthology.orchestra.run.smithi119.stderr: 6350K .......... .......... .......... .......... .......... 6% 113M 1s 2024-09-12T17:42:03.310 INFO:teuthology.orchestra.run.smithi119.stderr: 6400K .......... .......... .......... .......... .......... 6% 171M 1s 2024-09-12T17:42:03.310 INFO:teuthology.orchestra.run.smithi119.stderr: 6450K .......... .......... .......... .......... .......... 6% 133M 1s 2024-09-12T17:42:03.310 INFO:teuthology.orchestra.run.smithi119.stderr: 6500K .......... .......... .......... .......... .......... 7% 158M 1s 2024-09-12T17:42:03.310 INFO:teuthology.orchestra.run.smithi119.stderr: 6550K .......... .......... .......... .......... .......... 7% 125M 1s 2024-09-12T17:42:03.310 INFO:teuthology.orchestra.run.smithi119.stderr: 6600K .......... .......... .......... .......... .......... 7% 142M 1s 2024-09-12T17:42:03.310 INFO:teuthology.orchestra.run.smithi119.stderr: 6650K .......... .......... .......... .......... .......... 7% 179M 1s 2024-09-12T17:42:03.310 INFO:teuthology.orchestra.run.smithi119.stderr: 6700K .......... .......... .......... .......... .......... 7% 85.5M 1s 2024-09-12T17:42:03.310 INFO:teuthology.orchestra.run.smithi119.stderr: 6750K .......... .......... .......... .......... .......... 7% 125M 1s 2024-09-12T17:42:03.310 INFO:teuthology.orchestra.run.smithi119.stderr: 6800K .......... .......... .......... .......... .......... 7% 187M 1s 2024-09-12T17:42:03.310 INFO:teuthology.orchestra.run.smithi119.stderr: 6850K .......... .......... .......... .......... .......... 7% 194M 1s 2024-09-12T17:42:03.311 INFO:teuthology.orchestra.run.smithi119.stderr: 6900K .......... .......... .......... .......... .......... 7% 173M 1s 2024-09-12T17:42:03.311 INFO:teuthology.orchestra.run.smithi119.stderr: 6950K .......... .......... .......... .......... .......... 7% 195M 1s 2024-09-12T17:42:03.311 INFO:teuthology.orchestra.run.smithi119.stderr: 7000K .......... .......... .......... .......... .......... 7% 194M 1s 2024-09-12T17:42:03.311 INFO:teuthology.orchestra.run.smithi119.stderr: 7050K .......... .......... .......... .......... .......... 7% 193M 1s 2024-09-12T17:42:03.311 INFO:teuthology.orchestra.run.smithi119.stderr: 7100K .......... .......... .......... .......... .......... 7% 160M 1s 2024-09-12T17:42:03.311 INFO:teuthology.orchestra.run.smithi119.stderr: 7150K .......... .......... .......... .......... .......... 7% 191M 1s 2024-09-12T17:42:03.311 INFO:teuthology.orchestra.run.smithi119.stderr: 7200K .......... .......... .......... .......... .......... 7% 183M 1s 2024-09-12T17:42:03.311 INFO:teuthology.orchestra.run.smithi119.stderr: 7250K .......... .......... .......... .......... .......... 7% 194M 1s 2024-09-12T17:42:03.311 INFO:teuthology.orchestra.run.smithi119.stderr: 7300K .......... .......... .......... .......... .......... 7% 165M 1s 2024-09-12T17:42:03.311 INFO:teuthology.orchestra.run.smithi119.stderr: 7350K .......... .......... .......... .......... .......... 7% 83.8M 1s 2024-09-12T17:42:03.311 INFO:teuthology.orchestra.run.smithi119.stderr: 7400K .......... .......... .......... .......... .......... 8% 81.9M 1s 2024-09-12T17:42:03.311 INFO:teuthology.orchestra.run.smithi119.stderr: 7450K .......... .......... .......... .......... .......... 8% 152M 1s 2024-09-12T17:42:03.311 INFO:teuthology.orchestra.run.smithi119.stderr: 7500K .......... .......... .......... .......... .......... 8% 156M 1s 2024-09-12T17:42:03.311 INFO:teuthology.orchestra.run.smithi119.stderr: 7550K .......... .......... .......... .......... .......... 8% 204M 1s 2024-09-12T17:42:03.312 INFO:teuthology.orchestra.run.smithi119.stderr: 7600K .......... .......... .......... .......... .......... 8% 149M 1s 2024-09-12T17:42:03.312 INFO:teuthology.orchestra.run.smithi119.stderr: 7650K .......... .......... .......... .......... .......... 8% 197M 1s 2024-09-12T17:42:03.312 INFO:teuthology.orchestra.run.smithi119.stderr: 7700K .......... .......... .......... .......... .......... 8% 138M 1s 2024-09-12T17:42:03.312 INFO:teuthology.orchestra.run.smithi119.stderr: 7750K .......... .......... .......... .......... .......... 8% 200M 1s 2024-09-12T17:42:03.312 INFO:teuthology.orchestra.run.smithi119.stderr: 7800K .......... .......... .......... .......... .......... 8% 186M 1s 2024-09-12T17:42:03.312 INFO:teuthology.orchestra.run.smithi119.stderr: 7850K .......... .......... .......... .......... .......... 8% 195M 1s 2024-09-12T17:42:03.312 INFO:teuthology.orchestra.run.smithi119.stderr: 7900K .......... .......... .......... .......... .......... 8% 125M 1s 2024-09-12T17:42:03.312 INFO:teuthology.orchestra.run.smithi119.stderr: 7950K .......... .......... .......... .......... .......... 8% 144M 1s 2024-09-12T17:42:03.312 INFO:teuthology.orchestra.run.smithi119.stderr: 8000K .......... .......... .......... .......... .......... 8% 157M 1s 2024-09-12T17:42:03.312 INFO:teuthology.orchestra.run.smithi119.stderr: 8050K .......... .......... .......... .......... .......... 8% 155M 1s 2024-09-12T17:42:03.312 INFO:teuthology.orchestra.run.smithi119.stderr: 8100K .......... .......... .......... .......... .......... 8% 199M 1s 2024-09-12T17:42:03.312 INFO:teuthology.orchestra.run.smithi119.stderr: 8150K .......... .......... .......... .......... .......... 8% 171M 1s 2024-09-12T17:42:03.312 INFO:teuthology.orchestra.run.smithi119.stderr: 8200K .......... .......... .......... .......... .......... 8% 199M 1s 2024-09-12T17:42:03.313 INFO:teuthology.orchestra.run.smithi119.stderr: 8250K .......... .......... .......... .......... .......... 8% 211M 1s 2024-09-12T17:42:03.313 INFO:teuthology.orchestra.run.smithi119.stderr: 8300K .......... .......... .......... .......... .......... 8% 101M 1s 2024-09-12T17:42:03.313 INFO:teuthology.orchestra.run.smithi119.stderr: 8350K .......... .......... .......... .......... .......... 9% 220M 1s 2024-09-12T17:42:03.313 INFO:teuthology.orchestra.run.smithi119.stderr: 8400K .......... .......... .......... .......... .......... 9% 197M 1s 2024-09-12T17:42:03.313 INFO:teuthology.orchestra.run.smithi119.stderr: 8450K .......... .......... .......... .......... .......... 9% 114M 1s 2024-09-12T17:42:03.313 INFO:teuthology.orchestra.run.smithi119.stderr: 8500K .......... .......... .......... .......... .......... 9% 207M 1s 2024-09-12T17:42:03.313 INFO:teuthology.orchestra.run.smithi119.stderr: 8550K .......... .......... .......... .......... .......... 9% 229M 1s 2024-09-12T17:42:03.313 INFO:teuthology.orchestra.run.smithi119.stderr: 8600K .......... .......... .......... .......... .......... 9% 151M 1s 2024-09-12T17:42:03.313 INFO:teuthology.orchestra.run.smithi119.stderr: 8650K .......... .......... .......... .......... .......... 9% 143M 1s 2024-09-12T17:42:03.313 INFO:teuthology.orchestra.run.smithi119.stderr: 8700K .......... .......... .......... .......... .......... 9% 140M 1s 2024-09-12T17:42:03.313 INFO:teuthology.orchestra.run.smithi119.stderr: 8750K .......... .......... .......... .......... .......... 9% 230M 1s 2024-09-12T17:42:03.313 INFO:teuthology.orchestra.run.smithi119.stderr: 8800K .......... .......... .......... .......... .......... 9% 235M 1s 2024-09-12T17:42:03.313 INFO:teuthology.orchestra.run.smithi119.stderr: 8850K .......... .......... .......... .......... .......... 9% 231M 1s 2024-09-12T17:42:03.313 INFO:teuthology.orchestra.run.smithi119.stderr: 8900K .......... .......... .......... .......... .......... 9% 171M 1s 2024-09-12T17:42:03.314 INFO:teuthology.orchestra.run.smithi119.stderr: 8950K .......... .......... .......... .......... .......... 9% 229M 1s 2024-09-12T17:42:03.314 INFO:teuthology.orchestra.run.smithi119.stderr: 9000K .......... .......... .......... .......... .......... 9% 229M 1s 2024-09-12T17:42:03.314 INFO:teuthology.orchestra.run.smithi119.stderr: 9050K .......... .......... .......... .......... .......... 9% 232M 1s 2024-09-12T17:42:03.314 INFO:teuthology.orchestra.run.smithi119.stderr: 9100K .......... .......... .......... .......... .......... 9% 195M 1s 2024-09-12T17:42:03.314 INFO:teuthology.orchestra.run.smithi119.stderr: 9150K .......... .......... .......... .......... .......... 9% 233M 1s 2024-09-12T17:42:03.314 INFO:teuthology.orchestra.run.smithi119.stderr: 9200K .......... .......... .......... .......... .......... 9% 230M 1s 2024-09-12T17:42:03.314 INFO:teuthology.orchestra.run.smithi119.stderr: 9250K .......... .......... .......... .......... .......... 10% 211M 1s 2024-09-12T17:42:03.314 INFO:teuthology.orchestra.run.smithi119.stderr: 9300K .......... .......... .......... .......... .......... 10% 158M 1s 2024-09-12T17:42:03.314 INFO:teuthology.orchestra.run.smithi119.stderr: 9350K .......... .......... .......... .......... .......... 10% 111M 1s 2024-09-12T17:42:03.314 INFO:teuthology.orchestra.run.smithi119.stderr: 9400K .......... .......... .......... .......... .......... 10% 98.5M 1s 2024-09-12T17:42:03.314 INFO:teuthology.orchestra.run.smithi119.stderr: 9450K .......... .......... .......... .......... .......... 10% 154M 1s 2024-09-12T17:42:03.314 INFO:teuthology.orchestra.run.smithi119.stderr: 9500K .......... .......... .......... .......... .......... 10% 143M 1s 2024-09-12T17:42:03.314 INFO:teuthology.orchestra.run.smithi119.stderr: 9550K .......... .......... .......... .......... .......... 10% 241M 1s 2024-09-12T17:42:03.315 INFO:teuthology.orchestra.run.smithi119.stderr: 9600K .......... .......... .......... .......... .......... 10% 245M 1s 2024-09-12T17:42:03.315 INFO:teuthology.orchestra.run.smithi119.stderr: 9650K .......... .......... .......... .......... .......... 10% 147M 1s 2024-09-12T17:42:03.315 INFO:teuthology.orchestra.run.smithi119.stderr: 9700K .......... .......... .......... .......... .......... 10% 175M 1s 2024-09-12T17:42:03.315 INFO:teuthology.orchestra.run.smithi119.stderr: 9750K .......... .......... .......... .......... .......... 10% 190M 1s 2024-09-12T17:42:03.315 INFO:teuthology.orchestra.run.smithi119.stderr: 9800K .......... .......... .......... .......... .......... 10% 242M 1s 2024-09-12T17:42:03.315 INFO:teuthology.orchestra.run.smithi119.stderr: 9850K .......... .......... .......... .......... .......... 10% 243M 1s 2024-09-12T17:42:03.315 INFO:teuthology.orchestra.run.smithi119.stderr: 9900K .......... .......... .......... .......... .......... 10% 205M 1s 2024-09-12T17:42:03.315 INFO:teuthology.orchestra.run.smithi119.stderr: 9950K .......... .......... .......... .......... .......... 10% 147M 1s 2024-09-12T17:42:03.315 INFO:teuthology.orchestra.run.smithi119.stderr: 10000K .......... .......... .......... .......... .......... 10% 141M 1s 2024-09-12T17:42:03.315 INFO:teuthology.orchestra.run.smithi119.stderr: 10050K .......... .......... .......... .......... .......... 10% 193M 1s 2024-09-12T17:42:03.315 INFO:teuthology.orchestra.run.smithi119.stderr: 10100K .......... .......... .......... .......... .......... 10% 149M 1s 2024-09-12T17:42:03.315 INFO:teuthology.orchestra.run.smithi119.stderr: 10150K .......... .......... .......... .......... .......... 10% 169M 1s 2024-09-12T17:42:03.315 INFO:teuthology.orchestra.run.smithi119.stderr: 10200K .......... .......... .......... .......... .......... 11% 223M 1s 2024-09-12T17:42:03.315 INFO:teuthology.orchestra.run.smithi119.stderr: 10250K .......... .......... .......... .......... .......... 11% 267M 1s 2024-09-12T17:42:03.316 INFO:teuthology.orchestra.run.smithi119.stderr: 10300K .......... .......... .......... .......... .......... 11% 199M 1s 2024-09-12T17:42:03.316 INFO:teuthology.orchestra.run.smithi119.stderr: 10350K .......... .......... .......... .......... .......... 11% 137M 1s 2024-09-12T17:42:03.316 INFO:teuthology.orchestra.run.smithi119.stderr: 10400K .......... .......... .......... .......... .......... 11% 242M 1s 2024-09-12T17:42:03.316 INFO:teuthology.orchestra.run.smithi119.stderr: 10450K .......... .......... .......... .......... .......... 11% 167M 1s 2024-09-12T17:42:03.316 INFO:teuthology.orchestra.run.smithi119.stderr: 10500K .......... .......... .......... .......... .......... 11% 162M 1s 2024-09-12T17:42:03.316 INFO:teuthology.orchestra.run.smithi119.stderr: 10550K .......... .......... .......... .......... .......... 11% 144M 1s 2024-09-12T17:42:03.316 INFO:teuthology.orchestra.run.smithi119.stderr: 10600K .......... .......... .......... .......... .......... 11% 167M 1s 2024-09-12T17:42:03.316 INFO:teuthology.orchestra.run.smithi119.stderr: 10650K .......... .......... .......... .......... .......... 11% 240M 1s 2024-09-12T17:42:03.316 INFO:teuthology.orchestra.run.smithi119.stderr: 10700K .......... .......... .......... .......... .......... 11% 243M 1s 2024-09-12T17:42:03.316 INFO:teuthology.orchestra.run.smithi119.stderr: 10750K .......... .......... .......... .......... .......... 11% 123M 1s 2024-09-12T17:42:03.316 INFO:teuthology.orchestra.run.smithi119.stderr: 10800K .......... .......... .......... .......... .......... 11% 213M 1s 2024-09-12T17:42:03.316 INFO:teuthology.orchestra.run.smithi119.stderr: 10850K .......... .......... .......... .......... .......... 11% 243M 1s 2024-09-12T17:42:03.316 INFO:teuthology.orchestra.run.smithi119.stderr: 10900K .......... .......... .......... .......... .......... 11% 275M 1s 2024-09-12T17:42:03.317 INFO:teuthology.orchestra.run.smithi119.stderr: 10950K .......... .......... .......... .......... .......... 11% 252M 1s 2024-09-12T17:42:03.317 INFO:teuthology.orchestra.run.smithi119.stderr: 11000K .......... .......... .......... .......... .......... 11% 269M 1s 2024-09-12T17:42:03.317 INFO:teuthology.orchestra.run.smithi119.stderr: 11050K .......... .......... .......... .......... .......... 11% 278M 1s 2024-09-12T17:42:03.317 INFO:teuthology.orchestra.run.smithi119.stderr: 11100K .......... .......... .......... .......... .......... 12% 281M 1s 2024-09-12T17:42:03.317 INFO:teuthology.orchestra.run.smithi119.stderr: 11150K .......... .......... .......... .......... .......... 12% 150M 1s 2024-09-12T17:42:03.317 INFO:teuthology.orchestra.run.smithi119.stderr: 11200K .......... .......... .......... .......... .......... 12% 232M 1s 2024-09-12T17:42:03.317 INFO:teuthology.orchestra.run.smithi119.stderr: 11250K .......... .......... .......... .......... .......... 12% 267M 1s 2024-09-12T17:42:03.317 INFO:teuthology.orchestra.run.smithi119.stderr: 11300K .......... .......... .......... .......... .......... 12% 281M 1s 2024-09-12T17:42:03.317 INFO:teuthology.orchestra.run.smithi119.stderr: 11350K .......... .......... .......... .......... .......... 12% 248M 1s 2024-09-12T17:42:03.317 INFO:teuthology.orchestra.run.smithi119.stderr: 11400K .......... .......... .......... .......... .......... 12% 275M 1s 2024-09-12T17:42:03.317 INFO:teuthology.orchestra.run.smithi119.stderr: 11450K .......... .......... .......... .......... .......... 12% 281M 1s 2024-09-12T17:42:03.317 INFO:teuthology.orchestra.run.smithi119.stderr: 11500K .......... .......... .......... .......... .......... 12% 262M 1s 2024-09-12T17:42:03.317 INFO:teuthology.orchestra.run.smithi119.stderr: 11550K .......... .......... .......... .......... .......... 12% 229M 1s 2024-09-12T17:42:03.318 INFO:teuthology.orchestra.run.smithi119.stderr: 11600K .......... .......... .......... .......... .......... 12% 210M 1s 2024-09-12T17:42:03.318 INFO:teuthology.orchestra.run.smithi119.stderr: 11650K .......... .......... .......... .......... .......... 12% 167M 1s 2024-09-12T17:42:03.318 INFO:teuthology.orchestra.run.smithi119.stderr: 11700K .......... .......... .......... .......... .......... 12% 113M 1s 2024-09-12T17:42:03.318 INFO:teuthology.orchestra.run.smithi119.stderr: 11750K .......... .......... .......... .......... .......... 12% 177M 1s 2024-09-12T17:42:03.318 INFO:teuthology.orchestra.run.smithi119.stderr: 11800K .......... .......... .......... .......... .......... 12% 140M 1s 2024-09-12T17:42:03.318 INFO:teuthology.orchestra.run.smithi119.stderr: 11850K .......... .......... .......... .......... .......... 12% 193M 1s 2024-09-12T17:42:03.318 INFO:teuthology.orchestra.run.smithi119.stderr: 11900K .......... .......... .......... .......... .......... 12% 244M 1s 2024-09-12T17:42:03.318 INFO:teuthology.orchestra.run.smithi119.stderr: 11950K .......... .......... .......... .......... .......... 12% 233M 1s 2024-09-12T17:42:03.318 INFO:teuthology.orchestra.run.smithi119.stderr: 12000K .......... .......... .......... .......... .......... 12% 151M 1s 2024-09-12T17:42:03.318 INFO:teuthology.orchestra.run.smithi119.stderr: 12050K .......... .......... .......... .......... .......... 13% 261M 1s 2024-09-12T17:42:03.318 INFO:teuthology.orchestra.run.smithi119.stderr: 12100K .......... .......... .......... .......... .......... 13% 263M 1s 2024-09-12T17:42:03.318 INFO:teuthology.orchestra.run.smithi119.stderr: 12150K .......... .......... .......... .......... .......... 13% 173M 1s 2024-09-12T17:42:03.319 INFO:teuthology.orchestra.run.smithi119.stderr: 12200K .......... .......... .......... .......... .......... 13% 288M 1s 2024-09-12T17:42:03.319 INFO:teuthology.orchestra.run.smithi119.stderr: 12250K .......... .......... .......... .......... .......... 13% 250M 1s 2024-09-12T17:42:03.319 INFO:teuthology.orchestra.run.smithi119.stderr: 12300K .......... .......... .......... .......... .......... 13% 284M 1s 2024-09-12T17:42:03.319 INFO:teuthology.orchestra.run.smithi119.stderr: 12350K .......... .......... .......... .......... .......... 13% 275M 1s 2024-09-12T17:42:03.319 INFO:teuthology.orchestra.run.smithi119.stderr: 12400K .......... .......... .......... .......... .......... 13% 108M 1s 2024-09-12T17:42:03.319 INFO:teuthology.orchestra.run.smithi119.stderr: 12450K .......... .......... .......... .......... .......... 13% 227M 1s 2024-09-12T17:42:03.319 INFO:teuthology.orchestra.run.smithi119.stderr: 12500K .......... .......... .......... .......... .......... 13% 197M 1s 2024-09-12T17:42:03.319 INFO:teuthology.orchestra.run.smithi119.stderr: 12550K .......... .......... .......... .......... .......... 13% 295M 1s 2024-09-12T17:42:03.319 INFO:teuthology.orchestra.run.smithi119.stderr: 12600K .......... .......... .......... .......... .......... 13% 193M 1s 2024-09-12T17:42:03.319 INFO:teuthology.orchestra.run.smithi119.stderr: 12650K .......... .......... .......... .......... .......... 13% 235M 1s 2024-09-12T17:42:03.319 INFO:teuthology.orchestra.run.smithi119.stderr: 12700K .......... .......... .......... .......... .......... 13% 268M 1s 2024-09-12T17:42:03.319 INFO:teuthology.orchestra.run.smithi119.stderr: 12750K .......... .......... .......... .......... .......... 13% 196M 1s 2024-09-12T17:42:03.319 INFO:teuthology.orchestra.run.smithi119.stderr: 12800K .......... .......... .......... .......... .......... 13% 287M 1s 2024-09-12T17:42:03.320 INFO:teuthology.orchestra.run.smithi119.stderr: 12850K .......... .......... .......... .......... .......... 13% 264M 1s 2024-09-12T17:42:03.320 INFO:teuthology.orchestra.run.smithi119.stderr: 12900K .......... .......... .......... .......... .......... 13% 204M 1s 2024-09-12T17:42:03.320 INFO:teuthology.orchestra.run.smithi119.stderr: 12950K .......... .......... .......... .......... .......... 13% 193M 1s 2024-09-12T17:42:03.320 INFO:teuthology.orchestra.run.smithi119.stderr: 13000K .......... .......... .......... .......... .......... 14% 239M 1s 2024-09-12T17:42:03.320 INFO:teuthology.orchestra.run.smithi119.stderr: 13050K .......... .......... .......... .......... .......... 14% 290M 1s 2024-09-12T17:42:03.320 INFO:teuthology.orchestra.run.smithi119.stderr: 13100K .......... .......... .......... .......... .......... 14% 212M 1s 2024-09-12T17:42:03.320 INFO:teuthology.orchestra.run.smithi119.stderr: 13150K .......... .......... .......... .......... .......... 14% 185M 1s 2024-09-12T17:42:03.320 INFO:teuthology.orchestra.run.smithi119.stderr: 13200K .......... .......... .......... .......... .......... 14% 294M 1s 2024-09-12T17:42:03.320 INFO:teuthology.orchestra.run.smithi119.stderr: 13250K .......... .......... .......... .......... .......... 14% 302M 1s 2024-09-12T17:42:03.320 INFO:teuthology.orchestra.run.smithi119.stderr: 13300K .......... .......... .......... .......... .......... 14% 264M 1s 2024-09-12T17:42:03.320 INFO:teuthology.orchestra.run.smithi119.stderr: 13350K .......... .......... .......... .......... .......... 14% 158M 1s 2024-09-12T17:42:03.320 INFO:teuthology.orchestra.run.smithi119.stderr: 13400K .......... .......... .......... .......... .......... 14% 280M 1s 2024-09-12T17:42:03.320 INFO:teuthology.orchestra.run.smithi119.stderr: 13450K .......... .......... .......... .......... .......... 14% 294M 1s 2024-09-12T17:42:03.321 INFO:teuthology.orchestra.run.smithi119.stderr: 13500K .......... .......... .......... .......... .......... 14% 203M 1s 2024-09-12T17:42:03.321 INFO:teuthology.orchestra.run.smithi119.stderr: 13550K .......... .......... .......... .......... .......... 14% 208M 1s 2024-09-12T17:42:03.321 INFO:teuthology.orchestra.run.smithi119.stderr: 13600K .......... .......... .......... .......... .......... 14% 310M 1s 2024-09-12T17:42:03.321 INFO:teuthology.orchestra.run.smithi119.stderr: 13650K .......... .......... .......... .......... .......... 14% 309M 1s 2024-09-12T17:42:03.321 INFO:teuthology.orchestra.run.smithi119.stderr: 13700K .......... .......... .......... .......... .......... 14% 278M 1s 2024-09-12T17:42:03.321 INFO:teuthology.orchestra.run.smithi119.stderr: 13750K .......... .......... .......... .......... .......... 14% 182M 1s 2024-09-12T17:42:03.321 INFO:teuthology.orchestra.run.smithi119.stderr: 13800K .......... .......... .......... .......... .......... 14% 191M 1s 2024-09-12T17:42:03.321 INFO:teuthology.orchestra.run.smithi119.stderr: 13850K .......... .......... .......... .......... .......... 14% 250M 1s 2024-09-12T17:42:03.321 INFO:teuthology.orchestra.run.smithi119.stderr: 13900K .......... .......... .......... .......... .......... 15% 308M 1s 2024-09-12T17:42:03.321 INFO:teuthology.orchestra.run.smithi119.stderr: 13950K .......... .......... .......... .......... .......... 15% 262M 1s 2024-09-12T17:42:03.321 INFO:teuthology.orchestra.run.smithi119.stderr: 14000K .......... .......... .......... .......... .......... 15% 308M 1s 2024-09-12T17:42:03.321 INFO:teuthology.orchestra.run.smithi119.stderr: 14050K .......... .......... .......... .......... .......... 15% 297M 1s 2024-09-12T17:42:03.321 INFO:teuthology.orchestra.run.smithi119.stderr: 14100K .......... .......... .......... .......... .......... 15% 314M 1s 2024-09-12T17:42:03.321 INFO:teuthology.orchestra.run.smithi119.stderr: 14150K .......... .......... .......... .......... .......... 15% 276M 1s 2024-09-12T17:42:03.322 INFO:teuthology.orchestra.run.smithi119.stderr: 14200K .......... .......... .......... .......... .......... 15% 317M 1s 2024-09-12T17:42:03.322 INFO:teuthology.orchestra.run.smithi119.stderr: 14250K .......... .......... .......... .......... .......... 15% 312M 1s 2024-09-12T17:42:03.322 INFO:teuthology.orchestra.run.smithi119.stderr: 14300K .......... .......... .......... .......... .......... 15% 278M 1s 2024-09-12T17:42:03.322 INFO:teuthology.orchestra.run.smithi119.stderr: 14350K .......... .......... .......... .......... .......... 15% 152M 1s 2024-09-12T17:42:03.322 INFO:teuthology.orchestra.run.smithi119.stderr: 14400K .......... .......... .......... .......... .......... 15% 206M 1s 2024-09-12T17:42:03.322 INFO:teuthology.orchestra.run.smithi119.stderr: 14450K .......... .......... .......... .......... .......... 15% 219M 1s 2024-09-12T17:42:03.322 INFO:teuthology.orchestra.run.smithi119.stderr: 14500K .......... .......... .......... .......... .......... 15% 232M 1s 2024-09-12T17:42:03.322 INFO:teuthology.orchestra.run.smithi119.stderr: 14550K .......... .......... .......... .......... .......... 15% 216M 1s 2024-09-12T17:42:03.322 INFO:teuthology.orchestra.run.smithi119.stderr: 14600K .......... .......... .......... .......... .......... 15% 244M 1s 2024-09-12T17:42:03.322 INFO:teuthology.orchestra.run.smithi119.stderr: 14650K .......... .......... .......... .......... .......... 15% 231M 1s 2024-09-12T17:42:03.322 INFO:teuthology.orchestra.run.smithi119.stderr: 14700K .......... .......... .......... .......... .......... 15% 323M 1s 2024-09-12T17:42:03.322 INFO:teuthology.orchestra.run.smithi119.stderr: 14750K .......... .......... .......... .......... .......... 15% 276M 1s 2024-09-12T17:42:03.322 INFO:teuthology.orchestra.run.smithi119.stderr: 14800K .......... .......... .......... .......... .......... 15% 206M 1s 2024-09-12T17:42:03.323 INFO:teuthology.orchestra.run.smithi119.stderr: 14850K .......... .......... .......... .......... .......... 16% 279M 1s 2024-09-12T17:42:03.323 INFO:teuthology.orchestra.run.smithi119.stderr: 14900K .......... .......... .......... .......... .......... 16% 333M 1s 2024-09-12T17:42:03.323 INFO:teuthology.orchestra.run.smithi119.stderr: 14950K .......... .......... .......... .......... .......... 16% 197M 1s 2024-09-12T17:42:03.323 INFO:teuthology.orchestra.run.smithi119.stderr: 15000K .......... .......... .......... .......... .......... 16% 239M 1s 2024-09-12T17:42:03.323 INFO:teuthology.orchestra.run.smithi119.stderr: 15050K .......... .......... .......... .......... .......... 16% 315M 1s 2024-09-12T17:42:03.323 INFO:teuthology.orchestra.run.smithi119.stderr: 15100K .......... .......... .......... .......... .......... 16% 320M 1s 2024-09-12T17:42:03.323 INFO:teuthology.orchestra.run.smithi119.stderr: 15150K .......... .......... .......... .......... .......... 16% 275M 1s 2024-09-12T17:42:03.323 INFO:teuthology.orchestra.run.smithi119.stderr: 15200K .......... .......... .......... .......... .......... 16% 296M 1s 2024-09-12T17:42:03.323 INFO:teuthology.orchestra.run.smithi119.stderr: 15250K .......... .......... .......... .......... .......... 16% 200M 1s 2024-09-12T17:42:03.323 INFO:teuthology.orchestra.run.smithi119.stderr: 15300K .......... .......... .......... .......... .......... 16% 178M 1s 2024-09-12T17:42:03.323 INFO:teuthology.orchestra.run.smithi119.stderr: 15350K .......... .......... .......... .......... .......... 16% 158M 1s 2024-09-12T17:42:03.323 INFO:teuthology.orchestra.run.smithi119.stderr: 15400K .......... .......... .......... .......... .......... 16% 260M 1s 2024-09-12T17:42:03.323 INFO:teuthology.orchestra.run.smithi119.stderr: 15450K .......... .......... .......... .......... .......... 16% 315M 1s 2024-09-12T17:42:03.323 INFO:teuthology.orchestra.run.smithi119.stderr: 15500K .......... .......... .......... .......... .......... 16% 345M 1s 2024-09-12T17:42:03.324 INFO:teuthology.orchestra.run.smithi119.stderr: 15550K .......... .......... .......... .......... .......... 16% 235M 1s 2024-09-12T17:42:03.324 INFO:teuthology.orchestra.run.smithi119.stderr: 15600K .......... .......... .......... .......... .......... 16% 265M 1s 2024-09-12T17:42:03.324 INFO:teuthology.orchestra.run.smithi119.stderr: 15650K .......... .......... .......... .......... .......... 16% 266M 1s 2024-09-12T17:42:03.324 INFO:teuthology.orchestra.run.smithi119.stderr: 15700K .......... .......... .......... .......... .......... 16% 343M 1s 2024-09-12T17:42:03.324 INFO:teuthology.orchestra.run.smithi119.stderr: 15750K .......... .......... .......... .......... .......... 17% 211M 1s 2024-09-12T17:42:03.324 INFO:teuthology.orchestra.run.smithi119.stderr: 15800K .......... .......... .......... .......... .......... 17% 228M 1s 2024-09-12T17:42:03.324 INFO:teuthology.orchestra.run.smithi119.stderr: 15850K .......... .......... .......... .......... .......... 17% 244M 1s 2024-09-12T17:42:03.324 INFO:teuthology.orchestra.run.smithi119.stderr: 15900K .......... .......... .......... .......... .......... 17% 266M 1s 2024-09-12T17:42:03.324 INFO:teuthology.orchestra.run.smithi119.stderr: 15950K .......... .......... .......... .......... .......... 17% 312M 1s 2024-09-12T17:42:03.324 INFO:teuthology.orchestra.run.smithi119.stderr: 16000K .......... .......... .......... .......... .......... 17% 230M 1s 2024-09-12T17:42:03.324 INFO:teuthology.orchestra.run.smithi119.stderr: 16050K .......... .......... .......... .......... .......... 17% 224M 1s 2024-09-12T17:42:03.324 INFO:teuthology.orchestra.run.smithi119.stderr: 16100K .......... .......... .......... .......... .......... 17% 344M 1s 2024-09-12T17:42:03.324 INFO:teuthology.orchestra.run.smithi119.stderr: 16150K .......... .......... .......... .......... .......... 17% 239M 1s 2024-09-12T17:42:03.325 INFO:teuthology.orchestra.run.smithi119.stderr: 16200K .......... .......... .......... .......... .......... 17% 248M 1s 2024-09-12T17:42:03.325 INFO:teuthology.orchestra.run.smithi119.stderr: 16250K .......... .......... .......... .......... .......... 17% 346M 1s 2024-09-12T17:42:03.325 INFO:teuthology.orchestra.run.smithi119.stderr: 16300K .......... .......... .......... .......... .......... 17% 252M 1s 2024-09-12T17:42:03.325 INFO:teuthology.orchestra.run.smithi119.stderr: 16350K .......... .......... .......... .......... .......... 17% 200M 1s 2024-09-12T17:42:03.325 INFO:teuthology.orchestra.run.smithi119.stderr: 16400K .......... .......... .......... .......... .......... 17% 207M 1s 2024-09-12T17:42:03.325 INFO:teuthology.orchestra.run.smithi119.stderr: 16450K .......... .......... .......... .......... .......... 17% 304M 1s 2024-09-12T17:42:03.325 INFO:teuthology.orchestra.run.smithi119.stderr: 16500K .......... .......... .......... .......... .......... 17% 310M 1s 2024-09-12T17:42:03.325 INFO:teuthology.orchestra.run.smithi119.stderr: 16550K .......... .......... .......... .......... .......... 17% 139M 1s 2024-09-12T17:42:03.325 INFO:teuthology.orchestra.run.smithi119.stderr: 16600K .......... .......... .......... .......... .......... 17% 151M 1s 2024-09-12T17:42:03.325 INFO:teuthology.orchestra.run.smithi119.stderr: 16650K .......... .......... .......... .......... .......... 17% 183M 1s 2024-09-12T17:42:03.325 INFO:teuthology.orchestra.run.smithi119.stderr: 16700K .......... .......... .......... .......... .......... 18% 189M 1s 2024-09-12T17:42:03.325 INFO:teuthology.orchestra.run.smithi119.stderr: 16750K .......... .......... .......... .......... .......... 18% 158M 1s 2024-09-12T17:42:03.325 INFO:teuthology.orchestra.run.smithi119.stderr: 16800K .......... .......... .......... .......... .......... 18% 204M 1s 2024-09-12T17:42:03.326 INFO:teuthology.orchestra.run.smithi119.stderr: 16850K .......... .......... .......... .......... .......... 18% 321M 1s 2024-09-12T17:42:03.326 INFO:teuthology.orchestra.run.smithi119.stderr: 16900K .......... .......... .......... .......... .......... 18% 350M 1s 2024-09-12T17:42:03.326 INFO:teuthology.orchestra.run.smithi119.stderr: 16950K .......... .......... .......... .......... .......... 18% 312M 1s 2024-09-12T17:42:03.326 INFO:teuthology.orchestra.run.smithi119.stderr: 17000K .......... .......... .......... .......... .......... 18% 47.6M 1s 2024-09-12T17:42:03.326 INFO:teuthology.orchestra.run.smithi119.stderr: 17050K .......... .......... .......... .......... .......... 18% 217M 1s 2024-09-12T17:42:03.326 INFO:teuthology.orchestra.run.smithi119.stderr: 17100K .......... .......... .......... .......... .......... 18% 220M 1s 2024-09-12T17:42:03.326 INFO:teuthology.orchestra.run.smithi119.stderr: 17150K .......... .......... .......... .......... .......... 18% 196M 1s 2024-09-12T17:42:03.326 INFO:teuthology.orchestra.run.smithi119.stderr: 17200K .......... .......... .......... .......... .......... 18% 290M 1s 2024-09-12T17:42:03.326 INFO:teuthology.orchestra.run.smithi119.stderr: 17250K .......... .......... .......... .......... .......... 18% 230M 1s 2024-09-12T17:42:03.326 INFO:teuthology.orchestra.run.smithi119.stderr: 17300K .......... .......... .......... .......... .......... 18% 236M 1s 2024-09-12T17:42:03.326 INFO:teuthology.orchestra.run.smithi119.stderr: 17350K .......... .......... .......... .......... .......... 18% 226M 1s 2024-09-12T17:42:03.326 INFO:teuthology.orchestra.run.smithi119.stderr: 17400K .......... .......... .......... .......... .......... 18% 226M 1s 2024-09-12T17:42:03.326 INFO:teuthology.orchestra.run.smithi119.stderr: 17450K .......... .......... .......... .......... .......... 18% 283M 1s 2024-09-12T17:42:03.327 INFO:teuthology.orchestra.run.smithi119.stderr: 17500K .......... .......... .......... .......... .......... 18% 236M 1s 2024-09-12T17:42:03.327 INFO:teuthology.orchestra.run.smithi119.stderr: 17550K .......... .......... .......... .......... .......... 18% 187M 1s 2024-09-12T17:42:03.327 INFO:teuthology.orchestra.run.smithi119.stderr: 17600K .......... .......... .......... .......... .......... 18% 250M 1s 2024-09-12T17:42:03.327 INFO:teuthology.orchestra.run.smithi119.stderr: 17650K .......... .......... .......... .......... .......... 19% 293M 1s 2024-09-12T17:42:03.327 INFO:teuthology.orchestra.run.smithi119.stderr: 17700K .......... .......... .......... .......... .......... 19% 308M 1s 2024-09-12T17:42:03.327 INFO:teuthology.orchestra.run.smithi119.stderr: 17750K .......... .......... .......... .......... .......... 19% 202M 1s 2024-09-12T17:42:03.327 INFO:teuthology.orchestra.run.smithi119.stderr: 17800K .......... .......... .......... .......... .......... 19% 288M 1s 2024-09-12T17:42:03.327 INFO:teuthology.orchestra.run.smithi119.stderr: 17850K .......... .......... .......... .......... .......... 19% 351M 1s 2024-09-12T17:42:03.327 INFO:teuthology.orchestra.run.smithi119.stderr: 17900K .......... .......... .......... .......... .......... 19% 200M 1s 2024-09-12T17:42:03.327 INFO:teuthology.orchestra.run.smithi119.stderr: 17950K .......... .......... .......... .......... .......... 19% 182M 1s 2024-09-12T17:42:03.327 INFO:teuthology.orchestra.run.smithi119.stderr: 18000K .......... .......... .......... .......... .......... 19% 258M 1s 2024-09-12T17:42:03.327 INFO:teuthology.orchestra.run.smithi119.stderr: 18050K .......... .......... .......... .......... .......... 19% 199M 1s 2024-09-12T17:42:03.327 INFO:teuthology.orchestra.run.smithi119.stderr: 18100K .......... .......... .......... .......... .......... 19% 296M 1s 2024-09-12T17:42:03.328 INFO:teuthology.orchestra.run.smithi119.stderr: 18150K .......... .......... .......... .......... .......... 19% 280M 1s 2024-09-12T17:42:03.328 INFO:teuthology.orchestra.run.smithi119.stderr: 18200K .......... .......... .......... .......... .......... 19% 354M 1s 2024-09-12T17:42:03.328 INFO:teuthology.orchestra.run.smithi119.stderr: 18250K .......... .......... .......... .......... .......... 19% 360M 1s 2024-09-12T17:42:03.328 INFO:teuthology.orchestra.run.smithi119.stderr: 18300K .......... .......... .......... .......... .......... 19% 348M 1s 2024-09-12T17:42:03.328 INFO:teuthology.orchestra.run.smithi119.stderr: 18350K .......... .......... .......... .......... .......... 19% 278M 1s 2024-09-12T17:42:03.328 INFO:teuthology.orchestra.run.smithi119.stderr: 18400K .......... .......... .......... .......... .......... 19% 224M 1s 2024-09-12T17:42:03.328 INFO:teuthology.orchestra.run.smithi119.stderr: 18450K .......... .......... .......... .......... .......... 19% 241M 1s 2024-09-12T17:42:03.328 INFO:teuthology.orchestra.run.smithi119.stderr: 18500K .......... .......... .......... .......... .......... 19% 264M 1s 2024-09-12T17:42:03.328 INFO:teuthology.orchestra.run.smithi119.stderr: 18550K .......... .......... .......... .......... .......... 20% 226M 1s 2024-09-12T17:42:03.328 INFO:teuthology.orchestra.run.smithi119.stderr: 18600K .......... .......... .......... .......... .......... 20% 320M 1s 2024-09-12T17:42:03.328 INFO:teuthology.orchestra.run.smithi119.stderr: 18650K .......... .......... .......... .......... .......... 20% 184M 1s 2024-09-12T17:42:03.328 INFO:teuthology.orchestra.run.smithi119.stderr: 18700K .......... .......... .......... .......... .......... 20% 180M 1s 2024-09-12T17:42:03.328 INFO:teuthology.orchestra.run.smithi119.stderr: 18750K .......... .......... .......... .......... .......... 20% 212M 1s 2024-09-12T17:42:03.329 INFO:teuthology.orchestra.run.smithi119.stderr: 18800K .......... .......... .......... .......... .......... 20% 218M 1s 2024-09-12T17:42:03.329 INFO:teuthology.orchestra.run.smithi119.stderr: 18850K .......... .......... .......... .......... .......... 20% 349M 1s 2024-09-12T17:42:03.329 INFO:teuthology.orchestra.run.smithi119.stderr: 18900K .......... .......... .......... .......... .......... 20% 358M 1s 2024-09-12T17:42:03.329 INFO:teuthology.orchestra.run.smithi119.stderr: 18950K .......... .......... .......... .......... .......... 20% 258M 1s 2024-09-12T17:42:03.329 INFO:teuthology.orchestra.run.smithi119.stderr: 19000K .......... .......... .......... .......... .......... 20% 210M 1s 2024-09-12T17:42:03.329 INFO:teuthology.orchestra.run.smithi119.stderr: 19050K .......... .......... .......... .......... .......... 20% 209M 1s 2024-09-12T17:42:03.329 INFO:teuthology.orchestra.run.smithi119.stderr: 19100K .......... .......... .......... .......... .......... 20% 250M 1s 2024-09-12T17:42:03.329 INFO:teuthology.orchestra.run.smithi119.stderr: 19150K .......... .......... .......... .......... .......... 20% 292M 1s 2024-09-12T17:42:03.329 INFO:teuthology.orchestra.run.smithi119.stderr: 19200K .......... .......... .......... .......... .......... 20% 361M 1s 2024-09-12T17:42:03.329 INFO:teuthology.orchestra.run.smithi119.stderr: 19250K .......... .......... .......... .......... .......... 20% 289M 1s 2024-09-12T17:42:03.329 INFO:teuthology.orchestra.run.smithi119.stderr: 19300K .......... .......... .......... .......... .......... 20% 259M 1s 2024-09-12T17:42:03.329 INFO:teuthology.orchestra.run.smithi119.stderr: 19350K .......... .......... .......... .......... .......... 20% 206M 1s 2024-09-12T17:42:03.329 INFO:teuthology.orchestra.run.smithi119.stderr: 19400K .......... .......... .......... .......... .......... 20% 237M 1s 2024-09-12T17:42:03.330 INFO:teuthology.orchestra.run.smithi119.stderr: 19450K .......... .......... .......... .......... .......... 20% 337M 1s 2024-09-12T17:42:03.330 INFO:teuthology.orchestra.run.smithi119.stderr: 19500K .......... .......... .......... .......... .......... 21% 360M 1s 2024-09-12T17:42:03.330 INFO:teuthology.orchestra.run.smithi119.stderr: 19550K .......... .......... .......... .......... .......... 21% 200M 1s 2024-09-12T17:42:03.330 INFO:teuthology.orchestra.run.smithi119.stderr: 19600K .......... .......... .......... .......... .......... 21% 269M 1s 2024-09-12T17:42:03.330 INFO:teuthology.orchestra.run.smithi119.stderr: 19650K .......... .......... .......... .......... .......... 21% 359M 1s 2024-09-12T17:42:03.330 INFO:teuthology.orchestra.run.smithi119.stderr: 19700K .......... .......... .......... .......... .......... 21% 357M 1s 2024-09-12T17:42:03.330 INFO:teuthology.orchestra.run.smithi119.stderr: 19750K .......... .......... .......... .......... .......... 21% 319M 1s 2024-09-12T17:42:03.330 INFO:teuthology.orchestra.run.smithi119.stderr: 19800K .......... .......... .......... .......... .......... 21% 361M 1s 2024-09-12T17:42:03.330 INFO:teuthology.orchestra.run.smithi119.stderr: 19850K .......... .......... .......... .......... .......... 21% 348M 1s 2024-09-12T17:42:03.330 INFO:teuthology.orchestra.run.smithi119.stderr: 19900K .......... .......... .......... .......... .......... 21% 55.2M 1s 2024-09-12T17:42:03.330 INFO:teuthology.orchestra.run.smithi119.stderr: 19950K .......... .......... .......... .......... .......... 21% 194M 1s 2024-09-12T17:42:03.330 INFO:teuthology.orchestra.run.smithi119.stderr: 20000K .......... .......... .......... .......... .......... 21% 342M 1s 2024-09-12T17:42:03.330 INFO:teuthology.orchestra.run.smithi119.stderr: 20050K .......... .......... .......... .......... .......... 21% 260M 1s 2024-09-12T17:42:03.330 INFO:teuthology.orchestra.run.smithi119.stderr: 20100K .......... .......... .......... .......... .......... 21% 279M 1s 2024-09-12T17:42:03.331 INFO:teuthology.orchestra.run.smithi119.stderr: 20150K .......... .......... .......... .......... .......... 21% 72.5M 1s 2024-09-12T17:42:03.331 INFO:teuthology.orchestra.run.smithi119.stderr: 20200K .......... .......... .......... .......... .......... 21% 295M 1s 2024-09-12T17:42:03.331 INFO:teuthology.orchestra.run.smithi119.stderr: 20250K .......... .......... .......... .......... .......... 21% 153M 1s 2024-09-12T17:42:03.331 INFO:teuthology.orchestra.run.smithi119.stderr: 20300K .......... .......... .......... .......... .......... 21% 209M 1s 2024-09-12T17:42:03.331 INFO:teuthology.orchestra.run.smithi119.stderr: 20350K .......... .......... .......... .......... .......... 21% 215M 1s 2024-09-12T17:42:03.331 INFO:teuthology.orchestra.run.smithi119.stderr: 20400K .......... .......... .......... .......... .......... 22% 251M 1s 2024-09-12T17:42:03.331 INFO:teuthology.orchestra.run.smithi119.stderr: 20450K .......... .......... .......... .......... .......... 22% 240M 1s 2024-09-12T17:42:03.331 INFO:teuthology.orchestra.run.smithi119.stderr: 20500K .......... .......... .......... .......... .......... 22% 268M 1s 2024-09-12T17:42:03.331 INFO:teuthology.orchestra.run.smithi119.stderr: 20550K .......... .......... .......... .......... .......... 22% 348M 1s 2024-09-12T17:42:03.331 INFO:teuthology.orchestra.run.smithi119.stderr: 20600K .......... .......... .......... .......... .......... 22% 204M 1s 2024-09-12T17:42:03.331 INFO:teuthology.orchestra.run.smithi119.stderr: 20650K .......... .......... .......... .......... .......... 22% 236M 1s 2024-09-12T17:42:03.331 INFO:teuthology.orchestra.run.smithi119.stderr: 20700K .......... .......... .......... .......... .......... 22% 203M 1s 2024-09-12T17:42:03.331 INFO:teuthology.orchestra.run.smithi119.stderr: 20750K .......... .......... .......... .......... .......... 22% 264M 1s 2024-09-12T17:42:03.331 INFO:teuthology.orchestra.run.smithi119.stderr: 20800K .......... .......... .......... .......... .......... 22% 324M 1s 2024-09-12T17:42:03.331 INFO:teuthology.orchestra.run.smithi119.stderr: 20850K .......... .......... .......... .......... .......... 22% 313M 1s 2024-09-12T17:42:03.332 INFO:teuthology.orchestra.run.smithi119.stderr: 20900K .......... .......... .......... .......... .......... 22% 214M 1s 2024-09-12T17:42:03.332 INFO:teuthology.orchestra.run.smithi119.stderr: 20950K .......... .......... .......... .......... .......... 22% 241M 1s 2024-09-12T17:42:03.332 INFO:teuthology.orchestra.run.smithi119.stderr: 21000K .......... .......... .......... .......... .......... 22% 339M 1s 2024-09-12T17:42:03.332 INFO:teuthology.orchestra.run.smithi119.stderr: 21050K .......... .......... .......... .......... .......... 22% 362M 1s 2024-09-12T17:42:03.332 INFO:teuthology.orchestra.run.smithi119.stderr: 21100K .......... .......... .......... .......... .......... 22% 262M 1s 2024-09-12T17:42:03.332 INFO:teuthology.orchestra.run.smithi119.stderr: 21150K .......... .......... .......... .......... .......... 22% 253M 1s 2024-09-12T17:42:03.332 INFO:teuthology.orchestra.run.smithi119.stderr: 21200K .......... .......... .......... .......... .......... 22% 230M 1s 2024-09-12T17:42:03.332 INFO:teuthology.orchestra.run.smithi119.stderr: 21250K .......... .......... .......... .......... .......... 22% 268M 1s 2024-09-12T17:42:03.332 INFO:teuthology.orchestra.run.smithi119.stderr: 21300K .......... .......... .......... .......... .......... 22% 209M 1s 2024-09-12T17:42:03.332 INFO:teuthology.orchestra.run.smithi119.stderr: 21350K .......... .......... .......... .......... .......... 23% 263M 1s 2024-09-12T17:42:03.332 INFO:teuthology.orchestra.run.smithi119.stderr: 21400K .......... .......... .......... .......... .......... 23% 270M 1s 2024-09-12T17:42:03.332 INFO:teuthology.orchestra.run.smithi119.stderr: 21450K .......... .......... .......... .......... .......... 23% 307M 1s 2024-09-12T17:42:03.332 INFO:teuthology.orchestra.run.smithi119.stderr: 21500K .......... .......... .......... .......... .......... 23% 236M 1s 2024-09-12T17:42:03.332 INFO:teuthology.orchestra.run.smithi119.stderr: 21550K .......... .......... .......... .......... .......... 23% 326M 1s 2024-09-12T17:42:03.333 INFO:teuthology.orchestra.run.smithi119.stderr: 21600K .......... .......... .......... .......... .......... 23% 237M 1s 2024-09-12T17:42:03.333 INFO:teuthology.orchestra.run.smithi119.stderr: 21650K .......... .......... .......... .......... .......... 23% 276M 1s 2024-09-12T17:42:03.333 INFO:teuthology.orchestra.run.smithi119.stderr: 21700K .......... .......... .......... .......... .......... 23% 314M 1s 2024-09-12T17:42:03.333 INFO:teuthology.orchestra.run.smithi119.stderr: 21750K .......... .......... .......... .......... .......... 23% 357M 1s 2024-09-12T17:42:03.333 INFO:teuthology.orchestra.run.smithi119.stderr: 21800K .......... .......... .......... .......... .......... 23% 283M 1s 2024-09-12T17:42:03.333 INFO:teuthology.orchestra.run.smithi119.stderr: 21850K .......... .......... .......... .......... .......... 23% 237M 1s 2024-09-12T17:42:03.333 INFO:teuthology.orchestra.run.smithi119.stderr: 21900K .......... .......... .......... .......... .......... 23% 227M 1s 2024-09-12T17:42:03.333 INFO:teuthology.orchestra.run.smithi119.stderr: 21950K .......... .......... .......... .......... .......... 23% 270M 1s 2024-09-12T17:42:03.333 INFO:teuthology.orchestra.run.smithi119.stderr: 22000K .......... .......... .......... .......... .......... 23% 256M 1s 2024-09-12T17:42:03.333 INFO:teuthology.orchestra.run.smithi119.stderr: 22050K .......... .......... .......... .......... .......... 23% 301M 1s 2024-09-12T17:42:03.333 INFO:teuthology.orchestra.run.smithi119.stderr: 22100K .......... .......... .......... .......... .......... 23% 220M 1s 2024-09-12T17:42:03.333 INFO:teuthology.orchestra.run.smithi119.stderr: 22150K .......... .......... .......... .......... .......... 23% 253M 1s 2024-09-12T17:42:03.333 INFO:teuthology.orchestra.run.smithi119.stderr: 22200K .......... .......... .......... .......... .......... 23% 264M 1s 2024-09-12T17:42:03.334 INFO:teuthology.orchestra.run.smithi119.stderr: 22250K .......... .......... .......... .......... .......... 24% 311M 1s 2024-09-12T17:42:03.334 INFO:teuthology.orchestra.run.smithi119.stderr: 22300K .......... .......... .......... .......... .......... 24% 250M 1s 2024-09-12T17:42:03.334 INFO:teuthology.orchestra.run.smithi119.stderr: 22350K .......... .......... .......... .......... .......... 24% 267M 1s 2024-09-12T17:42:03.334 INFO:teuthology.orchestra.run.smithi119.stderr: 22400K .......... .......... .......... .......... .......... 24% 238M 1s 2024-09-12T17:42:03.334 INFO:teuthology.orchestra.run.smithi119.stderr: 22450K .......... .......... .......... .......... .......... 24% 332M 1s 2024-09-12T17:42:03.334 INFO:teuthology.orchestra.run.smithi119.stderr: 22500K .......... .......... .......... .......... .......... 24% 310M 1s 2024-09-12T17:42:03.334 INFO:teuthology.orchestra.run.smithi119.stderr: 22550K .......... .......... .......... .......... .......... 24% 358M 1s 2024-09-12T17:42:03.334 INFO:teuthology.orchestra.run.smithi119.stderr: 22600K .......... .......... .......... .......... .......... 24% 285M 1s 2024-09-12T17:42:03.334 INFO:teuthology.orchestra.run.smithi119.stderr: 22650K .......... .......... .......... .......... .......... 24% 50.1M 1s 2024-09-12T17:42:03.334 INFO:teuthology.orchestra.run.smithi119.stderr: 22700K .......... .......... .......... .......... .......... 24% 179M 1s 2024-09-12T17:42:03.334 INFO:teuthology.orchestra.run.smithi119.stderr: 22750K .......... .......... .......... .......... .......... 24% 240M 1s 2024-09-12T17:42:03.334 INFO:teuthology.orchestra.run.smithi119.stderr: 22800K .......... .......... .......... .......... .......... 24% 207M 1s 2024-09-12T17:42:03.334 INFO:teuthology.orchestra.run.smithi119.stderr: 22850K .......... .......... .......... .......... .......... 24% 196M 1s 2024-09-12T17:42:03.334 INFO:teuthology.orchestra.run.smithi119.stderr: 22900K .......... .......... .......... .......... .......... 24% 266M 1s 2024-09-12T17:42:03.335 INFO:teuthology.orchestra.run.smithi119.stderr: 22950K .......... .......... .......... .......... .......... 24% 355M 1s 2024-09-12T17:42:03.335 INFO:teuthology.orchestra.run.smithi119.stderr: 23000K .......... .......... .......... .......... .......... 24% 298M 1s 2024-09-12T17:42:03.335 INFO:teuthology.orchestra.run.smithi119.stderr: 23050K .......... .......... .......... .......... .......... 24% 302M 1s 2024-09-12T17:42:03.335 INFO:teuthology.orchestra.run.smithi119.stderr: 23100K .......... .......... .......... .......... .......... 24% 251M 1s 2024-09-12T17:42:03.335 INFO:teuthology.orchestra.run.smithi119.stderr: 23150K .......... .......... .......... .......... .......... 24% 254M 1s 2024-09-12T17:42:03.335 INFO:teuthology.orchestra.run.smithi119.stderr: 23200K .......... .......... .......... .......... .......... 25% 222M 1s 2024-09-12T17:42:03.335 INFO:teuthology.orchestra.run.smithi119.stderr: 23250K .......... .......... .......... .......... .......... 25% 240M 1s 2024-09-12T17:42:03.335 INFO:teuthology.orchestra.run.smithi119.stderr: 23300K .......... .......... .......... .......... .......... 25% 236M 1s 2024-09-12T17:42:03.335 INFO:teuthology.orchestra.run.smithi119.stderr: 23350K .......... .......... .......... .......... .......... 25% 315M 1s 2024-09-12T17:42:03.335 INFO:teuthology.orchestra.run.smithi119.stderr: 23400K .......... .......... .......... .......... .......... 25% 165M 1s 2024-09-12T17:42:03.335 INFO:teuthology.orchestra.run.smithi119.stderr: 23450K .......... .......... .......... .......... .......... 25% 371M 1s 2024-09-12T17:42:03.335 INFO:teuthology.orchestra.run.smithi119.stderr: 23500K .......... .......... .......... .......... .......... 25% 274M 1s 2024-09-12T17:42:03.335 INFO:teuthology.orchestra.run.smithi119.stderr: 23550K .......... .......... .......... .......... .......... 25% 217M 1s 2024-09-12T17:42:03.335 INFO:teuthology.orchestra.run.smithi119.stderr: 23600K .......... .......... .......... .......... .......... 25% 216M 1s 2024-09-12T17:42:03.336 INFO:teuthology.orchestra.run.smithi119.stderr: 23650K .......... .......... .......... .......... .......... 25% 210M 1s 2024-09-12T17:42:03.336 INFO:teuthology.orchestra.run.smithi119.stderr: 23700K .......... .......... .......... .......... .......... 25% 311M 1s 2024-09-12T17:42:03.336 INFO:teuthology.orchestra.run.smithi119.stderr: 23750K .......... .......... .......... .......... .......... 25% 232M 1s 2024-09-12T17:42:03.336 INFO:teuthology.orchestra.run.smithi119.stderr: 23800K .......... .......... .......... .......... .......... 25% 238M 1s 2024-09-12T17:42:03.336 INFO:teuthology.orchestra.run.smithi119.stderr: 23850K .......... .......... .......... .......... .......... 25% 203M 1s 2024-09-12T17:42:03.336 INFO:teuthology.orchestra.run.smithi119.stderr: 23900K .......... .......... .......... .......... .......... 25% 215M 1s 2024-09-12T17:42:03.336 INFO:teuthology.orchestra.run.smithi119.stderr: 23950K .......... .......... .......... .......... .......... 25% 312M 1s 2024-09-12T17:42:03.336 INFO:teuthology.orchestra.run.smithi119.stderr: 24000K .......... .......... .......... .......... .......... 25% 212M 1s 2024-09-12T17:42:03.336 INFO:teuthology.orchestra.run.smithi119.stderr: 24050K .......... .......... .......... .......... .......... 25% 257M 1s 2024-09-12T17:42:03.336 INFO:teuthology.orchestra.run.smithi119.stderr: 24100K .......... .......... .......... .......... .......... 25% 234M 1s 2024-09-12T17:42:03.336 INFO:teuthology.orchestra.run.smithi119.stderr: 24150K .......... .......... .......... .......... .......... 26% 253M 1s 2024-09-12T17:42:03.336 INFO:teuthology.orchestra.run.smithi119.stderr: 24200K .......... .......... .......... .......... .......... 26% 283M 1s 2024-09-12T17:42:03.336 INFO:teuthology.orchestra.run.smithi119.stderr: 24250K .......... .......... .......... .......... .......... 26% 283M 1s 2024-09-12T17:42:03.336 INFO:teuthology.orchestra.run.smithi119.stderr: 24300K .......... .......... .......... .......... .......... 26% 251M 1s 2024-09-12T17:42:03.337 INFO:teuthology.orchestra.run.smithi119.stderr: 24350K .......... .......... .......... .......... .......... 26% 256M 1s 2024-09-12T17:42:03.337 INFO:teuthology.orchestra.run.smithi119.stderr: 24400K .......... .......... .......... .......... .......... 26% 237M 1s 2024-09-12T17:42:03.337 INFO:teuthology.orchestra.run.smithi119.stderr: 24450K .......... .......... .......... .......... .......... 26% 185M 1s 2024-09-12T17:42:03.337 INFO:teuthology.orchestra.run.smithi119.stderr: 24500K .......... .......... .......... .......... .......... 26% 216M 1s 2024-09-12T17:42:03.337 INFO:teuthology.orchestra.run.smithi119.stderr: 24550K .......... .......... .......... .......... .......... 26% 197M 1s 2024-09-12T17:42:03.337 INFO:teuthology.orchestra.run.smithi119.stderr: 24600K .......... .......... .......... .......... .......... 26% 210M 1s 2024-09-12T17:42:03.337 INFO:teuthology.orchestra.run.smithi119.stderr: 24650K .......... .......... .......... .......... .......... 26% 259M 1s 2024-09-12T17:42:03.337 INFO:teuthology.orchestra.run.smithi119.stderr: 24700K .......... .......... .......... .......... .......... 26% 145M 1s 2024-09-12T17:42:03.337 INFO:teuthology.orchestra.run.smithi119.stderr: 24750K .......... .......... .......... .......... .......... 26% 227M 1s 2024-09-12T17:42:03.337 INFO:teuthology.orchestra.run.smithi119.stderr: 24800K .......... .......... .......... .......... .......... 26% 204M 1s 2024-09-12T17:42:03.337 INFO:teuthology.orchestra.run.smithi119.stderr: 24850K .......... .......... .......... .......... .......... 26% 217M 1s 2024-09-12T17:42:03.337 INFO:teuthology.orchestra.run.smithi119.stderr: 24900K .......... .......... .......... .......... .......... 26% 306M 1s 2024-09-12T17:42:03.337 INFO:teuthology.orchestra.run.smithi119.stderr: 24950K .......... .......... .......... .......... .......... 26% 255M 1s 2024-09-12T17:42:03.337 INFO:teuthology.orchestra.run.smithi119.stderr: 25000K .......... .......... .......... .......... .......... 26% 233M 1s 2024-09-12T17:42:03.338 INFO:teuthology.orchestra.run.smithi119.stderr: 25050K .......... .......... .......... .......... .......... 27% 284M 1s 2024-09-12T17:42:03.338 INFO:teuthology.orchestra.run.smithi119.stderr: 25100K .......... .......... .......... .......... .......... 27% 193M 1s 2024-09-12T17:42:03.338 INFO:teuthology.orchestra.run.smithi119.stderr: 25150K .......... .......... .......... .......... .......... 27% 293M 1s 2024-09-12T17:42:03.338 INFO:teuthology.orchestra.run.smithi119.stderr: 25200K .......... .......... .......... .......... .......... 27% 360M 1s 2024-09-12T17:42:03.338 INFO:teuthology.orchestra.run.smithi119.stderr: 25250K .......... .......... .......... .......... .......... 27% 365M 1s 2024-09-12T17:42:03.338 INFO:teuthology.orchestra.run.smithi119.stderr: 25300K .......... .......... .......... .......... .......... 27% 324M 1s 2024-09-12T17:42:03.338 INFO:teuthology.orchestra.run.smithi119.stderr: 25350K .......... .......... .......... .......... .......... 27% 62.7M 1s 2024-09-12T17:42:03.338 INFO:teuthology.orchestra.run.smithi119.stderr: 25400K .......... .......... .......... .......... .......... 27% 212M 1s 2024-09-12T17:42:03.338 INFO:teuthology.orchestra.run.smithi119.stderr: 25450K .......... .......... .......... .......... .......... 27% 328M 1s 2024-09-12T17:42:03.338 INFO:teuthology.orchestra.run.smithi119.stderr: 25500K .......... .......... .......... .......... .......... 27% 212M 1s 2024-09-12T17:42:03.338 INFO:teuthology.orchestra.run.smithi119.stderr: 25550K .......... .......... .......... .......... .......... 27% 230M 1s 2024-09-12T17:42:03.338 INFO:teuthology.orchestra.run.smithi119.stderr: 25600K .......... .......... .......... .......... .......... 27% 241M 1s 2024-09-12T17:42:03.338 INFO:teuthology.orchestra.run.smithi119.stderr: 25650K .......... .......... .......... .......... .......... 27% 238M 1s 2024-09-12T17:42:03.339 INFO:teuthology.orchestra.run.smithi119.stderr: 25700K .......... .......... .......... .......... .......... 27% 203M 1s 2024-09-12T17:42:03.339 INFO:teuthology.orchestra.run.smithi119.stderr: 25750K .......... .......... .......... .......... .......... 27% 183M 1s 2024-09-12T17:42:03.339 INFO:teuthology.orchestra.run.smithi119.stderr: 25800K .......... .......... .......... .......... .......... 27% 215M 1s 2024-09-12T17:42:03.339 INFO:teuthology.orchestra.run.smithi119.stderr: 25850K .......... .......... .......... .......... .......... 27% 261M 1s 2024-09-12T17:42:03.339 INFO:teuthology.orchestra.run.smithi119.stderr: 25900K .......... .......... .......... .......... .......... 27% 195M 1s 2024-09-12T17:42:03.339 INFO:teuthology.orchestra.run.smithi119.stderr: 25950K .......... .......... .......... .......... .......... 27% 344M 1s 2024-09-12T17:42:03.339 INFO:teuthology.orchestra.run.smithi119.stderr: 26000K .......... .......... .......... .......... .......... 28% 170M 1s 2024-09-12T17:42:03.339 INFO:teuthology.orchestra.run.smithi119.stderr: 26050K .......... .......... .......... .......... .......... 28% 301M 1s 2024-09-12T17:42:03.339 INFO:teuthology.orchestra.run.smithi119.stderr: 26100K .......... .......... .......... .......... .......... 28% 54.6M 1s 2024-09-12T17:42:03.339 INFO:teuthology.orchestra.run.smithi119.stderr: 26150K .......... .......... .......... .......... .......... 28% 274M 1s 2024-09-12T17:42:03.339 INFO:teuthology.orchestra.run.smithi119.stderr: 26200K .......... .......... .......... .......... .......... 28% 199M 1s 2024-09-12T17:42:03.339 INFO:teuthology.orchestra.run.smithi119.stderr: 26250K .......... .......... .......... .......... .......... 28% 234M 1s 2024-09-12T17:42:03.339 INFO:teuthology.orchestra.run.smithi119.stderr: 26300K .......... .......... .......... .......... .......... 28% 228M 1s 2024-09-12T17:42:03.339 INFO:teuthology.orchestra.run.smithi119.stderr: 26350K .......... .......... .......... .......... .......... 28% 256M 1s 2024-09-12T17:42:03.340 INFO:teuthology.orchestra.run.smithi119.stderr: 26400K .......... .......... .......... .......... .......... 28% 278M 1s 2024-09-12T17:42:03.340 INFO:teuthology.orchestra.run.smithi119.stderr: 26450K .......... .......... .......... .......... .......... 28% 307M 1s 2024-09-12T17:42:03.340 INFO:teuthology.orchestra.run.smithi119.stderr: 26500K .......... .......... .......... .......... .......... 28% 226M 1s 2024-09-12T17:42:03.340 INFO:teuthology.orchestra.run.smithi119.stderr: 26550K .......... .......... .......... .......... .......... 28% 267M 1s 2024-09-12T17:42:03.340 INFO:teuthology.orchestra.run.smithi119.stderr: 26600K .......... .......... .......... .......... .......... 28% 271M 1s 2024-09-12T17:42:03.340 INFO:teuthology.orchestra.run.smithi119.stderr: 26650K .......... .......... .......... .......... .......... 28% 248M 1s 2024-09-12T17:42:03.340 INFO:teuthology.orchestra.run.smithi119.stderr: 26700K .......... .......... .......... .......... .......... 28% 227M 1s 2024-09-12T17:42:03.340 INFO:teuthology.orchestra.run.smithi119.stderr: 26750K .......... .......... .......... .......... .......... 28% 347M 1s 2024-09-12T17:42:03.340 INFO:teuthology.orchestra.run.smithi119.stderr: 26800K .......... .......... .......... .......... .......... 28% 266M 1s 2024-09-12T17:42:03.340 INFO:teuthology.orchestra.run.smithi119.stderr: 26850K .......... .......... .......... .......... .......... 28% 297M 1s 2024-09-12T17:42:03.340 INFO:teuthology.orchestra.run.smithi119.stderr: 26900K .......... .......... .......... .......... .......... 29% 257M 1s 2024-09-12T17:42:03.340 INFO:teuthology.orchestra.run.smithi119.stderr: 26950K .......... .......... .......... .......... .......... 29% 265M 1s 2024-09-12T17:42:03.340 INFO:teuthology.orchestra.run.smithi119.stderr: 27000K .......... .......... .......... .......... .......... 29% 314M 1s 2024-09-12T17:42:03.340 INFO:teuthology.orchestra.run.smithi119.stderr: 27050K .......... .......... .......... .......... .......... 29% 264M 1s 2024-09-12T17:42:03.341 INFO:teuthology.orchestra.run.smithi119.stderr: 27100K .......... .......... .......... .......... .......... 29% 241M 1s 2024-09-12T17:42:03.341 INFO:teuthology.orchestra.run.smithi119.stderr: 27150K .......... .......... .......... .......... .......... 29% 304M 0s 2024-09-12T17:42:03.341 INFO:teuthology.orchestra.run.smithi119.stderr: 27200K .......... .......... .......... .......... .......... 29% 287M 0s 2024-09-12T17:42:03.341 INFO:teuthology.orchestra.run.smithi119.stderr: 27250K .......... .......... .......... .......... .......... 29% 306M 0s 2024-09-12T17:42:03.341 INFO:teuthology.orchestra.run.smithi119.stderr: 27300K .......... .......... .......... .......... .......... 29% 246M 0s 2024-09-12T17:42:03.341 INFO:teuthology.orchestra.run.smithi119.stderr: 27350K .......... .......... .......... .......... .......... 29% 312M 0s 2024-09-12T17:42:03.341 INFO:teuthology.orchestra.run.smithi119.stderr: 27400K .......... .......... .......... .......... .......... 29% 299M 0s 2024-09-12T17:42:03.341 INFO:teuthology.orchestra.run.smithi119.stderr: 27450K .......... .......... .......... .......... .......... 29% 262M 0s 2024-09-12T17:42:03.341 INFO:teuthology.orchestra.run.smithi119.stderr: 27500K .......... .......... .......... .......... .......... 29% 271M 0s 2024-09-12T17:42:03.341 INFO:teuthology.orchestra.run.smithi119.stderr: 27550K .......... .......... .......... .......... .......... 29% 294M 0s 2024-09-12T17:42:03.341 INFO:teuthology.orchestra.run.smithi119.stderr: 27600K .......... .......... .......... .......... .......... 29% 252M 0s 2024-09-12T17:42:03.341 INFO:teuthology.orchestra.run.smithi119.stderr: 27650K .......... .......... .......... .......... .......... 29% 337M 0s 2024-09-12T17:42:03.341 INFO:teuthology.orchestra.run.smithi119.stderr: 27700K .......... .......... .......... .......... .......... 29% 281M 0s 2024-09-12T17:42:03.342 INFO:teuthology.orchestra.run.smithi119.stderr: 27750K .......... .......... .......... .......... .......... 29% 262M 0s 2024-09-12T17:42:03.342 INFO:teuthology.orchestra.run.smithi119.stderr: 27800K .......... .......... .......... .......... .......... 29% 348M 0s 2024-09-12T17:42:03.342 INFO:teuthology.orchestra.run.smithi119.stderr: 27850K .......... .......... .......... .......... .......... 30% 361M 0s 2024-09-12T17:42:03.342 INFO:teuthology.orchestra.run.smithi119.stderr: 27900K .......... .......... .......... .......... .......... 30% 287M 0s 2024-09-12T17:42:03.342 INFO:teuthology.orchestra.run.smithi119.stderr: 27950K .......... .......... .......... .......... .......... 30% 46.4M 0s 2024-09-12T17:42:03.342 INFO:teuthology.orchestra.run.smithi119.stderr: 28000K .......... .......... .......... .......... .......... 30% 214M 0s 2024-09-12T17:42:03.342 INFO:teuthology.orchestra.run.smithi119.stderr: 28050K .......... .......... .......... .......... .......... 30% 263M 0s 2024-09-12T17:42:03.342 INFO:teuthology.orchestra.run.smithi119.stderr: 28100K .......... .......... .......... .......... .......... 30% 240M 0s 2024-09-12T17:42:03.342 INFO:teuthology.orchestra.run.smithi119.stderr: 28150K .......... .......... .......... .......... .......... 30% 243M 0s 2024-09-12T17:42:03.342 INFO:teuthology.orchestra.run.smithi119.stderr: 28200K .......... .......... .......... .......... .......... 30% 306M 0s 2024-09-12T17:42:03.342 INFO:teuthology.orchestra.run.smithi119.stderr: 28250K .......... .......... .......... .......... .......... 30% 366M 0s 2024-09-12T17:42:03.342 INFO:teuthology.orchestra.run.smithi119.stderr: 28300K .......... .......... .......... .......... .......... 30% 226M 0s 2024-09-12T17:42:03.342 INFO:teuthology.orchestra.run.smithi119.stderr: 28350K .......... .......... .......... .......... .......... 30% 342M 0s 2024-09-12T17:42:03.343 INFO:teuthology.orchestra.run.smithi119.stderr: 28400K .......... .......... .......... .......... .......... 30% 345M 0s 2024-09-12T17:42:03.343 INFO:teuthology.orchestra.run.smithi119.stderr: 28450K .......... .......... .......... .......... .......... 30% 144M 0s 2024-09-12T17:42:03.343 INFO:teuthology.orchestra.run.smithi119.stderr: 28500K .......... .......... .......... .......... .......... 30% 177M 0s 2024-09-12T17:42:03.343 INFO:teuthology.orchestra.run.smithi119.stderr: 28550K .......... .......... .......... .......... .......... 30% 239M 0s 2024-09-12T17:42:03.343 INFO:teuthology.orchestra.run.smithi119.stderr: 28600K .......... .......... .......... .......... .......... 30% 301M 0s 2024-09-12T17:42:03.343 INFO:teuthology.orchestra.run.smithi119.stderr: 28650K .......... .......... .......... .......... .......... 30% 251M 0s 2024-09-12T17:42:03.343 INFO:teuthology.orchestra.run.smithi119.stderr: 28700K .......... .......... .......... .......... .......... 30% 299M 0s 2024-09-12T17:42:03.343 INFO:teuthology.orchestra.run.smithi119.stderr: 28750K .......... .......... .......... .......... .......... 31% 300M 0s 2024-09-12T17:42:03.343 INFO:teuthology.orchestra.run.smithi119.stderr: 28800K .......... .......... .......... .......... .......... 31% 109M 0s 2024-09-12T17:42:03.343 INFO:teuthology.orchestra.run.smithi119.stderr: 28850K .......... .......... .......... .......... .......... 31% 72.0M 0s 2024-09-12T17:42:03.343 INFO:teuthology.orchestra.run.smithi119.stderr: 28900K .......... .......... .......... .......... .......... 31% 110M 0s 2024-09-12T17:42:03.343 INFO:teuthology.orchestra.run.smithi119.stderr: 28950K .......... .......... .......... .......... .......... 31% 261M 0s 2024-09-12T17:42:03.343 INFO:teuthology.orchestra.run.smithi119.stderr: 29000K .......... .......... .......... .......... .......... 31% 265M 0s 2024-09-12T17:42:03.344 INFO:teuthology.orchestra.run.smithi119.stderr: 29050K .......... .......... .......... .......... .......... 31% 331M 0s 2024-09-12T17:42:03.344 INFO:teuthology.orchestra.run.smithi119.stderr: 29100K .......... .......... .......... .......... .......... 31% 299M 0s 2024-09-12T17:42:03.344 INFO:teuthology.orchestra.run.smithi119.stderr: 29150K .......... .......... .......... .......... .......... 31% 135M 0s 2024-09-12T17:42:03.344 INFO:teuthology.orchestra.run.smithi119.stderr: 29200K .......... .......... .......... .......... .......... 31% 243M 0s 2024-09-12T17:42:03.344 INFO:teuthology.orchestra.run.smithi119.stderr: 29250K .......... .......... .......... .......... .......... 31% 228M 0s 2024-09-12T17:42:03.344 INFO:teuthology.orchestra.run.smithi119.stderr: 29300K .......... .......... .......... .......... .......... 31% 215M 0s 2024-09-12T17:42:03.344 INFO:teuthology.orchestra.run.smithi119.stderr: 29350K .......... .......... .......... .......... .......... 31% 242M 0s 2024-09-12T17:42:03.344 INFO:teuthology.orchestra.run.smithi119.stderr: 29400K .......... .......... .......... .......... .......... 31% 263M 0s 2024-09-12T17:42:03.344 INFO:teuthology.orchestra.run.smithi119.stderr: 29450K .......... .......... .......... .......... .......... 31% 233M 0s 2024-09-12T17:42:03.344 INFO:teuthology.orchestra.run.smithi119.stderr: 29500K .......... .......... .......... .......... .......... 31% 264M 0s 2024-09-12T17:42:03.344 INFO:teuthology.orchestra.run.smithi119.stderr: 29550K .......... .......... .......... .......... .......... 31% 357M 0s 2024-09-12T17:42:03.344 INFO:teuthology.orchestra.run.smithi119.stderr: 29600K .......... .......... .......... .......... .......... 31% 247M 0s 2024-09-12T17:42:03.344 INFO:teuthology.orchestra.run.smithi119.stderr: 29650K .......... .......... .......... .......... .......... 31% 221M 0s 2024-09-12T17:42:03.345 INFO:teuthology.orchestra.run.smithi119.stderr: 29700K .......... .......... .......... .......... .......... 32% 198M 0s 2024-09-12T17:42:03.345 INFO:teuthology.orchestra.run.smithi119.stderr: 29750K .......... .......... .......... .......... .......... 32% 262M 0s 2024-09-12T17:42:03.345 INFO:teuthology.orchestra.run.smithi119.stderr: 29800K .......... .......... .......... .......... .......... 32% 361M 0s 2024-09-12T17:42:03.345 INFO:teuthology.orchestra.run.smithi119.stderr: 29850K .......... .......... .......... .......... .......... 32% 294M 0s 2024-09-12T17:42:03.345 INFO:teuthology.orchestra.run.smithi119.stderr: 29900K .......... .......... .......... .......... .......... 32% 175M 0s 2024-09-12T17:42:03.345 INFO:teuthology.orchestra.run.smithi119.stderr: 29950K .......... .......... .......... .......... .......... 32% 255M 0s 2024-09-12T17:42:03.345 INFO:teuthology.orchestra.run.smithi119.stderr: 30000K .......... .......... .......... .......... .......... 32% 282M 0s 2024-09-12T17:42:03.345 INFO:teuthology.orchestra.run.smithi119.stderr: 30050K .......... .......... .......... .......... .......... 32% 261M 0s 2024-09-12T17:42:03.345 INFO:teuthology.orchestra.run.smithi119.stderr: 30100K .......... .......... .......... .......... .......... 32% 211M 0s 2024-09-12T17:42:03.345 INFO:teuthology.orchestra.run.smithi119.stderr: 30150K .......... .......... .......... .......... .......... 32% 224M 0s 2024-09-12T17:42:03.345 INFO:teuthology.orchestra.run.smithi119.stderr: 30200K .......... .......... .......... .......... .......... 32% 260M 0s 2024-09-12T17:42:03.345 INFO:teuthology.orchestra.run.smithi119.stderr: 30250K .......... .......... .......... .......... .......... 32% 238M 0s 2024-09-12T17:42:03.345 INFO:teuthology.orchestra.run.smithi119.stderr: 30300K .......... .......... .......... .......... .......... 32% 299M 0s 2024-09-12T17:42:03.346 INFO:teuthology.orchestra.run.smithi119.stderr: 30350K .......... .......... .......... .......... .......... 32% 364M 0s 2024-09-12T17:42:03.346 INFO:teuthology.orchestra.run.smithi119.stderr: 30400K .......... .......... .......... .......... .......... 32% 347M 0s 2024-09-12T17:42:03.346 INFO:teuthology.orchestra.run.smithi119.stderr: 30450K .......... .......... .......... .......... .......... 32% 362M 0s 2024-09-12T17:42:03.346 INFO:teuthology.orchestra.run.smithi119.stderr: 30500K .......... .......... .......... .......... .......... 32% 320M 0s 2024-09-12T17:42:03.346 INFO:teuthology.orchestra.run.smithi119.stderr: 30550K .......... .......... .......... .......... .......... 32% 355M 0s 2024-09-12T17:42:03.346 INFO:teuthology.orchestra.run.smithi119.stderr: 30600K .......... .......... .......... .......... .......... 32% 363M 0s 2024-09-12T17:42:03.346 INFO:teuthology.orchestra.run.smithi119.stderr: 30650K .......... .......... .......... .......... .......... 33% 354M 0s 2024-09-12T17:42:03.346 INFO:teuthology.orchestra.run.smithi119.stderr: 30700K .......... .......... .......... .......... .......... 33% 265M 0s 2024-09-12T17:42:03.346 INFO:teuthology.orchestra.run.smithi119.stderr: 30750K .......... .......... .......... .......... .......... 33% 326M 0s 2024-09-12T17:42:03.346 INFO:teuthology.orchestra.run.smithi119.stderr: 30800K .......... .......... .......... .......... .......... 33% 212M 0s 2024-09-12T17:42:03.346 INFO:teuthology.orchestra.run.smithi119.stderr: 30850K .......... .......... .......... .......... .......... 33% 331M 0s 2024-09-12T17:42:03.346 INFO:teuthology.orchestra.run.smithi119.stderr: 30900K .......... .......... .......... .......... .......... 33% 367M 0s 2024-09-12T17:42:03.346 INFO:teuthology.orchestra.run.smithi119.stderr: 30950K .......... .......... .......... .......... .......... 33% 354M 0s 2024-09-12T17:42:03.347 INFO:teuthology.orchestra.run.smithi119.stderr: 31000K .......... .......... .......... .......... .......... 33% 213M 0s 2024-09-12T17:42:03.347 INFO:teuthology.orchestra.run.smithi119.stderr: 31050K .......... .......... .......... .......... .......... 33% 290M 0s 2024-09-12T17:42:03.347 INFO:teuthology.orchestra.run.smithi119.stderr: 31100K .......... .......... .......... .......... .......... 33% 347M 0s 2024-09-12T17:42:03.347 INFO:teuthology.orchestra.run.smithi119.stderr: 31150K .......... .......... .......... .......... .......... 33% 373M 0s 2024-09-12T17:42:03.347 INFO:teuthology.orchestra.run.smithi119.stderr: 31200K .......... .......... .......... .......... .......... 33% 227M 0s 2024-09-12T17:42:03.347 INFO:teuthology.orchestra.run.smithi119.stderr: 31250K .......... .......... .......... .......... .......... 33% 256M 0s 2024-09-12T17:42:03.347 INFO:teuthology.orchestra.run.smithi119.stderr: 31300K .......... .......... .......... .......... .......... 33% 263M 0s 2024-09-12T17:42:03.347 INFO:teuthology.orchestra.run.smithi119.stderr: 31350K .......... .......... .......... .......... .......... 33% 258M 0s 2024-09-12T17:42:03.347 INFO:teuthology.orchestra.run.smithi119.stderr: 31400K .......... .......... .......... .......... .......... 33% 219M 0s 2024-09-12T17:42:03.347 INFO:teuthology.orchestra.run.smithi119.stderr: 31450K .......... .......... .......... .......... .......... 33% 354M 0s 2024-09-12T17:42:03.347 INFO:teuthology.orchestra.run.smithi119.stderr: 31500K .......... .......... .......... .......... .......... 33% 394M 0s 2024-09-12T17:42:03.347 INFO:teuthology.orchestra.run.smithi119.stderr: 31550K .......... .......... .......... .......... .......... 34% 402M 0s 2024-09-12T17:42:03.347 INFO:teuthology.orchestra.run.smithi119.stderr: 31600K .......... .......... .......... .......... .......... 34% 169M 0s 2024-09-12T17:42:03.347 INFO:teuthology.orchestra.run.smithi119.stderr: 31650K .......... .......... .......... .......... .......... 34% 360M 0s 2024-09-12T17:42:03.348 INFO:teuthology.orchestra.run.smithi119.stderr: 31700K .......... .......... .......... .......... .......... 34% 132M 0s 2024-09-12T17:42:03.348 INFO:teuthology.orchestra.run.smithi119.stderr: 31750K .......... .......... .......... .......... .......... 34% 271M 0s 2024-09-12T17:42:03.348 INFO:teuthology.orchestra.run.smithi119.stderr: 31800K .......... .......... .......... .......... .......... 34% 348M 0s 2024-09-12T17:42:03.348 INFO:teuthology.orchestra.run.smithi119.stderr: 31850K .......... .......... .......... .......... .......... 34% 80.6M 0s 2024-09-12T17:42:03.348 INFO:teuthology.orchestra.run.smithi119.stderr: 31900K .......... .......... .......... .......... .......... 34% 259M 0s 2024-09-12T17:42:03.348 INFO:teuthology.orchestra.run.smithi119.stderr: 31950K .......... .......... .......... .......... .......... 34% 124M 0s 2024-09-12T17:42:03.348 INFO:teuthology.orchestra.run.smithi119.stderr: 32000K .......... .......... .......... .......... .......... 34% 193M 0s 2024-09-12T17:42:03.348 INFO:teuthology.orchestra.run.smithi119.stderr: 32050K .......... .......... .......... .......... .......... 34% 322M 0s 2024-09-12T17:42:03.348 INFO:teuthology.orchestra.run.smithi119.stderr: 32100K .......... .......... .......... .......... .......... 34% 170M 0s 2024-09-12T17:42:03.348 INFO:teuthology.orchestra.run.smithi119.stderr: 32150K .......... .......... .......... .......... .......... 34% 282M 0s 2024-09-12T17:42:03.348 INFO:teuthology.orchestra.run.smithi119.stderr: 32200K .......... .......... .......... .......... .......... 34% 156M 0s 2024-09-12T17:42:03.348 INFO:teuthology.orchestra.run.smithi119.stderr: 32250K .......... .......... .......... .......... .......... 34% 246M 0s 2024-09-12T17:42:03.348 INFO:teuthology.orchestra.run.smithi119.stderr: 32300K .......... .......... .......... .......... .......... 34% 358M 0s 2024-09-12T17:42:03.348 INFO:teuthology.orchestra.run.smithi119.stderr: 32350K .......... .......... .......... .......... .......... 34% 269M 0s 2024-09-12T17:42:03.349 INFO:teuthology.orchestra.run.smithi119.stderr: 32400K .......... .......... .......... .......... .......... 34% 137M 0s 2024-09-12T17:42:03.349 INFO:teuthology.orchestra.run.smithi119.stderr: 32450K .......... .......... .......... .......... .......... 34% 263M 0s 2024-09-12T17:42:03.349 INFO:teuthology.orchestra.run.smithi119.stderr: 32500K .......... .......... .......... .......... .......... 35% 384M 0s 2024-09-12T17:42:03.349 INFO:teuthology.orchestra.run.smithi119.stderr: 32550K .......... .......... .......... .......... .......... 35% 152M 0s 2024-09-12T17:42:03.349 INFO:teuthology.orchestra.run.smithi119.stderr: 32600K .......... .......... .......... .......... .......... 35% 307M 0s 2024-09-12T17:42:03.349 INFO:teuthology.orchestra.run.smithi119.stderr: 32650K .......... .......... .......... .......... .......... 35% 229M 0s 2024-09-12T17:42:03.349 INFO:teuthology.orchestra.run.smithi119.stderr: 32700K .......... .......... .......... .......... .......... 35% 273M 0s 2024-09-12T17:42:03.349 INFO:teuthology.orchestra.run.smithi119.stderr: 32750K .......... .......... .......... .......... .......... 35% 389M 0s 2024-09-12T17:42:03.349 INFO:teuthology.orchestra.run.smithi119.stderr: 32800K .......... .......... .......... .......... .......... 35% 243M 0s 2024-09-12T17:42:03.349 INFO:teuthology.orchestra.run.smithi119.stderr: 32850K .......... .......... .......... .......... .......... 35% 233M 0s 2024-09-12T17:42:03.349 INFO:teuthology.orchestra.run.smithi119.stderr: 32900K .......... .......... .......... .......... .......... 35% 263M 0s 2024-09-12T17:42:03.349 INFO:teuthology.orchestra.run.smithi119.stderr: 32950K .......... .......... .......... .......... .......... 35% 305M 0s 2024-09-12T17:42:03.349 INFO:teuthology.orchestra.run.smithi119.stderr: 33000K .......... .......... .......... .......... .......... 35% 299M 0s 2024-09-12T17:42:03.349 INFO:teuthology.orchestra.run.smithi119.stderr: 33050K .......... .......... .......... .......... .......... 35% 300M 0s 2024-09-12T17:42:03.350 INFO:teuthology.orchestra.run.smithi119.stderr: 33100K .......... .......... .......... .......... .......... 35% 276M 0s 2024-09-12T17:42:03.350 INFO:teuthology.orchestra.run.smithi119.stderr: 33150K .......... .......... .......... .......... .......... 35% 263M 0s 2024-09-12T17:42:03.350 INFO:teuthology.orchestra.run.smithi119.stderr: 33200K .......... .......... .......... .......... .......... 35% 254M 0s 2024-09-12T17:42:03.350 INFO:teuthology.orchestra.run.smithi119.stderr: 33250K .......... .......... .......... .......... .......... 35% 301M 0s 2024-09-12T17:42:03.350 INFO:teuthology.orchestra.run.smithi119.stderr: 33300K .......... .......... .......... .......... .......... 35% 347M 0s 2024-09-12T17:42:03.350 INFO:teuthology.orchestra.run.smithi119.stderr: 33350K .......... .......... .......... .......... .......... 35% 328M 0s 2024-09-12T17:42:03.350 INFO:teuthology.orchestra.run.smithi119.stderr: 33400K .......... .......... .......... .......... .......... 36% 355M 0s 2024-09-12T17:42:03.350 INFO:teuthology.orchestra.run.smithi119.stderr: 33450K .......... .......... .......... .......... .......... 36% 43.9M 0s 2024-09-12T17:42:03.350 INFO:teuthology.orchestra.run.smithi119.stderr: 33500K .......... .......... .......... .......... .......... 36% 306M 0s 2024-09-12T17:42:03.350 INFO:teuthology.orchestra.run.smithi119.stderr: 33550K .......... .......... .......... .......... .......... 36% 278M 0s 2024-09-12T17:42:03.350 INFO:teuthology.orchestra.run.smithi119.stderr: 33600K .......... .......... .......... .......... .......... 36% 293M 0s 2024-09-12T17:42:03.350 INFO:teuthology.orchestra.run.smithi119.stderr: 33650K .......... .......... .......... .......... .......... 36% 294M 0s 2024-09-12T17:42:03.350 INFO:teuthology.orchestra.run.smithi119.stderr: 33700K .......... .......... .......... .......... .......... 36% 370M 0s 2024-09-12T17:42:03.350 INFO:teuthology.orchestra.run.smithi119.stderr: 33750K .......... .......... .......... .......... .......... 36% 313M 0s 2024-09-12T17:42:03.351 INFO:teuthology.orchestra.run.smithi119.stderr: 33800K .......... .......... .......... .......... .......... 36% 255M 0s 2024-09-12T17:42:03.351 INFO:teuthology.orchestra.run.smithi119.stderr: 33850K .......... .......... .......... .......... .......... 36% 303M 0s 2024-09-12T17:42:03.351 INFO:teuthology.orchestra.run.smithi119.stderr: 33900K .......... .......... .......... .......... .......... 36% 326M 0s 2024-09-12T17:42:03.351 INFO:teuthology.orchestra.run.smithi119.stderr: 33950K .......... .......... .......... .......... .......... 36% 308M 0s 2024-09-12T17:42:03.351 INFO:teuthology.orchestra.run.smithi119.stderr: 34000K .......... .......... .......... .......... .......... 36% 243M 0s 2024-09-12T17:42:03.351 INFO:teuthology.orchestra.run.smithi119.stderr: 34050K .......... .......... .......... .......... .......... 36% 305M 0s 2024-09-12T17:42:03.351 INFO:teuthology.orchestra.run.smithi119.stderr: 34100K .......... .......... .......... .......... .......... 36% 384M 0s 2024-09-12T17:42:03.351 INFO:teuthology.orchestra.run.smithi119.stderr: 34150K .......... .......... .......... .......... .......... 36% 340M 0s 2024-09-12T17:42:03.351 INFO:teuthology.orchestra.run.smithi119.stderr: 34200K .......... .......... .......... .......... .......... 36% 249M 0s 2024-09-12T17:42:03.351 INFO:teuthology.orchestra.run.smithi119.stderr: 34250K .......... .......... .......... .......... .......... 36% 317M 0s 2024-09-12T17:42:03.351 INFO:teuthology.orchestra.run.smithi119.stderr: 34300K .......... .......... .......... .......... .......... 36% 282M 0s 2024-09-12T17:42:03.351 INFO:teuthology.orchestra.run.smithi119.stderr: 34350K .......... .......... .......... .......... .......... 37% 285M 0s 2024-09-12T17:42:03.351 INFO:teuthology.orchestra.run.smithi119.stderr: 34400K .......... .......... .......... .......... .......... 37% 249M 0s 2024-09-12T17:42:03.352 INFO:teuthology.orchestra.run.smithi119.stderr: 34450K .......... .......... .......... .......... .......... 37% 371M 0s 2024-09-12T17:42:03.352 INFO:teuthology.orchestra.run.smithi119.stderr: 34500K .......... .......... .......... .......... .......... 37% 350M 0s 2024-09-12T17:42:03.352 INFO:teuthology.orchestra.run.smithi119.stderr: 34550K .......... .......... .......... .......... .......... 37% 322M 0s 2024-09-12T17:42:03.352 INFO:teuthology.orchestra.run.smithi119.stderr: 34600K .......... .......... .......... .......... .......... 37% 268M 0s 2024-09-12T17:42:03.352 INFO:teuthology.orchestra.run.smithi119.stderr: 34650K .......... .......... .......... .......... .......... 37% 384M 0s 2024-09-12T17:42:03.352 INFO:teuthology.orchestra.run.smithi119.stderr: 34700K .......... .......... .......... .......... .......... 37% 388M 0s 2024-09-12T17:42:03.352 INFO:teuthology.orchestra.run.smithi119.stderr: 34750K .......... .......... .......... .......... .......... 37% 346M 0s 2024-09-12T17:42:03.352 INFO:teuthology.orchestra.run.smithi119.stderr: 34800K .......... .......... .......... .......... .......... 37% 240M 0s 2024-09-12T17:42:03.352 INFO:teuthology.orchestra.run.smithi119.stderr: 34850K .......... .......... .......... .......... .......... 37% 365M 0s 2024-09-12T17:42:03.352 INFO:teuthology.orchestra.run.smithi119.stderr: 34900K .......... .......... .......... .......... .......... 37% 248M 0s 2024-09-12T17:42:03.352 INFO:teuthology.orchestra.run.smithi119.stderr: 34950K .......... .......... .......... .......... .......... 37% 147M 0s 2024-09-12T17:42:03.352 INFO:teuthology.orchestra.run.smithi119.stderr: 35000K .......... .......... .......... .......... .......... 37% 204M 0s 2024-09-12T17:42:03.352 INFO:teuthology.orchestra.run.smithi119.stderr: 35050K .......... .......... .......... .......... .......... 37% 217M 0s 2024-09-12T17:42:03.353 INFO:teuthology.orchestra.run.smithi119.stderr: 35100K .......... .......... .......... .......... .......... 37% 327M 0s 2024-09-12T17:42:03.353 INFO:teuthology.orchestra.run.smithi119.stderr: 35150K .......... .......... .......... .......... .......... 37% 184M 0s 2024-09-12T17:42:03.353 INFO:teuthology.orchestra.run.smithi119.stderr: 35200K .......... .......... .......... .......... .......... 37% 259M 0s 2024-09-12T17:42:03.353 INFO:teuthology.orchestra.run.smithi119.stderr: 35250K .......... .......... .......... .......... .......... 37% 77.5M 0s 2024-09-12T17:42:03.353 INFO:teuthology.orchestra.run.smithi119.stderr: 35300K .......... .......... .......... .......... .......... 38% 212M 0s 2024-09-12T17:42:03.353 INFO:teuthology.orchestra.run.smithi119.stderr: 35350K .......... .......... .......... .......... .......... 38% 300M 0s 2024-09-12T17:42:03.353 INFO:teuthology.orchestra.run.smithi119.stderr: 35400K .......... .......... .......... .......... .......... 38% 289M 0s 2024-09-12T17:42:03.353 INFO:teuthology.orchestra.run.smithi119.stderr: 35450K .......... .......... .......... .......... .......... 38% 222M 0s 2024-09-12T17:42:03.353 INFO:teuthology.orchestra.run.smithi119.stderr: 35500K .......... .......... .......... .......... .......... 38% 343M 0s 2024-09-12T17:42:03.353 INFO:teuthology.orchestra.run.smithi119.stderr: 35550K .......... .......... .......... .......... .......... 38% 273M 0s 2024-09-12T17:42:03.353 INFO:teuthology.orchestra.run.smithi119.stderr: 35600K .......... .......... .......... .......... .......... 38% 316M 0s 2024-09-12T17:42:03.353 INFO:teuthology.orchestra.run.smithi119.stderr: 35650K .......... .......... .......... .......... .......... 38% 263M 0s 2024-09-12T17:42:03.353 INFO:teuthology.orchestra.run.smithi119.stderr: 35700K .......... .......... .......... .......... .......... 38% 297M 0s 2024-09-12T17:42:03.354 INFO:teuthology.orchestra.run.smithi119.stderr: 35750K .......... .......... .......... .......... .......... 38% 295M 0s 2024-09-12T17:42:03.354 INFO:teuthology.orchestra.run.smithi119.stderr: 35800K .......... .......... .......... .......... .......... 38% 309M 0s 2024-09-12T17:42:03.354 INFO:teuthology.orchestra.run.smithi119.stderr: 35850K .......... .......... .......... .......... .......... 38% 259M 0s 2024-09-12T17:42:03.354 INFO:teuthology.orchestra.run.smithi119.stderr: 35900K .......... .......... .......... .......... .......... 38% 130M 0s 2024-09-12T17:42:03.354 INFO:teuthology.orchestra.run.smithi119.stderr: 35950K .......... .......... .......... .......... .......... 38% 174M 0s 2024-09-12T17:42:03.354 INFO:teuthology.orchestra.run.smithi119.stderr: 36000K .......... .......... .......... .......... .......... 38% 240M 0s 2024-09-12T17:42:03.354 INFO:teuthology.orchestra.run.smithi119.stderr: 36050K .......... .......... .......... .......... .......... 38% 115M 0s 2024-09-12T17:42:03.354 INFO:teuthology.orchestra.run.smithi119.stderr: 36100K .......... .......... .......... .......... .......... 38% 208M 0s 2024-09-12T17:42:03.354 INFO:teuthology.orchestra.run.smithi119.stderr: 36150K .......... .......... .......... .......... .......... 38% 293M 0s 2024-09-12T17:42:03.354 INFO:teuthology.orchestra.run.smithi119.stderr: 36200K .......... .......... .......... .......... .......... 39% 332M 0s 2024-09-12T17:42:03.354 INFO:teuthology.orchestra.run.smithi119.stderr: 36250K .......... .......... .......... .......... .......... 39% 309M 0s 2024-09-12T17:42:03.354 INFO:teuthology.orchestra.run.smithi119.stderr: 36300K .......... .......... .......... .......... .......... 39% 371M 0s 2024-09-12T17:42:03.354 INFO:teuthology.orchestra.run.smithi119.stderr: 36350K .......... .......... .......... .......... .......... 39% 85.4M 0s 2024-09-12T17:42:03.355 INFO:teuthology.orchestra.run.smithi119.stderr: 36400K .......... .......... .......... .......... .......... 39% 252M 0s 2024-09-12T17:42:03.355 INFO:teuthology.orchestra.run.smithi119.stderr: 36450K .......... .......... .......... .......... .......... 39% 322M 0s 2024-09-12T17:42:03.355 INFO:teuthology.orchestra.run.smithi119.stderr: 36500K .......... .......... .......... .......... .......... 39% 188M 0s 2024-09-12T17:42:03.355 INFO:teuthology.orchestra.run.smithi119.stderr: 36550K .......... .......... .......... .......... .......... 39% 113M 0s 2024-09-12T17:42:03.355 INFO:teuthology.orchestra.run.smithi119.stderr: 36600K .......... .......... .......... .......... .......... 39% 190M 0s 2024-09-12T17:42:03.355 INFO:teuthology.orchestra.run.smithi119.stderr: 36650K .......... .......... .......... .......... .......... 39% 212M 0s 2024-09-12T17:42:03.355 INFO:teuthology.orchestra.run.smithi119.stderr: 36700K .......... .......... .......... .......... .......... 39% 355M 0s 2024-09-12T17:42:03.355 INFO:teuthology.orchestra.run.smithi119.stderr: 36750K .......... .......... .......... .......... .......... 39% 198M 0s 2024-09-12T17:42:03.355 INFO:teuthology.orchestra.run.smithi119.stderr: 36800K .......... .......... .......... .......... .......... 39% 258M 0s 2024-09-12T17:42:03.355 INFO:teuthology.orchestra.run.smithi119.stderr: 36850K .......... .......... .......... .......... .......... 39% 297M 0s 2024-09-12T17:42:03.355 INFO:teuthology.orchestra.run.smithi119.stderr: 36900K .......... .......... .......... .......... .......... 39% 260M 0s 2024-09-12T17:42:03.355 INFO:teuthology.orchestra.run.smithi119.stderr: 36950K .......... .......... .......... .......... .......... 39% 206M 0s 2024-09-12T17:42:03.355 INFO:teuthology.orchestra.run.smithi119.stderr: 37000K .......... .......... .......... .......... .......... 39% 206M 0s 2024-09-12T17:42:03.355 INFO:teuthology.orchestra.run.smithi119.stderr: 37050K .......... .......... .......... .......... .......... 39% 179M 0s 2024-09-12T17:42:03.356 INFO:teuthology.orchestra.run.smithi119.stderr: 37100K .......... .......... .......... .......... .......... 39% 205M 0s 2024-09-12T17:42:03.356 INFO:teuthology.orchestra.run.smithi119.stderr: 37150K .......... .......... .......... .......... .......... 40% 247M 0s 2024-09-12T17:42:03.356 INFO:teuthology.orchestra.run.smithi119.stderr: 37200K .......... .......... .......... .......... .......... 40% 274M 0s 2024-09-12T17:42:03.356 INFO:teuthology.orchestra.run.smithi119.stderr: 37250K .......... .......... .......... .......... .......... 40% 263M 0s 2024-09-12T17:42:03.356 INFO:teuthology.orchestra.run.smithi119.stderr: 37300K .......... .......... .......... .......... .......... 40% 281M 0s 2024-09-12T17:42:03.356 INFO:teuthology.orchestra.run.smithi119.stderr: 37350K .......... .......... .......... .......... .......... 40% 365M 0s 2024-09-12T17:42:03.356 INFO:teuthology.orchestra.run.smithi119.stderr: 37400K .......... .......... .......... .......... .......... 40% 280M 0s 2024-09-12T17:42:03.356 INFO:teuthology.orchestra.run.smithi119.stderr: 37450K .......... .......... .......... .......... .......... 40% 189M 0s 2024-09-12T17:42:03.356 INFO:teuthology.orchestra.run.smithi119.stderr: 37500K .......... .......... .......... .......... .......... 40% 257M 0s 2024-09-12T17:42:03.356 INFO:teuthology.orchestra.run.smithi119.stderr: 37550K .......... .......... .......... .......... .......... 40% 268M 0s 2024-09-12T17:42:03.356 INFO:teuthology.orchestra.run.smithi119.stderr: 37600K .......... .......... .......... .......... .......... 40% 376M 0s 2024-09-12T17:42:03.356 INFO:teuthology.orchestra.run.smithi119.stderr: 37650K .......... .......... .......... .......... .......... 40% 270M 0s 2024-09-12T17:42:03.357 INFO:teuthology.orchestra.run.smithi119.stderr: 37700K .......... .......... .......... .......... .......... 40% 243M 0s 2024-09-12T17:42:03.357 INFO:teuthology.orchestra.run.smithi119.stderr: 37750K .......... .......... .......... .......... .......... 40% 365M 0s 2024-09-12T17:42:03.357 INFO:teuthology.orchestra.run.smithi119.stderr: 37800K .......... .......... .......... .......... .......... 40% 201M 0s 2024-09-12T17:42:03.357 INFO:teuthology.orchestra.run.smithi119.stderr: 37850K .......... .......... .......... .......... .......... 40% 292M 0s 2024-09-12T17:42:03.357 INFO:teuthology.orchestra.run.smithi119.stderr: 37900K .......... .......... .......... .......... .......... 40% 293M 0s 2024-09-12T17:42:03.357 INFO:teuthology.orchestra.run.smithi119.stderr: 37950K .......... .......... .......... .......... .......... 40% 311M 0s 2024-09-12T17:42:03.357 INFO:teuthology.orchestra.run.smithi119.stderr: 38000K .......... .......... .......... .......... .......... 40% 377M 0s 2024-09-12T17:42:03.357 INFO:teuthology.orchestra.run.smithi119.stderr: 38050K .......... .......... .......... .......... .......... 41% 258M 0s 2024-09-12T17:42:03.357 INFO:teuthology.orchestra.run.smithi119.stderr: 38100K .......... .......... .......... .......... .......... 41% 380M 0s 2024-09-12T17:42:03.357 INFO:teuthology.orchestra.run.smithi119.stderr: 38150K .......... .......... .......... .......... .......... 41% 316M 0s 2024-09-12T17:42:03.357 INFO:teuthology.orchestra.run.smithi119.stderr: 38200K .......... .......... .......... .......... .......... 41% 209M 0s 2024-09-12T17:42:03.357 INFO:teuthology.orchestra.run.smithi119.stderr: 38250K .......... .......... .......... .......... .......... 41% 347M 0s 2024-09-12T17:42:03.357 INFO:teuthology.orchestra.run.smithi119.stderr: 38300K .......... .......... .......... .......... .......... 41% 313M 0s 2024-09-12T17:42:03.358 INFO:teuthology.orchestra.run.smithi119.stderr: 38350K .......... .......... .......... .......... .......... 41% 195M 0s 2024-09-12T17:42:03.358 INFO:teuthology.orchestra.run.smithi119.stderr: 38400K .......... .......... .......... .......... .......... 41% 269M 0s 2024-09-12T17:42:03.358 INFO:teuthology.orchestra.run.smithi119.stderr: 38450K .......... .......... .......... .......... .......... 41% 280M 0s 2024-09-12T17:42:03.358 INFO:teuthology.orchestra.run.smithi119.stderr: 38500K .......... .......... .......... .......... .......... 41% 363M 0s 2024-09-12T17:42:03.358 INFO:teuthology.orchestra.run.smithi119.stderr: 38550K .......... .......... .......... .......... .......... 41% 245M 0s 2024-09-12T17:42:03.358 INFO:teuthology.orchestra.run.smithi119.stderr: 38600K .......... .......... .......... .......... .......... 41% 307M 0s 2024-09-12T17:42:03.358 INFO:teuthology.orchestra.run.smithi119.stderr: 38650K .......... .......... .......... .......... .......... 41% 330M 0s 2024-09-12T17:42:03.358 INFO:teuthology.orchestra.run.smithi119.stderr: 38700K .......... .......... .......... .......... .......... 41% 276M 0s 2024-09-12T17:42:03.358 INFO:teuthology.orchestra.run.smithi119.stderr: 38750K .......... .......... .......... .......... .......... 41% 277M 0s 2024-09-12T17:42:03.358 INFO:teuthology.orchestra.run.smithi119.stderr: 38800K .......... .......... .......... .......... .......... 41% 277M 0s 2024-09-12T17:42:03.358 INFO:teuthology.orchestra.run.smithi119.stderr: 38850K .......... .......... .......... .......... .......... 41% 344M 0s 2024-09-12T17:42:03.358 INFO:teuthology.orchestra.run.smithi119.stderr: 38900K .......... .......... .......... .......... .......... 41% 290M 0s 2024-09-12T17:42:03.358 INFO:teuthology.orchestra.run.smithi119.stderr: 38950K .......... .......... .......... .......... .......... 41% 234M 0s 2024-09-12T17:42:03.358 INFO:teuthology.orchestra.run.smithi119.stderr: 39000K .......... .......... .......... .......... .......... 42% 336M 0s 2024-09-12T17:42:03.359 INFO:teuthology.orchestra.run.smithi119.stderr: 39050K .......... .......... .......... .......... .......... 42% 392M 0s 2024-09-12T17:42:03.359 INFO:teuthology.orchestra.run.smithi119.stderr: 39100K .......... .......... .......... .......... .......... 42% 234M 0s 2024-09-12T17:42:03.359 INFO:teuthology.orchestra.run.smithi119.stderr: 39150K .......... .......... .......... .......... .......... 42% 159M 0s 2024-09-12T17:42:03.359 INFO:teuthology.orchestra.run.smithi119.stderr: 39200K .......... .......... .......... .......... .......... 42% 54.2M 0s 2024-09-12T17:42:03.359 INFO:teuthology.orchestra.run.smithi119.stderr: 39250K .......... .......... .......... .......... .......... 42% 222M 0s 2024-09-12T17:42:03.359 INFO:teuthology.orchestra.run.smithi119.stderr: 39300K .......... .......... .......... .......... .......... 42% 255M 0s 2024-09-12T17:42:03.359 INFO:teuthology.orchestra.run.smithi119.stderr: 39350K .......... .......... .......... .......... .......... 42% 240M 0s 2024-09-12T17:42:03.359 INFO:teuthology.orchestra.run.smithi119.stderr: 39400K .......... .......... .......... .......... .......... 42% 325M 0s 2024-09-12T17:42:03.359 INFO:teuthology.orchestra.run.smithi119.stderr: 39450K .......... .......... .......... .......... .......... 42% 382M 0s 2024-09-12T17:42:03.359 INFO:teuthology.orchestra.run.smithi119.stderr: 39500K .......... .......... .......... .......... .......... 42% 302M 0s 2024-09-12T17:42:03.359 INFO:teuthology.orchestra.run.smithi119.stderr: 39550K .......... .......... .......... .......... .......... 42% 291M 0s 2024-09-12T17:42:03.359 INFO:teuthology.orchestra.run.smithi119.stderr: 39600K .......... .......... .......... .......... .......... 42% 142M 0s 2024-09-12T17:42:03.359 INFO:teuthology.orchestra.run.smithi119.stderr: 39650K .......... .......... .......... .......... .......... 42% 287M 0s 2024-09-12T17:42:03.360 INFO:teuthology.orchestra.run.smithi119.stderr: 39700K .......... .......... .......... .......... .......... 42% 281M 0s 2024-09-12T17:42:03.360 INFO:teuthology.orchestra.run.smithi119.stderr: 39750K .......... .......... .......... .......... .......... 42% 211M 0s 2024-09-12T17:42:03.360 INFO:teuthology.orchestra.run.smithi119.stderr: 39800K .......... .......... .......... .......... .......... 42% 292M 0s 2024-09-12T17:42:03.360 INFO:teuthology.orchestra.run.smithi119.stderr: 39850K .......... .......... .......... .......... .......... 42% 257M 0s 2024-09-12T17:42:03.360 INFO:teuthology.orchestra.run.smithi119.stderr: 39900K .......... .......... .......... .......... .......... 43% 224M 0s 2024-09-12T17:42:03.360 INFO:teuthology.orchestra.run.smithi119.stderr: 39950K .......... .......... .......... .......... .......... 43% 263M 0s 2024-09-12T17:42:03.360 INFO:teuthology.orchestra.run.smithi119.stderr: 40000K .......... .......... .......... .......... .......... 43% 390M 0s 2024-09-12T17:42:03.360 INFO:teuthology.orchestra.run.smithi119.stderr: 40050K .......... .......... .......... .......... .......... 43% 94.3M 0s 2024-09-12T17:42:03.360 INFO:teuthology.orchestra.run.smithi119.stderr: 40100K .......... .......... .......... .......... .......... 43% 320M 0s 2024-09-12T17:42:03.360 INFO:teuthology.orchestra.run.smithi119.stderr: 40150K .......... .......... .......... .......... .......... 43% 90.3M 0s 2024-09-12T17:42:03.360 INFO:teuthology.orchestra.run.smithi119.stderr: 40200K .......... .......... .......... .......... .......... 43% 206M 0s 2024-09-12T17:42:03.361 INFO:teuthology.orchestra.run.smithi119.stderr: 40250K .......... .......... .......... .......... .......... 43% 221M 0s 2024-09-12T17:42:03.361 INFO:teuthology.orchestra.run.smithi119.stderr: 40300K .......... .......... .......... .......... .......... 43% 273M 0s 2024-09-12T17:42:03.361 INFO:teuthology.orchestra.run.smithi119.stderr: 40350K .......... .......... .......... .......... .......... 43% 212M 0s 2024-09-12T17:42:03.361 INFO:teuthology.orchestra.run.smithi119.stderr: 40400K .......... .......... .......... .......... .......... 43% 308M 0s 2024-09-12T17:42:03.361 INFO:teuthology.orchestra.run.smithi119.stderr: 40450K .......... .......... .......... .......... .......... 43% 298M 0s 2024-09-12T17:42:03.361 INFO:teuthology.orchestra.run.smithi119.stderr: 40500K .......... .......... .......... .......... .......... 43% 386M 0s 2024-09-12T17:42:03.361 INFO:teuthology.orchestra.run.smithi119.stderr: 40550K .......... .......... .......... .......... .......... 43% 232M 0s 2024-09-12T17:42:03.361 INFO:teuthology.orchestra.run.smithi119.stderr: 40600K .......... .......... .......... .......... .......... 43% 326M 0s 2024-09-12T17:42:03.361 INFO:teuthology.orchestra.run.smithi119.stderr: 40650K .......... .......... .......... .......... .......... 43% 324M 0s 2024-09-12T17:42:03.361 INFO:teuthology.orchestra.run.smithi119.stderr: 40700K .......... .......... .......... .......... .......... 43% 275M 0s 2024-09-12T17:42:03.361 INFO:teuthology.orchestra.run.smithi119.stderr: 40750K .......... .......... .......... .......... .......... 43% 278M 0s 2024-09-12T17:42:03.361 INFO:teuthology.orchestra.run.smithi119.stderr: 40800K .......... .......... .......... .......... .......... 43% 393M 0s 2024-09-12T17:42:03.361 INFO:teuthology.orchestra.run.smithi119.stderr: 40850K .......... .......... .......... .......... .......... 44% 398M 0s 2024-09-12T17:42:03.362 INFO:teuthology.orchestra.run.smithi119.stderr: 40900K .......... .......... .......... .......... .......... 44% 299M 0s 2024-09-12T17:42:03.362 INFO:teuthology.orchestra.run.smithi119.stderr: 40950K .......... .......... .......... .......... .......... 44% 292M 0s 2024-09-12T17:42:03.362 INFO:teuthology.orchestra.run.smithi119.stderr: 41000K .......... .......... .......... .......... .......... 44% 237M 0s 2024-09-12T17:42:03.362 INFO:teuthology.orchestra.run.smithi119.stderr: 41050K .......... .......... .......... .......... .......... 44% 224M 0s 2024-09-12T17:42:03.362 INFO:teuthology.orchestra.run.smithi119.stderr: 41100K .......... .......... .......... .......... .......... 44% 363M 0s 2024-09-12T17:42:03.362 INFO:teuthology.orchestra.run.smithi119.stderr: 41150K .......... .......... .......... .......... .......... 44% 325M 0s 2024-09-12T17:42:03.362 INFO:teuthology.orchestra.run.smithi119.stderr: 41200K .......... .......... .......... .......... .......... 44% 271M 0s 2024-09-12T17:42:03.362 INFO:teuthology.orchestra.run.smithi119.stderr: 41250K .......... .......... .......... .......... .......... 44% 242M 0s 2024-09-12T17:42:03.362 INFO:teuthology.orchestra.run.smithi119.stderr: 41300K .......... .......... .......... .......... .......... 44% 270M 0s 2024-09-12T17:42:03.362 INFO:teuthology.orchestra.run.smithi119.stderr: 41350K .......... .......... .......... .......... .......... 44% 251M 0s 2024-09-12T17:42:03.362 INFO:teuthology.orchestra.run.smithi119.stderr: 41400K .......... .......... .......... .......... .......... 44% 378M 0s 2024-09-12T17:42:03.362 INFO:teuthology.orchestra.run.smithi119.stderr: 41450K .......... .......... .......... .......... .......... 44% 393M 0s 2024-09-12T17:42:03.362 INFO:teuthology.orchestra.run.smithi119.stderr: 41500K .......... .......... .......... .......... .......... 44% 349M 0s 2024-09-12T17:42:03.362 INFO:teuthology.orchestra.run.smithi119.stderr: 41550K .......... .......... .......... .......... .......... 44% 247M 0s 2024-09-12T17:42:03.363 INFO:teuthology.orchestra.run.smithi119.stderr: 41600K .......... .......... .......... .......... .......... 44% 380M 0s 2024-09-12T17:42:03.363 INFO:teuthology.orchestra.run.smithi119.stderr: 41650K .......... .......... .......... .......... .......... 44% 354M 0s 2024-09-12T17:42:03.363 INFO:teuthology.orchestra.run.smithi119.stderr: 41700K .......... .......... .......... .......... .......... 44% 271M 0s 2024-09-12T17:42:03.363 INFO:teuthology.orchestra.run.smithi119.stderr: 41750K .......... .......... .......... .......... .......... 44% 208M 0s 2024-09-12T17:42:03.363 INFO:teuthology.orchestra.run.smithi119.stderr: 41800K .......... .......... .......... .......... .......... 45% 224M 0s 2024-09-12T17:42:03.363 INFO:teuthology.orchestra.run.smithi119.stderr: 41850K .......... .......... .......... .......... .......... 45% 268M 0s 2024-09-12T17:42:03.363 INFO:teuthology.orchestra.run.smithi119.stderr: 41900K .......... .......... .......... .......... .......... 45% 293M 0s 2024-09-12T17:42:03.363 INFO:teuthology.orchestra.run.smithi119.stderr: 41950K .......... .......... .......... .......... .......... 45% 261M 0s 2024-09-12T17:42:03.363 INFO:teuthology.orchestra.run.smithi119.stderr: 42000K .......... .......... .......... .......... .......... 45% 335M 0s 2024-09-12T17:42:03.363 INFO:teuthology.orchestra.run.smithi119.stderr: 42050K .......... .......... .......... .......... .......... 45% 311M 0s 2024-09-12T17:42:03.363 INFO:teuthology.orchestra.run.smithi119.stderr: 42100K .......... .......... .......... .......... .......... 45% 301M 0s 2024-09-12T17:42:03.363 INFO:teuthology.orchestra.run.smithi119.stderr: 42150K .......... .......... .......... .......... .......... 45% 353M 0s 2024-09-12T17:42:03.363 INFO:teuthology.orchestra.run.smithi119.stderr: 42200K .......... .......... .......... .......... .......... 45% 68.7M 0s 2024-09-12T17:42:03.364 INFO:teuthology.orchestra.run.smithi119.stderr: 42250K .......... .......... .......... .......... .......... 45% 264M 0s 2024-09-12T17:42:03.364 INFO:teuthology.orchestra.run.smithi119.stderr: 42300K .......... .......... .......... .......... .......... 45% 298M 0s 2024-09-12T17:42:03.364 INFO:teuthology.orchestra.run.smithi119.stderr: 42350K .......... .......... .......... .......... .......... 45% 149M 0s 2024-09-12T17:42:03.364 INFO:teuthology.orchestra.run.smithi119.stderr: 42400K .......... .......... .......... .......... .......... 45% 276M 0s 2024-09-12T17:42:03.364 INFO:teuthology.orchestra.run.smithi119.stderr: 42450K .......... .......... .......... .......... .......... 45% 341M 0s 2024-09-12T17:42:03.364 INFO:teuthology.orchestra.run.smithi119.stderr: 42500K .......... .......... .......... .......... .......... 45% 258M 0s 2024-09-12T17:42:03.364 INFO:teuthology.orchestra.run.smithi119.stderr: 42550K .......... .......... .......... .......... .......... 45% 226M 0s 2024-09-12T17:42:03.364 INFO:teuthology.orchestra.run.smithi119.stderr: 42600K .......... .......... .......... .......... .......... 45% 266M 0s 2024-09-12T17:42:03.364 INFO:teuthology.orchestra.run.smithi119.stderr: 42650K .......... .......... .......... .......... .......... 45% 253M 0s 2024-09-12T17:42:03.364 INFO:teuthology.orchestra.run.smithi119.stderr: 42700K .......... .......... .......... .......... .......... 46% 370M 0s 2024-09-12T17:42:03.364 INFO:teuthology.orchestra.run.smithi119.stderr: 42750K .......... .......... .......... .......... .......... 46% 253M 0s 2024-09-12T17:42:03.364 INFO:teuthology.orchestra.run.smithi119.stderr: 42800K .......... .......... .......... .......... .......... 46% 300M 0s 2024-09-12T17:42:03.364 INFO:teuthology.orchestra.run.smithi119.stderr: 42850K .......... .......... .......... .......... .......... 46% 333M 0s 2024-09-12T17:42:03.365 INFO:teuthology.orchestra.run.smithi119.stderr: 42900K .......... .......... .......... .......... .......... 46% 107M 0s 2024-09-12T17:42:03.365 INFO:teuthology.orchestra.run.smithi119.stderr: 42950K .......... .......... .......... .......... .......... 46% 128M 0s 2024-09-12T17:42:03.365 INFO:teuthology.orchestra.run.smithi119.stderr: 43000K .......... .......... .......... .......... .......... 46% 281M 0s 2024-09-12T17:42:03.365 INFO:teuthology.orchestra.run.smithi119.stderr: 43050K .......... .......... .......... .......... .......... 46% 315M 0s 2024-09-12T17:42:03.365 INFO:teuthology.orchestra.run.smithi119.stderr: 43100K .......... .......... .......... .......... .......... 46% 77.7M 0s 2024-09-12T17:42:03.365 INFO:teuthology.orchestra.run.smithi119.stderr: 43150K .......... .......... .......... .......... .......... 46% 223M 0s 2024-09-12T17:42:03.365 INFO:teuthology.orchestra.run.smithi119.stderr: 43200K .......... .......... .......... .......... .......... 46% 388M 0s 2024-09-12T17:42:03.365 INFO:teuthology.orchestra.run.smithi119.stderr: 43250K .......... .......... .......... .......... .......... 46% 300M 0s 2024-09-12T17:42:03.365 INFO:teuthology.orchestra.run.smithi119.stderr: 43300K .......... .......... .......... .......... .......... 46% 257M 0s 2024-09-12T17:42:03.365 INFO:teuthology.orchestra.run.smithi119.stderr: 43350K .......... .......... .......... .......... .......... 46% 228M 0s 2024-09-12T17:42:03.365 INFO:teuthology.orchestra.run.smithi119.stderr: 43400K .......... .......... .......... .......... .......... 46% 342M 0s 2024-09-12T17:42:03.365 INFO:teuthology.orchestra.run.smithi119.stderr: 43450K .......... .......... .......... .......... .......... 46% 408M 0s 2024-09-12T17:42:03.365 INFO:teuthology.orchestra.run.smithi119.stderr: 43500K .......... .......... .......... .......... .......... 46% 315M 0s 2024-09-12T17:42:03.365 INFO:teuthology.orchestra.run.smithi119.stderr: 43550K .......... .......... .......... .......... .......... 46% 231M 0s 2024-09-12T17:42:03.366 INFO:teuthology.orchestra.run.smithi119.stderr: 43600K .......... .......... .......... .......... .......... 46% 312M 0s 2024-09-12T17:42:03.366 INFO:teuthology.orchestra.run.smithi119.stderr: 43650K .......... .......... .......... .......... .......... 47% 305M 0s 2024-09-12T17:42:03.366 INFO:teuthology.orchestra.run.smithi119.stderr: 43700K .......... .......... .......... .......... .......... 47% 273M 0s 2024-09-12T17:42:03.366 INFO:teuthology.orchestra.run.smithi119.stderr: 43750K .......... .......... .......... .......... .......... 47% 276M 0s 2024-09-12T17:42:03.366 INFO:teuthology.orchestra.run.smithi119.stderr: 43800K .......... .......... .......... .......... .......... 47% 327M 0s 2024-09-12T17:42:03.366 INFO:teuthology.orchestra.run.smithi119.stderr: 43850K .......... .......... .......... .......... .......... 47% 294M 0s 2024-09-12T17:42:03.366 INFO:teuthology.orchestra.run.smithi119.stderr: 43900K .......... .......... .......... .......... .......... 47% 389M 0s 2024-09-12T17:42:03.366 INFO:teuthology.orchestra.run.smithi119.stderr: 43950K .......... .......... .......... .......... .......... 47% 339M 0s 2024-09-12T17:42:03.366 INFO:teuthology.orchestra.run.smithi119.stderr: 44000K .......... .......... .......... .......... .......... 47% 164M 0s 2024-09-12T17:42:03.366 INFO:teuthology.orchestra.run.smithi119.stderr: 44050K .......... .......... .......... .......... .......... 47% 381M 0s 2024-09-12T17:42:03.366 INFO:teuthology.orchestra.run.smithi119.stderr: 44100K .......... .......... .......... .......... .......... 47% 279M 0s 2024-09-12T17:42:03.366 INFO:teuthology.orchestra.run.smithi119.stderr: 44150K .......... .......... .......... .......... .......... 47% 223M 0s 2024-09-12T17:42:03.366 INFO:teuthology.orchestra.run.smithi119.stderr: 44200K .......... .......... .......... .......... .......... 47% 325M 0s 2024-09-12T17:42:03.367 INFO:teuthology.orchestra.run.smithi119.stderr: 44250K .......... .......... .......... .......... .......... 47% 285M 0s 2024-09-12T17:42:03.367 INFO:teuthology.orchestra.run.smithi119.stderr: 44300K .......... .......... .......... .......... .......... 47% 332M 0s 2024-09-12T17:42:03.367 INFO:teuthology.orchestra.run.smithi119.stderr: 44350K .......... .......... .......... .......... .......... 47% 333M 0s 2024-09-12T17:42:03.367 INFO:teuthology.orchestra.run.smithi119.stderr: 44400K .......... .......... .......... .......... .......... 47% 366M 0s 2024-09-12T17:42:03.367 INFO:teuthology.orchestra.run.smithi119.stderr: 44450K .......... .......... .......... .......... .......... 47% 236M 0s 2024-09-12T17:42:03.367 INFO:teuthology.orchestra.run.smithi119.stderr: 44500K .......... .......... .......... .......... .......... 47% 255M 0s 2024-09-12T17:42:03.367 INFO:teuthology.orchestra.run.smithi119.stderr: 44550K .......... .......... .......... .......... .......... 48% 334M 0s 2024-09-12T17:42:03.367 INFO:teuthology.orchestra.run.smithi119.stderr: 44600K .......... .......... .......... .......... .......... 48% 408M 0s 2024-09-12T17:42:03.367 INFO:teuthology.orchestra.run.smithi119.stderr: 44650K .......... .......... .......... .......... .......... 48% 111M 0s 2024-09-12T17:42:03.367 INFO:teuthology.orchestra.run.smithi119.stderr: 44700K .......... .......... .......... .......... .......... 48% 268M 0s 2024-09-12T17:42:03.367 INFO:teuthology.orchestra.run.smithi119.stderr: 44750K .......... .......... .......... .......... .......... 48% 228M 0s 2024-09-12T17:42:03.367 INFO:teuthology.orchestra.run.smithi119.stderr: 44800K .......... .......... .......... .......... .......... 48% 303M 0s 2024-09-12T17:42:03.367 INFO:teuthology.orchestra.run.smithi119.stderr: 44850K .......... .......... .......... .......... .......... 48% 251M 0s 2024-09-12T17:42:03.368 INFO:teuthology.orchestra.run.smithi119.stderr: 44900K .......... .......... .......... .......... .......... 48% 270M 0s 2024-09-12T17:42:03.368 INFO:teuthology.orchestra.run.smithi119.stderr: 44950K .......... .......... .......... .......... .......... 48% 297M 0s 2024-09-12T17:42:03.368 INFO:teuthology.orchestra.run.smithi119.stderr: 45000K .......... .......... .......... .......... .......... 48% 406M 0s 2024-09-12T17:42:03.368 INFO:teuthology.orchestra.run.smithi119.stderr: 45050K .......... .......... .......... .......... .......... 48% 395M 0s 2024-09-12T17:42:03.368 INFO:teuthology.orchestra.run.smithi119.stderr: 45100K .......... .......... .......... .......... .......... 48% 409M 0s 2024-09-12T17:42:03.368 INFO:teuthology.orchestra.run.smithi119.stderr: 45150K .......... .......... .......... .......... .......... 48% 85.3M 0s 2024-09-12T17:42:03.368 INFO:teuthology.orchestra.run.smithi119.stderr: 45200K .......... .......... .......... .......... .......... 48% 370M 0s 2024-09-12T17:42:03.368 INFO:teuthology.orchestra.run.smithi119.stderr: 45250K .......... .......... .......... .......... .......... 48% 239M 0s 2024-09-12T17:42:03.368 INFO:teuthology.orchestra.run.smithi119.stderr: 45300K .......... .......... .......... .......... .......... 48% 194M 0s 2024-09-12T17:42:03.368 INFO:teuthology.orchestra.run.smithi119.stderr: 45350K .......... .......... .......... .......... .......... 48% 245M 0s 2024-09-12T17:42:03.368 INFO:teuthology.orchestra.run.smithi119.stderr: 45400K .......... .......... .......... .......... .......... 48% 269M 0s 2024-09-12T17:42:03.368 INFO:teuthology.orchestra.run.smithi119.stderr: 45450K .......... .......... .......... .......... .......... 48% 395M 0s 2024-09-12T17:42:03.368 INFO:teuthology.orchestra.run.smithi119.stderr: 45500K .......... .......... .......... .......... .......... 49% 292M 0s 2024-09-12T17:42:03.368 INFO:teuthology.orchestra.run.smithi119.stderr: 45550K .......... .......... .......... .......... .......... 49% 238M 0s 2024-09-12T17:42:03.369 INFO:teuthology.orchestra.run.smithi119.stderr: 45600K .......... .......... .......... .......... .......... 49% 282M 0s 2024-09-12T17:42:03.369 INFO:teuthology.orchestra.run.smithi119.stderr: 45650K .......... .......... .......... .......... .......... 49% 253M 0s 2024-09-12T17:42:03.369 INFO:teuthology.orchestra.run.smithi119.stderr: 45700K .......... .......... .......... .......... .......... 49% 175M 0s 2024-09-12T17:42:03.369 INFO:teuthology.orchestra.run.smithi119.stderr: 45750K .......... .......... .......... .......... .......... 49% 221M 0s 2024-09-12T17:42:03.369 INFO:teuthology.orchestra.run.smithi119.stderr: 45800K .......... .......... .......... .......... .......... 49% 380M 0s 2024-09-12T17:42:03.369 INFO:teuthology.orchestra.run.smithi119.stderr: 45850K .......... .......... .......... .......... .......... 49% 114M 0s 2024-09-12T17:42:03.369 INFO:teuthology.orchestra.run.smithi119.stderr: 45900K .......... .......... .......... .......... .......... 49% 329M 0s 2024-09-12T17:42:03.369 INFO:teuthology.orchestra.run.smithi119.stderr: 45950K .......... .......... .......... .......... .......... 49% 267M 0s 2024-09-12T17:42:03.369 INFO:teuthology.orchestra.run.smithi119.stderr: 46000K .......... .......... .......... .......... .......... 49% 61.1M 0s 2024-09-12T17:42:03.369 INFO:teuthology.orchestra.run.smithi119.stderr: 46050K .......... .......... .......... .......... .......... 49% 265M 0s 2024-09-12T17:42:03.369 INFO:teuthology.orchestra.run.smithi119.stderr: 46100K .......... .......... .......... .......... .......... 49% 301M 0s 2024-09-12T17:42:03.369 INFO:teuthology.orchestra.run.smithi119.stderr: 46150K .......... .......... .......... .......... .......... 49% 225M 0s 2024-09-12T17:42:03.369 INFO:teuthology.orchestra.run.smithi119.stderr: 46200K .......... .......... .......... .......... .......... 49% 292M 0s 2024-09-12T17:42:03.370 INFO:teuthology.orchestra.run.smithi119.stderr: 46250K .......... .......... .......... .......... .......... 49% 396M 0s 2024-09-12T17:42:03.370 INFO:teuthology.orchestra.run.smithi119.stderr: 46300K .......... .......... .......... .......... .......... 49% 87.5M 0s 2024-09-12T17:42:03.370 INFO:teuthology.orchestra.run.smithi119.stderr: 46350K .......... .......... .......... .......... .......... 49% 244M 0s 2024-09-12T17:42:03.370 INFO:teuthology.orchestra.run.smithi119.stderr: 46400K .......... .......... .......... .......... .......... 49% 277M 0s 2024-09-12T17:42:03.370 INFO:teuthology.orchestra.run.smithi119.stderr: 46450K .......... .......... .......... .......... .......... 50% 324M 0s 2024-09-12T17:42:03.370 INFO:teuthology.orchestra.run.smithi119.stderr: 46500K .......... .......... .......... .......... .......... 50% 312M 0s 2024-09-12T17:42:03.370 INFO:teuthology.orchestra.run.smithi119.stderr: 46550K .......... .......... .......... .......... .......... 50% 324M 0s 2024-09-12T17:42:03.370 INFO:teuthology.orchestra.run.smithi119.stderr: 46600K .......... .......... .......... .......... .......... 50% 314M 0s 2024-09-12T17:42:03.370 INFO:teuthology.orchestra.run.smithi119.stderr: 46650K .......... .......... .......... .......... .......... 50% 280M 0s 2024-09-12T17:42:03.370 INFO:teuthology.orchestra.run.smithi119.stderr: 46700K .......... .......... .......... .......... .......... 50% 326M 0s 2024-09-12T17:42:03.370 INFO:teuthology.orchestra.run.smithi119.stderr: 46750K .......... .......... .......... .......... .......... 50% 234M 0s 2024-09-12T17:42:03.370 INFO:teuthology.orchestra.run.smithi119.stderr: 46800K .......... .......... .......... .......... .......... 50% 370M 0s 2024-09-12T17:42:03.370 INFO:teuthology.orchestra.run.smithi119.stderr: 46850K .......... .......... .......... .......... .......... 50% 300M 0s 2024-09-12T17:42:03.371 INFO:teuthology.orchestra.run.smithi119.stderr: 46900K .......... .......... .......... .......... .......... 50% 290M 0s 2024-09-12T17:42:03.371 INFO:teuthology.orchestra.run.smithi119.stderr: 46950K .......... .......... .......... .......... .......... 50% 298M 0s 2024-09-12T17:42:03.371 INFO:teuthology.orchestra.run.smithi119.stderr: 47000K .......... .......... .......... .......... .......... 50% 304M 0s 2024-09-12T17:42:03.371 INFO:teuthology.orchestra.run.smithi119.stderr: 47050K .......... .......... .......... .......... .......... 50% 269M 0s 2024-09-12T17:42:03.371 INFO:teuthology.orchestra.run.smithi119.stderr: 47100K .......... .......... .......... .......... .......... 50% 291M 0s 2024-09-12T17:42:03.371 INFO:teuthology.orchestra.run.smithi119.stderr: 47150K .......... .......... .......... .......... .......... 50% 205M 0s 2024-09-12T17:42:03.371 INFO:teuthology.orchestra.run.smithi119.stderr: 47200K .......... .......... .......... .......... .......... 50% 391M 0s 2024-09-12T17:42:03.371 INFO:teuthology.orchestra.run.smithi119.stderr: 47250K .......... .......... .......... .......... .......... 50% 318M 0s 2024-09-12T17:42:03.371 INFO:teuthology.orchestra.run.smithi119.stderr: 47300K .......... .......... .......... .......... .......... 50% 246M 0s 2024-09-12T17:42:03.371 INFO:teuthology.orchestra.run.smithi119.stderr: 47350K .......... .......... .......... .......... .......... 51% 326M 0s 2024-09-12T17:42:03.371 INFO:teuthology.orchestra.run.smithi119.stderr: 47400K .......... .......... .......... .......... .......... 51% 262M 0s 2024-09-12T17:42:03.371 INFO:teuthology.orchestra.run.smithi119.stderr: 47450K .......... .......... .......... .......... .......... 51% 375M 0s 2024-09-12T17:42:03.371 INFO:teuthology.orchestra.run.smithi119.stderr: 47500K .......... .......... .......... .......... .......... 51% 369M 0s 2024-09-12T17:42:03.371 INFO:teuthology.orchestra.run.smithi119.stderr: 47550K .......... .......... .......... .......... .......... 51% 223M 0s 2024-09-12T17:42:03.372 INFO:teuthology.orchestra.run.smithi119.stderr: 47600K .......... .......... .......... .......... .......... 51% 321M 0s 2024-09-12T17:42:03.372 INFO:teuthology.orchestra.run.smithi119.stderr: 47650K .......... .......... .......... .......... .......... 51% 341M 0s 2024-09-12T17:42:03.372 INFO:teuthology.orchestra.run.smithi119.stderr: 47700K .......... .......... .......... .......... .......... 51% 315M 0s 2024-09-12T17:42:03.372 INFO:teuthology.orchestra.run.smithi119.stderr: 47750K .......... .......... .......... .......... .......... 51% 244M 0s 2024-09-12T17:42:03.372 INFO:teuthology.orchestra.run.smithi119.stderr: 47800K .......... .......... .......... .......... .......... 51% 249M 0s 2024-09-12T17:42:03.372 INFO:teuthology.orchestra.run.smithi119.stderr: 47850K .......... .......... .......... .......... .......... 51% 326M 0s 2024-09-12T17:42:03.372 INFO:teuthology.orchestra.run.smithi119.stderr: 47900K .......... .......... .......... .......... .......... 51% 401M 0s 2024-09-12T17:42:03.372 INFO:teuthology.orchestra.run.smithi119.stderr: 47950K .......... .......... .......... .......... .......... 51% 342M 0s 2024-09-12T17:42:03.372 INFO:teuthology.orchestra.run.smithi119.stderr: 48000K .......... .......... .......... .......... .......... 51% 72.8M 0s 2024-09-12T17:42:03.372 INFO:teuthology.orchestra.run.smithi119.stderr: 48050K .......... .......... .......... .......... .......... 51% 279M 0s 2024-09-12T17:42:03.372 INFO:teuthology.orchestra.run.smithi119.stderr: 48100K .......... .......... .......... .......... .......... 51% 377M 0s 2024-09-12T17:42:03.372 INFO:teuthology.orchestra.run.smithi119.stderr: 48150K .......... .......... .......... .......... .......... 51% 307M 0s 2024-09-12T17:42:03.372 INFO:teuthology.orchestra.run.smithi119.stderr: 48200K .......... .......... .......... .......... .......... 51% 207M 0s 2024-09-12T17:42:03.373 INFO:teuthology.orchestra.run.smithi119.stderr: 48250K .......... .......... .......... .......... .......... 51% 292M 0s 2024-09-12T17:42:03.373 INFO:teuthology.orchestra.run.smithi119.stderr: 48300K .......... .......... .......... .......... .......... 52% 319M 0s 2024-09-12T17:42:03.373 INFO:teuthology.orchestra.run.smithi119.stderr: 48350K .......... .......... .......... .......... .......... 52% 332M 0s 2024-09-12T17:42:03.373 INFO:teuthology.orchestra.run.smithi119.stderr: 48400K .......... .......... .......... .......... .......... 52% 408M 0s 2024-09-12T17:42:03.373 INFO:teuthology.orchestra.run.smithi119.stderr: 48450K .......... .......... .......... .......... .......... 52% 191M 0s 2024-09-12T17:42:03.373 INFO:teuthology.orchestra.run.smithi119.stderr: 48500K .......... .......... .......... .......... .......... 52% 265M 0s 2024-09-12T17:42:03.373 INFO:teuthology.orchestra.run.smithi119.stderr: 48550K .......... .......... .......... .......... .......... 52% 274M 0s 2024-09-12T17:42:03.373 INFO:teuthology.orchestra.run.smithi119.stderr: 48600K .......... .......... .......... .......... .......... 52% 402M 0s 2024-09-12T17:42:03.373 INFO:teuthology.orchestra.run.smithi119.stderr: 48650K .......... .......... .......... .......... .......... 52% 355M 0s 2024-09-12T17:42:03.373 INFO:teuthology.orchestra.run.smithi119.stderr: 48700K .......... .......... .......... .......... .......... 52% 323M 0s 2024-09-12T17:42:03.373 INFO:teuthology.orchestra.run.smithi119.stderr: 48750K .......... .......... .......... .......... .......... 52% 258M 0s 2024-09-12T17:42:03.373 INFO:teuthology.orchestra.run.smithi119.stderr: 48800K .......... .......... .......... .......... .......... 52% 101M 0s 2024-09-12T17:42:03.373 INFO:teuthology.orchestra.run.smithi119.stderr: 48850K .......... .......... .......... .......... .......... 52% 261M 0s 2024-09-12T17:42:03.374 INFO:teuthology.orchestra.run.smithi119.stderr: 48900K .......... .......... .......... .......... .......... 52% 349M 0s 2024-09-12T17:42:03.374 INFO:teuthology.orchestra.run.smithi119.stderr: 48950K .......... .......... .......... .......... .......... 52% 287M 0s 2024-09-12T17:42:03.374 INFO:teuthology.orchestra.run.smithi119.stderr: 49000K .......... .......... .......... .......... .......... 52% 61.1M 0s 2024-09-12T17:42:03.374 INFO:teuthology.orchestra.run.smithi119.stderr: 49050K .......... .......... .......... .......... .......... 52% 378M 0s 2024-09-12T17:42:03.374 INFO:teuthology.orchestra.run.smithi119.stderr: 49100K .......... .......... .......... .......... .......... 52% 131M 0s 2024-09-12T17:42:03.374 INFO:teuthology.orchestra.run.smithi119.stderr: 49150K .......... .......... .......... .......... .......... 52% 292M 0s 2024-09-12T17:42:03.374 INFO:teuthology.orchestra.run.smithi119.stderr: 49200K .......... .......... .......... .......... .......... 53% 99.1M 0s 2024-09-12T17:42:03.374 INFO:teuthology.orchestra.run.smithi119.stderr: 49250K .......... .......... .......... .......... .......... 53% 162M 0s 2024-09-12T17:42:03.374 INFO:teuthology.orchestra.run.smithi119.stderr: 49300K .......... .......... .......... .......... .......... 53% 313M 0s 2024-09-12T17:42:03.374 INFO:teuthology.orchestra.run.smithi119.stderr: 49350K .......... .......... .......... .......... .......... 53% 321M 0s 2024-09-12T17:42:03.374 INFO:teuthology.orchestra.run.smithi119.stderr: 49400K .......... .......... .......... .......... .......... 53% 216M 0s 2024-09-12T17:42:03.374 INFO:teuthology.orchestra.run.smithi119.stderr: 49450K .......... .......... .......... .......... .......... 53% 253M 0s 2024-09-12T17:42:03.374 INFO:teuthology.orchestra.run.smithi119.stderr: 49500K .......... .......... .......... .......... .......... 53% 292M 0s 2024-09-12T17:42:03.375 INFO:teuthology.orchestra.run.smithi119.stderr: 49550K .......... .......... .......... .......... .......... 53% 231M 0s 2024-09-12T17:42:03.375 INFO:teuthology.orchestra.run.smithi119.stderr: 49600K .......... .......... .......... .......... .......... 53% 293M 0s 2024-09-12T17:42:03.375 INFO:teuthology.orchestra.run.smithi119.stderr: 49650K .......... .......... .......... .......... .......... 53% 279M 0s 2024-09-12T17:42:03.375 INFO:teuthology.orchestra.run.smithi119.stderr: 49700K .......... .......... .......... .......... .......... 53% 287M 0s 2024-09-12T17:42:03.375 INFO:teuthology.orchestra.run.smithi119.stderr: 49750K .......... .......... .......... .......... .......... 53% 252M 0s 2024-09-12T17:42:03.375 INFO:teuthology.orchestra.run.smithi119.stderr: 49800K .......... .......... .......... .......... .......... 53% 303M 0s 2024-09-12T17:42:03.375 INFO:teuthology.orchestra.run.smithi119.stderr: 49850K .......... .......... .......... .......... .......... 53% 325M 0s 2024-09-12T17:42:03.375 INFO:teuthology.orchestra.run.smithi119.stderr: 49900K .......... .......... .......... .......... .......... 53% 302M 0s 2024-09-12T17:42:03.375 INFO:teuthology.orchestra.run.smithi119.stderr: 49950K .......... .......... .......... .......... .......... 53% 264M 0s 2024-09-12T17:42:03.375 INFO:teuthology.orchestra.run.smithi119.stderr: 50000K .......... .......... .......... .......... .......... 53% 310M 0s 2024-09-12T17:42:03.375 INFO:teuthology.orchestra.run.smithi119.stderr: 50050K .......... .......... .......... .......... .......... 53% 293M 0s 2024-09-12T17:42:03.375 INFO:teuthology.orchestra.run.smithi119.stderr: 50100K .......... .......... .......... .......... .......... 53% 242M 0s 2024-09-12T17:42:03.375 INFO:teuthology.orchestra.run.smithi119.stderr: 50150K .......... .......... .......... .......... .......... 54% 265M 0s 2024-09-12T17:42:03.376 INFO:teuthology.orchestra.run.smithi119.stderr: 50200K .......... .......... .......... .......... .......... 54% 352M 0s 2024-09-12T17:42:03.376 INFO:teuthology.orchestra.run.smithi119.stderr: 50250K .......... .......... .......... .......... .......... 54% 207M 0s 2024-09-12T17:42:03.376 INFO:teuthology.orchestra.run.smithi119.stderr: 50300K .......... .......... .......... .......... .......... 54% 294M 0s 2024-09-12T17:42:03.376 INFO:teuthology.orchestra.run.smithi119.stderr: 50350K .......... .......... .......... .......... .......... 54% 241M 0s 2024-09-12T17:42:03.376 INFO:teuthology.orchestra.run.smithi119.stderr: 50400K .......... .......... .......... .......... .......... 54% 241M 0s 2024-09-12T17:42:03.376 INFO:teuthology.orchestra.run.smithi119.stderr: 50450K .......... .......... .......... .......... .......... 54% 265M 0s 2024-09-12T17:42:03.376 INFO:teuthology.orchestra.run.smithi119.stderr: 50500K .......... .......... .......... .......... .......... 54% 257M 0s 2024-09-12T17:42:03.376 INFO:teuthology.orchestra.run.smithi119.stderr: 50550K .......... .......... .......... .......... .......... 54% 322M 0s 2024-09-12T17:42:03.376 INFO:teuthology.orchestra.run.smithi119.stderr: 50600K .......... .......... .......... .......... .......... 54% 317M 0s 2024-09-12T17:42:03.376 INFO:teuthology.orchestra.run.smithi119.stderr: 50650K .......... .......... .......... .......... .......... 54% 248M 0s 2024-09-12T17:42:03.376 INFO:teuthology.orchestra.run.smithi119.stderr: 50700K .......... .......... .......... .......... .......... 54% 336M 0s 2024-09-12T17:42:03.376 INFO:teuthology.orchestra.run.smithi119.stderr: 50750K .......... .......... .......... .......... .......... 54% 339M 0s 2024-09-12T17:42:03.376 INFO:teuthology.orchestra.run.smithi119.stderr: 50800K .......... .......... .......... .......... .......... 54% 398M 0s 2024-09-12T17:42:03.377 INFO:teuthology.orchestra.run.smithi119.stderr: 50850K .......... .......... .......... .......... .......... 54% 405M 0s 2024-09-12T17:42:03.377 INFO:teuthology.orchestra.run.smithi119.stderr: 50900K .......... .......... .......... .......... .......... 54% 359M 0s 2024-09-12T17:42:03.377 INFO:teuthology.orchestra.run.smithi119.stderr: 50950K .......... .......... .......... .......... .......... 54% 160M 0s 2024-09-12T17:42:03.377 INFO:teuthology.orchestra.run.smithi119.stderr: 51000K .......... .......... .......... .......... .......... 54% 237M 0s 2024-09-12T17:42:03.377 INFO:teuthology.orchestra.run.smithi119.stderr: 51050K .......... .......... .......... .......... .......... 55% 248M 0s 2024-09-12T17:42:03.377 INFO:teuthology.orchestra.run.smithi119.stderr: 51100K .......... .......... .......... .......... .......... 55% 210M 0s 2024-09-12T17:42:03.377 INFO:teuthology.orchestra.run.smithi119.stderr: 51150K .......... .......... .......... .......... .......... 55% 162M 0s 2024-09-12T17:42:03.377 INFO:teuthology.orchestra.run.smithi119.stderr: 51200K .......... .......... .......... .......... .......... 55% 247M 0s 2024-09-12T17:42:03.377 INFO:teuthology.orchestra.run.smithi119.stderr: 51250K .......... .......... .......... .......... .......... 55% 134M 0s 2024-09-12T17:42:03.377 INFO:teuthology.orchestra.run.smithi119.stderr: 51300K .......... .......... .......... .......... .......... 55% 130M 0s 2024-09-12T17:42:03.377 INFO:teuthology.orchestra.run.smithi119.stderr: 51350K .......... .......... .......... .......... .......... 55% 141M 0s 2024-09-12T17:42:03.377 INFO:teuthology.orchestra.run.smithi119.stderr: 51400K .......... .......... .......... .......... .......... 55% 209M 0s 2024-09-12T17:42:03.377 INFO:teuthology.orchestra.run.smithi119.stderr: 51450K .......... .......... .......... .......... .......... 55% 315M 0s 2024-09-12T17:42:03.378 INFO:teuthology.orchestra.run.smithi119.stderr: 51500K .......... .......... .......... .......... .......... 55% 217M 0s 2024-09-12T17:42:03.378 INFO:teuthology.orchestra.run.smithi119.stderr: 51550K .......... .......... .......... .......... .......... 55% 206M 0s 2024-09-12T17:42:03.378 INFO:teuthology.orchestra.run.smithi119.stderr: 51600K .......... .......... .......... .......... .......... 55% 243M 0s 2024-09-12T17:42:03.378 INFO:teuthology.orchestra.run.smithi119.stderr: 51650K .......... .......... .......... .......... .......... 55% 187M 0s 2024-09-12T17:42:03.378 INFO:teuthology.orchestra.run.smithi119.stderr: 51700K .......... .......... .......... .......... .......... 55% 258M 0s 2024-09-12T17:42:03.378 INFO:teuthology.orchestra.run.smithi119.stderr: 51750K .......... .......... .......... .......... .......... 55% 312M 0s 2024-09-12T17:42:03.378 INFO:teuthology.orchestra.run.smithi119.stderr: 51800K .......... .......... .......... .......... .......... 55% 357M 0s 2024-09-12T17:42:03.378 INFO:teuthology.orchestra.run.smithi119.stderr: 51850K .......... .......... .......... .......... .......... 55% 312M 0s 2024-09-12T17:42:03.378 INFO:teuthology.orchestra.run.smithi119.stderr: 51900K .......... .......... .......... .......... .......... 55% 222M 0s 2024-09-12T17:42:03.378 INFO:teuthology.orchestra.run.smithi119.stderr: 51950K .......... .......... .......... .......... .......... 55% 324M 0s 2024-09-12T17:42:03.378 INFO:teuthology.orchestra.run.smithi119.stderr: 52000K .......... .......... .......... .......... .......... 56% 224M 0s 2024-09-12T17:42:03.378 INFO:teuthology.orchestra.run.smithi119.stderr: 52050K .......... .......... .......... .......... .......... 56% 261M 0s 2024-09-12T17:42:03.378 INFO:teuthology.orchestra.run.smithi119.stderr: 52100K .......... .......... .......... .......... .......... 56% 315M 0s 2024-09-12T17:42:03.378 INFO:teuthology.orchestra.run.smithi119.stderr: 52150K .......... .......... .......... .......... .......... 56% 205M 0s 2024-09-12T17:42:03.379 INFO:teuthology.orchestra.run.smithi119.stderr: 52200K .......... .......... .......... .......... .......... 56% 296M 0s 2024-09-12T17:42:03.379 INFO:teuthology.orchestra.run.smithi119.stderr: 52250K .......... .......... .......... .......... .......... 56% 159M 0s 2024-09-12T17:42:03.379 INFO:teuthology.orchestra.run.smithi119.stderr: 52300K .......... .......... .......... .......... .......... 56% 116M 0s 2024-09-12T17:42:03.379 INFO:teuthology.orchestra.run.smithi119.stderr: 52350K .......... .......... .......... .......... .......... 56% 215M 0s 2024-09-12T17:42:03.379 INFO:teuthology.orchestra.run.smithi119.stderr: 52400K .......... .......... .......... .......... .......... 56% 237M 0s 2024-09-12T17:42:03.379 INFO:teuthology.orchestra.run.smithi119.stderr: 52450K .......... .......... .......... .......... .......... 56% 202M 0s 2024-09-12T17:42:03.379 INFO:teuthology.orchestra.run.smithi119.stderr: 52500K .......... .......... .......... .......... .......... 56% 192M 0s 2024-09-12T17:42:03.379 INFO:teuthology.orchestra.run.smithi119.stderr: 52550K .......... .......... .......... .......... .......... 56% 310M 0s 2024-09-12T17:42:03.379 INFO:teuthology.orchestra.run.smithi119.stderr: 52600K .......... .......... .......... .......... .......... 56% 346M 0s 2024-09-12T17:42:03.379 INFO:teuthology.orchestra.run.smithi119.stderr: 52650K .......... .......... .......... .......... .......... 56% 360M 0s 2024-09-12T17:42:03.379 INFO:teuthology.orchestra.run.smithi119.stderr: 52700K .......... .......... .......... .......... .......... 56% 143M 0s 2024-09-12T17:42:03.379 INFO:teuthology.orchestra.run.smithi119.stderr: 52750K .......... .......... .......... .......... .......... 56% 212M 0s 2024-09-12T17:42:03.379 INFO:teuthology.orchestra.run.smithi119.stderr: 52800K .......... .......... .......... .......... .......... 56% 220M 0s 2024-09-12T17:42:03.379 INFO:teuthology.orchestra.run.smithi119.stderr: 52850K .......... .......... .......... .......... .......... 56% 231M 0s 2024-09-12T17:42:03.380 INFO:teuthology.orchestra.run.smithi119.stderr: 52900K .......... .......... .......... .......... .......... 56% 239M 0s 2024-09-12T17:42:03.380 INFO:teuthology.orchestra.run.smithi119.stderr: 52950K .......... .......... .......... .......... .......... 57% 277M 0s 2024-09-12T17:42:03.380 INFO:teuthology.orchestra.run.smithi119.stderr: 53000K .......... .......... .......... .......... .......... 57% 293M 0s 2024-09-12T17:42:03.380 INFO:teuthology.orchestra.run.smithi119.stderr: 53050K .......... .......... .......... .......... .......... 57% 336M 0s 2024-09-12T17:42:03.380 INFO:teuthology.orchestra.run.smithi119.stderr: 53100K .......... .......... .......... .......... .......... 57% 210M 0s 2024-09-12T17:42:03.380 INFO:teuthology.orchestra.run.smithi119.stderr: 53150K .......... .......... .......... .......... .......... 57% 234M 0s 2024-09-12T17:42:03.380 INFO:teuthology.orchestra.run.smithi119.stderr: 53200K .......... .......... .......... .......... .......... 57% 255M 0s 2024-09-12T17:42:03.380 INFO:teuthology.orchestra.run.smithi119.stderr: 53250K .......... .......... .......... .......... .......... 57% 243M 0s 2024-09-12T17:42:03.380 INFO:teuthology.orchestra.run.smithi119.stderr: 53300K .......... .......... .......... .......... .......... 57% 262M 0s 2024-09-12T17:42:03.380 INFO:teuthology.orchestra.run.smithi119.stderr: 53350K .......... .......... .......... .......... .......... 57% 193M 0s 2024-09-12T17:42:03.380 INFO:teuthology.orchestra.run.smithi119.stderr: 53400K .......... .......... .......... .......... .......... 57% 263M 0s 2024-09-12T17:42:03.380 INFO:teuthology.orchestra.run.smithi119.stderr: 53450K .......... .......... .......... .......... .......... 57% 185M 0s 2024-09-12T17:42:03.380 INFO:teuthology.orchestra.run.smithi119.stderr: 53500K .......... .......... .......... .......... .......... 57% 240M 0s 2024-09-12T17:42:03.381 INFO:teuthology.orchestra.run.smithi119.stderr: 53550K .......... .......... .......... .......... .......... 57% 233M 0s 2024-09-12T17:42:03.381 INFO:teuthology.orchestra.run.smithi119.stderr: 53600K .......... .......... .......... .......... .......... 57% 172M 0s 2024-09-12T17:42:03.381 INFO:teuthology.orchestra.run.smithi119.stderr: 53650K .......... .......... .......... .......... .......... 57% 297M 0s 2024-09-12T17:42:03.381 INFO:teuthology.orchestra.run.smithi119.stderr: 53700K .......... .......... .......... .......... .......... 57% 238M 0s 2024-09-12T17:42:03.381 INFO:teuthology.orchestra.run.smithi119.stderr: 53750K .......... .......... .......... .......... .......... 57% 272M 0s 2024-09-12T17:42:03.381 INFO:teuthology.orchestra.run.smithi119.stderr: 53800K .......... .......... .......... .......... .......... 57% 359M 0s 2024-09-12T17:42:03.381 INFO:teuthology.orchestra.run.smithi119.stderr: 53850K .......... .......... .......... .......... .......... 58% 271M 0s 2024-09-12T17:42:03.381 INFO:teuthology.orchestra.run.smithi119.stderr: 53900K .......... .......... .......... .......... .......... 58% 148M 0s 2024-09-12T17:42:03.381 INFO:teuthology.orchestra.run.smithi119.stderr: 53950K .......... .......... .......... .......... .......... 58% 187M 0s 2024-09-12T17:42:03.381 INFO:teuthology.orchestra.run.smithi119.stderr: 54000K .......... .......... .......... .......... .......... 58% 167M 0s 2024-09-12T17:42:03.381 INFO:teuthology.orchestra.run.smithi119.stderr: 54050K .......... .......... .......... .......... .......... 58% 199M 0s 2024-09-12T17:42:03.381 INFO:teuthology.orchestra.run.smithi119.stderr: 54100K .......... .......... .......... .......... .......... 58% 159M 0s 2024-09-12T17:42:03.381 INFO:teuthology.orchestra.run.smithi119.stderr: 54150K .......... .......... .......... .......... .......... 58% 212M 0s 2024-09-12T17:42:03.381 INFO:teuthology.orchestra.run.smithi119.stderr: 54200K .......... .......... .......... .......... .......... 58% 182M 0s 2024-09-12T17:42:03.382 INFO:teuthology.orchestra.run.smithi119.stderr: 54250K .......... .......... .......... .......... .......... 58% 231M 0s 2024-09-12T17:42:03.382 INFO:teuthology.orchestra.run.smithi119.stderr: 54300K .......... .......... .......... .......... .......... 58% 196M 0s 2024-09-12T17:42:03.382 INFO:teuthology.orchestra.run.smithi119.stderr: 54350K .......... .......... .......... .......... .......... 58% 172M 0s 2024-09-12T17:42:03.382 INFO:teuthology.orchestra.run.smithi119.stderr: 54400K .......... .......... .......... .......... .......... 58% 165M 0s 2024-09-12T17:42:03.382 INFO:teuthology.orchestra.run.smithi119.stderr: 54450K .......... .......... .......... .......... .......... 58% 215M 0s 2024-09-12T17:42:03.382 INFO:teuthology.orchestra.run.smithi119.stderr: 54500K .......... .......... .......... .......... .......... 58% 131M 0s 2024-09-12T17:42:03.382 INFO:teuthology.orchestra.run.smithi119.stderr: 54550K .......... .......... .......... .......... .......... 58% 236M 0s 2024-09-12T17:42:03.382 INFO:teuthology.orchestra.run.smithi119.stderr: 54600K .......... .......... .......... .......... .......... 58% 205M 0s 2024-09-12T17:42:03.382 INFO:teuthology.orchestra.run.smithi119.stderr: 54650K .......... .......... .......... .......... .......... 58% 142M 0s 2024-09-12T17:42:03.382 INFO:teuthology.orchestra.run.smithi119.stderr: 54700K .......... .......... .......... .......... .......... 58% 129M 0s 2024-09-12T17:42:03.382 INFO:teuthology.orchestra.run.smithi119.stderr: 54750K .......... .......... .......... .......... .......... 58% 202M 0s 2024-09-12T17:42:03.382 INFO:teuthology.orchestra.run.smithi119.stderr: 54800K .......... .......... .......... .......... .......... 59% 238M 0s 2024-09-12T17:42:03.382 INFO:teuthology.orchestra.run.smithi119.stderr: 54850K .......... .......... .......... .......... .......... 59% 157M 0s 2024-09-12T17:42:03.382 INFO:teuthology.orchestra.run.smithi119.stderr: 54900K .......... .......... .......... .......... .......... 59% 191M 0s 2024-09-12T17:42:03.383 INFO:teuthology.orchestra.run.smithi119.stderr: 54950K .......... .......... .......... .......... .......... 59% 186M 0s 2024-09-12T17:42:03.383 INFO:teuthology.orchestra.run.smithi119.stderr: 55000K .......... .......... .......... .......... .......... 59% 202M 0s 2024-09-12T17:42:03.383 INFO:teuthology.orchestra.run.smithi119.stderr: 55050K .......... .......... .......... .......... .......... 59% 237M 0s 2024-09-12T17:42:03.383 INFO:teuthology.orchestra.run.smithi119.stderr: 55100K .......... .......... .......... .......... .......... 59% 195M 0s 2024-09-12T17:42:03.383 INFO:teuthology.orchestra.run.smithi119.stderr: 55150K .......... .......... .......... .......... .......... 59% 195M 0s 2024-09-12T17:42:03.383 INFO:teuthology.orchestra.run.smithi119.stderr: 55200K .......... .......... .......... .......... .......... 59% 138M 0s 2024-09-12T17:42:03.383 INFO:teuthology.orchestra.run.smithi119.stderr: 55250K .......... .......... .......... .......... .......... 59% 152M 0s 2024-09-12T17:42:03.383 INFO:teuthology.orchestra.run.smithi119.stderr: 55300K .......... .......... .......... .......... .......... 59% 168M 0s 2024-09-12T17:42:03.383 INFO:teuthology.orchestra.run.smithi119.stderr: 55350K .......... .......... .......... .......... .......... 59% 157M 0s 2024-09-12T17:42:03.383 INFO:teuthology.orchestra.run.smithi119.stderr: 55400K .......... .......... .......... .......... .......... 59% 241M 0s 2024-09-12T17:42:03.383 INFO:teuthology.orchestra.run.smithi119.stderr: 55450K .......... .......... .......... .......... .......... 59% 173M 0s 2024-09-12T17:42:03.383 INFO:teuthology.orchestra.run.smithi119.stderr: 55500K .......... .......... .......... .......... .......... 59% 144M 0s 2024-09-12T17:42:03.383 INFO:teuthology.orchestra.run.smithi119.stderr: 55550K .......... .......... .......... .......... .......... 59% 218M 0s 2024-09-12T17:42:03.384 INFO:teuthology.orchestra.run.smithi119.stderr: 55600K .......... .......... .......... .......... .......... 59% 123M 0s 2024-09-12T17:42:03.384 INFO:teuthology.orchestra.run.smithi119.stderr: 55650K .......... .......... .......... .......... .......... 59% 174M 0s 2024-09-12T17:42:03.384 INFO:teuthology.orchestra.run.smithi119.stderr: 55700K .......... .......... .......... .......... .......... 60% 122M 0s 2024-09-12T17:42:03.384 INFO:teuthology.orchestra.run.smithi119.stderr: 55750K .......... .......... .......... .......... .......... 60% 179M 0s 2024-09-12T17:42:03.384 INFO:teuthology.orchestra.run.smithi119.stderr: 55800K .......... .......... .......... .......... .......... 60% 143M 0s 2024-09-12T17:42:03.384 INFO:teuthology.orchestra.run.smithi119.stderr: 55850K .......... .......... .......... .......... .......... 60% 182M 0s 2024-09-12T17:42:03.384 INFO:teuthology.orchestra.run.smithi119.stderr: 55900K .......... .......... .......... .......... .......... 60% 187M 0s 2024-09-12T17:42:03.384 INFO:teuthology.orchestra.run.smithi119.stderr: 55950K .......... .......... .......... .......... .......... 60% 239M 0s 2024-09-12T17:42:03.384 INFO:teuthology.orchestra.run.smithi119.stderr: 56000K .......... .......... .......... .......... .......... 60% 119M 0s 2024-09-12T17:42:03.384 INFO:teuthology.orchestra.run.smithi119.stderr: 56050K .......... .......... .......... .......... .......... 60% 142M 0s 2024-09-12T17:42:03.384 INFO:teuthology.orchestra.run.smithi119.stderr: 56100K .......... .......... .......... .......... .......... 60% 198M 0s 2024-09-12T17:42:03.384 INFO:teuthology.orchestra.run.smithi119.stderr: 56150K .......... .......... .......... .......... .......... 60% 188M 0s 2024-09-12T17:42:03.384 INFO:teuthology.orchestra.run.smithi119.stderr: 56200K .......... .......... .......... .......... .......... 60% 195M 0s 2024-09-12T17:42:03.385 INFO:teuthology.orchestra.run.smithi119.stderr: 56250K .......... .......... .......... .......... .......... 60% 179M 0s 2024-09-12T17:42:03.385 INFO:teuthology.orchestra.run.smithi119.stderr: 56300K .......... .......... .......... .......... .......... 60% 171M 0s 2024-09-12T17:42:03.385 INFO:teuthology.orchestra.run.smithi119.stderr: 56350K .......... .......... .......... .......... .......... 60% 232M 0s 2024-09-12T17:42:03.385 INFO:teuthology.orchestra.run.smithi119.stderr: 56400K .......... .......... .......... .......... .......... 60% 172M 0s 2024-09-12T17:42:03.385 INFO:teuthology.orchestra.run.smithi119.stderr: 56450K .......... .......... .......... .......... .......... 60% 139M 0s 2024-09-12T17:42:03.385 INFO:teuthology.orchestra.run.smithi119.stderr: 56500K .......... .......... .......... .......... .......... 60% 165M 0s 2024-09-12T17:42:03.385 INFO:teuthology.orchestra.run.smithi119.stderr: 56550K .......... .......... .......... .......... .......... 60% 197M 0s 2024-09-12T17:42:03.385 INFO:teuthology.orchestra.run.smithi119.stderr: 56600K .......... .......... .......... .......... .......... 60% 177M 0s 2024-09-12T17:42:03.385 INFO:teuthology.orchestra.run.smithi119.stderr: 56650K .......... .......... .......... .......... .......... 61% 228M 0s 2024-09-12T17:42:03.385 INFO:teuthology.orchestra.run.smithi119.stderr: 56700K .......... .......... .......... .......... .......... 61% 147M 0s 2024-09-12T17:42:03.385 INFO:teuthology.orchestra.run.smithi119.stderr: 56750K .......... .......... .......... .......... .......... 61% 141M 0s 2024-09-12T17:42:03.385 INFO:teuthology.orchestra.run.smithi119.stderr: 56800K .......... .......... .......... .......... .......... 61% 170M 0s 2024-09-12T17:42:03.385 INFO:teuthology.orchestra.run.smithi119.stderr: 56850K .......... .......... .......... .......... .......... 61% 170M 0s 2024-09-12T17:42:03.386 INFO:teuthology.orchestra.run.smithi119.stderr: 56900K .......... .......... .......... .......... .......... 61% 146M 0s 2024-09-12T17:42:03.386 INFO:teuthology.orchestra.run.smithi119.stderr: 56950K .......... .......... .......... .......... .......... 61% 171M 0s 2024-09-12T17:42:03.386 INFO:teuthology.orchestra.run.smithi119.stderr: 57000K .......... .......... .......... .......... .......... 61% 187M 0s 2024-09-12T17:42:03.386 INFO:teuthology.orchestra.run.smithi119.stderr: 57050K .......... .......... .......... .......... .......... 61% 246M 0s 2024-09-12T17:42:03.386 INFO:teuthology.orchestra.run.smithi119.stderr: 57100K .......... .......... .......... .......... .......... 61% 196M 0s 2024-09-12T17:42:03.386 INFO:teuthology.orchestra.run.smithi119.stderr: 57150K .......... .......... .......... .......... .......... 61% 233M 0s 2024-09-12T17:42:03.386 INFO:teuthology.orchestra.run.smithi119.stderr: 57200K .......... .......... .......... .......... .......... 61% 128M 0s 2024-09-12T17:42:03.386 INFO:teuthology.orchestra.run.smithi119.stderr: 57250K .......... .......... .......... .......... .......... 61% 189M 0s 2024-09-12T17:42:03.386 INFO:teuthology.orchestra.run.smithi119.stderr: 57300K .......... .......... .......... .......... .......... 61% 170M 0s 2024-09-12T17:42:03.386 INFO:teuthology.orchestra.run.smithi119.stderr: 57350K .......... .......... .......... .......... .......... 61% 188M 0s 2024-09-12T17:42:03.386 INFO:teuthology.orchestra.run.smithi119.stderr: 57400K .......... .......... .......... .......... .......... 61% 234M 0s 2024-09-12T17:42:03.386 INFO:teuthology.orchestra.run.smithi119.stderr: 57450K .......... .......... .......... .......... .......... 61% 180M 0s 2024-09-12T17:42:03.386 INFO:teuthology.orchestra.run.smithi119.stderr: 57500K .......... .......... .......... .......... .......... 61% 150M 0s 2024-09-12T17:42:03.386 INFO:teuthology.orchestra.run.smithi119.stderr: 57550K .......... .......... .......... .......... .......... 62% 215M 0s 2024-09-12T17:42:03.387 INFO:teuthology.orchestra.run.smithi119.stderr: 57600K .......... .......... .......... .......... .......... 62% 179M 0s 2024-09-12T17:42:03.387 INFO:teuthology.orchestra.run.smithi119.stderr: 57650K .......... .......... .......... .......... .......... 62% 177M 0s 2024-09-12T17:42:03.387 INFO:teuthology.orchestra.run.smithi119.stderr: 57700K .......... .......... .......... .......... .......... 62% 215M 0s 2024-09-12T17:42:03.387 INFO:teuthology.orchestra.run.smithi119.stderr: 57750K .......... .......... .......... .......... .......... 62% 171M 0s 2024-09-12T17:42:03.387 INFO:teuthology.orchestra.run.smithi119.stderr: 57800K .......... .......... .......... .......... .......... 62% 171M 0s 2024-09-12T17:42:03.387 INFO:teuthology.orchestra.run.smithi119.stderr: 57850K .......... .......... .......... .......... .......... 62% 174M 0s 2024-09-12T17:42:03.387 INFO:teuthology.orchestra.run.smithi119.stderr: 57900K .......... .......... .......... .......... .......... 62% 155M 0s 2024-09-12T17:42:03.387 INFO:teuthology.orchestra.run.smithi119.stderr: 57950K .......... .......... .......... .......... .......... 62% 174M 0s 2024-09-12T17:42:03.387 INFO:teuthology.orchestra.run.smithi119.stderr: 58000K .......... .......... .......... .......... .......... 62% 229M 0s 2024-09-12T17:42:03.387 INFO:teuthology.orchestra.run.smithi119.stderr: 58050K .......... .......... .......... .......... .......... 62% 238M 0s 2024-09-12T17:42:03.387 INFO:teuthology.orchestra.run.smithi119.stderr: 58100K .......... .......... .......... .......... .......... 62% 146M 0s 2024-09-12T17:42:03.387 INFO:teuthology.orchestra.run.smithi119.stderr: 58150K .......... .......... .......... .......... .......... 62% 178M 0s 2024-09-12T17:42:03.387 INFO:teuthology.orchestra.run.smithi119.stderr: 58200K .......... .......... .......... .......... .......... 62% 214M 0s 2024-09-12T17:42:03.388 INFO:teuthology.orchestra.run.smithi119.stderr: 58250K .......... .......... .......... .......... .......... 62% 192M 0s 2024-09-12T17:42:03.388 INFO:teuthology.orchestra.run.smithi119.stderr: 58300K .......... .......... .......... .......... .......... 62% 149M 0s 2024-09-12T17:42:03.388 INFO:teuthology.orchestra.run.smithi119.stderr: 58350K .......... .......... .......... .......... .......... 62% 176M 0s 2024-09-12T17:42:03.388 INFO:teuthology.orchestra.run.smithi119.stderr: 58400K .......... .......... .......... .......... .......... 62% 196M 0s 2024-09-12T17:42:03.388 INFO:teuthology.orchestra.run.smithi119.stderr: 58450K .......... .......... .......... .......... .......... 62% 218M 0s 2024-09-12T17:42:03.388 INFO:teuthology.orchestra.run.smithi119.stderr: 58500K .......... .......... .......... .......... .......... 63% 202M 0s 2024-09-12T17:42:03.388 INFO:teuthology.orchestra.run.smithi119.stderr: 58550K .......... .......... .......... .......... .......... 63% 167M 0s 2024-09-12T17:42:03.388 INFO:teuthology.orchestra.run.smithi119.stderr: 58600K .......... .......... .......... .......... .......... 63% 163M 0s 2024-09-12T17:42:03.388 INFO:teuthology.orchestra.run.smithi119.stderr: 58650K .......... .......... .......... .......... .......... 63% 205M 0s 2024-09-12T17:42:03.388 INFO:teuthology.orchestra.run.smithi119.stderr: 58700K .......... .......... .......... .......... .......... 63% 156M 0s 2024-09-12T17:42:03.388 INFO:teuthology.orchestra.run.smithi119.stderr: 58750K .......... .......... .......... .......... .......... 63% 173M 0s 2024-09-12T17:42:03.388 INFO:teuthology.orchestra.run.smithi119.stderr: 58800K .......... .......... .......... .......... .......... 63% 218M 0s 2024-09-12T17:42:03.388 INFO:teuthology.orchestra.run.smithi119.stderr: 58850K .......... .......... .......... .......... .......... 63% 137M 0s 2024-09-12T17:42:03.388 INFO:teuthology.orchestra.run.smithi119.stderr: 58900K .......... .......... .......... .......... .......... 63% 157M 0s 2024-09-12T17:42:03.389 INFO:teuthology.orchestra.run.smithi119.stderr: 58950K .......... .......... .......... .......... .......... 63% 202M 0s 2024-09-12T17:42:03.389 INFO:teuthology.orchestra.run.smithi119.stderr: 59000K .......... .......... .......... .......... .......... 63% 198M 0s 2024-09-12T17:42:03.389 INFO:teuthology.orchestra.run.smithi119.stderr: 59050K .......... .......... .......... .......... .......... 63% 158M 0s 2024-09-12T17:42:03.389 INFO:teuthology.orchestra.run.smithi119.stderr: 59100K .......... .......... .......... .......... .......... 63% 163M 0s 2024-09-12T17:42:03.389 INFO:teuthology.orchestra.run.smithi119.stderr: 59150K .......... .......... .......... .......... .......... 63% 192M 0s 2024-09-12T17:42:03.389 INFO:teuthology.orchestra.run.smithi119.stderr: 59200K .......... .......... .......... .......... .......... 63% 237M 0s 2024-09-12T17:42:03.389 INFO:teuthology.orchestra.run.smithi119.stderr: 59250K .......... .......... .......... .......... .......... 63% 237M 0s 2024-09-12T17:42:03.389 INFO:teuthology.orchestra.run.smithi119.stderr: 59300K .......... .......... .......... .......... .......... 63% 214M 0s 2024-09-12T17:42:03.389 INFO:teuthology.orchestra.run.smithi119.stderr: 59350K .......... .......... .......... .......... .......... 63% 166M 0s 2024-09-12T17:42:03.389 INFO:teuthology.orchestra.run.smithi119.stderr: 59400K .......... .......... .......... .......... .......... 63% 152M 0s 2024-09-12T17:42:03.389 INFO:teuthology.orchestra.run.smithi119.stderr: 59450K .......... .......... .......... .......... .......... 64% 176M 0s 2024-09-12T17:42:03.389 INFO:teuthology.orchestra.run.smithi119.stderr: 59500K .......... .......... .......... .......... .......... 64% 170M 0s 2024-09-12T17:42:03.389 INFO:teuthology.orchestra.run.smithi119.stderr: 59550K .......... .......... .......... .......... .......... 64% 179M 0s 2024-09-12T17:42:03.389 INFO:teuthology.orchestra.run.smithi119.stderr: 59600K .......... .......... .......... .......... .......... 64% 244M 0s 2024-09-12T17:42:03.390 INFO:teuthology.orchestra.run.smithi119.stderr: 59650K .......... .......... .......... .......... .......... 64% 170M 0s 2024-09-12T17:42:03.390 INFO:teuthology.orchestra.run.smithi119.stderr: 59700K .......... .......... .......... .......... .......... 64% 164M 0s 2024-09-12T17:42:03.390 INFO:teuthology.orchestra.run.smithi119.stderr: 59750K .......... .......... .......... .......... .......... 64% 170M 0s 2024-09-12T17:42:03.390 INFO:teuthology.orchestra.run.smithi119.stderr: 59800K .......... .......... .......... .......... .......... 64% 169M 0s 2024-09-12T17:42:03.390 INFO:teuthology.orchestra.run.smithi119.stderr: 59850K .......... .......... .......... .......... .......... 64% 236M 0s 2024-09-12T17:42:03.390 INFO:teuthology.orchestra.run.smithi119.stderr: 59900K .......... .......... .......... .......... .......... 64% 131M 0s 2024-09-12T17:42:03.390 INFO:teuthology.orchestra.run.smithi119.stderr: 59950K .......... .......... .......... .......... .......... 64% 244M 0s 2024-09-12T17:42:03.390 INFO:teuthology.orchestra.run.smithi119.stderr: 60000K .......... .......... .......... .......... .......... 64% 183M 0s 2024-09-12T17:42:03.390 INFO:teuthology.orchestra.run.smithi119.stderr: 60050K .......... .......... .......... .......... .......... 64% 191M 0s 2024-09-12T17:42:03.390 INFO:teuthology.orchestra.run.smithi119.stderr: 60100K .......... .......... .......... .......... .......... 64% 181M 0s 2024-09-12T17:42:03.390 INFO:teuthology.orchestra.run.smithi119.stderr: 60150K .......... .......... .......... .......... .......... 64% 203M 0s 2024-09-12T17:42:03.390 INFO:teuthology.orchestra.run.smithi119.stderr: 60200K .......... .......... .......... .......... .......... 64% 242M 0s 2024-09-12T17:42:03.390 INFO:teuthology.orchestra.run.smithi119.stderr: 60250K .......... .......... .......... .......... .......... 64% 181M 0s 2024-09-12T17:42:03.391 INFO:teuthology.orchestra.run.smithi119.stderr: 60300K .......... .......... .......... .......... .......... 64% 167M 0s 2024-09-12T17:42:03.391 INFO:teuthology.orchestra.run.smithi119.stderr: 60350K .......... .......... .......... .......... .......... 65% 196M 0s 2024-09-12T17:42:03.391 INFO:teuthology.orchestra.run.smithi119.stderr: 60400K .......... .......... .......... .......... .......... 65% 236M 0s 2024-09-12T17:42:03.391 INFO:teuthology.orchestra.run.smithi119.stderr: 60450K .......... .......... .......... .......... .......... 65% 177M 0s 2024-09-12T17:42:03.391 INFO:teuthology.orchestra.run.smithi119.stderr: 60500K .......... .......... .......... .......... .......... 65% 159M 0s 2024-09-12T17:42:03.391 INFO:teuthology.orchestra.run.smithi119.stderr: 60550K .......... .......... .......... .......... .......... 65% 207M 0s 2024-09-12T17:42:03.391 INFO:teuthology.orchestra.run.smithi119.stderr: 60600K .......... .......... .......... .......... .......... 65% 239M 0s 2024-09-12T17:42:03.391 INFO:teuthology.orchestra.run.smithi119.stderr: 60650K .......... .......... .......... .......... .......... 65% 189M 0s 2024-09-12T17:42:03.391 INFO:teuthology.orchestra.run.smithi119.stderr: 60700K .......... .......... .......... .......... .......... 65% 191M 0s 2024-09-12T17:42:03.391 INFO:teuthology.orchestra.run.smithi119.stderr: 60750K .......... .......... .......... .......... .......... 65% 158M 0s 2024-09-12T17:42:03.391 INFO:teuthology.orchestra.run.smithi119.stderr: 60800K .......... .......... .......... .......... .......... 65% 173M 0s 2024-09-12T17:42:03.391 INFO:teuthology.orchestra.run.smithi119.stderr: 60850K .......... .......... .......... .......... .......... 65% 231M 0s 2024-09-12T17:42:03.391 INFO:teuthology.orchestra.run.smithi119.stderr: 60900K .......... .......... .......... .......... .......... 65% 176M 0s 2024-09-12T17:42:03.392 INFO:teuthology.orchestra.run.smithi119.stderr: 60950K .......... .......... .......... .......... .......... 65% 188M 0s 2024-09-12T17:42:03.392 INFO:teuthology.orchestra.run.smithi119.stderr: 61000K .......... .......... .......... .......... .......... 65% 178M 0s 2024-09-12T17:42:03.392 INFO:teuthology.orchestra.run.smithi119.stderr: 61050K .......... .......... .......... .......... .......... 65% 179M 0s 2024-09-12T17:42:03.392 INFO:teuthology.orchestra.run.smithi119.stderr: 61100K .......... .......... .......... .......... .......... 65% 143M 0s 2024-09-12T17:42:03.392 INFO:teuthology.orchestra.run.smithi119.stderr: 61150K .......... .......... .......... .......... .......... 65% 195M 0s 2024-09-12T17:42:03.392 INFO:teuthology.orchestra.run.smithi119.stderr: 61200K .......... .......... .......... .......... .......... 65% 190M 0s 2024-09-12T17:42:03.392 INFO:teuthology.orchestra.run.smithi119.stderr: 61250K .......... .......... .......... .......... .......... 65% 164M 0s 2024-09-12T17:42:03.392 INFO:teuthology.orchestra.run.smithi119.stderr: 61300K .......... .......... .......... .......... .......... 66% 167M 0s 2024-09-12T17:42:03.392 INFO:teuthology.orchestra.run.smithi119.stderr: 61350K .......... .......... .......... .......... .......... 66% 246M 0s 2024-09-12T17:42:03.392 INFO:teuthology.orchestra.run.smithi119.stderr: 61400K .......... .......... .......... .......... .......... 66% 218M 0s 2024-09-12T17:42:03.392 INFO:teuthology.orchestra.run.smithi119.stderr: 61450K .......... .......... .......... .......... .......... 66% 270M 0s 2024-09-12T17:42:03.392 INFO:teuthology.orchestra.run.smithi119.stderr: 61500K .......... .......... .......... .......... .......... 66% 247M 0s 2024-09-12T17:42:03.392 INFO:teuthology.orchestra.run.smithi119.stderr: 61550K .......... .......... .......... .......... .......... 66% 117M 0s 2024-09-12T17:42:03.392 INFO:teuthology.orchestra.run.smithi119.stderr: 61600K .......... .......... .......... .......... .......... 66% 184M 0s 2024-09-12T17:42:03.393 INFO:teuthology.orchestra.run.smithi119.stderr: 61650K .......... .......... .......... .......... .......... 66% 182M 0s 2024-09-12T17:42:03.393 INFO:teuthology.orchestra.run.smithi119.stderr: 61700K .......... .......... .......... .......... .......... 66% 184M 0s 2024-09-12T17:42:03.393 INFO:teuthology.orchestra.run.smithi119.stderr: 61750K .......... .......... .......... .......... .......... 66% 186M 0s 2024-09-12T17:42:03.393 INFO:teuthology.orchestra.run.smithi119.stderr: 61800K .......... .......... .......... .......... .......... 66% 202M 0s 2024-09-12T17:42:03.393 INFO:teuthology.orchestra.run.smithi119.stderr: 61850K .......... .......... .......... .......... .......... 66% 185M 0s 2024-09-12T17:42:03.393 INFO:teuthology.orchestra.run.smithi119.stderr: 61900K .......... .......... .......... .......... .......... 66% 180M 0s 2024-09-12T17:42:03.393 INFO:teuthology.orchestra.run.smithi119.stderr: 61950K .......... .......... .......... .......... .......... 66% 168M 0s 2024-09-12T17:42:03.393 INFO:teuthology.orchestra.run.smithi119.stderr: 62000K .......... .......... .......... .......... .......... 66% 118M 0s 2024-09-12T17:42:03.393 INFO:teuthology.orchestra.run.smithi119.stderr: 62050K .......... .......... .......... .......... .......... 66% 140M 0s 2024-09-12T17:42:03.393 INFO:teuthology.orchestra.run.smithi119.stderr: 62100K .......... .......... .......... .......... .......... 66% 139M 0s 2024-09-12T17:42:03.393 INFO:teuthology.orchestra.run.smithi119.stderr: 62150K .......... .......... .......... .......... .......... 66% 131M 0s 2024-09-12T17:42:03.393 INFO:teuthology.orchestra.run.smithi119.stderr: 62200K .......... .......... .......... .......... .......... 67% 148M 0s 2024-09-12T17:42:03.393 INFO:teuthology.orchestra.run.smithi119.stderr: 62250K .......... .......... .......... .......... .......... 67% 137M 0s 2024-09-12T17:42:03.394 INFO:teuthology.orchestra.run.smithi119.stderr: 62300K .......... .......... .......... .......... .......... 67% 147M 0s 2024-09-12T17:42:03.394 INFO:teuthology.orchestra.run.smithi119.stderr: 62350K .......... .......... .......... .......... .......... 67% 112M 0s 2024-09-12T17:42:03.394 INFO:teuthology.orchestra.run.smithi119.stderr: 62400K .......... .......... .......... .......... .......... 67% 139M 0s 2024-09-12T17:42:03.394 INFO:teuthology.orchestra.run.smithi119.stderr: 62450K .......... .......... .......... .......... .......... 67% 133M 0s 2024-09-12T17:42:03.394 INFO:teuthology.orchestra.run.smithi119.stderr: 62500K .......... .......... .......... .......... .......... 67% 134M 0s 2024-09-12T17:42:03.394 INFO:teuthology.orchestra.run.smithi119.stderr: 62550K .......... .......... .......... .......... .......... 67% 128M 0s 2024-09-12T17:42:03.394 INFO:teuthology.orchestra.run.smithi119.stderr: 62600K .......... .......... .......... .......... .......... 67% 330M 0s 2024-09-12T17:42:03.394 INFO:teuthology.orchestra.run.smithi119.stderr: 62650K .......... .......... .......... .......... .......... 67% 328M 0s 2024-09-12T17:42:03.394 INFO:teuthology.orchestra.run.smithi119.stderr: 62700K .......... .......... .......... .......... .......... 67% 315M 0s 2024-09-12T17:42:03.394 INFO:teuthology.orchestra.run.smithi119.stderr: 62750K .......... .......... .......... .......... .......... 67% 296M 0s 2024-09-12T17:42:03.394 INFO:teuthology.orchestra.run.smithi119.stderr: 62800K .......... .......... .......... .......... .......... 67% 368M 0s 2024-09-12T17:42:03.394 INFO:teuthology.orchestra.run.smithi119.stderr: 62850K .......... .......... .......... .......... .......... 67% 367M 0s 2024-09-12T17:42:03.395 INFO:teuthology.orchestra.run.smithi119.stderr: 62900K .......... .......... .......... .......... .......... 67% 362M 0s 2024-09-12T17:42:03.395 INFO:teuthology.orchestra.run.smithi119.stderr: 62950K .......... .......... .......... .......... .......... 67% 336M 0s 2024-09-12T17:42:03.395 INFO:teuthology.orchestra.run.smithi119.stderr: 63000K .......... .......... .......... .......... .......... 67% 395M 0s 2024-09-12T17:42:03.395 INFO:teuthology.orchestra.run.smithi119.stderr: 63050K .......... .......... .......... .......... .......... 67% 369M 0s 2024-09-12T17:42:03.395 INFO:teuthology.orchestra.run.smithi119.stderr: 63100K .......... .......... .......... .......... .......... 67% 365M 0s 2024-09-12T17:42:03.395 INFO:teuthology.orchestra.run.smithi119.stderr: 63150K .......... .......... .......... .......... .......... 68% 307M 0s 2024-09-12T17:42:03.395 INFO:teuthology.orchestra.run.smithi119.stderr: 63200K .......... .......... .......... .......... .......... 68% 385M 0s 2024-09-12T17:42:03.395 INFO:teuthology.orchestra.run.smithi119.stderr: 63250K .......... .......... .......... .......... .......... 68% 377M 0s 2024-09-12T17:42:03.395 INFO:teuthology.orchestra.run.smithi119.stderr: 63300K .......... .......... .......... .......... .......... 68% 375M 0s 2024-09-12T17:42:03.395 INFO:teuthology.orchestra.run.smithi119.stderr: 63350K .......... .......... .......... .......... .......... 68% 306M 0s 2024-09-12T17:42:03.395 INFO:teuthology.orchestra.run.smithi119.stderr: 63400K .......... .......... .......... .......... .......... 68% 379M 0s 2024-09-12T17:42:03.395 INFO:teuthology.orchestra.run.smithi119.stderr: 63450K .......... .......... .......... .......... .......... 68% 372M 0s 2024-09-12T17:42:03.395 INFO:teuthology.orchestra.run.smithi119.stderr: 63500K .......... .......... .......... .......... .......... 68% 362M 0s 2024-09-12T17:42:03.395 INFO:teuthology.orchestra.run.smithi119.stderr: 63550K .......... .......... .......... .......... .......... 68% 273M 0s 2024-09-12T17:42:03.396 INFO:teuthology.orchestra.run.smithi119.stderr: 63600K .......... .......... .......... .......... .......... 68% 351M 0s 2024-09-12T17:42:03.396 INFO:teuthology.orchestra.run.smithi119.stderr: 63650K .......... .......... .......... .......... .......... 68% 359M 0s 2024-09-12T17:42:03.396 INFO:teuthology.orchestra.run.smithi119.stderr: 63700K .......... .......... .......... .......... .......... 68% 367M 0s 2024-09-12T17:42:03.396 INFO:teuthology.orchestra.run.smithi119.stderr: 63750K .......... .......... .......... .......... .......... 68% 313M 0s 2024-09-12T17:42:03.396 INFO:teuthology.orchestra.run.smithi119.stderr: 63800K .......... .......... .......... .......... .......... 68% 381M 0s 2024-09-12T17:42:03.396 INFO:teuthology.orchestra.run.smithi119.stderr: 63850K .......... .......... .......... .......... .......... 68% 275M 0s 2024-09-12T17:42:03.396 INFO:teuthology.orchestra.run.smithi119.stderr: 63900K .......... .......... .......... .......... .......... 68% 333M 0s 2024-09-12T17:42:03.396 INFO:teuthology.orchestra.run.smithi119.stderr: 63950K .......... .......... .......... .......... .......... 68% 308M 0s 2024-09-12T17:42:03.396 INFO:teuthology.orchestra.run.smithi119.stderr: 64000K .......... .......... .......... .......... .......... 68% 387M 0s 2024-09-12T17:42:03.396 INFO:teuthology.orchestra.run.smithi119.stderr: 64050K .......... .......... .......... .......... .......... 68% 393M 0s 2024-09-12T17:42:03.396 INFO:teuthology.orchestra.run.smithi119.stderr: 64100K .......... .......... .......... .......... .......... 69% 385M 0s 2024-09-12T17:42:03.396 INFO:teuthology.orchestra.run.smithi119.stderr: 64150K .......... .......... .......... .......... .......... 69% 349M 0s 2024-09-12T17:42:03.396 INFO:teuthology.orchestra.run.smithi119.stderr: 64200K .......... .......... .......... .......... .......... 69% 384M 0s 2024-09-12T17:42:03.397 INFO:teuthology.orchestra.run.smithi119.stderr: 64250K .......... .......... .......... .......... .......... 69% 388M 0s 2024-09-12T17:42:03.397 INFO:teuthology.orchestra.run.smithi119.stderr: 64300K .......... .......... .......... .......... .......... 69% 388M 0s 2024-09-12T17:42:03.397 INFO:teuthology.orchestra.run.smithi119.stderr: 64350K .......... .......... .......... .......... .......... 69% 309M 0s 2024-09-12T17:42:03.397 INFO:teuthology.orchestra.run.smithi119.stderr: 64400K .......... .......... .......... .......... .......... 69% 347M 0s 2024-09-12T17:42:03.397 INFO:teuthology.orchestra.run.smithi119.stderr: 64450K .......... .......... .......... .......... .......... 69% 327M 0s 2024-09-12T17:42:03.397 INFO:teuthology.orchestra.run.smithi119.stderr: 64500K .......... .......... .......... .......... .......... 69% 353M 0s 2024-09-12T17:42:03.397 INFO:teuthology.orchestra.run.smithi119.stderr: 64550K .......... .......... .......... .......... .......... 69% 297M 0s 2024-09-12T17:42:03.397 INFO:teuthology.orchestra.run.smithi119.stderr: 64600K .......... .......... .......... .......... .......... 69% 388M 0s 2024-09-12T17:42:03.397 INFO:teuthology.orchestra.run.smithi119.stderr: 64650K .......... .......... .......... .......... .......... 69% 377M 0s 2024-09-12T17:42:03.397 INFO:teuthology.orchestra.run.smithi119.stderr: 64700K .......... .......... .......... .......... .......... 69% 396M 0s 2024-09-12T17:42:03.397 INFO:teuthology.orchestra.run.smithi119.stderr: 64750K .......... .......... .......... .......... .......... 69% 330M 0s 2024-09-12T17:42:03.397 INFO:teuthology.orchestra.run.smithi119.stderr: 64800K .......... .......... .......... .......... .......... 69% 378M 0s 2024-09-12T17:42:03.397 INFO:teuthology.orchestra.run.smithi119.stderr: 64850K .......... .......... .......... .......... .......... 69% 288M 0s 2024-09-12T17:42:03.397 INFO:teuthology.orchestra.run.smithi119.stderr: 64900K .......... .......... .......... .......... .......... 69% 357M 0s 2024-09-12T17:42:03.398 INFO:teuthology.orchestra.run.smithi119.stderr: 64950K .......... .......... .......... .......... .......... 69% 339M 0s 2024-09-12T17:42:03.398 INFO:teuthology.orchestra.run.smithi119.stderr: 65000K .......... .......... .......... .......... .......... 70% 380M 0s 2024-09-12T17:42:03.398 INFO:teuthology.orchestra.run.smithi119.stderr: 65050K .......... .......... .......... .......... .......... 70% 375M 0s 2024-09-12T17:42:03.398 INFO:teuthology.orchestra.run.smithi119.stderr: 65100K .......... .......... .......... .......... .......... 70% 353M 0s 2024-09-12T17:42:03.398 INFO:teuthology.orchestra.run.smithi119.stderr: 65150K .......... .......... .......... .......... .......... 70% 307M 0s 2024-09-12T17:42:03.398 INFO:teuthology.orchestra.run.smithi119.stderr: 65200K .......... .......... .......... .......... .......... 70% 386M 0s 2024-09-12T17:42:03.398 INFO:teuthology.orchestra.run.smithi119.stderr: 65250K .......... .......... .......... .......... .......... 70% 385M 0s 2024-09-12T17:42:03.398 INFO:teuthology.orchestra.run.smithi119.stderr: 65300K .......... .......... .......... .......... .......... 70% 171M 0s 2024-09-12T17:42:03.398 INFO:teuthology.orchestra.run.smithi119.stderr: 65350K .......... .......... .......... .......... .......... 70% 118M 0s 2024-09-12T17:42:03.398 INFO:teuthology.orchestra.run.smithi119.stderr: 65400K .......... .......... .......... .......... .......... 70% 314M 0s 2024-09-12T17:42:03.398 INFO:teuthology.orchestra.run.smithi119.stderr: 65450K .......... .......... .......... .......... .......... 70% 171M 0s 2024-09-12T17:42:03.398 INFO:teuthology.orchestra.run.smithi119.stderr: 65500K .......... .......... .......... .......... .......... 70% 97.5M 0s 2024-09-12T17:42:03.398 INFO:teuthology.orchestra.run.smithi119.stderr: 65550K .......... .......... .......... .......... .......... 70% 132M 0s 2024-09-12T17:42:03.398 INFO:teuthology.orchestra.run.smithi119.stderr: 65600K .......... .......... .......... .......... .......... 70% 109M 0s 2024-09-12T17:42:03.399 INFO:teuthology.orchestra.run.smithi119.stderr: 65650K .......... .......... .......... .......... .......... 70% 280M 0s 2024-09-12T17:42:03.399 INFO:teuthology.orchestra.run.smithi119.stderr: 65700K .......... .......... .......... .......... .......... 70% 278M 0s 2024-09-12T17:42:03.399 INFO:teuthology.orchestra.run.smithi119.stderr: 65750K .......... .......... .......... .......... .......... 70% 106M 0s 2024-09-12T17:42:03.399 INFO:teuthology.orchestra.run.smithi119.stderr: 65800K .......... .......... .......... .......... .......... 70% 75.3M 0s 2024-09-12T17:42:03.399 INFO:teuthology.orchestra.run.smithi119.stderr: 65850K .......... .......... .......... .......... .......... 70% 370M 0s 2024-09-12T17:42:03.399 INFO:teuthology.orchestra.run.smithi119.stderr: 65900K .......... .......... .......... .......... .......... 70% 101M 0s 2024-09-12T17:42:03.399 INFO:teuthology.orchestra.run.smithi119.stderr: 65950K .......... .......... .......... .......... .......... 71% 297M 0s 2024-09-12T17:42:03.399 INFO:teuthology.orchestra.run.smithi119.stderr: 66000K .......... .......... .......... .......... .......... 71% 377M 0s 2024-09-12T17:42:03.399 INFO:teuthology.orchestra.run.smithi119.stderr: 66050K .......... .......... .......... .......... .......... 71% 380M 0s 2024-09-12T17:42:03.399 INFO:teuthology.orchestra.run.smithi119.stderr: 66100K .......... .......... .......... .......... .......... 71% 393M 0s 2024-09-12T17:42:03.399 INFO:teuthology.orchestra.run.smithi119.stderr: 66150K .......... .......... .......... .......... .......... 71% 336M 0s 2024-09-12T17:42:03.399 INFO:teuthology.orchestra.run.smithi119.stderr: 66200K .......... .......... .......... .......... .......... 71% 361M 0s 2024-09-12T17:42:03.400 INFO:teuthology.orchestra.run.smithi119.stderr: 66250K .......... .......... .......... .......... .......... 71% 221M 0s 2024-09-12T17:42:03.400 INFO:teuthology.orchestra.run.smithi119.stderr: 66300K .......... .......... .......... .......... .......... 71% 328M 0s 2024-09-12T17:42:03.400 INFO:teuthology.orchestra.run.smithi119.stderr: 66350K .......... .......... .......... .......... .......... 71% 286M 0s 2024-09-12T17:42:03.400 INFO:teuthology.orchestra.run.smithi119.stderr: 66400K .......... .......... .......... .......... .......... 71% 377M 0s 2024-09-12T17:42:03.400 INFO:teuthology.orchestra.run.smithi119.stderr: 66450K .......... .......... .......... .......... .......... 71% 372M 0s 2024-09-12T17:42:03.400 INFO:teuthology.orchestra.run.smithi119.stderr: 66500K .......... .......... .......... .......... .......... 71% 391M 0s 2024-09-12T17:42:03.400 INFO:teuthology.orchestra.run.smithi119.stderr: 66550K .......... .......... .......... .......... .......... 71% 336M 0s 2024-09-12T17:42:03.400 INFO:teuthology.orchestra.run.smithi119.stderr: 66600K .......... .......... .......... .......... .......... 71% 380M 0s 2024-09-12T17:42:03.400 INFO:teuthology.orchestra.run.smithi119.stderr: 66650K .......... .......... .......... .......... .......... 71% 379M 0s 2024-09-12T17:42:03.400 INFO:teuthology.orchestra.run.smithi119.stderr: 66700K .......... .......... .......... .......... .......... 71% 364M 0s 2024-09-12T17:42:03.400 INFO:teuthology.orchestra.run.smithi119.stderr: 66750K .......... .......... .......... .......... .......... 71% 313M 0s 2024-09-12T17:42:03.400 INFO:teuthology.orchestra.run.smithi119.stderr: 66800K .......... .......... .......... .......... .......... 71% 160M 0s 2024-09-12T17:42:03.400 INFO:teuthology.orchestra.run.smithi119.stderr: 66850K .......... .......... .......... .......... .......... 72% 347M 0s 2024-09-12T17:42:03.400 INFO:teuthology.orchestra.run.smithi119.stderr: 66900K .......... .......... .......... .......... .......... 72% 355M 0s 2024-09-12T17:42:03.401 INFO:teuthology.orchestra.run.smithi119.stderr: 66950K .......... .......... .......... .......... .......... 72% 338M 0s 2024-09-12T17:42:03.401 INFO:teuthology.orchestra.run.smithi119.stderr: 67000K .......... .......... .......... .......... .......... 72% 336M 0s 2024-09-12T17:42:03.401 INFO:teuthology.orchestra.run.smithi119.stderr: 67050K .......... .......... .......... .......... .......... 72% 360M 0s 2024-09-12T17:42:03.401 INFO:teuthology.orchestra.run.smithi119.stderr: 67100K .......... .......... .......... .......... .......... 72% 38.6M 0s 2024-09-12T17:42:03.401 INFO:teuthology.orchestra.run.smithi119.stderr: 67150K .......... .......... .......... .......... .......... 72% 286M 0s 2024-09-12T17:42:03.401 INFO:teuthology.orchestra.run.smithi119.stderr: 67200K .......... .......... .......... .......... .......... 72% 323M 0s 2024-09-12T17:42:03.401 INFO:teuthology.orchestra.run.smithi119.stderr: 67250K .......... .......... .......... .......... .......... 72% 308M 0s 2024-09-12T17:42:03.401 INFO:teuthology.orchestra.run.smithi119.stderr: 67300K .......... .......... .......... .......... .......... 72% 349M 0s 2024-09-12T17:42:03.401 INFO:teuthology.orchestra.run.smithi119.stderr: 67350K .......... .......... .......... .......... .......... 72% 306M 0s 2024-09-12T17:42:03.401 INFO:teuthology.orchestra.run.smithi119.stderr: 67400K .......... .......... .......... .......... .......... 72% 367M 0s 2024-09-12T17:42:03.401 INFO:teuthology.orchestra.run.smithi119.stderr: 67450K .......... .......... .......... .......... .......... 72% 379M 0s 2024-09-12T17:42:03.401 INFO:teuthology.orchestra.run.smithi119.stderr: 67500K .......... .......... .......... .......... .......... 72% 356M 0s 2024-09-12T17:42:03.401 INFO:teuthology.orchestra.run.smithi119.stderr: 67550K .......... .......... .......... .......... .......... 72% 264M 0s 2024-09-12T17:42:03.402 INFO:teuthology.orchestra.run.smithi119.stderr: 67600K .......... .......... .......... .......... .......... 72% 364M 0s 2024-09-12T17:42:03.402 INFO:teuthology.orchestra.run.smithi119.stderr: 67650K .......... .......... .......... .......... .......... 72% 359M 0s 2024-09-12T17:42:03.402 INFO:teuthology.orchestra.run.smithi119.stderr: 67700K .......... .......... .......... .......... .......... 72% 372M 0s 2024-09-12T17:42:03.402 INFO:teuthology.orchestra.run.smithi119.stderr: 67750K .......... .......... .......... .......... .......... 72% 354M 0s 2024-09-12T17:42:03.402 INFO:teuthology.orchestra.run.smithi119.stderr: 67800K .......... .......... .......... .......... .......... 73% 352M 0s 2024-09-12T17:42:03.402 INFO:teuthology.orchestra.run.smithi119.stderr: 67850K .......... .......... .......... .......... .......... 73% 365M 0s 2024-09-12T17:42:03.402 INFO:teuthology.orchestra.run.smithi119.stderr: 67900K .......... .......... .......... .......... .......... 73% 360M 0s 2024-09-12T17:42:03.402 INFO:teuthology.orchestra.run.smithi119.stderr: 67950K .......... .......... .......... .......... .......... 73% 304M 0s 2024-09-12T17:42:03.402 INFO:teuthology.orchestra.run.smithi119.stderr: 68000K .......... .......... .......... .......... .......... 73% 398M 0s 2024-09-12T17:42:03.402 INFO:teuthology.orchestra.run.smithi119.stderr: 68050K .......... .......... .......... .......... .......... 73% 400M 0s 2024-09-12T17:42:03.402 INFO:teuthology.orchestra.run.smithi119.stderr: 68100K .......... .......... .......... .......... .......... 73% 358M 0s 2024-09-12T17:42:03.402 INFO:teuthology.orchestra.run.smithi119.stderr: 68150K .......... .......... .......... .......... .......... 73% 308M 0s 2024-09-12T17:42:03.402 INFO:teuthology.orchestra.run.smithi119.stderr: 68200K .......... .......... .......... .......... .......... 73% 352M 0s 2024-09-12T17:42:03.403 INFO:teuthology.orchestra.run.smithi119.stderr: 68250K .......... .......... .......... .......... .......... 73% 370M 0s 2024-09-12T17:42:03.403 INFO:teuthology.orchestra.run.smithi119.stderr: 68300K .......... .......... .......... .......... .......... 73% 385M 0s 2024-09-12T17:42:03.403 INFO:teuthology.orchestra.run.smithi119.stderr: 68350K .......... .......... .......... .......... .......... 73% 107M 0s 2024-09-12T17:42:03.403 INFO:teuthology.orchestra.run.smithi119.stderr: 68400K .......... .......... .......... .......... .......... 73% 151M 0s 2024-09-12T17:42:03.403 INFO:teuthology.orchestra.run.smithi119.stderr: 68450K .......... .......... .......... .......... .......... 73% 388M 0s 2024-09-12T17:42:03.403 INFO:teuthology.orchestra.run.smithi119.stderr: 68500K .......... .......... .......... .......... .......... 73% 93.7M 0s 2024-09-12T17:42:03.403 INFO:teuthology.orchestra.run.smithi119.stderr: 68550K .......... .......... .......... .......... .......... 73% 97.9M 0s 2024-09-12T17:42:03.403 INFO:teuthology.orchestra.run.smithi119.stderr: 68600K .......... .......... .......... .......... .......... 73% 175M 0s 2024-09-12T17:42:03.403 INFO:teuthology.orchestra.run.smithi119.stderr: 68650K .......... .......... .......... .......... .......... 73% 366M 0s 2024-09-12T17:42:03.403 INFO:teuthology.orchestra.run.smithi119.stderr: 68700K .......... .......... .......... .......... .......... 74% 317M 0s 2024-09-12T17:42:03.403 INFO:teuthology.orchestra.run.smithi119.stderr: 68750K .......... .......... .......... .......... .......... 74% 115M 0s 2024-09-12T17:42:03.403 INFO:teuthology.orchestra.run.smithi119.stderr: 68800K .......... .......... .......... .......... .......... 74% 61.5M 0s 2024-09-12T17:42:03.403 INFO:teuthology.orchestra.run.smithi119.stderr: 68850K .......... .......... .......... .......... .......... 74% 366M 0s 2024-09-12T17:42:03.404 INFO:teuthology.orchestra.run.smithi119.stderr: 68900K .......... .......... .......... .......... .......... 74% 275M 0s 2024-09-12T17:42:03.404 INFO:teuthology.orchestra.run.smithi119.stderr: 68950K .......... .......... .......... .......... .......... 74% 287M 0s 2024-09-12T17:42:03.404 INFO:teuthology.orchestra.run.smithi119.stderr: 69000K .......... .......... .......... .......... .......... 74% 384M 0s 2024-09-12T17:42:03.404 INFO:teuthology.orchestra.run.smithi119.stderr: 69050K .......... .......... .......... .......... .......... 74% 367M 0s 2024-09-12T17:42:03.404 INFO:teuthology.orchestra.run.smithi119.stderr: 69100K .......... .......... .......... .......... .......... 74% 380M 0s 2024-09-12T17:42:03.404 INFO:teuthology.orchestra.run.smithi119.stderr: 69150K .......... .......... .......... .......... .......... 74% 308M 0s 2024-09-12T17:42:03.404 INFO:teuthology.orchestra.run.smithi119.stderr: 69200K .......... .......... .......... .......... .......... 74% 382M 0s 2024-09-12T17:42:03.404 INFO:teuthology.orchestra.run.smithi119.stderr: 69250K .......... .......... .......... .......... .......... 74% 364M 0s 2024-09-12T17:42:03.404 INFO:teuthology.orchestra.run.smithi119.stderr: 69300K .......... .......... .......... .......... .......... 74% 370M 0s 2024-09-12T17:42:03.404 INFO:teuthology.orchestra.run.smithi119.stderr: 69350K .......... .......... .......... .......... .......... 74% 317M 0s 2024-09-12T17:42:03.404 INFO:teuthology.orchestra.run.smithi119.stderr: 69400K .......... .......... .......... .......... .......... 74% 351M 0s 2024-09-12T17:42:03.404 INFO:teuthology.orchestra.run.smithi119.stderr: 69450K .......... .......... .......... .......... .......... 74% 364M 0s 2024-09-12T17:42:03.404 INFO:teuthology.orchestra.run.smithi119.stderr: 69500K .......... .......... .......... .......... .......... 74% 365M 0s 2024-09-12T17:42:03.405 INFO:teuthology.orchestra.run.smithi119.stderr: 69550K .......... .......... .......... .......... .......... 74% 293M 0s 2024-09-12T17:42:03.405 INFO:teuthology.orchestra.run.smithi119.stderr: 69600K .......... .......... .......... .......... .......... 74% 362M 0s 2024-09-12T17:42:03.405 INFO:teuthology.orchestra.run.smithi119.stderr: 69650K .......... .......... .......... .......... .......... 75% 377M 0s 2024-09-12T17:42:03.405 INFO:teuthology.orchestra.run.smithi119.stderr: 69700K .......... .......... .......... .......... .......... 75% 360M 0s 2024-09-12T17:42:03.405 INFO:teuthology.orchestra.run.smithi119.stderr: 69750K .......... .......... .......... .......... .......... 75% 280M 0s 2024-09-12T17:42:03.405 INFO:teuthology.orchestra.run.smithi119.stderr: 69800K .......... .......... .......... .......... .......... 75% 379M 0s 2024-09-12T17:42:03.405 INFO:teuthology.orchestra.run.smithi119.stderr: 69850K .......... .......... .......... .......... .......... 75% 395M 0s 2024-09-12T17:42:03.405 INFO:teuthology.orchestra.run.smithi119.stderr: 69900K .......... .......... .......... .......... .......... 75% 348M 0s 2024-09-12T17:42:03.405 INFO:teuthology.orchestra.run.smithi119.stderr: 69950K .......... .......... .......... .......... .......... 75% 345M 0s 2024-09-12T17:42:03.405 INFO:teuthology.orchestra.run.smithi119.stderr: 70000K .......... .......... .......... .......... .......... 75% 42.4M 0s 2024-09-12T17:42:03.405 INFO:teuthology.orchestra.run.smithi119.stderr: 70050K .......... .......... .......... .......... .......... 75% 371M 0s 2024-09-12T17:42:03.405 INFO:teuthology.orchestra.run.smithi119.stderr: 70100K .......... .......... .......... .......... .......... 75% 405M 0s 2024-09-12T17:42:03.405 INFO:teuthology.orchestra.run.smithi119.stderr: 70150K .......... .......... .......... .......... .......... 75% 337M 0s 2024-09-12T17:42:03.406 INFO:teuthology.orchestra.run.smithi119.stderr: 70200K .......... .......... .......... .......... .......... 75% 304M 0s 2024-09-12T17:42:03.406 INFO:teuthology.orchestra.run.smithi119.stderr: 70250K .......... .......... .......... .......... .......... 75% 88.6M 0s 2024-09-12T17:42:03.406 INFO:teuthology.orchestra.run.smithi119.stderr: 70300K .......... .......... .......... .......... .......... 75% 349M 0s 2024-09-12T17:42:03.406 INFO:teuthology.orchestra.run.smithi119.stderr: 70350K .......... .......... .......... .......... .......... 75% 317M 0s 2024-09-12T17:42:03.406 INFO:teuthology.orchestra.run.smithi119.stderr: 70400K .......... .......... .......... .......... .......... 75% 377M 0s 2024-09-12T17:42:03.406 INFO:teuthology.orchestra.run.smithi119.stderr: 70450K .......... .......... .......... .......... .......... 75% 367M 0s 2024-09-12T17:42:03.406 INFO:teuthology.orchestra.run.smithi119.stderr: 70500K .......... .......... .......... .......... .......... 75% 388M 0s 2024-09-12T17:42:03.406 INFO:teuthology.orchestra.run.smithi119.stderr: 70550K .......... .......... .......... .......... .......... 75% 342M 0s 2024-09-12T17:42:03.406 INFO:teuthology.orchestra.run.smithi119.stderr: 70600K .......... .......... .......... .......... .......... 76% 390M 0s 2024-09-12T17:42:03.406 INFO:teuthology.orchestra.run.smithi119.stderr: 70650K .......... .......... .......... .......... .......... 76% 403M 0s 2024-09-12T17:42:03.406 INFO:teuthology.orchestra.run.smithi119.stderr: 70700K .......... .......... .......... .......... .......... 76% 410M 0s 2024-09-12T17:42:03.406 INFO:teuthology.orchestra.run.smithi119.stderr: 70750K .......... .......... .......... .......... .......... 76% 339M 0s 2024-09-12T17:42:03.406 INFO:teuthology.orchestra.run.smithi119.stderr: 70800K .......... .......... .......... .......... .......... 76% 376M 0s 2024-09-12T17:42:03.407 INFO:teuthology.orchestra.run.smithi119.stderr: 70850K .......... .......... .......... .......... .......... 76% 384M 0s 2024-09-12T17:42:03.407 INFO:teuthology.orchestra.run.smithi119.stderr: 70900K .......... .......... .......... .......... .......... 76% 342M 0s 2024-09-12T17:42:03.407 INFO:teuthology.orchestra.run.smithi119.stderr: 70950K .......... .......... .......... .......... .......... 76% 357M 0s 2024-09-12T17:42:03.407 INFO:teuthology.orchestra.run.smithi119.stderr: 71000K .......... .......... .......... .......... .......... 76% 387M 0s 2024-09-12T17:42:03.407 INFO:teuthology.orchestra.run.smithi119.stderr: 71050K .......... .......... .......... .......... .......... 76% 402M 0s 2024-09-12T17:42:03.407 INFO:teuthology.orchestra.run.smithi119.stderr: 71100K .......... .......... .......... .......... .......... 76% 103M 0s 2024-09-12T17:42:03.407 INFO:teuthology.orchestra.run.smithi119.stderr: 71150K .......... .......... .......... .......... .......... 76% 223M 0s 2024-09-12T17:42:03.407 INFO:teuthology.orchestra.run.smithi119.stderr: 71200K .......... .......... .......... .......... .......... 76% 396M 0s 2024-09-12T17:42:03.407 INFO:teuthology.orchestra.run.smithi119.stderr: 71250K .......... .......... .......... .......... .......... 76% 411M 0s 2024-09-12T17:42:03.407 INFO:teuthology.orchestra.run.smithi119.stderr: 71300K .......... .......... .......... .......... .......... 76% 80.9M 0s 2024-09-12T17:42:03.407 INFO:teuthology.orchestra.run.smithi119.stderr: 71350K .......... .......... .......... .......... .......... 76% 327M 0s 2024-09-12T17:42:03.407 INFO:teuthology.orchestra.run.smithi119.stderr: 71400K .......... .......... .......... .......... .......... 76% 368M 0s 2024-09-12T17:42:03.407 INFO:teuthology.orchestra.run.smithi119.stderr: 71450K .......... .......... .......... .......... .......... 76% 385M 0s 2024-09-12T17:42:03.407 INFO:teuthology.orchestra.run.smithi119.stderr: 71500K .......... .......... .......... .......... .......... 77% 80.2M 0s 2024-09-12T17:42:03.408 INFO:teuthology.orchestra.run.smithi119.stderr: 71550K .......... .......... .......... .......... .......... 77% 166M 0s 2024-09-12T17:42:03.408 INFO:teuthology.orchestra.run.smithi119.stderr: 71600K .......... .......... .......... .......... .......... 77% 141M 0s 2024-09-12T17:42:03.408 INFO:teuthology.orchestra.run.smithi119.stderr: 71650K .......... .......... .......... .......... .......... 77% 224M 0s 2024-09-12T17:42:03.408 INFO:teuthology.orchestra.run.smithi119.stderr: 71700K .......... .......... .......... .......... .......... 77% 374M 0s 2024-09-12T17:42:03.408 INFO:teuthology.orchestra.run.smithi119.stderr: 71750K .......... .......... .......... .......... .......... 77% 120M 0s 2024-09-12T17:42:03.408 INFO:teuthology.orchestra.run.smithi119.stderr: 71800K .......... .......... .......... .......... .......... 77% 146M 0s 2024-09-12T17:42:03.408 INFO:teuthology.orchestra.run.smithi119.stderr: 71850K .......... .......... .......... .......... .......... 77% 363M 0s 2024-09-12T17:42:03.408 INFO:teuthology.orchestra.run.smithi119.stderr: 71900K .......... .......... .......... .......... .......... 77% 242M 0s 2024-09-12T17:42:03.408 INFO:teuthology.orchestra.run.smithi119.stderr: 71950K .......... .......... .......... .......... .......... 77% 404M 0s 2024-09-12T17:42:03.408 INFO:teuthology.orchestra.run.smithi119.stderr: 72000K .......... .......... .......... .......... .......... 77% 158M 0s 2024-09-12T17:42:03.408 INFO:teuthology.orchestra.run.smithi119.stderr: 72050K .......... .......... .......... .......... .......... 77% 354M 0s 2024-09-12T17:42:03.408 INFO:teuthology.orchestra.run.smithi119.stderr: 72100K .......... .......... .......... .......... .......... 77% 328M 0s 2024-09-12T17:42:03.408 INFO:teuthology.orchestra.run.smithi119.stderr: 72150K .......... .......... .......... .......... .......... 77% 322M 0s 2024-09-12T17:42:03.409 INFO:teuthology.orchestra.run.smithi119.stderr: 72200K .......... .......... .......... .......... .......... 77% 342M 0s 2024-09-12T17:42:03.409 INFO:teuthology.orchestra.run.smithi119.stderr: 72250K .......... .......... .......... .......... .......... 77% 380M 0s 2024-09-12T17:42:03.409 INFO:teuthology.orchestra.run.smithi119.stderr: 72300K .......... .......... .......... .......... .......... 77% 306M 0s 2024-09-12T17:42:03.409 INFO:teuthology.orchestra.run.smithi119.stderr: 72350K .......... .......... .......... .......... .......... 77% 382M 0s 2024-09-12T17:42:03.409 INFO:teuthology.orchestra.run.smithi119.stderr: 72400K .......... .......... .......... .......... .......... 77% 369M 0s 2024-09-12T17:42:03.409 INFO:teuthology.orchestra.run.smithi119.stderr: 72450K .......... .......... .......... .......... .......... 78% 394M 0s 2024-09-12T17:42:03.409 INFO:teuthology.orchestra.run.smithi119.stderr: 72500K .......... .......... .......... .......... .......... 78% 358M 0s 2024-09-12T17:42:03.409 INFO:teuthology.orchestra.run.smithi119.stderr: 72550K .......... .......... .......... .......... .......... 78% 399M 0s 2024-09-12T17:42:03.409 INFO:teuthology.orchestra.run.smithi119.stderr: 72600K .......... .......... .......... .......... .......... 78% 416M 0s 2024-09-12T17:42:03.409 INFO:teuthology.orchestra.run.smithi119.stderr: 72650K .......... .......... .......... .......... .......... 78% 341M 0s 2024-09-12T17:42:03.409 INFO:teuthology.orchestra.run.smithi119.stderr: 72700K .......... .......... .......... .......... .......... 78% 385M 0s 2024-09-12T17:42:03.409 INFO:teuthology.orchestra.run.smithi119.stderr: 72750K .......... .......... .......... .......... .......... 78% 321M 0s 2024-09-12T17:42:03.409 INFO:teuthology.orchestra.run.smithi119.stderr: 72800K .......... .......... .......... .......... .......... 78% 373M 0s 2024-09-12T17:42:03.410 INFO:teuthology.orchestra.run.smithi119.stderr: 72850K .......... .......... .......... .......... .......... 78% 339M 0s 2024-09-12T17:42:03.410 INFO:teuthology.orchestra.run.smithi119.stderr: 72900K .......... .......... .......... .......... .......... 78% 389M 0s 2024-09-12T17:42:03.410 INFO:teuthology.orchestra.run.smithi119.stderr: 72950K .......... .......... .......... .......... .......... 78% 54.5M 0s 2024-09-12T17:42:03.410 INFO:teuthology.orchestra.run.smithi119.stderr: 73000K .......... .......... .......... .......... .......... 78% 363M 0s 2024-09-12T17:42:03.410 INFO:teuthology.orchestra.run.smithi119.stderr: 73050K .......... .......... .......... .......... .......... 78% 332M 0s 2024-09-12T17:42:03.410 INFO:teuthology.orchestra.run.smithi119.stderr: 73100K .......... .......... .......... .......... .......... 78% 423M 0s 2024-09-12T17:42:03.410 INFO:teuthology.orchestra.run.smithi119.stderr: 73150K .......... .......... .......... .......... .......... 78% 284M 0s 2024-09-12T17:42:03.410 INFO:teuthology.orchestra.run.smithi119.stderr: 73200K .......... .......... .......... .......... .......... 78% 388M 0s 2024-09-12T17:42:03.410 INFO:teuthology.orchestra.run.smithi119.stderr: 73250K .......... .......... .......... .......... .......... 78% 107M 0s 2024-09-12T17:42:03.410 INFO:teuthology.orchestra.run.smithi119.stderr: 73300K .......... .......... .......... .......... .......... 78% 153M 0s 2024-09-12T17:42:03.410 INFO:teuthology.orchestra.run.smithi119.stderr: 73350K .......... .......... .......... .......... .......... 79% 188M 0s 2024-09-12T17:42:03.410 INFO:teuthology.orchestra.run.smithi119.stderr: 73400K .......... .......... .......... .......... .......... 79% 366M 0s 2024-09-12T17:42:03.410 INFO:teuthology.orchestra.run.smithi119.stderr: 73450K .......... .......... .......... .......... .......... 79% 374M 0s 2024-09-12T17:42:03.410 INFO:teuthology.orchestra.run.smithi119.stderr: 73500K .......... .......... .......... .......... .......... 79% 382M 0s 2024-09-12T17:42:03.411 INFO:teuthology.orchestra.run.smithi119.stderr: 73550K .......... .......... .......... .......... .......... 79% 322M 0s 2024-09-12T17:42:03.411 INFO:teuthology.orchestra.run.smithi119.stderr: 73600K .......... .......... .......... .......... .......... 79% 407M 0s 2024-09-12T17:42:03.411 INFO:teuthology.orchestra.run.smithi119.stderr: 73650K .......... .......... .......... .......... .......... 79% 316M 0s 2024-09-12T17:42:03.411 INFO:teuthology.orchestra.run.smithi119.stderr: 73700K .......... .......... .......... .......... .......... 79% 354M 0s 2024-09-12T17:42:03.411 INFO:teuthology.orchestra.run.smithi119.stderr: 73750K .......... .......... .......... .......... .......... 79% 336M 0s 2024-09-12T17:42:03.411 INFO:teuthology.orchestra.run.smithi119.stderr: 73800K .......... .......... .......... .......... .......... 79% 300M 0s 2024-09-12T17:42:03.411 INFO:teuthology.orchestra.run.smithi119.stderr: 73850K .......... .......... .......... .......... .......... 79% 290M 0s 2024-09-12T17:42:03.411 INFO:teuthology.orchestra.run.smithi119.stderr: 73900K .......... .......... .......... .......... .......... 79% 381M 0s 2024-09-12T17:42:03.411 INFO:teuthology.orchestra.run.smithi119.stderr: 73950K .......... .......... .......... .......... .......... 79% 345M 0s 2024-09-12T17:42:03.411 INFO:teuthology.orchestra.run.smithi119.stderr: 74000K .......... .......... .......... .......... .......... 79% 402M 0s 2024-09-12T17:42:03.411 INFO:teuthology.orchestra.run.smithi119.stderr: 74050K .......... .......... .......... .......... .......... 79% 373M 0s 2024-09-12T17:42:03.411 INFO:teuthology.orchestra.run.smithi119.stderr: 74100K .......... .......... .......... .......... .......... 79% 84.7M 0s 2024-09-12T17:42:03.411 INFO:teuthology.orchestra.run.smithi119.stderr: 74150K .......... .......... .......... .......... .......... 79% 307M 0s 2024-09-12T17:42:03.411 INFO:teuthology.orchestra.run.smithi119.stderr: 74200K .......... .......... .......... .......... .......... 79% 360M 0s 2024-09-12T17:42:03.412 INFO:teuthology.orchestra.run.smithi119.stderr: 74250K .......... .......... .......... .......... .......... 79% 184M 0s 2024-09-12T17:42:03.412 INFO:teuthology.orchestra.run.smithi119.stderr: 74300K .......... .......... .......... .......... .......... 80% 386M 0s 2024-09-12T17:42:03.412 INFO:teuthology.orchestra.run.smithi119.stderr: 74350K .......... .......... .......... .......... .......... 80% 307M 0s 2024-09-12T17:42:03.412 INFO:teuthology.orchestra.run.smithi119.stderr: 74400K .......... .......... .......... .......... .......... 80% 263M 0s 2024-09-12T17:42:03.412 INFO:teuthology.orchestra.run.smithi119.stderr: 74450K .......... .......... .......... .......... .......... 80% 108M 0s 2024-09-12T17:42:03.412 INFO:teuthology.orchestra.run.smithi119.stderr: 74500K .......... .......... .......... .......... .......... 80% 341M 0s 2024-09-12T17:42:03.412 INFO:teuthology.orchestra.run.smithi119.stderr: 74550K .......... .......... .......... .......... .......... 80% 334M 0s 2024-09-12T17:42:03.412 INFO:teuthology.orchestra.run.smithi119.stderr: 74600K .......... .......... .......... .......... .......... 80% 117M 0s 2024-09-12T17:42:03.412 INFO:teuthology.orchestra.run.smithi119.stderr: 74650K .......... .......... .......... .......... .......... 80% 154M 0s 2024-09-12T17:42:03.412 INFO:teuthology.orchestra.run.smithi119.stderr: 74700K .......... .......... .......... .......... .......... 80% 193M 0s 2024-09-12T17:42:03.412 INFO:teuthology.orchestra.run.smithi119.stderr: 74750K .......... .......... .......... .......... .......... 80% 346M 0s 2024-09-12T17:42:03.412 INFO:teuthology.orchestra.run.smithi119.stderr: 74800K .......... .......... .......... .......... .......... 80% 154M 0s 2024-09-12T17:42:03.413 INFO:teuthology.orchestra.run.smithi119.stderr: 74850K .......... .......... .......... .......... .......... 80% 174M 0s 2024-09-12T17:42:03.413 INFO:teuthology.orchestra.run.smithi119.stderr: 74900K .......... .......... .......... .......... .......... 80% 375M 0s 2024-09-12T17:42:03.413 INFO:teuthology.orchestra.run.smithi119.stderr: 74950K .......... .......... .......... .......... .......... 80% 382M 0s 2024-09-12T17:42:03.413 INFO:teuthology.orchestra.run.smithi119.stderr: 75000K .......... .......... .......... .......... .......... 80% 148M 0s 2024-09-12T17:42:03.413 INFO:teuthology.orchestra.run.smithi119.stderr: 75050K .......... .......... .......... .......... .......... 80% 93.9M 0s 2024-09-12T17:42:03.413 INFO:teuthology.orchestra.run.smithi119.stderr: 75100K .......... .......... .......... .......... .......... 80% 398M 0s 2024-09-12T17:42:03.413 INFO:teuthology.orchestra.run.smithi119.stderr: 75150K .......... .......... .......... .......... .......... 80% 393M 0s 2024-09-12T17:42:03.413 INFO:teuthology.orchestra.run.smithi119.stderr: 75200K .......... .......... .......... .......... .......... 81% 351M 0s 2024-09-12T17:42:03.413 INFO:teuthology.orchestra.run.smithi119.stderr: 75250K .......... .......... .......... .......... .......... 81% 346M 0s 2024-09-12T17:42:03.413 INFO:teuthology.orchestra.run.smithi119.stderr: 75300K .......... .......... .......... .......... .......... 81% 339M 0s 2024-09-12T17:42:03.413 INFO:teuthology.orchestra.run.smithi119.stderr: 75350K .......... .......... .......... .......... .......... 81% 406M 0s 2024-09-12T17:42:03.413 INFO:teuthology.orchestra.run.smithi119.stderr: 75400K .......... .......... .......... .......... .......... 81% 412M 0s 2024-09-12T17:42:03.413 INFO:teuthology.orchestra.run.smithi119.stderr: 75450K .......... .......... .......... .......... .......... 81% 404M 0s 2024-09-12T17:42:03.413 INFO:teuthology.orchestra.run.smithi119.stderr: 75500K .......... .......... .......... .......... .......... 81% 349M 0s 2024-09-12T17:42:03.414 INFO:teuthology.orchestra.run.smithi119.stderr: 75550K .......... .......... .......... .......... .......... 81% 385M 0s 2024-09-12T17:42:03.414 INFO:teuthology.orchestra.run.smithi119.stderr: 75600K .......... .......... .......... .......... .......... 81% 329M 0s 2024-09-12T17:42:03.414 INFO:teuthology.orchestra.run.smithi119.stderr: 75650K .......... .......... .......... .......... .......... 81% 388M 0s 2024-09-12T17:42:03.414 INFO:teuthology.orchestra.run.smithi119.stderr: 75700K .......... .......... .......... .......... .......... 81% 311M 0s 2024-09-12T17:42:03.414 INFO:teuthology.orchestra.run.smithi119.stderr: 75750K .......... .......... .......... .......... .......... 81% 379M 0s 2024-09-12T17:42:03.414 INFO:teuthology.orchestra.run.smithi119.stderr: 75800K .......... .......... .......... .......... .......... 81% 396M 0s 2024-09-12T17:42:03.414 INFO:teuthology.orchestra.run.smithi119.stderr: 75850K .......... .......... .......... .......... .......... 81% 60.2M 0s 2024-09-12T17:42:03.414 INFO:teuthology.orchestra.run.smithi119.stderr: 75900K .......... .......... .......... .......... .......... 81% 263M 0s 2024-09-12T17:42:03.414 INFO:teuthology.orchestra.run.smithi119.stderr: 75950K .......... .......... .......... .......... .......... 81% 347M 0s 2024-09-12T17:42:03.414 INFO:teuthology.orchestra.run.smithi119.stderr: 76000K .......... .......... .......... .......... .......... 81% 327M 0s 2024-09-12T17:42:03.414 INFO:teuthology.orchestra.run.smithi119.stderr: 76050K .......... .......... .......... .......... .......... 81% 311M 0s 2024-09-12T17:42:03.414 INFO:teuthology.orchestra.run.smithi119.stderr: 76100K .......... .......... .......... .......... .......... 81% 398M 0s 2024-09-12T17:42:03.414 INFO:teuthology.orchestra.run.smithi119.stderr: 76150K .......... .......... .......... .......... .......... 82% 397M 0s 2024-09-12T17:42:03.414 INFO:teuthology.orchestra.run.smithi119.stderr: 76200K .......... .......... .......... .......... .......... 82% 338M 0s 2024-09-12T17:42:03.415 INFO:teuthology.orchestra.run.smithi119.stderr: 76250K .......... .......... .......... .......... .......... 82% 403M 0s 2024-09-12T17:42:03.415 INFO:teuthology.orchestra.run.smithi119.stderr: 76300K .......... .......... .......... .......... .......... 82% 176M 0s 2024-09-12T17:42:03.415 INFO:teuthology.orchestra.run.smithi119.stderr: 76350K .......... .......... .......... .......... .......... 82% 380M 0s 2024-09-12T17:42:03.415 INFO:teuthology.orchestra.run.smithi119.stderr: 76400K .......... .......... .......... .......... .......... 82% 161M 0s 2024-09-12T17:42:03.415 INFO:teuthology.orchestra.run.smithi119.stderr: 76450K .......... .......... .......... .......... .......... 82% 197M 0s 2024-09-12T17:42:03.415 INFO:teuthology.orchestra.run.smithi119.stderr: 76500K .......... .......... .......... .......... .......... 82% 375M 0s 2024-09-12T17:42:03.415 INFO:teuthology.orchestra.run.smithi119.stderr: 76550K .......... .......... .......... .......... .......... 82% 220M 0s 2024-09-12T17:42:03.415 INFO:teuthology.orchestra.run.smithi119.stderr: 76600K .......... .......... .......... .......... .......... 82% 239M 0s 2024-09-12T17:42:03.415 INFO:teuthology.orchestra.run.smithi119.stderr: 76650K .......... .......... .......... .......... .......... 82% 443M 0s 2024-09-12T17:42:03.415 INFO:teuthology.orchestra.run.smithi119.stderr: 76700K .......... .......... .......... .......... .......... 82% 277M 0s 2024-09-12T17:42:03.415 INFO:teuthology.orchestra.run.smithi119.stderr: 76750K .......... .......... .......... .......... .......... 82% 308M 0s 2024-09-12T17:42:03.415 INFO:teuthology.orchestra.run.smithi119.stderr: 76800K .......... .......... .......... .......... .......... 82% 260M 0s 2024-09-12T17:42:03.415 INFO:teuthology.orchestra.run.smithi119.stderr: 76850K .......... .......... .......... .......... .......... 82% 294M 0s 2024-09-12T17:42:03.415 INFO:teuthology.orchestra.run.smithi119.stderr: 76900K .......... .......... .......... .......... .......... 82% 103M 0s 2024-09-12T17:42:03.416 INFO:teuthology.orchestra.run.smithi119.stderr: 76950K .......... .......... .......... .......... .......... 82% 310M 0s 2024-09-12T17:42:03.416 INFO:teuthology.orchestra.run.smithi119.stderr: 77000K .......... .......... .......... .......... .......... 82% 136M 0s 2024-09-12T17:42:03.416 INFO:teuthology.orchestra.run.smithi119.stderr: 77050K .......... .......... .......... .......... .......... 82% 359M 0s 2024-09-12T17:42:03.416 INFO:teuthology.orchestra.run.smithi119.stderr: 77100K .......... .......... .......... .......... .......... 83% 330M 0s 2024-09-12T17:42:03.416 INFO:teuthology.orchestra.run.smithi119.stderr: 77150K .......... .......... .......... .......... .......... 83% 403M 0s 2024-09-12T17:42:03.416 INFO:teuthology.orchestra.run.smithi119.stderr: 77200K .......... .......... .......... .......... .......... 83% 369M 0s 2024-09-12T17:42:03.416 INFO:teuthology.orchestra.run.smithi119.stderr: 77250K .......... .......... .......... .......... .......... 83% 379M 0s 2024-09-12T17:42:03.416 INFO:teuthology.orchestra.run.smithi119.stderr: 77300K .......... .......... .......... .......... .......... 83% 411M 0s 2024-09-12T17:42:03.416 INFO:teuthology.orchestra.run.smithi119.stderr: 77350K .......... .......... .......... .......... .......... 83% 109M 0s 2024-09-12T17:42:03.416 INFO:teuthology.orchestra.run.smithi119.stderr: 77400K .......... .......... .......... .......... .......... 83% 366M 0s 2024-09-12T17:42:03.416 INFO:teuthology.orchestra.run.smithi119.stderr: 77450K .......... .......... .......... .......... .......... 83% 295M 0s 2024-09-12T17:42:03.416 INFO:teuthology.orchestra.run.smithi119.stderr: 77500K .......... .......... .......... .......... .......... 83% 367M 0s 2024-09-12T17:42:03.416 INFO:teuthology.orchestra.run.smithi119.stderr: 77550K .......... .......... .......... .......... .......... 83% 357M 0s 2024-09-12T17:42:03.416 INFO:teuthology.orchestra.run.smithi119.stderr: 77600K .......... .......... .......... .......... .......... 83% 377M 0s 2024-09-12T17:42:03.417 INFO:teuthology.orchestra.run.smithi119.stderr: 77650K .......... .......... .......... .......... .......... 83% 181M 0s 2024-09-12T17:42:03.417 INFO:teuthology.orchestra.run.smithi119.stderr: 77700K .......... .......... .......... .......... .......... 83% 187M 0s 2024-09-12T17:42:03.417 INFO:teuthology.orchestra.run.smithi119.stderr: 77750K .......... .......... .......... .......... .......... 83% 200M 0s 2024-09-12T17:42:03.417 INFO:teuthology.orchestra.run.smithi119.stderr: 77800K .......... .......... .......... .......... .......... 83% 354M 0s 2024-09-12T17:42:03.417 INFO:teuthology.orchestra.run.smithi119.stderr: 77850K .......... .......... .......... .......... .......... 83% 96.9M 0s 2024-09-12T17:42:03.417 INFO:teuthology.orchestra.run.smithi119.stderr: 77900K .......... .......... .......... .......... .......... 83% 338M 0s 2024-09-12T17:42:03.417 INFO:teuthology.orchestra.run.smithi119.stderr: 77950K .......... .......... .......... .......... .......... 83% 139M 0s 2024-09-12T17:42:03.417 INFO:teuthology.orchestra.run.smithi119.stderr: 78000K .......... .......... .......... .......... .......... 84% 329M 0s 2024-09-12T17:42:03.417 INFO:teuthology.orchestra.run.smithi119.stderr: 78050K .......... .......... .......... .......... .......... 84% 88.1M 0s 2024-09-12T17:42:03.417 INFO:teuthology.orchestra.run.smithi119.stderr: 78100K .......... .......... .......... .......... .......... 84% 379M 0s 2024-09-12T17:42:03.417 INFO:teuthology.orchestra.run.smithi119.stderr: 78150K .......... .......... .......... .......... .......... 84% 289M 0s 2024-09-12T17:42:03.417 INFO:teuthology.orchestra.run.smithi119.stderr: 78200K .......... .......... .......... .......... .......... 84% 211M 0s 2024-09-12T17:42:03.417 INFO:teuthology.orchestra.run.smithi119.stderr: 78250K .......... .......... .......... .......... .......... 84% 348M 0s 2024-09-12T17:42:03.418 INFO:teuthology.orchestra.run.smithi119.stderr: 78300K .......... .......... .......... .......... .......... 84% 352M 0s 2024-09-12T17:42:03.418 INFO:teuthology.orchestra.run.smithi119.stderr: 78350K .......... .......... .......... .......... .......... 84% 330M 0s 2024-09-12T17:42:03.418 INFO:teuthology.orchestra.run.smithi119.stderr: 78400K .......... .......... .......... .......... .......... 84% 351M 0s 2024-09-12T17:42:03.418 INFO:teuthology.orchestra.run.smithi119.stderr: 78450K .......... .......... .......... .......... .......... 84% 392M 0s 2024-09-12T17:42:03.418 INFO:teuthology.orchestra.run.smithi119.stderr: 78500K .......... .......... .......... .......... .......... 84% 389M 0s 2024-09-12T17:42:03.418 INFO:teuthology.orchestra.run.smithi119.stderr: 78550K .......... .......... .......... .......... .......... 84% 360M 0s 2024-09-12T17:42:03.418 INFO:teuthology.orchestra.run.smithi119.stderr: 78600K .......... .......... .......... .......... .......... 84% 280M 0s 2024-09-12T17:42:03.418 INFO:teuthology.orchestra.run.smithi119.stderr: 78650K .......... .......... .......... .......... .......... 84% 344M 0s 2024-09-12T17:42:03.418 INFO:teuthology.orchestra.run.smithi119.stderr: 78700K .......... .......... .......... .......... .......... 84% 403M 0s 2024-09-12T17:42:03.418 INFO:teuthology.orchestra.run.smithi119.stderr: 78750K .......... .......... .......... .......... .......... 84% 395M 0s 2024-09-12T17:42:03.418 INFO:teuthology.orchestra.run.smithi119.stderr: 78800K .......... .......... .......... .......... .......... 84% 81.0M 0s 2024-09-12T17:42:03.418 INFO:teuthology.orchestra.run.smithi119.stderr: 78850K .......... .......... .......... .......... .......... 84% 188M 0s 2024-09-12T17:42:03.418 INFO:teuthology.orchestra.run.smithi119.stderr: 78900K .......... .......... .......... .......... .......... 84% 312M 0s 2024-09-12T17:42:03.418 INFO:teuthology.orchestra.run.smithi119.stderr: 78950K .......... .......... .......... .......... .......... 85% 359M 0s 2024-09-12T17:42:03.419 INFO:teuthology.orchestra.run.smithi119.stderr: 79000K .......... .......... .......... .......... .......... 85% 303M 0s 2024-09-12T17:42:03.419 INFO:teuthology.orchestra.run.smithi119.stderr: 79050K .......... .......... .......... .......... .......... 85% 373M 0s 2024-09-12T17:42:03.419 INFO:teuthology.orchestra.run.smithi119.stderr: 79100K .......... .......... .......... .......... .......... 85% 342M 0s 2024-09-12T17:42:03.419 INFO:teuthology.orchestra.run.smithi119.stderr: 79150K .......... .......... .......... .......... .......... 85% 376M 0s 2024-09-12T17:42:03.419 INFO:teuthology.orchestra.run.smithi119.stderr: 79200K .......... .......... .......... .......... .......... 85% 405M 0s 2024-09-12T17:42:03.419 INFO:teuthology.orchestra.run.smithi119.stderr: 79250K .......... .......... .......... .......... .......... 85% 237M 0s 2024-09-12T17:42:03.419 INFO:teuthology.orchestra.run.smithi119.stderr: 79300K .......... .......... .......... .......... .......... 85% 320M 0s 2024-09-12T17:42:03.419 INFO:teuthology.orchestra.run.smithi119.stderr: 79350K .......... .......... .......... .......... .......... 85% 248M 0s 2024-09-12T17:42:03.419 INFO:teuthology.orchestra.run.smithi119.stderr: 79400K .......... .......... .......... .......... .......... 85% 349M 0s 2024-09-12T17:42:03.419 INFO:teuthology.orchestra.run.smithi119.stderr: 79450K .......... .......... .......... .......... .......... 85% 368M 0s 2024-09-12T17:42:03.419 INFO:teuthology.orchestra.run.smithi119.stderr: 79500K .......... .......... .......... .......... .......... 85% 78.9M 0s 2024-09-12T17:42:03.419 INFO:teuthology.orchestra.run.smithi119.stderr: 79550K .......... .......... .......... .......... .......... 85% 345M 0s 2024-09-12T17:42:03.419 INFO:teuthology.orchestra.run.smithi119.stderr: 79600K .......... .......... .......... .......... .......... 85% 377M 0s 2024-09-12T17:42:03.420 INFO:teuthology.orchestra.run.smithi119.stderr: 79650K .......... .......... .......... .......... .......... 85% 336M 0s 2024-09-12T17:42:03.420 INFO:teuthology.orchestra.run.smithi119.stderr: 79700K .......... .......... .......... .......... .......... 85% 386M 0s 2024-09-12T17:42:03.420 INFO:teuthology.orchestra.run.smithi119.stderr: 79750K .......... .......... .......... .......... .......... 85% 309M 0s 2024-09-12T17:42:03.420 INFO:teuthology.orchestra.run.smithi119.stderr: 79800K .......... .......... .......... .......... .......... 85% 399M 0s 2024-09-12T17:42:03.420 INFO:teuthology.orchestra.run.smithi119.stderr: 79850K .......... .......... .......... .......... .......... 86% 203M 0s 2024-09-12T17:42:03.420 INFO:teuthology.orchestra.run.smithi119.stderr: 79900K .......... .......... .......... .......... .......... 86% 300M 0s 2024-09-12T17:42:03.420 INFO:teuthology.orchestra.run.smithi119.stderr: 79950K .......... .......... .......... .......... .......... 86% 187M 0s 2024-09-12T17:42:03.420 INFO:teuthology.orchestra.run.smithi119.stderr: 80000K .......... .......... .......... .......... .......... 86% 348M 0s 2024-09-12T17:42:03.420 INFO:teuthology.orchestra.run.smithi119.stderr: 80050K .......... .......... .......... .......... .......... 86% 105M 0s 2024-09-12T17:42:03.420 INFO:teuthology.orchestra.run.smithi119.stderr: 80100K .......... .......... .......... .......... .......... 86% 298M 0s 2024-09-12T17:42:03.420 INFO:teuthology.orchestra.run.smithi119.stderr: 80150K .......... .......... .......... .......... .......... 86% 317M 0s 2024-09-12T17:42:03.420 INFO:teuthology.orchestra.run.smithi119.stderr: 80200K .......... .......... .......... .......... .......... 86% 133M 0s 2024-09-12T17:42:03.420 INFO:teuthology.orchestra.run.smithi119.stderr: 80250K .......... .......... .......... .......... .......... 86% 148M 0s 2024-09-12T17:42:03.421 INFO:teuthology.orchestra.run.smithi119.stderr: 80300K .......... .......... .......... .......... .......... 86% 299M 0s 2024-09-12T17:42:03.421 INFO:teuthology.orchestra.run.smithi119.stderr: 80350K .......... .......... .......... .......... .......... 86% 389M 0s 2024-09-12T17:42:03.421 INFO:teuthology.orchestra.run.smithi119.stderr: 80400K .......... .......... .......... .......... .......... 86% 106M 0s 2024-09-12T17:42:03.421 INFO:teuthology.orchestra.run.smithi119.stderr: 80450K .......... .......... .......... .......... .......... 86% 308M 0s 2024-09-12T17:42:03.421 INFO:teuthology.orchestra.run.smithi119.stderr: 80500K .......... .......... .......... .......... .......... 86% 374M 0s 2024-09-12T17:42:03.421 INFO:teuthology.orchestra.run.smithi119.stderr: 80550K .......... .......... .......... .......... .......... 86% 330M 0s 2024-09-12T17:42:03.421 INFO:teuthology.orchestra.run.smithi119.stderr: 80600K .......... .......... .......... .......... .......... 86% 357M 0s 2024-09-12T17:42:03.421 INFO:teuthology.orchestra.run.smithi119.stderr: 80650K .......... .......... .......... .......... .......... 86% 374M 0s 2024-09-12T17:42:03.421 INFO:teuthology.orchestra.run.smithi119.stderr: 80700K .......... .......... .......... .......... .......... 86% 401M 0s 2024-09-12T17:42:03.421 INFO:teuthology.orchestra.run.smithi119.stderr: 80750K .......... .......... .......... .......... .......... 86% 322M 0s 2024-09-12T17:42:03.421 INFO:teuthology.orchestra.run.smithi119.stderr: 80800K .......... .......... .......... .......... .......... 87% 373M 0s 2024-09-12T17:42:03.421 INFO:teuthology.orchestra.run.smithi119.stderr: 80850K .......... .......... .......... .......... .......... 87% 336M 0s 2024-09-12T17:42:03.421 INFO:teuthology.orchestra.run.smithi119.stderr: 80900K .......... .......... .......... .......... .......... 87% 192M 0s 2024-09-12T17:42:03.422 INFO:teuthology.orchestra.run.smithi119.stderr: 80950K .......... .......... .......... .......... .......... 87% 350M 0s 2024-09-12T17:42:03.422 INFO:teuthology.orchestra.run.smithi119.stderr: 81000K .......... .......... .......... .......... .......... 87% 61.5M 0s 2024-09-12T17:42:03.422 INFO:teuthology.orchestra.run.smithi119.stderr: 81050K .......... .......... .......... .......... .......... 87% 282M 0s 2024-09-12T17:42:03.422 INFO:teuthology.orchestra.run.smithi119.stderr: 81100K .......... .......... .......... .......... .......... 87% 383M 0s 2024-09-12T17:42:03.422 INFO:teuthology.orchestra.run.smithi119.stderr: 81150K .......... .......... .......... .......... .......... 87% 189M 0s 2024-09-12T17:42:03.422 INFO:teuthology.orchestra.run.smithi119.stderr: 81200K .......... .......... .......... .......... .......... 87% 341M 0s 2024-09-12T17:42:03.422 INFO:teuthology.orchestra.run.smithi119.stderr: 81250K .......... .......... .......... .......... .......... 87% 160M 0s 2024-09-12T17:42:03.422 INFO:teuthology.orchestra.run.smithi119.stderr: 81300K .......... .......... .......... .......... .......... 87% 286M 0s 2024-09-12T17:42:03.422 INFO:teuthology.orchestra.run.smithi119.stderr: 81350K .......... .......... .......... .......... .......... 87% 379M 0s 2024-09-12T17:42:03.422 INFO:teuthology.orchestra.run.smithi119.stderr: 81400K .......... .......... .......... .......... .......... 87% 308M 0s 2024-09-12T17:42:03.422 INFO:teuthology.orchestra.run.smithi119.stderr: 81450K .......... .......... .......... .......... .......... 87% 405M 0s 2024-09-12T17:42:03.422 INFO:teuthology.orchestra.run.smithi119.stderr: 81500K .......... .......... .......... .......... .......... 87% 113M 0s 2024-09-12T17:42:03.422 INFO:teuthology.orchestra.run.smithi119.stderr: 81550K .......... .......... .......... .......... .......... 87% 295M 0s 2024-09-12T17:42:03.423 INFO:teuthology.orchestra.run.smithi119.stderr: 81600K .......... .......... .......... .......... .......... 87% 339M 0s 2024-09-12T17:42:03.423 INFO:teuthology.orchestra.run.smithi119.stderr: 81650K .......... .......... .......... .......... .......... 87% 362M 0s 2024-09-12T17:42:03.423 INFO:teuthology.orchestra.run.smithi119.stderr: 81700K .......... .......... .......... .......... .......... 87% 136M 0s 2024-09-12T17:42:03.423 INFO:teuthology.orchestra.run.smithi119.stderr: 81750K .......... .......... .......... .......... .......... 88% 355M 0s 2024-09-12T17:42:03.423 INFO:teuthology.orchestra.run.smithi119.stderr: 81800K .......... .......... .......... .......... .......... 88% 385M 0s 2024-09-12T17:42:03.423 INFO:teuthology.orchestra.run.smithi119.stderr: 81850K .......... .......... .......... .......... .......... 88% 371M 0s 2024-09-12T17:42:03.423 INFO:teuthology.orchestra.run.smithi119.stderr: 81900K .......... .......... .......... .......... .......... 88% 248M 0s 2024-09-12T17:42:03.423 INFO:teuthology.orchestra.run.smithi119.stderr: 81950K .......... .......... .......... .......... .......... 88% 110M 0s 2024-09-12T17:42:03.423 INFO:teuthology.orchestra.run.smithi119.stderr: 82000K .......... .......... .......... .......... .......... 88% 285M 0s 2024-09-12T17:42:03.423 INFO:teuthology.orchestra.run.smithi119.stderr: 82050K .......... .......... .......... .......... .......... 88% 346M 0s 2024-09-12T17:42:03.423 INFO:teuthology.orchestra.run.smithi119.stderr: 82100K .......... .......... .......... .......... .......... 88% 372M 0s 2024-09-12T17:42:03.423 INFO:teuthology.orchestra.run.smithi119.stderr: 82150K .......... .......... .......... .......... .......... 88% 332M 0s 2024-09-12T17:42:03.423 INFO:teuthology.orchestra.run.smithi119.stderr: 82200K .......... .......... .......... .......... .......... 88% 363M 0s 2024-09-12T17:42:03.424 INFO:teuthology.orchestra.run.smithi119.stderr: 82250K .......... .......... .......... .......... .......... 88% 390M 0s 2024-09-12T17:42:03.424 INFO:teuthology.orchestra.run.smithi119.stderr: 82300K .......... .......... .......... .......... .......... 88% 272M 0s 2024-09-12T17:42:03.424 INFO:teuthology.orchestra.run.smithi119.stderr: 82350K .......... .......... .......... .......... .......... 88% 288M 0s 2024-09-12T17:42:03.424 INFO:teuthology.orchestra.run.smithi119.stderr: 82400K .......... .......... .......... .......... .......... 88% 248M 0s 2024-09-12T17:42:03.424 INFO:teuthology.orchestra.run.smithi119.stderr: 82450K .......... .......... .......... .......... .......... 88% 182M 0s 2024-09-12T17:42:03.424 INFO:teuthology.orchestra.run.smithi119.stderr: 82500K .......... .......... .......... .......... .......... 88% 249M 0s 2024-09-12T17:42:03.424 INFO:teuthology.orchestra.run.smithi119.stderr: 82550K .......... .......... .......... .......... .......... 88% 297M 0s 2024-09-12T17:42:03.424 INFO:teuthology.orchestra.run.smithi119.stderr: 82600K .......... .......... .......... .......... .......... 88% 116M 0s 2024-09-12T17:42:03.424 INFO:teuthology.orchestra.run.smithi119.stderr: 82650K .......... .......... .......... .......... .......... 89% 339M 0s 2024-09-12T17:42:03.424 INFO:teuthology.orchestra.run.smithi119.stderr: 82700K .......... .......... .......... .......... .......... 89% 369M 0s 2024-09-12T17:42:03.424 INFO:teuthology.orchestra.run.smithi119.stderr: 82750K .......... .......... .......... .......... .......... 89% 342M 0s 2024-09-12T17:42:03.424 INFO:teuthology.orchestra.run.smithi119.stderr: 82800K .......... .......... .......... .......... .......... 89% 285M 0s 2024-09-12T17:42:03.424 INFO:teuthology.orchestra.run.smithi119.stderr: 82850K .......... .......... .......... .......... .......... 89% 358M 0s 2024-09-12T17:42:03.425 INFO:teuthology.orchestra.run.smithi119.stderr: 82900K .......... .......... .......... .......... .......... 89% 381M 0s 2024-09-12T17:42:03.425 INFO:teuthology.orchestra.run.smithi119.stderr: 82950K .......... .......... .......... .......... .......... 89% 333M 0s 2024-09-12T17:42:03.425 INFO:teuthology.orchestra.run.smithi119.stderr: 83000K .......... .......... .......... .......... .......... 89% 216M 0s 2024-09-12T17:42:03.425 INFO:teuthology.orchestra.run.smithi119.stderr: 83050K .......... .......... .......... .......... .......... 89% 158M 0s 2024-09-12T17:42:03.425 INFO:teuthology.orchestra.run.smithi119.stderr: 83100K .......... .......... .......... .......... .......... 89% 115M 0s 2024-09-12T17:42:03.425 INFO:teuthology.orchestra.run.smithi119.stderr: 83150K .......... .......... .......... .......... .......... 89% 156M 0s 2024-09-12T17:42:03.425 INFO:teuthology.orchestra.run.smithi119.stderr: 83200K .......... .......... .......... .......... .......... 89% 340M 0s 2024-09-12T17:42:03.425 INFO:teuthology.orchestra.run.smithi119.stderr: 83250K .......... .......... .......... .......... .......... 89% 272M 0s 2024-09-12T17:42:03.425 INFO:teuthology.orchestra.run.smithi119.stderr: 83300K .......... .......... .......... .......... .......... 89% 117M 0s 2024-09-12T17:42:03.425 INFO:teuthology.orchestra.run.smithi119.stderr: 83350K .......... .......... .......... .......... .......... 89% 316M 0s 2024-09-12T17:42:03.425 INFO:teuthology.orchestra.run.smithi119.stderr: 83400K .......... .......... .......... .......... .......... 89% 357M 0s 2024-09-12T17:42:03.425 INFO:teuthology.orchestra.run.smithi119.stderr: 83450K .......... .......... .......... .......... .......... 89% 153M 0s 2024-09-12T17:42:03.425 INFO:teuthology.orchestra.run.smithi119.stderr: 83500K .......... .......... .......... .......... .......... 89% 373M 0s 2024-09-12T17:42:03.426 INFO:teuthology.orchestra.run.smithi119.stderr: 83550K .......... .......... .......... .......... .......... 89% 320M 0s 2024-09-12T17:42:03.426 INFO:teuthology.orchestra.run.smithi119.stderr: 83600K .......... .......... .......... .......... .......... 90% 374M 0s 2024-09-12T17:42:03.426 INFO:teuthology.orchestra.run.smithi119.stderr: 83650K .......... .......... .......... .......... .......... 90% 344M 0s 2024-09-12T17:42:03.426 INFO:teuthology.orchestra.run.smithi119.stderr: 83700K .......... .......... .......... .......... .......... 90% 357M 0s 2024-09-12T17:42:03.426 INFO:teuthology.orchestra.run.smithi119.stderr: 83750K .......... .......... .......... .......... .......... 90% 325M 0s 2024-09-12T17:42:03.426 INFO:teuthology.orchestra.run.smithi119.stderr: 83800K .......... .......... .......... .......... .......... 90% 357M 0s 2024-09-12T17:42:03.426 INFO:teuthology.orchestra.run.smithi119.stderr: 83850K .......... .......... .......... .......... .......... 90% 371M 0s 2024-09-12T17:42:03.426 INFO:teuthology.orchestra.run.smithi119.stderr: 83900K .......... .......... .......... .......... .......... 90% 369M 0s 2024-09-12T17:42:03.426 INFO:teuthology.orchestra.run.smithi119.stderr: 83950K .......... .......... .......... .......... .......... 90% 304M 0s 2024-09-12T17:42:03.426 INFO:teuthology.orchestra.run.smithi119.stderr: 84000K .......... .......... .......... .......... .......... 90% 370M 0s 2024-09-12T17:42:03.426 INFO:teuthology.orchestra.run.smithi119.stderr: 84050K .......... .......... .......... .......... .......... 90% 118M 0s 2024-09-12T17:42:03.426 INFO:teuthology.orchestra.run.smithi119.stderr: 84100K .......... .......... .......... .......... .......... 90% 390M 0s 2024-09-12T17:42:03.426 INFO:teuthology.orchestra.run.smithi119.stderr: 84150K .......... .......... .......... .......... .......... 90% 278M 0s 2024-09-12T17:42:03.427 INFO:teuthology.orchestra.run.smithi119.stderr: 84200K .......... .......... .......... .......... .......... 90% 178M 0s 2024-09-12T17:42:03.427 INFO:teuthology.orchestra.run.smithi119.stderr: 84250K .......... .......... .......... .......... .......... 90% 141M 0s 2024-09-12T17:42:03.427 INFO:teuthology.orchestra.run.smithi119.stderr: 84300K .......... .......... .......... .......... .......... 90% 290M 0s 2024-09-12T17:42:03.427 INFO:teuthology.orchestra.run.smithi119.stderr: 84350K .......... .......... .......... .......... .......... 90% 182M 0s 2024-09-12T17:42:03.427 INFO:teuthology.orchestra.run.smithi119.stderr: 84400K .......... .......... .......... .......... .......... 90% 376M 0s 2024-09-12T17:42:03.427 INFO:teuthology.orchestra.run.smithi119.stderr: 84450K .......... .......... .......... .......... .......... 90% 91.3M 0s 2024-09-12T17:42:03.427 INFO:teuthology.orchestra.run.smithi119.stderr: 84500K .......... .......... .......... .......... .......... 91% 376M 0s 2024-09-12T17:42:03.427 INFO:teuthology.orchestra.run.smithi119.stderr: 84550K .......... .......... .......... .......... .......... 91% 338M 0s 2024-09-12T17:42:03.427 INFO:teuthology.orchestra.run.smithi119.stderr: 84600K .......... .......... .......... .......... .......... 91% 391M 0s 2024-09-12T17:42:03.427 INFO:teuthology.orchestra.run.smithi119.stderr: 84650K .......... .......... .......... .......... .......... 91% 141M 0s 2024-09-12T17:42:03.427 INFO:teuthology.orchestra.run.smithi119.stderr: 84700K .......... .......... .......... .......... .......... 91% 350M 0s 2024-09-12T17:42:03.427 INFO:teuthology.orchestra.run.smithi119.stderr: 84750K .......... .......... .......... .......... .......... 91% 260M 0s 2024-09-12T17:42:03.427 INFO:teuthology.orchestra.run.smithi119.stderr: 84800K .......... .......... .......... .......... .......... 91% 365M 0s 2024-09-12T17:42:03.427 INFO:teuthology.orchestra.run.smithi119.stderr: 84850K .......... .......... .......... .......... .......... 91% 103M 0s 2024-09-12T17:42:03.428 INFO:teuthology.orchestra.run.smithi119.stderr: 84900K .......... .......... .......... .......... .......... 91% 363M 0s 2024-09-12T17:42:03.428 INFO:teuthology.orchestra.run.smithi119.stderr: 84950K .......... .......... .......... .......... .......... 91% 292M 0s 2024-09-12T17:42:03.428 INFO:teuthology.orchestra.run.smithi119.stderr: 85000K .......... .......... .......... .......... .......... 91% 136M 0s 2024-09-12T17:42:03.428 INFO:teuthology.orchestra.run.smithi119.stderr: 85050K .......... .......... .......... .......... .......... 91% 373M 0s 2024-09-12T17:42:03.428 INFO:teuthology.orchestra.run.smithi119.stderr: 85100K .......... .......... .......... .......... .......... 91% 85.9M 0s 2024-09-12T17:42:03.428 INFO:teuthology.orchestra.run.smithi119.stderr: 85150K .......... .......... .......... .......... .......... 91% 272M 0s 2024-09-12T17:42:03.428 INFO:teuthology.orchestra.run.smithi119.stderr: 85200K .......... .......... .......... .......... .......... 91% 348M 0s 2024-09-12T17:42:03.428 INFO:teuthology.orchestra.run.smithi119.stderr: 85250K .......... .......... .......... .......... .......... 91% 352M 0s 2024-09-12T17:42:03.428 INFO:teuthology.orchestra.run.smithi119.stderr: 85300K .......... .......... .......... .......... .......... 91% 384M 0s 2024-09-12T17:42:03.428 INFO:teuthology.orchestra.run.smithi119.stderr: 85350K .......... .......... .......... .......... .......... 91% 362M 0s 2024-09-12T17:42:03.428 INFO:teuthology.orchestra.run.smithi119.stderr: 85400K .......... .......... .......... .......... .......... 91% 402M 0s 2024-09-12T17:42:03.428 INFO:teuthology.orchestra.run.smithi119.stderr: 85450K .......... .......... .......... .......... .......... 92% 93.9M 0s 2024-09-12T17:42:03.428 INFO:teuthology.orchestra.run.smithi119.stderr: 85500K .......... .......... .......... .......... .......... 92% 352M 0s 2024-09-12T17:42:03.429 INFO:teuthology.orchestra.run.smithi119.stderr: 85550K .......... .......... .......... .......... .......... 92% 120M 0s 2024-09-12T17:42:03.429 INFO:teuthology.orchestra.run.smithi119.stderr: 85600K .......... .......... .......... .......... .......... 92% 315M 0s 2024-09-12T17:42:03.429 INFO:teuthology.orchestra.run.smithi119.stderr: 85650K .......... .......... .......... .......... .......... 92% 350M 0s 2024-09-12T17:42:03.429 INFO:teuthology.orchestra.run.smithi119.stderr: 85700K .......... .......... .......... .......... .......... 92% 309M 0s 2024-09-12T17:42:03.429 INFO:teuthology.orchestra.run.smithi119.stderr: 85750K .......... .......... .......... .......... .......... 92% 334M 0s 2024-09-12T17:42:03.429 INFO:teuthology.orchestra.run.smithi119.stderr: 85800K .......... .......... .......... .......... .......... 92% 223M 0s 2024-09-12T17:42:03.429 INFO:teuthology.orchestra.run.smithi119.stderr: 85850K .......... .......... .......... .......... .......... 92% 213M 0s 2024-09-12T17:42:03.429 INFO:teuthology.orchestra.run.smithi119.stderr: 85900K .......... .......... .......... .......... .......... 92% 230M 0s 2024-09-12T17:42:03.429 INFO:teuthology.orchestra.run.smithi119.stderr: 85950K .......... .......... .......... .......... .......... 92% 192M 0s 2024-09-12T17:42:03.429 INFO:teuthology.orchestra.run.smithi119.stderr: 86000K .......... .......... .......... .......... .......... 92% 260M 0s 2024-09-12T17:42:03.429 INFO:teuthology.orchestra.run.smithi119.stderr: 86050K .......... .......... .......... .......... .......... 92% 254M 0s 2024-09-12T17:42:03.429 INFO:teuthology.orchestra.run.smithi119.stderr: 86100K .......... .......... .......... .......... .......... 92% 179M 0s 2024-09-12T17:42:03.429 INFO:teuthology.orchestra.run.smithi119.stderr: 86150K .......... .......... .......... .......... .......... 92% 210M 0s 2024-09-12T17:42:03.430 INFO:teuthology.orchestra.run.smithi119.stderr: 86200K .......... .......... .......... .......... .......... 92% 243M 0s 2024-09-12T17:42:03.430 INFO:teuthology.orchestra.run.smithi119.stderr: 86250K .......... .......... .......... .......... .......... 92% 266M 0s 2024-09-12T17:42:03.430 INFO:teuthology.orchestra.run.smithi119.stderr: 86300K .......... .......... .......... .......... .......... 92% 246M 0s 2024-09-12T17:42:03.430 INFO:teuthology.orchestra.run.smithi119.stderr: 86350K .......... .......... .......... .......... .......... 93% 215M 0s 2024-09-12T17:42:03.430 INFO:teuthology.orchestra.run.smithi119.stderr: 86400K .......... .......... .......... .......... .......... 93% 234M 0s 2024-09-12T17:42:03.430 INFO:teuthology.orchestra.run.smithi119.stderr: 86450K .......... .......... .......... .......... .......... 93% 263M 0s 2024-09-12T17:42:03.430 INFO:teuthology.orchestra.run.smithi119.stderr: 86500K .......... .......... .......... .......... .......... 93% 223M 0s 2024-09-12T17:42:03.430 INFO:teuthology.orchestra.run.smithi119.stderr: 86550K .......... .......... .......... .......... .......... 93% 210M 0s 2024-09-12T17:42:03.430 INFO:teuthology.orchestra.run.smithi119.stderr: 86600K .......... .......... .......... .......... .......... 93% 203M 0s 2024-09-12T17:42:03.430 INFO:teuthology.orchestra.run.smithi119.stderr: 86650K .......... .......... .......... .......... .......... 93% 231M 0s 2024-09-12T17:42:03.430 INFO:teuthology.orchestra.run.smithi119.stderr: 86700K .......... .......... .......... .......... .......... 93% 306M 0s 2024-09-12T17:42:03.430 INFO:teuthology.orchestra.run.smithi119.stderr: 86750K .......... .......... .......... .......... .......... 93% 307M 0s 2024-09-12T17:42:03.430 INFO:teuthology.orchestra.run.smithi119.stderr: 86800K .......... .......... .......... .......... .......... 93% 356M 0s 2024-09-12T17:42:03.430 INFO:teuthology.orchestra.run.smithi119.stderr: 86850K .......... .......... .......... .......... .......... 93% 381M 0s 2024-09-12T17:42:03.431 INFO:teuthology.orchestra.run.smithi119.stderr: 86900K .......... .......... .......... .......... .......... 93% 396M 0s 2024-09-12T17:42:03.431 INFO:teuthology.orchestra.run.smithi119.stderr: 86950K .......... .......... .......... .......... .......... 93% 328M 0s 2024-09-12T17:42:03.431 INFO:teuthology.orchestra.run.smithi119.stderr: 87000K .......... .......... .......... .......... .......... 93% 365M 0s 2024-09-12T17:42:03.431 INFO:teuthology.orchestra.run.smithi119.stderr: 87050K .......... .......... .......... .......... .......... 93% 381M 0s 2024-09-12T17:42:03.431 INFO:teuthology.orchestra.run.smithi119.stderr: 87100K .......... .......... .......... .......... .......... 93% 402M 0s 2024-09-12T17:42:03.431 INFO:teuthology.orchestra.run.smithi119.stderr: 87150K .......... .......... .......... .......... .......... 93% 303M 0s 2024-09-12T17:42:03.431 INFO:teuthology.orchestra.run.smithi119.stderr: 87200K .......... .......... .......... .......... .......... 93% 357M 0s 2024-09-12T17:42:03.431 INFO:teuthology.orchestra.run.smithi119.stderr: 87250K .......... .......... .......... .......... .......... 93% 360M 0s 2024-09-12T17:42:03.431 INFO:teuthology.orchestra.run.smithi119.stderr: 87300K .......... .......... .......... .......... .......... 94% 359M 0s 2024-09-12T17:42:03.431 INFO:teuthology.orchestra.run.smithi119.stderr: 87350K .......... .......... .......... .......... .......... 94% 351M 0s 2024-09-12T17:42:03.431 INFO:teuthology.orchestra.run.smithi119.stderr: 87400K .......... .......... .......... .......... .......... 94% 404M 0s 2024-09-12T17:42:03.431 INFO:teuthology.orchestra.run.smithi119.stderr: 87450K .......... .......... .......... .......... .......... 94% 369M 0s 2024-09-12T17:42:03.431 INFO:teuthology.orchestra.run.smithi119.stderr: 87500K .......... .......... .......... .......... .......... 94% 227M 0s 2024-09-12T17:42:03.431 INFO:teuthology.orchestra.run.smithi119.stderr: 87550K .......... .......... .......... .......... .......... 94% 62.9M 0s 2024-09-12T17:42:03.432 INFO:teuthology.orchestra.run.smithi119.stderr: 87600K .......... .......... .......... .......... .......... 94% 349M 0s 2024-09-12T17:42:03.432 INFO:teuthology.orchestra.run.smithi119.stderr: 87650K .......... .......... .......... .......... .......... 94% 353M 0s 2024-09-12T17:42:03.432 INFO:teuthology.orchestra.run.smithi119.stderr: 87700K .......... .......... .......... .......... .......... 94% 371M 0s 2024-09-12T17:42:03.432 INFO:teuthology.orchestra.run.smithi119.stderr: 87750K .......... .......... .......... .......... .......... 94% 350M 0s 2024-09-12T17:42:03.432 INFO:teuthology.orchestra.run.smithi119.stderr: 87800K .......... .......... .......... .......... .......... 94% 253M 0s 2024-09-12T17:42:03.432 INFO:teuthology.orchestra.run.smithi119.stderr: 87850K .......... .......... .......... .......... .......... 94% 236M 0s 2024-09-12T17:42:03.432 INFO:teuthology.orchestra.run.smithi119.stderr: 87900K .......... .......... .......... .......... .......... 94% 337M 0s 2024-09-12T17:42:03.432 INFO:teuthology.orchestra.run.smithi119.stderr: 87950K .......... .......... .......... .......... .......... 94% 324M 0s 2024-09-12T17:42:03.432 INFO:teuthology.orchestra.run.smithi119.stderr: 88000K .......... .......... .......... .......... .......... 94% 390M 0s 2024-09-12T17:42:03.432 INFO:teuthology.orchestra.run.smithi119.stderr: 88050K .......... .......... .......... .......... .......... 94% 102M 0s 2024-09-12T17:42:03.432 INFO:teuthology.orchestra.run.smithi119.stderr: 88100K .......... .......... .......... .......... .......... 94% 250M 0s 2024-09-12T17:42:03.432 INFO:teuthology.orchestra.run.smithi119.stderr: 88150K .......... .......... .......... .......... .......... 94% 89.5M 0s 2024-09-12T17:42:03.433 INFO:teuthology.orchestra.run.smithi119.stderr: 88200K .......... .......... .......... .......... .......... 94% 366M 0s 2024-09-12T17:42:03.433 INFO:teuthology.orchestra.run.smithi119.stderr: 88250K .......... .......... .......... .......... .......... 95% 93.6M 0s 2024-09-12T17:42:03.433 INFO:teuthology.orchestra.run.smithi119.stderr: 88300K .......... .......... .......... .......... .......... 95% 282M 0s 2024-09-12T17:42:03.433 INFO:teuthology.orchestra.run.smithi119.stderr: 88350K .......... .......... .......... .......... .......... 95% 193M 0s 2024-09-12T17:42:03.433 INFO:teuthology.orchestra.run.smithi119.stderr: 88400K .......... .......... .......... .......... .......... 95% 368M 0s 2024-09-12T17:42:03.433 INFO:teuthology.orchestra.run.smithi119.stderr: 88450K .......... .......... .......... .......... .......... 95% 393M 0s 2024-09-12T17:42:03.433 INFO:teuthology.orchestra.run.smithi119.stderr: 88500K .......... .......... .......... .......... .......... 95% 300M 0s 2024-09-12T17:42:03.433 INFO:teuthology.orchestra.run.smithi119.stderr: 88550K .......... .......... .......... .......... .......... 95% 332M 0s 2024-09-12T17:42:03.433 INFO:teuthology.orchestra.run.smithi119.stderr: 88600K .......... .......... .......... .......... .......... 95% 380M 0s 2024-09-12T17:42:03.433 INFO:teuthology.orchestra.run.smithi119.stderr: 88650K .......... .......... .......... .......... .......... 95% 396M 0s 2024-09-12T17:42:03.433 INFO:teuthology.orchestra.run.smithi119.stderr: 88700K .......... .......... .......... .......... .......... 95% 98.4M 0s 2024-09-12T17:42:03.433 INFO:teuthology.orchestra.run.smithi119.stderr: 88750K .......... .......... .......... .......... .......... 95% 243M 0s 2024-09-12T17:42:03.433 INFO:teuthology.orchestra.run.smithi119.stderr: 88800K .......... .......... .......... .......... .......... 95% 357M 0s 2024-09-12T17:42:03.434 INFO:teuthology.orchestra.run.smithi119.stderr: 88850K .......... .......... .......... .......... .......... 95% 402M 0s 2024-09-12T17:42:03.434 INFO:teuthology.orchestra.run.smithi119.stderr: 88900K .......... .......... .......... .......... .......... 95% 355M 0s 2024-09-12T17:42:03.434 INFO:teuthology.orchestra.run.smithi119.stderr: 88950K .......... .......... .......... .......... .......... 95% 354M 0s 2024-09-12T17:42:03.434 INFO:teuthology.orchestra.run.smithi119.stderr: 89000K .......... .......... .......... .......... .......... 95% 387M 0s 2024-09-12T17:42:03.434 INFO:teuthology.orchestra.run.smithi119.stderr: 89050K .......... .......... .......... .......... .......... 95% 375M 0s 2024-09-12T17:42:03.434 INFO:teuthology.orchestra.run.smithi119.stderr: 89100K .......... .......... .......... .......... .......... 95% 379M 0s 2024-09-12T17:42:03.434 INFO:teuthology.orchestra.run.smithi119.stderr: 89150K .......... .......... .......... .......... .......... 96% 96.4M 0s 2024-09-12T17:42:03.434 INFO:teuthology.orchestra.run.smithi119.stderr: 89200K .......... .......... .......... .......... .......... 96% 326M 0s 2024-09-12T17:42:03.434 INFO:teuthology.orchestra.run.smithi119.stderr: 89250K .......... .......... .......... .......... .......... 96% 392M 0s 2024-09-12T17:42:03.434 INFO:teuthology.orchestra.run.smithi119.stderr: 89300K .......... .......... .......... .......... .......... 96% 281M 0s 2024-09-12T17:42:03.434 INFO:teuthology.orchestra.run.smithi119.stderr: 89350K .......... .......... .......... .......... .......... 96% 344M 0s 2024-09-12T17:42:03.434 INFO:teuthology.orchestra.run.smithi119.stderr: 89400K .......... .......... .......... .......... .......... 96% 85.8M 0s 2024-09-12T17:42:03.434 INFO:teuthology.orchestra.run.smithi119.stderr: 89450K .......... .......... .......... .......... .......... 96% 354M 0s 2024-09-12T17:42:03.434 INFO:teuthology.orchestra.run.smithi119.stderr: 89500K .......... .......... .......... .......... .......... 96% 237M 0s 2024-09-12T17:42:03.435 INFO:teuthology.orchestra.run.smithi119.stderr: 89550K .......... .......... .......... .......... .......... 96% 288M 0s 2024-09-12T17:42:03.435 INFO:teuthology.orchestra.run.smithi119.stderr: 89600K .......... .......... .......... .......... .......... 96% 338M 0s 2024-09-12T17:42:03.435 INFO:teuthology.orchestra.run.smithi119.stderr: 89650K .......... .......... .......... .......... .......... 96% 388M 0s 2024-09-12T17:42:03.435 INFO:teuthology.orchestra.run.smithi119.stderr: 89700K .......... .......... .......... .......... .......... 96% 349M 0s 2024-09-12T17:42:03.435 INFO:teuthology.orchestra.run.smithi119.stderr: 89750K .......... .......... .......... .......... .......... 96% 312M 0s 2024-09-12T17:42:03.435 INFO:teuthology.orchestra.run.smithi119.stderr: 89800K .......... .......... .......... .......... .......... 96% 398M 0s 2024-09-12T17:42:03.435 INFO:teuthology.orchestra.run.smithi119.stderr: 89850K .......... .......... .......... .......... .......... 96% 355M 0s 2024-09-12T17:42:03.435 INFO:teuthology.orchestra.run.smithi119.stderr: 89900K .......... .......... .......... .......... .......... 96% 378M 0s 2024-09-12T17:42:03.435 INFO:teuthology.orchestra.run.smithi119.stderr: 89950K .......... .......... .......... .......... .......... 96% 153M 0s 2024-09-12T17:42:03.435 INFO:teuthology.orchestra.run.smithi119.stderr: 90000K .......... .......... .......... .......... .......... 96% 350M 0s 2024-09-12T17:42:03.435 INFO:teuthology.orchestra.run.smithi119.stderr: 90050K .......... .......... .......... .......... .......... 96% 334M 0s 2024-09-12T17:42:03.435 INFO:teuthology.orchestra.run.smithi119.stderr: 90100K .......... .......... .......... .......... .......... 97% 371M 0s 2024-09-12T17:42:03.435 INFO:teuthology.orchestra.run.smithi119.stderr: 90150K .......... .......... .......... .......... .......... 97% 338M 0s 2024-09-12T17:42:03.436 INFO:teuthology.orchestra.run.smithi119.stderr: 90200K .......... .......... .......... .......... .......... 97% 287M 0s 2024-09-12T17:42:03.436 INFO:teuthology.orchestra.run.smithi119.stderr: 90250K .......... .......... .......... .......... .......... 97% 334M 0s 2024-09-12T17:42:03.436 INFO:teuthology.orchestra.run.smithi119.stderr: 90300K .......... .......... .......... .......... .......... 97% 350M 0s 2024-09-12T17:42:03.436 INFO:teuthology.orchestra.run.smithi119.stderr: 90350K .......... .......... .......... .......... .......... 97% 305M 0s 2024-09-12T17:42:03.436 INFO:teuthology.orchestra.run.smithi119.stderr: 90400K .......... .......... .......... .......... .......... 97% 377M 0s 2024-09-12T17:42:03.436 INFO:teuthology.orchestra.run.smithi119.stderr: 90450K .......... .......... .......... .......... .......... 97% 397M 0s 2024-09-12T17:42:03.436 INFO:teuthology.orchestra.run.smithi119.stderr: 90500K .......... .......... .......... .......... .......... 97% 394M 0s 2024-09-12T17:42:03.436 INFO:teuthology.orchestra.run.smithi119.stderr: 90550K .......... .......... .......... .......... .......... 97% 77.4M 0s 2024-09-12T17:42:03.436 INFO:teuthology.orchestra.run.smithi119.stderr: 90600K .......... .......... .......... .......... .......... 97% 316M 0s 2024-09-12T17:42:03.436 INFO:teuthology.orchestra.run.smithi119.stderr: 90650K .......... .......... .......... .......... .......... 97% 357M 0s 2024-09-12T17:42:03.436 INFO:teuthology.orchestra.run.smithi119.stderr: 90700K .......... .......... .......... .......... .......... 97% 397M 0s 2024-09-12T17:42:03.436 INFO:teuthology.orchestra.run.smithi119.stderr: 90750K .......... .......... .......... .......... .......... 97% 136M 0s 2024-09-12T17:42:03.436 INFO:teuthology.orchestra.run.smithi119.stderr: 90800K .......... .......... .......... .......... .......... 97% 370M 0s 2024-09-12T17:42:03.437 INFO:teuthology.orchestra.run.smithi119.stderr: 90850K .......... .......... .......... .......... .......... 97% 371M 0s 2024-09-12T17:42:03.437 INFO:teuthology.orchestra.run.smithi119.stderr: 90900K .......... .......... .......... .......... .......... 97% 303M 0s 2024-09-12T17:42:03.437 INFO:teuthology.orchestra.run.smithi119.stderr: 90950K .......... .......... .......... .......... .......... 97% 326M 0s 2024-09-12T17:42:03.437 INFO:teuthology.orchestra.run.smithi119.stderr: 91000K .......... .......... .......... .......... .......... 98% 345M 0s 2024-09-12T17:42:03.437 INFO:teuthology.orchestra.run.smithi119.stderr: 91050K .......... .......... .......... .......... .......... 98% 120M 0s 2024-09-12T17:42:03.437 INFO:teuthology.orchestra.run.smithi119.stderr: 91100K .......... .......... .......... .......... .......... 98% 322M 0s 2024-09-12T17:42:03.437 INFO:teuthology.orchestra.run.smithi119.stderr: 91150K .......... .......... .......... .......... .......... 98% 104M 0s 2024-09-12T17:42:03.437 INFO:teuthology.orchestra.run.smithi119.stderr: 91200K .......... .......... .......... .......... .......... 98% 70.4M 0s 2024-09-12T17:42:03.437 INFO:teuthology.orchestra.run.smithi119.stderr: 91250K .......... .......... .......... .......... .......... 98% 195M 0s 2024-09-12T17:42:03.437 INFO:teuthology.orchestra.run.smithi119.stderr: 91300K .......... .......... .......... .......... .......... 98% 365M 0s 2024-09-12T17:42:03.437 INFO:teuthology.orchestra.run.smithi119.stderr: 91350K .......... .......... .......... .......... .......... 98% 334M 0s 2024-09-12T17:42:03.437 INFO:teuthology.orchestra.run.smithi119.stderr: 91400K .......... .......... .......... .......... .......... 98% 311M 0s 2024-09-12T17:42:03.437 INFO:teuthology.orchestra.run.smithi119.stderr: 91450K .......... .......... .......... .......... .......... 98% 355M 0s 2024-09-12T17:42:03.438 INFO:teuthology.orchestra.run.smithi119.stderr: 91500K .......... .......... .......... .......... .......... 98% 366M 0s 2024-09-12T17:42:03.438 INFO:teuthology.orchestra.run.smithi119.stderr: 91550K .......... .......... .......... .......... .......... 98% 296M 0s 2024-09-12T17:42:03.438 INFO:teuthology.orchestra.run.smithi119.stderr: 91600K .......... .......... .......... .......... .......... 98% 359M 0s 2024-09-12T17:42:03.438 INFO:teuthology.orchestra.run.smithi119.stderr: 91650K .......... .......... .......... .......... .......... 98% 401M 0s 2024-09-12T17:42:03.438 INFO:teuthology.orchestra.run.smithi119.stderr: 91700K .......... .......... .......... .......... .......... 98% 200M 0s 2024-09-12T17:42:03.438 INFO:teuthology.orchestra.run.smithi119.stderr: 91750K .......... .......... .......... .......... .......... 98% 153M 0s 2024-09-12T17:42:03.438 INFO:teuthology.orchestra.run.smithi119.stderr: 91800K .......... .......... .......... .......... .......... 98% 354M 0s 2024-09-12T17:42:03.438 INFO:teuthology.orchestra.run.smithi119.stderr: 91850K .......... .......... .......... .......... .......... 98% 365M 0s 2024-09-12T17:42:03.438 INFO:teuthology.orchestra.run.smithi119.stderr: 91900K .......... .......... .......... .......... .......... 98% 173M 0s 2024-09-12T17:42:03.438 INFO:teuthology.orchestra.run.smithi119.stderr: 91950K .......... .......... .......... .......... .......... 99% 322M 0s 2024-09-12T17:42:03.438 INFO:teuthology.orchestra.run.smithi119.stderr: 92000K .......... .......... .......... .......... .......... 99% 178M 0s 2024-09-12T17:42:03.438 INFO:teuthology.orchestra.run.smithi119.stderr: 92050K .......... .......... .......... .......... .......... 99% 391M 0s 2024-09-12T17:42:03.438 INFO:teuthology.orchestra.run.smithi119.stderr: 92100K .......... .......... .......... .......... .......... 99% 272M 0s 2024-09-12T17:42:03.438 INFO:teuthology.orchestra.run.smithi119.stderr: 92150K .......... .......... .......... .......... .......... 99% 308M 0s 2024-09-12T17:42:03.439 INFO:teuthology.orchestra.run.smithi119.stderr: 92200K .......... .......... .......... .......... .......... 99% 232M 0s 2024-09-12T17:42:03.439 INFO:teuthology.orchestra.run.smithi119.stderr: 92250K .......... .......... .......... .......... .......... 99% 367M 0s 2024-09-12T17:42:03.439 INFO:teuthology.orchestra.run.smithi119.stderr: 92300K .......... .......... .......... .......... .......... 99% 335M 0s 2024-09-12T17:42:03.439 INFO:teuthology.orchestra.run.smithi119.stderr: 92350K .......... .......... .......... .......... .......... 99% 312M 0s 2024-09-12T17:42:03.439 INFO:teuthology.orchestra.run.smithi119.stderr: 92400K .......... .......... .......... .......... .......... 99% 130M 0s 2024-09-12T17:42:03.439 INFO:teuthology.orchestra.run.smithi119.stderr: 92450K .......... .......... .......... .......... .......... 99% 145M 0s 2024-09-12T17:42:03.439 INFO:teuthology.orchestra.run.smithi119.stderr: 92500K .......... .......... .......... .......... .......... 99% 341M 0s 2024-09-12T17:42:03.439 INFO:teuthology.orchestra.run.smithi119.stderr: 92550K .......... .......... .......... .......... .......... 99% 337M 0s 2024-09-12T17:42:03.439 INFO:teuthology.orchestra.run.smithi119.stderr: 92600K .......... .......... .......... .......... .......... 99% 363M 0s 2024-09-12T17:42:03.439 INFO:teuthology.orchestra.run.smithi119.stderr: 92650K .......... .......... .......... .......... .......... 99% 370M 0s 2024-09-12T17:42:03.439 INFO:teuthology.orchestra.run.smithi119.stderr: 92700K .......... .......... .......... .......... .......... 99% 378M 0s 2024-09-12T17:42:03.439 INFO:teuthology.orchestra.run.smithi119.stderr: 92750K .......... .......... .......... .......... .......... 99% 311M 0s 2024-09-12T17:42:03.439 INFO:teuthology.orchestra.run.smithi119.stderr: 92800K .......... .......... .......... .......... .......... 99% 138M 0s 2024-09-12T17:42:03.440 INFO:teuthology.orchestra.run.smithi119.stderr: 92850K .......... .......... .......... .......... .......... 99% 400M 0s 2024-09-12T17:42:03.440 INFO:teuthology.orchestra.run.smithi119.stderr: 92900K 100% 134G=0.5s 2024-09-12T17:42:03.440 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-12T17:42:03.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12 17:42:02 (187 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-12T17:42:03.440 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-12T17:42:03.466 INFO:teuthology.orchestra.run.smithi119.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T17:42:03.466 INFO:teuthology.orchestra.run.smithi119.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T17:42:03.467 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T17:42:03.467 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T17:42:03.467 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T17:42:03.467 INFO:teuthology.orchestra.run.smithi119.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T17:42:03.467 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T17:42:03.467 INFO:teuthology.orchestra.run.smithi119.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T17:42:03.467 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T17:42:03.467 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T17:42:03.467 INFO:teuthology.orchestra.run.smithi119.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T17:42:03.467 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T17:42:03.467 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T17:42:03.467 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T17:42:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T17:42:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T17:42:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T17:42:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T17:42:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T17:42:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T17:42:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T17:42:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T17:42:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T17:42:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T17:42:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T17:42:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T17:42:03.469 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T17:42:03.469 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T17:42:03.469 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T17:42:03.469 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T17:42:03.469 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T17:42:03.469 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T17:42:03.469 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T17:42:03.469 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T17:42:03.469 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T17:42:03.469 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T17:42:03.469 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T17:42:03.469 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T17:42:03.470 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T17:42:03.470 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T17:42:03.470 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T17:42:03.470 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T17:42:03.470 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T17:42:03.470 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T17:42:03.470 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T17:42:03.470 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T17:42:03.470 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T17:42:03.470 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T17:42:03.470 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T17:42:03.470 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:42:03.470 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T17:42:03.471 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T17:42:03.471 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T17:42:03.471 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T17:42:03.471 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T17:42:03.471 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T17:42:03.471 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T17:42:03.471 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T17:42:03.471 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T17:42:03.471 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T17:42:03.471 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T17:42:03.471 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T17:42:03.471 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T17:42:03.471 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T17:42:03.472 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T17:42:03.472 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T17:42:03.472 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T17:42:03.472 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T17:42:03.472 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T17:42:03.472 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T17:42:03.472 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T17:42:03.472 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T17:42:03.472 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T17:42:03.472 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T17:42:03.472 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T17:42:03.472 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T17:42:03.473 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T17:42:03.473 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T17:42:03.473 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T17:42:03.473 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T17:42:03.473 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T17:42:03.473 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T17:42:03.473 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T17:42:03.473 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T17:42:03.473 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T17:42:03.473 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T17:42:03.473 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T17:42:03.473 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T17:42:03.473 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T17:42:03.474 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T17:42:03.474 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T17:42:03.474 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T17:42:03.474 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T17:42:03.474 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T17:42:03.474 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T17:42:03.474 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T17:42:03.474 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T17:42:03.474 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T17:42:03.474 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T17:42:03.474 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T17:42:03.474 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T17:42:03.474 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T17:42:03.475 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T17:42:03.475 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T17:42:03.475 INFO:teuthology.orchestra.run.smithi119.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T17:42:03.475 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T17:42:03.475 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T17:42:03.475 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T17:42:03.475 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T17:42:03.475 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T17:42:03.475 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T17:42:03.475 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T17:42:03.475 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T17:42:03.475 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T17:42:03.476 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T17:42:03.476 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T17:42:03.476 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T17:42:03.476 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T17:42:03.476 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T17:42:03.476 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T17:42:03.476 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T17:42:03.476 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T17:42:03.476 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T17:42:03.476 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T17:42:03.476 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T17:42:03.476 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T17:42:03.476 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T17:42:03.477 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T17:42:03.477 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T17:42:03.477 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T17:42:03.477 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T17:42:03.477 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T17:42:03.477 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T17:42:03.477 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T17:42:03.477 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T17:42:03.477 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T17:42:03.477 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T17:42:03.477 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T17:42:03.477 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T17:42:03.477 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T17:42:03.478 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T17:42:03.478 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T17:42:03.478 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T17:42:03.478 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T17:42:03.478 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T17:42:03.478 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T17:42:03.478 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T17:42:03.478 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T17:42:03.478 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T17:42:03.478 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T17:42:03.478 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T17:42:03.478 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T17:42:03.478 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T17:42:03.478 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T17:42:03.479 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T17:42:03.479 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T17:42:03.479 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T17:42:03.479 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T17:42:03.479 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T17:42:03.479 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T17:42:03.479 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T17:42:03.479 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T17:42:03.479 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T17:42:03.479 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T17:42:03.479 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T17:42:03.479 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T17:42:03.479 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T17:42:03.480 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T17:42:03.480 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T17:42:03.480 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T17:42:03.480 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T17:42:03.480 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T17:42:03.480 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T17:42:03.480 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T17:42:03.480 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T17:42:03.480 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T17:42:03.480 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T17:42:03.480 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T17:42:03.480 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T17:42:03.480 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T17:42:03.481 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T17:42:03.481 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T17:42:03.481 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T17:42:03.481 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T17:42:03.481 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T17:42:03.481 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T17:42:03.481 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T17:42:03.481 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T17:42:03.481 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T17:42:03.481 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T17:42:03.481 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T17:42:03.481 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T17:42:03.481 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T17:42:03.482 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T17:42:03.482 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T17:42:03.482 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T17:42:03.482 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T17:42:03.482 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T17:42:03.482 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T17:42:03.482 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T17:42:03.482 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T17:42:03.482 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T17:42:03.482 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T17:42:03.482 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T17:42:03.482 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T17:42:03.482 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T17:42:03.482 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T17:42:03.483 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T17:42:03.483 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T17:42:03.483 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T17:42:03.483 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T17:42:03.483 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T17:42:03.483 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T17:42:03.483 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T17:42:03.483 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T17:42:03.483 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T17:42:03.483 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T17:42:03.483 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T17:42:03.483 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T17:42:03.483 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T17:42:03.484 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T17:42:03.484 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T17:42:03.484 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T17:42:03.484 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T17:42:03.484 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T17:42:03.484 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T17:42:03.484 INFO:teuthology.orchestra.run.smithi119.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T17:42:03.484 INFO:teuthology.orchestra.run.smithi119.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-12T17:42:03.748 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:03.748 INFO:teuthology.orchestra.run.smithi119.stdout:Welcome to Gradle 6.0.1! 2024-09-12T17:42:03.748 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:03.748 INFO:teuthology.orchestra.run.smithi119.stdout:Here are the highlights of this release: 2024-09-12T17:42:03.748 INFO:teuthology.orchestra.run.smithi119.stdout: - Substantial improvements in dependency management, including 2024-09-12T17:42:03.749 INFO:teuthology.orchestra.run.smithi119.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T17:42:03.749 INFO:teuthology.orchestra.run.smithi119.stdout: - Advanced control of transitive versions 2024-09-12T17:42:03.749 INFO:teuthology.orchestra.run.smithi119.stdout: - Support for optional features and dependencies 2024-09-12T17:42:03.749 INFO:teuthology.orchestra.run.smithi119.stdout: - Rules to tweak published metadata 2024-09-12T17:42:03.749 INFO:teuthology.orchestra.run.smithi119.stdout: - Support for Java 13 2024-09-12T17:42:03.749 INFO:teuthology.orchestra.run.smithi119.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T17:42:03.749 INFO:teuthology.orchestra.run.smithi119.stdout: - New Zinc compiler for Scala 2024-09-12T17:42:03.749 INFO:teuthology.orchestra.run.smithi119.stdout: - VS2019 support 2024-09-12T17:42:03.749 INFO:teuthology.orchestra.run.smithi119.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T17:42:03.749 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:03.749 INFO:teuthology.orchestra.run.smithi119.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T17:42:03.749 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:03.749 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:03.750 INFO:teuthology.orchestra.run.smithi119.stdout:------------------------------------------------------------ 2024-09-12T17:42:03.750 INFO:teuthology.orchestra.run.smithi119.stdout:Gradle 6.0.1 2024-09-12T17:42:03.750 INFO:teuthology.orchestra.run.smithi119.stdout:------------------------------------------------------------ 2024-09-12T17:42:03.750 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:03.750 INFO:teuthology.orchestra.run.smithi119.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T17:42:03.750 INFO:teuthology.orchestra.run.smithi119.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T17:42:03.750 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:03.750 INFO:teuthology.orchestra.run.smithi119.stdout:Kotlin: 1.3.50 2024-09-12T17:42:03.750 INFO:teuthology.orchestra.run.smithi119.stdout:Groovy: 2.5.8 2024-09-12T17:42:03.750 INFO:teuthology.orchestra.run.smithi119.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T17:42:03.750 INFO:teuthology.orchestra.run.smithi119.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-12T17:42:03.750 INFO:teuthology.orchestra.run.smithi119.stdout:OS: Linux 5.15.0-119-generic amd64 2024-09-12T17:42:03.750 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:03.756 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T17:42:03.756 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T17:42:03.756 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T17:42:03.756 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T17:42:03.756 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T17:42:03.756 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T17:42:03.943 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T17:42:03.943 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T17:42:03.944 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'RVJFIPTFVWQRBXBYMVOX', 'access_secret': 'g2vLjkGa7hsiEfF1lugSXtxSSsPtu806ydR5BOlmtJOIzakwBGJefA==', 'region': 'mexico', 'endpoint': 'smithi119.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi119.front.sepia.ceph.com'} 2024-09-12T17:42:03.944 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T17:42:03.944 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'RVJFIPTFVWQRBXBYMVOX', '--secret', 'g2vLjkGa7hsiEfF1lugSXtxSSsPtu806ydR5BOlmtJOIzakwBGJefA==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T17:42:03.944 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key RVJFIPTFVWQRBXBYMVOX --secret g2vLjkGa7hsiEfF1lugSXtxSSsPtu806ydR5BOlmtJOIzakwBGJefA== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T17:42:03.985 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:03.985 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:04.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.024+0000 7f0e9ae909c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.024+0000 7f0e9ae909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:04.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.024+0000 7f0e9ae909c0 20 realm 2024-09-12T17:42:04.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.024+0000 7f0e9ae909c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.024+0000 7f0e9ae909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:04.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.024+0000 7f0e9ae909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:04.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.024+0000 7f0e9ae909c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.024+0000 7f0e9ae909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:04.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.024+0000 7f0e9ae909c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.028+0000 7f0e9ae909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:04.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.028+0000 7f0e9ae909c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.028+0000 7f0e9ae909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:04.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.028+0000 7f0e9ae909c0 20 searching for the correct realm 2024-09-12T17:42:04.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.032+0000 7f0e99197640 0 -- 172.21.15.119:0/965312371 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x559af93ad280 msgr2=0x559af93af670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:04.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.036+0000 7f0e98195640 0 -- 172.21.15.119:0/965312371 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f0e880a1410 msgr2=0x7f0e88096960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:04.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.252+0000 7f0e9ae909c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:42:04.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.252+0000 7f0e9ae909c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:42:04.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.252+0000 7f0e9ae909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:04.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.252+0000 7f0e9ae909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:04.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.252+0000 7f0e9ae909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:04.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.252+0000 7f0e9ae909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:04.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.252+0000 7f0e9ae909c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.252+0000 7f0e9ae909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:04.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.252+0000 7f0e9ae909c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.252+0000 7f0e9ae909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:04.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.256+0000 7f0e9ae909c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.256+0000 7f0e9ae909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:04.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.256+0000 7f0e9ae909c0 20 zone default found 2024-09-12T17:42:04.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.256+0000 7f0e9ae909c0 4 Realm: () 2024-09-12T17:42:04.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.256+0000 7f0e9ae909c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:42:04.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.256+0000 7f0e9ae909c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:42:04.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.256+0000 7f0e9ae909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:04.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.256+0000 7f0e9ae909c0 20 zonegroup default 2024-09-12T17:42:04.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.256+0000 7f0e9ae909c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.256+0000 7f0e9ae909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:04.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.256+0000 7f0e9ae909c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.256+0000 7f0e9ae909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:04.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.256+0000 7f0e9ae909c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.256+0000 7f0e9ae909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:04.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.256+0000 7f0e9ae909c0 20 started sync module instance, tier type = 2024-09-12T17:42:04.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.256+0000 7f0e9ae909c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:42:04.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.280+0000 7f0e9ae909c0 20 add_watcher() i=0 2024-09-12T17:42:04.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.280+0000 7f0e9ae909c0 20 add_watcher() i=1 2024-09-12T17:42:04.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.280+0000 7f0e9ae909c0 20 add_watcher() i=2 2024-09-12T17:42:04.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.280+0000 7f0e9ae909c0 20 add_watcher() i=3 2024-09-12T17:42:04.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.280+0000 7f0e9ae909c0 20 add_watcher() i=4 2024-09-12T17:42:04.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.280+0000 7f0e9ae909c0 20 add_watcher() i=5 2024-09-12T17:42:04.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.280+0000 7f0e9ae909c0 20 add_watcher() i=6 2024-09-12T17:42:04.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.280+0000 7f0e9ae909c0 20 add_watcher() i=7 2024-09-12T17:42:04.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.280+0000 7f0e9ae909c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:04.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.284+0000 7f0d4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:04.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.284+0000 7f0e9ae909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:04.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.284+0000 7f0e9ae909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:04.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.284+0000 7f0e9ae909c0 5 note: GC not initialized 2024-09-12T17:42:04.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0d4dfe3640 20 reqs_thread_entry: start 2024-09-12T17:42:04.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 20 init_complete bucket index max shards: 11 2024-09-12T17:42:04.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 20 Filter name: none 2024-09-12T17:42:04.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0cbf7fe640 20 reqs_thread_entry: start 2024-09-12T17:42:04.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T17:42:04.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:04.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T17:42:04.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:42:04.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T17:42:04.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:04.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T17:42:04.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:42:04.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 10 cache get: name=default.rgw.meta+users.keys+RVJFIPTFVWQRBXBYMVOX : miss 2024-09-12T17:42:04.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:04.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 10 cache put: name=default.rgw.meta+users.keys+RVJFIPTFVWQRBXBYMVOX info.flags=0x0 2024-09-12T17:42:04.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 10 adding default.rgw.meta+users.keys+RVJFIPTFVWQRBXBYMVOX to cache LRU end 2024-09-12T17:42:04.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 10 cache get: name=default.rgw.meta+users.keys+RVJFIPTFVWQRBXBYMVOX : hit (negative entry) 2024-09-12T17:42:04.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.288+0000 7f0e9ae909c0 10 cache get: name=default.rgw.meta+users.keys+RVJFIPTFVWQRBXBYMVOX : hit (negative entry) 2024-09-12T17:42:04.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.292+0000 7f0e9ae909c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T17:42:04.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.292+0000 7f0e9ae909c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:42:04.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.292+0000 7f0e9ae909c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T17:42:04.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.292+0000 7f0d6ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333524 cookie 94124094756880 notifier 8808 bl.length()=670 2024-09-12T17:42:04.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.292+0000 7f0d6ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T17:42:04.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.292+0000 7f0d6ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:42:04.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.296+0000 7f0e9ae909c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T17:42:04.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.296+0000 7f0e9ae909c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:42:04.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.296+0000 7f0e9ae909c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T17:42:04.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.296+0000 7f0d6ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333515 cookie 94124094738304 notifier 8808 bl.length()=200 2024-09-12T17:42:04.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.296+0000 7f0d6ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T17:42:04.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.296+0000 7f0d6ffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:42:04.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.300+0000 7f0e9ae909c0 10 cache put: name=default.rgw.meta+users.keys+RVJFIPTFVWQRBXBYMVOX info.flags=0x7 2024-09-12T17:42:04.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.300+0000 7f0e9ae909c0 10 moving default.rgw.meta+users.keys+RVJFIPTFVWQRBXBYMVOX to cache LRU end 2024-09-12T17:42:04.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.300+0000 7f0e9ae909c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:RVJFIPTFVWQRBXBYMVOX, ofs0, ns] 2024-09-12T17:42:04.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.300+0000 7f0d6ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333531 cookie 94124094739808 notifier 8808 bl.length()=189 2024-09-12T17:42:04.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.300+0000 7f0d6ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RVJFIPTFVWQRBXBYMVOX info.flags=0x7 2024-09-12T17:42:04.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.300+0000 7f0d6ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RVJFIPTFVWQRBXBYMVOX to cache LRU end 2024-09-12T17:42:04.305 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T17:42:04.305 INFO:teuthology.orchestra.run.smithi119.stdout: "user_id": "tester.client.0", 2024-09-12T17:42:04.305 INFO:teuthology.orchestra.run.smithi119.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T17:42:04.305 INFO:teuthology.orchestra.run.smithi119.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T17:42:04.305 INFO:teuthology.orchestra.run.smithi119.stdout: "suspended": 0, 2024-09-12T17:42:04.305 INFO:teuthology.orchestra.run.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:42:04.305 INFO:teuthology.orchestra.run.smithi119.stdout: "subusers": [], 2024-09-12T17:42:04.305 INFO:teuthology.orchestra.run.smithi119.stdout: "keys": [ 2024-09-12T17:42:04.305 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T17:42:04.305 INFO:teuthology.orchestra.run.smithi119.stdout: "user": "tester.client.0", 2024-09-12T17:42:04.305 INFO:teuthology.orchestra.run.smithi119.stdout: "access_key": "RVJFIPTFVWQRBXBYMVOX", 2024-09-12T17:42:04.305 INFO:teuthology.orchestra.run.smithi119.stdout: "secret_key": "g2vLjkGa7hsiEfF1lugSXtxSSsPtu806ydR5BOlmtJOIzakwBGJefA==", 2024-09-12T17:42:04.306 INFO:teuthology.orchestra.run.smithi119.stdout: "active": true, 2024-09-12T17:42:04.306 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:42:04.292452Z" 2024-09-12T17:42:04.306 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T17:42:04.306 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-12T17:42:04.306 INFO:teuthology.orchestra.run.smithi119.stdout: "swift_keys": [], 2024-09-12T17:42:04.306 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": [], 2024-09-12T17:42:04.306 INFO:teuthology.orchestra.run.smithi119.stdout: "op_mask": "read, write, delete", 2024-09-12T17:42:04.306 INFO:teuthology.orchestra.run.smithi119.stdout: "default_placement": "", 2024-09-12T17:42:04.306 INFO:teuthology.orchestra.run.smithi119.stdout: "default_storage_class": "", 2024-09-12T17:42:04.306 INFO:teuthology.orchestra.run.smithi119.stdout: "placement_tags": [], 2024-09-12T17:42:04.306 INFO:teuthology.orchestra.run.smithi119.stdout: "bucket_quota": { 2024-09-12T17:42:04.306 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:42:04.307 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:42:04.307 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:42:04.307 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:42:04.307 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:42:04.307 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:42:04.307 INFO:teuthology.orchestra.run.smithi119.stdout: "user_quota": { 2024-09-12T17:42:04.307 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:42:04.307 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:42:04.307 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:42:04.307 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:42:04.307 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:42:04.307 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:42:04.307 INFO:teuthology.orchestra.run.smithi119.stdout: "temp_url_keys": [], 2024-09-12T17:42:04.307 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "rgw", 2024-09-12T17:42:04.308 INFO:teuthology.orchestra.run.smithi119.stdout: "mfa_ids": [], 2024-09-12T17:42:04.308 INFO:teuthology.orchestra.run.smithi119.stdout: "account_id": "", 2024-09-12T17:42:04.308 INFO:teuthology.orchestra.run.smithi119.stdout: "path": "/", 2024-09-12T17:42:04.308 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:42:04.292401Z", 2024-09-12T17:42:04.308 INFO:teuthology.orchestra.run.smithi119.stdout: "tags": [], 2024-09-12T17:42:04.308 INFO:teuthology.orchestra.run.smithi119.stdout: "group_ids": [] 2024-09-12T17:42:04.308 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T17:42:04.308 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:04.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.304+0000 7f0d4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:04.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.308+0000 7f0e9ae909c0 20 remove_watcher() i=0 2024-09-12T17:42:04.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.308+0000 7f0e9ae909c0 2 removed watcher, disabling cache 2024-09-12T17:42:04.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.312+0000 7f0e9ae909c0 20 remove_watcher() i=1 2024-09-12T17:42:04.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.316+0000 7f0e9ae909c0 20 remove_watcher() i=2 2024-09-12T17:42:04.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.316+0000 7f0e9ae909c0 20 remove_watcher() i=3 2024-09-12T17:42:04.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.320+0000 7f0e9ae909c0 20 remove_watcher() i=4 2024-09-12T17:42:04.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.320+0000 7f0e9ae909c0 20 remove_watcher() i=5 2024-09-12T17:42:04.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.320+0000 7f0e9ae909c0 20 remove_watcher() i=6 2024-09-12T17:42:04.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.320+0000 7f0e9ae909c0 20 remove_watcher() i=7 2024-09-12T17:42:04.338 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:42:04.338 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T17:42:04.386 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T17:42:04.386 DEBUG:teuthology.orchestra.run.smithi119:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T17:42:04.436 DEBUG:teuthology.orchestra.run.smithi119:> radosgw-admin gc process --include-all 2024-09-12T17:42:04.511 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:04.512 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:04.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.560+0000 7fb9660749c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.560+0000 7fb9660749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:04.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.560+0000 7fb9660749c0 20 realm 2024-09-12T17:42:04.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.560+0000 7fb9660749c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.560+0000 7fb9660749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:04.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.560+0000 7fb9660749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:04.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.560+0000 7fb9660749c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.560+0000 7fb9660749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:04.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.560+0000 7fb9660749c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.560+0000 7fb9660749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:04.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.560+0000 7fb9660749c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:04.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.564+0000 7fb9660749c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:04.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.564+0000 7fb9660749c0 20 searching for the correct realm 2024-09-12T17:42:04.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.564+0000 7fb963b7a640 0 -- 172.21.15.119:0/2425716738 >> [v2:172.21.15.119:6800/1732749810,v1:172.21.15.119:6801/1732749810] conn(0x5572fc1f4970 msgr2=0x5572fc1f6e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:04.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:04.776+0000 7fb963b7a640 0 -- 172.21.15.119:0/2425716738 >> [v2:172.21.15.194:6824/504391855,v1:172.21.15.194:6825/504391855] conn(0x7fb950003be0 msgr2=0x7fb95401d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:05.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.000+0000 7fb9660749c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:42:05.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.000+0000 7fb9660749c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:42:05.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.000+0000 7fb9660749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:05.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.000+0000 7fb9660749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:05.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.000+0000 7fb9660749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:05.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.000+0000 7fb9660749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:05.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.000+0000 7fb9660749c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:05.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.000+0000 7fb9660749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:05.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.000+0000 7fb9660749c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:05.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.000+0000 7fb9660749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:05.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.000+0000 7fb9660749c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:05.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.004+0000 7fb9660749c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:05.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.004+0000 7fb9660749c0 20 zone default found 2024-09-12T17:42:05.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.004+0000 7fb9660749c0 4 Realm: () 2024-09-12T17:42:05.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.004+0000 7fb9660749c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:42:05.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.004+0000 7fb9660749c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:42:05.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.004+0000 7fb9660749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:05.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.004+0000 7fb9660749c0 20 zonegroup default 2024-09-12T17:42:05.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.004+0000 7fb9660749c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:05.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.004+0000 7fb9660749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:05.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.004+0000 7fb9660749c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:05.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.004+0000 7fb9660749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:05.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.004+0000 7fb9660749c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:05.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.004+0000 7fb9660749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:05.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.004+0000 7fb9660749c0 20 started sync module instance, tier type = 2024-09-12T17:42:05.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.004+0000 7fb9660749c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:42:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.024+0000 7fb9660749c0 20 add_watcher() i=0 2024-09-12T17:42:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.024+0000 7fb9660749c0 20 add_watcher() i=1 2024-09-12T17:42:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.024+0000 7fb9660749c0 20 add_watcher() i=2 2024-09-12T17:42:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.024+0000 7fb9660749c0 20 add_watcher() i=3 2024-09-12T17:42:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.024+0000 7fb9660749c0 20 add_watcher() i=4 2024-09-12T17:42:05.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.024+0000 7fb9660749c0 20 add_watcher() i=5 2024-09-12T17:42:05.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.028+0000 7fb9660749c0 20 add_watcher() i=6 2024-09-12T17:42:05.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.028+0000 7fb9660749c0 20 add_watcher() i=7 2024-09-12T17:42:05.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.028+0000 7fb9660749c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:05.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.032+0000 7fb819fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:05.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.032+0000 7fb9660749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:05.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.032+0000 7fb9660749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:05.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.120+0000 7fb818fe1640 20 reqs_thread_entry: start 2024-09-12T17:42:05.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.120+0000 7fb9660749c0 20 init_complete bucket index max shards: 11 2024-09-12T17:42:05.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.120+0000 7fb9660749c0 20 Filter name: none 2024-09-12T17:42:05.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.120+0000 7fb7927fc640 20 reqs_thread_entry: start 2024-09-12T17:42:05.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.120+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:42:05.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.124+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T17:42:05.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8037329698795032877', time=2024-09-12T19:31:56.508450+0000, chain.objs.size()=1 2024-09-12T17:42:05.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.DaP7L1FhEM3F-ae4Ui0GG7U_jOfDaVb_0 2024-09-12T17:42:05.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='_jfwy7bZNf2wWjMxiydKQhwXVup9HH53', time=2024-09-12T19:31:57.008579+0000, chain.objs.size()=3 2024-09-12T17:42:05.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.pywdbt2t-vfN0GzNFfSwGJ-XcnKPcad_0 2024-09-12T17:42:05.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.pywdbt2t-vfN0GzNFfSwGJ-XcnKPcad_1 2024-09-12T17:42:05.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.pywdbt2t-vfN0GzNFfSwGJ-XcnKPcad_2 2024-09-12T17:42:05.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6879922245594746138', time=2024-09-12T19:33:21.684878+0000, chain.objs.size()=1 2024-09-12T17:42:05.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.GlNvpV86y0coGoO6R1kHlcVlInDYiSp_0 2024-09-12T17:42:05.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1850212168507466272', time=2024-09-12T19:34:13.228339+0000, chain.objs.size()=1 2024-09-12T17:42:05.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.afC1VqdVqaUaLtVQj-wIXAxdjuBIO4q_0 2024-09-12T17:42:05.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.938747097327056865', time=2024-09-12T19:36:23.374584+0000, chain.objs.size()=1 2024-09-12T17:42:05.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.bTgbeYM2vaEx6noqD5LR198-X4b1OIJ_0 2024-09-12T17:42:05.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3758373178589892829', time=2024-09-12T19:36:23.544205+0000, chain.objs.size()=1 2024-09-12T17:42:05.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.g_g1C9CRERwSu_9rg-zkHRbPqQWxSwT_0 2024-09-12T17:42:05.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1173141482492743450', time=2024-09-12T19:36:23.546151+0000, chain.objs.size()=1 2024-09-12T17:42:05.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.lAeRBiZV9oIIPLKSZVLPcp1Zha8CHUl_0 2024-09-12T17:42:05.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3971432518271291915', time=2024-09-12T19:37:46.029317+0000, chain.objs.size()=1 2024-09-12T17:42:05.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.-1hGYBuzw08pgsbA2dEeN2_IBfvn7K__0 2024-09-12T17:42:05.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8792996079578783779', time=2024-09-12T19:37:52.235509+0000, chain.objs.size()=1 2024-09-12T17:42:05.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.yk5XFJpyTDBdzH_5mNMReAn5ZddJnBO_0 2024-09-12T17:42:05.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7579142408050605315', time=2024-09-12T19:38:33.446117+0000, chain.objs.size()=1 2024-09-12T17:42:05.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.128+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.5eFexIb8Y0z3doP6YLmpOoE3UVVaci__0 2024-09-12T17:42:05.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.140+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.144+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:42:05.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T17:42:05.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8733849924896191556', time=2024-09-12T19:31:57.233800+0000, chain.objs.size()=1 2024-09-12T17:42:05.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14__shadow_.DprmY0pGl61QKCAwkVW9orwxNN9a9f0_0 2024-09-12T17:42:05.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16541808856270553721', time=2024-09-12T19:33:21.669947+0000, chain.objs.size()=1 2024-09-12T17:42:05.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.AlnqkWHFl7J4e6fYKdqPfwIcPp11ykj_0 2024-09-12T17:42:05.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9353230259670548022', time=2024-09-12T19:34:01.925128+0000, chain.objs.size()=1 2024-09-12T17:42:05.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.uQdZ23Uf4Uol3i5-Hq7061GugOgFG7k_0 2024-09-12T17:42:05.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16407029715624097514', time=2024-09-12T19:34:02.051343+0000, chain.objs.size()=1 2024-09-12T17:42:05.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_._et30vqP6Y1iumb_ynk6pMmg8U-TiXU_0 2024-09-12T17:42:05.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10281793117421173102', time=2024-09-12T19:34:02.082935+0000, chain.objs.size()=1 2024-09-12T17:42:05.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.1yUrayaN10NJ_fcf137EQEMSJy3i_jm_0 2024-09-12T17:42:05.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7877418487048098245', time=2024-09-12T19:34:49.206722+0000, chain.objs.size()=1 2024-09-12T17:42:05.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.5i_V8a-XsAJDqboX8nICHjWtI8v4ybi_0 2024-09-12T17:42:05.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5755441197062067815', time=2024-09-12T19:34:59.953020+0000, chain.objs.size()=1 2024-09-12T17:42:05.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.jIlVPrKtJw_RQfJsSHlrSr-VD2mZOSs_0 2024-09-12T17:42:05.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15710711461940543485', time=2024-09-12T19:35:35.646230+0000, chain.objs.size()=1 2024-09-12T17:42:05.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.Ad66jAGJafvNowKlM1cs65ZAV5C-Mwv_0 2024-09-12T17:42:05.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13419953925071163722', time=2024-09-12T19:35:40.765867+0000, chain.objs.size()=1 2024-09-12T17:42:05.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.Hw53te3ci4Lz4urpy5C3m4IAaD3xf49_0 2024-09-12T17:42:05.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.874888985197724913', time=2024-09-12T19:36:17.592340+0000, chain.objs.size()=1 2024-09-12T17:42:05.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.eHB1-WPKkz5jcEzgXMCaRlzMdBFvlhi_0 2024-09-12T17:42:05.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.594628734181652403', time=2024-09-12T19:36:23.368936+0000, chain.objs.size()=1 2024-09-12T17:42:05.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.5xNgDk-omyhiEeGZFI9ezg1qIP7RsTi_0 2024-09-12T17:42:05.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1388234232370710453', time=2024-09-12T19:37:45.985305+0000, chain.objs.size()=1 2024-09-12T17:42:05.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.148+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.pfDM98dEfS0QBFnEfmY2UJMsSfyi6yM_0 2024-09-12T17:42:05.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.156+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15847546391885788322', time=2024-09-12T19:37:45.986989+0000, chain.objs.size()=1 2024-09-12T17:42:05.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.156+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.kLDfqy1Ns-2cSXsY5dWNeEzF_Vcv8uo_0 2024-09-12T17:42:05.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.160+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11877890318201825637', time=2024-09-12T19:38:37.747270+0000, chain.objs.size()=1 2024-09-12T17:42:05.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.160+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.x4S3e0TPZ64OYQuYK_wshr-thVWm2B7_0 2024-09-12T17:42:05.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.160+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6429529367874982134', time=2024-09-12T19:38:37.962184+0000, chain.objs.size()=1 2024-09-12T17:42:05.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.160+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.1s7025EtFhk-J9JTvLGpdAZzCn8UfwY_0 2024-09-12T17:42:05.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.164+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.168+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:42:05.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T17:42:05.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16693570649545422106', time=2024-09-12T19:31:57.097069+0000, chain.objs.size()=5 2024-09-12T17:42:05.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.1 2024-09-12T17:42:05.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.1_1 2024-09-12T17:42:05.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.2 2024-09-12T17:42:05.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.2_1 2024-09-12T17:42:05.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.3 2024-09-12T17:42:05.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11409222842991038813', time=2024-09-12T19:33:29.783723+0000, chain.objs.size()=1 2024-09-12T17:42:05.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.X5Ku2kR-VbK1zLpb3QuKU3qsSLTf2KE_0 2024-09-12T17:42:05.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5216284910012846587', time=2024-09-12T19:34:01.975354+0000, chain.objs.size()=1 2024-09-12T17:42:05.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.nETZ68pfDTVJvX0fqY6WKzeQM3_G3U-_0 2024-09-12T17:42:05.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14700491001127334412', time=2024-09-12T19:34:08.173729+0000, chain.objs.size()=1 2024-09-12T17:42:05.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.uZ3XxJ61zcRLiq0o-lbN97UmH-_ZG-D_0 2024-09-12T17:42:05.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16886397266462644888', time=2024-09-12T19:34:13.196703+0000, chain.objs.size()=1 2024-09-12T17:42:05.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.KC2dIytA1GvDv7IPBu9l6qVOjwRDXft_0 2024-09-12T17:42:05.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11060227164863996816', time=2024-09-12T19:34:55.056451+0000, chain.objs.size()=1 2024-09-12T17:42:05.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.YNtzl-ZxDEJrcIUWnNXmn2YUOHemUy0_0 2024-09-12T17:42:05.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8502097953138071411', time=2024-09-12T19:34:59.769433+0000, chain.objs.size()=1 2024-09-12T17:42:05.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.ojciwXoGU-WPGyD-Bzei_pxerwIwoVe_0 2024-09-12T17:42:05.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4702983048791513006', time=2024-09-12T19:35:35.523073+0000, chain.objs.size()=1 2024-09-12T17:42:05.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.172+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.w5PJrfrs2SH1D_IqEGfOab6mYo7lTko_0 2024-09-12T17:42:05.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.176+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17660275542019175110', time=2024-09-12T19:35:40.865296+0000, chain.objs.size()=1 2024-09-12T17:42:05.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.176+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.JptHx3W3CZgZHft0WzPy9xA9wmXA5Nn_0 2024-09-12T17:42:05.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.176+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6684757327104140764', time=2024-09-12T19:36:23.554536+0000, chain.objs.size()=1 2024-09-12T17:42:05.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.176+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.VOrwyWlq6gJq3LdvZaPma_hfdL_lvpa_0 2024-09-12T17:42:05.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.176+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2147264215196691038', time=2024-09-12T19:37:10.137874+0000, chain.objs.size()=1 2024-09-12T17:42:05.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.176+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.sejtnCm4pBsUKP0qpeb9UzKP7u2e2Tb_0 2024-09-12T17:42:05.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.176+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15302837267817399361', time=2024-09-12T19:37:10.176413+0000, chain.objs.size()=1 2024-09-12T17:42:05.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.176+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.uMpN0ju6XMGrqfmzgSpCO83VjbiapLQ_0 2024-09-12T17:42:05.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.176+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3624896396035727055', time=2024-09-12T19:37:10.274102+0000, chain.objs.size()=1 2024-09-12T17:42:05.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.176+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.AMCg9ZKg7bEEeO30qwUSSuv3e-fpxGU_0 2024-09-12T17:42:05.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.180+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17494601381808734419', time=2024-09-12T19:37:45.990292+0000, chain.objs.size()=1 2024-09-12T17:42:05.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.180+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.pOFV3jEnjaNwwsq8ZDYXsUjBO7e8bp8_0 2024-09-12T17:42:05.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.180+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14401376220122856014', time=2024-09-12T19:37:46.110934+0000, chain.objs.size()=1 2024-09-12T17:42:05.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.180+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.Vs7t7qiEUQSjknGYS3oq5zmDFzkn66v_0 2024-09-12T17:42:05.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.180+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2245675781416946786', time=2024-09-12T19:38:28.031058+0000, chain.objs.size()=1 2024-09-12T17:42:05.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.180+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.CFhv6YSjhryInDB43Ay_ZDb6rfISt5B_0 2024-09-12T17:42:05.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.180+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11527950656858089847', time=2024-09-12T19:38:33.435049+0000, chain.objs.size()=1 2024-09-12T17:42:05.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.180+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.rOXrPf5SgULySPpyX3ew1VSmVqztvvs_0 2024-09-12T17:42:05.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.180+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14229048244508436779', time=2024-09-12T19:38:33.471367+0000, chain.objs.size()=1 2024-09-12T17:42:05.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.180+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.F6DpaIVY7iyWZ8Huu3ur-hQ3bwTb51t_0 2024-09-12T17:42:05.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.180+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.542873067015984903', time=2024-09-12T19:38:37.800700+0000, chain.objs.size()=1 2024-09-12T17:42:05.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.180+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.7C2dXiBCvDHq3bX4qU9B20XOxJYjLNr_0 2024-09-12T17:42:05.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.184+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4645827019286358032', time=2024-09-12T19:39:14.424676+0000, chain.objs.size()=1 2024-09-12T17:42:05.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.184+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.xJbuwdkp-ZaBDiDJz-Ihd8BDKT-Qblt_0 2024-09-12T17:42:05.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.192+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5944021780378351007', time=2024-09-12T19:41:25.691361+0000, chain.objs.size()=1 2024-09-12T17:42:05.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.192+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18__shadow_.IenL9BzoODoWRt-trEnG7-28-cj8A3U_0 2024-09-12T17:42:05.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.196+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.200+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:42:05.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T17:42:05.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160199255982712328', time=2024-09-12T19:31:56.834256+0000, chain.objs.size()=2 2024-09-12T17:42:05.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.AAo2fbUfygtrhQBYVIc2lkOCfwQ36ro_0 2024-09-12T17:42:05.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.AAo2fbUfygtrhQBYVIc2lkOCfwQ36ro_1 2024-09-12T17:42:05.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8253704328200987311', time=2024-09-12T19:31:57.220647+0000, chain.objs.size()=3 2024-09-12T17:42:05.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14__shadow_.Vnamf1OhbYNOE4-xePdD5OSEY79ckQH_0 2024-09-12T17:42:05.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14__shadow_.Vnamf1OhbYNOE4-xePdD5OSEY79ckQH_1 2024-09-12T17:42:05.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14__shadow_.Vnamf1OhbYNOE4-xePdD5OSEY79ckQH_2 2024-09-12T17:42:05.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15110629588448270680', time=2024-09-12T19:33:21.485881+0000, chain.objs.size()=1 2024-09-12T17:42:05.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.lwSqH2Ax8w2oErUM8yjpiJL2zte5uTR_0 2024-09-12T17:42:05.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8633189610018960575', time=2024-09-12T19:33:25.775086+0000, chain.objs.size()=1 2024-09-12T17:42:05.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.2yK4aEY2c5z4RUzvUGR_xJQ-e9gkliW_0 2024-09-12T17:42:05.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1720117226716894316', time=2024-09-12T19:34:08.232556+0000, chain.objs.size()=1 2024-09-12T17:42:05.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.tX6UzeYQKjD7xUVOEsB-MrxkJjK1-dn_0 2024-09-12T17:42:05.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14113203763534772443', time=2024-09-12T19:34:13.126161+0000, chain.objs.size()=1 2024-09-12T17:42:05.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.4dNiOcwmiXdy4vQnUPhFlr5zmrozTF4_0 2024-09-12T17:42:05.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12102966226451274158', time=2024-09-12T19:34:54.935957+0000, chain.objs.size()=1 2024-09-12T17:42:05.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.YG42NQnCrpc8xHiaQYuCdFTCnUZ2GP0_0 2024-09-12T17:42:05.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11704463745780597968', time=2024-09-12T19:36:23.429729+0000, chain.objs.size()=1 2024-09-12T17:42:05.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.EIzxXPVOpM3BpATdw4-q8R8ToUIWMou_0 2024-09-12T17:42:05.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6029647178293165292', time=2024-09-12T19:36:23.499996+0000, chain.objs.size()=1 2024-09-12T17:42:05.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.204+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.nm3n8gNaBaZCiyWzyt0Z4F92CosWSYK_0 2024-09-12T17:42:05.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.216+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.220+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:42:05.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:42:05.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.948963268087707501', time=2024-09-12T19:31:56.762405+0000, chain.objs.size()=4 2024-09-12T17:42:05.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10__multipart_foo.2~7AAYDqmjXFlE_S2TN3tzmkjjDXHIl_l.1 2024-09-12T17:42:05.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10__multipart_foo.2~7AAYDqmjXFlE_S2TN3tzmkjjDXHIl_l.2 2024-09-12T17:42:05.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10__multipart_foo.2~7AAYDqmjXFlE_S2TN3tzmkjjDXHIl_l.3 2024-09-12T17:42:05.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10__multipart_foo.2~7AAYDqmjXFlE_S2TN3tzmkjjDXHIl_l.4 2024-09-12T17:42:05.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.857804487360329210', time=2024-09-12T19:33:21.604910+0000, chain.objs.size()=1 2024-09-12T17:42:05.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_._dzUHFqu0dyr-QEfOnP5WP0KrxwD7DT_0 2024-09-12T17:42:05.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.798237474128943053', time=2024-09-12T19:33:25.858640+0000, chain.objs.size()=1 2024-09-12T17:42:05.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.GPXfZuFdgYfcoYq_Y6WKJQaY6b-PVMx_0 2024-09-12T17:42:05.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1995555097960434290', time=2024-09-12T19:35:40.732326+0000, chain.objs.size()=1 2024-09-12T17:42:05.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.n4Pn6qV8XWod0WWYrfVTwHlNc48RkKr_0 2024-09-12T17:42:05.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2103503191850441169', time=2024-09-12T19:36:17.517960+0000, chain.objs.size()=1 2024-09-12T17:42:05.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.yrLGhmUltp8HjFRlXBTo5U4AAkZ8hES_0 2024-09-12T17:42:05.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9370955457825628528', time=2024-09-12T19:36:17.663977+0000, chain.objs.size()=1 2024-09-12T17:42:05.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.224+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.XiN3h_Y0s0VR-eWuEgd9dvkVaMzxcZ6_0 2024-09-12T17:42:05.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.228+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4408620009827166614', time=2024-09-12T19:36:17.683793+0000, chain.objs.size()=1 2024-09-12T17:42:05.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.228+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.QbowhwkdG5HO-y1JCtID8_lT9rD9sej_0 2024-09-12T17:42:05.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.228+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15873753712168133359', time=2024-09-12T19:36:23.639554+0000, chain.objs.size()=1 2024-09-12T17:42:05.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.228+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.yxM71piRReE4X4DPukPIiVKAmy3ZrP9_0 2024-09-12T17:42:05.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.228+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1363736438414078714', time=2024-09-12T19:36:28.073070+0000, chain.objs.size()=1 2024-09-12T17:42:05.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.228+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.sZfxRbtqB7QHJI7Uz4B-XjCudqL8iOH_0 2024-09-12T17:42:05.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.232+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4149047547658796985', time=2024-09-12T19:37:03.805405+0000, chain.objs.size()=1 2024-09-12T17:42:05.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.232+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.qVXPqiH9V1TVtBIaQ9cv8l7_aK-FSfA_0 2024-09-12T17:42:05.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.232+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10921083044861510255', time=2024-09-12T19:37:10.260162+0000, chain.objs.size()=1 2024-09-12T17:42:05.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.232+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.3sEubuJBZOwFd2OsAXTeCBnCJrxAjTm_0 2024-09-12T17:42:05.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.232+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9314301870411493764', time=2024-09-12T19:38:28.018418+0000, chain.objs.size()=1 2024-09-12T17:42:05.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.232+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.bTkstqznWPMfu6WxbUOVJ1puZgLJRQz_0 2024-09-12T17:42:05.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.232+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.773260145468623255', time=2024-09-12T19:39:14.484789+0000, chain.objs.size()=1 2024-09-12T17:42:05.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.232+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.9bVxuz9O_HJKn4qGlMDAuC3YtdBSAGi_0 2024-09-12T17:42:05.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.240+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.244+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:42:05.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:42:05.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='_vyzfajOzqYddUCNJPtZ-ZxELvr26HYe', time=2024-09-12T19:31:56.827334+0000, chain.objs.size()=2 2024-09-12T17:42:05.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.QYRA0rgiciW__ynYKKauOxxdDjKO0u3_0 2024-09-12T17:42:05.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.QYRA0rgiciW__ynYKKauOxxdDjKO0u3_1 2024-09-12T17:42:05.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.536454783019206846', time=2024-09-12T19:31:56.905142+0000, chain.objs.size()=2 2024-09-12T17:42:05.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.2v2BQmXSMhQuyoWKz_LOPCcXrcrrKyX_0 2024-09-12T17:42:05.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.2v2BQmXSMhQuyoWKz_LOPCcXrcrrKyX_1 2024-09-12T17:42:05.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3657166848837433462', time=2024-09-12T19:31:57.159562+0000, chain.objs.size()=3 2024-09-12T17:42:05.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-STANDARD.2~lXEFAOCJBpkgeBX5l5OdrMzxXuVsXnQ.1 2024-09-12T17:42:05.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-STANDARD.2~lXEFAOCJBpkgeBX5l5OdrMzxXuVsXnQ.2 2024-09-12T17:42:05.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-STANDARD.2~lXEFAOCJBpkgeBX5l5OdrMzxXuVsXnQ.3 2024-09-12T17:42:05.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13387569351947884442', time=2024-09-12T19:33:21.535239+0000, chain.objs.size()=1 2024-09-12T17:42:05.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.VGZI6I98QaezL3We14sWj7RXNIIwh-0_0 2024-09-12T17:42:05.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18050420361098857643', time=2024-09-12T19:33:21.536899+0000, chain.objs.size()=1 2024-09-12T17:42:05.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.b1gTEN7WRLPSpzuZziFFrlaWI-e5ZhU_0 2024-09-12T17:42:05.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13701012236648131869', time=2024-09-12T19:34:01.925009+0000, chain.objs.size()=1 2024-09-12T17:42:05.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.8F7l3m_iKRwKkKOPpHXO-UkiLRUoG3h_0 2024-09-12T17:42:05.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2246673881645039373', time=2024-09-12T19:34:02.051537+0000, chain.objs.size()=1 2024-09-12T17:42:05.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.k6KzNZDcMCpQf2LTimGXvAWgbPGj6qd_0 2024-09-12T17:42:05.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1885309277370603801', time=2024-09-12T19:34:54.981691+0000, chain.objs.size()=1 2024-09-12T17:42:05.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.248+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.f9vN_k2N-veWKbCBxC_gHej0_eE6cTm_0 2024-09-12T17:42:05.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8741743591096791868', time=2024-09-12T19:34:54.986589+0000, chain.objs.size()=1 2024-09-12T17:42:05.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.ZMJCJFUFMYyARI7F7k3WBUisbUMtY0R_0 2024-09-12T17:42:05.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2225146196780115962', time=2024-09-12T19:34:59.710834+0000, chain.objs.size()=1 2024-09-12T17:42:05.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.QnOuTQVxpebhPKswILtTLVkL6rICb-o_0 2024-09-12T17:42:05.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9862969518572640610', time=2024-09-12T19:35:35.478475+0000, chain.objs.size()=1 2024-09-12T17:42:05.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.WWWdu6_wDmPX2VNoYoXc49daR_gnzwe_0 2024-09-12T17:42:05.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2198588460258819491', time=2024-09-12T19:35:40.745490+0000, chain.objs.size()=1 2024-09-12T17:42:05.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.qx_H3LpdSjdn4HuqvcIDzTZbmu_amY6_0 2024-09-12T17:42:05.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7583666126345137329', time=2024-09-12T19:36:17.464845+0000, chain.objs.size()=1 2024-09-12T17:42:05.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.TaLw2ijzOAkStXJIJX9Q4fMzAsKj37R_0 2024-09-12T17:42:05.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7083960468452666776', time=2024-09-12T19:36:23.479704+0000, chain.objs.size()=1 2024-09-12T17:42:05.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.Gv56LGmts3BhDrtrcTgqoLi0_g39b5v_0 2024-09-12T17:42:05.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7748477010700908873', time=2024-09-12T19:37:52.231199+0000, chain.objs.size()=1 2024-09-12T17:42:05.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.zfT8QXbpr1BWiFZ-_FPAfulg1OV-aCg_0 2024-09-12T17:42:05.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15663849280434924610', time=2024-09-12T19:38:37.940671+0000, chain.objs.size()=1 2024-09-12T17:42:05.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.omfJNkv2orrswa5rGc0i2u8Mc9YF_FV_0 2024-09-12T17:42:05.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7761025158646124822', time=2024-09-12T19:39:14.576324+0000, chain.objs.size()=1 2024-09-12T17:42:05.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.vv-nvfNx7k3m4ZrC4-Djf3mwbDvDupO_0 2024-09-12T17:42:05.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5903686533507446077', time=2024-09-12T19:41:25.727591+0000, chain.objs.size()=1 2024-09-12T17:42:05.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.256+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18__shadow_.BoWPNcM6_wudZA7TRm3P0jaOqTu_PMe_0 2024-09-12T17:42:05.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.268+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.272+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:42:05.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:42:05.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4578272257859508826', time=2024-09-12T19:33:25.886319+0000, chain.objs.size()=1 2024-09-12T17:42:05.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.5Sh7zmL0ESVrzrPD-QMvpRMiMO-9qUi_0 2024-09-12T17:42:05.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.138123559067156047', time=2024-09-12T19:33:25.888562+0000, chain.objs.size()=1 2024-09-12T17:42:05.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.-6pGey_jwmzeqxhHCXAvXtpUjL1oqn5_0 2024-09-12T17:42:05.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8230828290079037501', time=2024-09-12T19:34:13.132858+0000, chain.objs.size()=1 2024-09-12T17:42:05.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.-RP5xFDTBlzwH5nP7LD8YQlmbDkwflU_0 2024-09-12T17:42:05.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4739580081493649674', time=2024-09-12T19:34:49.308706+0000, chain.objs.size()=1 2024-09-12T17:42:05.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.xZF-L6wyrOMxhlj2gXcbOkLgLyRizgn_0 2024-09-12T17:42:05.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14267085689517002244', time=2024-09-12T19:34:49.438968+0000, chain.objs.size()=1 2024-09-12T17:42:05.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.GgPfQ5GQqZFopapYy9fvYkEhNMd_Poa_0 2024-09-12T17:42:05.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15507564982203296962', time=2024-09-12T19:35:35.468037+0000, chain.objs.size()=1 2024-09-12T17:42:05.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.kWocH2T84qqd-8lfL9PVwNkTtIEdeU-_0 2024-09-12T17:42:05.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4366875798646466619', time=2024-09-12T19:35:35.562065+0000, chain.objs.size()=1 2024-09-12T17:42:05.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.v5qrcK69Ov8N_BULlkabFxcd2t23pbt_0 2024-09-12T17:42:05.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1166119147420994682', time=2024-09-12T19:35:40.806619+0000, chain.objs.size()=1 2024-09-12T17:42:05.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.xmLPlcwYte88RiGyrN0wsVUN_L0e0cF_0 2024-09-12T17:42:05.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3451840286770179575', time=2024-09-12T19:35:40.891891+0000, chain.objs.size()=1 2024-09-12T17:42:05.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.c6qzAgOaq7DYtaUxRb4nS2l6e2MVR1U_0 2024-09-12T17:42:05.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8805549907662697913', time=2024-09-12T19:37:03.890061+0000, chain.objs.size()=1 2024-09-12T17:42:05.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.Ult58Z__LWmYDQqP7FVsG__TZCAD2NR_0 2024-09-12T17:42:05.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16237914686305128200', time=2024-09-12T19:37:08.592905+0000, chain.objs.size()=1 2024-09-12T17:42:05.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.uvn6j-H_Ack_lkVU9XQ3zEY_aH-4CAF_0 2024-09-12T17:42:05.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11627128616597561294', time=2024-09-12T19:38:33.452852+0000, chain.objs.size()=1 2024-09-12T17:42:05.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.276+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.AeOTynuZF1JwQPXi20dCfR9UyIFOe3p_0 2024-09-12T17:42:05.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.280+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10950182217171555847', time=2024-09-12T19:41:25.699487+0000, chain.objs.size()=1 2024-09-12T17:42:05.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.280+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18__shadow_.-KLTb6abTnStm0C2AJUHhkafblI62a3_0 2024-09-12T17:42:05.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.284+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.288+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:42:05.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T17:42:05.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15872939156656258229', time=2024-09-12T19:31:56.529820+0000, chain.objs.size()=1 2024-09-12T17:42:05.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.WrPQTh8NhC3Eqq9lN0QNdghVGU3ixpg_0 2024-09-12T17:42:05.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3311967373833908892', time=2024-09-12T19:31:56.895089+0000, chain.objs.size()=1 2024-09-12T17:42:05.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.lVzESq797WaV1iLzzVfyBhZZTx8Dq65_0 2024-09-12T17:42:05.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12797598138224005477', time=2024-09-12T19:33:21.641526+0000, chain.objs.size()=1 2024-09-12T17:42:05.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.0CX_Jpr-FqNDujhfysZ4NNhD9xj3r4s_0 2024-09-12T17:42:05.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14101522181414919637', time=2024-09-12T19:33:25.961375+0000, chain.objs.size()=1 2024-09-12T17:42:05.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.S_li2RWa0ZLrwzK3Tk1MMhqWMSJuRdL_0 2024-09-12T17:42:05.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8101429482035360443', time=2024-09-12T19:34:01.973886+0000, chain.objs.size()=1 2024-09-12T17:42:05.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.oT_ptIKTaKC0F4nhgSqEsuhvJxLwvM0_0 2024-09-12T17:42:05.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14405421825358999855', time=2024-09-12T19:34:13.198970+0000, chain.objs.size()=1 2024-09-12T17:42:05.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.hHnxCeJFaUf85nfZ0G-QqeDj-ugnOUF_0 2024-09-12T17:42:05.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4049265296324337703', time=2024-09-12T19:34:59.868323+0000, chain.objs.size()=1 2024-09-12T17:42:05.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.ZZEF-6JsXHmTTjOQjb9kObQ-ZrJbLt1_0 2024-09-12T17:42:05.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12678368270963499420', time=2024-09-12T19:35:35.551031+0000, chain.objs.size()=1 2024-09-12T17:42:05.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.hLflYRC0hHs_UGxV6fE6E9lsCdnuzzO_0 2024-09-12T17:42:05.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13499874760764788112', time=2024-09-12T19:36:17.545575+0000, chain.objs.size()=1 2024-09-12T17:42:05.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.qrjaI2D7bCjzYdyK5P6TYZ_1YPg5FQz_0 2024-09-12T17:42:05.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7823166140150639403', time=2024-09-12T19:36:22.179646+0000, chain.objs.size()=1 2024-09-12T17:42:05.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.t7rEdsxyclL9JkzHznho2swHEzByIIr_0 2024-09-12T17:42:05.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3075038693318462605', time=2024-09-12T19:37:03.699225+0000, chain.objs.size()=1 2024-09-12T17:42:05.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.bMPsKcDgoOr8sqWpHHXl3chJzdHGIF7_0 2024-09-12T17:42:05.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14016666701067547618', time=2024-09-12T19:37:10.174806+0000, chain.objs.size()=1 2024-09-12T17:42:05.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.292+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.KzeUXpjUcretMkil2nIRZ3AdCxPhfuL_0 2024-09-12T17:42:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.296+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5327411025398419442', time=2024-09-12T19:37:52.073855+0000, chain.objs.size()=1 2024-09-12T17:42:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.296+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.oKH_G7piamMnxaDoOQh1YQzAblZ8Z3D_0 2024-09-12T17:42:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.296+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5204320104795716264', time=2024-09-12T19:37:52.232581+0000, chain.objs.size()=1 2024-09-12T17:42:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.296+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.ArXzo8aO4G0nbzUiAalJjnuKcyoy075_0 2024-09-12T17:42:05.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.300+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17988191061490712984', time=2024-09-12T19:39:14.423141+0000, chain.objs.size()=1 2024-09-12T17:42:05.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.300+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.3KnGnd_5s_pjKrZwJz9U4RhOpD_8lgB_0 2024-09-12T17:42:05.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.304+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.308+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:42:05.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.308+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.308+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T17:42:05.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16225867086355532915', time=2024-09-12T19:34:02.031400+0000, chain.objs.size()=1 2024-09-12T17:42:05.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.u5QXQGb9bUVSMtgWuTWL64_7_daRusj_0 2024-09-12T17:42:05.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13797706468231010405', time=2024-09-12T19:34:02.070015+0000, chain.objs.size()=1 2024-09-12T17:42:05.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.DVDdfnRW3sr0a5BD8bePVAFnQm_hoNb_0 2024-09-12T17:42:05.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7053990085273778202', time=2024-09-12T19:34:08.230890+0000, chain.objs.size()=1 2024-09-12T17:42:05.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.nsyXgc3EmmTfbvZtamdhrixdyYNS5lf_0 2024-09-12T17:42:05.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10835361675151434594', time=2024-09-12T19:34:13.177830+0000, chain.objs.size()=1 2024-09-12T17:42:05.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.JL3Aa1F5_rw-VHYLqsrGaKDh1oTomcj_0 2024-09-12T17:42:05.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11359943950375480604', time=2024-09-12T19:34:13.181537+0000, chain.objs.size()=1 2024-09-12T17:42:05.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.j0pInVWeNnvlZiwBBy_cjf0lBPzWDDf_0 2024-09-12T17:42:05.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18364825394722130790', time=2024-09-12T19:34:55.131074+0000, chain.objs.size()=1 2024-09-12T17:42:05.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.j5AoIs7q6qV9xKpUa2hoCN6lRvbzc0m_0 2024-09-12T17:42:05.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6459811815082198403', time=2024-09-12T19:35:35.467979+0000, chain.objs.size()=1 2024-09-12T17:42:05.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.eMaZTRdQXw7O2oE8M-oZ0oOxKeLCq3t_0 2024-09-12T17:42:05.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15009318321086175468', time=2024-09-12T19:35:35.569723+0000, chain.objs.size()=1 2024-09-12T17:42:05.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.AVkuhwGbc06uw4lDDeSznDPxuFzOG1n_0 2024-09-12T17:42:05.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17550732413642622981', time=2024-09-12T19:37:46.021128+0000, chain.objs.size()=1 2024-09-12T17:42:05.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.z-khGlOpaWGJMIKMNTg7GDcoNE9yjEP_0 2024-09-12T17:42:05.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14865658911728434918', time=2024-09-12T19:37:56.185952+0000, chain.objs.size()=1 2024-09-12T17:42:05.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.zKXI6Q1KXeQ6TarNB9kfYuWUAGXHuW7_0 2024-09-12T17:42:05.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6735656519549073768', time=2024-09-12T19:38:33.452975+0000, chain.objs.size()=1 2024-09-12T17:42:05.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.heV9Mt-HpcqkuGuO1kadZqHYIPcwaf9_0 2024-09-12T17:42:05.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3213549500404822683', time=2024-09-12T19:38:33.458582+0000, chain.objs.size()=1 2024-09-12T17:42:05.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.312+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.vJsL2r5mRfDHN71_wGGltqHxLUxdfk1_0 2024-09-12T17:42:05.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.316+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7767221973068685442', time=2024-09-12T19:38:37.841707+0000, chain.objs.size()=1 2024-09-12T17:42:05.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.316+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.fz5H2VreMAzHHLwNQ65S23ubFV1zuaf_0 2024-09-12T17:42:05.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.316+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17643859159490247208', time=2024-09-12T19:39:14.365339+0000, chain.objs.size()=1 2024-09-12T17:42:05.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.316+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.253clcKdtJ3YQH38WG5pfSE-8uymuPL_0 2024-09-12T17:42:05.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.316+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13899493389763491912', time=2024-09-12T19:39:14.408954+0000, chain.objs.size()=1 2024-09-12T17:42:05.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.316+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.B37er_9HwwJ3gh4ucDvgDglpIQSst8v_0 2024-09-12T17:42:05.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.320+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.324+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:42:05.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T17:42:05.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14551332519571767437', time=2024-09-12T19:31:57.476096+0000, chain.objs.size()=1 2024-09-12T17:42:05.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9__shadow_.3rYr6UhzczU2rQaEAzppwUEyWcFN7to_0 2024-09-12T17:42:05.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9761244659803284416', time=2024-09-12T19:33:21.478313+0000, chain.objs.size()=1 2024-09-12T17:42:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.aWaRftNTtxzv7K46kTKFXSaFrLEfGvS_0 2024-09-12T17:42:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9345601865610921794', time=2024-09-12T19:35:35.565480+0000, chain.objs.size()=1 2024-09-12T17:42:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.Lfh5s5mZEn77LNq6ykotDXhKRDr7-wZ_0 2024-09-12T17:42:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10025148445700584983', time=2024-09-12T19:36:28.105665+0000, chain.objs.size()=1 2024-09-12T17:42:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.FJ3qRw831YcMlHseZMmzTd9WLs5OI3j_0 2024-09-12T17:42:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1514091354749592350', time=2024-09-12T19:38:28.090917+0000, chain.objs.size()=1 2024-09-12T17:42:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.05_r65_zhD1DUwIKDxoxlFLGKoTis3Q_0 2024-09-12T17:42:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12572695644931137612', time=2024-09-12T19:38:32.169587+0000, chain.objs.size()=1 2024-09-12T17:42:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.YeSzQS4IUOET48tXZfv79TSOVloec-U_0 2024-09-12T17:42:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.759981838779335076', time=2024-09-12T19:38:33.382239+0000, chain.objs.size()=1 2024-09-12T17:42:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.XZ0YrLoXpCew6TlV99CxdD2rpJEizTK_0 2024-09-12T17:42:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.146713711204708743', time=2024-09-12T19:38:33.465842+0000, chain.objs.size()=1 2024-09-12T17:42:05.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.jYeilEHgoU7zxsC747NrYmYp90dk2C0_0 2024-09-12T17:42:05.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10615152584901409344', time=2024-09-12T19:38:37.741641+0000, chain.objs.size()=1 2024-09-12T17:42:05.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.JZIVNztRNqCqtwrfhtFKScm3cmy96K9_0 2024-09-12T17:42:05.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.830033335773004207', time=2024-09-12T19:39:14.513263+0000, chain.objs.size()=1 2024-09-12T17:42:05.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.cjd73jmjUGKdSxyis2wI0C20euNr7DN_0 2024-09-12T17:42:05.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.805310870318945996', time=2024-09-12T19:39:14.570589+0000, chain.objs.size()=1 2024-09-12T17:42:05.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.XamtWpdTwYLqP9FTFc3WWtQTfUoDg8l_0 2024-09-12T17:42:05.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14681562182655774701', time=2024-09-12T19:39:14.573249+0000, chain.objs.size()=1 2024-09-12T17:42:05.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.328+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.mUfIPzp3h-Q6641pTbT1kjetE8ZwR_T_0 2024-09-12T17:42:05.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.332+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14171665116830360249', time=2024-09-12T19:39:14.599814+0000, chain.objs.size()=1 2024-09-12T17:42:05.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.332+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.0QRC9lk9lVTuGjSUuWWp9DXrX9pbj4k_0 2024-09-12T17:42:05.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.336+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12355822922122597099', time=2024-09-12T19:41:25.798549+0000, chain.objs.size()=1 2024-09-12T17:42:05.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.336+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18__shadow_.cQVzMwdEVrgeyaer3AKW_UArzOe4Ily_0 2024-09-12T17:42:05.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.340+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.340+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:42:05.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T17:42:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1794682688058021129', time=2024-09-12T19:31:57.399260+0000, chain.objs.size()=1 2024-09-12T17:42:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8__shadow_.Lt7_gIiwDZ0UpuqXSIjABqqOTvxXZwW_0 2024-09-12T17:42:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2328193514246019475', time=2024-09-12T19:34:13.116724+0000, chain.objs.size()=1 2024-09-12T17:42:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.by5XUc42C2kQ9P3D2I5EWeVBmRafUgU_0 2024-09-12T17:42:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11612907297361800884', time=2024-09-12T19:34:59.760081+0000, chain.objs.size()=1 2024-09-12T17:42:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.VCZp19y0OO04N2X0aZEj6E6FI9jw04z_0 2024-09-12T17:42:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1366242803372929892', time=2024-09-12T19:35:35.539610+0000, chain.objs.size()=1 2024-09-12T17:42:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.XQ-nnmwqowQ7lZ8sSWyXh1hPd-QjSFZ_0 2024-09-12T17:42:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.877321879871078055', time=2024-09-12T19:35:35.666444+0000, chain.objs.size()=1 2024-09-12T17:42:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.Ttv11wDivkEkxjjOTfW_1_vbOIo-gkO_0 2024-09-12T17:42:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11186896544929252327', time=2024-09-12T19:36:17.629433+0000, chain.objs.size()=1 2024-09-12T17:42:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.dOahI72p0xGqXY_qIOXic9NGmrSH3qT_0 2024-09-12T17:42:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10575507216108562917', time=2024-09-12T19:37:03.862225+0000, chain.objs.size()=1 2024-09-12T17:42:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.RF_x0GNu5EqJ9uqjWXFN4y0-RJIMS_Q_0 2024-09-12T17:42:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.91603448613711442', time=2024-09-12T19:37:52.100791+0000, chain.objs.size()=1 2024-09-12T17:42:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.Sxa1QzgxSSK6wQIDXgBt0XNplBIiiqD_0 2024-09-12T17:42:05.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15191368969709611874', time=2024-09-12T19:38:37.955334+0000, chain.objs.size()=1 2024-09-12T17:42:05.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.344+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.UnnKA6lNF1lGbTEXjW4C_JG0ORSkEVN_0 2024-09-12T17:42:05.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.352+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:42:05.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:42:05.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8390202886560243334', time=2024-09-12T19:33:25.775922+0000, chain.objs.size()=1 2024-09-12T17:42:05.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.CAqTkIlaZcpp3tGacEkRHy8XEeEFuTT_0 2024-09-12T17:42:05.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2858782614527532389', time=2024-09-12T19:33:25.854751+0000, chain.objs.size()=1 2024-09-12T17:42:05.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.WTRfd_YloXnD45etciwSa935H12MJAR_0 2024-09-12T17:42:05.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4189947877061452488', time=2024-09-12T19:34:01.878476+0000, chain.objs.size()=1 2024-09-12T17:42:05.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_._VCdvtVOqqUi63v-bcsenP8DY0fZlRo_0 2024-09-12T17:42:05.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15793945111290700914', time=2024-09-12T19:34:02.095376+0000, chain.objs.size()=1 2024-09-12T17:42:05.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.lBEIVGYYkfvspXmvIHbpp8E-F3q_DM2_0 2024-09-12T17:42:05.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5247635472405441408', time=2024-09-12T19:34:13.220162+0000, chain.objs.size()=1 2024-09-12T17:42:05.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.wZ4uT39bxBTXJoi9oDPlBx-7JkoDVjj_0 2024-09-12T17:42:05.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3036769453553501679', time=2024-09-12T19:34:13.223554+0000, chain.objs.size()=1 2024-09-12T17:42:05.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.NRYPGdogzHP3ymfStNg4sZ1A6OEtvo__0 2024-09-12T17:42:05.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3527449733981578226', time=2024-09-12T19:34:13.348661+0000, chain.objs.size()=1 2024-09-12T17:42:05.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.7dV8lThBAUnmf8fQWApMn-jh_O4T2mw_0 2024-09-12T17:42:05.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9056985808444213406', time=2024-09-12T19:34:49.317927+0000, chain.objs.size()=1 2024-09-12T17:42:05.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.nkanH-01LKUPlb8WuMcylfO6UdjZHk3_0 2024-09-12T17:42:05.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.467304181793142516', time=2024-09-12T19:35:35.645913+0000, chain.objs.size()=1 2024-09-12T17:42:05.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.ysHGdOYkd3J2x_CazvwGnEQFvdmKDHT_0 2024-09-12T17:42:05.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2841248578272776131', time=2024-09-12T19:36:23.429156+0000, chain.objs.size()=1 2024-09-12T17:42:05.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.f8xs_R3iO6fzKNGOZads3UshmkZSgLT_0 2024-09-12T17:42:05.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10480542102498030398', time=2024-09-12T19:36:27.934401+0000, chain.objs.size()=1 2024-09-12T17:42:05.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.NR642hFtjH2O01AVhdyryHoDYdg0Nm0_0 2024-09-12T17:42:05.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12051694700377766402', time=2024-09-12T19:37:03.799862+0000, chain.objs.size()=1 2024-09-12T17:42:05.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.356+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.hnKORb8nLr2Rhdb86ATEEn-9bYtJte6_0 2024-09-12T17:42:05.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.360+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15389255877237086409', time=2024-09-12T19:37:46.148379+0000, chain.objs.size()=1 2024-09-12T17:42:05.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.360+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.sCzisteLiylOtq5UhqZqPP3QnwlJ_WT_0 2024-09-12T17:42:05.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.360+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9917372579199425057', time=2024-09-12T19:37:52.329031+0000, chain.objs.size()=1 2024-09-12T17:42:05.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.360+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.iQoUGm3NrzuT-w-koRFg_5e_ZhpFFKD_0 2024-09-12T17:42:05.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.364+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7699300577479480553', time=2024-09-12T19:38:28.122378+0000, chain.objs.size()=1 2024-09-12T17:42:05.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.364+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.aLWNp3kuOe5nyYU56ynYGskDyB09X8v_0 2024-09-12T17:42:05.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.364+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13174459503055813990', time=2024-09-12T19:38:28.214296+0000, chain.objs.size()=1 2024-09-12T17:42:05.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.364+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.SKr9Ibk4dGCBE5zvyLIr-w9hbj-Ge7S_0 2024-09-12T17:42:05.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.364+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11293711551007675139', time=2024-09-12T19:38:37.736756+0000, chain.objs.size()=1 2024-09-12T17:42:05.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.364+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.OQKrPkhzA0NMC_C7FDmKarx5mZ_jx3D_0 2024-09-12T17:42:05.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.364+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6317711493200937142', time=2024-09-12T19:39:14.628406+0000, chain.objs.size()=1 2024-09-12T17:42:05.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.364+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.yerPXhOOtmyiaYVkf40yX85MYu-_Jfx_0 2024-09-12T17:42:05.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.368+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.372+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:42:05.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.372+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.372+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.372+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:42:05.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.372+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12160401997955455530', time=2024-09-12T19:31:56.703937+0000, chain.objs.size()=7 2024-09-12T17:42:05.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.372+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11__multipart_foo.2~npb7hBg2wdwR1jQ52w4pGaz9YumDb6Y.1 2024-09-12T17:42:05.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.372+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11__shadow_foo.2~npb7hBg2wdwR1jQ52w4pGaz9YumDb6Y.1_1 2024-09-12T17:42:05.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.372+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11__multipart_foo.2~npb7hBg2wdwR1jQ52w4pGaz9YumDb6Y.2 2024-09-12T17:42:05.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.372+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11__shadow_foo.2~npb7hBg2wdwR1jQ52w4pGaz9YumDb6Y.2_1 2024-09-12T17:42:05.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.372+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11__multipart_foo.2~npb7hBg2wdwR1jQ52w4pGaz9YumDb6Y.3 2024-09-12T17:42:05.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.372+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11__shadow_foo.2~npb7hBg2wdwR1jQ52w4pGaz9YumDb6Y.3_1 2024-09-12T17:42:05.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.372+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11__multipart_foo.2~npb7hBg2wdwR1jQ52w4pGaz9YumDb6Y.4 2024-09-12T17:42:05.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.372+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18044038350532231209', time=2024-09-12T19:31:57.149683+0000, chain.objs.size()=5 2024-09-12T17:42:05.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.372+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-FROZEN.2~jQdl0gSfec2B7tWsLreqHQFvZObY7wp.1 2024-09-12T17:42:05.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.372+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__shadow_foo-FROZEN.2~jQdl0gSfec2B7tWsLreqHQFvZObY7wp.1_1 2024-09-12T17:42:05.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.376+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-FROZEN.2~jQdl0gSfec2B7tWsLreqHQFvZObY7wp.2 2024-09-12T17:42:05.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.376+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__shadow_foo-FROZEN.2~jQdl0gSfec2B7tWsLreqHQFvZObY7wp.2_1 2024-09-12T17:42:05.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.376+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-FROZEN.2~jQdl0gSfec2B7tWsLreqHQFvZObY7wp.3 2024-09-12T17:42:05.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.376+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12701893161314853621', time=2024-09-12T19:33:21.581371+0000, chain.objs.size()=1 2024-09-12T17:42:05.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.376+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.o14S0yADoGthMiyqxE_8T2ZdueA9jIQ_0 2024-09-12T17:42:05.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2025645436219626538', time=2024-09-12T19:34:08.089968+0000, chain.objs.size()=1 2024-09-12T17:42:05.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.qGFHiylenI0rTb_VOhMS04Br0kQMKTE_0 2024-09-12T17:42:05.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4554276459313786267', time=2024-09-12T19:34:08.091965+0000, chain.objs.size()=1 2024-09-12T17:42:05.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.3DAy6lTMJNg5m8H74LhfJCvDTc4S8C2_0 2024-09-12T17:42:05.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.767605869118040808', time=2024-09-12T19:34:13.349283+0000, chain.objs.size()=1 2024-09-12T17:42:05.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.CrAzhPyhEHJFdlxA9hjRfiKZCe8rjMX_0 2024-09-12T17:42:05.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5609260997984933286', time=2024-09-12T19:34:59.824932+0000, chain.objs.size()=1 2024-09-12T17:42:05.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.p7BZ_VLFsShVgB_7-7oVLWifsXUh7vy_0 2024-09-12T17:42:05.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5310235001091700073', time=2024-09-12T19:34:59.873523+0000, chain.objs.size()=1 2024-09-12T17:42:05.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.rOCjSIhzfwhm0eUQ1joMo3Pl9fahTt-_0 2024-09-12T17:42:05.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5705524228374378369', time=2024-09-12T19:34:59.875232+0000, chain.objs.size()=1 2024-09-12T17:42:05.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.eR7ru29U-whskAkrP4QxOkwl-w-Mm9l_0 2024-09-12T17:42:05.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3463732034021882032', time=2024-09-12T19:36:17.517808+0000, chain.objs.size()=1 2024-09-12T17:42:05.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.WtwoshTxnfb-EHfkahg6tULl9HA_6A6_0 2024-09-12T17:42:05.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13475956351692907120', time=2024-09-12T19:37:04.008858+0000, chain.objs.size()=1 2024-09-12T17:42:05.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.i2kriye3CIqIhqs-GMw8GLtNkowRUde_0 2024-09-12T17:42:05.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6864287847438322715', time=2024-09-12T19:37:45.933318+0000, chain.objs.size()=1 2024-09-12T17:42:05.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.bRKwafP5dnBBJ0BJJeTjmiDlf4SwGwR_0 2024-09-12T17:42:05.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6166867803614786641', time=2024-09-12T19:38:27.929710+0000, chain.objs.size()=1 2024-09-12T17:42:05.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.IstOabaRQFQA6Jej3yMqlHOmrwVfPnG_0 2024-09-12T17:42:05.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15843539405150290780', time=2024-09-12T19:38:28.119334+0000, chain.objs.size()=1 2024-09-12T17:42:05.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.380+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.fs1ienD7MAPN4zbyPZ_a1RhoBrqAY4W_0 2024-09-12T17:42:05.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.388+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1345822998959256428', time=2024-09-12T19:39:14.563767+0000, chain.objs.size()=1 2024-09-12T17:42:05.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.388+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.DZ4su_47SgOgi0PtZ06-Vbu87CknbSa_0 2024-09-12T17:42:05.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.388+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15078906247894524142', time=2024-09-12T19:41:25.756011+0000, chain.objs.size()=1 2024-09-12T17:42:05.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.388+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18__shadow_.CrcnaAixez6lt5KLgjhc9vHi5ouCbbj_0 2024-09-12T17:42:05.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.388+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.392+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:42:05.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.392+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T17:42:05.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9641450553978722621', time=2024-09-12T19:33:20.198603+0000, chain.objs.size()=1 2024-09-12T17:42:05.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.tydaYBjvBKTS1dZYwkrKqMXz3FMc3GE_0 2024-09-12T17:42:05.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.549512738981979989', time=2024-09-12T19:34:07.990210+0000, chain.objs.size()=1 2024-09-12T17:42:05.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.DDjA2KBuViPjyuYiecTuX77RucJdVVv_0 2024-09-12T17:42:05.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3389214859228440924', time=2024-09-12T19:34:08.217396+0000, chain.objs.size()=1 2024-09-12T17:42:05.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.hld41XhrgAcpR_Ao8B3eR5bZx5rFp40_0 2024-09-12T17:42:05.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.229756593794608470', time=2024-09-12T19:34:54.981786+0000, chain.objs.size()=1 2024-09-12T17:42:05.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.lAeF74OZDDZ2L4lTgFatInsHtH2uq-b_0 2024-09-12T17:42:05.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.52402251634593523', time=2024-09-12T19:34:59.972823+0000, chain.objs.size()=1 2024-09-12T17:42:05.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.n5x1e-rMkpYaOden6wGTxEQP5ylfuBG_0 2024-09-12T17:42:05.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.426946328184952049', time=2024-09-12T19:36:27.929688+0000, chain.objs.size()=1 2024-09-12T17:42:05.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.BNFB9RVWT9qDseHUvrS8kuxykCsZkhs_0 2024-09-12T17:42:05.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.857241745604089213', time=2024-09-12T19:37:03.770082+0000, chain.objs.size()=1 2024-09-12T17:42:05.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.yweo1xUBdmO978g0MvIWtI0V4VHw4DJ_0 2024-09-12T17:42:05.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4563498618687206828', time=2024-09-12T19:37:03.772397+0000, chain.objs.size()=1 2024-09-12T17:42:05.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.2kZM2rsrQHntBSXgaa80Q4WLf0O8n2B_0 2024-09-12T17:42:05.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2138438731369479984', time=2024-09-12T19:38:28.009909+0000, chain.objs.size()=1 2024-09-12T17:42:05.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.slo3NUvZP-_Yg2cA4YXTGDXRbxkS2QX_0 2024-09-12T17:42:05.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13863455656374385888', time=2024-09-12T19:38:28.011886+0000, chain.objs.size()=1 2024-09-12T17:42:05.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.396+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.hSf3O80DD7-zXuTSNslxHC8hXTyiV8j_0 2024-09-12T17:42:05.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.400+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:42:05.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T17:42:05.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='_tL-owelgoVc3T1qAvGXru3fPf8lKO-k', time=2024-09-12T19:31:57.044283+0000, chain.objs.size()=3 2024-09-12T17:42:05.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_._b9nMRh_hMlOQyxxOJoVChP2kaENDtf_0 2024-09-12T17:42:05.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_._b9nMRh_hMlOQyxxOJoVChP2kaENDtf_1 2024-09-12T17:42:05.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_._b9nMRh_hMlOQyxxOJoVChP2kaENDtf_2 2024-09-12T17:42:05.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9797377095814867287', time=2024-09-12T19:33:21.464676+0000, chain.objs.size()=1 2024-09-12T17:42:05.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.lTWVXBcNNCvQIGJnigAVwdNZo0nLf9p_0 2024-09-12T17:42:05.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2550479742096853434', time=2024-09-12T19:34:13.188388+0000, chain.objs.size()=1 2024-09-12T17:42:05.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.2EqtSqFC3FihKD_Iw7m01l6ogMKTmAX_0 2024-09-12T17:42:05.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13557383289584333930', time=2024-09-12T19:34:13.349337+0000, chain.objs.size()=1 2024-09-12T17:42:05.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.0myLjOwQVS-gNwzeFroGKb2VM9-L8Z1_0 2024-09-12T17:42:05.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14499964371010377852', time=2024-09-12T19:35:40.813783+0000, chain.objs.size()=1 2024-09-12T17:42:05.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.Uak3g6VqNghXFqy63C9wHe4BnaUap7L_0 2024-09-12T17:42:05.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16469089317598928854', time=2024-09-12T19:35:45.644733+0000, chain.objs.size()=1 2024-09-12T17:42:05.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.SBINd79wjByQqie2CdcB5Acjss-1DPo_0 2024-09-12T17:42:05.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1686835969074415374', time=2024-09-12T19:37:46.011855+0000, chain.objs.size()=1 2024-09-12T17:42:05.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.WGTJirW2Wo4nGm7rrvQPLuH9Jn-qw5R_0 2024-09-12T17:42:05.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6453420709851153514', time=2024-09-12T19:37:46.013883+0000, chain.objs.size()=1 2024-09-12T17:42:05.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.e8nj6Qq2z4m5EOaxX5xD1d9GbyU_g9z_0 2024-09-12T17:42:05.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9080811797686599090', time=2024-09-12T19:37:46.016274+0000, chain.objs.size()=1 2024-09-12T17:42:05.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.82K-LPEsqnuxSAEXDWHQkYWDQ0Hmeux_0 2024-09-12T17:42:05.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9783518828710723763', time=2024-09-12T19:37:52.215099+0000, chain.objs.size()=1 2024-09-12T17:42:05.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.404+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.v0loqS12By-Dg6r7Veoc4WLbMZ_WNhR_0 2024-09-12T17:42:05.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.408+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3892599159627130325', time=2024-09-12T19:38:28.119373+0000, chain.objs.size()=1 2024-09-12T17:42:05.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.408+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.-GB9lXksFXG0vIUyhPnbZNW7ajVcBpu_0 2024-09-12T17:42:05.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.408+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9959566588645040420', time=2024-09-12T19:38:33.452073+0000, chain.objs.size()=1 2024-09-12T17:42:05.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.408+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.tlo1UIVYwK-shCKcEAjAPFujOfPv3cJ_0 2024-09-12T17:42:05.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.408+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1122177405469106698', time=2024-09-12T19:38:37.696180+0000, chain.objs.size()=1 2024-09-12T17:42:05.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.408+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.VTE_FtsgevSPt2JRDaRt0KlavLNaNIB_0 2024-09-12T17:42:05.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.408+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14593197501882943246', time=2024-09-12T19:39:14.563822+0000, chain.objs.size()=1 2024-09-12T17:42:05.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.408+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.Pl6m7yW2p6adob3Qv8tF4SxQwRFo-tu_0 2024-09-12T17:42:05.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.408+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.653945106192650765', time=2024-09-12T19:41:35.501660+0000, chain.objs.size()=1 2024-09-12T17:42:05.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.408+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19__shadow:LtT-TJ-ytWe5ZjRbhF7.4fkEqiws5C4_.WD7OIsg7jcOMGB1iPBJE-t3-tS91ene_0 2024-09-12T17:42:05.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.416+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.416+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:42:05.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:42:05.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1404284957849971980', time=2024-09-12T19:33:25.777373+0000, chain.objs.size()=1 2024-09-12T17:42:05.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.g2EyPKJ1CquOTmZj2QDPIIaJUkIYYhB_0 2024-09-12T17:42:05.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18073313166904344477', time=2024-09-12T19:33:25.982999+0000, chain.objs.size()=1 2024-09-12T17:42:05.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.Ltxl00oDB2sN20vMXWrVzWzbYSw0Le5_0 2024-09-12T17:42:05.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16240165397777534281', time=2024-09-12T19:34:08.278304+0000, chain.objs.size()=1 2024-09-12T17:42:05.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.0H1xVr5G93N9Ln8dSSJgpmBGhLjt2pm_0 2024-09-12T17:42:05.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8917289619762738258', time=2024-09-12T19:34:59.735682+0000, chain.objs.size()=1 2024-09-12T17:42:05.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.-uipKcx-9rbANnKTGsNLbelbr1oHDOj_0 2024-09-12T17:42:05.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13833835723794439189', time=2024-09-12T19:34:59.761003+0000, chain.objs.size()=1 2024-09-12T17:42:05.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.CAFSpalCoGSijBtzr2zAYv1rtORzLIA_0 2024-09-12T17:42:05.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11025611523454955046', time=2024-09-12T19:36:17.465126+0000, chain.objs.size()=1 2024-09-12T17:42:05.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.awt9tA3CsQ_tqvMBxpv7saXp0GHrLMG_0 2024-09-12T17:42:05.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16199874846833557640', time=2024-09-12T19:36:17.591625+0000, chain.objs.size()=1 2024-09-12T17:42:05.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.TLOSMTE3-8gkbMlYYux4T-GlUZRXqi5_0 2024-09-12T17:42:05.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13163355879880411139', time=2024-09-12T19:36:23.388625+0000, chain.objs.size()=1 2024-09-12T17:42:05.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.x7fliqkfWOTVK52dvT5dXLst5hple5f_0 2024-09-12T17:42:05.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11119840338617620208', time=2024-09-12T19:36:23.629977+0000, chain.objs.size()=1 2024-09-12T17:42:05.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.6ktdjo5KlWAJwMd_RptgQHjqA7fu4Tf_0 2024-09-12T17:42:05.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8194855230813574025', time=2024-09-12T19:36:27.860079+0000, chain.objs.size()=1 2024-09-12T17:42:05.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.Q4OJPXMrTgkVGta4K-uqQH_JyJtocUT_0 2024-09-12T17:42:05.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7683540048031450628', time=2024-09-12T19:36:27.927419+0000, chain.objs.size()=1 2024-09-12T17:42:05.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.WouVFii3LsSLa0zvj7AKzU07vIkk9fr_0 2024-09-12T17:42:05.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16792185929806166693', time=2024-09-12T19:37:10.067063+0000, chain.objs.size()=1 2024-09-12T17:42:05.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.420+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.SsduZDZhdObI_X1tOm4CPaQTQ88l3XT_0 2024-09-12T17:42:05.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.424+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15105741508046862256', time=2024-09-12T19:37:46.099908+0000, chain.objs.size()=1 2024-09-12T17:42:05.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.424+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.yfseR1uIAJdRJVeGr2nZlasm9uULI7__0 2024-09-12T17:42:05.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.424+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4622511484459182701', time=2024-09-12T19:38:28.029747+0000, chain.objs.size()=1 2024-09-12T17:42:05.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.424+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.ZtlpoiutGQWz701IA6hUgdaa0HrzBAL_0 2024-09-12T17:42:05.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.424+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1335659222914658086', time=2024-09-12T19:38:33.509377+0000, chain.objs.size()=1 2024-09-12T17:42:05.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.424+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.kMJjnAwe0R3LQr2efDAqCzQUXvRH8oM_0 2024-09-12T17:42:05.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.424+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3251491117500657123', time=2024-09-12T19:41:42.010212+0000, chain.objs.size()=1 2024-09-12T17:42:05.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.424+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19__shadow:7J3C5aCe7OBr5IDkI996LBej9mAr5Mo_.aA4m4L7oFtoBSVp-_WyWBb8OCFb1WO9_0 2024-09-12T17:42:05.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.428+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:42:05.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T17:42:05.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10511557525969913233', time=2024-09-12T19:31:56.502687+0000, chain.objs.size()=1 2024-09-12T17:42:05.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.lvOO4BvIVqShv2L9c6gBWldUoZPjBZR_0 2024-09-12T17:42:05.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='_RtXW7np_bVEXyCw5_ywMGd1kTEJ69Al', time=2024-09-12T19:31:56.816383+0000, chain.objs.size()=1 2024-09-12T17:42:05.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.7crKhVOKl17n2vUOfk_X0vSzkf6ho99_0 2024-09-12T17:42:05.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.795468978822280530', time=2024-09-12T19:31:56.926364+0000, chain.objs.size()=2 2024-09-12T17:42:05.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.AAo2fbUfygtrhQBYVIc2lkOCfwQ36ro_0 2024-09-12T17:42:05.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.AAo2fbUfygtrhQBYVIc2lkOCfwQ36ro_1 2024-09-12T17:42:05.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7571909418216920418', time=2024-09-12T19:31:57.077499+0000, chain.objs.size()=5 2024-09-12T17:42:05.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.1 2024-09-12T17:42:05.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.1_1 2024-09-12T17:42:05.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.2 2024-09-12T17:42:05.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.2_1 2024-09-12T17:42:05.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.3 2024-09-12T17:42:05.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6361960372815130445', time=2024-09-12T19:31:57.244196+0000, chain.objs.size()=3 2024-09-12T17:42:05.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14__shadow_.gclBoRI-xKUBe-DwEMdlOhb5EQQjMsJ_0 2024-09-12T17:42:05.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14__shadow_.gclBoRI-xKUBe-DwEMdlOhb5EQQjMsJ_1 2024-09-12T17:42:05.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.432+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14__shadow_.gclBoRI-xKUBe-DwEMdlOhb5EQQjMsJ_2 2024-09-12T17:42:05.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13855174368489502723', time=2024-09-12T19:34:08.114702+0000, chain.objs.size()=1 2024-09-12T17:42:05.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.uzX04EgyfSEpnr5_vEEFWfqeFJQ3ufp_0 2024-09-12T17:42:05.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.427650192933477747', time=2024-09-12T19:34:08.282471+0000, chain.objs.size()=1 2024-09-12T17:42:05.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.UWvGsws57BK_2FvMWVnx04Ip1JROGzi_0 2024-09-12T17:42:05.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4843108024593471370', time=2024-09-12T19:34:08.284844+0000, chain.objs.size()=1 2024-09-12T17:42:05.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.rWSppAl42pl5M2V4d9uLOa3WztDRN9s_0 2024-09-12T17:42:05.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10415711430363493388', time=2024-09-12T19:34:49.326457+0000, chain.objs.size()=1 2024-09-12T17:42:05.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.1FHWpfKzGHN3xqr1Jo0EGPS23SyC46-_0 2024-09-12T17:42:05.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5267734581986432958', time=2024-09-12T19:34:49.328479+0000, chain.objs.size()=1 2024-09-12T17:42:05.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.kOQoBTnhdPuhE4aW4rkzOwMupDJgfyM_0 2024-09-12T17:42:05.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9635141191204920724', time=2024-09-12T19:34:59.769409+0000, chain.objs.size()=1 2024-09-12T17:42:05.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.ekoD3GhYrUwfRCZ2_IGeqELewiR6Jn1_0 2024-09-12T17:42:05.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12617759692094835150', time=2024-09-12T19:34:59.846492+0000, chain.objs.size()=1 2024-09-12T17:42:05.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.Q8FEGDICJX-SbFbPp-CU7OTyvqDkXkU_0 2024-09-12T17:42:05.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14785025475254458832', time=2024-09-12T19:36:17.433565+0000, chain.objs.size()=1 2024-09-12T17:42:05.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.KsVkI2iSdk2EJFSXAbC0_CR75LoKpTd_0 2024-09-12T17:42:05.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8120896955898079303', time=2024-09-12T19:36:27.833692+0000, chain.objs.size()=1 2024-09-12T17:42:05.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.6axz_sNlzZdNiOBIMzLnUakwImLkt_d_0 2024-09-12T17:42:05.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13390442522869127544', time=2024-09-12T19:37:10.044945+0000, chain.objs.size()=1 2024-09-12T17:42:05.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.436+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.HvdTZnZ0aLIRuKHuScLdEfd17SUI1AH_0 2024-09-12T17:42:05.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.440+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17205898093173641978', time=2024-09-12T19:37:10.068558+0000, chain.objs.size()=1 2024-09-12T17:42:05.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.440+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.b7qEIcFpil6UPZvCz8iHbfy-0a9UHy-_0 2024-09-12T17:42:05.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.440+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.550623031076255461', time=2024-09-12T19:37:10.139997+0000, chain.objs.size()=1 2024-09-12T17:42:05.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.440+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.9bQU4hWWR65raUKXfsxKeX3fveKCnbS_0 2024-09-12T17:42:05.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.440+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5499343414249375647', time=2024-09-12T19:37:52.119966+0000, chain.objs.size()=1 2024-09-12T17:42:05.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.440+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.ZeJtoKMitBP7u78rjP4gopcKmiLj_qo_0 2024-09-12T17:42:05.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.440+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3555321296247600956', time=2024-09-12T19:37:52.169235+0000, chain.objs.size()=1 2024-09-12T17:42:05.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.440+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.ex_9MU7xI9DxkszgQNpb_fGi3-kvrci_0 2024-09-12T17:42:05.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.440+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7974663563234723964', time=2024-09-12T19:38:33.471413+0000, chain.objs.size()=1 2024-09-12T17:42:05.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.440+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.6LgEBs_6ValED4SG9rBybJB42QEYW6z_0 2024-09-12T17:42:05.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.444+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7997242445276457193', time=2024-09-12T19:41:42.005435+0000, chain.objs.size()=1 2024-09-12T17:42:05.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.444+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19__shadow:tvLfpGA-DDcE2K3-gAxeM2U8kKn6k2V_.3EvqTCzgArfCghxtm8no4dwr7pY3cYY_0 2024-09-12T17:42:05.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.448+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.448+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:42:05.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T17:42:05.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5604725477027928390', time=2024-09-12T19:31:57.030252+0000, chain.objs.size()=3 2024-09-12T17:42:05.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-STANDARD.2~B2dC-mdSBfQtqUfRQPYLAC99mRrHXTB.1 2024-09-12T17:42:05.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-STANDARD.2~B2dC-mdSBfQtqUfRQPYLAC99mRrHXTB.2 2024-09-12T17:42:05.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-STANDARD.2~B2dC-mdSBfQtqUfRQPYLAC99mRrHXTB.3 2024-09-12T17:42:05.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8502928286335774732', time=2024-09-12T19:31:57.487378+0000, chain.objs.size()=1 2024-09-12T17:42:05.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9__shadow_.Bfg8OJ5q6Hfg7MT1LXzquwJ1ezbq923_0 2024-09-12T17:42:05.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10352996056912781285', time=2024-09-12T19:33:26.024293+0000, chain.objs.size()=1 2024-09-12T17:42:05.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.Bv1l0wpjcdTnVVwDWwQrXBWIs_zR1LC_0 2024-09-12T17:42:05.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12461838841134890934', time=2024-09-12T19:34:08.320059+0000, chain.objs.size()=1 2024-09-12T17:42:05.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.giYfmw6TU71NjaxImSTZBty-QeYU1yP_0 2024-09-12T17:42:05.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7284909939261335389', time=2024-09-12T19:34:49.227859+0000, chain.objs.size()=1 2024-09-12T17:42:05.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.do4Q6BkgnnjQ5w6dtXsqx1qhAqz-7Pk_0 2024-09-12T17:42:05.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6194181305675556914', time=2024-09-12T19:34:53.455982+0000, chain.objs.size()=1 2024-09-12T17:42:05.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.fsdlI6GLM-zry-LRGHJYrJGqyvCLcsT_0 2024-09-12T17:42:05.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18282683165232284675', time=2024-09-12T19:35:03.502291+0000, chain.objs.size()=1 2024-09-12T17:42:05.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.lIBel3-IGttf27DX6ZqvLj_zcFe23Ei_0 2024-09-12T17:42:05.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7788364168717275829', time=2024-09-12T19:36:28.061363+0000, chain.objs.size()=1 2024-09-12T17:42:05.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.bPOZg2XigjniL7oYERbiP3De4EFUVOL_0 2024-09-12T17:42:05.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13542057742795577320', time=2024-09-12T19:37:10.043806+0000, chain.objs.size()=1 2024-09-12T17:42:05.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.fVbKY9j8iAIsVYPxzCjzQMZrGXETPHx_0 2024-09-12T17:42:05.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12654840268883988822', time=2024-09-12T19:37:46.165314+0000, chain.objs.size()=1 2024-09-12T17:42:05.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.452+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.B_DtUamijU0L9OoHbJxhoPVrLEsK9ex_0 2024-09-12T17:42:05.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.456+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11121358372327939496', time=2024-09-12T19:37:52.317470+0000, chain.objs.size()=1 2024-09-12T17:42:05.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.456+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.HWsgOarYyhP-YqTW9p7lxFALBVsj12q_0 2024-09-12T17:42:05.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.456+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9004842060029166111', time=2024-09-12T19:38:27.992972+0000, chain.objs.size()=1 2024-09-12T17:42:05.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.456+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.1hhjYocTr0SqLgpLl26oM6geh4NXaML_0 2024-09-12T17:42:05.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.456+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5807459776265694746', time=2024-09-12T19:38:28.213958+0000, chain.objs.size()=1 2024-09-12T17:42:05.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.456+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.7LZsuNv1-UiTiF0YBBib0GUF6JqCjd__0 2024-09-12T17:42:05.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.456+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11670975537814447516', time=2024-09-12T19:38:37.845692+0000, chain.objs.size()=1 2024-09-12T17:42:05.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.456+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.u4Zl3a57Np0pmwN7OvWPLeNfMpcGbJE_0 2024-09-12T17:42:05.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.456+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11126544323927181738', time=2024-09-12T19:39:14.325007+0000, chain.objs.size()=1 2024-09-12T17:42:05.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.456+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.duTCbUl8SRWc_L9uvyiDlF8vHs3FzLZ_0 2024-09-12T17:42:05.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.456+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11276293479777380881', time=2024-09-12T19:41:25.735085+0000, chain.objs.size()=1 2024-09-12T17:42:05.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.456+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18__shadow_.CEdlwzj0cqcDMHgq6Q56WZ7SgYoLnx4_0 2024-09-12T17:42:05.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.456+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7763600250061973359', time=2024-09-12T19:41:25.755840+0000, chain.objs.size()=1 2024-09-12T17:42:05.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.456+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18__shadow_.erxCbU1Ui4NAhbMyelpcghMmQSO08ps_0 2024-09-12T17:42:05.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.460+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.464+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:42:05.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.464+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.464+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T17:42:05.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16379098036230393502', time=2024-09-12T19:31:56.488440+0000, chain.objs.size()=1 2024-09-12T17:42:05.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.eFC-N9HyrVBnEw4shBfSyUnju8bhL2-_0 2024-09-12T17:42:05.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2023055123320550331', time=2024-09-12T19:31:56.537467+0000, chain.objs.size()=1 2024-09-12T17:42:05.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.Z4k9iij9KR06iX-H_WP_eq0OJjAi0ME_0 2024-09-12T17:42:05.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4957205627766043379', time=2024-09-12T19:31:56.885774+0000, chain.objs.size()=2 2024-09-12T17:42:05.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.2v2BQmXSMhQuyoWKz_LOPCcXrcrrKyX_0 2024-09-12T17:42:05.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.2v2BQmXSMhQuyoWKz_LOPCcXrcrrKyX_1 2024-09-12T17:42:05.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='_6Cp19SFwLgrTgXJjNTLEhT95uQDd1Kb', time=2024-09-12T19:31:57.022689+0000, chain.objs.size()=3 2024-09-12T17:42:05.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.8xWqNDXH8r24Uuox-XNHwNZB4ussicd_0 2024-09-12T17:42:05.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.8xWqNDXH8r24Uuox-XNHwNZB4ussicd_1 2024-09-12T17:42:05.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.8xWqNDXH8r24Uuox-XNHwNZB4ussicd_2 2024-09-12T17:42:05.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13091350954197062429', time=2024-09-12T19:33:25.771510+0000, chain.objs.size()=1 2024-09-12T17:42:05.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.sBegZrmVbIjdBAuZPiGUiq4R2h5AYug_0 2024-09-12T17:42:05.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1588219651570968794', time=2024-09-12T19:34:08.013507+0000, chain.objs.size()=1 2024-09-12T17:42:05.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.hSNv6v6J8meZA5B7TvyhEtr4Am0k4rh_0 2024-09-12T17:42:05.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3426417776970918359', time=2024-09-12T19:34:08.217247+0000, chain.objs.size()=1 2024-09-12T17:42:05.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.4ORp5zFHNk2FShs1dtdpRVOigAOxG5a_0 2024-09-12T17:42:05.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2996297629948770049', time=2024-09-12T19:34:13.262900+0000, chain.objs.size()=1 2024-09-12T17:42:05.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.HqqYjVbIekpBLbzgu30pdqGUG_cwYQy_0 2024-09-12T17:42:05.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13322069518672142214', time=2024-09-12T19:34:49.414425+0000, chain.objs.size()=1 2024-09-12T17:42:05.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.wqG1WV-1OvY-RRhKNrJg9996VRYo6lH_0 2024-09-12T17:42:05.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17885503905620799813', time=2024-09-12T19:34:55.066620+0000, chain.objs.size()=1 2024-09-12T17:42:05.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.yeEDVtmdzLRGfz4hy02b4f9n-LRYMvn_0 2024-09-12T17:42:05.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.468+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17389741597582886247', time=2024-09-12T19:36:17.666119+0000, chain.objs.size()=1 2024-09-12T17:42:05.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.CtlPaMg1amN9SqWGQQrJRYIsIRrHDD__0 2024-09-12T17:42:05.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17684779580907140979', time=2024-09-12T19:36:27.929955+0000, chain.objs.size()=1 2024-09-12T17:42:05.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.ebioBI-JlST8W_PngUGYJUJF3EM579o_0 2024-09-12T17:42:05.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10198931838207098126', time=2024-09-12T19:36:27.931888+0000, chain.objs.size()=1 2024-09-12T17:42:05.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.SKt4VdBDR_FAFovrka74-p7viVcZqrG_0 2024-09-12T17:42:05.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6209731843939273881', time=2024-09-12T19:37:03.753006+0000, chain.objs.size()=1 2024-09-12T17:42:05.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.9Pov0dFCrhM462wbXzP5T8Zqi76EiaT_0 2024-09-12T17:42:05.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4951614966821380151', time=2024-09-12T19:37:03.888569+0000, chain.objs.size()=1 2024-09-12T17:42:05.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.arMMqyvej5adYIGYHc3EqnbJiaCkoYB_0 2024-09-12T17:42:05.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2994568200588858347', time=2024-09-12T19:37:10.033462+0000, chain.objs.size()=1 2024-09-12T17:42:05.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.Si9-OxMg-zF9iX-Bnu91klOx3coOI88_0 2024-09-12T17:42:05.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.610937069520271710', time=2024-09-12T19:37:10.164174+0000, chain.objs.size()=1 2024-09-12T17:42:05.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.gM3DWoIMJHadbRV-utHGgn6ABGt3ysx_0 2024-09-12T17:42:05.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4331942329317864496', time=2024-09-12T19:37:46.078990+0000, chain.objs.size()=1 2024-09-12T17:42:05.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.SrSWJrUO72KrpVher3xl7BH4zshJphH_0 2024-09-12T17:42:05.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15153949650493986082', time=2024-09-12T19:38:28.111620+0000, chain.objs.size()=1 2024-09-12T17:42:05.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.Jul9eXd62Wac8s8Cw4AzzIbKmB_iap9_0 2024-09-12T17:42:05.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4877387685261623578', time=2024-09-12T19:38:33.613912+0000, chain.objs.size()=1 2024-09-12T17:42:05.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.472+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.WMCZdcALmaQCOV0hGf0qJIim8E36_2f_0 2024-09-12T17:42:05.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.476+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:42:05.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T17:42:05.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5192372696479772500', time=2024-09-12T19:31:56.650006+0000, chain.objs.size()=7 2024-09-12T17:42:05.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13__multipart_foo.2~JjUitW07m0VBazlIoCHQ2aR9JxP80Mc.1 2024-09-12T17:42:05.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13__shadow_foo.2~JjUitW07m0VBazlIoCHQ2aR9JxP80Mc.1_1 2024-09-12T17:42:05.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13__multipart_foo.2~JjUitW07m0VBazlIoCHQ2aR9JxP80Mc.2 2024-09-12T17:42:05.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13__shadow_foo.2~JjUitW07m0VBazlIoCHQ2aR9JxP80Mc.2_1 2024-09-12T17:42:05.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13__multipart_foo.2~JjUitW07m0VBazlIoCHQ2aR9JxP80Mc.3 2024-09-12T17:42:05.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13__shadow_foo.2~JjUitW07m0VBazlIoCHQ2aR9JxP80Mc.3_1 2024-09-12T17:42:05.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13__multipart_foo.2~JjUitW07m0VBazlIoCHQ2aR9JxP80Mc.4 2024-09-12T17:42:05.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='_zAfoNxG11RS4vyaaEOVqlYCXLKZIeef', time=2024-09-12T19:31:56.857265+0000, chain.objs.size()=2 2024-09-12T17:42:05.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.AWhWLUmlzGAaJTNambI2iujLsm8uuCf_0 2024-09-12T17:42:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.AWhWLUmlzGAaJTNambI2iujLsm8uuCf_1 2024-09-12T17:42:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='_vKhIN7KsUBZkHYArVQrYxS6W_QClmLl', time=2024-09-12T19:31:56.876343+0000, chain.objs.size()=2 2024-09-12T17:42:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.gL-oFHKm6ODmx8hP84x0vaQL8OgPgLn_0 2024-09-12T17:42:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.gL-oFHKm6ODmx8hP84x0vaQL8OgPgLn_1 2024-09-12T17:42:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7509008032571970361', time=2024-09-12T19:33:25.791581+0000, chain.objs.size()=1 2024-09-12T17:42:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.480+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.xBz825x-fGrgopbF6v7TlWB4EvDUk6g_0 2024-09-12T17:42:05.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.484+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5799237510283261833', time=2024-09-12T19:34:01.837822+0000, chain.objs.size()=1 2024-09-12T17:42:05.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.484+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.AHIp3vaRzw4fLLxGLksfSJScV33Of7N_0 2024-09-12T17:42:05.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.484+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3525418297337943422', time=2024-09-12T19:34:01.936918+0000, chain.objs.size()=1 2024-09-12T17:42:05.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.484+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.wh6FLPJN9_wgecjqHbCae8aapzAVIUz_0 2024-09-12T17:42:05.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.484+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16233157251241278484', time=2024-09-12T19:34:49.238208+0000, chain.objs.size()=1 2024-09-12T17:42:05.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.484+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.64CL2w1zT9ZrmvDD65q7X-dB0mtCH9S_0 2024-09-12T17:42:05.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.484+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13424072008447596313', time=2024-09-12T19:34:54.995879+0000, chain.objs.size()=1 2024-09-12T17:42:05.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.484+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.UKBjy2hpQB1ceA_d-bXYksOcnXsS6J-_0 2024-09-12T17:42:05.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.488+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.109478677592956693', time=2024-09-12T19:34:59.729748+0000, chain.objs.size()=1 2024-09-12T17:42:05.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.488+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.DtaUj3FkXcHjruS45UUtTvmw3lSPxuG_0 2024-09-12T17:42:05.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.488+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17433250742748504199', time=2024-09-12T19:35:35.510701+0000, chain.objs.size()=1 2024-09-12T17:42:05.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.488+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.MchZoYYeHSgvJ9EcwLhfSI5dNTq72Yn_0 2024-09-12T17:42:05.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.488+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15115934786452700718', time=2024-09-12T19:36:17.546335+0000, chain.objs.size()=1 2024-09-12T17:42:05.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.488+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.Sz789g0_PBAqpGWP_qbfMJtvcxX6asN_0 2024-09-12T17:42:05.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.488+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15382056246675421608', time=2024-09-12T19:36:27.861609+0000, chain.objs.size()=1 2024-09-12T17:42:05.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.488+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.qqQT5XEbAuMiiy_P6Rcj9I98WCaBTZQ_0 2024-09-12T17:42:05.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.488+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11978151648969876942', time=2024-09-12T19:36:27.934774+0000, chain.objs.size()=1 2024-09-12T17:42:05.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.488+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.fxfWwcr8iNAbUObURMkwdrh7ITMxrHU_0 2024-09-12T17:42:05.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.488+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9546952800891810104', time=2024-09-12T19:37:03.935719+0000, chain.objs.size()=1 2024-09-12T17:42:05.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.488+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.OfcyjVfKKkH3vDN-t5C_zNNhNy3LgJM_0 2024-09-12T17:42:05.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.488+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11221147785576409533', time=2024-09-12T19:38:33.603480+0000, chain.objs.size()=1 2024-09-12T17:42:05.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.488+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.Vcw3fJC2DKhJsqKBczOpOGyW1Rchf48_0 2024-09-12T17:42:05.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.492+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4702548201424768230', time=2024-09-12T19:38:37.973177+0000, chain.objs.size()=1 2024-09-12T17:42:05.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.492+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.fuE-aqf5Cl8yh6gTRra2PVzGDHwx_K1_0 2024-09-12T17:42:05.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.492+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16547197149657512141', time=2024-09-12T19:39:14.412635+0000, chain.objs.size()=1 2024-09-12T17:42:05.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.492+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.Kwqqeo28s6I41gNAJH4-3iDvx_vRq4c_0 2024-09-12T17:42:05.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.496+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.496+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:42:05.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T17:42:05.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9555249048264848867', time=2024-09-12T19:31:56.998177+0000, chain.objs.size()=5 2024-09-12T17:42:05.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.1 2024-09-12T17:42:05.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.1_1 2024-09-12T17:42:05.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.2 2024-09-12T17:42:05.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.2_1 2024-09-12T17:42:05.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-FROZEN.2~ZaRLGvkVZKoOcDxOKNwERspNh3sEQQG.3 2024-09-12T17:42:05.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4403033759848450654', time=2024-09-12T19:33:21.538230+0000, chain.objs.size()=1 2024-09-12T17:42:05.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.cX_kTHu9ELq1j6NXaWux6vp1ICYWBy4_0 2024-09-12T17:42:05.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8839370610976502708', time=2024-09-12T19:33:21.542841+0000, chain.objs.size()=1 2024-09-12T17:42:05.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.2fhjKc6opY4wVg0SEOAvvE8xGGv_T7b_0 2024-09-12T17:42:05.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8070007102932599590', time=2024-09-12T19:34:13.129356+0000, chain.objs.size()=1 2024-09-12T17:42:05.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.NDekeEXE4psFyPocIsN2p_n5Qxf2ljs_0 2024-09-12T17:42:05.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9446621592606501826', time=2024-09-12T19:34:13.190015+0000, chain.objs.size()=1 2024-09-12T17:42:05.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.OFjcUAYqP6Ur8GRoS5ECkAChGTQMWIT_0 2024-09-12T17:42:05.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10408454723534788753', time=2024-09-12T19:34:13.192131+0000, chain.objs.size()=1 2024-09-12T17:42:05.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.VCCbE3W94Z-81hSf2BoS-n4bj1U7WO5_0 2024-09-12T17:42:05.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7917775893976177682', time=2024-09-12T19:34:54.930396+0000, chain.objs.size()=1 2024-09-12T17:42:05.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.tWdYIiCw6RODmdXBycUfu1q780IVGF5_0 2024-09-12T17:42:05.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14719089980709283335', time=2024-09-12T19:34:59.758939+0000, chain.objs.size()=1 2024-09-12T17:42:05.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.500+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.f87FWdOgNd6rf2P1oJrgtL1wwip5hl0_0 2024-09-12T17:42:05.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5806631719418471605', time=2024-09-12T19:35:40.806576+0000, chain.objs.size()=1 2024-09-12T17:42:05.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.DWxqd9YS7ihEdnk_21YY4acPGwJNzz7_0 2024-09-12T17:42:05.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7221230041752113354', time=2024-09-12T19:35:40.964790+0000, chain.objs.size()=1 2024-09-12T17:42:05.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.pgrX7y-AfRGdxk-6g6qaWtkmehY53OF_0 2024-09-12T17:42:05.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16336265027287452112', time=2024-09-12T19:35:40.970998+0000, chain.objs.size()=1 2024-09-12T17:42:05.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.b2Wa1qGA8yo50TpQwsj5kkwMoWtC05E_0 2024-09-12T17:42:05.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7681929712604160947', time=2024-09-12T19:36:17.531334+0000, chain.objs.size()=1 2024-09-12T17:42:05.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.xoadLIB-fvtRWZwETE4WF5yiqy_LiYF_0 2024-09-12T17:42:05.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3357418492921773315', time=2024-09-12T19:36:17.532676+0000, chain.objs.size()=1 2024-09-12T17:42:05.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.EwRrFZheePoWcbR3qcPiTqPj_uK28Wv_0 2024-09-12T17:42:05.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16412725969166034752', time=2024-09-12T19:36:27.862271+0000, chain.objs.size()=1 2024-09-12T17:42:05.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.cuHGyCHoBAifqyYJKQXgNJQTnrpPK_5_0 2024-09-12T17:42:05.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11337780983336498503', time=2024-09-12T19:37:03.708787+0000, chain.objs.size()=1 2024-09-12T17:42:05.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.8uoRFfDAnS4Cf6ocEjv7eUcxSz0TKrC_0 2024-09-12T17:42:05.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8074142791517745875', time=2024-09-12T19:37:03.783860+0000, chain.objs.size()=1 2024-09-12T17:42:05.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.X3gi-CaUsFEYJAMXrS4A47hwiEL1Oy1_0 2024-09-12T17:42:05.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2250314691635777720', time=2024-09-12T19:37:04.023991+0000, chain.objs.size()=1 2024-09-12T17:42:05.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.CTzLekpVSaqw0iGcOB-EoBsNP3GrwAh_0 2024-09-12T17:42:05.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7918254206752107984', time=2024-09-12T19:38:37.740529+0000, chain.objs.size()=1 2024-09-12T17:42:05.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.cO1YOG_Y77xvf8FBGJQKAjx1rnXy8Mi_0 2024-09-12T17:42:05.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15976366968252457894', time=2024-09-12T19:38:42.455766+0000, chain.objs.size()=1 2024-09-12T17:42:05.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.504+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.L056mOrN0DWSdHk_7P9TojeyHu8wI_z_0 2024-09-12T17:42:05.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.508+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:42:05.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:42:05.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5720086665172111917', time=2024-09-12T19:31:56.496258+0000, chain.objs.size()=1 2024-09-12T17:42:05.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.gLr-IHpkpCRJziEc24p9odBVtFELoxy_0 2024-09-12T17:42:05.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10274638960181617382', time=2024-09-12T19:33:21.585158+0000, chain.objs.size()=1 2024-09-12T17:42:05.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.RzVX0f_tdJc7P1hRcyYZzEtLB3NS2bK_0 2024-09-12T17:42:05.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14193070029094385650', time=2024-09-12T19:34:02.051493+0000, chain.objs.size()=1 2024-09-12T17:42:05.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.ovGd0SKj6-BgUquW7RvgJAKQQxYNciF_0 2024-09-12T17:42:05.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2921505356052298735', time=2024-09-12T19:34:06.147139+0000, chain.objs.size()=1 2024-09-12T17:42:05.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.iWwa1M8_r1JdvetfOiC0e10KQEBJyg7_0 2024-09-12T17:42:05.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.41732943245839910', time=2024-09-12T19:34:08.098841+0000, chain.objs.size()=1 2024-09-12T17:42:05.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.jIBpC1nn3-EGmdW2rskw8jA7-OhJqFV_0 2024-09-12T17:42:05.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4347211727559776968', time=2024-09-12T19:34:49.316832+0000, chain.objs.size()=1 2024-09-12T17:42:05.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.4705KO1Fq3fr55HhfwHF-Ci3XPFahNu_0 2024-09-12T17:42:05.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16160861399376560958', time=2024-09-12T19:34:54.981860+0000, chain.objs.size()=1 2024-09-12T17:42:05.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.-bdaAwyR-ykRCobloL_lhYE7PgRGeGD_0 2024-09-12T17:42:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16054747041090985250', time=2024-09-12T19:34:59.927261+0000, chain.objs.size()=1 2024-09-12T17:42:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.MU8kNzP8g3kMZZENLA4wnnqjQek9RFY_0 2024-09-12T17:42:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4494146504608617984', time=2024-09-12T19:35:39.317580+0000, chain.objs.size()=1 2024-09-12T17:42:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.SYopFO7CYPWDq84oUUed3E9N1ssBfHK_0 2024-09-12T17:42:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11112041448054528951', time=2024-09-12T19:35:40.888226+0000, chain.objs.size()=1 2024-09-12T17:42:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.fXXxIDJkfXqCHSDoYI__zxhoDh2yvAz_0 2024-09-12T17:42:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2964783385071630762', time=2024-09-12T19:36:23.573970+0000, chain.objs.size()=1 2024-09-12T17:42:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.khv3_8fvmJfZ2AJRyGrEViOfzRTsHPh_0 2024-09-12T17:42:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10816138253977713725', time=2024-09-12T19:36:23.606334+0000, chain.objs.size()=1 2024-09-12T17:42:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.512+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.dOxKZdtWOXy2jweZAO-bStxmk9Ut3YM_0 2024-09-12T17:42:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.516+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6798206876917460092', time=2024-09-12T19:36:27.871622+0000, chain.objs.size()=1 2024-09-12T17:42:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.516+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.sUti2ljzZkn-RkTp_0Vhg0ex7eUCN1Y_0 2024-09-12T17:42:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.516+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13525524980774583183', time=2024-09-12T19:37:52.156260+0000, chain.objs.size()=1 2024-09-12T17:42:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.516+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.y6kNCEhZIFCRg02GV2sJsnmEIZaXgOz_0 2024-09-12T17:42:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.516+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6758359623754527588', time=2024-09-12T19:37:52.159158+0000, chain.objs.size()=1 2024-09-12T17:42:05.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.516+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.ygjudCtk-cTtF5uNkSLqwdU_IdeKYpJ_0 2024-09-12T17:42:05.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.520+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5820809034222449592', time=2024-09-12T19:38:33.585138+0000, chain.objs.size()=1 2024-09-12T17:42:05.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.520+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.GUlNNIKv2VZ5sDhLSC8ZEfyo-TkA0y7_0 2024-09-12T17:42:05.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.524+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.524+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:42:05.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T17:42:05.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16804753628595489948', time=2024-09-12T19:31:56.555482+0000, chain.objs.size()=1 2024-09-12T17:42:05.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.C4oIweLYqaELhDMcCj2gz1umVZYQtXm_0 2024-09-12T17:42:05.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11549448654676767792', time=2024-09-12T19:33:25.860128+0000, chain.objs.size()=1 2024-09-12T17:42:05.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.54GzRZnggFNhlUMo83tb_jpqVxEmcS0_0 2024-09-12T17:42:05.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17162066548060016042', time=2024-09-12T19:34:01.940840+0000, chain.objs.size()=1 2024-09-12T17:42:05.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.nG4X9oGpAV7tiAOq8NXLN_jcJ99owyZ_0 2024-09-12T17:42:05.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11029867770568032298', time=2024-09-12T19:34:01.942852+0000, chain.objs.size()=1 2024-09-12T17:42:05.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.K2WqOTn9jxppjkLXZ_vUZpqFEEup-vh_0 2024-09-12T17:42:05.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6855902596908992561', time=2024-09-12T19:34:13.188250+0000, chain.objs.size()=1 2024-09-12T17:42:05.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.psraco0CHjMRGBfWMsYMiFdQ_lFegnA_0 2024-09-12T17:42:05.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1713149695856722914', time=2024-09-12T19:34:54.995322+0000, chain.objs.size()=1 2024-09-12T17:42:05.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.1PPMZmAphEV0JN-V83Yw0Hg6whk4KkQ_0 2024-09-12T17:42:05.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6729293510066455478', time=2024-09-12T19:34:55.120576+0000, chain.objs.size()=1 2024-09-12T17:42:05.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.0ytdhmmxafveAe0QPtvNE4bj2e5HF6q_0 2024-09-12T17:42:05.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10807788776510946451', time=2024-09-12T19:34:55.145523+0000, chain.objs.size()=1 2024-09-12T17:42:05.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.faY6ZhakbH4GIacDHjT6ZwecAXBxHxA_0 2024-09-12T17:42:05.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8803294183924234530', time=2024-09-12T19:34:59.672013+0000, chain.objs.size()=1 2024-09-12T17:42:05.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.rM__bqnQxrCmwPyjvr8Wio-rda8xhRc_0 2024-09-12T17:42:05.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6013963379036321057', time=2024-09-12T19:35:40.821596+0000, chain.objs.size()=1 2024-09-12T17:42:05.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.UfbxnnUdmgZknZP6NLJ23JgNhiT5pby_0 2024-09-12T17:42:05.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5689797446895967339', time=2024-09-12T19:36:17.397862+0000, chain.objs.size()=1 2024-09-12T17:42:05.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.Mlzf4w_WFSqgJxyWCUF-Bh2RDr1A-wM_0 2024-09-12T17:42:05.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13515147051689810775', time=2024-09-12T19:37:02.449458+0000, chain.objs.size()=1 2024-09-12T17:42:05.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.528+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.8YXwxwRmJcdr5xlk-gx9gpjKoFoju0S_0 2024-09-12T17:42:05.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.532+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5354658240562690158', time=2024-09-12T19:37:10.179607+0000, chain.objs.size()=1 2024-09-12T17:42:05.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.532+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.kLncBxyi2-lKH54Q3VFViFkRe83Lc1N_0 2024-09-12T17:42:05.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.532+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6774330962584543064', time=2024-09-12T19:37:46.011914+0000, chain.objs.size()=1 2024-09-12T17:42:05.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.532+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.OirVwkHjTBlQDTJP-rFV5OPWm9IvQiW_0 2024-09-12T17:42:05.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.532+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.646294090363252635', time=2024-09-12T19:37:46.120871+0000, chain.objs.size()=1 2024-09-12T17:42:05.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.532+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.gw5Z9kJurBNBQ8a_q_CaNLWR-EzbiaO_0 2024-09-12T17:42:05.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.532+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2375148519311235628', time=2024-09-12T19:38:33.451951+0000, chain.objs.size()=1 2024-09-12T17:42:05.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.532+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.e0xtRaiRZpHvKQ4TwjfT69KmtkgJnXb_0 2024-09-12T17:42:05.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.532+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1108881044743526954', time=2024-09-12T19:38:37.855256+0000, chain.objs.size()=1 2024-09-12T17:42:05.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.532+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.xBnqAS9vYW2kWKHdQgCM0IyTfaTBRvw_0 2024-09-12T17:42:05.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.536+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.536+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:42:05.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T17:42:05.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17282991394478149969', time=2024-09-12T19:31:56.866411+0000, chain.objs.size()=1 2024-09-12T17:42:05.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.lVzESq797WaV1iLzzVfyBhZZTx8Dq65_0 2024-09-12T17:42:05.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2098507457251307049', time=2024-09-12T19:31:57.410401+0000, chain.objs.size()=1 2024-09-12T17:42:05.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8__shadow_.4W9yTA51XNnE0k4ttQlvnhW1VfdhuXl_0 2024-09-12T17:42:05.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3004914254324423682', time=2024-09-12T19:33:21.516898+0000, chain.objs.size()=1 2024-09-12T17:42:05.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.S18ERiXuEliGY9XXv5Z6axOP8jE-VVG_0 2024-09-12T17:42:05.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9701469074885384734', time=2024-09-12T19:34:13.370589+0000, chain.objs.size()=1 2024-09-12T17:42:05.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24__shadow_.6TpG1FR3piKxIDQaImo_4GejUyAf8CF_0 2024-09-12T17:42:05.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18046861858357998233', time=2024-09-12T19:34:49.254666+0000, chain.objs.size()=1 2024-09-12T17:42:05.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.3lf4G3NPARvH_vT80KMb10fTbt8oPgT_0 2024-09-12T17:42:05.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17573900007163574336', time=2024-09-12T19:34:49.326441+0000, chain.objs.size()=1 2024-09-12T17:42:05.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.gNW6PFo-h3t9g7qTlAcsc_wudsTCxF8_0 2024-09-12T17:42:05.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12954085197005920832', time=2024-09-12T19:34:49.431957+0000, chain.objs.size()=1 2024-09-12T17:42:05.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.dQGwUR9mQQ8EHU19FdSz_MGFJ1GXBBb_0 2024-09-12T17:42:05.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5571119998357023708', time=2024-09-12T19:35:35.462492+0000, chain.objs.size()=1 2024-09-12T17:42:05.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.cPIzo5jILsdmtVFA5jqe8m3MayzpOqE_0 2024-09-12T17:42:05.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3901502002863159798', time=2024-09-12T19:35:40.867298+0000, chain.objs.size()=1 2024-09-12T17:42:05.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.HU4f2nzow0QPCuKpIdzv8QBt81LkLMa_0 2024-09-12T17:42:05.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5731244892841550005', time=2024-09-12T19:37:10.177740+0000, chain.objs.size()=1 2024-09-12T17:42:05.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.tl-ELtRj2-x4yitGj0TWlM1B4M3bn0y_0 2024-09-12T17:42:05.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5922916156662475210', time=2024-09-12T19:37:52.234416+0000, chain.objs.size()=1 2024-09-12T17:42:05.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.gN_iCgn0l9yMV5m5fO2qY5b4Rs_3a36_0 2024-09-12T17:42:05.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17197780444823294219', time=2024-09-12T19:38:28.127461+0000, chain.objs.size()=1 2024-09-12T17:42:05.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.540+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.mwQ8NVIgzTXSTCbRQUZUXINyvRhdUpD_0 2024-09-12T17:42:05.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.544+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8489599985835940713', time=2024-09-12T19:38:37.738817+0000, chain.objs.size()=1 2024-09-12T17:42:05.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.544+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.0K_spEkyPS6lfWk0liSQl65JPtpFtYX_0 2024-09-12T17:42:05.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.544+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13616391980615412364', time=2024-09-12T19:41:25.705192+0000, chain.objs.size()=1 2024-09-12T17:42:05.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.544+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18__shadow_.FlwzhQ3glBSeTVeLvS7XRs6sBny4fO9_0 2024-09-12T17:42:05.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.544+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.548+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:42:05.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.548+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T17:42:05.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5313167539662983166', time=2024-09-12T19:31:56.600612+0000, chain.objs.size()=7 2024-09-12T17:42:05.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12__multipart_foo.2~TYSb7E2pz6SWu7feLR0e01_si8tEWAh.1 2024-09-12T17:42:05.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12__shadow_foo.2~TYSb7E2pz6SWu7feLR0e01_si8tEWAh.1_1 2024-09-12T17:42:05.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12__multipart_foo.2~TYSb7E2pz6SWu7feLR0e01_si8tEWAh.2 2024-09-12T17:42:05.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12__shadow_foo.2~TYSb7E2pz6SWu7feLR0e01_si8tEWAh.2_1 2024-09-12T17:42:05.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12__multipart_foo.2~TYSb7E2pz6SWu7feLR0e01_si8tEWAh.3 2024-09-12T17:42:05.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12__shadow_foo.2~TYSb7E2pz6SWu7feLR0e01_si8tEWAh.3_1 2024-09-12T17:42:05.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12__multipart_foo.2~TYSb7E2pz6SWu7feLR0e01_si8tEWAh.4 2024-09-12T17:42:05.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13515739229234760043', time=2024-09-12T19:33:21.518734+0000, chain.objs.size()=1 2024-09-12T17:42:05.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.0JHm7obkmMF-CjAN1R9-h89NekDi4CF_0 2024-09-12T17:42:05.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18417623664767778396', time=2024-09-12T19:33:25.997852+0000, chain.objs.size()=1 2024-09-12T17:42:05.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.9L0QA0BVsqnQuEDlxF4MkWrC8hQCE68_0 2024-09-12T17:42:05.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15910825192145384929', time=2024-09-12T19:34:01.954172+0000, chain.objs.size()=1 2024-09-12T17:42:05.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.9FuUIWLyZqQWw9h2Xi9a24BOxmTmTab_0 2024-09-12T17:42:05.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6800519374125416242', time=2024-09-12T19:34:01.956226+0000, chain.objs.size()=1 2024-09-12T17:42:05.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.ExooowKKzC8ma4LsOQjwJO0nT87NSwn_0 2024-09-12T17:42:05.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10606588127606776793', time=2024-09-12T19:35:35.480452+0000, chain.objs.size()=1 2024-09-12T17:42:05.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.XErDDuECSvyxn61tdbKiaXmGGAKyWdY_0 2024-09-12T17:42:05.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4224733761568905833', time=2024-09-12T19:36:23.543500+0000, chain.objs.size()=1 2024-09-12T17:42:05.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.552+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.YvDpZ4M_hp029iz_yuHtvraCDXx319I_0 2024-09-12T17:42:05.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.556+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15367409947837497957', time=2024-09-12T19:36:23.545689+0000, chain.objs.size()=1 2024-09-12T17:42:05.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.556+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.L3yTvE2dSRWEp0wy2Wyhh2M7nXp5-8-_0 2024-09-12T17:42:05.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.556+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16696096288320838959', time=2024-09-12T19:38:33.448268+0000, chain.objs.size()=1 2024-09-12T17:42:05.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.556+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.y4BkELw9vSIwEfclqzGjzLylqPfsvO0_0 2024-09-12T17:42:05.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.556+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12130149589984575825', time=2024-09-12T19:38:37.739323+0000, chain.objs.size()=1 2024-09-12T17:42:05.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.556+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.wm-xM4LjmvSGXaCXXlJN74KWXvUQv3P_0 2024-09-12T17:42:05.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.556+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11551739554472651315', time=2024-09-12T19:41:25.731970+0000, chain.objs.size()=1 2024-09-12T17:42:05.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.556+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18__shadow_.ytM0qIUYnLP-ZNzxD5eyckWsC9iH0Cb_0 2024-09-12T17:42:05.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.560+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:42:05.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T17:42:05.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='_c4EzlECL1f7ZGRGrd2eZ9U40XlLAWi2', time=2024-09-12T19:31:57.087494+0000, chain.objs.size()=1 2024-09-12T17:42:05.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.RrbK3B5JST8i2J4_NLQ93fLRe5WxF4v_0 2024-09-12T17:42:05.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.314798049828710742', time=2024-09-12T19:33:25.899605+0000, chain.objs.size()=1 2024-09-12T17:42:05.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.IJ0rBJSpT0c34sQ7Wz1fo12TYZOQ6WT_0 2024-09-12T17:42:05.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6235197366025108234', time=2024-09-12T19:34:08.307854+0000, chain.objs.size()=1 2024-09-12T17:42:05.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.66UF4EOgmKMLCi4-NjB4AQx9kWQAIJ3_0 2024-09-12T17:42:05.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16059062793294131485', time=2024-09-12T19:34:17.347499+0000, chain.objs.size()=1 2024-09-12T17:42:05.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.NLmhbAcjShC09q16nlkOMyp-VjLY8aa_0 2024-09-12T17:42:05.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7381642334074764188', time=2024-09-12T19:35:40.887730+0000, chain.objs.size()=1 2024-09-12T17:42:05.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.sDv9Y-PFaVJhNDm3HHRIHk3yrfWwA-B_0 2024-09-12T17:42:05.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8684537685893615969', time=2024-09-12T19:36:27.931788+0000, chain.objs.size()=1 2024-09-12T17:42:05.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.JlV2zSFwB7yTDdSwbKsn7t3t5Pi9pi5_0 2024-09-12T17:42:05.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11451416755799116985', time=2024-09-12T19:37:52.156537+0000, chain.objs.size()=1 2024-09-12T17:42:05.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.7QD1IiCsDLjefzXaLOX_-OHVvXfDjQA_0 2024-09-12T17:42:05.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.697719525646726448', time=2024-09-12T19:37:52.158610+0000, chain.objs.size()=1 2024-09-12T17:42:05.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.yr5fdpBmo4oPPCNn_P9ZA4MUhE59T9s_0 2024-09-12T17:42:05.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12906273244769904135', time=2024-09-12T19:37:52.337618+0000, chain.objs.size()=1 2024-09-12T17:42:05.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.A7lLul7DBNa2i8-Gc8LZRZAetqswMtj_0 2024-09-12T17:42:05.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14835233524743566516', time=2024-09-12T19:38:28.111490+0000, chain.objs.size()=1 2024-09-12T17:42:05.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.564+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.cIwLrD812F4hzV2UnkbX81JGa7-Ulki_0 2024-09-12T17:42:05.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.568+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:42:05.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T17:42:05.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='_f56ULyuKUuPR8bB0qjRXFaUKcgYpAGy', time=2024-09-12T19:31:56.844432+0000, chain.objs.size()=2 2024-09-12T17:42:05.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.VX9ugkuPX0fDP8rG0v4U6g2Qpa8J3rJ_0 2024-09-12T17:42:05.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.VX9ugkuPX0fDP8rG0v4U6g2Qpa8J3rJ_1 2024-09-12T17:42:05.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4750437457234591568', time=2024-09-12T19:31:57.464844+0000, chain.objs.size()=1 2024-09-12T17:42:05.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9__shadow_.WNvGLOO3xuFofp5XH2YpVuriNIUbb13_0 2024-09-12T17:42:05.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9301200549972056386', time=2024-09-12T19:34:49.331738+0000, chain.objs.size()=1 2024-09-12T17:42:05.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.5t2AJpp32Frt2O_xINOE1WnBAM1Zpgh_0 2024-09-12T17:42:05.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4420501189229156664', time=2024-09-12T19:34:54.928912+0000, chain.objs.size()=1 2024-09-12T17:42:05.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.H5s-0ERdKIJrdIXcF2G_0jmr5tgSipb_0 2024-09-12T17:42:05.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6321570551515213426', time=2024-09-12T19:34:54.935166+0000, chain.objs.size()=1 2024-09-12T17:42:05.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.n9zxqm28ZeR_U-fI60YvxHPQEIONSnd_0 2024-09-12T17:42:05.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17811419374858655509', time=2024-09-12T19:34:55.040625+0000, chain.objs.size()=1 2024-09-12T17:42:05.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.5CszrSasJ4uKc4Zhkd_3cCoBy2cea36_0 2024-09-12T17:42:05.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10546243805111372338', time=2024-09-12T19:35:35.442781+0000, chain.objs.size()=1 2024-09-12T17:42:05.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.PqJU5Z-5YGWhFB4i4LZf8so8s8GZ6WQ_0 2024-09-12T17:42:05.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1749605837496622805', time=2024-09-12T19:35:35.448879+0000, chain.objs.size()=1 2024-09-12T17:42:05.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.572+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.H1NxfGepS0_sOXM6P7UBfnrUuH3Q6xZ_0 2024-09-12T17:42:05.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5713158656910277527', time=2024-09-12T19:36:23.459286+0000, chain.objs.size()=1 2024-09-12T17:42:05.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.DtZKMfgNak5G_foPP_0GaMKeWWO9lip_0 2024-09-12T17:42:05.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.869771407865388932', time=2024-09-12T19:36:23.542519+0000, chain.objs.size()=1 2024-09-12T17:42:05.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.WaUb_5_fdFEEHsCO_GaZBM40MpcTPTT_0 2024-09-12T17:42:05.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16826165387090959513', time=2024-09-12T19:36:27.926811+0000, chain.objs.size()=1 2024-09-12T17:42:05.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.7HipvpeMoZmozscn1Uk3bsXHz8WodKx_0 2024-09-12T17:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7688088827656252346', time=2024-09-12T19:37:03.833223+0000, chain.objs.size()=1 2024-09-12T17:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.tdDZ_rRcdE1pvJeoZrG50Jelk4Di5ot_0 2024-09-12T17:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9533464923928314561', time=2024-09-12T19:37:45.977953+0000, chain.objs.size()=1 2024-09-12T17:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.MjphkcpsHbcJqBN7e51G53JMlYbOKWE_0 2024-09-12T17:42:05.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3382049212861461654', time=2024-09-12T19:38:28.061056+0000, chain.objs.size()=1 2024-09-12T17:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.6l34RG8U7zg0VL3wcA4skQpj3ubkO7s_0 2024-09-12T17:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16102930596805422679', time=2024-09-12T19:38:33.512231+0000, chain.objs.size()=1 2024-09-12T17:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.CGEFUt-fu4dBee_QlPniabtmdBsILQf_0 2024-09-12T17:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9396265799381228648', time=2024-09-12T19:39:14.578348+0000, chain.objs.size()=1 2024-09-12T17:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.zSfEfwR1mR7u0rBSQjeFdvpHdHKdlhU_0 2024-09-12T17:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12554067549538030109', time=2024-09-12T19:39:14.607182+0000, chain.objs.size()=1 2024-09-12T17:42:05.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.576+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.wtml0adid8OKfCOKEQD9SQdd-RlxU5U_0 2024-09-12T17:42:05.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.580+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.584+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:42:05.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.584+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.584+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.584+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:42:05.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.584+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13754968116813053155', time=2024-09-12T19:31:56.547145+0000, chain.objs.size()=1 2024-09-12T17:42:05.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.584+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.Xx6_yVPJvGC8vMEE3XeLsVcNrXly3Nj_0 2024-09-12T17:42:05.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.584+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16946559474477116778', time=2024-09-12T19:31:57.376441+0000, chain.objs.size()=1 2024-09-12T17:42:05.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.584+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8__shadow_.ij7i3IFV5P5Z9w2p9WFd11JFgqDUgub_0 2024-09-12T17:42:05.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12859347293238333425', time=2024-09-12T19:33:25.792367+0000, chain.objs.size()=1 2024-09-12T17:42:05.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.jp4qgfwFddfbTeRznWSyMfWGiHyQRbQ_0 2024-09-12T17:42:05.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5223344976667554565', time=2024-09-12T19:34:08.173686+0000, chain.objs.size()=1 2024-09-12T17:42:05.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.ZmQUHu4_ufuCIUmLU_PzC5SZ27_Ie7Y_0 2024-09-12T17:42:05.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2661654444680175414', time=2024-09-12T19:34:49.254708+0000, chain.objs.size()=1 2024-09-12T17:42:05.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.uB90x5K0WRt9aQdwAidhddlxxrpNmqC_0 2024-09-12T17:42:05.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5923597410378731271', time=2024-09-12T19:35:35.462683+0000, chain.objs.size()=1 2024-09-12T17:42:05.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.OmLXU8PwLVbDhK-mlFhYfpkAgxrHVAm_0 2024-09-12T17:42:05.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15614662262183763453', time=2024-09-12T19:35:40.767766+0000, chain.objs.size()=1 2024-09-12T17:42:05.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.0YqQubUQE4_rsbCOQKJu3nCYgnJTCrv_0 2024-09-12T17:42:05.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11260993093103931619', time=2024-09-12T19:35:40.789155+0000, chain.objs.size()=1 2024-09-12T17:42:05.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.ZNcJ60f0oE15sUX466aY5Dk2gvM16LA_0 2024-09-12T17:42:05.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2276012848150684657', time=2024-09-12T19:35:40.865258+0000, chain.objs.size()=1 2024-09-12T17:42:05.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.XxkSwZguG9FPxqHU_CO2gpBSRIwNhYs_0 2024-09-12T17:42:05.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12746788389172923117', time=2024-09-12T19:36:17.545494+0000, chain.objs.size()=1 2024-09-12T17:42:05.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.ePOgKHyYyFK-CE2ZWPcRCkk2_ebdVlW_0 2024-09-12T17:42:05.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10000973124706976630', time=2024-09-12T19:36:27.942905+0000, chain.objs.size()=1 2024-09-12T17:42:05.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.1lXtDE2nS8UsfzOf0oJXtZmhyXQWVFw_0 2024-09-12T17:42:05.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17278942084803741509', time=2024-09-12T19:37:03.739558+0000, chain.objs.size()=1 2024-09-12T17:42:05.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.g_78VyXUeH_QCi8wYzl67jfbCGcN4eF_0 2024-09-12T17:42:05.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2692961402076072070', time=2024-09-12T19:37:10.137845+0000, chain.objs.size()=1 2024-09-12T17:42:05.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.cb_Ep4_0LhvwFhMJHKS8YqE4BWkBPJS_0 2024-09-12T17:42:05.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.385888097369005168', time=2024-09-12T19:38:33.469263+0000, chain.objs.size()=1 2024-09-12T17:42:05.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.CQjxcws9KH8_pS0kZU99SpbazUyW6MS_0 2024-09-12T17:42:05.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1964909592179099776', time=2024-09-12T19:39:14.488099+0000, chain.objs.size()=1 2024-09-12T17:42:05.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.xte_RZklfYvMaILpSv2rOQIE-n6FlGD_0 2024-09-12T17:42:05.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12344119325975583784', time=2024-09-12T19:41:25.691666+0000, chain.objs.size()=1 2024-09-12T17:42:05.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.588+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18__shadow_.Ne02XnWdz9bim0-IJzIomydvjiFT0jp_0 2024-09-12T17:42:05.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.592+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.596+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:42:05.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.596+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.596+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T17:42:05.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='_7mT_QuF8khdmJcRQcvYJ13QPClTTpoW', time=2024-09-12T19:31:56.988163+0000, chain.objs.size()=3 2024-09-12T17:42:05.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.DNvztgmBEoa6PFNc86TrvkV1TgIfXub_0 2024-09-12T17:42:05.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.DNvztgmBEoa6PFNc86TrvkV1TgIfXub_1 2024-09-12T17:42:05.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.DNvztgmBEoa6PFNc86TrvkV1TgIfXub_2 2024-09-12T17:42:05.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9213288094139652188', time=2024-09-12T19:33:25.858384+0000, chain.objs.size()=1 2024-09-12T17:42:05.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.eEtR_Npl57V5cGbJRtQ3mmBbE938Zm2_0 2024-09-12T17:42:05.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5585518445577664817', time=2024-09-12T19:33:25.875657+0000, chain.objs.size()=1 2024-09-12T17:42:05.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.yM4zph34Y2wGhw5v_ULLGPdzSVVrPmU_0 2024-09-12T17:42:05.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17059227641218075273', time=2024-09-12T19:34:08.119981+0000, chain.objs.size()=1 2024-09-12T17:42:05.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.tLDi9qiIoxNT2UDZ7orm_Se6f-1SvpF_0 2024-09-12T17:42:05.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11900668451778106371', time=2024-09-12T19:34:08.275484+0000, chain.objs.size()=1 2024-09-12T17:42:05.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.23__shadow_.wvD78vf6wVk1Q4xZ6_jLmxsAPVZkuIr_0 2024-09-12T17:42:05.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16910238352633215162', time=2024-09-12T19:34:49.317869+0000, chain.objs.size()=1 2024-09-12T17:42:05.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.w7CUetOQxjWgcKFh4gYklXwUls_Cet4_0 2024-09-12T17:42:05.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12427269864910692854', time=2024-09-12T19:34:54.885912+0000, chain.objs.size()=1 2024-09-12T17:42:05.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.jT7fGhGswqICyV7lT--sx8Tyvvgal91_0 2024-09-12T17:42:05.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11990991264266592669', time=2024-09-12T19:34:55.011053+0000, chain.objs.size()=1 2024-09-12T17:42:05.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.Xq4wQclRKJJuQiVqAbwEoehDWBtAqtA_0 2024-09-12T17:42:05.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5546379777369236899', time=2024-09-12T19:34:59.698321+0000, chain.objs.size()=1 2024-09-12T17:42:05.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.ssZ7Mu-_cbwva8U6w8_lMabJ9_1fuGY_0 2024-09-12T17:42:05.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14724443327821370086', time=2024-09-12T19:34:59.956342+0000, chain.objs.size()=1 2024-09-12T17:42:05.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.600+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.TdmsNZDAMS4HnSEdtbYKHFtXMBHBXxS_0 2024-09-12T17:42:05.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6968360143248005369', time=2024-09-12T19:35:35.440311+0000, chain.objs.size()=1 2024-09-12T17:42:05.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.28__shadow_.HckPfNbrHDym5z-KKPsZuORzsM5pYRS_0 2024-09-12T17:42:05.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3262111681924145348', time=2024-09-12T19:35:40.765086+0000, chain.objs.size()=1 2024-09-12T17:42:05.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.thjkJeEUirl5RvepJ0NctqVlA4f_HJ4_0 2024-09-12T17:42:05.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11207738777714550868', time=2024-09-12T19:36:28.086133+0000, chain.objs.size()=1 2024-09-12T17:42:05.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.7anKzmkIRTSYgosyE2SUppYB4VSNBYW_0 2024-09-12T17:42:05.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11685447607793102018', time=2024-09-12T19:37:03.893962+0000, chain.objs.size()=1 2024-09-12T17:42:05.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.JFSMWuKfGpefdqPVosayF_Pq_b0yyWG_0 2024-09-12T17:42:05.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7197654008677470958', time=2024-09-12T19:37:10.127546+0000, chain.objs.size()=1 2024-09-12T17:42:05.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.OWD4mo0aqdmyoZvqHaTOIwJK3nMiIsy_0 2024-09-12T17:42:05.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2823317464889242461', time=2024-09-12T19:37:50.264094+0000, chain.objs.size()=1 2024-09-12T17:42:05.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.pgbncuubnzEGE4U2Z-tBGx291ZPr-aO_0 2024-09-12T17:42:05.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18420397208848005922', time=2024-09-12T19:38:28.183072+0000, chain.objs.size()=1 2024-09-12T17:42:05.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.4FE3lmX8rEOLZRJpWePIUc2oy9rJfyl_0 2024-09-12T17:42:05.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6725020265487275925', time=2024-09-12T19:38:33.448349+0000, chain.objs.size()=1 2024-09-12T17:42:05.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.38__shadow_.vBHk9FirTodi7i6BFF63my7TboOcbVX_0 2024-09-12T17:42:05.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15036796529989189482', time=2024-09-12T19:38:37.684235+0000, chain.objs.size()=1 2024-09-12T17:42:05.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.abgT_D6x96Fp0mol4CqHC60eRwg4c15_0 2024-09-12T17:42:05.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1407994425577693190', time=2024-09-12T19:38:37.885142+0000, chain.objs.size()=1 2024-09-12T17:42:05.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.DUqHOELNCGAJK54xqR4Datb6s_xULsw_0 2024-09-12T17:42:05.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1250879422630767046', time=2024-09-12T19:41:41.998315+0000, chain.objs.size()=1 2024-09-12T17:42:05.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.604+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19__shadow:lNre-yfx3ShykdOhZkyJxu2xOyW2Tbs_.fPx4wtBl1tVp14D0GP4od1r_nRxpwuI_0 2024-09-12T17:42:05.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.608+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.612+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:42:05.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.612+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.612+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.612+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T17:42:05.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.612+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='_eT8arOG8xz_mqq6wj6RQZi9K6VN1Wsz', time=2024-09-12T19:31:56.912832+0000, chain.objs.size()=1 2024-09-12T17:42:05.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16__shadow_.N91ONlmuNw5gMqICXAONphPYJMKhC0o_0 2024-09-12T17:42:05.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17778293772344010913', time=2024-09-12T19:31:57.063254+0000, chain.objs.size()=3 2024-09-12T17:42:05.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-STANDARD.2~B2dC-mdSBfQtqUfRQPYLAC99mRrHXTB.1 2024-09-12T17:42:05.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-STANDARD.2~B2dC-mdSBfQtqUfRQPYLAC99mRrHXTB.2 2024-09-12T17:42:05.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-STANDARD.2~B2dC-mdSBfQtqUfRQPYLAC99mRrHXTB.3 2024-09-12T17:42:05.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11798744798891782355', time=2024-09-12T19:33:21.517391+0000, chain.objs.size()=1 2024-09-12T17:42:05.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.OVXACF0AYNFfzwm_LGfDwXhgSDV_z6G_0 2024-09-12T17:42:05.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17244668383449346376', time=2024-09-12T19:33:21.519316+0000, chain.objs.size()=1 2024-09-12T17:42:05.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.tlqXCSNajJClUNvg0qb7fgAy45U2PIa_0 2024-09-12T17:42:05.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11937970983476596664', time=2024-09-12T19:33:25.875654+0000, chain.objs.size()=1 2024-09-12T17:42:05.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.2Sdwiv3uifyfHUHb4gJrEWLJQnkjo3D_0 2024-09-12T17:42:05.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1234478588005118864', time=2024-09-12T19:34:01.878206+0000, chain.objs.size()=1 2024-09-12T17:42:05.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22__shadow_.5hU7tt0FZwEl03d5_RQdRKqrE46WgPs_0 2024-09-12T17:42:05.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4350053706036940245', time=2024-09-12T19:34:49.226223+0000, chain.objs.size()=1 2024-09-12T17:42:05.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.FVmkCCgP100eCYphQFVs2_oM720IXTs_0 2024-09-12T17:42:05.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12932493069947386991', time=2024-09-12T19:34:49.317027+0000, chain.objs.size()=1 2024-09-12T17:42:05.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.Gc5Y4GnSCbeW0igaESOda25x22LuLz__0 2024-09-12T17:42:05.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12544996404543981767', time=2024-09-12T19:34:55.010979+0000, chain.objs.size()=1 2024-09-12T17:42:05.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.26__shadow_.5lcgq2KvWdFrCev_JONFNcTkJVuxjaO_0 2024-09-12T17:42:05.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14225181611960062764', time=2024-09-12T19:36:17.514633+0000, chain.objs.size()=1 2024-09-12T17:42:05.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.wA3KPmEpWVLE5BhpN1x3l-p0HQj1IQf_0 2024-09-12T17:42:05.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4083340345296811718', time=2024-09-12T19:36:17.518083+0000, chain.objs.size()=1 2024-09-12T17:42:05.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.616+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.30__shadow_.WsjgyfKdag9IH9gy_GRUjMbGza40Acz_0 2024-09-12T17:42:05.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.620+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6644351006558226540', time=2024-09-12T19:36:23.414377+0000, chain.objs.size()=1 2024-09-12T17:42:05.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.620+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.31__shadow_.I_co2JS2H05wP04y10qNvGwmFd87-gu_0 2024-09-12T17:42:05.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.620+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15166275456979783870', time=2024-09-12T19:36:27.856920+0000, chain.objs.size()=1 2024-09-12T17:42:05.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.620+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.Md0cWsRBvkCOpyFq-eAZSMHsBaBoOf4_0 2024-09-12T17:42:05.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.620+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4695984157982226445', time=2024-09-12T19:37:03.805602+0000, chain.objs.size()=1 2024-09-12T17:42:05.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.620+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.9vzWgpZzQteBwM_D-k2D-S4QYA3qW6N_0 2024-09-12T17:42:05.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.620+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17594693019238490117', time=2024-09-12T19:37:10.032819+0000, chain.objs.size()=1 2024-09-12T17:42:05.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.620+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.o7HAOmskDT-NTGBTOKoKW-QJfEawwaq_0 2024-09-12T17:42:05.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.620+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6777279347561668844', time=2024-09-12T19:37:14.066258+0000, chain.objs.size()=1 2024-09-12T17:42:05.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.620+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.lWwJsgc3I63c9_11pRyMPmi5iv_NdeY_0 2024-09-12T17:42:05.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.620+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8364471836780880990', time=2024-09-12T19:37:46.179831+0000, chain.objs.size()=1 2024-09-12T17:42:05.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.620+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.kmmBQZrDGHnuK_w4o08GLe4Y8DBQ9YL_0 2024-09-12T17:42:05.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.620+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10936837977923359662', time=2024-09-12T19:39:14.484839+0000, chain.objs.size()=1 2024-09-12T17:42:05.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.620+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40__shadow_.iz0f5iO7-yV61BewAgTT2ewo-yr6E9b_0 2024-09-12T17:42:05.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.620+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3620333578200464076', time=2024-09-12T19:41:25.731926+0000, chain.objs.size()=1 2024-09-12T17:42:05.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.620+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18__shadow_.SSFxhiox-qiwpqGE_27APBsUE6zL-Wx_0 2024-09-12T17:42:05.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.624+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.624+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:42:05.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T17:42:05.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11529627708681969685', time=2024-09-12T19:31:56.517122+0000, chain.objs.size()=1 2024-09-12T17:42:05.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5__shadow_.aby0QwHv3X0kqBJ5wZ9N7F4WyOC5CDz_0 2024-09-12T17:42:05.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='_1P0ESBwShbGcdnRk5jiK22Y9PnxeWqb', time=2024-09-12T19:31:56.977651+0000, chain.objs.size()=1 2024-09-12T17:42:05.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_.ZvQxubbwTNa2PZXCx_Ar6-KtnsDK1Gi_0 2024-09-12T17:42:05.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6545071648289882598', time=2024-09-12T19:31:57.051887+0000, chain.objs.size()=5 2024-09-12T17:42:05.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.1 2024-09-12T17:42:05.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.1_1 2024-09-12T17:42:05.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.2 2024-09-12T17:42:05.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__shadow_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.2_1 2024-09-12T17:42:05.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17__multipart_foo-LUKEWARM.2~m3Jq7rNduj05ny9CnS8f2mkiSjZ2_0p.3 2024-09-12T17:42:05.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9136144736747085220', time=2024-09-12T19:31:57.166300+0000, chain.objs.size()=5 2024-09-12T17:42:05.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-LUKEWARM.2~Pg9lo4FJ3x1wYydZCd1h7k8iH2uDWKu.1 2024-09-12T17:42:05.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__shadow_foo-LUKEWARM.2~Pg9lo4FJ3x1wYydZCd1h7k8iH2uDWKu.1_1 2024-09-12T17:42:05.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-LUKEWARM.2~Pg9lo4FJ3x1wYydZCd1h7k8iH2uDWKu.2 2024-09-12T17:42:05.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__shadow_foo-LUKEWARM.2~Pg9lo4FJ3x1wYydZCd1h7k8iH2uDWKu.2_1 2024-09-12T17:42:05.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.628+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15__multipart_foo-LUKEWARM.2~Pg9lo4FJ3x1wYydZCd1h7k8iH2uDWKu.3 2024-09-12T17:42:05.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15097813554854046152', time=2024-09-12T19:33:21.654066+0000, chain.objs.size()=1 2024-09-12T17:42:05.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.5zQQm7Ltg9Fe8K9NioKrWCovWuP0tnS_0 2024-09-12T17:42:05.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3177984221410394371', time=2024-09-12T19:35:40.981580+0000, chain.objs.size()=1 2024-09-12T17:42:05.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29__shadow_.8f40pl4y2xUTrVqvnS9xZ7a6V96VxKv_0 2024-09-12T17:42:05.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2053838728413532722', time=2024-09-12T19:37:03.803510+0000, chain.objs.size()=1 2024-09-12T17:42:05.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.33__shadow_.TzcUjRqhdA6TEplcdoBj1MtKBRUJ2jg_0 2024-09-12T17:42:05.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8347548122302418203', time=2024-09-12T19:37:10.288207+0000, chain.objs.size()=1 2024-09-12T17:42:05.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.C9fwu03iZgdffFlNhAWqE7w4FhefUR8_0 2024-09-12T17:42:05.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11122927087048932778', time=2024-09-12T19:37:52.233102+0000, chain.objs.size()=1 2024-09-12T17:42:05.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.c_x9B8STpfjcxlIhhpIjk95TlCjsJ2n_0 2024-09-12T17:42:05.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6541326959407231735', time=2024-09-12T19:37:52.235508+0000, chain.objs.size()=1 2024-09-12T17:42:05.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.S_03L1qa3AOW8Ia4qtiHhdQXqKHpAQ3_0 2024-09-12T17:42:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4231068134132983368', time=2024-09-12T19:38:37.737492+0000, chain.objs.size()=1 2024-09-12T17:42:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.-KTAKfAUfFR-XF2-ayXH6rqbrzxvEVN_0 2024-09-12T17:42:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.974723154503152729', time=2024-09-12T19:38:37.814238+0000, chain.objs.size()=1 2024-09-12T17:42:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.UL8SfzUtLVKbEmUsstq3I9shFavDX2t_0 2024-09-12T17:42:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2304934185948217319', time=2024-09-12T19:38:37.888777+0000, chain.objs.size()=1 2024-09-12T17:42:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.39__shadow_.-Lone9_yk0sPJHUmijSHlAEwZwvrG4j_0 2024-09-12T17:42:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13002591831278526199', time=2024-09-12T19:41:25.704641+0000, chain.objs.size()=1 2024-09-12T17:42:05.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.632+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18__shadow_.LRcM-YFVAhlQKzyKkT0Clst8BV_2jMY_0 2024-09-12T17:42:05.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.636+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:42:05.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:05.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:05.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T17:42:05.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7099280287857698429', time=2024-09-12T19:31:57.387622+0000, chain.objs.size()=1 2024-09-12T17:42:05.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8__shadow_.2eH1YXnQsaU-MWyiWHvEKVamIJjghpZ_0 2024-09-12T17:42:05.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16158128735114956740', time=2024-09-12T19:31:57.501502+0000, chain.objs.size()=1 2024-09-12T17:42:05.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9__shadow_.eXUW0MQ863npMYu2SK85mT6-8O2ze0O_0 2024-09-12T17:42:05.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3370010239421186070', time=2024-09-12T19:33:21.506506+0000, chain.objs.size()=1 2024-09-12T17:42:05.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20__shadow_.QDw4EA_geIZ7M4qsHV6bqU_4mhm26Pm_0 2024-09-12T17:42:05.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7591872079914129254', time=2024-09-12T19:33:26.015582+0000, chain.objs.size()=1 2024-09-12T17:42:05.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21__shadow_.z7qG9qnCZN8-5tMVOjjH7U5_lWnJvI0_0 2024-09-12T17:42:05.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18306836263891188578', time=2024-09-12T19:34:49.345465+0000, chain.objs.size()=1 2024-09-12T17:42:05.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25__shadow_.aaw-uIp8I3DMhZE_ep1UBF5OY0HuWBB_0 2024-09-12T17:42:05.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5878843451542961474', time=2024-09-12T19:34:59.706232+0000, chain.objs.size()=1 2024-09-12T17:42:05.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.27__shadow_.h2BrE5vDdailiI_g925fKa1ibgQi903_0 2024-09-12T17:42:05.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.536890384158610625', time=2024-09-12T19:36:27.890208+0000, chain.objs.size()=1 2024-09-12T17:42:05.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.32__shadow_.oot9M4KGc8JklrNSu5ADZ1D-0u2NT-h_0 2024-09-12T17:42:05.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17445123196856136904', time=2024-09-12T19:37:10.178996+0000, chain.objs.size()=1 2024-09-12T17:42:05.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.34__shadow_.T5L1x36LZDC4pFBa6KdzFX6qd068oKB_0 2024-09-12T17:42:05.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9237552192801987562', time=2024-09-12T19:37:46.012741+0000, chain.objs.size()=1 2024-09-12T17:42:05.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.35__shadow_.pkLhu6YVgHK06Er0LSbZlKSTn7s_-Kt_0 2024-09-12T17:42:05.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12479029627359724225', time=2024-09-12T19:37:52.152955+0000, chain.objs.size()=1 2024-09-12T17:42:05.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.36__shadow_.qEKkA3dVrjnUSVE6IcLvAhaVG9DjOeH_0 2024-09-12T17:42:05.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10771970605715655600', time=2024-09-12T19:38:28.085074+0000, chain.objs.size()=1 2024-09-12T17:42:05.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.640+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.37__shadow_.Ugkau6N4bsmVLbhGthxwgyXz4ROFC1s_0 2024-09-12T17:42:05.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.644+0000 7fb9660749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:42:05.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.648+0000 7fb819fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:05.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.652+0000 7fb9660749c0 20 remove_watcher() i=0 2024-09-12T17:42:05.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.652+0000 7fb9660749c0 2 removed watcher, disabling cache 2024-09-12T17:42:05.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.652+0000 7fb9660749c0 20 remove_watcher() i=1 2024-09-12T17:42:05.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.652+0000 7fb9660749c0 20 remove_watcher() i=2 2024-09-12T17:42:05.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.656+0000 7fb9660749c0 20 remove_watcher() i=3 2024-09-12T17:42:05.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.656+0000 7fb9660749c0 20 remove_watcher() i=4 2024-09-12T17:42:05.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.656+0000 7fb9660749c0 20 remove_watcher() i=5 2024-09-12T17:42:05.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.656+0000 7fb9660749c0 20 remove_watcher() i=6 2024-09-12T17:42:05.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.660+0000 7fb9660749c0 20 remove_watcher() i=7 2024-09-12T17:42:05.674 DEBUG:teuthology.orchestra.run.smithi119:> radosgw-admin gc process --include-all 2024-09-12T17:42:05.740 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:05.740 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:05.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.784+0000 7f2ce35649c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:05.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.788+0000 7f2ce35649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:05.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.788+0000 7f2ce35649c0 20 realm 2024-09-12T17:42:05.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.788+0000 7f2ce35649c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:05.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.788+0000 7f2ce35649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:05.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.788+0000 7f2ce35649c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:42:05.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.788+0000 7f2ce35649c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:05.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.788+0000 7f2ce35649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:05.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.788+0000 7f2ce35649c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:05.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.788+0000 7f2ce35649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:05.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.788+0000 7f2ce35649c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:05.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.792+0000 7f2ce35649c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:42:05.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.792+0000 7f2ce35649c0 20 searching for the correct realm 2024-09-12T17:42:05.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.792+0000 7f2ce186b640 0 -- 172.21.15.119:0/1744000621 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f2cd803e060 msgr2=0x7f2cd80630b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:42:05.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:05.800+0000 7f2ce0869640 0 -- 172.21.15.119:0/1744000621 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f2cdc068eb0 msgr2=0x7f2cdc071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:42:06.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.016+0000 7f2ce35649c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:42:06.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.016+0000 7f2ce35649c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:42:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.016+0000 7f2ce35649c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:42:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.016+0000 7f2ce35649c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:42:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.016+0000 7f2ce35649c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:42:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.016+0000 7f2ce35649c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:42:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.016+0000 7f2ce35649c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.016+0000 7f2ce35649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.016+0000 7f2ce35649c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.020+0000 7f2ce35649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:42:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.020+0000 7f2ce35649c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:06.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.020+0000 7f2ce35649c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:42:06.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.020+0000 7f2ce35649c0 20 zone default found 2024-09-12T17:42:06.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.020+0000 7f2ce35649c0 4 Realm: () 2024-09-12T17:42:06.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.020+0000 7f2ce35649c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:42:06.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.020+0000 7f2ce35649c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:42:06.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.020+0000 7f2ce35649c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:42:06.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.020+0000 7f2ce35649c0 20 zonegroup default 2024-09-12T17:42:06.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.020+0000 7f2ce35649c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:06.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.020+0000 7f2ce35649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:06.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.020+0000 7f2ce35649c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:06.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.020+0000 7f2ce35649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:06.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.020+0000 7f2ce35649c0 20 rados->read ofs=0 len=0 2024-09-12T17:42:06.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.024+0000 7f2ce35649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:42:06.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.024+0000 7f2ce35649c0 20 started sync module instance, tier type = 2024-09-12T17:42:06.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.024+0000 7f2ce35649c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:42:06.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.044+0000 7f2ce35649c0 20 add_watcher() i=0 2024-09-12T17:42:06.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.044+0000 7f2ce35649c0 20 add_watcher() i=1 2024-09-12T17:42:06.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.044+0000 7f2ce35649c0 20 add_watcher() i=2 2024-09-12T17:42:06.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.044+0000 7f2ce35649c0 20 add_watcher() i=3 2024-09-12T17:42:06.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.044+0000 7f2ce35649c0 20 add_watcher() i=4 2024-09-12T17:42:06.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.044+0000 7f2ce35649c0 20 add_watcher() i=5 2024-09-12T17:42:06.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.044+0000 7f2ce35649c0 20 add_watcher() i=6 2024-09-12T17:42:06.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.048+0000 7f2ce35649c0 20 add_watcher() i=7 2024-09-12T17:42:06.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.048+0000 7f2ce35649c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:42:06.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.052+0000 7f2b977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:06.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.052+0000 7f2ce35649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:42:06.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.052+0000 7f2ce35649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:42:06.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.144+0000 7f2b967e4640 20 reqs_thread_entry: start 2024-09-12T17:42:06.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.148+0000 7f2ce35649c0 20 init_complete bucket index max shards: 11 2024-09-12T17:42:06.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.148+0000 7f2ce35649c0 20 Filter name: none 2024-09-12T17:42:06.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.148+0000 7f2b07fff640 20 reqs_thread_entry: start 2024-09-12T17:42:06.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.148+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:42:06.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.152+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.152+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.152+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.156+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:42:06.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.160+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.164+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.164+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.168+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:42:06.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.168+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.172+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.172+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.172+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:42:06.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.176+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.176+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.180+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.180+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:42:06.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.184+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.184+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.184+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.184+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:42:06.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.188+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.188+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.192+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.192+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:42:06.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.196+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.196+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.200+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.200+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:42:06.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.204+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.208+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.208+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.208+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:42:06.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.212+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.216+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.216+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.220+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:42:06.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.224+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.224+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.224+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.228+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:42:06.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.232+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.232+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.232+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.236+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:42:06.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.240+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.240+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.244+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.244+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:42:06.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.248+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.248+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.252+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.252+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:42:06.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.256+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.256+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.256+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.260+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:42:06.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.264+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.264+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.264+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.268+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:42:06.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.272+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.272+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.276+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.276+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:42:06.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.280+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.284+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.284+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.288+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:42:06.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.288+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.292+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.292+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.296+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:42:06.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.300+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.300+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.300+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.304+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:42:06.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.308+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.308+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.312+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.312+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:42:06.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.316+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.320+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.320+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.324+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:42:06.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.328+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.328+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.328+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.332+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:42:06.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.336+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.340+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.340+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.340+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:42:06.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.344+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.348+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.348+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.352+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:42:06.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.356+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.356+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.356+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.360+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:42:06.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.364+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.364+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.364+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.368+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:42:06.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.372+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.372+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.372+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.376+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:42:06.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.380+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.380+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.384+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.384+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:42:06.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.388+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.388+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.392+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.392+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:42:06.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.396+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.400+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.400+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.400+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:42:06.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.404+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.408+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.408+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.412+0000 7f2ce35649c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:42:06.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.416+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.416+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:42:06.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.416+0000 7f2ce35649c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:42:06.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.424+0000 7f2b977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:42:06.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.428+0000 7f2ce35649c0 20 remove_watcher() i=0 2024-09-12T17:42:06.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.428+0000 7f2ce35649c0 2 removed watcher, disabling cache 2024-09-12T17:42:06.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.432+0000 7f2ce35649c0 20 remove_watcher() i=1 2024-09-12T17:42:06.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.432+0000 7f2ce35649c0 20 remove_watcher() i=2 2024-09-12T17:42:06.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.436+0000 7f2ce35649c0 20 remove_watcher() i=3 2024-09-12T17:42:06.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.436+0000 7f2ce35649c0 20 remove_watcher() i=4 2024-09-12T17:42:06.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.440+0000 7f2ce35649c0 20 remove_watcher() i=5 2024-09-12T17:42:06.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.440+0000 7f2ce35649c0 20 remove_watcher() i=6 2024-09-12T17:42:06.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:42:06.444+0000 7f2ce35649c0 20 remove_watcher() i=7 2024-09-12T17:42:06.463 DEBUG:teuthology.orchestra.run.smithi119:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T17:42:07.037 INFO:teuthology.orchestra.run.smithi119.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T17:42:11.537 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :clean UP-TO-DATE 2024-09-12T17:42:29.636 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :compileJava 2024-09-12T17:42:29.636 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :processResources 2024-09-12T17:42:29.636 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :classes 2024-09-12T17:42:30.435 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:30.435 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :compileTestJava 2024-09-12T17:42:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:42:30.436 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:30.436 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:42:30.436 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :testClasses 2024-09-12T17:42:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:42:37.335 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:37.336 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :test 2024-09-12T17:42:37.336 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:37.336 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T17:42:45.036 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:45.036 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T17:42:45.735 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:45.736 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T17:42:46.035 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:46.036 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T17:42:46.835 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:46.835 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T17:42:57.435 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:57.435 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T17:42:58.335 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:58.335 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T17:42:58.435 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:58.435 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T17:42:58.635 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:58.635 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T17:42:58.835 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:58.835 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T17:42:59.635 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:42:59.635 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T17:43:08.235 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:43:08.236 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T17:43:09.836 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:43:09.836 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T17:43:10.335 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:43:10.336 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T17:43:10.336 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12 17:43:10,275 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:43:48.636 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:43:48.636 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T17:43:50.235 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:43:50.235 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T17:43:50.435 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:43:50.435 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T17:43:51.235 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:43:51.235 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T17:43:51.536 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:43:51.536 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T17:43:52.935 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:43:52.935 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T17:44:10.735 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:44:10.736 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T17:44:11.635 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:44:11.635 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T17:44:11.735 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:44:11.735 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T17:44:11.935 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:44:11.935 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T17:44:22.335 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:44:22.336 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T17:44:23.435 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:44:23.436 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T17:44:59.036 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:44:59.036 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T17:45:00.235 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:45:00.235 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T17:45:04.635 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:45:04.636 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T17:45:05.535 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:45:05.535 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T17:47:32.636 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:47:32.637 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T17:47:33.535 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:47:33.535 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T17:47:52.235 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:47:52.236 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T17:47:53.036 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:47:53.037 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T17:48:01.135 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:01.135 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T17:48:02.035 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:02.035 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T17:48:05.435 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:05.435 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T17:48:21.135 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:21.135 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T17:48:21.435 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:21.435 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T17:48:22.335 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:22.335 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T17:48:22.535 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:22.536 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T17:48:23.435 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:23.435 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T17:48:23.735 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:23.735 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T17:48:24.635 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:24.635 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T17:48:24.835 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:24.835 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T17:48:25.735 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:25.735 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T17:48:26.035 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:26.035 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T17:48:26.935 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:26.935 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T17:48:27.135 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:27.136 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T17:48:28.035 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:28.035 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T17:48:28.335 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:28.335 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T17:48:29.135 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:29.135 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T17:48:47.135 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:47.136 INFO:teuthology.orchestra.run.smithi119.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T17:48:48.114 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:48.115 INFO:teuthology.orchestra.run.smithi119.stdout:---------------------------------------------------------------------- 2024-09-12T17:48:48.115 INFO:teuthology.orchestra.run.smithi119.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T17:48:48.115 INFO:teuthology.orchestra.run.smithi119.stdout:---------------------------------------------------------------------- 2024-09-12T17:48:48.115 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:48.115 INFO:teuthology.orchestra.run.smithi119.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:48:48.115 INFO:teuthology.orchestra.run.smithi119.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:48:48.115 INFO:teuthology.orchestra.run.smithi119.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:48:48.115 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:48.115 INFO:teuthology.orchestra.run.smithi119.stdout:BUILD SUCCESSFUL in 6m 41s 2024-09-12T17:48:48.115 INFO:teuthology.orchestra.run.smithi119.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T17:48:48.439 DEBUG:teuthology.orchestra.run.smithi119:> radosgw-admin gc process --include-all 2024-09-12T17:48:48.472 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:48.472 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:48.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.514+0000 7fb2433969c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:48.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.518+0000 7fb2433969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:48.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.518+0000 7fb2433969c0 20 realm 2024-09-12T17:48:48.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.518+0000 7fb2433969c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:48.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.518+0000 7fb2433969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:48.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.518+0000 7fb2433969c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:48.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.518+0000 7fb2433969c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:48.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.518+0000 7fb2433969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:48.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.518+0000 7fb2433969c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:48.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.522+0000 7fb2433969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:48.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.522+0000 7fb2433969c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:48.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.522+0000 7fb2433969c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:48.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.522+0000 7fb2433969c0 20 searching for the correct realm 2024-09-12T17:48:48.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.526+0000 7fb24169d640 0 -- 172.21.15.119:0/22070223 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fb22807ac20 msgr2=0x7fb228078ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:48.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.534+0000 7fb24069b640 0 -- 172.21.15.119:0/22070223 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fb23003c910 msgr2=0x7fb230020440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:48.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.750+0000 7fb2433969c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:48:48.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.750+0000 7fb2433969c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:48:48.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.750+0000 7fb2433969c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:48.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.750+0000 7fb2433969c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:48.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.750+0000 7fb2433969c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:48.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.750+0000 7fb2433969c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:48.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.750+0000 7fb2433969c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:48.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.754+0000 7fb2433969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:48.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.754+0000 7fb2433969c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:48.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.754+0000 7fb2433969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:48.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.754+0000 7fb2433969c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:48.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.754+0000 7fb2433969c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:48.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.754+0000 7fb2433969c0 20 zone default found 2024-09-12T17:48:48.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.754+0000 7fb2433969c0 4 Realm: () 2024-09-12T17:48:48.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.754+0000 7fb2433969c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:48:48.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.754+0000 7fb2433969c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:48:48.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.754+0000 7fb2433969c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:48.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.754+0000 7fb2433969c0 20 zonegroup default 2024-09-12T17:48:48.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.754+0000 7fb2433969c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:48.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.754+0000 7fb2433969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:48.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.754+0000 7fb2433969c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:48.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.754+0000 7fb2433969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:48.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.754+0000 7fb2433969c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:48.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.758+0000 7fb2433969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:48.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.758+0000 7fb2433969c0 20 started sync module instance, tier type = 2024-09-12T17:48:48.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.758+0000 7fb2433969c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:48:48.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.778+0000 7fb2433969c0 20 add_watcher() i=0 2024-09-12T17:48:48.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.778+0000 7fb2433969c0 20 add_watcher() i=1 2024-09-12T17:48:48.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.778+0000 7fb2433969c0 20 add_watcher() i=2 2024-09-12T17:48:48.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.778+0000 7fb2433969c0 20 add_watcher() i=3 2024-09-12T17:48:48.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.778+0000 7fb2433969c0 20 add_watcher() i=4 2024-09-12T17:48:48.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.778+0000 7fb2433969c0 20 add_watcher() i=5 2024-09-12T17:48:48.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.778+0000 7fb2433969c0 20 add_watcher() i=6 2024-09-12T17:48:48.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.782+0000 7fb2433969c0 20 add_watcher() i=7 2024-09-12T17:48:48.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.782+0000 7fb2433969c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:48.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.786+0000 7fb0f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:48.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.786+0000 7fb2433969c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:48.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.786+0000 7fb2433969c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:48.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.874+0000 7fb0f4fe1640 20 reqs_thread_entry: start 2024-09-12T17:48:48.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.874+0000 7fb2433969c0 20 init_complete bucket index max shards: 11 2024-09-12T17:48:48.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.874+0000 7fb2433969c0 20 Filter name: none 2024-09-12T17:48:48.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.874+0000 7fb06e7fc640 20 reqs_thread_entry: start 2024-09-12T17:48:48.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.874+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:48:48.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.878+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:48.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.878+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:48.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.878+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:48.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.882+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:48:48.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.882+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:48.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.882+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:48.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.882+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:48:48.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.882+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='2~qX4kWmZvCgWKSpIMtlw2QunZ46EVkK8', time=2024-09-12T19:42:44.893405+0000, chain.objs.size()=9 2024-09-12T17:48:48.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.882+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.41__multipart_key1.2~qX4kWmZvCgWKSpIMtlw2QunZ46EVkK8.1 2024-09-12T17:48:48.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.882+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.41__shadow_key1.2~qX4kWmZvCgWKSpIMtlw2QunZ46EVkK8.1_1 2024-09-12T17:48:48.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.882+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.41__multipart_key1.2~qX4kWmZvCgWKSpIMtlw2QunZ46EVkK8.2 2024-09-12T17:48:48.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.882+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.41__shadow_key1.2~qX4kWmZvCgWKSpIMtlw2QunZ46EVkK8.2_1 2024-09-12T17:48:48.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.886+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.41__multipart_key1.2~qX4kWmZvCgWKSpIMtlw2QunZ46EVkK8.3 2024-09-12T17:48:48.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.886+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.41__shadow_key1.2~qX4kWmZvCgWKSpIMtlw2QunZ46EVkK8.3_1 2024-09-12T17:48:48.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.886+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.41__multipart_key1.2~qX4kWmZvCgWKSpIMtlw2QunZ46EVkK8.4 2024-09-12T17:48:48.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.886+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.41__shadow_key1.2~qX4kWmZvCgWKSpIMtlw2QunZ46EVkK8.4_1 2024-09-12T17:48:48.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.886+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.41__multipart_key1.2~qX4kWmZvCgWKSpIMtlw2QunZ46EVkK8.5 2024-09-12T17:48:48.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.894+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:48.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.898+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:48:48.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.902+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:48.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.902+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:48.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.902+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:48.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.906+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:48:48.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.910+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:48.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.910+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:48.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.910+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:48.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.914+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:48:48.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.918+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:48.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.918+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:48.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.918+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:48.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.922+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:48:48.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.922+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:48.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.926+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:48.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.926+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:48.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.930+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:48:48.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.930+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:48.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.930+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:48.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.930+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:48.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.934+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:48:48.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.934+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:48.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.934+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:48.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.938+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:48:48.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.938+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4588292230831256123', time=2024-09-12T19:43:34.575298+0000, chain.objs.size()=9 2024-09-12T17:48:48.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.938+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~myVh7oV077v0fYd-vnvL_u6_CmFV66R.1 2024-09-12T17:48:48.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.938+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~myVh7oV077v0fYd-vnvL_u6_CmFV66R.1_1 2024-09-12T17:48:48.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.938+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~myVh7oV077v0fYd-vnvL_u6_CmFV66R.2 2024-09-12T17:48:48.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.938+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~myVh7oV077v0fYd-vnvL_u6_CmFV66R.2_1 2024-09-12T17:48:48.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.938+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~myVh7oV077v0fYd-vnvL_u6_CmFV66R.3 2024-09-12T17:48:48.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.938+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~myVh7oV077v0fYd-vnvL_u6_CmFV66R.3_1 2024-09-12T17:48:48.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.938+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~myVh7oV077v0fYd-vnvL_u6_CmFV66R.4 2024-09-12T17:48:48.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.938+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~myVh7oV077v0fYd-vnvL_u6_CmFV66R.4_1 2024-09-12T17:48:48.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.938+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~myVh7oV077v0fYd-vnvL_u6_CmFV66R.5 2024-09-12T17:48:48.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.938+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16768884813297032804', time=2024-09-12T19:44:59.449557+0000, chain.objs.size()=9 2024-09-12T17:48:48.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.938+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__multipart_file2.mpg.2~5izfVYJSNBwLaciOrXxuymmQx4QzUQS.1 2024-09-12T17:48:48.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.938+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__shadow_file2.mpg.2~5izfVYJSNBwLaciOrXxuymmQx4QzUQS.1_1 2024-09-12T17:48:48.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.938+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__multipart_file2.mpg.2~5izfVYJSNBwLaciOrXxuymmQx4QzUQS.2 2024-09-12T17:48:48.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.946+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__shadow_file2.mpg.2~5izfVYJSNBwLaciOrXxuymmQx4QzUQS.2_1 2024-09-12T17:48:48.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.946+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__multipart_file2.mpg.2~5izfVYJSNBwLaciOrXxuymmQx4QzUQS.3 2024-09-12T17:48:48.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.950+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__shadow_file2.mpg.2~5izfVYJSNBwLaciOrXxuymmQx4QzUQS.3_1 2024-09-12T17:48:48.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.950+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__multipart_file2.mpg.2~5izfVYJSNBwLaciOrXxuymmQx4QzUQS.4 2024-09-12T17:48:48.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.950+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__shadow_file2.mpg.2~5izfVYJSNBwLaciOrXxuymmQx4QzUQS.4_1 2024-09-12T17:48:48.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.950+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__multipart_file2.mpg.2~5izfVYJSNBwLaciOrXxuymmQx4QzUQS.5 2024-09-12T17:48:48.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.958+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:48.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.962+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:48:48.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.966+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:48.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.966+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.966+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:48:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.966+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3272566214497593525', time=2024-09-12T19:48:22.807042+0000, chain.objs.size()=1 2024-09-12T17:48:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.966+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.61__shadow_.rS7zL29xEE5zGMBadKPi_lmnxpflCzB_0 2024-09-12T17:48:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.966+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7584731591514956879', time=2024-09-12T19:48:23.957056+0000, chain.objs.size()=1 2024-09-12T17:48:48.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.966+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.62__shadow_.xw9gzwV-tUWMOMoHNqfWRszMUEdZXpu_0 2024-09-12T17:48:48.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.970+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:48.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.974+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:48:48.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.978+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:48.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.978+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:48.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.978+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:48:48.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.978+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10311088966412723052', time=2024-09-12T19:46:37.921652+0000, chain.objs.size()=19 2024-09-12T17:48:48.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.978+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.1 2024-09-12T17:48:48.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.978+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.1_1 2024-09-12T17:48:48.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.978+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.2 2024-09-12T17:48:48.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.978+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.2_1 2024-09-12T17:48:48.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.978+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.3 2024-09-12T17:48:48.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.978+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.3_1 2024-09-12T17:48:48.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.978+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.4 2024-09-12T17:48:48.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.978+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.4_1 2024-09-12T17:48:48.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.978+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.5 2024-09-12T17:48:48.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.978+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.5_1 2024-09-12T17:48:48.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.978+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.6 2024-09-12T17:48:48.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.978+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.6_1 2024-09-12T17:48:48.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.986+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.7 2024-09-12T17:48:48.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.986+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.7_1 2024-09-12T17:48:48.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.986+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.8 2024-09-12T17:48:48.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.986+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.8_1 2024-09-12T17:48:48.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.986+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.9 2024-09-12T17:48:48.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.986+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.9_1 2024-09-12T17:48:48.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.990+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~vQaK0FVGFe1V8PD3G3kYe4tYNuwlCOv.10 2024-09-12T17:48:48.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.998+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:49.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:48.998+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:48:49.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:48:49.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11649373867263900543', time=2024-09-12T19:43:08.487735+0000, chain.objs.size()=9 2024-09-12T17:48:49.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__multipart_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.1 2024-09-12T17:48:49.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__shadow_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.1_1 2024-09-12T17:48:49.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__multipart_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.2 2024-09-12T17:48:49.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__shadow_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.2_1 2024-09-12T17:48:49.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__multipart_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.3 2024-09-12T17:48:49.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__shadow_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.3_1 2024-09-12T17:48:49.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__multipart_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.4 2024-09-12T17:48:49.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__shadow_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.4_1 2024-09-12T17:48:49.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__multipart_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.5 2024-09-12T17:48:49.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10662123668302500302', time=2024-09-12T19:43:39.067787+0000, chain.objs.size()=9 2024-09-12T17:48:49.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~EoSuIkuoTP7r7AWXZuGx8C104VQZkLL.1 2024-09-12T17:48:49.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~EoSuIkuoTP7r7AWXZuGx8C104VQZkLL.1_1 2024-09-12T17:48:49.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.002+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~EoSuIkuoTP7r7AWXZuGx8C104VQZkLL.2 2024-09-12T17:48:49.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.010+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~EoSuIkuoTP7r7AWXZuGx8C104VQZkLL.2_1 2024-09-12T17:48:49.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.010+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~EoSuIkuoTP7r7AWXZuGx8C104VQZkLL.3 2024-09-12T17:48:49.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.010+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~EoSuIkuoTP7r7AWXZuGx8C104VQZkLL.3_1 2024-09-12T17:48:49.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.010+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~EoSuIkuoTP7r7AWXZuGx8C104VQZkLL.4 2024-09-12T17:48:49.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.010+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~EoSuIkuoTP7r7AWXZuGx8C104VQZkLL.4_1 2024-09-12T17:48:49.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.010+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~EoSuIkuoTP7r7AWXZuGx8C104VQZkLL.5 2024-09-12T17:48:49.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.010+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1774141332971207412', time=2024-09-12T19:44:22.581026+0000, chain.objs.size()=9 2024-09-12T17:48:49.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.010+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.53__multipart_key1.2~RbzySwqkGscDQtP7pBl5iPcIMBCgkng.1 2024-09-12T17:48:49.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.010+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.53__shadow_key1.2~RbzySwqkGscDQtP7pBl5iPcIMBCgkng.1_1 2024-09-12T17:48:49.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.010+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.53__multipart_key1.2~RbzySwqkGscDQtP7pBl5iPcIMBCgkng.2 2024-09-12T17:48:49.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.010+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.53__shadow_key1.2~RbzySwqkGscDQtP7pBl5iPcIMBCgkng.2_1 2024-09-12T17:48:49.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.010+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.53__multipart_key1.2~RbzySwqkGscDQtP7pBl5iPcIMBCgkng.3 2024-09-12T17:48:49.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.018+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.53__shadow_key1.2~RbzySwqkGscDQtP7pBl5iPcIMBCgkng.3_1 2024-09-12T17:48:49.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.018+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.53__multipart_key1.2~RbzySwqkGscDQtP7pBl5iPcIMBCgkng.4 2024-09-12T17:48:49.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.018+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.53__shadow_key1.2~RbzySwqkGscDQtP7pBl5iPcIMBCgkng.4_1 2024-09-12T17:48:49.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.022+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.53__multipart_key1.2~RbzySwqkGscDQtP7pBl5iPcIMBCgkng.5 2024-09-12T17:48:49.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.026+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:49.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.030+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:48:49.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.034+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.034+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.034+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:48:49.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.034+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1048974767243041792', time=2024-09-12T19:47:32.519589+0000, chain.objs.size()=16 2024-09-12T17:48:49.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.034+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~sVkYitGnR-U6BVt3l4flJVIVgUCPuFS.1 2024-09-12T17:48:49.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.034+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~sVkYitGnR-U6BVt3l4flJVIVgUCPuFS.1_1 2024-09-12T17:48:49.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.034+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~sVkYitGnR-U6BVt3l4flJVIVgUCPuFS.1_2 2024-09-12T17:48:49.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.034+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~sVkYitGnR-U6BVt3l4flJVIVgUCPuFS.2 2024-09-12T17:48:49.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.034+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~sVkYitGnR-U6BVt3l4flJVIVgUCPuFS.2_1 2024-09-12T17:48:49.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.034+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~sVkYitGnR-U6BVt3l4flJVIVgUCPuFS.2_2 2024-09-12T17:48:49.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.034+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~sVkYitGnR-U6BVt3l4flJVIVgUCPuFS.3 2024-09-12T17:48:49.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.034+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~sVkYitGnR-U6BVt3l4flJVIVgUCPuFS.3_1 2024-09-12T17:48:49.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.034+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~sVkYitGnR-U6BVt3l4flJVIVgUCPuFS.3_2 2024-09-12T17:48:49.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.034+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~sVkYitGnR-U6BVt3l4flJVIVgUCPuFS.4 2024-09-12T17:48:49.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.034+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~sVkYitGnR-U6BVt3l4flJVIVgUCPuFS.4_1 2024-09-12T17:48:49.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.034+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~sVkYitGnR-U6BVt3l4flJVIVgUCPuFS.4_2 2024-09-12T17:48:49.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.042+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~sVkYitGnR-U6BVt3l4flJVIVgUCPuFS.5 2024-09-12T17:48:49.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.042+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~sVkYitGnR-U6BVt3l4flJVIVgUCPuFS.5_1 2024-09-12T17:48:49.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.042+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~sVkYitGnR-U6BVt3l4flJVIVgUCPuFS.5_2 2024-09-12T17:48:49.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.042+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~sVkYitGnR-U6BVt3l4flJVIVgUCPuFS.6 2024-09-12T17:48:49.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.046+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:49.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.050+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:48:49.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.054+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.054+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.054+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.058+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:48:49.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.058+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.058+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.058+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.062+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:48:49.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.062+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.062+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.066+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:48:49.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.066+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7886679507589716294', time=2024-09-12T19:43:43.615717+0000, chain.objs.size()=7 2024-09-12T17:48:49.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.066+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~9v7sso3hEymq2of_lnZnpS3-q7K31SD.1 2024-09-12T17:48:49.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.066+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~9v7sso3hEymq2of_lnZnpS3-q7K31SD.1_1 2024-09-12T17:48:49.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.066+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~9v7sso3hEymq2of_lnZnpS3-q7K31SD.1_2 2024-09-12T17:48:49.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.066+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~9v7sso3hEymq2of_lnZnpS3-q7K31SD.2 2024-09-12T17:48:49.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.066+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~9v7sso3hEymq2of_lnZnpS3-q7K31SD.2_1 2024-09-12T17:48:49.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.066+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~9v7sso3hEymq2of_lnZnpS3-q7K31SD.2_2 2024-09-12T17:48:49.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.066+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~9v7sso3hEymq2of_lnZnpS3-q7K31SD.3 2024-09-12T17:48:49.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.066+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3646746040611099197', time=2024-09-12T19:46:54.100947+0000, chain.objs.size()=16 2024-09-12T17:48:49.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.066+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~fdmXckvHGAkce2lfC0mM26pHHC_80bN.1 2024-09-12T17:48:49.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.066+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~fdmXckvHGAkce2lfC0mM26pHHC_80bN.1_1 2024-09-12T17:48:49.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.066+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~fdmXckvHGAkce2lfC0mM26pHHC_80bN.1_2 2024-09-12T17:48:49.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.066+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~fdmXckvHGAkce2lfC0mM26pHHC_80bN.2 2024-09-12T17:48:49.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.066+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~fdmXckvHGAkce2lfC0mM26pHHC_80bN.2_1 2024-09-12T17:48:49.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.074+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~fdmXckvHGAkce2lfC0mM26pHHC_80bN.2_2 2024-09-12T17:48:49.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.074+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~fdmXckvHGAkce2lfC0mM26pHHC_80bN.3 2024-09-12T17:48:49.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.074+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~fdmXckvHGAkce2lfC0mM26pHHC_80bN.3_1 2024-09-12T17:48:49.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.074+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~fdmXckvHGAkce2lfC0mM26pHHC_80bN.3_2 2024-09-12T17:48:49.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.074+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~fdmXckvHGAkce2lfC0mM26pHHC_80bN.4 2024-09-12T17:48:49.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.074+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~fdmXckvHGAkce2lfC0mM26pHHC_80bN.4_1 2024-09-12T17:48:49.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.074+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~fdmXckvHGAkce2lfC0mM26pHHC_80bN.4_2 2024-09-12T17:48:49.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.074+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~fdmXckvHGAkce2lfC0mM26pHHC_80bN.5 2024-09-12T17:48:49.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.074+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~fdmXckvHGAkce2lfC0mM26pHHC_80bN.5_1 2024-09-12T17:48:49.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.074+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~fdmXckvHGAkce2lfC0mM26pHHC_80bN.5_2 2024-09-12T17:48:49.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.074+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~fdmXckvHGAkce2lfC0mM26pHHC_80bN.6 2024-09-12T17:48:49.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.082+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:49.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.086+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:48:49.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.090+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.090+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.090+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:48:49.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.090+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14790653665917021882', time=2024-09-12T19:44:59.616429+0000, chain.objs.size()=1 2024-09-12T17:48:49.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.090+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__shadow_.6u7wcVvlK_vXZbl__KenJoD3Sd9XBLy_0 2024-09-12T17:48:49.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.090+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18132200902119891333', time=2024-09-12T19:48:27.398705+0000, chain.objs.size()=1 2024-09-12T17:48:49.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.090+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.65__shadow_.YYi0Ps8-1JYNiOlX9WsJ2WirUnEr43O_0 2024-09-12T17:48:49.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.090+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:49.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.094+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:48:49.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:48:49.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4850322923883340195', time=2024-09-12T19:43:09.212706+0000, chain.objs.size()=9 2024-09-12T17:48:49.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__multipart_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.1 2024-09-12T17:48:49.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__shadow_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.1_1 2024-09-12T17:48:49.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__multipart_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.2 2024-09-12T17:48:49.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__shadow_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.2_1 2024-09-12T17:48:49.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__multipart_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.3 2024-09-12T17:48:49.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__shadow_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.3_1 2024-09-12T17:48:49.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__multipart_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.4 2024-09-12T17:48:49.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__shadow_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.4_1 2024-09-12T17:48:49.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45__multipart_key1.2~Bld4_yloCwWi7lH-296OER5yWg62IOV.5 2024-09-12T17:48:49.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1178795776023329521', time=2024-09-12T19:43:49.614914+0000, chain.objs.size()=6 2024-09-12T17:48:49.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.47__shadow_.Cg8wllxaURRMcc_UR7RsG9gOAT2ELDq_0 2024-09-12T17:48:49.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.47__shadow_.Cg8wllxaURRMcc_UR7RsG9gOAT2ELDq_1 2024-09-12T17:48:49.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.098+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.47__shadow_.Cg8wllxaURRMcc_UR7RsG9gOAT2ELDq_2 2024-09-12T17:48:49.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.102+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.47__shadow_.Cg8wllxaURRMcc_UR7RsG9gOAT2ELDq_3 2024-09-12T17:48:49.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.102+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.47__shadow_.Cg8wllxaURRMcc_UR7RsG9gOAT2ELDq_4 2024-09-12T17:48:49.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.102+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.47__shadow_.Cg8wllxaURRMcc_UR7RsG9gOAT2ELDq_5 2024-09-12T17:48:49.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.102+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='2~MYCStVjcaTh7LYo3bG14FuGeu8PYeUw', time=2024-09-12T19:45:05.204010+0000, chain.objs.size()=5 2024-09-12T17:48:49.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.102+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.55__multipart_key1.2~MYCStVjcaTh7LYo3bG14FuGeu8PYeUw.7 2024-09-12T17:48:49.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.102+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.55__shadow_key1.2~MYCStVjcaTh7LYo3bG14FuGeu8PYeUw.7_1 2024-09-12T17:48:49.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.102+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.55__multipart_key1.2~MYCStVjcaTh7LYo3bG14FuGeu8PYeUw.10 2024-09-12T17:48:49.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.102+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.55__shadow_key1.2~MYCStVjcaTh7LYo3bG14FuGeu8PYeUw.10_1 2024-09-12T17:48:49.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.102+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.55__multipart_key1.2~MYCStVjcaTh7LYo3bG14FuGeu8PYeUw.13 2024-09-12T17:48:49.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.102+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11545214863975910755', time=2024-09-12T19:47:32.883224+0000, chain.objs.size()=16 2024-09-12T17:48:49.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.102+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~yt6rcf26rLW3qdlwXujQMLl3uNQT9ll.1 2024-09-12T17:48:49.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.102+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~yt6rcf26rLW3qdlwXujQMLl3uNQT9ll.1_1 2024-09-12T17:48:49.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.102+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~yt6rcf26rLW3qdlwXujQMLl3uNQT9ll.1_2 2024-09-12T17:48:49.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.106+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~yt6rcf26rLW3qdlwXujQMLl3uNQT9ll.2 2024-09-12T17:48:49.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.110+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~yt6rcf26rLW3qdlwXujQMLl3uNQT9ll.2_1 2024-09-12T17:48:49.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.110+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~yt6rcf26rLW3qdlwXujQMLl3uNQT9ll.2_2 2024-09-12T17:48:49.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.110+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~yt6rcf26rLW3qdlwXujQMLl3uNQT9ll.3 2024-09-12T17:48:49.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.110+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~yt6rcf26rLW3qdlwXujQMLl3uNQT9ll.3_1 2024-09-12T17:48:49.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.110+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~yt6rcf26rLW3qdlwXujQMLl3uNQT9ll.3_2 2024-09-12T17:48:49.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.110+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~yt6rcf26rLW3qdlwXujQMLl3uNQT9ll.4 2024-09-12T17:48:49.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.114+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~yt6rcf26rLW3qdlwXujQMLl3uNQT9ll.4_1 2024-09-12T17:48:49.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.114+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~yt6rcf26rLW3qdlwXujQMLl3uNQT9ll.4_2 2024-09-12T17:48:49.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.114+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~yt6rcf26rLW3qdlwXujQMLl3uNQT9ll.5 2024-09-12T17:48:49.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.114+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~yt6rcf26rLW3qdlwXujQMLl3uNQT9ll.5_1 2024-09-12T17:48:49.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.114+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~yt6rcf26rLW3qdlwXujQMLl3uNQT9ll.5_2 2024-09-12T17:48:49.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.114+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~yt6rcf26rLW3qdlwXujQMLl3uNQT9ll.6 2024-09-12T17:48:49.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.122+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:49.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.122+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:48:49.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.126+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.126+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.126+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.126+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:48:49.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:48:49.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10233908633357339524', time=2024-09-12T19:43:28.272044+0000, chain.objs.size()=9 2024-09-12T17:48:49.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~HIPsk_MYQp5EML0qeGUYGjfqzTjCONY.1 2024-09-12T17:48:49.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~HIPsk_MYQp5EML0qeGUYGjfqzTjCONY.1_1 2024-09-12T17:48:49.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~HIPsk_MYQp5EML0qeGUYGjfqzTjCONY.2 2024-09-12T17:48:49.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~HIPsk_MYQp5EML0qeGUYGjfqzTjCONY.2_1 2024-09-12T17:48:49.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~HIPsk_MYQp5EML0qeGUYGjfqzTjCONY.3 2024-09-12T17:48:49.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~HIPsk_MYQp5EML0qeGUYGjfqzTjCONY.3_1 2024-09-12T17:48:49.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~HIPsk_MYQp5EML0qeGUYGjfqzTjCONY.4 2024-09-12T17:48:49.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~HIPsk_MYQp5EML0qeGUYGjfqzTjCONY.4_1 2024-09-12T17:48:49.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~HIPsk_MYQp5EML0qeGUYGjfqzTjCONY.5 2024-09-12T17:48:49.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15653944155787403753', time=2024-09-12T19:48:01.349686+0000, chain.objs.size()=9 2024-09-12T17:48:49.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.58__multipart_key1.2~aEEfZS-4rvUCmWs14uJicJ8scIo_tKf.1 2024-09-12T17:48:49.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.58__shadow_key1.2~aEEfZS-4rvUCmWs14uJicJ8scIo_tKf.1_1 2024-09-12T17:48:49.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.130+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.58__multipart_key1.2~aEEfZS-4rvUCmWs14uJicJ8scIo_tKf.2 2024-09-12T17:48:49.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.138+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.58__shadow_key1.2~aEEfZS-4rvUCmWs14uJicJ8scIo_tKf.2_1 2024-09-12T17:48:49.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.138+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.58__multipart_key1.2~aEEfZS-4rvUCmWs14uJicJ8scIo_tKf.3 2024-09-12T17:48:49.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.138+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.58__shadow_key1.2~aEEfZS-4rvUCmWs14uJicJ8scIo_tKf.3_1 2024-09-12T17:48:49.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.138+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.58__multipart_key1.2~aEEfZS-4rvUCmWs14uJicJ8scIo_tKf.4 2024-09-12T17:48:49.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.138+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.58__shadow_key1.2~aEEfZS-4rvUCmWs14uJicJ8scIo_tKf.4_1 2024-09-12T17:48:49.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.138+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.58__multipart_key1.2~aEEfZS-4rvUCmWs14uJicJ8scIo_tKf.5 2024-09-12T17:48:49.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.142+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:49.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.142+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:48:49.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:48:49.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14748492837500905822', time=2024-09-12T19:43:48.534421+0000, chain.objs.size()=7 2024-09-12T17:48:49.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~H91-iPf6jICRgSsl7gTLF-Yju82nYP_.1 2024-09-12T17:48:49.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~H91-iPf6jICRgSsl7gTLF-Yju82nYP_.1_1 2024-09-12T17:48:49.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~H91-iPf6jICRgSsl7gTLF-Yju82nYP_.1_2 2024-09-12T17:48:49.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~H91-iPf6jICRgSsl7gTLF-Yju82nYP_.2 2024-09-12T17:48:49.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~H91-iPf6jICRgSsl7gTLF-Yju82nYP_.2_1 2024-09-12T17:48:49.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~H91-iPf6jICRgSsl7gTLF-Yju82nYP_.2_2 2024-09-12T17:48:49.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~H91-iPf6jICRgSsl7gTLF-Yju82nYP_.3 2024-09-12T17:48:49.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8603806894634086775', time=2024-09-12T19:44:59.270704+0000, chain.objs.size()=9 2024-09-12T17:48:49.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__multipart_file.mpg.2~B01m-Fn08-LuYq63oSL7ztTGJ7vKkNs.1 2024-09-12T17:48:49.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__shadow_file.mpg.2~B01m-Fn08-LuYq63oSL7ztTGJ7vKkNs.1_1 2024-09-12T17:48:49.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__multipart_file.mpg.2~B01m-Fn08-LuYq63oSL7ztTGJ7vKkNs.2 2024-09-12T17:48:49.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__shadow_file.mpg.2~B01m-Fn08-LuYq63oSL7ztTGJ7vKkNs.2_1 2024-09-12T17:48:49.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.146+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__multipart_file.mpg.2~B01m-Fn08-LuYq63oSL7ztTGJ7vKkNs.3 2024-09-12T17:48:49.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.150+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__shadow_file.mpg.2~B01m-Fn08-LuYq63oSL7ztTGJ7vKkNs.3_1 2024-09-12T17:48:49.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.150+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__multipart_file.mpg.2~B01m-Fn08-LuYq63oSL7ztTGJ7vKkNs.4 2024-09-12T17:48:49.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.150+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__shadow_file.mpg.2~B01m-Fn08-LuYq63oSL7ztTGJ7vKkNs.4_1 2024-09-12T17:48:49.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.154+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__multipart_file.mpg.2~B01m-Fn08-LuYq63oSL7ztTGJ7vKkNs.5 2024-09-12T17:48:49.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.154+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa', time=2024-09-12T19:48:18.298448+0000, chain.objs.size()=62 2024-09-12T17:48:49.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.154+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.1 2024-09-12T17:48:49.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.154+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.2 2024-09-12T17:48:49.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.154+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.3 2024-09-12T17:48:49.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.154+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.4 2024-09-12T17:48:49.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.154+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.5 2024-09-12T17:48:49.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.154+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.6 2024-09-12T17:48:49.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.154+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.7 2024-09-12T17:48:49.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.154+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.8 2024-09-12T17:48:49.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.154+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.9 2024-09-12T17:48:49.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.158+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.10 2024-09-12T17:48:49.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.158+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.11 2024-09-12T17:48:49.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.158+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.12 2024-09-12T17:48:49.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.158+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.13 2024-09-12T17:48:49.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.158+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.14 2024-09-12T17:48:49.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.158+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.15 2024-09-12T17:48:49.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.158+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.16 2024-09-12T17:48:49.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.158+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.17 2024-09-12T17:48:49.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.158+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.18 2024-09-12T17:48:49.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.162+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.19 2024-09-12T17:48:49.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.162+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.20 2024-09-12T17:48:49.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.162+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.21 2024-09-12T17:48:49.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.162+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.22 2024-09-12T17:48:49.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.162+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.23 2024-09-12T17:48:49.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.162+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.24 2024-09-12T17:48:49.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.166+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.25 2024-09-12T17:48:49.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.166+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.26 2024-09-12T17:48:49.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.166+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.27 2024-09-12T17:48:49.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.166+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.28 2024-09-12T17:48:49.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.166+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.29 2024-09-12T17:48:49.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.166+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.30 2024-09-12T17:48:49.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.166+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.31 2024-09-12T17:48:49.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.166+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.32 2024-09-12T17:48:49.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.166+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.33 2024-09-12T17:48:49.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.166+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.34 2024-09-12T17:48:49.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.170+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.35 2024-09-12T17:48:49.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.170+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.36 2024-09-12T17:48:49.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.170+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.37 2024-09-12T17:48:49.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.170+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.38 2024-09-12T17:48:49.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.170+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.39 2024-09-12T17:48:49.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.170+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.40 2024-09-12T17:48:49.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.170+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.41 2024-09-12T17:48:49.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.174+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.42 2024-09-12T17:48:49.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.174+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.43 2024-09-12T17:48:49.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.174+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.44 2024-09-12T17:48:49.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.174+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.45 2024-09-12T17:48:49.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.174+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.46 2024-09-12T17:48:49.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.174+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.47 2024-09-12T17:48:49.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.174+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.48 2024-09-12T17:48:49.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.174+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.49 2024-09-12T17:48:49.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.174+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.50 2024-09-12T17:48:49.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.174+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.51 2024-09-12T17:48:49.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.178+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.52 2024-09-12T17:48:49.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.178+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.53 2024-09-12T17:48:49.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.178+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.54 2024-09-12T17:48:49.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.178+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.55 2024-09-12T17:48:49.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.178+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.56 2024-09-12T17:48:49.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.178+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.57 2024-09-12T17:48:49.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.178+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.58 2024-09-12T17:48:49.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.178+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.59 2024-09-12T17:48:49.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.178+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.60 2024-09-12T17:48:49.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.178+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.61 2024-09-12T17:48:49.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.182+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59__multipart_key1.2~XDsEkWKOJ87zUWHyGmu8FIMxfNXVcXa.62 2024-09-12T17:48:49.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.186+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:49.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.186+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:48:49.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.190+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.190+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.190+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:48:49.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.190+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4639545002783324637', time=2024-09-12T19:44:10.975305+0000, chain.objs.size()=9 2024-09-12T17:48:49.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.190+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.52__multipart_key1.2~_pVkmZwGrtzUCxs1_lh7DrLCnxzzx8n.1 2024-09-12T17:48:49.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.190+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.52__shadow_key1.2~_pVkmZwGrtzUCxs1_lh7DrLCnxzzx8n.1_1 2024-09-12T17:48:49.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.190+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.52__multipart_key1.2~_pVkmZwGrtzUCxs1_lh7DrLCnxzzx8n.2 2024-09-12T17:48:49.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.190+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.52__shadow_key1.2~_pVkmZwGrtzUCxs1_lh7DrLCnxzzx8n.2_1 2024-09-12T17:48:49.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.190+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.52__multipart_key1.2~_pVkmZwGrtzUCxs1_lh7DrLCnxzzx8n.3 2024-09-12T17:48:49.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.190+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.52__shadow_key1.2~_pVkmZwGrtzUCxs1_lh7DrLCnxzzx8n.3_1 2024-09-12T17:48:49.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.190+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.52__multipart_key1.2~_pVkmZwGrtzUCxs1_lh7DrLCnxzzx8n.4 2024-09-12T17:48:49.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.190+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.52__shadow_key1.2~_pVkmZwGrtzUCxs1_lh7DrLCnxzzx8n.4_1 2024-09-12T17:48:49.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.190+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.52__multipart_key1.2~_pVkmZwGrtzUCxs1_lh7DrLCnxzzx8n.5 2024-09-12T17:48:49.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.190+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6937906190212094355', time=2024-09-12T19:48:26.288828+0000, chain.objs.size()=1 2024-09-12T17:48:49.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.190+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.64__shadow_.3mH6Mpu9JbEs8gIt9n-wDEEgWD5TJOx_0 2024-09-12T17:48:49.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.198+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:49.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.198+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:48:49.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.202+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.202+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.202+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:48:49.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.202+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14927727848887752255', time=2024-09-12T19:45:59.395170+0000, chain.objs.size()=21 2024-09-12T17:48:49.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.202+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.1 2024-09-12T17:48:49.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.202+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.1_1 2024-09-12T17:48:49.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.202+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.2 2024-09-12T17:48:49.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.202+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.2_1 2024-09-12T17:48:49.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.202+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.3 2024-09-12T17:48:49.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.202+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.3_1 2024-09-12T17:48:49.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.202+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.4 2024-09-12T17:48:49.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.202+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.4_1 2024-09-12T17:48:49.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.202+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.5 2024-09-12T17:48:49.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.202+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.5_1 2024-09-12T17:48:49.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.202+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.6 2024-09-12T17:48:49.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.202+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.6_1 2024-09-12T17:48:49.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.206+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.7 2024-09-12T17:48:49.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.206+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.7_1 2024-09-12T17:48:49.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.206+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.8 2024-09-12T17:48:49.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.206+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.8_1 2024-09-12T17:48:49.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.206+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.9 2024-09-12T17:48:49.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.206+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.9_1 2024-09-12T17:48:49.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.206+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.10 2024-09-12T17:48:49.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.206+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.10_1 2024-09-12T17:48:49.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.206+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~Zvxa45I7hJ1bj0y5fOlrGFXLnB-0Ad-.11 2024-09-12T17:48:49.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.210+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:49.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.214+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:48:49.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.214+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.214+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.218+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:48:49.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.218+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9562459167218709314', time=2024-09-12T19:45:40.266655+0000, chain.objs.size()=21 2024-09-12T17:48:49.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.218+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.1 2024-09-12T17:48:49.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.218+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.1_1 2024-09-12T17:48:49.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.218+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.2 2024-09-12T17:48:49.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.218+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.2_1 2024-09-12T17:48:49.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.218+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.3 2024-09-12T17:48:49.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.218+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.3_1 2024-09-12T17:48:49.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.218+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.4 2024-09-12T17:48:49.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.218+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.4_1 2024-09-12T17:48:49.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.218+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.5 2024-09-12T17:48:49.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.218+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.5_1 2024-09-12T17:48:49.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.218+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.6 2024-09-12T17:48:49.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.218+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.6_1 2024-09-12T17:48:49.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.222+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.7 2024-09-12T17:48:49.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.222+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.7_1 2024-09-12T17:48:49.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.222+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.8 2024-09-12T17:48:49.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.222+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.8_1 2024-09-12T17:48:49.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.222+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.9 2024-09-12T17:48:49.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.222+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.9_1 2024-09-12T17:48:49.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.222+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.10 2024-09-12T17:48:49.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.222+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__shadow_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.10_1 2024-09-12T17:48:49.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.222+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.56__multipart_key1.2~SxfGgdLdESjz9sUnrWcbtgOzKfWkm5K.11 2024-09-12T17:48:49.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.222+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.937621338934518887', time=2024-09-12T19:48:21.647282+0000, chain.objs.size()=1 2024-09-12T17:48:49.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.222+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.60__shadow_.HASBZI12qLzy7YkjFpkVar87ZzowEl6_0 2024-09-12T17:48:49.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.222+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18413920210041342392', time=2024-09-12T19:48:25.120210+0000, chain.objs.size()=1 2024-09-12T17:48:49.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.222+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.63__shadow_.smKQ--aGOCFUdW_hEG8TwqxzwoGVYSy_0 2024-09-12T17:48:49.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.230+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:49.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.230+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:48:49.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.234+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.234+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.234+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.234+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:48:49.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.234+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.234+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:48:49.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:48:49.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4678173884449183085', time=2024-09-12T19:42:57.720358+0000, chain.objs.size()=9 2024-09-12T17:48:49.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.43__multipart_key1.2~-SjYBAjWwgxP485H0l_LfyMrkKZtKxy.1 2024-09-12T17:48:49.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.43__shadow_key1.2~-SjYBAjWwgxP485H0l_LfyMrkKZtKxy.1_1 2024-09-12T17:48:49.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.43__multipart_key1.2~-SjYBAjWwgxP485H0l_LfyMrkKZtKxy.2 2024-09-12T17:48:49.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.43__shadow_key1.2~-SjYBAjWwgxP485H0l_LfyMrkKZtKxy.2_1 2024-09-12T17:48:49.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.43__multipart_key1.2~-SjYBAjWwgxP485H0l_LfyMrkKZtKxy.3 2024-09-12T17:48:49.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.43__shadow_key1.2~-SjYBAjWwgxP485H0l_LfyMrkKZtKxy.3_1 2024-09-12T17:48:49.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.43__multipart_key1.2~-SjYBAjWwgxP485H0l_LfyMrkKZtKxy.4 2024-09-12T17:48:49.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.43__shadow_key1.2~-SjYBAjWwgxP485H0l_LfyMrkKZtKxy.4_1 2024-09-12T17:48:49.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.43__multipart_key1.2~-SjYBAjWwgxP485H0l_LfyMrkKZtKxy.5 2024-09-12T17:48:49.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4108455567108735905', time=2024-09-12T19:44:59.546444+0000, chain.objs.size()=1 2024-09-12T17:48:49.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.238+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__shadow_.ykdsDvJqJxkYD1n1YHXkzX8ESdHLkZA_0 2024-09-12T17:48:49.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.242+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:49.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.246+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:48:49.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.250+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.250+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.250+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.250+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:48:49.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.250+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.254+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.254+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:48:49.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.254+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4943806444718757189', time=2024-09-12T19:44:59.345151+0000, chain.objs.size()=1 2024-09-12T17:48:49.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.254+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54__shadow_.poA_QKvHXadWZUcMTseU4FKmfWUggv9_0 2024-09-12T17:48:49.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.254+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:49.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.258+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:48:49.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.258+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.258+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.258+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:48:49.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.258+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1734416796574161140', time=2024-09-12T19:43:48.905637+0000, chain.objs.size()=7 2024-09-12T17:48:49.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.258+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~eylWe1buAXJf9LihWiBNmzErCoH6HDU.1 2024-09-12T17:48:49.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.258+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~eylWe1buAXJf9LihWiBNmzErCoH6HDU.1_1 2024-09-12T17:48:49.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.258+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~eylWe1buAXJf9LihWiBNmzErCoH6HDU.1_2 2024-09-12T17:48:49.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.258+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~eylWe1buAXJf9LihWiBNmzErCoH6HDU.2 2024-09-12T17:48:49.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.258+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~eylWe1buAXJf9LihWiBNmzErCoH6HDU.2_1 2024-09-12T17:48:49.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.258+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__shadow_key1.2~eylWe1buAXJf9LihWiBNmzErCoH6HDU.2_2 2024-09-12T17:48:49.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.258+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48__multipart_key1.2~eylWe1buAXJf9LihWiBNmzErCoH6HDU.3 2024-09-12T17:48:49.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.262+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:49.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:48:49.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:48:49.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2197769721416061917', time=2024-09-12T19:47:52.346124+0000, chain.objs.size()=9 2024-09-12T17:48:49.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.57__multipart_key1.2~MtSxoNEuOe2PGRMdMo7l0o1yICf3VP6.1 2024-09-12T17:48:49.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.57__shadow_key1.2~MtSxoNEuOe2PGRMdMo7l0o1yICf3VP6.1_1 2024-09-12T17:48:49.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.57__multipart_key1.2~MtSxoNEuOe2PGRMdMo7l0o1yICf3VP6.2 2024-09-12T17:48:49.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.57__shadow_key1.2~MtSxoNEuOe2PGRMdMo7l0o1yICf3VP6.2_1 2024-09-12T17:48:49.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.57__multipart_key1.2~MtSxoNEuOe2PGRMdMo7l0o1yICf3VP6.3 2024-09-12T17:48:49.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.57__shadow_key1.2~MtSxoNEuOe2PGRMdMo7l0o1yICf3VP6.3_1 2024-09-12T17:48:49.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.57__multipart_key1.2~MtSxoNEuOe2PGRMdMo7l0o1yICf3VP6.4 2024-09-12T17:48:49.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.57__shadow_key1.2~MtSxoNEuOe2PGRMdMo7l0o1yICf3VP6.4_1 2024-09-12T17:48:49.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.57__multipart_key1.2~MtSxoNEuOe2PGRMdMo7l0o1yICf3VP6.5 2024-09-12T17:48:49.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16633276894243184442', time=2024-09-12T19:48:47.323877+0000, chain.objs.size()=21 2024-09-12T17:48:49.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__multipart_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.1 2024-09-12T17:48:49.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__shadow_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.1_1 2024-09-12T17:48:49.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.266+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__multipart_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.2 2024-09-12T17:48:49.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.270+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__shadow_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.2_1 2024-09-12T17:48:49.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.270+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__multipart_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.3 2024-09-12T17:48:49.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.270+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__shadow_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.3_1 2024-09-12T17:48:49.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.270+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__multipart_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.4 2024-09-12T17:48:49.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.270+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__shadow_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.4_1 2024-09-12T17:48:49.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.270+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__multipart_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.5 2024-09-12T17:48:49.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.270+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__shadow_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.5_1 2024-09-12T17:48:49.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.274+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__multipart_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.6 2024-09-12T17:48:49.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.274+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__shadow_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.6_1 2024-09-12T17:48:49.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.274+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__multipart_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.7 2024-09-12T17:48:49.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.274+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__shadow_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.7_1 2024-09-12T17:48:49.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.278+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__multipart_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.8 2024-09-12T17:48:49.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.278+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__shadow_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.8_1 2024-09-12T17:48:49.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.278+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__multipart_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.9 2024-09-12T17:48:49.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.278+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__shadow_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.9_1 2024-09-12T17:48:49.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.278+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__multipart_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.10 2024-09-12T17:48:49.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.278+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__shadow_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.10_1 2024-09-12T17:48:49.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.278+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67__multipart_key1.2~lLiWzE-G4lceh_BwYSMXmxiWXM3iS5Z.11 2024-09-12T17:48:49.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.282+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:49.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.286+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:48:49.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.286+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.286+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.286+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.290+0000 7fb2433969c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:48:49.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.290+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.290+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.290+0000 7fb2433969c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:48:49.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.290+0000 7fb2433969c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9986102072766626099', time=2024-09-12T19:47:50.392693+0000, chain.objs.size()=1 2024-09-12T17:48:49.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.290+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.57__shadow_.fDkludHhaV4djSphV4JGEG438lC_UpE_0 2024-09-12T17:48:49.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.294+0000 7fb2433969c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:48:49.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.294+0000 7fb0f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:49.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.298+0000 7fb2433969c0 20 remove_watcher() i=0 2024-09-12T17:48:49.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.298+0000 7fb2433969c0 2 removed watcher, disabling cache 2024-09-12T17:48:49.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.298+0000 7fb2433969c0 20 remove_watcher() i=1 2024-09-12T17:48:49.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.302+0000 7fb2433969c0 20 remove_watcher() i=2 2024-09-12T17:48:49.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.302+0000 7fb2433969c0 20 remove_watcher() i=3 2024-09-12T17:48:49.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.302+0000 7fb2433969c0 20 remove_watcher() i=4 2024-09-12T17:48:49.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.306+0000 7fb2433969c0 20 remove_watcher() i=5 2024-09-12T17:48:49.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.306+0000 7fb2433969c0 20 remove_watcher() i=6 2024-09-12T17:48:49.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.306+0000 7fb2433969c0 20 remove_watcher() i=7 2024-09-12T17:48:49.322 DEBUG:teuthology.orchestra.run.smithi119:> radosgw-admin gc process --include-all 2024-09-12T17:48:49.391 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:49.391 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:49.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.434+0000 7f15ea0799c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.434+0000 7f15ea0799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.434+0000 7f15ea0799c0 20 realm 2024-09-12T17:48:49.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.434+0000 7f15ea0799c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.434+0000 7f15ea0799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.434+0000 7f15ea0799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:49.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.434+0000 7f15ea0799c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.434+0000 7f15ea0799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.434+0000 7f15ea0799c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.434+0000 7f15ea0799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:49.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.434+0000 7f15ea0799c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.438+0000 7f15ea0799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:49.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.438+0000 7f15ea0799c0 20 searching for the correct realm 2024-09-12T17:48:49.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.442+0000 7f15e8380640 0 -- 172.21.15.119:0/3431235297 >> [v2:172.21.15.119:6816/4034469375,v1:172.21.15.119:6818/4034469375] conn(0x556b467ab000 msgr2=0x556b467ad470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:49.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.450+0000 7f15e737e640 0 -- 172.21.15.119:0/3431235297 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f15e003d410 msgr2=0x7f15e003d890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:49.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:48:49.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:48:49.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:49.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:49.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:49.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:49.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:49.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:49.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 zone default found 2024-09-12T17:48:49.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 4 Realm: () 2024-09-12T17:48:49.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:48:49.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:48:49.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:49.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 zonegroup default 2024-09-12T17:48:49.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.458+0000 7f15ea0799c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.462+0000 7f15ea0799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.462+0000 7f15ea0799c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:49.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.462+0000 7f15ea0799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:49.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.462+0000 7f15ea0799c0 20 started sync module instance, tier type = 2024-09-12T17:48:49.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.462+0000 7f15ea0799c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:48:49.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.478+0000 7f15ea0799c0 20 add_watcher() i=0 2024-09-12T17:48:49.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.478+0000 7f15ea0799c0 20 add_watcher() i=1 2024-09-12T17:48:49.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.478+0000 7f15ea0799c0 20 add_watcher() i=2 2024-09-12T17:48:49.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.478+0000 7f15ea0799c0 20 add_watcher() i=3 2024-09-12T17:48:49.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.478+0000 7f15ea0799c0 20 add_watcher() i=4 2024-09-12T17:48:49.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.478+0000 7f15ea0799c0 20 add_watcher() i=5 2024-09-12T17:48:49.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.478+0000 7f15ea0799c0 20 add_watcher() i=6 2024-09-12T17:48:49.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.478+0000 7f15ea0799c0 20 add_watcher() i=7 2024-09-12T17:48:49.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.478+0000 7f15ea0799c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:49.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.482+0000 7f149dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:49.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.482+0000 7f15ea0799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:49.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.482+0000 7f15ea0799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:49.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.558+0000 7f149cfe1640 20 reqs_thread_entry: start 2024-09-12T17:48:49.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.558+0000 7f15ea0799c0 20 init_complete bucket index max shards: 11 2024-09-12T17:48:49.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.558+0000 7f15ea0799c0 20 Filter name: none 2024-09-12T17:48:49.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.558+0000 7f14167fc640 20 reqs_thread_entry: start 2024-09-12T17:48:49.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.558+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:48:49.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.562+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.562+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.562+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.562+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:48:49.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.566+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.570+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.570+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.574+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:48:49.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.574+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.574+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.574+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.578+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:48:49.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.578+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.582+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.582+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.586+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:48:49.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.586+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.586+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.586+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.590+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:48:49.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.590+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.590+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.590+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.594+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:48:49.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.598+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.598+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.602+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.602+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:48:49.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.606+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.606+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.610+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.610+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:48:49.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.614+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.614+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.614+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.618+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:48:49.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.622+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.622+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.622+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.626+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:48:49.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.630+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.634+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.634+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.634+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:48:49.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.638+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.638+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.642+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.642+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:48:49.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.646+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.650+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.650+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.654+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:48:49.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.654+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.658+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.658+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.662+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:48:49.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.662+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.666+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.666+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.670+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:48:49.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.674+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.674+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.678+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.678+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:48:49.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.682+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.686+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.686+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.690+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:48:49.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.690+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.694+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.694+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.698+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:48:49.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.702+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.702+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.702+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.706+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:48:49.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.710+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.710+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.710+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.714+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:48:49.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.718+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.722+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.722+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.726+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:48:49.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.730+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.730+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.730+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.734+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:48:49.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.738+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.742+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.742+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.746+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:48:49.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.750+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.750+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.750+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.754+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:48:49.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.758+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.758+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.762+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.766+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:48:49.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.770+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.770+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.770+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.774+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:48:49.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.778+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.778+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.782+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.782+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:48:49.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.786+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.786+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.790+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.790+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:48:49.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.794+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.798+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.798+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.802+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:48:49.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.802+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.806+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.806+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.810+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:48:49.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.814+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.814+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.814+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.818+0000 7f15ea0799c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:48:49.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.822+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.822+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:49.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.826+0000 7f15ea0799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:49.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.830+0000 7f149dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:49.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.834+0000 7f15ea0799c0 20 remove_watcher() i=0 2024-09-12T17:48:49.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.834+0000 7f15ea0799c0 2 removed watcher, disabling cache 2024-09-12T17:48:49.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.838+0000 7f15ea0799c0 20 remove_watcher() i=1 2024-09-12T17:48:49.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.838+0000 7f15ea0799c0 20 remove_watcher() i=2 2024-09-12T17:48:49.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.842+0000 7f15ea0799c0 20 remove_watcher() i=3 2024-09-12T17:48:49.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.842+0000 7f15ea0799c0 20 remove_watcher() i=4 2024-09-12T17:48:49.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.846+0000 7f15ea0799c0 20 remove_watcher() i=5 2024-09-12T17:48:49.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.846+0000 7f15ea0799c0 20 remove_watcher() i=6 2024-09-12T17:48:49.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.850+0000 7f15ea0799c0 20 remove_watcher() i=7 2024-09-12T17:48:49.875 DEBUG:teuthology.orchestra.run.smithi119:> radosgw-admin gc process --include-all 2024-09-12T17:48:49.950 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:49.951 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:49.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.994+0000 7f10d04fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.998+0000 7f10d04fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:50.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.998+0000 7f10d04fc9c0 20 realm 2024-09-12T17:48:50.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.998+0000 7f10d04fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.998+0000 7f10d04fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:50.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.998+0000 7f10d04fc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:50.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.998+0000 7f10d04fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.998+0000 7f10d04fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:50.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.998+0000 7f10d04fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.998+0000 7f10d04fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:50.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:49.998+0000 7f10d04fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.002+0000 7f10d04fc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:50.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.002+0000 7f10d04fc9c0 20 searching for the correct realm 2024-09-12T17:48:50.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.006+0000 7f10ce803640 0 -- 172.21.15.119:0/447055528 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f10c401a040 msgr2=0x7f10c40670f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:50.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.222+0000 7f10cd801640 0 -- 172.21.15.119:0/447055528 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f10c804fbc0 msgr2=0x7f10c800b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:50.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.438+0000 7f10d04fc9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:48:50.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.438+0000 7f10d04fc9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:48:50.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.438+0000 7f10d04fc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:50.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.438+0000 7f10d04fc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:50.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.438+0000 7f10d04fc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:50.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.438+0000 7f10d04fc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:50.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.438+0000 7f10d04fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.438+0000 7f10d04fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:50.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.438+0000 7f10d04fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.442+0000 7f10d04fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:50.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.442+0000 7f10d04fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.442+0000 7f10d04fc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:50.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.442+0000 7f10d04fc9c0 20 zone default found 2024-09-12T17:48:50.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.442+0000 7f10d04fc9c0 4 Realm: () 2024-09-12T17:48:50.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.442+0000 7f10d04fc9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:48:50.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.442+0000 7f10d04fc9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:48:50.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.442+0000 7f10d04fc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:50.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.442+0000 7f10d04fc9c0 20 zonegroup default 2024-09-12T17:48:50.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.442+0000 7f10d04fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.442+0000 7f10d04fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:50.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.442+0000 7f10d04fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.442+0000 7f10d04fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:50.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.442+0000 7f10d04fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.446+0000 7f10d04fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:50.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.446+0000 7f10d04fc9c0 20 started sync module instance, tier type = 2024-09-12T17:48:50.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.446+0000 7f10d04fc9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:48:50.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.466+0000 7f10d04fc9c0 20 add_watcher() i=0 2024-09-12T17:48:50.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.466+0000 7f10d04fc9c0 20 add_watcher() i=1 2024-09-12T17:48:50.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.466+0000 7f10d04fc9c0 20 add_watcher() i=2 2024-09-12T17:48:50.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.466+0000 7f10d04fc9c0 20 add_watcher() i=3 2024-09-12T17:48:50.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.466+0000 7f10d04fc9c0 20 add_watcher() i=4 2024-09-12T17:48:50.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.466+0000 7f10d04fc9c0 20 add_watcher() i=5 2024-09-12T17:48:50.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.466+0000 7f10d04fc9c0 20 add_watcher() i=6 2024-09-12T17:48:50.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.470+0000 7f10d04fc9c0 20 add_watcher() i=7 2024-09-12T17:48:50.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.470+0000 7f10d04fc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:50.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.474+0000 7f0f7f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:50.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.474+0000 7f10d04fc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:50.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.474+0000 7f10d04fc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:50.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.570+0000 7f0f7e7fc640 20 reqs_thread_entry: start 2024-09-12T17:48:50.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.570+0000 7f10d04fc9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:48:50.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.570+0000 7f10d04fc9c0 20 Filter name: none 2024-09-12T17:48:50.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.570+0000 7f0eeffff640 20 reqs_thread_entry: start 2024-09-12T17:48:50.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.570+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:48:50.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.574+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.574+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.574+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.574+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:48:50.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.578+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.582+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.582+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.586+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:48:50.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.586+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.590+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.590+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.590+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:48:50.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.594+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.594+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.594+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.598+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:48:50.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.602+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.602+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.602+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.606+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:48:50.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.610+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.610+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.610+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.610+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:48:50.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.614+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.614+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.614+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.618+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:48:50.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.622+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.622+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.622+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.626+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:48:50.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.630+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.630+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.630+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.634+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:48:50.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.638+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.638+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.638+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.642+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:48:50.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.646+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.646+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.646+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.650+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:48:50.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.654+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.654+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.654+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.658+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:48:50.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.662+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.662+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.662+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.666+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:48:50.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.670+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.670+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.670+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.674+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:48:50.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.678+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.678+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.678+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.682+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:48:50.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.686+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.686+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.686+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.690+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:48:50.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.694+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.694+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.694+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.698+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:48:50.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.702+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.702+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.702+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.706+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:48:50.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.710+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.710+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.710+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.714+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:48:50.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.718+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.718+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.718+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.722+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:48:50.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.726+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.726+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.730+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.730+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:48:50.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.734+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.734+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.738+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.738+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:48:50.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.742+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.746+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.746+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.750+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:48:50.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.754+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.754+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.754+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.758+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:48:50.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.762+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.762+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.766+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.770+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:48:50.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.774+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.778+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.778+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.782+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:48:50.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.782+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.786+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.786+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.786+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:48:50.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.790+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.794+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.794+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.798+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:48:50.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.798+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.802+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.802+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.802+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:48:50.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.806+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.810+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.810+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.810+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:48:50.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.814+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.818+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.818+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.822+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:48:50.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.826+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.826+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:50.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.830+0000 7f10d04fc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:50.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.834+0000 7f0f7f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:50.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.838+0000 7f10d04fc9c0 20 remove_watcher() i=0 2024-09-12T17:48:50.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.838+0000 7f10d04fc9c0 2 removed watcher, disabling cache 2024-09-12T17:48:50.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.842+0000 7f10d04fc9c0 20 remove_watcher() i=1 2024-09-12T17:48:50.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.842+0000 7f10d04fc9c0 20 remove_watcher() i=2 2024-09-12T17:48:50.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.846+0000 7f10d04fc9c0 20 remove_watcher() i=3 2024-09-12T17:48:50.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.846+0000 7f10d04fc9c0 20 remove_watcher() i=4 2024-09-12T17:48:50.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.850+0000 7f10d04fc9c0 20 remove_watcher() i=5 2024-09-12T17:48:50.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.850+0000 7f10d04fc9c0 20 remove_watcher() i=6 2024-09-12T17:48:50.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.854+0000 7f10d04fc9c0 20 remove_watcher() i=7 2024-09-12T17:48:50.874 DEBUG:teuthology.orchestra.run.smithi119:> radosgw-admin gc process --include-all 2024-09-12T17:48:50.947 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:50.947 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:50.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.990+0000 7fc5ad5d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.994+0000 7fc5ad5d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:50.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.994+0000 7fc5ad5d89c0 20 realm 2024-09-12T17:48:50.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.994+0000 7fc5ad5d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.994+0000 7fc5ad5d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:50.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.994+0000 7fc5ad5d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:50.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.994+0000 7fc5ad5d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.994+0000 7fc5ad5d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:50.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.994+0000 7fc5ad5d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.994+0000 7fc5ad5d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:50.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.994+0000 7fc5ad5d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:50.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.998+0000 7fc5ad5d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:50.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.998+0000 7fc5ad5d89c0 20 searching for the correct realm 2024-09-12T17:48:51.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:50.998+0000 7fc5ab8df640 0 -- 172.21.15.119:0/980684585 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fc5a00f6cf0 msgr2=0x7fc5a00ff9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:51.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.006+0000 7fc5aa8dd640 0 -- 172.21.15.119:0/980684585 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fc5a404b7d0 msgr2=0x7fc5a40881c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.222+0000 7fc5ad5d89c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:48:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.222+0000 7fc5ad5d89c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:48:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.222+0000 7fc5ad5d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.222+0000 7fc5ad5d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.222+0000 7fc5ad5d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.222+0000 7fc5ad5d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.222+0000 7fc5ad5d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.226+0000 7fc5ad5d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.226+0000 7fc5ad5d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.226+0000 7fc5ad5d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:51.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.226+0000 7fc5ad5d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.226+0000 7fc5ad5d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:51.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.226+0000 7fc5ad5d89c0 20 zone default found 2024-09-12T17:48:51.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.226+0000 7fc5ad5d89c0 4 Realm: () 2024-09-12T17:48:51.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.226+0000 7fc5ad5d89c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:48:51.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.226+0000 7fc5ad5d89c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:48:51.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.226+0000 7fc5ad5d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:51.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.226+0000 7fc5ad5d89c0 20 zonegroup default 2024-09-12T17:48:51.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.226+0000 7fc5ad5d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.226+0000 7fc5ad5d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.226+0000 7fc5ad5d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.226+0000 7fc5ad5d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.226+0000 7fc5ad5d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:48:51.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.230+0000 7fc5ad5d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:51.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.230+0000 7fc5ad5d89c0 20 started sync module instance, tier type = 2024-09-12T17:48:51.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.230+0000 7fc5ad5d89c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:48:51.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.254+0000 7fc5ad5d89c0 20 add_watcher() i=0 2024-09-12T17:48:51.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.254+0000 7fc5ad5d89c0 20 add_watcher() i=1 2024-09-12T17:48:51.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.254+0000 7fc5ad5d89c0 20 add_watcher() i=2 2024-09-12T17:48:51.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.254+0000 7fc5ad5d89c0 20 add_watcher() i=3 2024-09-12T17:48:51.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.254+0000 7fc5ad5d89c0 20 add_watcher() i=4 2024-09-12T17:48:51.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.254+0000 7fc5ad5d89c0 20 add_watcher() i=5 2024-09-12T17:48:51.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.254+0000 7fc5ad5d89c0 20 add_watcher() i=6 2024-09-12T17:48:51.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.254+0000 7fc5ad5d89c0 20 add_watcher() i=7 2024-09-12T17:48:51.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.254+0000 7fc5ad5d89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:51.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.258+0000 7fc461fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:51.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.258+0000 7fc5ad5d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:51.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.258+0000 7fc5ad5d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:51.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.350+0000 7fc460fe1640 20 reqs_thread_entry: start 2024-09-12T17:48:51.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.350+0000 7fc5ad5d89c0 20 init_complete bucket index max shards: 11 2024-09-12T17:48:51.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.354+0000 7fc5ad5d89c0 20 Filter name: none 2024-09-12T17:48:51.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.354+0000 7fc3da7fc640 20 reqs_thread_entry: start 2024-09-12T17:48:51.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.354+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:48:51.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.358+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.358+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.358+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.362+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:48:51.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.362+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.366+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.366+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.366+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:48:51.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.370+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.374+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.374+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.378+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:48:51.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.382+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.382+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.382+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.386+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:48:51.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.390+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.390+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.390+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.394+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:48:51.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.398+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.398+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.398+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.402+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:48:51.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.402+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.406+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.406+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.410+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:48:51.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.410+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.414+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.414+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.414+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:48:51.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.418+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.422+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.422+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.422+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:48:51.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.426+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.430+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.430+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.434+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:48:51.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.438+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.438+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.438+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.442+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:48:51.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.446+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.446+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.450+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.450+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:48:51.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.454+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.454+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.458+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.458+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:48:51.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.462+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.466+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.466+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.470+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:48:51.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.474+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.474+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.474+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.478+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:48:51.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.482+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.482+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.486+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.486+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:48:51.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.490+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.494+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.494+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.498+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:48:51.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.502+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.502+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.502+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.510+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:48:51.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.514+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.514+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.514+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.518+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:48:51.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.522+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.526+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.526+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.526+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:48:51.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.530+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.534+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.534+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.538+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:48:51.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.542+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.546+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.546+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.550+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:48:51.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.554+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.554+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.554+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.558+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:48:51.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.562+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.566+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.566+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.570+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:48:51.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.570+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.574+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.574+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.574+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:48:51.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.578+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.582+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.582+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.586+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:48:51.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.590+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.590+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.594+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.594+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:48:51.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.598+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.602+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.602+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.602+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:48:51.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.606+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.610+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.610+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.614+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:48:51.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.618+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.618+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.618+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.622+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:48:51.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.626+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.626+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.626+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.630+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:48:51.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.634+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.634+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:48:51.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.634+0000 7fc5ad5d89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:48:51.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.642+0000 7fc461fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:51.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.646+0000 7fc5ad5d89c0 20 remove_watcher() i=0 2024-09-12T17:48:51.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.646+0000 7fc5ad5d89c0 2 removed watcher, disabling cache 2024-09-12T17:48:51.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.646+0000 7fc5ad5d89c0 20 remove_watcher() i=1 2024-09-12T17:48:51.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.650+0000 7fc5ad5d89c0 20 remove_watcher() i=2 2024-09-12T17:48:51.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.654+0000 7fc5ad5d89c0 20 remove_watcher() i=3 2024-09-12T17:48:51.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.654+0000 7fc5ad5d89c0 20 remove_watcher() i=4 2024-09-12T17:48:51.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.658+0000 7fc5ad5d89c0 20 remove_watcher() i=5 2024-09-12T17:48:51.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.658+0000 7fc5ad5d89c0 20 remove_watcher() i=6 2024-09-12T17:48:51.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:48:51.658+0000 7fc5ad5d89c0 20 remove_watcher() i=7 2024-09-12T17:48:51.680 DEBUG:teuthology.orchestra.run.smithi119:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T17:48:52.377 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :clean 2024-09-12T17:48:53.275 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :compileJava 2024-09-12T17:48:53.275 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :processResources 2024-09-12T17:48:53.275 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :classes 2024-09-12T17:48:53.874 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:53.875 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :compileTestJava 2024-09-12T17:48:53.875 INFO:teuthology.orchestra.run.smithi119.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:48:53.875 INFO:teuthology.orchestra.run.smithi119.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:48:53.876 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:53.876 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:48:53.876 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :testClasses 2024-09-12T17:48:55.877 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:55.877 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :test 2024-09-12T17:48:55.877 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:55.878 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T17:48:55.878 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12 17:48:55,318 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:48:55.878 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:55.878 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T17:48:55.878 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:55.878 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T17:48:56.275 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:56.275 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T17:48:56.375 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:56.375 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T17:48:57.074 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:57.074 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T17:48:57.174 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:57.175 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T17:48:57.874 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:57.875 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T17:48:58.374 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:58.375 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T17:48:58.574 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:58.575 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T17:48:58.974 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:58.975 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T17:48:59.775 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:59.775 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T17:48:59.775 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:59.775 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T17:48:59.974 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:48:59.975 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T17:49:00.374 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:00.375 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T17:49:01.675 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:01.675 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T17:49:01.875 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:01.875 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T17:49:02.574 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:02.575 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T17:49:02.674 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:02.675 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T17:49:02.827 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:02.827 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------- 2024-09-12T17:49:02.827 INFO:teuthology.orchestra.run.smithi119.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T17:49:02.827 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------- 2024-09-12T17:49:02.827 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:02.827 INFO:teuthology.orchestra.run.smithi119.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:49:02.827 INFO:teuthology.orchestra.run.smithi119.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:49:02.827 INFO:teuthology.orchestra.run.smithi119.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:49:02.828 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:02.828 INFO:teuthology.orchestra.run.smithi119.stdout:BUILD SUCCESSFUL in 11s 2024-09-12T17:49:02.828 INFO:teuthology.orchestra.run.smithi119.stdout:5 actionable tasks: 5 executed 2024-09-12T17:49:02.835 DEBUG:teuthology.orchestra.run.smithi119:> radosgw-admin gc process --include-all 2024-09-12T17:49:02.864 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:02.864 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:02.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:02.909+0000 7f2f061fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:02.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:02.909+0000 7f2f061fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:02.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:02.909+0000 7f2f061fa9c0 20 realm 2024-09-12T17:49:02.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:02.909+0000 7f2f061fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:02.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:02.913+0000 7f2f061fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:02.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:02.913+0000 7f2f061fa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:02.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:02.913+0000 7f2f061fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:02.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:02.913+0000 7f2f061fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:02.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:02.913+0000 7f2f061fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:02.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:02.913+0000 7f2f061fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:02.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:02.913+0000 7f2f061fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:02.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:02.913+0000 7f2f061fa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:02.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:02.913+0000 7f2f061fa9c0 20 searching for the correct realm 2024-09-12T17:49:02.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:02.917+0000 7f2f03d00640 0 -- 172.21.15.119:0/252113177 >> [v2:172.21.15.119:6800/1732749810,v1:172.21.15.119:6801/1732749810] conn(0x555ae4aefe10 msgr2=0x555ae4af22d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:03.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.129+0000 7f2f03d00640 0 -- 172.21.15.119:0/252113177 >> [v2:172.21.15.194:6824/504391855,v1:172.21.15.194:6825/504391855] conn(0x7f2ef0003be0 msgr2=0x7f2efc08e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:03.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.353+0000 7f2f061fa9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:49:03.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.353+0000 7f2f061fa9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:49:03.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.353+0000 7f2f061fa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:03.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.353+0000 7f2f061fa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:03.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.353+0000 7f2f061fa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:03.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.353+0000 7f2f061fa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:03.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.353+0000 7f2f061fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:03.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.353+0000 7f2f061fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:03.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.353+0000 7f2f061fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:03.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.353+0000 7f2f061fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:03.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.357+0000 7f2f061fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:03.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.357+0000 7f2f061fa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:03.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.357+0000 7f2f061fa9c0 20 zone default found 2024-09-12T17:49:03.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.357+0000 7f2f061fa9c0 4 Realm: () 2024-09-12T17:49:03.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.357+0000 7f2f061fa9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:49:03.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.357+0000 7f2f061fa9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:49:03.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.357+0000 7f2f061fa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:03.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.357+0000 7f2f061fa9c0 20 zonegroup default 2024-09-12T17:49:03.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.357+0000 7f2f061fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:03.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.357+0000 7f2f061fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:03.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.357+0000 7f2f061fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:03.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.357+0000 7f2f061fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:03.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.357+0000 7f2f061fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:03.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.357+0000 7f2f061fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:03.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.357+0000 7f2f061fa9c0 20 started sync module instance, tier type = 2024-09-12T17:49:03.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.357+0000 7f2f061fa9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:49:03.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.381+0000 7f2f061fa9c0 20 add_watcher() i=0 2024-09-12T17:49:03.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.381+0000 7f2f061fa9c0 20 add_watcher() i=1 2024-09-12T17:49:03.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.381+0000 7f2f061fa9c0 20 add_watcher() i=2 2024-09-12T17:49:03.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.381+0000 7f2f061fa9c0 20 add_watcher() i=3 2024-09-12T17:49:03.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.381+0000 7f2f061fa9c0 20 add_watcher() i=4 2024-09-12T17:49:03.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.381+0000 7f2f061fa9c0 20 add_watcher() i=5 2024-09-12T17:49:03.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.381+0000 7f2f061fa9c0 20 add_watcher() i=6 2024-09-12T17:49:03.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.385+0000 7f2f061fa9c0 20 add_watcher() i=7 2024-09-12T17:49:03.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.385+0000 7f2f061fa9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:03.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.389+0000 7f2db9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:03.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.389+0000 7f2f061fa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:03.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.389+0000 7f2f061fa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:03.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.477+0000 7f2db8fe1640 20 reqs_thread_entry: start 2024-09-12T17:49:03.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.477+0000 7f2f061fa9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:49:03.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.477+0000 7f2f061fa9c0 20 Filter name: none 2024-09-12T17:49:03.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.477+0000 7f2d327fc640 20 reqs_thread_entry: start 2024-09-12T17:49:03.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.477+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:49:03.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.481+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.485+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.485+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.485+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:49:03.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.489+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.489+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.489+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.493+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:49:03.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.497+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.497+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.497+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.501+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:49:03.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.505+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.505+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.509+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.509+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:49:03.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.513+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.513+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.517+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.517+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:49:03.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.521+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.521+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.525+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.525+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:49:03.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.529+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.529+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.529+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.533+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:49:03.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.537+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.537+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.537+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.541+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:49:03.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.545+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.545+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.545+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.549+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:49:03.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.553+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.553+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.553+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.557+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:49:03.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.561+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.561+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.561+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.565+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:49:03.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.569+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.573+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.573+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.577+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:49:03.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.577+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.581+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.581+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.585+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:49:03.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.585+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.589+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.589+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.589+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:49:03.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.593+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.597+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.597+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.597+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:49:03.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.601+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.605+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.605+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.605+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:49:03.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.609+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.613+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.613+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.613+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:49:03.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.617+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.617+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.621+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.621+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:49:03.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.625+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.625+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.629+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.629+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:49:03.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.633+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.637+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.637+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.637+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:49:03.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.641+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.645+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.645+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.649+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:49:03.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.649+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.653+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.653+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.653+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:49:03.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.661+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.661+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.661+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.665+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:49:03.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.669+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.673+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.673+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.677+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:49:03.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.681+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.681+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.681+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.685+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:49:03.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.689+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.689+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.689+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.693+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:49:03.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.697+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.697+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.697+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:49:03.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.697+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16244302095687893476', time=2024-09-12T19:48:59.138115+0000, chain.objs.size()=1 2024-09-12T17:49:03.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.697+0000 7f2f061fa9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.72__shadow_.ePbDluF4mSqPtjEQ6rjJuuVdUEKsH5__0 2024-09-12T17:49:03.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.701+0000 7f2f061fa9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:03.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.709+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:49:03.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.713+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.713+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.713+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.717+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:49:03.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.721+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.721+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.721+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.725+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:49:03.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.729+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.729+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.733+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.733+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:49:03.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.737+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.741+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.741+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:49:03.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.741+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3030925512110410725', time=2024-09-12T19:49:01.071139+0000, chain.objs.size()=1 2024-09-12T17:49:03.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.741+0000 7f2f061fa9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.73__shadow_.3h29bDkARMK_2EzIJehWv2dnTLN2vK9_0 2024-09-12T17:49:03.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.745+0000 7f2f061fa9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:49:03.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.749+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:49:03.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.753+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.753+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:03.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.757+0000 7f2f061fa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:03.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.761+0000 7f2db9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:03.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.765+0000 7f2f061fa9c0 20 remove_watcher() i=0 2024-09-12T17:49:03.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.765+0000 7f2f061fa9c0 2 removed watcher, disabling cache 2024-09-12T17:49:03.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.769+0000 7f2f061fa9c0 20 remove_watcher() i=1 2024-09-12T17:49:03.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.769+0000 7f2f061fa9c0 20 remove_watcher() i=2 2024-09-12T17:49:03.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.773+0000 7f2f061fa9c0 20 remove_watcher() i=3 2024-09-12T17:49:03.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.777+0000 7f2f061fa9c0 20 remove_watcher() i=4 2024-09-12T17:49:03.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.777+0000 7f2f061fa9c0 20 remove_watcher() i=5 2024-09-12T17:49:03.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.781+0000 7f2f061fa9c0 20 remove_watcher() i=6 2024-09-12T17:49:03.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.781+0000 7f2f061fa9c0 20 remove_watcher() i=7 2024-09-12T17:49:03.805 DEBUG:teuthology.orchestra.run.smithi119:> radosgw-admin gc process --include-all 2024-09-12T17:49:03.877 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:03.878 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:03.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.921+0000 7fb4f49379c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:03.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.925+0000 7fb4f49379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:03.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.925+0000 7fb4f49379c0 20 realm 2024-09-12T17:49:03.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.925+0000 7fb4f49379c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:03.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.925+0000 7fb4f49379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:03.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.925+0000 7fb4f49379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:03.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.925+0000 7fb4f49379c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:03.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.925+0000 7fb4f49379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:03.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.925+0000 7fb4f49379c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:03.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.925+0000 7fb4f49379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:03.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.925+0000 7fb4f49379c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:03.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.929+0000 7fb4f49379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:03.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.929+0000 7fb4f49379c0 20 searching for the correct realm 2024-09-12T17:49:03.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:03.929+0000 7fb4f2c3e640 0 -- 172.21.15.119:0/2808032638 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fb4dc0bf020 msgr2=0x7fb4dc0f5f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:04.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.145+0000 7fb4f1c3c640 0 -- 172.21.15.119:0/2808032638 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fb4ec036b10 msgr2=0x7fb4ec05c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:04.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:49:04.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:49:04.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:04.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:04.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:04.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:04.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:04.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:04.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:04.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:04.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:04.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:04.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 20 zone default found 2024-09-12T17:49:04.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 4 Realm: () 2024-09-12T17:49:04.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:49:04.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:49:04.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:04.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 20 zonegroup default 2024-09-12T17:49:04.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.365+0000 7fb4f49379c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:04.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.369+0000 7fb4f49379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:04.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.369+0000 7fb4f49379c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:04.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.369+0000 7fb4f49379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:04.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.369+0000 7fb4f49379c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:04.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.369+0000 7fb4f49379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:04.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.369+0000 7fb4f49379c0 20 started sync module instance, tier type = 2024-09-12T17:49:04.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.369+0000 7fb4f49379c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:49:04.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.393+0000 7fb4f49379c0 20 add_watcher() i=0 2024-09-12T17:49:04.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.393+0000 7fb4f49379c0 20 add_watcher() i=1 2024-09-12T17:49:04.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.393+0000 7fb4f49379c0 20 add_watcher() i=2 2024-09-12T17:49:04.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.393+0000 7fb4f49379c0 20 add_watcher() i=3 2024-09-12T17:49:04.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.393+0000 7fb4f49379c0 20 add_watcher() i=4 2024-09-12T17:49:04.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.393+0000 7fb4f49379c0 20 add_watcher() i=5 2024-09-12T17:49:04.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.393+0000 7fb4f49379c0 20 add_watcher() i=6 2024-09-12T17:49:04.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.397+0000 7fb4f49379c0 20 add_watcher() i=7 2024-09-12T17:49:04.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.397+0000 7fb4f49379c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:04.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.401+0000 7fb3a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:04.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.401+0000 7fb4f49379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:04.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.401+0000 7fb4f49379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:04.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.497+0000 7fb3a37fe640 20 reqs_thread_entry: start 2024-09-12T17:49:04.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.497+0000 7fb4f49379c0 20 init_complete bucket index max shards: 11 2024-09-12T17:49:04.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.497+0000 7fb4f49379c0 20 Filter name: none 2024-09-12T17:49:04.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.497+0000 7fb3a17fa640 20 reqs_thread_entry: start 2024-09-12T17:49:04.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.497+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:49:04.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.501+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.501+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.501+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.501+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:49:04.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.505+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.505+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.505+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.509+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:49:04.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.509+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.513+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.513+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.513+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:49:04.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.517+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.517+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.517+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.517+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:49:04.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.521+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.521+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.521+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.525+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:49:04.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.529+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.529+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.533+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.533+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:49:04.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.537+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.537+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.537+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.541+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:49:04.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.541+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.545+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.545+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.549+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:49:04.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.553+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.553+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.553+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.557+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:49:04.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.557+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.561+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.561+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.565+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:49:04.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.565+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.569+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.569+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.573+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:49:04.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.573+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.577+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.577+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.581+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:49:04.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.581+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.581+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.581+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.585+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:49:04.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.589+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.589+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.589+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.593+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:49:04.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.597+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.597+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.597+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.597+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:49:04.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.601+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.601+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.605+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.605+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:49:04.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.609+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.609+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.613+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.613+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:49:04.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.617+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.617+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.621+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.621+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:49:04.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.625+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.625+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.625+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.629+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:49:04.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.633+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.633+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.633+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.637+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:49:04.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.641+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.641+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.641+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.645+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:49:04.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.649+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.649+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.653+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.653+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:49:04.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.657+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.661+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.661+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.665+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:49:04.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.665+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.669+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.669+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.669+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:49:04.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.673+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.673+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.677+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.677+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:49:04.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.681+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.681+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.685+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.685+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:49:04.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.689+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.689+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.689+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.693+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:49:04.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.697+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.697+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.701+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.701+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:49:04.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.705+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.709+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.709+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.713+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:49:04.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.717+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.717+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.717+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.721+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:49:04.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.725+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.725+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.729+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.729+0000 7fb4f49379c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:49:04.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.733+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.737+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:04.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.737+0000 7fb4f49379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:04.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.741+0000 7fb3a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:04.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.749+0000 7fb4f49379c0 20 remove_watcher() i=0 2024-09-12T17:49:04.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.749+0000 7fb4f49379c0 2 removed watcher, disabling cache 2024-09-12T17:49:04.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.749+0000 7fb4f49379c0 20 remove_watcher() i=1 2024-09-12T17:49:04.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.753+0000 7fb4f49379c0 20 remove_watcher() i=2 2024-09-12T17:49:04.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.753+0000 7fb4f49379c0 20 remove_watcher() i=3 2024-09-12T17:49:04.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.757+0000 7fb4f49379c0 20 remove_watcher() i=4 2024-09-12T17:49:04.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.761+0000 7fb4f49379c0 20 remove_watcher() i=5 2024-09-12T17:49:04.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.761+0000 7fb4f49379c0 20 remove_watcher() i=6 2024-09-12T17:49:04.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.765+0000 7fb4f49379c0 20 remove_watcher() i=7 2024-09-12T17:49:04.793 DEBUG:teuthology.orchestra.run.smithi119:> radosgw-admin gc process --include-all 2024-09-12T17:49:04.862 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:04.862 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:04.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.905+0000 7fcd14ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:04.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.909+0000 7fcd14ed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:04.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.909+0000 7fcd14ed09c0 20 realm 2024-09-12T17:49:04.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.909+0000 7fcd14ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:04.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.909+0000 7fcd14ed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:04.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.909+0000 7fcd14ed09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:04.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.909+0000 7fcd14ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:04.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.909+0000 7fcd14ed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:04.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.909+0000 7fcd14ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:04.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.913+0000 7fcd14ed09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:04.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.913+0000 7fcd14ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:04.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.913+0000 7fcd14ed09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:04.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.913+0000 7fcd14ed09c0 20 searching for the correct realm 2024-09-12T17:49:04.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.917+0000 7fcd131d7640 0 -- 172.21.15.119:0/2029811043 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fcd08008040 msgr2=0x7fcd08066bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:04.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:04.925+0000 7fcd121d5640 0 -- 172.21.15.119:0/2029811043 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fcd04070bd0 msgr2=0x7fcd04089ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:05.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.141+0000 7fcd14ed09c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:49:05.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.141+0000 7fcd14ed09c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:49:05.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.141+0000 7fcd14ed09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:05.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.141+0000 7fcd14ed09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:05.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.141+0000 7fcd14ed09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:05.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.141+0000 7fcd14ed09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:05.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.141+0000 7fcd14ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.145+0000 7fcd14ed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:05.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.145+0000 7fcd14ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.145+0000 7fcd14ed09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:05.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.145+0000 7fcd14ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.145+0000 7fcd14ed09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:05.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.145+0000 7fcd14ed09c0 20 zone default found 2024-09-12T17:49:05.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.145+0000 7fcd14ed09c0 4 Realm: () 2024-09-12T17:49:05.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.145+0000 7fcd14ed09c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:49:05.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.145+0000 7fcd14ed09c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:49:05.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.145+0000 7fcd14ed09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:05.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.145+0000 7fcd14ed09c0 20 zonegroup default 2024-09-12T17:49:05.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.145+0000 7fcd14ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.145+0000 7fcd14ed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:05.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.145+0000 7fcd14ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.145+0000 7fcd14ed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:05.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.145+0000 7fcd14ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.149+0000 7fcd14ed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:05.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.149+0000 7fcd14ed09c0 20 started sync module instance, tier type = 2024-09-12T17:49:05.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.149+0000 7fcd14ed09c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:49:05.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.169+0000 7fcd14ed09c0 20 add_watcher() i=0 2024-09-12T17:49:05.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.169+0000 7fcd14ed09c0 20 add_watcher() i=1 2024-09-12T17:49:05.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.169+0000 7fcd14ed09c0 20 add_watcher() i=2 2024-09-12T17:49:05.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.169+0000 7fcd14ed09c0 20 add_watcher() i=3 2024-09-12T17:49:05.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.169+0000 7fcd14ed09c0 20 add_watcher() i=4 2024-09-12T17:49:05.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.169+0000 7fcd14ed09c0 20 add_watcher() i=5 2024-09-12T17:49:05.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.169+0000 7fcd14ed09c0 20 add_watcher() i=6 2024-09-12T17:49:05.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.173+0000 7fcd14ed09c0 20 add_watcher() i=7 2024-09-12T17:49:05.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.173+0000 7fcd14ed09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:05.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.177+0000 7fcbc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:05.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.177+0000 7fcd14ed09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:05.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.177+0000 7fcd14ed09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:05.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.261+0000 7fcbc8fe1640 20 reqs_thread_entry: start 2024-09-12T17:49:05.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.261+0000 7fcd14ed09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:49:05.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.261+0000 7fcd14ed09c0 20 Filter name: none 2024-09-12T17:49:05.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.261+0000 7fcbc1ffb640 20 reqs_thread_entry: start 2024-09-12T17:49:05.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.261+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:49:05.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.265+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.265+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.265+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.269+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:49:05.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.273+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.273+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.277+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.277+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:49:05.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.281+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.285+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.285+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.289+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:49:05.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.293+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.293+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.293+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.297+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:49:05.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.297+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.301+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.301+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.301+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:49:05.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.305+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.305+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.309+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.309+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:49:05.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.313+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.313+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.313+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.313+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:49:05.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.317+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.317+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.317+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.321+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:49:05.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.325+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.325+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.325+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.329+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:49:05.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.333+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.333+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.333+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.337+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:49:05.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.341+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.341+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.341+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.345+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:49:05.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.349+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.349+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.349+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.353+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:49:05.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.357+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.357+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.357+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.361+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:49:05.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.365+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.365+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.365+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.369+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:49:05.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.373+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.373+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.377+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.377+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:49:05.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.381+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.381+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.381+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.385+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:49:05.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.389+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.389+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.393+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.397+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:49:05.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.397+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.401+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.401+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.405+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:49:05.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.405+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.409+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.409+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.409+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:49:05.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.413+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.413+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.417+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.417+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:49:05.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.421+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.425+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.425+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.429+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:49:05.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.429+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.429+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.433+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.433+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:49:05.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.437+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.441+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.441+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.445+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:49:05.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.445+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.449+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.449+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.449+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:49:05.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.453+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.453+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.457+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.457+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:49:05.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.461+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.465+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.465+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.469+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:49:05.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.469+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.473+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.473+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.477+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:49:05.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.477+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.481+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.481+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.485+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:49:05.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.485+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.485+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.489+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.489+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:49:05.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.493+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.493+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.497+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.497+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:49:05.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.501+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.501+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.501+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.505+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:49:05.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.509+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.513+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:05.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.513+0000 7fcd14ed09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:05.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.517+0000 7fcbc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:05.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.521+0000 7fcd14ed09c0 20 remove_watcher() i=0 2024-09-12T17:49:05.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.521+0000 7fcd14ed09c0 2 removed watcher, disabling cache 2024-09-12T17:49:05.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.525+0000 7fcd14ed09c0 20 remove_watcher() i=1 2024-09-12T17:49:05.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.525+0000 7fcd14ed09c0 20 remove_watcher() i=2 2024-09-12T17:49:05.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.529+0000 7fcd14ed09c0 20 remove_watcher() i=3 2024-09-12T17:49:05.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.533+0000 7fcd14ed09c0 20 remove_watcher() i=4 2024-09-12T17:49:05.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.533+0000 7fcd14ed09c0 20 remove_watcher() i=5 2024-09-12T17:49:05.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.533+0000 7fcd14ed09c0 20 remove_watcher() i=6 2024-09-12T17:49:05.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.537+0000 7fcd14ed09c0 20 remove_watcher() i=7 2024-09-12T17:49:05.560 DEBUG:teuthology.orchestra.run.smithi119:> radosgw-admin gc process --include-all 2024-09-12T17:49:05.634 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:05.634 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:05.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.677+0000 7fcbea2619c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.681+0000 7fcbea2619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:05.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.681+0000 7fcbea2619c0 20 realm 2024-09-12T17:49:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.681+0000 7fcbea2619c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.681+0000 7fcbea2619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.681+0000 7fcbea2619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.681+0000 7fcbea2619c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.681+0000 7fcbea2619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.681+0000 7fcbea2619c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.681+0000 7fcbea2619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:05.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.681+0000 7fcbea2619c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.685+0000 7fcbea2619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:05.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.685+0000 7fcbea2619c0 20 searching for the correct realm 2024-09-12T17:49:05.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.689+0000 7fcbe8568640 0 -- 172.21.15.119:0/1475903130 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x5579ad6b8730 msgr2=0x5579ad6bab20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:05.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.693+0000 7fcbe7566640 0 -- 172.21.15.119:0/1475903130 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fcbd8028520 msgr2=0x7fcbd809d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:05.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:49:05.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:49:05.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:05.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:05.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:05.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:05.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:05.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:05.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:05.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 zone default found 2024-09-12T17:49:05.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 4 Realm: () 2024-09-12T17:49:05.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:49:05.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:49:05.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:05.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 zonegroup default 2024-09-12T17:49:05.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:05.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.913+0000 7fcbea2619c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.917+0000 7fcbea2619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:05.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.917+0000 7fcbea2619c0 20 rados->read ofs=0 len=0 2024-09-12T17:49:05.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.917+0000 7fcbea2619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:05.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.917+0000 7fcbea2619c0 20 started sync module instance, tier type = 2024-09-12T17:49:05.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.917+0000 7fcbea2619c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:49:05.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.941+0000 7fcbea2619c0 20 add_watcher() i=0 2024-09-12T17:49:05.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.941+0000 7fcbea2619c0 20 add_watcher() i=1 2024-09-12T17:49:05.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.941+0000 7fcbea2619c0 20 add_watcher() i=2 2024-09-12T17:49:05.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.941+0000 7fcbea2619c0 20 add_watcher() i=3 2024-09-12T17:49:05.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.941+0000 7fcbea2619c0 20 add_watcher() i=4 2024-09-12T17:49:05.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.941+0000 7fcbea2619c0 20 add_watcher() i=5 2024-09-12T17:49:05.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.941+0000 7fcbea2619c0 20 add_watcher() i=6 2024-09-12T17:49:05.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.941+0000 7fcbea2619c0 20 add_watcher() i=7 2024-09-12T17:49:05.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.941+0000 7fcbea2619c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:05.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.945+0000 7fca9e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:05.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.945+0000 7fcbea2619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:05.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:05.945+0000 7fcbea2619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:06.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.037+0000 7fca9d7e2640 20 reqs_thread_entry: start 2024-09-12T17:49:06.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.037+0000 7fcbea2619c0 20 init_complete bucket index max shards: 11 2024-09-12T17:49:06.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.037+0000 7fcbea2619c0 20 Filter name: none 2024-09-12T17:49:06.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.037+0000 7fca967fc640 20 reqs_thread_entry: start 2024-09-12T17:49:06.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.037+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:49:06.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.041+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.045+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.045+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.045+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:49:06.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.049+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.049+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.049+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.053+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:49:06.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.057+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.057+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.057+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.061+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:49:06.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.065+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.065+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.065+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.069+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:49:06.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.069+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.073+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.073+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.077+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:49:06.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.081+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.081+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.085+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.085+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:49:06.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.089+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.089+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.089+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.089+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:49:06.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.093+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.097+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.097+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.097+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:49:06.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.101+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.101+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.105+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.105+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:49:06.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.109+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.109+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.109+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.113+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:49:06.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.117+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.117+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.117+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.121+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:49:06.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.125+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.125+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.129+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.129+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:49:06.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.133+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.133+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.133+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.137+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:49:06.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.141+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.141+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.141+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.145+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:49:06.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.145+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.149+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.149+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.149+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:49:06.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.153+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.153+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.153+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.157+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:49:06.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.161+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.161+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.161+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.165+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:49:06.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.169+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.169+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.169+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.173+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:49:06.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.173+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.177+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.177+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.177+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:49:06.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.181+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.185+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.185+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.185+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:49:06.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.189+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.193+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.193+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.193+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:49:06.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.197+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.197+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.197+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.201+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:49:06.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.205+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.205+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.205+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.209+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:49:06.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.213+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.213+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.213+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.217+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:49:06.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.225+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.225+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.225+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.229+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:49:06.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.233+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.233+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.233+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.237+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:49:06.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.241+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.241+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.245+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.245+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:49:06.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.249+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.249+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.249+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.253+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:49:06.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.257+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.257+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.257+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.261+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:49:06.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.265+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.265+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.265+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.265+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:49:06.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.269+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.269+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.273+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.273+0000 7fcbea2619c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:49:06.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.277+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.277+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:49:06.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.281+0000 7fcbea2619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:49:06.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.285+0000 7fca9e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:06.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.289+0000 7fcbea2619c0 20 remove_watcher() i=0 2024-09-12T17:49:06.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.289+0000 7fcbea2619c0 2 removed watcher, disabling cache 2024-09-12T17:49:06.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.293+0000 7fcbea2619c0 20 remove_watcher() i=1 2024-09-12T17:49:06.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.293+0000 7fcbea2619c0 20 remove_watcher() i=2 2024-09-12T17:49:06.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.297+0000 7fcbea2619c0 20 remove_watcher() i=3 2024-09-12T17:49:06.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.297+0000 7fcbea2619c0 20 remove_watcher() i=4 2024-09-12T17:49:06.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.301+0000 7fcbea2619c0 20 remove_watcher() i=5 2024-09-12T17:49:06.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.301+0000 7fcbea2619c0 20 remove_watcher() i=6 2024-09-12T17:49:06.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:49:06.305+0000 7fcbea2619c0 20 remove_watcher() i=7 2024-09-12T17:49:06.326 DEBUG:teuthology.orchestra.run.smithi119:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T17:49:07.029 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :clean 2024-09-12T17:49:07.727 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :compileJava 2024-09-12T17:49:07.727 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :processResources 2024-09-12T17:49:07.727 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :classes 2024-09-12T17:49:08.227 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:08.227 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :compileTestJava 2024-09-12T17:49:08.227 INFO:teuthology.orchestra.run.smithi119.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:49:08.228 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:08.228 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:49:08.228 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :testClasses 2024-09-12T17:49:08.228 INFO:teuthology.orchestra.run.smithi119.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:49:10.227 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:10.227 INFO:teuthology.orchestra.run.smithi119.stdout:> Task :test 2024-09-12T17:49:10.227 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:10.227 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests STANDARD_OUT 2024-09-12T17:49:10.228 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12 17:49:09,507 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:49:10.229 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:10.229 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T17:49:10.229 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:10.229 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T17:49:11.127 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:11.127 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T17:49:11.327 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:11.327 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T17:49:12.127 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:12.127 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T17:49:12.327 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:12.327 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T17:49:13.027 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:13.027 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T17:49:25.427 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:25.427 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T17:49:26.227 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:26.227 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T17:49:26.426 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:26.427 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T17:49:27.026 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:27.027 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T17:49:27.527 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:27.527 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T17:49:28.226 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:28.227 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T17:49:28.327 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:28.327 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T17:49:28.426 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:28.427 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T17:49:28.627 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:28.627 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T17:49:29.226 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:29.227 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T17:49:31.427 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:31.427 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T17:49:32.127 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:32.127 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T17:49:32.427 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:32.427 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T17:49:33.126 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:33.226 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T17:49:33.427 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:33.427 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T17:49:34.127 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:34.127 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T17:49:34.327 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:34.327 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T17:49:35.026 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:35.027 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T17:49:35.227 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:35.227 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T17:49:35.926 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:35.927 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T17:49:36.127 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:36.127 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T17:49:36.827 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:36.827 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T17:49:37.027 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:37.027 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T17:49:37.627 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:37.627 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T17:49:38.027 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:38.037 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T17:49:38.726 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:38.727 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T17:49:42.727 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:42.727 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T17:49:44.126 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:49:44.127 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T17:50:35.027 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:50:35.027 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T17:50:36.326 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:50:36.326 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T17:50:36.526 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:50:36.527 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T17:50:37.126 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:50:37.126 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T17:50:37.426 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:50:37.426 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T17:50:38.526 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:50:38.526 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T17:50:42.726 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:50:42.727 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T17:50:43.426 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:50:43.426 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T17:50:43.526 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:50:43.526 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T17:50:43.726 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:50:43.726 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T17:50:58.427 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:50:58.427 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T17:50:59.827 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:50:59.827 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests STANDARD_OUT 2024-09-12T17:50:59.827 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12 17:50:59,768 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T17:50:59.827 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12 17:50:59,787 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T17:51:00.526 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:51:00.527 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T17:51:11.026 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:51:11.027 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T17:51:12.226 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:51:12.226 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T17:51:24.626 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:51:24.626 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T17:51:25.326 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:51:25.326 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T17:51:55.527 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:51:55.527 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T17:51:56.326 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:51:56.326 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T17:52:01.426 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:01.426 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T17:52:02.126 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:02.126 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T17:52:06.426 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:06.426 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T17:52:07.126 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:07.126 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T17:52:09.326 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:09.326 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T17:52:24.826 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:24.826 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T17:52:24.926 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:24.926 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T17:52:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:25.026 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T17:52:25.226 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:25.226 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T17:52:26.026 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:26.026 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T17:52:26.226 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:26.226 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T17:52:26.926 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:26.926 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T17:52:27.126 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:27.126 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T17:52:27.826 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:27.826 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T17:52:28.026 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:28.026 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T17:52:28.726 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:28.726 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T17:52:28.826 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:28.826 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T17:52:29.526 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:29.526 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T17:52:29.826 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:29.826 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T17:52:30.526 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:30.526 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T17:52:31.126 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:31.126 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T17:52:32.126 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:32.126 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T17:52:32.726 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:32.726 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T17:52:33.626 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:33.626 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T17:52:34.226 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:34.226 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T17:52:35.126 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:35.126 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T17:52:35.626 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:35.626 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T17:52:36.726 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:36.726 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T17:52:37.226 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:37.226 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T17:52:38.226 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:38.226 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T17:52:38.726 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:38.726 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T17:52:39.726 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:39.726 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T17:52:40.226 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:40.226 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T17:52:41.226 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:41.226 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T17:52:41.826 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:41.826 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T17:52:42.826 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:42.826 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T17:52:43.326 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:43.326 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T17:52:44.226 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:44.226 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T17:52:44.826 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:44.826 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T17:52:45.829 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:45.829 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T17:52:46.326 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:46.326 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T17:52:47.326 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:47.326 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T17:52:47.726 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:47.726 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T17:52:48.626 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:48.626 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T17:52:49.126 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:49.126 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T17:52:50.026 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:50.026 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T17:52:50.626 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:50.626 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T17:52:51.626 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:51.626 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T17:52:52.125 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:52.126 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T17:52:53.026 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:53.026 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T17:52:53.526 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:53.526 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T17:52:54.526 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:54.526 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T17:52:55.026 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:55.026 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T17:52:56.026 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:56.026 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T17:52:56.626 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:56.626 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T17:52:57.525 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:57.526 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T17:52:58.025 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:58.026 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T17:52:58.925 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:58.926 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T17:52:59.426 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:52:59.426 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T17:53:00.226 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:00.226 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T17:53:00.725 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:00.726 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T17:53:01.725 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:01.726 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T17:53:02.126 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:02.126 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T17:53:03.227 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:03.228 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T17:53:03.426 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:03.426 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T17:53:04.126 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:04.126 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T17:53:04.325 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:04.326 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T17:53:05.026 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:05.026 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T17:53:05.226 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:05.226 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T17:53:05.926 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:05.926 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T17:53:06.225 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:06.226 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T17:53:06.925 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:06.926 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T17:53:07.626 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:07.626 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T17:53:08.326 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:08.326 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T17:53:08.326 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:08.326 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T17:53:08.525 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:08.526 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T17:53:08.825 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:08.826 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T17:53:09.526 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:09.526 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T17:53:09.825 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:09.826 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T17:53:10.626 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:10.626 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T17:53:11.025 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:11.026 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T17:53:11.725 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:11.726 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T17:53:11.926 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:11.926 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T17:53:12.625 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:12.626 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T17:53:16.026 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:16.026 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T17:53:16.825 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:16.826 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T17:53:20.625 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:20.625 INFO:teuthology.orchestra.run.smithi119.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T17:53:21.495 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:21.495 INFO:teuthology.orchestra.run.smithi119.stdout:---------------------------------------------------------------------- 2024-09-12T17:53:21.495 INFO:teuthology.orchestra.run.smithi119.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T17:53:21.495 INFO:teuthology.orchestra.run.smithi119.stdout:---------------------------------------------------------------------- 2024-09-12T17:53:21.496 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:21.496 INFO:teuthology.orchestra.run.smithi119.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:53:21.496 INFO:teuthology.orchestra.run.smithi119.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:53:21.496 INFO:teuthology.orchestra.run.smithi119.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:53:21.496 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:21.496 INFO:teuthology.orchestra.run.smithi119.stdout:BUILD SUCCESSFUL in 4m 15s 2024-09-12T17:53:21.496 INFO:teuthology.orchestra.run.smithi119.stdout:5 actionable tasks: 5 executed 2024-09-12T17:53:21.503 DEBUG:teuthology.orchestra.run.smithi119:> radosgw-admin gc process --include-all 2024-09-12T17:53:21.528 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:21.529 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:21.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.572+0000 7f74bbfdb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:21.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.572+0000 7f74bbfdb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:21.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.572+0000 7f74bbfdb9c0 20 realm 2024-09-12T17:53:21.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.572+0000 7f74bbfdb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:21.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.576+0000 7f74bbfdb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:21.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.576+0000 7f74bbfdb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:21.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.576+0000 7f74bbfdb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:21.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.576+0000 7f74bbfdb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:21.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.576+0000 7f74bbfdb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:21.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.576+0000 7f74bbfdb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:21.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.576+0000 7f74bbfdb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:21.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.576+0000 7f74bbfdb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:21.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.576+0000 7f74bbfdb9c0 20 searching for the correct realm 2024-09-12T17:53:21.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.584+0000 7f74b9ae1640 0 -- 172.21.15.119:0/3202045563 >> [v2:172.21.15.119:6800/1732749810,v1:172.21.15.119:6801/1732749810] conn(0x55d65e130510 msgr2=0x55d65e1329d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:21.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.588+0000 7f74b92e0640 0 -- 172.21.15.119:0/3202045563 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f74b402b920 msgr2=0x7f74b4049400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:21.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.596+0000 7f74bbfdb9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:21.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.596+0000 7f74bbfdb9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:21.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.596+0000 7f74bbfdb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:21.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.596+0000 7f74bbfdb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:21.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.596+0000 7f74bbfdb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:21.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.596+0000 7f74bbfdb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:21.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.596+0000 7f74bbfdb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:21.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.596+0000 7f74bbfdb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:21.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.596+0000 7f74bbfdb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:21.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.596+0000 7f74bbfdb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:21.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.596+0000 7f74bbfdb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:21.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.600+0000 7f74bbfdb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:21.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.600+0000 7f74bbfdb9c0 20 zone default found 2024-09-12T17:53:21.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.600+0000 7f74bbfdb9c0 4 Realm: () 2024-09-12T17:53:21.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.600+0000 7f74bbfdb9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:21.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.600+0000 7f74bbfdb9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:21.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.600+0000 7f74bbfdb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:21.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.600+0000 7f74bbfdb9c0 20 zonegroup default 2024-09-12T17:53:21.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.600+0000 7f74bbfdb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:21.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.600+0000 7f74bbfdb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:21.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.600+0000 7f74bbfdb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:21.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.600+0000 7f74bbfdb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:21.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.600+0000 7f74bbfdb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:21.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.600+0000 7f74bbfdb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:21.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.600+0000 7f74bbfdb9c0 20 started sync module instance, tier type = 2024-09-12T17:53:21.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.600+0000 7f74bbfdb9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:21.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.616+0000 7f74bbfdb9c0 20 add_watcher() i=0 2024-09-12T17:53:21.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.616+0000 7f74bbfdb9c0 20 add_watcher() i=1 2024-09-12T17:53:21.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.616+0000 7f74bbfdb9c0 20 add_watcher() i=2 2024-09-12T17:53:21.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.616+0000 7f74bbfdb9c0 20 add_watcher() i=3 2024-09-12T17:53:21.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.616+0000 7f74bbfdb9c0 20 add_watcher() i=4 2024-09-12T17:53:21.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.616+0000 7f74bbfdb9c0 20 add_watcher() i=5 2024-09-12T17:53:21.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.616+0000 7f74bbfdb9c0 20 add_watcher() i=6 2024-09-12T17:53:21.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.616+0000 7f74bbfdb9c0 20 add_watcher() i=7 2024-09-12T17:53:21.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.616+0000 7f74bbfdb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:21.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.620+0000 7f736b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:21.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.620+0000 7f74bbfdb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:21.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.620+0000 7f74bbfdb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:21.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.688+0000 7f736a7fc640 20 reqs_thread_entry: start 2024-09-12T17:53:21.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.688+0000 7f74bbfdb9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:21.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.688+0000 7f74bbfdb9c0 20 Filter name: none 2024-09-12T17:53:21.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.688+0000 7f72dbfff640 20 reqs_thread_entry: start 2024-09-12T17:53:21.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.688+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:53:21.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.692+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.692+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.692+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T17:53:21.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.692+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6255674506553376345', time=2024-09-12T19:50:22.052907+0000, chain.objs.size()=9 2024-09-12T17:53:21.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.692+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~bcfcMSi9duXChCDXt__Yb-R6RttoOsc.1 2024-09-12T17:53:21.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.692+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~bcfcMSi9duXChCDXt__Yb-R6RttoOsc.1_1 2024-09-12T17:53:21.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.692+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~bcfcMSi9duXChCDXt__Yb-R6RttoOsc.2 2024-09-12T17:53:21.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.692+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~bcfcMSi9duXChCDXt__Yb-R6RttoOsc.2_1 2024-09-12T17:53:21.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.692+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~bcfcMSi9duXChCDXt__Yb-R6RttoOsc.3 2024-09-12T17:53:21.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.692+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~bcfcMSi9duXChCDXt__Yb-R6RttoOsc.3_1 2024-09-12T17:53:21.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.692+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~bcfcMSi9duXChCDXt__Yb-R6RttoOsc.4 2024-09-12T17:53:21.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.692+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~bcfcMSi9duXChCDXt__Yb-R6RttoOsc.4_1 2024-09-12T17:53:21.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.692+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~bcfcMSi9duXChCDXt__Yb-R6RttoOsc.5 2024-09-12T17:53:21.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.696+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14763653881459961726', time=2024-09-12T19:50:30.436767+0000, chain.objs.size()=7 2024-09-12T17:53:21.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.696+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~vFl2IS9bsjX_CqMvhXNN3cz6JLHMoVl.1 2024-09-12T17:53:21.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.696+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~vFl2IS9bsjX_CqMvhXNN3cz6JLHMoVl.1_1 2024-09-12T17:53:21.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.696+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~vFl2IS9bsjX_CqMvhXNN3cz6JLHMoVl.1_2 2024-09-12T17:53:21.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.700+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~vFl2IS9bsjX_CqMvhXNN3cz6JLHMoVl.2 2024-09-12T17:53:21.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.704+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~vFl2IS9bsjX_CqMvhXNN3cz6JLHMoVl.2_1 2024-09-12T17:53:21.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.704+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~vFl2IS9bsjX_CqMvhXNN3cz6JLHMoVl.2_2 2024-09-12T17:53:21.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.704+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~vFl2IS9bsjX_CqMvhXNN3cz6JLHMoVl.3 2024-09-12T17:53:21.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.704+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11430562791218843705', time=2024-09-12T19:51:11.401352+0000, chain.objs.size()=5 2024-09-12T17:53:21.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.704+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__multipart_file2.mpg.2~BQX4xx_5ivc43o2YZKZst7gME7paNi0.1 2024-09-12T17:53:21.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.704+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__multipart_file2.mpg.2~BQX4xx_5ivc43o2YZKZst7gME7paNi0.2 2024-09-12T17:53:21.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.708+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__multipart_file2.mpg.2~BQX4xx_5ivc43o2YZKZst7gME7paNi0.3 2024-09-12T17:53:21.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.708+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__multipart_file2.mpg.2~BQX4xx_5ivc43o2YZKZst7gME7paNi0.4 2024-09-12T17:53:21.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.708+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__multipart_file2.mpg.2~BQX4xx_5ivc43o2YZKZst7gME7paNi0.5 2024-09-12T17:53:21.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.708+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16910800308404289361', time=2024-09-12T19:51:40.316389+0000, chain.objs.size()=9 2024-09-12T17:53:21.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.708+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~p2KnjdjjWUfc5wfSPATW0f0RT0-7vWh.1 2024-09-12T17:53:21.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.708+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~p2KnjdjjWUfc5wfSPATW0f0RT0-7vWh.1_1 2024-09-12T17:53:21.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.712+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~p2KnjdjjWUfc5wfSPATW0f0RT0-7vWh.2 2024-09-12T17:53:21.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.712+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~p2KnjdjjWUfc5wfSPATW0f0RT0-7vWh.2_1 2024-09-12T17:53:21.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.712+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~p2KnjdjjWUfc5wfSPATW0f0RT0-7vWh.3 2024-09-12T17:53:21.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.712+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~p2KnjdjjWUfc5wfSPATW0f0RT0-7vWh.3_1 2024-09-12T17:53:21.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.712+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~p2KnjdjjWUfc5wfSPATW0f0RT0-7vWh.4 2024-09-12T17:53:21.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.712+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~p2KnjdjjWUfc5wfSPATW0f0RT0-7vWh.4_1 2024-09-12T17:53:21.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.720+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~p2KnjdjjWUfc5wfSPATW0f0RT0-7vWh.5 2024-09-12T17:53:21.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.720+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12333845271487706180', time=2024-09-12T19:51:52.316525+0000, chain.objs.size()=7 2024-09-12T17:53:21.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.720+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~lfk5wTGaRMe5P3EfrXicyOkmvGQ5Cv7.1 2024-09-12T17:53:21.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.720+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~lfk5wTGaRMe5P3EfrXicyOkmvGQ5Cv7.1_1 2024-09-12T17:53:21.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.720+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~lfk5wTGaRMe5P3EfrXicyOkmvGQ5Cv7.1_2 2024-09-12T17:53:21.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.720+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~lfk5wTGaRMe5P3EfrXicyOkmvGQ5Cv7.2 2024-09-12T17:53:21.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.720+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~lfk5wTGaRMe5P3EfrXicyOkmvGQ5Cv7.2_1 2024-09-12T17:53:21.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.728+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~lfk5wTGaRMe5P3EfrXicyOkmvGQ5Cv7.2_2 2024-09-12T17:53:21.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.728+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~lfk5wTGaRMe5P3EfrXicyOkmvGQ5Cv7.3 2024-09-12T17:53:21.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.728+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14373612659949632366', time=2024-09-12T19:51:59.806384+0000, chain.objs.size()=1 2024-09-12T17:53:21.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.728+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.104__shadow_.VxBH9smV6Zk9pBTmUO9ayR1opGWHdk5_0 2024-09-12T17:53:21.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.728+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7682838047313318134', time=2024-09-12T19:52:34.367978+0000, chain.objs.size()=1 2024-09-12T17:53:21.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.728+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.115__shadow_.TIMNGll7haK2IThx-EDi2LQylfjDnqM_0 2024-09-12T17:53:21.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.728+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7828413029222752779', time=2024-09-12T19:52:46.667084+0000, chain.objs.size()=1 2024-09-12T17:53:21.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.728+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.123__shadow_.GNRe3oL4IibBgZOjY_MdejFzt_L96AD_0 2024-09-12T17:53:21.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.740+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.744+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:53:21.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.744+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.748+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.748+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:53:21.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.748+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10378669950967587034', time=2024-09-12T19:51:11.471961+0000, chain.objs.size()=1 2024-09-12T17:53:21.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.748+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__shadow_.eDah1k4VIQIFE0U0xvS-uETXmh_7IWl_0 2024-09-12T17:53:21.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.748+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16360178892248374556', time=2024-09-12T19:52:35.919857+0000, chain.objs.size()=1 2024-09-12T17:53:21.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.748+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.116__shadow_.G7quKWsDUsoiBF2s1QEQgAWhJDEIbLa_0 2024-09-12T17:53:21.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.748+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15864084642917923521', time=2024-09-12T19:52:45.007815+0000, chain.objs.size()=1 2024-09-12T17:53:21.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.748+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.122__shadow_.EuZh-jw9fOrsLeYWQ3Ld0q8j3Y1FhJK_0 2024-09-12T17:53:21.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.752+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.756+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:53:21.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.756+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.756+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.760+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:53:21.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.760+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE', time=2024-09-12T19:52:19.053808+0000, chain.objs.size()=68 2024-09-12T17:53:21.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.760+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.1 2024-09-12T17:53:21.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.760+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.2 2024-09-12T17:53:21.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.760+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.3 2024-09-12T17:53:21.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.760+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.4 2024-09-12T17:53:21.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.760+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.5 2024-09-12T17:53:21.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.760+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.6 2024-09-12T17:53:21.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.760+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.7 2024-09-12T17:53:21.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.760+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.8 2024-09-12T17:53:21.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.760+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.9 2024-09-12T17:53:21.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.760+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.10 2024-09-12T17:53:21.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.760+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.11 2024-09-12T17:53:21.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.760+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.12 2024-09-12T17:53:21.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.764+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.13 2024-09-12T17:53:21.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.764+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.14 2024-09-12T17:53:21.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.764+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.15 2024-09-12T17:53:21.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.764+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.16 2024-09-12T17:53:21.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.764+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.17 2024-09-12T17:53:21.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.764+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.18 2024-09-12T17:53:21.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.764+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.19 2024-09-12T17:53:21.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.764+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.20 2024-09-12T17:53:21.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.764+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.21 2024-09-12T17:53:21.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.768+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.22 2024-09-12T17:53:21.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.768+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.23 2024-09-12T17:53:21.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.772+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.24 2024-09-12T17:53:21.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.772+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.25 2024-09-12T17:53:21.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.772+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.26 2024-09-12T17:53:21.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.772+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.27 2024-09-12T17:53:21.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.772+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.28 2024-09-12T17:53:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.776+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.29 2024-09-12T17:53:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.776+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.30 2024-09-12T17:53:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.776+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.31 2024-09-12T17:53:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.780+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.32 2024-09-12T17:53:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.780+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.33 2024-09-12T17:53:21.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.780+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.34 2024-09-12T17:53:21.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.780+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.35 2024-09-12T17:53:21.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.784+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.36 2024-09-12T17:53:21.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.784+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.37 2024-09-12T17:53:21.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.784+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.38 2024-09-12T17:53:21.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.784+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.39 2024-09-12T17:53:21.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.784+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.40 2024-09-12T17:53:21.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.784+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.41 2024-09-12T17:53:21.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.784+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.42 2024-09-12T17:53:21.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.788+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.43 2024-09-12T17:53:21.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.788+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.44 2024-09-12T17:53:21.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.788+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.45 2024-09-12T17:53:21.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.788+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.46 2024-09-12T17:53:21.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.788+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.47 2024-09-12T17:53:21.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.788+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.48 2024-09-12T17:53:21.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.788+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.49 2024-09-12T17:53:21.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.792+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.50 2024-09-12T17:53:21.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.792+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.51 2024-09-12T17:53:21.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.792+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.52 2024-09-12T17:53:21.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.792+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.53 2024-09-12T17:53:21.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.796+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.54 2024-09-12T17:53:21.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.796+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.55 2024-09-12T17:53:21.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.796+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.56 2024-09-12T17:53:21.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.796+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.57 2024-09-12T17:53:21.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.796+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.58 2024-09-12T17:53:21.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.796+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.59 2024-09-12T17:53:21.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.796+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.60 2024-09-12T17:53:21.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.796+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.61 2024-09-12T17:53:21.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.800+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.62 2024-09-12T17:53:21.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.800+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.63 2024-09-12T17:53:21.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.804+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.64 2024-09-12T17:53:21.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.804+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.65 2024-09-12T17:53:21.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.804+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.66 2024-09-12T17:53:21.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.804+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.67 2024-09-12T17:53:21.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.804+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.106__multipart_key1.2~syIoHUZNNuQqL9VlLHnfMMzMAU9ReZE.68 2024-09-12T17:53:21.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.804+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9194431461748319619', time=2024-09-12T19:52:31.407902+0000, chain.objs.size()=1 2024-09-12T17:53:21.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.804+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.113__shadow_.1V63acs92jCs3lSgzGi6yYtdHPZNBiR_0 2024-09-12T17:53:21.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.808+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14609914070615210106', time=2024-09-12T19:52:46.596452+0000, chain.objs.size()=1 2024-09-12T17:53:21.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.808+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.123__shadow_.CD4RTlYitCi5CJLbtHmYgChwZIZ7WmA_0 2024-09-12T17:53:21.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.808+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9659737263372300361', time=2024-09-12T19:52:56.912670+0000, chain.objs.size()=1 2024-09-12T17:53:21.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.808+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.130__shadow_.r6fNeane7Gim297ZZMJRSrjiqxW5gPF_0 2024-09-12T17:53:21.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.812+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.816+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:53:21.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.816+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.816+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.820+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:53:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.820+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14751408949841223918', time=2024-09-12T19:50:26.218334+0000, chain.objs.size()=9 2024-09-12T17:53:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.820+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~gUF_hKeK_mE3zzKLLDEp1EpumsUBRs3.1 2024-09-12T17:53:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.820+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~gUF_hKeK_mE3zzKLLDEp1EpumsUBRs3.1_1 2024-09-12T17:53:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.820+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~gUF_hKeK_mE3zzKLLDEp1EpumsUBRs3.2 2024-09-12T17:53:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.820+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~gUF_hKeK_mE3zzKLLDEp1EpumsUBRs3.2_1 2024-09-12T17:53:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.820+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~gUF_hKeK_mE3zzKLLDEp1EpumsUBRs3.3 2024-09-12T17:53:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.820+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~gUF_hKeK_mE3zzKLLDEp1EpumsUBRs3.3_1 2024-09-12T17:53:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.820+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~gUF_hKeK_mE3zzKLLDEp1EpumsUBRs3.4 2024-09-12T17:53:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.820+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~gUF_hKeK_mE3zzKLLDEp1EpumsUBRs3.4_1 2024-09-12T17:53:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.820+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~gUF_hKeK_mE3zzKLLDEp1EpumsUBRs3.5 2024-09-12T17:53:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.820+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.839014461843046889', time=2024-09-12T19:50:34.921866+0000, chain.objs.size()=7 2024-09-12T17:53:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.820+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~i15A4L5PKaTFmu3hqqjw_Ifm8jJjw6K.1 2024-09-12T17:53:21.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.820+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~i15A4L5PKaTFmu3hqqjw_Ifm8jJjw6K.1_1 2024-09-12T17:53:21.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.820+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~i15A4L5PKaTFmu3hqqjw_Ifm8jJjw6K.1_2 2024-09-12T17:53:21.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.820+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~i15A4L5PKaTFmu3hqqjw_Ifm8jJjw6K.2 2024-09-12T17:53:21.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.824+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~i15A4L5PKaTFmu3hqqjw_Ifm8jJjw6K.2_1 2024-09-12T17:53:21.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.824+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~i15A4L5PKaTFmu3hqqjw_Ifm8jJjw6K.2_2 2024-09-12T17:53:21.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.824+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~i15A4L5PKaTFmu3hqqjw_Ifm8jJjw6K.3 2024-09-12T17:53:21.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.824+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12968006566263392114', time=2024-09-12T19:52:47.957448+0000, chain.objs.size()=1 2024-09-12T17:53:21.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.824+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.124__shadow_.J65-brBCvnOSNIxMCSkrRZ30TLUbI9i_0 2024-09-12T17:53:21.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.824+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6256612558373802146', time=2024-09-12T19:52:49.408714+0000, chain.objs.size()=1 2024-09-12T17:53:21.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.824+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.125__shadow_.N6GTwWXYRGxViy9KSf2NGTfzwjzw81j_0 2024-09-12T17:53:21.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.824+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7161054343139795718', time=2024-09-12T19:53:05.388823+0000, chain.objs.size()=1 2024-09-12T17:53:21.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.824+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.137__shadow_.CYMnn02oFjDOB08zjmoBolWucxmRRud_0 2024-09-12T17:53:21.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.828+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.832+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:53:21.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.836+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.836+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.836+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:53:21.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.836+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3016390597678482825', time=2024-09-12T19:52:31.333504+0000, chain.objs.size()=1 2024-09-12T17:53:21.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.836+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.113__shadow_.afAjcHQBY-96oPYDckmLh4bPOxsvcMV_0 2024-09-12T17:53:21.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.836+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.840+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:53:21.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:53:21.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3062769604467145806', time=2024-09-12T19:49:33.571776+0000, chain.objs.size()=1 2024-09-12T17:53:21.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.86__shadow_.wmFy22RSnApXzqZkWjtv9DrjPtoL6SO_0 2024-09-12T17:53:21.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13100061226772470486', time=2024-09-12T19:51:55.433488+0000, chain.objs.size()=7 2024-09-12T17:53:21.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~PUeAqiPDq7avA0hbYssox5QFSgx6PBA.1 2024-09-12T17:53:21.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~PUeAqiPDq7avA0hbYssox5QFSgx6PBA.1_1 2024-09-12T17:53:21.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~PUeAqiPDq7avA0hbYssox5QFSgx6PBA.1_2 2024-09-12T17:53:21.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~PUeAqiPDq7avA0hbYssox5QFSgx6PBA.2 2024-09-12T17:53:21.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~PUeAqiPDq7avA0hbYssox5QFSgx6PBA.2_1 2024-09-12T17:53:21.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~PUeAqiPDq7avA0hbYssox5QFSgx6PBA.2_2 2024-09-12T17:53:21.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~PUeAqiPDq7avA0hbYssox5QFSgx6PBA.3 2024-09-12T17:53:21.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8529945910079097959', time=2024-09-12T19:52:34.571902+0000, chain.objs.size()=1 2024-09-12T17:53:21.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.115__shadow_.aRuZNNgL1_9sFfKv1edX5odq8s5dzZC_0 2024-09-12T17:53:21.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17677864496303015937', time=2024-09-12T19:52:58.296153+0000, chain.objs.size()=1 2024-09-12T17:53:21.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.131__shadow_.5ZvLujDWvPkl2_GTvn4pCT-9DQvT_6X_0 2024-09-12T17:53:21.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11406266379117208847', time=2024-09-12T19:53:07.471905+0000, chain.objs.size()=1 2024-09-12T17:53:21.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.844+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.139__shadow_.eiXVeBV5PXjIK9dOxFLgzNmhT0xlCfO_0 2024-09-12T17:53:21.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.852+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.852+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:53:21.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.856+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.856+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.856+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:53:21.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.856+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5761797886450852926', time=2024-09-12T19:52:40.435287+0000, chain.objs.size()=1 2024-09-12T17:53:21.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.856+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.119__shadow_.WJmwqqeSQwNCD_7LwmVd-AjoziFLHD-_0 2024-09-12T17:53:21.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.856+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9063077287969537570', time=2024-09-12T19:52:43.545958+0000, chain.objs.size()=1 2024-09-12T17:53:21.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.856+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.121__shadow_.yaopWogy3E7iAimZGxCEpXDazHqlfYT_0 2024-09-12T17:53:21.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.856+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11311491360099292241', time=2024-09-12T19:53:08.958300+0000, chain.objs.size()=1 2024-09-12T17:53:21.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.856+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.140__shadow_.fQ7_Xzm6DAWZR87VmQGBqt0PhCsAd_9_0 2024-09-12T17:53:21.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.860+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.860+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:53:21.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.864+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.864+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.864+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:53:21.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.864+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1950152963357902797', time=2024-09-12T19:49:32.587853+0000, chain.objs.size()=1 2024-09-12T17:53:21.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.864+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.85__shadow_.wVbC4sJvKJCT6tuvqyJLbqqmpKiCB-P_0 2024-09-12T17:53:21.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.864+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1387336905748875344', time=2024-09-12T19:52:49.481545+0000, chain.objs.size()=1 2024-09-12T17:53:21.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.864+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.125__shadow_.eJEq4rkWJVy-n7EL617qWT3acmU4_FR_0 2024-09-12T17:53:21.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.864+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1834406451354904321', time=2024-09-12T19:52:53.886840+0000, chain.objs.size()=1 2024-09-12T17:53:21.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.864+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.128__shadow_.vokB3XODlQ7OfKtB0wcghiPmaEGdWkO_0 2024-09-12T17:53:21.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.864+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16218466469078971391', time=2024-09-12T19:53:02.491182+0000, chain.objs.size()=1 2024-09-12T17:53:21.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.864+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.134__shadow_.BtlPkxqStAN8x_DR8uSTw9yRLXKHdmw_0 2024-09-12T17:53:21.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.868+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.868+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:53:21.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.872+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.872+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.872+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:53:21.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.872+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17749713058183364005', time=2024-09-12T19:52:34.439344+0000, chain.objs.size()=1 2024-09-12T17:53:21.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.872+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.115__shadow_.nxAZJSmnZ5L3G1vyG9UH7FT54WOHFTg_0 2024-09-12T17:53:21.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.872+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16922532187132268686', time=2024-09-12T19:52:42.077100+0000, chain.objs.size()=1 2024-09-12T17:53:21.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.872+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.120__shadow_.MjwiwP9SKOuaZwDTy9xo9TNF9ffS5vf_0 2024-09-12T17:53:21.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.872+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3631499077306419216', time=2024-09-12T19:52:43.616147+0000, chain.objs.size()=1 2024-09-12T17:53:21.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.872+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.121__shadow_.7kJFgM_jKT0briFHb-nPPwNxsMAHonC_0 2024-09-12T17:53:21.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.872+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6568690929876147961', time=2024-09-12T19:52:48.104273+0000, chain.objs.size()=1 2024-09-12T17:53:21.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.872+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.124__shadow_.aEU-rS8BnokJK1Mfux95_zEli67Q8XK_0 2024-09-12T17:53:21.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.872+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1908119829613739829', time=2024-09-12T19:52:58.353358+0000, chain.objs.size()=1 2024-09-12T17:53:21.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.872+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.131__shadow_.98GO2iED96JOTRlU9Z_BTNkfCZg_QVG_0 2024-09-12T17:53:21.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.872+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16499984556207959544', time=2024-09-12T19:53:10.010063+0000, chain.objs.size()=1 2024-09-12T17:53:21.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.872+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.141__shadow_.gIAdHrTX_9YDxSa7I1p-uNjzEpD93D2_0 2024-09-12T17:53:21.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.876+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:53:21.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:53:21.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11247212453846163139', time=2024-09-12T19:51:55.760301+0000, chain.objs.size()=7 2024-09-12T17:53:21.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~_g3ou2hLniNzOIROyEkwoa0QeBIT1A6.1 2024-09-12T17:53:21.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~_g3ou2hLniNzOIROyEkwoa0QeBIT1A6.1_1 2024-09-12T17:53:21.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~_g3ou2hLniNzOIROyEkwoa0QeBIT1A6.1_2 2024-09-12T17:53:21.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~_g3ou2hLniNzOIROyEkwoa0QeBIT1A6.2 2024-09-12T17:53:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~_g3ou2hLniNzOIROyEkwoa0QeBIT1A6.2_1 2024-09-12T17:53:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~_g3ou2hLniNzOIROyEkwoa0QeBIT1A6.2_2 2024-09-12T17:53:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~_g3ou2hLniNzOIROyEkwoa0QeBIT1A6.3 2024-09-12T17:53:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9765380372010935684', time=2024-09-12T19:52:53.963883+0000, chain.objs.size()=1 2024-09-12T17:53:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.128__shadow_.KmKYrRUZkQYSdQaRNfxh3bj0cgotyVg_0 2024-09-12T17:53:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1586446189861751974', time=2024-09-12T19:53:00.913131+0000, chain.objs.size()=1 2024-09-12T17:53:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.133__shadow_.gtb5iqFuzAakAu2Ix6uRvQ81tZ8jyVZ_0 2024-09-12T17:53:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2868898280119482172', time=2024-09-12T19:53:16.226884+0000, chain.objs.size()=9 2024-09-12T17:53:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.144__multipart_key1.2~pOaOYS9gCVXNBNey7fv1czhTzgpDBka.1 2024-09-12T17:53:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.144__shadow_key1.2~pOaOYS9gCVXNBNey7fv1czhTzgpDBka.1_1 2024-09-12T17:53:21.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.880+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.144__multipart_key1.2~pOaOYS9gCVXNBNey7fv1czhTzgpDBka.2 2024-09-12T17:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.888+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.144__shadow_key1.2~pOaOYS9gCVXNBNey7fv1czhTzgpDBka.2_1 2024-09-12T17:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.888+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.144__multipart_key1.2~pOaOYS9gCVXNBNey7fv1czhTzgpDBka.3 2024-09-12T17:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.888+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.144__shadow_key1.2~pOaOYS9gCVXNBNey7fv1czhTzgpDBka.3_1 2024-09-12T17:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.888+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.144__multipart_key1.2~pOaOYS9gCVXNBNey7fv1czhTzgpDBka.4 2024-09-12T17:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.888+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.144__shadow_key1.2~pOaOYS9gCVXNBNey7fv1czhTzgpDBka.4_1 2024-09-12T17:53:21.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.888+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.144__multipart_key1.2~pOaOYS9gCVXNBNey7fv1czhTzgpDBka.5 2024-09-12T17:53:21.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.892+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.896+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:53:21.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.896+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.900+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.900+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:53:21.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.900+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7198741541561945536', time=2024-09-12T19:52:32.924216+0000, chain.objs.size()=1 2024-09-12T17:53:21.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.900+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.114__shadow_.O3ajj1gJeUb6wOqcP60Ye-gwxC4vUPH_0 2024-09-12T17:53:21.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.900+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2737562744497131710', time=2024-09-12T19:52:35.989778+0000, chain.objs.size()=1 2024-09-12T17:53:21.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.900+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.116__shadow_._O9kfN8LdImcMFtX3L533WTy3OFrpPO_0 2024-09-12T17:53:21.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.900+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8591704919973004724', time=2024-09-12T19:52:39.004016+0000, chain.objs.size()=1 2024-09-12T17:53:21.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.900+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.118__shadow_.6_Rr2P3FVa2mFgTnE8MdQ5aO12AWKMW_0 2024-09-12T17:53:21.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.900+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15793138578840518192', time=2024-09-12T19:53:20.908496+0000, chain.objs.size()=1 2024-09-12T17:53:21.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.900+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.145__shadow_.VPsB_yNSkcv3plvUEusx-pK_7yolHTp_0 2024-09-12T17:53:21.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.900+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.904+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:53:21.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.904+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.908+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.908+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:53:21.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.908+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.316465878138128139', time=2024-09-12T19:52:01.568175+0000, chain.objs.size()=9 2024-09-12T17:53:21.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.908+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.104__multipart_key1.2~uGhNVV56-6GIjPWXwCQh8RKSu5j4kBE.1 2024-09-12T17:53:21.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.908+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.104__shadow_key1.2~uGhNVV56-6GIjPWXwCQh8RKSu5j4kBE.1_1 2024-09-12T17:53:21.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.908+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.104__multipart_key1.2~uGhNVV56-6GIjPWXwCQh8RKSu5j4kBE.2 2024-09-12T17:53:21.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.908+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.104__shadow_key1.2~uGhNVV56-6GIjPWXwCQh8RKSu5j4kBE.2_1 2024-09-12T17:53:21.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.908+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.104__multipart_key1.2~uGhNVV56-6GIjPWXwCQh8RKSu5j4kBE.3 2024-09-12T17:53:21.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.908+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.104__shadow_key1.2~uGhNVV56-6GIjPWXwCQh8RKSu5j4kBE.3_1 2024-09-12T17:53:21.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.908+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.104__multipart_key1.2~uGhNVV56-6GIjPWXwCQh8RKSu5j4kBE.4 2024-09-12T17:53:21.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.908+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.104__shadow_key1.2~uGhNVV56-6GIjPWXwCQh8RKSu5j4kBE.4_1 2024-09-12T17:53:21.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.908+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.104__multipart_key1.2~uGhNVV56-6GIjPWXwCQh8RKSu5j4kBE.5 2024-09-12T17:53:21.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.908+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11715510790909066081', time=2024-09-12T19:53:00.986985+0000, chain.objs.size()=1 2024-09-12T17:53:21.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.908+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.133__shadow_.5du6lsOO2YY1bDvxFz9mzYJpsKlIcdr_0 2024-09-12T17:53:21.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.912+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.916+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:53:21.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.916+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.916+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:53:21.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.543469651231863727', time=2024-09-12T19:49:42.895549+0000, chain.objs.size()=9 2024-09-12T17:53:21.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__multipart_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.1 2024-09-12T17:53:21.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__shadow_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.1_1 2024-09-12T17:53:21.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__multipart_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.2 2024-09-12T17:53:21.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__shadow_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.2_1 2024-09-12T17:53:21.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__multipart_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.3 2024-09-12T17:53:21.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__shadow_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.3_1 2024-09-12T17:53:21.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__multipart_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.4 2024-09-12T17:53:21.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__shadow_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.4_1 2024-09-12T17:53:21.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__multipart_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.5 2024-09-12T17:53:21.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6620847763011455385', time=2024-09-12T19:50:35.823372+0000, chain.objs.size()=6 2024-09-12T17:53:21.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.94__shadow_.kfSTP-fS8aTLwQJkEUjNcdyfIz4eEYT_0 2024-09-12T17:53:21.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.94__shadow_.kfSTP-fS8aTLwQJkEUjNcdyfIz4eEYT_1 2024-09-12T17:53:21.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.94__shadow_.kfSTP-fS8aTLwQJkEUjNcdyfIz4eEYT_2 2024-09-12T17:53:21.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.94__shadow_.kfSTP-fS8aTLwQJkEUjNcdyfIz4eEYT_3 2024-09-12T17:53:21.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.94__shadow_.kfSTP-fS8aTLwQJkEUjNcdyfIz4eEYT_4 2024-09-12T17:53:21.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.920+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.94__shadow_.kfSTP-fS8aTLwQJkEUjNcdyfIz4eEYT_5 2024-09-12T17:53:21.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.924+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14982176498808275', time=2024-09-12T19:51:33.284953+0000, chain.objs.size()=9 2024-09-12T17:53:21.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.924+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~QmOYYgzN-EsKkwGuFXWcJFnnNjTP_Mh.1 2024-09-12T17:53:21.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.924+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~QmOYYgzN-EsKkwGuFXWcJFnnNjTP_Mh.1_1 2024-09-12T17:53:21.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.924+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~QmOYYgzN-EsKkwGuFXWcJFnnNjTP_Mh.2 2024-09-12T17:53:21.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.924+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~QmOYYgzN-EsKkwGuFXWcJFnnNjTP_Mh.2_1 2024-09-12T17:53:21.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.924+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~QmOYYgzN-EsKkwGuFXWcJFnnNjTP_Mh.3 2024-09-12T17:53:21.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.924+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~QmOYYgzN-EsKkwGuFXWcJFnnNjTP_Mh.3_1 2024-09-12T17:53:21.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.928+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~QmOYYgzN-EsKkwGuFXWcJFnnNjTP_Mh.4 2024-09-12T17:53:21.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.928+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~QmOYYgzN-EsKkwGuFXWcJFnnNjTP_Mh.4_1 2024-09-12T17:53:21.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.928+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~QmOYYgzN-EsKkwGuFXWcJFnnNjTP_Mh.5 2024-09-12T17:53:21.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.928+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17543147817854735688', time=2024-09-12T19:52:35.846476+0000, chain.objs.size()=1 2024-09-12T17:53:21.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.928+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.116__shadow_.KE8AxhVaQ7ri-24T5Zn5trQiBKSFvvs_0 2024-09-12T17:53:21.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.932+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.936+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:53:21.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.936+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.936+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.936+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:53:21.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.936+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11528763024067003370', time=2024-09-12T19:52:39.080647+0000, chain.objs.size()=1 2024-09-12T17:53:21.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.936+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.118__shadow_.AIOMR-IpbLPhNzvBOPYG53l66gV033C_0 2024-09-12T17:53:21.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.936+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12140846330544132866', time=2024-09-12T19:52:42.223532+0000, chain.objs.size()=1 2024-09-12T17:53:21.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.936+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.120__shadow_.LQIcjfl3rWGDYgsX_6Fo8ZQ7plq1_Ws_0 2024-09-12T17:53:21.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.936+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16698530598196990628', time=2024-09-12T19:52:53.817088+0000, chain.objs.size()=1 2024-09-12T17:53:21.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.936+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.128__shadow_.oRN37XBOL6vaLz5rCp83mpCyifRqjN-_0 2024-09-12T17:53:21.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.936+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13807589357658840900', time=2024-09-12T19:53:06.378518+0000, chain.objs.size()=1 2024-09-12T17:53:21.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.936+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.138__shadow_.Ipl_SQ5cgcjIqjLloCqfWbfbvLDIlby_0 2024-09-12T17:53:21.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.940+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:53:21.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:53:21.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~gxMulQDQ-oczlmjD_G-Gh9BBCVB3ay5', time=2024-09-12T19:49:25.378996+0000, chain.objs.size()=9 2024-09-12T17:53:21.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.80__multipart_key1.2~gxMulQDQ-oczlmjD_G-Gh9BBCVB3ay5.1 2024-09-12T17:53:21.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.80__shadow_key1.2~gxMulQDQ-oczlmjD_G-Gh9BBCVB3ay5.1_1 2024-09-12T17:53:21.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.80__multipart_key1.2~gxMulQDQ-oczlmjD_G-Gh9BBCVB3ay5.2 2024-09-12T17:53:21.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.80__shadow_key1.2~gxMulQDQ-oczlmjD_G-Gh9BBCVB3ay5.2_1 2024-09-12T17:53:21.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.80__multipart_key1.2~gxMulQDQ-oczlmjD_G-Gh9BBCVB3ay5.3 2024-09-12T17:53:21.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.80__shadow_key1.2~gxMulQDQ-oczlmjD_G-Gh9BBCVB3ay5.3_1 2024-09-12T17:53:21.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.80__multipart_key1.2~gxMulQDQ-oczlmjD_G-Gh9BBCVB3ay5.4 2024-09-12T17:53:21.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.80__shadow_key1.2~gxMulQDQ-oczlmjD_G-Gh9BBCVB3ay5.4_1 2024-09-12T17:53:21.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.80__multipart_key1.2~gxMulQDQ-oczlmjD_G-Gh9BBCVB3ay5.5 2024-09-12T17:53:21.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7721511045080982561', time=2024-09-12T19:49:27.670933+0000, chain.objs.size()=1 2024-09-12T17:53:21.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.82__shadow_.kcNSkuOjIBFFzrTOAnPVDUynC4Ayelt_0 2024-09-12T17:53:21.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14703051343510071745', time=2024-09-12T19:52:38.931880+0000, chain.objs.size()=1 2024-09-12T17:53:21.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.118__shadow_.nm5tg8EW_BAFwoG_FP4e_wXHJXBUEl9_0 2024-09-12T17:53:21.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.40713114608147063', time=2024-09-12T19:52:55.292363+0000, chain.objs.size()=1 2024-09-12T17:53:21.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.944+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.129__shadow_.5KtIGqYaTt5S4So8EXb82fpZMNrXFYz_0 2024-09-12T17:53:21.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.948+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10258095505755867758', time=2024-09-12T19:52:56.988680+0000, chain.objs.size()=1 2024-09-12T17:53:21.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.948+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.130__shadow_.VR1mnn0zQOkIVVfAX5vwlOyVUB9on1B_0 2024-09-12T17:53:21.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.952+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.956+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:53:21.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.956+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.956+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.956+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:53:21.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.956+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.494381662816592212', time=2024-09-12T19:52:31.547421+0000, chain.objs.size()=1 2024-09-12T17:53:21.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.956+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.113__shadow_.OUcxaBKE2CHfY7Fr8xjri8i5B-8WZci_0 2024-09-12T17:53:21.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.956+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16049905177046825839', time=2024-09-12T19:52:56.838513+0000, chain.objs.size()=1 2024-09-12T17:53:21.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.956+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.130__shadow_.rbAU3ldGmIoH1wBsFQe3pVEHf3GWuM5_0 2024-09-12T17:53:21.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.956+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15663139398390146412', time=2024-09-12T19:52:59.700691+0000, chain.objs.size()=1 2024-09-12T17:53:21.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.956+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.132__shadow_.WWv9JU7e7VOy_PCdbvOcO7Y64qifujd_0 2024-09-12T17:53:21.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.956+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3137907134158963189', time=2024-09-12T19:53:02.335468+0000, chain.objs.size()=1 2024-09-12T17:53:21.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.956+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.134__shadow_.b8_9jaH2iOVWsKB-oBm77nn_15Ur5Zo_0 2024-09-12T17:53:21.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.960+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.960+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:53:21.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.964+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.964+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.964+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:53:21.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.964+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11087038179736237366', time=2024-09-12T19:51:37.458706+0000, chain.objs.size()=9 2024-09-12T17:53:21.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.964+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~c4qppOhmhHZXLr1bLayn9KXV4IRaEa3.1 2024-09-12T17:53:21.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.964+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~c4qppOhmhHZXLr1bLayn9KXV4IRaEa3.1_1 2024-09-12T17:53:21.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.964+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~c4qppOhmhHZXLr1bLayn9KXV4IRaEa3.2 2024-09-12T17:53:21.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.964+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~c4qppOhmhHZXLr1bLayn9KXV4IRaEa3.2_1 2024-09-12T17:53:21.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.964+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~c4qppOhmhHZXLr1bLayn9KXV4IRaEa3.3 2024-09-12T17:53:21.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.964+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~c4qppOhmhHZXLr1bLayn9KXV4IRaEa3.3_1 2024-09-12T17:53:21.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.964+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~c4qppOhmhHZXLr1bLayn9KXV4IRaEa3.4 2024-09-12T17:53:21.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.964+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__shadow_key1.2~c4qppOhmhHZXLr1bLayn9KXV4IRaEa3.4_1 2024-09-12T17:53:21.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.964+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103__multipart_key1.2~c4qppOhmhHZXLr1bLayn9KXV4IRaEa3.5 2024-09-12T17:53:21.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.964+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2181638447489792460', time=2024-09-12T19:52:55.352287+0000, chain.objs.size()=1 2024-09-12T17:53:21.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.964+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.129__shadow_.bf0R6zHPNkoeUS83pVWMmnkE65gXZ0g_0 2024-09-12T17:53:21.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.968+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.972+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:53:21.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.972+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.976+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.976+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:53:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.976+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1171872539507484891', time=2024-09-12T19:52:33.052696+0000, chain.objs.size()=1 2024-09-12T17:53:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.976+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.114__shadow_.dxAPH362cVxRlbmyRVzQJ2nnYuQ5VbL_0 2024-09-12T17:53:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.976+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4926391964109220347', time=2024-09-12T19:52:46.741263+0000, chain.objs.size()=1 2024-09-12T17:53:21.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.976+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.123__shadow_.8uvy8k6bKIe5Ic3Tk_Dt3X7AsS2PSp1_0 2024-09-12T17:53:21.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.976+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.980+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:53:21.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.980+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.980+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.984+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:53:21.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.984+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11173881289865486636', time=2024-09-12T19:52:25.424144+0000, chain.objs.size()=1 2024-09-12T17:53:21.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.984+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.107__shadow_.kq6_q_8E7SNGOBH1UNTv2PuvTlJBTyM_0 2024-09-12T17:53:21.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.984+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9134886703064127901', time=2024-09-12T19:52:36.062938+0000, chain.objs.size()=1 2024-09-12T17:53:21.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.984+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.116__shadow_.YrAl-Ry6LFGwAu20O5jHKF9UiMANtzm_0 2024-09-12T17:53:21.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.984+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8119837761429582513', time=2024-09-12T19:52:45.082109+0000, chain.objs.size()=1 2024-09-12T17:53:21.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.984+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.122__shadow_.-YJLXFMkPRZ2ECFWHCfFllZ2ebOjSyY_0 2024-09-12T17:53:21.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.984+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5688165767461675291', time=2024-09-12T19:52:50.844341+0000, chain.objs.size()=1 2024-09-12T17:53:21.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.984+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.126__shadow_.ePalloApdOhXic1dYbYNwyky6M3XNd4_0 2024-09-12T17:53:21.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.984+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18325064758842469588', time=2024-09-12T19:52:58.224141+0000, chain.objs.size()=1 2024-09-12T17:53:21.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.984+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.131__shadow_.0HVv3NGrjxinztPHsyMzNLlNCmlKRKU_0 2024-09-12T17:53:21.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.984+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:21.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.988+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:53:21.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.988+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:21.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.988+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:21.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.992+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:53:21.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.992+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12839545449260047947', time=2024-09-12T19:52:40.649297+0000, chain.objs.size()=1 2024-09-12T17:53:21.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.992+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.119__shadow_.NOm1HBESDBoLtV5QnbQlSTaAJwHOBeH_0 2024-09-12T17:53:21.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.992+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18150487686675984928', time=2024-09-12T19:53:20.861234+0000, chain.objs.size()=9 2024-09-12T17:53:21.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.992+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.145__multipart_key1/data/file.mpg.2~sYY_QWcJ_LYxzFclcsbiCxjKoUjgXoa.1 2024-09-12T17:53:21.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.992+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.145__shadow_key1/data/file.mpg.2~sYY_QWcJ_LYxzFclcsbiCxjKoUjgXoa.1_1 2024-09-12T17:53:21.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.992+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.145__multipart_key1/data/file.mpg.2~sYY_QWcJ_LYxzFclcsbiCxjKoUjgXoa.2 2024-09-12T17:53:21.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.992+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.145__shadow_key1/data/file.mpg.2~sYY_QWcJ_LYxzFclcsbiCxjKoUjgXoa.2_1 2024-09-12T17:53:21.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.992+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.145__multipart_key1/data/file.mpg.2~sYY_QWcJ_LYxzFclcsbiCxjKoUjgXoa.3 2024-09-12T17:53:21.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.992+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.145__shadow_key1/data/file.mpg.2~sYY_QWcJ_LYxzFclcsbiCxjKoUjgXoa.3_1 2024-09-12T17:53:21.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.992+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.145__multipart_key1/data/file.mpg.2~sYY_QWcJ_LYxzFclcsbiCxjKoUjgXoa.4 2024-09-12T17:53:21.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.992+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.145__shadow_key1/data/file.mpg.2~sYY_QWcJ_LYxzFclcsbiCxjKoUjgXoa.4_1 2024-09-12T17:53:21.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.992+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.145__multipart_key1/data/file.mpg.2~sYY_QWcJ_LYxzFclcsbiCxjKoUjgXoa.5 2024-09-12T17:53:21.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:21.996+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:22.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.000+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:53:22.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.000+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:53:22.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16172144220727281200', time=2024-09-12T19:49:11.558592+0000, chain.objs.size()=1 2024-09-12T17:53:22.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.78__shadow_.mNYfvzkgIXfKaqrfQM_xwhpT6QsYkmW_0 2024-09-12T17:53:22.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4705112327703303749', time=2024-09-12T19:50:07.661402+0000, chain.objs.size()=9 2024-09-12T17:53:22.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~pTiGaeDnqz9W0iyuCBiwHoenKtnJFhY.1 2024-09-12T17:53:22.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~pTiGaeDnqz9W0iyuCBiwHoenKtnJFhY.1_1 2024-09-12T17:53:22.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~pTiGaeDnqz9W0iyuCBiwHoenKtnJFhY.2 2024-09-12T17:53:22.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~pTiGaeDnqz9W0iyuCBiwHoenKtnJFhY.2_1 2024-09-12T17:53:22.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~pTiGaeDnqz9W0iyuCBiwHoenKtnJFhY.3 2024-09-12T17:53:22.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~pTiGaeDnqz9W0iyuCBiwHoenKtnJFhY.3_1 2024-09-12T17:53:22.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~pTiGaeDnqz9W0iyuCBiwHoenKtnJFhY.4 2024-09-12T17:53:22.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~pTiGaeDnqz9W0iyuCBiwHoenKtnJFhY.4_1 2024-09-12T17:53:22.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~pTiGaeDnqz9W0iyuCBiwHoenKtnJFhY.5 2024-09-12T17:53:22.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15601779791368007658', time=2024-09-12T19:52:52.378557+0000, chain.objs.size()=1 2024-09-12T17:53:22.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.127__shadow_.dWiZvUhMpv5-ZIiZqM4CGrVhsuQZul3_0 2024-09-12T17:53:22.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11043570251546813843', time=2024-09-12T19:53:02.408475+0000, chain.objs.size()=1 2024-09-12T17:53:22.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.004+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.134__shadow_.bWG7RseMyULCXpusp00SViV85GvN1F8_0 2024-09-12T17:53:22.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.008+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:22.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.012+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:53:22.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.012+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.012+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:53:22.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1473731637111008679', time=2024-09-12T19:49:31.602388+0000, chain.objs.size()=3 2024-09-12T17:53:22.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.84__shadow_.4Bag2_IiSy7heZPb5FXRYnIqr6tyRgg_0 2024-09-12T17:53:22.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.84__shadow_.4Bag2_IiSy7heZPb5FXRYnIqr6tyRgg_1 2024-09-12T17:53:22.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.84__shadow_.4Bag2_IiSy7heZPb5FXRYnIqr6tyRgg_2 2024-09-12T17:53:22.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14562857254701034482', time=2024-09-12T19:50:42.901800+0000, chain.objs.size()=9 2024-09-12T17:53:22.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.99__multipart_key1.2~z6L2WVGEQ1t3ObgCoMdjidhz03ksKDp.1 2024-09-12T17:53:22.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.99__shadow_key1.2~z6L2WVGEQ1t3ObgCoMdjidhz03ksKDp.1_1 2024-09-12T17:53:22.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.99__multipart_key1.2~z6L2WVGEQ1t3ObgCoMdjidhz03ksKDp.2 2024-09-12T17:53:22.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.99__shadow_key1.2~z6L2WVGEQ1t3ObgCoMdjidhz03ksKDp.2_1 2024-09-12T17:53:22.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.99__multipart_key1.2~z6L2WVGEQ1t3ObgCoMdjidhz03ksKDp.3 2024-09-12T17:53:22.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.99__shadow_key1.2~z6L2WVGEQ1t3ObgCoMdjidhz03ksKDp.3_1 2024-09-12T17:53:22.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.99__multipart_key1.2~z6L2WVGEQ1t3ObgCoMdjidhz03ksKDp.4 2024-09-12T17:53:22.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.99__shadow_key1.2~z6L2WVGEQ1t3ObgCoMdjidhz03ksKDp.4_1 2024-09-12T17:53:22.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.99__multipart_key1.2~z6L2WVGEQ1t3ObgCoMdjidhz03ksKDp.5 2024-09-12T17:53:22.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10692087327657453727', time=2024-09-12T19:52:37.427509+0000, chain.objs.size()=1 2024-09-12T17:53:22.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.016+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.117__shadow_.zLaprsd8wvrAMea_Xz3Xu8scfP5QqNB_0 2024-09-12T17:53:22.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.020+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14505490596203932009', time=2024-09-12T19:52:53.740947+0000, chain.objs.size()=1 2024-09-12T17:53:22.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.020+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.128__shadow_.BLRtrkAOWDLM5314QAw6lm3_wQ_6EQK_0 2024-09-12T17:53:22.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.020+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11821476018173166851', time=2024-09-12T19:52:55.414922+0000, chain.objs.size()=1 2024-09-12T17:53:22.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.020+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.129__shadow_.MhkxhxHQwp_fKk7MG0he40QEJ2UjBSD_0 2024-09-12T17:53:22.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.024+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:22.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.024+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:53:22.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.028+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.028+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.028+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:53:22.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.028+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17698770922171872360', time=2024-09-12T19:51:11.308421+0000, chain.objs.size()=1 2024-09-12T17:53:22.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.028+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__shadow_.BPXB5aD8SDy4EOmBl8G-sFHukmohTqF_0 2024-09-12T17:53:22.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.028+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4871205508202150606', time=2024-09-12T19:52:34.501003+0000, chain.objs.size()=1 2024-09-12T17:53:22.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.028+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.115__shadow_.MfDkGpXDvelqdNYnvCBiJ4rv1rz4SeG_0 2024-09-12T17:53:22.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.028+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:22.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.032+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:53:22.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.032+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.032+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:53:22.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13208807634628409650', time=2024-09-12T19:49:43.513571+0000, chain.objs.size()=9 2024-09-12T17:53:22.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__multipart_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.1 2024-09-12T17:53:22.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__shadow_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.1_1 2024-09-12T17:53:22.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__multipart_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.2 2024-09-12T17:53:22.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__shadow_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.2_1 2024-09-12T17:53:22.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__multipart_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.3 2024-09-12T17:53:22.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__shadow_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.3_1 2024-09-12T17:53:22.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__multipart_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.4 2024-09-12T17:53:22.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__shadow_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.4_1 2024-09-12T17:53:22.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.92__multipart_key1.2~nA8-8y2NU1g9w5IJCT16UMNXPU1nq2L.5 2024-09-12T17:53:22.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3273906858227976848', time=2024-09-12T19:51:11.550794+0000, chain.objs.size()=1 2024-09-12T17:53:22.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__shadow_.rLCARaqVF_0yqc6aMu8xNcUZHrQWguT_0 2024-09-12T17:53:22.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2222667433644587193', time=2024-09-12T19:52:31.479527+0000, chain.objs.size()=1 2024-09-12T17:53:22.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.113__shadow_.RiWo4sPEAtFTt8rXvG7t1bdTJa54o24_0 2024-09-12T17:53:22.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11340010681516971979', time=2024-09-12T19:52:39.153790+0000, chain.objs.size()=1 2024-09-12T17:53:22.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.118__shadow_.J93Zff7ir-OwSrri2hVKGw5fkrItr1p_0 2024-09-12T17:53:22.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11290664928622326874', time=2024-09-12T19:52:55.242758+0000, chain.objs.size()=1 2024-09-12T17:53:22.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.129__shadow_.ibD7lr456vUQI_vYKWK5TUm_RUJsmEV_0 2024-09-12T17:53:22.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10671191173283280809', time=2024-09-12T19:53:07.305279+0000, chain.objs.size()=1 2024-09-12T17:53:22.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.036+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.139__shadow_.plltcnIIUnm9U3LgzwF_0sOuxVZly0i_0 2024-09-12T17:53:22.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.040+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:22.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.044+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:53:22.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:53:22.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12528587864686708221', time=2024-09-12T19:50:59.852732+0000, chain.objs.size()=9 2024-09-12T17:53:22.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.100__multipart_key1.2~02fWSzpZL4UPvCTNrqDJU1zEuKgSjqj.1 2024-09-12T17:53:22.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.100__shadow_key1.2~02fWSzpZL4UPvCTNrqDJU1zEuKgSjqj.1_1 2024-09-12T17:53:22.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.100__multipart_key1.2~02fWSzpZL4UPvCTNrqDJU1zEuKgSjqj.2 2024-09-12T17:53:22.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.100__shadow_key1.2~02fWSzpZL4UPvCTNrqDJU1zEuKgSjqj.2_1 2024-09-12T17:53:22.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.100__multipart_key1.2~02fWSzpZL4UPvCTNrqDJU1zEuKgSjqj.3 2024-09-12T17:53:22.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.100__shadow_key1.2~02fWSzpZL4UPvCTNrqDJU1zEuKgSjqj.3_1 2024-09-12T17:53:22.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.100__multipart_key1.2~02fWSzpZL4UPvCTNrqDJU1zEuKgSjqj.4 2024-09-12T17:53:22.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.100__shadow_key1.2~02fWSzpZL4UPvCTNrqDJU1zEuKgSjqj.4_1 2024-09-12T17:53:22.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.100__multipart_key1.2~02fWSzpZL4UPvCTNrqDJU1zEuKgSjqj.5 2024-09-12T17:53:22.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3919735370492985471', time=2024-09-12T19:52:49.335693+0000, chain.objs.size()=1 2024-09-12T17:53:22.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.125__shadow_.UTgJBPQ9lRnu9OPzW7BtW49BrRPDVVb_0 2024-09-12T17:53:22.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14016248778151872935', time=2024-09-12T19:52:59.628101+0000, chain.objs.size()=1 2024-09-12T17:53:22.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.048+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.132__shadow_.5eig3rhZoCNT7tXh92TAb9TZTyI_fIx_0 2024-09-12T17:53:22.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.052+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:22.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.056+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:53:22.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.056+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:53:22.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2110645718227543441', time=2024-09-12T19:52:06.577020+0000, chain.objs.size()=9 2024-09-12T17:53:22.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.105__multipart_key1.2~xrGIqDQd9KC3BNW7O2BnByAAUsWvkAO.1 2024-09-12T17:53:22.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.105__shadow_key1.2~xrGIqDQd9KC3BNW7O2BnByAAUsWvkAO.1_1 2024-09-12T17:53:22.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.105__multipart_key1.2~xrGIqDQd9KC3BNW7O2BnByAAUsWvkAO.2 2024-09-12T17:53:22.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.105__shadow_key1.2~xrGIqDQd9KC3BNW7O2BnByAAUsWvkAO.2_1 2024-09-12T17:53:22.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.105__multipart_key1.2~xrGIqDQd9KC3BNW7O2BnByAAUsWvkAO.3 2024-09-12T17:53:22.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.105__shadow_key1.2~xrGIqDQd9KC3BNW7O2BnByAAUsWvkAO.3_1 2024-09-12T17:53:22.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.105__multipart_key1.2~xrGIqDQd9KC3BNW7O2BnByAAUsWvkAO.4 2024-09-12T17:53:22.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.105__shadow_key1.2~xrGIqDQd9KC3BNW7O2BnByAAUsWvkAO.4_1 2024-09-12T17:53:22.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.105__multipart_key1.2~xrGIqDQd9KC3BNW7O2BnByAAUsWvkAO.5 2024-09-12T17:53:22.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10042167988091778795', time=2024-09-12T19:52:45.154110+0000, chain.objs.size()=1 2024-09-12T17:53:22.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.122__shadow_.AZR7GNXC9IXSSjfw_KxG-R8qiwu6WJj_0 2024-09-12T17:53:22.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16202597649773081682', time=2024-09-12T19:52:45.220441+0000, chain.objs.size()=1 2024-09-12T17:53:22.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.122__shadow_.u0iwaqftmxW6cMzJNjL5aADUHE3bdyq_0 2024-09-12T17:53:22.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17446358703259342253', time=2024-09-12T19:53:01.060125+0000, chain.objs.size()=1 2024-09-12T17:53:22.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.060+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.133__shadow_.qsIBJgD5VyHew9uxowAiHAk8Yk99oIU_0 2024-09-12T17:53:22.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.064+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:22.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.068+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:53:22.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.068+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.068+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.072+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:53:22.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.072+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18318891618464919646', time=2024-09-12T19:51:11.235970+0000, chain.objs.size()=9 2024-09-12T17:53:22.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.072+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__multipart_file.mpg.2~z14Lg154m0Kco5EmZ4RNC1b4mmRwHYA.1 2024-09-12T17:53:22.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.072+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__shadow_file.mpg.2~z14Lg154m0Kco5EmZ4RNC1b4mmRwHYA.1_1 2024-09-12T17:53:22.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.072+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__multipart_file.mpg.2~z14Lg154m0Kco5EmZ4RNC1b4mmRwHYA.2 2024-09-12T17:53:22.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.072+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__shadow_file.mpg.2~z14Lg154m0Kco5EmZ4RNC1b4mmRwHYA.2_1 2024-09-12T17:53:22.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.072+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__multipart_file.mpg.2~z14Lg154m0Kco5EmZ4RNC1b4mmRwHYA.3 2024-09-12T17:53:22.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.072+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__shadow_file.mpg.2~z14Lg154m0Kco5EmZ4RNC1b4mmRwHYA.3_1 2024-09-12T17:53:22.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.072+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__multipart_file.mpg.2~z14Lg154m0Kco5EmZ4RNC1b4mmRwHYA.4 2024-09-12T17:53:22.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.072+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__shadow_file.mpg.2~z14Lg154m0Kco5EmZ4RNC1b4mmRwHYA.4_1 2024-09-12T17:53:22.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.072+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.101__multipart_file.mpg.2~z14Lg154m0Kco5EmZ4RNC1b4mmRwHYA.5 2024-09-12T17:53:22.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.072+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7681616048687978961', time=2024-09-12T19:52:42.005481+0000, chain.objs.size()=1 2024-09-12T17:53:22.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.072+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.120__shadow_.Ee4YT1NAxYtWcJ2DDf9GvBCVfOaiRo5_0 2024-09-12T17:53:22.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.076+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:22.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.076+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:53:22.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.080+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.080+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.080+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:53:22.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.080+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4781775789612106554', time=2024-09-12T19:52:50.916972+0000, chain.objs.size()=1 2024-09-12T17:53:22.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.080+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.126__shadow_.-QULgilWas0cLgfvD6SQ2-f9xIkKkPs_0 2024-09-12T17:53:22.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.080+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11335105580026989883', time=2024-09-12T19:52:52.451841+0000, chain.objs.size()=1 2024-09-12T17:53:22.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.080+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.127__shadow_.1qISCa3zbnkohog5ffE_qjK-KTi3Go8_0 2024-09-12T17:53:22.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.080+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:22.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.084+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:53:22.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.084+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.088+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.088+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:53:22.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.088+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11766164837587287323', time=2024-09-12T19:52:32.866240+0000, chain.objs.size()=1 2024-09-12T17:53:22.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.088+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.114__shadow_.mpINbbZ9YNaD4_xVt6gsrt5WKwQwqRX_0 2024-09-12T17:53:22.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.088+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2452932383746446629', time=2024-09-12T19:52:37.498579+0000, chain.objs.size()=1 2024-09-12T17:53:22.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.088+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.117__shadow_.XmGpiud9X1aikannFbQLt5rkLGaBpIK_0 2024-09-12T17:53:22.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.088+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7753428362908164036', time=2024-09-12T19:52:46.524221+0000, chain.objs.size()=1 2024-09-12T17:53:22.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.088+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.123__shadow_.J_93Ws56r9qax45n1ru4jTrL7z3JLsW_0 2024-09-12T17:53:22.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.088+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:22.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.092+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:53:22.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.092+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.096+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.096+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:53:22.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.096+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7054473466150777584', time=2024-09-12T19:52:37.571922+0000, chain.objs.size()=1 2024-09-12T17:53:22.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.096+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.117__shadow_.4nDnVcRwH1wU3DoL3GcpTFjqf06Y6xU_0 2024-09-12T17:53:22.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.096+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15311021035559211343', time=2024-09-12T19:52:40.506797+0000, chain.objs.size()=1 2024-09-12T17:53:22.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.096+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.119__shadow_.g00ErpwM0bq6HtWTU6sUKxCjgITTtlS_0 2024-09-12T17:53:22.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.096+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:22.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:53:22.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T17:53:22.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16160330904487123209', time=2024-09-12T19:49:37.881049+0000, chain.objs.size()=1 2024-09-12T17:53:22.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.91__shadow_.cBwM1rFdVAZxbJpkhePVqCeTPJFyTZI_0 2024-09-12T17:53:22.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~XPmlyCIJykaEqQMfCyXF1Leqknm3c-0', time=2024-09-12T19:51:25.022833+0000, chain.objs.size()=9 2024-09-12T17:53:22.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.102__multipart_key1.2~XPmlyCIJykaEqQMfCyXF1Leqknm3c-0.7 2024-09-12T17:53:22.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.102__shadow_key1.2~XPmlyCIJykaEqQMfCyXF1Leqknm3c-0.7_1 2024-09-12T17:53:22.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.102__multipart_key1.2~XPmlyCIJykaEqQMfCyXF1Leqknm3c-0.8 2024-09-12T17:53:22.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.102__shadow_key1.2~XPmlyCIJykaEqQMfCyXF1Leqknm3c-0.8_1 2024-09-12T17:53:22.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.102__multipart_key1.2~XPmlyCIJykaEqQMfCyXF1Leqknm3c-0.9 2024-09-12T17:53:22.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.102__shadow_key1.2~XPmlyCIJykaEqQMfCyXF1Leqknm3c-0.9_1 2024-09-12T17:53:22.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.102__multipart_key1.2~XPmlyCIJykaEqQMfCyXF1Leqknm3c-0.10 2024-09-12T17:53:22.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.102__shadow_key1.2~XPmlyCIJykaEqQMfCyXF1Leqknm3c-0.10_1 2024-09-12T17:53:22.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.102__multipart_key1.2~XPmlyCIJykaEqQMfCyXF1Leqknm3c-0.11 2024-09-12T17:53:22.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16080263461085056156', time=2024-09-12T19:52:37.644375+0000, chain.objs.size()=1 2024-09-12T17:53:22.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.117__shadow_.10O-bIi8ofZeg_IShTmUkmnoetOmjyo_0 2024-09-12T17:53:22.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1512194609334369706', time=2024-09-12T19:52:40.576268+0000, chain.objs.size()=1 2024-09-12T17:53:22.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.100+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.119__shadow_.c3ElpUbvuLtyX8qnlOz661_drxTFQn6_0 2024-09-12T17:53:22.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.104+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15366480131681309411', time=2024-09-12T19:52:42.149384+0000, chain.objs.size()=1 2024-09-12T17:53:22.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.104+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.120__shadow_.nGUYKgTHU8KgiRRZgDvjw5BL8HtBOIY_0 2024-09-12T17:53:22.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.108+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14518776099167221385', time=2024-09-12T19:52:50.989778+0000, chain.objs.size()=1 2024-09-12T17:53:22.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.108+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.126__shadow_.VvOH6oxzG6iaiYkvIPAKMPzddXkDgUM_0 2024-09-12T17:53:22.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.108+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15325772370791791677', time=2024-09-12T19:52:52.308196+0000, chain.objs.size()=1 2024-09-12T17:53:22.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.108+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.127__shadow_.ONozQJFvh2ti92KKl_FKZ7k746kZ8Hw_0 2024-09-12T17:53:22.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.108+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8618522866976707558', time=2024-09-12T19:52:52.523935+0000, chain.objs.size()=1 2024-09-12T17:53:22.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.108+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.127__shadow_.T50W8Tu3XdPP5x66nCJn8UuVJq_fWjT_0 2024-09-12T17:53:22.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.108+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16430128887633115836', time=2024-09-12T19:52:56.766897+0000, chain.objs.size()=1 2024-09-12T17:53:22.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.108+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.130__shadow_.cO_N1TFQPR-Ih0ZvKRXGHmSxggFhIQF_0 2024-09-12T17:53:22.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.112+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:22.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.112+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:53:22.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T17:53:22.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9106487585836804385', time=2024-09-12T19:50:35.232208+0000, chain.objs.size()=7 2024-09-12T17:53:22.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~AkYApGt_CTqxR55ZLjqoR-0xg0-7x6J.1 2024-09-12T17:53:22.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~AkYApGt_CTqxR55ZLjqoR-0xg0-7x6J.1_1 2024-09-12T17:53:22.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~AkYApGt_CTqxR55ZLjqoR-0xg0-7x6J.1_2 2024-09-12T17:53:22.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~AkYApGt_CTqxR55ZLjqoR-0xg0-7x6J.2 2024-09-12T17:53:22.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~AkYApGt_CTqxR55ZLjqoR-0xg0-7x6J.2_1 2024-09-12T17:53:22.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__shadow_key1.2~AkYApGt_CTqxR55ZLjqoR-0xg0-7x6J.2_2 2024-09-12T17:53:22.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.95__multipart_key1.2~AkYApGt_CTqxR55ZLjqoR-0xg0-7x6J.3 2024-09-12T17:53:22.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2686999028130481813', time=2024-09-12T19:52:32.984903+0000, chain.objs.size()=1 2024-09-12T17:53:22.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.114__shadow_.z9NtKVoHtIB-KBAZg6KWHCyCrH5k79S_0 2024-09-12T17:53:22.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1879092027333749239', time=2024-09-12T19:52:43.485686+0000, chain.objs.size()=1 2024-09-12T17:53:22.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.121__shadow_.u7jVIjk3NIWvcoLCD50huwZaNs4_ybd_0 2024-09-12T17:53:22.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8782083624746206535', time=2024-09-12T19:52:43.687697+0000, chain.objs.size()=1 2024-09-12T17:53:22.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.121__shadow_.SXb_BJMOpY3zgk40ZONV1TpvMgquqkh_0 2024-09-12T17:53:22.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9587519782389114617', time=2024-09-12T19:52:48.030424+0000, chain.objs.size()=1 2024-09-12T17:53:22.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.124__shadow_.nysgPxXZiP9--rm78fZmcQgzwfG23jX_0 2024-09-12T17:53:22.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5295290017153254111', time=2024-09-12T19:52:50.770200+0000, chain.objs.size()=1 2024-09-12T17:53:22.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.116+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.126__shadow_.obZXz0PQLMRgM7G783ECGClMKRcCgp6_0 2024-09-12T17:53:22.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.120+0000 7f74bbfdb9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15684098532510104461', time=2024-09-12T19:52:59.555688+0000, chain.objs.size()=1 2024-09-12T17:53:22.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.120+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.132__shadow_.YFm7Akywh5-8pPtfyI91crAL-OQoWDI_0 2024-09-12T17:53:22.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.124+0000 7f74bbfdb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:53:22.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.128+0000 7f736b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:22.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.128+0000 7f74bbfdb9c0 20 remove_watcher() i=0 2024-09-12T17:53:22.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.128+0000 7f74bbfdb9c0 2 removed watcher, disabling cache 2024-09-12T17:53:22.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.128+0000 7f74bbfdb9c0 20 remove_watcher() i=1 2024-09-12T17:53:22.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.132+0000 7f74bbfdb9c0 20 remove_watcher() i=2 2024-09-12T17:53:22.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.132+0000 7f74bbfdb9c0 20 remove_watcher() i=3 2024-09-12T17:53:22.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.132+0000 7f74bbfdb9c0 20 remove_watcher() i=4 2024-09-12T17:53:22.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.136+0000 7f74bbfdb9c0 20 remove_watcher() i=5 2024-09-12T17:53:22.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.136+0000 7f74bbfdb9c0 20 remove_watcher() i=6 2024-09-12T17:53:22.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.136+0000 7f74bbfdb9c0 20 remove_watcher() i=7 2024-09-12T17:53:22.150 DEBUG:teuthology.orchestra.run.smithi119:> radosgw-admin gc process --include-all 2024-09-12T17:53:22.220 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:22.220 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:22.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.264+0000 7fdfb52b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:22.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.268+0000 7fdfb52b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:22.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.268+0000 7fdfb52b19c0 20 realm 2024-09-12T17:53:22.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.268+0000 7fdfb52b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:22.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.268+0000 7fdfb52b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:22.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.268+0000 7fdfb52b19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:22.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.268+0000 7fdfb52b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:22.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.268+0000 7fdfb52b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:22.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.268+0000 7fdfb52b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:22.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.268+0000 7fdfb52b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:22.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.268+0000 7fdfb52b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:22.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.272+0000 7fdfb52b19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:22.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.272+0000 7fdfb52b19c0 20 searching for the correct realm 2024-09-12T17:53:22.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.276+0000 7fdfb35b8640 0 -- 172.21.15.119:0/2600369719 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x562cafe72760 msgr2=0x562cafe74b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:22.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.280+0000 7fdfb25b6640 0 -- 172.21.15.119:0/2600369719 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fdfac07acf0 msgr2=0x7fdfac08b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:22.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.496+0000 7fdfb52b19c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:22.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.496+0000 7fdfb52b19c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:22.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.496+0000 7fdfb52b19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:22.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.496+0000 7fdfb52b19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:22.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.496+0000 7fdfb52b19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:22.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.496+0000 7fdfb52b19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:22.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.496+0000 7fdfb52b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:22.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.496+0000 7fdfb52b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:22.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.496+0000 7fdfb52b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:22.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.496+0000 7fdfb52b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:22.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.496+0000 7fdfb52b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:22.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.500+0000 7fdfb52b19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:22.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.500+0000 7fdfb52b19c0 20 zone default found 2024-09-12T17:53:22.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.500+0000 7fdfb52b19c0 4 Realm: () 2024-09-12T17:53:22.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.500+0000 7fdfb52b19c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:22.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.500+0000 7fdfb52b19c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:22.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.500+0000 7fdfb52b19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:22.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.500+0000 7fdfb52b19c0 20 zonegroup default 2024-09-12T17:53:22.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.500+0000 7fdfb52b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:22.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.500+0000 7fdfb52b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:22.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.500+0000 7fdfb52b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:22.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.500+0000 7fdfb52b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:22.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.500+0000 7fdfb52b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:22.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.500+0000 7fdfb52b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:22.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.500+0000 7fdfb52b19c0 20 started sync module instance, tier type = 2024-09-12T17:53:22.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.500+0000 7fdfb52b19c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:22.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.524+0000 7fdfb52b19c0 20 add_watcher() i=0 2024-09-12T17:53:22.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.524+0000 7fdfb52b19c0 20 add_watcher() i=1 2024-09-12T17:53:22.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.524+0000 7fdfb52b19c0 20 add_watcher() i=2 2024-09-12T17:53:22.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.524+0000 7fdfb52b19c0 20 add_watcher() i=3 2024-09-12T17:53:22.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.524+0000 7fdfb52b19c0 20 add_watcher() i=4 2024-09-12T17:53:22.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.524+0000 7fdfb52b19c0 20 add_watcher() i=5 2024-09-12T17:53:22.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.524+0000 7fdfb52b19c0 20 add_watcher() i=6 2024-09-12T17:53:22.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.528+0000 7fdfb52b19c0 20 add_watcher() i=7 2024-09-12T17:53:22.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.528+0000 7fdfb52b19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:22.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.532+0000 7fde697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:22.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.532+0000 7fdfb52b19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:22.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.532+0000 7fdfb52b19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:22.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.624+0000 7fdde3fff640 20 reqs_thread_entry: start 2024-09-12T17:53:22.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.624+0000 7fdfb52b19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:22.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.624+0000 7fdfb52b19c0 20 Filter name: none 2024-09-12T17:53:22.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.624+0000 7fdde1ffb640 20 reqs_thread_entry: start 2024-09-12T17:53:22.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.624+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:53:22.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.628+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.628+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.628+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.632+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:53:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.636+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.636+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.636+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.640+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:53:22.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.644+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.644+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.648+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.648+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:53:22.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.652+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.652+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.652+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.656+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:53:22.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.660+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.660+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.660+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.668+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:53:22.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.668+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.668+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.668+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.672+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:53:22.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.672+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.676+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.676+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.676+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:53:22.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.680+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.680+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.684+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.684+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:53:22.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.692+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.692+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.692+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.696+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:53:22.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.700+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.700+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.700+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.704+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:53:22.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.704+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.708+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.708+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.712+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:53:22.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.716+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.716+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.716+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.720+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:53:22.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.724+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.724+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.724+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.728+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:53:22.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.732+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.736+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.736+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.740+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:53:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.744+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.744+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.744+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.744+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:53:22.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.748+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.752+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.752+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.752+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:53:22.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.756+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.756+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.756+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.760+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:53:22.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.764+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.764+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.764+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.768+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:53:22.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.768+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.772+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.772+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.772+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:53:22.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.776+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.780+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.780+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.780+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:53:22.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.784+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.788+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.788+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.792+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:53:22.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.796+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.796+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.796+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.800+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:53:22.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.804+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.804+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.808+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.808+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:53:22.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.812+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.812+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.816+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.816+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:53:22.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.820+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.824+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.824+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.828+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:53:22.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.832+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.832+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.832+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.832+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:53:22.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.836+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.840+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.840+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.840+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:53:22.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.844+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.844+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.844+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.848+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:53:22.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.852+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.852+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.852+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.856+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:53:22.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.860+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.860+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.860+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.864+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:53:22.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.868+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.868+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.872+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.872+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:53:22.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.876+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.880+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:53:22.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.880+0000 7fdfb52b19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:53:22.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.884+0000 7fde697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:22.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.888+0000 7fdfb52b19c0 20 remove_watcher() i=0 2024-09-12T17:53:22.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.888+0000 7fdfb52b19c0 2 removed watcher, disabling cache 2024-09-12T17:53:22.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.892+0000 7fdfb52b19c0 20 remove_watcher() i=1 2024-09-12T17:53:22.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.896+0000 7fdfb52b19c0 20 remove_watcher() i=2 2024-09-12T17:53:22.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.896+0000 7fdfb52b19c0 20 remove_watcher() i=3 2024-09-12T17:53:22.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.900+0000 7fdfb52b19c0 20 remove_watcher() i=4 2024-09-12T17:53:22.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.900+0000 7fdfb52b19c0 20 remove_watcher() i=5 2024-09-12T17:53:22.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.904+0000 7fdfb52b19c0 20 remove_watcher() i=6 2024-09-12T17:53:22.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:22.904+0000 7fdfb52b19c0 20 remove_watcher() i=7 2024-09-12T17:53:22.924 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T17:53:22.945 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T17:53:22.945 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T17:53:22.945 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T17:53:22.946 DEBUG:teuthology.orchestra.run.smithi119:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T17:53:22.971 INFO:teuthology.orchestra.run.smithi119.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T17:53:23.783 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T17:53:23.783 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-12T17:53:23.866 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:23.867 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:23.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:23.908+0000 7f0d8a2659c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:23.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:23.912+0000 7f0d8a2659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:23.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:23.912+0000 7f0d8a2659c0 20 realm 2024-09-12T17:53:23.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:23.912+0000 7f0d8a2659c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:23.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:23.912+0000 7f0d8a2659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:23.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:23.912+0000 7f0d8a2659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:23.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:23.912+0000 7f0d8a2659c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:23.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:23.912+0000 7f0d8a2659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:23.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:23.912+0000 7f0d8a2659c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:23.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:23.912+0000 7f0d8a2659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:23.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:23.912+0000 7f0d8a2659c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:23.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:23.916+0000 7f0d8a2659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:23.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:23.916+0000 7f0d8a2659c0 20 searching for the correct realm 2024-09-12T17:53:23.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:23.916+0000 7f0d8856c640 0 -- 172.21.15.119:0/760289443 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f0d70018070 msgr2=0x7f0d7007dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:24.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.132+0000 7f0d8756a640 0 -- 172.21.15.119:0/760289443 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f0d80117a20 msgr2=0x7f0d800fd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:24.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.348+0000 7f0d8a2659c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:24.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.348+0000 7f0d8a2659c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:24.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.348+0000 7f0d8a2659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:24.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.348+0000 7f0d8a2659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:24.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.348+0000 7f0d8a2659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:24.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.348+0000 7f0d8a2659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:24.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.348+0000 7f0d8a2659c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.352+0000 7f0d8a2659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.352+0000 7f0d8a2659c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.352+0000 7f0d8a2659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:24.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.352+0000 7f0d8a2659c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.352+0000 7f0d8a2659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:24.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.352+0000 7f0d8a2659c0 20 zone default found 2024-09-12T17:53:24.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.352+0000 7f0d8a2659c0 4 Realm: () 2024-09-12T17:53:24.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.352+0000 7f0d8a2659c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:24.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.352+0000 7f0d8a2659c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:24.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.352+0000 7f0d8a2659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:24.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.352+0000 7f0d8a2659c0 20 zonegroup default 2024-09-12T17:53:24.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.352+0000 7f0d8a2659c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.352+0000 7f0d8a2659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.352+0000 7f0d8a2659c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.352+0000 7f0d8a2659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.352+0000 7f0d8a2659c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.356+0000 7f0d8a2659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.356+0000 7f0d8a2659c0 20 started sync module instance, tier type = 2024-09-12T17:53:24.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.356+0000 7f0d8a2659c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:24.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.376+0000 7f0d8a2659c0 20 add_watcher() i=0 2024-09-12T17:53:24.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.376+0000 7f0d8a2659c0 20 add_watcher() i=1 2024-09-12T17:53:24.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.376+0000 7f0d8a2659c0 20 add_watcher() i=2 2024-09-12T17:53:24.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.376+0000 7f0d8a2659c0 20 add_watcher() i=3 2024-09-12T17:53:24.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.376+0000 7f0d8a2659c0 20 add_watcher() i=4 2024-09-12T17:53:24.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.376+0000 7f0d8a2659c0 20 add_watcher() i=5 2024-09-12T17:53:24.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.376+0000 7f0d8a2659c0 20 add_watcher() i=6 2024-09-12T17:53:24.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.376+0000 7f0d8a2659c0 20 add_watcher() i=7 2024-09-12T17:53:24.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.376+0000 7f0d8a2659c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:24.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.380+0000 7f0c3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:24.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.380+0000 7f0d8a2659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:24.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.380+0000 7f0d8a2659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:24.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.380+0000 7f0d8a2659c0 5 note: GC not initialized 2024-09-12T17:53:24.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.384+0000 7f0c3cfe1640 20 reqs_thread_entry: start 2024-09-12T17:53:24.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.384+0000 7f0d8a2659c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:24.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.384+0000 7f0d8a2659c0 20 Filter name: none 2024-09-12T17:53:24.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.384+0000 7f0bb67fc640 20 reqs_thread_entry: start 2024-09-12T17:53:24.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.384+0000 7f0d8a2659c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-12T17:53:24.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.384+0000 7f0d8a2659c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.384+0000 7f0d8a2659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.384+0000 7f0d8a2659c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-12T17:53:24.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.384+0000 7f0d8a2659c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T17:53:24.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.384+0000 7f0d8a2659c0 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-12T17:53:24.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.384+0000 7f0d8a2659c0 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-12T17:53:24.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.384+0000 7f0d8a2659c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.384+0000 7f0d8a2659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.384+0000 7f0d8a2659c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-12T17:53:24.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.384+0000 7f0d8a2659c0 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T17:53:24.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.384+0000 7f0d8a2659c0 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-12T17:53:24.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.388+0000 7f0d8a2659c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T17:53:24.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.388+0000 7f0d8a2659c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T17:53:24.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.388+0000 7f0d8a2659c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-12T17:53:24.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.388+0000 7f0c66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333590 cookie 94379613273872 notifier 9042 bl.length()=384 2024-09-12T17:53:24.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.388+0000 7f0c66ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T17:53:24.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.388+0000 7f0c66ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T17:53:24.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.392+0000 7f0d8a2659c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T17:53:24.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.392+0000 7f0d8a2659c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T17:53:24.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.392+0000 7f0d8a2659c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-12T17:53:24.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.392+0000 7f0c66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333633 cookie 94379613283680 notifier 9042 bl.length()=225 2024-09-12T17:53:24.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.392+0000 7f0c66ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T17:53:24.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.392+0000 7f0c66ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T17:53:24.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.400+0000 7f0d8a2659c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T17:53:24.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.400+0000 7f0d8a2659c0 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T17:53:24.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.400+0000 7f0d8a2659c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-12T17:53:24.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.400+0000 7f0c667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333566 cookie 94379613276144 notifier 9042 bl.length()=234 2024-09-12T17:53:24.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.400+0000 7f0c667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T17:53:24.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.400+0000 7f0c667fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T17:53:24.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.404+0000 7f0c3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:24.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.408+0000 7f0d8a2659c0 20 remove_watcher() i=0 2024-09-12T17:53:24.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.408+0000 7f0d8a2659c0 2 removed watcher, disabling cache 2024-09-12T17:53:24.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.412+0000 7f0d8a2659c0 20 remove_watcher() i=1 2024-09-12T17:53:24.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.412+0000 7f0d8a2659c0 20 remove_watcher() i=2 2024-09-12T17:53:24.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.416+0000 7f0d8a2659c0 20 remove_watcher() i=3 2024-09-12T17:53:24.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.416+0000 7f0d8a2659c0 20 remove_watcher() i=4 2024-09-12T17:53:24.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.420+0000 7f0d8a2659c0 20 remove_watcher() i=5 2024-09-12T17:53:24.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.420+0000 7f0d8a2659c0 20 remove_watcher() i=6 2024-09-12T17:53:24.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.424+0000 7f0d8a2659c0 20 remove_watcher() i=7 2024-09-12T17:53:24.436 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T17:53:24.436 INFO:teuthology.orchestra.run.smithi119.stdout: "id": "RGW11111111111111111", 2024-09-12T17:53:24.436 INFO:teuthology.orchestra.run.smithi119.stdout: "tenant": "", 2024-09-12T17:53:24.436 INFO:teuthology.orchestra.run.smithi119.stdout: "name": "Mr.RGW11111111111111111", 2024-09-12T17:53:24.436 INFO:teuthology.orchestra.run.smithi119.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-12T17:53:24.436 INFO:teuthology.orchestra.run.smithi119.stdout: "quota": { 2024-09-12T17:53:24.436 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:24.436 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:24.436 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:24.437 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:24.437 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:24.437 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:24.437 INFO:teuthology.orchestra.run.smithi119.stdout: "bucket_quota": { 2024-09-12T17:53:24.437 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:24.437 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:24.437 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:24.437 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:24.437 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:24.438 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:24.438 INFO:teuthology.orchestra.run.smithi119.stdout: "max_users": 1000, 2024-09-12T17:53:24.438 INFO:teuthology.orchestra.run.smithi119.stdout: "max_roles": 1000, 2024-09-12T17:53:24.438 INFO:teuthology.orchestra.run.smithi119.stdout: "max_groups": 1000, 2024-09-12T17:53:24.438 INFO:teuthology.orchestra.run.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:53:24.438 INFO:teuthology.orchestra.run.smithi119.stdout: "max_access_keys": 4 2024-09-12T17:53:24.438 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T17:53:24.439 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-12T17:53:24.440 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key XAHCFRMJCMBNHSWGJXAA --secret 27LRsWX7eaYPJlEfCH5y/6FlWcBNP/Suog8aXkmXrTQNUZ2dMCqNtw== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-12T17:53:24.530 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:24.530 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:24.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.572+0000 7f3db541a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.572+0000 7f3db541a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.572+0000 7f3db541a9c0 20 realm 2024-09-12T17:53:24.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.572+0000 7f3db541a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.576+0000 7f3db541a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.576+0000 7f3db541a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:24.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.576+0000 7f3db541a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.576+0000 7f3db541a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.576+0000 7f3db541a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.576+0000 7f3db541a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:24.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.576+0000 7f3db541a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.576+0000 7f3db541a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:24.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.576+0000 7f3db541a9c0 20 searching for the correct realm 2024-09-12T17:53:24.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.580+0000 7f3db271f640 0 -- 172.21.15.119:0/1718826056 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f3da403c040 msgr2=0x7f3da403e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:24.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.796+0000 7f3db3721640 0 -- 172.21.15.119:0/1718826056 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f3da8085030 msgr2=0x7f3da8060980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:24.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:24.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:24.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:24.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:24.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:24.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:24.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:24.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:24.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 20 zone default found 2024-09-12T17:53:24.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 4 Realm: () 2024-09-12T17:53:24.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:24.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:24.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:24.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 20 zonegroup default 2024-09-12T17:53:24.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.812+0000 7f3db541a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.816+0000 7f3db541a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.816+0000 7f3db541a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.816+0000 7f3db541a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.816+0000 7f3db541a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.816+0000 7f3db541a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.816+0000 7f3db541a9c0 20 started sync module instance, tier type = 2024-09-12T17:53:24.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.816+0000 7f3db541a9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:24.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.840+0000 7f3db541a9c0 20 add_watcher() i=0 2024-09-12T17:53:24.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.840+0000 7f3db541a9c0 20 add_watcher() i=1 2024-09-12T17:53:24.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.840+0000 7f3db541a9c0 20 add_watcher() i=2 2024-09-12T17:53:24.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.840+0000 7f3db541a9c0 20 add_watcher() i=3 2024-09-12T17:53:24.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.840+0000 7f3db541a9c0 20 add_watcher() i=4 2024-09-12T17:53:24.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.840+0000 7f3db541a9c0 20 add_watcher() i=5 2024-09-12T17:53:24.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.840+0000 7f3db541a9c0 20 add_watcher() i=6 2024-09-12T17:53:24.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.844+0000 7f3db541a9c0 20 add_watcher() i=7 2024-09-12T17:53:24.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.844+0000 7f3db541a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:24.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3c697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:24.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:24.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:24.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 5 note: GC not initialized 2024-09-12T17:53:24.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3be3fff640 20 reqs_thread_entry: start 2024-09-12T17:53:24.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:24.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 20 Filter name: none 2024-09-12T17:53:24.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3be1ffb640 20 reqs_thread_entry: start 2024-09-12T17:53:24.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T17:53:24.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T17:53:24.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:53:24.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T17:53:24.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T17:53:24.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:53:24.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 10 cache get: name=default.rgw.meta+users.keys+XAHCFRMJCMBNHSWGJXAA : miss 2024-09-12T17:53:24.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 10 cache put: name=default.rgw.meta+users.keys+XAHCFRMJCMBNHSWGJXAA info.flags=0x0 2024-09-12T17:53:24.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 10 adding default.rgw.meta+users.keys+XAHCFRMJCMBNHSWGJXAA to cache LRU end 2024-09-12T17:53:24.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-12T17:53:24.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:53:24.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T17:53:24.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T17:53:24.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.848+0000 7f3db541a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:24.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.852+0000 7f3db541a9c0 10 cache get: name=default.rgw.meta+users.keys+XAHCFRMJCMBNHSWGJXAA : hit (negative entry) 2024-09-12T17:53:24.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.852+0000 7f3db541a9c0 10 cache get: name=default.rgw.meta+users.keys+XAHCFRMJCMBNHSWGJXAA : hit (negative entry) 2024-09-12T17:53:24.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.852+0000 7f3db541a9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:53:24.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.852+0000 7f3db541a9c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:53:24.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.852+0000 7f3db541a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T17:53:24.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.852+0000 7f3c967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333634 cookie 94829514107664 notifier 8501 bl.length()=673 2024-09-12T17:53:24.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.852+0000 7f3c967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:53:24.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.852+0000 7f3c967fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:53:24.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.856+0000 7f3db541a9c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T17:53:24.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.856+0000 7f3db541a9c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:53:24.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.856+0000 7f3db541a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T17:53:24.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.860+0000 7f3c95ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333635 cookie 94829514120944 notifier 8501 bl.length()=185 2024-09-12T17:53:24.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.860+0000 7f3c95ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T17:53:24.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.860+0000 7f3c95ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:53:24.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.860+0000 7f3db541a9c0 10 cache put: name=default.rgw.meta+users.keys+XAHCFRMJCMBNHSWGJXAA info.flags=0x7 2024-09-12T17:53:24.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.860+0000 7f3db541a9c0 10 moving default.rgw.meta+users.keys+XAHCFRMJCMBNHSWGJXAA to cache LRU end 2024-09-12T17:53:24.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.860+0000 7f3db541a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:XAHCFRMJCMBNHSWGJXAA, ofs0, ns] 2024-09-12T17:53:24.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.864+0000 7f3c95ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333636 cookie 94829514107664 notifier 8501 bl.length()=186 2024-09-12T17:53:24.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.864+0000 7f3c95ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XAHCFRMJCMBNHSWGJXAA info.flags=0x7 2024-09-12T17:53:24.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.864+0000 7f3c95ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XAHCFRMJCMBNHSWGJXAA to cache LRU end 2024-09-12T17:53:24.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.868+0000 7f3db541a9c0 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-12T17:53:24.867 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T17:53:24.867 INFO:teuthology.orchestra.run.smithi119.stdout: "user_id": "foo.client.0", 2024-09-12T17:53:24.867 INFO:teuthology.orchestra.run.smithi119.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-12T17:53:24.867 INFO:teuthology.orchestra.run.smithi119.stdout: "email": "foo+test@test.test", 2024-09-12T17:53:24.867 INFO:teuthology.orchestra.run.smithi119.stdout: "suspended": 0, 2024-09-12T17:53:24.867 INFO:teuthology.orchestra.run.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:53:24.867 INFO:teuthology.orchestra.run.smithi119.stdout: "subusers": [], 2024-09-12T17:53:24.867 INFO:teuthology.orchestra.run.smithi119.stdout: "keys": [ 2024-09-12T17:53:24.867 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T17:53:24.867 INFO:teuthology.orchestra.run.smithi119.stdout: "user": "foo.client.0", 2024-09-12T17:53:24.868 INFO:teuthology.orchestra.run.smithi119.stdout: "access_key": "XAHCFRMJCMBNHSWGJXAA", 2024-09-12T17:53:24.868 INFO:teuthology.orchestra.run.smithi119.stdout: "secret_key": "27LRsWX7eaYPJlEfCH5y/6FlWcBNP/Suog8aXkmXrTQNUZ2dMCqNtw==", 2024-09-12T17:53:24.868 INFO:teuthology.orchestra.run.smithi119.stdout: "active": true, 2024-09-12T17:53:24.868 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:53:24.853381Z" 2024-09-12T17:53:24.868 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T17:53:24.868 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-12T17:53:24.868 INFO:teuthology.orchestra.run.smithi119.stdout: "swift_keys": [], 2024-09-12T17:53:24.868 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": [], 2024-09-12T17:53:24.868 INFO:teuthology.orchestra.run.smithi119.stdout: "op_mask": "read, write, delete", 2024-09-12T17:53:24.868 INFO:teuthology.orchestra.run.smithi119.stdout: "default_placement": "", 2024-09-12T17:53:24.868 INFO:teuthology.orchestra.run.smithi119.stdout: "default_storage_class": "", 2024-09-12T17:53:24.868 INFO:teuthology.orchestra.run.smithi119.stdout: "placement_tags": [], 2024-09-12T17:53:24.869 INFO:teuthology.orchestra.run.smithi119.stdout: "bucket_quota": { 2024-09-12T17:53:24.869 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:24.869 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:24.869 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:24.869 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:24.869 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:24.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:24.869 INFO:teuthology.orchestra.run.smithi119.stdout: "user_quota": { 2024-09-12T17:53:24.869 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:24.869 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:24.869 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:24.869 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:24.869 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:24.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "temp_url_keys": [], 2024-09-12T17:53:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "root", 2024-09-12T17:53:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "mfa_ids": [], 2024-09-12T17:53:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "account_id": "RGW11111111111111111", 2024-09-12T17:53:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "path": "/", 2024-09-12T17:53:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:53:24.853344Z", 2024-09-12T17:53:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "tags": [], 2024-09-12T17:53:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "group_ids": [] 2024-09-12T17:53:24.870 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T17:53:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:24.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.868+0000 7f3c697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:24.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.872+0000 7f3db541a9c0 20 remove_watcher() i=0 2024-09-12T17:53:24.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.872+0000 7f3db541a9c0 2 removed watcher, disabling cache 2024-09-12T17:53:24.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.876+0000 7f3db541a9c0 20 remove_watcher() i=1 2024-09-12T17:53:24.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.880+0000 7f3db541a9c0 20 remove_watcher() i=2 2024-09-12T17:53:24.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.880+0000 7f3db541a9c0 20 remove_watcher() i=3 2024-09-12T17:53:24.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.884+0000 7f3db541a9c0 20 remove_watcher() i=4 2024-09-12T17:53:24.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.884+0000 7f3db541a9c0 20 remove_watcher() i=5 2024-09-12T17:53:24.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.884+0000 7f3db541a9c0 20 remove_watcher() i=6 2024-09-12T17:53:24.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.888+0000 7f3db541a9c0 20 remove_watcher() i=7 2024-09-12T17:53:24.905 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 5007722944 --totp-seed T4O3WVHEDF6HTPYDRKLWSCP4MUKLMM7KIRZQJMJ2ILF3PXNV63M2JOSMJY6YYGXU --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:53:24.951 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:24.951 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:24.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.992+0000 7fddd8bc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.996+0000 7fddd8bc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.996+0000 7fddd8bc19c0 20 realm 2024-09-12T17:53:24.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.996+0000 7fddd8bc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.996+0000 7fddd8bc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.996+0000 7fddd8bc19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:24.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.996+0000 7fddd8bc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.996+0000 7fddd8bc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:24.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.996+0000 7fddd8bc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.996+0000 7fddd8bc19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:24.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:24.996+0000 7fddd8bc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:24.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.000+0000 7fddd8bc19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:24.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.000+0000 7fddd8bc19c0 20 searching for the correct realm 2024-09-12T17:53:25.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.000+0000 7fddd6ec8640 0 -- 172.21.15.119:0/2078919703 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fddcc0093d0 msgr2=0x7fddcc0039d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:25.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.216+0000 7fddd5ec6640 0 -- 172.21.15.119:0/2078919703 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fddc8049960 msgr2=0x7fddc8056440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:25.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.432+0000 7fddd8bc19c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:25.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.432+0000 7fddd8bc19c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:25.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.432+0000 7fddd8bc19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:25.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.432+0000 7fddd8bc19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:25.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.432+0000 7fddd8bc19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:25.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.432+0000 7fddd8bc19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:25.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.432+0000 7fddd8bc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:25.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.436+0000 7fddd8bc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:25.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.436+0000 7fddd8bc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:25.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.436+0000 7fddd8bc19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:25.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.436+0000 7fddd8bc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:25.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.436+0000 7fddd8bc19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:25.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.436+0000 7fddd8bc19c0 20 zone default found 2024-09-12T17:53:25.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.436+0000 7fddd8bc19c0 4 Realm: () 2024-09-12T17:53:25.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.436+0000 7fddd8bc19c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:25.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.436+0000 7fddd8bc19c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:25.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.436+0000 7fddd8bc19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:25.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.436+0000 7fddd8bc19c0 20 zonegroup default 2024-09-12T17:53:25.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.436+0000 7fddd8bc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:25.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.436+0000 7fddd8bc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:25.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.436+0000 7fddd8bc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:25.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.440+0000 7fddd8bc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:25.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.440+0000 7fddd8bc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:25.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.440+0000 7fddd8bc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:25.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.440+0000 7fddd8bc19c0 20 started sync module instance, tier type = 2024-09-12T17:53:25.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.440+0000 7fddd8bc19c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:25.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.460+0000 7fddd8bc19c0 20 add_watcher() i=0 2024-09-12T17:53:25.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.460+0000 7fddd8bc19c0 20 add_watcher() i=1 2024-09-12T17:53:25.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.460+0000 7fddd8bc19c0 20 add_watcher() i=2 2024-09-12T17:53:25.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.460+0000 7fddd8bc19c0 20 add_watcher() i=3 2024-09-12T17:53:25.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.460+0000 7fddd8bc19c0 20 add_watcher() i=4 2024-09-12T17:53:25.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.460+0000 7fddd8bc19c0 20 add_watcher() i=5 2024-09-12T17:53:25.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.460+0000 7fddd8bc19c0 20 add_watcher() i=6 2024-09-12T17:53:25.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.464+0000 7fddd8bc19c0 20 add_watcher() i=7 2024-09-12T17:53:25.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.464+0000 7fddd8bc19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:25.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.468+0000 7fdc8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:25.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.468+0000 7fddd8bc19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:25.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.468+0000 7fddd8bc19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:25.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.468+0000 7fddd8bc19c0 5 note: GC not initialized 2024-09-12T17:53:25.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.472+0000 7fdc877fe640 20 reqs_thread_entry: start 2024-09-12T17:53:25.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.472+0000 7fddd8bc19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:25.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.472+0000 7fddd8bc19c0 20 Filter name: none 2024-09-12T17:53:25.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.472+0000 7fdc857fa640 20 reqs_thread_entry: start 2024-09-12T17:53:25.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.472+0000 7fddd8bc19c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T17:53:25.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.472+0000 7fddd8bc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:25.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.472+0000 7fddd8bc19c0 20 rados_obj.operate() r=0 bl.length=488 2024-09-12T17:53:25.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.472+0000 7fddd8bc19c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T17:53:25.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.472+0000 7fddd8bc19c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:53:25.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:25.472+0000 7fddd8bc19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:27.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.171+0000 7fddd8bc19c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:53:27.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.171+0000 7fddd8bc19c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:53:27.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.171+0000 7fddd8bc19c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T17:53:27.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.175+0000 7fdcb97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268229 cookie 94424267097472 notifier 8519 bl.length()=687 2024-09-12T17:53:27.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.175+0000 7fdcb97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:53:27.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.175+0000 7fdcb97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:53:27.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.179+0000 7fdc8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:27.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.187+0000 7fddd8bc19c0 20 remove_watcher() i=0 2024-09-12T17:53:27.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.187+0000 7fddd8bc19c0 2 removed watcher, disabling cache 2024-09-12T17:53:27.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.187+0000 7fddd8bc19c0 20 remove_watcher() i=1 2024-09-12T17:53:27.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.191+0000 7fddd8bc19c0 20 remove_watcher() i=2 2024-09-12T17:53:27.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.191+0000 7fddd8bc19c0 20 remove_watcher() i=3 2024-09-12T17:53:27.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.195+0000 7fddd8bc19c0 20 remove_watcher() i=4 2024-09-12T17:53:27.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.195+0000 7fddd8bc19c0 20 remove_watcher() i=5 2024-09-12T17:53:27.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.199+0000 7fddd8bc19c0 20 remove_watcher() i=6 2024-09-12T17:53:27.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.199+0000 7fddd8bc19c0 20 remove_watcher() i=7 2024-09-12T17:53:27.222 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T17:53:27.223 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key PDEGYQLPGJABHMZRPANI --secret sYKxgjEwcNA6AU7Q+zIDvf4IQ63PNj85xwrKOKKPPif4lLfWhGEHzQ== --cluster ceph 2024-09-12T17:53:27.269 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:27.269 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:27.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.315+0000 7ff1a93019c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.315+0000 7ff1a93019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:27.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.315+0000 7ff1a93019c0 20 realm 2024-09-12T17:53:27.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.315+0000 7ff1a93019c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.315+0000 7ff1a93019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:27.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.315+0000 7ff1a93019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:27.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.315+0000 7ff1a93019c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.315+0000 7ff1a93019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:27.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.315+0000 7ff1a93019c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.319+0000 7ff1a93019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:27.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.319+0000 7ff1a93019c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.319+0000 7ff1a93019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:27.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.319+0000 7ff1a93019c0 20 searching for the correct realm 2024-09-12T17:53:27.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.323+0000 7ff1a7608640 0 -- 172.21.15.119:0/21743029 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7ff19c043350 msgr2=0x7ff19c0863c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:27.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.331+0000 7ff1a6606640 0 -- 172.21.15.119:0/21743029 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7ff1a00c38d0 msgr2=0x7ff1a00e09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:27.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.547+0000 7ff1a93019c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:27.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.547+0000 7ff1a93019c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:27.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.547+0000 7ff1a93019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:27.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.547+0000 7ff1a93019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:27.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.547+0000 7ff1a93019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:27.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.547+0000 7ff1a93019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:27.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.547+0000 7ff1a93019c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.547+0000 7ff1a93019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:27.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.547+0000 7ff1a93019c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.551+0000 7ff1a93019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:27.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.551+0000 7ff1a93019c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.551+0000 7ff1a93019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:27.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.551+0000 7ff1a93019c0 20 zone default found 2024-09-12T17:53:27.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.551+0000 7ff1a93019c0 4 Realm: () 2024-09-12T17:53:27.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.551+0000 7ff1a93019c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:27.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.551+0000 7ff1a93019c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:27.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.551+0000 7ff1a93019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:27.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.551+0000 7ff1a93019c0 20 zonegroup default 2024-09-12T17:53:27.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.551+0000 7ff1a93019c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.551+0000 7ff1a93019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:27.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.551+0000 7ff1a93019c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.551+0000 7ff1a93019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:27.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.551+0000 7ff1a93019c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.555+0000 7ff1a93019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:27.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.555+0000 7ff1a93019c0 20 started sync module instance, tier type = 2024-09-12T17:53:27.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.555+0000 7ff1a93019c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:27.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.575+0000 7ff1a93019c0 20 add_watcher() i=0 2024-09-12T17:53:27.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.575+0000 7ff1a93019c0 20 add_watcher() i=1 2024-09-12T17:53:27.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.575+0000 7ff1a93019c0 20 add_watcher() i=2 2024-09-12T17:53:27.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.575+0000 7ff1a93019c0 20 add_watcher() i=3 2024-09-12T17:53:27.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.575+0000 7ff1a93019c0 20 add_watcher() i=4 2024-09-12T17:53:27.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.575+0000 7ff1a93019c0 20 add_watcher() i=5 2024-09-12T17:53:27.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.575+0000 7ff1a93019c0 20 add_watcher() i=6 2024-09-12T17:53:27.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.579+0000 7ff1a93019c0 20 add_watcher() i=7 2024-09-12T17:53:27.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.579+0000 7ff1a93019c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:27.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff05d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:27.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:27.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:27.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 5 note: GC not initialized 2024-09-12T17:53:27.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7fefd7fff640 20 reqs_thread_entry: start 2024-09-12T17:53:27.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:27.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 20 Filter name: none 2024-09-12T17:53:27.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7fefd5ffb640 20 reqs_thread_entry: start 2024-09-12T17:53:27.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T17:53:27.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:27.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T17:53:27.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:53:27.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T17:53:27.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:27.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T17:53:27.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:53:27.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 10 cache get: name=default.rgw.meta+users.keys+PDEGYQLPGJABHMZRPANI : miss 2024-09-12T17:53:27.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:27.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 10 cache put: name=default.rgw.meta+users.keys+PDEGYQLPGJABHMZRPANI info.flags=0x0 2024-09-12T17:53:27.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 10 adding default.rgw.meta+users.keys+PDEGYQLPGJABHMZRPANI to cache LRU end 2024-09-12T17:53:27.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 10 cache get: name=default.rgw.meta+users.keys+PDEGYQLPGJABHMZRPANI : hit (negative entry) 2024-09-12T17:53:27.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.583+0000 7ff1a93019c0 10 cache get: name=default.rgw.meta+users.keys+PDEGYQLPGJABHMZRPANI : hit (negative entry) 2024-09-12T17:53:27.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.587+0000 7ff1a93019c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:53:27.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.587+0000 7ff1a93019c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:53:27.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.587+0000 7ff1a93019c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T17:53:27.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.591+0000 7ff089ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268183 cookie 94037164888672 notifier 9096 bl.length()=645 2024-09-12T17:53:27.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.591+0000 7ff089ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:53:27.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.591+0000 7ff089ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:53:27.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.595+0000 7ff1a93019c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T17:53:27.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.595+0000 7ff1a93019c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:53:27.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.595+0000 7ff1a93019c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T17:53:27.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.595+0000 7ff089ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268205 cookie 94037164893296 notifier 9096 bl.length()=185 2024-09-12T17:53:27.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.595+0000 7ff089ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T17:53:27.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.595+0000 7ff089ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:53:27.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.599+0000 7ff1a93019c0 10 cache put: name=default.rgw.meta+users.keys+PDEGYQLPGJABHMZRPANI info.flags=0x7 2024-09-12T17:53:27.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.599+0000 7ff1a93019c0 10 moving default.rgw.meta+users.keys+PDEGYQLPGJABHMZRPANI to cache LRU end 2024-09-12T17:53:27.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.599+0000 7ff1a93019c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:PDEGYQLPGJABHMZRPANI, ofs0, ns] 2024-09-12T17:53:27.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.599+0000 7ff089ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268143 cookie 94037164882176 notifier 9096 bl.length()=186 2024-09-12T17:53:27.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.599+0000 7ff089ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PDEGYQLPGJABHMZRPANI info.flags=0x7 2024-09-12T17:53:27.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.599+0000 7ff089ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PDEGYQLPGJABHMZRPANI to cache LRU end 2024-09-12T17:53:27.603 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T17:53:27.603 INFO:teuthology.orchestra.run.smithi119.stdout: "user_id": "bar.client.0", 2024-09-12T17:53:27.604 INFO:teuthology.orchestra.run.smithi119.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T17:53:27.604 INFO:teuthology.orchestra.run.smithi119.stdout: "email": "bar+test@test.test", 2024-09-12T17:53:27.604 INFO:teuthology.orchestra.run.smithi119.stdout: "suspended": 0, 2024-09-12T17:53:27.604 INFO:teuthology.orchestra.run.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:53:27.604 INFO:teuthology.orchestra.run.smithi119.stdout: "subusers": [], 2024-09-12T17:53:27.604 INFO:teuthology.orchestra.run.smithi119.stdout: "keys": [ 2024-09-12T17:53:27.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T17:53:27.604 INFO:teuthology.orchestra.run.smithi119.stdout: "user": "bar.client.0", 2024-09-12T17:53:27.604 INFO:teuthology.orchestra.run.smithi119.stdout: "access_key": "PDEGYQLPGJABHMZRPANI", 2024-09-12T17:53:27.605 INFO:teuthology.orchestra.run.smithi119.stdout: "secret_key": "sYKxgjEwcNA6AU7Q+zIDvf4IQ63PNj85xwrKOKKPPif4lLfWhGEHzQ==", 2024-09-12T17:53:27.605 INFO:teuthology.orchestra.run.smithi119.stdout: "active": true, 2024-09-12T17:53:27.605 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:53:27.589166Z" 2024-09-12T17:53:27.605 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T17:53:27.605 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-12T17:53:27.605 INFO:teuthology.orchestra.run.smithi119.stdout: "swift_keys": [], 2024-09-12T17:53:27.605 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": [], 2024-09-12T17:53:27.605 INFO:teuthology.orchestra.run.smithi119.stdout: "op_mask": "read, write, delete", 2024-09-12T17:53:27.605 INFO:teuthology.orchestra.run.smithi119.stdout: "default_placement": "", 2024-09-12T17:53:27.605 INFO:teuthology.orchestra.run.smithi119.stdout: "default_storage_class": "", 2024-09-12T17:53:27.605 INFO:teuthology.orchestra.run.smithi119.stdout: "placement_tags": [], 2024-09-12T17:53:27.605 INFO:teuthology.orchestra.run.smithi119.stdout: "bucket_quota": { 2024-09-12T17:53:27.605 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:27.605 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:27.606 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:27.606 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:27.606 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:27.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:27.606 INFO:teuthology.orchestra.run.smithi119.stdout: "user_quota": { 2024-09-12T17:53:27.606 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:27.606 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:27.606 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:27.606 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:27.606 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:27.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:27.606 INFO:teuthology.orchestra.run.smithi119.stdout: "temp_url_keys": [], 2024-09-12T17:53:27.606 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "rgw", 2024-09-12T17:53:27.606 INFO:teuthology.orchestra.run.smithi119.stdout: "mfa_ids": [], 2024-09-12T17:53:27.607 INFO:teuthology.orchestra.run.smithi119.stdout: "account_id": "", 2024-09-12T17:53:27.607 INFO:teuthology.orchestra.run.smithi119.stdout: "path": "/", 2024-09-12T17:53:27.607 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:53:27.589142Z", 2024-09-12T17:53:27.607 INFO:teuthology.orchestra.run.smithi119.stdout: "tags": [], 2024-09-12T17:53:27.607 INFO:teuthology.orchestra.run.smithi119.stdout: "group_ids": [] 2024-09-12T17:53:27.607 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T17:53:27.607 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:27.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.603+0000 7ff05d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:27.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.607+0000 7ff1a93019c0 20 remove_watcher() i=0 2024-09-12T17:53:27.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.607+0000 7ff1a93019c0 2 removed watcher, disabling cache 2024-09-12T17:53:27.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.611+0000 7ff1a93019c0 20 remove_watcher() i=1 2024-09-12T17:53:27.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.611+0000 7ff1a93019c0 20 remove_watcher() i=2 2024-09-12T17:53:27.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.615+0000 7ff1a93019c0 20 remove_watcher() i=3 2024-09-12T17:53:27.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.615+0000 7ff1a93019c0 20 remove_watcher() i=4 2024-09-12T17:53:27.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.619+0000 7ff1a93019c0 20 remove_watcher() i=5 2024-09-12T17:53:27.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.619+0000 7ff1a93019c0 20 remove_watcher() i=6 2024-09-12T17:53:27.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.623+0000 7ff1a93019c0 20 remove_watcher() i=7 2024-09-12T17:53:27.640 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 2966369785 --totp-seed JO2HHKRXVEPJ3NNXMSSYRVEAP4T3JPJQWZOLAYSJ66E7YTQN756WWPDM2FDKJW4S --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:53:27.729 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:27.729 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:27.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.771+0000 7f1d762009c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.771+0000 7f1d762009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:27.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.771+0000 7f1d762009c0 20 realm 2024-09-12T17:53:27.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.771+0000 7f1d762009c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.771+0000 7f1d762009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:27.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.771+0000 7f1d762009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:27.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.771+0000 7f1d762009c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.771+0000 7f1d762009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:27.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.771+0000 7f1d762009c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.775+0000 7f1d762009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:27.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.775+0000 7f1d762009c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:27.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.775+0000 7f1d762009c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:27.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.775+0000 7f1d762009c0 20 searching for the correct realm 2024-09-12T17:53:27.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.779+0000 7f1d74507640 0 -- 172.21.15.119:0/2107228818 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f1d5c0d3bb0 msgr2=0x7f1d5c0d18c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:28.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:27.995+0000 7f1d73505640 0 -- 172.21.15.119:0/2107228818 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f1d6c04e400 msgr2=0x7f1d6c04e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:28.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.235+0000 7f1d762009c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:28.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.235+0000 7f1d762009c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:28.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.235+0000 7f1d762009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:28.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.235+0000 7f1d762009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:28.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.235+0000 7f1d762009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:28.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.235+0000 7f1d762009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:28.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.235+0000 7f1d762009c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.235+0000 7f1d762009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:28.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.235+0000 7f1d762009c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.239+0000 7f1d762009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:28.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.239+0000 7f1d762009c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.247+0000 7f1d762009c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:28.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.247+0000 7f1d762009c0 20 zone default found 2024-09-12T17:53:28.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.247+0000 7f1d762009c0 4 Realm: () 2024-09-12T17:53:28.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.247+0000 7f1d762009c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:28.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.247+0000 7f1d762009c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:28.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.247+0000 7f1d762009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:28.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.247+0000 7f1d762009c0 20 zonegroup default 2024-09-12T17:53:28.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.247+0000 7f1d762009c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.247+0000 7f1d762009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:28.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.247+0000 7f1d762009c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.255+0000 7f1d762009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:28.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.255+0000 7f1d762009c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.255+0000 7f1d762009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:28.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.255+0000 7f1d762009c0 20 started sync module instance, tier type = 2024-09-12T17:53:28.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.255+0000 7f1d762009c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:28.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.283+0000 7f1d762009c0 20 add_watcher() i=0 2024-09-12T17:53:28.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.283+0000 7f1d762009c0 20 add_watcher() i=1 2024-09-12T17:53:28.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.283+0000 7f1d762009c0 20 add_watcher() i=2 2024-09-12T17:53:28.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.283+0000 7f1d762009c0 20 add_watcher() i=3 2024-09-12T17:53:28.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.283+0000 7f1d762009c0 20 add_watcher() i=4 2024-09-12T17:53:28.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.283+0000 7f1d762009c0 20 add_watcher() i=5 2024-09-12T17:53:28.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.283+0000 7f1d762009c0 20 add_watcher() i=6 2024-09-12T17:53:28.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.283+0000 7f1d762009c0 20 add_watcher() i=7 2024-09-12T17:53:28.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.283+0000 7f1d762009c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:28.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.287+0000 7f1c29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:28.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.287+0000 7f1d762009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:28.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.287+0000 7f1d762009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:28.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.287+0000 7f1d762009c0 5 note: GC not initialized 2024-09-12T17:53:28.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.287+0000 7f1c28fe1640 20 reqs_thread_entry: start 2024-09-12T17:53:28.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.291+0000 7f1d762009c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:28.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.291+0000 7f1d762009c0 20 Filter name: none 2024-09-12T17:53:28.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.291+0000 7f1ba27fc640 20 reqs_thread_entry: start 2024-09-12T17:53:28.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.291+0000 7f1d762009c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T17:53:28.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.291+0000 7f1d762009c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.291+0000 7f1d762009c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:53:28.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.291+0000 7f1d762009c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T17:53:28.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.291+0000 7f1d762009c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:53:28.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.291+0000 7f1d762009c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:28.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.299+0000 7f1d762009c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:53:28.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.299+0000 7f1d762009c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:53:28.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.299+0000 7f1d762009c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T17:53:28.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.299+0000 7f1c52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235480 cookie 93923275332960 notifier 9117 bl.length()=659 2024-09-12T17:53:28.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.299+0000 7f1c52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:53:28.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.299+0000 7f1c52ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:53:28.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.303+0000 7f1c29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:28.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.307+0000 7f1d762009c0 20 remove_watcher() i=0 2024-09-12T17:53:28.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.307+0000 7f1d762009c0 2 removed watcher, disabling cache 2024-09-12T17:53:28.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.311+0000 7f1d762009c0 20 remove_watcher() i=1 2024-09-12T17:53:28.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.311+0000 7f1d762009c0 20 remove_watcher() i=2 2024-09-12T17:53:28.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.315+0000 7f1d762009c0 20 remove_watcher() i=3 2024-09-12T17:53:28.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.315+0000 7f1d762009c0 20 remove_watcher() i=4 2024-09-12T17:53:28.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.319+0000 7f1d762009c0 20 remove_watcher() i=5 2024-09-12T17:53:28.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.319+0000 7f1d762009c0 20 remove_watcher() i=6 2024-09-12T17:53:28.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.323+0000 7f1d762009c0 20 remove_watcher() i=7 2024-09-12T17:53:28.338 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-12T17:53:28.374 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:28.374 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:28.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.415+0000 7f93cdcbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.419+0000 7f93cdcbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:28.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.419+0000 7f93cdcbb9c0 20 realm 2024-09-12T17:53:28.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.419+0000 7f93cdcbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.419+0000 7f93cdcbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:28.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.419+0000 7f93cdcbb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:28.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.419+0000 7f93cdcbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.419+0000 7f93cdcbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:28.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.419+0000 7f93cdcbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.419+0000 7f93cdcbb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:28.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.419+0000 7f93cdcbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.423+0000 7f93cdcbb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:28.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.423+0000 7f93cdcbb9c0 20 searching for the correct realm 2024-09-12T17:53:28.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.427+0000 7f93cbfc2640 0 -- 172.21.15.119:0/3840664798 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55e288fc31a0 msgr2=0x55e288fc5590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:28.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.435+0000 7f93cafc0640 0 -- 172.21.15.119:0/3840664798 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f93c40c6b50 msgr2=0x7f93c40b8950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.443+0000 7f93cdcbb9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.443+0000 7f93cdcbb9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.443+0000 7f93cdcbb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.443+0000 7f93cdcbb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.443+0000 7f93cdcbb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.443+0000 7f93cdcbb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.443+0000 7f93cdcbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.443+0000 7f93cdcbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:28.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.443+0000 7f93cdcbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.443+0000 7f93cdcbb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:28.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.443+0000 7f93cdcbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.447+0000 7f93cdcbb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:28.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.447+0000 7f93cdcbb9c0 20 zone default found 2024-09-12T17:53:28.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.447+0000 7f93cdcbb9c0 4 Realm: () 2024-09-12T17:53:28.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.447+0000 7f93cdcbb9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:28.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.447+0000 7f93cdcbb9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:28.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.447+0000 7f93cdcbb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:28.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.447+0000 7f93cdcbb9c0 20 zonegroup default 2024-09-12T17:53:28.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.447+0000 7f93cdcbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.447+0000 7f93cdcbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:28.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.447+0000 7f93cdcbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.447+0000 7f93cdcbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:28.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.447+0000 7f93cdcbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.447+0000 7f93cdcbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:28.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.447+0000 7f93cdcbb9c0 20 started sync module instance, tier type = 2024-09-12T17:53:28.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.447+0000 7f93cdcbb9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:28.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.463+0000 7f93cdcbb9c0 20 add_watcher() i=0 2024-09-12T17:53:28.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.463+0000 7f93cdcbb9c0 20 add_watcher() i=1 2024-09-12T17:53:28.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.463+0000 7f93cdcbb9c0 20 add_watcher() i=2 2024-09-12T17:53:28.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.463+0000 7f93cdcbb9c0 20 add_watcher() i=3 2024-09-12T17:53:28.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.463+0000 7f93cdcbb9c0 20 add_watcher() i=4 2024-09-12T17:53:28.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.463+0000 7f93cdcbb9c0 20 add_watcher() i=5 2024-09-12T17:53:28.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.463+0000 7f93cdcbb9c0 20 add_watcher() i=6 2024-09-12T17:53:28.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.463+0000 7f93cdcbb9c0 20 add_watcher() i=7 2024-09-12T17:53:28.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.463+0000 7f93cdcbb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:28.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f9281fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:28.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:28.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:28.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 5 note: GC not initialized 2024-09-12T17:53:28.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f9280fe1640 20 reqs_thread_entry: start 2024-09-12T17:53:28.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:28.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 20 Filter name: none 2024-09-12T17:53:28.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f91fa7fc640 20 reqs_thread_entry: start 2024-09-12T17:53:28.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-12T17:53:28.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:28.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-12T17:53:28.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T17:53:28.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-12T17:53:28.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-12T17:53:28.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:28.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-12T17:53:28.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T17:53:28.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.467+0000 7f93cdcbb9c0 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-12T17:53:28.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.471+0000 7f93cdcbb9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T17:53:28.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.471+0000 7f93cdcbb9c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T17:53:28.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.471+0000 7f93cdcbb9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-12T17:53:28.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.471+0000 7f92aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235481 cookie 94431449232304 notifier 8567 bl.length()=389 2024-09-12T17:53:28.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.471+0000 7f92aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T17:53:28.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.471+0000 7f92aeffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T17:53:28.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.475+0000 7f93cdcbb9c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T17:53:28.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.475+0000 7f93cdcbb9c0 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T17:53:28.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.475+0000 7f93cdcbb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-12T17:53:28.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.475+0000 7f92aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235526 cookie 94431449242336 notifier 8567 bl.length()=230 2024-09-12T17:53:28.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.475+0000 7f92aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T17:53:28.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.475+0000 7f92aeffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T17:53:28.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.483+0000 7f93cdcbb9c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T17:53:28.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.483+0000 7f93cdcbb9c0 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T17:53:28.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.483+0000 7f93cdcbb9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-12T17:53:28.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.483+0000 7f92aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235455 cookie 94431449239200 notifier 8567 bl.length()=234 2024-09-12T17:53:28.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.483+0000 7f92aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T17:53:28.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.483+0000 7f92aeffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T17:53:28.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.491+0000 7f9281fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:28.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.495+0000 7f93cdcbb9c0 20 remove_watcher() i=0 2024-09-12T17:53:28.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.495+0000 7f93cdcbb9c0 2 removed watcher, disabling cache 2024-09-12T17:53:28.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.495+0000 7f93cdcbb9c0 20 remove_watcher() i=1 2024-09-12T17:53:28.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.499+0000 7f93cdcbb9c0 20 remove_watcher() i=2 2024-09-12T17:53:28.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.499+0000 7f93cdcbb9c0 20 remove_watcher() i=3 2024-09-12T17:53:28.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.503+0000 7f93cdcbb9c0 20 remove_watcher() i=4 2024-09-12T17:53:28.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.503+0000 7f93cdcbb9c0 20 remove_watcher() i=5 2024-09-12T17:53:28.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.503+0000 7f93cdcbb9c0 20 remove_watcher() i=6 2024-09-12T17:53:28.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.507+0000 7f93cdcbb9c0 20 remove_watcher() i=7 2024-09-12T17:53:28.518 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T17:53:28.518 INFO:teuthology.orchestra.run.smithi119.stdout: "id": "RGW33333333333333333", 2024-09-12T17:53:28.518 INFO:teuthology.orchestra.run.smithi119.stdout: "tenant": "testx", 2024-09-12T17:53:28.518 INFO:teuthology.orchestra.run.smithi119.stdout: "name": "Mr.RGW33333333333333333", 2024-09-12T17:53:28.518 INFO:teuthology.orchestra.run.smithi119.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-12T17:53:28.518 INFO:teuthology.orchestra.run.smithi119.stdout: "quota": { 2024-09-12T17:53:28.518 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:28.519 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:28.519 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:28.519 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:28.519 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:28.519 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:28.519 INFO:teuthology.orchestra.run.smithi119.stdout: "bucket_quota": { 2024-09-12T17:53:28.519 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:28.519 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:28.519 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:28.519 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:28.519 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:28.519 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:28.520 INFO:teuthology.orchestra.run.smithi119.stdout: "max_users": 1000, 2024-09-12T17:53:28.520 INFO:teuthology.orchestra.run.smithi119.stdout: "max_roles": 1000, 2024-09-12T17:53:28.520 INFO:teuthology.orchestra.run.smithi119.stdout: "max_groups": 1000, 2024-09-12T17:53:28.520 INFO:teuthology.orchestra.run.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:53:28.520 INFO:teuthology.orchestra.run.smithi119.stdout: "max_access_keys": 4 2024-09-12T17:53:28.520 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T17:53:28.521 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-12T17:53:28.521 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key GQXIOXVKRFZNTJZWNELS --secret IARiVeOhuLjL//AXdz6NBdH3a17p5cc5/5gLjIJl0fCjv3DjJurmGg== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-12T17:53:28.604 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:28.604 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:28.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.647+0000 7f2830dc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.647+0000 7f2830dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:28.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.647+0000 7f2830dc89c0 20 realm 2024-09-12T17:53:28.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.647+0000 7f2830dc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.647+0000 7f2830dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:28.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.647+0000 7f2830dc89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:28.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.647+0000 7f2830dc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.647+0000 7f2830dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:28.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.647+0000 7f2830dc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.651+0000 7f2830dc89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:28.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.651+0000 7f2830dc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:28.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.651+0000 7f2830dc89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:28.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.651+0000 7f2830dc89c0 20 searching for the correct realm 2024-09-12T17:53:28.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.655+0000 7f282f0cf640 0 -- 172.21.15.119:0/2599995745 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f2820077b70 msgr2=0x7f28200095e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:28.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:28.871+0000 7f282e0cd640 0 -- 172.21.15.119:0/2599995745 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f282801eb60 msgr2=0x7f282804f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:29.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:29.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:29.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:29.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:29.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:29.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:29.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:29.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:29.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 zone default found 2024-09-12T17:53:29.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 4 Realm: () 2024-09-12T17:53:29.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:29.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:29.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:29.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 zonegroup default 2024-09-12T17:53:29.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.091+0000 7f2830dc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.095+0000 7f2830dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.095+0000 7f2830dc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.095+0000 7f2830dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.095+0000 7f2830dc89c0 20 started sync module instance, tier type = 2024-09-12T17:53:29.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.095+0000 7f2830dc89c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:29.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.119+0000 7f2830dc89c0 20 add_watcher() i=0 2024-09-12T17:53:29.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.119+0000 7f2830dc89c0 20 add_watcher() i=1 2024-09-12T17:53:29.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.119+0000 7f2830dc89c0 20 add_watcher() i=2 2024-09-12T17:53:29.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.119+0000 7f2830dc89c0 20 add_watcher() i=3 2024-09-12T17:53:29.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.119+0000 7f2830dc89c0 20 add_watcher() i=4 2024-09-12T17:53:29.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.119+0000 7f2830dc89c0 20 add_watcher() i=5 2024-09-12T17:53:29.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.119+0000 7f2830dc89c0 20 add_watcher() i=6 2024-09-12T17:53:29.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.119+0000 7f2830dc89c0 20 add_watcher() i=7 2024-09-12T17:53:29.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.119+0000 7f2830dc89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:29.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.123+0000 7f26e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:29.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.123+0000 7f2830dc89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:29.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.123+0000 7f2830dc89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:29.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.123+0000 7f2830dc89c0 5 note: GC not initialized 2024-09-12T17:53:29.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.123+0000 7f265ffff640 20 reqs_thread_entry: start 2024-09-12T17:53:29.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.123+0000 7f2830dc89c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:29.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.123+0000 7f2830dc89c0 20 Filter name: none 2024-09-12T17:53:29.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.123+0000 7f265dffb640 20 reqs_thread_entry: start 2024-09-12T17:53:29.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.123+0000 7f2830dc89c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T17:53:29.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.123+0000 7f2830dc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T17:53:29.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:53:29.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T17:53:29.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T17:53:29.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:53:29.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 10 cache get: name=default.rgw.meta+users.keys+GQXIOXVKRFZNTJZWNELS : miss 2024-09-12T17:53:29.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 10 cache put: name=default.rgw.meta+users.keys+GQXIOXVKRFZNTJZWNELS info.flags=0x0 2024-09-12T17:53:29.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 10 adding default.rgw.meta+users.keys+GQXIOXVKRFZNTJZWNELS to cache LRU end 2024-09-12T17:53:29.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-12T17:53:29.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:53:29.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T17:53:29.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T17:53:29.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:29.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 10 cache get: name=default.rgw.meta+users.keys+GQXIOXVKRFZNTJZWNELS : hit (negative entry) 2024-09-12T17:53:29.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.127+0000 7f2830dc89c0 10 cache get: name=default.rgw.meta+users.keys+GQXIOXVKRFZNTJZWNELS : hit (negative entry) 2024-09-12T17:53:29.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.131+0000 7f2830dc89c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:53:29.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.131+0000 7f2830dc89c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:53:29.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.131+0000 7f2830dc89c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T17:53:29.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.131+0000 7f27127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235502 cookie 94065983569552 notifier 9153 bl.length()=732 2024-09-12T17:53:29.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.131+0000 7f27127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:53:29.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.131+0000 7f27127fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:53:29.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.139+0000 7f2830dc89c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T17:53:29.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.139+0000 7f2830dc89c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:53:29.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.139+0000 7f2830dc89c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T17:53:29.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.139+0000 7f27127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235428 cookie 94065983576848 notifier 9153 bl.length()=215 2024-09-12T17:53:29.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.139+0000 7f27127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T17:53:29.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.139+0000 7f27127fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:53:29.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.143+0000 7f2830dc89c0 10 cache put: name=default.rgw.meta+users.keys+GQXIOXVKRFZNTJZWNELS info.flags=0x7 2024-09-12T17:53:29.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.143+0000 7f2830dc89c0 10 moving default.rgw.meta+users.keys+GQXIOXVKRFZNTJZWNELS to cache LRU end 2024-09-12T17:53:29.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.143+0000 7f2830dc89c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:GQXIOXVKRFZNTJZWNELS, ofs0, ns] 2024-09-12T17:53:29.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.147+0000 7f27127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235429 cookie 94065983576848 notifier 9153 bl.length()=201 2024-09-12T17:53:29.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.147+0000 7f27127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+GQXIOXVKRFZNTJZWNELS info.flags=0x7 2024-09-12T17:53:29.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.147+0000 7f27127fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+GQXIOXVKRFZNTJZWNELS to cache LRU end 2024-09-12T17:53:29.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.147+0000 7f2830dc89c0 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-12T17:53:29.150 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T17:53:29.150 INFO:teuthology.orchestra.run.smithi119.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T17:53:29.150 INFO:teuthology.orchestra.run.smithi119.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-12T17:53:29.150 INFO:teuthology.orchestra.run.smithi119.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T17:53:29.151 INFO:teuthology.orchestra.run.smithi119.stdout: "suspended": 0, 2024-09-12T17:53:29.151 INFO:teuthology.orchestra.run.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:53:29.151 INFO:teuthology.orchestra.run.smithi119.stdout: "subusers": [], 2024-09-12T17:53:29.151 INFO:teuthology.orchestra.run.smithi119.stdout: "keys": [ 2024-09-12T17:53:29.151 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T17:53:29.151 INFO:teuthology.orchestra.run.smithi119.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T17:53:29.151 INFO:teuthology.orchestra.run.smithi119.stdout: "access_key": "GQXIOXVKRFZNTJZWNELS", 2024-09-12T17:53:29.151 INFO:teuthology.orchestra.run.smithi119.stdout: "secret_key": "IARiVeOhuLjL//AXdz6NBdH3a17p5cc5/5gLjIJl0fCjv3DjJurmGg==", 2024-09-12T17:53:29.151 INFO:teuthology.orchestra.run.smithi119.stdout: "active": true, 2024-09-12T17:53:29.151 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:53:29.133085Z" 2024-09-12T17:53:29.151 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T17:53:29.151 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-12T17:53:29.151 INFO:teuthology.orchestra.run.smithi119.stdout: "swift_keys": [], 2024-09-12T17:53:29.152 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": [], 2024-09-12T17:53:29.152 INFO:teuthology.orchestra.run.smithi119.stdout: "op_mask": "read, write, delete", 2024-09-12T17:53:29.152 INFO:teuthology.orchestra.run.smithi119.stdout: "default_placement": "", 2024-09-12T17:53:29.152 INFO:teuthology.orchestra.run.smithi119.stdout: "default_storage_class": "", 2024-09-12T17:53:29.152 INFO:teuthology.orchestra.run.smithi119.stdout: "placement_tags": [], 2024-09-12T17:53:29.152 INFO:teuthology.orchestra.run.smithi119.stdout: "bucket_quota": { 2024-09-12T17:53:29.152 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:29.152 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:29.152 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:29.152 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:29.152 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:29.152 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:29.153 INFO:teuthology.orchestra.run.smithi119.stdout: "user_quota": { 2024-09-12T17:53:29.153 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:29.153 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:29.153 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:29.153 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:29.153 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:29.153 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:29.153 INFO:teuthology.orchestra.run.smithi119.stdout: "temp_url_keys": [], 2024-09-12T17:53:29.153 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "root", 2024-09-12T17:53:29.153 INFO:teuthology.orchestra.run.smithi119.stdout: "mfa_ids": [], 2024-09-12T17:53:29.153 INFO:teuthology.orchestra.run.smithi119.stdout: "account_id": "RGW33333333333333333", 2024-09-12T17:53:29.153 INFO:teuthology.orchestra.run.smithi119.stdout: "path": "/", 2024-09-12T17:53:29.154 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:53:29.133050Z", 2024-09-12T17:53:29.154 INFO:teuthology.orchestra.run.smithi119.stdout: "tags": [], 2024-09-12T17:53:29.154 INFO:teuthology.orchestra.run.smithi119.stdout: "group_ids": [] 2024-09-12T17:53:29.154 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T17:53:29.154 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.151+0000 7f26e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:29.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.155+0000 7f2830dc89c0 20 remove_watcher() i=0 2024-09-12T17:53:29.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.155+0000 7f2830dc89c0 2 removed watcher, disabling cache 2024-09-12T17:53:29.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.159+0000 7f2830dc89c0 20 remove_watcher() i=1 2024-09-12T17:53:29.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.159+0000 7f2830dc89c0 20 remove_watcher() i=2 2024-09-12T17:53:29.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.163+0000 7f2830dc89c0 20 remove_watcher() i=3 2024-09-12T17:53:29.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.163+0000 7f2830dc89c0 20 remove_watcher() i=4 2024-09-12T17:53:29.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.167+0000 7f2830dc89c0 20 remove_watcher() i=5 2024-09-12T17:53:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.167+0000 7f2830dc89c0 20 remove_watcher() i=6 2024-09-12T17:53:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.167+0000 7f2830dc89c0 20 remove_watcher() i=7 2024-09-12T17:53:29.187 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 8401242254 --totp-seed QWU77MPDCHYCPXFP3BB33GNCDEXGW4FP55K5PR5DXNW27FHEWIESJEKC5ADGS4PX --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:53:29.277 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:29.277 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:29.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.319+0000 7f91b2ad99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.319+0000 7f91b2ad99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.319+0000 7f91b2ad99c0 20 realm 2024-09-12T17:53:29.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.319+0000 7f91b2ad99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.319+0000 7f91b2ad99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.319+0000 7f91b2ad99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:29.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.319+0000 7f91b2ad99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.319+0000 7f91b2ad99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.319+0000 7f91b2ad99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.323+0000 7f91b2ad99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:29.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.323+0000 7f91b2ad99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.323+0000 7f91b2ad99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:29.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.323+0000 7f91b2ad99c0 20 searching for the correct realm 2024-09-12T17:53:29.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.327+0000 7f91b0de0640 0 -- 172.21.15.119:0/1507862133 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x55e54e8c34e0 msgr2=0x55e54e8c58d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:29.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.335+0000 7f91afdde640 0 -- 172.21.15.119:0/1507862133 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f91a0043400 msgr2=0x7f91a0043860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:29.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.551+0000 7f91b2ad99c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:29.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.551+0000 7f91b2ad99c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:29.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.551+0000 7f91b2ad99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:29.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.551+0000 7f91b2ad99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:29.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.551+0000 7f91b2ad99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:29.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.551+0000 7f91b2ad99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:29.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.551+0000 7f91b2ad99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.555+0000 7f91b2ad99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.555+0000 7f91b2ad99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.555+0000 7f91b2ad99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:29.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.555+0000 7f91b2ad99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.555+0000 7f91b2ad99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:29.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.555+0000 7f91b2ad99c0 20 zone default found 2024-09-12T17:53:29.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.555+0000 7f91b2ad99c0 4 Realm: () 2024-09-12T17:53:29.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.555+0000 7f91b2ad99c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:29.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.555+0000 7f91b2ad99c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:29.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.555+0000 7f91b2ad99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:29.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.555+0000 7f91b2ad99c0 20 zonegroup default 2024-09-12T17:53:29.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.555+0000 7f91b2ad99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.555+0000 7f91b2ad99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.555+0000 7f91b2ad99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.555+0000 7f91b2ad99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.555+0000 7f91b2ad99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.559+0000 7f91b2ad99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.559+0000 7f91b2ad99c0 20 started sync module instance, tier type = 2024-09-12T17:53:29.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.559+0000 7f91b2ad99c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:29.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.579+0000 7f91b2ad99c0 20 add_watcher() i=0 2024-09-12T17:53:29.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.583+0000 7f91b2ad99c0 20 add_watcher() i=1 2024-09-12T17:53:29.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.583+0000 7f91b2ad99c0 20 add_watcher() i=2 2024-09-12T17:53:29.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.583+0000 7f91b2ad99c0 20 add_watcher() i=3 2024-09-12T17:53:29.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.583+0000 7f91b2ad99c0 20 add_watcher() i=4 2024-09-12T17:53:29.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.583+0000 7f91b2ad99c0 20 add_watcher() i=5 2024-09-12T17:53:29.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.583+0000 7f91b2ad99c0 20 add_watcher() i=6 2024-09-12T17:53:29.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.583+0000 7f91b2ad99c0 20 add_watcher() i=7 2024-09-12T17:53:29.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.583+0000 7f91b2ad99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.587+0000 7f9066fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.587+0000 7f91b2ad99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.587+0000 7f91b2ad99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.587+0000 7f91b2ad99c0 5 note: GC not initialized 2024-09-12T17:53:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.587+0000 7f9065fdb640 20 reqs_thread_entry: start 2024-09-12T17:53:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.587+0000 7f91b2ad99c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.587+0000 7f91b2ad99c0 20 Filter name: none 2024-09-12T17:53:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.587+0000 7f8fd77fe640 20 reqs_thread_entry: start 2024-09-12T17:53:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.591+0000 7f91b2ad99c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T17:53:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.591+0000 7f91b2ad99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.591+0000 7f91b2ad99c0 20 rados_obj.operate() r=0 bl.length=532 2024-09-12T17:53:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.591+0000 7f91b2ad99c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T17:53:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.591+0000 7f91b2ad99c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:53:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.591+0000 7f91b2ad99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:29.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.595+0000 7f91b2ad99c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:53:29.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.595+0000 7f91b2ad99c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:53:29.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.595+0000 7f91b2ad99c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T17:53:29.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.595+0000 7f90877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235503 cookie 94443353729056 notifier 8600 bl.length()=746 2024-09-12T17:53:29.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.595+0000 7f90877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:53:29.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.595+0000 7f90877fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:53:29.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.599+0000 7f9066fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:29.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.603+0000 7f91b2ad99c0 20 remove_watcher() i=0 2024-09-12T17:53:29.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.603+0000 7f91b2ad99c0 2 removed watcher, disabling cache 2024-09-12T17:53:29.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.607+0000 7f91b2ad99c0 20 remove_watcher() i=1 2024-09-12T17:53:29.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.607+0000 7f91b2ad99c0 20 remove_watcher() i=2 2024-09-12T17:53:29.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.611+0000 7f91b2ad99c0 20 remove_watcher() i=3 2024-09-12T17:53:29.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.611+0000 7f91b2ad99c0 20 remove_watcher() i=4 2024-09-12T17:53:29.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.615+0000 7f91b2ad99c0 20 remove_watcher() i=5 2024-09-12T17:53:29.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.615+0000 7f91b2ad99c0 20 remove_watcher() i=6 2024-09-12T17:53:29.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.615+0000 7f91b2ad99c0 20 remove_watcher() i=7 2024-09-12T17:53:29.642 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T17:53:29.643 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key ZXTKETPIENFWLEXDBHBC --secret 3yqRJ+QXzlFNmZHqJs4qXKoFbN13yzqt345iD6pf4u9fJCv+S1c+YQ== --cluster ceph 2024-09-12T17:53:29.687 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:29.687 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:29.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.731+0000 7fa993fb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.731+0000 7fa993fb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.731+0000 7fa993fb79c0 20 realm 2024-09-12T17:53:29.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.731+0000 7fa993fb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.731+0000 7fa993fb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.731+0000 7fa993fb79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:29.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.731+0000 7fa993fb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.731+0000 7fa993fb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:29.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.731+0000 7fa993fb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.735+0000 7fa993fb79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:29.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.735+0000 7fa993fb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:29.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.735+0000 7fa993fb79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:29.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.735+0000 7fa993fb79c0 20 searching for the correct realm 2024-09-12T17:53:29.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.739+0000 7fa9922be640 0 -- 172.21.15.119:0/3282978736 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7fa97c06db50 msgr2=0x7fa97c063a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:29.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:29.955+0000 7fa9912bc640 0 -- 172.21.15.119:0/3282978736 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7fa984008050 msgr2=0x7fa98408a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:30.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.171+0000 7fa993fb79c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:30.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.171+0000 7fa993fb79c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:30.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.171+0000 7fa993fb79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:30.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.171+0000 7fa993fb79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:30.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.171+0000 7fa993fb79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:30.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.171+0000 7fa993fb79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:30.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.171+0000 7fa993fb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.171+0000 7fa993fb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.171+0000 7fa993fb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:30.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:30.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 20 zone default found 2024-09-12T17:53:30.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 4 Realm: () 2024-09-12T17:53:30.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:30.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:30.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:30.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 20 zonegroup default 2024-09-12T17:53:30.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 20 started sync module instance, tier type = 2024-09-12T17:53:30.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.175+0000 7fa993fb79c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:30.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.199+0000 7fa993fb79c0 20 add_watcher() i=0 2024-09-12T17:53:30.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.199+0000 7fa993fb79c0 20 add_watcher() i=1 2024-09-12T17:53:30.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.199+0000 7fa993fb79c0 20 add_watcher() i=2 2024-09-12T17:53:30.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.199+0000 7fa993fb79c0 20 add_watcher() i=3 2024-09-12T17:53:30.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.199+0000 7fa993fb79c0 20 add_watcher() i=4 2024-09-12T17:53:30.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.199+0000 7fa993fb79c0 20 add_watcher() i=5 2024-09-12T17:53:30.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.199+0000 7fa993fb79c0 20 add_watcher() i=6 2024-09-12T17:53:30.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.203+0000 7fa993fb79c0 20 add_watcher() i=7 2024-09-12T17:53:30.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.203+0000 7fa993fb79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:30.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.207+0000 7fa8437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:30.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.207+0000 7fa993fb79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:30.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.207+0000 7fa993fb79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:30.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.207+0000 7fa993fb79c0 5 note: GC not initialized 2024-09-12T17:53:30.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.207+0000 7fa8427fc640 20 reqs_thread_entry: start 2024-09-12T17:53:30.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.207+0000 7fa993fb79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:30.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.207+0000 7fa993fb79c0 20 Filter name: none 2024-09-12T17:53:30.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.207+0000 7fa7b3fff640 20 reqs_thread_entry: start 2024-09-12T17:53:30.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.207+0000 7fa993fb79c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:53:30.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.207+0000 7fa993fb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T17:53:30.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:53:30.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T17:53:30.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T17:53:30.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:53:30.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 10 cache get: name=default.rgw.meta+users.keys+ZXTKETPIENFWLEXDBHBC : miss 2024-09-12T17:53:30.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 10 cache put: name=default.rgw.meta+users.keys+ZXTKETPIENFWLEXDBHBC info.flags=0x0 2024-09-12T17:53:30.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 10 adding default.rgw.meta+users.keys+ZXTKETPIENFWLEXDBHBC to cache LRU end 2024-09-12T17:53:30.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 10 cache get: name=default.rgw.meta+users.keys+ZXTKETPIENFWLEXDBHBC : hit (negative entry) 2024-09-12T17:53:30.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 10 cache get: name=default.rgw.meta+users.keys+ZXTKETPIENFWLEXDBHBC : hit (negative entry) 2024-09-12T17:53:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:53:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:53:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.211+0000 7fa993fb79c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:53:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.215+0000 7fa8757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235430 cookie 94544416200032 notifier 8618 bl.length()=660 2024-09-12T17:53:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.215+0000 7fa8757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:53:30.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.215+0000 7fa8757fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:53:30.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.219+0000 7fa993fb79c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T17:53:30.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.219+0000 7fa993fb79c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:53:30.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.219+0000 7fa993fb79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T17:53:30.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.219+0000 7fa8757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235482 cookie 94544416183952 notifier 8618 bl.length()=191 2024-09-12T17:53:30.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.219+0000 7fa8757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T17:53:30.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.219+0000 7fa8757fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:53:30.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.223+0000 7fa993fb79c0 10 cache put: name=default.rgw.meta+users.keys+ZXTKETPIENFWLEXDBHBC info.flags=0x7 2024-09-12T17:53:30.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.227+0000 7fa993fb79c0 10 moving default.rgw.meta+users.keys+ZXTKETPIENFWLEXDBHBC to cache LRU end 2024-09-12T17:53:30.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.227+0000 7fa993fb79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:ZXTKETPIENFWLEXDBHBC, ofs0, ns] 2024-09-12T17:53:30.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.227+0000 7fa8757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235440 cookie 94544416192928 notifier 8618 bl.length()=189 2024-09-12T17:53:30.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.227+0000 7fa8757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZXTKETPIENFWLEXDBHBC info.flags=0x7 2024-09-12T17:53:30.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.227+0000 7fa8757fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZXTKETPIENFWLEXDBHBC to cache LRU end 2024-09-12T17:53:30.229 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T17:53:30.229 INFO:teuthology.orchestra.run.smithi119.stdout: "user_id": "foobar.client.0", 2024-09-12T17:53:30.229 INFO:teuthology.orchestra.run.smithi119.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T17:53:30.229 INFO:teuthology.orchestra.run.smithi119.stdout: "email": "foobar+test@test.test", 2024-09-12T17:53:30.229 INFO:teuthology.orchestra.run.smithi119.stdout: "suspended": 0, 2024-09-12T17:53:30.229 INFO:teuthology.orchestra.run.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:53:30.229 INFO:teuthology.orchestra.run.smithi119.stdout: "subusers": [], 2024-09-12T17:53:30.230 INFO:teuthology.orchestra.run.smithi119.stdout: "keys": [ 2024-09-12T17:53:30.230 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T17:53:30.230 INFO:teuthology.orchestra.run.smithi119.stdout: "user": "foobar.client.0", 2024-09-12T17:53:30.230 INFO:teuthology.orchestra.run.smithi119.stdout: "access_key": "ZXTKETPIENFWLEXDBHBC", 2024-09-12T17:53:30.230 INFO:teuthology.orchestra.run.smithi119.stdout: "secret_key": "3yqRJ+QXzlFNmZHqJs4qXKoFbN13yzqt345iD6pf4u9fJCv+S1c+YQ==", 2024-09-12T17:53:30.230 INFO:teuthology.orchestra.run.smithi119.stdout: "active": true, 2024-09-12T17:53:30.230 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:53:30.214989Z" 2024-09-12T17:53:30.230 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T17:53:30.230 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-12T17:53:30.230 INFO:teuthology.orchestra.run.smithi119.stdout: "swift_keys": [], 2024-09-12T17:53:30.231 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": [], 2024-09-12T17:53:30.231 INFO:teuthology.orchestra.run.smithi119.stdout: "op_mask": "read, write, delete", 2024-09-12T17:53:30.231 INFO:teuthology.orchestra.run.smithi119.stdout: "default_placement": "", 2024-09-12T17:53:30.231 INFO:teuthology.orchestra.run.smithi119.stdout: "default_storage_class": "", 2024-09-12T17:53:30.231 INFO:teuthology.orchestra.run.smithi119.stdout: "placement_tags": [], 2024-09-12T17:53:30.231 INFO:teuthology.orchestra.run.smithi119.stdout: "bucket_quota": { 2024-09-12T17:53:30.231 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:30.231 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:30.231 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:30.231 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:30.231 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:30.231 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:30.232 INFO:teuthology.orchestra.run.smithi119.stdout: "user_quota": { 2024-09-12T17:53:30.232 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:30.232 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:30.232 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:30.232 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:30.232 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:30.232 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:30.232 INFO:teuthology.orchestra.run.smithi119.stdout: "temp_url_keys": [], 2024-09-12T17:53:30.232 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "rgw", 2024-09-12T17:53:30.232 INFO:teuthology.orchestra.run.smithi119.stdout: "mfa_ids": [], 2024-09-12T17:53:30.232 INFO:teuthology.orchestra.run.smithi119.stdout: "account_id": "", 2024-09-12T17:53:30.232 INFO:teuthology.orchestra.run.smithi119.stdout: "path": "/", 2024-09-12T17:53:30.232 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:53:30.214956Z", 2024-09-12T17:53:30.232 INFO:teuthology.orchestra.run.smithi119.stdout: "tags": [], 2024-09-12T17:53:30.233 INFO:teuthology.orchestra.run.smithi119.stdout: "group_ids": [] 2024-09-12T17:53:30.233 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T17:53:30.233 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:30.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.231+0000 7fa8437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:30.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.235+0000 7fa993fb79c0 20 remove_watcher() i=0 2024-09-12T17:53:30.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.235+0000 7fa993fb79c0 2 removed watcher, disabling cache 2024-09-12T17:53:30.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.239+0000 7fa993fb79c0 20 remove_watcher() i=1 2024-09-12T17:53:30.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.239+0000 7fa993fb79c0 20 remove_watcher() i=2 2024-09-12T17:53:30.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.243+0000 7fa993fb79c0 20 remove_watcher() i=3 2024-09-12T17:53:30.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.243+0000 7fa993fb79c0 20 remove_watcher() i=4 2024-09-12T17:53:30.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.247+0000 7fa993fb79c0 20 remove_watcher() i=5 2024-09-12T17:53:30.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.247+0000 7fa993fb79c0 20 remove_watcher() i=6 2024-09-12T17:53:30.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.247+0000 7fa993fb79c0 20 remove_watcher() i=7 2024-09-12T17:53:30.267 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 9366613007 --totp-seed ZB5QXSWRMNVJHGI7TCH2CPLZ5JPBSL2G5VLO22QS6DVHM47RMCZSY3AT7HSTJU3O --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:53:30.310 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:30.310 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:30.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.351+0000 7f733c69f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.355+0000 7f733c69f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.355+0000 7f733c69f9c0 20 realm 2024-09-12T17:53:30.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.355+0000 7f733c69f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.355+0000 7f733c69f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.355+0000 7f733c69f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:30.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.355+0000 7f733c69f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.355+0000 7f733c69f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.355+0000 7f733c69f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.355+0000 7f733c69f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:30.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.355+0000 7f733c69f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.359+0000 7f733c69f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:30.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.359+0000 7f733c69f9c0 20 searching for the correct realm 2024-09-12T17:53:30.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.359+0000 7f733a9a6640 0 -- 172.21.15.119:0/1681864612 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f7330008050 msgr2=0x7f73300208b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:30.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.575+0000 7f73399a4640 0 -- 172.21.15.119:0/1681864612 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f732c065210 msgr2=0x7f732c021e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.791+0000 7f733c69f9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.791+0000 7f733c69f9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.791+0000 7f733c69f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.791+0000 7f733c69f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.791+0000 7f733c69f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.791+0000 7f733c69f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.791+0000 7f733c69f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.791+0000 7f733c69f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.791+0000 7f733c69f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 20 zone default found 2024-09-12T17:53:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 4 Realm: () 2024-09-12T17:53:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 20 zonegroup default 2024-09-12T17:53:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 20 started sync module instance, tier type = 2024-09-12T17:53:30.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.795+0000 7f733c69f9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.823+0000 7f733c69f9c0 20 add_watcher() i=0 2024-09-12T17:53:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.823+0000 7f733c69f9c0 20 add_watcher() i=1 2024-09-12T17:53:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.823+0000 7f733c69f9c0 20 add_watcher() i=2 2024-09-12T17:53:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.823+0000 7f733c69f9c0 20 add_watcher() i=3 2024-09-12T17:53:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.823+0000 7f733c69f9c0 20 add_watcher() i=4 2024-09-12T17:53:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.823+0000 7f733c69f9c0 20 add_watcher() i=5 2024-09-12T17:53:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.823+0000 7f733c69f9c0 20 add_watcher() i=6 2024-09-12T17:53:30.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.823+0000 7f733c69f9c0 20 add_watcher() i=7 2024-09-12T17:53:30.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.823+0000 7f733c69f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.827+0000 7f71f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.827+0000 7f733c69f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.827+0000 7f733c69f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.827+0000 7f733c69f9c0 5 note: GC not initialized 2024-09-12T17:53:30.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.827+0000 7f716b7fe640 20 reqs_thread_entry: start 2024-09-12T17:53:30.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.827+0000 7f733c69f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.831+0000 7f733c69f9c0 20 Filter name: none 2024-09-12T17:53:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.831+0000 7f71697fa640 20 reqs_thread_entry: start 2024-09-12T17:53:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.831+0000 7f733c69f9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:53:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.831+0000 7f733c69f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.831+0000 7f733c69f9c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T17:53:30.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.831+0000 7f733c69f9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T17:53:30.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.831+0000 7f733c69f9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:53:30.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.831+0000 7f733c69f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:30.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.835+0000 7f733c69f9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:53:30.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.835+0000 7f733c69f9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:53:30.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.835+0000 7f733c69f9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:53:30.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.835+0000 7f721dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235431 cookie 94525626330416 notifier 8636 bl.length()=674 2024-09-12T17:53:30.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.835+0000 7f721dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:53:30.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.835+0000 7f721dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:53:30.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.839+0000 7f71f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:30.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.847+0000 7f733c69f9c0 20 remove_watcher() i=0 2024-09-12T17:53:30.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.847+0000 7f733c69f9c0 2 removed watcher, disabling cache 2024-09-12T17:53:30.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.847+0000 7f733c69f9c0 20 remove_watcher() i=1 2024-09-12T17:53:30.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.851+0000 7f733c69f9c0 20 remove_watcher() i=2 2024-09-12T17:53:30.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.851+0000 7f733c69f9c0 20 remove_watcher() i=3 2024-09-12T17:53:30.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.855+0000 7f733c69f9c0 20 remove_watcher() i=4 2024-09-12T17:53:30.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.855+0000 7f733c69f9c0 20 remove_watcher() i=5 2024-09-12T17:53:30.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.859+0000 7f733c69f9c0 20 remove_watcher() i=6 2024-09-12T17:53:30.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.859+0000 7f733c69f9c0 20 remove_watcher() i=7 2024-09-12T17:53:30.876 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T17:53:30.952 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:30.952 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:30.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.995+0000 7f3d391e39c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.995+0000 7f3d391e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.995+0000 7f3d391e39c0 20 realm 2024-09-12T17:53:30.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.995+0000 7f3d391e39c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.995+0000 7f3d391e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.995+0000 7f3d391e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:30.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.995+0000 7f3d391e39c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.995+0000 7f3d391e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:30.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.995+0000 7f3d391e39c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:30.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.999+0000 7f3d391e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:31.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.999+0000 7f3d391e39c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.999+0000 7f3d391e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:31.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:30.999+0000 7f3d391e39c0 20 searching for the correct realm 2024-09-12T17:53:31.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.003+0000 7f3d364e8640 0 -- 172.21.15.119:0/404774565 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f3d280abb90 msgr2=0x7f3d280cf970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:31.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.219+0000 7f3d374ea640 0 -- 172.21.15.119:0/404774565 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f3d2c021060 msgr2=0x7f3d2c003390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:31.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.235+0000 7f3d391e39c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:31.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.235+0000 7f3d391e39c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:31.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.235+0000 7f3d391e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:31.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.235+0000 7f3d391e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:31.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.235+0000 7f3d391e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:31.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.235+0000 7f3d391e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:31.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.235+0000 7f3d391e39c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.235+0000 7f3d391e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:31.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.235+0000 7f3d391e39c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.235+0000 7f3d391e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:31.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.235+0000 7f3d391e39c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.239+0000 7f3d391e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:31.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.239+0000 7f3d391e39c0 20 zone default found 2024-09-12T17:53:31.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.239+0000 7f3d391e39c0 4 Realm: () 2024-09-12T17:53:31.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.239+0000 7f3d391e39c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:31.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.239+0000 7f3d391e39c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:31.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.239+0000 7f3d391e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:31.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.239+0000 7f3d391e39c0 20 zonegroup default 2024-09-12T17:53:31.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.239+0000 7f3d391e39c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.239+0000 7f3d391e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:31.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.239+0000 7f3d391e39c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.239+0000 7f3d391e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:31.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.239+0000 7f3d391e39c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.239+0000 7f3d391e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:31.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.239+0000 7f3d391e39c0 20 started sync module instance, tier type = 2024-09-12T17:53:31.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.239+0000 7f3d391e39c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:31.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.263+0000 7f3d391e39c0 20 add_watcher() i=0 2024-09-12T17:53:31.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.263+0000 7f3d391e39c0 20 add_watcher() i=1 2024-09-12T17:53:31.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.263+0000 7f3d391e39c0 20 add_watcher() i=2 2024-09-12T17:53:31.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.263+0000 7f3d391e39c0 20 add_watcher() i=3 2024-09-12T17:53:31.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.263+0000 7f3d391e39c0 20 add_watcher() i=4 2024-09-12T17:53:31.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.263+0000 7f3d391e39c0 20 add_watcher() i=5 2024-09-12T17:53:31.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.263+0000 7f3d391e39c0 20 add_watcher() i=6 2024-09-12T17:53:31.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.267+0000 7f3d391e39c0 20 add_watcher() i=7 2024-09-12T17:53:31.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.267+0000 7f3d391e39c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:31.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.271+0000 7f3bedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:31.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.271+0000 7f3d391e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:31.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.271+0000 7f3d391e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:31.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.271+0000 7f3d391e39c0 5 note: GC not initialized 2024-09-12T17:53:31.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.271+0000 7f3becfe1640 20 reqs_thread_entry: start 2024-09-12T17:53:31.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.271+0000 7f3d391e39c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:31.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.271+0000 7f3d391e39c0 20 Filter name: none 2024-09-12T17:53:31.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.271+0000 7f3be5ffb640 20 reqs_thread_entry: start 2024-09-12T17:53:31.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.271+0000 7f3d391e39c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:53:31.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.271+0000 7f3d391e39c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.271+0000 7f3d391e39c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:53:31.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.271+0000 7f3d391e39c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T17:53:31.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.271+0000 7f3d391e39c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:53:31.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.271+0000 7f3d391e39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:31.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.275+0000 7f3d391e39c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:53:31.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.275+0000 7f3d391e39c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:53:31.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.275+0000 7f3d391e39c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:53:31.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.275+0000 7f3c1a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235432 cookie 93910223177520 notifier 8651 bl.length()=727 2024-09-12T17:53:31.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.275+0000 7f3c1a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:53:31.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.275+0000 7f3c1a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:53:31.278 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T17:53:31.279 INFO:teuthology.orchestra.run.smithi119.stdout: "user_id": "foobar.client.0", 2024-09-12T17:53:31.279 INFO:teuthology.orchestra.run.smithi119.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T17:53:31.279 INFO:teuthology.orchestra.run.smithi119.stdout: "email": "foobar+test@test.test", 2024-09-12T17:53:31.279 INFO:teuthology.orchestra.run.smithi119.stdout: "suspended": 0, 2024-09-12T17:53:31.279 INFO:teuthology.orchestra.run.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:53:31.279 INFO:teuthology.orchestra.run.smithi119.stdout: "subusers": [], 2024-09-12T17:53:31.279 INFO:teuthology.orchestra.run.smithi119.stdout: "keys": [ 2024-09-12T17:53:31.279 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T17:53:31.279 INFO:teuthology.orchestra.run.smithi119.stdout: "user": "foobar.client.0", 2024-09-12T17:53:31.279 INFO:teuthology.orchestra.run.smithi119.stdout: "access_key": "ZXTKETPIENFWLEXDBHBC", 2024-09-12T17:53:31.279 INFO:teuthology.orchestra.run.smithi119.stdout: "secret_key": "3yqRJ+QXzlFNmZHqJs4qXKoFbN13yzqt345iD6pf4u9fJCv+S1c+YQ==", 2024-09-12T17:53:31.279 INFO:teuthology.orchestra.run.smithi119.stdout: "active": true, 2024-09-12T17:53:31.279 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:53:30.214989Z" 2024-09-12T17:53:31.280 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T17:53:31.280 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-12T17:53:31.280 INFO:teuthology.orchestra.run.smithi119.stdout: "swift_keys": [], 2024-09-12T17:53:31.280 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": [ 2024-09-12T17:53:31.280 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T17:53:31.280 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "oidc-provider", 2024-09-12T17:53:31.280 INFO:teuthology.orchestra.run.smithi119.stdout: "perm": "*" 2024-09-12T17:53:31.280 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:31.280 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T17:53:31.280 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "roles", 2024-09-12T17:53:31.280 INFO:teuthology.orchestra.run.smithi119.stdout: "perm": "*" 2024-09-12T17:53:31.280 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:31.280 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T17:53:31.280 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "user-policy", 2024-09-12T17:53:31.281 INFO:teuthology.orchestra.run.smithi119.stdout: "perm": "*" 2024-09-12T17:53:31.281 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T17:53:31.281 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-12T17:53:31.281 INFO:teuthology.orchestra.run.smithi119.stdout: "op_mask": "read, write, delete", 2024-09-12T17:53:31.281 INFO:teuthology.orchestra.run.smithi119.stdout: "default_placement": "", 2024-09-12T17:53:31.281 INFO:teuthology.orchestra.run.smithi119.stdout: "default_storage_class": "", 2024-09-12T17:53:31.281 INFO:teuthology.orchestra.run.smithi119.stdout: "placement_tags": [], 2024-09-12T17:53:31.281 INFO:teuthology.orchestra.run.smithi119.stdout: "bucket_quota": { 2024-09-12T17:53:31.281 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:31.281 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:31.281 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:31.281 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:31.281 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:31.281 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:31.282 INFO:teuthology.orchestra.run.smithi119.stdout: "user_quota": { 2024-09-12T17:53:31.282 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:31.282 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:31.282 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:31.282 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:31.282 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:31.282 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:31.282 INFO:teuthology.orchestra.run.smithi119.stdout: "temp_url_keys": [], 2024-09-12T17:53:31.282 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "rgw", 2024-09-12T17:53:31.282 INFO:teuthology.orchestra.run.smithi119.stdout: "mfa_ids": [ 2024-09-12T17:53:31.282 INFO:teuthology.orchestra.run.smithi119.stdout: "9366613007" 2024-09-12T17:53:31.282 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-12T17:53:31.282 INFO:teuthology.orchestra.run.smithi119.stdout: "account_id": "", 2024-09-12T17:53:31.282 INFO:teuthology.orchestra.run.smithi119.stdout: "path": "/", 2024-09-12T17:53:31.283 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:53:30.214956Z", 2024-09-12T17:53:31.283 INFO:teuthology.orchestra.run.smithi119.stdout: "tags": [], 2024-09-12T17:53:31.283 INFO:teuthology.orchestra.run.smithi119.stdout: "group_ids": [] 2024-09-12T17:53:31.283 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T17:53:31.283 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:31.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.279+0000 7f3bedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:31.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.283+0000 7f3d391e39c0 20 remove_watcher() i=0 2024-09-12T17:53:31.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.283+0000 7f3d391e39c0 2 removed watcher, disabling cache 2024-09-12T17:53:31.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.287+0000 7f3d391e39c0 20 remove_watcher() i=1 2024-09-12T17:53:31.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.287+0000 7f3d391e39c0 20 remove_watcher() i=2 2024-09-12T17:53:31.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.291+0000 7f3d391e39c0 20 remove_watcher() i=3 2024-09-12T17:53:31.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.291+0000 7f3d391e39c0 20 remove_watcher() i=4 2024-09-12T17:53:31.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.295+0000 7f3d391e39c0 20 remove_watcher() i=5 2024-09-12T17:53:31.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.295+0000 7f3d391e39c0 20 remove_watcher() i=6 2024-09-12T17:53:31.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.299+0000 7f3d391e39c0 20 remove_watcher() i=7 2024-09-12T17:53:31.317 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T17:53:31.398 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:31.398 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:31.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.439+0000 7f67a15569c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.443+0000 7f67a15569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:31.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.443+0000 7f67a15569c0 20 realm 2024-09-12T17:53:31.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.443+0000 7f67a15569c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.443+0000 7f67a15569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:31.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.443+0000 7f67a15569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:31.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.443+0000 7f67a15569c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.443+0000 7f67a15569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:31.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.443+0000 7f67a15569c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.443+0000 7f67a15569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:31.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.443+0000 7f67a15569c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.447+0000 7f67a15569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:31.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.447+0000 7f67a15569c0 20 searching for the correct realm 2024-09-12T17:53:31.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.451+0000 7f679f85d640 0 -- 172.21.15.119:0/1718901665 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f6788008050 msgr2=0x7f6788038410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:31.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.459+0000 7f679e85b640 0 -- 172.21.15.119:0/1718901665 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f67980b9b00 msgr2=0x7f67980e3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:31.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:31.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:31.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:31.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:31.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:31.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:31.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:31.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:31.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 zone default found 2024-09-12T17:53:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 4 Realm: () 2024-09-12T17:53:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 zonegroup default 2024-09-12T17:53:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.679+0000 7f67a15569c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.683+0000 7f67a15569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:31.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.683+0000 7f67a15569c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.683+0000 7f67a15569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:31.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.683+0000 7f67a15569c0 20 started sync module instance, tier type = 2024-09-12T17:53:31.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.683+0000 7f67a15569c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:31.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.707+0000 7f67a15569c0 20 add_watcher() i=0 2024-09-12T17:53:31.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.707+0000 7f67a15569c0 20 add_watcher() i=1 2024-09-12T17:53:31.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.707+0000 7f67a15569c0 20 add_watcher() i=2 2024-09-12T17:53:31.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.707+0000 7f67a15569c0 20 add_watcher() i=3 2024-09-12T17:53:31.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.707+0000 7f67a15569c0 20 add_watcher() i=4 2024-09-12T17:53:31.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.707+0000 7f67a15569c0 20 add_watcher() i=5 2024-09-12T17:53:31.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.707+0000 7f67a15569c0 20 add_watcher() i=6 2024-09-12T17:53:31.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.711+0000 7f67a15569c0 20 add_watcher() i=7 2024-09-12T17:53:31.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.711+0000 7f67a15569c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:31.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f6655fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:31.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:31.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:31.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 5 note: GC not initialized 2024-09-12T17:53:31.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f6654fe1640 20 reqs_thread_entry: start 2024-09-12T17:53:31.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 20 Filter name: none 2024-09-12T17:53:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f65ce7fc640 20 reqs_thread_entry: start 2024-09-12T17:53:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T17:53:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T17:53:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:53:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T17:53:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T17:53:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T17:53:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:53:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.715+0000 7f67a15569c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T17:53:31.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.719+0000 7f67a15569c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:53:31.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.719+0000 7f67a15569c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:53:31.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.719+0000 7f67a15569c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T17:53:31.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.719+0000 7f6682ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235483 cookie 93870574554896 notifier 9246 bl.length()=384 2024-09-12T17:53:31.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.719+0000 7f6682ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:53:31.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.719+0000 7f6682ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:53:31.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.727+0000 7f67a15569c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T17:53:31.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.727+0000 7f67a15569c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:53:31.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.727+0000 7f67a15569c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T17:53:31.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.727+0000 7f6682ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235527 cookie 93870574561504 notifier 9246 bl.length()=225 2024-09-12T17:53:31.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.727+0000 7f6682ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T17:53:31.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.727+0000 7f6682ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:53:31.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.731+0000 7f67a15569c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T17:53:31.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.731+0000 7f67a15569c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:53:31.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.731+0000 7f67a15569c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T17:53:31.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.735+0000 7f66827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235456 cookie 93870574556800 notifier 9246 bl.length()=234 2024-09-12T17:53:31.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.735+0000 7f66827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T17:53:31.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.735+0000 7f66827fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:53:31.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.739+0000 7f6655fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:31.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.743+0000 7f67a15569c0 20 remove_watcher() i=0 2024-09-12T17:53:31.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.743+0000 7f67a15569c0 2 removed watcher, disabling cache 2024-09-12T17:53:31.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.743+0000 7f67a15569c0 20 remove_watcher() i=1 2024-09-12T17:53:31.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.747+0000 7f67a15569c0 20 remove_watcher() i=2 2024-09-12T17:53:31.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.751+0000 7f67a15569c0 20 remove_watcher() i=3 2024-09-12T17:53:31.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.751+0000 7f67a15569c0 20 remove_watcher() i=4 2024-09-12T17:53:31.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.755+0000 7f67a15569c0 20 remove_watcher() i=5 2024-09-12T17:53:31.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.755+0000 7f67a15569c0 20 remove_watcher() i=6 2024-09-12T17:53:31.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.759+0000 7f67a15569c0 20 remove_watcher() i=7 2024-09-12T17:53:31.774 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T17:53:31.775 INFO:teuthology.orchestra.run.smithi119.stdout: "id": "RGW88888888888888888", 2024-09-12T17:53:31.775 INFO:teuthology.orchestra.run.smithi119.stdout: "tenant": "", 2024-09-12T17:53:31.775 INFO:teuthology.orchestra.run.smithi119.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T17:53:31.775 INFO:teuthology.orchestra.run.smithi119.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T17:53:31.775 INFO:teuthology.orchestra.run.smithi119.stdout: "quota": { 2024-09-12T17:53:31.775 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:31.775 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:31.775 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:31.775 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:31.775 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:31.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:31.775 INFO:teuthology.orchestra.run.smithi119.stdout: "bucket_quota": { 2024-09-12T17:53:31.776 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:31.776 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:31.776 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:31.776 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:31.776 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:31.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:31.776 INFO:teuthology.orchestra.run.smithi119.stdout: "max_users": 1000, 2024-09-12T17:53:31.776 INFO:teuthology.orchestra.run.smithi119.stdout: "max_roles": 1000, 2024-09-12T17:53:31.776 INFO:teuthology.orchestra.run.smithi119.stdout: "max_groups": 1000, 2024-09-12T17:53:31.776 INFO:teuthology.orchestra.run.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:53:31.776 INFO:teuthology.orchestra.run.smithi119.stdout: "max_access_keys": 4 2024-09-12T17:53:31.776 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T17:53:31.778 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T17:53:31.778 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key JDESDVBIEZIACHAYMAWX --secret 2jticEfTt0BvG8yyvBHgnhrx6DbgjW/SxHy57dQDu+g8jpUw0uipnQ== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T17:53:31.867 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:31.867 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:31.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.907+0000 7f6df837c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.911+0000 7f6df837c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:31.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.911+0000 7f6df837c9c0 20 realm 2024-09-12T17:53:31.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.911+0000 7f6df837c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.911+0000 7f6df837c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:31.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.911+0000 7f6df837c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:31.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.911+0000 7f6df837c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.911+0000 7f6df837c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:31.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.911+0000 7f6df837c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.911+0000 7f6df837c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:31.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.911+0000 7f6df837c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:31.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.915+0000 7f6df837c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:31.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.915+0000 7f6df837c9c0 20 searching for the correct realm 2024-09-12T17:53:31.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.915+0000 7f6df6683640 0 -- 172.21.15.119:0/2104568772 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f6dec069050 msgr2=0x7f6dec081400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:31.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:31.923+0000 7f6df5681640 0 -- 172.21.15.119:0/2104568772 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f6df00303d0 msgr2=0x7f6df0030850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:32.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.139+0000 7f6df837c9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:32.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.139+0000 7f6df837c9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:32.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.139+0000 7f6df837c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:32.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.139+0000 7f6df837c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:32.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.139+0000 7f6df837c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:32.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.139+0000 7f6df837c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:32.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.139+0000 7f6df837c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.143+0000 7f6df837c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.143+0000 7f6df837c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.143+0000 7f6df837c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:32.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.143+0000 7f6df837c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.143+0000 7f6df837c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:32.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.143+0000 7f6df837c9c0 20 zone default found 2024-09-12T17:53:32.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.143+0000 7f6df837c9c0 4 Realm: () 2024-09-12T17:53:32.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.143+0000 7f6df837c9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:32.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.143+0000 7f6df837c9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:32.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.143+0000 7f6df837c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:32.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.143+0000 7f6df837c9c0 20 zonegroup default 2024-09-12T17:53:32.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.143+0000 7f6df837c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.143+0000 7f6df837c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.143+0000 7f6df837c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.143+0000 7f6df837c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.143+0000 7f6df837c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.147+0000 7f6df837c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.147+0000 7f6df837c9c0 20 started sync module instance, tier type = 2024-09-12T17:53:32.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.147+0000 7f6df837c9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:32.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.171+0000 7f6df837c9c0 20 add_watcher() i=0 2024-09-12T17:53:32.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.171+0000 7f6df837c9c0 20 add_watcher() i=1 2024-09-12T17:53:32.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.171+0000 7f6df837c9c0 20 add_watcher() i=2 2024-09-12T17:53:32.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.171+0000 7f6df837c9c0 20 add_watcher() i=3 2024-09-12T17:53:32.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.171+0000 7f6df837c9c0 20 add_watcher() i=4 2024-09-12T17:53:32.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.171+0000 7f6df837c9c0 20 add_watcher() i=5 2024-09-12T17:53:32.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.171+0000 7f6df837c9c0 20 add_watcher() i=6 2024-09-12T17:53:32.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.175+0000 7f6df837c9c0 20 add_watcher() i=7 2024-09-12T17:53:32.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.175+0000 7f6df837c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:32.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.175+0000 7f6cabfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:32.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:32.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:32.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 5 note: GC not initialized 2024-09-12T17:53:32.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6caafe5640 20 reqs_thread_entry: start 2024-09-12T17:53:32.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:32.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 20 Filter name: none 2024-09-12T17:53:32.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6ca8fe1640 20 reqs_thread_entry: start 2024-09-12T17:53:32.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T17:53:32.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T17:53:32.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:53:32.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T17:53:32.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T17:53:32.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:53:32.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 10 cache get: name=default.rgw.meta+users.keys+JDESDVBIEZIACHAYMAWX : miss 2024-09-12T17:53:32.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 10 cache put: name=default.rgw.meta+users.keys+JDESDVBIEZIACHAYMAWX info.flags=0x0 2024-09-12T17:53:32.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 10 adding default.rgw.meta+users.keys+JDESDVBIEZIACHAYMAWX to cache LRU end 2024-09-12T17:53:32.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T17:53:32.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.179+0000 7f6df837c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.183+0000 7f6df837c9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:53:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.183+0000 7f6df837c9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:53:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.183+0000 7f6df837c9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:53:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.183+0000 7f6df837c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:32.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.183+0000 7f6df837c9c0 10 cache get: name=default.rgw.meta+users.keys+JDESDVBIEZIACHAYMAWX : hit (negative entry) 2024-09-12T17:53:32.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.183+0000 7f6df837c9c0 10 cache get: name=default.rgw.meta+users.keys+JDESDVBIEZIACHAYMAWX : hit (negative entry) 2024-09-12T17:53:32.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.187+0000 7f6df837c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:53:32.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.187+0000 7f6df837c9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:53:32.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.187+0000 7f6df837c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T17:53:32.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.187+0000 7f6cd97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235484 cookie 94691240327200 notifier 8687 bl.length()=681 2024-09-12T17:53:32.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.187+0000 7f6cd97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:53:32.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.187+0000 7f6cd97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:53:32.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.191+0000 7f6df837c9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T17:53:32.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.191+0000 7f6df837c9c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:53:32.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.191+0000 7f6df837c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T17:53:32.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.191+0000 7f6cd97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235504 cookie 94691240352608 notifier 8687 bl.length()=189 2024-09-12T17:53:32.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.191+0000 7f6cd97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T17:53:32.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.191+0000 7f6cd97fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:53:32.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.199+0000 7f6df837c9c0 10 cache put: name=default.rgw.meta+users.keys+JDESDVBIEZIACHAYMAWX info.flags=0x7 2024-09-12T17:53:32.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.199+0000 7f6df837c9c0 10 moving default.rgw.meta+users.keys+JDESDVBIEZIACHAYMAWX to cache LRU end 2024-09-12T17:53:32.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.199+0000 7f6df837c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:JDESDVBIEZIACHAYMAWX, ofs0, ns] 2024-09-12T17:53:32.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.199+0000 7f6cd8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235505 cookie 94691240352608 notifier 8687 bl.length()=188 2024-09-12T17:53:32.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.199+0000 7f6cd8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JDESDVBIEZIACHAYMAWX info.flags=0x7 2024-09-12T17:53:32.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.199+0000 7f6cd8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JDESDVBIEZIACHAYMAWX to cache LRU end 2024-09-12T17:53:32.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.203+0000 7f6df837c9c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T17:53:32.204 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T17:53:32.204 INFO:teuthology.orchestra.run.smithi119.stdout: "user_id": "root1.client.0", 2024-09-12T17:53:32.204 INFO:teuthology.orchestra.run.smithi119.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T17:53:32.204 INFO:teuthology.orchestra.run.smithi119.stdout: "email": "root1+test@test.test", 2024-09-12T17:53:32.204 INFO:teuthology.orchestra.run.smithi119.stdout: "suspended": 0, 2024-09-12T17:53:32.204 INFO:teuthology.orchestra.run.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:53:32.204 INFO:teuthology.orchestra.run.smithi119.stdout: "subusers": [], 2024-09-12T17:53:32.204 INFO:teuthology.orchestra.run.smithi119.stdout: "keys": [ 2024-09-12T17:53:32.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T17:53:32.204 INFO:teuthology.orchestra.run.smithi119.stdout: "user": "root1.client.0", 2024-09-12T17:53:32.204 INFO:teuthology.orchestra.run.smithi119.stdout: "access_key": "JDESDVBIEZIACHAYMAWX", 2024-09-12T17:53:32.205 INFO:teuthology.orchestra.run.smithi119.stdout: "secret_key": "2jticEfTt0BvG8yyvBHgnhrx6DbgjW/SxHy57dQDu+g8jpUw0uipnQ==", 2024-09-12T17:53:32.205 INFO:teuthology.orchestra.run.smithi119.stdout: "active": true, 2024-09-12T17:53:32.205 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:53:32.186579Z" 2024-09-12T17:53:32.205 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T17:53:32.205 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-12T17:53:32.205 INFO:teuthology.orchestra.run.smithi119.stdout: "swift_keys": [], 2024-09-12T17:53:32.205 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": [], 2024-09-12T17:53:32.205 INFO:teuthology.orchestra.run.smithi119.stdout: "op_mask": "read, write, delete", 2024-09-12T17:53:32.205 INFO:teuthology.orchestra.run.smithi119.stdout: "default_placement": "", 2024-09-12T17:53:32.205 INFO:teuthology.orchestra.run.smithi119.stdout: "default_storage_class": "", 2024-09-12T17:53:32.205 INFO:teuthology.orchestra.run.smithi119.stdout: "placement_tags": [], 2024-09-12T17:53:32.205 INFO:teuthology.orchestra.run.smithi119.stdout: "bucket_quota": { 2024-09-12T17:53:32.205 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:32.206 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:32.206 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:32.206 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:32.206 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:32.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:32.206 INFO:teuthology.orchestra.run.smithi119.stdout: "user_quota": { 2024-09-12T17:53:32.206 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:32.206 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:32.206 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:32.206 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:32.206 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:32.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:32.206 INFO:teuthology.orchestra.run.smithi119.stdout: "temp_url_keys": [], 2024-09-12T17:53:32.206 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "root", 2024-09-12T17:53:32.206 INFO:teuthology.orchestra.run.smithi119.stdout: "mfa_ids": [], 2024-09-12T17:53:32.207 INFO:teuthology.orchestra.run.smithi119.stdout: "account_id": "RGW88888888888888888", 2024-09-12T17:53:32.207 INFO:teuthology.orchestra.run.smithi119.stdout: "path": "/", 2024-09-12T17:53:32.207 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:53:32.186539Z", 2024-09-12T17:53:32.207 INFO:teuthology.orchestra.run.smithi119.stdout: "tags": [], 2024-09-12T17:53:32.207 INFO:teuthology.orchestra.run.smithi119.stdout: "group_ids": [] 2024-09-12T17:53:32.207 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T17:53:32.207 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.203+0000 7f6cabfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.207+0000 7f6df837c9c0 20 remove_watcher() i=0 2024-09-12T17:53:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.211+0000 7f6df837c9c0 2 removed watcher, disabling cache 2024-09-12T17:53:32.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.211+0000 7f6df837c9c0 20 remove_watcher() i=1 2024-09-12T17:53:32.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.215+0000 7f6df837c9c0 20 remove_watcher() i=2 2024-09-12T17:53:32.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.215+0000 7f6df837c9c0 20 remove_watcher() i=3 2024-09-12T17:53:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.219+0000 7f6df837c9c0 20 remove_watcher() i=4 2024-09-12T17:53:32.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.219+0000 7f6df837c9c0 20 remove_watcher() i=5 2024-09-12T17:53:32.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.223+0000 7f6df837c9c0 20 remove_watcher() i=6 2024-09-12T17:53:32.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.223+0000 7f6df837c9c0 20 remove_watcher() i=7 2024-09-12T17:53:32.241 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 9849411688 --totp-seed KHUYXIM3VM2WBQG5XWUHHBZQGGSQY4CSQT5XUGEMWT3VTRNQBYOTC4Y2QA7KFJEW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:53:32.285 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:32.285 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:32.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.327+0000 7f3f7b0cf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.327+0000 7f3f7b0cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.327+0000 7f3f7b0cf9c0 20 realm 2024-09-12T17:53:32.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.327+0000 7f3f7b0cf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.327+0000 7f3f7b0cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.327+0000 7f3f7b0cf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:32.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.327+0000 7f3f7b0cf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.327+0000 7f3f7b0cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.327+0000 7f3f7b0cf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.331+0000 7f3f7b0cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:32.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.331+0000 7f3f7b0cf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.331+0000 7f3f7b0cf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:32.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.331+0000 7f3f7b0cf9c0 20 searching for the correct realm 2024-09-12T17:53:32.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.335+0000 7f3f793d6640 0 -- 172.21.15.119:0/345431363 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f3f60043040 msgr2=0x7f3f60042410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:32.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.343+0000 7f3f783d4640 0 -- 172.21.15.119:0/345431363 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f3f700f3cf0 msgr2=0x7f3f701240d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:32.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.559+0000 7f3f7b0cf9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:32.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.559+0000 7f3f7b0cf9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:32.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.559+0000 7f3f7b0cf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:32.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.559+0000 7f3f7b0cf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:32.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.559+0000 7f3f7b0cf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:32.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.559+0000 7f3f7b0cf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:32.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.559+0000 7f3f7b0cf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.563+0000 7f3f7b0cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.563+0000 7f3f7b0cf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.563+0000 7f3f7b0cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:32.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.563+0000 7f3f7b0cf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.563+0000 7f3f7b0cf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:32.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.563+0000 7f3f7b0cf9c0 20 zone default found 2024-09-12T17:53:32.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.563+0000 7f3f7b0cf9c0 4 Realm: () 2024-09-12T17:53:32.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.563+0000 7f3f7b0cf9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:32.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.563+0000 7f3f7b0cf9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:32.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.563+0000 7f3f7b0cf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:32.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.563+0000 7f3f7b0cf9c0 20 zonegroup default 2024-09-12T17:53:32.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.563+0000 7f3f7b0cf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.563+0000 7f3f7b0cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.563+0000 7f3f7b0cf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.563+0000 7f3f7b0cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.563+0000 7f3f7b0cf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.567+0000 7f3f7b0cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.567+0000 7f3f7b0cf9c0 20 started sync module instance, tier type = 2024-09-12T17:53:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.567+0000 7f3f7b0cf9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:32.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.591+0000 7f3f7b0cf9c0 20 add_watcher() i=0 2024-09-12T17:53:32.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.591+0000 7f3f7b0cf9c0 20 add_watcher() i=1 2024-09-12T17:53:32.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.591+0000 7f3f7b0cf9c0 20 add_watcher() i=2 2024-09-12T17:53:32.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.591+0000 7f3f7b0cf9c0 20 add_watcher() i=3 2024-09-12T17:53:32.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.591+0000 7f3f7b0cf9c0 20 add_watcher() i=4 2024-09-12T17:53:32.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.591+0000 7f3f7b0cf9c0 20 add_watcher() i=5 2024-09-12T17:53:32.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.591+0000 7f3f7b0cf9c0 20 add_watcher() i=6 2024-09-12T17:53:32.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.591+0000 7f3f7b0cf9c0 20 add_watcher() i=7 2024-09-12T17:53:32.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.591+0000 7f3f7b0cf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:32.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.595+0000 7f3e2efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:32.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.595+0000 7f3f7b0cf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:32.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.595+0000 7f3f7b0cf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:32.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.599+0000 7f3f7b0cf9c0 5 note: GC not initialized 2024-09-12T17:53:32.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.599+0000 7f3e2dfe3640 20 reqs_thread_entry: start 2024-09-12T17:53:32.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.599+0000 7f3f7b0cf9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:32.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.599+0000 7f3f7b0cf9c0 20 Filter name: none 2024-09-12T17:53:32.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.599+0000 7f3d9f7fe640 20 reqs_thread_entry: start 2024-09-12T17:53:32.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.599+0000 7f3f7b0cf9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T17:53:32.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.599+0000 7f3f7b0cf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.599+0000 7f3f7b0cf9c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T17:53:32.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.599+0000 7f3f7b0cf9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T17:53:32.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.599+0000 7f3f7b0cf9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:53:32.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.599+0000 7f3f7b0cf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:32.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.603+0000 7f3f7b0cf9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:53:32.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.603+0000 7f3f7b0cf9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:53:32.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.603+0000 7f3f7b0cf9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T17:53:32.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.603+0000 7f3e4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235485 cookie 94034956975296 notifier 9282 bl.length()=695 2024-09-12T17:53:32.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.603+0000 7f3e4ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:53:32.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.603+0000 7f3e4ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:53:32.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.611+0000 7f3e2efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:32.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.615+0000 7f3f7b0cf9c0 20 remove_watcher() i=0 2024-09-12T17:53:32.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.615+0000 7f3f7b0cf9c0 2 removed watcher, disabling cache 2024-09-12T17:53:32.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.615+0000 7f3f7b0cf9c0 20 remove_watcher() i=1 2024-09-12T17:53:32.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.619+0000 7f3f7b0cf9c0 20 remove_watcher() i=2 2024-09-12T17:53:32.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.623+0000 7f3f7b0cf9c0 20 remove_watcher() i=3 2024-09-12T17:53:32.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.623+0000 7f3f7b0cf9c0 20 remove_watcher() i=4 2024-09-12T17:53:32.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.627+0000 7f3f7b0cf9c0 20 remove_watcher() i=5 2024-09-12T17:53:32.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.627+0000 7f3f7b0cf9c0 20 remove_watcher() i=6 2024-09-12T17:53:32.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.627+0000 7f3f7b0cf9c0 20 remove_watcher() i=7 2024-09-12T17:53:32.645 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T17:53:32.726 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:32.726 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:32.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.767+0000 7f19515889c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.771+0000 7f19515889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.771+0000 7f19515889c0 20 realm 2024-09-12T17:53:32.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.771+0000 7f19515889c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.771+0000 7f19515889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.771+0000 7f19515889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:32.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.771+0000 7f19515889c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.771+0000 7f19515889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:32.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.771+0000 7f19515889c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.771+0000 7f19515889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:32.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.771+0000 7f19515889c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:32.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.775+0000 7f19515889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:32.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.775+0000 7f19515889c0 20 searching for the correct realm 2024-09-12T17:53:32.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.775+0000 7f194f88f640 0 -- 172.21.15.119:0/629527462 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x559b598ba170 msgr2=0x559b598bc580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:32.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:32.783+0000 7f194e88d640 0 -- 172.21.15.119:0/629527462 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f19480d2be0 msgr2=0x7f1948132270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:33.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:33.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:33.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:33.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:33.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:33.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:33.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:33.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:33.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 zone default found 2024-09-12T17:53:33.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 4 Realm: () 2024-09-12T17:53:33.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:33.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:33.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:33.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 zonegroup default 2024-09-12T17:53:33.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.003+0000 7f19515889c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.007+0000 7f19515889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.007+0000 7f19515889c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.007+0000 7f19515889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.007+0000 7f19515889c0 20 started sync module instance, tier type = 2024-09-12T17:53:33.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.007+0000 7f19515889c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:33.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.031+0000 7f19515889c0 20 add_watcher() i=0 2024-09-12T17:53:33.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.031+0000 7f19515889c0 20 add_watcher() i=1 2024-09-12T17:53:33.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.031+0000 7f19515889c0 20 add_watcher() i=2 2024-09-12T17:53:33.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.031+0000 7f19515889c0 20 add_watcher() i=3 2024-09-12T17:53:33.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.031+0000 7f19515889c0 20 add_watcher() i=4 2024-09-12T17:53:33.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.031+0000 7f19515889c0 20 add_watcher() i=5 2024-09-12T17:53:33.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.031+0000 7f19515889c0 20 add_watcher() i=6 2024-09-12T17:53:33.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.035+0000 7f19515889c0 20 add_watcher() i=7 2024-09-12T17:53:33.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.035+0000 7f19515889c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:33.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f18067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:33.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:33.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:33.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 5 note: GC not initialized 2024-09-12T17:53:33.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f18057e2640 20 reqs_thread_entry: start 2024-09-12T17:53:33.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:33.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 20 Filter name: none 2024-09-12T17:53:33.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f17fe7fc640 20 reqs_thread_entry: start 2024-09-12T17:53:33.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T17:53:33.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T17:53:33.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:53:33.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T17:53:33.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T17:53:33.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T17:53:33.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:53:33.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.039+0000 7f19515889c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T17:53:33.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.043+0000 7f19515889c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:53:33.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.043+0000 7f19515889c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:53:33.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.043+0000 7f19515889c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T17:53:33.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.047+0000 7f1832ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235486 cookie 94125710619488 notifier 9300 bl.length()=384 2024-09-12T17:53:33.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.047+0000 7f1832ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:53:33.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.047+0000 7f1832ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:53:33.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.051+0000 7f19515889c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T17:53:33.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.051+0000 7f19515889c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:53:33.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.051+0000 7f19515889c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T17:53:33.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.051+0000 7f1832ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235528 cookie 94125710649536 notifier 9300 bl.length()=225 2024-09-12T17:53:33.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.051+0000 7f1832ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T17:53:33.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.051+0000 7f1832ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:53:33.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.055+0000 7f19515889c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T17:53:33.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.055+0000 7f19515889c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:53:33.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.055+0000 7f19515889c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T17:53:33.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.059+0000 7f1832ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235457 cookie 94125710654512 notifier 9300 bl.length()=234 2024-09-12T17:53:33.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.059+0000 7f1832ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T17:53:33.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.059+0000 7f1832ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:53:33.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.059+0000 7f18067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:33.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.067+0000 7f19515889c0 20 remove_watcher() i=0 2024-09-12T17:53:33.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.067+0000 7f19515889c0 2 removed watcher, disabling cache 2024-09-12T17:53:33.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.067+0000 7f19515889c0 20 remove_watcher() i=1 2024-09-12T17:53:33.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.071+0000 7f19515889c0 20 remove_watcher() i=2 2024-09-12T17:53:33.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.075+0000 7f19515889c0 20 remove_watcher() i=3 2024-09-12T17:53:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.079+0000 7f19515889c0 20 remove_watcher() i=4 2024-09-12T17:53:33.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.079+0000 7f19515889c0 20 remove_watcher() i=5 2024-09-12T17:53:33.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.083+0000 7f19515889c0 20 remove_watcher() i=6 2024-09-12T17:53:33.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.083+0000 7f19515889c0 20 remove_watcher() i=7 2024-09-12T17:53:33.100 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T17:53:33.100 INFO:teuthology.orchestra.run.smithi119.stdout: "id": "RGW99999999999999999", 2024-09-12T17:53:33.100 INFO:teuthology.orchestra.run.smithi119.stdout: "tenant": "", 2024-09-12T17:53:33.100 INFO:teuthology.orchestra.run.smithi119.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T17:53:33.100 INFO:teuthology.orchestra.run.smithi119.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T17:53:33.100 INFO:teuthology.orchestra.run.smithi119.stdout: "quota": { 2024-09-12T17:53:33.100 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:33.100 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:33.100 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:33.101 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:33.101 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:33.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:33.101 INFO:teuthology.orchestra.run.smithi119.stdout: "bucket_quota": { 2024-09-12T17:53:33.101 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:33.101 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:33.101 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:33.101 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:33.101 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:33.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:33.101 INFO:teuthology.orchestra.run.smithi119.stdout: "max_users": 1000, 2024-09-12T17:53:33.101 INFO:teuthology.orchestra.run.smithi119.stdout: "max_roles": 1000, 2024-09-12T17:53:33.101 INFO:teuthology.orchestra.run.smithi119.stdout: "max_groups": 1000, 2024-09-12T17:53:33.102 INFO:teuthology.orchestra.run.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:53:33.102 INFO:teuthology.orchestra.run.smithi119.stdout: "max_access_keys": 4 2024-09-12T17:53:33.102 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T17:53:33.103 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T17:53:33.103 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key CXEIUILQBKOXSGJNSMZZ --secret 3Rvc5QAq8sLi+8MXmzQYUJyKM5lZYRRNTj3P6t5RVKHbnWDHfxOpSg== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T17:53:33.193 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:33.194 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:33.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.239+0000 7f56f1bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.239+0000 7f56f1bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.239+0000 7f56f1bd09c0 20 realm 2024-09-12T17:53:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.239+0000 7f56f1bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.239+0000 7f56f1bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.239+0000 7f56f1bd09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.239+0000 7f56f1bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.239+0000 7f56f1bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.239+0000 7f56f1bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.243+0000 7f56f1bd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:33.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.243+0000 7f56f1bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.243+0000 7f56f1bd09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:33.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.243+0000 7f56f1bd09c0 20 searching for the correct realm 2024-09-12T17:53:33.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.247+0000 7f56efed7640 0 -- 172.21.15.119:0/3666106070 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f56e40aa3d0 msgr2=0x7f56e40aa7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:33.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.255+0000 7f56eeed5640 0 -- 172.21.15.119:0/3666106070 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f56e8090350 msgr2=0x7f56e80a3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:33.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.471+0000 7f56f1bd09c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:33.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.471+0000 7f56f1bd09c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:33.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.471+0000 7f56f1bd09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:33.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.471+0000 7f56f1bd09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:33.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.471+0000 7f56f1bd09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:33.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.471+0000 7f56f1bd09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:33.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.471+0000 7f56f1bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.471+0000 7f56f1bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.471+0000 7f56f1bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:33.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:33.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 20 zone default found 2024-09-12T17:53:33.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 4 Realm: () 2024-09-12T17:53:33.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:33.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:33.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:33.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 20 zonegroup default 2024-09-12T17:53:33.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 20 started sync module instance, tier type = 2024-09-12T17:53:33.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.475+0000 7f56f1bd09c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:33.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.503+0000 7f56f1bd09c0 20 add_watcher() i=0 2024-09-12T17:53:33.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.503+0000 7f56f1bd09c0 20 add_watcher() i=1 2024-09-12T17:53:33.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.503+0000 7f56f1bd09c0 20 add_watcher() i=2 2024-09-12T17:53:33.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.503+0000 7f56f1bd09c0 20 add_watcher() i=3 2024-09-12T17:53:33.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.503+0000 7f56f1bd09c0 20 add_watcher() i=4 2024-09-12T17:53:33.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.503+0000 7f56f1bd09c0 20 add_watcher() i=5 2024-09-12T17:53:33.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.503+0000 7f56f1bd09c0 20 add_watcher() i=6 2024-09-12T17:53:33.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.507+0000 7f56f1bd09c0 20 add_watcher() i=7 2024-09-12T17:53:33.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.507+0000 7f56f1bd09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:33.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f55a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:33.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:33.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:33.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 5 note: GC not initialized 2024-09-12T17:53:33.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f55a4fe1640 20 reqs_thread_entry: start 2024-09-12T17:53:33.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:33.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 20 Filter name: none 2024-09-12T17:53:33.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f551e7fc640 20 reqs_thread_entry: start 2024-09-12T17:53:33.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T17:53:33.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T17:53:33.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:53:33.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T17:53:33.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T17:53:33.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:53:33.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 10 cache get: name=default.rgw.meta+users.keys+CXEIUILQBKOXSGJNSMZZ : miss 2024-09-12T17:53:33.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 10 cache put: name=default.rgw.meta+users.keys+CXEIUILQBKOXSGJNSMZZ info.flags=0x0 2024-09-12T17:53:33.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 10 adding default.rgw.meta+users.keys+CXEIUILQBKOXSGJNSMZZ to cache LRU end 2024-09-12T17:53:33.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T17:53:33.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.511+0000 7f56f1bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.515+0000 7f56f1bd09c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:53:33.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.515+0000 7f56f1bd09c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:53:33.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.515+0000 7f56f1bd09c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:53:33.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.515+0000 7f56f1bd09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:33.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.515+0000 7f56f1bd09c0 10 cache get: name=default.rgw.meta+users.keys+CXEIUILQBKOXSGJNSMZZ : hit (negative entry) 2024-09-12T17:53:33.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.515+0000 7f56f1bd09c0 10 cache get: name=default.rgw.meta+users.keys+CXEIUILQBKOXSGJNSMZZ : hit (negative entry) 2024-09-12T17:53:33.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.519+0000 7f56f1bd09c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:53:33.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.519+0000 7f56f1bd09c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:53:33.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.519+0000 7f56f1bd09c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T17:53:33.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.519+0000 7f55d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235487 cookie 94110080254544 notifier 8741 bl.length()=681 2024-09-12T17:53:33.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.519+0000 7f55d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:53:33.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.519+0000 7f55d2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:53:33.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.523+0000 7f56f1bd09c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T17:53:33.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.523+0000 7f56f1bd09c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:53:33.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.523+0000 7f56f1bd09c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T17:53:33.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.523+0000 7f55d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235506 cookie 94110080271888 notifier 8741 bl.length()=189 2024-09-12T17:53:33.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.523+0000 7f55d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T17:53:33.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.523+0000 7f55d2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:53:33.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.527+0000 7f56f1bd09c0 10 cache put: name=default.rgw.meta+users.keys+CXEIUILQBKOXSGJNSMZZ info.flags=0x7 2024-09-12T17:53:33.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.527+0000 7f56f1bd09c0 10 moving default.rgw.meta+users.keys+CXEIUILQBKOXSGJNSMZZ to cache LRU end 2024-09-12T17:53:33.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.527+0000 7f56f1bd09c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:CXEIUILQBKOXSGJNSMZZ, ofs0, ns] 2024-09-12T17:53:33.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.527+0000 7f55d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235507 cookie 94110080271888 notifier 8741 bl.length()=188 2024-09-12T17:53:33.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.527+0000 7f55d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CXEIUILQBKOXSGJNSMZZ info.flags=0x7 2024-09-12T17:53:33.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.527+0000 7f55d27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CXEIUILQBKOXSGJNSMZZ to cache LRU end 2024-09-12T17:53:33.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.535+0000 7f56f1bd09c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T17:53:33.535 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T17:53:33.535 INFO:teuthology.orchestra.run.smithi119.stdout: "user_id": "root2.client.0", 2024-09-12T17:53:33.535 INFO:teuthology.orchestra.run.smithi119.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T17:53:33.535 INFO:teuthology.orchestra.run.smithi119.stdout: "email": "root2+test@test.test", 2024-09-12T17:53:33.535 INFO:teuthology.orchestra.run.smithi119.stdout: "suspended": 0, 2024-09-12T17:53:33.535 INFO:teuthology.orchestra.run.smithi119.stdout: "max_buckets": 1000, 2024-09-12T17:53:33.535 INFO:teuthology.orchestra.run.smithi119.stdout: "subusers": [], 2024-09-12T17:53:33.535 INFO:teuthology.orchestra.run.smithi119.stdout: "keys": [ 2024-09-12T17:53:33.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T17:53:33.535 INFO:teuthology.orchestra.run.smithi119.stdout: "user": "root2.client.0", 2024-09-12T17:53:33.535 INFO:teuthology.orchestra.run.smithi119.stdout: "access_key": "CXEIUILQBKOXSGJNSMZZ", 2024-09-12T17:53:33.535 INFO:teuthology.orchestra.run.smithi119.stdout: "secret_key": "3Rvc5QAq8sLi+8MXmzQYUJyKM5lZYRRNTj3P6t5RVKHbnWDHfxOpSg==", 2024-09-12T17:53:33.536 INFO:teuthology.orchestra.run.smithi119.stdout: "active": true, 2024-09-12T17:53:33.536 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:53:33.518625Z" 2024-09-12T17:53:33.536 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T17:53:33.536 INFO:teuthology.orchestra.run.smithi119.stdout: ], 2024-09-12T17:53:33.536 INFO:teuthology.orchestra.run.smithi119.stdout: "swift_keys": [], 2024-09-12T17:53:33.536 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": [], 2024-09-12T17:53:33.536 INFO:teuthology.orchestra.run.smithi119.stdout: "op_mask": "read, write, delete", 2024-09-12T17:53:33.536 INFO:teuthology.orchestra.run.smithi119.stdout: "default_placement": "", 2024-09-12T17:53:33.536 INFO:teuthology.orchestra.run.smithi119.stdout: "default_storage_class": "", 2024-09-12T17:53:33.536 INFO:teuthology.orchestra.run.smithi119.stdout: "placement_tags": [], 2024-09-12T17:53:33.536 INFO:teuthology.orchestra.run.smithi119.stdout: "bucket_quota": { 2024-09-12T17:53:33.536 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:33.536 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:33.536 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:33.537 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:33.537 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:33.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:33.537 INFO:teuthology.orchestra.run.smithi119.stdout: "user_quota": { 2024-09-12T17:53:33.537 INFO:teuthology.orchestra.run.smithi119.stdout: "enabled": false, 2024-09-12T17:53:33.537 INFO:teuthology.orchestra.run.smithi119.stdout: "check_on_raw": false, 2024-09-12T17:53:33.537 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size": -1, 2024-09-12T17:53:33.537 INFO:teuthology.orchestra.run.smithi119.stdout: "max_size_kb": 0, 2024-09-12T17:53:33.537 INFO:teuthology.orchestra.run.smithi119.stdout: "max_objects": -1 2024-09-12T17:53:33.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T17:53:33.537 INFO:teuthology.orchestra.run.smithi119.stdout: "temp_url_keys": [], 2024-09-12T17:53:33.538 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "root", 2024-09-12T17:53:33.538 INFO:teuthology.orchestra.run.smithi119.stdout: "mfa_ids": [], 2024-09-12T17:53:33.538 INFO:teuthology.orchestra.run.smithi119.stdout: "account_id": "RGW99999999999999999", 2024-09-12T17:53:33.538 INFO:teuthology.orchestra.run.smithi119.stdout: "path": "/", 2024-09-12T17:53:33.538 INFO:teuthology.orchestra.run.smithi119.stdout: "create_date": "2024-09-12T17:53:33.518578Z", 2024-09-12T17:53:33.538 INFO:teuthology.orchestra.run.smithi119.stdout: "tags": [], 2024-09-12T17:53:33.538 INFO:teuthology.orchestra.run.smithi119.stdout: "group_ids": [] 2024-09-12T17:53:33.538 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T17:53:33.538 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:53:33.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.535+0000 7f55a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:33.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.539+0000 7f56f1bd09c0 20 remove_watcher() i=0 2024-09-12T17:53:33.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.539+0000 7f56f1bd09c0 2 removed watcher, disabling cache 2024-09-12T17:53:33.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.543+0000 7f56f1bd09c0 20 remove_watcher() i=1 2024-09-12T17:53:33.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.547+0000 7f56f1bd09c0 20 remove_watcher() i=2 2024-09-12T17:53:33.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.547+0000 7f56f1bd09c0 20 remove_watcher() i=3 2024-09-12T17:53:33.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.551+0000 7f56f1bd09c0 20 remove_watcher() i=4 2024-09-12T17:53:33.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.551+0000 7f56f1bd09c0 20 remove_watcher() i=5 2024-09-12T17:53:33.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.551+0000 7f56f1bd09c0 20 remove_watcher() i=6 2024-09-12T17:53:33.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.555+0000 7f56f1bd09c0 20 remove_watcher() i=7 2024-09-12T17:53:33.571 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 0588153986 --totp-seed DPNJPR5YD45YHMTDR5CY6TLMIQL2Z3CVSYGTPUCD6PMJH37OBGW5VODX7CSJRBUF --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:53:33.613 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:33.613 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:33.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.655+0000 7faeb70509c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.655+0000 7faeb70509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.655+0000 7faeb70509c0 20 realm 2024-09-12T17:53:33.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.655+0000 7faeb70509c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.655+0000 7faeb70509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.655+0000 7faeb70509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:33.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.655+0000 7faeb70509c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.655+0000 7faeb70509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.655+0000 7faeb70509c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.659+0000 7faeb70509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:33.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.659+0000 7faeb70509c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.659+0000 7faeb70509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:33.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.659+0000 7faeb70509c0 20 searching for the correct realm 2024-09-12T17:53:33.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.663+0000 7faeb4355640 0 -- 172.21.15.119:0/3701881493 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7faea40b2910 msgr2=0x7faea40cd3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:33.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.671+0000 7faeb4355640 0 -- 172.21.15.119:0/3701881493 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7faeac008030 msgr2=0x7faeac073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:33.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.887+0000 7faeb70509c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T17:53:33.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.887+0000 7faeb70509c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T17:53:33.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.887+0000 7faeb70509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:33.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.887+0000 7faeb70509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:33.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.887+0000 7faeb70509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:33.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.887+0000 7faeb70509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:33.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.891+0000 7faeb70509c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.891+0000 7faeb70509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.891+0000 7faeb70509c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.891+0000 7faeb70509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:33.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.891+0000 7faeb70509c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.891+0000 7faeb70509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:33.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.891+0000 7faeb70509c0 20 zone default found 2024-09-12T17:53:33.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.891+0000 7faeb70509c0 4 Realm: () 2024-09-12T17:53:33.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.891+0000 7faeb70509c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T17:53:33.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.891+0000 7faeb70509c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T17:53:33.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.891+0000 7faeb70509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:33.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.891+0000 7faeb70509c0 20 zonegroup default 2024-09-12T17:53:33.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.891+0000 7faeb70509c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.891+0000 7faeb70509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.891+0000 7faeb70509c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.891+0000 7faeb70509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.895+0000 7faeb70509c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.895+0000 7faeb70509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:33.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.895+0000 7faeb70509c0 20 started sync module instance, tier type = 2024-09-12T17:53:33.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.895+0000 7faeb70509c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T17:53:33.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.923+0000 7faeb70509c0 20 add_watcher() i=0 2024-09-12T17:53:33.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.923+0000 7faeb70509c0 20 add_watcher() i=1 2024-09-12T17:53:33.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.923+0000 7faeb70509c0 20 add_watcher() i=2 2024-09-12T17:53:33.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.923+0000 7faeb70509c0 20 add_watcher() i=3 2024-09-12T17:53:33.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.923+0000 7faeb70509c0 20 add_watcher() i=4 2024-09-12T17:53:33.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.923+0000 7faeb70509c0 20 add_watcher() i=5 2024-09-12T17:53:33.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.923+0000 7faeb70509c0 20 add_watcher() i=6 2024-09-12T17:53:33.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.927+0000 7faeb70509c0 20 add_watcher() i=7 2024-09-12T17:53:33.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.927+0000 7faeb70509c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:33.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.931+0000 7fad6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:33.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.931+0000 7faeb70509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:33.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.931+0000 7faeb70509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:33.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.931+0000 7faeb70509c0 5 note: GC not initialized 2024-09-12T17:53:33.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.931+0000 7fad6a7e4640 20 reqs_thread_entry: start 2024-09-12T17:53:33.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.931+0000 7faeb70509c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:33.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.931+0000 7faeb70509c0 20 Filter name: none 2024-09-12T17:53:33.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.931+0000 7fad637fe640 20 reqs_thread_entry: start 2024-09-12T17:53:33.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.931+0000 7faeb70509c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T17:53:33.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.931+0000 7faeb70509c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:33.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.931+0000 7faeb70509c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T17:53:33.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.931+0000 7faeb70509c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T17:53:33.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.931+0000 7faeb70509c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:53:33.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.931+0000 7faeb70509c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:33.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.939+0000 7faeb70509c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:53:33.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.939+0000 7faeb70509c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:53:33.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.939+0000 7faeb70509c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T17:53:33.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.939+0000 7fad8bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235488 cookie 94507068773776 notifier 8756 bl.length()=695 2024-09-12T17:53:33.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.939+0000 7fad8bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:53:33.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.939+0000 7fad8bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:53:33.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.943+0000 7fad6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:33.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.951+0000 7faeb70509c0 20 remove_watcher() i=0 2024-09-12T17:53:33.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.951+0000 7faeb70509c0 2 removed watcher, disabling cache 2024-09-12T17:53:33.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.951+0000 7faeb70509c0 20 remove_watcher() i=1 2024-09-12T17:53:33.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.955+0000 7faeb70509c0 20 remove_watcher() i=2 2024-09-12T17:53:33.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.955+0000 7faeb70509c0 20 remove_watcher() i=3 2024-09-12T17:53:33.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.959+0000 7faeb70509c0 20 remove_watcher() i=4 2024-09-12T17:53:33.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.959+0000 7faeb70509c0 20 remove_watcher() i=5 2024-09-12T17:53:33.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.963+0000 7faeb70509c0 20 remove_watcher() i=6 2024-09-12T17:53:33.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T17:53:33.963+0000 7faeb70509c0 20 remove_watcher() i=7 2024-09-12T17:53:33.988 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T17:53:33.989 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:53:33.989 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T17:53:34.056 INFO:tasks.s3tests:Configuring boto... 2024-09-12T17:53:34.056 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T17:53:34.056 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T17:53:34.118 DEBUG:teuthology.orchestra.run.smithi119:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T17:53:34.299 INFO:teuthology.orchestra.run.smithi119.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T17:53:34.498 INFO:teuthology.orchestra.run.smithi119.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T17:53:34.797 INFO:teuthology.orchestra.run.smithi119.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:55:28.298 INFO:teuthology.orchestra.run.smithi119.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T17:55:30.185 INFO:teuthology.orchestra.run.smithi119.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=d9889c38bfbdac8c925ea2f0f5a5534cd6ad9a22ea0d2524a35f953e529c344c,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T17:55:30.186 INFO:teuthology.orchestra.run.smithi119.stdout:py run-test-pre: PYTHONHASHSEED='1782387061' 2024-09-12T17:55:30.186 INFO:teuthology.orchestra.run.smithi119.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T17:55:30.353 INFO:teuthology.orchestra.run.smithi119.stdout:============================= test session starts ============================== 2024-09-12T17:55:30.353 INFO:teuthology.orchestra.run.smithi119.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T17:55:30.353 INFO:teuthology.orchestra.run.smithi119.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:55:30.353 INFO:teuthology.orchestra.run.smithi119.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T17:55:30.353 INFO:teuthology.orchestra.run.smithi119.stdout:configfile: pytest.ini 2024-09-12T17:55:32.131 INFO:teuthology.orchestra.run.smithi119.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T17:55:32.131 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T17:55:33.071 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T17:55:33.813 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T17:55:34.678 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T17:55:35.493 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T17:55:36.220 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T17:55:37.064 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T17:55:38.057 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T17:55:38.744 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T17:55:38.906 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T17:55:39.065 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T17:55:39.812 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T17:55:40.544 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T17:55:41.267 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T17:55:42.054 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T17:55:42.227 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T17:55:42.396 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T17:55:42.511 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T17:55:42.623 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T17:55:42.733 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T17:55:42.845 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T17:55:42.955 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T17:55:43.066 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T17:55:43.179 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T17:55:43.291 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T17:55:43.400 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T17:55:43.513 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T17:55:43.624 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T17:55:43.736 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T17:55:43.848 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T17:55:43.960 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T17:55:44.070 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T17:55:44.187 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T17:55:44.300 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T17:55:44.412 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T17:55:44.526 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T17:55:44.637 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T17:55:44.749 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T17:55:44.860 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T17:55:44.972 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:55:45.083 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T17:55:45.196 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T17:55:45.308 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:55:45.418 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:55:45.529 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T17:55:45.643 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T17:55:45.752 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T17:55:45.863 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T17:55:45.974 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T17:55:46.084 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T17:55:46.197 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T17:55:46.308 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T17:55:46.419 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T17:55:46.533 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T17:55:47.872 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T17:55:53.798 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T17:56:00.700 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T17:56:09.687 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T17:56:22.112 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T17:56:26.264 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T17:56:31.156 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T17:56:32.731 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T17:56:33.420 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T17:56:34.367 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T17:56:35.327 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T17:56:36.940 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T17:56:37.948 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T17:56:38.644 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T17:56:38.647 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T17:56:38.649 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T17:56:38.651 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T17:56:38.653 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T17:56:38.655 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T17:56:38.658 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T17:56:38.660 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T17:56:38.662 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:56:38.664 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:56:38.666 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:56:38.669 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:56:38.671 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T17:56:38.673 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:56:38.675 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:56:38.677 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:56:38.679 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:56:38.681 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:56:38.683 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:56:38.685 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:56:38.687 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T17:56:38.689 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T17:56:38.691 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T17:56:38.692 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T17:56:38.694 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T17:56:38.696 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T17:56:38.698 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T17:56:38.699 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T17:56:38.804 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T17:56:38.813 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T17:56:40.209 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T17:56:47.825 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T17:56:48.892 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T17:56:50.190 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T17:56:51.508 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T17:56:52.824 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T17:56:54.136 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T17:56:55.149 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T17:56:56.541 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T17:56:57.759 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T17:56:58.943 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T17:56:59.982 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T17:57:00.969 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T17:57:01.956 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T17:57:02.331 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T17:57:03.428 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T17:57:04.680 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T17:57:06.004 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T17:57:07.016 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T17:57:08.087 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T17:57:09.104 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T17:57:10.111 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T17:57:11.174 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T17:57:12.133 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T17:57:13.100 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T17:57:13.497 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T17:57:13.918 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T17:57:14.309 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T17:57:14.704 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T17:57:15.101 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T17:57:16.031 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T17:57:16.460 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:57:16.935 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T17:57:17.736 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T17:57:18.440 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T17:57:18.895 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:57:19.612 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T17:57:20.334 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:57:21.426 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T17:57:22.048 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T17:57:22.786 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T17:57:23.516 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T17:57:24.857 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T17:57:26.382 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T17:57:27.680 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T17:57:29.200 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:57:30.922 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:57:33.343 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:57:35.761 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:57:37.625 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:57:39.384 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:57:40.724 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T17:57:42.350 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T17:57:43.200 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T17:57:45.549 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T17:57:46.976 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T17:57:48.747 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T17:57:52.456 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T17:57:57.326 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T17:58:00.045 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T17:58:02.550 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T17:58:04.389 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T17:58:05.524 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T17:58:07.773 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T17:58:09.254 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T17:58:11.391 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T17:58:12.777 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T17:58:15.546 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T17:58:18.034 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T17:58:21.047 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T17:58:24.063 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T17:58:26.105 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T17:58:28.018 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T17:58:29.454 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T17:58:33.180 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T17:58:35.943 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T17:58:39.005 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T17:58:41.876 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T17:58:44.592 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T17:58:47.331 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T17:58:49.665 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T17:58:51.191 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T17:58:53.001 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T17:58:56.425 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T17:59:00.916 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T17:59:02.712 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T17:59:05.471 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T17:59:08.212 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T17:59:10.911 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T17:59:13.842 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T17:59:17.001 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T17:59:19.969 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T17:59:22.704 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T17:59:24.505 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T17:59:25.875 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T17:59:27.232 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T17:59:28.646 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T17:59:31.526 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T17:59:34.507 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T17:59:37.428 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T17:59:40.313 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T17:59:43.272 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T17:59:46.149 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T17:59:49.090 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T17:59:51.991 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T17:59:54.885 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T17:59:57.775 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T18:00:00.714 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T18:00:03.611 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T18:00:05.475 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T18:00:07.380 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T18:00:09.196 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T18:00:11.029 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T18:00:12.383 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T18:00:14.295 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T18:00:15.967 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T18:00:17.652 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T18:00:19.377 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T18:00:21.049 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T18:00:22.824 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T18:00:24.511 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T18:00:26.149 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T18:00:28.695 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T18:00:31.167 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T18:00:32.490 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T18:00:33.820 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T18:00:35.490 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T18:00:37.148 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T18:00:39.653 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T18:00:42.126 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T18:00:43.887 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T18:00:45.518 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T18:00:47.151 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T18:00:48.864 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T18:00:50.491 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T18:00:52.139 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T18:00:53.873 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T18:00:55.540 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T18:00:57.214 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T18:00:58.931 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T18:01:00.590 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T18:01:02.273 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T18:01:03.863 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T18:01:05.376 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T18:01:06.940 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T18:01:08.660 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T18:01:10.531 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T18:03:21.386 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T18:03:22.907 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T18:03:24.507 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T18:03:26.047 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T18:03:27.610 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T18:03:29.168 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T18:03:30.777 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T18:03:32.289 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T18:03:33.817 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T18:03:35.406 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T18:03:36.919 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T18:03:38.442 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T18:03:40.013 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T18:03:41.685 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T18:03:43.339 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T18:03:45.032 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T18:03:46.695 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T18:03:48.336 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T18:03:50.044 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T18:03:51.759 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:03:53.415 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:03:55.136 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:03:56.792 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:03:58.583 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T18:04:00.453 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T18:04:02.095 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T18:04:03.791 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T18:04:05.498 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T18:04:07.184 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T18:04:07.665 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T18:04:08.933 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T18:04:13.911 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T18:04:18.902 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T18:04:20.565 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T18:04:22.211 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T18:04:23.871 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T18:04:25.597 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T18:04:27.379 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T18:04:29.198 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T18:04:30.899 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T18:04:32.571 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T18:04:34.229 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T18:04:35.904 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T18:04:37.552 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T18:04:39.285 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T18:04:41.374 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T18:04:44.061 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T18:04:45.255 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T18:04:46.389 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T18:04:47.411 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T18:04:48.421 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T18:04:48.841 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T18:04:49.313 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T18:04:49.748 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T18:04:51.093 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T18:04:55.190 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T18:04:55.656 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T18:04:56.884 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T18:04:57.861 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T18:04:58.901 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T18:04:59.986 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T18:05:04.864 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T18:05:06.779 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T18:05:08.631 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T18:07:19.883 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T18:09:30.892 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T18:09:32.148 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T18:09:33.394 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T18:09:34.646 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T18:09:35.958 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T18:09:37.499 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T18:09:38.810 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T18:09:40.078 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T18:09:41.557 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T18:09:42.882 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T18:09:44.228 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T18:09:45.597 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T18:09:47.059 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T18:09:48.281 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T18:09:49.363 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T18:09:50.545 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T18:09:51.700 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T18:09:53.335 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T18:09:54.619 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T18:09:55.814 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T18:09:57.009 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T18:09:58.298 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T18:09:59.722 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T18:10:00.717 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T18:10:01.819 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T18:10:02.854 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T18:10:03.917 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T18:10:04.941 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T18:10:05.972 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T18:10:07.246 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T18:10:08.276 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T18:10:09.341 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T18:10:10.371 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T18:10:11.419 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T18:10:13.068 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T18:10:14.141 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T18:10:15.196 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T18:10:16.235 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T18:10:17.294 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T18:10:18.336 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T18:10:19.450 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T18:10:20.530 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T18:10:22.831 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T18:10:23.909 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T18:10:25.199 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T18:10:26.512 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T18:10:27.774 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T18:10:29.137 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T18:10:30.508 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T18:10:32.881 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T18:10:34.231 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T18:10:35.525 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T18:10:37.069 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T18:10:38.633 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T18:10:40.200 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T18:10:41.422 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T18:10:43.007 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T18:10:44.628 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T18:10:45.936 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T18:10:47.503 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T18:10:48.736 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T18:10:49.874 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T18:10:50.961 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T18:10:52.218 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T18:10:53.303 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T18:10:53.715 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T18:10:55.572 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T18:10:56.773 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T18:10:58.013 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T18:11:02.264 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T18:11:03.513 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T18:11:04.826 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T18:11:06.104 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T18:11:07.367 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T18:11:08.614 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T18:11:09.996 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T18:11:11.537 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T18:11:13.123 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T18:11:14.626 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T18:11:15.906 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T18:11:17.106 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T18:11:18.379 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T18:11:19.709 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T18:11:21.189 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T18:11:22.480 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T18:11:23.755 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T18:11:25.013 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T18:11:25.434 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T18:11:25.853 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T18:11:26.270 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T18:11:27.258 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T18:11:28.249 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T18:11:29.224 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T18:11:30.239 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T18:11:31.335 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T18:11:31.758 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T18:11:32.191 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T18:11:33.171 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T18:11:33.593 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T18:11:34.011 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T18:11:34.432 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T18:11:34.912 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T18:11:36.050 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T18:11:37.122 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T18:11:38.184 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T18:11:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T18:11:40.385 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T18:11:41.428 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T18:11:42.499 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T18:11:43.730 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T18:11:44.859 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T18:11:45.920 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T18:11:47.230 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T18:11:48.576 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T18:11:50.109 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T18:11:51.398 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T18:11:52.703 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T18:11:54.166 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T18:11:55.692 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T18:11:57.271 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T18:11:58.789 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T18:11:59.957 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T18:12:01.448 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T18:12:02.968 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T18:12:04.457 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T18:12:06.023 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T18:12:07.549 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T18:12:09.274 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T18:12:10.851 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T18:12:12.371 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T18:12:13.987 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T18:12:15.549 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T18:12:16.688 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T18:12:18.016 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T18:12:19.447 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T18:12:20.720 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T18:12:21.843 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T18:12:23.382 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T18:12:25.414 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T18:12:27.416 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T18:12:29.456 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T18:12:31.473 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T18:12:33.464 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T18:12:35.515 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T18:12:37.565 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T18:12:39.786 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T18:12:41.791 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T18:12:43.987 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T18:12:46.209 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T18:12:48.409 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T18:12:52.041 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T18:12:55.567 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T18:12:56.007 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T18:12:56.452 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T18:12:56.859 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T18:12:57.992 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T18:12:59.097 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T18:13:00.051 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T18:13:01.063 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T18:13:02.769 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T18:13:07.945 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T18:13:09.902 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T18:13:11.506 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T18:13:16.239 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T18:13:17.776 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T18:13:19.312 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T18:13:20.689 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T18:13:22.156 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T18:13:24.419 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T18:13:26.375 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T18:13:28.225 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T18:13:29.941 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T18:13:32.807 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T18:13:35.631 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T18:13:36.734 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T18:13:37.737 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T18:13:42.624 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T18:13:44.457 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T18:14:00.464 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T18:14:01.618 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T18:14:03.293 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T18:14:07.459 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T18:14:08.934 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T18:14:11.684 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T18:14:23.484 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T18:14:39.969 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T18:15:00.812 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T18:16:21.221 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T18:16:32.248 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T18:16:48.753 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T18:16:51.286 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T18:16:57.770 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T18:17:01.983 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T18:17:04.948 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T18:17:06.217 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T18:17:10.847 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T18:17:12.555 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T18:17:13.892 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T18:17:15.270 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T18:17:35.502 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T18:17:39.667 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T18:17:41.075 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T18:17:42.194 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T18:17:43.683 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T18:17:49.318 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T18:17:53.575 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T18:17:57.786 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T18:17:59.136 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T18:18:00.481 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T18:18:01.862 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T18:18:03.216 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T18:18:04.570 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T18:18:05.943 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T18:18:07.318 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T18:18:09.501 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T18:18:12.439 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T18:18:16.622 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T18:18:19.067 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T18:18:22.601 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T18:18:28.004 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T18:18:30.552 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T18:18:35.124 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T18:18:42.575 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T18:18:45.024 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T18:18:46.643 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T18:18:48.984 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T18:18:50.263 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T18:18:56.682 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T18:18:58.013 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T18:18:59.382 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T18:19:00.698 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T18:19:01.995 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T18:19:03.802 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T18:19:27.301 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T18:19:30.147 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T18:19:31.839 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T18:19:34.174 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T18:19:36.372 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T18:19:46.229 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T18:19:48.700 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T18:20:00.127 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T18:20:42.366 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T18:21:02.858 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T18:21:08.051 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T18:21:13.440 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T18:21:15.833 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T18:21:18.083 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T18:21:19.603 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T18:21:22.363 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T18:21:24.696 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T18:21:28.967 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T18:21:30.179 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T18:21:31.468 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T18:21:32.676 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T18:21:33.735 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T18:21:34.769 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T18:21:35.996 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T18:21:37.147 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T18:21:38.252 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T18:21:39.684 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T18:21:40.803 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T18:21:41.951 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T18:21:43.058 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T18:21:44.177 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T18:21:45.237 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T18:21:46.632 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T18:21:47.988 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T18:21:49.796 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T18:21:51.113 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T18:21:52.610 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T18:21:53.925 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T18:21:55.232 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T18:21:56.317 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T18:21:57.485 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T18:21:58.583 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T18:21:59.736 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T18:22:39.129 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T18:23:17.701 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T18:23:28.409 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T18:23:29.748 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T18:24:31.697 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T18:25:33.767 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T18:25:35.197 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T18:25:36.629 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T18:25:37.719 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T18:25:38.758 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T18:26:07.541 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T18:26:16.636 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T18:26:25.910 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T18:26:27.232 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T18:26:28.558 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T18:26:29.865 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T18:26:31.649 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T18:26:33.002 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T18:26:34.298 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T18:26:35.728 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T18:26:37.208 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T18:26:38.825 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T18:26:40.403 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T18:26:41.743 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T18:26:43.208 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T18:26:45.717 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T18:26:48.293 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T18:26:50.646 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T18:26:53.046 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T18:26:55.615 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T18:26:58.086 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T18:27:00.933 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T18:27:03.896 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T18:27:06.222 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T18:27:08.972 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T18:27:11.733 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T18:27:13.143 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T18:27:14.409 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T18:27:15.857 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T18:27:18.379 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T18:27:20.802 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T18:27:23.369 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T18:27:26.775 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T18:27:49.888 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T18:27:52.013 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T18:27:54.385 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T18:27:56.613 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T18:27:59.708 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T18:28:02.351 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T18:28:03.830 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T18:28:06.359 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T18:28:07.385 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T18:28:08.409 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T18:28:09.480 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T18:28:10.510 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T18:28:11.869 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T18:28:13.009 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T18:28:15.417 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T18:28:16.678 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T18:28:17.744 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T18:28:18.845 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T18:28:20.022 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T18:28:21.091 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T18:28:22.259 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T18:28:23.316 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T18:28:24.453 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T18:28:25.593 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T18:28:26.714 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T18:28:28.234 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T18:28:29.601 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T18:28:31.134 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T18:28:32.615 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T18:28:34.138 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T18:28:35.462 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T18:28:37.232 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T18:28:38.806 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T18:28:40.504 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T18:28:41.989 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T18:28:43.573 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T18:28:45.103 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T18:28:46.794 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T18:28:48.579 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T18:28:50.362 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T18:28:51.868 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T18:28:53.184 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T18:28:54.648 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T18:28:56.390 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T18:28:57.708 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T18:28:59.310 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T18:29:01.199 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T18:29:02.572 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T18:29:04.248 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T18:29:05.802 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T18:29:16.845 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T18:29:18.242 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T18:29:28.873 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T18:29:30.436 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T18:29:31.932 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T18:29:32.988 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T18:29:34.111 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:29:35.333 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:29:36.579 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:29:37.805 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T18:29:38.970 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T18:29:40.162 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T18:29:41.322 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T18:29:42.683 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T18:29:43.834 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T18:29:45.338 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T18:29:46.657 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T18:29:47.826 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T18:29:48.985 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T18:29:50.862 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T18:30:02.533 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T18:30:03.615 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:30:04.813 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:30:06.201 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:30:07.514 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T18:30:09.709 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T18:30:11.179 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T18:30:13.622 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T18:30:19.076 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T18:30:20.984 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T18:30:33.702 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T18:30:44.673 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T18:30:45.795 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T18:30:47.280 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T18:31:03.030 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T18:31:28.299 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T18:31:32.848 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T18:31:35.715 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T18:31:38.402 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T18:31:40.745 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T18:31:41.635 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T18:31:46.616 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T18:31:52.519 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T18:32:10.834 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T18:32:14.851 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T18:32:17.427 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T18:32:22.284 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T18:32:23.463 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T18:32:30.980 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T18:32:38.041 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T18:32:39.427 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T18:32:41.064 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T18:32:48.291 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T18:32:52.707 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T18:32:58.795 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T18:33:00.877 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T18:33:01.228 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T18:33:05.848 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T18:33:10.600 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T18:33:13.481 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T18:33:18.363 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T18:33:19.935 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T18:33:55.203 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T18:33:55.539 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T18:33:57.436 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T18:33:58.849 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T18:34:00.541 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T18:34:02.593 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T18:34:02.643 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T18:34:02.643 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.643 INFO:teuthology.orchestra.run.smithi119.stdout:=============================== warnings summary =============================== 2024-09-12T18:34:02.643 INFO:teuthology.orchestra.run.smithi119.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T18:34:02.644 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T18:34:02.644 INFO:teuthology.orchestra.run.smithi119.stdout: import imp 2024-09-12T18:34:02.644 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.644 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py:120 2024-09-12T18:34:02.644 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:34:02.644 INFO:teuthology.orchestra.run.smithi119.stdout: if boto_type is 'S3Connection': 2024-09-12T18:34:02.644 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.644 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_headers.py:124 2024-09-12T18:34:02.644 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:34:02.644 INFO:teuthology.orchestra.run.smithi119.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T18:34:02.644 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.645 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3.py:359 2024-09-12T18:34:02.645 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-12T18:34:02.645 INFO:teuthology.orchestra.run.smithi119.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T18:34:02.645 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.645 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T18:34:02.645 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:34:02.645 INFO:teuthology.orchestra.run.smithi119.stdout: if k is 'BucketName': 2024-09-12T18:34:02.645 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.645 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T18:34:02.645 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T18:34:02.645 INFO:teuthology.orchestra.run.smithi119.stdout: @pytest.mark.timeout(10) 2024-09-12T18:34:02.645 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.646 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T18:34:02.646 INFO:teuthology.orchestra.run.smithi119.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T18:34:02.646 INFO:teuthology.orchestra.run.smithi119.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T18:34:02.646 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.646 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T18:34:02.646 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:34:02.646 INFO:teuthology.orchestra.run.smithi119.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:34:02.646 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.646 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T18:34:02.646 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:34:02.646 INFO:teuthology.orchestra.run.smithi119.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:34:02.646 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.646 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T18:34:02.647 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:34:02.647 INFO:teuthology.orchestra.run.smithi119.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T18:34:02.647 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.647 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T18:34:02.647 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:34:02.647 INFO:teuthology.orchestra.run.smithi119.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:34:02.647 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.647 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T18:34:02.647 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:34:02.647 INFO:teuthology.orchestra.run.smithi119.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:34:02.647 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.647 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T18:34:02.647 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:34:02.647 INFO:teuthology.orchestra.run.smithi119.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:34:02.648 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.648 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T18:34:02.648 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:34:02.648 INFO:teuthology.orchestra.run.smithi119.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T18:34:02.648 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.648 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T18:34:02.648 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:34:02.648 INFO:teuthology.orchestra.run.smithi119.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:34:02.648 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.648 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T18:34:02.648 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:34:02.649 INFO:teuthology.orchestra.run.smithi119.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:34:02.649 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.649 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T18:34:02.649 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:34:02.649 INFO:teuthology.orchestra.run.smithi119.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:34:02.649 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.649 INFO:teuthology.orchestra.run.smithi119.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T18:34:02.649 INFO:teuthology.orchestra.run.smithi119.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T18:34:02.649 INFO:teuthology.orchestra.run.smithi119.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:34:02.649 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:34:02.649 INFO:teuthology.orchestra.run.smithi119.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T18:34:02.649 INFO:teuthology.orchestra.run.smithi119.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 2312.29s (0:38:32) = 2024-09-12T18:34:02.825 INFO:teuthology.orchestra.run.smithi119.stdout:___________________________________ summary ____________________________________ 2024-09-12T18:34:02.826 INFO:teuthology.orchestra.run.smithi119.stdout: py: commands succeeded 2024-09-12T18:34:02.826 INFO:teuthology.orchestra.run.smithi119.stdout: congratulations :) 2024-09-12T18:34:02.864 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T18:34:02.864 DEBUG:teuthology.orchestra.run.smithi119:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T18:34:02.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:34:02.962 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T18:34:02.963 DEBUG:teuthology.orchestra.run.smithi119:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T18:34:02.968 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T18:34:02.969 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:34:03.160 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T18:34:03.176 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:34:03.176 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T18:34:03.176 DEBUG:teuthology.orchestra.run.smithi119:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:34:03.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:34:03.182 INFO:teuthology.orchestra.run.smithi119.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T18:34:03.183 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:34:03.230 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T18:34:03.230 DEBUG:teuthology.orchestra.run.smithi119:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T18:34:03.278 INFO:tasks.workunit:timeout=3h 2024-09-12T18:34:03.278 INFO:tasks.workunit:cleanup=True 2024-09-12T18:34:03.279 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:34:03.328 INFO:tasks.workunit.client.0.smithi119.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T18:35:00.351 INFO:tasks.workunit.client.0.smithi119.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T18:35:00.351 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T18:35:00.351 INFO:tasks.workunit.client.0.smithi119.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T18:35:00.351 INFO:tasks.workunit.client.0.smithi119.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T18:35:00.351 INFO:tasks.workunit.client.0.smithi119.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T18:35:00.351 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T18:35:00.351 INFO:tasks.workunit.client.0.smithi119.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T18:35:00.352 INFO:tasks.workunit.client.0.smithi119.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T18:35:00.352 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T18:35:00.352 INFO:tasks.workunit.client.0.smithi119.stderr: git switch -c 2024-09-12T18:35:00.352 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T18:35:00.352 INFO:tasks.workunit.client.0.smithi119.stderr:Or undo this operation with: 2024-09-12T18:35:00.352 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T18:35:00.352 INFO:tasks.workunit.client.0.smithi119.stderr: git switch - 2024-09-12T18:35:00.352 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T18:35:00.352 INFO:tasks.workunit.client.0.smithi119.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T18:35:00.352 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T18:35:00.352 INFO:tasks.workunit.client.0.smithi119.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T18:35:00.357 DEBUG:teuthology.orchestra.run.smithi119:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T18:35:00.407 INFO:tasks.workunit.client.0.smithi119.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T18:35:00.411 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:35:00.411 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T18:35:00.466 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T18:35:00.523 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T18:35:00.567 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:35:00.568 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:35:00.568 INFO:tasks.workunit.client.0.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T18:35:00.613 INFO:tasks.workunit.client.0.smithi119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:35:00.618 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T18:35:00.619 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T18:35:00.666 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T18:35:00.668 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T18:35:00.668 DEBUG:teuthology.orchestra.run.smithi119:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T18:35:00.719 INFO:tasks.workunit.client.0.smithi119.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T18:35:00.720 INFO:tasks.workunit.client.0.smithi119.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:35:00.721 INFO:tasks.workunit.client.0.smithi119.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:35:03.626 INFO:tasks.workunit.client.0.smithi119.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T18:35:03.626 INFO:tasks.workunit.client.0.smithi119.stderr:++ deactivate nondestructive 2024-09-12T18:35:03.626 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n '' ']' 2024-09-12T18:35:03.626 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n '' ']' 2024-09-12T18:35:03.627 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:35:03.627 INFO:tasks.workunit.client.0.smithi119.stderr:++ hash -r 2024-09-12T18:35:03.627 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n '' ']' 2024-09-12T18:35:03.627 INFO:tasks.workunit.client.0.smithi119.stderr:++ unset VIRTUAL_ENV 2024-09-12T18:35:03.627 INFO:tasks.workunit.client.0.smithi119.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T18:35:03.627 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T18:35:03.627 INFO:tasks.workunit.client.0.smithi119.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:35:03.627 INFO:tasks.workunit.client.0.smithi119.stderr:++ export VIRTUAL_ENV 2024-09-12T18:35:03.627 INFO:tasks.workunit.client.0.smithi119.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:35:03.627 INFO:tasks.workunit.client.0.smithi119.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:35:03.627 INFO:tasks.workunit.client.0.smithi119.stderr:++ export PATH 2024-09-12T18:35:03.628 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n '' ']' 2024-09-12T18:35:03.628 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -z '' ']' 2024-09-12T18:35:03.628 INFO:tasks.workunit.client.0.smithi119.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T18:35:03.629 INFO:tasks.workunit.client.0.smithi119.stderr:++ PS1='(rgw) ' 2024-09-12T18:35:03.629 INFO:tasks.workunit.client.0.smithi119.stderr:++ export PS1 2024-09-12T18:35:03.629 INFO:tasks.workunit.client.0.smithi119.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T18:35:03.629 INFO:tasks.workunit.client.0.smithi119.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T18:35:03.629 INFO:tasks.workunit.client.0.smithi119.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:35:03.629 INFO:tasks.workunit.client.0.smithi119.stderr:++ hash -r 2024-09-12T18:35:03.629 INFO:tasks.workunit.client.0.smithi119.stderr:+ pip install pip --upgrade 2024-09-12T18:35:03.983 INFO:tasks.workunit.client.0.smithi119.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T18:35:04.189 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting pip 2024-09-12T18:35:04.194 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T18:35:04.229 INFO:tasks.workunit.client.0.smithi119.stdout:Installing collected packages: pip 2024-09-12T18:35:04.229 INFO:tasks.workunit.client.0.smithi119.stdout: Attempting uninstall: pip 2024-09-12T18:35:04.229 INFO:tasks.workunit.client.0.smithi119.stdout: Found existing installation: pip 22.0.2 2024-09-12T18:35:04.491 INFO:tasks.workunit.client.0.smithi119.stdout: Uninstalling pip-22.0.2: 2024-09-12T18:35:04.497 INFO:tasks.workunit.client.0.smithi119.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T18:35:05.244 INFO:tasks.workunit.client.0.smithi119.stdout:Successfully installed pip-24.2 2024-09-12T18:35:05.303 INFO:tasks.workunit.client.0.smithi119.stderr:+ pip install boto3 2024-09-12T18:35:06.282 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting boto3 2024-09-12T18:35:06.283 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T18:35:06.788 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T18:35:06.789 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T18:35:06.835 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T18:35:06.836 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T18:35:06.890 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T18:35:06.891 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T18:35:06.942 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:35:06.943 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T18:35:07.029 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:35:07.031 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T18:35:07.172 INFO:tasks.workunit.client.0.smithi119.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:35:07.173 INFO:tasks.workunit.client.0.smithi119.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T18:35:07.177 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T18:35:07.178 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T18:35:07.189 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T18:35:07.190 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T18:35:07.191 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T18:35:07.193 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T18:35:07.194 INFO:tasks.workunit.client.0.smithi119.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T18:35:07.268 INFO:tasks.workunit.client.0.smithi119.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T18:35:08.403 INFO:tasks.workunit.client.0.smithi119.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T18:35:08.596 INFO:tasks.workunit.client.0.smithi119.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T18:35:08.735 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T18:35:08.774 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:35:08.774 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:35:08.818 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.814+0000 7f79c4ea39c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:08.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.814+0000 7f79c4ea39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:08.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.814+0000 7f79c4ea39c0 20 realm 2024-09-12T18:35:08.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.814+0000 7f79c4ea39c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:08.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.814+0000 7f79c4ea39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:08.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.814+0000 7f79c4ea39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:35:08.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.814+0000 7f79c4ea39c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:08.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.814+0000 7f79c4ea39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:08.820 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.814+0000 7f79c4ea39c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:08.821 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.814+0000 7f79c4ea39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:35:08.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.814+0000 7f79c4ea39c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:08.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.818+0000 7f79c4ea39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:35:08.823 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.818+0000 7f79c4ea39c0 20 searching for the correct realm 2024-09-12T18:35:08.825 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.818+0000 7f79c21a8640 0 -- 172.21.15.119:0/715264044 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f79b40c2030 msgr2=0x7f79b4138120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:35:08.830 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.826+0000 7f79c31aa640 0 -- 172.21.15.119:0/715264044 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f79ac008040 msgr2=0x7f79ac05a010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:35:08.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.834+0000 7f79c4ea39c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T18:35:08.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.834+0000 7f79c4ea39c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T18:35:08.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.834+0000 7f79c4ea39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:35:08.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.834+0000 7f79c4ea39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:35:08.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.834+0000 7f79c4ea39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:35:08.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.834+0000 7f79c4ea39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:35:08.841 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.834+0000 7f79c4ea39c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:08.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.834+0000 7f79c4ea39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:08.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.834+0000 7f79c4ea39c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:08.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:35:08.842 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:08.843 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:35:08.843 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 20 zone default found 2024-09-12T18:35:08.843 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 4 Realm: () 2024-09-12T18:35:08.843 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T18:35:08.843 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T18:35:08.843 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:35:08.843 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 20 zonegroup default 2024-09-12T18:35:08.844 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:08.844 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:08.844 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:08.844 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:08.844 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:08.844 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:08.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 20 started sync module instance, tier type = 2024-09-12T18:35:08.845 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.838+0000 7f79c4ea39c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T18:35:08.860 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.854+0000 7f79c4ea39c0 20 add_watcher() i=0 2024-09-12T18:35:08.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.854+0000 7f79c4ea39c0 20 add_watcher() i=1 2024-09-12T18:35:08.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.854+0000 7f79c4ea39c0 20 add_watcher() i=2 2024-09-12T18:35:08.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.854+0000 7f79c4ea39c0 20 add_watcher() i=3 2024-09-12T18:35:08.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.854+0000 7f79c4ea39c0 20 add_watcher() i=4 2024-09-12T18:35:08.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.854+0000 7f79c4ea39c0 20 add_watcher() i=5 2024-09-12T18:35:08.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.854+0000 7f79c4ea39c0 20 add_watcher() i=6 2024-09-12T18:35:08.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.854+0000 7f79c4ea39c0 20 add_watcher() i=7 2024-09-12T18:35:08.861 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.854+0000 7f79c4ea39c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:35:08.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.858+0000 7f78757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:35:08.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.858+0000 7f79c4ea39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:35:08.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.858+0000 7f79c4ea39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:35:08.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.858+0000 7f79c4ea39c0 5 note: GC not initialized 2024-09-12T18:35:08.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.858+0000 7f77effff640 20 reqs_thread_entry: start 2024-09-12T18:35:08.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.858+0000 7f79c4ea39c0 20 init_complete bucket index max shards: 11 2024-09-12T18:35:08.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.858+0000 7f79c4ea39c0 20 Filter name: none 2024-09-12T18:35:08.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.858+0000 7f77edffb640 20 reqs_thread_entry: start 2024-09-12T18:35:08.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.858+0000 7f79c4ea39c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T18:35:08.865 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.858+0000 7f79c4ea39c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:08.866 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.862+0000 7f79c4ea39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:08.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.862+0000 7f79c4ea39c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T18:35:08.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.862+0000 7f79c4ea39c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:35:08.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.862+0000 7f79c4ea39c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T18:35:08.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.862+0000 7f79c4ea39c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:08.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.862+0000 7f79c4ea39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:08.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.862+0000 7f79c4ea39c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T18:35:08.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.862+0000 7f79c4ea39c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:35:08.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.862+0000 7f79c4ea39c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T18:35:08.867 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.862+0000 7f79c4ea39c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T18:35:08.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.862+0000 7f79c4ea39c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T18:35:08.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.862+0000 7f79c4ea39c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:35:08.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.862+0000 7f79c4ea39c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T18:35:08.869 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.862+0000 7f789e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235550 cookie 93911365391088 notifier 9357 bl.length()=613 2024-09-12T18:35:08.870 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.862+0000 7f789e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T18:35:08.870 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.862+0000 7f789e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:35:08.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.866+0000 7f79c4ea39c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T18:35:08.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.866+0000 7f79c4ea39c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:35:08.873 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.866+0000 7f79c4ea39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T18:35:08.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.870+0000 7f789e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235808 cookie 93911365392656 notifier 9357 bl.length()=191 2024-09-12T18:35:08.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.870+0000 7f789e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T18:35:08.874 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.870+0000 7f789e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:35:08.876 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.870+0000 7f78757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:35:08.880 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.874+0000 7f79c4ea39c0 20 remove_watcher() i=0 2024-09-12T18:35:08.880 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.874+0000 7f79c4ea39c0 2 removed watcher, disabling cache 2024-09-12T18:35:08.883 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.878+0000 7f79c4ea39c0 20 remove_watcher() i=1 2024-09-12T18:35:08.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.878+0000 7f79c4ea39c0 20 remove_watcher() i=2 2024-09-12T18:35:08.886 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.882+0000 7f79c4ea39c0 20 remove_watcher() i=3 2024-09-12T18:35:08.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.882+0000 7f79c4ea39c0 20 remove_watcher() i=4 2024-09-12T18:35:08.889 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.886+0000 7f79c4ea39c0 20 remove_watcher() i=5 2024-09-12T18:35:08.892 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.886+0000 7f79c4ea39c0 20 remove_watcher() i=6 2024-09-12T18:35:08.893 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:08.886+0000 7f79c4ea39c0 20 remove_watcher() i=7 2024-09-12T18:35:09.286 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T18:35:09.287 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T18:35:09.609 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T18:35:09.642 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:35:09.643 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:35:09.690 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.686+0000 7f13b80989c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:09.692 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.686+0000 7f13b80989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:09.692 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.686+0000 7f13b80989c0 20 realm 2024-09-12T18:35:09.692 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.686+0000 7f13b80989c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:09.692 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.686+0000 7f13b80989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:09.693 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.686+0000 7f13b80989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:35:09.693 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.686+0000 7f13b80989c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:09.693 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.686+0000 7f13b80989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:09.693 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.686+0000 7f13b80989c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:09.694 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.690+0000 7f13b80989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:35:09.694 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.690+0000 7f13b80989c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:09.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.690+0000 7f13b80989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:35:09.696 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.690+0000 7f13b80989c0 20 searching for the correct realm 2024-09-12T18:35:09.700 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.694+0000 7f13b639f640 0 -- 172.21.15.119:0/1767116642 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x561f1b98c6f0 msgr2=0x561f1b98eae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:35:09.707 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.702+0000 7f13b539d640 0 -- 172.21.15.119:0/1767116642 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f13b003c920 msgr2=0x7f13b0030410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:35:09.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T18:35:09.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T18:35:09.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:35:09.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:35:09.926 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:35:09.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:35:09.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:09.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:09.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:09.927 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:35:09.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:09.928 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:35:09.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 zone default found 2024-09-12T18:35:09.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 4 Realm: () 2024-09-12T18:35:09.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T18:35:09.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T18:35:09.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:35:09.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 zonegroup default 2024-09-12T18:35:09.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:09.929 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:09.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.922+0000 7f13b80989c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:09.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.926+0000 7f13b80989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:09.930 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.926+0000 7f13b80989c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:09.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.926+0000 7f13b80989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:09.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.926+0000 7f13b80989c0 20 started sync module instance, tier type = 2024-09-12T18:35:09.931 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.926+0000 7f13b80989c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T18:35:09.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.950+0000 7f13b80989c0 20 add_watcher() i=0 2024-09-12T18:35:09.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.950+0000 7f13b80989c0 20 add_watcher() i=1 2024-09-12T18:35:09.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.950+0000 7f13b80989c0 20 add_watcher() i=2 2024-09-12T18:35:09.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.950+0000 7f13b80989c0 20 add_watcher() i=3 2024-09-12T18:35:09.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.950+0000 7f13b80989c0 20 add_watcher() i=4 2024-09-12T18:35:09.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.950+0000 7f13b80989c0 20 add_watcher() i=5 2024-09-12T18:35:09.957 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.950+0000 7f13b80989c0 20 add_watcher() i=6 2024-09-12T18:35:09.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.954+0000 7f13b80989c0 20 add_watcher() i=7 2024-09-12T18:35:09.959 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.954+0000 7f13b80989c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:35:09.963 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.958+0000 7f12677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:35:09.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.958+0000 7f13b80989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:35:09.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.958+0000 7f13b80989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:35:09.964 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.958+0000 7f13b80989c0 5 note: GC not initialized 2024-09-12T18:35:09.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.958+0000 7f12667fc640 20 reqs_thread_entry: start 2024-09-12T18:35:09.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.958+0000 7f13b80989c0 20 init_complete bucket index max shards: 11 2024-09-12T18:35:09.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.958+0000 7f13b80989c0 20 Filter name: none 2024-09-12T18:35:09.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.958+0000 7f11d7fff640 20 reqs_thread_entry: start 2024-09-12T18:35:09.965 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.958+0000 7f13b80989c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:09.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.962+0000 7f13b80989c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:35:09.966 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.962+0000 7f13b80989c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:09.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.962+0000 7f13b80989c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:35:09.967 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.962+0000 7f13b80989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:35:09.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.962+0000 7f13b80989c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:35:09.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.962+0000 7f13b80989c0 20 INFO: main: starting shard=0 2024-09-12T18:35:09.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.962+0000 7f13b80989c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.0 2024-09-12T18:35:09.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.962+0000 7f13b80989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:09.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.962+0000 7f13b80989c0 20 INFO: main: starting shard=1 2024-09-12T18:35:09.968 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.962+0000 7f13b80989c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.1 2024-09-12T18:35:09.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.962+0000 7f13b80989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:09.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.962+0000 7f13b80989c0 20 INFO: main: starting shard=2 2024-09-12T18:35:09.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.962+0000 7f13b80989c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.2 2024-09-12T18:35:09.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.962+0000 7f13b80989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:09.969 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.962+0000 7f13b80989c0 20 INFO: main: starting shard=3 2024-09-12T18:35:09.970 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.962+0000 7f13b80989c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.3 2024-09-12T18:35:09.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.966+0000 7f13b80989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:09.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.966+0000 7f13b80989c0 20 INFO: main: starting shard=4 2024-09-12T18:35:09.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.966+0000 7f13b80989c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.4 2024-09-12T18:35:09.971 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.966+0000 7f13b80989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:09.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.966+0000 7f13b80989c0 20 INFO: main: starting shard=5 2024-09-12T18:35:09.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.966+0000 7f13b80989c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.5 2024-09-12T18:35:09.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.966+0000 7f13b80989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:09.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.966+0000 7f13b80989c0 20 INFO: main: starting shard=6 2024-09-12T18:35:09.972 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.966+0000 7f13b80989c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.6 2024-09-12T18:35:09.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.966+0000 7f13b80989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:09.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.966+0000 7f13b80989c0 20 INFO: main: starting shard=7 2024-09-12T18:35:09.973 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.966+0000 7f13b80989c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.7 2024-09-12T18:35:09.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.970+0000 7f13b80989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:09.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.970+0000 7f13b80989c0 20 INFO: main: starting shard=8 2024-09-12T18:35:09.974 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.970+0000 7f13b80989c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.8 2024-09-12T18:35:09.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.970+0000 7f13b80989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:09.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.970+0000 7f13b80989c0 20 INFO: main: starting shard=9 2024-09-12T18:35:09.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.970+0000 7f13b80989c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.9 2024-09-12T18:35:09.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.970+0000 7f13b80989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:09.975 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.970+0000 7f13b80989c0 20 INFO: main: starting shard=10 2024-09-12T18:35:09.976 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.970+0000 7f13b80989c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.10 2024-09-12T18:35:09.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.970+0000 7f13b80989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:09.977 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.970+0000 7f13b80989c0 20 INFO: main: done 2024-09-12T18:35:09.978 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.974+0000 7f12677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:35:09.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.978+0000 7f13b80989c0 20 remove_watcher() i=0 2024-09-12T18:35:09.984 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.978+0000 7f13b80989c0 2 removed watcher, disabling cache 2024-09-12T18:35:09.986 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.982+0000 7f13b80989c0 20 remove_watcher() i=1 2024-09-12T18:35:09.989 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.982+0000 7f13b80989c0 20 remove_watcher() i=2 2024-09-12T18:35:09.990 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.986+0000 7f13b80989c0 20 remove_watcher() i=3 2024-09-12T18:35:09.993 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.986+0000 7f13b80989c0 20 remove_watcher() i=4 2024-09-12T18:35:09.994 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.990+0000 7f13b80989c0 20 remove_watcher() i=5 2024-09-12T18:35:09.996 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.990+0000 7f13b80989c0 20 remove_watcher() i=6 2024-09-12T18:35:09.998 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:09.994+0000 7f13b80989c0 20 remove_watcher() i=7 2024-09-12T18:35:10.017 INFO:tasks.workunit.client.0.smithi119.stderr:rados -p default.rgw.buckets.data ls | grep 78ff7954-931f-4554-a5e2-18738cc5825b 2024-09-12T18:35:10.040 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:35:10.040 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:35:10.218 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:10.210+0000 7f2f7b550640 0 -- 172.21.15.119:0/3083104818 >> [v2:172.21.15.119:6800/1732749810,v1:172.21.15.119:6801/1732749810] conn(0x7f2f6c014940 msgr2=0x7f2f6c01d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:35:10.244 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T18:35:10.244 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T18:35:10.244 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:35:11.786 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:35:12.241 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T18:35:12.270 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:35:12.270 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:35:12.312 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.306+0000 7f1be51779c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:12.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.310+0000 7f1be51779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:12.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.310+0000 7f1be51779c0 20 realm 2024-09-12T18:35:12.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.310+0000 7f1be51779c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:12.314 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.310+0000 7f1be51779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:12.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.310+0000 7f1be51779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:35:12.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.310+0000 7f1be51779c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:12.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.310+0000 7f1be51779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:12.315 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.310+0000 7f1be51779c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:12.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.310+0000 7f1be51779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:35:12.316 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.310+0000 7f1be51779c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:12.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.314+0000 7f1be51779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:35:12.320 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.314+0000 7f1be51779c0 20 searching for the correct realm 2024-09-12T18:35:12.322 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.318+0000 7f1be247c640 0 -- 172.21.15.119:0/338523439 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f1bd4014420 msgr2=0x7f1bd40148a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:35:12.328 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.322+0000 7f1be247c640 0 -- 172.21.15.119:0/338523439 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f1bdc07dc80 msgr2=0x7f1bdc069040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:35:12.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.538+0000 7f1be51779c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T18:35:12.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.538+0000 7f1be51779c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T18:35:12.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.538+0000 7f1be51779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:35:12.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.538+0000 7f1be51779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:35:12.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.538+0000 7f1be51779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:35:12.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.538+0000 7f1be51779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:35:12.546 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:12.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:12.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:12.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:35:12.547 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:12.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:35:12.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 20 zone default found 2024-09-12T18:35:12.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 4 Realm: () 2024-09-12T18:35:12.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T18:35:12.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T18:35:12.548 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:35:12.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 20 zonegroup default 2024-09-12T18:35:12.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:12.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:12.549 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:12.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:12.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.542+0000 7f1be51779c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:12.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.546+0000 7f1be51779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:12.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.546+0000 7f1be51779c0 20 started sync module instance, tier type = 2024-09-12T18:35:12.550 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.546+0000 7f1be51779c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T18:35:12.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.570+0000 7f1be51779c0 20 add_watcher() i=0 2024-09-12T18:35:12.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.570+0000 7f1be51779c0 20 add_watcher() i=1 2024-09-12T18:35:12.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.570+0000 7f1be51779c0 20 add_watcher() i=2 2024-09-12T18:35:12.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.570+0000 7f1be51779c0 20 add_watcher() i=3 2024-09-12T18:35:12.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.570+0000 7f1be51779c0 20 add_watcher() i=4 2024-09-12T18:35:12.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.570+0000 7f1be51779c0 20 add_watcher() i=5 2024-09-12T18:35:12.575 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.570+0000 7f1be51779c0 20 add_watcher() i=6 2024-09-12T18:35:12.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.570+0000 7f1be51779c0 20 add_watcher() i=7 2024-09-12T18:35:12.577 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.570+0000 7f1be51779c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:35:12.580 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.574+0000 7f1a997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:35:12.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.574+0000 7f1be51779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:35:12.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.574+0000 7f1be51779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:35:12.581 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.574+0000 7f1be51779c0 5 note: GC not initialized 2024-09-12T18:35:12.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.574+0000 7f1a13fff640 20 reqs_thread_entry: start 2024-09-12T18:35:12.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1be51779c0 20 init_complete bucket index max shards: 11 2024-09-12T18:35:12.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1be51779c0 20 Filter name: none 2024-09-12T18:35:12.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1a11ffb640 20 reqs_thread_entry: start 2024-09-12T18:35:12.582 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1be51779c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:12.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1be51779c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:35:12.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1be51779c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:12.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1be51779c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:35:12.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1be51779c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:35:12.583 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1be51779c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:35:12.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1be51779c0 20 INFO: main: starting shard=0 2024-09-12T18:35:12.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1be51779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.0 2024-09-12T18:35:12.584 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1be51779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:12.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1be51779c0 20 INFO: main: starting shard=1 2024-09-12T18:35:12.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1be51779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.1 2024-09-12T18:35:12.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1be51779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:12.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1be51779c0 20 INFO: main: starting shard=2 2024-09-12T18:35:12.585 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.578+0000 7f1be51779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.2 2024-09-12T18:35:12.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:12.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 INFO: main: starting shard=3 2024-09-12T18:35:12.586 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.3 2024-09-12T18:35:12.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:12.587 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 INFO: main: starting shard=4 2024-09-12T18:35:12.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.4 2024-09-12T18:35:12.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:12.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 INFO: main: starting shard=5 2024-09-12T18:35:12.588 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.5 2024-09-12T18:35:12.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:12.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 INFO: main: starting shard=6 2024-09-12T18:35:12.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.6 2024-09-12T18:35:12.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:12.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 INFO: main: starting shard=7 2024-09-12T18:35:12.589 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.7 2024-09-12T18:35:12.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:12.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 INFO: main: starting shard=8 2024-09-12T18:35:12.590 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.582+0000 7f1be51779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.8 2024-09-12T18:35:12.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.586+0000 7f1be51779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:12.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.586+0000 7f1be51779c0 20 INFO: main: starting shard=9 2024-09-12T18:35:12.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.586+0000 7f1be51779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.9 2024-09-12T18:35:12.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.586+0000 7f1be51779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:12.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.586+0000 7f1be51779c0 20 INFO: main: starting shard=10 2024-09-12T18:35:12.591 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.586+0000 7f1be51779c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.10 2024-09-12T18:35:12.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.586+0000 7f1be51779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:35:12.593 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.586+0000 7f1be51779c0 20 INFO: main: done 2024-09-12T18:35:12.594 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.590+0000 7f1a997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:35:12.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.594+0000 7f1be51779c0 20 remove_watcher() i=0 2024-09-12T18:35:12.599 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.594+0000 7f1be51779c0 2 removed watcher, disabling cache 2024-09-12T18:35:12.602 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.598+0000 7f1be51779c0 20 remove_watcher() i=1 2024-09-12T18:35:12.604 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.598+0000 7f1be51779c0 20 remove_watcher() i=2 2024-09-12T18:35:12.606 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.602+0000 7f1be51779c0 20 remove_watcher() i=3 2024-09-12T18:35:12.609 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.602+0000 7f1be51779c0 20 remove_watcher() i=4 2024-09-12T18:35:12.610 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.606+0000 7f1be51779c0 20 remove_watcher() i=5 2024-09-12T18:35:12.612 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.606+0000 7f1be51779c0 20 remove_watcher() i=6 2024-09-12T18:35:12.613 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.606+0000 7f1be51779c0 20 remove_watcher() i=7 2024-09-12T18:35:12.629 INFO:tasks.workunit.client.0.smithi119.stderr:rados -p default.rgw.buckets.data ls | grep de1eb40f-d7de-4ef1-a53c-b4e95affac42 2024-09-12T18:35:12.655 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:35:12.655 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:35:12.822 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:12.814+0000 7f88f5975640 0 -- 172.21.15.119:0/466030086 >> [v2:172.21.15.119:6800/1732749810,v1:172.21.15.119:6801/1732749810] conn(0x7f88f00236f0 msgr2=0x7f88f0023ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:35:12.849 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T18:35:12.850 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T18:35:13.108 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:35:14.743 INFO:tasks.workunit.client.0.smithi119.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:35:14.743 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:35:15.327 INFO:tasks.workunit.client.0.smithi119.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T18:35:15.328 INFO:tasks.workunit.client.0.smithi119.stderr: 2024-09-12T18:35:15.720 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T18:35:19.383 INFO:tasks.workunit.client.0.smithi119.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T18:35:19.815 INFO:tasks.workunit.client.0.smithi119.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T18:35:19.841 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:35:19.841 INFO:tasks.workunit.client.0.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:35:19.881 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:19.874+0000 7f4ad0e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:19.883 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:19.878+0000 7f4ad0e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:19.883 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:19.878+0000 7f4ad0e959c0 20 realm 2024-09-12T18:35:19.883 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:19.878+0000 7f4ad0e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:19.883 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:19.878+0000 7f4ad0e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:19.883 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:19.878+0000 7f4ad0e959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:35:19.883 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:19.878+0000 7f4ad0e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:19.883 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:19.878+0000 7f4ad0e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:19.883 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:19.878+0000 7f4ad0e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:19.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:19.878+0000 7f4ad0e959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:35:19.885 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:19.878+0000 7f4ad0e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:19.886 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:19.882+0000 7f4ad0e959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:35:19.886 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:19.882+0000 7f4ad0e959c0 20 searching for the correct realm 2024-09-12T18:35:19.890 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:19.886+0000 7f4acf19c640 0 -- 172.21.15.119:0/23168953 >> [v2:172.21.15.194:6808/923639088,v1:172.21.15.194:6809/923639088] conn(0x5632ce16cec0 msgr2=0x5632ce16f2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:35:19.896 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:19.890+0000 7f4ace19a640 0 -- 172.21.15.119:0/23168953 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f4ac8104580 msgr2=0x7f4ac80fd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:35:20.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.106+0000 7f4ad0e959c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T18:35:20.112 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.106+0000 7f4ad0e959c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T18:35:20.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.106+0000 7f4ad0e959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:35:20.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.106+0000 7f4ad0e959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:35:20.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.106+0000 7f4ad0e959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:35:20.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.106+0000 7f4ad0e959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:35:20.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.106+0000 7f4ad0e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:20.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.106+0000 7f4ad0e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:20.113 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.106+0000 7f4ad0e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:20.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.106+0000 7f4ad0e959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:35:20.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.110+0000 7f4ad0e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:20.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.110+0000 7f4ad0e959c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:35:20.114 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.110+0000 7f4ad0e959c0 20 zone default found 2024-09-12T18:35:20.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.110+0000 7f4ad0e959c0 4 Realm: () 2024-09-12T18:35:20.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.110+0000 7f4ad0e959c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T18:35:20.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.110+0000 7f4ad0e959c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T18:35:20.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.110+0000 7f4ad0e959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:35:20.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.110+0000 7f4ad0e959c0 20 zonegroup default 2024-09-12T18:35:20.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.110+0000 7f4ad0e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:20.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.110+0000 7f4ad0e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:20.115 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.110+0000 7f4ad0e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:20.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.110+0000 7f4ad0e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:20.116 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.110+0000 7f4ad0e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:20.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.110+0000 7f4ad0e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:20.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.110+0000 7f4ad0e959c0 20 started sync module instance, tier type = 2024-09-12T18:35:20.117 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.110+0000 7f4ad0e959c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T18:35:20.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.134+0000 7f4ad0e959c0 20 add_watcher() i=0 2024-09-12T18:35:20.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.134+0000 7f4ad0e959c0 20 add_watcher() i=1 2024-09-12T18:35:20.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.134+0000 7f4ad0e959c0 20 add_watcher() i=2 2024-09-12T18:35:20.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.134+0000 7f4ad0e959c0 20 add_watcher() i=3 2024-09-12T18:35:20.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.134+0000 7f4ad0e959c0 20 add_watcher() i=4 2024-09-12T18:35:20.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.134+0000 7f4ad0e959c0 20 add_watcher() i=5 2024-09-12T18:35:20.141 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.134+0000 7f4ad0e959c0 20 add_watcher() i=6 2024-09-12T18:35:20.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.138+0000 7f4ad0e959c0 20 add_watcher() i=7 2024-09-12T18:35:20.143 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.138+0000 7f4ad0e959c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:35:20.147 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.142+0000 7f49857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:35:20.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.142+0000 7f4ad0e959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:35:20.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.142+0000 7f4ad0e959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:35:20.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.142+0000 7f4ad0e959c0 5 note: GC not initialized 2024-09-12T18:35:20.148 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.142+0000 7f48fffff640 20 reqs_thread_entry: start 2024-09-12T18:35:20.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.142+0000 7f4ad0e959c0 20 init_complete bucket index max shards: 11 2024-09-12T18:35:20.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.142+0000 7f4ad0e959c0 20 Filter name: none 2024-09-12T18:35:20.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.142+0000 7f48fdffb640 20 reqs_thread_entry: start 2024-09-12T18:35:20.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.142+0000 7f4ad0e959c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T18:35:20.149 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.142+0000 7f4ad0e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:20.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.146+0000 7f4ad0e959c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:35:20.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.146+0000 7f4ad0e959c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T18:35:20.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.146+0000 7f4ad0e959c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T18:35:20.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.146+0000 7f4ad0e959c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783 : miss 2024-09-12T18:35:20.150 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.146+0000 7f4ad0e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:20.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.146+0000 7f4ad0e959c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:35:20.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.146+0000 7f4ad0e959c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783 info.flags=0x17 2024-09-12T18:35:20.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.146+0000 7f4ad0e959c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783 to cache LRU end 2024-09-12T18:35:20.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.146+0000 7f4ad0e959c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:35:20.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.146+0000 7f4ad0e959c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:35:20.151 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.146+0000 7f4ad0e959c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783 2024-09-12T18:35:20.152 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.146+0000 7f4ad0e959c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.0 2024-09-12T18:35:20.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.146+0000 7f4ad0e959c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T18:35:20.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.146+0000 7f4ad0e959c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.1 2024-09-12T18:35:20.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.146+0000 7f4ad0e959c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T18:35:20.153 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.146+0000 7f4ad0e959c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.2 2024-09-12T18:35:20.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.150+0000 7f4ad0e959c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T18:35:20.154 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.150+0000 7f4ad0e959c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.3 2024-09-12T18:35:20.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.150+0000 7f4ad0e959c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T18:35:20.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.150+0000 7f4ad0e959c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.4 2024-09-12T18:35:20.156 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.150+0000 7f4ad0e959c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T18:35:20.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.150+0000 7f4ad0e959c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.5 2024-09-12T18:35:20.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.150+0000 7f4ad0e959c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T18:35:20.157 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.150+0000 7f4ad0e959c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.6 2024-09-12T18:35:20.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.154+0000 7f4ad0e959c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T18:35:20.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.154+0000 7f4ad0e959c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.7 2024-09-12T18:35:20.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.154+0000 7f4ad0e959c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T18:35:20.158 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.154+0000 7f4ad0e959c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.8 2024-09-12T18:35:20.160 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.154+0000 7f4ad0e959c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T18:35:20.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.154+0000 7f4ad0e959c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.9 2024-09-12T18:35:20.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.154+0000 7f4ad0e959c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T18:35:20.161 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.154+0000 7f4ad0e959c0 20 bucket index object: :.dir.4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783.10 2024-09-12T18:35:20.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.158+0000 7f4ad0e959c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T18:35:20.162 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.158+0000 7f4ad0e959c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T18:35:20.163 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.158+0000 7f49857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:35:20.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.162+0000 7f4ad0e959c0 20 remove_watcher() i=0 2024-09-12T18:35:20.168 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.162+0000 7f4ad0e959c0 2 removed watcher, disabling cache 2024-09-12T18:35:20.170 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.166+0000 7f4ad0e959c0 20 remove_watcher() i=1 2024-09-12T18:35:20.172 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.166+0000 7f4ad0e959c0 20 remove_watcher() i=2 2024-09-12T18:35:20.175 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.170+0000 7f4ad0e959c0 20 remove_watcher() i=3 2024-09-12T18:35:20.177 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.170+0000 7f4ad0e959c0 20 remove_watcher() i=4 2024-09-12T18:35:20.179 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.174+0000 7f4ad0e959c0 20 remove_watcher() i=5 2024-09-12T18:35:20.181 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.174+0000 7f4ad0e959c0 20 remove_watcher() i=6 2024-09-12T18:35:20.182 INFO:tasks.workunit.client.0.smithi119.stderr:2024-09-12T18:35:20.178+0000 7f4ad0e959c0 20 remove_watcher() i=7 2024-09-12T18:35:20.199 INFO:tasks.workunit.client.0.smithi119.stderr:Deleting bucket versioning-bucket 2024-09-12T18:35:20.560 INFO:tasks.workunit.client.0.smithi119.stderr:Completed bucket versioning tests 2024-09-12T18:35:20.560 INFO:tasks.workunit.client.0.smithi119.stdout:connected to http://localhost:80 2024-09-12T18:35:20.655 INFO:tasks.workunit.client.0.smithi119.stderr:+ deactivate 2024-09-12T18:35:20.655 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T18:35:20.655 INFO:tasks.workunit.client.0.smithi119.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:35:20.655 INFO:tasks.workunit.client.0.smithi119.stderr:+ export PATH 2024-09-12T18:35:20.655 INFO:tasks.workunit.client.0.smithi119.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T18:35:20.655 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' -n '' ']' 2024-09-12T18:35:20.655 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:35:20.656 INFO:tasks.workunit.client.0.smithi119.stderr:+ hash -r 2024-09-12T18:35:20.656 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' -n '' ']' 2024-09-12T18:35:20.656 INFO:tasks.workunit.client.0.smithi119.stderr:+ unset VIRTUAL_ENV 2024-09-12T18:35:20.656 INFO:tasks.workunit.client.0.smithi119.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T18:35:20.656 INFO:tasks.workunit.client.0.smithi119.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T18:35:20.656 INFO:tasks.workunit.client.0.smithi119.stderr:+ unset -f deactivate 2024-09-12T18:35:20.656 INFO:tasks.workunit.client.0.smithi119.stderr:+ echo OK. 2024-09-12T18:35:20.657 INFO:tasks.workunit.client.0.smithi119.stdout:OK. 2024-09-12T18:35:20.657 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:35:20.658 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:35:20.718 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T18:35:20.718 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:35:21.105 DEBUG:teuthology.parallel:result is None 2024-09-12T18:35:21.105 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:35:21.117 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:35:21.118 DEBUG:teuthology.orchestra.run.smithi119:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:35:21.166 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:35:21.166 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T18:35:21.176 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T18:35:21.214 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T18:35:21.214 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T18:35:21.214 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T18:35:21.265 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T18:35:21.265 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T18:35:21.335 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:35:21.335 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:35:21.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.369+0000 7f0b8e2bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:21.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.373+0000 7f0b8e2bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:21.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.373+0000 7f0b8e2bb9c0 20 realm 2024-09-12T18:35:21.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.373+0000 7f0b8e2bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:21.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.373+0000 7f0b8e2bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:21.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.373+0000 7f0b8e2bb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:35:21.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.373+0000 7f0b8e2bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:21.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.373+0000 7f0b8e2bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:21.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.373+0000 7f0b8e2bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:21.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.373+0000 7f0b8e2bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:35:21.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.373+0000 7f0b8e2bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:21.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.373+0000 7f0b8e2bb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:35:21.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.373+0000 7f0b8e2bb9c0 20 searching for the correct realm 2024-09-12T18:35:21.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.377+0000 7f0b8b5c0640 0 -- 172.21.15.119:0/1861857874 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f0b780023a0 msgr2=0x7f0b7c079d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:35:21.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.589+0000 7f0b8c5c2640 0 -- 172.21.15.119:0/1861857874 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f0b740c2070 msgr2=0x7f0b7413a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:35:21.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.605+0000 7f0b8e2bb9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T18:35:21.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.605+0000 7f0b8e2bb9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T18:35:21.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.605+0000 7f0b8e2bb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:35:21.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.605+0000 7f0b8e2bb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:35:21.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.605+0000 7f0b8e2bb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:35:21.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.605+0000 7f0b8e2bb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:35:21.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.605+0000 7f0b8e2bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:21.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.605+0000 7f0b8e2bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:21.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.605+0000 7f0b8e2bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:21.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.605+0000 7f0b8e2bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:35:21.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.605+0000 7f0b8e2bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:21.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.609+0000 7f0b8e2bb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:35:21.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.609+0000 7f0b8e2bb9c0 20 zone default found 2024-09-12T18:35:21.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.609+0000 7f0b8e2bb9c0 4 Realm: () 2024-09-12T18:35:21.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.609+0000 7f0b8e2bb9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T18:35:21.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.609+0000 7f0b8e2bb9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T18:35:21.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.609+0000 7f0b8e2bb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:35:21.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.609+0000 7f0b8e2bb9c0 20 zonegroup default 2024-09-12T18:35:21.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.609+0000 7f0b8e2bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:21.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.609+0000 7f0b8e2bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:21.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.609+0000 7f0b8e2bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:21.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.609+0000 7f0b8e2bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:21.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.609+0000 7f0b8e2bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:21.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.609+0000 7f0b8e2bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:21.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.609+0000 7f0b8e2bb9c0 20 started sync module instance, tier type = 2024-09-12T18:35:21.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.609+0000 7f0b8e2bb9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T18:35:21.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.633+0000 7f0b8e2bb9c0 20 add_watcher() i=0 2024-09-12T18:35:21.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.633+0000 7f0b8e2bb9c0 20 add_watcher() i=1 2024-09-12T18:35:21.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.633+0000 7f0b8e2bb9c0 20 add_watcher() i=2 2024-09-12T18:35:21.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.633+0000 7f0b8e2bb9c0 20 add_watcher() i=3 2024-09-12T18:35:21.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.633+0000 7f0b8e2bb9c0 20 add_watcher() i=4 2024-09-12T18:35:21.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.633+0000 7f0b8e2bb9c0 20 add_watcher() i=5 2024-09-12T18:35:21.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.633+0000 7f0b8e2bb9c0 20 add_watcher() i=6 2024-09-12T18:35:21.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.637+0000 7f0b8e2bb9c0 20 add_watcher() i=7 2024-09-12T18:35:21.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.637+0000 7f0b8e2bb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:35:21.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.641+0000 7f0a41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:35:21.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.641+0000 7f0b8e2bb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:35:21.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.641+0000 7f0b8e2bb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:35:21.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.733+0000 7f0a40fe1640 20 reqs_thread_entry: start 2024-09-12T18:35:21.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.733+0000 7f0b8e2bb9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:35:21.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.733+0000 7f0b8e2bb9c0 20 Filter name: none 2024-09-12T18:35:21.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.733+0000 7f09ba7fc640 20 reqs_thread_entry: start 2024-09-12T18:35:21.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.733+0000 7f0b8e2bb9c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T18:35:21.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.733+0000 7f0b8e2bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:21.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.737+0000 7f0b8e2bb9c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T18:35:21.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.737+0000 7f0b8e2bb9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T18:35:21.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.737+0000 7f0b8e2bb9c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:35:21.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.737+0000 7f0b8e2bb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:35:21.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.737+0000 7f0b8e2bb9c0 10 removing key index: RVJFIPTFVWQRBXBYMVOX 2024-09-12T18:35:21.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.737+0000 7f0b8e2bb9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:RVJFIPTFVWQRBXBYMVOX, ofs0, ns] 2024-09-12T18:35:21.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.741+0000 7f0a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235611 cookie 94473920538448 notifier 9492 bl.length()=170 2024-09-12T18:35:21.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.749+0000 7f0b8e2bb9c0 10 removing email index: tester.client.0_test@test.test 2024-09-12T18:35:21.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.749+0000 7f0b8e2bb9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T18:35:21.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.749+0000 7f0a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051237639 cookie 94473920544464 notifier 9492 bl.length()=181 2024-09-12T18:35:21.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.753+0000 7f0b8e2bb9c0 10 removing user buckets index 2024-09-12T18:35:21.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.757+0000 7f0b8e2bb9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T18:35:21.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.757+0000 7f0a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235551 cookie 94473920556848 notifier 9492 bl.length()=172 2024-09-12T18:35:21.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.761+0000 7f0b8e2bb9c0 10 removing user index: tester.client.0 2024-09-12T18:35:21.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.765+0000 7f0b8e2bb9c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T18:35:21.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.765+0000 7f0b8e2bb9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T18:35:21.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.765+0000 7f0a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235817 cookie 94473920550624 notifier 9492 bl.length()=164 2024-09-12T18:35:21.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.765+0000 7f0a41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:35:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.773+0000 7f0b8e2bb9c0 20 remove_watcher() i=0 2024-09-12T18:35:21.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.773+0000 7f0b8e2bb9c0 2 removed watcher, disabling cache 2024-09-12T18:35:21.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.773+0000 7f0b8e2bb9c0 20 remove_watcher() i=1 2024-09-12T18:35:21.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.777+0000 7f0b8e2bb9c0 20 remove_watcher() i=2 2024-09-12T18:35:21.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.777+0000 7f0b8e2bb9c0 20 remove_watcher() i=3 2024-09-12T18:35:21.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.781+0000 7f0b8e2bb9c0 20 remove_watcher() i=4 2024-09-12T18:35:21.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.781+0000 7f0b8e2bb9c0 20 remove_watcher() i=5 2024-09-12T18:35:21.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.785+0000 7f0b8e2bb9c0 20 remove_watcher() i=6 2024-09-12T18:35:21.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:21.785+0000 7f0b8e2bb9c0 20 remove_watcher() i=7 2024-09-12T18:35:21.807 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T18:35:21.819 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T18:35:21.857 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T18:35:21.898 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T18:35:21.909 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T18:35:21.909 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:35:21.967 INFO:tasks.rgw.client.0.smithi119.stdout:2024-09-12T18:35:21.949+0000 e571640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 38784) UID: 0 2024-09-12T18:35:21.969 INFO:tasks.rgw.client.0.smithi119.stdout:2024-09-12T18:35:21.957+0000 8ed9f80 -1 shutting down 2024-09-12T18:35:56.894 INFO:tasks.rgw.client.0.smithi119.stderr:==00:01:25:12.952 38787== could not unlink /tmp/vgdb-pipe-from-vgdb-to-38787-by-root-on-??? 2024-09-12T18:35:56.894 INFO:tasks.rgw.client.0.smithi119.stderr:==00:01:25:12.952 38787== could not unlink /tmp/vgdb-pipe-to-vgdb-from-38787-by-root-on-??? 2024-09-12T18:35:56.894 INFO:tasks.rgw.client.0.smithi119.stderr:==00:01:25:12.952 38787== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-38787-by-root-on-??? 2024-09-12T18:35:58.518 INFO:tasks.rgw.client.0:Stopped 2024-09-12T18:35:58.519 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T18:35:58.525 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T18:35:58.583 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T18:35:58.638 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T18:35:58.639 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T18:35:58.639 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T18:35:58.720 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:35:58.720 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:35:58.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.757+0000 7f4eb342c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:58.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.761+0000 7f4eb342c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:58.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.761+0000 7f4eb342c9c0 20 realm 2024-09-12T18:35:58.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.761+0000 7f4eb342c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:58.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.761+0000 7f4eb342c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:58.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.761+0000 7f4eb342c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:35:58.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.761+0000 7f4eb342c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:58.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.761+0000 7f4eb342c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:58.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.761+0000 7f4eb342c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:58.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.761+0000 7f4eb342c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:35:58.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.761+0000 7f4eb342c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:58.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.765+0000 7f4eb342c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:35:58.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.765+0000 7f4eb342c9c0 20 searching for the correct realm 2024-09-12T18:35:58.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.769+0000 7f4eb1733640 0 -- 172.21.15.119:0/22423105 >> [v2:172.21.15.119:6808/4281878132,v1:172.21.15.119:6809/4281878132] conn(0x7f4ea401e060 msgr2=0x7f4ea4049060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:35:58.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.773+0000 7f4eb0731640 0 -- 172.21.15.119:0/22423105 >> [v2:172.21.15.119:6817/1487028232,v1:172.21.15.119:6820/1487028232] conn(0x7f4ea8131220 msgr2=0x7f4ea80fd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:35:58.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.989+0000 7f4eb342c9c0 20 RGWRados::pool_iterate: got zonegroup_info.45e6d2a9-5694-4df7-beda-6007c577e9d7 2024-09-12T18:35:58.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.989+0000 7f4eb342c9c0 20 RGWRados::pool_iterate: got zone_info.4832a6ae-eda0-431a-85d5-6b1af8837fa3 2024-09-12T18:35:58.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.989+0000 7f4eb342c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:35:58.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.989+0000 7f4eb342c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:35:58.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.989+0000 7f4eb342c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:35:58.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.989+0000 7f4eb342c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:35:58.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.989+0000 7f4eb342c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:58.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.989+0000 7f4eb342c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:58.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.989+0000 7f4eb342c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:58.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:35:58.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:58.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:35:58.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 20 zone default found 2024-09-12T18:35:58.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 4 Realm: () 2024-09-12T18:35:58.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 4 ZoneGroup: default (45e6d2a9-5694-4df7-beda-6007c577e9d7) 2024-09-12T18:35:58.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 4 Zone: default (4832a6ae-eda0-431a-85d5-6b1af8837fa3) 2024-09-12T18:35:58.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:35:58.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 20 zonegroup default 2024-09-12T18:35:58.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:58.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:58.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:58.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:58.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:58.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:58.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 20 started sync module instance, tier type = 2024-09-12T18:35:58.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:58.993+0000 7f4eb342c9c0 20 started zone id=4832a6ae-eda0-431a-85d5-6b1af8837fa3 (name=default) with tier type = 2024-09-12T18:35:59.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.017+0000 7f4eb342c9c0 20 add_watcher() i=0 2024-09-12T18:35:59.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.017+0000 7f4eb342c9c0 20 add_watcher() i=1 2024-09-12T18:35:59.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.017+0000 7f4eb342c9c0 20 add_watcher() i=2 2024-09-12T18:35:59.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.017+0000 7f4eb342c9c0 20 add_watcher() i=3 2024-09-12T18:35:59.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.017+0000 7f4eb342c9c0 20 add_watcher() i=4 2024-09-12T18:35:59.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.017+0000 7f4eb342c9c0 20 add_watcher() i=5 2024-09-12T18:35:59.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.017+0000 7f4eb342c9c0 20 add_watcher() i=6 2024-09-12T18:35:59.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.017+0000 7f4eb342c9c0 20 add_watcher() i=7 2024-09-12T18:35:59.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.017+0000 7f4eb342c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:35:59.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.021+0000 7f4d677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:35:59.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.021+0000 7f4eb342c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:35:59.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.021+0000 7f4eb342c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:35:59.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.117+0000 7f4d667e4640 20 reqs_thread_entry: start 2024-09-12T18:35:59.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.117+0000 7f4eb342c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:35:59.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.117+0000 7f4eb342c9c0 20 Filter name: none 2024-09-12T18:35:59.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.117+0000 7f4d5f7fe640 20 reqs_thread_entry: start 2024-09-12T18:35:59.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.117+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:35:59.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.121+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:35:59.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:35:59.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54168' 2024-09-12T18:35:59.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14008923265408654180', time=2024-09-12T19:56:15.520973+0000, chain.objs.size()=5 2024-09-12T18:35:59.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__multipart_foo-LUKEWARM.2~Uxu2hWZc7UshHM2AeRxKzcMGcASN6jp.1 2024-09-12T18:35:59.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_foo-LUKEWARM.2~Uxu2hWZc7UshHM2AeRxKzcMGcASN6jp.1_1 2024-09-12T18:35:59.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__multipart_foo-LUKEWARM.2~Uxu2hWZc7UshHM2AeRxKzcMGcASN6jp.2 2024-09-12T18:35:59.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_foo-LUKEWARM.2~Uxu2hWZc7UshHM2AeRxKzcMGcASN6jp.2_1 2024-09-12T18:35:59.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__multipart_foo-LUKEWARM.2~Uxu2hWZc7UshHM2AeRxKzcMGcASN6jp.3 2024-09-12T18:35:59.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15953804555391698722', time=2024-09-12T19:56:37.533172+0000, chain.objs.size()=1 2024-09-12T18:35:59.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.172__shadow_.HGxT0y_DNMtVLR3cqjMtO0F6WpND1qN_0 2024-09-12T18:35:59.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15152564903546799498', time=2024-09-12T20:00:16.993944+0000, chain.objs.size()=1 2024-09-12T18:35:59.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.232__shadow_.w2UiiXJpGoeaZJ8IoubQPJLBL9QFqsc_0 2024-09-12T18:35:59.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7686817893938090662', time=2024-09-12T20:00:28.048380+0000, chain.objs.size()=1 2024-09-12T18:35:59.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.238__shadow_.iRVW34GFswGJylBcoJTRHORFFd5lBxf_0 2024-09-12T18:35:59.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12331051809340777079', time=2024-09-12T20:00:59.931511+0000, chain.objs.size()=1 2024-09-12T18:35:59.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.256__shadow_.qs9xuVdLObA5X5jInBp5Mh21l6YF2LR_0 2024-09-12T18:35:59.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13276531823103498290', time=2024-09-12T20:01:03.175888+0000, chain.objs.size()=1 2024-09-12T18:35:59.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.258__shadow_.7Rv6YJElL3VSEXGd2dHB-Gco69IfpzC_0 2024-09-12T18:35:59.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14326569072638247222', time=2024-09-12T20:02:51.935053+0000, chain.objs.size()=1 2024-09-12T18:35:59.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Pn-lsRgAMCIpsqxDzeD9efHq2PkJ-wA_0 2024-09-12T18:35:59.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.125+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.686054968910465026', time=2024-09-12T20:02:53.445916+0000, chain.objs.size()=1 2024-09-12T18:35:59.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.129+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Bx2xy9buiNTd-6Hr9WvCpbGXK4Tv63y_0 2024-09-12T18:35:59.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.129+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16067110624257251761', time=2024-09-12T20:02:56.039634+0000, chain.objs.size()=1 2024-09-12T18:35:59.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.129+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XXFU2Ohp_iUWoT8mzIfv0X5ehv0Wx4z_0 2024-09-12T18:35:59.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.129+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1370302154759456580', time=2024-09-12T20:02:56.172189+0000, chain.objs.size()=1 2024-09-12T18:35:59.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.129+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.tBZrtJSZZxdoU4cCwgzkJHYUq52kuZd_0 2024-09-12T18:35:59.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.133+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4188064671636586009', time=2024-09-12T20:02:56.279490+0000, chain.objs.size()=1 2024-09-12T18:35:59.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.133+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.GUAZC-ZX8zkcooCacUA77-L7mworsB9_0 2024-09-12T18:35:59.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.133+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12063157978339069493', time=2024-09-12T20:02:58.012417+0000, chain.objs.size()=1 2024-09-12T18:35:59.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.133+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.rBcnV09aSRHM7M9r7MOTT9W47nw0HGD_0 2024-09-12T18:35:59.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.133+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2372895814958392357', time=2024-09-12T20:03:01.112341+0000, chain.objs.size()=1 2024-09-12T18:35:59.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.133+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3qeA33C6OFZRyDI7UAgRnNtRBHukS3P_0 2024-09-12T18:35:59.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.133+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12876330895061929023', time=2024-09-12T20:03:01.740511+0000, chain.objs.size()=1 2024-09-12T18:35:59.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.133+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.KJSvahqFkmjAr1Kk5Ols2KOkao7fU9c_0 2024-09-12T18:35:59.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.133+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7304977987395774747', time=2024-09-12T20:03:01.742352+0000, chain.objs.size()=1 2024-09-12T18:35:59.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.133+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.95pfj_gGE_tIq0JDDn3JHIeSRdr-t5O_0 2024-09-12T18:35:59.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.137+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10398466280164692402', time=2024-09-12T20:03:04.423523+0000, chain.objs.size()=1 2024-09-12T18:35:59.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.137+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3NrJhqUXpB3PSyFkAaTv-CBAKiNantS_0 2024-09-12T18:35:59.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.137+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9936157781430673134', time=2024-09-12T20:03:05.091034+0000, chain.objs.size()=1 2024-09-12T18:35:59.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.137+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.nKAd92AuiKhoyD4tdkVgJoyE2ligkBL_0 2024-09-12T18:35:59.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.137+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7561315658894086539', time=2024-09-12T20:03:05.158222+0000, chain.objs.size()=1 2024-09-12T18:35:59.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.137+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.jEb4SY92pQLf-7fMQFxUMhn84mOR89G_0 2024-09-12T18:35:59.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.137+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12404982218290410479', time=2024-09-12T20:03:06.250930+0000, chain.objs.size()=1 2024-09-12T18:35:59.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.137+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.V07prMC4o5G0hSyJK7UKkoE1081D2Oh_0 2024-09-12T18:35:59.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.137+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1333388370035503318', time=2024-09-12T20:03:07.597710+0000, chain.objs.size()=1 2024-09-12T18:35:59.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.137+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Jf-9cc9qbHSI5oHgy7gUwRCisLtGYex_0 2024-09-12T18:35:59.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.137+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18262971458290529772', time=2024-09-12T20:03:07.599563+0000, chain.objs.size()=1 2024-09-12T18:35:59.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.137+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.eIWFGBAT7z_jkQloZ-2yrS0g8BWjzvm_0 2024-09-12T18:35:59.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.145+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12550837884951553583', time=2024-09-12T20:03:08.144304+0000, chain.objs.size()=1 2024-09-12T18:35:59.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.145+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ofi10xepuXG0VzROsefwyHMxZ9ND9R1_0 2024-09-12T18:35:59.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.145+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11739206068241362208', time=2024-09-12T20:03:10.084729+0000, chain.objs.size()=1 2024-09-12T18:35:59.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.145+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2kvHwOTrHXCBZ62TqIFxHMK29RJp5DE_0 2024-09-12T18:35:59.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.145+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5598356484609031236', time=2024-09-12T20:03:11.770083+0000, chain.objs.size()=1 2024-09-12T18:35:59.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.145+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.keiSlX_OiK7i2KrH-FSeMUtcp42jX2__0 2024-09-12T18:35:59.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.149+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12256825769036282340', time=2024-09-12T20:03:15.751000+0000, chain.objs.size()=1 2024-09-12T18:35:59.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.149+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.DSkeBrD6QyzBL7aWjE-C3OVYQ4ZdqGN_0 2024-09-12T18:35:59.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.149+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15692298949822928552', time=2024-09-12T20:03:16.190723+0000, chain.objs.size()=1 2024-09-12T18:35:59.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.149+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.d8FCIE0uRdEuRWePFrPdSISz048wnKW_0 2024-09-12T18:35:59.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.149+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15077786549748264530', time=2024-09-12T20:03:16.565875+0000, chain.objs.size()=1 2024-09-12T18:35:59.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.149+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.jITiBYM7ezIcIwrhhWVTelS6SkEaChK_0 2024-09-12T18:35:59.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.149+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11135900936156480982', time=2024-09-12T20:03:18.549094+0000, chain.objs.size()=1 2024-09-12T18:35:59.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.149+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.y0u1FF1XFysyRjn9dvMRwhw-mHhZjIg_0 2024-09-12T18:35:59.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.149+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13066763764091556400', time=2024-09-12T20:03:18.692862+0000, chain.objs.size()=1 2024-09-12T18:35:59.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.149+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.UZ8b_qCaV1KDOEQo9__y0y8vH7g7Kd1_0 2024-09-12T18:35:59.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.149+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3128209919767816333', time=2024-09-12T20:03:19.693021+0000, chain.objs.size()=1 2024-09-12T18:35:59.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.149+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Om1NHQ00Lf8m_UjfyLuesCozKZUoA_r_0 2024-09-12T18:35:59.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.153+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15082559777530428802', time=2024-09-12T20:03:44.343622+0000, chain.objs.size()=1 2024-09-12T18:35:59.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.153+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.278__shadow_.G75Ga_x2mVtCOb1YfmAIMT84_Dei3kE_0 2024-09-12T18:35:59.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.153+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6365198666058427125', time=2024-09-12T20:03:47.681933+0000, chain.objs.size()=1 2024-09-12T18:35:59.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.153+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.280__shadow_.ZXH119JkVB9Vm704XjvZu8vRqynLbZ7_0 2024-09-12T18:35:59.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.153+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15464124941454772903', time=2024-09-12T20:03:56.154057+0000, chain.objs.size()=1 2024-09-12T18:35:59.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.153+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.285__shadow_.F97MktAwd6OzX7fC1KZC-2_9ncLM7xa_0 2024-09-12T18:35:59.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.153+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15506748781706074834', time=2024-09-12T20:04:17.958201+0000, chain.objs.size()=1 2024-09-12T18:35:59.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.153+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.JtZ78B6KtMd9WZOuWNpWD9ImpRLu4vw_0 2024-09-12T18:35:59.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.153+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9040784274745623148', time=2024-09-12T20:04:21.566641+0000, chain.objs.size()=1 2024-09-12T18:35:59.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.153+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.296__shadow_.gcUX81NOuyMHa79QRUHm0_bKdhJ4Zke_0 2024-09-12T18:35:59.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.157+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3464188098693119254', time=2024-09-12T20:04:28.571714+0000, chain.objs.size()=1 2024-09-12T18:35:59.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.157+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.300__shadow_.HpVzRsMyxwM3IrfF4TcbUll1YoXFwoZ_0 2024-09-12T18:35:59.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.161+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9888924947789351012', time=2024-09-12T20:06:52.927988+0000, chain.objs.size()=1 2024-09-12T18:35:59.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.161+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.pqrwhdqwm1kIA6Snu72j23iAoon2rK1_0 2024-09-12T18:35:59.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.161+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15867191139763401879', time=2024-09-12T20:06:53.850460+0000, chain.objs.size()=1 2024-09-12T18:35:59.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.161+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.K7CZ_acuxXW5-udjXxGaU8exjjxyWG5_0 2024-09-12T18:35:59.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.161+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13863816634020548370', time=2024-09-12T20:06:56.001894+0000, chain.objs.size()=1 2024-09-12T18:35:59.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.161+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.MJhqbhinnB1X37Nz-D-ZOJ3q3pxQQ8A_0 2024-09-12T18:35:59.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.161+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15324048501310552792', time=2024-09-12T20:06:56.766180+0000, chain.objs.size()=1 2024-09-12T18:35:59.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.161+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.vnAF0c_x272j27KzZWp7omqAqaSvSvK_0 2024-09-12T18:35:59.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.161+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17871859871014347116', time=2024-09-12T20:06:59.115885+0000, chain.objs.size()=1 2024-09-12T18:35:59.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.161+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.468xTYndz0wWX9uFxPCjcs9Jf5ENvSJ_0 2024-09-12T18:35:59.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.161+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7484293993909706528', time=2024-09-12T20:07:01.389715+0000, chain.objs.size()=1 2024-09-12T18:35:59.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.161+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-x5KpnV4odpYJG7nA7lgY91MFs7IfhX_0 2024-09-12T18:35:59.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.161+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7529836351701833915', time=2024-09-12T20:07:02.627247+0000, chain.objs.size()=1 2024-09-12T18:35:59.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.161+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ur7fEpFoKn73nsDrPn1PyZ_xeCKQ3OK_0 2024-09-12T18:35:59.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.165+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4262669522431021748', time=2024-09-12T20:07:03.095838+0000, chain.objs.size()=1 2024-09-12T18:35:59.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.165+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.gmT6v1wM2mqhhVOVXIlpdZd_yIl22E0_0 2024-09-12T18:35:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.165+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10854074710629959606', time=2024-09-12T20:07:03.323769+0000, chain.objs.size()=1 2024-09-12T18:35:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.165+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Gzmv5VIbfNZZqU_UYQV2ku1to546CrY_0 2024-09-12T18:35:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.165+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7398562331229959638', time=2024-09-12T20:07:04.886419+0000, chain.objs.size()=1 2024-09-12T18:35:59.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.165+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.L_bXnYm77o7pi7Cu01YxY2cT2S1Xnn6_0 2024-09-12T18:35:59.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.165+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5664999224068428647', time=2024-09-12T20:07:05.049885+0000, chain.objs.size()=1 2024-09-12T18:35:59.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.165+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Zvp-I23E9q03X_wZGpjcSGqD-sDYFW__0 2024-09-12T18:35:59.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.169+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9236919921423580784', time=2024-09-12T20:07:05.238020+0000, chain.objs.size()=1 2024-09-12T18:35:59.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.169+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7bXK1hj5mWHUKnWQg4jEhqwrqP0ljlD_0 2024-09-12T18:35:59.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.169+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2847074923097155203', time=2024-09-12T20:07:05.283419+0000, chain.objs.size()=1 2024-09-12T18:35:59.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.169+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.XMo7nJb1Bu2rk30UDTg4q_90nmLcDgB_0 2024-09-12T18:35:59.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.169+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4851084592901559294', time=2024-09-12T20:07:07.849443+0000, chain.objs.size()=1 2024-09-12T18:35:59.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.169+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.dXj1V-vf5586Epckxv4sejRqa0FNf_q_0 2024-09-12T18:35:59.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12688638101317969167', time=2024-09-12T20:07:08.360447+0000, chain.objs.size()=1 2024-09-12T18:35:59.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Z030iC6UPGXAp9tz_3j4_qAJzOqi5Ic_0 2024-09-12T18:35:59.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9318893597897871835', time=2024-09-12T20:07:08.588976+0000, chain.objs.size()=1 2024-09-12T18:35:59.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.bkX-gSTdtfTE10vUQe-gw2Wh3qS-ifX_0 2024-09-12T18:35:59.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4043632022528185596', time=2024-09-12T20:07:10.939532+0000, chain.objs.size()=1 2024-09-12T18:35:59.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Jp3yIbjjpwWYyAgCWY3wn1yeaGRN1Mh_0 2024-09-12T18:35:59.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10965326633034587366', time=2024-09-12T20:07:11.048586+0000, chain.objs.size()=1 2024-09-12T18:35:59.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.uEu_xQy03uT0MzS_mJC5hRN589Q1cRT_0 2024-09-12T18:35:59.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10930341905017655780', time=2024-09-12T20:07:11.984822+0000, chain.objs.size()=1 2024-09-12T18:35:59.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ZiHJy2oPNaewCy8mYcWjmWtk0QyRteC_0 2024-09-12T18:35:59.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3060210604272174792', time=2024-09-12T20:07:12.113661+0000, chain.objs.size()=1 2024-09-12T18:35:59.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.YVSdEQQSM1CZG2XV_jJsb1PeZ6BVAgK_0 2024-09-12T18:35:59.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17743463015814575327', time=2024-09-12T20:07:13.353057+0000, chain.objs.size()=1 2024-09-12T18:35:59.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ZmwqMFop9WYVgBMDj1bSZ62WDO3jEqC_0 2024-09-12T18:35:59.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14136644699503417062', time=2024-09-12T20:07:14.330199+0000, chain.objs.size()=1 2024-09-12T18:35:59.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.3AXI3NBsP2a9HljtgE7RxfWlOntZJ6i_0 2024-09-12T18:35:59.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8541674260463833005', time=2024-09-12T20:07:15.146913+0000, chain.objs.size()=1 2024-09-12T18:35:59.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.173+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.lL-zMwoNx2DdK8l3rAMTUuAe4IJpog6_0 2024-09-12T18:35:59.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.181+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12414707128994899676', time=2024-09-12T20:07:17.261640+0000, chain.objs.size()=1 2024-09-12T18:35:59.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.181+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.2gnSWkkJfQGg0gKsANguNwfP8sHluGO_0 2024-09-12T18:35:59.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.181+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17469155393387037360', time=2024-09-12T20:07:18.451703+0000, chain.objs.size()=1 2024-09-12T18:35:59.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.181+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.O7mwe9lw4JH_j3_xXfez2w0osKTNEf2_0 2024-09-12T18:35:59.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8326434445459843656', time=2024-09-12T20:07:18.453645+0000, chain.objs.size()=1 2024-09-12T18:35:59.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.8Xc1er3Io_06T49xKmvtuBq2bmbBWTO_0 2024-09-12T18:35:59.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1312737503163088866', time=2024-09-12T20:07:19.001469+0000, chain.objs.size()=1 2024-09-12T18:35:59.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.tGsdotV4XLSsA-JNgQpQg4gaicD1zzk_0 2024-09-12T18:35:59.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14066403885312312810', time=2024-09-12T20:07:19.162564+0000, chain.objs.size()=1 2024-09-12T18:35:59.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.pmWuDJ3bmZZ6edM4iyRFfpYQg2a7iMt_0 2024-09-12T18:35:59.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3218937250474166494', time=2024-09-12T20:09:04.534146+0000, chain.objs.size()=1 2024-09-12T18:35:59.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.NeyMWNW8ObD4PcD9pDblLj3tJjtVSJG_0 2024-09-12T18:35:59.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15137951293960771413', time=2024-09-12T20:09:08.305235+0000, chain.objs.size()=1 2024-09-12T18:35:59.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.W7kp92Sf6Jg_JEFVDzNGbzsyoQ3AcNm_0 2024-09-12T18:35:59.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1531428969875398157', time=2024-09-12T20:09:08.308998+0000, chain.objs.size()=1 2024-09-12T18:35:59.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.hPho0n7HLZIasDuFnCbs1dBmZqUOgPe_0 2024-09-12T18:35:59.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10056397650366782304', time=2024-09-12T20:09:09.534559+0000, chain.objs.size()=1 2024-09-12T18:35:59.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.kRt27hfsEabXPlbCyVTKAsA2vVyps-z_0 2024-09-12T18:35:59.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17786303371356583236', time=2024-09-12T20:09:09.567138+0000, chain.objs.size()=1 2024-09-12T18:35:59.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.EXTDA2zVUV3hf8hXJtVFrdlm8X-wjvo_0 2024-09-12T18:35:59.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570031283318981940', time=2024-09-12T20:09:10.170228+0000, chain.objs.size()=1 2024-09-12T18:35:59.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.185+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Qq6wYG7-ZnrmlcvX6K7jjY6eS3CwRqw_0 2024-09-12T18:35:59.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.193+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6747794582955251678', time=2024-09-12T20:09:10.767549+0000, chain.objs.size()=1 2024-09-12T18:35:59.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.193+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.qm48_ogalzs-jOzMwTt3mG4S0RqNJsE_0 2024-09-12T18:35:59.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.193+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10002901238661316245', time=2024-09-12T20:09:15.089324+0000, chain.objs.size()=1 2024-09-12T18:35:59.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.193+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.CF43J_PLqx8rAKcYM4unZpO14excDLB_0 2024-09-12T18:35:59.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.193+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16031262712728187313', time=2024-09-12T20:09:15.358407+0000, chain.objs.size()=1 2024-09-12T18:35:59.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.193+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.UoPqs_kEA5cYmEKmNWTXQ3eMk2nu1Iw_0 2024-09-12T18:35:59.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.193+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5004058716754727446', time=2024-09-12T20:09:15.865323+0000, chain.objs.size()=1 2024-09-12T18:35:59.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.193+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.fY2Ih5X_Xa25NlJlHS2exnl7cnF223k_0 2024-09-12T18:35:59.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7427886338247449324', time=2024-09-12T20:09:17.812174+0000, chain.objs.size()=1 2024-09-12T18:35:59.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.JWnWc3YdVG5ZGKTGJDfJCgx_gE7VbmD_0 2024-09-12T18:35:59.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4621820255603322455', time=2024-09-12T20:09:18.507323+0000, chain.objs.size()=1 2024-09-12T18:35:59.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.UsInc50Kcc2bU2Vr9oV0HrrR4Cn1PN3_0 2024-09-12T18:35:59.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5347127220616121115', time=2024-09-12T20:09:19.337382+0000, chain.objs.size()=1 2024-09-12T18:35:59.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cVAeoJ-nl8Ed-mrSYT6ig2pwEG_9r9K_0 2024-09-12T18:35:59.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9864730494714223688', time=2024-09-12T20:09:19.810511+0000, chain.objs.size()=1 2024-09-12T18:35:59.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Ufpzte2HY3G7QxdPmakbwsCvRXHbu-e_0 2024-09-12T18:35:59.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9896860223958728652', time=2024-09-12T20:09:20.989138+0000, chain.objs.size()=1 2024-09-12T18:35:59.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.pzzoUyVsPM5SoSswTK35W6nAwO5mpxh_0 2024-09-12T18:35:59.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14795876475066555769', time=2024-09-12T20:09:21.279764+0000, chain.objs.size()=1 2024-09-12T18:35:59.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Y0X9OByzagUiiDihIrRw1La_SPVGI58_0 2024-09-12T18:35:59.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8085543164895779690', time=2024-09-12T20:09:21.282887+0000, chain.objs.size()=1 2024-09-12T18:35:59.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.i20lhuZpW1dEe_zvAiLh3CiavYTbXch_0 2024-09-12T18:35:59.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9729658746393527160', time=2024-09-12T20:09:21.413584+0000, chain.objs.size()=1 2024-09-12T18:35:59.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.yauTTGhx4m4j5XgdaWo4tJyi6QM1cv5_0 2024-09-12T18:35:59.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18392604788416194407', time=2024-09-12T20:09:23.713305+0000, chain.objs.size()=1 2024-09-12T18:35:59.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.58fzOBpVE9CsKSE-OJvf69HQbmHhr7k_0 2024-09-12T18:35:59.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5079894667281438978', time=2024-09-12T20:09:25.693410+0000, chain.objs.size()=1 2024-09-12T18:35:59.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.EcwZL2qsFUl4vgJs6MjzHZ_DSXXguSE_0 2024-09-12T18:35:59.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2549372293293177734', time=2024-09-12T20:09:26.147992+0000, chain.objs.size()=1 2024-09-12T18:35:59.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.NOGgNuvoZk38gqEtI_gVjcQiKRkL5F5_0 2024-09-12T18:35:59.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15076360414024830471', time=2024-09-12T20:09:26.982590+0000, chain.objs.size()=1 2024-09-12T18:35:59.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.QsD5Z50knzGZ7qeRxPtCDAboAAgdX0G_0 2024-09-12T18:35:59.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3295218122292247825', time=2024-09-12T20:09:28.085963+0000, chain.objs.size()=1 2024-09-12T18:35:59.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.W9I6YSddnfDK5kohYMP40jQLEO_uMj__0 2024-09-12T18:35:59.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6807620498841268321', time=2024-09-12T20:09:28.354887+0000, chain.objs.size()=1 2024-09-12T18:35:59.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.PibghMjw8OFdsyOHc5QWE55uGVkOLo7_0 2024-09-12T18:35:59.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12536852408510559345', time=2024-09-12T20:09:28.525761+0000, chain.objs.size()=1 2024-09-12T18:35:59.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.f3iHO1qNwoBcevF4BJecwSdajGp32TS_0 2024-09-12T18:35:59.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11037755739449930801', time=2024-09-12T20:09:29.189469+0000, chain.objs.size()=1 2024-09-12T18:35:59.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.PJpUW-YTCxcoP42Za7g1oljr08ri8rq_0 2024-09-12T18:35:59.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17161782188935015694', time=2024-09-12T20:09:30.236202+0000, chain.objs.size()=1 2024-09-12T18:35:59.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.201+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ncvjZj1iu74QzsFwERxyh_WRYm0_iCa_0 2024-09-12T18:35:59.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.205+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16328786009064352464', time=2024-09-12T20:11:23.219706+0000, chain.objs.size()=1 2024-09-12T18:35:59.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.205+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.411__shadow_.NVNQr6RPqbsaaNOtFHO-_F2EXzD4Brm_0 2024-09-12T18:35:59.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.205+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3624939814199885809', time=2024-09-12T20:16:20.600504+0000, chain.objs.size()=6 2024-09-12T18:35:59.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.205+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.YBALrmPDBqQNRoscOUX5cmPXsROl5cp1.1 2024-09-12T18:35:59.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.205+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.bMnlT3ixoivsnwrY_PbWA0AzTUYoQm5i.2 2024-09-12T18:35:59.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.205+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.UDEGz9183MLByo_4Wexs0AdU7EK20l_3.3 2024-09-12T18:35:59.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.209+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.iN0ynO9-YaLHN38cZK453VjwAN5vW9a5.4 2024-09-12T18:35:59.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.209+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.lJfji1Ldp-eCRRMk4AfxK7g2G7Wagdqk.5 2024-09-12T18:35:59.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.209+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.CTkx9euQj6DNSe0gJaFqxfQ_GKuH-1Z3.6 2024-09-12T18:35:59.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.213+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4959959343974588356', time=2024-09-12T20:18:48.282350+0000, chain.objs.size()=1 2024-09-12T18:35:59.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.213+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.562__multipart_mymultipart.sRabmJnmxFsvbiSok_E-SrdfxSF0j6gY.1 2024-09-12T18:35:59.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.213+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8457616147034727110', time=2024-09-12T20:19:12.402012+0000, chain.objs.size()=1 2024-09-12T18:35:59.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.213+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:x4BWBvH7BpDKsYDsfGy2yqniudPRA0Q_.bhtIQdxCOE_uLo-BMUdcaGMCWAZUK2D_0 2024-09-12T18:35:59.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.213+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4550298506784430091', time=2024-09-12T20:19:29.302901+0000, chain.objs.size()=1 2024-09-12T18:35:59.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.213+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.571__shadow:8-J2cfddigwOS1Yd1J8I1.1yFn50eyf_.SUwefuXgR8eKiJ71NHZG7vJ-zs9p9aZ_0 2024-09-12T18:35:59.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.213+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11359570117791606464', time=2024-09-12T20:20:12.373230+0000, chain.objs.size()=1 2024-09-12T18:35:59.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.213+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:BUJ15ZxAHuEsQ.R21p3buQoD.1NG7dR_.7CX5O2gv-Fo5lFgYqjHML4U3UcDOSoN_0 2024-09-12T18:35:59.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.213+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5498813063242468249', time=2024-09-12T20:20:26.547288+0000, chain.objs.size()=1 2024-09-12T18:35:59.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.213+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:6a1rjriB9C1vIECLtvx.Rj9FjgLLFtJ_.fQ50O_4qj45OFbN0lIoYgCfWbWboTWO_0 2024-09-12T18:35:59.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.213+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10870602541989913655', time=2024-09-12T20:21:00.993763+0000, chain.objs.size()=4 2024-09-12T18:35:59.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.213+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__multipart_testobj.2~qmQQqHoxWuc_Ne7QB6W7VKe1HnOSYX0.1 2024-09-12T18:35:59.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.213+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__multipart_testobj.2~qmQQqHoxWuc_Ne7QB6W7VKe1HnOSYX0.2 2024-09-12T18:35:59.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.213+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__multipart_testobj.2~qmQQqHoxWuc_Ne7QB6W7VKe1HnOSYX0.3 2024-09-12T18:35:59.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.217+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__multipart_testobj.2~qmQQqHoxWuc_Ne7QB6W7VKe1HnOSYX0.4 2024-09-12T18:35:59.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.217+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12860188267300781361', time=2024-09-12T20:21:39.033564+0000, chain.objs.size()=1 2024-09-12T18:35:59.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.217+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.597__shadow_.rqCC-03oLDwJJDPS8ITOk-KdB0CMlb6_0 2024-09-12T18:35:59.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.225+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54168 2024-09-12T18:35:59.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:35:59.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11057959305600473530', time=2024-09-12T20:26:41.108788+0000, chain.objs.size()=1 2024-09-12T18:35:59.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.637__shadow_.y9kCIy2CwJCp4bugpwwCo1D5N_0ebZT_0 2024-09-12T18:35:59.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17380608065553177802', time=2024-09-12T20:27:55.955176+0000, chain.objs.size()=1 2024-09-12T18:35:59.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.666__shadow_.nGeH4EGbsUlUBGs72QHQG1A8iYX4AlT_0 2024-09-12T18:35:59.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.126551042052809752', time=2024-09-12T20:28:05.153837+0000, chain.objs.size()=1 2024-09-12T18:35:59.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.672__shadow_.ur_uz-EdBI8gledLeezlHnGs736b3mS_0 2024-09-12T18:35:59.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8788282185086635444', time=2024-09-12T20:28:49.301510+0000, chain.objs.size()=1 2024-09-12T18:35:59.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.705__shadow:1af2zUJ7CU3EweeB5ZIoScjQAZbkz9-_.Nq5KIJt2iUSwRWMRNCCCzB_bSIGOzrM_0 2024-09-12T18:35:59.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17578755729028156956', time=2024-09-12T20:30:01.911500+0000, chain.objs.size()=20 2024-09-12T18:35:59.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__multipart_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.1 2024-09-12T18:35:59.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__shadow_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.1_1 2024-09-12T18:35:59.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__multipart_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.2 2024-09-12T18:35:59.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__shadow_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.2_1 2024-09-12T18:35:59.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__multipart_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.3 2024-09-12T18:35:59.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__shadow_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.3_1 2024-09-12T18:35:59.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__multipart_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.4 2024-09-12T18:35:59.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.229+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__shadow_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.4_1 2024-09-12T18:35:59.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.233+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__multipart_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.5 2024-09-12T18:35:59.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.233+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__shadow_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.5_1 2024-09-12T18:35:59.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__multipart_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.6 2024-09-12T18:35:59.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__shadow_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.6_1 2024-09-12T18:35:59.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__multipart_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.7 2024-09-12T18:35:59.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__shadow_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.7_1 2024-09-12T18:35:59.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__multipart_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.8 2024-09-12T18:35:59.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__shadow_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.8_1 2024-09-12T18:35:59.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__multipart_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.9 2024-09-12T18:35:59.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__shadow_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.9_1 2024-09-12T18:35:59.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__multipart_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.10 2024-09-12T18:35:59.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.241+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736__shadow_foo.2~OZeiNrKFwA3GwjeAgxK19ZVtIIN2RPJ.10_1 2024-09-12T18:35:59.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.249+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:35:59.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.257+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:35:59.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:35:59.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:35:59.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/56497' 2024-09-12T18:35:59.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12162252857728498923', time=2024-09-12T19:56:00.281746+0000, chain.objs.size()=3 2024-09-12T18:35:59.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160__multipart_mymultipart-STANDARD.2~h3xGlvD15RWXKi7QoauYYImcAFzCxHD.1 2024-09-12T18:35:59.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160__multipart_mymultipart-STANDARD.2~h3xGlvD15RWXKi7QoauYYImcAFzCxHD.2 2024-09-12T18:35:59.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160__multipart_mymultipart-STANDARD.2~h3xGlvD15RWXKi7QoauYYImcAFzCxHD.3 2024-09-12T18:35:59.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_AARdwTWlP40BdRH2rmuHuuSp6vCWxMI', time=2024-09-12T19:56:09.257555+0000, chain.objs.size()=1 2024-09-12T18:35:59.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.6fGH9jmR_i9-Nvu7AqHySytzayYcCcw_0 2024-09-12T18:35:59.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_TMO4Znsege5TYgQ4EqjZ6OQXfEP89Rw', time=2024-09-12T19:56:12.400514+0000, chain.objs.size()=1 2024-09-12T18:35:59.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_.cLoIgnmqDiDFoQeujbrdb338D47hquo_0 2024-09-12T18:35:59.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9914198255699622341', time=2024-09-12T19:56:31.736317+0000, chain.objs.size()=1 2024-09-12T18:35:59.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.167__shadow_.2hqmCMx0xr0PUwE44u3mC8NznR9I2N7_0 2024-09-12T18:35:59.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14396581910328744641', time=2024-09-12T19:56:49.555011+0000, chain.objs.size()=1 2024-09-12T18:35:59.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.177__shadow_.xWwyy4opgfX5QPb-Gi0NhNkilkIlMR5_0 2024-09-12T18:35:59.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14608522741579135077', time=2024-09-12T20:00:34.838331+0000, chain.objs.size()=1 2024-09-12T18:35:59.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.242__shadow_.LManRd9bRsERO6lvyfiPhDe2JqhtgxZ_0 2024-09-12T18:35:59.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10458873556635876552', time=2024-09-12T20:00:44.860369+0000, chain.objs.size()=1 2024-09-12T18:35:59.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.247__shadow_.pNdHtC9NEyP6xtjcmtgH0vwS-X8zwtp_0 2024-09-12T18:35:59.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10840097953040821354', time=2024-09-12T20:00:58.303867+0000, chain.objs.size()=1 2024-09-12T18:35:59.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.255__shadow_.yqy7L7kT6_EGGopkUDpF-wy5BQgbLv__0 2024-09-12T18:35:59.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12209104411254375901', time=2024-09-12T20:01:06.319744+0000, chain.objs.size()=1 2024-09-12T18:35:59.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.260__shadow_.tfHTLvyJyoQvf3s9JisaCjpN9zllHAh_0 2024-09-12T18:35:59.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2744922269352525079', time=2024-09-12T20:02:52.649728+0000, chain.objs.size()=1 2024-09-12T18:35:59.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.261+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.xWCohL1M0NPFtBBG3I-rQy2Of7LcvoV_0 2024-09-12T18:35:59.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.265+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12371101760776484153', time=2024-09-12T20:02:53.991520+0000, chain.objs.size()=1 2024-09-12T18:35:59.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.265+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.jUmNWZCOGp-YlJ7RETueHpht9wMcHvB_0 2024-09-12T18:35:59.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14353576255234367963', time=2024-09-12T20:02:54.335531+0000, chain.objs.size()=1 2024-09-12T18:35:59.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.6-R4KEp7dYm9-A0195GkG3R5MuKhVuP_0 2024-09-12T18:35:59.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17943033958837386050', time=2024-09-12T20:02:56.418264+0000, chain.objs.size()=1 2024-09-12T18:35:59.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.4QjEmkKzZXskYGvyGhSVRCQmvsdc7V1_0 2024-09-12T18:35:59.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15672996642367567181', time=2024-09-12T20:02:56.543443+0000, chain.objs.size()=1 2024-09-12T18:35:59.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.pGp6qsjeMGV827OE3dhKFUezkeXyYpJ_0 2024-09-12T18:35:59.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16431303879621039292', time=2024-09-12T20:02:57.814365+0000, chain.objs.size()=1 2024-09-12T18:35:59.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.jRiIUR2MdFCHnOKrx7lMw62xtozac4k_0 2024-09-12T18:35:59.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6448547565315395705', time=2024-09-12T20:02:59.877680+0000, chain.objs.size()=1 2024-09-12T18:35:59.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XUyg7V2cYKd0FihWIO2vuOecRUAAISy_0 2024-09-12T18:35:59.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11560212768768036802', time=2024-09-12T20:02:59.879188+0000, chain.objs.size()=1 2024-09-12T18:35:59.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.d8phsYOsNhrl1QZJwcFDe6oqTEwdoUf_0 2024-09-12T18:35:59.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18323027599110127539', time=2024-09-12T20:03:01.114728+0000, chain.objs.size()=1 2024-09-12T18:35:59.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.tCHWRpY5Db7utYGOeWOMuyosUP04o_2_0 2024-09-12T18:35:59.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15050231026533924804', time=2024-09-12T20:03:01.575632+0000, chain.objs.size()=1 2024-09-12T18:35:59.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.12CJ7QLUUTYCvLWJPD8sTCF8dlYHaYF_0 2024-09-12T18:35:59.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1431697176211565757', time=2024-09-12T20:03:02.475641+0000, chain.objs.size()=1 2024-09-12T18:35:59.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.lHhMZt9jpQFooq21WJBNas12DEFRlNS_0 2024-09-12T18:35:59.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12370814889075953795', time=2024-09-12T20:03:07.802992+0000, chain.objs.size()=1 2024-09-12T18:35:59.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.cNPgWp3RTzsQqdYhh4xheeyNVm8OVLx_0 2024-09-12T18:35:59.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15584818109081519025', time=2024-09-12T20:03:08.106400+0000, chain.objs.size()=1 2024-09-12T18:35:59.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.269+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Ue-RYKsFJLIQV922lj7rGPJ1bxxIHG3_0 2024-09-12T18:35:59.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.273+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5203136630181003458', time=2024-09-12T20:03:08.588937+0000, chain.objs.size()=1 2024-09-12T18:35:59.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.273+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.4ACQ2mDwsqAghSEX9ZgKx_eJusN7Fx7_0 2024-09-12T18:35:59.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.273+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18161168069724591468', time=2024-09-12T20:03:09.926419+0000, chain.objs.size()=1 2024-09-12T18:35:59.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.273+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.F9o77XWkWGovfoqRGbH6hUuyZp37qrW_0 2024-09-12T18:35:59.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.273+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16789102531475543997', time=2024-09-12T20:03:09.928332+0000, chain.objs.size()=1 2024-09-12T18:35:59.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.273+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.FjSZS8fIjQmHewYM4n3CLUMEwq12pC0_0 2024-09-12T18:35:59.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.277+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13198819863425955088', time=2024-09-12T20:03:11.925091+0000, chain.objs.size()=1 2024-09-12T18:35:59.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.277+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.9rZyNcyhR-ePGEzAec_-9y7i7tcN9U2_0 2024-09-12T18:35:59.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.277+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3265885319112902651', time=2024-09-12T20:03:12.190156+0000, chain.objs.size()=1 2024-09-12T18:35:59.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.277+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.riC_wC35OUyZAoykJntynZm_wFtzffw_0 2024-09-12T18:35:59.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.277+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4062876106951265231', time=2024-09-12T20:03:12.423856+0000, chain.objs.size()=1 2024-09-12T18:35:59.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.277+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.SIojOo6hEXi9k0qHGg81CaWoNM1t4zV_0 2024-09-12T18:35:59.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.277+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12609231707947896351', time=2024-09-12T20:03:12.814776+0000, chain.objs.size()=1 2024-09-12T18:35:59.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.277+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Hr0pBLU3Vi-jWPqCROr6o3BFm6NaLRs_0 2024-09-12T18:35:59.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.277+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17797025669319031430', time=2024-09-12T20:03:15.181739+0000, chain.objs.size()=1 2024-09-12T18:35:59.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.277+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.OHo8crNMLyBHqa45-HG6AFBuwSlPpOr_0 2024-09-12T18:35:59.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.277+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10505756010545771747', time=2024-09-12T20:03:16.173563+0000, chain.objs.size()=1 2024-09-12T18:35:59.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.277+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Ce4YOKg185ElxNIdmX6lGTyseoaExzh_0 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.277+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1505420385727475099', time=2024-09-12T20:03:16.501478+0000, chain.objs.size()=1 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.277+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.v0tqWWUDNhYpUpssUWgydh9L_FOigJZ_0 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.277+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67959326889706228', time=2024-09-12T20:03:18.115891+0000, chain.objs.size()=1 2024-09-12T18:35:59.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.277+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.LuUwd3bQnFW_--JDtXs66u59el6jdNd_0 2024-09-12T18:35:59.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.281+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.134286257079969106', time=2024-09-12T20:03:19.441022+0000, chain.objs.size()=1 2024-09-12T18:35:59.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.281+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.xiLood984VIUBVJw-8ArOC3nOS3tLsG_0 2024-09-12T18:35:59.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.281+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4197232475626023881', time=2024-09-12T20:03:19.874237+0000, chain.objs.size()=1 2024-09-12T18:35:59.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.281+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.bJ38s3R9WGiIvyGZz347WC_-I1k4fdG_0 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.281+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14519094487584399971', time=2024-09-12T20:03:42.686446+0000, chain.objs.size()=1 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.281+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.277__shadow_.2Z50zfzr4z-X7e2hvlOhJntCEwTVOzo_0 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.285+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12478330345377165229', time=2024-09-12T20:03:54.449563+0000, chain.objs.size()=1 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.285+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.284__shadow_.V0jGKpFq0gRSnrVpdY3-1ggTRjTk3-K_0 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.285+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6361661644764599074', time=2024-09-12T20:03:54.451727+0000, chain.objs.size()=1 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.285+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.284__shadow_.9FTQTSHzaqJTKQHUSjeVFG3hk8yThLu_0 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.285+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11836904524723642093', time=2024-09-12T20:03:56.117449+0000, chain.objs.size()=1 2024-09-12T18:35:59.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.285+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.285__shadow_.0T-XgMSUFi4mJ5_T2kZGbP4yxNOyB3u_0 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.285+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15621225403676114978', time=2024-09-12T20:04:13.164477+0000, chain.objs.size()=1 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.285+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.C9nsp_eUJ1kHUGZ32e1lLMy5SERy9mq_0 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.285+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.457878170939204124', time=2024-09-12T20:04:18.229500+0000, chain.objs.size()=1 2024-09-12T18:35:59.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.285+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.9_d-_bFx69fWMDmfAXPoHhr3p_fffp6_0 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.285+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10784549218102297807', time=2024-09-12T20:04:23.242793+0000, chain.objs.size()=1 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.285+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.297__shadow_.kIxR0XXSRI7AxU4r0W-iJYwBFhdptcr_0 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.285+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3414166823760910339', time=2024-09-12T20:04:28.556868+0000, chain.objs.size()=1 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.285+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.300__shadow_.8ep08LG-oib6WezENUJykKLmhdDCv4t_0 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.285+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3555046742609669006', time=2024-09-12T20:04:33.566877+0000, chain.objs.size()=1 2024-09-12T18:35:59.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.285+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.303__shadow_.WK20jELoPO50Lc8dOVzeL0dlThHnEqN_0 2024-09-12T18:35:59.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.289+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12609803177145977340', time=2024-09-12T20:06:50.920261+0000, chain.objs.size()=1 2024-09-12T18:35:59.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.289+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Bk4Q7uNKYgNIteSRGlH459lKSSrPy0E_0 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.289+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3669324149552669346', time=2024-09-12T20:06:51.521119+0000, chain.objs.size()=1 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.289+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.sS-DGNd85NodWv47WaEkyWgg4bHtMwl_0 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.289+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8910009256069043375', time=2024-09-12T20:06:51.523798+0000, chain.objs.size()=1 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.289+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.P1GJrGy5hrWnziZQAb-R7SrHozE6ywh_0 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.289+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4680282519439102333', time=2024-09-12T20:06:52.195867+0000, chain.objs.size()=1 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.289+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.QVOZw41LNBWkrM9nXR_w60KWnAvVjEp_0 2024-09-12T18:35:59.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.289+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18265971832106122229', time=2024-09-12T20:06:53.405509+0000, chain.objs.size()=1 2024-09-12T18:35:59.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.289+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.13pPQzlSCPTgVUhefI_V7fVJiKvXDW4_0 2024-09-12T18:35:59.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.293+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7881107308706464313', time=2024-09-12T20:06:56.540334+0000, chain.objs.size()=1 2024-09-12T18:35:59.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.293+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.xky-3yv6RFRx8fN_y2_kvoIIeVCk0Wd_0 2024-09-12T18:35:59.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.293+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6588478082803817660', time=2024-09-12T20:06:56.709872+0000, chain.objs.size()=1 2024-09-12T18:35:59.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.293+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-8YYiJqrnC78A-RZt2gJLeLBGNYtS_3_0 2024-09-12T18:35:59.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.293+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10188071503210515192', time=2024-09-12T20:06:57.215135+0000, chain.objs.size()=1 2024-09-12T18:35:59.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.293+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.a1nBnpdi5dqG7GRsDrIcF6ss3eKiPxb_0 2024-09-12T18:35:59.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.293+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2815143092461912354', time=2024-09-12T20:06:57.509732+0000, chain.objs.size()=1 2024-09-12T18:35:59.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.293+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.tWYqVO7dxgwA2jkTisXolPba9N-KbB4_0 2024-09-12T18:35:59.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.293+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11317312492940071882', time=2024-09-12T20:06:57.664792+0000, chain.objs.size()=1 2024-09-12T18:35:59.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.293+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.sjWplWowCeewzlyL6-9xYGJK8bOy_3Y_0 2024-09-12T18:35:59.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.293+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18344231516069237599', time=2024-09-12T20:06:59.239096+0000, chain.objs.size()=1 2024-09-12T18:35:59.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.293+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.vfJHctlKAFyjHY2O67s6WCPc1eYG1cp_0 2024-09-12T18:35:59.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.293+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2403973354880895023', time=2024-09-12T20:06:59.333820+0000, chain.objs.size()=1 2024-09-12T18:35:59.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.293+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.yL3JvUCEO1N6X2zfu6oCqcqinhxutDB_0 2024-09-12T18:35:59.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.297+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8326511555758609527', time=2024-09-12T20:07:01.077581+0000, chain.objs.size()=1 2024-09-12T18:35:59.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.297+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.X0TPE9nJ7jKPMlEnINODycNGvXQOFYz_0 2024-09-12T18:35:59.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.297+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1532178703086082676', time=2024-09-12T20:07:01.618754+0000, chain.objs.size()=1 2024-09-12T18:35:59.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.297+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.UjFp4o3aA1igvNnTp8jGiV1ti0R_A9g_0 2024-09-12T18:35:59.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.297+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9825355833385997888', time=2024-09-12T20:07:03.787980+0000, chain.objs.size()=1 2024-09-12T18:35:59.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.297+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.DYwU1D_kMoleNFqE-EKR8RFWZu3KLl3_0 2024-09-12T18:35:59.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.297+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2623358034739466326', time=2024-09-12T20:07:04.723621+0000, chain.objs.size()=1 2024-09-12T18:35:59.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.297+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.A0-IbVLhnwsyt2MZC_0SHjsrudnMdB1_0 2024-09-12T18:35:59.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.297+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16588460378719218755', time=2024-09-12T20:07:05.142999+0000, chain.objs.size()=1 2024-09-12T18:35:59.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.297+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.mgDD63IycUylGDjY69_r8G1titwK3Bp_0 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.301+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2090858185192293561', time=2024-09-12T20:07:06.960741+0000, chain.objs.size()=1 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.301+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.pNvgMRcG7t2gOpbuft8Hz-66WCgKbFm_0 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.301+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12867106345520521079', time=2024-09-12T20:07:08.542414+0000, chain.objs.size()=1 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.301+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.KINrK-MdhaZMcnKPG_bB4ZzPRDEa7et_0 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.301+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17653256690193177914', time=2024-09-12T20:07:09.005673+0000, chain.objs.size()=1 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.301+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7tysioy0-8ktX8TwQcFFBWfMRUXz3sx_0 2024-09-12T18:35:59.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.301+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3651066137207661851', time=2024-09-12T20:07:09.977060+0000, chain.objs.size()=1 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.301+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.r25FSDSWjLSwA4A1qlr4oP3l0WHX2g__0 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.301+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17848389585157028152', time=2024-09-12T20:07:10.688432+0000, chain.objs.size()=1 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.301+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.cbqKP_uDj2mHGpJ7VHvVQclgHstkuOJ_0 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.301+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5630634492317331297', time=2024-09-12T20:07:11.787108+0000, chain.objs.size()=1 2024-09-12T18:35:59.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.301+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.WnjZ6-RCvabcvJW_WlnmOCPktFbOvQT_0 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3793911998231222922', time=2024-09-12T20:07:12.606620+0000, chain.objs.size()=1 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.X6Q-VojlsFu5tv1zeNO7ib4lwS6wXIS_0 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12171632997972744429', time=2024-09-12T20:07:14.072888+0000, chain.objs.size()=1 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.S25zzi7Zurs9rKBDYHPfzzQZLBQb4dG_0 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8263890283630264237', time=2024-09-12T20:07:15.673127+0000, chain.objs.size()=1 2024-09-12T18:35:59.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.qg4JTqiFvRqCO66PXPsXC0X_DPanAku_0 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2120718360795401016', time=2024-09-12T20:07:18.887359+0000, chain.objs.size()=1 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.95q6cgNfrpmP-u9WqiDuUHbLCEBqGir_0 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3402122820874573829', time=2024-09-12T20:09:02.270998+0000, chain.objs.size()=1 2024-09-12T18:35:59.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.u6bij_L6sEAPmRzfBnOdfXWUFgHC6yz_0 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4601030280094047215', time=2024-09-12T20:09:02.371579+0000, chain.objs.size()=1 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.7GBbSPWmh8F8f8AtUc1AaaGBxG4tnjq_0 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3919596163071103846', time=2024-09-12T20:09:02.519398+0000, chain.objs.size()=1 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.4Hg5ETKvVFW_V_qWJ6x9URmc7hQolID_0 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4962311943605987022', time=2024-09-12T20:09:03.317767+0000, chain.objs.size()=1 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.QPqmo7h9TRIQJsnMoyAOx8xMjKWjbW7_0 2024-09-12T18:35:59.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7901363797858170774', time=2024-09-12T20:09:03.611669+0000, chain.objs.size()=1 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.mRc7DRW1RZQadW0nagklnxLOAoob0fp_0 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3765185754407360757', time=2024-09-12T20:09:03.633734+0000, chain.objs.size()=1 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.zJqT2X957cA8S-7rPpPBbWJEw4XsfFl_0 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1589600103517249378', time=2024-09-12T20:09:05.743865+0000, chain.objs.size()=1 2024-09-12T18:35:59.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.JaXch0vYtG1yDxyLtR3e5ZEQdI9VgG__0 2024-09-12T18:35:59.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.309+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1178088808136649238', time=2024-09-12T20:09:07.453145+0000, chain.objs.size()=1 2024-09-12T18:35:59.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.309+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ZC8YuMNRvmyXWrPZRwofm-Qi35xkcBF_0 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.309+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12304813077569306011', time=2024-09-12T20:09:10.946337+0000, chain.objs.size()=1 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.309+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.XxHcRubK96ycXpI-7hX_ntSAQpY9zjk_0 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.309+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3384165774275569731', time=2024-09-12T20:09:11.671665+0000, chain.objs.size()=1 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.309+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cm8sx8gsgAEiuYvVeb9Gd3JrhRgDO79_0 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.309+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17393308247940464339', time=2024-09-12T20:09:11.771568+0000, chain.objs.size()=1 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.309+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.7etYtACSDdgZHqRjewqZGdsBZB3zsJa_0 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.309+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4790948809880161569', time=2024-09-12T20:09:11.851599+0000, chain.objs.size()=1 2024-09-12T18:35:59.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.309+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.wyES_h6_-E7N_DUMf7E5wQSxeGEAf8K_0 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.313+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11538660007540306904', time=2024-09-12T20:09:13.295560+0000, chain.objs.size()=1 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.313+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_._eG9WxphHqNHHIDn3xW-EgsmT0x-wny_0 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.313+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4757066731003393228', time=2024-09-12T20:09:14.635441+0000, chain.objs.size()=1 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.313+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Es_-0xHQ_wo97TlJd4TqjN87K-BJ7d9_0 2024-09-12T18:35:59.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.313+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11526474499406620865', time=2024-09-12T20:09:14.829478+0000, chain.objs.size()=1 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.313+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Gmk5d5Ww9QNJMHpPuUxlY5TC8LUI03u_0 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.313+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12157795039780384926', time=2024-09-12T20:09:15.619457+0000, chain.objs.size()=1 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.313+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.hteTEbDfyEFomhE_YKWeD5N3SAnC3Qv_0 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.313+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4704352846988046257', time=2024-09-12T20:09:17.045821+0000, chain.objs.size()=1 2024-09-12T18:35:59.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.313+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.MnLr9RgpTA9TcceDcNRBwi3DbwLBjfQ_0 2024-09-12T18:35:59.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.313+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.337254857207193186', time=2024-09-12T20:09:17.048079+0000, chain.objs.size()=1 2024-09-12T18:35:59.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.313+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.M8rsnpoyBZEmPjD2TptPKhtXVLNdXb1_0 2024-09-12T18:35:59.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2849106626030862985', time=2024-09-12T20:09:18.135944+0000, chain.objs.size()=1 2024-09-12T18:35:59.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5y_EdoikpM1w5qnbsIvxCpXW-B-H5_G_0 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.290358889076947262', time=2024-09-12T20:09:18.470496+0000, chain.objs.size()=1 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vFvHX2vHZihjkOiiUaNNJ1DneHd0_0l_0 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14329978343425110403', time=2024-09-12T20:09:20.862691+0000, chain.objs.size()=1 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.v-yQKDNJZmguLaG6Lq41iJoTolMJXnH_0 2024-09-12T18:35:59.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9513714748810945069', time=2024-09-12T20:09:22.761664+0000, chain.objs.size()=1 2024-09-12T18:35:59.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.8GlFxbAWUze20k-6T6XZ-0ZGurS4ZV0_0 2024-09-12T18:35:59.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6244782468007605772', time=2024-09-12T20:09:22.763434+0000, chain.objs.size()=1 2024-09-12T18:35:59.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.G67OdMD_sttkkshAqZwyC8rw-RYkkT1_0 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7228724320113432020', time=2024-09-12T20:09:23.743294+0000, chain.objs.size()=1 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.E0BfiAzxkzVKub9i1Vw-ZcYCHiqRxgl_0 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7046270991532519519', time=2024-09-12T20:09:24.431883+0000, chain.objs.size()=1 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.X_mfMY5xDjXInXqn_0QRxxaBmGRqkur_0 2024-09-12T18:35:59.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10902000319327468134', time=2024-09-12T20:09:25.198631+0000, chain.objs.size()=1 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.i74snfQ-A0KUAnzdphfbZdIp2Eq-c-2_0 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10069655783436815001', time=2024-09-12T20:09:25.833495+0000, chain.objs.size()=1 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.qmY8wW1KHm00p8JQ2x68hAgWcVLdLsP_0 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3530750388490529573', time=2024-09-12T20:09:27.993567+0000, chain.objs.size()=1 2024-09-12T18:35:59.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.RUkUFXMteOcIC0O4VZrxwFkIHsPYrQX_0 2024-09-12T18:35:59.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.321+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1076881967279082057', time=2024-09-12T20:09:28.086981+0000, chain.objs.size()=1 2024-09-12T18:35:59.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.321+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.3AGj8LAF6MXvanl79iYTflPxuVFkkv5_0 2024-09-12T18:35:59.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.325+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/56497 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16463350906475598773', time=2024-09-12T20:09:28.455122+0000, chain.objs.size()=1 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ISVVmDhZ-ZMP5cWAsEa-q9bO5leN5bK_0 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18210642539501405293', time=2024-09-12T20:09:28.750125+0000, chain.objs.size()=1 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ZHd5mxIsOpDEVxZxs-gDIsG_NMxo7OJ_0 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.628981609582748740', time=2024-09-12T20:09:28.938971+0000, chain.objs.size()=1 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.mMj6ZeGuSS0SoVMDX3DkafaokFc1dD0_0 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11469233905628610851', time=2024-09-12T20:09:29.570013+0000, chain.objs.size()=1 2024-09-12T18:35:59.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Kuk-cIr4fU4UbrHMrqqtRMeoScz1NbH_0 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18128560489416753597', time=2024-09-12T20:09:32.711128+0000, chain.objs.size()=1 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.327__shadow_.3-Yma7_t6VK9rVrHwZ1tLoLeKIkQFpM_0 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.53259057070397781', time=2024-09-12T20:12:43.341089+0000, chain.objs.size()=1 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.465__shadow_.nxtqaoOg4QWjG-3WtMaCapzW0F6n9rM_0 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4263254974004552220', time=2024-09-12T20:12:47.174220+0000, chain.objs.size()=1 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.467__shadow_.rgmtrZxgoKjYu4Rkx-g7ebZNVnZ61kf_0 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8295303177223507383', time=2024-09-12T20:13:07.202423+0000, chain.objs.size()=1 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.484__shadow_.pV-aQVCB-rSxL9r0K8_8vG0ViO3NK8D_0 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14558924502761213050', time=2024-09-12T20:15:00.163582+0000, chain.objs.size()=6 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.522__multipart_mymultipart.2~CLSBb7dXiVncHcdr0ac39-dgap-XBYe.1 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.522__shadow_mymultipart.2~CLSBb7dXiVncHcdr0ac39-dgap-XBYe.1_1 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.522__multipart_mymultipart.2~CLSBb7dXiVncHcdr0ac39-dgap-XBYe.2 2024-09-12T18:35:59.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.522__shadow_mymultipart.2~CLSBb7dXiVncHcdr0ac39-dgap-XBYe.2_1 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.522__multipart_mymultipart.2~CLSBb7dXiVncHcdr0ac39-dgap-XBYe.3 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.522__shadow_mymultipart.2~CLSBb7dXiVncHcdr0ac39-dgap-XBYe.3_1 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.337+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15967734907643564903', time=2024-09-12T20:15:37.264741+0000, chain.objs.size()=12 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~70hIeWCywSLhqBYyLIvAXanpTa6e3PI.1 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__shadow_mymultipart.2~70hIeWCywSLhqBYyLIvAXanpTa6e3PI.1_1 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.1xoNMrAJCSZ7SDhRk9sc8ZVKqtI7xTX_.2 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__shadow_mymultipart.1xoNMrAJCSZ7SDhRk9sc8ZVKqtI7xTX_.2_1 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~70hIeWCywSLhqBYyLIvAXanpTa6e3PI.3 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__shadow_mymultipart.2~70hIeWCywSLhqBYyLIvAXanpTa6e3PI.3_1 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~70hIeWCywSLhqBYyLIvAXanpTa6e3PI.4 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__shadow_mymultipart.2~70hIeWCywSLhqBYyLIvAXanpTa6e3PI.4_1 2024-09-12T18:35:59.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~70hIeWCywSLhqBYyLIvAXanpTa6e3PI.5 2024-09-12T18:35:59.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.341+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__shadow_mymultipart.2~70hIeWCywSLhqBYyLIvAXanpTa6e3PI.5_1 2024-09-12T18:35:59.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~70hIeWCywSLhqBYyLIvAXanpTa6e3PI.6 2024-09-12T18:35:59.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__shadow_mymultipart.2~70hIeWCywSLhqBYyLIvAXanpTa6e3PI.6_1 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5795905624675222507', time=2024-09-12T20:19:06.522285+0000, chain.objs.size()=1 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:0faZNI.MlzZWJn0KZ3VEnU126YEP3Bp_.SSZDM2oybRoR83nxOyqVYmXb0h1DeMH_0 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12974098200408748894', time=2024-09-12T20:19:07.138816+0000, chain.objs.size()=1 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:yQHFof6le1QyJ.eMH.9sL9wTJYsxwUt_.QCDE64dWtuyqUkP5eID1F3kGM0aNHXH_0 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.70932515497064158', time=2024-09-12T20:19:10.223908+0000, chain.objs.size()=1 2024-09-12T18:35:59.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:cNc.1fnGmLSGoyQOyHdh-PJZm4hcFii_.mxctc0r-I5WxfFVyDj8bTiL7UFxuZN2_0 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3050153022124994106', time=2024-09-12T20:19:16.133645+0000, chain.objs.size()=1 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:VXdXSE1mVVdvxRLUZoP9mu0CBCQC6BJ_.o5dp4tZf6mLmR6NGMsC2P1Y9O2sokJF_0 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8648641724041915646', time=2024-09-12T20:19:18.291171+0000, chain.objs.size()=1 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:hlA2y-SuXrRBc-Y-mOOmCpALRDBGWV2_.k-5RUzd7kGmqckfrQH3O6IWL4nW3vth_0 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8656656635970591885', time=2024-09-12T20:19:32.794566+0000, chain.objs.size()=1 2024-09-12T18:35:59.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.573__shadow:sFlT6hXpIhKB4Lo4k5dlQIjurFYc3Fq_.tkFFYZ93z4zIA_uTDf4Y5pG_8ixwZ0a_0 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6596990375164946388', time=2024-09-12T20:19:39.424094+0000, chain.objs.size()=1 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.575__shadow:oa3Jp8YnI1fzN5sEQG.ChDYBZVr-zg-_.jCWRPz42rWVRM_GXUHi3kAlYfJiaYLM_0 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13892295565249724890', time=2024-09-12T20:20:59.539378+0000, chain.objs.size()=7 2024-09-12T18:35:59.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__multipart_testobj.2~GMyW3o89Uw8z2QyeGJSVeaAfR9ARGGs.1 2024-09-12T18:35:59.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.349+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__shadow_testobj.2~GMyW3o89Uw8z2QyeGJSVeaAfR9ARGGs.1_1 2024-09-12T18:35:59.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.349+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__multipart_testobj.2~GMyW3o89Uw8z2QyeGJSVeaAfR9ARGGs.2 2024-09-12T18:35:59.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.349+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__shadow_testobj.2~GMyW3o89Uw8z2QyeGJSVeaAfR9ARGGs.2_1 2024-09-12T18:35:59.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.349+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__multipart_testobj.2~GMyW3o89Uw8z2QyeGJSVeaAfR9ARGGs.3 2024-09-12T18:35:59.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.353+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__shadow_testobj.2~GMyW3o89Uw8z2QyeGJSVeaAfR9ARGGs.3_1 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.353+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__multipart_testobj.2~GMyW3o89Uw8z2QyeGJSVeaAfR9ARGGs.4 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.353+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~LpwDRVI4jpOyrF5f7zVEavBcoP8Fm-G', time=2024-09-12T20:26:25.449813+0000, chain.objs.size()=12 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.353+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.626__multipart_multipart_enc.2~LpwDRVI4jpOyrF5f7zVEavBcoP8Fm-G.1 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.353+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.626__shadow_multipart_enc.2~LpwDRVI4jpOyrF5f7zVEavBcoP8Fm-G.1_1 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.353+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.626__multipart_multipart_enc.2~LpwDRVI4jpOyrF5f7zVEavBcoP8Fm-G.2 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.353+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.626__shadow_multipart_enc.2~LpwDRVI4jpOyrF5f7zVEavBcoP8Fm-G.2_1 2024-09-12T18:35:59.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.353+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.626__multipart_multipart_enc.2~LpwDRVI4jpOyrF5f7zVEavBcoP8Fm-G.3 2024-09-12T18:35:59.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.353+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.626__shadow_multipart_enc.2~LpwDRVI4jpOyrF5f7zVEavBcoP8Fm-G.3_1 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.357+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.626__multipart_multipart_enc.2~LpwDRVI4jpOyrF5f7zVEavBcoP8Fm-G.4 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.357+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.626__shadow_multipart_enc.2~LpwDRVI4jpOyrF5f7zVEavBcoP8Fm-G.4_1 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.357+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.626__multipart_multipart_enc.2~LpwDRVI4jpOyrF5f7zVEavBcoP8Fm-G.5 2024-09-12T18:35:59.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.357+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.626__shadow_multipart_enc.2~LpwDRVI4jpOyrF5f7zVEavBcoP8Fm-G.5_1 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.357+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.626__multipart_multipart_enc.2~LpwDRVI4jpOyrF5f7zVEavBcoP8Fm-G.6 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.357+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.626__shadow_multipart_enc.2~LpwDRVI4jpOyrF5f7zVEavBcoP8Fm-G.6_1 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.357+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7837903823722840016', time=2024-09-12T20:26:42.678362+0000, chain.objs.size()=1 2024-09-12T18:35:59.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.357+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.638__shadow_.IY-p-pJ0KrqOLiQC_Nbp6EQKTsMDK-k_0 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9226650093216594684', time=2024-09-12T20:26:50.018517+0000, chain.objs.size()=1 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.361+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.643__shadow_.WuAebeYHm7p1WJ_cVY3ZR5oiy7pmZBx_0 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8496141682388768580', time=2024-09-12T20:27:53.743447+0000, chain.objs.size()=1 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.361+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.665__shadow_.mmnDrUk0Q749zR5JMDQlYRCx1IftC-3_0 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4097624156795754428', time=2024-09-12T20:27:55.940388+0000, chain.objs.size()=1 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.361+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.666__shadow_.X00Xt8M4GFQLm0vlwzRReqtV7najgGW_0 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1431659425301102470', time=2024-09-12T20:28:53.932575+0000, chain.objs.size()=1 2024-09-12T18:35:59.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.361+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.708__shadow:naEClIOnDylvMtzAcw3mPQoWE64PAlh_.VPq4IZUIRVUQsRwtPr4rjKlNRPTIjfz_0 2024-09-12T18:35:59.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.365+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10160544043532112076', time=2024-09-12T20:29:03.373094+0000, chain.objs.size()=1 2024-09-12T18:35:59.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.365+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.714__shadow:zDj2n9Bztb7AZxWxbS3OVpWaxBEqh64_.HRGTDvqRC-RMpIh9uW8dzsPzwtLqIYI_0 2024-09-12T18:35:59.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.369+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:35:59.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.377+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:35:59.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.377+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:35:59.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.377+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:35:59.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.377+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49048' 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.377+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1439468144973783914', time=2024-09-12T19:56:00.132679+0000, chain.objs.size()=5 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.377+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160__multipart_mymultipart-FROZEN.2~yb_Tby8XcyUXr1Mez-VrOXH5bfpIiSn.1 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.377+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160__shadow_mymultipart-FROZEN.2~yb_Tby8XcyUXr1Mez-VrOXH5bfpIiSn.1_1 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160__multipart_mymultipart-FROZEN.2~yb_Tby8XcyUXr1Mez-VrOXH5bfpIiSn.2 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160__shadow_mymultipart-FROZEN.2~yb_Tby8XcyUXr1Mez-VrOXH5bfpIiSn.2_1 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160__multipart_mymultipart-FROZEN.2~yb_Tby8XcyUXr1Mez-VrOXH5bfpIiSn.3 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.381+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_pQ29sgz_msGPSZycVXpQuUdoI-bZ7H1', time=2024-09-12T19:56:09.188073+0000, chain.objs.size()=3 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.d1w4KZigmb2b98HRg3B_ZwAXs2JqX-5_0 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.d1w4KZigmb2b98HRg3B_ZwAXs2JqX-5_1 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.d1w4KZigmb2b98HRg3B_ZwAXs2JqX-5_2 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.381+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_BfjWCOShzn-Mhl08L_aVECpgf0Xh4ug', time=2024-09-12T19:56:21.613347+0000, chain.objs.size()=3 2024-09-12T18:35:59.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_.EQg5ELlePmLCL2fBVB4okDCxMKXaDIW_0 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_.EQg5ELlePmLCL2fBVB4okDCxMKXaDIW_1 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_.EQg5ELlePmLCL2fBVB4okDCxMKXaDIW_2 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.381+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16998535662021818295', time=2024-09-12T19:56:58.315023+0000, chain.objs.size()=1 2024-09-12T18:35:59.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.184__shadow_.46zNePEyzp75R5ziDW1pnYbsnQxoFFK_0 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.385+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7173120641375818468', time=2024-09-12T20:00:34.800682+0000, chain.objs.size()=1 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.385+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.242__shadow_.8UXAlFRzaxbi9-LGGRckauKu8-dpwz5_0 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.385+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10927972859827788040', time=2024-09-12T20:00:48.221116+0000, chain.objs.size()=1 2024-09-12T18:35:59.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.385+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.249__shadow_.F7FtPiXrPM94UrrIOk_STTVmF-Vqavw_0 2024-09-12T18:35:59.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.639740593295435533', time=2024-09-12T20:00:51.495260+0000, chain.objs.size()=1 2024-09-12T18:35:59.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.251__shadow_.E1BqdcPQlIXE8kIepwEjAx63SRQSelm_0 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14152663382128419376', time=2024-09-12T20:00:54.898883+0000, chain.objs.size()=1 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.253__shadow_.JQ4S9gvAhSwax5Rs5h64kCnnIszLAmM_0 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1395325156459427588', time=2024-09-12T20:01:01.637513+0000, chain.objs.size()=1 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.257__shadow_.touwhOuEVAZ0EBpl8oXJ4Jvj2PlSCl8_0 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18175853977060870251', time=2024-09-12T20:01:08.013349+0000, chain.objs.size()=1 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.261__shadow_.22ki-gzOtgPYXjeBfkR6jIwrmStBht-_0 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1905478608068924804', time=2024-09-12T20:02:51.967631+0000, chain.objs.size()=1 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.VdcEnjKvNJTEOV_UuFXLfuuhn18X1rR_0 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1071788379674323345', time=2024-09-12T20:02:52.400905+0000, chain.objs.size()=1 2024-09-12T18:35:59.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.MP7DwAi5kJ_SvmoCHgjZ5NsCIvoNyBP_0 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2527426855165098621', time=2024-09-12T20:02:52.402338+0000, chain.objs.size()=1 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.7nKRLGeW_6c4d70fpx6aoV4LeVXLU4B_0 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4427962821288588824', time=2024-09-12T20:02:53.107930+0000, chain.objs.size()=1 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.oj6qBcciV4WpxrjHRd7GRxQ7wzqx401_0 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18149283443584374353', time=2024-09-12T20:02:53.549378+0000, chain.objs.size()=1 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Bg01dkvvGA_v3saS9BpAU5bjS6_pGy8_0 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4910354342677723026', time=2024-09-12T20:02:54.436903+0000, chain.objs.size()=1 2024-09-12T18:35:59.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.pVxQtqDf-bjZZNA65l02jT0Ou74RVUc_0 2024-09-12T18:35:59.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14450400513674691549', time=2024-09-12T20:02:54.813817+0000, chain.objs.size()=1 2024-09-12T18:35:59.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.29gP9SBmmNRp7M9soHUphMwe6-bigbI_0 2024-09-12T18:35:59.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16360954324596996932', time=2024-09-12T20:02:55.969738+0000, chain.objs.size()=1 2024-09-12T18:35:59.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.AjUGuQFWD5Tq6GSrdMRUuxnMMwXEunO_0 2024-09-12T18:35:59.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9957451423106226793', time=2024-09-12T20:02:56.059694+0000, chain.objs.size()=1 2024-09-12T18:35:59.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.7mmpgkhyLnUX0qcMXRiUT7EH3KrJwOG_0 2024-09-12T18:35:59.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10520399665810637755', time=2024-09-12T20:02:56.263643+0000, chain.objs.size()=1 2024-09-12T18:35:59.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.YSwCpal_gioGM2O61T-tGNd5EU5FKeD_0 2024-09-12T18:35:59.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.59160104845534911', time=2024-09-12T20:02:58.499306+0000, chain.objs.size()=1 2024-09-12T18:35:59.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XHhkbCaVBuVS976NVCe2iDWIKUi--Mk_0 2024-09-12T18:35:59.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2700528128512673144', time=2024-09-12T20:02:58.733787+0000, chain.objs.size()=1 2024-09-12T18:35:59.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.l3g7y6RwNLNjw1AoWT_im7KELt6htxh_0 2024-09-12T18:35:59.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7881645502385026067', time=2024-09-12T20:02:59.775671+0000, chain.objs.size()=1 2024-09-12T18:35:59.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.DzgLAtuL9-I2T7mCdHXKZIyLUN7-hg-_0 2024-09-12T18:35:59.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1667842289646673704', time=2024-09-12T20:03:03.626513+0000, chain.objs.size()=1 2024-09-12T18:35:59.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.iSNXV_qsC0yc9qfWn4tD4uakvi0waCA_0 2024-09-12T18:35:59.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3995178914704388060', time=2024-09-12T20:03:04.076511+0000, chain.objs.size()=1 2024-09-12T18:35:59.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.hdowXYoklWZYvkEYu0Q1l3yKRwPXa4c_0 2024-09-12T18:35:59.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16196348043346884963', time=2024-09-12T20:03:05.442813+0000, chain.objs.size()=1 2024-09-12T18:35:59.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.tUfGgDVvv4WiwCQZDfHcWNdxbEijNv0_0 2024-09-12T18:35:59.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10933191311698902790', time=2024-09-12T20:03:05.566692+0000, chain.objs.size()=1 2024-09-12T18:35:59.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Yxh-1sh27H061gNK0mQ-wjAggFc6l2S_0 2024-09-12T18:35:59.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13329046816364373860', time=2024-09-12T20:03:07.444173+0000, chain.objs.size()=1 2024-09-12T18:35:59.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.397+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.xLMZk2kH8TxNpso3YXa-246Byt57Bwx_0 2024-09-12T18:35:59.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.401+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17858600307709029527', time=2024-09-12T20:03:08.276616+0000, chain.objs.size()=1 2024-09-12T18:35:59.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.401+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.4VMAtthzxYGw5iYEar2hN1oI1Gq2qD0_0 2024-09-12T18:35:59.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.401+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14118708956108889918', time=2024-09-12T20:03:09.758715+0000, chain.objs.size()=1 2024-09-12T18:35:59.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.401+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.5fwhjTgirWXUAn_yVN8f37C6Mpl73n2_0 2024-09-12T18:35:59.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.401+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15477217132869767772', time=2024-09-12T20:03:09.995917+0000, chain.objs.size()=1 2024-09-12T18:35:59.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.401+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.eCAiaLsgAj4rZHGhS1iK52vBjgjv6Fl_0 2024-09-12T18:35:59.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2884036062353614374', time=2024-09-12T20:03:11.326946+0000, chain.objs.size()=1 2024-09-12T18:35:59.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.G7POKIimKh2wSlhJlLIyLr0bvkfGjLu_0 2024-09-12T18:35:59.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7149238885841669280', time=2024-09-12T20:03:12.065405+0000, chain.objs.size()=1 2024-09-12T18:35:59.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.LsfyhbCYYRjme5WG419AgYSZw3YbUOw_0 2024-09-12T18:35:59.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2710704491057426519', time=2024-09-12T20:03:12.204310+0000, chain.objs.size()=1 2024-09-12T18:35:59.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XCh34Lv81-peo10VfKv2o_Us4i4w7Kg_0 2024-09-12T18:35:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4991484148111455044', time=2024-09-12T20:03:12.551610+0000, chain.objs.size()=1 2024-09-12T18:35:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.OSreDfm7SefsZIDVAixvZrOujNkS6HB_0 2024-09-12T18:35:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15093426232903302786', time=2024-09-12T20:03:13.319579+0000, chain.objs.size()=1 2024-09-12T18:35:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.57tBDwDieklhpp8zU8bFSecTyM-joJM_0 2024-09-12T18:35:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8358262521758200263', time=2024-09-12T20:03:14.614524+0000, chain.objs.size()=1 2024-09-12T18:35:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.adO6SDE7GdHpGYv-wVIzuWdFocgjMK6_0 2024-09-12T18:35:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4508015361037512057', time=2024-09-12T20:03:17.188966+0000, chain.objs.size()=1 2024-09-12T18:35:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.dlRJPvimbkXGboLOg2ayXWraLxnduPZ_0 2024-09-12T18:35:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14283513567615855055', time=2024-09-12T20:03:17.468859+0000, chain.objs.size()=1 2024-09-12T18:35:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.53yEaMwJ5qNhCRWunKWYNzbs3KbmKFs_0 2024-09-12T18:35:59.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5478395621079293085', time=2024-09-12T20:03:18.120186+0000, chain.objs.size()=1 2024-09-12T18:35:59.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.p_c_hJwnMbY9uQDq2AKNp8y-5MXL3A1_0 2024-09-12T18:35:59.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12805492156614663275', time=2024-09-12T20:03:18.540641+0000, chain.objs.size()=1 2024-09-12T18:35:59.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.405+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.BYbS6jUzBx6CuEypqx5ZvbRBHhtX6JP_0 2024-09-12T18:35:59.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1402684926129855793', time=2024-09-12T20:03:19.563971+0000, chain.objs.size()=1 2024-09-12T18:35:59.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XQkPoCWq4fUGlYowXWZJYptDo4lp85X_0 2024-09-12T18:35:59.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16421050767557596150', time=2024-09-12T20:03:20.537823+0000, chain.objs.size()=1 2024-09-12T18:35:59.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XKzOzFlChH1vI8FIn0IpOECqmuAZqNI_0 2024-09-12T18:35:59.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13003215987252721090', time=2024-09-12T20:03:23.803044+0000, chain.objs.size()=1 2024-09-12T18:35:59.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.265__shadow_.Ehm-g64wX0l5nxuE6A7j6NIlLhvqbow_0 2024-09-12T18:35:59.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15855647721380193734', time=2024-09-12T20:03:34.757949+0000, chain.objs.size()=1 2024-09-12T18:35:59.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.272__shadow_.9-yJwRvtIbT4uce1cR5dlXWAYmVwXQN_0 2024-09-12T18:35:59.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14278785458818208313', time=2024-09-12T20:03:44.325826+0000, chain.objs.size()=1 2024-09-12T18:35:59.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.278__shadow_.hy7RjU0sijuP8TtKm-LR-7WwOC67DBL_0 2024-09-12T18:35:59.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10853883329684589152', time=2024-09-12T20:03:44.327475+0000, chain.objs.size()=1 2024-09-12T18:35:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.278__shadow_.E60LTu_oVVkefyIjpNqS6bL9kKOjvyT_0 2024-09-12T18:35:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9309555205062432649', time=2024-09-12T20:04:04.840418+0000, chain.objs.size()=1 2024-09-12T18:35:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.290__shadow_.rptpN2Y8xVicUG8JmRyD0IIPKC98yY8_0 2024-09-12T18:35:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13089489764946840106', time=2024-09-12T20:04:12.868707+0000, chain.objs.size()=1 2024-09-12T18:35:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.irtfTzP5yKcwBRdM8fhkfBb6qxvfpB8_0 2024-09-12T18:35:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1820899461637377078', time=2024-09-12T20:04:18.212002+0000, chain.objs.size()=1 2024-09-12T18:35:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.I_hkM62LNsyrqRqGLEZULP_syc1BJZ9_0 2024-09-12T18:35:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18382670751970074811', time=2024-09-12T20:04:35.251047+0000, chain.objs.size()=1 2024-09-12T18:35:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.304__shadow_.ygdeGts-9FpLnljWe_tPxEmTRWBHGRO_0 2024-09-12T18:35:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15202959991735378476', time=2024-09-12T20:04:40.725807+0000, chain.objs.size()=1 2024-09-12T18:35:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.409+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.307__shadow_.vLMw2rE8bCgr1eo48qSwBt5195dN7sg_0 2024-09-12T18:35:59.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.413+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9459933224207819659', time=2024-09-12T20:06:51.471311+0000, chain.objs.size()=1 2024-09-12T18:35:59.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.413+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.PtMQq0uq641yOB0gm3h0O8IrWRhCniw_0 2024-09-12T18:35:59.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.413+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15466856093876041403', time=2024-09-12T20:06:52.508573+0000, chain.objs.size()=1 2024-09-12T18:35:59.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.413+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.rFgyX8G-f-JFhWZBLRcuh75yociA0FX_0 2024-09-12T18:35:59.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.413+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10777761667107591882', time=2024-09-12T20:06:53.503331+0000, chain.objs.size()=1 2024-09-12T18:35:59.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.413+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.JVZv4gmCsCqFGkGQkfmDpJP0BLll4SC_0 2024-09-12T18:35:59.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.413+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11268299737908170316', time=2024-09-12T20:06:55.027599+0000, chain.objs.size()=1 2024-09-12T18:35:59.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.413+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.gAMKNSIudmUP3wX9QRVG3g435OK8cTi_0 2024-09-12T18:35:59.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.413+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17903229400130959639', time=2024-09-12T20:06:55.614753+0000, chain.objs.size()=1 2024-09-12T18:35:59.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.413+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.P41fCVmjdAIiTw5D0KhMqfB7o0E1idm_0 2024-09-12T18:35:59.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.417+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18174783486739990681', time=2024-09-12T20:06:55.711282+0000, chain.objs.size()=1 2024-09-12T18:35:59.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.417+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-I787HMyShCxSwE-mZuYj2R2XfhmMB1_0 2024-09-12T18:35:59.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.417+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2346213398855795612', time=2024-09-12T20:06:56.323737+0000, chain.objs.size()=1 2024-09-12T18:35:59.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.417+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.K3ZE-HirKuodRtKhrnwoj2g-HcBPQwW_0 2024-09-12T18:35:59.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.417+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1273522429036043661', time=2024-09-12T20:06:56.982382+0000, chain.objs.size()=1 2024-09-12T18:35:59.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.417+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.wMo1nRN1uePf0HGBwpb9kAPThpHvzh1_0 2024-09-12T18:35:59.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.417+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14085355793708743177', time=2024-09-12T20:06:57.430436+0000, chain.objs.size()=1 2024-09-12T18:35:59.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.417+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.6BwRDQ7VH1Zc2stDCeTxcMAN6ZoCgu3_0 2024-09-12T18:35:59.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.417+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8324317478168149962', time=2024-09-12T20:06:57.750246+0000, chain.objs.size()=1 2024-09-12T18:35:59.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.417+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.8Gl2QYPqeWCTIFidGtaKPD4obP1joGP_0 2024-09-12T18:35:59.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.417+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8210888741929221110', time=2024-09-12T20:06:58.764605+0000, chain.objs.size()=1 2024-09-12T18:35:59.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.417+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ceZkJZK3jXwuOCx9uuBjHehC2_uJaBn_0 2024-09-12T18:35:59.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.417+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3569105208296059808', time=2024-09-12T20:06:59.610027+0000, chain.objs.size()=1 2024-09-12T18:35:59.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.417+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.CUmIOxmPDaGnjmUHu7x8yamefaVbEBM_0 2024-09-12T18:35:59.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.421+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.24219104232844117', time=2024-09-12T20:06:59.712544+0000, chain.objs.size()=1 2024-09-12T18:35:59.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.421+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.nL6b9dBguE7y8FmKPLMp4rumZ9rSJZe_0 2024-09-12T18:35:59.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.421+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8595046484365602527', time=2024-09-12T20:07:00.201956+0000, chain.objs.size()=1 2024-09-12T18:35:59.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.421+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.owbR1q85RsWdSXbl1xeb9Zb_lZwJySN_0 2024-09-12T18:35:59.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.421+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2016570412839760078', time=2024-09-12T20:07:00.753397+0000, chain.objs.size()=1 2024-09-12T18:35:59.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.421+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.CUOATVtEQmH0rIpvd-MA4jw0asPUbFr_0 2024-09-12T18:35:59.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.421+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14208146678433122301', time=2024-09-12T20:07:01.376807+0000, chain.objs.size()=1 2024-09-12T18:35:59.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.421+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.FvIEIa5beHKN26SyAgsuoAly1lNhP6E_0 2024-09-12T18:35:59.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.421+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16393063302544624557', time=2024-09-12T20:07:01.554196+0000, chain.objs.size()=1 2024-09-12T18:35:59.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.421+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.FRkE-yUiakO9RlVOyAOzz6iGN8UHnup_0 2024-09-12T18:35:59.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16251431749947280466', time=2024-09-12T20:07:02.928949+0000, chain.objs.size()=1 2024-09-12T18:35:59.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.jxN2r_RSYW7uaA4vGyOlOgX5juxO6vd_0 2024-09-12T18:35:59.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1407781515940264605', time=2024-09-12T20:07:03.783760+0000, chain.objs.size()=1 2024-09-12T18:35:59.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.3cFrzke5oGB3E6mEAmZQsOgrFeNefeg_0 2024-09-12T18:35:59.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11096067667516481608', time=2024-09-12T20:07:04.837211+0000, chain.objs.size()=1 2024-09-12T18:35:59.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.aNnt_pDpgh18YAE-L8TgbG_l8OLEIFh_0 2024-09-12T18:35:59.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14211086168463371755', time=2024-09-12T20:07:08.230372+0000, chain.objs.size()=1 2024-09-12T18:35:59.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.0PIXeF5FvVJcbu-zTvAOwTtfQTKCSrV_0 2024-09-12T18:35:59.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17711531752119452070', time=2024-09-12T20:07:10.609075+0000, chain.objs.size()=1 2024-09-12T18:35:59.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ae3NrGlp0zbvWRvwHZJ7xqNrpQpj9pc_0 2024-09-12T18:35:59.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5669250246312920556', time=2024-09-12T20:07:10.763744+0000, chain.objs.size()=1 2024-09-12T18:35:59.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.HouRsmsxmw6uhsfTrN9t65eU7hCFF7T_0 2024-09-12T18:35:59.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6315026316616850113', time=2024-09-12T20:07:11.121549+0000, chain.objs.size()=1 2024-09-12T18:35:59.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.LqtZztjQKLI5hwKgk8CIIFhfqq9apPV_0 2024-09-12T18:35:59.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11855003877587681495', time=2024-09-12T20:07:12.101266+0000, chain.objs.size()=1 2024-09-12T18:35:59.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.mx1nurH2htBmH3dXBooPUxeDgMcgOpu_0 2024-09-12T18:35:59.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18094497709114367571', time=2024-09-12T20:07:12.599365+0000, chain.objs.size()=1 2024-09-12T18:35:59.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.t8zIy0lWNtIGYtcHTRRy75if_rA6rjz_0 2024-09-12T18:35:59.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13574102796097203688', time=2024-09-12T20:07:13.532542+0000, chain.objs.size()=1 2024-09-12T18:35:59.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.TKCySeu0edt_xnyRIsI8EyHpUJF-a_B_0 2024-09-12T18:35:59.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.429+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.233993174098537148', time=2024-09-12T20:07:17.019716+0000, chain.objs.size()=1 2024-09-12T18:35:59.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.429+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.PFLMrrXqAe7bZgAQnHbHuGPyXcdpCHf_0 2024-09-12T18:35:59.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.429+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11492555324607027402', time=2024-09-12T20:07:17.462944+0000, chain.objs.size()=1 2024-09-12T18:35:59.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.429+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Z_p3cUesq2Bi8OJYgWseYMhVBXYmYQf_0 2024-09-12T18:35:59.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.429+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11288362187508928703', time=2024-09-12T20:07:17.873057+0000, chain.objs.size()=1 2024-09-12T18:35:59.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.429+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.vIQzF1Zspi7IVXHjHHFarLH_3xeZUwr_0 2024-09-12T18:35:59.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.429+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9352092290590434286', time=2024-09-12T20:07:18.771683+0000, chain.objs.size()=1 2024-09-12T18:35:59.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.429+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Upr1-1lmtdc6zoqkwTRa0yevzbZH9fR_0 2024-09-12T18:35:59.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.429+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15094645340993032221', time=2024-09-12T20:07:18.851068+0000, chain.objs.size()=1 2024-09-12T18:35:59.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.429+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.vBJJEm8-pJlROoPtQ40IuX7eSPhxts1_0 2024-09-12T18:35:59.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.429+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11861871998504383074', time=2024-09-12T20:07:19.160803+0000, chain.objs.size()=1 2024-09-12T18:35:59.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.429+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7vAKrCJfPKinRYl10OTMfwUuV2jhPaU_0 2024-09-12T18:35:59.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.429+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15804780520249509071', time=2024-09-12T20:09:02.923168+0000, chain.objs.size()=1 2024-09-12T18:35:59.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.429+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.VL8jwtwbkGVcA3FWiMjoOgrpqOj1l8R_0 2024-09-12T18:35:59.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.433+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5838434500308992325', time=2024-09-12T20:09:03.546839+0000, chain.objs.size()=1 2024-09-12T18:35:59.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.433+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.PDeYEJ09XRQhshskjv8iqcGxeaidCfV_0 2024-09-12T18:35:59.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.433+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.768170661737213420', time=2024-09-12T20:09:03.996679+0000, chain.objs.size()=1 2024-09-12T18:35:59.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.433+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.fBSLgTMadTiSGaYQP1YJEJL171HXQBB_0 2024-09-12T18:35:59.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.433+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14631902505997375991', time=2024-09-12T20:09:04.620067+0000, chain.objs.size()=1 2024-09-12T18:35:59.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.433+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.lSX-LJRz6o-c0XTDKSyMen27RxZDZjc_0 2024-09-12T18:35:59.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.433+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6611414276708440100', time=2024-09-12T20:09:05.773011+0000, chain.objs.size()=1 2024-09-12T18:35:59.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.433+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vPSkWIYBaBeyj90rrd0fNlBe7YnPEIq_0 2024-09-12T18:35:59.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.433+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9124525251750314556', time=2024-09-12T20:09:06.174036+0000, chain.objs.size()=1 2024-09-12T18:35:59.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.433+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.CNinarobkRrdweS5eT1nSs39NWu57Ef_0 2024-09-12T18:35:59.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1901302020337651134', time=2024-09-12T20:09:06.176235+0000, chain.objs.size()=1 2024-09-12T18:35:59.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ktKpCkpz_jQy0lmlkPeRNGqdnuShIGL_0 2024-09-12T18:35:59.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15706986188609505001', time=2024-09-12T20:09:06.510603+0000, chain.objs.size()=1 2024-09-12T18:35:59.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.t2URUHrghZsiCGDYdMtBJS9yaeNJcl3_0 2024-09-12T18:35:59.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17963149301374301827', time=2024-09-12T20:09:06.815192+0000, chain.objs.size()=1 2024-09-12T18:35:59.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.43HwPlhwM8fkWsQ0_49o6UH3bNiHrFP_0 2024-09-12T18:35:59.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.405522352559405367', time=2024-09-12T20:09:06.879765+0000, chain.objs.size()=1 2024-09-12T18:35:59.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.S5eWNAQ-DOIGV-XRLRX3VtS__2oDoDZ_0 2024-09-12T18:35:59.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15554266730392556760', time=2024-09-12T20:09:08.282911+0000, chain.objs.size()=1 2024-09-12T18:35:59.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Z-zq2ow6O0jQWO1D4xHnmS84Z-gCAEY_0 2024-09-12T18:35:59.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6269581693717856015', time=2024-09-12T20:09:09.675217+0000, chain.objs.size()=1 2024-09-12T18:35:59.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.qzm4jrPgIJpnVQzpouPPGUebVUubLAE_0 2024-09-12T18:35:59.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1007504169095075333', time=2024-09-12T20:09:10.031135+0000, chain.objs.size()=1 2024-09-12T18:35:59.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.KajMoTxUO6TOZZ9S29I3yHXJqZfI-0v_0 2024-09-12T18:35:59.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4912026298483011089', time=2024-09-12T20:09:10.200601+0000, chain.objs.size()=1 2024-09-12T18:35:59.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.lbnfumkwdCyoO2aeTMR4s2xVBihPCyf_0 2024-09-12T18:35:59.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8920228074697769366', time=2024-09-12T20:09:10.559975+0000, chain.objs.size()=1 2024-09-12T18:35:59.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.437+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.QDqifnLS-MiawgSHVQs1Enl7kZB556f_0 2024-09-12T18:35:59.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.445+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49048 2024-09-12T18:35:59.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T18:35:59.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.195140808503036349', time=2024-09-12T20:09:13.372382+0000, chain.objs.size()=1 2024-09-12T18:35:59.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.7Q0Qt8DAR64wzw6qFTZG-FH4DF3oL8k_0 2024-09-12T18:35:59.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9870820559036749325', time=2024-09-12T20:09:13.505537+0000, chain.objs.size()=1 2024-09-12T18:35:59.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5Q1nY9I93TB_MTjH_Suc1r7u1XSTmMR_0 2024-09-12T18:35:59.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8960267097503671123', time=2024-09-12T20:09:15.567344+0000, chain.objs.size()=1 2024-09-12T18:35:59.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.E7gXQalpShrt1WfpjQcpxxwHxBv1Dhx_0 2024-09-12T18:35:59.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2102474124665799516', time=2024-09-12T20:09:17.045979+0000, chain.objs.size()=1 2024-09-12T18:35:59.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.SCOjWBIgNs1R4LRNMD97hnTBD35v8CZ_0 2024-09-12T18:35:59.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13859937797227099956', time=2024-09-12T20:09:19.690264+0000, chain.objs.size()=1 2024-09-12T18:35:59.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.a9uvftmlT1UTt9uBto1ewU90NnyhgEw_0 2024-09-12T18:35:59.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10564249267108089321', time=2024-09-12T20:09:21.416781+0000, chain.objs.size()=1 2024-09-12T18:35:59.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.8pJMsaBYQ4fYZ1V6uzh65YDoruVS_zQ_0 2024-09-12T18:35:59.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14932352422393558961', time=2024-09-12T20:09:21.525514+0000, chain.objs.size()=1 2024-09-12T18:35:59.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ZwxE6MH95mMw6izj4Z5WEdolDL9QWhN_0 2024-09-12T18:35:59.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17987204574945070221', time=2024-09-12T20:09:22.164098+0000, chain.objs.size()=1 2024-09-12T18:35:59.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.663jhjGKtGxWyyCtlafIpb8DIVXdUE3_0 2024-09-12T18:35:59.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7600263098629659360', time=2024-09-12T20:09:22.290738+0000, chain.objs.size()=1 2024-09-12T18:35:59.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.-QS95BYq_0jc26G7iq_syBaKI-kHIjv_0 2024-09-12T18:35:59.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16842549103990496832', time=2024-09-12T20:09:24.599895+0000, chain.objs.size()=1 2024-09-12T18:35:59.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2v-RoKlGSCyMNxBe6I1U9OVRJLocm0B_0 2024-09-12T18:35:59.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5409264482649834294', time=2024-09-12T20:09:25.265125+0000, chain.objs.size()=1 2024-09-12T18:35:59.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.pL7D4PhtCjQmg0HJg1CA7aXOG3xvsJs_0 2024-09-12T18:35:59.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14795295786649030051', time=2024-09-12T20:09:25.640914+0000, chain.objs.size()=1 2024-09-12T18:35:59.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.453+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.TlFxG83q9a0fXgsSYgaLjwZTsGKLI2E_0 2024-09-12T18:35:59.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.457+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12841621972675710292', time=2024-09-12T20:09:25.897649+0000, chain.objs.size()=1 2024-09-12T18:35:59.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.457+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FiStHIlT04GqX6nQuQPBhv1Mlc6r27y_0 2024-09-12T18:35:59.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.457+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12183422008802775366', time=2024-09-12T20:09:26.991641+0000, chain.objs.size()=1 2024-09-12T18:35:59.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.457+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.JmP4pd4tXwl_bPzQbB4rBKi9Xsddlxc_0 2024-09-12T18:35:59.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.457+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15814289147593374826', time=2024-09-12T20:09:27.069938+0000, chain.objs.size()=1 2024-09-12T18:35:59.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.457+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.GcpEnCKHdBVrsxuP4Z0k0sUBvczz15A_0 2024-09-12T18:35:59.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3928574063595482928', time=2024-09-12T20:09:28.117870+0000, chain.objs.size()=1 2024-09-12T18:35:59.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.XbOU-DWsnonpNnHdlbVwcq9nSIw3ZSD_0 2024-09-12T18:35:59.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16436496155609132425', time=2024-09-12T20:10:36.422558+0000, chain.objs.size()=1 2024-09-12T18:35:59.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.378__shadow_.5lig865fO1aQSOKohkLOT14jReNy9yU_0 2024-09-12T18:35:59.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4765579704122165557', time=2024-09-12T20:12:45.562925+0000, chain.objs.size()=1 2024-09-12T18:35:59.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.466__shadow_.0wGzjLIrPfCe31fOoEbirhtySE1V7Ha_0 2024-09-12T18:35:59.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4057413428443615797', time=2024-09-12T20:13:34.393885+0000, chain.objs.size()=1 2024-09-12T18:35:59.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.500__shadow_.gpKv18PuD4gHOpKKrZppOayzi46ioVj_0 2024-09-12T18:35:59.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10738082958370229436', time=2024-09-12T20:18:29.271793+0000, chain.objs.size()=1 2024-09-12T18:35:59.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.557__shadow_.GoFWRdwdfHcEbOywZ8GofOWqM6L9ryO_0 2024-09-12T18:35:59.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10358111815312233575', time=2024-09-12T20:18:38.415956+0000, chain.objs.size()=1 2024-09-12T18:35:59.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.559__shadow_.j4V1n5tYKq97wSVesiZggn67SQ3VL8i_0 2024-09-12T18:35:59.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15342705639499786667', time=2024-09-12T20:19:47.832048+0000, chain.objs.size()=1 2024-09-12T18:35:59.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.576__shadow:LiPn8n4aVJVS-muuP2TO8gCJDA.nmOo_.ODs9tCuQ3qGUVboGdph19_eLw4wMZVl_0 2024-09-12T18:35:59.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15535172863626164475', time=2024-09-12T20:21:39.039184+0000, chain.objs.size()=1 2024-09-12T18:35:59.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.597__shadow_.G7fwwe3-j3AWk3hMlQSg8mWPWlX5_FY_0 2024-09-12T18:35:59.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9427139457758190335', time=2024-09-12T20:25:32.823587+0000, chain.objs.size()=1 2024-09-12T18:35:59.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.619__shadow_.EmBWKf0cti02xHCH6R6NV5fpoFR5nOA_0 2024-09-12T18:35:59.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1974125487293698936', time=2024-09-12T20:25:34.570785+0000, chain.objs.size()=1 2024-09-12T18:35:59.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.620__shadow_.s2OyWAFZaIqXo2P-RDceA4MF_U-ogoa_0 2024-09-12T18:35:59.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12512183632715343393', time=2024-09-12T20:26:33.671634+0000, chain.objs.size()=1 2024-09-12T18:35:59.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.461+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.632__shadow_.gjqr9UY6jc8HppnwZDzxYFNwFviGz46_0 2024-09-12T18:35:59.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.465+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6052906897436066700', time=2024-09-12T20:28:27.378010+0000, chain.objs.size()=1 2024-09-12T18:35:59.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.465+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.691__shadow:uYa6LHs.Br2suz7R8sz-njqhSHrK5jl_.HAXNpuZ3GcKqk-Y_UyVQGSEpjFohG_8_0 2024-09-12T18:35:59.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.465+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12568962700728464206', time=2024-09-12T20:28:36.576938+0000, chain.objs.size()=1 2024-09-12T18:35:59.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.465+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.697__shadow:6RxPdQe85gxdQIEOSHelLnIZQVylE7d_.KnnvweT0UiPk5Z6MG0N0gbUf7iOpPUR_0 2024-09-12T18:35:59.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.469+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17459102022488228201', time=2024-09-12T20:28:55.740230+0000, chain.objs.size()=1 2024-09-12T18:35:59.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.469+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.709__shadow:x.9SATlB5jwggVcYCEwP0tkjoy5tX4c_.l7mtFQ3sJq-_XKZDPKqVWzHvbjt-oNc_0 2024-09-12T18:35:59.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.473+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:35:59.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.477+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:35:59.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:35:59.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:35:59.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52346' 2024-09-12T18:35:59.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.205726978559252520', time=2024-09-12T19:55:53.321151+0000, chain.objs.size()=3 2024-09-12T18:35:59.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.159__shadow_.PYcP4tR16_rmoNwG4I43ImX-NbM-NhN_0 2024-09-12T18:35:59.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.159__shadow_.PYcP4tR16_rmoNwG4I43ImX-NbM-NhN_1 2024-09-12T18:35:59.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.159__shadow_.PYcP4tR16_rmoNwG4I43ImX-NbM-NhN_2 2024-09-12T18:35:59.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12635721877662440083', time=2024-09-12T19:56:12.069344+0000, chain.objs.size()=3 2024-09-12T18:35:59.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__multipart_foo-STANDARD.2~mabRqZ0dzmcYpXI0oYF7Jdbip4-iY2J.1 2024-09-12T18:35:59.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__multipart_foo-STANDARD.2~mabRqZ0dzmcYpXI0oYF7Jdbip4-iY2J.2 2024-09-12T18:35:59.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__multipart_foo-STANDARD.2~mabRqZ0dzmcYpXI0oYF7Jdbip4-iY2J.3 2024-09-12T18:35:59.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_5cUaUBCTQIozWzuTq9MILqE7MzbE2SV', time=2024-09-12T19:56:21.544813+0000, chain.objs.size()=3 2024-09-12T18:35:59.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_.UAJwkl2m2NmN_YfDT_-VoFno69P6VLO_0 2024-09-12T18:35:59.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_.UAJwkl2m2NmN_YfDT_-VoFno69P6VLO_1 2024-09-12T18:35:59.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_.UAJwkl2m2NmN_YfDT_-VoFno69P6VLO_2 2024-09-12T18:35:59.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10105244036391072701', time=2024-09-12T20:00:22.138418+0000, chain.objs.size()=1 2024-09-12T18:35:59.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.235__shadow_.FTTZnEMcWBDc2CLX6XCB4FTf93eans-_0 2024-09-12T18:35:59.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15811391323366914478', time=2024-09-12T20:00:30.524661+0000, chain.objs.size()=1 2024-09-12T18:35:59.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.239__shadow_.9M0mDnWhfSqRF2d1MClSSZQznYQ6H4G_0 2024-09-12T18:35:59.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18247435870924949785', time=2024-09-12T20:00:59.943437+0000, chain.objs.size()=1 2024-09-12T18:35:59.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.256__shadow_.1QyypGdjv_z2mjIuhoUONViAKI2ec2J_0 2024-09-12T18:35:59.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11206035049640060670', time=2024-09-12T20:02:52.810848+0000, chain.objs.size()=1 2024-09-12T18:35:59.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.9APxoeiX8aAmxXa22uFG7911tzCU579_0 2024-09-12T18:35:59.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8204396740684376116', time=2024-09-12T20:02:53.221698+0000, chain.objs.size()=1 2024-09-12T18:35:59.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.iLOBItHdcyH5jX60CUAT2IiW1igWSnY_0 2024-09-12T18:35:59.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10603018754218624297', time=2024-09-12T20:02:53.859047+0000, chain.objs.size()=1 2024-09-12T18:35:59.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.OiXNycvzQuMBQbv9kfD3G127r2cwpb__0 2024-09-12T18:35:59.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2776425119592260748', time=2024-09-12T20:02:54.817447+0000, chain.objs.size()=1 2024-09-12T18:35:59.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wWKjmq1OYLHGM79dgFx3ifQQ0GxeMTq_0 2024-09-12T18:35:59.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4472994539980466900', time=2024-09-12T20:02:56.650923+0000, chain.objs.size()=1 2024-09-12T18:35:59.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.h-cWSsKHVQ8nJ7_V2hFiNu6TAqEi6PK_0 2024-09-12T18:35:59.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6347600771730200459', time=2024-09-12T20:02:58.610263+0000, chain.objs.size()=1 2024-09-12T18:35:59.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.8e75VSsgyXNQKF2jEEw5Stm_-taxgrD_0 2024-09-12T18:35:59.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6712212452524785481', time=2024-09-12T20:02:59.807028+0000, chain.objs.size()=1 2024-09-12T18:35:59.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.SyBWVq0pOHdxOfWBf48e4RA80AL1DBL_0 2024-09-12T18:35:59.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2534955892968749545', time=2024-09-12T20:03:00.246270+0000, chain.objs.size()=1 2024-09-12T18:35:59.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ajyGjKBTNtV6fJl4Q7z5c9Hy5OGO9nq_0 2024-09-12T18:35:59.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10851437157015935111', time=2024-09-12T20:03:00.673657+0000, chain.objs.size()=1 2024-09-12T18:35:59.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.jnYKp0_ltIZLt53QL0HQWHCdTrOMNY9_0 2024-09-12T18:35:59.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11289928842777004364', time=2024-09-12T20:03:02.153317+0000, chain.objs.size()=1 2024-09-12T18:35:59.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.6dEdavSQVasAQd4cVJQAHCgEFL_gFL7_0 2024-09-12T18:35:59.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13942120468445493773', time=2024-09-12T20:03:03.919723+0000, chain.objs.size()=1 2024-09-12T18:35:59.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.tSTkqA5EmQsPa5HvoJ7iwHT-exoVjVB_0 2024-09-12T18:35:59.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.489+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2772585341537051498', time=2024-09-12T20:03:04.740918+0000, chain.objs.size()=1 2024-09-12T18:35:59.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.489+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.HPp0OYnQTRQZ9Ac4wzhGW5u1MHDYkDT_0 2024-09-12T18:35:59.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.493+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10285770303292867557', time=2024-09-12T20:03:07.685268+0000, chain.objs.size()=1 2024-09-12T18:35:59.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.493+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Ty5BDVnGK_srzFuvmfMKN4ZZoPosqwo_0 2024-09-12T18:35:59.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.493+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15256913548304792810', time=2024-09-12T20:03:08.696694+0000, chain.objs.size()=1 2024-09-12T18:35:59.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.493+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Mb-QHjjJC70WM0q4NdmAAHWPSg_fTf2_0 2024-09-12T18:35:59.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.493+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7176937333801157968', time=2024-09-12T20:03:11.974847+0000, chain.objs.size()=1 2024-09-12T18:35:59.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.493+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.sVn1XpQCYnktGLiFN48AD-e0rbYIB8Z_0 2024-09-12T18:35:59.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.493+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3689372292505409847', time=2024-09-12T20:03:11.976679+0000, chain.objs.size()=1 2024-09-12T18:35:59.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.493+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.dF5hTyEiQBq4rU7BS-2o1qre1DxoM2g_0 2024-09-12T18:35:59.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.493+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12761229530850070319', time=2024-09-12T20:03:12.355397+0000, chain.objs.size()=1 2024-09-12T18:35:59.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.493+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.V75cDxk4ckbfpFKKdbiKZc0hgdGcDc2_0 2024-09-12T18:35:59.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.493+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14424593792421866844', time=2024-09-12T20:03:12.939517+0000, chain.objs.size()=1 2024-09-12T18:35:59.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.493+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._QdHiEzf1QjvB-JuRAGqJFlnsm-0du8_0 2024-09-12T18:35:59.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.493+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14011380751109694625', time=2024-09-12T20:03:13.290725+0000, chain.objs.size()=1 2024-09-12T18:35:59.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.493+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.hJhOzo0KS9bJiP0f0kcl-yTIBDRhslt_0 2024-09-12T18:35:59.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.497+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13032587518455235666', time=2024-09-12T20:03:13.485652+0000, chain.objs.size()=1 2024-09-12T18:35:59.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.497+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wI5AwyrT7hhLd_FrSectFDhf7iZ0cm5_0 2024-09-12T18:35:59.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.497+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3954503937556785824', time=2024-09-12T20:03:15.679327+0000, chain.objs.size()=1 2024-09-12T18:35:59.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.497+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.6lbYK4L9-NfFSTG2KsIx1UgoOzy9-WQ_0 2024-09-12T18:35:59.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.497+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17378422571522028878', time=2024-09-12T20:03:18.933662+0000, chain.objs.size()=1 2024-09-12T18:35:59.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.497+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.fWR43KVHjRT2O-zn3B-izyqg1DpAg_3_0 2024-09-12T18:35:59.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.497+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11304822424144607318', time=2024-09-12T20:04:01.443391+0000, chain.objs.size()=1 2024-09-12T18:35:59.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.497+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.288__shadow_.WqX7PxT7e-PXbYk3DjJfDC3cTuXeiGb_0 2024-09-12T18:35:59.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.497+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8355827015724296273', time=2024-09-12T20:04:01.461636+0000, chain.objs.size()=1 2024-09-12T18:35:59.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.497+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.288__shadow_.QMPFJg3IJyJ0ucE_72ImcqLTOHMP2yR_0 2024-09-12T18:35:59.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.497+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11408523872396045502', time=2024-09-12T20:04:12.948901+0000, chain.objs.size()=1 2024-09-12T18:35:59.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.497+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.KMfRWud78ynx53tQCpnIKTsYuMg_FwC_0 2024-09-12T18:35:59.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16594248429315519931', time=2024-09-12T20:04:36.896437+0000, chain.objs.size()=1 2024-09-12T18:35:59.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.305__shadow_.3-Vf9YpbQlgNSNlnri6-7PIeCK2Jqt2_0 2024-09-12T18:35:59.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13394725317382821588', time=2024-09-12T20:04:43.367117+0000, chain.objs.size()=1 2024-09-12T18:35:59.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.308__shadow:a9nfOwOiJDCq-FECxTHzfnfQq8wvHTA_.ptpnIjm-weJZt89gTGkvOD3OkvS2P8g_0 2024-09-12T18:35:59.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17105138845098024934', time=2024-09-12T20:06:53.356202+0000, chain.objs.size()=1 2024-09-12T18:35:59.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Q3mvg2J9w3rk5ujkdB6gtPuiEOcTE0c_0 2024-09-12T18:35:59.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14501195633952671267', time=2024-09-12T20:06:55.606636+0000, chain.objs.size()=1 2024-09-12T18:35:59.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.8PBkQyl-6FzYfoqvKhVGyxvvSNRyY0i_0 2024-09-12T18:35:59.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8818182995693331371', time=2024-09-12T20:06:57.058070+0000, chain.objs.size()=1 2024-09-12T18:35:59.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.dHMa3iEPp4duNjVVFqcY47c4tqbkw7i_0 2024-09-12T18:35:59.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.856539347598372914', time=2024-09-12T20:06:57.743101+0000, chain.objs.size()=1 2024-09-12T18:35:59.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.o9eNfvfTrPt-d8WLy8MFbqr4sBjXt6e_0 2024-09-12T18:35:59.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14035027991004357595', time=2024-09-12T20:06:58.853556+0000, chain.objs.size()=1 2024-09-12T18:35:59.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.RZp_76fBhAPiiWf21_DxED1OcIlROr9_0 2024-09-12T18:35:59.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14448689971581263982', time=2024-09-12T20:06:58.855609+0000, chain.objs.size()=1 2024-09-12T18:35:59.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.4_rCg0ErogwUbLGfeDeLVTB_moCP2jg_0 2024-09-12T18:35:59.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10073621076451000742', time=2024-09-12T20:06:59.238727+0000, chain.objs.size()=1 2024-09-12T18:35:59.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Lz2zFxIi0Iiysz49WKq3usX2o5d68yw_0 2024-09-12T18:35:59.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11536642589779629284', time=2024-09-12T20:06:59.333859+0000, chain.objs.size()=1 2024-09-12T18:35:59.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.YxtjBl_w9m0Nf2swQjx3X59FUEtUrUU_0 2024-09-12T18:35:59.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.505+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6090624770754687170', time=2024-09-12T20:06:59.726432+0000, chain.objs.size()=1 2024-09-12T18:35:59.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.505+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Nh9HGT0Y9XPIlHPF3_GkYVxE5equUhd_0 2024-09-12T18:35:59.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.505+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17555804953595458646', time=2024-09-12T20:07:00.339837+0000, chain.objs.size()=1 2024-09-12T18:35:59.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.505+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-X9Zm_8ApHlUNEpbpL4WShGPcnLTpy__0 2024-09-12T18:35:59.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.505+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7678448539207113614', time=2024-09-12T20:07:05.290347+0000, chain.objs.size()=1 2024-09-12T18:35:59.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.505+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.6sni20symbfKU5lBy-A7HpJG1Us_WGk_0 2024-09-12T18:35:59.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11566171863480435328', time=2024-09-12T20:07:06.174375+0000, chain.objs.size()=1 2024-09-12T18:35:59.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.3dIvoNAvRqKC9oqQdIL5gVfqcsIQ9eI_0 2024-09-12T18:35:59.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8473046287833047085', time=2024-09-12T20:07:07.767194+0000, chain.objs.size()=1 2024-09-12T18:35:59.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.dy_gKpqstRB6sYR2NBxXWPv7GXCBNkS_0 2024-09-12T18:35:59.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13818280942069810288', time=2024-09-12T20:07:07.929326+0000, chain.objs.size()=1 2024-09-12T18:35:59.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.hwRxJNbK32Nq0kSS3JyjiDNjx1XlEpK_0 2024-09-12T18:35:59.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13284331549044265764', time=2024-09-12T20:07:08.270598+0000, chain.objs.size()=1 2024-09-12T18:35:59.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.UW2qzNqRCjdW4Lh13JLSJSmPsd-8nvq_0 2024-09-12T18:35:59.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13826009678088119747', time=2024-09-12T20:07:08.542656+0000, chain.objs.size()=1 2024-09-12T18:35:59.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.pCuEyPOjHFCkHrv4zHyyzh5jXMRwvh7_0 2024-09-12T18:35:59.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13519414339102716900', time=2024-09-12T20:07:09.791822+0000, chain.objs.size()=1 2024-09-12T18:35:59.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.RLKl3UNoiGCmoeqRzpIF-9KerFhtwbM_0 2024-09-12T18:35:59.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.76195699802614898', time=2024-09-12T20:07:14.122069+0000, chain.objs.size()=1 2024-09-12T18:35:59.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_._FsL_Y9hi4QRfs2Nnjje8m5c18MV_WA_0 2024-09-12T18:35:59.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7450537165849375765', time=2024-09-12T20:07:14.264862+0000, chain.objs.size()=1 2024-09-12T18:35:59.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.fwz7J-MaIdSazXk2-kPefZ9tNLpDDP0_0 2024-09-12T18:35:59.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15493172507181415646', time=2024-09-12T20:07:14.402406+0000, chain.objs.size()=1 2024-09-12T18:35:59.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.509+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.htuxYftH41qguD7EMwrwr1DlHFSlDv3_0 2024-09-12T18:35:59.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.513+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8152548578526697453', time=2024-09-12T20:07:15.014329+0000, chain.objs.size()=1 2024-09-12T18:35:59.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.513+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.g5pRS-IRECSgUqo7J2iqmkuvW98YYjI_0 2024-09-12T18:35:59.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.513+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13844628882829351831', time=2024-09-12T20:07:15.172499+0000, chain.objs.size()=1 2024-09-12T18:35:59.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.513+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.5m2zlmt2TjzqX1BgpHROdwdkl7UkZ5D_0 2024-09-12T18:35:59.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12546276014163990377', time=2024-09-12T20:07:15.845963+0000, chain.objs.size()=1 2024-09-12T18:35:59.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-SMTdNJXbJadXK6HQukPEk78YjCcItd_0 2024-09-12T18:35:59.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15538907311079154981', time=2024-09-12T20:07:18.249787+0000, chain.objs.size()=1 2024-09-12T18:35:59.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.IzD_Xzc5ivabtro2taTvhU6SUgTDQtR_0 2024-09-12T18:35:59.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8767233487312767771', time=2024-09-12T20:07:18.572419+0000, chain.objs.size()=1 2024-09-12T18:35:59.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.GRE70qV6o15zXwkNva2FfJRjTs5eTN3_0 2024-09-12T18:35:59.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3012881433760531090', time=2024-09-12T20:07:18.697138+0000, chain.objs.size()=1 2024-09-12T18:35:59.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.1C_ennOBxuqRPurGn6uMc59oDXbOI6S_0 2024-09-12T18:35:59.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11045937406936299749', time=2024-09-12T20:07:18.743530+0000, chain.objs.size()=1 2024-09-12T18:35:59.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.p3WrysH4jhVrf5TJn_UIM23EqY1iLWZ_0 2024-09-12T18:35:59.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4070184635113401209', time=2024-09-12T20:09:01.907750+0000, chain.objs.size()=1 2024-09-12T18:35:59.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.v_iCFVyFszc2LKnV8X2q3C8QY6Rr3bO_0 2024-09-12T18:35:59.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16576570663002944836', time=2024-09-12T20:09:02.724377+0000, chain.objs.size()=1 2024-09-12T18:35:59.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.dHGjM90gkJGT0RWi2x2VqAArdQ-Helx_0 2024-09-12T18:35:59.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6253799249027686419', time=2024-09-12T20:09:03.190941+0000, chain.objs.size()=1 2024-09-12T18:35:59.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.X7N91yxnGvldVr5AhU4pVEIdRcLuUGz_0 2024-09-12T18:35:59.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14830877509054426984', time=2024-09-12T20:09:03.628408+0000, chain.objs.size()=1 2024-09-12T18:35:59.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.hNM3cR5ZQ1nlNxYPwSKcjdn5Auo76dX_0 2024-09-12T18:35:59.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4447226617618326546', time=2024-09-12T20:09:04.304252+0000, chain.objs.size()=1 2024-09-12T18:35:59.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.88-j8S81hOoXP0IlnvbKwzG9ZXeSbia_0 2024-09-12T18:35:59.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4341249435219203925', time=2024-09-12T20:09:10.606905+0000, chain.objs.size()=1 2024-09-12T18:35:59.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.517+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.KTUxvobf5sj8ToLzAn11n8W_bCWDhcS_0 2024-09-12T18:35:59.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.521+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8396368751206275318', time=2024-09-12T20:09:13.334183+0000, chain.objs.size()=1 2024-09-12T18:35:59.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.521+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.M5PjKBJIScIyiDlZa-PW90CikGUOUnx_0 2024-09-12T18:35:59.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5579186699406624495', time=2024-09-12T20:09:13.429662+0000, chain.objs.size()=1 2024-09-12T18:35:59.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.LrJg_DCV6ROIfGUJVI5eU6Tx_RcMFSe_0 2024-09-12T18:35:59.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1571538134341095800', time=2024-09-12T20:09:13.865753+0000, chain.objs.size()=1 2024-09-12T18:35:59.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.4ZHc5zZ6DgQ8H3F2vWxHacOwTBtNQMx_0 2024-09-12T18:35:59.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15189884123471310054', time=2024-09-12T20:09:14.071499+0000, chain.objs.size()=1 2024-09-12T18:35:59.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.n9lqYjPHnh1cAJsXUSHDopIZCBnz-56_0 2024-09-12T18:35:59.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10330942215109335185', time=2024-09-12T20:09:14.073311+0000, chain.objs.size()=1 2024-09-12T18:35:59.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.nAPKeWf4_tLJY_MvpJL-8nOv-vOz7tF_0 2024-09-12T18:35:59.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14255140982756611548', time=2024-09-12T20:09:15.184503+0000, chain.objs.size()=1 2024-09-12T18:35:59.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.w6HNSriTlM_qUi3n3Pl2_5-rHLh61wq_0 2024-09-12T18:35:59.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8156083879672662651', time=2024-09-12T20:09:15.619335+0000, chain.objs.size()=1 2024-09-12T18:35:59.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.wqWGLBFtcKRuJNdu2nnh2BUmDIvwa85_0 2024-09-12T18:35:59.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1256806283361366042', time=2024-09-12T20:09:17.416609+0000, chain.objs.size()=1 2024-09-12T18:35:59.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.AkU3Se2D8c1wKLbLOmCVRAIWxgkdwHj_0 2024-09-12T18:35:59.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17684799634266371093', time=2024-09-12T20:09:17.483771+0000, chain.objs.size()=1 2024-09-12T18:35:59.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.QdMMkrxH21mkRSsp2fOhCQZ_ETwZAKV_0 2024-09-12T18:35:59.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15518678679303324836', time=2024-09-12T20:09:17.633081+0000, chain.objs.size()=1 2024-09-12T18:35:59.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.GOKeO157rAOETvtOWMkjWb4_bk5saiQ_0 2024-09-12T18:35:59.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17498907191084783264', time=2024-09-12T20:09:17.891927+0000, chain.objs.size()=1 2024-09-12T18:35:59.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.YtuA7-QFlaBX_uODKXoYwnoBRhSAKHO_0 2024-09-12T18:35:59.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6415333743482141869', time=2024-09-12T20:09:17.893594+0000, chain.objs.size()=1 2024-09-12T18:35:59.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.3LtkNUzDx-x7AupPfrDgs9je4d3OpbE_0 2024-09-12T18:35:59.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.529+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5513347447241784258', time=2024-09-12T20:09:18.135830+0000, chain.objs.size()=1 2024-09-12T18:35:59.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.529+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2c3wnXfbJZ2Ec0KaiDp_r_NxY9Y1YQU_0 2024-09-12T18:35:59.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.529+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8270852821551882414', time=2024-09-12T20:09:18.734131+0000, chain.objs.size()=1 2024-09-12T18:35:59.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.529+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Zdolv_VymEbG_g5IKJ5kx0enW5t303J_0 2024-09-12T18:35:59.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.529+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12925256820208014440', time=2024-09-12T20:09:18.962227+0000, chain.objs.size()=1 2024-09-12T18:35:59.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.529+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.0VBB6wEVhIncau_rgAxHty4XUVo80ug_0 2024-09-12T18:35:59.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.529+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6913399767598642462', time=2024-09-12T20:09:20.542707+0000, chain.objs.size()=1 2024-09-12T18:35:59.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.529+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.h4jB7O2X8JAaOYqsXrIgftfr27n9_0__0 2024-09-12T18:35:59.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.533+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4952330245534813544', time=2024-09-12T20:09:21.368504+0000, chain.objs.size()=1 2024-09-12T18:35:59.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.533+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.zE8ORz7gGvhKIaOCvGyRBzRa1C9ShiR_0 2024-09-12T18:35:59.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.533+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7811203149571391865', time=2024-09-12T20:09:22.019152+0000, chain.objs.size()=1 2024-09-12T18:35:59.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.533+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Bismffq6k5kJTbmQ860kgee4zSQQPn__0 2024-09-12T18:35:59.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.533+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10996967713583481739', time=2024-09-12T20:09:22.276324+0000, chain.objs.size()=1 2024-09-12T18:35:59.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.533+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.nZASTdiS0DBtH8c6Rm817GUVVRYoDey_0 2024-09-12T18:35:59.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.533+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10230801631849254711', time=2024-09-12T20:09:24.886997+0000, chain.objs.size()=1 2024-09-12T18:35:59.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.533+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.YOmH8jMDBi9opNR_buFbaTbDfpylm-C_0 2024-09-12T18:35:59.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.533+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6785008279002502720', time=2024-09-12T20:09:24.946552+0000, chain.objs.size()=1 2024-09-12T18:35:59.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.533+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.QhgRS5AxSx5MKAXb1OBfsCMMeHnZVtI_0 2024-09-12T18:35:59.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.533+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14519930019880700005', time=2024-09-12T20:09:25.574122+0000, chain.objs.size()=1 2024-09-12T18:35:59.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.533+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xCzMGbfLW4b49Was7pQa69a1j6um2tC_0 2024-09-12T18:35:59.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.533+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13033026422450352965', time=2024-09-12T20:09:25.833550+0000, chain.objs.size()=1 2024-09-12T18:35:59.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.533+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.so_3JdtOiyW33jjHxWVcaMFggzhH9xx_0 2024-09-12T18:35:59.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.533+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3047056234129046955', time=2024-09-12T20:09:25.949548+0000, chain.objs.size()=1 2024-09-12T18:35:59.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.533+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.32_eAb1KpbUANVUl5gU6oKKSc6tQOau_0 2024-09-12T18:35:59.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14292805531491500381', time=2024-09-12T20:09:26.234902+0000, chain.objs.size()=1 2024-09-12T18:35:59.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.usyJ7QQhI4tNzzQpym7cEmkyLEOqAuY_0 2024-09-12T18:35:59.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3415886978066365534', time=2024-09-12T20:09:26.619152+0000, chain.objs.size()=1 2024-09-12T18:35:59.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.7sF42gonR_S8c70zl0M1XSAXH1fAjSi_0 2024-09-12T18:35:59.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6003142034057979597', time=2024-09-12T20:09:28.365341+0000, chain.objs.size()=1 2024-09-12T18:35:59.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.-aRozIkZGmVbIO-ZSP8qkKnnpDAUHtg_0 2024-09-12T18:35:59.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9317222372242737792', time=2024-09-12T20:09:29.106805+0000, chain.objs.size()=1 2024-09-12T18:35:59.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.HXHLpVIl2ujJNfc9GezbZmSkCstq7Ot_0 2024-09-12T18:35:59.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15115883111149283373', time=2024-09-12T20:09:29.642736+0000, chain.objs.size()=1 2024-09-12T18:35:59.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.rb8vxMTjkAmglsbLZNUqMUhixXgi29P_0 2024-09-12T18:35:59.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2878421954999022098', time=2024-09-12T20:09:40.926446+0000, chain.objs.size()=1 2024-09-12T18:35:59.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.333__shadow_.EOy7JohzP9RMO3QBsINcXeOBX3lNsod_0 2024-09-12T18:35:59.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5341132065076115813', time=2024-09-12T20:09:55.171583+0000, chain.objs.size()=1 2024-09-12T18:35:59.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.344__shadow_.xk7HiXkqoaeQ2jQ1fuyaNAZa47AZrE0_0 2024-09-12T18:35:59.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15875424963593272838', time=2024-09-12T20:12:30.839977+0000, chain.objs.size()=1 2024-09-12T18:35:59.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.459__shadow_.Vl3G9PlVHuiJ2Cq-cYTK5u2ugov4auc_0 2024-09-12T18:35:59.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9472511239589319126', time=2024-09-12T20:13:10.267138+0000, chain.objs.size()=1 2024-09-12T18:35:59.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.486__shadow_.pje7CUwyyRhkfQjoj5S6AZJ2W2k450G_0 2024-09-12T18:35:59.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13267423979474208631', time=2024-09-12T20:14:11.024045+0000, chain.objs.size()=1 2024-09-12T18:35:59.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.517__multipart_mymultipartcopy.2~Ex0WU9K8qx58YFXjTzTjhuwIYey9UrN.1 2024-09-12T18:35:59.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.545+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52346 2024-09-12T18:35:59.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T18:35:59.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2181831789103093309', time=2024-09-12T20:16:41.994984+0000, chain.objs.size()=2 2024-09-12T18:35:59.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.526__multipart_mymultipart.2~FoBrGlNHtChypAkwRStmTA5_ynhXlT4.1 2024-09-12T18:35:59.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.526__multipart_mymultipart.2~FoBrGlNHtChypAkwRStmTA5_ynhXlT4.2 2024-09-12T18:35:59.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3960028745400057807', time=2024-09-12T20:18:47.270740+0000, chain.objs.size()=1 2024-09-12T18:35:59.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.562__multipart_mymultipart.2~OO3XJm6M-3xZuZKJtAuTpkmHXFNlRWq.1 2024-09-12T18:35:59.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8245477037067494378', time=2024-09-12T20:19:34.940026+0000, chain.objs.size()=1 2024-09-12T18:35:59.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.574__shadow_.GCbvmndp2BvrlfR4DbHq9QGQOtZGi6b_0 2024-09-12T18:35:59.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10096797867716409102', time=2024-09-12T20:19:44.759185+0000, chain.objs.size()=1 2024-09-12T18:35:59.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.575__shadow:j9YClpvLUzzbK8o2t16ZlNgGAJxhhPb_.7XDLAapcnzuby7CH-YMmMusd-T9O4-0_0 2024-09-12T18:35:59.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2951573566466806465', time=2024-09-12T20:20:41.470266+0000, chain.objs.size()=1 2024-09-12T18:35:59.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:I9xmAIb7xIaXE41ZYJQJEzb9.L.MsuG_.kY12z6Zk9b7j4GIev5gUM1l85w9LLxZ_0 2024-09-12T18:35:59.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.29745161921362940', time=2024-09-12T20:21:11.723026+0000, chain.objs.size()=1 2024-09-12T18:35:59.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.581__shadow:8lkG-CsxESMZWJVlxzlVfzwJhT9RfF3_.2CfEIQ15zFt1KIe0ByggQxYj6e-SFvD_0 2024-09-12T18:35:59.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3221065777760781881', time=2024-09-12T20:21:27.529872+0000, chain.objs.size()=1 2024-09-12T18:35:59.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.588__shadow:ItbwlAr7VeE8FyMKAolrEPLf2-OlGS0_.KhL7LfqP2N8SWdwRbfdq6tYPT_ZdVXQ_0 2024-09-12T18:35:59.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6026090028477591272', time=2024-09-12T20:28:52.533546+0000, chain.objs.size()=1 2024-09-12T18:35:59.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.549+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.707__shadow_.7N7ditouWf1Fu7quUK3nsVKDydo6QT5_0 2024-09-12T18:35:59.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.557+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:35:59.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.561+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:35:59.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.561+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:35:59.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.561+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46052' 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18296868947630532035', time=2024-09-12T19:56:25.258149+0000, chain.objs.size()=1 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.163__shadow_.GZY8AVCcSAgnTFnb2TmqtFGhaHoUfjr_0 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_n_Ynm2VW9XuEBTTzIlkd3z8ra6FfTY9', time=2024-09-12T19:56:30.748046+0000, chain.objs.size()=1 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.166__shadow_.3L3NxZE-7te99XyhnNZByCl4VE3Fbfu_0 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13484200161399884529', time=2024-09-12T19:56:32.321467+0000, chain.objs.size()=1 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.167__shadow_.z-u-mVlbuDZ43Hud8fBtjTjqxBkjCWU_0 2024-09-12T18:35:59.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6309495927419917589', time=2024-09-12T20:00:59.963104+0000, chain.objs.size()=1 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.256__shadow_.fl9KYPax7caAcjynkC5ruVgJ7Sr0Y_w_0 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3913682653350837957', time=2024-09-12T20:02:51.973124+0000, chain.objs.size()=1 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.bfNJByn8JtmDvykpxsxrXQvcc4H1ACo_0 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8404650586703773998', time=2024-09-12T20:02:51.975391+0000, chain.objs.size()=1 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._QYrtVD1pWf1lrjVjc2NFhnnkcToAI9_0 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1889096329994690995', time=2024-09-12T20:02:54.017571+0000, chain.objs.size()=1 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.iWZjcl33sh3RlmP9QNHiVn1mor_OUjt_0 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15534661603898301053', time=2024-09-12T20:02:56.293575+0000, chain.objs.size()=1 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.z2KJWn0XvEMGA5TC-fC4r_cBCT5FNsS_0 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2917031657338317997', time=2024-09-12T20:02:56.738830+0000, chain.objs.size()=1 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.MWI2gu_gNPfT3UMEpHpwWLpxkWT170r_0 2024-09-12T18:35:59.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14139638963680220734', time=2024-09-12T20:02:57.081079+0000, chain.objs.size()=1 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._nUTCpSRQA3afiW0nSflIWbZ0pLMg4L_0 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17531507036095989429', time=2024-09-12T20:02:58.085413+0000, chain.objs.size()=1 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2N5NDQwy54gPZMKriBlACXy3Smlh_qM_0 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13605234133053554457', time=2024-09-12T20:02:58.258786+0000, chain.objs.size()=1 2024-09-12T18:35:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ByvdG9oyofk2hX8-vj3gqabtMm_Ni4__0 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16031585924431400143', time=2024-09-12T20:03:00.324777+0000, chain.objs.size()=1 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.evdfQEF3GSzVA-dslnIWlRj8ZU5_CiS_0 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2822299113731861278', time=2024-09-12T20:03:00.326775+0000, chain.objs.size()=1 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.kARBsuUMV-dg7kvnxjAYcsdjki1i0P9_0 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9861570746299995483', time=2024-09-12T20:03:01.134857+0000, chain.objs.size()=1 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Nu5AiZM5bL6i8GkCWHCHkIliOtY_h_N_0 2024-09-12T18:35:59.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16567384639619646906', time=2024-09-12T20:03:01.573468+0000, chain.objs.size()=1 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XqcmHl3Twz5qN_4xsKuASVl696yMaDT_0 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10883375103732468104', time=2024-09-12T20:03:02.291537+0000, chain.objs.size()=1 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3r94kbPFUDczCq_OjY6hE1zhe5iJn5F_0 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1887596260125677858', time=2024-09-12T20:03:02.429778+0000, chain.objs.size()=1 2024-09-12T18:35:59.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.i0UMZMEu_bsgzq2cju86WIl5IYKB5sW_0 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13922598213993719336', time=2024-09-12T20:03:03.491968+0000, chain.objs.size()=1 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.i-AkqdcL16GaiNWFlQo7mGPql6GnFX4_0 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5332746365719190982', time=2024-09-12T20:03:03.954987+0000, chain.objs.size()=1 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.AwHY4o7B_YPM4gezCbh3gSVcVVS0UvT_0 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.532156728367293784', time=2024-09-12T20:03:04.099729+0000, chain.objs.size()=1 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.7rdsyqiFZOfOGxlEeRqDfriq7WSWyFl_0 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6493413419662269067', time=2024-09-12T20:03:04.570015+0000, chain.objs.size()=1 2024-09-12T18:35:59.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.UHml0cxlaNW7i4r_IMu_o5LT5r6fRzc_0 2024-09-12T18:35:59.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18436399377194541472', time=2024-09-12T20:03:05.218275+0000, chain.objs.size()=1 2024-09-12T18:35:59.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.569+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._ysoL_n6elmU9oAacIlz2y7JM1DQt2O_0 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4906993944706169219', time=2024-09-12T20:03:05.917498+0000, chain.objs.size()=1 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-jPv3GTKhbyVMQ1SaHhQCzeogCij1jj_0 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13084072458828778462', time=2024-09-12T20:03:06.111868+0000, chain.objs.size()=1 2024-09-12T18:35:59.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.dVImi1mbdeTFqTwIaMTyiOmSurvRvtz_0 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3897684767120205689', time=2024-09-12T20:03:06.331051+0000, chain.objs.size()=1 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.643eveHdJgECcMgfuVN1QYBkTk7ZSeL_0 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4447401376910207586', time=2024-09-12T20:03:08.728336+0000, chain.objs.size()=1 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Adq8Yx6HZmJJACc3EwD_PcMGK6GjPAw_0 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2194146344834017830', time=2024-09-12T20:03:09.502484+0000, chain.objs.size()=1 2024-09-12T18:35:59.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.OWGmvbS_x2GEN8C1XOzkD9oRfmKJ02-_0 2024-09-12T18:35:59.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17066306702514290036', time=2024-09-12T20:03:15.206554+0000, chain.objs.size()=1 2024-09-12T18:35:59.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Ec2efeCY2ovZO7huRveQrYKXlgDary9_0 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.577+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17097652402965859265', time=2024-09-12T20:03:16.003464+0000, chain.objs.size()=1 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.577+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.YAeO_LbXqOOg17skCMfdlQYP0h6q-rU_0 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.577+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15943157903132707453', time=2024-09-12T20:03:18.956873+0000, chain.objs.size()=1 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.577+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.pmimUDxeSs3kZwk7pKgW2TeYsxWk9Jk_0 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.577+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13753637111064702896', time=2024-09-12T20:03:19.273817+0000, chain.objs.size()=1 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.577+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.gythj3DjQWuqdPyiozkbgpJZhOQA_b3_0 2024-09-12T18:35:59.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.577+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14809109626263801911', time=2024-09-12T20:03:19.336554+0000, chain.objs.size()=1 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.577+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.TrWn2LhLiGq7ejNpbiHCBxnPNB1-XEg_0 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.577+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9199454695090737598', time=2024-09-12T20:03:20.040735+0000, chain.objs.size()=1 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.577+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.zvlrrQ6oULlgfsGeVHUJtNQvt-pqOcy_0 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.577+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5654332007345099450', time=2024-09-12T20:03:20.346997+0000, chain.objs.size()=1 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.577+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-gYJnSuM-19YvANNmiQYPI68tDiZwfm_0 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.577+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8192232595885196521', time=2024-09-12T20:03:22.261942+0000, chain.objs.size()=1 2024-09-12T18:35:59.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.577+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.264__shadow_.yDkU7LOoyjFxRZW4xSwAQE2koNjXA8B_0 2024-09-12T18:35:59.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.581+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12061805428866174738', time=2024-09-12T20:03:25.391927+0000, chain.objs.size()=1 2024-09-12T18:35:59.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.581+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.266__shadow_.vksuUah-35uaHAnIJ3PVnA9LH07aauw_0 2024-09-12T18:35:59.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.581+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12828024609696602644', time=2024-09-12T20:03:28.500230+0000, chain.objs.size()=1 2024-09-12T18:35:59.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.581+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.268__shadow_.Qts3MoawwzjN8X9-re0tpb56-qFc5vk_0 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.581+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10206783018258719480', time=2024-09-12T20:03:49.354630+0000, chain.objs.size()=1 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.581+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.281__shadow_.fIltjeLpthKCtHcjyAiOLk39J_49msA_0 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.581+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17749950447178456337', time=2024-09-12T20:03:59.795128+0000, chain.objs.size()=1 2024-09-12T18:35:59.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.581+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.287__shadow_.TdPb8a4AmM5LJmXBsbo-nNezVjXagou_0 2024-09-12T18:35:59.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7868236281920622555', time=2024-09-12T20:04:03.166139+0000, chain.objs.size()=1 2024-09-12T18:35:59.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.289__shadow_.U8qE4f_L4B8jt4M05zIEz6i53nsYlPV_0 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17890126383166164391', time=2024-09-12T20:04:12.981090+0000, chain.objs.size()=1 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.qT00ZVVCIgZDWZSsaThKQ1AohFzpHg5_0 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7789318683276174328', time=2024-09-12T20:04:19.921723+0000, chain.objs.size()=1 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.295__shadow_.ajlIx6KP-MxmV-EovCVyGfJfSzOAuWr_0 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14667821428923902984', time=2024-09-12T20:04:30.235420+0000, chain.objs.size()=1 2024-09-12T18:35:59.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.301__shadow_.f0ahQu0m5jFUVvwrAo2bS1GFlpGi65a_0 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.928361347045617825', time=2024-09-12T20:05:02.496054+0000, chain.objs.size()=1 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.320__shadow:aMX1QW-QvGfTBKFTjiUYxs7289yLNCA_.SRWLr4f3aO--iMdy3JCheUf1JRL_yiF_0 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9337766072400029379', time=2024-09-12T20:06:52.301170+0000, chain.objs.size()=1 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.gJC1zJzfCPz0DQwQPM1InI3HlgvxLUn_0 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16969384883128369854', time=2024-09-12T20:06:52.806116+0000, chain.objs.size()=1 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.mQWYStKPX4X_dbt6GxvfTfbIPXIsPsv_0 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8856558635515753441', time=2024-09-12T20:06:53.690205+0000, chain.objs.size()=1 2024-09-12T18:35:59.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.d0VnTarFcAxJbl_whu9yLoCxO_A2jJp_0 2024-09-12T18:35:59.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1455023850123590799', time=2024-09-12T20:06:54.923527+0000, chain.objs.size()=1 2024-09-12T18:35:59.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.j1V1raOZT06t_VjnueCFyJ9P8jotgn7_0 2024-09-12T18:35:59.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9899021176354700692', time=2024-09-12T20:06:55.018335+0000, chain.objs.size()=1 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.MVff4I-_b-da4QF5kKI5nECEQyFMPyp_0 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13003486314609761536', time=2024-09-12T20:06:57.540940+0000, chain.objs.size()=1 2024-09-12T18:35:59.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.585+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.42UgJzwGq7q58tokBSqxib1Of4ba0_g_0 2024-09-12T18:35:59.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.589+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15856338557243471081', time=2024-09-12T20:06:57.544777+0000, chain.objs.size()=1 2024-09-12T18:35:59.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.589+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.t4TNahDIHD9UeJdEarxvKuNnmXvyiTb_0 2024-09-12T18:35:59.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.589+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6105225205425452906', time=2024-09-12T20:06:57.740277+0000, chain.objs.size()=1 2024-09-12T18:35:59.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.589+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.JW9F_lECzbmSCf6eDGq17y1X9ufcvYq_0 2024-09-12T18:35:59.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.589+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12823126577778111824', time=2024-09-12T20:07:01.275719+0000, chain.objs.size()=1 2024-09-12T18:35:59.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.589+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ErVyYaPHqe2FFcEDS8ILiwWctlo4E92_0 2024-09-12T18:35:59.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.589+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18114512389715049426', time=2024-09-12T20:07:02.805461+0000, chain.objs.size()=1 2024-09-12T18:35:59.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.589+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7aydeQKJylWmig0ItV9IfenzIPKt8ZW_0 2024-09-12T18:35:59.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.589+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14403554663910017739', time=2024-09-12T20:07:02.974794+0000, chain.objs.size()=1 2024-09-12T18:35:59.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.589+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.EIittsbbRFI7I9XmoKA4k1i6-QI22_b_0 2024-09-12T18:35:59.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.589+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3623501626703926320', time=2024-09-12T20:07:03.364514+0000, chain.objs.size()=1 2024-09-12T18:35:59.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.589+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.eHNUz2s1NQHb9DuDiZl2Nknhu5U-KCP_0 2024-09-12T18:35:59.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.589+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13684242656867182704', time=2024-09-12T20:07:04.009445+0000, chain.objs.size()=1 2024-09-12T18:35:59.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.589+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.nHoNxUVt54uvXJzSoxyO4hAW4yIbR1t_0 2024-09-12T18:35:59.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.593+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15092203407490272402', time=2024-09-12T20:07:04.991268+0000, chain.objs.size()=1 2024-09-12T18:35:59.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.593+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.wM8CRgsVd68C8dXyUYIxGOSrGCkrguY_0 2024-09-12T18:35:59.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.593+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14877345495376859567', time=2024-09-12T20:07:06.969679+0000, chain.objs.size()=1 2024-09-12T18:35:59.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.593+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.zDHk8GoS3JLdZmw4VyeFTslUzAPh6O7_0 2024-09-12T18:35:59.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.593+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6212063460343763090', time=2024-09-12T20:07:08.261607+0000, chain.objs.size()=1 2024-09-12T18:35:59.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.593+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.GUVW_dMmlsZDr7gJkAPWG4vM25UkUDb_0 2024-09-12T18:35:59.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.593+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4936300752392530828', time=2024-09-12T20:07:09.861988+0000, chain.objs.size()=1 2024-09-12T18:35:59.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.593+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.kOxdj3M3pc-kURqn0DG4JxfCUiwagwS_0 2024-09-12T18:35:59.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.593+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12859476473980583187', time=2024-09-12T20:07:10.278580+0000, chain.objs.size()=1 2024-09-12T18:35:59.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.593+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.hDdTUdPDfoKvI28YLJ6lZFEoVUo9gF7_0 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.852193972773977997', time=2024-09-12T20:07:10.606390+0000, chain.objs.size()=1 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.uN2jRxpSjNyq95LFf9D78XKawsSupaE_0 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16723152197702255076', time=2024-09-12T20:07:11.003059+0000, chain.objs.size()=1 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.F3HEXFOyei3DhovjJrmnlpYUnXkAKhx_0 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12885429790056847837', time=2024-09-12T20:07:11.513259+0000, chain.objs.size()=1 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.3zoEi_jbXp1Hmalx_haZc_rgI5u0gNP_0 2024-09-12T18:35:59.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17376566787530446756', time=2024-09-12T20:07:11.683627+0000, chain.objs.size()=1 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.WJ0YwO1iX2nyeTIw1wesznLlHcRN06d_0 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15565295392917147193', time=2024-09-12T20:07:15.571362+0000, chain.objs.size()=1 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.XLgAbcDqDUGzgKjSEfrKAjxil-234GF_0 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9601465751264258208', time=2024-09-12T20:07:15.735796+0000, chain.objs.size()=1 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.vBD0ib9BuKiG-xFmXvZvzL7Zd6vSPAZ_0 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17514760900577485665', time=2024-09-12T20:07:16.131330+0000, chain.objs.size()=1 2024-09-12T18:35:59.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.HF35tX2tZ5TwKOQRn08M-CcUJDb4xUI_0 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12137552015456518775', time=2024-09-12T20:07:19.031313+0000, chain.objs.size()=1 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Od8f1d3IlKY16b0m9xUXbcGDd5WdHZd_0 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2057039627231424507', time=2024-09-12T20:07:19.165990+0000, chain.objs.size()=1 2024-09-12T18:35:59.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Ea3ICacWBT923rTfe7dAsOSw7GZUVKI_0 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2105287846332002219', time=2024-09-12T20:09:01.953187+0000, chain.objs.size()=1 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.toAnM9wFtlRk3T994dkhpTP55EPDw-b_0 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9479380288226233207', time=2024-09-12T20:09:02.988188+0000, chain.objs.size()=1 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.J3y8KGmYaYqotD4gWXL9zUDE_MgTVuG_0 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7615790488986010246', time=2024-09-12T20:09:03.644036+0000, chain.objs.size()=1 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.597+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.-Q0l71Lf48JcpMp6qlEilK62jDyzpIe_0 2024-09-12T18:35:59.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.601+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6998035470602120396', time=2024-09-12T20:09:05.727188+0000, chain.objs.size()=1 2024-09-12T18:35:59.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.601+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.RP1Ct7bSC3fJBOTEYQ1VsKhb4ZYZORM_0 2024-09-12T18:35:59.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.601+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10603218486793256468', time=2024-09-12T20:09:05.728975+0000, chain.objs.size()=1 2024-09-12T18:35:59.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.601+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.4hKe2YfkiLKABOBkDPIVSyDawQebW0X_0 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.601+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13578675492434567273', time=2024-09-12T20:09:06.817325+0000, chain.objs.size()=1 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.601+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.BYhjqigqI8XZrnrzRAk67PLGuAaRk3p_0 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.601+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3893914525129681385', time=2024-09-12T20:09:07.477763+0000, chain.objs.size()=1 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.601+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.45MRbnAwhXlvNyS1kDg1Ulf7eURArJX_0 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.601+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7472024812715853444', time=2024-09-12T20:09:07.542988+0000, chain.objs.size()=1 2024-09-12T18:35:59.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.601+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.eG5kGNRahk-6C5uDsjIVgDuT6PxJAbp_0 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5555346613971282125', time=2024-09-12T20:09:09.597267+0000, chain.objs.size()=1 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.hij3JuePnVrF0YKjwoWuiXeHUrv_zvt_0 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8485700414925618584', time=2024-09-12T20:09:10.413937+0000, chain.objs.size()=1 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.9REsV491CPC1FfRGL-pPrbLiqZqgcHG_0 2024-09-12T18:35:59.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15066458529955493191', time=2024-09-12T20:09:10.636301+0000, chain.objs.size()=1 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.zJrZ7SUaYR3C4_XOXAuaS3mi6S0qRzC_0 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3803646519000256100', time=2024-09-12T20:09:10.725617+0000, chain.objs.size()=1 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.D0E23jYVIxQ1wx0pgCB_1heLik0HQ69_0 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16861811802947503071', time=2024-09-12T20:09:10.768904+0000, chain.objs.size()=1 2024-09-12T18:35:59.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.eeSG91Fko8J26-gCWtdlVXFwT--XVGD_0 2024-09-12T18:35:59.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10008828722167046611', time=2024-09-12T20:09:11.897660+0000, chain.objs.size()=1 2024-09-12T18:35:59.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.EpAHEWyUwVCFC9Tb_GMRScu0acBeRyO_0 2024-09-12T18:35:59.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9888591398018974246', time=2024-09-12T20:09:11.899564+0000, chain.objs.size()=1 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.QmaKRl1iA80L6O4sCOCTzZ8ZnLnakpu_0 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5289861823207878951', time=2024-09-12T20:09:15.052096+0000, chain.objs.size()=1 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.WpEBPqMCmoXmntukhIRXdW2-LORiyOd_0 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3419223828695469002', time=2024-09-12T20:09:15.414884+0000, chain.objs.size()=1 2024-09-12T18:35:59.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.605+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.A8ZVkxJP5iX1quCSiMh_4NPJWovEpDs_0 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.609+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10169691214337197524', time=2024-09-12T20:09:15.694698+0000, chain.objs.size()=1 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.609+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.W_t9RLOU6rmJSHUhdMPth9_nHVlM1Nj_0 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.609+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14090033041105661067', time=2024-09-12T20:09:16.047791+0000, chain.objs.size()=1 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.609+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.nlBzVQKp91WrMa5TSz2VrhsA-B2w02z_0 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.609+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14848240982233187364', time=2024-09-12T20:09:18.243864+0000, chain.objs.size()=1 2024-09-12T18:35:59.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.609+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.0e3OFOQQvDJ3yc_1SUgYv3vh-m6RU2K_0 2024-09-12T18:35:59.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.609+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.647173569108822861', time=2024-09-12T20:09:18.804333+0000, chain.objs.size()=1 2024-09-12T18:35:59.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.609+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vGAuirRbC-q9hl4l1__OMyg80TDamyo_0 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.609+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14668055102743211626', time=2024-09-12T20:09:20.578907+0000, chain.objs.size()=1 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.609+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.bVhH16MRIXZShfsC24KECMwIDVuwy--_0 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.609+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2516082087016294335', time=2024-09-12T20:09:20.580999+0000, chain.objs.size()=1 2024-09-12T18:35:59.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.609+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.KGgsOE1uO6JAD72l7w8yBAeQ7hwoLR-_0 2024-09-12T18:35:59.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.613+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8557995547377701161', time=2024-09-12T20:09:21.623593+0000, chain.objs.size()=1 2024-09-12T18:35:59.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.613+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xkFMe8z5g5azzqxqFtjOSGQAaJ3zzGm_0 2024-09-12T18:35:59.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.613+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16567042076789868899', time=2024-09-12T20:09:22.629420+0000, chain.objs.size()=1 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.613+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.9nyJ4E12U6EYTd66XcT8XU6prKDe_3L_0 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.613+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1924211939574231119', time=2024-09-12T20:09:23.795826+0000, chain.objs.size()=1 2024-09-12T18:35:59.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.613+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.1SPVpdADr1elz_abC8fABza8kuB7Tfs_0 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.613+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14043872372835571855', time=2024-09-12T20:09:25.514305+0000, chain.objs.size()=1 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.613+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.L8Aw9Pg0WCZ59Vfo-HUgzBjg2ut5CCi_0 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.617+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14956634040364573102', time=2024-09-12T20:09:26.246400+0000, chain.objs.size()=1 2024-09-12T18:35:59.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.617+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.olALzmxEom8HiANFsLdBojBjVckq8It_0 2024-09-12T18:35:59.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.621+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46052 2024-09-12T18:35:59.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T18:35:59.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14592791042324686677', time=2024-09-12T20:09:27.206865+0000, chain.objs.size()=1 2024-09-12T18:35:59.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ibJ5YspboacDvOJ9tb0gJytdBynHF81_0 2024-09-12T18:35:59.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10317294503982106952', time=2024-09-12T20:09:28.482197+0000, chain.objs.size()=1 2024-09-12T18:35:59.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.H5UCrNFaQS5tdw4u-_WWqn1L7xzW2Wx_0 2024-09-12T18:35:59.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12220988934314554466', time=2024-09-12T20:09:30.036562+0000, chain.objs.size()=1 2024-09-12T18:35:59.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.x4Nx51Wc8xc119_LlveRWsISD8BHaYN_0 2024-09-12T18:35:59.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11970335022200544358', time=2024-09-12T20:10:43.950721+0000, chain.objs.size()=1 2024-09-12T18:35:59.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.383__shadow_.esWXr9-AyPk2sPJVgoWI3THQ5bKhA88_0 2024-09-12T18:35:59.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17270048095712062949', time=2024-09-12T20:12:42.767369+0000, chain.objs.size()=1 2024-09-12T18:35:59.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.465__shadow_.s2dIqnKB9k30nBbtj_vN5TFBHEeMZtd_0 2024-09-12T18:35:59.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8685836227877601421', time=2024-09-12T20:13:17.110796+0000, chain.objs.size()=1 2024-09-12T18:35:59.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.488__shadow_.PWv02-ehkAxvGYXmM5Q2AGCQ1XsabA6_0 2024-09-12T18:35:59.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3314843319325737270', time=2024-09-12T20:13:23.794264+0000, chain.objs.size()=1 2024-09-12T18:35:59.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.492__shadow_.jprt9Co3MoOur-hqdPaiaR2RM-Pi4dt_0 2024-09-12T18:35:59.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4400985585586285168', time=2024-09-12T20:14:06.797014+0000, chain.objs.size()=1 2024-09-12T18:35:59.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.514__multipart_mymultipart.2~zPLeSf0hs5aGdhQanm7q4VDvyffGRjT.1 2024-09-12T18:35:59.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6550603134859546605', time=2024-09-12T20:16:29.331070+0000, chain.objs.size()=3 2024-09-12T18:35:59.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.524__multipart_mymultipart.2~Jx1bwUMkCoAXfOM7IipiqUvcXEIXzVb.1 2024-09-12T18:35:59.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.524__multipart_mymultipart.2~Jx1bwUMkCoAXfOM7IipiqUvcXEIXzVb.2 2024-09-12T18:35:59.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.524__multipart_mymultipart.2~Jx1bwUMkCoAXfOM7IipiqUvcXEIXzVb.3 2024-09-12T18:35:59.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1811699861756215282', time=2024-09-12T20:16:31.310019+0000, chain.objs.size()=3 2024-09-12T18:35:59.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.625+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.524__multipart_mymultipart.2~Cg33-wK2IdfIgFcP_ErnBZh1okt4iJA.1 2024-09-12T18:35:59.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.629+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.524__multipart_mymultipart.2~Cg33-wK2IdfIgFcP_ErnBZh1okt4iJA.2 2024-09-12T18:35:59.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.629+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.524__multipart_mymultipart.2~Cg33-wK2IdfIgFcP_ErnBZh1okt4iJA.3 2024-09-12T18:35:59.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.633+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7969516543671177353', time=2024-09-12T20:16:44.537136+0000, chain.objs.size()=3 2024-09-12T18:35:59.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.633+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.526__multipart_mymultipart.2~Ze12xNUtTjy6LxmGpJc3loBNkW58Yfc.1 2024-09-12T18:35:59.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.633+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.526__multipart_mymultipart.2~Ze12xNUtTjy6LxmGpJc3loBNkW58Yfc.2 2024-09-12T18:35:59.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.633+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.526__multipart_mymultipart.2~Ze12xNUtTjy6LxmGpJc3loBNkW58Yfc.3 2024-09-12T18:35:59.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.633+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~xGcaqCdryhI9eT5LaK8BIBk_o-kpzQn', time=2024-09-12T20:17:13.444019+0000, chain.objs.size()=1 2024-09-12T18:35:59.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.633+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.534__multipart_mymultipart.2~xGcaqCdryhI9eT5LaK8BIBk_o-kpzQn.1 2024-09-12T18:35:59.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.633+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15613036299395677291', time=2024-09-12T20:18:15.988356+0000, chain.objs.size()=1 2024-09-12T18:35:59.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.633+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.553__shadow_.rzv7WjJt63RhYGy_3seNYhvR4QP1O5p_0 2024-09-12T18:35:59.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2707545762705930295', time=2024-09-12T20:18:21.976750+0000, chain.objs.size()=1 2024-09-12T18:35:59.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.555__shadow_.U874dJu3OitpCwgYTNp9ba5KcyEDO-z_0 2024-09-12T18:35:59.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10154232404407829999', time=2024-09-12T20:18:28.881025+0000, chain.objs.size()=1 2024-09-12T18:35:59.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.557__shadow_.f7U3Xd8byVFH6FGvvDkAgg7TnqB4HON_0 2024-09-12T18:35:59.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5040108212003831357', time=2024-09-12T20:18:33.040900+0000, chain.objs.size()=1 2024-09-12T18:35:59.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.558__shadow_.gVb9c2Xa7PPgymNi1BGja3VdBSVABFF_0 2024-09-12T18:35:59.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13488110055344884229', time=2024-09-12T20:19:38.244163+0000, chain.objs.size()=1 2024-09-12T18:35:59.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.575__shadow_.j4lhIjB_3geF8Gcnx4X4kb0kwrA4Y3X_0 2024-09-12T18:35:59.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12921287541432971125', time=2024-09-12T20:20:09.589671+0000, chain.objs.size()=1 2024-09-12T18:35:59.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:ztc-iHcuohP8wlnbVrpyA4knmIHP1dI_.Ryw0JNxikglUqiLxcGoPL1fRSzN7Vgn_0 2024-09-12T18:35:59.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3713212700065836973', time=2024-09-12T20:20:20.893769+0000, chain.objs.size()=1 2024-09-12T18:35:59.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:18RV6Hb0TwsPjCzDcrfn9OfoWaBxFs-_.McPsItVZFY5-Mey9B6nIwZCjWDSvQxF_0 2024-09-12T18:35:59.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1375206032174197272', time=2024-09-12T20:28:31.755224+0000, chain.objs.size()=1 2024-09-12T18:35:59.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.694__shadow:EL1pRdigiwrfu9CVp.J4kxL4yt9.k21_.P4UJHO3GRaMpmHZBwWHQXmLNOldBMHT_0 2024-09-12T18:35:59.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9697287257990508009', time=2024-09-12T20:29:29.720549+0000, chain.objs.size()=1 2024-09-12T18:35:59.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.719__shadow_.Aj2TZa7PiwU1fTKnwRm_jeY3EuHU8Di_0 2024-09-12T18:35:59.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.645+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:35:59.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.653+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:35:59.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:35:59.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:35:59.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44011' 2024-09-12T18:35:59.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12821426560584387604', time=2024-09-12T19:56:55.892632+0000, chain.objs.size()=1 2024-09-12T18:35:59.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.182__shadow_._idXQ6Vb6UZfeNveKtqMaNveuhM_otK_0 2024-09-12T18:35:59.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12172091886607077346', time=2024-09-12T20:00:46.519040+0000, chain.objs.size()=1 2024-09-12T18:35:59.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.248__shadow_.wPwp9JbKUS2aUbdY-YLaa29EgGyTXqG_0 2024-09-12T18:35:59.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8460247659729977316', time=2024-09-12T20:01:04.739263+0000, chain.objs.size()=1 2024-09-12T18:35:59.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.259__shadow_.mIS-wdAY-5GkySohL-gYZ_a5Gh6duej_0 2024-09-12T18:35:59.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12491327591502132062', time=2024-09-12T20:02:52.390879+0000, chain.objs.size()=1 2024-09-12T18:35:59.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.KiihrN9WBBHiEkMK8SYNffXTL34eLuJ_0 2024-09-12T18:35:59.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9637758369334663961', time=2024-09-12T20:02:53.519501+0000, chain.objs.size()=1 2024-09-12T18:35:59.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Hmv7xsPCD8zF5xOCEt3wFTH1UFPmLUo_0 2024-09-12T18:35:59.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2931374767767286202', time=2024-09-12T20:02:53.892705+0000, chain.objs.size()=1 2024-09-12T18:35:59.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.YKAuEYW8C7mIRKpVfyxZThUrwyBjSZG_0 2024-09-12T18:35:59.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5332613800516227292', time=2024-09-12T20:02:56.872302+0000, chain.objs.size()=1 2024-09-12T18:35:59.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-FWmzZLjAAWnda_D6gs6bTjMKzXW3He_0 2024-09-12T18:35:59.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3582643465620182731', time=2024-09-12T20:02:57.407150+0000, chain.objs.size()=1 2024-09-12T18:35:59.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.EzZ0arn3SWbNGS7Ctya3-p6JuKYUnaI_0 2024-09-12T18:35:59.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11098096346769551566', time=2024-09-12T20:02:57.541286+0000, chain.objs.size()=1 2024-09-12T18:35:59.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.rTzeO3F_QoN5pexMFpLGpRIj9-2KesZ_0 2024-09-12T18:35:59.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13383492135505072441', time=2024-09-12T20:02:58.011542+0000, chain.objs.size()=1 2024-09-12T18:35:59.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.7SMPEjKkJz7ZZcTFWd_mzpYTKfGXCwX_0 2024-09-12T18:35:59.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2520889784328246516', time=2024-09-12T20:02:58.319772+0000, chain.objs.size()=1 2024-09-12T18:35:59.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QmjNzsgCFlor7_fvFajbDAjfdFRQqVi_0 2024-09-12T18:35:59.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12847039220811276511', time=2024-09-12T20:03:01.869197+0000, chain.objs.size()=1 2024-09-12T18:35:59.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-iVRx5ySPpxDVF21iB9NWxqvWF5-_fl_0 2024-09-12T18:35:59.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12951840064739691645', time=2024-09-12T20:03:06.239743+0000, chain.objs.size()=1 2024-09-12T18:35:59.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Nt4k-8GRjc8HEf2B5rJPBDUYmzJfHZe_0 2024-09-12T18:35:59.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8984786654229893564', time=2024-09-12T20:03:08.106403+0000, chain.objs.size()=1 2024-09-12T18:35:59.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3a8WS21ya52HQM4WaZUKBiIijqTN_Nr_0 2024-09-12T18:35:59.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10724981824763331469', time=2024-09-12T20:03:08.696653+0000, chain.objs.size()=1 2024-09-12T18:35:59.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.niWQKd-nyL2SDB_wjVfbBJi7m_Eyj1s_0 2024-09-12T18:35:59.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8285750665707884573', time=2024-09-12T20:03:09.263670+0000, chain.objs.size()=1 2024-09-12T18:35:59.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.SAlh9FWhPL6vZAdwoAv5UWx30iLo0qh_0 2024-09-12T18:35:59.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10749670037585147524', time=2024-09-12T20:03:09.265549+0000, chain.objs.size()=1 2024-09-12T18:35:59.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.j1L_uo1nxQp_eG659MzcMLaYyE3W8zx_0 2024-09-12T18:35:59.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12488735120365117396', time=2024-09-12T20:03:09.449786+0000, chain.objs.size()=1 2024-09-12T18:35:59.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XcHmrOeC2ahYulAWGDeEYVeyt2rHCx9_0 2024-09-12T18:35:59.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12799920413001507330', time=2024-09-12T20:03:10.990050+0000, chain.objs.size()=1 2024-09-12T18:35:59.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.J8rlCshvLE7xcT1wikznrl54YvN6Xdw_0 2024-09-12T18:35:59.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11060282164498098599', time=2024-09-12T20:03:11.086139+0000, chain.objs.size()=1 2024-09-12T18:35:59.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XfsB7LsfVn1YbPr54neZyGdrIQAw8xW_0 2024-09-12T18:35:59.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15110804255397632241', time=2024-09-12T20:03:11.643998+0000, chain.objs.size()=1 2024-09-12T18:35:59.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.hjP-gMudWvxT2cHkoogvA7rbZOPUlBt_0 2024-09-12T18:35:59.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.665+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10703642963170738989', time=2024-09-12T20:03:11.850134+0000, chain.objs.size()=1 2024-09-12T18:35:59.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.665+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2IsT99GTFrO_Ks8xQlg1AmR-CFL2Tzl_0 2024-09-12T18:35:59.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.665+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17279779730240487295', time=2024-09-12T20:03:12.939517+0000, chain.objs.size()=1 2024-09-12T18:35:59.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.665+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-Bc2nSIxXejWxs0c7wgAUhBDYET3j8x_0 2024-09-12T18:35:59.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.665+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13161537279859172712', time=2024-09-12T20:03:13.073866+0000, chain.objs.size()=1 2024-09-12T18:35:59.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.665+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.sQfZvvMsJ5QHHRfilLkTGqByeUy3Ypq_0 2024-09-12T18:35:59.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4880442996433804681', time=2024-09-12T20:03:15.374972+0000, chain.objs.size()=1 2024-09-12T18:35:59.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.vcr9oi42pcaI0MvJ14YlbFXC4GLo6Ey_0 2024-09-12T18:35:59.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2603021778830933633', time=2024-09-12T20:03:17.137367+0000, chain.objs.size()=1 2024-09-12T18:35:59.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.fZRHC5WC8YYrrl7AR7u4r3SrtQf_MlU_0 2024-09-12T18:35:59.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17832000125841279511', time=2024-09-12T20:03:17.487156+0000, chain.objs.size()=1 2024-09-12T18:35:59.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Y3RnKuPx2qiNIERoimJKGcdysVh6GNH_0 2024-09-12T18:35:59.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10747811590693003682', time=2024-09-12T20:03:18.115887+0000, chain.objs.size()=1 2024-09-12T18:35:59.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.j-X1FgYRcD7Am-HLqMU0Pkv3xsu-igf_0 2024-09-12T18:35:59.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14744438895668020241', time=2024-09-12T20:03:18.662021+0000, chain.objs.size()=1 2024-09-12T18:35:59.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.f2dQ4cZ6OYeRPv5KMKXTmtzuOWyP3Dn_0 2024-09-12T18:35:59.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14236350113271668004', time=2024-09-12T20:03:19.237803+0000, chain.objs.size()=1 2024-09-12T18:35:59.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.9RIVIORuMo6QimjS07xsCAYzMb02A_i_0 2024-09-12T18:35:59.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2981328097932645844', time=2024-09-12T20:03:19.240159+0000, chain.objs.size()=1 2024-09-12T18:35:59.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.jMdoigdrHCTHMX2041AJLPQSac5tJUw_0 2024-09-12T18:35:59.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11643006687335402527', time=2024-09-12T20:03:20.103284+0000, chain.objs.size()=1 2024-09-12T18:35:59.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.t5flc1RcjJMF4EtwUuX4nV-bpCn6GYM_0 2024-09-12T18:35:59.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10751372717679416658', time=2024-09-12T20:04:18.165340+0000, chain.objs.size()=1 2024-09-12T18:35:59.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.669+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.9lPTbl1Ar02BktxAGgSQ-ivJQjq9LxG_0 2024-09-12T18:35:59.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.673+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9474942145677252790', time=2024-09-12T20:04:23.242622+0000, chain.objs.size()=1 2024-09-12T18:35:59.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.673+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.297__shadow_.QNMkXUbVjZK3HaG7wX8WZ0UzavnU_MT_0 2024-09-12T18:35:59.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.673+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15709862396096388645', time=2024-09-12T20:04:23.244635+0000, chain.objs.size()=1 2024-09-12T18:35:59.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.673+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.297__shadow_.WC-_3TvQuM8ABw2LSh5i0GZEbps23-8_0 2024-09-12T18:35:59.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.673+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6879633041708723822', time=2024-09-12T20:04:30.257574+0000, chain.objs.size()=1 2024-09-12T18:35:59.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.673+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.301__shadow_.nerJqfBffbHlHmDKTVtzhZRhSeJeGdv_0 2024-09-12T18:35:59.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.673+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18317746221180722177', time=2024-09-12T20:06:51.000615+0000, chain.objs.size()=1 2024-09-12T18:35:59.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.673+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.nh7BBe7Oxe74wnMAd_09uZomoIqZvqy_0 2024-09-12T18:35:59.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.677+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7287133783355573987', time=2024-09-12T20:06:51.138144+0000, chain.objs.size()=1 2024-09-12T18:35:59.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.677+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7iJ4U98TNbzM10dVUAjrjAW-S6a9i7G_0 2024-09-12T18:35:59.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.677+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4608669065908365510', time=2024-09-12T20:06:51.870048+0000, chain.objs.size()=1 2024-09-12T18:35:59.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.677+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-CqQ-LhR-9Fjho4jV73WwT2ILGy-ZYy_0 2024-09-12T18:35:59.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.677+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1901509982134019201', time=2024-09-12T20:06:52.405117+0000, chain.objs.size()=1 2024-09-12T18:35:59.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.677+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.HULr4tFEbHT3i-VcUKxDjwBRlkgtivY_0 2024-09-12T18:35:59.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.677+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10470432746262411529', time=2024-09-12T20:06:53.823576+0000, chain.objs.size()=1 2024-09-12T18:35:59.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.677+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.lHuTWnFQYRLGUAfRbybU66EV1hUc4mD_0 2024-09-12T18:35:59.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.677+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2086349533760939795', time=2024-09-12T20:06:54.897635+0000, chain.objs.size()=1 2024-09-12T18:35:59.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.677+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.O2aF60OzFu3rTwUMl187xoh76rF8job_0 2024-09-12T18:35:59.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.677+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3264464006675502836', time=2024-09-12T20:06:56.258913+0000, chain.objs.size()=1 2024-09-12T18:35:59.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.677+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.QAL7ol411g_XNBavG4NsbnPDq_sXlgo_0 2024-09-12T18:35:59.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8493533059900846901', time=2024-09-12T20:06:57.141570+0000, chain.objs.size()=1 2024-09-12T18:35:59.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.alNKuYWfOz2YoJD-EKcs-993UPgHB3f_0 2024-09-12T18:35:59.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13988754830218038884', time=2024-09-12T20:06:58.853798+0000, chain.objs.size()=1 2024-09-12T18:35:59.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.B7-myvOcbt2sYn22Th66TJZ3y2RlxSQ_0 2024-09-12T18:35:59.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16172652536232040365', time=2024-09-12T20:06:59.560796+0000, chain.objs.size()=1 2024-09-12T18:35:59.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.raOQXnwueheL9z8nMDB2gx21baLIN2M_0 2024-09-12T18:35:59.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4486000438384758870', time=2024-09-12T20:07:00.339944+0000, chain.objs.size()=1 2024-09-12T18:35:59.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.4xBxXqMhLDn6FE1CJiRzYoAU_m-mLax_0 2024-09-12T18:35:59.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7694516341609994203', time=2024-09-12T20:07:00.578999+0000, chain.objs.size()=1 2024-09-12T18:35:59.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.oeO-_fw68g7f9Vc5xtG1z7x82Xm8qwE_0 2024-09-12T18:35:59.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14452843132230095875', time=2024-09-12T20:07:01.005334+0000, chain.objs.size()=1 2024-09-12T18:35:59.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.SDxafz3JZ7uw_ligUSGo9zUyEqDClmR_0 2024-09-12T18:35:59.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10756021639545359478', time=2024-09-12T20:07:01.077345+0000, chain.objs.size()=1 2024-09-12T18:35:59.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.KGwJxcmC3-co_3AaeezNClSj0H06B3Y_0 2024-09-12T18:35:59.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7989413148254435103', time=2024-09-12T20:07:02.921346+0000, chain.objs.size()=1 2024-09-12T18:35:59.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.mKvbIOPVp362-KqXIIcupJHkTMODnRz_0 2024-09-12T18:35:59.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16300214520565651644', time=2024-09-12T20:07:03.296217+0000, chain.objs.size()=1 2024-09-12T18:35:59.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.681+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.y4d5xQy8nL9neXEwxxb5XYW1RuPrD5E_0 2024-09-12T18:35:59.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16643353642831924959', time=2024-09-12T20:07:04.389177+0000, chain.objs.size()=1 2024-09-12T18:35:59.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.x766bvkBlXxB-yyhF7WGHxVmd0-9unC_0 2024-09-12T18:35:59.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7804466676874960545', time=2024-09-12T20:07:04.535833+0000, chain.objs.size()=1 2024-09-12T18:35:59.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.QPLt_PLYhC_MdwZVeJtb4YgXW5i7_Ai_0 2024-09-12T18:35:59.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6464777555542488666', time=2024-09-12T20:07:08.796711+0000, chain.objs.size()=1 2024-09-12T18:35:59.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.u8C3w8wSKZvwTps7yQn5NG_kkhcz4QL_0 2024-09-12T18:35:59.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6678399359952586118', time=2024-09-12T20:07:11.121230+0000, chain.objs.size()=1 2024-09-12T18:35:59.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-L7JuoTwzba5w7VRXumItz-xBaGjlVV_0 2024-09-12T18:35:59.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3102763821823579365', time=2024-09-12T20:07:11.312557+0000, chain.objs.size()=1 2024-09-12T18:35:59.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.BZ8a31apo1or3AdpGGHlsDtxnTeH1M7_0 2024-09-12T18:35:59.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3632497306384555789', time=2024-09-12T20:07:11.441900+0000, chain.objs.size()=1 2024-09-12T18:35:59.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.TMkymVKObC-y59-w2vLkK7HKC1W4chl_0 2024-09-12T18:35:59.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3874944584171930371', time=2024-09-12T20:07:11.883115+0000, chain.objs.size()=1 2024-09-12T18:35:59.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.4Vgs85Z61oc92PpckgszTAthl1aDP92_0 2024-09-12T18:35:59.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12368552527413590189', time=2024-09-12T20:07:12.162156+0000, chain.objs.size()=1 2024-09-12T18:35:59.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.FEfu9KW0TLZDvD_HL_T66z_heVPq1Wz_0 2024-09-12T18:35:59.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4137118148281652079', time=2024-09-12T20:07:14.458071+0000, chain.objs.size()=1 2024-09-12T18:35:59.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.FkblBDimwsAgPFHob8kpRHgE9awR82__0 2024-09-12T18:35:59.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3832600885354739096', time=2024-09-12T20:07:14.891186+0000, chain.objs.size()=1 2024-09-12T18:35:59.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Ypeu8pjGmeNoK4X6ZzYUjXFPBMNjMXb_0 2024-09-12T18:35:59.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13778344666423099122', time=2024-09-12T20:07:14.893125+0000, chain.objs.size()=1 2024-09-12T18:35:59.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Lxze6Wy8WB8rHQ0wJS0h2h8T__g3Gcs_0 2024-09-12T18:35:59.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8157771754898808803', time=2024-09-12T20:07:16.975192+0000, chain.objs.size()=1 2024-09-12T18:35:59.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.eD1A9az6OkjAxs00GmCW6ouqU1zvpKN_0 2024-09-12T18:35:59.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16077668745810068105', time=2024-09-12T20:07:17.724207+0000, chain.objs.size()=1 2024-09-12T18:35:59.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.jdk4u1N4f79pWtlYO77edeSj9uzq9C3_0 2024-09-12T18:35:59.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13475442182101913077', time=2024-09-12T20:07:17.833294+0000, chain.objs.size()=1 2024-09-12T18:35:59.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ZNMnv7y1PUOmLGmI4iixh1PX3INxUKs_0 2024-09-12T18:35:59.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7201706526717573006', time=2024-09-12T20:07:18.441506+0000, chain.objs.size()=1 2024-09-12T18:35:59.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.KcLv1CHlvtmcEIalcY-6OMMUNRMOJUZ_0 2024-09-12T18:35:59.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4355806784588364316', time=2024-09-12T20:09:02.519575+0000, chain.objs.size()=1 2024-09-12T18:35:59.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vNi1GYEFaNV_RSkqgWVfONn7LyQrPvO_0 2024-09-12T18:35:59.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15127028554748524752', time=2024-09-12T20:09:02.930229+0000, chain.objs.size()=1 2024-09-12T18:35:59.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.WFWnaf28SqEiv_6bzpSPXj61LcG5AyK_0 2024-09-12T18:35:59.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11219083178640777691', time=2024-09-12T20:09:03.859618+0000, chain.objs.size()=1 2024-09-12T18:35:59.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.G_Zdr0kgweTiWQVFJqVG75DLy6rezop_0 2024-09-12T18:35:59.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3792634918366764752', time=2024-09-12T20:09:04.261117+0000, chain.objs.size()=1 2024-09-12T18:35:59.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.689+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5iTYK5i1yZXUxceirj09LLp9n3sgDMK_0 2024-09-12T18:35:59.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17824375466284941050', time=2024-09-12T20:09:06.353654+0000, chain.objs.size()=1 2024-09-12T18:35:59.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.TpxEq23t_yvYxmtNTgHlAgZ1LVlJF0y_0 2024-09-12T18:35:59.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7423681555982728217', time=2024-09-12T20:09:06.880783+0000, chain.objs.size()=1 2024-09-12T18:35:59.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.WyY5dQ4hAz-C06LxXdqdAGkOzIR3y6G_0 2024-09-12T18:35:59.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11602807366505670232', time=2024-09-12T20:09:07.493778+0000, chain.objs.size()=1 2024-09-12T18:35:59.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.solKqElRRsOLyG1dqhmaXE3zO044T8j_0 2024-09-12T18:35:59.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7206929673024678014', time=2024-09-12T20:09:07.752446+0000, chain.objs.size()=1 2024-09-12T18:35:59.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ZT_FLCacmCMVQt4GP3tTMPQO1iyC5B0_0 2024-09-12T18:35:59.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6320499232259158998', time=2024-09-12T20:09:07.911815+0000, chain.objs.size()=1 2024-09-12T18:35:59.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.OVQsfLuOdhhlSlEw9NPUHk_BUcAag7l_0 2024-09-12T18:35:59.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13329056130073838521', time=2024-09-12T20:09:09.804789+0000, chain.objs.size()=1 2024-09-12T18:35:59.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.T7lw8cBc_W5tKMxvXbcE9P-9naXwjnN_0 2024-09-12T18:35:59.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17022121749693581637', time=2024-09-12T20:09:09.865401+0000, chain.objs.size()=1 2024-09-12T18:35:59.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.w3B_YpkbF2GItChBf0XrdARm8181UJu_0 2024-09-12T18:35:59.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9722158523750937784', time=2024-09-12T20:09:11.168133+0000, chain.objs.size()=1 2024-09-12T18:35:59.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Va8VEzIRWu7qg0cpQ5l5LE7uaLLmKMj_0 2024-09-12T18:35:59.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1579255894484573170', time=2024-09-12T20:09:11.469272+0000, chain.objs.size()=1 2024-09-12T18:35:59.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.acgnoRkqYFA9XCBFOI310sCzuUvLehn_0 2024-09-12T18:35:59.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11536115960391006935', time=2024-09-12T20:09:17.265482+0000, chain.objs.size()=1 2024-09-12T18:35:59.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.A0Vx9KdoSvA9qEQz3guhpL0nqBiPohQ_0 2024-09-12T18:35:59.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18046824618552642760', time=2024-09-12T20:09:17.784261+0000, chain.objs.size()=1 2024-09-12T18:35:59.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.K-gLTcMjD8ipmAZjSBq1RW35NTW3KZ2_0 2024-09-12T18:35:59.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7505714366029493076', time=2024-09-12T20:09:18.893842+0000, chain.objs.size()=1 2024-09-12T18:35:59.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Ew158AMZAJSRjP5Jpw6peQs97AFetd2_0 2024-09-12T18:35:59.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17285160101498257792', time=2024-09-12T20:09:21.136390+0000, chain.objs.size()=1 2024-09-12T18:35:59.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FzzEmIK2h0NJG48pxg822Qqtyrro6up_0 2024-09-12T18:35:59.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6943376747898905846', time=2024-09-12T20:09:23.469072+0000, chain.objs.size()=1 2024-09-12T18:35:59.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FK9JCkP8IwEh82vyVUC8DQA-GT6jxv1_0 2024-09-12T18:35:59.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10724889316886317588', time=2024-09-12T20:09:23.728645+0000, chain.objs.size()=1 2024-09-12T18:35:59.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xJCnF9VbiJIuUdCjuq5_Nf7SiiVPvCg_0 2024-09-12T18:35:59.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4171675835095968738', time=2024-09-12T20:09:24.776725+0000, chain.objs.size()=1 2024-09-12T18:35:59.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.h5LMZCXu3S_LqUGy8ex4H_JHQ565wL2_0 2024-09-12T18:35:59.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14567511094343014672', time=2024-09-12T20:09:25.336037+0000, chain.objs.size()=1 2024-09-12T18:35:59.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Ga6S6MrWvgAk-tgE33HKCs6V5G1dM9p_0 2024-09-12T18:35:59.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1412988504453961241', time=2024-09-12T20:09:26.059726+0000, chain.objs.size()=1 2024-09-12T18:35:59.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.dRefmeQ4IzjuvN_F7MLJhxLB2PfIa4P_0 2024-09-12T18:35:59.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17993445992952022845', time=2024-09-12T20:09:26.820681+0000, chain.objs.size()=1 2024-09-12T18:35:59.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.R1HBIhraprUeaHON8m5Oclg4g0IHTKK_0 2024-09-12T18:35:59.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4129720885400798141', time=2024-09-12T20:09:29.268999+0000, chain.objs.size()=1 2024-09-12T18:35:59.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.4ydXMJOXAKr_O1aWXTxdeYWefp-3ika_0 2024-09-12T18:35:59.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13874076083357845121', time=2024-09-12T20:09:29.877056+0000, chain.objs.size()=1 2024-09-12T18:35:59.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.GsksuW1W06ax_yVdZLjvhfcX3mpHX7F_0 2024-09-12T18:35:59.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6241613990004052928', time=2024-09-12T20:09:29.944572+0000, chain.objs.size()=1 2024-09-12T18:35:59.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.TFUJRvtorNOk3p3t6XJaRyitFtUlxQX_0 2024-09-12T18:35:59.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5602404576650699651', time=2024-09-12T20:10:34.898297+0000, chain.objs.size()=1 2024-09-12T18:35:59.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.377__shadow_.hGVD39J6cDSzk4wRnhZK-1LkvKHJWNH_0 2024-09-12T18:35:59.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.705+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3043548938536506136', time=2024-09-12T20:12:00.807609+0000, chain.objs.size()=1 2024-09-12T18:35:59.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.705+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.440__shadow_.d2wTs1KIXYxFapTKnY9sgiAV3FOecv__0 2024-09-12T18:35:59.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.705+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3959335858673847845', time=2024-09-12T20:12:36.899391+0000, chain.objs.size()=1 2024-09-12T18:35:59.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.705+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.462__shadow_.ZZQoDULiDf45xdOewkJ7VUJ-LGbaM3c_0 2024-09-12T18:35:59.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.705+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9582586973848271109', time=2024-09-12T20:16:23.644089+0000, chain.objs.size()=1 2024-09-12T18:35:59.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.705+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.524__multipart_mymultipart.2~UTOyle5OsagbB4TLCn5oUJh9-WbkNow.1 2024-09-12T18:35:59.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.705+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9808183191392508800', time=2024-09-12T20:19:58.748644+0000, chain.objs.size()=1 2024-09-12T18:35:59.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.705+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.577__shadow:35f89LMoDSu6C5YFQsCQ-dpNQtTDQbc_.xfzHFTFrUw6YzVeRNvNjc-2I6aedn7f_0 2024-09-12T18:35:59.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.705+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10100864065334379954', time=2024-09-12T20:20:18.247776+0000, chain.objs.size()=1 2024-09-12T18:35:59.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.705+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:wZHItbGwAxtALj45JerccpUxcxKcqGf_.xfIdLLMIR5QOPyKB6FCOi_e-_Y6h-3J_0 2024-09-12T18:35:59.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.705+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7398291784827872986', time=2024-09-12T20:20:20.404161+0000, chain.objs.size()=1 2024-09-12T18:35:59.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.705+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:Uz0MVLe9zEpqqRhr66wriA.yVDonpaM_.VZJRhmCLWJtG6vnAbUg5A2XaAQxSRrp_0 2024-09-12T18:35:59.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.713+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44011 2024-09-12T18:35:59.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.725+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:35:59.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.725+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7508133529584932930', time=2024-09-12T20:21:12.642702+0000, chain.objs.size()=1 2024-09-12T18:35:59.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.581__shadow:8lkG-CsxESMZWJVlxzlVfzwJhT9RfF3_.2CfEIQ15zFt1KIe0ByggQxYj6e-SFvD_0 2024-09-12T18:35:59.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.725+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8289044974352997305', time=2024-09-12T20:25:33.131784+0000, chain.objs.size()=1 2024-09-12T18:35:59.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.619__shadow_.yY6O3PcsEio1yjEKwGv0JQ8jk_gA_sa_0 2024-09-12T18:35:59.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.725+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10567830099558659025', time=2024-09-12T20:26:06.917973+0000, chain.objs.size()=12 2024-09-12T18:35:59.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.624__multipart_multipart_enc.2~kr7K87jYtqKOnIG7lOoqFsW9Dzeiq3B.1 2024-09-12T18:35:59.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.624__shadow_multipart_enc.2~kr7K87jYtqKOnIG7lOoqFsW9Dzeiq3B.1_1 2024-09-12T18:35:59.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.624__multipart_multipart_enc.2~kr7K87jYtqKOnIG7lOoqFsW9Dzeiq3B.2 2024-09-12T18:35:59.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.624__shadow_multipart_enc.2~kr7K87jYtqKOnIG7lOoqFsW9Dzeiq3B.2_1 2024-09-12T18:35:59.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.624__multipart_multipart_enc.2~kr7K87jYtqKOnIG7lOoqFsW9Dzeiq3B.3 2024-09-12T18:35:59.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.624__shadow_multipart_enc.2~kr7K87jYtqKOnIG7lOoqFsW9Dzeiq3B.3_1 2024-09-12T18:35:59.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.624__multipart_multipart_enc.2~kr7K87jYtqKOnIG7lOoqFsW9Dzeiq3B.4 2024-09-12T18:35:59.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.624__shadow_multipart_enc.2~kr7K87jYtqKOnIG7lOoqFsW9Dzeiq3B.4_1 2024-09-12T18:35:59.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.624__multipart_multipart_enc.2~kr7K87jYtqKOnIG7lOoqFsW9Dzeiq3B.5 2024-09-12T18:35:59.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.624__shadow_multipart_enc.2~kr7K87jYtqKOnIG7lOoqFsW9Dzeiq3B.5_1 2024-09-12T18:35:59.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.729+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.624__multipart_multipart_enc.2~kr7K87jYtqKOnIG7lOoqFsW9Dzeiq3B.6 2024-09-12T18:35:59.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.733+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.624__shadow_multipart_enc.2~kr7K87jYtqKOnIG7lOoqFsW9Dzeiq3B.6_1 2024-09-12T18:35:59.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.737+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:35:59.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.745+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:35:59.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:35:59.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:35:59.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44113' 2024-09-12T18:35:59.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9571065013289589340', time=2024-09-12T19:55:34.252525+0000, chain.objs.size()=1 2024-09-12T18:35:59.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.148__shadow_.I4CtKPbLL06i2bYp3eribsQIRZJEQ_Y_0 2024-09-12T18:35:59.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_LH4jop9tBbWbGgCGKMBO4EeZ7jOelgR', time=2024-09-12T19:56:05.368076+0000, chain.objs.size()=3 2024-09-12T18:35:59.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.mFMiMTXWrKf9u5X5ocKSqZ3MCiSXdmG_0 2024-09-12T18:35:59.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.mFMiMTXWrKf9u5X5ocKSqZ3MCiSXdmG_1 2024-09-12T18:35:59.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.mFMiMTXWrKf9u5X5ocKSqZ3MCiSXdmG_2 2024-09-12T18:35:59.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10145167044780002039', time=2024-09-12T19:56:36.521372+0000, chain.objs.size()=1 2024-09-12T18:35:59.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.171__shadow_.GvuoYyPN3u31jaSU8N9rzamW0QHSD6B_0 2024-09-12T18:35:59.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14041741966486043287', time=2024-09-12T20:00:22.113687+0000, chain.objs.size()=1 2024-09-12T18:35:59.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.235__shadow_.WhMNOEnC50zOSUICoVEgYphy4DwpHo2_0 2024-09-12T18:35:59.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4018279783238764252', time=2024-09-12T20:00:25.523090+0000, chain.objs.size()=1 2024-09-12T18:35:59.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.237__shadow_.uWle5WawcfFn3KDCpHh5a-XVyDlUfFJ_0 2024-09-12T18:35:59.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.776002421942255101', time=2024-09-12T20:00:49.868293+0000, chain.objs.size()=1 2024-09-12T18:35:59.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.250__shadow_.GLSGY7mJO5wKkHpFGGcGYPa0QS1NVZq_0 2024-09-12T18:35:59.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13634877258638376749', time=2024-09-12T20:00:56.554335+0000, chain.objs.size()=1 2024-09-12T18:35:59.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.254__shadow_.2Vc4GvBr-K9Uw2xZkXLqmHC_OpDjTAS_0 2024-09-12T18:35:59.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9952558025493696741', time=2024-09-12T20:01:01.635206+0000, chain.objs.size()=1 2024-09-12T18:35:59.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.257__shadow_.UP_SQSquJI8Guv-aWCtjAbKaf-MRaEb_0 2024-09-12T18:35:59.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7178950286908410607', time=2024-09-12T20:02:52.328959+0000, chain.objs.size()=1 2024-09-12T18:35:59.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2kv5oqfQsZZGtDJWR25_rPPg3ueiveI_0 2024-09-12T18:35:59.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4390038240313848033', time=2024-09-12T20:02:53.390018+0000, chain.objs.size()=1 2024-09-12T18:35:59.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.749+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.hsfepA7TI2Vo8Cra2jx0kngxKa4xjiu_0 2024-09-12T18:35:59.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.176370688167452885', time=2024-09-12T20:02:53.887358+0000, chain.objs.size()=1 2024-09-12T18:35:59.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.EG6VWiU-YZSxWQ5qNrxxiYDDt8FGScy_0 2024-09-12T18:35:59.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2668935476246494374', time=2024-09-12T20:02:56.353087+0000, chain.objs.size()=1 2024-09-12T18:35:59.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ssWriR08vHAvbuoGsJ5CJk8Ru56KWG3_0 2024-09-12T18:35:59.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4012148413892525613', time=2024-09-12T20:03:01.563680+0000, chain.objs.size()=1 2024-09-12T18:35:59.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.R2lOEOjy_MA9FlBxI72V6R8YNlQwYcD_0 2024-09-12T18:35:59.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8936564660404847888', time=2024-09-12T20:03:01.666596+0000, chain.objs.size()=1 2024-09-12T18:35:59.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Xx-WQ_lRzhx3q9fnyEEcbHFfoZV-pvx_0 2024-09-12T18:35:59.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3559310606906853049', time=2024-09-12T20:03:02.541975+0000, chain.objs.size()=1 2024-09-12T18:35:59.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qHMKXch7o8NuAi05Ov3BtYO5ZBeKr6j_0 2024-09-12T18:35:59.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.862997031785978968', time=2024-09-12T20:03:02.576220+0000, chain.objs.size()=1 2024-09-12T18:35:59.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.irQ7uO-CGONkemirr-4YX9V6UHAbR_a_0 2024-09-12T18:35:59.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8715480940465275286', time=2024-09-12T20:03:04.235295+0000, chain.objs.size()=1 2024-09-12T18:35:59.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3b-tx89vDgPuW222FiPTnHDblOKNcmF_0 2024-09-12T18:35:59.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17374409681307786039', time=2024-09-12T20:03:04.376788+0000, chain.objs.size()=1 2024-09-12T18:35:59.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.RrWd36yaiVSdeFqBQQgrfDQEl_z4MRk_0 2024-09-12T18:35:59.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8135789850065537297', time=2024-09-12T20:03:05.572256+0000, chain.objs.size()=1 2024-09-12T18:35:59.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.pKBqsbipP8pl86egpTWMp8v6QHj0VqX_0 2024-09-12T18:35:59.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1599543689897883465', time=2024-09-12T20:03:07.505400+0000, chain.objs.size()=1 2024-09-12T18:35:59.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._ue3UPFc3PNINj3JqJjn2dAyabiIPTI_0 2024-09-12T18:35:59.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13311265491137453746', time=2024-09-12T20:03:07.756215+0000, chain.objs.size()=1 2024-09-12T18:35:59.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3hldsgKObl6wQEsZU0j_7KEwSfxhC8T_0 2024-09-12T18:35:59.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11240326143600624650', time=2024-09-12T20:03:08.981395+0000, chain.objs.size()=1 2024-09-12T18:35:59.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.hRHYbVwa9NVMdE7b1w4dxtIgczDhTkn_0 2024-09-12T18:35:59.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2978229727228864832', time=2024-09-12T20:03:12.640327+0000, chain.objs.size()=1 2024-09-12T18:35:59.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ktbHP00OFmU7GaCy4HGPdoSA1b9YqTB_0 2024-09-12T18:35:59.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13597281365492987132', time=2024-09-12T20:03:12.979977+0000, chain.objs.size()=1 2024-09-12T18:35:59.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.eZtuzgW6Wa658DVkl-ZAy1NTZGyeBWU_0 2024-09-12T18:35:59.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5167950941219180585', time=2024-09-12T20:03:13.570944+0000, chain.objs.size()=1 2024-09-12T18:35:59.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wv7spTUF7HKsbKHEfK4JM9qx2Kb8sCt_0 2024-09-12T18:35:59.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15018707525929833087', time=2024-09-12T20:03:13.663752+0000, chain.objs.size()=1 2024-09-12T18:35:59.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.LQm9W5xRoH5wOw8yxx7X-c1fPtSJ2UP_0 2024-09-12T18:35:59.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1204363506245723956', time=2024-09-12T20:03:18.195672+0000, chain.objs.size()=1 2024-09-12T18:35:59.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.htmTRAEvWtmhg6Oq2N1X618p5XHMs_o_0 2024-09-12T18:35:59.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12401573050583552236', time=2024-09-12T20:03:18.646260+0000, chain.objs.size()=1 2024-09-12T18:35:59.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Pp80G-4D0c4UJuHywKnni224boNiex__0 2024-09-12T18:35:59.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7288409160252189734', time=2024-09-12T20:03:19.731211+0000, chain.objs.size()=1 2024-09-12T18:35:59.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.4z7-uqxpq_sYUAlleC0BOWM-WVe_GH__0 2024-09-12T18:35:59.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12929784373938338706', time=2024-09-12T20:03:19.924229+0000, chain.objs.size()=1 2024-09-12T18:35:59.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.WPWOwD67Cz2HGDzY61hYgjrRlIrXgeV_0 2024-09-12T18:35:59.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9324496896882684162', time=2024-09-12T20:03:20.302232+0000, chain.objs.size()=1 2024-09-12T18:35:59.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.6Nopsqa7io5LHZ8ogwUpbYTBQhriQ3S_0 2024-09-12T18:35:59.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15548047680750305778', time=2024-09-12T20:03:20.627916+0000, chain.objs.size()=1 2024-09-12T18:35:59.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.TGMBU3sUA4tgURV_vERCl1GnaeP4YNj_0 2024-09-12T18:35:59.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13586431347088580410', time=2024-09-12T20:03:20.669103+0000, chain.objs.size()=1 2024-09-12T18:35:59.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.hMiTwOWqBxqIBAkT8Hozl32ogsOKit6_0 2024-09-12T18:35:59.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10973411385972996071', time=2024-09-12T20:03:41.034162+0000, chain.objs.size()=1 2024-09-12T18:35:59.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.276__shadow_.O3hfS7Hq0F8a_qv5HkUcLhagUrL6BFC_0 2024-09-12T18:35:59.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10057721330991087380', time=2024-09-12T20:03:54.448453+0000, chain.objs.size()=1 2024-09-12T18:35:59.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.284__shadow_.k-FbJKbzRn0_bjrXsNNjgRwHxGob9RO_0 2024-09-12T18:35:59.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3504848554442641498', time=2024-09-12T20:04:08.306680+0000, chain.objs.size()=1 2024-09-12T18:35:59.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.292__shadow_.76Sfg4qjtX_X0mKht_0JqfRzrIglMdn_0 2024-09-12T18:35:59.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12716248480283880325', time=2024-09-12T20:04:17.907395+0000, chain.objs.size()=1 2024-09-12T18:35:59.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.JfdZ1gkw1vkKYpeNA-aivrsbflRNnRL_0 2024-09-12T18:35:59.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7233609720434275100', time=2024-09-12T20:04:18.156499+0000, chain.objs.size()=1 2024-09-12T18:35:59.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.XCaq7xy5vS-KrVpMuhIDM38rzKdRW7d_0 2024-09-12T18:35:59.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14404976242637490532', time=2024-09-12T20:06:51.141495+0000, chain.objs.size()=1 2024-09-12T18:35:59.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7Untu4rrDnDZHlA7AZDOnTJr2auNQXM_0 2024-09-12T18:35:59.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8866878927835867782', time=2024-09-12T20:06:52.011850+0000, chain.objs.size()=1 2024-09-12T18:35:59.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ZzWbQxaoMRi8yF6F99Iisnp4Iy9a9oB_0 2024-09-12T18:35:59.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2068195954362961690', time=2024-09-12T20:06:52.013795+0000, chain.objs.size()=1 2024-09-12T18:35:59.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.J-Fv95eUbXKeSofiYo1VQXGy4cCYSYO_0 2024-09-12T18:35:59.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3658555809180508832', time=2024-09-12T20:06:53.177477+0000, chain.objs.size()=1 2024-09-12T18:35:59.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.YOJsgDA2X5-9jMD2pKBM-SjfxbZwxOQ_0 2024-09-12T18:35:59.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9439388789605356340', time=2024-09-12T20:06:53.769424+0000, chain.objs.size()=1 2024-09-12T18:35:59.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-SPG615Kpo3XvAzdt78uYCeQ0mtJHtY_0 2024-09-12T18:35:59.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9913442627600177531', time=2024-09-12T20:06:54.904445+0000, chain.objs.size()=1 2024-09-12T18:35:59.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-2_rhhHASD_zccSY_82x8EC4jLyksvx_0 2024-09-12T18:35:59.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2663701914562192316', time=2024-09-12T20:06:54.906653+0000, chain.objs.size()=1 2024-09-12T18:35:59.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.LY2Lol35GvC_j3exBSrguGUTzvM3H4l_0 2024-09-12T18:35:59.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5307543620378821133', time=2024-09-12T20:06:55.717196+0000, chain.objs.size()=1 2024-09-12T18:35:59.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.DlbJpk0bHtcZuypGJDfB_R30h2NOyUV_0 2024-09-12T18:35:59.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3765870368961825763', time=2024-09-12T20:06:56.002407+0000, chain.objs.size()=1 2024-09-12T18:35:59.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.P2e_tRumPh3zcaFuYn66hprmlj5lLgr_0 2024-09-12T18:35:59.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2377710725724366165', time=2024-09-12T20:06:56.771523+0000, chain.objs.size()=1 2024-09-12T18:35:59.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.MufaTLskHVb8E8useD9_HucMMpxo7lO_0 2024-09-12T18:35:59.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5218393860685349232', time=2024-09-12T20:07:00.121694+0000, chain.objs.size()=1 2024-09-12T18:35:59.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.lfrzdpT1v7SWXwVztVW0rcTyYzYiLon_0 2024-09-12T18:35:59.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7714348065909565917', time=2024-09-12T20:07:00.176917+0000, chain.objs.size()=1 2024-09-12T18:35:59.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.RyFnC1CAT2t5TV06Fdg7hUwpqx-hpwy_0 2024-09-12T18:35:59.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9628401499405327163', time=2024-09-12T20:07:00.380503+0000, chain.objs.size()=1 2024-09-12T18:35:59.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_._0M95CepeOK1m1epeMeIkK9u8VZ4K90_0 2024-09-12T18:35:59.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1847977447323433229', time=2024-09-12T20:07:01.536177+0000, chain.objs.size()=1 2024-09-12T18:35:59.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.WNrtFw9YxzLfJQhXsi0OzZeOHeUNM6a_0 2024-09-12T18:35:59.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15605873345994266083', time=2024-09-12T20:07:03.605714+0000, chain.objs.size()=1 2024-09-12T18:35:59.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.5SKQHDoIFYMbvZi3889iSQHk5DgSL5Z_0 2024-09-12T18:35:59.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12624309716654419751', time=2024-09-12T20:07:03.814347+0000, chain.objs.size()=1 2024-09-12T18:35:59.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.781+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.jayMj7FR5-Xh9LmR9j3YzLggadL2KsM_0 2024-09-12T18:35:59.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.785+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12297297145960902940', time=2024-09-12T20:07:05.142454+0000, chain.objs.size()=1 2024-09-12T18:35:59.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.785+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_._QffOtnjwgojixGxhtapr9WgTHziuai_0 2024-09-12T18:35:59.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.785+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2765623615370604555', time=2024-09-12T20:07:08.175427+0000, chain.objs.size()=1 2024-09-12T18:35:59.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.785+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Xw6Em3G3YTpYG8SWtKeWFEWvz4T21Fj_0 2024-09-12T18:35:59.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.785+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3098842533241176047', time=2024-09-12T20:07:09.065002+0000, chain.objs.size()=1 2024-09-12T18:35:59.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.785+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.PPOTezDI4hp0Y5lUc-2xTBOsKYEzuHL_0 2024-09-12T18:35:59.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.785+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18415183526575397285', time=2024-09-12T20:07:10.730690+0000, chain.objs.size()=1 2024-09-12T18:35:59.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.785+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.N71TXjzEbWyVM9OXj8ElyXQYad0-MUd_0 2024-09-12T18:35:59.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.789+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5857241549062365577', time=2024-09-12T20:07:14.727148+0000, chain.objs.size()=1 2024-09-12T18:35:59.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.789+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.gzMe7jAYu425S-bCafDNLeJr8dDyPAd_0 2024-09-12T18:35:59.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.789+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8769938274870991596', time=2024-09-12T20:07:15.589977+0000, chain.objs.size()=1 2024-09-12T18:35:59.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.789+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ZiQsqA2i3Fxb18cJ8XM7hEShqpZ8gzz_0 2024-09-12T18:35:59.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.789+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3654475863264621068', time=2024-09-12T20:07:15.845905+0000, chain.objs.size()=1 2024-09-12T18:35:59.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.789+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.R6Iu8il5GeMKjCEaXXQ8PFqOu2DfGgB_0 2024-09-12T18:35:59.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.789+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17424949145951837013', time=2024-09-12T20:07:15.851277+0000, chain.objs.size()=1 2024-09-12T18:35:59.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.789+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.loxLZ2pPoNnYY7qyHf3RWYHGchpUelv_0 2024-09-12T18:35:59.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.789+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6760539358189461566', time=2024-09-12T20:07:16.984349+0000, chain.objs.size()=1 2024-09-12T18:35:59.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.789+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.DZGab15j-HKFUCUdncrrUc7WByT0aKA_0 2024-09-12T18:35:59.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.789+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3014471902661130068', time=2024-09-12T20:07:18.662642+0000, chain.objs.size()=1 2024-09-12T18:35:59.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.789+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.oQ6zaHKh_6cbgAzD2IorxtbUoQuTRLE_0 2024-09-12T18:35:59.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.789+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6733811170262192773', time=2024-09-12T20:09:02.422833+0000, chain.objs.size()=1 2024-09-12T18:35:59.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.789+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.GRbg9vOVsE977IRVnCFat3vG_lXk7hn_0 2024-09-12T18:35:59.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.789+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11532595008843068683', time=2024-09-12T20:09:02.886137+0000, chain.objs.size()=1 2024-09-12T18:35:59.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.789+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5wwmPrVigO4Y9z82dUZDt6kJwF9XYE8_0 2024-09-12T18:35:59.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15454760724926369586', time=2024-09-12T20:09:02.976504+0000, chain.objs.size()=1 2024-09-12T18:35:59.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Od4Dl_MsytBy2SJzfd3MsacqBY1i226_0 2024-09-12T18:35:59.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5674030891561649490', time=2024-09-12T20:09:04.529592+0000, chain.objs.size()=1 2024-09-12T18:35:59.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.M_0G-hO_wx72hQedmlGicSNGShoDK9E_0 2024-09-12T18:35:59.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17567542856062191830', time=2024-09-12T20:09:06.118973+0000, chain.objs.size()=1 2024-09-12T18:35:59.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.J9H99_Gwu3eyfooOfLObyN2ZEkNzGu3_0 2024-09-12T18:35:59.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1722041619052948882', time=2024-09-12T20:09:06.176749+0000, chain.objs.size()=1 2024-09-12T18:35:59.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.MCg6t7yaMFUTbq0zPt0kMCnkCPn0fEM_0 2024-09-12T18:35:59.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17803711793867325359', time=2024-09-12T20:09:09.651704+0000, chain.objs.size()=1 2024-09-12T18:35:59.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.RPW9ayHSwb8K0S8tjcLzQyr6mfJAxid_0 2024-09-12T18:35:59.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13375370823518935058', time=2024-09-12T20:09:11.543544+0000, chain.objs.size()=1 2024-09-12T18:35:59.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.8KPXY9tpTu26oUFQr5p30nOLuAYDg9F_0 2024-09-12T18:35:59.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12122534742357807121', time=2024-09-12T20:09:11.636291+0000, chain.objs.size()=1 2024-09-12T18:35:59.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cnJL8kjTr-AIL6MNjm4Tu2IYl3ejAl7_0 2024-09-12T18:35:59.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6817305019357254300', time=2024-09-12T20:09:11.670157+0000, chain.objs.size()=1 2024-09-12T18:35:59.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.s7dXMnBGnpIhFtGAfW8PnFrPPolD6-2_0 2024-09-12T18:35:59.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2483143319188577998', time=2024-09-12T20:09:13.642147+0000, chain.objs.size()=1 2024-09-12T18:35:59.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.793+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.0HmllhkU13M7ghbs47GHL_A66YQ7x3L_0 2024-09-12T18:35:59.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.797+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6671481981817977272', time=2024-09-12T20:09:14.068667+0000, chain.objs.size()=1 2024-09-12T18:35:59.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.797+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.1oIm251S-a-bBHWcxhBjZHT5qcPmlIi_0 2024-09-12T18:35:59.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.797+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6561147070024353625', time=2024-09-12T20:09:14.144105+0000, chain.objs.size()=1 2024-09-12T18:35:59.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.797+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.IzEMRKYgMLFQSUQaUufn1r69kE4o_BA_0 2024-09-12T18:35:59.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.797+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14682446935662457495', time=2024-09-12T20:09:14.625929+0000, chain.objs.size()=1 2024-09-12T18:35:59.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.797+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.0jDXf7TKUJIPgBdYmkUs-5SomKDcGnY_0 2024-09-12T18:35:59.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.797+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9157795211392927071', time=2024-09-12T20:09:14.834696+0000, chain.objs.size()=1 2024-09-12T18:35:59.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.797+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.MKzy61Z-EjK2gWPbhftOeiDDB_DU7nS_0 2024-09-12T18:35:59.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.797+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15582351447111042911', time=2024-09-12T20:09:15.223354+0000, chain.objs.size()=1 2024-09-12T18:35:59.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.797+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vRwdEoCzlOodLIFmITdnwfV2vJSxUei_0 2024-09-12T18:35:59.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.797+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7455034437675812278', time=2024-09-12T20:09:15.693150+0000, chain.objs.size()=1 2024-09-12T18:35:59.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.797+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.RJtm2pD-Qjho6WeRjbeXH6WlBlZZnuX_0 2024-09-12T18:35:59.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.797+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.480443162948007349', time=2024-09-12T20:09:17.327010+0000, chain.objs.size()=1 2024-09-12T18:35:59.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.797+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.--PBKy5G4V1dEJPkRwDYDTQWCdzrQnp_0 2024-09-12T18:35:59.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.801+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3369230649511686686', time=2024-09-12T20:09:17.721495+0000, chain.objs.size()=1 2024-09-12T18:35:59.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.801+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2dxQaPsTeLOZ7hRj5VA9rHvOknvQ0ow_0 2024-09-12T18:35:59.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.801+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3396741906299188723', time=2024-09-12T20:09:17.976132+0000, chain.objs.size()=1 2024-09-12T18:35:59.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.801+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.LxdS5MNow_7kHQjXtcqaXrBXAQbCSs1_0 2024-09-12T18:35:59.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.801+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8048752202165234857', time=2024-09-12T20:09:18.153268+0000, chain.objs.size()=1 2024-09-12T18:35:59.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.801+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_._1a7jNJ3j6B-CiavFvjhjhQe2i-pFAg_0 2024-09-12T18:35:59.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.801+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17970574093063462772', time=2024-09-12T20:09:19.377880+0000, chain.objs.size()=1 2024-09-12T18:35:59.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.801+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.bll94xNbJarRltTLaZ040Czt8rlB6Vt_0 2024-09-12T18:35:59.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.801+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4496432261140916572', time=2024-09-12T20:09:19.589850+0000, chain.objs.size()=1 2024-09-12T18:35:59.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.801+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.wnIVfIM7pASo_VZd4BVwe3HW9Oa6fYc_0 2024-09-12T18:35:59.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.801+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9626736769939063445', time=2024-09-12T20:09:20.855859+0000, chain.objs.size()=1 2024-09-12T18:35:59.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.801+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.uJECydlCxirJW8pBXhZiDdk0Sx4WhDs_0 2024-09-12T18:35:59.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.801+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12397667894024551854', time=2024-09-12T20:09:21.030497+0000, chain.objs.size()=1 2024-09-12T18:35:59.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.801+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.-uXJ_Fuc0Qf0Sevs1sLWawrlBhECDkC_0 2024-09-12T18:35:59.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6773796192021703392', time=2024-09-12T20:09:21.068612+0000, chain.objs.size()=1 2024-09-12T18:35:59.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.MRDt5jLYcI0ymqHyZXCxEaoUUh2lHm0_0 2024-09-12T18:35:59.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16190477490078180433', time=2024-09-12T20:09:21.611681+0000, chain.objs.size()=1 2024-09-12T18:35:59.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.kCGyyF3-v2H-fULHGT635uXPdSldKv4_0 2024-09-12T18:35:59.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15979458451922286135', time=2024-09-12T20:09:23.697999+0000, chain.objs.size()=1 2024-09-12T18:35:59.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.GZC-I5DCiXPd7Wp_5VBOu7wGX_cEYVH_0 2024-09-12T18:35:59.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11417415649562257472', time=2024-09-12T20:09:25.637820+0000, chain.objs.size()=1 2024-09-12T18:35:59.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.TzAjp-qIo9n3k6DuNnmQ4h8e4flbVrV_0 2024-09-12T18:35:59.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7907996282140149669', time=2024-09-12T20:09:25.739377+0000, chain.objs.size()=1 2024-09-12T18:35:59.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ut8X7cG7S6JgQ68af1M01bw2p98BnOt_0 2024-09-12T18:35:59.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13144743798398181657', time=2024-09-12T20:09:26.148956+0000, chain.objs.size()=1 2024-09-12T18:35:59.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FeN3SpOblXrojZsIcoCEJzA5FRSgfhl_0 2024-09-12T18:35:59.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1127341250698702564', time=2024-09-12T20:09:28.603638+0000, chain.objs.size()=1 2024-09-12T18:35:59.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.HIwwoJ4R3ITmkozRH6aiNtRcvMw_IOG_0 2024-09-12T18:35:59.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7070930404225760391', time=2024-09-12T20:09:29.942654+0000, chain.objs.size()=1 2024-09-12T18:35:59.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.CQf7Wljc3lK8UOgNd5lbT8kOyOI_Qyp_0 2024-09-12T18:35:59.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2658102972855799126', time=2024-09-12T20:12:06.877670+0000, chain.objs.size()=1 2024-09-12T18:35:59.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.444__shadow_.qArb2_9cMAC3fiw1Vv8gARIYl7MVXGz_0 2024-09-12T18:35:59.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10353407638259635065', time=2024-09-12T20:12:41.159537+0000, chain.objs.size()=1 2024-09-12T18:35:59.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.464__shadow_.9-J9gGfTcBEvw7qxX6yPrWRCXFEYFQW_0 2024-09-12T18:35:59.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3297380532841027452', time=2024-09-12T20:13:07.165218+0000, chain.objs.size()=1 2024-09-12T18:35:59.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.805+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.484__shadow_.YJhf_BrmSW6PdZf05uuUrMQ_bBPqvOT_0 2024-09-12T18:35:59.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.813+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44113 2024-09-12T18:35:59.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:35:59.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13694486261946120415', time=2024-09-12T20:13:34.993993+0000, chain.objs.size()=1 2024-09-12T18:35:59.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.501__shadow_.6Q0mY6z4OStZdx0yOChqrfo8ugtiCR6_0 2024-09-12T18:35:59.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14499219901323286830', time=2024-09-12T20:14:22.038031+0000, chain.objs.size()=2 2024-09-12T18:35:59.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.518__shadow_.AO7qppqfpRpNGLDWyDNgMXWuimkHfX6_0 2024-09-12T18:35:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.518__shadow_.AO7qppqfpRpNGLDWyDNgMXWuimkHfX6_1 2024-09-12T18:35:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12852505751934738627', time=2024-09-12T20:14:59.419298+0000, chain.objs.size()=4 2024-09-12T18:35:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.521__shadow:oEjzTiab8VvCO57ywn-wMaqweMK0B2D_.r4f0IHxIj8dZxeef0-QkblsMZPv0Rxb_0 2024-09-12T18:35:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.521__shadow:oEjzTiab8VvCO57ywn-wMaqweMK0B2D_.r4f0IHxIj8dZxeef0-QkblsMZPv0Rxb_1 2024-09-12T18:35:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.521__shadow:oEjzTiab8VvCO57ywn-wMaqweMK0B2D_.r4f0IHxIj8dZxeef0-QkblsMZPv0Rxb_2 2024-09-12T18:35:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.521__shadow:oEjzTiab8VvCO57ywn-wMaqweMK0B2D_.r4f0IHxIj8dZxeef0-QkblsMZPv0Rxb_3 2024-09-12T18:35:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2278537254260841488', time=2024-09-12T20:18:15.394587+0000, chain.objs.size()=2 2024-09-12T18:35:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.553__shadow_.tuL7e3vrR6GchUGjAOC-Zp76B0Yvx0H_0 2024-09-12T18:35:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.553__shadow_.tuL7e3vrR6GchUGjAOC-Zp76B0Yvx0H_1 2024-09-12T18:35:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1838011688000621917', time=2024-09-12T20:19:13.222623+0000, chain.objs.size()=1 2024-09-12T18:35:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:SLt1W6fbc4dFsQ4jIC4bZmu4DcGaAk2_.gu8fxzRH7xzkrdjRGhtjPrNE6acnDlk_0 2024-09-12T18:35:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8478910003460309263', time=2024-09-12T20:19:57.451396+0000, chain.objs.size()=1 2024-09-12T18:35:59.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.577__shadow:UiWu51Pvgoc05PLaVyk3DOen7ercED3_.ThSlMWiIA1Lh6sU2Z8f3E8WHSEAatrR_0 2024-09-12T18:35:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9377466503104490726', time=2024-09-12T20:20:27.607939+0000, chain.objs.size()=1 2024-09-12T18:35:59.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.817+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:j9kpop9Mcq6LlyQzEg0OMHtAZLkFRzO_.RR8xaeqMzffU-f_-XexzG4VXWCbSFUn_0 2024-09-12T18:35:59.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17051862605876519506', time=2024-09-12T20:20:29.355189+0000, chain.objs.size()=1 2024-09-12T18:35:59.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:TqvGrFLBU0kDKOxuoQYaVYo1YISZvXe_.27AL4y48rA63_chEFA9XmGg1qR-_S_u_0 2024-09-12T18:35:59.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6679237598099456932', time=2024-09-12T20:21:06.567548+0000, chain.objs.size()=1 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.580__shadow:Nugps8OMnSBpr1QGJ7-Lw3gv11IGW23_.RRx5dbYVeaKzrojInkCe25Incs9nJMM_0 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16401130707974373928', time=2024-09-12T20:21:11.602628+0000, chain.objs.size()=1 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.581__shadow:8lkG-CsxESMZWJVlxzlVfzwJhT9RfF3_.2CfEIQ15zFt1KIe0ByggQxYj6e-SFvD_0 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11676911040086852578', time=2024-09-12T20:21:53.294847+0000, chain.objs.size()=1 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.608__shadow_.59jKJsBGFUqQJIT9FqDiWqnEDU5W7t5_0 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13558330796849254290', time=2024-09-12T20:26:31.005402+0000, chain.objs.size()=1 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.630__shadow_.rtrcJQ0wyIzzYHmRBo6CaXm7W1Ib9Mn_0 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15906287530130411586', time=2024-09-12T20:26:47.656023+0000, chain.objs.size()=1 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.642__shadow_.7UzD_2ZeCcsT9KCGXap9zXTKXzKvqKy_0 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18312607881814023398', time=2024-09-12T20:27:00.312558+0000, chain.objs.size()=1 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.647__shadow_.2QW2Cexct0usfetV84zJwFqnmZ4_dMA_0 2024-09-12T18:35:59.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13739547983366827354', time=2024-09-12T20:27:15.228094+0000, chain.objs.size()=1 2024-09-12T18:35:59.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.654__shadow_.XtMzaUWRCY5mEwwMbNyQ-ujNrhhaN6h_0 2024-09-12T18:35:59.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14135517388468051565', time=2024-09-12T20:27:53.751548+0000, chain.objs.size()=1 2024-09-12T18:35:59.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.665__shadow_.oPIeIyP3zXZlyXk-Za2pXsJk_OAvAQ0_0 2024-09-12T18:35:59.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~m15heRq_mdMW7hcR7iEX42D4tYCeiJW', time=2024-09-12T20:30:13.179492+0000, chain.objs.size()=1 2024-09-12T18:35:59.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.825+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.743__multipart_mymultipart2.2~m15heRq_mdMW7hcR7iEX42D4tYCeiJW.1 2024-09-12T18:35:59.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.833+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:35:59.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:35:59.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:35:59.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:35:59.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50303' 2024-09-12T18:35:59.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_SV5PXhhKer-ZTabeJTrRBVaQ2GYvOzv', time=2024-09-12T19:56:25.849280+0000, chain.objs.size()=1 2024-09-12T18:35:59.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.164__shadow_.sImvnswioUyiRx7Iqu9PujMn9svEP_P_0 2024-09-12T18:35:59.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9463125283913846896', time=2024-09-12T19:57:28.289779+0000, chain.objs.size()=1 2024-09-12T18:35:59.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.200__shadow_.TK1n7-YRfF-1icLBYDakm6WjAIvIHEy_0 2024-09-12T18:35:59.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.340384748922606526', time=2024-09-12T20:00:39.014983+0000, chain.objs.size()=1 2024-09-12T18:35:59.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.244__shadow_.nvKUbTbkPZzVbKjPP6ghyO7iV6GF1sz_0 2024-09-12T18:35:59.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16444808902228168393', time=2024-09-12T20:00:53.235026+0000, chain.objs.size()=1 2024-09-12T18:35:59.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.252__shadow_.LAuURRpMj3wmpp4KBznKKL00xre21Nl_0 2024-09-12T18:35:59.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4768587370849296402', time=2024-09-12T20:00:58.304729+0000, chain.objs.size()=1 2024-09-12T18:35:59.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.255__shadow_.5vsxUziwS8DF74j4YdKFKO6X7n8Umvr_0 2024-09-12T18:35:59.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8666335454872858343', time=2024-09-12T20:02:52.068740+0000, chain.objs.size()=1 2024-09-12T18:35:59.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.n18Ln17tSRxHwTa5o3kOFR3kFO973J9_0 2024-09-12T18:35:59.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5776747588447794129', time=2024-09-12T20:02:52.478321+0000, chain.objs.size()=1 2024-09-12T18:35:59.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.VFH0TWC5kmF1TTWi4MYj2eSwTaYxvKI_0 2024-09-12T18:35:59.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10303695032157571264', time=2024-09-12T20:02:53.567538+0000, chain.objs.size()=1 2024-09-12T18:35:59.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.g2VdzuLs5o2Lw8ShIRc6WCLuGuFqj-U_0 2024-09-12T18:35:59.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.620539701548967087', time=2024-09-12T20:02:53.664408+0000, chain.objs.size()=1 2024-09-12T18:35:59.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.PSIyalOiIgu7fBYkoYndA7PNa4teeyu_0 2024-09-12T18:35:59.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16731650814780499100', time=2024-09-12T20:02:54.013987+0000, chain.objs.size()=1 2024-09-12T18:35:59.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.jLO8C0GQ4DigXsFz4nlgovzUM-9xyuZ_0 2024-09-12T18:35:59.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2264412231092910857', time=2024-09-12T20:02:55.949912+0000, chain.objs.size()=1 2024-09-12T18:35:59.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.B18EoIu7os6y_cPV7Ffb3kSN3qFgroi_0 2024-09-12T18:35:59.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9758150496052890831', time=2024-09-12T20:02:56.387784+0000, chain.objs.size()=1 2024-09-12T18:35:59.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.841+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.hbqXEBN4Y2ZTqOy1IrnAn1BBvPFIYeI_0 2024-09-12T18:35:59.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.845+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16780467079963435719', time=2024-09-12T20:02:56.464666+0000, chain.objs.size()=1 2024-09-12T18:35:59.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.845+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.SWNsuRMMNaLxjpQCEMP5_dT6kmqrYkU_0 2024-09-12T18:35:59.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.845+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11571786033112540741', time=2024-09-12T20:02:57.752185+0000, chain.objs.size()=1 2024-09-12T18:35:59.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.845+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.AaMqT7DlCBXM8ndcib158k1SVA4iT_K_0 2024-09-12T18:35:59.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11794669970469474090', time=2024-09-12T20:02:59.762543+0000, chain.objs.size()=1 2024-09-12T18:35:59.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.NxXmwFcAVrfLwTFTD1NSpNb-O0IIdTy_0 2024-09-12T18:35:59.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6394664126783255468', time=2024-09-12T20:02:59.886052+0000, chain.objs.size()=1 2024-09-12T18:35:59.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.TkseGfOFI5jh9O7H0-2dV-YKkkixVWD_0 2024-09-12T18:35:59.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4391633633432985740', time=2024-09-12T20:03:06.041691+0000, chain.objs.size()=1 2024-09-12T18:35:59.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Xk9xft7ileO_YnCYOhm-GP9xfkCn9dA_0 2024-09-12T18:35:59.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9014985540046983150', time=2024-09-12T20:03:09.697221+0000, chain.objs.size()=1 2024-09-12T18:35:59.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.vUn9R6Y_Nhn0lidhoQMwmQ_9MNUAVDq_0 2024-09-12T18:35:59.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7002216269581799205', time=2024-09-12T20:03:10.920263+0000, chain.objs.size()=1 2024-09-12T18:35:59.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._QW7dsFd-Tz3QQ2CmmZS8eb_iLo_f3P_0 2024-09-12T18:35:59.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7745835312411010088', time=2024-09-12T20:03:11.360980+0000, chain.objs.size()=1 2024-09-12T18:35:59.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.KCsLEo9cACXhjtw9zfq8EY_eGO4Dzm6_0 2024-09-12T18:35:59.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6766829135759132103', time=2024-09-12T20:03:14.998156+0000, chain.objs.size()=1 2024-09-12T18:35:59.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._31Fe7S8Lb5N2o7udtySYwjXzemfDMz_0 2024-09-12T18:35:59.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4375765761174795804', time=2024-09-12T20:03:15.640755+0000, chain.objs.size()=1 2024-09-12T18:35:59.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Aa8CGjNUVFJn7sIknXLynFM8555hnIp_0 2024-09-12T18:35:59.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14918879945155795075', time=2024-09-12T20:03:15.887734+0000, chain.objs.size()=1 2024-09-12T18:35:59.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.sm8F64erTx4zF_zQIInNgcTTvTyaTt3_0 2024-09-12T18:35:59.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17893421016083845526', time=2024-09-12T20:03:15.889747+0000, chain.objs.size()=1 2024-09-12T18:35:59.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ROl_k35Jl8S1kmIwUVlu8wSFa7ZhOgV_0 2024-09-12T18:35:59.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8257150327688098151', time=2024-09-12T20:03:16.996443+0000, chain.objs.size()=1 2024-09-12T18:35:59.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.849+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.mQNYxoyj7wYoUnZUqm2mv5G-vdDDJyW_0 2024-09-12T18:35:59.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.853+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16618502338088205819', time=2024-09-12T20:03:17.146607+0000, chain.objs.size()=1 2024-09-12T18:35:59.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.853+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.FOWmDRQHxvQJnOc3uh-5ZmBgaBelP1Q_0 2024-09-12T18:35:59.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.853+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2874872753082624631', time=2024-09-12T20:03:18.124632+0000, chain.objs.size()=1 2024-09-12T18:35:59.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.853+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ynrXqysDlHQ4D6jAjtD9kSTkxzW3O5m_0 2024-09-12T18:35:59.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.853+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12377232024160006303', time=2024-09-12T20:03:18.143887+0000, chain.objs.size()=1 2024-09-12T18:35:59.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.853+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XfvzBVXcqWO7RWt_tE6WlK3x8OhXIRz_0 2024-09-12T18:35:59.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.853+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13831005421277238873', time=2024-09-12T20:03:20.225400+0000, chain.objs.size()=1 2024-09-12T18:35:59.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.853+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._o3Qr1DiEGus-jmBuXVfi-q_sLuW73h_0 2024-09-12T18:35:59.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.853+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10965496199670373052', time=2024-09-12T20:03:20.331371+0000, chain.objs.size()=1 2024-09-12T18:35:59.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.853+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.0GfyuwmpoOeVdfXZNH4_9jSA4Er_cwL_0 2024-09-12T18:35:59.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.853+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13654349457002092209', time=2024-09-12T20:03:33.189335+0000, chain.objs.size()=1 2024-09-12T18:35:59.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.853+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.271__shadow_.IfzGykUSRrbQ3BxcpkBhk27HPtHc7jc_0 2024-09-12T18:35:59.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.853+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4103362119091489832', time=2024-09-12T20:03:47.688426+0000, chain.objs.size()=1 2024-09-12T18:35:59.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.853+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.280__shadow_.vFdRDnWqTNJYNMf6_VmDZwwlspmU_by_0 2024-09-12T18:35:59.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.857+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15796046073261501593', time=2024-09-12T20:03:52.777898+0000, chain.objs.size()=1 2024-09-12T18:35:59.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.857+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.283__shadow_.hZkTPaNe7Zo0EZpgqImRR3hPZl_iSb7_0 2024-09-12T18:35:59.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.857+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5681267001713509402', time=2024-09-12T20:04:06.552544+0000, chain.objs.size()=1 2024-09-12T18:35:59.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.857+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.291__shadow_.CLypD0CjtUMNhOoLXdn-AQ4uzZajaDH_0 2024-09-12T18:35:59.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.857+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9829407404378400163', time=2024-09-12T20:04:06.554138+0000, chain.objs.size()=1 2024-09-12T18:35:59.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.857+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.291__shadow_.90fQCnnelyZyJVr_dFkmF6YPtpokWmi_0 2024-09-12T18:35:59.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.857+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9044364533813571901', time=2024-09-12T20:04:12.894248+0000, chain.objs.size()=1 2024-09-12T18:35:59.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.857+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.O9i2ZEphxDyTe3NjBhJ3iGxrp4QhEG8_0 2024-09-12T18:35:59.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.861+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15007168408990032301', time=2024-09-12T20:04:12.959731+0000, chain.objs.size()=1 2024-09-12T18:35:59.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.861+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.ZZpiQGNmUamZfoCuZ1-oKs0yf2BNXkp_0 2024-09-12T18:35:59.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.861+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.158670804747712343', time=2024-09-12T20:04:13.186967+0000, chain.objs.size()=1 2024-09-12T18:35:59.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.861+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.eYxIjx_gx4pEuJ8YVyqJHAbTE9yP-EQ_0 2024-09-12T18:35:59.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.861+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15609669175452704688', time=2024-09-12T20:04:13.218621+0000, chain.objs.size()=1 2024-09-12T18:35:59.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.861+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.badzYjZehrtE64o3QQN_G5IoObyzb1N_0 2024-09-12T18:35:59.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.861+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3552139319056183748', time=2024-09-12T20:04:17.886212+0000, chain.objs.size()=1 2024-09-12T18:35:59.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.861+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.dM67OiEBx9BNQ4GQzbufqulKvW2HHL-_0 2024-09-12T18:35:59.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.861+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1595861192628368288', time=2024-09-12T20:06:51.776740+0000, chain.objs.size()=1 2024-09-12T18:35:59.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.861+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7kw8h1kxm0BE_3ioSZFjnvYEH4iHtSl_0 2024-09-12T18:35:59.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.861+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8444958822313981094', time=2024-09-12T20:06:52.308009+0000, chain.objs.size()=1 2024-09-12T18:35:59.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.861+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.a1DTtU3D02Xc3qROI_CaZqeouG9nESi_0 2024-09-12T18:35:59.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.861+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10713925708592949884', time=2024-09-12T20:06:52.567382+0000, chain.objs.size()=1 2024-09-12T18:35:59.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.861+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.EsiudrQfsgKnWtEvebW3IcZnC7NLzGl_0 2024-09-12T18:35:59.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.861+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7653164034229480343', time=2024-09-12T20:06:54.934385+0000, chain.objs.size()=1 2024-09-12T18:35:59.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.861+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.T1Z84NTGtx5yJkgFVm0L9-bYPw0Oqk7_0 2024-09-12T18:35:59.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.865+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12449184196494710262', time=2024-09-12T20:06:55.297724+0000, chain.objs.size()=1 2024-09-12T18:35:59.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.865+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.t2OSpsGNBnKGU2jxcclX0W8V8DSGfUR_0 2024-09-12T18:35:59.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.865+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7551610159446192009', time=2024-09-12T20:06:56.207516+0000, chain.objs.size()=1 2024-09-12T18:35:59.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.865+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.AMejO1ZtivOtu6NPEOviDtx-PXRFniF_0 2024-09-12T18:35:59.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.865+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5399439567144232987', time=2024-09-12T20:06:56.356014+0000, chain.objs.size()=1 2024-09-12T18:35:59.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.865+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.P7EBtxsCsrBb7yBHjnw-2vzWCRdK-4k_0 2024-09-12T18:35:59.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.865+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.879333338317998600', time=2024-09-12T20:06:56.955669+0000, chain.objs.size()=1 2024-09-12T18:35:59.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.865+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.imSKCX0_XmxSLg7Uua9xa1ZkyvS8Q1j_0 2024-09-12T18:35:59.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.865+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10174024962594139899', time=2024-09-12T20:06:57.216038+0000, chain.objs.size()=1 2024-09-12T18:35:59.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.865+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.jFPuZPGCXnhxtn7MISpGXmftjO2Cm1p_0 2024-09-12T18:35:59.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.865+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10128057262272272714', time=2024-09-12T20:06:58.734590+0000, chain.objs.size()=1 2024-09-12T18:35:59.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.865+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.--p0yVfhow6Vdsg0v6kP5E6cDvDcq2t_0 2024-09-12T18:35:59.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.865+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14131648833906755309', time=2024-09-12T20:06:59.567965+0000, chain.objs.size()=1 2024-09-12T18:35:59.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.865+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.NW11rScynbu3duPa0NnYcWiYtKM-nsY_0 2024-09-12T18:35:59.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.869+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3511573883759205395', time=2024-09-12T20:07:00.980373+0000, chain.objs.size()=1 2024-09-12T18:35:59.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.869+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.8gkiGVBKyoztu6M6aUOOyLI0ElWw0NB_0 2024-09-12T18:35:59.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.869+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7854116011171177607', time=2024-09-12T20:07:03.375011+0000, chain.objs.size()=1 2024-09-12T18:35:59.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.869+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Fwv6yhkWpyFsrnL1cM4EjNtTZohLPUi_0 2024-09-12T18:35:59.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.869+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6420293855343744819', time=2024-09-12T20:07:03.882332+0000, chain.objs.size()=1 2024-09-12T18:35:59.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.869+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.GSIQwsypROG__JMCahw9THGIZgxLtn8_0 2024-09-12T18:35:59.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.869+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11866619971681236872', time=2024-09-12T20:07:04.513553+0000, chain.objs.size()=1 2024-09-12T18:35:59.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.869+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_._0cZjkTXu0KL9C0iX5adL7h9MOnDqN7_0 2024-09-12T18:35:59.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.869+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3322689772728878377', time=2024-09-12T20:07:05.055189+0000, chain.objs.size()=1 2024-09-12T18:35:59.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.869+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.mc8aC5PC2-FHykjwdIARfDa4ljfFrlG_0 2024-09-12T18:35:59.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.869+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.520256577946318738', time=2024-09-12T20:07:06.282318+0000, chain.objs.size()=1 2024-09-12T18:35:59.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.869+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.RxvZ8w8Z7KFBa4izHms1LIocWbqfYqZ_0 2024-09-12T18:35:59.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.869+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16678462595160060783', time=2024-09-12T20:07:07.037977+0000, chain.objs.size()=1 2024-09-12T18:35:59.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.869+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.xqRRywsYDA1PNCqQfGbh4TFDkN0Dqzg_0 2024-09-12T18:35:59.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.869+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12587784743330000304', time=2024-09-12T20:07:07.690502+0000, chain.objs.size()=1 2024-09-12T18:35:59.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.869+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.MH_AvlPJxdoBtSM7bPFgUai6FzImFXD_0 2024-09-12T18:35:59.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.873+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10275152524177483679', time=2024-09-12T20:07:11.481858+0000, chain.objs.size()=1 2024-09-12T18:35:59.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.873+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.CWIn9fNBUqWq3jUSZLTMhxjE2edvlzC_0 2024-09-12T18:35:59.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.873+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8734260870582911248', time=2024-09-12T20:07:12.278204+0000, chain.objs.size()=1 2024-09-12T18:35:59.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.873+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.nhCGrkke3yJNubMVDDgzWM36eO0ZzKv_0 2024-09-12T18:35:59.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.873+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14420444720613897463', time=2024-09-12T20:07:12.685584+0000, chain.objs.size()=1 2024-09-12T18:35:59.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.873+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.8iRcsmDvOOMA07oKrPibtLVF8vPVzeC_0 2024-09-12T18:35:59.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.873+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11984247865881200424', time=2024-09-12T20:07:14.824669+0000, chain.objs.size()=1 2024-09-12T18:35:59.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.873+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.kV77rKJMLTZ5hxOyHEAkq-SMNH6l1wE_0 2024-09-12T18:35:59.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.873+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1492905369419248034', time=2024-09-12T20:07:15.429537+0000, chain.objs.size()=1 2024-09-12T18:35:59.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.873+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.H2zaVu7wgNinX9VcbHQz4_UXeX6xXut_0 2024-09-12T18:35:59.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.877+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1655641373197220584', time=2024-09-12T20:07:16.130138+0000, chain.objs.size()=1 2024-09-12T18:35:59.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.877+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.RCXkKpzj_xFyjB1CunhEVn48mlG4YKF_0 2024-09-12T18:35:59.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.877+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.464367623101011407', time=2024-09-12T20:07:17.480900+0000, chain.objs.size()=1 2024-09-12T18:35:59.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.877+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.o4XWOM2GaK_XkKGZSteiJU82BER9mzi_0 2024-09-12T18:35:59.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.877+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1147845645155219698', time=2024-09-12T20:07:18.488439+0000, chain.objs.size()=1 2024-09-12T18:35:59.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.877+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.HxVyBSnl8Dn_CK9hjmeFXmVE6vNg-mv_0 2024-09-12T18:35:59.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.877+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8576005529862871709', time=2024-09-12T20:07:18.888801+0000, chain.objs.size()=1 2024-09-12T18:35:59.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.877+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.fRCXGsAE7rUcpwwapNvymRstL6NXkJK_0 2024-09-12T18:35:59.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.877+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.360016708435039274', time=2024-09-12T20:09:02.674879+0000, chain.objs.size()=1 2024-09-12T18:35:59.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.877+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.pm7xerBHnZBxCUws7tIaS2f96sKbUTH_0 2024-09-12T18:35:59.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.877+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14776351770316764459', time=2024-09-12T20:09:03.216428+0000, chain.objs.size()=1 2024-09-12T18:35:59.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.877+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.1RXgKRIXGL5piNoOoVAw8Br5jS200rS_0 2024-09-12T18:35:59.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14328162837952041555', time=2024-09-12T20:09:03.218145+0000, chain.objs.size()=1 2024-09-12T18:35:59.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.APQ4t3H7-vy2KAGmlV5jTE9NWrRYT1c_0 2024-09-12T18:35:59.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10683987662475899390', time=2024-09-12T20:09:03.325025+0000, chain.objs.size()=1 2024-09-12T18:35:59.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xkhOhwFK_K8fwk08TbqDZ4bqSyaaErJ_0 2024-09-12T18:35:59.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10036051775803720624', time=2024-09-12T20:09:06.942021+0000, chain.objs.size()=1 2024-09-12T18:35:59.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.87K8yE6KsgqMY36ZrMw0B-gSEWUs5lg_0 2024-09-12T18:35:59.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10193165531052883575', time=2024-09-12T20:09:11.337844+0000, chain.objs.size()=1 2024-09-12T18:35:59.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FP6uhcPCrgdYMdIQUqtQnQ7ZFo0kDlS_0 2024-09-12T18:35:59.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14811612512271919229', time=2024-09-12T20:09:12.134387+0000, chain.objs.size()=1 2024-09-12T18:35:59.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.a7DlkSTAl6ypHBmN-GNHHi7xqQr0KKh_0 2024-09-12T18:35:59.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1946899023426305559', time=2024-09-12T20:09:13.343971+0000, chain.objs.size()=1 2024-09-12T18:35:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.E_WWQyAsyXvAK89rxPDNluvUOa9slIO_0 2024-09-12T18:35:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.512385520630487610', time=2024-09-12T20:09:14.474895+0000, chain.objs.size()=1 2024-09-12T18:35:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.oDLGjrUIGeRllaJMllEJnl5Q6dWoW_5_0 2024-09-12T18:35:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8847136457950123654', time=2024-09-12T20:09:15.301779+0000, chain.objs.size()=1 2024-09-12T18:35:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Q8tyqQOUVqLXKmnlXgR2M9OpAfBnAwd_0 2024-09-12T18:35:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6638536438626331720', time=2024-09-12T20:09:16.962268+0000, chain.objs.size()=1 2024-09-12T18:35:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.HfcZXjmSn3Wh1NCjwjSlfu9cteFS7vI_0 2024-09-12T18:35:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7012249353043812067', time=2024-09-12T20:09:17.388702+0000, chain.objs.size()=1 2024-09-12T18:35:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.78DOvlu6myJ7tiWTWpIoxE_l_bbCqho_0 2024-09-12T18:35:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6068789535907371464', time=2024-09-12T20:09:17.977455+0000, chain.objs.size()=1 2024-09-12T18:35:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.881+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2Kxt3MzsFbHQaXA9KuaMVpNC_8Hmdv0_0 2024-09-12T18:35:59.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.885+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12082249334677415415', time=2024-09-12T20:09:18.221949+0000, chain.objs.size()=1 2024-09-12T18:35:59.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.885+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.yjQxROtvsLKUM6s8Kq8AGo5eZ_dem43_0 2024-09-12T18:35:59.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.885+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5578113638527719490', time=2024-09-12T20:09:20.651035+0000, chain.objs.size()=1 2024-09-12T18:35:59.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.885+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.JHrrVXEuuanQAtUeq0G1epspzMgFrig_0 2024-09-12T18:35:59.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.885+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5994377708896169530', time=2024-09-12T20:09:22.353916+0000, chain.objs.size()=1 2024-09-12T18:35:59.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.885+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.z8oornxsUZKbjTMfl-TeSGqfbF6kraX_0 2024-09-12T18:35:59.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.885+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5366527847084722185', time=2024-09-12T20:09:23.392243+0000, chain.objs.size()=1 2024-09-12T18:35:59.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.885+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.qwJYKvueIE0hNMQFRvycYbXTgHxkiUo_0 2024-09-12T18:35:59.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.885+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4823543829457849843', time=2024-09-12T20:11:56.596156+0000, chain.objs.size()=1 2024-09-12T18:35:59.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.885+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.437__shadow_.6PNcXTfk4lcl3Imlo2yQwNxztPUFWCZ_0 2024-09-12T18:35:59.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6679350283890727201', time=2024-09-12T20:12:38.963700+0000, chain.objs.size()=1 2024-09-12T18:35:59.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.463__shadow_.GzPOGrzfnAgqlsP8vJD4KuKpvTItCT4_0 2024-09-12T18:35:59.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11995333789357886455', time=2024-09-12T20:13:07.266962+0000, chain.objs.size()=1 2024-09-12T18:35:59.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.484__shadow_.qjoa27Dl7hG2PLwuPXwKdMIXZCACR-v_0 2024-09-12T18:35:59.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11251525057813645276', time=2024-09-12T20:13:32.141931+0000, chain.objs.size()=1 2024-09-12T18:35:59.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.499__shadow_.65GsMNLzzd89hIhsTeHQY31S7fPZOuh_0 2024-09-12T18:35:59.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.555405712155430645', time=2024-09-12T20:16:27.176262+0000, chain.objs.size()=2 2024-09-12T18:35:59.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.524__multipart_mymultipart.2~5UefsOgblDmzzcz3-ZRsxv8R1pTx1ZR.1 2024-09-12T18:35:59.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.524__multipart_mymultipart.2~5UefsOgblDmzzcz3-ZRsxv8R1pTx1ZR.2 2024-09-12T18:35:59.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10216348240829523597', time=2024-09-12T20:17:39.037480+0000, chain.objs.size()=1 2024-09-12T18:35:59.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.537__multipart_mymultipart.2~JtP2hWg1Ingsry5ME1Mm8liOK4ngoP9.1 2024-09-12T18:35:59.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16386633460700408454', time=2024-09-12T20:19:13.983000+0000, chain.objs.size()=1 2024-09-12T18:35:59.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:3vl-.ViSp6Q.lVTfunhp5RbFzpOy-5S_.jYL8uEGwOKwXzfGyYCbCaFRiCJ7D3Et_0 2024-09-12T18:35:59.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1821183223757251492', time=2024-09-12T20:20:02.130824+0000, chain.objs.size()=1 2024-09-12T18:35:59.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:00GjGaxGMBcUaMRH8rpfBMu-5vdBFOG_.2_BLFczFF08fpmVJ6wJnoKPxMCXqKwA_0 2024-09-12T18:35:59.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1458499607524495666', time=2024-09-12T20:21:21.464730+0000, chain.objs.size()=1 2024-09-12T18:35:59.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.889+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.586__shadow:iMy7UrYwFXRe1oRsRxb1Mmy4shV8U9Y_.H2pVMQXu0IzfW6BTQ8oOBu8wxTHYObs_0 2024-09-12T18:35:59.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.893+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9932267026009710570', time=2024-09-12T20:21:50.485474+0000, chain.objs.size()=1 2024-09-12T18:35:59.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.893+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.606__shadow_.NylLI4Pu8Iyv3tgFH6blRcwCXk509qs_0 2024-09-12T18:35:59.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.893+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10008231171575963937', time=2024-09-12T20:23:27.777414+0000, chain.objs.size()=12 2024-09-12T18:35:59.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.893+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.616__multipart_multipart_enc.2~PFDThjODZdlH2QESI5Je__2H97OBuRR.1 2024-09-12T18:35:59.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.897+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.616__shadow_multipart_enc.2~PFDThjODZdlH2QESI5Je__2H97OBuRR.1_1 2024-09-12T18:35:59.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.897+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.616__multipart_multipart_enc.2~PFDThjODZdlH2QESI5Je__2H97OBuRR.2 2024-09-12T18:35:59.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.897+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.616__shadow_multipart_enc.2~PFDThjODZdlH2QESI5Je__2H97OBuRR.2_1 2024-09-12T18:35:59.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.897+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.616__multipart_multipart_enc.2~PFDThjODZdlH2QESI5Je__2H97OBuRR.3 2024-09-12T18:35:59.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.897+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.616__shadow_multipart_enc.2~PFDThjODZdlH2QESI5Je__2H97OBuRR.3_1 2024-09-12T18:35:59.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.897+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.616__multipart_multipart_enc.2~PFDThjODZdlH2QESI5Je__2H97OBuRR.4 2024-09-12T18:35:59.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.897+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.616__shadow_multipart_enc.2~PFDThjODZdlH2QESI5Je__2H97OBuRR.4_1 2024-09-12T18:35:59.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.897+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.616__multipart_multipart_enc.2~PFDThjODZdlH2QESI5Je__2H97OBuRR.5 2024-09-12T18:35:59.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.897+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.616__shadow_multipart_enc.2~PFDThjODZdlH2QESI5Je__2H97OBuRR.5_1 2024-09-12T18:35:59.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.897+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.616__multipart_multipart_enc.2~PFDThjODZdlH2QESI5Je__2H97OBuRR.6 2024-09-12T18:35:59.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.897+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.616__shadow_multipart_enc.2~PFDThjODZdlH2QESI5Je__2H97OBuRR.6_1 2024-09-12T18:35:59.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.901+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12792635623309378814', time=2024-09-12T20:26:38.176129+0000, chain.objs.size()=1 2024-09-12T18:35:59.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.901+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.635__shadow_.M6HNk6-4JtBQ58lA7hPbmRBQpl3907d_0 2024-09-12T18:35:59.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.901+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5917616941594324036', time=2024-09-12T20:27:13.770945+0000, chain.objs.size()=1 2024-09-12T18:35:59.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.901+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.653__shadow_.BcQpmn9L15qA7ImwapUNN2igLQlw2sP_0 2024-09-12T18:35:59.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.905+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15300568549553678069', time=2024-09-12T20:27:59.067911+0000, chain.objs.size()=1 2024-09-12T18:35:59.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.905+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.667__shadow_.zU0y-69Sxus-d72Snmg1olNCEutGjkz_0 2024-09-12T18:35:59.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.905+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4713752361981378729', time=2024-09-12T20:28:34.810593+0000, chain.objs.size()=1 2024-09-12T18:35:59.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.905+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.696__shadow_.XrVOwcVljxZj8ZaH7LVY0E2WftZOu1s_0 2024-09-12T18:35:59.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.909+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50303 2024-09-12T18:35:59.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.917+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:35:59.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.917+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6747527453226385749', time=2024-09-12T20:28:57.056259+0000, chain.objs.size()=1 2024-09-12T18:35:59.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.917+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.710__shadow_.jTxRS6yfRpRKML2Mgoduz086Ac7A6y9_0 2024-09-12T18:35:59.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.917+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13826640291596176809', time=2024-09-12T20:30:18.423856+0000, chain.objs.size()=6 2024-09-12T18:35:59.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.917+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.744__multipart_mymultipart3.2~OBop7G9mvwUsVz_wAaqYgm4YxGjCfr5.1 2024-09-12T18:35:59.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.917+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.744__shadow_mymultipart3.2~OBop7G9mvwUsVz_wAaqYgm4YxGjCfr5.1_1 2024-09-12T18:35:59.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.917+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.744__multipart_mymultipart3.2~OBop7G9mvwUsVz_wAaqYgm4YxGjCfr5.2 2024-09-12T18:35:59.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.917+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.744__shadow_mymultipart3.2~OBop7G9mvwUsVz_wAaqYgm4YxGjCfr5.2_1 2024-09-12T18:35:59.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.917+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.744__multipart_mymultipart3.2~OBop7G9mvwUsVz_wAaqYgm4YxGjCfr5.3 2024-09-12T18:35:59.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.917+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.744__shadow_mymultipart3.2~OBop7G9mvwUsVz_wAaqYgm4YxGjCfr5.3_1 2024-09-12T18:35:59.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.925+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:35:59.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:35:59.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:35:59.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:35:59.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49915' 2024-09-12T18:35:59.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6231430882160376680', time=2024-09-12T19:56:19.832005+0000, chain.objs.size()=5 2024-09-12T18:35:59.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__multipart_foo-FROZEN.2~hkIMkUsGu0ctLOYmPOPhVdiRfnORnw3.1 2024-09-12T18:35:59.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_foo-FROZEN.2~hkIMkUsGu0ctLOYmPOPhVdiRfnORnw3.1_1 2024-09-12T18:35:59.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__multipart_foo-FROZEN.2~hkIMkUsGu0ctLOYmPOPhVdiRfnORnw3.2 2024-09-12T18:35:59.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_foo-FROZEN.2~hkIMkUsGu0ctLOYmPOPhVdiRfnORnw3.2_1 2024-09-12T18:35:59.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__multipart_foo-FROZEN.2~hkIMkUsGu0ctLOYmPOPhVdiRfnORnw3.3 2024-09-12T18:35:59.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_YQsQ8CyNltJYGipXS--Z7ECBIR7wTng', time=2024-09-12T19:56:25.779974+0000, chain.objs.size()=1 2024-09-12T18:35:59.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.164__shadow_._bD4E_POSJJNtCfVjpfHH8VyC7DmWnq_0 2024-09-12T18:35:59.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14224578245937753366', time=2024-09-12T19:57:30.327227+0000, chain.objs.size()=1 2024-09-12T18:35:59.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.201__shadow_.yldePlQqdqi778Mtu3O8WzrEI_E6qxE_0 2024-09-12T18:35:59.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7399709719247060232', time=2024-09-12T20:00:28.048572+0000, chain.objs.size()=1 2024-09-12T18:35:59.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.238__shadow_.j8ly8g5FHds18OqqBf6LrUn7QbE4HhK_0 2024-09-12T18:35:59.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2361762670094262115', time=2024-09-12T20:00:30.528135+0000, chain.objs.size()=1 2024-09-12T18:35:59.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.239__shadow_.nYviS-Whsv_RU4WiZKKRUM6CJenERCX_0 2024-09-12T18:35:59.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14034986368150577549', time=2024-09-12T20:00:41.457860+0000, chain.objs.size()=1 2024-09-12T18:35:59.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.245__shadow_.UeirCRQZcQEHRYFnzwuKbcQM9kKxNcP_0 2024-09-12T18:35:59.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13444179577032872230', time=2024-09-12T20:00:41.490821+0000, chain.objs.size()=1 2024-09-12T18:35:59.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.245__shadow_.MoHMftF5oteRIUyzlTQiy2qhLpBmaYJ_0 2024-09-12T18:35:59.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13472556115440432904', time=2024-09-12T20:00:43.193291+0000, chain.objs.size()=1 2024-09-12T18:35:59.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.933+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.246__shadow_.hA-0NgP4b1Vi-z7aVOPg_TIglZdYToP_0 2024-09-12T18:35:59.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.941+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14699243277594051946', time=2024-09-12T20:02:51.935115+0000, chain.objs.size()=1 2024-09-12T18:35:59.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.941+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3H_6vbs4pDjRXRJXMMD4J8lTOBcKPdm_0 2024-09-12T18:35:59.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.941+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11489465004882461493', time=2024-09-12T20:02:54.218866+0000, chain.objs.size()=1 2024-09-12T18:35:59.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.941+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3SD8eoyubtSv4Cj4lRCVL_hDfunqYcC_0 2024-09-12T18:35:59.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.941+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7176205547251759170', time=2024-09-12T20:02:54.372010+0000, chain.objs.size()=1 2024-09-12T18:35:59.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.941+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.x3hIQHK88k-YzwXDWpIunXw2_tVZxC4_0 2024-09-12T18:35:59.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14730550254317452679', time=2024-09-12T20:02:54.829059+0000, chain.objs.size()=1 2024-09-12T18:35:59.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.iNFyPQWAHReCVZk-hqzw3Qv7wK9_Ezn_0 2024-09-12T18:35:59.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11038130899189084895', time=2024-09-12T20:02:56.272652+0000, chain.objs.size()=1 2024-09-12T18:35:59.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.m9pM2ur24sNJinT58Oqr4QMQACOP-Df_0 2024-09-12T18:35:59.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4052183425167564360', time=2024-09-12T20:02:56.770853+0000, chain.objs.size()=1 2024-09-12T18:35:59.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XBFaP6c9PBuKIfQmOIMDX1cxT594Cet_0 2024-09-12T18:35:59.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.131209402183243507', time=2024-09-12T20:02:57.069268+0000, chain.objs.size()=1 2024-09-12T18:35:59.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.BjvhgTBNl9VIefncrmXLTrtNHJJsA8O_0 2024-09-12T18:35:59.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.825377825375671583', time=2024-09-12T20:02:57.386569+0000, chain.objs.size()=1 2024-09-12T18:35:59.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.K1Ti0ldPAsHRM-RWnCcdcnbO__8jnqm_0 2024-09-12T18:35:59.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1027479827465025725', time=2024-09-12T20:02:57.830826+0000, chain.objs.size()=1 2024-09-12T18:35:59.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.1Z8Kz8BA4ovJONnRcmUkpnYEEh-pxAx_0 2024-09-12T18:35:59.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1879492832523313059', time=2024-09-12T20:02:58.129266+0000, chain.objs.size()=1 2024-09-12T18:35:59.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.mByfVJBD9ScOtq_bbMbrIjePegU2tiv_0 2024-09-12T18:35:59.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13794835728280280099', time=2024-09-12T20:02:58.609352+0000, chain.objs.size()=1 2024-09-12T18:35:59.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.pMVytxkBHdoSPGjRqsq1m260i6vHFtH_0 2024-09-12T18:35:59.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5046116576819123062', time=2024-09-12T20:02:58.744009+0000, chain.objs.size()=1 2024-09-12T18:35:59.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qcmIqrmJM1ENOYJ8L0vIkafULB0QAtK_0 2024-09-12T18:35:59.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10162980185226150154', time=2024-09-12T20:03:00.106048+0000, chain.objs.size()=1 2024-09-12T18:35:59.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.945+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.BPP7Z6oofZFXR0196WrCuMN95wtdgjB_0 2024-09-12T18:35:59.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.949+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3785490635334275120', time=2024-09-12T20:03:00.242023+0000, chain.objs.size()=1 2024-09-12T18:35:59.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.949+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qVM9RwNFrKlRDruQGRUSIiT0Ym_2vlf_0 2024-09-12T18:35:59.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.949+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14029962561425538619', time=2024-09-12T20:03:00.689152+0000, chain.objs.size()=1 2024-09-12T18:35:59.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.949+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.0vJV3pisbY-3n4mGmc_HzjbGx4q7zD6_0 2024-09-12T18:35:59.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16688850177259386232', time=2024-09-12T20:03:01.006736+0000, chain.objs.size()=1 2024-09-12T18:35:59.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.laonoDFC-eyTA-nAMNBhYiUzYguy9c2_0 2024-09-12T18:35:59.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3109373884053328487', time=2024-09-12T20:03:01.960444+0000, chain.objs.size()=1 2024-09-12T18:35:59.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ajVdy7qe_S0r6omf95K6cLc_aODFQr__0 2024-09-12T18:35:59.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17236245775002135834', time=2024-09-12T20:03:02.085132+0000, chain.objs.size()=1 2024-09-12T18:35:59.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.SQiMAZraTE3oGJOUTYNrjeThP1jheS9_0 2024-09-12T18:35:59.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4644885129882605914', time=2024-09-12T20:03:02.278543+0000, chain.objs.size()=1 2024-09-12T18:35:59.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.BukKkASWPU9Zw2KDYbLEB11kQB2cuSn_0 2024-09-12T18:35:59.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1833513655959025042', time=2024-09-12T20:03:02.436341+0000, chain.objs.size()=1 2024-09-12T18:35:59.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.7_3D8zidpoX2sq6vj3Bc754h7E6pGmb_0 2024-09-12T18:35:59.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11538512162871620119', time=2024-09-12T20:03:02.613499+0000, chain.objs.size()=1 2024-09-12T18:35:59.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ieZQxIWud_IG83bpYj8cP23XuXIZlij_0 2024-09-12T18:35:59.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11594835928576164525', time=2024-09-12T20:03:03.535044+0000, chain.objs.size()=1 2024-09-12T18:35:59.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.DLUBUkv88GF7JEFlp-_Y1EorhJoZZzy_0 2024-09-12T18:35:59.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5595510417291005447', time=2024-09-12T20:03:04.423558+0000, chain.objs.size()=1 2024-09-12T18:35:59.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.FFl4EkpfGjer-os4wSErc2501jxqX2v_0 2024-09-12T18:35:59.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11508453055711515850', time=2024-09-12T20:03:04.543915+0000, chain.objs.size()=1 2024-09-12T18:35:59.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.953+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.5S3kb7tS3Fg8-ku_p_YF5iOxYxJNjom_0 2024-09-12T18:35:59.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.957+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10115949908122555898', time=2024-09-12T20:03:05.280109+0000, chain.objs.size()=1 2024-09-12T18:35:59.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.957+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wuh8ImY7A5pcpoIJgUjufAF8PAm3VoG_0 2024-09-12T18:35:59.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.957+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15569923612878723093', time=2024-09-12T20:03:07.469835+0000, chain.objs.size()=1 2024-09-12T18:35:59.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.957+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ifSEZ2WUBl0uf46Hxb-p556jrP9GDNc_0 2024-09-12T18:35:59.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8761120925775496506', time=2024-09-12T20:03:09.415412+0000, chain.objs.size()=1 2024-09-12T18:35:59.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.KwqUspZo3lGkOyXEpKXm3tqZvaF_Y6H_0 2024-09-12T18:35:59.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13258970595198006146', time=2024-09-12T20:03:09.507864+0000, chain.objs.size()=1 2024-09-12T18:35:59.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.uTlyf-OgOpbh1QHhkRiLsYqE5IpIQCb_0 2024-09-12T18:35:59.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10285730078461882414', time=2024-09-12T20:03:10.194981+0000, chain.objs.size()=1 2024-09-12T18:35:59.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.d96Fbl8R0GPAPs2kZFOOQUtK4uG-Ah7_0 2024-09-12T18:35:59.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6180163339700209239', time=2024-09-12T20:03:11.465973+0000, chain.objs.size()=1 2024-09-12T18:35:59.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.vJPPTvV8lT2NwDHqq4dW4l_e6CYgOY__0 2024-09-12T18:35:59.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16885570772995751531', time=2024-09-12T20:03:11.855536+0000, chain.objs.size()=1 2024-09-12T18:35:59.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.pSJaVwetdfwrg4PbwrFMWFqv--KtPaO_0 2024-09-12T18:35:59.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8066750390577917529', time=2024-09-12T20:03:11.984376+0000, chain.objs.size()=1 2024-09-12T18:35:59.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.O-PCLTlq5Fue9e4r8FKrskaQZ2wOPSC_0 2024-09-12T18:35:59.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3547545285154319155', time=2024-09-12T20:03:12.979097+0000, chain.objs.size()=1 2024-09-12T18:35:59.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3IEo2_PHXikjke6upyqf_wyX1jVcUK3_0 2024-09-12T18:35:59.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12147084480055412830', time=2024-09-12T20:03:14.580072+0000, chain.objs.size()=1 2024-09-12T18:35:59.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.EUEBPZUMvC561XbGsSTUfobUd0vkjik_0 2024-09-12T18:35:59.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10863387153069924740', time=2024-09-12T20:03:14.676776+0000, chain.objs.size()=1 2024-09-12T18:35:59.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.961+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.bKmUpanvsaoarSGg_uyU2klDug0-XZD_0 2024-09-12T18:35:59.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4705554704206653549', time=2024-09-12T20:03:14.678160+0000, chain.objs.size()=1 2024-09-12T18:35:59.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XnRtoh5y_I5iPJSDpiqdUldLhUAovI5_0 2024-09-12T18:35:59.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3321135252985862619', time=2024-09-12T20:03:15.665315+0000, chain.objs.size()=1 2024-09-12T18:35:59.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3BVdB5YR3mqhgExt2HGPisexBnKnYOm_0 2024-09-12T18:35:59.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10790372582196048115', time=2024-09-12T20:03:16.302518+0000, chain.objs.size()=1 2024-09-12T18:35:59.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.D4P-s5Xz94UaGPLt4gpYyNnBpodYcaf_0 2024-09-12T18:35:59.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6377808359219125601', time=2024-09-12T20:03:16.369769+0000, chain.objs.size()=1 2024-09-12T18:35:59.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.nnO4naBhTlbbi6uqipRUHG1PUuU6o3g_0 2024-09-12T18:35:59.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2502399964341807230', time=2024-09-12T20:03:16.990803+0000, chain.objs.size()=1 2024-09-12T18:35:59.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.E982GakAMXCpR2Krni2TVGjiFcj4S9I_0 2024-09-12T18:35:59.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17418907479847020637', time=2024-09-12T20:03:16.992790+0000, chain.objs.size()=1 2024-09-12T18:35:59.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.5G7WH--9KGCYpMdmX-VacIDCdKGrDAr_0 2024-09-12T18:35:59.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8231954815129237200', time=2024-09-12T20:03:17.344002+0000, chain.objs.size()=1 2024-09-12T18:35:59.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.gTo2_-dNrT8AzwTHXMvEqnv0NLpQKOy_0 2024-09-12T18:35:59.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15232049856778460766', time=2024-09-12T20:03:18.695544+0000, chain.objs.size()=1 2024-09-12T18:35:59.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.sD1jayPEvcDZbYR7aBUHfd5ruuWvHlR_0 2024-09-12T18:35:59.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1117882552740385865', time=2024-09-12T20:03:18.931386+0000, chain.objs.size()=1 2024-09-12T18:35:59.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.969+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.KEK54gP-9lGjilQ3MXRRGvyKh88EvP3_0 2024-09-12T18:35:59.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.973+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3343291674443463976', time=2024-09-12T20:03:19.149489+0000, chain.objs.size()=1 2024-09-12T18:35:59.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.973+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.5cFpD9NLLndKbnWLxYjX4Qs2qogqahL_0 2024-09-12T18:35:59.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.973+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2106972785925029120', time=2024-09-12T20:03:19.234168+0000, chain.objs.size()=1 2024-09-12T18:35:59.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.973+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.kTwF8RobvGmoWIJjDEAlh3jUEi0piEj_0 2024-09-12T18:35:59.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.973+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10864007123565753540', time=2024-09-12T20:03:19.569585+0000, chain.objs.size()=1 2024-09-12T18:35:59.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.973+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.S7DqQD-C-HwCsFbJ11JEh0G7AxPT6dz_0 2024-09-12T18:35:59.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.973+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11201953445853823190', time=2024-09-12T20:03:44.339184+0000, chain.objs.size()=1 2024-09-12T18:35:59.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.973+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.278__shadow_._eTXCmWJUvvoJ4a0AuBXM3eX3d7vCHD_0 2024-09-12T18:35:59.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.973+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14436406627621923363', time=2024-09-12T20:04:13.231688+0000, chain.objs.size()=1 2024-09-12T18:35:59.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.973+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.AXyPXVex371rsc3KmhoI59lRgtm4uV8_0 2024-09-12T18:35:59.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.973+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8298906058061228038', time=2024-09-12T20:04:13.251268+0000, chain.objs.size()=1 2024-09-12T18:35:59.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.973+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.4t9pQzB9nKQKfLJX8EjCk9T9L0QAYWa_0 2024-09-12T18:35:59.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.973+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14524910618896641381', time=2024-09-12T20:04:38.617601+0000, chain.objs.size()=1 2024-09-12T18:35:59.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.973+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.306__shadow_.lNRIXulkQDUncPLbtiOA9yBViLtTX_h_0 2024-09-12T18:35:59.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.973+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13721489016396323876', time=2024-09-12T20:05:05.592444+0000, chain.objs.size()=1 2024-09-12T18:35:59.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.973+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.322__shadow_.sIqbYDOblNhoFd5KSiJMVSt2vk_uTPY_0 2024-09-12T18:35:59.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.977+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6547642481212332836', time=2024-09-12T20:06:51.675787+0000, chain.objs.size()=1 2024-09-12T18:35:59.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.977+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.3seq0m3UJa1sqqO7T41BebY-wlgCU8b_0 2024-09-12T18:35:59.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.977+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17701803356021727654', time=2024-09-12T20:06:51.720702+0000, chain.objs.size()=1 2024-09-12T18:35:59.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.977+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.AhUcXO4KdSipVmnMxdC6B5yTflVxCvm_0 2024-09-12T18:35:59.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.977+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14188064499745702203', time=2024-09-12T20:06:51.783897+0000, chain.objs.size()=1 2024-09-12T18:35:59.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.977+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Bb9wKCkCG1BBkKnI66gNL-lgVGKHDvv_0 2024-09-12T18:35:59.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.977+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15010126275181658076', time=2024-09-12T20:06:52.811429+0000, chain.objs.size()=1 2024-09-12T18:35:59.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.977+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.qcX42aJb-9PWqStDkF50p9-f-9XQJ08_0 2024-09-12T18:35:59.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.977+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9565759098020008000', time=2024-09-12T20:06:56.002716+0000, chain.objs.size()=1 2024-09-12T18:35:59.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.977+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.K96K0X2kWsOrpn6NIj7fnSrejGCM8ZR_0 2024-09-12T18:35:59.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.977+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3082103460851662200', time=2024-09-12T20:06:57.116038+0000, chain.objs.size()=1 2024-09-12T18:35:59.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.977+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.zEfF2lAfifGpNu59Y2kDC3NouVCY-7I_0 2024-09-12T18:35:59.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.977+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3109059601657016037', time=2024-09-12T20:06:57.117535+0000, chain.objs.size()=1 2024-09-12T18:35:59.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.977+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.nOoLI7fRqQtqHa91DFgSxTRSP0mFNby_0 2024-09-12T18:35:59.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.977+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5232417156756821253', time=2024-09-12T20:06:57.376250+0000, chain.objs.size()=1 2024-09-12T18:35:59.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.977+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.cc7a6kxuibCTy2M2nN6ZnPV5aikNmDW_0 2024-09-12T18:35:59.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.981+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2634539657278839396', time=2024-09-12T20:06:58.807889+0000, chain.objs.size()=1 2024-09-12T18:35:59.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.981+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.GdvsGm6N_F6JxH9ZZsUy6TUAqzCdLOp_0 2024-09-12T18:35:59.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.981+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4174413112188546000', time=2024-09-12T20:06:58.810064+0000, chain.objs.size()=1 2024-09-12T18:35:59.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.981+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.tRI29RZnPSm6HocG7HLPnxOQte4HWuS_0 2024-09-12T18:35:59.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.981+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13718861240351845084', time=2024-09-12T20:07:01.302280+0000, chain.objs.size()=1 2024-09-12T18:35:59.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.981+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Gc1wCAP3GuLA0fR2ys3gd9wYdBTjd2R_0 2024-09-12T18:35:59.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14306554523035093000', time=2024-09-12T20:07:04.405961+0000, chain.objs.size()=1 2024-09-12T18:35:59.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.kDwJuyCC3xMSKoam826ANfj80lxx8jJ_0 2024-09-12T18:35:59.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14328189462662657849', time=2024-09-12T20:07:05.191527+0000, chain.objs.size()=1 2024-09-12T18:35:59.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.59TZ-Bty3hq5ggNr5XQIqq9--lANr1H_0 2024-09-12T18:35:59.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8447430739218065699', time=2024-09-12T20:07:05.193586+0000, chain.objs.size()=1 2024-09-12T18:35:59.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.FxnifTxHTt--rvskc6LLPfrN3oTs7en_0 2024-09-12T18:35:59.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14446004539444623046', time=2024-09-12T20:07:06.590702+0000, chain.objs.size()=1 2024-09-12T18:35:59.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.9Wo00Wmv9QAR2OOlcmG9bnLnJxL8mTf_0 2024-09-12T18:35:59.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14821267485329172381', time=2024-09-12T20:07:08.678570+0000, chain.objs.size()=1 2024-09-12T18:35:59.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.A8iQlbk54P8WUL8rIg13JNcwmZVrQWs_0 2024-09-12T18:35:59.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9787307912870239495', time=2024-09-12T20:07:11.114784+0000, chain.objs.size()=1 2024-09-12T18:35:59.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.8xB2JfgrfLLAbIFU_mfroVBP-_Wv-uY_0 2024-09-12T18:35:59.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13884079151206026402', time=2024-09-12T20:07:13.439542+0000, chain.objs.size()=1 2024-09-12T18:35:59.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.c9xCbcfTaR38sQFiyJ__jCpKDeB4axZ_0 2024-09-12T18:35:59.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3177497185487640789', time=2024-09-12T20:07:14.726983+0000, chain.objs.size()=1 2024-09-12T18:35:59.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.cRL7jj2gpu6A8YkCkWlWm52fXtUStfj_0 2024-09-12T18:35:59.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8412877596514707588', time=2024-09-12T20:07:14.819944+0000, chain.objs.size()=1 2024-09-12T18:35:59.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.QRLW-7LqOg9kt58VbhOSW5H4AKgbGiy_0 2024-09-12T18:35:59.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6182596240816063740', time=2024-09-12T20:07:15.429122+0000, chain.objs.size()=1 2024-09-12T18:35:59.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Vi7AN25DIfRHtFKCYcUKgoo4i4_sH5A_0 2024-09-12T18:35:59.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4083442826165929331', time=2024-09-12T20:07:15.433031+0000, chain.objs.size()=1 2024-09-12T18:35:59.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.04_2c38LHL8zN3cAmfWzrGlCaGj-a4R_0 2024-09-12T18:35:59.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14826821537833596512', time=2024-09-12T20:07:15.745395+0000, chain.objs.size()=1 2024-09-12T18:35:59.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.985+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.epifIGqtKAVynAp9DdencxPK2FLHE-W_0 2024-09-12T18:35:59.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.989+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13023266243345907343', time=2024-09-12T20:07:17.012377+0000, chain.objs.size()=1 2024-09-12T18:35:59.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.989+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.FzzxWDWIMjoLPaCS1T43OzhsMne6xbb_0 2024-09-12T18:35:59.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.989+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7219981781343717638', time=2024-09-12T20:07:17.470357+0000, chain.objs.size()=1 2024-09-12T18:35:59.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.989+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.cjvSkZy8lXxUwpzUKlSR-_VkGk8jEqP_0 2024-09-12T18:35:59.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.989+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15921774714983264600', time=2024-09-12T20:07:17.624101+0000, chain.objs.size()=1 2024-09-12T18:35:59.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.989+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.qQDF42yamE2CzFncfjKbsE3MXbV-skY_0 2024-09-12T18:35:59.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.989+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10785419664460962715', time=2024-09-12T20:07:19.083053+0000, chain.objs.size()=1 2024-09-12T18:35:59.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.989+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.bBdiJU3HbOpZTYAydHWZ4H9--cuEOjm_0 2024-09-12T18:35:59.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.989+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15667978990378809743', time=2024-09-12T20:07:19.162599+0000, chain.objs.size()=1 2024-09-12T18:35:59.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.989+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.mOHiofLaxUY30Cfoe-6DrEFyur18Qtv_0 2024-09-12T18:35:59.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.989+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.745245179564833738', time=2024-09-12T20:09:03.343947+0000, chain.objs.size()=1 2024-09-12T18:35:59.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.989+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.DkgtzrmGEmV6N6W28wYXsjQoA7bFveH_0 2024-09-12T18:35:59.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.989+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8113970345659023010', time=2024-09-12T20:09:04.697031+0000, chain.objs.size()=1 2024-09-12T18:35:59.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.989+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.8o2L2shbUMUf8MF7Md1qSC3zrgx07v-_0 2024-09-12T18:35:59.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.993+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14002236286155179957', time=2024-09-12T20:09:05.736336+0000, chain.objs.size()=1 2024-09-12T18:35:59.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.993+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.fPyQErxv3QIfRWdgvZQJJwY35hUXcxe_0 2024-09-12T18:35:59.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.993+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3106499894934412792', time=2024-09-12T20:09:05.955565+0000, chain.objs.size()=1 2024-09-12T18:35:59.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.993+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.YkvyZyou2TTpjtZroR8OhZHqJ1WXD13_0 2024-09-12T18:35:59.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.993+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12830263436901518629', time=2024-09-12T20:09:06.526846+0000, chain.objs.size()=1 2024-09-12T18:35:59.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.993+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cVwG4EapPKtorw47unV6mlAy9UBGQUh_0 2024-09-12T18:35:59.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.993+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9007568221659398645', time=2024-09-12T20:09:06.676650+0000, chain.objs.size()=1 2024-09-12T18:35:59.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.993+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.OISWQ1JbMd6S4mjRGdufjRU17FY-Wcx_0 2024-09-12T18:35:59.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.997+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.190078791302420384', time=2024-09-12T20:09:06.683311+0000, chain.objs.size()=1 2024-09-12T18:35:59.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.997+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.x4vqLwuzC3spDC6e-X3GUgYMpSOU4eP_0 2024-09-12T18:35:59.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.997+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15551469441399820413', time=2024-09-12T20:09:07.171132+0000, chain.objs.size()=1 2024-09-12T18:35:59.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.997+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.z6SxM6H9B0wp93p5VCAROPAUCdvPlJb_0 2024-09-12T18:35:59.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.997+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1879950001009783123', time=2024-09-12T20:09:08.006173+0000, chain.objs.size()=1 2024-09-12T18:35:59.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.997+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cPqNkJkujfBam9dde6javZoJxElMefE_0 2024-09-12T18:36:00.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.997+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1862472690979492860', time=2024-09-12T20:09:08.371662+0000, chain.objs.size()=1 2024-09-12T18:36:00.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.997+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.v0FHqrwUqQyt1ccOnEdHppAr5j4U_2S_0 2024-09-12T18:36:00.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.997+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7153377157869877330', time=2024-09-12T20:09:09.738327+0000, chain.objs.size()=1 2024-09-12T18:36:00.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.997+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.6uvZFal7YKdQ7P0CoVL7kYbsa-mKYLb_0 2024-09-12T18:36:00.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.997+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12236868961425308382', time=2024-09-12T20:09:09.953581+0000, chain.objs.size()=1 2024-09-12T18:36:00.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:35:59.997+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5kixgYASRCjs1ty9icBI8ze9yo6A8w1_0 2024-09-12T18:36:00.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.005+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49915 2024-09-12T18:36:00.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T18:36:00.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5214161564644807483', time=2024-09-12T20:09:10.523211+0000, chain.objs.size()=1 2024-09-12T18:36:00.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.a59tMdFqMqNSyDQAbkSq5PvkdwMvKWe_0 2024-09-12T18:36:00.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10619565432042537068', time=2024-09-12T20:09:12.015272+0000, chain.objs.size()=1 2024-09-12T18:36:00.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vVjL-MbZ2u1QV-s2p8o-XmP0FJ1dQ1I_0 2024-09-12T18:36:00.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8855132699509861511', time=2024-09-12T20:09:12.206751+0000, chain.objs.size()=1 2024-09-12T18:36:00.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FrNSOMuHOxt91mi50TgSLe84E3BVTRr_0 2024-09-12T18:36:00.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13423493564168043980', time=2024-09-12T20:09:13.298698+0000, chain.objs.size()=1 2024-09-12T18:36:00.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2SnTwaiaFa-SPDx8gxQXs-h7eeWuNo2_0 2024-09-12T18:36:00.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3831828962021856922', time=2024-09-12T20:09:13.652463+0000, chain.objs.size()=1 2024-09-12T18:36:00.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.HXgJVnKuCCSohDWr6BYfadDcecJBWMS_0 2024-09-12T18:36:00.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13982899083964940983', time=2024-09-12T20:09:18.698878+0000, chain.objs.size()=1 2024-09-12T18:36:00.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.9-QclFVi77RfJn_DNtMLG62qxejZK4Y_0 2024-09-12T18:36:00.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15600232283213987751', time=2024-09-12T20:09:19.057860+0000, chain.objs.size()=1 2024-09-12T18:36:00.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ALtggYpDOZTSUDZdRUYc6eUffuOdKsS_0 2024-09-12T18:36:00.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6957614169093062850', time=2024-09-12T20:09:19.504538+0000, chain.objs.size()=1 2024-09-12T18:36:00.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.goKKzPkDWs_IWiQfEMqCEiWdl1NSmKc_0 2024-09-12T18:36:00.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16024885183995006290', time=2024-09-12T20:09:19.510099+0000, chain.objs.size()=1 2024-09-12T18:36:00.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.arGjgceRLJYtHrf40T6iADPr4jMRBRb_0 2024-09-12T18:36:00.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4581878634827966965', time=2024-09-12T20:09:20.662788+0000, chain.objs.size()=1 2024-09-12T18:36:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.8P9FMuTabsklvjVfVbFKc6LjfyrJJzT_0 2024-09-12T18:36:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16312556822002428925', time=2024-09-12T20:09:20.666281+0000, chain.objs.size()=1 2024-09-12T18:36:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.fTTyKO0VdonwNsCzeAZQPlMmqWOu0FD_0 2024-09-12T18:36:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18436797826576108351', time=2024-09-12T20:09:21.134546+0000, chain.objs.size()=1 2024-09-12T18:36:00.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.009+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.GVzgxVqRk-GPw-WPHPXX0G6CVv_FiwL_0 2024-09-12T18:36:00.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4433432270865166567', time=2024-09-12T20:09:21.407900+0000, chain.objs.size()=1 2024-09-12T18:36:00.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.CMNEV3jDfK7vBgFMPtRpbULi7V9ErTo_0 2024-09-12T18:36:00.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16035224767311706736', time=2024-09-12T20:09:22.056817+0000, chain.objs.size()=1 2024-09-12T18:36:00.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.OXSSCddRpMw8N-mT5aZzOKOn2zdOT81_0 2024-09-12T18:36:00.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15376831118225398481', time=2024-09-12T20:09:23.374325+0000, chain.objs.size()=1 2024-09-12T18:36:00.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.TNWMcInn9vuafc9ci5LeAc4IQvMvodD_0 2024-09-12T18:36:00.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11427182032795495005', time=2024-09-12T20:09:23.779307+0000, chain.objs.size()=1 2024-09-12T18:36:00.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.kq4viHZ5WmjGBEhx3Rm0KrVrYoScNSt_0 2024-09-12T18:36:00.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14149041090034104054', time=2024-09-12T20:09:26.625732+0000, chain.objs.size()=1 2024-09-12T18:36:00.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.9-7gDnK6J-ICjJh8dJUt1BcMe4ngMGs_0 2024-09-12T18:36:00.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6108042305109868178', time=2024-09-12T20:09:26.986101+0000, chain.objs.size()=1 2024-09-12T18:36:00.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.RkFdXuwmEXzzNDhhcWodNgeSde3J9jO_0 2024-09-12T18:36:00.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11663849637385852370', time=2024-09-12T20:09:27.247078+0000, chain.objs.size()=1 2024-09-12T18:36:00.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.gYn4dP-me05Q2ITujzx_Cl3b5C2ImlF_0 2024-09-12T18:36:00.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15852782092480541568', time=2024-09-12T20:09:29.362071+0000, chain.objs.size()=1 2024-09-12T18:36:00.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.QKsgP_OvJ6qIb4S7YPOwdu3ke71Z53Q_0 2024-09-12T18:36:00.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4921047368061496377', time=2024-09-12T20:10:54.918243+0000, chain.objs.size()=1 2024-09-12T18:36:00.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.391__shadow_.YNrBwktYMYIFBxljhd4LYHiqX0Wuj9W_0 2024-09-12T18:36:00.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3866698903992058399', time=2024-09-12T20:12:47.759056+0000, chain.objs.size()=1 2024-09-12T18:36:00.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.467__shadow_.ZUOFuiZvZ28Ol64yxuhjZn1MEvagm6i_0 2024-09-12T18:36:00.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11020079646040191787', time=2024-09-12T20:13:09.239918+0000, chain.objs.size()=1 2024-09-12T18:36:00.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.017+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.485__shadow_.LFJ6V_tGxAeOvgbpAoigHfAmUeurn7H_0 2024-09-12T18:36:00.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.021+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4428492873792933255', time=2024-09-12T20:14:15.557799+0000, chain.objs.size()=1 2024-09-12T18:36:00.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.021+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.519__multipart_mymultipart.2~SV88KEouayzn-OHbz6rEgIlV6Zy8HY8.1 2024-09-12T18:36:00.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.021+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13181596194674185461', time=2024-09-12T20:14:20.952057+0000, chain.objs.size()=1 2024-09-12T18:36:00.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.021+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.519__multipart_mymultipart.2~rfp9sOlR65neIFLY-f6pvCM3pVaW5hJ.1 2024-09-12T18:36:00.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.021+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~i5C_z-Jkfvxg4U8NibcfNSg4UEp56c9', time=2024-09-12T20:15:06.951444+0000, chain.objs.size()=1 2024-09-12T18:36:00.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.021+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~i5C_z-Jkfvxg4U8NibcfNSg4UEp56c9.1 2024-09-12T18:36:00.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.021+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7782632558727880399', time=2024-09-12T20:17:40.451700+0000, chain.objs.size()=1 2024-09-12T18:36:00.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.021+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.538__shadow_.-QTV_dSAnuMXafLvVyDoEzj7FFA7Va0_0 2024-09-12T18:36:00.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.021+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2748915043930024667', time=2024-09-12T20:18:29.938832+0000, chain.objs.size()=1 2024-09-12T18:36:00.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.021+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.557__shadow_.yNhsjsj_povG8eRvFhxJUTB3z9DJ435_0 2024-09-12T18:36:00.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.021+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3629013047029357495', time=2024-09-12T20:19:17.692677+0000, chain.objs.size()=1 2024-09-12T18:36:00.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.021+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:Y-3BsisV3F7pZIAc0Ii3F8chCECN8a4_.dqzsOG3sUJk5xK8nrLK6-uoRgZBWMYo_0 2024-09-12T18:36:00.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.025+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8608182884224922854', time=2024-09-12T20:21:06.567842+0000, chain.objs.size()=1 2024-09-12T18:36:00.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.025+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.580__shadow:pq-WS1697pg7Wixe0qGkj.QJs3sgynM_.qk03-SQmZ5IrEE8YNqVdheKmOIdIx_D_0 2024-09-12T18:36:00.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.025+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10647050442079485733', time=2024-09-12T20:21:12.643127+0000, chain.objs.size()=1 2024-09-12T18:36:00.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.025+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.581__shadow:hLCzKGGx8ZW.JyQVwyUyeA5mPAp2.2e_.k1GlvoeOKVIPT3Gg_OCwHp3-txOgAl4_0 2024-09-12T18:36:00.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.025+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5782229461314492477', time=2024-09-12T20:21:26.534512+0000, chain.objs.size()=1 2024-09-12T18:36:00.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.025+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.588__shadow:UtXfqvAnTcq5HEMShuY7ktf2Z62usdf_.eLGABlxwrfKyMHJ0Mhiy41eYo_J1kua_0 2024-09-12T18:36:00.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.025+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15378079833903890233', time=2024-09-12T20:26:29.251022+0000, chain.objs.size()=1 2024-09-12T18:36:00.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.025+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.629__shadow_.InSXjrTU1awI5SAw5HracjvPtTmvqj__0 2024-09-12T18:36:00.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.025+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16514913612135545605', time=2024-09-12T20:28:05.725915+0000, chain.objs.size()=1 2024-09-12T18:36:00.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.025+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.673__shadow_.vIavCH8vT7QQ1lYab2ff8_nH2_vxQr9_0 2024-09-12T18:36:00.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.025+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10596966636229086364', time=2024-09-12T20:29:16.189899+0000, chain.objs.size()=1 2024-09-12T18:36:00.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.025+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.716__shadow:yret-4VQWQ4ypj5t.tBAFssuSxPawNY_.t8b-4oOUrMOJcdXMjyOONNIv-S20V30_0 2024-09-12T18:36:00.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.033+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:00.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:36:00.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:00.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:00.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49609' 2024-09-12T18:36:00.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3046252194926890166', time=2024-09-12T19:56:07.650145+0000, chain.objs.size()=3 2024-09-12T18:36:00.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.zpRTD2XQj0qDopYfjZqm1gUB-RfSj9D_0 2024-09-12T18:36:00.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.zpRTD2XQj0qDopYfjZqm1gUB-RfSj9D_1 2024-09-12T18:36:00.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.zpRTD2XQj0qDopYfjZqm1gUB-RfSj9D_2 2024-09-12T18:36:00.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13137038418594815832', time=2024-09-12T19:56:30.148375+0000, chain.objs.size()=2 2024-09-12T18:36:00.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.165__multipart_foo.2~Ep07SVIYmHGsKpbi7DG6FyNTP6xC14i.1 2024-09-12T18:36:00.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.165__multipart_foo.2~Ep07SVIYmHGsKpbi7DG6FyNTP6xC14i.2 2024-09-12T18:36:00.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11270299320677585771', time=2024-09-12T20:00:23.861190+0000, chain.objs.size()=1 2024-09-12T18:36:00.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.236__shadow_.nmBEQloeOoDcPEGKVHUjgwUg1NMQYR3_0 2024-09-12T18:36:00.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8190518982866104358', time=2024-09-12T20:00:30.527258+0000, chain.objs.size()=1 2024-09-12T18:36:00.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.239__shadow_.XFztDebUGtQtB_xci2WwLaADbsPUO4T_0 2024-09-12T18:36:00.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9570770528699953097', time=2024-09-12T20:00:39.010548+0000, chain.objs.size()=1 2024-09-12T18:36:00.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.244__shadow_.MFAwUan7kTaxIPNxDUYmgnobTO9P-hw_0 2024-09-12T18:36:00.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10124158249712051559', time=2024-09-12T20:00:41.476243+0000, chain.objs.size()=1 2024-09-12T18:36:00.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.245__shadow_.9joTGfcPdB-gJxuW9JnFMZ2orK328AX_0 2024-09-12T18:36:00.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1061158864468947016', time=2024-09-12T20:02:52.676466+0000, chain.objs.size()=1 2024-09-12T18:36:00.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.4Iw6NWbWbltbU2Pa7dLsnXIpnucjBfE_0 2024-09-12T18:36:00.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6999856422136354858', time=2024-09-12T20:02:53.028625+0000, chain.objs.size()=1 2024-09-12T18:36:00.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.x1sv5dEKCgywDlrRoOw7k4loLHVn7wV_0 2024-09-12T18:36:00.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15306698593892154013', time=2024-09-12T20:02:53.198914+0000, chain.objs.size()=1 2024-09-12T18:36:00.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.041+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.dT5IF3Q6gtkbEFuFLCc3vsSQqWoN6ZA_0 2024-09-12T18:36:00.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12259859641711441144', time=2024-09-12T20:02:53.484659+0000, chain.objs.size()=1 2024-09-12T18:36:00.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3dFbPhhYraUxkuirKk3cfAuCZv0VGmO_0 2024-09-12T18:36:00.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1077135681572618095', time=2024-09-12T20:02:53.534549+0000, chain.objs.size()=1 2024-09-12T18:36:00.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.thLcYCh0Bwlja5tAB3Jl6gc4pl7QFlP_0 2024-09-12T18:36:00.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14339251849534362194', time=2024-09-12T20:02:55.976623+0000, chain.objs.size()=1 2024-09-12T18:36:00.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Jv-ypOWokaNyqGGu9E9Ij8Z70OLMayP_0 2024-09-12T18:36:00.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12028705504014446663', time=2024-09-12T20:02:56.958425+0000, chain.objs.size()=1 2024-09-12T18:36:00.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.RJ2jyR8l0JLf889fU3fl9P60XHizwGk_0 2024-09-12T18:36:00.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7804277814947621460', time=2024-09-12T20:02:57.618419+0000, chain.objs.size()=1 2024-09-12T18:36:00.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.t9mi0FmZVsYZ0cC_OFN-f_55i0zaJN9_0 2024-09-12T18:36:00.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15196914704944798342', time=2024-09-12T20:02:58.673475+0000, chain.objs.size()=1 2024-09-12T18:36:00.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.bEDwrtr8ZsiBMJRz8d2OyAdtbkF7Fnj_0 2024-09-12T18:36:00.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17803109699165284137', time=2024-09-12T20:02:59.902518+0000, chain.objs.size()=1 2024-09-12T18:36:00.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.UcbHFw23DG9VwtUB9ZZwp0E1LOQotRy_0 2024-09-12T18:36:00.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11202038776784339951', time=2024-09-12T20:03:00.655784+0000, chain.objs.size()=1 2024-09-12T18:36:00.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.bgOKgcVQBthhQohMoeDHYaszUD7YFh__0 2024-09-12T18:36:00.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4098847029453777972', time=2024-09-12T20:03:00.752104+0000, chain.objs.size()=1 2024-09-12T18:36:00.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.SEY0NpQpxqnCD0Eg2TG0BjqJEp_WoD3_0 2024-09-12T18:36:00.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16850409264889029438', time=2024-09-12T20:03:00.924823+0000, chain.objs.size()=1 2024-09-12T18:36:00.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.r3y7skdaTOgpeIKBningwjeArsiaIMx_0 2024-09-12T18:36:00.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.173934121268325113', time=2024-09-12T20:03:01.355649+0000, chain.objs.size()=1 2024-09-12T18:36:00.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.049+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Zeg8h9RnN8OQel4c-8CtG0o-I_MokC0_0 2024-09-12T18:36:00.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.053+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12480969934821635974', time=2024-09-12T20:03:01.573824+0000, chain.objs.size()=1 2024-09-12T18:36:00.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.053+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.7a4HKtD4zj9gFj0Xh-FyDDPAF_-DBNt_0 2024-09-12T18:36:00.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.053+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15016766520530274113', time=2024-09-12T20:03:03.542717+0000, chain.objs.size()=1 2024-09-12T18:36:00.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.053+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ZcQlsRVFSJcewbq-ZKfFC8KgdsqQXVU_0 2024-09-12T18:36:00.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.053+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15648669613351957096', time=2024-09-12T20:03:03.954252+0000, chain.objs.size()=1 2024-09-12T18:36:00.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.053+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.fZC0S8uaHPySE-HN1wV1oPmHNXI5Hpu_0 2024-09-12T18:36:00.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.053+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9375373224890294075', time=2024-09-12T20:03:04.449157+0000, chain.objs.size()=1 2024-09-12T18:36:00.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.053+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QtHLrOTYb-5U6nG54q9j0gt2rGFpUtr_0 2024-09-12T18:36:00.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.053+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10167444018323033004', time=2024-09-12T20:03:04.569751+0000, chain.objs.size()=1 2024-09-12T18:36:00.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.053+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2OsxuXN3Y0TO0tzoNt3EG2u23iBn9Sn_0 2024-09-12T18:36:00.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.053+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1201732968515662606', time=2024-09-12T20:03:04.768206+0000, chain.objs.size()=1 2024-09-12T18:36:00.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.053+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Xwzl_xGNh2ldvZw5xY0b1QLQIstMXJs_0 2024-09-12T18:36:00.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.057+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18433657281110947678', time=2024-09-12T20:03:04.839263+0000, chain.objs.size()=1 2024-09-12T18:36:00.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.057+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.kz6FU13OVNaSRk679DPyrrWIghm96oJ_0 2024-09-12T18:36:00.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.057+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8090341582858257652', time=2024-09-12T20:03:07.783284+0000, chain.objs.size()=1 2024-09-12T18:36:00.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.057+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.NmPCTQePseHRLFZcf1xotrP-NWxVRuI_0 2024-09-12T18:36:00.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.057+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17397803726604039403', time=2024-09-12T20:03:09.728307+0000, chain.objs.size()=1 2024-09-12T18:36:00.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.057+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.WCcBNHMdS7FcrQA-Az_Op8i0Dzx7tSj_0 2024-09-12T18:36:00.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.057+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15191833935770226781', time=2024-09-12T20:03:10.196057+0000, chain.objs.size()=1 2024-09-12T18:36:00.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.057+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.oebeQpY9WD5GEqgXeyD5Rc0Zz76hK29_0 2024-09-12T18:36:00.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.057+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12358676383284682567', time=2024-09-12T20:03:11.100829+0000, chain.objs.size()=1 2024-09-12T18:36:00.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.057+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.BQ3OGwylKU21Wt1W0HI-J89fu0oteG__0 2024-09-12T18:36:00.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.061+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5207963259856949287', time=2024-09-12T20:03:11.633566+0000, chain.objs.size()=1 2024-09-12T18:36:00.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.061+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.rKpdDXXgNexAyIQ_wETzN4OlBDLkkQj_0 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.061+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11719328831964690065', time=2024-09-12T20:03:11.884536+0000, chain.objs.size()=1 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.061+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.oRhaOZsdGUe2u9gCanZlWivhGf4hj3F_0 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.061+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2156923485402333837', time=2024-09-12T20:03:12.972374+0000, chain.objs.size()=1 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.061+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.jpPJparZVVxyEuAQtR9YWLAc1IBhD9y_0 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.061+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11077408940176912513', time=2024-09-12T20:03:13.072700+0000, chain.objs.size()=1 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.061+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.JEkrNrinHQin3WJnFuv1q8nF7uz_LNe_0 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.061+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18408776693051034624', time=2024-09-12T20:03:13.800392+0000, chain.objs.size()=1 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.061+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.FGRlihiHDsG5Y7YqFQVwD7_A5e1HN9x_0 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.061+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18328519558786453628', time=2024-09-12T20:03:15.380230+0000, chain.objs.size()=1 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.061+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.NEbfDbAy9zffiFZCjmgJe54igjvnSYN_0 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.061+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12524736518046558660', time=2024-09-12T20:03:15.382388+0000, chain.objs.size()=1 2024-09-12T18:36:00.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.061+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.FAY2yt7wpbAesHgLeGPS4aTw5TyDs1m_0 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.065+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9697870508376074156', time=2024-09-12T20:03:15.523539+0000, chain.objs.size()=1 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.065+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ZWVE6bVbqPxIRVwVwjaCj49j3QpBATf_0 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.065+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.516225378143213621', time=2024-09-12T20:03:15.893614+0000, chain.objs.size()=1 2024-09-12T18:36:00.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.065+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.eczmBkTrFkB-PBcfCNOjFw9uFifz8He_0 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.065+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8788757287349388511', time=2024-09-12T20:03:16.116568+0000, chain.objs.size()=1 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.065+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.IEm25p5DvpNFlsM-9PDuGjEgg84mZPb_0 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.065+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10259660964866191098', time=2024-09-12T20:03:19.273711+0000, chain.objs.size()=1 2024-09-12T18:36:00.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.065+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.vlIQ2mTnC2mOa1SYZXqfu6RIhYlUIsw_0 2024-09-12T18:36:00.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.069+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17485230454341432283', time=2024-09-12T20:03:25.401839+0000, chain.objs.size()=1 2024-09-12T18:36:00.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.069+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.266__shadow_.mnL_Xba-u7Qf69l6qS0Fv8WKX7cV34c_0 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.371324850963600839', time=2024-09-12T20:03:42.711833+0000, chain.objs.size()=1 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.277__shadow_.jPbgbFpCMCvCKbI0wP2GIZmWDjL5ugB_0 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3463878912315364967', time=2024-09-12T20:03:57.947505+0000, chain.objs.size()=1 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.286__shadow_.q27uHhIG16VByp9gFwsNCssSGMKO4q-_0 2024-09-12T18:36:00.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15098575642634836780', time=2024-09-12T20:04:04.854113+0000, chain.objs.size()=1 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.290__shadow_._vGuhfHhr-QHhUSS3PrcVI-rWEd6fWy_0 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7834726057779827947', time=2024-09-12T20:04:18.139397+0000, chain.objs.size()=1 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.HoPPbERl7pjaMpw_3mbG-XaNLYDPDGH_0 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7867314677806149475', time=2024-09-12T20:04:18.172179+0000, chain.objs.size()=1 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.yQT0bFvy7PnvMFGdJmm7DOC_IFwAMUG_0 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10696926954006141112', time=2024-09-12T20:04:18.237455+0000, chain.objs.size()=1 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.5e3y7MRd2e_9j5A6oKDsamCAuenO4Tp_0 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4976741995590794932', time=2024-09-12T20:04:21.566324+0000, chain.objs.size()=1 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.296__shadow_.3xWR8XYiv4-QymzDjKJqwAF_INlqhD2_0 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3196338959323322245', time=2024-09-12T20:04:26.748870+0000, chain.objs.size()=1 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.299__shadow_.etpBldWOB-MH6UaWrAg6DK1xujiwXmE_0 2024-09-12T18:36:00.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18076872449187868326', time=2024-09-12T20:06:51.515132+0000, chain.objs.size()=1 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.MQTefaC3XheIH4MK7uYYuH2mP8aAaVb_0 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8302450428101606255', time=2024-09-12T20:06:52.584797+0000, chain.objs.size()=1 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.5SKM8PYQuqON6dN7b4S0N7hZnI-3Gmo_0 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3448460198366955405', time=2024-09-12T20:06:52.935497+0000, chain.objs.size()=1 2024-09-12T18:36:00.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.073+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.6ZZBCwUKu3wCco4tunQcl5AitebK9DB_0 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13543289162505403804', time=2024-09-12T20:06:53.349948+0000, chain.objs.size()=1 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.FzoNo26fmZdq38yYZVB1lBFlZIIdslB_0 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12608676740143296214', time=2024-09-12T20:06:53.765335+0000, chain.objs.size()=1 2024-09-12T18:36:00.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.5dDpUYYqOgbRYe7bYWgWmxv2NKZMRSX_0 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.77460629109526800', time=2024-09-12T20:06:53.767081+0000, chain.objs.size()=1 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.HSfNFwVQtk3wxh1Zp6EBR6OlPQ56u5E_0 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17638433712197968241', time=2024-09-12T20:06:55.603630+0000, chain.objs.size()=1 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.cqRtybPRv-CiYC2IyYg06D3Q26FUGcy_0 2024-09-12T18:36:00.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2063387602063371344', time=2024-09-12T20:06:56.116785+0000, chain.objs.size()=1 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7zbrROuSJ_bAVr36qqGtPJQvR9J-DKK_0 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7580839871866274112', time=2024-09-12T20:06:59.168974+0000, chain.objs.size()=1 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ZwzA3BOMfhQaAXlqeo-cr4FuDipg5kJ_0 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2633574411660160450', time=2024-09-12T20:06:59.523984+0000, chain.objs.size()=1 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.0915bdQnSuRDimBlNgqVgIMhN9LG3uK_0 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11375661959314541129', time=2024-09-12T20:07:00.041493+0000, chain.objs.size()=1 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.b3-ko7XuzgV_975HR7IJPJm1QEU4m8k_0 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2690180582264309780', time=2024-09-12T20:07:00.043886+0000, chain.objs.size()=1 2024-09-12T18:36:00.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.d-ZFuzwwvANRFP6HLeTVz2gePaC1GZI_0 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9362748239378869786', time=2024-09-12T20:07:01.275660+0000, chain.objs.size()=1 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.DU-jiJItlripTs4IbvgafArsBkRO1nY_0 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15012070347211863934', time=2024-09-12T20:07:01.594839+0000, chain.objs.size()=1 2024-09-12T18:36:00.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.077+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.PjrCHwvYLvmieneWVGxe1h1LNh-jYhF_0 2024-09-12T18:36:00.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.081+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16450060193676210419', time=2024-09-12T20:07:02.645778+0000, chain.objs.size()=1 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.081+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.wLm0EDgsBQBY6sZyXNpJKYRi4BcwFIu_0 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.081+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5557280955676935440', time=2024-09-12T20:07:06.299746+0000, chain.objs.size()=1 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.081+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.2BUlvbyjiuX-cjeI3-IaArFfTDgquAk_0 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.081+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8657412794502648586', time=2024-09-12T20:07:06.744890+0000, chain.objs.size()=1 2024-09-12T18:36:00.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.081+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.9Vf7pLHKulIlqqsR82BTz5k134WTBoL_0 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18131637269150963341', time=2024-09-12T20:07:07.114318+0000, chain.objs.size()=1 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.nhXt-vKPYGRXDFFKekeqhGWY6Cgd2uM_0 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10285030313291738299', time=2024-09-12T20:07:08.449431+0000, chain.objs.size()=1 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.qKVHMQOrIasOlgO17JyT86wdo82oWlr_0 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6809426662687383425', time=2024-09-12T20:07:09.862527+0000, chain.objs.size()=1 2024-09-12T18:36:00.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.KL-hGV1NUzUbGB9Erm7BPXgZFgjdVgp_0 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1025393567282309478', time=2024-09-12T20:07:11.111959+0000, chain.objs.size()=1 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.zxlRVDzbu9sIoOR1N-ZE83OWqJkQF7H_0 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15194989582458589756', time=2024-09-12T20:07:11.510805+0000, chain.objs.size()=1 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.e9GmssU8lIGjMpbqVPqjcfQ-LcVSePK_0 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5108227613577304205', time=2024-09-12T20:07:14.543961+0000, chain.objs.size()=1 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_._gLkaygaDclhdAEe7lQejG2c_f7RiS3_0 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5447133670997890403', time=2024-09-12T20:07:14.719851+0000, chain.objs.size()=1 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.itaZ5UassLci0flR_b4uhMoly3bZZu8_0 2024-09-12T18:36:00.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3967787604407204691', time=2024-09-12T20:07:15.256380+0000, chain.objs.size()=1 2024-09-12T18:36:00.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.vOMKsN3xIU9-emJqwqFkf6eoHRlvXuU_0 2024-09-12T18:36:00.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2498067498142652102', time=2024-09-12T20:07:16.931733+0000, chain.objs.size()=1 2024-09-12T18:36:00.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.085+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.UtJKvz1-kiDf2tv94NBLBpHDyoCzoUI_0 2024-09-12T18:36:00.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.089+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18259733551597314632', time=2024-09-12T20:07:17.616817+0000, chain.objs.size()=1 2024-09-12T18:36:00.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.089+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.emCYv7t1KA7LCjA0IUjodBeZWq7wDxK_0 2024-09-12T18:36:00.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.089+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11001978134938213926', time=2024-09-12T20:07:18.197063+0000, chain.objs.size()=1 2024-09-12T18:36:00.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.089+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.v3FMjamWz-_O2kU7A3-tMUvGxkOdxO-_0 2024-09-12T18:36:00.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.093+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3756896731225845886', time=2024-09-12T20:07:18.237706+0000, chain.objs.size()=1 2024-09-12T18:36:00.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.093+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.0X36o3iyUAcf3y7iRRuLXjyVO0qYg2Z_0 2024-09-12T18:36:00.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.093+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16725783315257438736', time=2024-09-12T20:07:18.239878+0000, chain.objs.size()=1 2024-09-12T18:36:00.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.093+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.WfOhqxb-ZTG_qW0UlSOTJIE2ua4uom-_0 2024-09-12T18:36:00.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.093+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14141466574613343143', time=2024-09-12T20:07:19.031073+0000, chain.objs.size()=1 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.093+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.xatS3yhxM9PChCMYXqPeEg2xydFeMmr_0 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.093+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14598809481064603405', time=2024-09-12T20:09:01.870557+0000, chain.objs.size()=1 2024-09-12T18:36:00.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.093+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.OvENxi767X_arVy3nbOlEI8G5XlzPpa_0 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17382622049460631075', time=2024-09-12T20:09:02.279950+0000, chain.objs.size()=1 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.RuMcZCzz-mcsuI0iE8KlBzAOIRI88mc_0 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12422001387016525469', time=2024-09-12T20:09:02.592215+0000, chain.objs.size()=1 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.x_lGl7FnqkGzMWxxnkPG_wmGEFwtU1C_0 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12592092534748967268', time=2024-09-12T20:09:02.987814+0000, chain.objs.size()=1 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.yL-DsuRpiiu5YGpRmAsovn3xJcFnCfF_0 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16193916400666295920', time=2024-09-12T20:09:03.513935+0000, chain.objs.size()=1 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FIVWA1OaZ6PieB1vTiUNdJ4gomDQp8S_0 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13951592444399111371', time=2024-09-12T20:09:04.328530+0000, chain.objs.size()=1 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.v4JWrCdxPvKdqeOunnlcYlPZ0SlG1yK_0 2024-09-12T18:36:00.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15470196679008432638', time=2024-09-12T20:09:05.676516+0000, chain.objs.size()=1 2024-09-12T18:36:00.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.bMgGr45UmjgaLMpqBqEZCcHMbDkDAX1_0 2024-09-12T18:36:00.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15598376486337402911', time=2024-09-12T20:09:06.121064+0000, chain.objs.size()=1 2024-09-12T18:36:00.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.nmbIP9M511apsk7nbaR6Z4SHUTjYvht_0 2024-09-12T18:36:00.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.732862788589599853', time=2024-09-12T20:09:07.009628+0000, chain.objs.size()=1 2024-09-12T18:36:00.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.N7uyD5CLbvyT01c24tik17yyqgJ5NQb_0 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3052871027548489340', time=2024-09-12T20:09:08.000213+0000, chain.objs.size()=1 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.g5vzJxG3uBOqGgu_LZZBWqwnXfII_06_0 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10456199489071632892', time=2024-09-12T20:09:08.315178+0000, chain.objs.size()=1 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.jcv04pM1oEBRuLmGhhftYkvZib97ETV_0 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2815355802381798810', time=2024-09-12T20:09:08.321383+0000, chain.objs.size()=1 2024-09-12T18:36:00.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.097+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.YZiwch66mxuKfguoEuRBbLNPhm9qA2a_0 2024-09-12T18:36:00.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.101+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18282924707493236303', time=2024-09-12T20:09:08.409843+0000, chain.objs.size()=1 2024-09-12T18:36:00.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.101+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Ayjvb2y3mVeH1BNVcni0-ouk8qiJP1c_0 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.101+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5582151665234747888', time=2024-09-12T20:09:09.593402+0000, chain.objs.size()=1 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.101+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ryZdcJd4cmwDYRsjtXbBaAB8TJpLJxl_0 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.101+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17681704117590692118', time=2024-09-12T20:09:09.992590+0000, chain.objs.size()=1 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.101+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.omcl4skVApdEiq11ikT9_F9OVHiuxqZ_0 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.101+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18037407661560631022', time=2024-09-12T20:09:10.849939+0000, chain.objs.size()=1 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.101+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.VV88WNm5x1gMOe4nBplDRLHkc5n4a8j_0 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.101+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.461911576225274472', time=2024-09-12T20:09:11.164668+0000, chain.objs.size()=1 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.101+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.oI_AiQohDgH2kra67ZhjQQG-RbGb33x_0 2024-09-12T18:36:00.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.101+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9780921441945155374', time=2024-09-12T20:09:11.698324+0000, chain.objs.size()=1 2024-09-12T18:36:00.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.101+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.I2_UH4Q21gjApy0z9Rnod5RdrLmZ6Qp_0 2024-09-12T18:36:00.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.105+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49609 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=46, truncated=0, next_marker='' 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9465973537387350645', time=2024-09-12T20:09:11.700876+0000, chain.objs.size()=1 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_._8cFCoOp4DkTTWWd8yPb6a7GtWTZpa0_0 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8452997440500158000', time=2024-09-12T20:09:11.965869+0000, chain.objs.size()=1 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.oIKXb39kRXspi-WeoTc4Oe9LzsBSWde_0 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.124566210463989148', time=2024-09-12T20:09:13.299707+0000, chain.objs.size()=1 2024-09-12T18:36:00.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.snp0hABifyFgG0R6LsBgecJUxATb3xo_0 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2654048403952764463', time=2024-09-12T20:09:13.857680+0000, chain.objs.size()=1 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.MjhT3Sh2q6ZjsPLz3b878ZKL2ePOelC_0 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12941504926748928909', time=2024-09-12T20:09:14.440484+0000, chain.objs.size()=1 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.nsI4zOGLv17u3DqmmkFbv5QnqTjzUmX_0 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.828047606528994249', time=2024-09-12T20:09:14.745752+0000, chain.objs.size()=1 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.kZbAJ7ydZAXsRu3AGLfoLE9hResYmPd_0 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9651355921293794667', time=2024-09-12T20:09:14.747745+0000, chain.objs.size()=1 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.I5Bm2vfBcwUCjupdtTl8NvSq7T80qTf_0 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1340471228112518985', time=2024-09-12T20:09:14.921963+0000, chain.objs.size()=1 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.1oodZw2AYeAyGNQljM2oXHDay4u8aqz_0 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2736397933808855927', time=2024-09-12T20:09:14.979485+0000, chain.objs.size()=1 2024-09-12T18:36:00.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.VPp7Cz7Rk5HJaKG8eRI7Wz5hMdX8MJH_0 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8125346020634346872', time=2024-09-12T20:09:15.414900+0000, chain.objs.size()=1 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.AUJYpbuAF_gySxNGulwLwvkBPjqoguz_0 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.929889486893052125', time=2024-09-12T20:09:15.895241+0000, chain.objs.size()=1 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_._Ni7EzdIhFoKQyVptyo0ZyTbZdVGHiz_0 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.384614230165207880', time=2024-09-12T20:09:18.296829+0000, chain.objs.size()=1 2024-09-12T18:36:00.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.109+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.LC6htx67vkKAtwqdECUEKVrqpN5r0ov_0 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.113+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9669952686802793353', time=2024-09-12T20:09:18.298843+0000, chain.objs.size()=1 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.113+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.uwYMcUIwY-BD9mVO1it4X0PM4ZwOq_v_0 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.113+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13798991607664685490', time=2024-09-12T20:09:18.417986+0000, chain.objs.size()=1 2024-09-12T18:36:00.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.113+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.huDAX29vj8-DALlwDuMOWE9MzFO1eH__0 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.113+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5541417689807217189', time=2024-09-12T20:09:22.613307+0000, chain.objs.size()=1 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.113+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5O-PrfEusegpcCkYlX9mannKv-Q5Cpc_0 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.113+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8591012099819325611', time=2024-09-12T20:09:23.409605+0000, chain.objs.size()=1 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.113+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FvamShXtVOiaUq_gboDDFbtk-924aj3_0 2024-09-12T18:36:00.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.117+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.264507145477108606', time=2024-09-12T20:09:24.589813+0000, chain.objs.size()=1 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.117+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Za9COS2SoVnoXdKddX64duGLlOCkfcX_0 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.117+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4245680998536371068', time=2024-09-12T20:09:25.616362+0000, chain.objs.size()=1 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.117+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Z5YAZSMsHt8Whf7Rzc7tdtGNvyXyfEm_0 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.117+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7061757152027673258', time=2024-09-12T20:09:27.091083+0000, chain.objs.size()=1 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.117+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FPzDxsjJPV6zJzgvz0wTEc0Tb-1WvOh_0 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.117+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15932983292948323726', time=2024-09-12T20:09:29.345557+0000, chain.objs.size()=1 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.117+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.4iw2ODnvz8lpDZj3IPlwhj3YfXoMm3N_0 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.117+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13452450086612981788', time=2024-09-12T20:09:29.578233+0000, chain.objs.size()=1 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.117+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Dxe8KMRBxLaEDx3QPkBsrERy7DSOO5D_0 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.117+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11084769461472516074', time=2024-09-12T20:09:36.456564+0000, chain.objs.size()=1 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.117+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.330__shadow_.PKtLFh6y8V7JjOiPBD4nC-odu8yx73w_0 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.117+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5592616022622768540', time=2024-09-12T20:10:06.620010+0000, chain.objs.size()=1 2024-09-12T18:36:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.117+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.354__shadow_.drpwm4p4UALa39R9csqRLYbV5VhdbY3_0 2024-09-12T18:36:00.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.121+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1522901011498464794', time=2024-09-12T20:11:47.952713+0000, chain.objs.size()=1 2024-09-12T18:36:00.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.121+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.431__shadow_.7TCd4vdgwuNzL5Jv6_Ti4o9jkbEX7D7_0 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.125+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16566537837240969528', time=2024-09-12T20:12:28.753964+0000, chain.objs.size()=1 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.458__shadow_.O0A4Tfk6bNl13qbAQQ-GStZfMGHa1Qb_0 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.125+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3768335353734448084', time=2024-09-12T20:12:44.731605+0000, chain.objs.size()=1 2024-09-12T18:36:00.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.466__shadow_.bpAAV4ZpJJQ8sl-keBTaK3ke3HVrDzc_0 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.125+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1234949244941934221', time=2024-09-12T20:13:59.861617+0000, chain.objs.size()=6 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.1 2024-09-12T18:36:00.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.2 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.3 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.4 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.5 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.6 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.125+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6581481350232469558', time=2024-09-12T20:14:06.229198+0000, chain.objs.size()=2 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.513__shadow_.TCTqmXwNJtiXdBHwLvQ0ToXYZrUQ1LN_0 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.513__shadow_.TCTqmXwNJtiXdBHwLvQ0ToXYZrUQ1LN_1 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.125+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1690170790315573951', time=2024-09-12T20:14:08.283943+0000, chain.objs.size()=1 2024-09-12T18:36:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.125+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.515__shadow_.FWt7OsAVDSeWKX92-Kq6-5PVXJ4uEdJ_0 2024-09-12T18:36:00.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8565712092035922133', time=2024-09-12T20:14:22.849663+0000, chain.objs.size()=1 2024-09-12T18:36:00.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.519__multipart_mymultipart.2~-d8fM5Cc_aUhf20hPLXHCyC1JNcMdBE.1 2024-09-12T18:36:00.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15950747635741678322', time=2024-09-12T20:18:08.844035+0000, chain.objs.size()=1 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.551__shadow_.POKfVt7M-AbYpZNt__B0tKEIh4UuPWn_0 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2434984427516860080', time=2024-09-12T20:18:40.347469+0000, chain.objs.size()=2 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.559__shadow_.z9IRiZ3PuvBiGC__IBkFrWftxYuQqRr_0 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.559__shadow_.z9IRiZ3PuvBiGC__IBkFrWftxYuQqRr_1 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5393178145170560668', time=2024-09-12T20:18:56.046429+0000, chain.objs.size()=2 2024-09-12T18:36:00.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.564__shadow_.gCgKJBxhoFH9iy7MaWHUXUOHtdYQRMU_0 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.564__shadow_.gCgKJBxhoFH9iy7MaWHUXUOHtdYQRMU_1 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.226629871789846952', time=2024-09-12T20:19:25.211910+0000, chain.objs.size()=1 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:ly5LKQUy.-87L3KdgQ.dJiVUO0LdtXN_.MRVDMEfAkB6puXsXMI93ujXzUweA4cb_0 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14015854576526185284', time=2024-09-12T20:19:28.359101+0000, chain.objs.size()=1 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.571__shadow:4zO4feHw.qitKq1Z8CbJC.6oO7q15sq_.X4P-2yh39TtXqMOxBTerBrAshYxDTGR_0 2024-09-12T18:36:00.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7515363250922945167', time=2024-09-12T20:19:53.426375+0000, chain.objs.size()=1 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.577__shadow:Ew9iS5zTp.uc5NfNFdpcKOnBmue0Z7t_.3GOKXWoDnTsY-NVM-WgwE-2pgrV3_ig_0 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9165596358978994431', time=2024-09-12T20:20:08.840306+0000, chain.objs.size()=1 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:LsM2G-zPz5t3c6MCjB43GHFI7nIWnC2_.NohWHCvk443hkHHv-WNHyUINOXx_7Lq_0 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10730494391854004546', time=2024-09-12T20:20:16.252355+0000, chain.objs.size()=1 2024-09-12T18:36:00.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.133+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:57mopeKkNxvQgsnE1wKW2sdB5kJkKhh_.tSgZGNk7v6meMtNJUEPY33AzaEYedFd_0 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.141+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.767714990058559097', time=2024-09-12T20:20:25.394470+0000, chain.objs.size()=1 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.141+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:dYVYaA3eKeYkuUzczx7urdzXuiEuX02_.7eW2bkhuirvIwwO6f9pujYn3x5dAnGI_0 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.141+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~HH412vUi6dKwWlTGKbdUBsWQAXxHhGR', time=2024-09-12T20:26:16.114573+0000, chain.objs.size()=12 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.141+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.625__multipart_multipart_enc.2~HH412vUi6dKwWlTGKbdUBsWQAXxHhGR.1 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.141+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.625__shadow_multipart_enc.2~HH412vUi6dKwWlTGKbdUBsWQAXxHhGR.1_1 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.141+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.625__multipart_multipart_enc.2~HH412vUi6dKwWlTGKbdUBsWQAXxHhGR.2 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.141+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.625__shadow_multipart_enc.2~HH412vUi6dKwWlTGKbdUBsWQAXxHhGR.2_1 2024-09-12T18:36:00.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.141+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.625__multipart_multipart_enc.2~HH412vUi6dKwWlTGKbdUBsWQAXxHhGR.3 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.141+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.625__shadow_multipart_enc.2~HH412vUi6dKwWlTGKbdUBsWQAXxHhGR.3_1 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.141+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.625__multipart_multipart_enc.2~HH412vUi6dKwWlTGKbdUBsWQAXxHhGR.4 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.141+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.625__shadow_multipart_enc.2~HH412vUi6dKwWlTGKbdUBsWQAXxHhGR.4_1 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.141+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.625__multipart_multipart_enc.2~HH412vUi6dKwWlTGKbdUBsWQAXxHhGR.5 2024-09-12T18:36:00.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.141+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.625__shadow_multipart_enc.2~HH412vUi6dKwWlTGKbdUBsWQAXxHhGR.5_1 2024-09-12T18:36:00.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.153+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.625__multipart_multipart_enc.2~HH412vUi6dKwWlTGKbdUBsWQAXxHhGR.6 2024-09-12T18:36:00.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.153+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.625__shadow_multipart_enc.2~HH412vUi6dKwWlTGKbdUBsWQAXxHhGR.6_1 2024-09-12T18:36:00.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.153+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16211635388250083156', time=2024-09-12T20:26:44.492384+0000, chain.objs.size()=1 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.153+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.639__shadow_.4_TQNVe_3__E6BAruILRTGzoMJDSEeW_0 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.153+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7336350654010532297', time=2024-09-12T20:27:58.377041+0000, chain.objs.size()=1 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.153+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.667__shadow_.dygu2b99bTyWiZ62JkGeGhp1GWmDqP2_0 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.153+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14610914674828847697', time=2024-09-12T20:28:33.208509+0000, chain.objs.size()=1 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.153+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.695__shadow:v.ItuSY4J6Dne86ZyqgGsB9Jic1QaDf_.8GVGR5hQfrdE3YvNb_xCEIcYGpDxuNe_0 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.153+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9999466492076579125', time=2024-09-12T20:28:37.944451+0000, chain.objs.size()=1 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.153+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.698__shadow:nGSDlebSInED972CaILMu3zXOmsL1Ej_.aO_BDDqnF3xU4DUhDO2ZgFezwB62fry_0 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.153+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12492079504425793182', time=2024-09-12T20:29:01.706554+0000, chain.objs.size()=1 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.153+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.713__shadow:Ps2RIoraZ8pQAJ66p-lOAkAz7WTe8J8_.-VpMb5bipkKxUZU9WfE3odhu9QEcXdQ_0 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.153+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.217931584414483894', time=2024-09-12T20:29:29.711245+0000, chain.objs.size()=1 2024-09-12T18:36:00.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.153+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.719__shadow_.Aj2TZa7PiwU1fTKnwRm_jeY3EuHU8Di_0 2024-09-12T18:36:00.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.161+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:00.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.173+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:36:00.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.173+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:00.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:00.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/60342' 2024-09-12T18:36:00.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1907949869985371244', time=2024-09-12T20:00:15.329185+0000, chain.objs.size()=1 2024-09-12T18:36:00.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.231__shadow_.czXNY3SPTUcmfrVg2KIFXHG7SSr7AUE_0 2024-09-12T18:36:00.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8266232356214442297', time=2024-09-12T20:00:44.858178+0000, chain.objs.size()=1 2024-09-12T18:36:00.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.247__shadow_.8zyF037nag2ExtfXADwWkKQuUI0ayFA_0 2024-09-12T18:36:00.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14519899568324276465', time=2024-09-12T20:00:46.530748+0000, chain.objs.size()=1 2024-09-12T18:36:00.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.248__shadow_.0UaSvSVCrtIAAIF3FefxZHgA1yTrFqp_0 2024-09-12T18:36:00.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8533671492650218481', time=2024-09-12T20:00:54.905673+0000, chain.objs.size()=1 2024-09-12T18:36:00.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.253__shadow_.kXEXugGbwz0kkvA6eQIKu23MHufc5M9_0 2024-09-12T18:36:00.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17728650809681637902', time=2024-09-12T20:01:04.759318+0000, chain.objs.size()=1 2024-09-12T18:36:00.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.259__shadow_.S5x-z-3_nh6-u_9CKaYHYmhClvJ00IZ_0 2024-09-12T18:36:00.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12450293840043848928', time=2024-09-12T20:02:51.988949+0000, chain.objs.size()=1 2024-09-12T18:36:00.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.RrQV0wDXnGAFt42XXxvFLI9pWaN8TLY_0 2024-09-12T18:36:00.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10197243874933433401', time=2024-09-12T20:02:52.516943+0000, chain.objs.size()=1 2024-09-12T18:36:00.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.W8QIe2o7QSnliBAVufZ79foCRsPz1wy_0 2024-09-12T18:36:00.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14687674344757961708', time=2024-09-12T20:02:52.781817+0000, chain.objs.size()=1 2024-09-12T18:36:00.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.4mj6lpETRyTDAB5e_4EpZq3M7dgC15H_0 2024-09-12T18:36:00.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13948759698026395541', time=2024-09-12T20:02:55.946824+0000, chain.objs.size()=1 2024-09-12T18:36:00.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.H9cSOVYlr5aIIiSq9HGo10fo2FOQlxp_0 2024-09-12T18:36:00.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8138084858029787409', time=2024-09-12T20:02:56.867186+0000, chain.objs.size()=1 2024-09-12T18:36:00.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.f6gjO7NleQAQKxZY66qdUnsXaJ-3X9C_0 2024-09-12T18:36:00.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11370176341207052749', time=2024-09-12T20:02:57.470012+0000, chain.objs.size()=1 2024-09-12T18:36:00.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.4SLGNYm7OsNJCuk8UwHIoaSe2Vkopv8_0 2024-09-12T18:36:00.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2239355197953277964', time=2024-09-12T20:02:58.382675+0000, chain.objs.size()=1 2024-09-12T18:36:00.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.177+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.IJrxlyOYgSGwtakuUY4Ahvlnmm4wro5_0 2024-09-12T18:36:00.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.181+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11249655166891587397', time=2024-09-12T20:03:00.238750+0000, chain.objs.size()=1 2024-09-12T18:36:00.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.181+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.R28NgDRKk-6C-U2X8JEkws54T7O6JSN_0 2024-09-12T18:36:00.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.181+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13415750353996681301', time=2024-09-12T20:03:01.000684+0000, chain.objs.size()=1 2024-09-12T18:36:00.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.181+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.bSEHLsUuRoaEEpoQpkKy7q91euY_B8w_0 2024-09-12T18:36:00.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.181+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.283373576913008214', time=2024-09-12T20:03:01.479326+0000, chain.objs.size()=1 2024-09-12T18:36:00.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.181+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.nprqMnMFGPYo0mM9qdV53dFp2YEiRgK_0 2024-09-12T18:36:00.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.181+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17512796824580560112', time=2024-09-12T20:03:02.333836+0000, chain.objs.size()=1 2024-09-12T18:36:00.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.181+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._l7gWpXobyw9IMjgh61AWKCWU9CrMlq_0 2024-09-12T18:36:00.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.181+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14151925975570318271', time=2024-09-12T20:03:04.028370+0000, chain.objs.size()=1 2024-09-12T18:36:00.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.181+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.O0jvHjatAPrZ1tY0mfXMDrydMdu1i4o_0 2024-09-12T18:36:00.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.181+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12799488454022855033', time=2024-09-12T20:03:04.259725+0000, chain.objs.size()=1 2024-09-12T18:36:00.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.181+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.CXzsUeZQYwLsf_hZuneJ8MHZfYVZ5NW_0 2024-09-12T18:36:00.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.181+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.777632306066168441', time=2024-09-12T20:03:04.800364+0000, chain.objs.size()=1 2024-09-12T18:36:00.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.181+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.HFSnhersdUHTkrcJFlNMA58aSqlaVs0_0 2024-09-12T18:36:00.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.181+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16997175338597283680', time=2024-09-12T20:03:05.579689+0000, chain.objs.size()=1 2024-09-12T18:36:00.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.181+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2j6EYqaygyhyFjE_RW-sYRPI7TSgx6o_0 2024-09-12T18:36:00.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.185+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.602708015288906864', time=2024-09-12T20:03:05.797187+0000, chain.objs.size()=1 2024-09-12T18:36:00.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.185+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.J97EqIZ0F7qkF1sANiybPNdLgy7KaTS_0 2024-09-12T18:36:00.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.185+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6076735105046420333', time=2024-09-12T20:03:07.278130+0000, chain.objs.size()=1 2024-09-12T18:36:00.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.185+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.4UQSOxJl-IiH3qMK86QsL_ivgs29ewH_0 2024-09-12T18:36:00.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.185+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2138177580281875207', time=2024-09-12T20:03:07.550680+0000, chain.objs.size()=1 2024-09-12T18:36:00.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.185+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.EIkkNy7lGShFdw56gf3ZWr0631PxAMN_0 2024-09-12T18:36:00.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.189+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10253463319360971973', time=2024-09-12T20:03:07.762274+0000, chain.objs.size()=1 2024-09-12T18:36:00.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.189+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.PPisMx_yyQrfjU_7llw97-7ASVv_daw_0 2024-09-12T18:36:00.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.189+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2181177823675110325', time=2024-09-12T20:03:07.838482+0000, chain.objs.size()=1 2024-09-12T18:36:00.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.189+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ViTjtpJwYzxYzH2Zfm1mLz37Yi5vaj7_0 2024-09-12T18:36:00.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.189+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5589338189601131224', time=2024-09-12T20:03:08.012852+0000, chain.objs.size()=1 2024-09-12T18:36:00.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.189+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.g_UrVwtv81dmOezXj4gtEsgDhyGIMoz_0 2024-09-12T18:36:00.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.189+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11544222909894114654', time=2024-09-12T20:03:08.741388+0000, chain.objs.size()=1 2024-09-12T18:36:00.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.189+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2msRXpVywRNENQ7Q7IyOuY0wIa3df22_0 2024-09-12T18:36:00.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.189+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3165544455665557685', time=2024-09-12T20:03:09.636775+0000, chain.objs.size()=1 2024-09-12T18:36:00.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.189+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.8rEasknkWLuEoi7sZTgyp0uXuR4hEf-_0 2024-09-12T18:36:00.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.189+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15425069138846324896', time=2024-09-12T20:03:10.108439+0000, chain.objs.size()=1 2024-09-12T18:36:00.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.189+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.oUwD7RBA_hF-Yl72bbYyXhj9HRKSgia_0 2024-09-12T18:36:00.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.189+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16482495127832613002', time=2024-09-12T20:03:10.996643+0000, chain.objs.size()=1 2024-09-12T18:36:00.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.189+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.1P0BczxxdA8HjbzfuPouWGoNl41QuGr_0 2024-09-12T18:36:00.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.189+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15847286780556008346', time=2024-09-12T20:03:11.567426+0000, chain.objs.size()=1 2024-09-12T18:36:00.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.189+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QhZSIGztVkapzEvyxSxI393i_z9j27d_0 2024-09-12T18:36:00.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.193+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17039024730055170709', time=2024-09-12T20:03:12.554910+0000, chain.objs.size()=1 2024-09-12T18:36:00.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.193+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.6t4qTTc59lckrhNQqhYvu7VFmXc06eM_0 2024-09-12T18:36:00.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.193+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7978411146947968665', time=2024-09-12T20:03:12.557461+0000, chain.objs.size()=1 2024-09-12T18:36:00.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.193+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.44avkUqluFTRook_LhNMhdec2Ggzyf__0 2024-09-12T18:36:00.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.193+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16260554989007317682', time=2024-09-12T20:03:12.631945+0000, chain.objs.size()=1 2024-09-12T18:36:00.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.193+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XBUNCKv02wFhbf_thMZnoPti_57H7b2_0 2024-09-12T18:36:00.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.193+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7906607321797074299', time=2024-09-12T20:03:12.952133+0000, chain.objs.size()=1 2024-09-12T18:36:00.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.193+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.c9F7f05uXj0fPOJxYf-JJn-PWALRtXE_0 2024-09-12T18:36:00.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.193+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5223166689032429246', time=2024-09-12T20:03:13.461017+0000, chain.objs.size()=1 2024-09-12T18:36:00.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.193+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.9cVgG6ICCHU0_2f-JLT6ntreewYCHEw_0 2024-09-12T18:36:00.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.193+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16620481143790738499', time=2024-09-12T20:03:15.793488+0000, chain.objs.size()=1 2024-09-12T18:36:00.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.193+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-Dg5DWxQlZ-6Ud52GxKJl6TszhA2KMn_0 2024-09-12T18:36:00.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5543920739025368935', time=2024-09-12T20:03:16.658262+0000, chain.objs.size()=1 2024-09-12T18:36:00.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.pzxRQS7VZv76EVnzwVPcfDIGt9sOT7p_0 2024-09-12T18:36:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17477563486878669269', time=2024-09-12T20:03:16.711795+0000, chain.objs.size()=1 2024-09-12T18:36:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2D9rIzb-fTt68zAwTlNEzBU2u5T2yRW_0 2024-09-12T18:36:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.632832196007737939', time=2024-09-12T20:03:18.222486+0000, chain.objs.size()=1 2024-09-12T18:36:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.NhkxEtkh9QoWLYL2R74F1AsiroISLCa_0 2024-09-12T18:36:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14076440290957526463', time=2024-09-12T20:03:20.634754+0000, chain.objs.size()=1 2024-09-12T18:36:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.lcXDfbk-ByuHqBFylgJpA-_EPkZtiLc_0 2024-09-12T18:36:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11297943050325532019', time=2024-09-12T20:03:31.656202+0000, chain.objs.size()=1 2024-09-12T18:36:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.270__shadow_.4U9J-Zz7gPn_RFPd0MsSMytfEyydC4U_0 2024-09-12T18:36:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11517734741649993118', time=2024-09-12T20:03:49.357404+0000, chain.objs.size()=1 2024-09-12T18:36:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.281__shadow_.L5YnCmfqVevO79MCBnTrWxNgJhQHMpa_0 2024-09-12T18:36:00.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6959164997282799901', time=2024-09-12T20:04:12.984322+0000, chain.objs.size()=1 2024-09-12T18:36:00.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.gaWmUy3HrMYJNgrK1f8n1XfEvOEbsQW_0 2024-09-12T18:36:00.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14370814411024193528', time=2024-09-12T20:04:26.731526+0000, chain.objs.size()=1 2024-09-12T18:36:00.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.299__shadow_.EvD4pN8WcmK1ClLhrELoog6LpgeR60n_0 2024-09-12T18:36:00.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4527669295922063548', time=2024-09-12T20:06:51.365864+0000, chain.objs.size()=1 2024-09-12T18:36:00.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.hgldkKveVBWCS3HIeprJkNXVqkbIWFy_0 2024-09-12T18:36:00.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16660971627026889440', time=2024-09-12T20:06:51.868694+0000, chain.objs.size()=1 2024-09-12T18:36:00.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.mTD5fhP6tf_-hwchN7e2gWzlY0nDNDm_0 2024-09-12T18:36:00.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6539882544159958546', time=2024-09-12T20:06:52.112018+0000, chain.objs.size()=1 2024-09-12T18:36:00.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.197+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.j0ibBtJq5q5ELAskC8Kt4jN4oV2VmZd_0 2024-09-12T18:36:00.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5454393513177256418', time=2024-09-12T20:06:52.179129+0000, chain.objs.size()=1 2024-09-12T18:36:00.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.4q5FGicN8xNB0AS_gy5LyWGSBCaExM7_0 2024-09-12T18:36:00.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8366490349766806446', time=2024-09-12T20:06:52.305064+0000, chain.objs.size()=1 2024-09-12T18:36:00.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7htMJVnp0QKOrcRX6dNdb7VcMVK_2X0_0 2024-09-12T18:36:00.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15199280651291512403', time=2024-09-12T20:06:53.324195+0000, chain.objs.size()=1 2024-09-12T18:36:00.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.qLyMYANCQQd9G-pfXMlEZ5T0Il6l-9x_0 2024-09-12T18:36:00.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6055584044515959962', time=2024-09-12T20:06:55.309898+0000, chain.objs.size()=1 2024-09-12T18:36:00.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.IuTLahKZvaD4oRn_IFJ1_G4UiIusO4o_0 2024-09-12T18:36:00.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7776319442123286658', time=2024-09-12T20:06:56.718994+0000, chain.objs.size()=1 2024-09-12T18:36:00.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.DpJODREVCLwuzVLQmlkAXJu0-r8EwTy_0 2024-09-12T18:36:00.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7830877590937785859', time=2024-09-12T20:06:57.323324+0000, chain.objs.size()=1 2024-09-12T18:36:00.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ePHGOJxsMIZH67OyniEGLM8b6rls6ST_0 2024-09-12T18:36:00.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10328110772269394326', time=2024-09-12T20:06:57.517720+0000, chain.objs.size()=1 2024-09-12T18:36:00.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.QbWT1pQT1luZoskKcYbg3MllODE5LdL_0 2024-09-12T18:36:00.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17946342243415446906', time=2024-09-12T20:06:59.603130+0000, chain.objs.size()=1 2024-09-12T18:36:00.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.qR41xD-9yL3kQO71r24VyLDjCkgre8a_0 2024-09-12T18:36:00.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15901681633436044621', time=2024-09-12T20:06:59.822142+0000, chain.objs.size()=1 2024-09-12T18:36:00.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Wec6Z-lz2Ps4uFFyF_R5EMKU1NyOg2d_0 2024-09-12T18:36:00.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13237233791033953695', time=2024-09-12T20:07:00.123465+0000, chain.objs.size()=1 2024-09-12T18:36:00.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.pIEON7JNc6BGetpck6d99g50QkFhhS__0 2024-09-12T18:36:00.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17609235321071976337', time=2024-09-12T20:07:00.489458+0000, chain.objs.size()=1 2024-09-12T18:36:00.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.lcX0DDH-S9kTsxClUDFrz3UtR3F9131_0 2024-09-12T18:36:00.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1178200690762750085', time=2024-09-12T20:07:00.698882+0000, chain.objs.size()=1 2024-09-12T18:36:00.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.205+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.wSSrU6FWVzR0FP6AR95vPrHZZBDs8yc_0 2024-09-12T18:36:00.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16284258899291434869', time=2024-09-12T20:07:01.559467+0000, chain.objs.size()=1 2024-09-12T18:36:00.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.WI5v_TmTseTNK6FshRybnr63Tba_i91_0 2024-09-12T18:36:00.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8341828942045644737', time=2024-09-12T20:07:02.986429+0000, chain.objs.size()=1 2024-09-12T18:36:00.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.8vNWXPaF0XlGil7PFS7K1PFrhlr2Khn_0 2024-09-12T18:36:00.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17422195399678285694', time=2024-09-12T20:07:03.447284+0000, chain.objs.size()=1 2024-09-12T18:36:00.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.QXkspnvRaBQr5Fsym8RXkoiSUMWC5jr_0 2024-09-12T18:36:00.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13122131868471960405', time=2024-09-12T20:07:03.516418+0000, chain.objs.size()=1 2024-09-12T18:36:00.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ZDNVz_6HirlxgqUqLk6wJoIz3Ko26Na_0 2024-09-12T18:36:00.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8758003996372800668', time=2024-09-12T20:07:06.636650+0000, chain.objs.size()=1 2024-09-12T18:36:00.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.9eDwHUPQOLSYc7Nj0kINpvTHXerGibC_0 2024-09-12T18:36:00.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10357758517127691021', time=2024-09-12T20:07:07.093363+0000, chain.objs.size()=1 2024-09-12T18:36:00.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.o59ovzk-MkBm6oESlNAGH70-2VHmKi7_0 2024-09-12T18:36:00.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17443336062011552639', time=2024-09-12T20:07:08.009594+0000, chain.objs.size()=1 2024-09-12T18:36:00.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Wa66qsSzMkhUrbnh3u0n1yaj4PdGk_K_0 2024-09-12T18:36:00.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5542080831504635842', time=2024-09-12T20:07:08.166712+0000, chain.objs.size()=1 2024-09-12T18:36:00.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.LeTIRjVwues0-XsYNKC7u5EWEmqpDlQ_0 2024-09-12T18:36:00.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5948941134828856470', time=2024-09-12T20:07:08.169092+0000, chain.objs.size()=1 2024-09-12T18:36:00.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.e7HrBGlpnKmcyt4ZdUwGVocEeNJ9e_S_0 2024-09-12T18:36:00.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3017446751286321361', time=2024-09-12T20:07:08.455487+0000, chain.objs.size()=1 2024-09-12T18:36:00.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.fQ6qHuUxQGxNkd4l_9k5tUDTYYjIk6j_0 2024-09-12T18:36:00.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12833575793140438373', time=2024-09-12T20:07:08.866742+0000, chain.objs.size()=1 2024-09-12T18:36:00.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.209+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.1DjxGnbMZQQOWcGAlbris0H9hBRtqOL_0 2024-09-12T18:36:00.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.213+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17433704226124196915', time=2024-09-12T20:07:10.224552+0000, chain.objs.size()=1 2024-09-12T18:36:00.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.213+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.q8QeycV6gCwuhmSxOovuY9BUoR7x4Rx_0 2024-09-12T18:36:00.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.213+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15743884807685259177', time=2024-09-12T20:07:13.354761+0000, chain.objs.size()=1 2024-09-12T18:36:00.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.213+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.6LaD_Xr8kZmSmd0IL69IIFNriKrGDg-_0 2024-09-12T18:36:00.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.213+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14844521539365861969', time=2024-09-12T20:07:13.827202+0000, chain.objs.size()=1 2024-09-12T18:36:00.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.213+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.4MNzLNUESaBBu3ks6qctpTxUGR2Y6HA_0 2024-09-12T18:36:00.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.213+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17186580538465064307', time=2024-09-12T20:07:17.487829+0000, chain.objs.size()=1 2024-09-12T18:36:00.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.213+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.N46mIBCGljmDAmCCN8Fel-6TZ8Xk9zv_0 2024-09-12T18:36:00.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.213+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17911139131782448844', time=2024-09-12T20:07:18.828581+0000, chain.objs.size()=1 2024-09-12T18:36:00.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.213+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.GLLAV_I-Fepqpmazdeh5QqI63lIRKxn_0 2024-09-12T18:36:00.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.213+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2492755436726774276', time=2024-09-12T20:07:19.103775+0000, chain.objs.size()=1 2024-09-12T18:36:00.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.213+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.fcW4rtFTOPkrhr2FnCCKEwxPMxDqIyb_0 2024-09-12T18:36:00.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13388753625432765764', time=2024-09-12T20:09:01.925555+0000, chain.objs.size()=1 2024-09-12T18:36:00.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.TJTRFYTT_RYghYPe_l4PXNTqcEU1KTA_0 2024-09-12T18:36:00.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2818150123528909111', time=2024-09-12T20:09:03.863087+0000, chain.objs.size()=1 2024-09-12T18:36:00.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.OjmHwXmmDzrMcz7Ik1037u_NGT9FlqH_0 2024-09-12T18:36:00.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7581480887866542312', time=2024-09-12T20:09:06.421671+0000, chain.objs.size()=1 2024-09-12T18:36:00.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.dFLNxgWhJndC1f2bYZLNWfiJCOuj4Iu_0 2024-09-12T18:36:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11206632525068627489', time=2024-09-12T20:09:11.762338+0000, chain.objs.size()=1 2024-09-12T18:36:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.LBI0PJrWNjLC89ssCwaJ_yvN-1u1gP6_0 2024-09-12T18:36:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8420450868532689406', time=2024-09-12T20:09:11.975761+0000, chain.objs.size()=1 2024-09-12T18:36:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.E_m2yxKNw-Fj4kT1PMYsR5c85QlTTLp_0 2024-09-12T18:36:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.475992240623847935', time=2024-09-12T20:09:13.712838+0000, chain.objs.size()=1 2024-09-12T18:36:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.XpfTGk7jrtQakSgwBCx-9xp-3JGgUdC_0 2024-09-12T18:36:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2957090454328390978', time=2024-09-12T20:09:14.632942+0000, chain.objs.size()=1 2024-09-12T18:36:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.507SBJdtZCdbocctcZv78Ce08p-WOGE_0 2024-09-12T18:36:00.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18364291895479559294', time=2024-09-12T20:09:15.166029+0000, chain.objs.size()=1 2024-09-12T18:36:00.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.jA4ENQecV7Xcg2aBLM6W4gfoZsFU2CH_0 2024-09-12T18:36:00.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15025371406668451648', time=2024-09-12T20:09:16.071712+0000, chain.objs.size()=1 2024-09-12T18:36:00.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2heDDxbNiqE-oU-HetM_AGBEsdSmRGB_0 2024-09-12T18:36:00.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4886048496606581333', time=2024-09-12T20:09:17.043811+0000, chain.objs.size()=1 2024-09-12T18:36:00.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.W6u9xE0dGrFbWqEz1nntADGT7MZ2HSk_0 2024-09-12T18:36:00.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5127489994704243400', time=2024-09-12T20:09:19.809733+0000, chain.objs.size()=1 2024-09-12T18:36:00.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.217+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Z76fQMVtJ5HKhrr4ZJp1tcykQLj1KdH_0 2024-09-12T18:36:00.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.221+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13041804779380122934', time=2024-09-12T20:09:20.651908+0000, chain.objs.size()=1 2024-09-12T18:36:00.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.221+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.zSV6CGYRG2PYljzpZF_3b6MLbJHWNJR_0 2024-09-12T18:36:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.221+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18369757348557794004', time=2024-09-12T20:09:20.989377+0000, chain.objs.size()=1 2024-09-12T18:36:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.221+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.lmz2KHEdSARbYshpi8WCAl20XyyPosR_0 2024-09-12T18:36:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.221+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14380008644301723277', time=2024-09-12T20:09:23.474039+0000, chain.objs.size()=1 2024-09-12T18:36:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.221+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.9aCkP3pNxPLEnJpf8GBOFe37Ltw28jW_0 2024-09-12T18:36:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.221+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11062978991272143153', time=2024-09-12T20:09:25.889730+0000, chain.objs.size()=1 2024-09-12T18:36:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.221+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.NNYjonC5qh9GYezrebWQi6W8g_sIjmE_0 2024-09-12T18:36:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.221+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.48199719950347160', time=2024-09-12T20:09:26.855408+0000, chain.objs.size()=1 2024-09-12T18:36:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.221+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.plHg1U0IzKlFxXSLNLcVcKekQpQfRFm_0 2024-09-12T18:36:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.221+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11651713502435064448', time=2024-09-12T20:09:27.278295+0000, chain.objs.size()=1 2024-09-12T18:36:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.221+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ncamxZD16BX4gKpmn6fqOY638Q2rvBI_0 2024-09-12T18:36:00.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.221+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12371334100998011482', time=2024-09-12T20:09:28.503789+0000, chain.objs.size()=1 2024-09-12T18:36:00.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.221+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.t6VAWE3xZUrb4Jf3KkVv9cggTreLDoW_0 2024-09-12T18:36:00.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.221+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10283739135086789378', time=2024-09-12T20:09:28.964422+0000, chain.objs.size()=1 2024-09-12T18:36:00.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.221+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.97smBAO8N3I418ZrxGF1zQclehgGg_H_0 2024-09-12T18:36:00.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.225+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15276021352349125065', time=2024-09-12T20:09:29.222178+0000, chain.objs.size()=1 2024-09-12T18:36:00.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.225+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.SIu2ZSluKRYKh2QaRQh--UFtHUZuPOJ_0 2024-09-12T18:36:00.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.225+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4713794425072768446', time=2024-09-12T20:09:30.210174+0000, chain.objs.size()=1 2024-09-12T18:36:00.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.225+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.02QpXfWfxeBAtFrDPh-Unxy-j2-J4n8_0 2024-09-12T18:36:00.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.225+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16514633633911469377', time=2024-09-12T20:09:38.124463+0000, chain.objs.size()=1 2024-09-12T18:36:00.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.225+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.331__shadow_.1JejCWu-vY_jIKg9cK1STfRSpp4erqP_0 2024-09-12T18:36:00.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.225+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11657215179550940362', time=2024-09-12T20:09:56.382116+0000, chain.objs.size()=1 2024-09-12T18:36:00.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.225+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.345__shadow_.N81X8eKMfTfhaOi2-c4Nh-g7glkCoyI_0 2024-09-12T18:36:00.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.229+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/60342 2024-09-12T18:36:00.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.229+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T18:36:00.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.229+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1131478247111624726', time=2024-09-12T20:10:54.932138+0000, chain.objs.size()=1 2024-09-12T18:36:00.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.229+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.391__shadow_.HGtf5z0g69ZiO237GmWzYcglsvV6Wug_0 2024-09-12T18:36:00.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15870282984213306224', time=2024-09-12T20:11:58.138793+0000, chain.objs.size()=1 2024-09-12T18:36:00.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.438__shadow_.REXN_OMav4jle62biMe5I7V5zldYE76_0 2024-09-12T18:36:00.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13485213276951161298', time=2024-09-12T20:12:03.822024+0000, chain.objs.size()=1 2024-09-12T18:36:00.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.442__shadow_.4TgoLIW6O1wruxNYoVf8TIFmWyausSL_0 2024-09-12T18:36:00.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14404255623090430528', time=2024-09-12T20:12:22.758508+0000, chain.objs.size()=1 2024-09-12T18:36:00.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.455__shadow_.KR4TD7_0c4LTJtzsbtXEXFhse9zrlin_0 2024-09-12T18:36:00.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15653728439366899903', time=2024-09-12T20:12:34.808660+0000, chain.objs.size()=1 2024-09-12T18:36:00.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.461__shadow_.d2xz-5M0XYr9kGde_s427J40IlkjjvG_0 2024-09-12T18:36:00.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11813892019390405492', time=2024-09-12T20:12:47.764605+0000, chain.objs.size()=1 2024-09-12T18:36:00.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.467__shadow_.7HtylpXtfVzFTJ4UtoUPQZJtPCn74rS_0 2024-09-12T18:36:00.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.847160203794337600', time=2024-09-12T20:13:07.262762+0000, chain.objs.size()=1 2024-09-12T18:36:00.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.484__shadow_.OgzsBO248zRunsKc-jGRLr66Zpd7-Eh_0 2024-09-12T18:36:00.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5587893961186397446', time=2024-09-12T20:14:59.483845+0000, chain.objs.size()=1 2024-09-12T18:36:00.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.521__shadow:6Rs4v1h5oCi0MDa4K5mG6etvce7arIX_.u1xkDxqFez9k_pWq84NcUQHLjueKbwR_0 2024-09-12T18:36:00.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~G7lm1_WeWXtn_-qX_81PHEj5mbNorpX', time=2024-09-12T20:17:19.501700+0000, chain.objs.size()=1 2024-09-12T18:36:00.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.536__multipart_mymultipart.2~G7lm1_WeWXtn_-qX_81PHEj5mbNorpX.3 2024-09-12T18:36:00.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10470256258232682630', time=2024-09-12T20:18:21.440816+0000, chain.objs.size()=1 2024-09-12T18:36:00.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.555__shadow_.FyjnzDF74L33g-xCDkDV8lPvPQ8CilX_0 2024-09-12T18:36:00.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1308991549402671186', time=2024-09-12T20:19:16.974174+0000, chain.objs.size()=1 2024-09-12T18:36:00.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:3R6surzZBDaKcAXJ2I6NAtYbCXhgxH2_.UcxWVwA22kD9WYzYJrOVU5nyeh0VoSE_0 2024-09-12T18:36:00.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10357847060718868664', time=2024-09-12T20:19:28.907462+0000, chain.objs.size()=1 2024-09-12T18:36:00.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.233+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.571__shadow:7J.FHVYYZgx6xVnL9AwaQxe8yuwcEwR_.AuQ0g-Eijda2uVnsXSPuk6R3zj3g2E2_0 2024-09-12T18:36:00.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15862486500998205974', time=2024-09-12T20:19:43.389531+0000, chain.objs.size()=1 2024-09-12T18:36:00.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.575__shadow:bK3.CSZvJTXnTK0om2CahiGwcUza7f-_.tYTrruaAf7gTiM8LC7Um94ffQodtZPq_0 2024-09-12T18:36:00.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14703064078187758035', time=2024-09-12T20:20:07.052756+0000, chain.objs.size()=1 2024-09-12T18:36:00.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:CSY6VK6KcHjw6FVv11aU7LEwdK.jVbj_.9K6hldUjwBClEh-BL2k7JaJGwXDovqU_0 2024-09-12T18:36:00.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17076761346757761769', time=2024-09-12T20:20:10.188513+0000, chain.objs.size()=1 2024-09-12T18:36:00.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:q4vWsOett8YADnn4FriipuqYNj2mxp2_.CZQZzVSDoTj6J7pMFYFfeKOyJQfSK77_0 2024-09-12T18:36:00.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16184034428221158856', time=2024-09-12T20:20:13.769310+0000, chain.objs.size()=1 2024-09-12T18:36:00.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:Dzd2U97skSDdza5Qslz79-TKO-0rVaA_.NxmmGfUfJfUz7aeGmkPByupU7jY_KYL_0 2024-09-12T18:36:00.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7122370756047397548', time=2024-09-12T20:20:30.714408+0000, chain.objs.size()=1 2024-09-12T18:36:00.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:UHLyGlvWvT5BHbIUf9vR9rWi8JY8WRh_.RyWua3tDw7IoMt59SLZl691IhreICC0_0 2024-09-12T18:36:00.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15825384996817137817', time=2024-09-12T20:21:11.747689+0000, chain.objs.size()=1 2024-09-12T18:36:00.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.581__shadow:hLCzKGGx8ZW.JyQVwyUyeA5mPAp2.2e_.k1GlvoeOKVIPT3Gg_OCwHp3-txOgAl4_0 2024-09-12T18:36:00.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13363217650299569840', time=2024-09-12T20:21:23.933859+0000, chain.objs.size()=1 2024-09-12T18:36:00.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.587__shadow:suTHSR3zrNr89srdXPlzqxXPi6iJQIK_.jfhQ6zRQYWv32LgFJRpLi9A7avld5j2_0 2024-09-12T18:36:00.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2935406130780408941', time=2024-09-12T20:23:29.050255+0000, chain.objs.size()=1 2024-09-12T18:36:00.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.617__shadow_.Li4Q_1xlXmslTRdO0G042Z7m_D2CZhT_0 2024-09-12T18:36:00.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12007394392422724655', time=2024-09-12T20:26:36.497542+0000, chain.objs.size()=1 2024-09-12T18:36:00.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.634__shadow_.RzkMJhmQfPlNhgZRw0MrK0cWVLT3cYL_0 2024-09-12T18:36:00.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15336233186951565332', time=2024-09-12T20:28:30.476967+0000, chain.objs.size()=1 2024-09-12T18:36:00.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.693__shadow:9mQbfq.4eGRQlOZcPqQFRLMSel4Bz.-_.Hx6VcIfzrg5FniQeQyf6EfadlCj9UNf_0 2024-09-12T18:36:00.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8157623171489949380', time=2024-09-12T20:28:42.712332+0000, chain.objs.size()=1 2024-09-12T18:36:00.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.237+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.701__shadow:4sZB4YTkmjj5oaVWtI0HxB45tB84jWn_.mGS-wRVXSpfIHv3F1ss2v0PZ9WDkmVF_0 2024-09-12T18:36:00.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.245+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:00.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.253+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:36:00.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:00.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:00.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47317' 2024-09-12T18:36:00.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6216522549612145263', time=2024-09-12T19:56:04.597751+0000, chain.objs.size()=3 2024-09-12T18:36:00.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.W8ZpVi7HeWghVgoTC3_Rg_4lagcFZjp_0 2024-09-12T18:36:00.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.W8ZpVi7HeWghVgoTC3_Rg_4lagcFZjp_1 2024-09-12T18:36:00.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.W8ZpVi7HeWghVgoTC3_Rg_4lagcFZjp_2 2024-09-12T18:36:00.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_9BtQrJYr5Vp9RsW_vxv6VQjhKTDu8MJ', time=2024-09-12T19:56:09.115523+0000, chain.objs.size()=3 2024-09-12T18:36:00.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.UK-r5-Z_UEQglKXi-XQ-rs6Bl3YWX8w_0 2024-09-12T18:36:00.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.UK-r5-Z_UEQglKXi-XQ-rs6Bl3YWX8w_1 2024-09-12T18:36:00.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.UK-r5-Z_UEQglKXi-XQ-rs6Bl3YWX8w_2 2024-09-12T18:36:00.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18252579093707695492', time=2024-09-12T19:56:53.487437+0000, chain.objs.size()=1 2024-09-12T18:36:00.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.180__shadow_.zX1ZBabR6js5dFXejWgYkTVr_ABa6LH_0 2024-09-12T18:36:00.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18023545507480650762', time=2024-09-12T19:57:25.447663+0000, chain.objs.size()=1 2024-09-12T18:36:00.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.198__shadow_.jhM9CeimhhyKxcKMNUUf225nocUFNdL_0 2024-09-12T18:36:00.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4473590862201290458', time=2024-09-12T20:00:25.500862+0000, chain.objs.size()=1 2024-09-12T18:36:00.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.237__shadow_.kZuTVi1avRkzJcSrF08lunULC9q8YWQ_0 2024-09-12T18:36:00.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3856976885970679393', time=2024-09-12T20:00:41.457968+0000, chain.objs.size()=1 2024-09-12T18:36:00.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.245__shadow_.cyzgLVB9Mi0oXEjUnZIIbviJjV4NnDZ_0 2024-09-12T18:36:00.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.846300991010542335', time=2024-09-12T20:00:46.498530+0000, chain.objs.size()=1 2024-09-12T18:36:00.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.248__shadow_.iDB5SqLeStLjNLjAHpqFM3CnyJFXuXs_0 2024-09-12T18:36:00.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9856134370377911199', time=2024-09-12T20:00:58.276608+0000, chain.objs.size()=1 2024-09-12T18:36:00.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.257+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.255__shadow_.aYd7jbEQt156HDauwi7ObTsI0SVO4UF_0 2024-09-12T18:36:00.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8021314606790787979', time=2024-09-12T20:02:52.064088+0000, chain.objs.size()=1 2024-09-12T18:36:00.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.261+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.my281zRxR02LkT7xdTOtRc5iedHJ57s_0 2024-09-12T18:36:00.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4556810144773417317', time=2024-09-12T20:02:53.363723+0000, chain.objs.size()=1 2024-09-12T18:36:00.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.261+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.CU7nh5ynX8V_K5Cb67RW0rBvmD1jbeu_0 2024-09-12T18:36:00.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4793764618916804588', time=2024-09-12T20:02:53.375144+0000, chain.objs.size()=1 2024-09-12T18:36:00.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.261+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.1lI5lY-rdIzwKI8x-H5Vqan791p2vZe_0 2024-09-12T18:36:00.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.261+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2063903105252146700', time=2024-09-12T20:02:54.881864+0000, chain.objs.size()=1 2024-09-12T18:36:00.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.261+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.8yc_MWDfbP1-cJx21rvikL2fjw93hKr_0 2024-09-12T18:36:00.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3149055706666364589', time=2024-09-12T20:02:57.069978+0000, chain.objs.size()=1 2024-09-12T18:36:00.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.b6bu90t6AIOZMTX3d1Ck4L69p_Jw9_O_0 2024-09-12T18:36:00.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11914769886801061250', time=2024-09-12T20:02:57.071938+0000, chain.objs.size()=1 2024-09-12T18:36:00.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Ph-ydWHHSUcTi4wZNzRnazozaAEmM1J_0 2024-09-12T18:36:00.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12225740704272192362', time=2024-09-12T20:02:57.619131+0000, chain.objs.size()=1 2024-09-12T18:36:00.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.vvWUy5xCOqsrp8bDXcWVCFkkA-W6KPY_0 2024-09-12T18:36:00.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10080845592247914907', time=2024-09-12T20:02:58.011356+0000, chain.objs.size()=1 2024-09-12T18:36:00.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.LjHaQ6nyLsTSaMhie1-jXWiXnNUMcvp_0 2024-09-12T18:36:00.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10696286511388493863', time=2024-09-12T20:02:59.926862+0000, chain.objs.size()=1 2024-09-12T18:36:00.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.xNuI2Jr312g0r5slyBh732rY8EAYZCS_0 2024-09-12T18:36:00.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3169481758158839024', time=2024-09-12T20:03:00.245670+0000, chain.objs.size()=1 2024-09-12T18:36:00.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.dbVxfcbO0oAFReCmB-rsog5MIQeCstZ_0 2024-09-12T18:36:00.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18445613872138828470', time=2024-09-12T20:03:01.283660+0000, chain.objs.size()=1 2024-09-12T18:36:00.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.kbbTuTqZLJ8dLm5vD8PaNwK1Lu-wyga_0 2024-09-12T18:36:00.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14418554439175038349', time=2024-09-12T20:03:01.577255+0000, chain.objs.size()=1 2024-09-12T18:36:00.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Pl1pnpgafWNp7zR_OwHHEV9BC6qUlA8_0 2024-09-12T18:36:00.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11413282252360077732', time=2024-09-12T20:03:02.434216+0000, chain.objs.size()=1 2024-09-12T18:36:00.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.kvDPzfd83WY2Hm6XDuUAHVlf1xspr1-_0 2024-09-12T18:36:00.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7858185728542407732', time=2024-09-12T20:03:02.542326+0000, chain.objs.size()=1 2024-09-12T18:36:00.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.265+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.AbJRkxlgB4Q9yfJUrxnA54gv1YS-lIY_0 2024-09-12T18:36:00.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.269+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.737705956166534235', time=2024-09-12T20:03:03.905017+0000, chain.objs.size()=1 2024-09-12T18:36:00.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.269+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.C1a4vi_1VP_m-AXAfvN42_zz75RyzqC_0 2024-09-12T18:36:00.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.269+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10938433295879981514', time=2024-09-12T20:03:04.831010+0000, chain.objs.size()=1 2024-09-12T18:36:00.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.269+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.lBYqMReqbi4SSoAHTu_QMNX9AoXYJ4l_0 2024-09-12T18:36:00.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.269+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4990242839162025689', time=2024-09-12T20:03:04.940771+0000, chain.objs.size()=1 2024-09-12T18:36:00.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.269+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.nLFIeSG2xwBtOPjAdifMxIK0m5GyWIo_0 2024-09-12T18:36:00.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17438888588573103937', time=2024-09-12T20:03:06.321972+0000, chain.objs.size()=1 2024-09-12T18:36:00.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.hQLVfd69GDfKuEKn6f7YRqKRRuHWqGH_0 2024-09-12T18:36:00.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4608182700005736458', time=2024-09-12T20:03:08.255866+0000, chain.objs.size()=1 2024-09-12T18:36:00.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QCc_4Y9K2E9QRGaVyI8bYCDfTKIH8kO_0 2024-09-12T18:36:00.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14164361051174182411', time=2024-09-12T20:03:08.257359+0000, chain.objs.size()=1 2024-09-12T18:36:00.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.6BFYtdNIQ1Bulrq6h8voIC91Y5L6q-x_0 2024-09-12T18:36:00.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8088900440401674835', time=2024-09-12T20:03:08.357562+0000, chain.objs.size()=1 2024-09-12T18:36:00.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.b7ICw_r3O_uOILTtMB6wTJjIyYIrd7V_0 2024-09-12T18:36:00.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7039516763302359601', time=2024-09-12T20:03:08.432472+0000, chain.objs.size()=1 2024-09-12T18:36:00.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wE7Jaw-GXbSSu1CINTkyB0MP6RREM4q_0 2024-09-12T18:36:00.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.458553976446810924', time=2024-09-12T20:03:09.354256+0000, chain.objs.size()=1 2024-09-12T18:36:00.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.hK3SKxoqMeHXiNOJrYgP6xWMoHQs16i_0 2024-09-12T18:36:00.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2210654088474717711', time=2024-09-12T20:03:09.869001+0000, chain.objs.size()=1 2024-09-12T18:36:00.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.GIqu2dpav3ejdcvb7x1p25Q-R45D3UW_0 2024-09-12T18:36:00.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16163183805151590444', time=2024-09-12T20:03:09.905226+0000, chain.objs.size()=1 2024-09-12T18:36:00.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qZA1pCsHXpJjjZS-hrkW0nqWv3bsAGp_0 2024-09-12T18:36:00.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7843302102986904886', time=2024-09-12T20:03:13.503617+0000, chain.objs.size()=1 2024-09-12T18:36:00.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.xZQYuFaFLo0G9gmnnNTGk9XSTJYtrTG_0 2024-09-12T18:36:00.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4422062965376186303', time=2024-09-12T20:03:13.675553+0000, chain.objs.size()=1 2024-09-12T18:36:00.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.273+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.NL9zL5y-X3YslWrIvLSTJKjUTEEI7w9_0 2024-09-12T18:36:00.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.277+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14307413100158754177', time=2024-09-12T20:03:13.677382+0000, chain.objs.size()=1 2024-09-12T18:36:00.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.277+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.T9zhxpqD24RtnbGU5MVol2XaOiTbGcc_0 2024-09-12T18:36:00.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.277+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7754207205487505776', time=2024-09-12T20:03:13.780258+0000, chain.objs.size()=1 2024-09-12T18:36:00.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.277+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.KQ-sW1d7tq3eJDzlvossguXMS3jaetq_0 2024-09-12T18:36:00.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.277+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10887960940625103596', time=2024-09-12T20:03:14.673891+0000, chain.objs.size()=1 2024-09-12T18:36:00.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.277+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ZqwozPk742jIEezquJGgdHPMN4DZW9J_0 2024-09-12T18:36:00.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10961967411893281803', time=2024-09-12T20:03:15.090231+0000, chain.objs.size()=1 2024-09-12T18:36:00.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2_FOl1bsNjPQGfNN6YUHUWpkf4wvgpW_0 2024-09-12T18:36:00.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12538870086118808584', time=2024-09-12T20:03:15.932904+0000, chain.objs.size()=1 2024-09-12T18:36:00.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.dkyG-ri-yvWmeWbsFfrHr1qvUFqxwHO_0 2024-09-12T18:36:00.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6185741616009743210', time=2024-09-12T20:03:16.875524+0000, chain.objs.size()=1 2024-09-12T18:36:00.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.fCt4zcDFOLulV_qEYCQwPoizC_IY_xr_0 2024-09-12T18:36:00.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6288908974455985323', time=2024-09-12T20:03:17.273971+0000, chain.objs.size()=1 2024-09-12T18:36:00.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wiGZ9gYa2OrTTuXaOnPw2fdw6uB685t_0 2024-09-12T18:36:00.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9275664168961274845', time=2024-09-12T20:03:19.234167+0000, chain.objs.size()=1 2024-09-12T18:36:00.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.IDBGofCu31Db68b9-S1NjKRtu_Xj8Iz_0 2024-09-12T18:36:00.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8989807020659206788', time=2024-09-12T20:03:59.769089+0000, chain.objs.size()=1 2024-09-12T18:36:00.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.287__shadow_.DoUz3hsTvEPGMwF3gfJ2pLn6SQCYsGp_0 2024-09-12T18:36:00.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3498553174044289084', time=2024-09-12T20:04:03.128456+0000, chain.objs.size()=1 2024-09-12T18:36:00.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.289__shadow_.hF-otIZ0j2T2e3pxYJTmrQYI4_U544u_0 2024-09-12T18:36:00.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2156789380441545346', time=2024-09-12T20:04:17.869020+0000, chain.objs.size()=1 2024-09-12T18:36:00.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.-OaRS8xS-vlbv_2CvBwR5SsGpLFTDOz_0 2024-09-12T18:36:00.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2456574817247510638', time=2024-09-12T20:04:17.870748+0000, chain.objs.size()=1 2024-09-12T18:36:00.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.YMgazs12ByHjMQ7yPZebmReOd0R_d40_0 2024-09-12T18:36:00.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.67925956880167061', time=2024-09-12T20:05:05.604008+0000, chain.objs.size()=1 2024-09-12T18:36:00.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.322__shadow_.IKlmwGybQ9xPaIaoPyqpLcy_zUATg8i_0 2024-09-12T18:36:00.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9020899801392424395', time=2024-09-12T20:06:52.578656+0000, chain.objs.size()=1 2024-09-12T18:36:00.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.udooA_o83nJ-gqTPRjJSRDBj5o_ZmGG_0 2024-09-12T18:36:00.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11751455848916122890', time=2024-09-12T20:06:52.809080+0000, chain.objs.size()=1 2024-09-12T18:36:00.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.wXykg4easjuBRHSpUU1OBRli2rdl169_0 2024-09-12T18:36:00.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12269516699991617353', time=2024-09-12T20:06:52.927660+0000, chain.objs.size()=1 2024-09-12T18:36:00.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.281+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.TsnSSjgC3fecjywpiZV2MhZfIBtKKCo_0 2024-09-12T18:36:00.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.285+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10910566939155056856', time=2024-09-12T20:06:53.174389+0000, chain.objs.size()=1 2024-09-12T18:36:00.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.285+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-B9-Clw6aM_KHs1opjDvaNlYKa__OQ1_0 2024-09-12T18:36:00.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.285+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2622969740887541684', time=2024-09-12T20:06:53.871408+0000, chain.objs.size()=1 2024-09-12T18:36:00.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.285+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-HRHr4RF0aT5R-I-JM3FFIFnUJ1IBgV_0 2024-09-12T18:36:00.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.285+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15667852414554609470', time=2024-09-12T20:06:55.407295+0000, chain.objs.size()=1 2024-09-12T18:36:00.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.285+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.IWdwtnn3eORSSJ_2hJR9vhzfqTi0DLV_0 2024-09-12T18:36:00.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.285+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16052994564756211952', time=2024-09-12T20:06:56.131355+0000, chain.objs.size()=1 2024-09-12T18:36:00.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.285+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.a3yyZOK9mofJnte12Y37K5NNViK1W0U_0 2024-09-12T18:36:00.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.285+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16084738789751863915', time=2024-09-12T20:06:56.472487+0000, chain.objs.size()=1 2024-09-12T18:36:00.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.285+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Xu_yF7RdMmmcuXvI8U_a7KvH8SvjAW5_0 2024-09-12T18:36:00.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.285+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2580553432932517220', time=2024-09-12T20:06:57.721599+0000, chain.objs.size()=1 2024-09-12T18:36:00.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.285+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.uxOmOtecnrDzb9jPwHoyc80Icd9zwhT_0 2024-09-12T18:36:00.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.285+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6688734034083234200', time=2024-09-12T20:07:00.710806+0000, chain.objs.size()=1 2024-09-12T18:36:00.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.285+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.uY2byAup_FRR4lPgW_SkFAGCSoYTt_O_0 2024-09-12T18:36:00.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.285+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14180768227368651496', time=2024-09-12T20:07:01.110828+0000, chain.objs.size()=1 2024-09-12T18:36:00.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.285+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_._OO2jEvKJWXJ339k0gwNycevr-Du9_j_0 2024-09-12T18:36:00.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8486017819787589696', time=2024-09-12T20:07:02.624683+0000, chain.objs.size()=1 2024-09-12T18:36:00.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.y9jN8F1uO2hhtpWsydP-tOyoqANcryl_0 2024-09-12T18:36:00.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15610835620388825204', time=2024-09-12T20:07:02.724336+0000, chain.objs.size()=1 2024-09-12T18:36:00.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.MT5qVs7qsnoQNEc5wto_wRlt7NFns9b_0 2024-09-12T18:36:00.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13003509503319653030', time=2024-09-12T20:07:03.023847+0000, chain.objs.size()=1 2024-09-12T18:36:00.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.UaQMqmIPelcvP0dmJde_0PD05GAzphe_0 2024-09-12T18:36:00.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8959521206171280215', time=2024-09-12T20:07:03.323775+0000, chain.objs.size()=1 2024-09-12T18:36:00.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.HUYkob5gDEls9HGJKGTEmyDiMQZakaZ_0 2024-09-12T18:36:00.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5479413978679175627', time=2024-09-12T20:07:04.043190+0000, chain.objs.size()=1 2024-09-12T18:36:00.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.SuGD67p9ZqvoNa1aA7nG-zrW0FMD6ao_0 2024-09-12T18:36:00.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16211207730714838218', time=2024-09-12T20:07:05.384542+0000, chain.objs.size()=1 2024-09-12T18:36:00.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.uyUGuc3IO7wwk-QIaZyBbIPm0pYxhgM_0 2024-09-12T18:36:00.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9050769028709941245', time=2024-09-12T20:07:06.266078+0000, chain.objs.size()=1 2024-09-12T18:36:00.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.XGJKCGFugSqVWgOicP9pfPvv4wRNI3z_0 2024-09-12T18:36:00.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3507676432431830377', time=2024-09-12T20:07:06.274021+0000, chain.objs.size()=1 2024-09-12T18:36:00.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.QMs6K9AyhLKN6PXXGeMjDPz5DCZTyb0_0 2024-09-12T18:36:00.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3007426945819609398', time=2024-09-12T20:07:07.116803+0000, chain.objs.size()=1 2024-09-12T18:36:00.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.0WKxZ7yYO8SiQjW_h6g87i0-jIuPboh_0 2024-09-12T18:36:00.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2884108510428896782', time=2024-09-12T20:07:08.105324+0000, chain.objs.size()=1 2024-09-12T18:36:00.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.289+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.tXJTYtbUr_Mv7do5RVfvmXM0ksgqJ9R_0 2024-09-12T18:36:00.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.293+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2540392204465837045', time=2024-09-12T20:07:08.367026+0000, chain.objs.size()=1 2024-09-12T18:36:00.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.293+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.U253RpGFH5fuyonIUr60jCJmD_Kscza_0 2024-09-12T18:36:00.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.293+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18350921499675845569', time=2024-09-12T20:07:08.468623+0000, chain.objs.size()=1 2024-09-12T18:36:00.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.293+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.0FE9pBb2ciT2JYXgwLb_gt-uk-GpvoT_0 2024-09-12T18:36:00.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.293+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9815233328005122106', time=2024-09-12T20:07:08.727178+0000, chain.objs.size()=1 2024-09-12T18:36:00.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.293+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.fq0g10zo2Vr9a1cDlq025Vsene4MCcN_0 2024-09-12T18:36:00.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.293+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12543726881733600898', time=2024-09-12T20:07:09.808127+0000, chain.objs.size()=1 2024-09-12T18:36:00.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.293+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.0C-7ywPHnFGl-IBKx0Co7QylIB22Mlf_0 2024-09-12T18:36:00.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.293+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16617291061932611669', time=2024-09-12T20:07:10.197942+0000, chain.objs.size()=1 2024-09-12T18:36:00.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.293+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.sWrYFMVV2bXOYhiAI1gIG_7qhudGaW1_0 2024-09-12T18:36:00.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.293+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5329280293545345951', time=2024-09-12T20:07:10.761461+0000, chain.objs.size()=1 2024-09-12T18:36:00.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.293+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.JFIzbpwhpNsmuW4Ir-LL3lt3zePcWlG_0 2024-09-12T18:36:00.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7304708351533880167', time=2024-09-12T20:07:12.336117+0000, chain.objs.size()=1 2024-09-12T18:36:00.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.PynywcrTlFpFqCcQPkHYxc2XKlawnkI_0 2024-09-12T18:36:00.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8494459379926297963', time=2024-09-12T20:07:12.420595+0000, chain.objs.size()=1 2024-09-12T18:36:00.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.CygUuMVUN2-TcdVdiRgiHWBpOsFThhy_0 2024-09-12T18:36:00.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15699421989780920302', time=2024-09-12T20:07:12.514274+0000, chain.objs.size()=1 2024-09-12T18:36:00.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-tVHWmFFUsjWR1k6acvgK-7pV8HUW0U_0 2024-09-12T18:36:00.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7124918855530052328', time=2024-09-12T20:07:14.153772+0000, chain.objs.size()=1 2024-09-12T18:36:00.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.4jhWH5fUBOdN6O5k9Q-k00bsMT8GTXa_0 2024-09-12T18:36:00.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16062325615287602331', time=2024-09-12T20:07:16.986831+0000, chain.objs.size()=1 2024-09-12T18:36:00.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.oXonX8PTIeuoiighGuS_mzGld3Oe04A_0 2024-09-12T18:36:00.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4925929053206555767', time=2024-09-12T20:07:17.005477+0000, chain.objs.size()=1 2024-09-12T18:36:00.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.J9ZCRyDcM3npOwwBne3hBp58uQbP2yL_0 2024-09-12T18:36:00.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8733087237962774541', time=2024-09-12T20:07:17.940132+0000, chain.objs.size()=1 2024-09-12T18:36:00.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.57ibT5m16Jj6UGr-S7sqer4a9LxsYRj_0 2024-09-12T18:36:00.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2751824189778856425', time=2024-09-12T20:07:18.455181+0000, chain.objs.size()=1 2024-09-12T18:36:00.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.jxSLv5FnJtezKmwofmh-B2EfTeHS4wE_0 2024-09-12T18:36:00.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16909811786028200348', time=2024-09-12T20:09:02.422013+0000, chain.objs.size()=1 2024-09-12T18:36:00.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.jQO93cwnwHuja085PUSyyO93bC8e82a_0 2024-09-12T18:36:00.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9580841526282463674', time=2024-09-12T20:09:03.393872+0000, chain.objs.size()=1 2024-09-12T18:36:00.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.O78d4Si45o0aTUeP-NbHw7MGDD0MABV_0 2024-09-12T18:36:00.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1691036754840793448', time=2024-09-12T20:09:04.310252+0000, chain.objs.size()=1 2024-09-12T18:36:00.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.297+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.MPXOM1fVa13PVRqN5481auBfoRD5_jF_0 2024-09-12T18:36:00.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.301+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5406417704509158562', time=2024-09-12T20:09:04.607468+0000, chain.objs.size()=1 2024-09-12T18:36:00.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.301+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Bqprch_c_kbelZ9dYsVV9dUAyKsc2Zg_0 2024-09-12T18:36:00.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.301+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18103948800626079744', time=2024-09-12T20:09:04.718543+0000, chain.objs.size()=1 2024-09-12T18:36:00.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.301+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.TdOfsvJzfT9AJkAPy3vhI2VC4wOpT2b_0 2024-09-12T18:36:00.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.301+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1289451391239620088', time=2024-09-12T20:09:09.447682+0000, chain.objs.size()=1 2024-09-12T18:36:00.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.301+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.G8Oy-HJu1A3wGVHNu6JPcELbhFfzf-k_0 2024-09-12T18:36:00.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.301+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4785575035743765882', time=2024-09-12T20:09:10.426391+0000, chain.objs.size()=1 2024-09-12T18:36:00.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.301+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.YMAe2KM0VT3u8NKpnOFd-lGJQKW-tG__0 2024-09-12T18:36:00.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15712013785672843476', time=2024-09-12T20:09:10.428189+0000, chain.objs.size()=1 2024-09-12T18:36:00.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.kC2crbL-oUbO7IukFmXOW1hzXubcB9X_0 2024-09-12T18:36:00.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6502445379215551518', time=2024-09-12T20:09:10.599247+0000, chain.objs.size()=1 2024-09-12T18:36:00.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Ray9f1jIULw9zo9ZNZO8u9qUqh6uucl_0 2024-09-12T18:36:00.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3474000593056083603', time=2024-09-12T20:09:11.220710+0000, chain.objs.size()=1 2024-09-12T18:36:00.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.9zI-Onz_c7N9SorU515KHlsplUBvEMK_0 2024-09-12T18:36:00.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1895327547374508675', time=2024-09-12T20:09:12.010245+0000, chain.objs.size()=1 2024-09-12T18:36:00.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.zf03MpWU2WEy7_hjOeeSz-bE_Ft23uN_0 2024-09-12T18:36:00.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4175350515463834995', time=2024-09-12T20:09:13.473157+0000, chain.objs.size()=1 2024-09-12T18:36:00.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.enYC9gyHoj5PirvOyPziPYuPCYS8mB8_0 2024-09-12T18:36:00.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15045067705294439470', time=2024-09-12T20:09:14.107068+0000, chain.objs.size()=1 2024-09-12T18:36:00.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.7nNWTubRPygUMcqa_dadpCSkoAkhppl_0 2024-09-12T18:36:00.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14997552400181015187', time=2024-09-12T20:09:14.255657+0000, chain.objs.size()=1 2024-09-12T18:36:00.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.aAcHLo-uO134J9D9BsX3xsoIn6Rmfhq_0 2024-09-12T18:36:00.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6430259165838961454', time=2024-09-12T20:09:14.735374+0000, chain.objs.size()=1 2024-09-12T18:36:00.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.73aEfoCtvluOeHLpUZR_07BlYn3HqAL_0 2024-09-12T18:36:00.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16432510691123191655', time=2024-09-12T20:09:15.190911+0000, chain.objs.size()=1 2024-09-12T18:36:00.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.K9tILZdCFzPriHDO-FUE0JSqLfAdD0I_0 2024-09-12T18:36:00.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.983176908149433130', time=2024-09-12T20:09:17.876791+0000, chain.objs.size()=1 2024-09-12T18:36:00.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.305+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.g5TMbvBbivMm6DdgwOHdwNMhzBi6YQd_0 2024-09-12T18:36:00.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.313+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47317 2024-09-12T18:36:00.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T18:36:00.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5165582576786939640', time=2024-09-12T20:09:18.291647+0000, chain.objs.size()=1 2024-09-12T18:36:00.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ncB8UHmWxLTQaTAV0F7OyJtvKpndA0G_0 2024-09-12T18:36:00.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12082277327345837076', time=2024-09-12T20:09:18.507460+0000, chain.objs.size()=1 2024-09-12T18:36:00.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xcawWPgRqXZezme9vrmg7gbZNx7O-f7_0 2024-09-12T18:36:00.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15317040367659299713', time=2024-09-12T20:09:18.668917+0000, chain.objs.size()=1 2024-09-12T18:36:00.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.v2oeVq7ThQAFzOiyFq1AI5-cnMWGMAk_0 2024-09-12T18:36:00.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18091809191019575674', time=2024-09-12T20:09:19.194733+0000, chain.objs.size()=1 2024-09-12T18:36:00.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.sJZYi7ad3d7Ppv2Jq-QYjWFbMaWOcp5_0 2024-09-12T18:36:00.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14392037539522356126', time=2024-09-12T20:09:19.198204+0000, chain.objs.size()=1 2024-09-12T18:36:00.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ceA2rKztZ7pOPNzUHoBQUyOrs7rEyA5_0 2024-09-12T18:36:00.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11486811183952488717', time=2024-09-12T20:09:21.615375+0000, chain.objs.size()=1 2024-09-12T18:36:00.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.KXNqpR6izlDVou7FxuhW9s0JtKLLAX8_0 2024-09-12T18:36:00.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11525682116836922960', time=2024-09-12T20:09:21.693038+0000, chain.objs.size()=1 2024-09-12T18:36:00.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xQX94UQONlRVYe8tP_oiTiNFOfBCVAm_0 2024-09-12T18:36:00.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1569283714135407388', time=2024-09-12T20:09:21.746385+0000, chain.objs.size()=1 2024-09-12T18:36:00.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.HJcqaWrKk5MaNh4qbkeMJ7bZBelhgwA_0 2024-09-12T18:36:00.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9596374601072513651', time=2024-09-12T20:09:23.802245+0000, chain.objs.size()=1 2024-09-12T18:36:00.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.BvBvhDBp1VvyxlqFrp0ehGWGDaAPoeT_0 2024-09-12T18:36:00.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11895785295595236676', time=2024-09-12T20:09:24.448958+0000, chain.objs.size()=1 2024-09-12T18:36:00.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.fLztrdjVXGvaPXHZuIgEkc3ZAOk4VIX_0 2024-09-12T18:36:00.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6314305196702201366', time=2024-09-12T20:09:25.885505+0000, chain.objs.size()=1 2024-09-12T18:36:00.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5x_MunD7R7Cjx5Pzir5Oqb02Fx5MT-A_0 2024-09-12T18:36:00.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17760844450687141405', time=2024-09-12T20:09:26.727540+0000, chain.objs.size()=1 2024-09-12T18:36:00.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.317+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ggFXyCNEZ8AL2ZeDJy8VmsGxmMFPdCk_0 2024-09-12T18:36:00.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.321+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10515388518600769260', time=2024-09-12T20:09:28.523777+0000, chain.objs.size()=1 2024-09-12T18:36:00.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.321+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.kObNJfO-uAR34utMZ3oWsMbCgP0X4L5_0 2024-09-12T18:36:00.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.321+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12221183809243178757', time=2024-09-12T20:09:28.791389+0000, chain.objs.size()=1 2024-09-12T18:36:00.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.321+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.tamXlw1iTYrlqJFEegNwGW5YnitiV6e_0 2024-09-12T18:36:00.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.321+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8672090983722299287', time=2024-09-12T20:09:29.125852+0000, chain.objs.size()=1 2024-09-12T18:36:00.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.321+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.0pXfSWpg8LjC_2LWzpkaA2fBtdUlxJr_0 2024-09-12T18:36:00.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.321+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16527101370849706388', time=2024-09-12T20:09:57.649845+0000, chain.objs.size()=1 2024-09-12T18:36:00.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.321+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.346__shadow_.H9Rrk86ZkyG8iAuvadQ0O6W_uyi-YQE_0 2024-09-12T18:36:00.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.325+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18008114786857208477', time=2024-09-12T20:10:22.209597+0000, chain.objs.size()=1 2024-09-12T18:36:00.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.325+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.368__shadow_.mthwfMvCNQlyxpj_-3AYF37SmgJIDSI_0 2024-09-12T18:36:00.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.325+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.406907990719279946', time=2024-09-12T20:10:24.595902+0000, chain.objs.size()=1 2024-09-12T18:36:00.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.325+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.370__shadow_.BSLImXGoBa2-KCSW-W2i8zeIORcaoFy_0 2024-09-12T18:36:00.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.325+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16720127905026617105', time=2024-09-12T20:10:27.145824+0000, chain.objs.size()=1 2024-09-12T18:36:00.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.325+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.372__shadow_.6A0KRjCt4XoQv4iH1pNDuDGur0wwwB6_0 2024-09-12T18:36:00.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.325+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1264754300650931331', time=2024-09-12T20:10:28.461835+0000, chain.objs.size()=1 2024-09-12T18:36:00.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.325+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.373__shadow_.Nuieq5Ixqb-hv72f7HOw7E6hCxzqeNS_0 2024-09-12T18:36:00.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.325+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.335030847755402901', time=2024-09-12T20:11:01.581146+0000, chain.objs.size()=1 2024-09-12T18:36:00.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.325+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.395__shadow:fkBPGVsG9vPkpd9.0z3xYGR1vlqlstm_.e8tv__KXp01tZFfhMgiffZUewjAq0vm_0 2024-09-12T18:36:00.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.325+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16689155021391207747', time=2024-09-12T20:11:49.436297+0000, chain.objs.size()=1 2024-09-12T18:36:00.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.325+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.432__shadow_.Zfa04V5o0R7lkpFE9IoiPDNrtF5UKWh_0 2024-09-12T18:36:00.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.325+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.310353024540795266', time=2024-09-12T20:13:02.120329+0000, chain.objs.size()=1 2024-09-12T18:36:00.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.325+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.482__shadow_.ZfDYFeJiqiIJlZW2CMl3ij6eWtvsisd_0 2024-09-12T18:36:00.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.329+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12674985811719791944', time=2024-09-12T20:13:02.123923+0000, chain.objs.size()=1 2024-09-12T18:36:00.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.482__shadow_.kYSVdTCjxvjnZBPcZVvouLHcggGmj4t_0 2024-09-12T18:36:00.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.329+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9858860628645647312', time=2024-09-12T20:13:58.575241+0000, chain.objs.size()=6 2024-09-12T18:36:00.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.1 2024-09-12T18:36:00.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.2 2024-09-12T18:36:00.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.3 2024-09-12T18:36:00.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.4 2024-09-12T18:36:00.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.5 2024-09-12T18:36:00.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.6 2024-09-12T18:36:00.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.329+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12878856656244888503', time=2024-09-12T20:14:59.555196+0000, chain.objs.size()=4 2024-09-12T18:36:00.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.521__shadow:4WzXx3oxfSxmbSxFB8A6gU8vudFKHw8_.bvfdenl_MV0kD7xtIWbqlc3Hyo8-b-8_0 2024-09-12T18:36:00.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.521__shadow:4WzXx3oxfSxmbSxFB8A6gU8vudFKHw8_.bvfdenl_MV0kD7xtIWbqlc3Hyo8-b-8_1 2024-09-12T18:36:00.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.521__shadow:4WzXx3oxfSxmbSxFB8A6gU8vudFKHw8_.bvfdenl_MV0kD7xtIWbqlc3Hyo8-b-8_2 2024-09-12T18:36:00.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.329+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.521__shadow:4WzXx3oxfSxmbSxFB8A6gU8vudFKHw8_.bvfdenl_MV0kD7xtIWbqlc3Hyo8-b-8_3 2024-09-12T18:36:00.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.333+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7195961701010389814', time=2024-09-12T20:15:55.570243+0000, chain.objs.size()=6 2024-09-12T18:36:00.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.333+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~yJym7Ux88Sjfzu_Cx8dqjzlxRs2b0WM.1 2024-09-12T18:36:00.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~yJym7Ux88Sjfzu_Cx8dqjzlxRs2b0WM.2 2024-09-12T18:36:00.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.5LTFmPNTZ2sZsjY353cGG-PPJHMdrKz0.3 2024-09-12T18:36:00.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~yJym7Ux88Sjfzu_Cx8dqjzlxRs2b0WM.4 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~yJym7Ux88Sjfzu_Cx8dqjzlxRs2b0WM.5 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~yJym7Ux88Sjfzu_Cx8dqjzlxRs2b0WM.6 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.337+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~GDIALAX7pNjtol0jMyWHzoEESkPttKK', time=2024-09-12T20:16:50.838175+0000, chain.objs.size()=10 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.527__multipart_mymultipart.2~GDIALAX7pNjtol0jMyWHzoEESkPttKK.1 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.527__multipart_mymultipart.2~GDIALAX7pNjtol0jMyWHzoEESkPttKK.2 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.527__multipart_mymultipart.2~GDIALAX7pNjtol0jMyWHzoEESkPttKK.3 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.527__multipart_mymultipart.2~GDIALAX7pNjtol0jMyWHzoEESkPttKK.4 2024-09-12T18:36:00.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.337+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.527__multipart_mymultipart.2~GDIALAX7pNjtol0jMyWHzoEESkPttKK.5 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.527__multipart_mymultipart.2~GDIALAX7pNjtol0jMyWHzoEESkPttKK.6 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.527__multipart_mymultipart.2~GDIALAX7pNjtol0jMyWHzoEESkPttKK.7 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.527__multipart_mymultipart.2~GDIALAX7pNjtol0jMyWHzoEESkPttKK.8 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.527__multipart_mymultipart.2~GDIALAX7pNjtol0jMyWHzoEESkPttKK.9 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.527__multipart_mymultipart.2~GDIALAX7pNjtol0jMyWHzoEESkPttKK.10 2024-09-12T18:36:00.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13611082107502496145', time=2024-09-12T20:18:26.583768+0000, chain.objs.size()=1 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.556__shadow_.1LpwIJArhAWciTXbkru3rEVm0HhOTcg_0 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15582635451898468514', time=2024-09-12T20:19:42.575338+0000, chain.objs.size()=1 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.575__shadow:zw1AC65xKvRYuSgXoJ2RZrdeFYPa9W4_.C_mWZqPKsan8gj-u5NXxDI7k6msMaoE_0 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4102663560816583497', time=2024-09-12T20:19:55.692129+0000, chain.objs.size()=1 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.577__shadow:GR3oHXYyOClBZZ1FeCCf7D19j2P8kbz_.OAv8w40zr2FTXAEvnpF_qzPSNsR-S-i_0 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8961313527229458475', time=2024-09-12T20:20:32.909937+0000, chain.objs.size()=1 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:jv7ew9lOqaIO-Knjd8WbC.-W5hHfp95_.vxTndMD-ihQ1bD8i85rARSuDYb1zS6S_0 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15804110908133225529', time=2024-09-12T20:21:27.264459+0000, chain.objs.size()=1 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.588__shadow:8PndjOuQQtmLR5BQudU6vTV-sAgsvSI_.xs9jur7gPc8Cam2siiFiDRJ_Ie0JCNU_0 2024-09-12T18:36:00.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.952758124728440897', time=2024-09-12T20:28:01.102229+0000, chain.objs.size()=1 2024-09-12T18:36:00.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.345+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.669__shadow_.tZ8fBwM5yET4dN27emwLmXdC80r6y3w_0 2024-09-12T18:36:00.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.353+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4157416453562179356', time=2024-09-12T20:29:00.524223+0000, chain.objs.size()=1 2024-09-12T18:36:00.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.353+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.712__multipart_file1.2~iwh_txQKq23TfH-XgddEJg0JnR8rhWq.1 2024-09-12T18:36:00.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.357+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:00.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.357+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:36:00.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:00.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/66326' 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5300145732575335372', time=2024-09-12T20:00:39.010431+0000, chain.objs.size()=1 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.244__shadow_.IPLRmCLcEXFNKfkNZXoLOg651QBRXy9_0 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9864386596139163915', time=2024-09-12T20:00:44.855226+0000, chain.objs.size()=1 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.247__shadow_.EH1HjKVWDJbOJqll418r2MQtebml0gl_0 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14101561229415656536', time=2024-09-12T20:01:03.186535+0000, chain.objs.size()=1 2024-09-12T18:36:00.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.258__shadow_.-9QYoOy6j6l54h0JELz8IVHyM_hXhP0_0 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7035453492727489382', time=2024-09-12T20:02:51.934409+0000, chain.objs.size()=1 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.gVNet8TQCU-RvEgVFaIasrO7-GpOE2T_0 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1052704475162532527', time=2024-09-12T20:02:53.198791+0000, chain.objs.size()=1 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.N_Vz8u2F4jZKc4fWTc11r45qSVRIZg__0 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12173483408918193145', time=2024-09-12T20:02:54.757700+0000, chain.objs.size()=1 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.yxJ9bnx7iHKam12ZoAhL_2T796myAZQ_0 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18277493288002197543', time=2024-09-12T20:02:56.512915+0000, chain.objs.size()=1 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.GfcODkPp4OQ8sQD6sPkICD3uR-EZYgD_0 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12269473543822513865', time=2024-09-12T20:02:56.616638+0000, chain.objs.size()=1 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QbjclP1sxCpNJruNVun1CX_HbrpV8CN_0 2024-09-12T18:36:00.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14801771443267927262', time=2024-09-12T20:02:56.958209+0000, chain.objs.size()=1 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ceHnuerx6TbbtsBAU9Q5sbO9P4S4gb6_0 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4263637701535302686', time=2024-09-12T20:02:57.188258+0000, chain.objs.size()=1 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.SdA-fKIPGvj8bu8sv-mbxgUO9DL5YaV_0 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6115579995192844239', time=2024-09-12T20:02:58.639195+0000, chain.objs.size()=1 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QhpVGLXVu_FiGu4GrzZKUPHk5S_4bAp_0 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16317211952292181368', time=2024-09-12T20:02:58.758650+0000, chain.objs.size()=1 2024-09-12T18:36:00.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.361+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.8IpLL8UIc1nzGwfI5IGzwvKJVH_-h6n_0 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.365+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10269019610778402527', time=2024-09-12T20:02:59.902083+0000, chain.objs.size()=1 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.365+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.5viWIOKxI3nlrwuu3ptY24YXb2YEPPF_0 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.365+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15787488262480771077', time=2024-09-12T20:03:00.142317+0000, chain.objs.size()=1 2024-09-12T18:36:00.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.365+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wFxcxyfLaTZwZkXUsi7Cd4WUFt5EDAf_0 2024-09-12T18:36:00.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.365+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17589900609982279649', time=2024-09-12T20:03:00.324949+0000, chain.objs.size()=1 2024-09-12T18:36:00.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.365+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.M5qYyllzLk4jRHUEgy9_HEXPOHDbtxx_0 2024-09-12T18:36:00.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.369+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.745394542516357600', time=2024-09-12T20:03:00.326786+0000, chain.objs.size()=1 2024-09-12T18:36:00.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.369+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.sAetDjozWlmQyTmm5iqLaaQiIEPL93-_0 2024-09-12T18:36:00.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.369+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14242883363705214222', time=2024-09-12T20:03:00.329493+0000, chain.objs.size()=1 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.369+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Vf6BS3pfQMVLdFygARaMYhxVTaKS_wu_0 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.369+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7084841918603652856', time=2024-09-12T20:03:00.924959+0000, chain.objs.size()=1 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.369+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.dBKMYa9VriAx5JDvI0CT8_xVNO9cElF_0 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.369+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4485349808024979395', time=2024-09-12T20:03:01.189844+0000, chain.objs.size()=1 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.369+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.x9U-sBNtCWVXmN-AvHtYdunEGLUQ7kM_0 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.369+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14401836566909996518', time=2024-09-12T20:03:02.429565+0000, chain.objs.size()=1 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.369+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.VFlO51RSn-9546jdSP5QJKrxjeVfsv6_0 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.369+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16354619647087855071', time=2024-09-12T20:03:02.536354+0000, chain.objs.size()=1 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.369+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.mWYyp3OtxkJ7DRysvh6TQ8BaD08i3zb_0 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.369+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1072603446291306289', time=2024-09-12T20:03:02.599655+0000, chain.objs.size()=1 2024-09-12T18:36:00.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.369+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.uECGMOW0_XeTGepxC38kxuUSjkYgVUC_0 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.369+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16443495800191094795', time=2024-09-12T20:03:03.491865+0000, chain.objs.size()=1 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.369+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.IW89Lq13o9UhE2LmC2s-qsW8hdZiIkV_0 2024-09-12T18:36:00.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.373+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17935629869052592025', time=2024-09-12T20:03:03.550360+0000, chain.objs.size()=1 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.373+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.8Zr5ctGHgqFA8Hoas0zISEIsNmMlFdI_0 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.373+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4129790303352941366', time=2024-09-12T20:03:03.596427+0000, chain.objs.size()=1 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.373+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.MdKiE3f-ZvhgxPh0itkrye4UziSQSDt_0 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.373+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16279070005616572017', time=2024-09-12T20:03:03.954571+0000, chain.objs.size()=1 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.373+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.IUQfC7YjaA7Vz6vWnd-KbSzkMokoVrD_0 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.373+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10407408637409073881', time=2024-09-12T20:03:05.748161+0000, chain.objs.size()=1 2024-09-12T18:36:00.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.373+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.pmjiJV-ClTj3GxNFACZPEu9qP4NZJ4y_0 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.373+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3067559556982838042', time=2024-09-12T20:03:05.750521+0000, chain.objs.size()=1 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.373+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.fkhnnM5i30qRQBu3sZPgAdsf7Yc3Qq1_0 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.373+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14728899344016604016', time=2024-09-12T20:03:07.923274+0000, chain.objs.size()=1 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.373+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._q1_muPLOvUW3LIR8kyQDIg4o6TQdVa_0 2024-09-12T18:36:00.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.373+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12659603558034073416', time=2024-09-12T20:03:08.288286+0000, chain.objs.size()=1 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.373+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.LgwcgEJVcFyJ1qLTYt4hEmrbuS0z00g_0 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.373+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6435583057834834857', time=2024-09-12T20:03:08.852643+0000, chain.objs.size()=1 2024-09-12T18:36:00.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.373+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qhXDs6pJlvkWg9HdJZVBtEiwypUjKI3_0 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.377+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10280520029760040253', time=2024-09-12T20:03:09.065913+0000, chain.objs.size()=1 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.377+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Ci-kmldDP65CSPoi8Jl-Ghx-IgltvPi_0 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.377+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2661791380046560959', time=2024-09-12T20:03:09.728462+0000, chain.objs.size()=1 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.377+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.x_WxrceQGYpNaoI61Qq1tBVEEOF3kD8_0 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.377+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11363172730191770494', time=2024-09-12T20:03:10.126006+0000, chain.objs.size()=1 2024-09-12T18:36:00.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.377+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.0uCYMj0fliK5DwMDaBhtbeEuy9QK5Xq_0 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.377+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7373502817727303530', time=2024-09-12T20:03:10.165732+0000, chain.objs.size()=1 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.377+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ED5GnopV717FttOF2GXsoQ75IbmGO5S_0 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.377+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8270542889991487742', time=2024-09-12T20:03:11.507185+0000, chain.objs.size()=1 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.377+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.LM8d1XImbk0KhNvyzzS3_tbi7-P8iLA_0 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.377+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3231562197330582629', time=2024-09-12T20:03:12.483953+0000, chain.objs.size()=1 2024-09-12T18:36:00.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.377+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ZKeCki9aFp9vRUdMliVoC9DUJh4jCip_0 2024-09-12T18:36:00.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.377+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15620202800467836855', time=2024-09-12T20:03:13.249141+0000, chain.objs.size()=1 2024-09-12T18:36:00.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.377+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.x5r8WCKHQQHDzttWWjVeEo-LE7140y2_0 2024-09-12T18:36:00.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2535947645185519870', time=2024-09-12T20:03:15.312623+0000, chain.objs.size()=1 2024-09-12T18:36:00.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.vuKj_4-3L3u2bCPkmNe79ZBP6EXctNQ_0 2024-09-12T18:36:00.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6647554946236776579', time=2024-09-12T20:03:16.350666+0000, chain.objs.size()=1 2024-09-12T18:36:00.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.CNxEE25D6Mw36JgB-SMgZCZK4_G1cjJ_0 2024-09-12T18:36:00.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17126418822228196154', time=2024-09-12T20:03:18.550345+0000, chain.objs.size()=1 2024-09-12T18:36:00.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.1dVnofaEvfxGhM30TEataLYpBvvmBNT_0 2024-09-12T18:36:00.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9106838315610805151', time=2024-09-12T20:03:18.608260+0000, chain.objs.size()=1 2024-09-12T18:36:00.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.5aZncYyR17iMnYZeAlYY71zqgT5DfQ5_0 2024-09-12T18:36:00.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9117737318500544803', time=2024-09-12T20:03:18.626556+0000, chain.objs.size()=1 2024-09-12T18:36:00.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.oaBMyMaR1bPqkRwIA779EOuXdha6Wlv_0 2024-09-12T18:36:00.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9330821270684652529', time=2024-09-12T20:03:19.913528+0000, chain.objs.size()=1 2024-09-12T18:36:00.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.GYdqjfomSin1Vp8fklGUG9t8kOCeIGP_0 2024-09-12T18:36:00.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11735443486384953755', time=2024-09-12T20:03:49.354469+0000, chain.objs.size()=1 2024-09-12T18:36:00.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.281__shadow_.GwWRiTuP44HVl4aREn2ptKUPPSqVXJe_0 2024-09-12T18:36:00.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16608243842241110200', time=2024-09-12T20:04:36.900304+0000, chain.objs.size()=1 2024-09-12T18:36:00.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.305__shadow_.h-W7OoLI2ST5oo38wiDlt7zdUtQ4NZl_0 2024-09-12T18:36:00.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5964156826231923059', time=2024-09-12T20:05:07.462293+0000, chain.objs.size()=1 2024-09-12T18:36:00.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.323__shadow_.DObtk06clHIC5LXlgkJgCPadvRf0Z2X_0 2024-09-12T18:36:00.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5493000653548511888', time=2024-09-12T20:06:52.445145+0000, chain.objs.size()=1 2024-09-12T18:36:00.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.f2yr7fZzUNbMcM1Ljvt-gvI9UdFPIY__0 2024-09-12T18:36:00.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7870242055933844009', time=2024-09-12T20:06:53.243300+0000, chain.objs.size()=1 2024-09-12T18:36:00.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.381+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.EZZ1qXAAz_h0X1XUSJs4fs2L2VeauUx_0 2024-09-12T18:36:00.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.385+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1200345023940301505', time=2024-09-12T20:06:53.396858+0000, chain.objs.size()=1 2024-09-12T18:36:00.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.kzYaUkqCaA2N4yEpE7S4m79WuJGXPqZ_0 2024-09-12T18:36:00.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15410801229588236651', time=2024-09-12T20:06:54.923655+0000, chain.objs.size()=1 2024-09-12T18:36:00.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Wv9o_vqqhfWFZWB5TORVXeVta80QUYe_0 2024-09-12T18:36:00.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4315690694433705748', time=2024-09-12T20:06:54.925511+0000, chain.objs.size()=1 2024-09-12T18:36:00.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7TfnrRcFJ0bOZWBBmnVySwzHjsQIMvy_0 2024-09-12T18:36:00.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2943384176568808529', time=2024-09-12T20:06:56.553814+0000, chain.objs.size()=1 2024-09-12T18:36:00.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.74dybi39if8Khv3uxII6tk8CgKXfvYT_0 2024-09-12T18:36:00.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5901333341165922383', time=2024-09-12T20:06:56.844929+0000, chain.objs.size()=1 2024-09-12T18:36:00.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.4qLdzTUKJqElYEAI8zBzFpuYDMUWdxm_0 2024-09-12T18:36:00.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12270173414220180177', time=2024-09-12T20:06:57.540260+0000, chain.objs.size()=1 2024-09-12T18:36:00.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.aPc1CZso3nZGufJ4nUCHOjVJ9OC-Ip0_0 2024-09-12T18:36:00.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.650840731077603165', time=2024-09-12T20:06:59.454921+0000, chain.objs.size()=1 2024-09-12T18:36:00.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.kCYh4XuXoJyuOkOY_YJGLqrphmGneQf_0 2024-09-12T18:36:00.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1375903207458811875', time=2024-09-12T20:07:01.463532+0000, chain.objs.size()=1 2024-09-12T18:36:00.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.GxpYRJx48y6tGhze_2e9BIydrRfcZq9_0 2024-09-12T18:36:00.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15859324044585923342', time=2024-09-12T20:07:02.699480+0000, chain.objs.size()=1 2024-09-12T18:36:00.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.nlMabj1dxVj1uRzimOVkvBo00GmCO-U_0 2024-09-12T18:36:00.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15677364806466769334', time=2024-09-12T20:07:03.693308+0000, chain.objs.size()=1 2024-09-12T18:36:00.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.UZ2TVYahfSkat0lNBPkWTvbZKsO2K8G_0 2024-09-12T18:36:00.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7742786901157784474', time=2024-09-12T20:07:03.771423+0000, chain.objs.size()=1 2024-09-12T18:36:00.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.jqmeldg0SAc_erFEbKNacA_8YKDvjUP_0 2024-09-12T18:36:00.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13103758092967516686', time=2024-09-12T20:07:06.746628+0000, chain.objs.size()=1 2024-09-12T18:36:00.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.389+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_._ERaltojV7lEdMKUjzD2aZ7ga1mBpLc_0 2024-09-12T18:36:00.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16582948784446250887', time=2024-09-12T20:07:07.247774+0000, chain.objs.size()=1 2024-09-12T18:36:00.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.WG5cfaOhwZFOJ5rMGtwads92ZzersM8_0 2024-09-12T18:36:00.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12016474320693625767', time=2024-09-12T20:07:07.712365+0000, chain.objs.size()=1 2024-09-12T18:36:00.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.sqkZ-2mpLyKKxzRqL5tABP0wLT8-DJ3_0 2024-09-12T18:36:00.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12434714254688987877', time=2024-09-12T20:07:07.822841+0000, chain.objs.size()=1 2024-09-12T18:36:00.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.TMjl9avZucIPrDBz9ti65ASwhsT0Sct_0 2024-09-12T18:36:00.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4941020369973386408', time=2024-09-12T20:07:09.862017+0000, chain.objs.size()=1 2024-09-12T18:36:00.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.3h-37x8mAUsfjgh_s2PPI_2C9pjyJIi_0 2024-09-12T18:36:00.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5731480112861184807', time=2024-09-12T20:07:12.024434+0000, chain.objs.size()=1 2024-09-12T18:36:00.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Ptxo5aGlxxJqc-lSSosPalu3fb930HF_0 2024-09-12T18:36:00.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9103979365437545009', time=2024-09-12T20:07:12.295483+0000, chain.objs.size()=1 2024-09-12T18:36:00.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.rzLO292HVCCeqEucRn7Vgz0OctNojdG_0 2024-09-12T18:36:00.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16228405193518579886', time=2024-09-12T20:07:12.530194+0000, chain.objs.size()=1 2024-09-12T18:36:00.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.wKL7EyWTMBiHrRZM-_DUfW_V5MUhohn_0 2024-09-12T18:36:00.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18361985411272888350', time=2024-09-12T20:07:13.851441+0000, chain.objs.size()=1 2024-09-12T18:36:00.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ZvkIsTKeZF3WzxXTMFz1Hzs8IeTvm92_0 2024-09-12T18:36:00.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324410536736984936', time=2024-09-12T20:07:14.355581+0000, chain.objs.size()=1 2024-09-12T18:36:00.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.g3DUVu6rZWIBb3xrTRv0lK-p8zPOpCf_0 2024-09-12T18:36:00.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10565689269241931595', time=2024-09-12T20:07:14.452271+0000, chain.objs.size()=1 2024-09-12T18:36:00.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.sy8qQGr3HfDZc2Nkw2WXsH2Xz3zRW-s_0 2024-09-12T18:36:00.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12762078253094152679', time=2024-09-12T20:07:15.478512+0000, chain.objs.size()=1 2024-09-12T18:36:00.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.393+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.9atlXzRQEJPifa-9zba1lZMmbJ7mk6j_0 2024-09-12T18:36:00.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.397+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3928220466908377407', time=2024-09-12T20:07:17.307423+0000, chain.objs.size()=1 2024-09-12T18:36:00.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.397+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-sqyesoPZ1w7fZvsPnvi7f89WiUrbyT_0 2024-09-12T18:36:00.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.397+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10700719474166381644', time=2024-09-12T20:07:17.437798+0000, chain.objs.size()=1 2024-09-12T18:36:00.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.397+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.cGJTHu-6h4M666YvtlaM2Q0SEBEE-UZ_0 2024-09-12T18:36:00.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.397+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3038773930476449521', time=2024-09-12T20:07:17.680645+0000, chain.objs.size()=1 2024-09-12T18:36:00.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.397+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.MvM0IBi97MyTs1QtHhSRkVUUsRRlG0S_0 2024-09-12T18:36:00.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.397+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17705155838306611703', time=2024-09-12T20:07:19.121385+0000, chain.objs.size()=1 2024-09-12T18:36:00.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.397+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ja58ydyRHk7qDF_OidgrSVDIhR_iNq6_0 2024-09-12T18:36:00.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.401+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18434796504331325966', time=2024-09-12T20:09:02.219905+0000, chain.objs.size()=1 2024-09-12T18:36:00.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.401+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.8flngfLC63T8XhZncn4VbfsjDCga2jk_0 2024-09-12T18:36:00.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.401+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1276797126707019597', time=2024-09-12T20:09:05.834679+0000, chain.objs.size()=1 2024-09-12T18:36:00.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.401+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xVrspYSvrF9WIiuWvrYKI0Va-psuG1l_0 2024-09-12T18:36:00.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.401+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18011880220594235320', time=2024-09-12T20:09:07.360979+0000, chain.objs.size()=1 2024-09-12T18:36:00.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.401+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.0Wt9sZs4TQEtMQMJhYtQtDS5t6L7Qzf_0 2024-09-12T18:36:00.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.401+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7660459402508840337', time=2024-09-12T20:09:07.478008+0000, chain.objs.size()=1 2024-09-12T18:36:00.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.401+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xPVN-d02L2uTCO2E_ACSiZUL2-T5AjZ_0 2024-09-12T18:36:00.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.401+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3971417313968084675', time=2024-09-12T20:09:09.792952+0000, chain.objs.size()=1 2024-09-12T18:36:00.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.401+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.E9RPGMBQeeXwsV047nu5GCPN6gTUlaB_0 2024-09-12T18:36:00.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.401+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14933670414289147234', time=2024-09-12T20:09:09.882425+0000, chain.objs.size()=1 2024-09-12T18:36:00.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.401+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.0xTJ8qAIO-rgDGIsVPr0ucUy2aAWIdN_0 2024-09-12T18:36:00.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.401+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6137411836989461011', time=2024-09-12T20:09:10.153086+0000, chain.objs.size()=1 2024-09-12T18:36:00.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.401+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.6oS19xB1p-CLpnVaOavPYUgEPGAiKuw_0 2024-09-12T18:36:00.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.405+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3925262126119151519', time=2024-09-12T20:09:10.324197+0000, chain.objs.size()=1 2024-09-12T18:36:00.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.405+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.V3xNzZb_ei5AkiLaHoAISqJS_yKud8D_0 2024-09-12T18:36:00.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.405+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7052955829728058907', time=2024-09-12T20:09:11.049238+0000, chain.objs.size()=1 2024-09-12T18:36:00.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.405+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.B6u_Ata-dmBeKymJ9Rt4_bt23n_4ccK_0 2024-09-12T18:36:00.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.405+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18058588656099905760', time=2024-09-12T20:09:17.311902+0000, chain.objs.size()=1 2024-09-12T18:36:00.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.405+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.VUSIIMvnBsf-5aNUAP5JHnVdpmL0_Z__0 2024-09-12T18:36:00.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.405+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10671114279882060691', time=2024-09-12T20:09:25.080479+0000, chain.objs.size()=1 2024-09-12T18:36:00.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.405+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.gc7xfINbk5bQ-1Q09_jHfQtHI8bplm7_0 2024-09-12T18:36:00.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.405+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.22835555590910307', time=2024-09-12T20:09:26.659485+0000, chain.objs.size()=1 2024-09-12T18:36:00.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.405+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.-LqN04dvz8H2PEVDkOYjZpZSgGucghV_0 2024-09-12T18:36:00.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.405+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3891023819867222732', time=2024-09-12T20:09:26.973179+0000, chain.objs.size()=1 2024-09-12T18:36:00.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.405+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.6MesBQXfikBKSsIZVjrUSpV66s8vbnH_0 2024-09-12T18:36:00.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.409+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2720089759532770595', time=2024-09-12T20:09:27.329179+0000, chain.objs.size()=1 2024-09-12T18:36:00.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.409+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.fyNjyTzdvtTmewuaAvaKKEvAYeTmleu_0 2024-09-12T18:36:00.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.409+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14172543180373131948', time=2024-09-12T20:09:29.578247+0000, chain.objs.size()=1 2024-09-12T18:36:00.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.409+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.HEIRM6xAaQCEMPvzOiq5lImFQ5UHxDP_0 2024-09-12T18:36:00.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.409+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5410304184256719203', time=2024-09-12T20:09:30.036775+0000, chain.objs.size()=1 2024-09-12T18:36:00.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.409+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.CTuRo_9O-YfHMzrR-N09Z3ob4RPQKAf_0 2024-09-12T18:36:00.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.409+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6273042242520535930', time=2024-09-12T20:09:30.148476+0000, chain.objs.size()=1 2024-09-12T18:36:00.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.409+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xhqUvwsuZ9uTlDgN0_1qAyRkwPaOGEm_0 2024-09-12T18:36:00.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.409+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9346028064993359145', time=2024-09-12T20:09:30.209001+0000, chain.objs.size()=1 2024-09-12T18:36:00.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.409+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.C5SoXD_kQ4zyW9ujsnr6EZfLQ5I951O_0 2024-09-12T18:36:00.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.413+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11413710139677871141', time=2024-09-12T20:09:59.085398+0000, chain.objs.size()=1 2024-09-12T18:36:00.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.413+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.347__shadow_.I3oU4lGS7tfs0XfVR6s6GB1wSxeOmQJ_0 2024-09-12T18:36:00.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.413+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8189702419441305673', time=2024-09-12T20:10:37.994388+0000, chain.objs.size()=1 2024-09-12T18:36:00.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.413+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.379__shadow_.FKsyVJkR44jEzo5bRgNjLgUWbNkoK10_0 2024-09-12T18:36:00.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.413+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15755401713027874584', time=2024-09-12T20:10:39.570134+0000, chain.objs.size()=1 2024-09-12T18:36:00.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.413+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.380__shadow_._Tnp1kqMAryTZs2J5n54SXRODKgxcvS_0 2024-09-12T18:36:00.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.413+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6800689915726390784', time=2024-09-12T20:12:41.166880+0000, chain.objs.size()=1 2024-09-12T18:36:00.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.413+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.464__shadow_.m6vseY1dQDNVqV8U8E1dDAohNE46rmr_0 2024-09-12T18:36:00.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.413+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13584732848177693267', time=2024-09-12T20:12:42.539259+0000, chain.objs.size()=1 2024-09-12T18:36:00.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.413+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.465__shadow_.bDTdTstM0EqlZu5BV5MFGfKKclU1sK8_0 2024-09-12T18:36:00.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.413+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5737608127811715860', time=2024-09-12T20:13:07.254289+0000, chain.objs.size()=1 2024-09-12T18:36:00.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.413+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.484__shadow_.35J9R6daJwV7yAQcQEO9hVtkYLrv-YH_0 2024-09-12T18:36:00.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.421+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/66326 2024-09-12T18:36:00.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:36:00.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5085735217821314645', time=2024-09-12T20:13:27.581767+0000, chain.objs.size()=1 2024-09-12T18:36:00.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.496__shadow_.8ZSbBa9UQbz5UE5F_hCxxyiQbUQ5OQ5_0 2024-09-12T18:36:00.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5381534361206164309', time=2024-09-12T20:13:40.621113+0000, chain.objs.size()=1 2024-09-12T18:36:00.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.504__shadow:p--u8yBdmzUFbtwCdiIMSfaVaX-Tsns_.K5_RZa2CGyb4Lrga0hcpjF_NIfZ0MyJ_0 2024-09-12T18:36:00.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13453186103738289802', time=2024-09-12T20:18:08.379075+0000, chain.objs.size()=1 2024-09-12T18:36:00.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.551__shadow_.7MgJgLznEVXMR-aSeeB1WubeH2YQdlq_0 2024-09-12T18:36:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17412696328711435789', time=2024-09-12T20:18:11.793846+0000, chain.objs.size()=1 2024-09-12T18:36:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.552__shadow_.e473M3L12Wrl6HIUSV3VfKF29rzstDM_0 2024-09-12T18:36:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10312340226879234803', time=2024-09-12T20:18:43.951994+0000, chain.objs.size()=1 2024-09-12T18:36:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.560__shadow_.-9gFo0UBbJIcXLNuNh2pNFj1MldUSL-_0 2024-09-12T18:36:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14328456349723972589', time=2024-09-12T20:18:49.654049+0000, chain.objs.size()=1 2024-09-12T18:36:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.563__shadow_.RWhy9IPeC3E4DxuZMOboBJc7jwBIz_1_0 2024-09-12T18:36:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17215791093033605197', time=2024-09-12T20:19:25.801524+0000, chain.objs.size()=1 2024-09-12T18:36:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:ZhnflQgJ-0.2iSKA.5VW8IckCbe26W._.G1yhg_XcYWvXVESys0rTmZRPpbShINS_0 2024-09-12T18:36:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1150987393220634051', time=2024-09-12T20:19:30.760414+0000, chain.objs.size()=1 2024-09-12T18:36:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.572__shadow_.CvoAhJltS8MvCmqDZZ6F6n-gw0TMTOe_0 2024-09-12T18:36:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14931141988058142387', time=2024-09-12T20:19:54.633794+0000, chain.objs.size()=1 2024-09-12T18:36:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.577__shadow:1XNYzSR4E5RdcSm5EHVhcDUoiV6yLGB_.FJAfSDAVvMIgEKjUm977AASZ0N8e5o0_0 2024-09-12T18:36:00.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7840317487529636543', time=2024-09-12T20:19:56.614572+0000, chain.objs.size()=1 2024-09-12T18:36:00.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.577__shadow:PAcoo-zxphLXxSxJGeqSC.rLEjpo4Gd_.7KkHJAxq8xSfStPpzBmE5SVgCOhGd4Y_0 2024-09-12T18:36:00.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1378902316396637515', time=2024-09-12T20:21:07.009930+0000, chain.objs.size()=1 2024-09-12T18:36:00.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.580__shadow:gKJIFmI4cfP3ZqKgfD5gpJ1cVs4LlzU_.4SHfu6yKYRFccxhZVnzrSoJm45S1WtA_0 2024-09-12T18:36:00.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8468736776266217268', time=2024-09-12T20:23:17.090257+0000, chain.objs.size()=12 2024-09-12T18:36:00.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.425+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.615__multipart_multipart_enc.2~yZ498SCqjYoWONIF8J7FvRfidKcCblB.1 2024-09-12T18:36:00.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.429+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.615__shadow_multipart_enc.2~yZ498SCqjYoWONIF8J7FvRfidKcCblB.1_1 2024-09-12T18:36:00.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.429+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.615__multipart_multipart_enc.2~yZ498SCqjYoWONIF8J7FvRfidKcCblB.2 2024-09-12T18:36:00.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.429+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.615__shadow_multipart_enc.2~yZ498SCqjYoWONIF8J7FvRfidKcCblB.2_1 2024-09-12T18:36:00.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.429+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.615__multipart_multipart_enc.2~yZ498SCqjYoWONIF8J7FvRfidKcCblB.3 2024-09-12T18:36:00.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.433+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.615__shadow_multipart_enc.2~yZ498SCqjYoWONIF8J7FvRfidKcCblB.3_1 2024-09-12T18:36:00.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.433+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.615__multipart_multipart_enc.2~yZ498SCqjYoWONIF8J7FvRfidKcCblB.4 2024-09-12T18:36:00.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.433+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.615__shadow_multipart_enc.2~yZ498SCqjYoWONIF8J7FvRfidKcCblB.4_1 2024-09-12T18:36:00.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.433+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.615__multipart_multipart_enc.2~yZ498SCqjYoWONIF8J7FvRfidKcCblB.5 2024-09-12T18:36:00.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.433+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.615__shadow_multipart_enc.2~yZ498SCqjYoWONIF8J7FvRfidKcCblB.5_1 2024-09-12T18:36:00.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.433+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.615__multipart_multipart_enc.2~yZ498SCqjYoWONIF8J7FvRfidKcCblB.6 2024-09-12T18:36:00.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.433+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.615__shadow_multipart_enc.2~yZ498SCqjYoWONIF8J7FvRfidKcCblB.6_1 2024-09-12T18:36:00.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.433+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14037165748247936782', time=2024-09-12T20:28:01.114305+0000, chain.objs.size()=1 2024-09-12T18:36:00.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.433+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.669__shadow_.gdiMzziFs3Mo2iIKWCig18O3laA88FL_0 2024-09-12T18:36:00.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.437+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5948156869810870905', time=2024-09-12T20:28:28.899428+0000, chain.objs.size()=1 2024-09-12T18:36:00.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.437+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.692__shadow_.PdjhANurpMFC81nNBBhHbjzUlqjaWe9_0 2024-09-12T18:36:00.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.437+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17454241848855206512', time=2024-09-12T20:30:06.893583+0000, chain.objs.size()=1 2024-09-12T18:36:00.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.437+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.740__shadow_.IjaT7XjjWNhKrGnsjgHojs1OzW8vAvP_0 2024-09-12T18:36:00.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.437+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7071767214284829960', time=2024-09-12T20:30:10.550765+0000, chain.objs.size()=1 2024-09-12T18:36:00.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.437+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.742__shadow_.k87NkByejD_Q2PgOLHRYhLGppqEu-DU_0 2024-09-12T18:36:00.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.445+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:00.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.453+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:36:00.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.453+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:00.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.453+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:00.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/55466' 2024-09-12T18:36:00.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11590468262697067468', time=2024-09-12T19:55:47.440688+0000, chain.objs.size()=1 2024-09-12T18:36:00.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.158__shadow:QTXIMc7ce94yCkR2xbyH4TZ6OBHsa25_.JVWAZNP5dxr4wiIX32ZgydZpcsQE2EK_0 2024-09-12T18:36:00.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17046856440867701971', time=2024-09-12T20:00:28.034958+0000, chain.objs.size()=1 2024-09-12T18:36:00.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.238__shadow_.VSY4dU30HQ4QkBqkxr9nqbvHam-N2su_0 2024-09-12T18:36:00.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11668382108892214006', time=2024-09-12T20:00:49.848580+0000, chain.objs.size()=1 2024-09-12T18:36:00.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.250__shadow_.Bov4NOOktkDIRoCY_keFkD5GY_-tXOV_0 2024-09-12T18:36:00.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8138402698834350480', time=2024-09-12T20:00:53.223958+0000, chain.objs.size()=1 2024-09-12T18:36:00.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.252__shadow_.Wgh-zcOZIPZCd65ARh3t1LguV7vdzJL_0 2024-09-12T18:36:00.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5664722108462456268', time=2024-09-12T20:00:56.577267+0000, chain.objs.size()=1 2024-09-12T18:36:00.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.254__shadow_.ZUMUyl5cgDxI9qwLxjeEKK72qxoaBwc_0 2024-09-12T18:36:00.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.556748076033676821', time=2024-09-12T20:02:52.046158+0000, chain.objs.size()=1 2024-09-12T18:36:00.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XQw3tqkfMu-LKEESiUMtkz3Xb23sb6i_0 2024-09-12T18:36:00.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5410313360526154872', time=2024-09-12T20:02:52.048287+0000, chain.objs.size()=1 2024-09-12T18:36:00.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.DhQScENMNN8EA5FlJrC72m61t6uEAZW_0 2024-09-12T18:36:00.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10719112267934837131', time=2024-09-12T20:02:53.088766+0000, chain.objs.size()=1 2024-09-12T18:36:00.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.fa-Xl0DKcsQxkBV_YEVY0kV5IoQeFNy_0 2024-09-12T18:36:00.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4506636111691485153', time=2024-09-12T20:02:55.868706+0000, chain.objs.size()=1 2024-09-12T18:36:00.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.p_GULMmSMHEfoCpMJ0SlbiMDiV-M4pt_0 2024-09-12T18:36:00.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4954852873514595291', time=2024-09-12T20:02:56.375045+0000, chain.objs.size()=1 2024-09-12T18:36:00.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.OaakEydYyIi3eb1dj58FlcoQxej4HTU_0 2024-09-12T18:36:00.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10285039620558701601', time=2024-09-12T20:02:57.377896+0000, chain.objs.size()=1 2024-09-12T18:36:00.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.d2H-lafIcSne5G4ueKomvekRWTgt8P4_0 2024-09-12T18:36:00.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2667957760092701663', time=2024-09-12T20:02:57.814131+0000, chain.objs.size()=1 2024-09-12T18:36:00.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.457+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.LutuqC_hSNbfVD7jyOKEk8_AI2RuyVu_0 2024-09-12T18:36:00.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.461+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17065324431512019706', time=2024-09-12T20:02:59.877781+0000, chain.objs.size()=1 2024-09-12T18:36:00.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.461+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.DCd510DVmd6Qe6g8ItgHjU_1ZVk7ONY_0 2024-09-12T18:36:00.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.461+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14958191296023165982', time=2024-09-12T20:03:00.245940+0000, chain.objs.size()=1 2024-09-12T18:36:00.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.461+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3UdXIX8W4AkOlAvVReUaSMmCiCGcqYg_0 2024-09-12T18:36:00.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6081814366675657082', time=2024-09-12T20:03:01.860552+0000, chain.objs.size()=1 2024-09-12T18:36:00.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.vYqKix1UdSs0IXfNhSKRnAbWGkN9zKv_0 2024-09-12T18:36:00.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10017533933083886947', time=2024-09-12T20:03:01.862995+0000, chain.objs.size()=1 2024-09-12T18:36:00.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.HX19--QOV1C5779-v8QND2CkfmX3bv-_0 2024-09-12T18:36:00.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6558859773734230236', time=2024-09-12T20:03:03.849840+0000, chain.objs.size()=1 2024-09-12T18:36:00.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.gYJImVHabFIgQ8auDPm2CI4_u0Wrkmu_0 2024-09-12T18:36:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2819159642016927105', time=2024-09-12T20:03:05.192427+0000, chain.objs.size()=1 2024-09-12T18:36:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.HHh0piOWobpltLEBPiDCrKGyoVmvv9g_0 2024-09-12T18:36:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18331977382411058686', time=2024-09-12T20:03:06.387522+0000, chain.objs.size()=1 2024-09-12T18:36:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.0cv8dSdz2HuvnU56qROFBE6x5VIj2g5_0 2024-09-12T18:36:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1254598397342993687', time=2024-09-12T20:03:07.355390+0000, chain.objs.size()=1 2024-09-12T18:36:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.fLDtyVnfXDbiK9lDJ7aqSIskFKP39GP_0 2024-09-12T18:36:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14770769317118849403', time=2024-09-12T20:03:07.650759+0000, chain.objs.size()=1 2024-09-12T18:36:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.4UJNsKEFM1DoRyYjLEB2Xv-Y8x4vdBV_0 2024-09-12T18:36:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7607036978636481487', time=2024-09-12T20:03:09.059369+0000, chain.objs.size()=1 2024-09-12T18:36:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.15HreNwiNv5PCBaAbOEte1Z9nOFk0xw_0 2024-09-12T18:36:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9226766161321095234', time=2024-09-12T20:03:10.096528+0000, chain.objs.size()=1 2024-09-12T18:36:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.9zS47W8_ZV7GSNhq4qC42s1WdQCFybn_0 2024-09-12T18:36:00.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1711954463677029933', time=2024-09-12T20:03:11.320264+0000, chain.objs.size()=1 2024-09-12T18:36:00.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Yhi1onwS33vVB4eQ-P1PtcnVHu62boA_0 2024-09-12T18:36:00.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13636927732873527398', time=2024-09-12T20:03:11.322386+0000, chain.objs.size()=1 2024-09-12T18:36:00.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.465+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.zZa74QLvIjsfGPHRfzeKXTIIOJAT88K_0 2024-09-12T18:36:00.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.469+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7477430571723996113', time=2024-09-12T20:03:11.746957+0000, chain.objs.size()=1 2024-09-12T18:36:00.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.469+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.t8typIr8I9z84lUX6XJcqE3zoH0zdKi_0 2024-09-12T18:36:00.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17210837110138295109', time=2024-09-12T20:03:12.142812+0000, chain.objs.size()=1 2024-09-12T18:36:00.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.SjtM9WYwd1VERnXMHxkYRHWN997RuMM_0 2024-09-12T18:36:00.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9054799504805393701', time=2024-09-12T20:03:13.229184+0000, chain.objs.size()=1 2024-09-12T18:36:00.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3dfKPQFAOJv6_K769BVcGkFFclvkgg7_0 2024-09-12T18:36:00.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17721480724431222281', time=2024-09-12T20:03:14.780175+0000, chain.objs.size()=1 2024-09-12T18:36:00.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.AifBObFgVIgcMbFsUXFgGpgQJJz65II_0 2024-09-12T18:36:00.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5803890757215116995', time=2024-09-12T20:03:15.558786+0000, chain.objs.size()=1 2024-09-12T18:36:00.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.s8fbH-B0X8Zi77prIioX3GEMG3zYhJm_0 2024-09-12T18:36:00.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6521281515862560655', time=2024-09-12T20:03:15.772083+0000, chain.objs.size()=1 2024-09-12T18:36:00.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.4GZtGdifXLmS6PwgxCXQVrqcDVvuy5I_0 2024-09-12T18:36:00.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7463893489082604175', time=2024-09-12T20:03:16.007588+0000, chain.objs.size()=1 2024-09-12T18:36:00.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ILIF01Db43aY2P-WfeKV7z92l2klxeg_0 2024-09-12T18:36:00.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14700359060846985739', time=2024-09-12T20:03:16.391392+0000, chain.objs.size()=1 2024-09-12T18:36:00.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.v0KECebR48rqg02BBT6OTxJfCxsAtrM_0 2024-09-12T18:36:00.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11890233212348727946', time=2024-09-12T20:03:17.137261+0000, chain.objs.size()=1 2024-09-12T18:36:00.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.NxJBZqo7EAgmjGlZVHEkfVrqq5DqXf3_0 2024-09-12T18:36:00.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7032837042600399712', time=2024-09-12T20:03:18.406189+0000, chain.objs.size()=1 2024-09-12T18:36:00.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2LZa7WLMsk0XpDo0jXiVEjGBJtb-Qax_0 2024-09-12T18:36:00.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9152834708686224869', time=2024-09-12T20:03:26.945812+0000, chain.objs.size()=1 2024-09-12T18:36:00.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.473+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.267__shadow_.UkogwwID3og1xqknQwgf1gfSoHT1KzG_0 2024-09-12T18:36:00.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.477+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10336043630353261888', time=2024-09-12T20:03:33.180058+0000, chain.objs.size()=1 2024-09-12T18:36:00.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.477+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.271__shadow_.NMoRmbjMzCdPECbsPwYnfsE96tCC2b8_0 2024-09-12T18:36:00.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.477+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16507712993723689230', time=2024-09-12T20:03:41.028526+0000, chain.objs.size()=1 2024-09-12T18:36:00.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.477+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.276__shadow_.GCOk4xvp0ehTTG4hux_Oj_HqderU3Kt_0 2024-09-12T18:36:00.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.477+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13235353501914702390', time=2024-09-12T20:03:51.097607+0000, chain.objs.size()=1 2024-09-12T18:36:00.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.477+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.282__shadow_.k8ACUDmiOVZgYhHpLAIb_clRzh7YSwv_0 2024-09-12T18:36:00.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.477+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12224240997330755782', time=2024-09-12T20:03:51.103930+0000, chain.objs.size()=1 2024-09-12T18:36:00.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.477+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.282__shadow_.ofzY8hW85ZITcHQ6wYx5BYszX80hmEE_0 2024-09-12T18:36:00.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.477+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15996882334288789405', time=2024-09-12T20:04:12.949162+0000, chain.objs.size()=1 2024-09-12T18:36:00.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.477+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.x5PNJXnwpY0azwlLBnI_T0_5JBvv3eS_0 2024-09-12T18:36:00.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.481+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3902213098245710747', time=2024-09-12T20:04:13.229036+0000, chain.objs.size()=1 2024-09-12T18:36:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.P1SgeWKV_UYu7eG-3i2FktEZsnmjOiM_0 2024-09-12T18:36:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.481+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4245474883590375775', time=2024-09-12T20:04:24.950007+0000, chain.objs.size()=1 2024-09-12T18:36:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.298__shadow_.sMHmSH3R3z8H9BQJkealid4JESSuygf_0 2024-09-12T18:36:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.481+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16012493436360298684', time=2024-09-12T20:04:26.730546+0000, chain.objs.size()=1 2024-09-12T18:36:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.299__shadow_.8O_IG66ClEa28B3NFZGESSm0DuhfX_0_0 2024-09-12T18:36:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.481+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4393160931460242464', time=2024-09-12T20:04:31.903346+0000, chain.objs.size()=1 2024-09-12T18:36:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.302__shadow_.ic7g8vXsjyc8eyyI3KLh9FrFRJeV8rF_0 2024-09-12T18:36:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.481+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13963546681766512481', time=2024-09-12T20:04:31.915994+0000, chain.objs.size()=1 2024-09-12T18:36:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.302__shadow_.n9OFO3xp5PMtejCIjCoCz52egK4x2Xi_0 2024-09-12T18:36:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.481+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4122429369737250829', time=2024-09-12T20:06:51.725131+0000, chain.objs.size()=1 2024-09-12T18:36:00.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.a1eMlmekMKSNHBqHIsyT0O2shDX2v34_0 2024-09-12T18:36:00.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.481+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8402890508217380274', time=2024-09-12T20:06:52.790821+0000, chain.objs.size()=1 2024-09-12T18:36:00.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.481+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_._mEfQDV9ysRbmv60sNxe9HhDSkEYOG-_0 2024-09-12T18:36:00.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14061229805095557946', time=2024-09-12T20:06:53.501285+0000, chain.objs.size()=1 2024-09-12T18:36:00.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.KtL7hydO57xuFEnFjTPbcMSR85270P2_0 2024-09-12T18:36:00.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10474857250035998137', time=2024-09-12T20:06:57.509737+0000, chain.objs.size()=1 2024-09-12T18:36:00.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.RzoevGtwZQdfGcqwefEUJ0wg8xylC9v_0 2024-09-12T18:36:00.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18441297102020484319', time=2024-09-12T20:06:57.743346+0000, chain.objs.size()=1 2024-09-12T18:36:00.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.TeKsRtrL5MfDiSIxYB6MpMvFPMvbnC4_0 2024-09-12T18:36:00.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4704049761659095749', time=2024-09-12T20:06:58.853809+0000, chain.objs.size()=1 2024-09-12T18:36:00.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.IhhRV0Vp4dwFgtRQ64QDT9ZqD1O7RGZ_0 2024-09-12T18:36:00.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14781001819620445104', time=2024-09-12T20:06:59.726405+0000, chain.objs.size()=1 2024-09-12T18:36:00.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.9ifpQsrmLMkCZKIV--Vtwzpc1H0hlRf_0 2024-09-12T18:36:00.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3390381488849617204', time=2024-09-12T20:06:59.960808+0000, chain.objs.size()=1 2024-09-12T18:36:00.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.KKBOC4lq8AIXiOOFAMh20Ucrm6kb6KT_0 2024-09-12T18:36:00.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18327816480023093728', time=2024-09-12T20:06:59.970301+0000, chain.objs.size()=1 2024-09-12T18:36:00.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ErYv0Hdx8xtvag782VatWi0btrs4pF6_0 2024-09-12T18:36:00.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8917605740419438476', time=2024-09-12T20:07:00.680774+0000, chain.objs.size()=1 2024-09-12T18:36:00.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.iu4IK7bYKSvHwvB-rgaZqbsK5qrRXBj_0 2024-09-12T18:36:00.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9673022989675636849', time=2024-09-12T20:07:01.224493+0000, chain.objs.size()=1 2024-09-12T18:36:00.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Izu04mKQf9wP4n5P2dHE5YROPEf9Y4Y_0 2024-09-12T18:36:00.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8032280079114548887', time=2024-09-12T20:07:03.389429+0000, chain.objs.size()=1 2024-09-12T18:36:00.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.485+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.xLOjaWdEZygMBO6oyNAa6gmqsnaDPvA_0 2024-09-12T18:36:00.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.489+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12780249834988428283', time=2024-09-12T20:07:03.449258+0000, chain.objs.size()=1 2024-09-12T18:36:00.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.489+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.1YeIoGvvuZ_oIRH7wKNMF7k-WtS4e9R_0 2024-09-12T18:36:00.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.493+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16379998249092837443', time=2024-09-12T20:07:03.623572+0000, chain.objs.size()=1 2024-09-12T18:36:00.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.493+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.KYClj-zH7Kf10vyhfx8nn3BLJd2F8Sv_0 2024-09-12T18:36:00.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.493+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17624985974165439721', time=2024-09-12T20:07:03.992785+0000, chain.objs.size()=1 2024-09-12T18:36:00.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.493+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.XqgnJgkWRQT2_nszLSELdwweyKwXYG2_0 2024-09-12T18:36:00.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.493+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14105691313024620491', time=2024-09-12T20:07:04.813372+0000, chain.objs.size()=1 2024-09-12T18:36:00.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.493+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.wky1PYHCJ77U-zTUDBkiK55pH9QSFDy_0 2024-09-12T18:36:00.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.493+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14072434236237242329', time=2024-09-12T20:07:07.767194+0000, chain.objs.size()=1 2024-09-12T18:36:00.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.493+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.GiHykROJz7VN7jlAmLGiqtNEBuQJ1FZ_0 2024-09-12T18:36:00.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.493+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16614412666142766418', time=2024-09-12T20:07:08.270210+0000, chain.objs.size()=1 2024-09-12T18:36:00.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.493+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.UY-ihbORPJkdWQKyL-m_k0DborcYKhr_0 2024-09-12T18:36:00.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.493+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10937881139153474354', time=2024-09-12T20:07:09.976953+0000, chain.objs.size()=1 2024-09-12T18:36:00.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.493+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.2WUDmZQ4Iw6ucANPr-BddKXIHVNZumF_0 2024-09-12T18:36:00.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.493+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3833886677628551893', time=2024-09-12T20:07:10.208982+0000, chain.objs.size()=1 2024-09-12T18:36:00.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.493+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.V9GyWGNVuVVBQPhh_YZRCZ5UpCbnaSW_0 2024-09-12T18:36:00.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.497+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15833467424012572729', time=2024-09-12T20:07:10.631015+0000, chain.objs.size()=1 2024-09-12T18:36:00.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.497+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.PgEiP61syxBYLFKAikuYhTl3wSBHFNd_0 2024-09-12T18:36:00.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.497+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3965154098831517295', time=2024-09-12T20:07:10.829818+0000, chain.objs.size()=1 2024-09-12T18:36:00.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.497+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.5cB8HQzE8qrn6krJ25TVOkG6ZzFDTu6_0 2024-09-12T18:36:00.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.497+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5117621330319413577', time=2024-09-12T20:07:11.402239+0000, chain.objs.size()=1 2024-09-12T18:36:00.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.497+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.3cAjhV_9capyNw4QfTulGSiPvne7IFb_0 2024-09-12T18:36:00.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.497+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2292527530365348181', time=2024-09-12T20:07:12.279735+0000, chain.objs.size()=1 2024-09-12T18:36:00.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.497+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.TIAumMoQ9eCpg74LkPVEDsf2Oi7A9P9_0 2024-09-12T18:36:00.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.497+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15281329881126740900', time=2024-09-12T20:07:12.433683+0000, chain.objs.size()=1 2024-09-12T18:36:00.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.497+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.uzjFCgrRQa-ItuPzD7wNg-FQewfJzIP_0 2024-09-12T18:36:00.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.497+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16272199951949462738', time=2024-09-12T20:07:12.435732+0000, chain.objs.size()=1 2024-09-12T18:36:00.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.497+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.IkPY7zPRgJS6DDUe3_Keqrnw-eCDZFk_0 2024-09-12T18:36:00.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.497+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10637876921443841975', time=2024-09-12T20:07:12.606465+0000, chain.objs.size()=1 2024-09-12T18:36:00.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.497+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ReoZycmUWP8xPzaL0mu7W92eVGDM4qL_0 2024-09-12T18:36:00.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.497+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9606857547224455471', time=2024-09-12T20:07:12.608312+0000, chain.objs.size()=1 2024-09-12T18:36:00.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.497+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.gfSonK1wAKSh4QyW3GjjS9SYtiJvYlW_0 2024-09-12T18:36:00.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3962530703687979429', time=2024-09-12T20:07:12.659379+0000, chain.objs.size()=1 2024-09-12T18:36:00.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.qq6OmFgmmy-TS5wXcNsQW9y_FgcIDaA_0 2024-09-12T18:36:00.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9627496053084262455', time=2024-09-12T20:07:13.371231+0000, chain.objs.size()=1 2024-09-12T18:36:00.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.hbohpOHFneR5Qs8dpVKe0N6M8EI5L8a_0 2024-09-12T18:36:00.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3281038649250314573', time=2024-09-12T20:07:13.728309+0000, chain.objs.size()=1 2024-09-12T18:36:00.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.jbf7T6f4VQhdZRAp08SmvRqxtcBNdkw_0 2024-09-12T18:36:00.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17208464972547775049', time=2024-09-12T20:07:15.672708+0000, chain.objs.size()=1 2024-09-12T18:36:00.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7ZLJ_gicrDV-KQ1la07-Sld1C-6WLXL_0 2024-09-12T18:36:00.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4147275080242306710', time=2024-09-12T20:07:15.982416+0000, chain.objs.size()=1 2024-09-12T18:36:00.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.27jd9Lh4MtVjDETZJN1Xawc3sQYxGr9_0 2024-09-12T18:36:00.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.191576801718515900', time=2024-09-12T20:07:17.238691+0000, chain.objs.size()=1 2024-09-12T18:36:00.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.uBZUbe9dXLNW1wENhaBiVoc6r5UiLID_0 2024-09-12T18:36:00.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.501+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17979957555490909069', time=2024-09-12T20:07:17.352484+0000, chain.objs.size()=1 2024-09-12T18:36:00.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.501+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.iOW2JaPmCzWAjX3khU7EgPhWcgEi9bj_0 2024-09-12T18:36:00.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7196381157241387939', time=2024-09-12T20:09:01.905643+0000, chain.objs.size()=1 2024-09-12T18:36:00.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xYpI8MktA-0DE4fdrnN4xEoA2sgx_rG_0 2024-09-12T18:36:00.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12677821294008084896', time=2024-09-12T20:09:01.907715+0000, chain.objs.size()=1 2024-09-12T18:36:00.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.72AOLwgoX8-57Z1ZFNlwqbyxq3ohT_l_0 2024-09-12T18:36:00.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10658374965741502782', time=2024-09-12T20:09:03.317730+0000, chain.objs.size()=1 2024-09-12T18:36:00.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.gxXMRcRnv67KpbH7VlLo_FdKPtU5Q8-_0 2024-09-12T18:36:00.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5702110939614150819', time=2024-09-12T20:09:04.012198+0000, chain.objs.size()=1 2024-09-12T18:36:00.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.EhG0aKiseqmtkKYO5a5yotsMet3Fpar_0 2024-09-12T18:36:00.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14623479953385177227', time=2024-09-12T20:09:04.160692+0000, chain.objs.size()=1 2024-09-12T18:36:00.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vzEYQOGCa73_NrXVeqgYzdN82LJzdXQ_0 2024-09-12T18:36:00.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9805614772260550928', time=2024-09-12T20:09:04.197749+0000, chain.objs.size()=1 2024-09-12T18:36:00.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.VWIB2mPwV12KgM35PaDFr6MZFG3xFmT_0 2024-09-12T18:36:00.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4083467213181073599', time=2024-09-12T20:09:09.981080+0000, chain.objs.size()=1 2024-09-12T18:36:00.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.PAK2DIFCy_QJWwmz99-TbPxARsuYpKX_0 2024-09-12T18:36:00.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10321704009612529808', time=2024-09-12T20:09:10.901521+0000, chain.objs.size()=1 2024-09-12T18:36:00.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.RlmLejBSp0p-iOaxP2chH1ZEh_RmCkm_0 2024-09-12T18:36:00.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.683521798850959502', time=2024-09-12T20:09:11.771533+0000, chain.objs.size()=1 2024-09-12T18:36:00.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.sz-aWWdCVlSXdwK9yxNiTjDGZ6qclak_0 2024-09-12T18:36:00.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5774352966527531159', time=2024-09-12T20:09:12.072251+0000, chain.objs.size()=1 2024-09-12T18:36:00.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ou7gYe7nZzU02VjiyXIvfxbsLOUu4Ju_0 2024-09-12T18:36:00.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8386215895201480481', time=2024-09-12T20:09:12.240429+0000, chain.objs.size()=1 2024-09-12T18:36:00.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.505+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.bxjy9TjeWq2dTIcV8-Mh1Xmfqpe-ZDA_0 2024-09-12T18:36:00.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.509+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2697184330719621027', time=2024-09-12T20:09:14.829756+0000, chain.objs.size()=1 2024-09-12T18:36:00.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.509+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.oKXUeLMxt_nbLQkB6Ud8ZDWnnssXPA8_0 2024-09-12T18:36:00.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.509+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6165536673311410108', time=2024-09-12T20:09:15.548318+0000, chain.objs.size()=1 2024-09-12T18:36:00.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.509+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ggwGg6Xjpz2qa7ulbUWw2lyDBLj6BKK_0 2024-09-12T18:36:00.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.509+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8729575295179236624', time=2024-09-12T20:09:18.736355+0000, chain.objs.size()=1 2024-09-12T18:36:00.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.509+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.UUu7xptdITjmqlEKhLtvwOaRofSkhL6_0 2024-09-12T18:36:00.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.509+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9055633258971318651', time=2024-09-12T20:09:18.876349+0000, chain.objs.size()=1 2024-09-12T18:36:00.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.509+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.po4cYTJfP9FyyGihTjnm86N9ADMBPzd_0 2024-09-12T18:36:00.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.509+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13755277741280883048', time=2024-09-12T20:09:19.500028+0000, chain.objs.size()=1 2024-09-12T18:36:00.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.509+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cfLA75e_I4U9b-oj1J5DcfeI3dzMI_o_0 2024-09-12T18:36:00.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.513+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6248503929525356987', time=2024-09-12T20:09:19.706255+0000, chain.objs.size()=1 2024-09-12T18:36:00.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.513+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.XdJ5rZqOpM9mC215VWOaquibWVOr9a2_0 2024-09-12T18:36:00.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.513+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4991455871972990393', time=2024-09-12T20:09:20.629426+0000, chain.objs.size()=1 2024-09-12T18:36:00.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.513+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.0E9kOgvvPitUYIQRie6v8D7mEKQsxbL_0 2024-09-12T18:36:00.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.513+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17948337101683865761', time=2024-09-12T20:09:22.424111+0000, chain.objs.size()=1 2024-09-12T18:36:00.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.513+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.o8STICSKYFiYGTsZrgwLMUP66pQILIi_0 2024-09-12T18:36:00.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.517+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/55466 2024-09-12T18:36:00.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T18:36:00.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10998134562249704225', time=2024-09-12T20:09:22.848163+0000, chain.objs.size()=1 2024-09-12T18:36:00.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5Uj-6HnBN_iV0Mn3vHaniWLKWgdiGrE_0 2024-09-12T18:36:00.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8149846945646639085', time=2024-09-12T20:09:23.623331+0000, chain.objs.size()=1 2024-09-12T18:36:00.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.akI-82NN6NZQAuLBMZLqN4sp2RNFx-D_0 2024-09-12T18:36:00.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12232436015827441031', time=2024-09-12T20:09:24.946431+0000, chain.objs.size()=1 2024-09-12T18:36:00.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ov0EkMm3FP8Clh4uuqHK2Bh-igLVFG3_0 2024-09-12T18:36:00.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.479166587746155634', time=2024-09-12T20:09:26.426699+0000, chain.objs.size()=1 2024-09-12T18:36:00.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.R7kShXpNoyo9SeBL4JEL2Hgdt-j21j0_0 2024-09-12T18:36:00.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6319541825017150308', time=2024-09-12T20:09:27.296464+0000, chain.objs.size()=1 2024-09-12T18:36:00.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.tRaEtGCMNHyDFh_N6l1QVV3eMpLGwrQ_0 2024-09-12T18:36:00.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4167990479503333812', time=2024-09-12T20:09:27.993596+0000, chain.objs.size()=1 2024-09-12T18:36:00.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.snPFQGDumbyCFGq4svpiBFwEIc6fkw1_0 2024-09-12T18:36:00.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12380646723828014668', time=2024-09-12T20:09:28.747912+0000, chain.objs.size()=1 2024-09-12T18:36:00.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.DE95JNOlfOIM4NNpq-DnFsT16MErRj4_0 2024-09-12T18:36:00.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3868328034343312736', time=2024-09-12T20:09:29.277539+0000, chain.objs.size()=1 2024-09-12T18:36:00.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.dweASfNneuImmfYmne47_1f22Yrycs9_0 2024-09-12T18:36:00.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10747487230077065303', time=2024-09-12T20:09:29.675132+0000, chain.objs.size()=1 2024-09-12T18:36:00.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.TK0VzWzBwJKa8-psqKcEiH7lSu0HEWU_0 2024-09-12T18:36:00.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17118876609509249269', time=2024-09-12T20:09:29.798605+0000, chain.objs.size()=1 2024-09-12T18:36:00.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.P7XA1MslcRARZFypcrZyVsZz4wQIJ9p_0 2024-09-12T18:36:00.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11310377498859247077', time=2024-09-12T20:09:30.169613+0000, chain.objs.size()=1 2024-09-12T18:36:00.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Yznx6QbuT69vwKXTFVILf3sqrxcOyXx_0 2024-09-12T18:36:00.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13674671157152554468', time=2024-09-12T20:09:47.660586+0000, chain.objs.size()=1 2024-09-12T18:36:00.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.525+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.338__shadow_.RcRf3iFnmr9aGe_uCkzioxjh_2-zc4f_0 2024-09-12T18:36:00.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1551094960827492790', time=2024-09-12T20:10:42.349624+0000, chain.objs.size()=1 2024-09-12T18:36:00.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.382__shadow_.mnYkJy_UwQZv4Fj7OXhL3QueJsdndgQ_0 2024-09-12T18:36:00.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8444708011441057512', time=2024-09-12T20:12:08.641672+0000, chain.objs.size()=1 2024-09-12T18:36:00.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.445__shadow_.fxjLWA8cL-fdA6ZU7_zmVBdoCEMh41H_0 2024-09-12T18:36:00.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6539646134425072782', time=2024-09-12T20:13:09.187332+0000, chain.objs.size()=1 2024-09-12T18:36:00.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.485__shadow_.0rKucW18IoY_8CG7F9EcHXQyhy7qX4l_0 2024-09-12T18:36:00.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2701810811205829997', time=2024-09-12T20:13:28.872909+0000, chain.objs.size()=1 2024-09-12T18:36:00.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.497__shadow_.jbnJkG3iatHGBXOj2pLszSXTsG2jUAU_0 2024-09-12T18:36:00.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13590935248248932140', time=2024-09-12T20:13:29.293239+0000, chain.objs.size()=1 2024-09-12T18:36:00.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.497__shadow_.jbnJkG3iatHGBXOj2pLszSXTsG2jUAU_0 2024-09-12T18:36:00.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1605839581401343693', time=2024-09-12T20:18:46.013255+0000, chain.objs.size()=1 2024-09-12T18:36:00.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.561__shadow_.4OnbDOnxaHxVnCO9e7Qg_tNjRni-2ZM_0 2024-09-12T18:36:00.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16615145562949899417', time=2024-09-12T20:19:11.303060+0000, chain.objs.size()=1 2024-09-12T18:36:00.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:MpfCWeqMDlRszqDlmeIU9hbPID9Wsgn_.BhWVe-7Wf8qD7_tnA-lW3NryoSFNQQe_0 2024-09-12T18:36:00.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10282179835007765242', time=2024-09-12T20:19:35.298811+0000, chain.objs.size()=1 2024-09-12T18:36:00.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.574__shadow_.XLKe7gQVJJls4Bce2zP0t8QDgCaNTTZ_0 2024-09-12T18:36:00.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15103766323030093334', time=2024-09-12T20:20:37.845462+0000, chain.objs.size()=1 2024-09-12T18:36:00.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:u6BEtuFj6gDPseg5zMNbA8TEt.NnAMv_.W5l_7klpsgGKL_4xbcdh1O-nh16TMs-_0 2024-09-12T18:36:00.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17564242469990797108', time=2024-09-12T20:21:11.607137+0000, chain.objs.size()=1 2024-09-12T18:36:00.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.529+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.581__shadow:hLCzKGGx8ZW.JyQVwyUyeA5mPAp2.2e_.k1GlvoeOKVIPT3Gg_OCwHp3-txOgAl4_0 2024-09-12T18:36:00.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.533+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9897214918018565656', time=2024-09-12T20:21:12.613934+0000, chain.objs.size()=1 2024-09-12T18:36:00.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.533+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.581__shadow:hLCzKGGx8ZW.JyQVwyUyeA5mPAp2.2e_.k1GlvoeOKVIPT3Gg_OCwHp3-txOgAl4_0 2024-09-12T18:36:00.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.533+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7926775656055168304', time=2024-09-12T20:21:27.384792+0000, chain.objs.size()=1 2024-09-12T18:36:00.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.533+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.588__shadow:GjMAMvyigin5PGajELoHUa8.QN54.er_.1Gx91jXztpRCd55aDouP4PhKr5sUSZS_0 2024-09-12T18:36:00.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.537+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3008945941610114824', time=2024-09-12T20:26:32.360192+0000, chain.objs.size()=1 2024-09-12T18:36:00.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.631__shadow_.ODZ-DuYr8uxBogGQEMYX23xIMrOmqnQ_0 2024-09-12T18:36:00.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.537+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1386045858541454056', time=2024-09-12T20:27:49.217365+0000, chain.objs.size()=6 2024-09-12T18:36:00.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.663__multipart_foo.2~F98gPamaTVON37ioqfLY3CHIfaF7LLU.1 2024-09-12T18:36:00.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.663__multipart_foo.2~F98gPamaTVON37ioqfLY3CHIfaF7LLU.2 2024-09-12T18:36:00.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.663__multipart_foo.2~F98gPamaTVON37ioqfLY3CHIfaF7LLU.3 2024-09-12T18:36:00.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.663__multipart_foo.2~F98gPamaTVON37ioqfLY3CHIfaF7LLU.4 2024-09-12T18:36:00.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.663__multipart_foo.2~F98gPamaTVON37ioqfLY3CHIfaF7LLU.5 2024-09-12T18:36:00.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.663__multipart_foo.2~F98gPamaTVON37ioqfLY3CHIfaF7LLU.6 2024-09-12T18:36:00.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.537+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16523131415612037184', time=2024-09-12T20:27:58.380243+0000, chain.objs.size()=1 2024-09-12T18:36:00.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.537+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.667__shadow_.zU0y-69Sxus-d72Snmg1olNCEutGjkz_0 2024-09-12T18:36:00.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.549+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:00.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.553+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:36:00.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.553+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:00.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.553+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:00.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47331' 2024-09-12T18:36:00.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14297832879444786308', time=2024-09-12T19:56:52.178772+0000, chain.objs.size()=1 2024-09-12T18:36:00.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.179__shadow_.CwMCZn2E9Q4CIqs2rLWq-cP9jleb8Y1_0 2024-09-12T18:36:00.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16462446935487362082', time=2024-09-12T20:00:23.862715+0000, chain.objs.size()=1 2024-09-12T18:36:00.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.236__shadow_.AtBJ53tmztodyxBrU3pt4xeWs1mYIqk_0 2024-09-12T18:36:00.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17701848930276341220', time=2024-09-12T20:01:06.306399+0000, chain.objs.size()=1 2024-09-12T18:36:00.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.260__shadow_.O_iN6iOhasgSJQGTCFFIt8i7nUffIq6_0 2024-09-12T18:36:00.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3879391628110288473', time=2024-09-12T20:02:52.418251+0000, chain.objs.size()=1 2024-09-12T18:36:00.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.oLK6ZCxAZHdMolNBaG-5uSX-m1Uc4eK_0 2024-09-12T18:36:00.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5836311670341078747', time=2024-09-12T20:02:52.935356+0000, chain.objs.size()=1 2024-09-12T18:36:00.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.WQQ1V2fd91v_t2EwmI-zjqLkb_HZlGD_0 2024-09-12T18:36:00.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14159620308631353864', time=2024-09-12T20:02:53.792553+0000, chain.objs.size()=1 2024-09-12T18:36:00.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.RaTIRGE2Ql7oakIk_LXXGxtPpMygG7H_0 2024-09-12T18:36:00.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8724684276997208496', time=2024-09-12T20:02:54.430878+0000, chain.objs.size()=1 2024-09-12T18:36:00.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.gqr5O7ILDIIJalsv_6A0HfnWOOdFEF-_0 2024-09-12T18:36:00.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13242801825913827309', time=2024-09-12T20:02:54.606396+0000, chain.objs.size()=1 2024-09-12T18:36:00.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.59zSvIiyemiXfm55CUwPHSfhAd8jFVk_0 2024-09-12T18:36:00.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13052490967122437127', time=2024-09-12T20:02:54.608411+0000, chain.objs.size()=1 2024-09-12T18:36:00.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.8W4VveAlpvdmOvpWDp8NFwTRI7Tjp2T_0 2024-09-12T18:36:00.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11636321099662205042', time=2024-09-12T20:02:55.894041+0000, chain.objs.size()=1 2024-09-12T18:36:00.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.RZtF5WeRFPoIFhE-47hk4MNSX3KP3W__0 2024-09-12T18:36:00.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11344586100884909968', time=2024-09-12T20:02:57.101099+0000, chain.objs.size()=1 2024-09-12T18:36:00.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.BwRKDb4be2ZKJ7STsifVvmO1q5DDTkj_0 2024-09-12T18:36:00.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16498866689879586341', time=2024-09-12T20:02:57.381434+0000, chain.objs.size()=1 2024-09-12T18:36:00.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.557+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._Ue68uQ-oVRUCjxMqB35ry4aIJ0_DHg_0 2024-09-12T18:36:00.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.561+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17856076582356516297', time=2024-09-12T20:02:58.112933+0000, chain.objs.size()=1 2024-09-12T18:36:00.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.561+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.iDbtW-nycHDPs7n87AZJ26ck2lDzf4E_0 2024-09-12T18:36:00.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.561+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3601964359691981623', time=2024-09-12T20:02:58.397763+0000, chain.objs.size()=1 2024-09-12T18:36:00.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.561+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.WJftyXG4qMWzGSAV4wElMLKkAqZtgZX_0 2024-09-12T18:36:00.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6692065176656116788', time=2024-09-12T20:02:59.885773+0000, chain.objs.size()=1 2024-09-12T18:36:00.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.kHkHZlE3du1Iuq-8lGNRG78cMBxkGt-_0 2024-09-12T18:36:00.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18022090943146236695', time=2024-09-12T20:02:59.887243+0000, chain.objs.size()=1 2024-09-12T18:36:00.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XcgIudinMBe-gMqyHJI13DR-hUb4ac1_0 2024-09-12T18:36:00.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11694869162583600435', time=2024-09-12T20:03:00.671541+0000, chain.objs.size()=1 2024-09-12T18:36:00.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.aX4HHXmiVYDDuczScNddDxDVwPk7v29_0 2024-09-12T18:36:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7459159558411229350', time=2024-09-12T20:03:04.875502+0000, chain.objs.size()=1 2024-09-12T18:36:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.w6BrcwImG9kWlA1Q2ZljgNTzL-FjzYs_0 2024-09-12T18:36:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.608423205489838656', time=2024-09-12T20:03:05.127851+0000, chain.objs.size()=1 2024-09-12T18:36:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.haYqNUPkZfXP7NBpEPwwtA-S2P9OEhr_0 2024-09-12T18:36:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9387901824138886365', time=2024-09-12T20:03:05.129457+0000, chain.objs.size()=1 2024-09-12T18:36:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.pxwU5GyCRXjfcjaffeeBWnGb6zjQik7_0 2024-09-12T18:36:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11108657756145544647', time=2024-09-12T20:03:05.411919+0000, chain.objs.size()=1 2024-09-12T18:36:00.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.05Uis9YeMra7c1xXuifUTtWYztySlXc_0 2024-09-12T18:36:00.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8382123699943008805', time=2024-09-12T20:03:06.270067+0000, chain.objs.size()=1 2024-09-12T18:36:00.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.zSTCWDdO-KHjSRU-zILBJfd6io3y185_0 2024-09-12T18:36:00.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1026670651441785360', time=2024-09-12T20:03:08.286350+0000, chain.objs.size()=1 2024-09-12T18:36:00.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.G1ijVV6QAPAFi5-wAqX7E9FkmNV3KIV_0 2024-09-12T18:36:00.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15430626333143911766', time=2024-09-12T20:03:08.402866+0000, chain.objs.size()=1 2024-09-12T18:36:00.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.tUfFRwKvEIxYdTtgVRuAbeM19nv4ABH_0 2024-09-12T18:36:00.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3809023069854720710', time=2024-09-12T20:03:08.583623+0000, chain.objs.size()=1 2024-09-12T18:36:00.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.565+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.djCZdyfiKRoShWQPsT2Dily7ZW3g0yu_0 2024-09-12T18:36:00.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7312152236649568735', time=2024-09-12T20:03:08.585921+0000, chain.objs.size()=1 2024-09-12T18:36:00.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.aHcZCHIPYA9A54sU7s0A5hG4D_cDjqF_0 2024-09-12T18:36:00.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15747919048349005742', time=2024-09-12T20:03:08.968297+0000, chain.objs.size()=1 2024-09-12T18:36:00.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QVvwThl1MGwMZSYb0JzVWN7u8b_i7mn_0 2024-09-12T18:36:00.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8193932389738856823', time=2024-09-12T20:03:08.970235+0000, chain.objs.size()=1 2024-09-12T18:36:00.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.RHN6g7qSRMMiywo7Gso3mnvkmH-1_JW_0 2024-09-12T18:36:00.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13673340600231798886', time=2024-09-12T20:03:09.361712+0000, chain.objs.size()=1 2024-09-12T18:36:00.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3LfUu_HWUds3CuWRzDC2VU1iIRnpFra_0 2024-09-12T18:36:00.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14685103176825423996', time=2024-09-12T20:03:12.298718+0000, chain.objs.size()=1 2024-09-12T18:36:00.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.EHouCMPeX2vhyCYQsvgKBRd-pjr5fHN_0 2024-09-12T18:36:00.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11825815463748811035', time=2024-09-12T20:03:13.743795+0000, chain.objs.size()=1 2024-09-12T18:36:00.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.8bocg8IB7YkSi3HFSzrIVKueNF64hky_0 2024-09-12T18:36:00.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14256621046511421343', time=2024-09-12T20:03:13.807209+0000, chain.objs.size()=1 2024-09-12T18:36:00.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QOyM9Z53KaV1xWuAk74oLqcT-om_Nyt_0 2024-09-12T18:36:00.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15060251409678275430', time=2024-09-12T20:03:15.399719+0000, chain.objs.size()=1 2024-09-12T18:36:00.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.E6s2GonapT_fdFNwl9i0scnJ-ndYvr2_0 2024-09-12T18:36:00.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10161731757312719104', time=2024-09-12T20:03:16.796421+0000, chain.objs.size()=1 2024-09-12T18:36:00.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.dg6oL9VjIxP_Uwx2Wa2tZHJjp8VOM1J_0 2024-09-12T18:36:00.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17292743045858296728', time=2024-09-12T20:03:18.533110+0000, chain.objs.size()=1 2024-09-12T18:36:00.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.nNYW6jZm1cpFEYyPJ7u1Eka9JRJEDZU_0 2024-09-12T18:36:00.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8535095835210757479', time=2024-09-12T20:03:19.076417+0000, chain.objs.size()=1 2024-09-12T18:36:00.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.573+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-MR22_KfFwEDirpEThCh2xYy7440rSr_0 2024-09-12T18:36:00.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.577+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15890677581266645568', time=2024-09-12T20:03:19.267689+0000, chain.objs.size()=1 2024-09-12T18:36:00.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.577+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.LQz6SKHfpjLHotN4GAwj3ALaR1a9nUc_0 2024-09-12T18:36:00.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12629383536517508598', time=2024-09-12T20:03:19.675389+0000, chain.objs.size()=1 2024-09-12T18:36:00.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.StHO2Llq13uNRj8BjjJqX6lrQaeCk69_0 2024-09-12T18:36:00.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5839881325051790586', time=2024-09-12T20:03:20.451047+0000, chain.objs.size()=1 2024-09-12T18:36:00.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.vMSM8RiuzBn0-L1NgEmFIhk3WlsdN2d_0 2024-09-12T18:36:00.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10036722545422765139', time=2024-09-12T20:03:20.707014+0000, chain.objs.size()=1 2024-09-12T18:36:00.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ZsOH8JwstlNjVSUg-Kn-PzsWqepozKL_0 2024-09-12T18:36:00.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14948752692226571198', time=2024-09-12T20:03:42.710304+0000, chain.objs.size()=1 2024-09-12T18:36:00.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.277__shadow_.n3z54cq4dGlSZFphSt4_tshnA-DIIST_0 2024-09-12T18:36:00.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3265437988326007780', time=2024-09-12T20:03:57.932279+0000, chain.objs.size()=1 2024-09-12T18:36:00.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.286__shadow_.oVsbS1ZCRIcvtyM8Y5gHSfXCGIsBrMM_0 2024-09-12T18:36:00.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8759781461022861880', time=2024-09-12T20:04:04.836235+0000, chain.objs.size()=1 2024-09-12T18:36:00.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.290__shadow_.3ccCSWwlvmv4IWDjexFFDcJ3_uPolyM_0 2024-09-12T18:36:00.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2043920216248171057', time=2024-09-12T20:04:12.960073+0000, chain.objs.size()=1 2024-09-12T18:36:00.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.wXdXKvEZy4dvHrBoGCX5g-lF3YnEltY_0 2024-09-12T18:36:00.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2680727802817224743', time=2024-09-12T20:04:17.886267+0000, chain.objs.size()=1 2024-09-12T18:36:00.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.9TOVAXw_cp79THtbEBoSjLRX-H4-pYj_0 2024-09-12T18:36:00.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9348415194284541598', time=2024-09-12T20:04:18.228113+0000, chain.objs.size()=1 2024-09-12T18:36:00.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.27mWfZlA34oaoLQBU46XsGJVzmvVyBO_0 2024-09-12T18:36:00.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14212400685703243880', time=2024-09-12T20:04:33.580692+0000, chain.objs.size()=1 2024-09-12T18:36:00.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.581+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.303__shadow_.E-uJCj-AOPViGqCDc1gVDm_AUDeuye5_0 2024-09-12T18:36:00.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.585+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9541809676894085235', time=2024-09-12T20:06:51.865524+0000, chain.objs.size()=1 2024-09-12T18:36:00.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.585+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.mipcMeJjysP8Ul4hhyIJla_KdrJz9QB_0 2024-09-12T18:36:00.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.585+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18060745021434910192', time=2024-09-12T20:06:52.420485+0000, chain.objs.size()=1 2024-09-12T18:36:00.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.585+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.4Hk26TkImGzwmlzMrzh7U9GcdIhUxJ7_0 2024-09-12T18:36:00.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.585+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14269340197770209229', time=2024-09-12T20:06:53.688090+0000, chain.objs.size()=1 2024-09-12T18:36:00.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.585+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.DrSUars167aEF0MjU6WqBkceuUR12zj_0 2024-09-12T18:36:00.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.585+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11557914457948089976', time=2024-09-12T20:06:55.507818+0000, chain.objs.size()=1 2024-09-12T18:36:00.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.585+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ts0FfcXDAjDy_4iUMXOab445BLd1yHg_0 2024-09-12T18:36:00.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.585+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15023903729696254757', time=2024-09-12T20:06:55.740515+0000, chain.objs.size()=1 2024-09-12T18:36:00.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.585+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.gYe0N20_bV5ALJYpkTc0rroRE5PNLhR_0 2024-09-12T18:36:00.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.589+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11681309986457548033', time=2024-09-12T20:06:56.355965+0000, chain.objs.size()=1 2024-09-12T18:36:00.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.589+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.6aP2isf2Xh1u-vbV64ZC1Zl_xNJh-Xy_0 2024-09-12T18:36:00.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.589+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8553173225587664050', time=2024-09-12T20:06:58.890143+0000, chain.objs.size()=1 2024-09-12T18:36:00.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.589+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.hrTZvMMerxK1clSO7Dt2BQ_Tq5CuDDh_0 2024-09-12T18:36:00.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.589+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7357564092986667765', time=2024-09-12T20:06:59.353144+0000, chain.objs.size()=1 2024-09-12T18:36:00.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.589+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Gw6z8TpGvdUwab3McZ21iuOI1fryolF_0 2024-09-12T18:36:00.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.589+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5319287351161783759', time=2024-09-12T20:07:00.905666+0000, chain.objs.size()=1 2024-09-12T18:36:00.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.589+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Zephhecygvf2gcT3k6Px_0BgommocwV_0 2024-09-12T18:36:00.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.589+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2342421634615714536', time=2024-09-12T20:07:02.560461+0000, chain.objs.size()=1 2024-09-12T18:36:00.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.589+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.HcGsIEr6Y_b4c1xlEMrx5iLQCh-7XFW_0 2024-09-12T18:36:00.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.589+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13917476826995579733', time=2024-09-12T20:07:04.716085+0000, chain.objs.size()=1 2024-09-12T18:36:00.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.589+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.kgJQe7Qea8A89ywUqkoN9RYjbcr7M8C_0 2024-09-12T18:36:00.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.589+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6131041289780252691', time=2024-09-12T20:07:05.185948+0000, chain.objs.size()=1 2024-09-12T18:36:00.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.589+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.4GtpEyO1L4RzNj-8C-BE9Cas7kSxeLk_0 2024-09-12T18:36:00.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.589+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13960308040628142415', time=2024-09-12T20:07:06.276665+0000, chain.objs.size()=1 2024-09-12T18:36:00.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.589+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.5Ax3x5zepdOPNhbyR7HqeAGcwnLBZGG_0 2024-09-12T18:36:00.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8348251881823404898', time=2024-09-12T20:07:06.996111+0000, chain.objs.size()=1 2024-09-12T18:36:00.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.SO-zLm1ex0L5r2TXyWyNWzv8PtR80-O_0 2024-09-12T18:36:00.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.25522606942892805', time=2024-09-12T20:07:07.200167+0000, chain.objs.size()=1 2024-09-12T18:36:00.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Lrfx-txv6LUYMtvdEGUHEtbMPJk6C5J_0 2024-09-12T18:36:00.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14128151206361253896', time=2024-09-12T20:07:07.845438+0000, chain.objs.size()=1 2024-09-12T18:36:00.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.bh8V0fegI5oAfiTS_wuaHMx4Okgn0-n_0 2024-09-12T18:36:00.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10888845287754200773', time=2024-09-12T20:07:08.123943+0000, chain.objs.size()=1 2024-09-12T18:36:00.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.slZmDI3QizMlQ6AqP0RHcYqFXkNfoZs_0 2024-09-12T18:36:00.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12097208453463859829', time=2024-09-12T20:07:10.358763+0000, chain.objs.size()=1 2024-09-12T18:36:00.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.HZGV75icj9BQSnagFMiV22PJxgEnzsP_0 2024-09-12T18:36:00.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15540244587528828000', time=2024-09-12T20:07:11.980008+0000, chain.objs.size()=1 2024-09-12T18:36:00.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.sDHp5tuE-geTC1K30hN6moFuYUolRLm_0 2024-09-12T18:36:00.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3813870663430088725', time=2024-09-12T20:07:14.670206+0000, chain.objs.size()=1 2024-09-12T18:36:00.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.54szAur03yhdDfT1DtHyrtjHmMvb5xj_0 2024-09-12T18:36:00.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2690494003512940577', time=2024-09-12T20:07:15.346383+0000, chain.objs.size()=1 2024-09-12T18:36:00.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.s4WDrNzfTGZi75OOJ_wZY742APyKvcY_0 2024-09-12T18:36:00.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13937489594173357965', time=2024-09-12T20:07:15.593251+0000, chain.objs.size()=1 2024-09-12T18:36:00.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ds8ra202odq1B2PT5VbD3QfRraZqgnm_0 2024-09-12T18:36:00.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9812372588963984615', time=2024-09-12T20:07:15.895741+0000, chain.objs.size()=1 2024-09-12T18:36:00.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.593+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.6C5t37h82EsdxMp5nYBgFW-WyvkeOdy_0 2024-09-12T18:36:00.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.597+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11190716230970223309', time=2024-09-12T20:07:16.923099+0000, chain.objs.size()=1 2024-09-12T18:36:00.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.597+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Nr7K9ZqUobXdy6eomw6q03w1Tzryzxz_0 2024-09-12T18:36:00.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.597+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6825000262958481965', time=2024-09-12T20:07:17.317614+0000, chain.objs.size()=1 2024-09-12T18:36:00.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.597+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.B8e6kRwW1sh-Cs9J__nwHzEVXdkz_yH_0 2024-09-12T18:36:00.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.597+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7020289790162889470', time=2024-09-12T20:07:17.482656+0000, chain.objs.size()=1 2024-09-12T18:36:00.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.597+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.BkZCZADI1gZQVN3ITotwYZsOB2BvEI4_0 2024-09-12T18:36:00.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.597+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5775449302016362584', time=2024-09-12T20:09:01.813097+0000, chain.objs.size()=1 2024-09-12T18:36:00.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.597+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.gtiiTJbCdnuRXlHOTbRkdPZK7PAYXKO_0 2024-09-12T18:36:00.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6351877675650151924', time=2024-09-12T20:09:02.574509+0000, chain.objs.size()=1 2024-09-12T18:36:00.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.XzGI5xydgx7qFmwW6AMyiVr1dJUSQwN_0 2024-09-12T18:36:00.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.275441324424268398', time=2024-09-12T20:09:04.605251+0000, chain.objs.size()=1 2024-09-12T18:36:00.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Z0R07rQXY9_Q8jfR5ce9gQ6Io4tLPh2_0 2024-09-12T18:36:00.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8713191202467120030', time=2024-09-12T20:09:04.618923+0000, chain.objs.size()=1 2024-09-12T18:36:00.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.NmlqFcnHUfkfjEz9meET8GPliJUo5iT_0 2024-09-12T18:36:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12904778919464585967', time=2024-09-12T20:09:06.093960+0000, chain.objs.size()=1 2024-09-12T18:36:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2vIS4byVkKRhDXP61E7efGZ_UUc2QLA_0 2024-09-12T18:36:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14650360667532120345', time=2024-09-12T20:09:06.172525+0000, chain.objs.size()=1 2024-09-12T18:36:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.pyKc2DNokp1y_KSw3HXGvws7J4kxjy-_0 2024-09-12T18:36:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14806603435252487426', time=2024-09-12T20:09:07.172730+0000, chain.objs.size()=1 2024-09-12T18:36:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.PjqNi7pzfqokOlLAdn1Nsj7YAGlPaCj_0 2024-09-12T18:36:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10128738881063588979', time=2024-09-12T20:09:07.339797+0000, chain.objs.size()=1 2024-09-12T18:36:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.JF7TMmzC8sKJM_aFNlLuKfpSRCEWHdN_0 2024-09-12T18:36:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5228607606917988431', time=2024-09-12T20:09:07.498112+0000, chain.objs.size()=1 2024-09-12T18:36:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.WS_jc16aRhWO0DPTUPXutU3TBfPXDwi_0 2024-09-12T18:36:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13636761960871058969', time=2024-09-12T20:09:07.918471+0000, chain.objs.size()=1 2024-09-12T18:36:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.efzBgwc13v1e2-Hcc58JaLwme06sCM-_0 2024-09-12T18:36:00.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6382312606127033458', time=2024-09-12T20:09:07.995484+0000, chain.objs.size()=1 2024-09-12T18:36:00.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.601+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.76LYN1iZ-DWoy--DTK_EhvB_AHX3e7v_0 2024-09-12T18:36:00.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.605+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17571688698029479899', time=2024-09-12T20:09:08.469032+0000, chain.objs.size()=1 2024-09-12T18:36:00.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.605+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.DulAmx1HQEZ1FhYs0qL8JHbuqb0IiQb_0 2024-09-12T18:36:00.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.605+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3793344630759007163', time=2024-09-12T20:09:11.338834+0000, chain.objs.size()=1 2024-09-12T18:36:00.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.605+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.zCwg5r6j7M1ZbEXXeMD3FjbYHZ3kKg6_0 2024-09-12T18:36:00.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5238139596919282373', time=2024-09-12T20:09:11.340733+0000, chain.objs.size()=1 2024-09-12T18:36:00.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.wVVK8_-I1eP08Z8iZxO1Ucs1FkuZZnW_0 2024-09-12T18:36:00.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2309638038728247426', time=2024-09-12T20:09:11.981792+0000, chain.objs.size()=1 2024-09-12T18:36:00.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.CbdWdhw1ocFIX6i70TrIp8iCRGiGmKh_0 2024-09-12T18:36:00.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13516314780831202185', time=2024-09-12T20:09:12.027788+0000, chain.objs.size()=1 2024-09-12T18:36:00.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.iIukoSUCngmSRK3tsH9KYw_pnqBiQiC_0 2024-09-12T18:36:00.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2232913701624086624', time=2024-09-12T20:09:13.278775+0000, chain.objs.size()=1 2024-09-12T18:36:00.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.mUmQDaCPqKl8xK7HPnVtPxTU4HSl3dm_0 2024-09-12T18:36:00.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.401069697202380382', time=2024-09-12T20:09:13.807209+0000, chain.objs.size()=1 2024-09-12T18:36:00.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.wtvrtjt5LRIlCZFnqxBGAUIIE8499BK_0 2024-09-12T18:36:00.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6523014804280786398', time=2024-09-12T20:09:13.969050+0000, chain.objs.size()=1 2024-09-12T18:36:00.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2amw0X4qKbducr816gk3fr6-JP-fdcT_0 2024-09-12T18:36:00.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7706401893322889755', time=2024-09-12T20:09:14.832989+0000, chain.objs.size()=1 2024-09-12T18:36:00.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.DzXbuFqA47uJ2oSCpzBdo5fnY3gJ7hV_0 2024-09-12T18:36:00.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3758033553540717720', time=2024-09-12T20:09:15.301723+0000, chain.objs.size()=1 2024-09-12T18:36:00.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.qHFEg3pjSmdbILttPtNn7ptqA2syc-e_0 2024-09-12T18:36:00.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3190448788637979560', time=2024-09-12T20:09:15.799740+0000, chain.objs.size()=1 2024-09-12T18:36:00.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ufiC-goNNV52DD7LAlN2P-toAw2wr2q_0 2024-09-12T18:36:00.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18083889698978527584', time=2024-09-12T20:09:16.011904+0000, chain.objs.size()=1 2024-09-12T18:36:00.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.609+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.8OwIx1amahXEML84mvqPANXBYiw9nQF_0 2024-09-12T18:36:00.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.613+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8982439298794584318', time=2024-09-12T20:09:16.089748+0000, chain.objs.size()=1 2024-09-12T18:36:00.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.613+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.kf4xBik9jt06ZIwWXgYweqKSYdn-0zm_0 2024-09-12T18:36:00.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.617+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4052124373200107766', time=2024-09-12T20:09:17.474340+0000, chain.objs.size()=1 2024-09-12T18:36:00.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.617+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.eD04hPQjJZkiQ6wDk3v_PPC0aMXMy_a_0 2024-09-12T18:36:00.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.617+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9751592770556698578', time=2024-09-12T20:09:17.777537+0000, chain.objs.size()=1 2024-09-12T18:36:00.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.617+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.MXefkchaKxF76o9bJbunj83D61Yfbqb_0 2024-09-12T18:36:00.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.617+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7097316454528324065', time=2024-09-12T20:09:18.221886+0000, chain.objs.size()=1 2024-09-12T18:36:00.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.617+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.OSBJQ11qjhNk4y5Mt_DkH-qylXZd3BZ_0 2024-09-12T18:36:00.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.625+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47331 2024-09-12T18:36:00.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T18:36:00.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12741058044061294504', time=2024-09-12T20:09:18.673095+0000, chain.objs.size()=1 2024-09-12T18:36:00.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.sAyNfY9OnvYZUVpSx_GZIBayvr82eJH_0 2024-09-12T18:36:00.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8729700223870589446', time=2024-09-12T20:09:21.016222+0000, chain.objs.size()=1 2024-09-12T18:36:00.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.rbvf4-OjmgFCz_QSJe5Psp7ZuYKJxZ3_0 2024-09-12T18:36:00.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11737393985884015442', time=2024-09-12T20:09:21.149113+0000, chain.objs.size()=1 2024-09-12T18:36:00.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5ZEondiMNJgezQqyoAtolV27nX0-WDs_0 2024-09-12T18:36:00.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9640075052020986202', time=2024-09-12T20:09:21.286366+0000, chain.objs.size()=1 2024-09-12T18:36:00.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.EoikOekc9nPvnBtWo4Yg8Ux8mA_QtOV_0 2024-09-12T18:36:00.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16530219391182632350', time=2024-09-12T20:09:22.307044+0000, chain.objs.size()=1 2024-09-12T18:36:00.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Rsf4twkvzav7huc7fzezULPGK9Gxhem_0 2024-09-12T18:36:00.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9913370329849926833', time=2024-09-12T20:09:22.441107+0000, chain.objs.size()=1 2024-09-12T18:36:00.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ZoCzPM0TgU9IxUnKtq-6bAyJe-bp-4h_0 2024-09-12T18:36:00.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15152360010528561962', time=2024-09-12T20:09:23.392168+0000, chain.objs.size()=1 2024-09-12T18:36:00.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.-z5YkKvACklQf3gfWJoNOxO2ZPmThPf_0 2024-09-12T18:36:00.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12131881619967536110', time=2024-09-12T20:09:23.468841+0000, chain.objs.size()=1 2024-09-12T18:36:00.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.7x_BnHY82fXVzH9_nmWibCz2eapFdvO_0 2024-09-12T18:36:00.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11931320741513355106', time=2024-09-12T20:09:23.645954+0000, chain.objs.size()=1 2024-09-12T18:36:00.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ld9DZ4FVtbuzUbWIioH-lko2Jnltwla_0 2024-09-12T18:36:00.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12929664320073014194', time=2024-09-12T20:09:24.494166+0000, chain.objs.size()=1 2024-09-12T18:36:00.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.seQpNPUyjF2L3l_35G21v974LDwmO5q_0 2024-09-12T18:36:00.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13086648142954752027', time=2024-09-12T20:09:25.117699+0000, chain.objs.size()=1 2024-09-12T18:36:00.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FWseT-3EPg1ElzBSClAE_797IwhVLhT_0 2024-09-12T18:36:00.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5766737539075640145', time=2024-09-12T20:09:25.189486+0000, chain.objs.size()=1 2024-09-12T18:36:00.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.629+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.KMVUV_17GofUr65Y-dFaMKE5vRYg-8y_0 2024-09-12T18:36:00.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.633+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4013692986413426269', time=2024-09-12T20:09:26.577305+0000, chain.objs.size()=1 2024-09-12T18:36:00.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.633+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.H2o1KLS73mPPcbPv697PEJ7RtS7Vuek_0 2024-09-12T18:36:00.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8488980236532675378', time=2024-09-12T20:09:28.862391+0000, chain.objs.size()=1 2024-09-12T18:36:00.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.uDzXXOtUtR_8639nO0zwJpGVI974bH9_0 2024-09-12T18:36:00.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6090633672144064855', time=2024-09-12T20:09:28.880259+0000, chain.objs.size()=1 2024-09-12T18:36:00.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.o4YhVkzz15DyErHO64xOjEdHjeinKSr_0 2024-09-12T18:36:00.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10247466411460597023', time=2024-09-12T20:09:29.950466+0000, chain.objs.size()=1 2024-09-12T18:36:00.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.aFxd3tAvwNJAUxYkr6QJ8-R6uIpt0fV_0 2024-09-12T18:36:00.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7561049315150386408', time=2024-09-12T20:09:35.318609+0000, chain.objs.size()=1 2024-09-12T18:36:00.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.329__shadow_.t2CeE4pUCtHB1mn_bJQa5AKwuKjQa_w_0 2024-09-12T18:36:00.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18085787024218872538', time=2024-09-12T20:10:45.305896+0000, chain.objs.size()=1 2024-09-12T18:36:00.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.384__shadow_.sj_pG-2ozwWl-powqGmvS5OypbONyfs_0 2024-09-12T18:36:00.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5043739867200121759', time=2024-09-12T20:13:07.266767+0000, chain.objs.size()=1 2024-09-12T18:36:00.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.484__shadow_.BHNFCHNNjfXQzSNqWbP6ULFvLgKhItG_0 2024-09-12T18:36:00.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12891927821482948049', time=2024-09-12T20:13:07.268374+0000, chain.objs.size()=1 2024-09-12T18:36:00.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.484__shadow_.V12qeSH3ChzdHvlDW7qXfUrDb8cV_-N_0 2024-09-12T18:36:00.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11549594897310116639', time=2024-09-12T20:13:40.623485+0000, chain.objs.size()=1 2024-09-12T18:36:00.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.504__shadow:p--u8yBdmzUFbtwCdiIMSfaVaX-Tsns_.K5_RZa2CGyb4Lrga0hcpjF_NIfZ0MyJ_0 2024-09-12T18:36:00.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.885172224545023192', time=2024-09-12T20:14:22.011463+0000, chain.objs.size()=1 2024-09-12T18:36:00.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.518__shadow_.aJ_fo3Z6jJX7jkarQyextqtcK1ruF48_0 2024-09-12T18:36:00.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12569989038440030096', time=2024-09-12T20:14:57.214670+0000, chain.objs.size()=3 2024-09-12T18:36:00.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.637+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.522__multipart_mymultipart.2~S0JCSj5vBctgzR4g151a81crb5DaXII.1 2024-09-12T18:36:00.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.641+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.522__multipart_mymultipart.2~S0JCSj5vBctgzR4g151a81crb5DaXII.2 2024-09-12T18:36:00.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.641+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.522__multipart_mymultipart.2~S0JCSj5vBctgzR4g151a81crb5DaXII.3 2024-09-12T18:36:00.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.641+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9801201313081794099', time=2024-09-12T20:18:44.393421+0000, chain.objs.size()=1 2024-09-12T18:36:00.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.641+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.560__shadow_.ytiLaNmdsMwxI2GyH65q9q-AOwTvsWl_0 2024-09-12T18:36:00.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.641+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3095676078183033123', time=2024-09-12T20:19:07.625642+0000, chain.objs.size()=1 2024-09-12T18:36:00.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.641+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:naqEEA4hNpRwbahrTu-ULz6MH1-VXxv_.cmJFLy-bcSgZ3HCGps2j21XVk-oWtk6_0 2024-09-12T18:36:00.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.641+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8421932347490297728', time=2024-09-12T20:19:22.547947+0000, chain.objs.size()=1 2024-09-12T18:36:00.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.641+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:DQqr7ZAebt8AOV0vArO0Rfqe03zuUEs_.yiH9Qx72wOnSazxBMT7u7EWWo-dt6Hx_0 2024-09-12T18:36:00.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.641+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18255292582937754873', time=2024-09-12T20:20:35.646422+0000, chain.objs.size()=1 2024-09-12T18:36:00.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.641+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:MM1a9TFeHZlrGmqUfuQNXTNuIphNhuo_.6G3cBtquiyhcBex427bWDX2vt3z84vB_0 2024-09-12T18:36:00.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.645+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16849032865276103665', time=2024-09-12T20:21:21.626012+0000, chain.objs.size()=1 2024-09-12T18:36:00.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.645+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.586__shadow:KRM4BhhfHKkqQJm87ekpz9nL7DBD1dv_.dCVMKRrCQash-UjmBsXnD-mIcHbfy3l_0 2024-09-12T18:36:00.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.645+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11239769079835582385', time=2024-09-12T20:26:45.084830+0000, chain.objs.size()=1 2024-09-12T18:36:00.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.645+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.640__shadow_.8Z9nIFCO6OMkwrVV7HDL6v0zWgvrYf6_0 2024-09-12T18:36:00.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.645+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9333098394265130057', time=2024-09-12T20:27:08.348007+0000, chain.objs.size()=2 2024-09-12T18:36:00.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.645+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.650__shadow_.zvNelIXQ9z7Mj0okrYX6RaPRlp7FQp0_0 2024-09-12T18:36:00.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.645+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.650__shadow_.zvNelIXQ9z7Mj0okrYX6RaPRlp7FQp0_1 2024-09-12T18:36:00.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.645+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14309256523137728831', time=2024-09-12T20:28:14.752051+0000, chain.objs.size()=1 2024-09-12T18:36:00.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.645+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.680__shadow_.XHDW_9IbwG2k0-tK8JuhOq8I_UW-PWq_0 2024-09-12T18:36:00.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.649+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:00.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.653+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:36:00.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:00.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:00.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45608' 2024-09-12T18:36:00.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5085876439598621184', time=2024-09-12T19:55:35.104128+0000, chain.objs.size()=1 2024-09-12T18:36:00.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.149__shadow_.7HqBk2plZk3rjJqSdnLE_BQdABnOBZi_0 2024-09-12T18:36:00.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_bN5-gwjCQ6-2QKlOvefEVYrgcpC2Fvm', time=2024-09-12T19:56:21.683305+0000, chain.objs.size()=1 2024-09-12T18:36:00.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_.RnsbrzJMSdzSUgGmvlhy67q5ptV07zB_0 2024-09-12T18:36:00.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16334634694335944095', time=2024-09-12T20:00:28.046852+0000, chain.objs.size()=1 2024-09-12T18:36:00.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.238__shadow_.MntgQTJXmcld49xva75lLSgP2YARuLH_0 2024-09-12T18:36:00.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16263717230669571820', time=2024-09-12T20:00:48.221130+0000, chain.objs.size()=1 2024-09-12T18:36:00.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.249__shadow_.28gqY_D7HSCaEzwPrBv6E-PZP-HcSI0_0 2024-09-12T18:36:00.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1205445571594045196', time=2024-09-12T20:02:51.967913+0000, chain.objs.size()=1 2024-09-12T18:36:00.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.z9XTHbpMDgu5DG1Wg--xF4vbY8Fyptq_0 2024-09-12T18:36:00.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6068818136318404518', time=2024-09-12T20:02:54.436790+0000, chain.objs.size()=1 2024-09-12T18:36:00.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.pRIRLH2vBC5W5vg6vT21xOsbxjKwVrY_0 2024-09-12T18:36:00.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2163697210789123348', time=2024-09-12T20:02:54.769217+0000, chain.objs.size()=1 2024-09-12T18:36:00.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Ex3mg5IO03nLKhof8tuBp7Oc_cvGsDc_0 2024-09-12T18:36:00.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9613548946033861968', time=2024-09-12T20:02:54.875346+0000, chain.objs.size()=1 2024-09-12T18:36:00.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.DQuNpM1qDTwm7YjNtiL99QNC4LHdAZk_0 2024-09-12T18:36:00.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10946011545804030192', time=2024-09-12T20:02:55.849366+0000, chain.objs.size()=1 2024-09-12T18:36:00.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.zH0Y6QGgZd0gViUJq7jqtf_EkECAi12_0 2024-09-12T18:36:00.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1611547049190646497', time=2024-09-12T20:02:56.721954+0000, chain.objs.size()=1 2024-09-12T18:36:00.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-1UZ4aZbBdSFFTq2yuyURD2RjzYYfpN_0 2024-09-12T18:36:00.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11038037549491893438', time=2024-09-12T20:02:57.523117+0000, chain.objs.size()=1 2024-09-12T18:36:00.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Q3K3aIPjnIeE3vs22J14muIXxI0k1uM_0 2024-09-12T18:36:00.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12586852541300791669', time=2024-09-12T20:02:58.432860+0000, chain.objs.size()=1 2024-09-12T18:36:00.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.657+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.t9eWnKrAygQHPOJxceq_NsAMFUEm9R-_0 2024-09-12T18:36:00.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4384988977118422435', time=2024-09-12T20:02:58.675180+0000, chain.objs.size()=1 2024-09-12T18:36:00.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.C7SNhtarH_j9pcAhE1nJVBDFhPzGswt_0 2024-09-12T18:36:00.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11008815170785841524', time=2024-09-12T20:03:00.683108+0000, chain.objs.size()=1 2024-09-12T18:36:00.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ekKWMWBwdlEzM9Y9ByFMvAwTD56U0Ty_0 2024-09-12T18:36:00.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12901332651539918502', time=2024-09-12T20:03:01.000817+0000, chain.objs.size()=1 2024-09-12T18:36:00.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wGoED0ahgYHVJ5hyz3VT0tUTHSfjL7P_0 2024-09-12T18:36:00.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5383762337091274479', time=2024-09-12T20:03:01.974827+0000, chain.objs.size()=1 2024-09-12T18:36:00.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.JQjU7siK08-q4zd5deCn7KTUx79C98p_0 2024-09-12T18:36:00.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13872270885886933867', time=2024-09-12T20:03:02.633895+0000, chain.objs.size()=1 2024-09-12T18:36:00.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.UEgGRE2zzyQj_DZE5e2WMJ_wlfiCnQZ_0 2024-09-12T18:36:00.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6081257066685564987', time=2024-09-12T20:03:04.076459+0000, chain.objs.size()=1 2024-09-12T18:36:00.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.19r8rLO9SoAyUbd4ZCdGf1Q29oVPqpR_0 2024-09-12T18:36:00.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6795297406796059931', time=2024-09-12T20:03:05.137078+0000, chain.objs.size()=1 2024-09-12T18:36:00.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-00YJwjByRqQLwBx0eWcEoadHihm_91_0 2024-09-12T18:36:00.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18405807468729512932', time=2024-09-12T20:03:05.262397+0000, chain.objs.size()=1 2024-09-12T18:36:00.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.J6jfGSAL2fr7tpH11oaaY-m8wYg5nIm_0 2024-09-12T18:36:00.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1862032333126585686', time=2024-09-12T20:03:05.329826+0000, chain.objs.size()=1 2024-09-12T18:36:00.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.hL2H_WjHCnzlpk1_AZa2wuru4iaZ0a__0 2024-09-12T18:36:00.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9284891097933201519', time=2024-09-12T20:03:07.441082+0000, chain.objs.size()=1 2024-09-12T18:36:00.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.zvKSfTnpJ-I7O-rMVde7O2QeYHOyuj7_0 2024-09-12T18:36:00.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7913560408569198823', time=2024-09-12T20:03:12.983241+0000, chain.objs.size()=1 2024-09-12T18:36:00.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.JF8oFss7HdcQgasvdOnPC3cusgyDcC6_0 2024-09-12T18:36:00.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13097642514192108956', time=2024-09-12T20:03:14.660287+0000, chain.objs.size()=1 2024-09-12T18:36:00.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.dOs1h1zwfU3-iN7xRMOwrb9gVxwiJvd_0 2024-09-12T18:36:00.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16437993225420029527', time=2024-09-12T20:03:15.509309+0000, chain.objs.size()=1 2024-09-12T18:36:00.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.661+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.22-iJ-A7b4I0DCw_oNRW58pq_Rrpnwh_0 2024-09-12T18:36:00.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.665+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4107170466330068974', time=2024-09-12T20:03:15.778578+0000, chain.objs.size()=1 2024-09-12T18:36:00.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.665+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.dVNnZpDaiZJN_37AvEVbnqWfssdypl-_0 2024-09-12T18:36:00.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9061225534836322535', time=2024-09-12T20:03:16.420962+0000, chain.objs.size()=1 2024-09-12T18:36:00.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.as4jQezIbNs6pTcLrafo6uAyzA8LXH7_0 2024-09-12T18:36:00.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10436227419174956269', time=2024-09-12T20:03:16.638332+0000, chain.objs.size()=1 2024-09-12T18:36:00.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.VMeFkYrKT3B_fTfcNVs58sEd2w2-ClK_0 2024-09-12T18:36:00.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9742912599495140222', time=2024-09-12T20:03:20.534293+0000, chain.objs.size()=1 2024-09-12T18:36:00.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.jUNTADRs56CnRLNnfcbtejAJShgd9J9_0 2024-09-12T18:36:00.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10582993462818204169', time=2024-09-12T20:03:20.546740+0000, chain.objs.size()=1 2024-09-12T18:36:00.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ssvCwP-aY_vPftkkX2fWEEeNO3MnJI3_0 2024-09-12T18:36:00.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10802238202957256180', time=2024-09-12T20:03:20.619498+0000, chain.objs.size()=1 2024-09-12T18:36:00.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.o8PQnsAfDV_rt8I-0jQjnSK4zQJZnpI_0 2024-09-12T18:36:00.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18172787962746431396', time=2024-09-12T20:03:28.516341+0000, chain.objs.size()=1 2024-09-12T18:36:00.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.268__shadow_.Pfciuvmuf5jHROdDIb2TakCgNoe2B2V_0 2024-09-12T18:36:00.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16097568223748931969', time=2024-09-12T20:03:30.124923+0000, chain.objs.size()=1 2024-09-12T18:36:00.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.269__shadow_.-SP55FFBBC2bD3P9dk3-3QTaP1w8qCL_0 2024-09-12T18:36:00.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9022689448812538670', time=2024-09-12T20:04:12.955565+0000, chain.objs.size()=1 2024-09-12T18:36:00.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.upLyOtJQckfc8RF_iWRNgVTjPA6mUmm_0 2024-09-12T18:36:00.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17974683062447972831', time=2024-09-12T20:04:17.948550+0000, chain.objs.size()=1 2024-09-12T18:36:00.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.YHbwgCU8LKSGdV6oS1k9pA2F5Ih7hi1_0 2024-09-12T18:36:00.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5163773904660312238', time=2024-09-12T20:04:21.576383+0000, chain.objs.size()=1 2024-09-12T18:36:00.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.296__shadow_.d53paLisx2e-K9xTGnfrl4mfpCR3Jxq_0 2024-09-12T18:36:00.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5665887013640751983', time=2024-09-12T20:06:51.866448+0000, chain.objs.size()=1 2024-09-12T18:36:00.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.673+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.slC_LzYWW3XLG0xDB_t8EpoN6LzyH9t_0 2024-09-12T18:36:00.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17774847300406800413', time=2024-09-12T20:06:52.291166+0000, chain.objs.size()=1 2024-09-12T18:36:00.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7ackmYVK5oRfrr_NMGM4UEkNPLessF0_0 2024-09-12T18:36:00.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15394980013924905399', time=2024-09-12T20:06:52.508469+0000, chain.objs.size()=1 2024-09-12T18:36:00.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.au0g-xAmt9XCpX5q4tsvcKv9SlO4aWh_0 2024-09-12T18:36:00.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.638887838045502439', time=2024-09-12T20:06:52.586577+0000, chain.objs.size()=1 2024-09-12T18:36:00.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.OPILOTaOtQhkmgLB8oQuNJ0wGJ8YoeJ_0 2024-09-12T18:36:00.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4338584019934285402', time=2024-09-12T20:06:54.932657+0000, chain.objs.size()=1 2024-09-12T18:36:00.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.4zIDJc6LguBbNl9Z14Yk-yaegO6X9To_0 2024-09-12T18:36:00.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10794546861364351616', time=2024-09-12T20:06:55.270042+0000, chain.objs.size()=1 2024-09-12T18:36:00.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.IfF5k6DvFVcxZfrOgJSOEWgHc0BlqmZ_0 2024-09-12T18:36:00.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5198722984169707218', time=2024-09-12T20:06:59.715155+0000, chain.objs.size()=1 2024-09-12T18:36:00.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.3EZo4I-SvWW1sZshTRmrtMBQ0jmc7WX_0 2024-09-12T18:36:00.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2740070142403717587', time=2024-09-12T20:07:00.044721+0000, chain.objs.size()=1 2024-09-12T18:36:00.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.OdLPeGjiR6e89EmazX9PtlsJlLQHfub_0 2024-09-12T18:36:00.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18239172287033801152', time=2024-09-12T20:07:00.871055+0000, chain.objs.size()=1 2024-09-12T18:36:00.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.o0Ib91SpHevN3DwxU8FYmZy1cdHFCwc_0 2024-09-12T18:36:00.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8794832216088721404', time=2024-09-12T20:07:02.555233+0000, chain.objs.size()=1 2024-09-12T18:36:00.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.677+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.3s0zE8l7k9BxaF4WP80sYUzR3ZIjR9k_0 2024-09-12T18:36:00.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.681+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15141066780243146029', time=2024-09-12T20:07:04.746773+0000, chain.objs.size()=1 2024-09-12T18:36:00.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.681+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.z3QxJ4HYzMdy0cmE897G_Kh164lEPSO_0 2024-09-12T18:36:00.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.681+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15977249724083736204', time=2024-09-12T20:07:06.543417+0000, chain.objs.size()=1 2024-09-12T18:36:00.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.681+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Mh37nkq4y8S725MEfSs1oomAuaLjgaK_0 2024-09-12T18:36:00.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.681+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17209265745401742825', time=2024-09-12T20:07:07.653198+0000, chain.objs.size()=1 2024-09-12T18:36:00.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.681+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.GA4Iie7ozMvGGXHJaGjMobv3wK3ijF3_0 2024-09-12T18:36:00.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.681+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16211371544196910317', time=2024-09-12T20:07:07.994794+0000, chain.objs.size()=1 2024-09-12T18:36:00.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.681+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Q25FqsATg2Lh3efdFd8TBBq9rpPfe9S_0 2024-09-12T18:36:00.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11864495485990457225', time=2024-09-12T20:07:08.723513+0000, chain.objs.size()=1 2024-09-12T18:36:00.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.zbz9E5S24Vk_jAX1QQ50XIB9htrXOoz_0 2024-09-12T18:36:00.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14872593375376647832', time=2024-09-12T20:07:08.922134+0000, chain.objs.size()=1 2024-09-12T18:36:00.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.qijlxgL7lkeFbpxp4WX9PZD_xnpgGnh_0 2024-09-12T18:36:00.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.484453373081684844', time=2024-09-12T20:07:08.924199+0000, chain.objs.size()=1 2024-09-12T18:36:00.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.gcyv7LIkjXk9YeMs24v_0HayDQnBtDt_0 2024-09-12T18:36:00.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17255356740167134905', time=2024-09-12T20:07:10.766922+0000, chain.objs.size()=1 2024-09-12T18:36:00.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.h5OGN3k0TkGNyPqJZye2RSC37dPTmVR_0 2024-09-12T18:36:00.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.844113096073886957', time=2024-09-12T20:07:10.906149+0000, chain.objs.size()=1 2024-09-12T18:36:00.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.isNG6q_xmnlauNFCCmzJpg-fuKp6W-N_0 2024-09-12T18:36:00.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8059192185423113959', time=2024-09-12T20:07:11.350262+0000, chain.objs.size()=1 2024-09-12T18:36:00.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.6uManabzoTtubqigfI9CDi_1usMGVkF_0 2024-09-12T18:36:00.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13803041338249199544', time=2024-09-12T20:07:11.562185+0000, chain.objs.size()=1 2024-09-12T18:36:00.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.vHTDFyBUKsMHKOO-hPK6sh2tf_W5SK2_0 2024-09-12T18:36:00.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3656576984150472075', time=2024-09-12T20:07:11.850523+0000, chain.objs.size()=1 2024-09-12T18:36:00.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ll9bdz19a5w2EM9XrFP1OtXXE_EOj20_0 2024-09-12T18:36:00.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4681915663468703327', time=2024-09-12T20:07:13.435184+0000, chain.objs.size()=1 2024-09-12T18:36:00.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.685+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.W04FENiIuCW2le5gHBaKFexMPSl8fVO_0 2024-09-12T18:36:00.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.689+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9353930460783284096', time=2024-09-12T20:07:13.803335+0000, chain.objs.size()=1 2024-09-12T18:36:00.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.689+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.2AUtNLdjN6169n4QUxLszGBVrIYErep_0 2024-09-12T18:36:00.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.689+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8496554466335876040', time=2024-09-12T20:07:14.461310+0000, chain.objs.size()=1 2024-09-12T18:36:00.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.689+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.qWGONmCIuU8kzxIAMyMD08LEP7M_8aT_0 2024-09-12T18:36:00.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.689+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6010249809582734617', time=2024-09-12T20:07:15.226052+0000, chain.objs.size()=1 2024-09-12T18:36:00.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.689+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.uEUqdFjKgF3XgHJ7iTNXVZsraBWt0Qg_0 2024-09-12T18:36:00.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.664992245811138810', time=2024-09-12T20:07:15.893227+0000, chain.objs.size()=1 2024-09-12T18:36:00.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.n0f4sHqK18dd_7NQIQaiimiQGuHodiP_0 2024-09-12T18:36:00.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11796683926459438280', time=2024-09-12T20:07:16.134499+0000, chain.objs.size()=1 2024-09-12T18:36:00.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.EvHzvkCdD0_SSshF7JSENJ0hEjtxVVj_0 2024-09-12T18:36:00.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13082248073441319653', time=2024-09-12T20:07:18.463389+0000, chain.objs.size()=1 2024-09-12T18:36:00.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Z7wwvUR1aEwzSJ86vebob5ZYCijIygR_0 2024-09-12T18:36:00.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12680350929281844782', time=2024-09-12T20:09:02.843297+0000, chain.objs.size()=1 2024-09-12T18:36:00.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.9f_nW2LP2zV09T12DyBPaQj856eoVM-_0 2024-09-12T18:36:00.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17634212138627188321', time=2024-09-12T20:09:03.097036+0000, chain.objs.size()=1 2024-09-12T18:36:00.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.rU_E5iVQgjE3Tf7_0Xzsby16edCdA1P_0 2024-09-12T18:36:00.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15365088484815167338', time=2024-09-12T20:09:04.443606+0000, chain.objs.size()=1 2024-09-12T18:36:00.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.UWI2ThVwwNPy8TtUqtQnQQMe3lD42oK_0 2024-09-12T18:36:00.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1199157503434735247', time=2024-09-12T20:09:04.692952+0000, chain.objs.size()=1 2024-09-12T18:36:00.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.9c49q7gTmykqaJjrFQa0tQL_-KSeSfM_0 2024-09-12T18:36:00.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11168902526962449381', time=2024-09-12T20:09:06.706619+0000, chain.objs.size()=1 2024-09-12T18:36:00.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Q-AO4rQ4l4Rq9IMqMs-3bqzolT4i-Lh_0 2024-09-12T18:36:00.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16984577108794003318', time=2024-09-12T20:09:07.356124+0000, chain.objs.size()=1 2024-09-12T18:36:00.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.nVIoTcBklZdyUZNxOx6sdad_ZW_EC_Y_0 2024-09-12T18:36:00.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2140751698880018535', time=2024-09-12T20:09:08.034988+0000, chain.objs.size()=1 2024-09-12T18:36:00.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.nFCaH593PR6CwemFIf58JLn-N-3lPSE_0 2024-09-12T18:36:00.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9679547905659924974', time=2024-09-12T20:09:09.673806+0000, chain.objs.size()=1 2024-09-12T18:36:00.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.693+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xPaIgRWOAqKcvnUlBt-s_dqrMMTKIik_0 2024-09-12T18:36:00.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.697+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3849934896974784769', time=2024-09-12T20:09:10.436496+0000, chain.objs.size()=1 2024-09-12T18:36:00.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.697+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.wYqNU4CJVjGKphg54tCAVkUJiRUQQ4s_0 2024-09-12T18:36:00.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.697+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.467099894370032726', time=2024-09-12T20:09:12.292832+0000, chain.objs.size()=1 2024-09-12T18:36:00.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.697+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.EAlxWM-BbRe_XWbOTWxdE2KpgSctopp_0 2024-09-12T18:36:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13996372785277946273', time=2024-09-12T20:09:13.866038+0000, chain.objs.size()=1 2024-09-12T18:36:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.DngvAA0GWFV6y9qOsblyA4QIkCUyooK_0 2024-09-12T18:36:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5205623433558228259', time=2024-09-12T20:09:14.361892+0000, chain.objs.size()=1 2024-09-12T18:36:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.dnpxXjIO1h3Me6wfg5UFoKvRO67GZNV_0 2024-09-12T18:36:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3720117762285331058', time=2024-09-12T20:09:14.574053+0000, chain.objs.size()=1 2024-09-12T18:36:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.LY_dtZhE869rf-CQZ5DLlNOtJdgotxG_0 2024-09-12T18:36:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8348254512511459823', time=2024-09-12T20:09:15.690856+0000, chain.objs.size()=1 2024-09-12T18:36:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.IrFBSXDaXKb9vaXu84JM6Mpce0rbpfZ_0 2024-09-12T18:36:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4888215513543832645', time=2024-09-12T20:09:18.100581+0000, chain.objs.size()=1 2024-09-12T18:36:00.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.-XeTY9PW1SfFQxWOs-n9jN7xf1KLLEE_0 2024-09-12T18:36:00.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2861421100156770292', time=2024-09-12T20:09:18.634267+0000, chain.objs.size()=1 2024-09-12T18:36:00.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.kueKZgVS5QuIG13zWhDMB9GqJnAAMls_0 2024-09-12T18:36:00.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6082154515714942723', time=2024-09-12T20:09:19.097609+0000, chain.objs.size()=1 2024-09-12T18:36:00.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Acu1l9MO7Ld4P7Fj_tVAw_U5zFKHhaO_0 2024-09-12T18:36:00.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2653011726026517378', time=2024-09-12T20:09:19.210154+0000, chain.objs.size()=1 2024-09-12T18:36:00.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.j3_CqEyDCN4aZNnn3ODM9dqn0ph0Q15_0 2024-09-12T18:36:00.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9157385287916423007', time=2024-09-12T20:09:19.607613+0000, chain.objs.size()=1 2024-09-12T18:36:00.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.G9SxMJoFElv9yJisfu19g9FG41wt0zT_0 2024-09-12T18:36:00.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10919230832163181472', time=2024-09-12T20:09:19.694001+0000, chain.objs.size()=1 2024-09-12T18:36:00.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.l5O3K459LXWOw8JlcJ3IcGvEq8oAswP_0 2024-09-12T18:36:00.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10769233309295574261', time=2024-09-12T20:09:19.766264+0000, chain.objs.size()=1 2024-09-12T18:36:00.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.701+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xu7THb5mdSaZUfNJ3Uh2IHBhGSuSGvj_0 2024-09-12T18:36:00.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.705+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13295108365600731075', time=2024-09-12T20:09:23.469436+0000, chain.objs.size()=1 2024-09-12T18:36:00.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.705+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.krEZb4bikcYfXdpoUovCe5bbiSnEHA2_0 2024-09-12T18:36:00.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.705+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6577814581256272153', time=2024-09-12T20:09:24.732529+0000, chain.objs.size()=1 2024-09-12T18:36:00.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.705+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.GZDrUal53ZbEcQXD8N-rOO2QI6y57cW_0 2024-09-12T18:36:00.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.705+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14658621788240249387', time=2024-09-12T20:09:26.296060+0000, chain.objs.size()=1 2024-09-12T18:36:00.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.705+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.-5C6pjNYYdYjD9Ol5Z3ddE9XJhI0h9p_0 2024-09-12T18:36:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10824126478918260533', time=2024-09-12T20:09:26.585412+0000, chain.objs.size()=1 2024-09-12T18:36:00.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.LJfal8Yu0sVThG-11V74QMWiTMg3khv_0 2024-09-12T18:36:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13633472844882041591', time=2024-09-12T20:09:26.586791+0000, chain.objs.size()=1 2024-09-12T18:36:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.AhFLxqkdC5IWWE2ZvYcdW5LqSEF9N1e_0 2024-09-12T18:36:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9967963143616738360', time=2024-09-12T20:09:28.121633+0000, chain.objs.size()=1 2024-09-12T18:36:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.0fgEnU7AiQ6XWn4sYXGndQBFU9_nu-6_0 2024-09-12T18:36:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.102351084934021389', time=2024-09-12T20:09:28.760692+0000, chain.objs.size()=1 2024-09-12T18:36:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2M8qOPtCMwW8bowrUjxEgw73rcG4koi_0 2024-09-12T18:36:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9990803775898702753', time=2024-09-12T20:09:28.826946+0000, chain.objs.size()=1 2024-09-12T18:36:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.AJVrDOFF87sQk0etLJHj6aIW2j6G47F_0 2024-09-12T18:36:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9407894269519877858', time=2024-09-12T20:09:28.957582+0000, chain.objs.size()=1 2024-09-12T18:36:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FlU4oMGZ4JHf-bnbqr1bK4g0Cunam5r_0 2024-09-12T18:36:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2167608550001927917', time=2024-09-12T20:09:29.641822+0000, chain.objs.size()=1 2024-09-12T18:36:00.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.d9plBXsPeuAqPHlUcKpQSsa0qyrzzjl_0 2024-09-12T18:36:00.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17095303282285177653', time=2024-09-12T20:09:30.196093+0000, chain.objs.size()=1 2024-09-12T18:36:00.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.UAb96lmFo4ul818z3VFdfhk-DpEi_OG_0 2024-09-12T18:36:00.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3251419979400651045', time=2024-09-12T20:09:49.910618+0000, chain.objs.size()=1 2024-09-12T18:36:00.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.340__shadow_.dRH7BFaPrLPoexnCGV-JD8MVCyd0gjP_0 2024-09-12T18:36:00.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6175953435646890921', time=2024-09-12T20:10:46.851125+0000, chain.objs.size()=1 2024-09-12T18:36:00.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.385__shadow_.f-yvH2uKLRDjG5px-piVcUVnQQI6vXd_0 2024-09-12T18:36:00.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12867559173908575630', time=2024-09-12T20:12:17.390814+0000, chain.objs.size()=1 2024-09-12T18:36:00.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.709+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.451__shadow_.IhJ67NMsFSQhz-KQHzv8LhmOcWH6_Yq_0 2024-09-12T18:36:00.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45608 2024-09-12T18:36:00.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:36:00.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16775211867179566515', time=2024-09-12T20:12:46.946568+0000, chain.objs.size()=1 2024-09-12T18:36:00.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.467__shadow_.GtHwJxTKggk_TC3vrqliS043d1hujQq_0 2024-09-12T18:36:00.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5460535615730759151', time=2024-09-12T20:13:07.219665+0000, chain.objs.size()=1 2024-09-12T18:36:00.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.484__shadow_.RssrWENE3j6_QByrwaLrnEQgbNEUx9J_0 2024-09-12T18:36:00.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10047577097200611338', time=2024-09-12T20:13:09.206633+0000, chain.objs.size()=1 2024-09-12T18:36:00.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.485__shadow_.9Ct3A9rG77xNKACyGkU5XYzOAUtCh4l_0 2024-09-12T18:36:00.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18343639407244302827', time=2024-09-12T20:14:39.335475+0000, chain.objs.size()=12 2024-09-12T18:36:00.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.520__multipart_mymultipart.2~i4lpyR1VV4R83RNBGhUOJpg6TMH9NSG.1 2024-09-12T18:36:00.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.520__shadow_mymultipart.2~i4lpyR1VV4R83RNBGhUOJpg6TMH9NSG.1_1 2024-09-12T18:36:00.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.520__multipart_mymultipart.2~i4lpyR1VV4R83RNBGhUOJpg6TMH9NSG.2 2024-09-12T18:36:00.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.520__shadow_mymultipart.2~i4lpyR1VV4R83RNBGhUOJpg6TMH9NSG.2_1 2024-09-12T18:36:00.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.520__multipart_mymultipart.2~i4lpyR1VV4R83RNBGhUOJpg6TMH9NSG.3 2024-09-12T18:36:00.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.520__shadow_mymultipart.2~i4lpyR1VV4R83RNBGhUOJpg6TMH9NSG.3_1 2024-09-12T18:36:00.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.520__multipart_mymultipart.2~i4lpyR1VV4R83RNBGhUOJpg6TMH9NSG.4 2024-09-12T18:36:00.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.520__shadow_mymultipart.2~i4lpyR1VV4R83RNBGhUOJpg6TMH9NSG.4_1 2024-09-12T18:36:00.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.717+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.520__multipart_mymultipart.2~i4lpyR1VV4R83RNBGhUOJpg6TMH9NSG.5 2024-09-12T18:36:00.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.520__shadow_mymultipart.2~i4lpyR1VV4R83RNBGhUOJpg6TMH9NSG.5_1 2024-09-12T18:36:00.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.520__multipart_mymultipart.2~i4lpyR1VV4R83RNBGhUOJpg6TMH9NSG.6 2024-09-12T18:36:00.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.520__shadow_mymultipart.2~i4lpyR1VV4R83RNBGhUOJpg6TMH9NSG.6_1 2024-09-12T18:36:00.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.725+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2950263548240400181', time=2024-09-12T20:16:46.645036+0000, chain.objs.size()=3 2024-09-12T18:36:00.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.526__multipart_mymultipart.2~Flxr42pH3Fl1EMiNDGKzHmvoBRyV-1W.1 2024-09-12T18:36:00.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.526__multipart_mymultipart.2~Flxr42pH3Fl1EMiNDGKzHmvoBRyV-1W.2 2024-09-12T18:36:00.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.526__multipart_mymultipart.2~Flxr42pH3Fl1EMiNDGKzHmvoBRyV-1W.3 2024-09-12T18:36:00.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.725+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1375822549489297648', time=2024-09-12T20:18:33.921810+0000, chain.objs.size()=1 2024-09-12T18:36:00.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.558__shadow_.Xo2VUnHQFF4g4bE1wEG0ZxLO3_231sV_0 2024-09-12T18:36:00.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.725+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1272500854480482525', time=2024-09-12T20:19:09.532268+0000, chain.objs.size()=1 2024-09-12T18:36:00.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:4GdFOeutN14-.J8lUDVEITzkBmSjeOA_.7jpmz-V2ZvCEzJ7t5N49IXJvd8Vu-Ql_0 2024-09-12T18:36:00.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.725+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16149352497768133882', time=2024-09-12T20:20:24.091688+0000, chain.objs.size()=1 2024-09-12T18:36:00.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:4sWDYc55OLEt3NDDZmZ8-tVMz7JfeQh_.m6Tz5uZRI1GAUwJUR2bVAPoKkl10vXD_0 2024-09-12T18:36:00.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.725+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15688355743850901916', time=2024-09-12T20:21:01.982423+0000, chain.objs.size()=7 2024-09-12T18:36:00.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__multipart_testobj.2~jfyBJ1H9Bb2kXVZL11W7woLYDOCkHsD.1 2024-09-12T18:36:00.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.725+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__shadow_testobj.2~jfyBJ1H9Bb2kXVZL11W7woLYDOCkHsD.1_1 2024-09-12T18:36:00.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.729+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__multipart_testobj.2~jfyBJ1H9Bb2kXVZL11W7woLYDOCkHsD.2 2024-09-12T18:36:00.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.729+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__shadow_testobj.2~jfyBJ1H9Bb2kXVZL11W7woLYDOCkHsD.2_1 2024-09-12T18:36:00.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.729+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__multipart_testobj.2~jfyBJ1H9Bb2kXVZL11W7woLYDOCkHsD.3 2024-09-12T18:36:00.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.733+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__shadow_testobj.2~jfyBJ1H9Bb2kXVZL11W7woLYDOCkHsD.3_1 2024-09-12T18:36:00.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.733+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.579__multipart_testobj.2~jfyBJ1H9Bb2kXVZL11W7woLYDOCkHsD.4 2024-09-12T18:36:00.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.733+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11802714876536994186', time=2024-09-12T20:21:23.878104+0000, chain.objs.size()=1 2024-09-12T18:36:00.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.733+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.587__shadow:YQIExD4xmKbiPoX6WusXFRsuq5Ubs0M_.V4CBp9XLZUpw5LR3UQ1rBzTB93_AEdg_0 2024-09-12T18:36:00.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.733+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17034413516149682116', time=2024-09-12T20:27:48.492262+0000, chain.objs.size()=12 2024-09-12T18:36:00.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.733+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.662__multipart_baz.2~ynQw2RnFfdX5AMsRTqtXrPzbOFORGM1.1 2024-09-12T18:36:00.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.733+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.662__shadow_baz.2~ynQw2RnFfdX5AMsRTqtXrPzbOFORGM1.1_1 2024-09-12T18:36:00.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.733+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.662__multipart_baz.2~ynQw2RnFfdX5AMsRTqtXrPzbOFORGM1.2 2024-09-12T18:36:00.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.733+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.662__shadow_baz.2~ynQw2RnFfdX5AMsRTqtXrPzbOFORGM1.2_1 2024-09-12T18:36:00.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.733+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.662__multipart_baz.2~ynQw2RnFfdX5AMsRTqtXrPzbOFORGM1.3 2024-09-12T18:36:00.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.737+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.662__shadow_baz.2~ynQw2RnFfdX5AMsRTqtXrPzbOFORGM1.3_1 2024-09-12T18:36:00.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.737+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.662__multipart_baz.2~ynQw2RnFfdX5AMsRTqtXrPzbOFORGM1.4 2024-09-12T18:36:00.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.737+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.662__shadow_baz.2~ynQw2RnFfdX5AMsRTqtXrPzbOFORGM1.4_1 2024-09-12T18:36:00.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.737+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.662__multipart_baz.2~ynQw2RnFfdX5AMsRTqtXrPzbOFORGM1.5 2024-09-12T18:36:00.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.737+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.662__shadow_baz.2~ynQw2RnFfdX5AMsRTqtXrPzbOFORGM1.5_1 2024-09-12T18:36:00.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.737+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.662__multipart_baz.2~ynQw2RnFfdX5AMsRTqtXrPzbOFORGM1.6 2024-09-12T18:36:00.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.737+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.662__shadow_baz.2~ynQw2RnFfdX5AMsRTqtXrPzbOFORGM1.6_1 2024-09-12T18:36:00.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.741+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13796293677075408094', time=2024-09-12T20:27:53.725864+0000, chain.objs.size()=1 2024-09-12T18:36:00.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.741+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.665__shadow_.ay7hEnhMhc7m4Fa-787VOY65ieqXluR_0 2024-09-12T18:36:00.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.741+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16200677932545513297', time=2024-09-12T20:28:01.718234+0000, chain.objs.size()=1 2024-09-12T18:36:00.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.741+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.669__shadow_.gdiMzziFs3Mo2iIKWCig18O3laA88FL_0 2024-09-12T18:36:00.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.741+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18277037573373534160', time=2024-09-12T20:28:14.740526+0000, chain.objs.size()=1 2024-09-12T18:36:00.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.741+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.680__shadow_.j35tPUDAcYjFChls8XHsOJ0kaukCnJV_0 2024-09-12T18:36:00.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.745+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:00.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.749+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:36:00.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.749+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:00.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:00.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43479' 2024-09-12T18:36:00.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1953630760884221208', time=2024-09-12T19:56:00.207767+0000, chain.objs.size()=5 2024-09-12T18:36:00.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160__multipart_mymultipart-LUKEWARM.2~2q3T0LhDKIzCMHgRfDkbS2SaArXn0rV.1 2024-09-12T18:36:00.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160__shadow_mymultipart-LUKEWARM.2~2q3T0LhDKIzCMHgRfDkbS2SaArXn0rV.1_1 2024-09-12T18:36:00.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160__multipart_mymultipart-LUKEWARM.2~2q3T0LhDKIzCMHgRfDkbS2SaArXn0rV.2 2024-09-12T18:36:00.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160__shadow_mymultipart-LUKEWARM.2~2q3T0LhDKIzCMHgRfDkbS2SaArXn0rV.2_1 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.160__multipart_mymultipart-LUKEWARM.2~2q3T0LhDKIzCMHgRfDkbS2SaArXn0rV.3 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11054973723768001337', time=2024-09-12T20:00:15.315221+0000, chain.objs.size()=1 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.231__shadow_.g6DDxZpr6a1fJN3r7CyMHsJPBA0wFKe_0 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13145762669250655660', time=2024-09-12T20:00:36.498486+0000, chain.objs.size()=1 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.243__shadow_.LsKufEletGsWTaJHj6l8rbo1goNPnuS_0 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8594784983235423911', time=2024-09-12T20:00:44.874111+0000, chain.objs.size()=1 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.247__shadow_.VqIEvAltRNKrDLwj3_aP1h8S5kAIQVK_0 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11724642065915798423', time=2024-09-12T20:02:54.015621+0000, chain.objs.size()=1 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Mdl2LT5S4VGQLP6RKAtSD0mS8yiXZ6z_0 2024-09-12T18:36:00.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2676014917650289318', time=2024-09-12T20:02:57.540086+0000, chain.objs.size()=1 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.b-fbia942xf4fpkvVowXIyvjKsoJlny_0 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9274740692226423555', time=2024-09-12T20:02:57.876142+0000, chain.objs.size()=1 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.49e29aOOT1jHW8TuPf8g__KZwQVBhNQ_0 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13701021432245071615', time=2024-09-12T20:02:58.436679+0000, chain.objs.size()=1 2024-09-12T18:36:00.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.753+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.xY4MHCNBRQyxzuIKXufZJni70K6EvuX_0 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.397687948781322849', time=2024-09-12T20:03:00.994203+0000, chain.objs.size()=1 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.imMKFdQwlxMeDaoWdFjDzKHNG7ZZU6q_0 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3429555174200414934', time=2024-09-12T20:03:01.136920+0000, chain.objs.size()=1 2024-09-12T18:36:00.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QGUb-K_bxFFLq-vmEX-SkWWxXq8Ivy7_0 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4309493388233541391', time=2024-09-12T20:03:01.189787+0000, chain.objs.size()=1 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.nQzqy9zrlnW0RzEC7DwQtan6Tvaip8U_0 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6098014760051506797', time=2024-09-12T20:03:01.964969+0000, chain.objs.size()=1 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Za8VvVGRCD0rpF8v81X1qpE5MTQT5Ph_0 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2457900928842328510', time=2024-09-12T20:03:02.536358+0000, chain.objs.size()=1 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.n7JEtVst4-dSSNCKC9n9ox7Zb9fzwtt_0 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6959717727391928012', time=2024-09-12T20:03:04.449652+0000, chain.objs.size()=1 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.puqwg8yeiTAZF4JzwknyfB9wNYSxL38_0 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2713375397501003363', time=2024-09-12T20:03:05.216126+0000, chain.objs.size()=1 2024-09-12T18:36:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.5hqEX-otl69TWWfEN3PYzWwFYAN6rxs_0 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14757963376776737169', time=2024-09-12T20:03:05.649197+0000, chain.objs.size()=1 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.n_fuUZsTxLGUunDY5wUzzFnnRqC0xmk_0 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3469782371733527622', time=2024-09-12T20:03:06.108168+0000, chain.objs.size()=1 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.oedukqwby-y3QvObHlzCw8oSPvHAxO-_0 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.104034261429176377', time=2024-09-12T20:03:06.110331+0000, chain.objs.size()=1 2024-09-12T18:36:00.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.8MRvDhPhaZpAWnI3sZDVEzG1zBVg5dA_0 2024-09-12T18:36:00.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3128040116906980817', time=2024-09-12T20:03:08.015816+0000, chain.objs.size()=1 2024-09-12T18:36:00.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.757+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.WzHFjHQwg5V0mfgHWXUf-5A_90Sjsjy_0 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11601648918861236688', time=2024-09-12T20:03:08.018112+0000, chain.objs.size()=1 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wqKtwDMkVzvD3wJIG2HuBpAan9xQPcA_0 2024-09-12T18:36:00.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7244138159235813272', time=2024-09-12T20:03:08.982423+0000, chain.objs.size()=1 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.blpsRP0Bq20sBowSlIOkPfihw1cK7jU_0 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13882835291026075689', time=2024-09-12T20:03:09.065712+0000, chain.objs.size()=1 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.d0TjKz1Nqk8QlqYYtsaIQRuLEoE7Gj-_0 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4623813365806389374', time=2024-09-12T20:03:09.981016+0000, chain.objs.size()=1 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.5VkgBioQoPz91S10W6JDM4mC8NDxIVZ_0 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18433626780162013719', time=2024-09-12T20:03:11.100692+0000, chain.objs.size()=1 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.kWAqMPyU86aJ7WiRE0Qbt4thRWKWe7J_0 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9636314243999935121', time=2024-09-12T20:03:11.176785+0000, chain.objs.size()=1 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.IZV7jklTqJBwr5pVo5PELWtWq5INqYg_0 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1063139209929304497', time=2024-09-12T20:03:11.934948+0000, chain.objs.size()=1 2024-09-12T18:36:00.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.x4tgWrFPHLlU1jq-GiqVEoSmrsfcLOY_0 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14840349865115624763', time=2024-09-12T20:03:12.223113+0000, chain.objs.size()=1 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.frqv96Ms9q112efhdiGBW5mKjbKvJ94_0 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15843712493686819386', time=2024-09-12T20:03:12.872556+0000, chain.objs.size()=1 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.c-W5RnnH6FyHHaYO5W9vhx1JOXt3k83_0 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5889778792287849533', time=2024-09-12T20:03:13.240960+0000, chain.objs.size()=1 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.JP_zqScFWQyrFOCWOJqT0kZvpowC8l7_0 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1024921716335259059', time=2024-09-12T20:03:15.089800+0000, chain.objs.size()=1 2024-09-12T18:36:00.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.765+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.os9n-bY9AjKjuu1ZW01oYOHaCxFLcwv_0 2024-09-12T18:36:00.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6073052908426951770', time=2024-09-12T20:03:16.001323+0000, chain.objs.size()=1 2024-09-12T18:36:00.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.gGUL9vzy0vl5kgsBPd_ZrQXNSh6dnLW_0 2024-09-12T18:36:00.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3780631320701451437', time=2024-09-12T20:03:16.273720+0000, chain.objs.size()=1 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.lgYj5e5y3gl4mysP1obIuWbCrRc1S6j_0 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2269114344397574034', time=2024-09-12T20:03:19.976601+0000, chain.objs.size()=1 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.aB_rRxGr2k0PBU0-vK1HoRhEj244qud_0 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8628283406861229284', time=2024-09-12T20:03:23.806148+0000, chain.objs.size()=1 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.265__shadow_.Y-auzseylLVn3xt9QGs-knuOG0503hR_0 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8842094023806155402', time=2024-09-12T20:03:30.143136+0000, chain.objs.size()=1 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.269__shadow_.sO6Y5UYJpjCzNX58oj46S5nLDJJTUl3_0 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16835903691755790877', time=2024-09-12T20:04:17.957477+0000, chain.objs.size()=1 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.24q2guIPZ4GEI8omBNafbeijEZt0Buk_0 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1238087730954177273', time=2024-09-12T20:04:17.959627+0000, chain.objs.size()=1 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.01IT0HXMElkYIQsuGsTm8ZCSF3ok3fB_0 2024-09-12T18:36:00.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10517219730892168156', time=2024-09-12T20:04:23.216065+0000, chain.objs.size()=1 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.297__shadow_.ldbFHZcp9acPuoGsZ1S178nCEo0csfz_0 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4855969314612259226', time=2024-09-12T20:04:24.883992+0000, chain.objs.size()=1 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.298__shadow_.qkY5dc5UB2J73DkbAI88i_wAa0ABwi8_0 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17456869893337241929', time=2024-09-12T20:04:24.890876+0000, chain.objs.size()=1 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.298__shadow_.7nfSjHuSysCSPqzo4seNPsOOpbOM07N_0 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17381380506433669149', time=2024-09-12T20:04:36.924093+0000, chain.objs.size()=1 2024-09-12T18:36:00.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.769+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.305__shadow_.9x1AAI2Ku3ad_Wc3qEnugRws5PCJgos_0 2024-09-12T18:36:00.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15013038891391238688', time=2024-09-12T20:04:50.472051+0000, chain.objs.size()=1 2024-09-12T18:36:00.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.314__shadow_.73NNkUuoOsWya9xUXFxpvXAoDWmxh91_0 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7697014385004590006', time=2024-09-12T20:06:51.017039+0000, chain.objs.size()=1 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.VUkck8HUNd9ptOKm4qAdLFMZ-w1fI-b_0 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13438794732531641328', time=2024-09-12T20:06:51.083540+0000, chain.objs.size()=1 2024-09-12T18:36:00.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.XWrmVMFitFTPoyfFmbIQ72APjzW6R8J_0 2024-09-12T18:36:00.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14021482958316305457', time=2024-09-12T20:06:51.419455+0000, chain.objs.size()=1 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.MjUXO0lrOxYy3FBaPVPDKHjRoMoNIK2_0 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12446445884306914654', time=2024-09-12T20:06:52.020195+0000, chain.objs.size()=1 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-ixSrQz96Ou_qu9llneDAEhrQZhn1bb_0 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3654071336456772199', time=2024-09-12T20:06:52.170852+0000, chain.objs.size()=1 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.97YG_R522emoFiMqtYiIJIW8BKycVIq_0 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.773+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4739448347373344489', time=2024-09-12T20:06:52.935433+0000, chain.objs.size()=1 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.773+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ThtqXjwk51b4v7Omx8aAebRrkqDiyRP_0 2024-09-12T18:36:00.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12268838553708533589', time=2024-09-12T20:06:55.417835+0000, chain.objs.size()=1 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.o2a_mc1HQtfZJrSONnmu9rrF9uQyOAJ_0 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2631453632555179487', time=2024-09-12T20:06:57.413436+0000, chain.objs.size()=1 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.l4faHSla3SCo_vTjyLvaXBuaYI9xqTQ_0 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4375383297786584251', time=2024-09-12T20:06:57.542832+0000, chain.objs.size()=1 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.5hPP6WtO2tL19fVWoqmJgHferRz1pRb_0 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7980510354410916049', time=2024-09-12T20:06:58.738983+0000, chain.objs.size()=1 2024-09-12T18:36:00.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.VyBwT1QqWdM-Z0-WnK23ncu5UEQWxib_0 2024-09-12T18:36:00.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4111895725394614585', time=2024-09-12T20:06:59.206970+0000, chain.objs.size()=1 2024-09-12T18:36:00.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.lUI2rvIHdCOu-l711VGDueuc1pzmqIl_0 2024-09-12T18:36:00.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2028654013486949455', time=2024-09-12T20:06:59.354597+0000, chain.objs.size()=1 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.SeKz8IkyhmqqwQRC46rEAQUiQS9mv3e_0 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10889088268840472717', time=2024-09-12T20:06:59.455006+0000, chain.objs.size()=1 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.MM7Q9OxJk4WgV875hQ8EyItgR5Q1XXh_0 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6058020461090056024', time=2024-09-12T20:07:00.225815+0000, chain.objs.size()=1 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.2r6O_XQ3GNTaaV5FQ2syxRQ7aGk4k3-_0 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10424052130995909251', time=2024-09-12T20:07:01.031636+0000, chain.objs.size()=1 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.6Qk5lRot-DJVsbDWWZmcYofyMajoJem_0 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9730743697982457232', time=2024-09-12T20:07:01.592634+0000, chain.objs.size()=1 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Su_7jz166zLQqTUmtHvNh6FQXX3eo-F_0 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1975796264121238302', time=2024-09-12T20:07:02.972346+0000, chain.objs.size()=1 2024-09-12T18:36:00.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.777+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.wqEKCyFzXjEThoVLIyGBD-9ET5fGNUT_0 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13262413513021983737', time=2024-09-12T20:07:02.978659+0000, chain.objs.size()=1 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.BtmA9kBYm64PzMV1V-2Cs1AUsXKy0r4_0 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9889431953318833847', time=2024-09-12T20:07:04.842139+0000, chain.objs.size()=1 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.hzKUdW9v5KQOOAsztCjMZY1gJGOXsUZ_0 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9258571192792090698', time=2024-09-12T20:07:05.074228+0000, chain.objs.size()=1 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.FTG6uWHIUANgJB5JbM47zp-ihuP7LR7_0 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2891312635709009712', time=2024-09-12T20:07:05.390213+0000, chain.objs.size()=1 2024-09-12T18:36:00.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.lWQMJoVg17PRCHMy_UH5aO6XcbeZWqZ_0 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8060562681557294435', time=2024-09-12T20:07:06.298182+0000, chain.objs.size()=1 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.4XQCeaDBwW51FEcNfjCBSBJQkLqZF5B_0 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3066221294830457096', time=2024-09-12T20:07:06.556724+0000, chain.objs.size()=1 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.E1Z_bVW-_-KzzwA_nzi8dxu7mEe4ZQp_0 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5259606479603879995', time=2024-09-12T20:07:06.632753+0000, chain.objs.size()=1 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.SKMd6xpkgealjhuviRL37GQOLlM0ecc_0 2024-09-12T18:36:00.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2053348116902508089', time=2024-09-12T20:07:07.277559+0000, chain.objs.size()=1 2024-09-12T18:36:00.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.YRvf5f9IUbD9O_0eFnP_QGSYjZEPgdK_0 2024-09-12T18:36:00.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14895766135783689105', time=2024-09-12T20:07:07.712168+0000, chain.objs.size()=1 2024-09-12T18:36:00.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ErVEtkA1Azgk8Bic_fGm-drLvVXafTc_0 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4876883035540137684', time=2024-09-12T20:07:08.087853+0000, chain.objs.size()=1 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.DVcshzWO76nA8VN5dXpQ7WnRnmi5bC8_0 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11348366047429998185', time=2024-09-12T20:07:08.916835+0000, chain.objs.size()=1 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.TxU3ZguhwKOvS4aHSbROXHGHFcWsjnc_0 2024-09-12T18:36:00.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9647923212686987444', time=2024-09-12T20:07:08.919037+0000, chain.objs.size()=1 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7U-wbxJVWOckO-xQC8QvT7PCP1_Ssdl_0 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16554895335334360416', time=2024-09-12T20:07:09.046845+0000, chain.objs.size()=1 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.AdB3n5oJlVkSgBHyP-eBD7H3-Gt8VXh_0 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15895017151397316026', time=2024-09-12T20:07:09.968631+0000, chain.objs.size()=1 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Xq0KcN4r2TzjVU_GdRYPb8ZXz3oEW9-_0 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9921148902911249063', time=2024-09-12T20:07:10.211483+0000, chain.objs.size()=1 2024-09-12T18:36:00.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.1W_NnZAI7HNqrPsVEbDD5IYQ5LDrBd1_0 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3661147651099890769', time=2024-09-12T20:07:10.280781+0000, chain.objs.size()=1 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.D6r9NpT3ykc_zvwPhOlykuJegYg5V7z_0 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14643891573674607502', time=2024-09-12T20:07:11.510889+0000, chain.objs.size()=1 2024-09-12T18:36:00.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.zNNm5uxg8FYenwx4WeCQ4Qi3nO8cBnh_0 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13265338112284075283', time=2024-09-12T20:07:12.490045+0000, chain.objs.size()=1 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.GDOG7oFiv9E_3NiLzxeBIAoehI4bcAh_0 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3683232414762376422', time=2024-09-12T20:07:12.515698+0000, chain.objs.size()=1 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.PtPRb_CxuIX4wlka2fMxSf7ONEQ5Sk0_0 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.788+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9123664653828727106', time=2024-09-12T20:07:13.469854+0000, chain.objs.size()=1 2024-09-12T18:36:00.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.788+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.E4OEHC8mbQ-GrBO04J0SnuhIF1bR51x_0 2024-09-12T18:36:00.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.788+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2118169127432507052', time=2024-09-12T20:07:13.852053+0000, chain.objs.size()=1 2024-09-12T18:36:00.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.788+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.r6e_yWnvRGRIAkU5bOpHBxyiKT3bgrH_0 2024-09-12T18:36:00.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.788+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5977142462969457780', time=2024-09-12T20:07:16.144133+0000, chain.objs.size()=1 2024-09-12T18:36:00.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.788+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Yk-r7wF1_b0k8JL2oOG5_9rfY-QNyf1_0 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.792+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5765337338715193773', time=2024-09-12T20:07:16.930759+0000, chain.objs.size()=1 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.792+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.p5kPHHq-fIcaVsbv3R1co-cGdU0fwsb_0 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.792+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7995208807444858064', time=2024-09-12T20:07:17.437954+0000, chain.objs.size()=1 2024-09-12T18:36:00.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.792+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.fK0d7o3LvmMsMXRT13IZSDAl8gAlr6f_0 2024-09-12T18:36:00.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.792+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9353258909474091495', time=2024-09-12T20:07:17.680948+0000, chain.objs.size()=1 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.792+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Gjo00CfFB35SPXnXss-BuYwWcyiTkfB_0 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.792+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.100858728886618622', time=2024-09-12T20:07:17.719853+0000, chain.objs.size()=1 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.792+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.R2b_efbkI6hD5wt7qS2SCWytWQuV0xL_0 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.792+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13296180238911902377', time=2024-09-12T20:07:17.977806+0000, chain.objs.size()=1 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.792+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.9jEjimmof_kpdy6am99xvSQUuQwAd3M_0 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.792+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7820296523342629210', time=2024-09-12T20:07:18.125485+0000, chain.objs.size()=1 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.792+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-raooi83cyc8Hhu7weXVtBwZ22p6s3z_0 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.792+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1094247433338262821', time=2024-09-12T20:07:18.555218+0000, chain.objs.size()=1 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.792+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Kv7xdz8d3BkbKpSFGwdWSqXkhY9Bpse_0 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.792+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6832457632229514920', time=2024-09-12T20:07:19.121497+0000, chain.objs.size()=1 2024-09-12T18:36:00.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.792+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.m7SEzlhqDc4kssS5bfN6VKXz2t9ZwGy_0 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.796+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1533371089827692238', time=2024-09-12T20:09:01.868722+0000, chain.objs.size()=1 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.796+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.A_CRAOCboMlwGQMq-ZRUtHQZZ4k_ylK_0 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.796+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16589965651981846317', time=2024-09-12T20:09:03.870009+0000, chain.objs.size()=1 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.796+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.GerqImCdg00qHbp8I-8UQp0ezPwbEcQ_0 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.796+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4687624982403396617', time=2024-09-12T20:09:04.155486+0000, chain.objs.size()=1 2024-09-12T18:36:00.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.796+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.zKX9Is8o7MH1bVzeTaycaDPuVYQSX1X_0 2024-09-12T18:36:00.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.796+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5488671827362624595', time=2024-09-12T20:09:05.834758+0000, chain.objs.size()=1 2024-09-12T18:36:00.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.796+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Asa1kHW8GzFiprfTx12Xmv1Cyz8rAJg_0 2024-09-12T18:36:00.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.796+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.453726923713275854', time=2024-09-12T20:09:06.071902+0000, chain.objs.size()=1 2024-09-12T18:36:00.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.796+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.w19yc3peMwZJXWluQHIflnsOFjUITdN_0 2024-09-12T18:36:00.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.796+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18430153099394046903', time=2024-09-12T20:09:06.121095+0000, chain.objs.size()=1 2024-09-12T18:36:00.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.796+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.j8QOFW8ADtyDy1YxOgmsCY-THEO6puN_0 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17288227088630401856', time=2024-09-12T20:09:06.407179+0000, chain.objs.size()=1 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Ro-BjZRRuf1k5mf7S7AG4ubTzafgWiJ_0 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12114153728846887542', time=2024-09-12T20:09:06.542078+0000, chain.objs.size()=1 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vG0hrK5g_mlJ6u1pID4CokxNbkRf68O_0 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12133699889273704775', time=2024-09-12T20:09:07.863558+0000, chain.objs.size()=1 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.sDFN-WBzIKgvCXGo97rVZK_-K48FgQn_0 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4100416053414853292', time=2024-09-12T20:09:08.409682+0000, chain.objs.size()=1 2024-09-12T18:36:00.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Vtv6b6iSg0r-BKNjsFefGaCo6QrOqj3_0 2024-09-12T18:36:00.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3983519939321787179', time=2024-09-12T20:09:08.507621+0000, chain.objs.size()=1 2024-09-12T18:36:00.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.WbvPiVjq5nKtwoiUXAKgK7emkqvFo0z_0 2024-09-12T18:36:00.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.804+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43479 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8243147235300887954', time=2024-09-12T20:09:08.532718+0000, chain.objs.size()=1 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.UCLs0Arqr6xZ1v10i1HiUkOCNFrj8tf_0 2024-09-12T18:36:00.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1195111754316061055', time=2024-09-12T20:09:09.593303+0000, chain.objs.size()=1 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.eB0XJqCt5w9rvIC46ED8aZTFcAhiYti_0 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13244730631363312790', time=2024-09-12T20:09:09.595360+0000, chain.objs.size()=1 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.O0SpRZYhPD7yEUykAG5udFwUselOhdS_0 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11120551777600243637', time=2024-09-12T20:09:10.727656+0000, chain.objs.size()=1 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.upQyle9W7fsiKZ9LS2tisLU8KMzuN2U_0 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3027663519052114737', time=2024-09-12T20:09:11.048977+0000, chain.objs.size()=1 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.aB3KWXJb75T1s8aI7__HbzPW2RK1FK0_0 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15637963335742888282', time=2024-09-12T20:09:14.258795+0000, chain.objs.size()=1 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.moH2yZ2bstmrXpo1ukoeAkwrO5vGMnE_0 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6664024726364468326', time=2024-09-12T20:09:15.696269+0000, chain.objs.size()=1 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ckZVsI1zIx73IWT5WBMHLYE8l3te9ig_0 2024-09-12T18:36:00.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7769623183520338216', time=2024-09-12T20:09:15.895150+0000, chain.objs.size()=1 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ElrulDzoR6KX_yMJmzbVpxjYOatb_PC_0 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6964277459269040030', time=2024-09-12T20:09:16.102405+0000, chain.objs.size()=1 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.gn1pyYQieE9GvnKHBAyLS5bPpKr6ccz_0 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7422755326152279375', time=2024-09-12T20:09:19.065846+0000, chain.objs.size()=1 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FzYjiEthlniaUW1-X4vZEhsC0hnIK6d_0 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2729803911259990262', time=2024-09-12T20:09:19.217779+0000, chain.objs.size()=1 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ZKcHcoLPt62VFPWFefprkoMYrQuismq_0 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8815820547624838441', time=2024-09-12T20:09:19.258762+0000, chain.objs.size()=1 2024-09-12T18:36:00.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.rP-JPcDUVJu_OiKDq4Cn4jGd4YU1Gy__0 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.882620976826704314', time=2024-09-12T20:09:22.297306+0000, chain.objs.size()=1 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vv0Jai1bDE9q08tKuDpbH1-pLQZPklu_0 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5793483682254179665', time=2024-09-12T20:09:22.332736+0000, chain.objs.size()=1 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.keeY5-WRRktRS4VObmaEs_q8i7KXFdx_0 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12645786172896036847', time=2024-09-12T20:09:22.732358+0000, chain.objs.size()=1 2024-09-12T18:36:00.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.6xSNZGfsQDaFHyvxb7IeJxDy9Ms4HWJ_0 2024-09-12T18:36:00.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2011754761186129985', time=2024-09-12T20:09:24.892806+0000, chain.objs.size()=1 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.T7aW7zvkMYAegbUMBeCoXraBpsqREh__0 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10744553836800601916', time=2024-09-12T20:09:26.244502+0000, chain.objs.size()=1 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.SIoIzDZ5D8baSYOf_zY4iZ696jh4wz3_0 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16070875890489243270', time=2024-09-12T20:09:26.248449+0000, chain.objs.size()=1 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.V34joDFzWxzau-cy12Jao0NeDfa4JLV_0 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8970424553454436286', time=2024-09-12T20:09:27.132164+0000, chain.objs.size()=1 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5E8aLcPn2ReDQbX8fGXQrMjbXSV4nkG_0 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9328554489466356649', time=2024-09-12T20:09:28.832604+0000, chain.objs.size()=1 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.H8DL45shM4SHufE4fEMLqP0OCG31WWv_0 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10575368223436743398', time=2024-09-12T20:09:29.214709+0000, chain.objs.size()=1 2024-09-12T18:36:00.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Rc8aPWe68h0zigPtpcc5vTw0tHsxLhT_0 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2166162090334223472', time=2024-09-12T20:09:30.039737+0000, chain.objs.size()=1 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2oo3AVNUcp7R0-PCqH6smXNFiBP7xuM_0 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4625204177294855230', time=2024-09-12T20:09:30.102028+0000, chain.objs.size()=1 2024-09-12T18:36:00.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FYoQX62vhTpM3N3lP-R84TTVwvj5mYO_0 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.820+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3088712406381175762', time=2024-09-12T20:09:46.419720+0000, chain.objs.size()=1 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.820+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.337__shadow_.c8OaRgcma-BgRnbV-zBHoqoi178GtAA_0 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.820+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2276216482733656735', time=2024-09-12T20:11:50.742386+0000, chain.objs.size()=1 2024-09-12T18:36:00.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.820+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.433__shadow_.VvCR3CekNbqvumkADen9fXTCC1DgwCt_0 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.824+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4758778162162025143', time=2024-09-12T20:11:54.596346+0000, chain.objs.size()=1 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.436__shadow_.MvclOCDPmVTjt41cLTiDhifrmCgIpoH_0 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.824+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9453875269312067278', time=2024-09-12T20:12:13.357869+0000, chain.objs.size()=1 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.448__shadow_.E-tYsyLP_Ou066tHo3A9-bLM5PcghlL_0 2024-09-12T18:36:00.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.824+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2141240920958250077', time=2024-09-12T20:12:26.772658+0000, chain.objs.size()=1 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.457__shadow_.s5ZT2-ll6LCB2tN-d6HX66pjv2w7g6w_0 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.824+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1375009366230211985', time=2024-09-12T20:13:58.554785+0000, chain.objs.size()=6 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.1 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.2 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.3 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.4 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.5 2024-09-12T18:36:00.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.6 2024-09-12T18:36:00.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.824+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~hixHru--F-ZNKk8sscaWD5FZE1MKXww', time=2024-09-12T20:17:03.923834+0000, chain.objs.size()=2 2024-09-12T18:36:00.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.530__multipart_mymultipart.2~hixHru--F-ZNKk8sscaWD5FZE1MKXww.1 2024-09-12T18:36:00.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.530__multipart_mymultipart.2~hixHru--F-ZNKk8sscaWD5FZE1MKXww.2 2024-09-12T18:36:00.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.832+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7061230902746631090', time=2024-09-12T20:19:29.164452+0000, chain.objs.size()=1 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.832+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.571__shadow:f7ujwrx1eCQDDm1RzMQaXug6ohEqD-z_.Jzn3Yh-HG-EBWCWuZExuDeVLzffGTsz_0 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.832+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1483436024153685361', time=2024-09-12T20:20:38.779409+0000, chain.objs.size()=1 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.832+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:Odpw.dlSuGvxgtlgQKsE3TA6Y81C4Ob_.Fw-wpoiO5zjsmqOU0D3wkFFH4weAjak_0 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.832+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13621895079376588164', time=2024-09-12T20:20:39.604255+0000, chain.objs.size()=1 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.832+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:sFBD2fbnIptphvB4UXHLEYl5uRxBicT_.HAQwQfmtwrJo1tSjefjO_rVJLGZ1JvP_0 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.832+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10770666888255578418', time=2024-09-12T20:20:40.379950+0000, chain.objs.size()=1 2024-09-12T18:36:00.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.832+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:0KuKQ9osvtEFs.jDa1DxC671dncSjZH_.bLurYazhMmxm5FMnvR-cktogAGUP7m__0 2024-09-12T18:36:00.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.840+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:00.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.844+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:36:00.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.844+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:00.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.844+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:00.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50917' 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17097628552825828247', time=2024-09-12T19:55:53.247859+0000, chain.objs.size()=3 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.159__shadow_.P8A48RIgl5uPlK_Bu9n6wiKhB8gUaih_0 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.159__shadow_.P8A48RIgl5uPlK_Bu9n6wiKhB8gUaih_1 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.159__shadow_.P8A48RIgl5uPlK_Bu9n6wiKhB8gUaih_2 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8712174603670108495', time=2024-09-12T20:00:23.859408+0000, chain.objs.size()=1 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.236__shadow_.Wr4-T_ZWS0gwvRk2CtLYRrOEqjuJ3Va_0 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2649824279151463185', time=2024-09-12T20:00:36.486310+0000, chain.objs.size()=1 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.243__shadow_.WqkNIpHczPPMJ8-yMJYbKp3X4_MQwsz_0 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5726006754833782604', time=2024-09-12T20:00:36.511656+0000, chain.objs.size()=1 2024-09-12T18:36:00.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.243__shadow_.ftHQb_17jU7pAi36UaxQ7btXRsHBxeM_0 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6767568676932666684', time=2024-09-12T20:00:48.240426+0000, chain.objs.size()=1 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.249__shadow_.masySm8x8dU2NUTeLUJh3OcVPro3JoF_0 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3848860616315605654', time=2024-09-12T20:00:49.868527+0000, chain.objs.size()=1 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.250__shadow_.ITI4DBxz_b2-CC6sFrXNijxB-BC7Y8t_0 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5859410842350097069', time=2024-09-12T20:00:53.232008+0000, chain.objs.size()=1 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.252__shadow_._qYhlkigpowKmZUPT-1ReDy5RjW2qcc_0 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5864540398439943078', time=2024-09-12T20:00:56.554943+0000, chain.objs.size()=1 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.254__shadow_.b7f4MtWP4vR4SwfJQW0NLb50nbGak83_0 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16764511162334173236', time=2024-09-12T20:01:01.607917+0000, chain.objs.size()=1 2024-09-12T18:36:00.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.257__shadow_._MSiidNj8dlq1bNro-MeiNTkL0lNKp6_0 2024-09-12T18:36:00.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10636468382339119798', time=2024-09-12T20:01:09.745929+0000, chain.objs.size()=1 2024-09-12T18:36:00.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.262__shadow_.voPkuGnBTSas2-zmkaAqxnuLEQVg7d4_0 2024-09-12T18:36:00.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14051896497541191464', time=2024-09-12T20:02:52.296993+0000, chain.objs.size()=1 2024-09-12T18:36:00.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.koehbsxj0DB8nwYnqqB4__t281P439b_0 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.852+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6456535977088481924', time=2024-09-12T20:02:53.437676+0000, chain.objs.size()=1 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.852+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.kOhpqLs77QsANd6ZG7OMiMUBoq9GFOX_0 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.852+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10477602874462836210', time=2024-09-12T20:02:54.007250+0000, chain.objs.size()=1 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.852+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ezSTA2DNQZRZlNdCHlrEdBNN6o7vXYq_0 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.852+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2766585180173490253', time=2024-09-12T20:02:54.606339+0000, chain.objs.size()=1 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.852+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.rP75fdW_HBzOQY2VDX8PQ4IHmQ_vONV_0 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.852+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12723051216254289413', time=2024-09-12T20:02:55.954207+0000, chain.objs.size()=1 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.852+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3VCTTDFPE0mUO9C1pfd5-pTZsSj7yoB_0 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.852+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14977649718171475447', time=2024-09-12T20:02:56.353004+0000, chain.objs.size()=1 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.852+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.S7fO3-jJvAyGjrSAMukYKb0tL1z7IzI_0 2024-09-12T18:36:00.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.852+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8588361708447576276', time=2024-09-12T20:02:58.015337+0000, chain.objs.size()=1 2024-09-12T18:36:00.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.852+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ru58N8Y5uIdPXdJfU6OPX91Gu9RHiHI_0 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.856+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10285933717339855398', time=2024-09-12T20:02:59.902014+0000, chain.objs.size()=1 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.856+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.fW3t9FI6_WlYk2naUu5Jfu9kXibo4wK_0 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.856+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11937044953363689951', time=2024-09-12T20:03:01.029120+0000, chain.objs.size()=1 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.856+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.AAlQssvvQkH4ABzucstZqkg6xstDoOX_0 2024-09-12T18:36:00.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.856+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15885449710458543960', time=2024-09-12T20:03:01.271898+0000, chain.objs.size()=1 2024-09-12T18:36:00.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.856+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qmOpRg5Ma4DFHMprdI4pG7l3vHsyLJx_0 2024-09-12T18:36:00.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.856+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8000918416292095703', time=2024-09-12T20:03:01.883424+0000, chain.objs.size()=1 2024-09-12T18:36:00.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.856+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.7GurFEzhtINhqX6h0k7h6mb9jyGMTlF_0 2024-09-12T18:36:00.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.856+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.592908015083561263', time=2024-09-12T20:03:01.965942+0000, chain.objs.size()=1 2024-09-12T18:36:00.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.856+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XCFN_P2Pvjq2Q3NuMNjmTpXOTEEU6nS_0 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.856+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6578552692194521842', time=2024-09-12T20:03:02.064812+0000, chain.objs.size()=1 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.856+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.VIVOjPZYPvDJ6ZFe16l2H2pwB6b8xT3_0 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.856+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15582286803052406705', time=2024-09-12T20:03:02.387449+0000, chain.objs.size()=1 2024-09-12T18:36:00.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.856+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.k_AhoEAZnmINnZ9jMLjPN7zvocDT_Xo_0 2024-09-12T18:36:00.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14420111419953573245', time=2024-09-12T20:03:06.101545+0000, chain.objs.size()=1 2024-09-12T18:36:00.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.9VxKZZh33GgPqPJGVYCPldBvZiZCktj_0 2024-09-12T18:36:00.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14397879011339942936', time=2024-09-12T20:03:08.017330+0000, chain.objs.size()=1 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.jdTPB2NkvCC3NyQyxz9-g_lcsYboQs3_0 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13640162740441130988', time=2024-09-12T20:03:08.525002+0000, chain.objs.size()=1 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Lb2dq8VY2xo8JF5SY6GsFLnV-i-7c32_0 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7306078592115506736', time=2024-09-12T20:03:09.286887+0000, chain.objs.size()=1 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.YCDOhWJ-4j2-tREz92UPPKQBkXC8vuQ_0 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.924835166334076518', time=2024-09-12T20:03:09.833572+0000, chain.objs.size()=1 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.M8oQGEeUAozlhcWW3OOtpQpTpBYpOYE_0 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4443882570715221881', time=2024-09-12T20:03:12.393321+0000, chain.objs.size()=1 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.9qML4OiVY1pH46tLzyRiVIBosW_ZWNF_0 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17082806472485807928', time=2024-09-12T20:03:12.812892+0000, chain.objs.size()=1 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.soaWwHWbWqle7J7e1rYdF24j6tJeCoD_0 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9217755979569889849', time=2024-09-12T20:03:12.977280+0000, chain.objs.size()=1 2024-09-12T18:36:00.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.n9hejQIF0qRRTKVBpLHCiqkoxrhsDGa_0 2024-09-12T18:36:00.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8982228674097654531', time=2024-09-12T20:03:15.037659+0000, chain.objs.size()=1 2024-09-12T18:36:00.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.RXEuvvHMZlFZLtL6m4SdafLEq6Of17P_0 2024-09-12T18:36:00.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7789837508648150475', time=2024-09-12T20:03:17.390807+0000, chain.objs.size()=1 2024-09-12T18:36:00.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.KKoVr9WQCf6CsB8Bv3hT4BrS2IbXIgk_0 2024-09-12T18:36:00.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5348436914569975802', time=2024-09-12T20:03:18.192500+0000, chain.objs.size()=1 2024-09-12T18:36:00.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.zrlFECP8Vsto_yvkXCU_9oyUIxuuSwi_0 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10528562450325523474', time=2024-09-12T20:03:18.963200+0000, chain.objs.size()=1 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.SY8BI-YcOokFGmHEflJJ8RI4PRtEL2o_0 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18157708558164613546', time=2024-09-12T20:03:19.441559+0000, chain.objs.size()=1 2024-09-12T18:36:00.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.rs9QQjxwsY7XxbogFNN5-wBrGD2bFK5_0 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10439149793626578507', time=2024-09-12T20:03:31.653598+0000, chain.objs.size()=1 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.270__shadow_.VLmd6zqhf3NjK4LNss-rOqA-4sgQb7-_0 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15017406490697804896', time=2024-09-12T20:03:36.273181+0000, chain.objs.size()=1 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.273__shadow_.PzQcqFwE3Hk8dVbjf1uXi7KXJhEfuz6_0 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9755986580106310457', time=2024-09-12T20:04:03.155365+0000, chain.objs.size()=1 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.289__shadow_.No3E61pBZunn7oFoWlZvl5O_bl2Qb17_0 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2753192123944996472', time=2024-09-12T20:04:19.926415+0000, chain.objs.size()=1 2024-09-12T18:36:00.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.295__shadow_.pNEHITZ7QNplqWNt0tXmU52cMPsaDP__0 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14410557922735242508', time=2024-09-12T20:04:31.934896+0000, chain.objs.size()=1 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.302__shadow_.FbizAGIZ7zz2QP5Bw_EfdK1-6DrVboT_0 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9580346669163043460', time=2024-09-12T20:04:35.272722+0000, chain.objs.size()=1 2024-09-12T18:36:00.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.304__shadow_.qNEz6oWob-z26Het5NWNoiIDiOE8x0a_0 2024-09-12T18:36:00.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.868+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17098838851868699476', time=2024-09-12T20:05:02.397514+0000, chain.objs.size()=1 2024-09-12T18:36:00.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.868+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.320__shadow:hc6skyr3hD6EYcfoyhM-BK9wrP1GI0r_.MPOwdl9WLil1WdPwW6CLATydNEBGfv1_0 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.868+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.205074995274187655', time=2024-09-12T20:05:07.459736+0000, chain.objs.size()=1 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.868+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.323__shadow_.sKRB1qergI_HGmPGrADNLIepzgwrZpE_0 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.868+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1326828202831279198', time=2024-09-12T20:06:51.423964+0000, chain.objs.size()=1 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.868+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.4_YmOoF8pZvxt3gqTnjHVyarQAhtYzv_0 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.868+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13304090657763519736', time=2024-09-12T20:06:53.321054+0000, chain.objs.size()=1 2024-09-12T18:36:00.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.868+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.s1WgQJ1_6qaOixp6cvlJ8FWCojSoQcR_0 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.872+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15018421326396944518', time=2024-09-12T20:06:55.510339+0000, chain.objs.size()=1 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.872+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.rHmtRggTr4zpZstR5PNQw18Cv0Rqgfs_0 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.872+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8338357666478185281', time=2024-09-12T20:06:56.002171+0000, chain.objs.size()=1 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.872+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.p3tobowIvjBou_hPP67HBvBLAOtG7tN_0 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.872+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8384710441548814867', time=2024-09-12T20:06:56.265889+0000, chain.objs.size()=1 2024-09-12T18:36:00.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.872+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.qOTNqTuhHX9d3SoJpDVtL72Phmc1pp0_0 2024-09-12T18:36:00.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.872+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12939928328553755858', time=2024-09-12T20:06:56.481635+0000, chain.objs.size()=1 2024-09-12T18:36:00.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.872+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.eEA18suPYzrnUt6Cos8DFv0NqbrETwi_0 2024-09-12T18:36:00.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.872+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12362767169782857075', time=2024-09-12T20:06:56.895084+0000, chain.objs.size()=1 2024-09-12T18:36:00.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.872+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.04mwBCDDeFf3c7P9hsumgYR_YTMSBHT_0 2024-09-12T18:36:00.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.872+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9253376367720959854', time=2024-09-12T20:06:59.911058+0000, chain.objs.size()=1 2024-09-12T18:36:00.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.872+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.r5gTseYGZK0_e83U6Teg2U_4oXzWddf_0 2024-09-12T18:36:00.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.872+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15932783951218774001', time=2024-09-12T20:07:00.614617+0000, chain.objs.size()=1 2024-09-12T18:36:00.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.872+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.8pIMaesN1oZK5a54k2LE5HdV7eAgoRz_0 2024-09-12T18:36:00.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13789473554941331518', time=2024-09-12T20:07:00.656218+0000, chain.objs.size()=1 2024-09-12T18:36:00.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.KDOqBEgduxZvQ47LH2RY4FL097jfEAa_0 2024-09-12T18:36:00.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14160254224995124446', time=2024-09-12T20:07:00.804202+0000, chain.objs.size()=1 2024-09-12T18:36:00.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.OGESjJquD60CmCAh0qM0LdL84A7pgHG_0 2024-09-12T18:36:00.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7279562658838028363', time=2024-09-12T20:07:00.860000+0000, chain.objs.size()=1 2024-09-12T18:36:00.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.usUg8x9j21Bfjzk3WXJ_I9yC_XeCAW8_0 2024-09-12T18:36:00.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5147026759816595564', time=2024-09-12T20:07:01.594779+0000, chain.objs.size()=1 2024-09-12T18:36:00.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.NSy4sYhba9ySlpPC9i4jfm9ztIBJ33x_0 2024-09-12T18:36:00.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5945751576960840172', time=2024-09-12T20:07:03.753136+0000, chain.objs.size()=1 2024-09-12T18:36:00.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.lkZHcNe8RmPfSLys6DHcZifb5NL_7uA_0 2024-09-12T18:36:00.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16488391637939292943', time=2024-09-12T20:07:04.276355+0000, chain.objs.size()=1 2024-09-12T18:36:00.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.lqp26knQQuOzHBuYLSBcWkaMN2uugX2_0 2024-09-12T18:36:00.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5215166539021866929', time=2024-09-12T20:07:04.784724+0000, chain.objs.size()=1 2024-09-12T18:36:00.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ggRv6tFivV2qecOEMJBL0cpclF_c5FI_0 2024-09-12T18:36:00.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7000210555698573629', time=2024-09-12T20:07:07.583977+0000, chain.objs.size()=1 2024-09-12T18:36:00.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.rJ2jVGP4DTjl1ashURKZnlDOj-Rzb2C_0 2024-09-12T18:36:00.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5165495386121047387', time=2024-09-12T20:07:08.783316+0000, chain.objs.size()=1 2024-09-12T18:36:00.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.S2Q3Ss2VS_uGBD_QMleUrC4sRQDNeFV_0 2024-09-12T18:36:00.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2651519597614179435', time=2024-09-12T20:07:09.797865+0000, chain.objs.size()=1 2024-09-12T18:36:00.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.p2mv5iYQEnyD3QSz_KiokHSUE9Ae05F_0 2024-09-12T18:36:00.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12696334828842009855', time=2024-09-12T20:07:09.852074+0000, chain.objs.size()=1 2024-09-12T18:36:00.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.RRo8epjDGIvK5voBKF0Ap76k9SC4s9P_0 2024-09-12T18:36:00.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5495434495269564803', time=2024-09-12T20:07:10.684422+0000, chain.objs.size()=1 2024-09-12T18:36:00.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.CkoN9CrEbqrAVssmb2Lcx78JQOkb9EB_0 2024-09-12T18:36:00.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15299935597417627690', time=2024-09-12T20:07:10.947017+0000, chain.objs.size()=1 2024-09-12T18:36:00.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.SweNav_J2_-lVTlCRPt4jAD-LIGR0ks_0 2024-09-12T18:36:00.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6528384090141235315', time=2024-09-12T20:07:11.033784+0000, chain.objs.size()=1 2024-09-12T18:36:00.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.RSXQ6Nuj3dVCHkBtVsLuEyW7SBZ15PZ_0 2024-09-12T18:36:00.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2592760394595745535', time=2024-09-12T20:07:12.226125+0000, chain.objs.size()=1 2024-09-12T18:36:00.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.yESzL9cHo9mjKoGcOXP2DoqW_t6f3P1_0 2024-09-12T18:36:00.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9873720457748647271', time=2024-09-12T20:07:14.332197+0000, chain.objs.size()=1 2024-09-12T18:36:00.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.oo935OrK3WtyOXX3IjsOOixGXN1dFlD_0 2024-09-12T18:36:00.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14097777350797238876', time=2024-09-12T20:07:14.875155+0000, chain.objs.size()=1 2024-09-12T18:36:00.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.cJSszir-J3Yuu1Zv9Mlmgb3TMh0ks8r_0 2024-09-12T18:36:00.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15158736845619113472', time=2024-09-12T20:07:16.204652+0000, chain.objs.size()=1 2024-09-12T18:36:00.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Xk4enMlhQyNWlZhCgHTgOJSOkEisYln_0 2024-09-12T18:36:00.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17151699081597433844', time=2024-09-12T20:07:18.071628+0000, chain.objs.size()=1 2024-09-12T18:36:00.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.oCRjonkhdJNLYHSuIq78q8KTOiLlETm_0 2024-09-12T18:36:00.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15767355596057700949', time=2024-09-12T20:07:18.601177+0000, chain.objs.size()=1 2024-09-12T18:36:00.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.3bfWVk3SeQfUY5gyfAUkL71bqfy6cWJ_0 2024-09-12T18:36:00.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15067556991469773086', time=2024-09-12T20:07:18.662775+0000, chain.objs.size()=1 2024-09-12T18:36:00.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.by7dGfaU9_96adKV6cKKc8a6eRuUTb7_0 2024-09-12T18:36:00.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14069390345472470280', time=2024-09-12T20:09:01.805078+0000, chain.objs.size()=1 2024-09-12T18:36:00.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.XYnpqt1XPYMuGg_JvnxQYUhnPHz1ouJ_0 2024-09-12T18:36:00.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.884+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1066111818711540117', time=2024-09-12T20:09:05.759857+0000, chain.objs.size()=1 2024-09-12T18:36:00.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.884+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.E5EUm_SbzdNy8niCWOYmws8WeTgLFvn_0 2024-09-12T18:36:00.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.884+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5584119711960011038', time=2024-09-12T20:09:06.176836+0000, chain.objs.size()=1 2024-09-12T18:36:00.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.884+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.YO59idTLrLSflwe4Fi9Gldv-2QnGWHR_0 2024-09-12T18:36:00.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.884+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4096924419543099396', time=2024-09-12T20:09:06.648988+0000, chain.objs.size()=1 2024-09-12T18:36:00.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.884+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.aCrwxOGiw8iyhmraMjfYmrfV4bAlwog_0 2024-09-12T18:36:00.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.884+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8936382363386393624', time=2024-09-12T20:09:07.655680+0000, chain.objs.size()=1 2024-09-12T18:36:00.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.884+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.gYgbPk0OiI1OBxJLKE55e45jxImkhjS_0 2024-09-12T18:36:00.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.884+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.398884190286228740', time=2024-09-12T20:09:08.223014+0000, chain.objs.size()=1 2024-09-12T18:36:00.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.884+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.g15XWheBhE9g1_J_MKS5Vhc35fCO6cr_0 2024-09-12T18:36:00.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.884+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10604907802992206583', time=2024-09-12T20:09:10.333974+0000, chain.objs.size()=1 2024-09-12T18:36:00.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.884+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vfvug_ayNvOimsMTFC_ZhRnKMJm-jL6_0 2024-09-12T18:36:00.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.884+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5247794716006549523', time=2024-09-12T20:09:17.337396+0000, chain.objs.size()=1 2024-09-12T18:36:00.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.884+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.s7bzPcdVDRIviy9dkJIyvxuWzVKbxny_0 2024-09-12T18:36:00.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16465427305336234844', time=2024-09-12T20:09:17.339036+0000, chain.objs.size()=1 2024-09-12T18:36:00.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.omO-KbcrvblklH42OfMf2m5lD6VwI7L_0 2024-09-12T18:36:00.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3296981731269369475', time=2024-09-12T20:09:19.377831+0000, chain.objs.size()=1 2024-09-12T18:36:00.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.uvX9xOvFxzLQDV1LPCgMx8gKOsFhhod_0 2024-09-12T18:36:00.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8848079605789141230', time=2024-09-12T20:09:19.779075+0000, chain.objs.size()=1 2024-09-12T18:36:00.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.YmXGl8YhX8_D82U6u8J7Qh1I0K010GT_0 2024-09-12T18:36:00.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12934676906108186199', time=2024-09-12T20:09:21.331993+0000, chain.objs.size()=1 2024-09-12T18:36:00.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.-0P7dq28YQ0e1NcheXXUTw6sxEWHaks_0 2024-09-12T18:36:00.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4801919019589921795', time=2024-09-12T20:09:21.739254+0000, chain.objs.size()=1 2024-09-12T18:36:00.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5jt4hi0OUig_YY8uK-jdAfy-KiMmY5R_0 2024-09-12T18:36:00.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2734502390993886963', time=2024-09-12T20:09:23.478813+0000, chain.objs.size()=1 2024-09-12T18:36:00.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.hqI0V_6QxtB5_claC7zzhZySNr6M8ap_0 2024-09-12T18:36:00.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4268915392206413441', time=2024-09-12T20:09:23.732083+0000, chain.objs.size()=1 2024-09-12T18:36:00.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.nuVx5UapE18MW2sDENme5ClPFkkK36q_0 2024-09-12T18:36:00.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5580690276143894187', time=2024-09-12T20:09:24.846885+0000, chain.objs.size()=1 2024-09-12T18:36:00.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2JrFSUc2r_NrrCgg3RCLihoGBsySQAZ_0 2024-09-12T18:36:00.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2704389211919876607', time=2024-09-12T20:09:25.257101+0000, chain.objs.size()=1 2024-09-12T18:36:00.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.E9OyOJRFMxIHNRJX5W89l_e_DWUDjrm_0 2024-09-12T18:36:00.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8963516869136872282', time=2024-09-12T20:09:25.686958+0000, chain.objs.size()=1 2024-09-12T18:36:00.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.888+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.fJ9yrLNxF7iiv6h8vUnyR9PFp7_36II_0 2024-09-12T18:36:00.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.892+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1256568956643786847', time=2024-09-12T20:09:27.296659+0000, chain.objs.size()=1 2024-09-12T18:36:00.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.i-xyZCpekjbRsS-NfstV69REJQTuyz2_0 2024-09-12T18:36:00.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.892+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2031139594936416499', time=2024-09-12T20:09:28.083395+0000, chain.objs.size()=1 2024-09-12T18:36:00.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.fC8Ukex16Dlf7Rd77_i58YHw5B4Y_ft_0 2024-09-12T18:36:00.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.892+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11479772353929777262', time=2024-09-12T20:09:29.258202+0000, chain.objs.size()=1 2024-09-12T18:36:00.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.skP9VfNWKEMMG2SFPKY0zF7AFQgPBBJ_0 2024-09-12T18:36:00.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.892+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5565274603056126073', time=2024-09-12T20:10:25.868095+0000, chain.objs.size()=1 2024-09-12T18:36:00.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.371__shadow_.x9qKeI1hLutzjeVPsrX678HiahgJvqS_0 2024-09-12T18:36:00.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.892+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1113744448217213149', time=2024-09-12T20:12:32.831948+0000, chain.objs.size()=1 2024-09-12T18:36:00.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.460__shadow_.BOxFcq55ehhnvH0Yxf92XHOhgPu30bx_0 2024-09-12T18:36:00.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.896+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6718767626790456376', time=2024-09-12T20:12:36.902112+0000, chain.objs.size()=1 2024-09-12T18:36:00.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.896+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.462__shadow_.jgJwdiTXzg0wtg873x66KyDXtRUiawD_0 2024-09-12T18:36:00.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.896+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16286355931336423364', time=2024-09-12T20:12:43.330692+0000, chain.objs.size()=1 2024-09-12T18:36:00.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.896+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.465__shadow_.PcjZjQ3frFbM7NfTFe8r4JZRyQj8zv6_0 2024-09-12T18:36:00.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.900+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50917 2024-09-12T18:36:00.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:36:00.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14619563408631274586', time=2024-09-12T20:12:44.957633+0000, chain.objs.size()=1 2024-09-12T18:36:00.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.466__shadow_.O7aMknKxN070hE6Po0ic5UuotpcF-9q_0 2024-09-12T18:36:00.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11106976469450788299', time=2024-09-12T20:12:45.585737+0000, chain.objs.size()=1 2024-09-12T18:36:00.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.466__shadow_.cb63Qou5ii_RNbNiXX00V2CUv3zP4K4_0 2024-09-12T18:36:00.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5096643676155548856', time=2024-09-12T20:13:20.054682+0000, chain.objs.size()=1 2024-09-12T18:36:00.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.490__shadow_.fleiRtlbWE9FfkBgnr4dy-Ot5VcVegm_0 2024-09-12T18:36:00.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~QR0cQa6-9zNYMhlOltCjX0Op4VCxAdn', time=2024-09-12T20:18:47.726780+0000, chain.objs.size()=1 2024-09-12T18:36:00.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.562__multipart_mymultipart.2~QR0cQa6-9zNYMhlOltCjX0Op4VCxAdn.1 2024-09-12T18:36:00.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12669596682955157307', time=2024-09-12T20:18:58.746985+0000, chain.objs.size()=1 2024-09-12T18:36:00.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.566__shadow_._LTKoAGBGc5svp6PoGZQJ_EM84HBxXt_0 2024-09-12T18:36:00.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1361326988003170973', time=2024-09-12T20:19:10.823356+0000, chain.objs.size()=1 2024-09-12T18:36:00.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:ge-0JgM9d6t5B-6NoO7KAYbJI1iYE-e_.9wAWyaORTQyfFte7woD--tw-o_8oaIq_0 2024-09-12T18:36:00.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11211438534445223612', time=2024-09-12T20:19:18.837331+0000, chain.objs.size()=1 2024-09-12T18:36:00.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:bu9RV.IMBd.BAFxYJ0yqRqG4i4iL1Wv_.YKRyHBKV--o1kMYVoHZ1apcI2jjknvP_0 2024-09-12T18:36:00.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17893612706269298018', time=2024-09-12T20:19:23.647610+0000, chain.objs.size()=1 2024-09-12T18:36:00.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:D1RUEH6Z02s8UA.OucqeqmkU1cTZTQK_.OC1eFUNofWcV_Rsd4tnQavfVcKZKmS9_0 2024-09-12T18:36:00.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11542162475551846185', time=2024-09-12T20:19:45.250668+0000, chain.objs.size()=1 2024-09-12T18:36:00.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.575__shadow:TPMWUQcBgDfRibBEvwZomW5KXY3keoF_.6b9NdYcC5kB6mFE8irFRMJHmAdQjNOq_0 2024-09-12T18:36:00.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6644481718468316097', time=2024-09-12T20:21:06.811240+0000, chain.objs.size()=1 2024-09-12T18:36:00.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.580__shadow:o5hkH.R6qK7FlbDpNqVNMPvnxGHI2uP_.Za1IEwJ_0hiVD9mj_pp3STb9eCJnycd_0 2024-09-12T18:36:00.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15954233061189622595', time=2024-09-12T20:21:07.031521+0000, chain.objs.size()=1 2024-09-12T18:36:00.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.580__shadow:VlX-MuH-fRp2U4Tm7muOJm0G8pQHhUY_.Q7ZHMtfNTcZy4jseBN4gQnSyteC0R0f_0 2024-09-12T18:36:00.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2550327486462219381', time=2024-09-12T20:21:27.720671+0000, chain.objs.size()=1 2024-09-12T18:36:00.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.588__shadow:VqUHdlKhz7Phr4vSGL1FP4wS-Ox3V5o_.pTEPoPv7PyUWGBHELCj-tTlc2fIQV35_0 2024-09-12T18:36:00.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1268244332487347289', time=2024-09-12T20:27:12.423759+0000, chain.objs.size()=1 2024-09-12T18:36:00.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.908+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.652__shadow_.7HQScOiljrYftsf1QNM-9GfkEiBTgGH_0 2024-09-12T18:36:00.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.916+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:00.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:36:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:00.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45273' 2024-09-12T18:36:00.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9658105852375564938', time=2024-09-12T20:00:33.192898+0000, chain.objs.size()=1 2024-09-12T18:36:00.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.241__shadow_.f_-WeqmmWm1duF0Bb-rqQEuV0EeYaWn_0 2024-09-12T18:36:00.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8719127980354810980', time=2024-09-12T20:00:51.489063+0000, chain.objs.size()=1 2024-09-12T18:36:00.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.251__shadow_.qv48d1Mrn2ygJXXCLozBApc6mpjWje9_0 2024-09-12T18:36:00.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13754527174840005959', time=2024-09-12T20:00:53.209309+0000, chain.objs.size()=1 2024-09-12T18:36:00.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.252__shadow_.rBl_rO2KYzfAHXbCM_syB0X8KkJiXSK_0 2024-09-12T18:36:00.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7220023752092571070', time=2024-09-12T20:00:58.286048+0000, chain.objs.size()=1 2024-09-12T18:36:00.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.255__shadow_.03YFguRW0fuTdvRr9ip8Hl2YLIi-JVT_0 2024-09-12T18:36:00.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13732828770131553601', time=2024-09-12T20:00:59.948807+0000, chain.objs.size()=1 2024-09-12T18:36:00.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.256__shadow_.vL1QmgE6d30SofkTP9-P-tTFFjM9Q-j_0 2024-09-12T18:36:00.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14969064885392528026', time=2024-09-12T20:02:52.070388+0000, chain.objs.size()=1 2024-09-12T18:36:00.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QBIf62iR0vuJ_lx_laKZLUMJoRcLajn_0 2024-09-12T18:36:00.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12227394382701124942', time=2024-09-12T20:02:54.258391+0000, chain.objs.size()=1 2024-09-12T18:36:00.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.nIkp6KTqZ0YlN0N6qYLim-96MK1J4Q9_0 2024-09-12T18:36:00.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4262398048308739400', time=2024-09-12T20:02:55.832660+0000, chain.objs.size()=1 2024-09-12T18:36:00.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.A8XbIZWdoohOlS2xwrspD5g4pAu5bPa_0 2024-09-12T18:36:00.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9437531983403558590', time=2024-09-12T20:02:56.032955+0000, chain.objs.size()=1 2024-09-12T18:36:00.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.IcQtP1VMtMeCisp8S-_dLCxZP7PoGqp_0 2024-09-12T18:36:00.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12517336729705171994', time=2024-09-12T20:02:56.311917+0000, chain.objs.size()=1 2024-09-12T18:36:00.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.vKdJsKUbkLjr8O1Y5OpLJ3GCKZ5xzHx_0 2024-09-12T18:36:00.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5660120474556488508', time=2024-09-12T20:02:57.381305+0000, chain.objs.size()=1 2024-09-12T18:36:00.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.DlXQ7ffoJl4QqeI-B2cam-QJFBUqEFG_0 2024-09-12T18:36:00.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8582176368119952841', time=2024-09-12T20:02:58.482443+0000, chain.objs.size()=1 2024-09-12T18:36:00.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.924+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.F-G8X_LXWN9R9qY8nzEOJmuclEm5QPQ_0 2024-09-12T18:36:00.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.928+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2850413637756651875', time=2024-09-12T20:03:00.481024+0000, chain.objs.size()=1 2024-09-12T18:36:00.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.928+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.LuIOq5j8nsTX8Cyqz44erstA_8hKt6p_0 2024-09-12T18:36:00.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.928+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10860911488777549650', time=2024-09-12T20:03:00.559716+0000, chain.objs.size()=1 2024-09-12T18:36:00.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.928+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.xjgzhxfEr33m7c54mDP-nHRD6kqV2Tn_0 2024-09-12T18:36:00.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.928+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7559616992478164062', time=2024-09-12T20:03:00.669148+0000, chain.objs.size()=1 2024-09-12T18:36:00.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.928+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3cGj9miLHftCa_Ekke9Epl40SPok3QS_0 2024-09-12T18:36:00.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.928+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8719264935048700602', time=2024-09-12T20:03:00.861175+0000, chain.objs.size()=1 2024-09-12T18:36:00.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.928+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.R1BNdWreD398ppKLMj9DuakWRfAkavp_0 2024-09-12T18:36:00.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.928+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16699931490052582866', time=2024-09-12T20:03:01.664516+0000, chain.objs.size()=1 2024-09-12T18:36:00.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.928+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.0CfeU05RkI1r09Oy507Od0SYhKui-1R_0 2024-09-12T18:36:00.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.928+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9078838800972791775', time=2024-09-12T20:03:03.616740+0000, chain.objs.size()=1 2024-09-12T18:36:00.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.928+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.CERzQZfEP5757YkgQw8mC4AFVK6TrBQ_0 2024-09-12T18:36:00.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.932+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3511695599789897335', time=2024-09-12T20:03:03.618500+0000, chain.objs.size()=1 2024-09-12T18:36:00.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.932+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.KQYrrEZydHOPY3fqXpO1Kgd7CtFUJvO_0 2024-09-12T18:36:00.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.932+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2849298129383776066', time=2024-09-12T20:03:08.583758+0000, chain.objs.size()=1 2024-09-12T18:36:00.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.932+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.5pYDS880quycg1yO5OU9VT-6HboD8p-_0 2024-09-12T18:36:00.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.932+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12787432126631418756', time=2024-09-12T20:03:09.357374+0000, chain.objs.size()=1 2024-09-12T18:36:00.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.932+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.MUTc_zwncCjoO5N_d8hybNokUCh8_cn_0 2024-09-12T18:36:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.932+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9303994989231691602', time=2024-09-12T20:03:10.149671+0000, chain.objs.size()=1 2024-09-12T18:36:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.932+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.vb1TNtugiCFH-wYgkiZ1Sye4KN9EWEu_0 2024-09-12T18:36:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.932+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2710873546588104391', time=2024-09-12T20:03:10.997440+0000, chain.objs.size()=1 2024-09-12T18:36:00.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.932+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.KxPrNI_FOpsBC2xz6wntCbF594EmYFv_0 2024-09-12T18:36:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5411355735771103766', time=2024-09-12T20:03:11.368830+0000, chain.objs.size()=1 2024-09-12T18:36:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.5Y0_ZwsOS-3NSsNv22wTgZhadtFgAgg_0 2024-09-12T18:36:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14986770994416098621', time=2024-09-12T20:03:11.618672+0000, chain.objs.size()=1 2024-09-12T18:36:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.HtOdvMoJZeOCh6Wg2Vh3clYcLxe9eE-_0 2024-09-12T18:36:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12532752596067980878', time=2024-09-12T20:03:11.753509+0000, chain.objs.size()=1 2024-09-12T18:36:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.0knyJgipMIv7Q_DrSqzP-IIJVi_mRHw_0 2024-09-12T18:36:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12365436499961101417', time=2024-09-12T20:03:11.755724+0000, chain.objs.size()=1 2024-09-12T18:36:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ZPDvJRMp_O_YEGGFyngXnQbc58FanMR_0 2024-09-12T18:36:00.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15736331582584006114', time=2024-09-12T20:03:12.846375+0000, chain.objs.size()=1 2024-09-12T18:36:00.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.5I1mO4jGRG707czYlnYB1AebgNpKDBk_0 2024-09-12T18:36:00.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6717227413695458504', time=2024-09-12T20:03:13.698473+0000, chain.objs.size()=1 2024-09-12T18:36:00.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.T8t09Nwng0TqtJMetheLLvr9Y404zKD_0 2024-09-12T18:36:00.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17001748367797200674', time=2024-09-12T20:03:13.773899+0000, chain.objs.size()=1 2024-09-12T18:36:00.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.vf31rXJdXYy6qgzfvQHY9UxlbmWx3QY_0 2024-09-12T18:36:00.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11948849859992073994', time=2024-09-12T20:03:14.932660+0000, chain.objs.size()=1 2024-09-12T18:36:00.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.T4sFoUwZ1JN7E3w7aXhbH81y2xEXVW0_0 2024-09-12T18:36:00.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13533703268095239109', time=2024-09-12T20:03:15.608640+0000, chain.objs.size()=1 2024-09-12T18:36:00.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.7AL3IZ4UiPEcl-jy7AUdG4upe5V1L5c_0 2024-09-12T18:36:00.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6261605580679864127', time=2024-09-12T20:03:16.191115+0000, chain.objs.size()=1 2024-09-12T18:36:00.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.h-Sn5WCEuMR5d1SmLTRtPkWRe172ZSY_0 2024-09-12T18:36:00.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9336781842877362719', time=2024-09-12T20:03:16.193331+0000, chain.objs.size()=1 2024-09-12T18:36:00.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.940+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.HS1b3Uhxl_6qzXGCZIHbGX8vbwFmk_b_0 2024-09-12T18:36:00.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.944+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7027266147249922702', time=2024-09-12T20:03:16.870799+0000, chain.objs.size()=1 2024-09-12T18:36:00.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.944+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-g5wzYSW3TR68aR3NW6Mvr-4_jnKqOY_0 2024-09-12T18:36:00.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.944+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4677412389378500679', time=2024-09-12T20:03:16.994605+0000, chain.objs.size()=1 2024-09-12T18:36:00.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.944+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ZjqVrE3JJSD7CNhc7Pe-0ZyYax7N9BY_0 2024-09-12T18:36:00.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.944+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.316351031961385346', time=2024-09-12T20:03:17.367571+0000, chain.objs.size()=1 2024-09-12T18:36:00.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.944+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.mFJGUIwaWLLckadqAuJhPwtZdEQiEZU_0 2024-09-12T18:36:00.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11041816012114168632', time=2024-09-12T20:03:20.327491+0000, chain.objs.size()=1 2024-09-12T18:36:00.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Cl-2k56vcbDTHu7QRBmhHaF3usHYlWK_0 2024-09-12T18:36:00.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4806681200629755835', time=2024-09-12T20:03:20.329620+0000, chain.objs.size()=1 2024-09-12T18:36:00.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.nvWoAvKB4oafyL-ztOHCKmHnOKJkoJ4_0 2024-09-12T18:36:00.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8965662542067121227', time=2024-09-12T20:03:36.274552+0000, chain.objs.size()=1 2024-09-12T18:36:00.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.273__shadow_.eJ5CR3HwJ9kPG3o1Pi3-2eLuXPO35sY_0 2024-09-12T18:36:00.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.534542315753167789', time=2024-09-12T20:03:49.375445+0000, chain.objs.size()=1 2024-09-12T18:36:00.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.281__shadow_.UMouil_CDlAnjxIhbNpI5SQrUOz18My_0 2024-09-12T18:36:00.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2589225561604879091', time=2024-09-12T20:03:51.130443+0000, chain.objs.size()=1 2024-09-12T18:36:00.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.282__shadow_.y0fByI5Bt2Gmr6Gk9DN-DrxUhtZByzj_0 2024-09-12T18:36:00.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1081796135515993525', time=2024-09-12T20:03:56.131000+0000, chain.objs.size()=1 2024-09-12T18:36:00.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.285__shadow_.3TsOJ4_xgcnUvkOVwN0zo8aDV3FCswP_0 2024-09-12T18:36:00.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6914133976528569050', time=2024-09-12T20:04:03.157613+0000, chain.objs.size()=1 2024-09-12T18:36:00.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.289__shadow_.Am2nkKSferAl2gF9YPxEvi42iRzjPrg_0 2024-09-12T18:36:00.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13141353281732757719', time=2024-09-12T20:04:12.961407+0000, chain.objs.size()=1 2024-09-12T18:36:00.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.R-Ok-38aiMtIg5X20uIw7ykaAthbPhz_0 2024-09-12T18:36:00.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2887335857862384521', time=2024-09-12T20:04:13.217030+0000, chain.objs.size()=1 2024-09-12T18:36:00.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.ijoxU4d5zK_SAC4w252Y8B0gX-x2W6s_0 2024-09-12T18:36:00.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7103038248293148832', time=2024-09-12T20:04:17.834190+0000, chain.objs.size()=1 2024-09-12T18:36:00.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.Wd4X3lWkG9XNNpoMKYKLqGdXPtTL82O_0 2024-09-12T18:36:00.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1797130649594552519', time=2024-09-12T20:04:17.903336+0000, chain.objs.size()=1 2024-09-12T18:36:00.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.948+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.fw0UoC7HkMZ42Wr55x5DrTFPr_3aiLG_0 2024-09-12T18:36:00.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.952+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12194813281073889367', time=2024-09-12T20:04:28.544369+0000, chain.objs.size()=1 2024-09-12T18:36:00.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.952+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.300__shadow_.Pa5EYqDcmJQCH6OzlIF3kmajv0hagS3_0 2024-09-12T18:36:00.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.952+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15610540276799007761', time=2024-09-12T20:04:38.622252+0000, chain.objs.size()=1 2024-09-12T18:36:00.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.952+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.306__shadow_.HWsPWEXS2ROtaGe-ngM5IiLuW_oMHKo_0 2024-09-12T18:36:00.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15488295806384924475', time=2024-09-12T20:06:52.208099+0000, chain.objs.size()=1 2024-09-12T18:36:00.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.QxnaN76z5RXJxrnoicnEqj5NBr5aRIz_0 2024-09-12T18:36:00.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6245267949140048188', time=2024-09-12T20:06:53.858727+0000, chain.objs.size()=1 2024-09-12T18:36:00.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Op0w_sa0CsYhPlll0wLP8e8L0VnjIU__0 2024-09-12T18:36:00.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11849481049739843984', time=2024-09-12T20:06:56.357943+0000, chain.objs.size()=1 2024-09-12T18:36:00.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.B2seQKxSLbABdGfrnmB1QUNjnVagQBA_0 2024-09-12T18:36:00.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14975990915806462009', time=2024-09-12T20:06:56.766241+0000, chain.objs.size()=1 2024-09-12T18:36:00.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.qKgUQzr3z2fnP93i3eU2MK9C_isVd9L_0 2024-09-12T18:36:00.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10432726428643728652', time=2024-09-12T20:06:59.069328+0000, chain.objs.size()=1 2024-09-12T18:36:00.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-vQKNsst5w91EGmI_iCUumOLXIbU1sT_0 2024-09-12T18:36:00.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13603851636686842617', time=2024-09-12T20:06:59.720779+0000, chain.objs.size()=1 2024-09-12T18:36:00.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Y2hT-3aYAziVEzgpQXgFw08zv_0xNl5_0 2024-09-12T18:36:00.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6319266629276582911', time=2024-09-12T20:07:00.149682+0000, chain.objs.size()=1 2024-09-12T18:36:00.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.N41bfuitRnZ1nAVxR3dsXQgI0cYt3QX_0 2024-09-12T18:36:00.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4623438332769745201', time=2024-09-12T20:07:00.539288+0000, chain.objs.size()=1 2024-09-12T18:36:00.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.kbh0yvfw9ZjFBH1c078kx_oTdq9qmAh_0 2024-09-12T18:36:00.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4003864798117134590', time=2024-09-12T20:07:00.541549+0000, chain.objs.size()=1 2024-09-12T18:36:00.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.IMFpM1DolIQxoN5RsImGgEHPEGZeh4S_0 2024-09-12T18:36:00.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15680240109855962265', time=2024-09-12T20:07:03.880356+0000, chain.objs.size()=1 2024-09-12T18:36:00.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.tul--k0csRVmKOm1evhKBpzzvRow1t__0 2024-09-12T18:36:00.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9601341838340619655', time=2024-09-12T20:07:05.001294+0000, chain.objs.size()=1 2024-09-12T18:36:00.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.956+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.l36KRK0aNbYlTHQC3VTISbb4jpRCSUE_0 2024-09-12T18:36:00.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6721147624232634416', time=2024-09-12T20:07:05.294421+0000, chain.objs.size()=1 2024-09-12T18:36:00.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ckM4Vyt00aTnS9d0hF3CmZ5YkPBFsGB_0 2024-09-12T18:36:00.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8012158186701234654', time=2024-09-12T20:07:06.230497+0000, chain.objs.size()=1 2024-09-12T18:36:00.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.k5T34aF80N8CIHM-9Lm8SKKpm_nvzGK_0 2024-09-12T18:36:00.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15101919983745503506', time=2024-09-12T20:07:06.277796+0000, chain.objs.size()=1 2024-09-12T18:36:00.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.dU5BI29DafP_WVbuKIvOtgyZKCvJ3Ne_0 2024-09-12T18:36:00.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10075299676622690387', time=2024-09-12T20:07:06.279718+0000, chain.objs.size()=1 2024-09-12T18:36:00.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.jbFipDmwSJ7lp-Ngx2qO9Gg0P5QFLsg_0 2024-09-12T18:36:00.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1403193117079588684', time=2024-09-12T20:07:07.425443+0000, chain.objs.size()=1 2024-09-12T18:36:00.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.PsfYVphqWnxwFrrsWhs0aKulQaGD4CL_0 2024-09-12T18:36:00.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14140917409354967012', time=2024-09-12T20:07:07.682078+0000, chain.objs.size()=1 2024-09-12T18:36:00.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.IgH_z_nCB3064W22eAcWrLaUJwSLw4S_0 2024-09-12T18:36:00.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12617379663972154105', time=2024-09-12T20:07:08.659394+0000, chain.objs.size()=1 2024-09-12T18:36:00.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.WAmrOYi1iVNGVC0QOwLZJe-2bG_hn8__0 2024-09-12T18:36:00.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12091987626457244061', time=2024-09-12T20:07:10.493330+0000, chain.objs.size()=1 2024-09-12T18:36:00.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.wceC6Y1GqpkaujzEDyiX8ykw870DoLY_0 2024-09-12T18:36:00.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17653917119597524428', time=2024-09-12T20:07:11.214353+0000, chain.objs.size()=1 2024-09-12T18:36:00.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.RRuqEGqjEzuxjEW9H6X5uiVDFgS_JlP_0 2024-09-12T18:36:00.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.63732352355303819', time=2024-09-12T20:07:13.325905+0000, chain.objs.size()=1 2024-09-12T18:36:00.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_._4wQCYojHg0r5DDQAsIbhyz_gptYxlk_0 2024-09-12T18:36:00.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13270000728760406884', time=2024-09-12T20:07:13.697520+0000, chain.objs.size()=1 2024-09-12T18:36:00.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_._fevxB2wHjUKz5_CE6-gjWvbXJHlRTw_0 2024-09-12T18:36:00.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15687128191789374479', time=2024-09-12T20:07:13.974066+0000, chain.objs.size()=1 2024-09-12T18:36:00.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.X-AVwoE_vtNE9WK2luacwnYnZZsqSjV_0 2024-09-12T18:36:00.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5016453073602502253', time=2024-09-12T20:07:14.497491+0000, chain.objs.size()=1 2024-09-12T18:36:00.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.960+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.aQtDECohnsHOldvsEUd-6tIfuk1bP8m_0 2024-09-12T18:36:00.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.964+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12584210924615910098', time=2024-09-12T20:07:14.577262+0000, chain.objs.size()=1 2024-09-12T18:36:00.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.964+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.aEmd3HYnuVcK90rH_dxt6lf5_wXJzIq_0 2024-09-12T18:36:00.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.964+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.632969187209135262', time=2024-09-12T20:07:15.021718+0000, chain.objs.size()=1 2024-09-12T18:36:00.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.964+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.FCoi3Gnm8dU7Tfec8rFrh15INQ4uEip_0 2024-09-12T18:36:00.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.964+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17147098626669214781', time=2024-09-12T20:07:15.346300+0000, chain.objs.size()=1 2024-09-12T18:36:00.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.964+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_._mFbD7_HVzX6yijK-GKS78xfP_qM6S8_0 2024-09-12T18:36:00.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.964+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7196629013153688193', time=2024-09-12T20:07:15.430922+0000, chain.objs.size()=1 2024-09-12T18:36:00.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.964+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.CPk-UhibVYHpZ8EqlBfDMd_vMicHNkg_0 2024-09-12T18:36:00.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.964+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12251067115573682281', time=2024-09-12T20:07:17.482500+0000, chain.objs.size()=1 2024-09-12T18:36:00.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.964+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.FGtQAmVAQwHyoFEqx2f2exVnaQx362D_0 2024-09-12T18:36:00.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.968+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2699247513862469336', time=2024-09-12T20:07:18.238211+0000, chain.objs.size()=1 2024-09-12T18:36:00.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.968+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.biE1i4DzaPH3feMLws7ge_AQdK4pKHg_0 2024-09-12T18:36:00.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.968+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8540102730369729034', time=2024-09-12T20:09:02.154853+0000, chain.objs.size()=1 2024-09-12T18:36:00.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.968+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.7UpEvqE1tzOjWzjEirOtLQxGE2gUp2l_0 2024-09-12T18:36:00.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.968+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10555442571762341564', time=2024-09-12T20:09:02.288917+0000, chain.objs.size()=1 2024-09-12T18:36:00.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.968+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.sCRDNdlE557ihAAoB4aYLaxH3VBMw4G_0 2024-09-12T18:36:00.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.968+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10755402856617297993', time=2024-09-12T20:09:03.699665+0000, chain.objs.size()=1 2024-09-12T18:36:00.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.968+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.90YlhZzGJnVgOodxXFD69VjtQ1Y7-K9_0 2024-09-12T18:36:00.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.968+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15485634692543413311', time=2024-09-12T20:09:04.210082+0000, chain.objs.size()=1 2024-09-12T18:36:00.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.968+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.mygW0fYReDdoQI2Ti4eVPEInQ66Tjvu_0 2024-09-12T18:36:00.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.968+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6928082133706674248', time=2024-09-12T20:09:04.523978+0000, chain.objs.size()=1 2024-09-12T18:36:00.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.968+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.whkuO0Ty0svBLAX8aUzxrVhxyvXCmcN_0 2024-09-12T18:36:00.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.968+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3144707215818812369', time=2024-09-12T20:09:06.541223+0000, chain.objs.size()=1 2024-09-12T18:36:00.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.968+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ArzDGpHaIb2zY4H-ShvlWHSONvzx9YC_0 2024-09-12T18:36:00.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.972+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18403120507572566266', time=2024-09-12T20:09:07.339745+0000, chain.objs.size()=1 2024-09-12T18:36:00.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.972+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5l2g-WoHtWHWU_AMFxS1ra8pk7WhfMR_0 2024-09-12T18:36:00.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.972+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7242043699896384277', time=2024-09-12T20:09:09.892459+0000, chain.objs.size()=1 2024-09-12T18:36:00.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.972+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.1mj4dNKXUyBedML8q0UEipzjO4jkEI1_0 2024-09-12T18:36:00.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.972+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.20165321314975252', time=2024-09-12T20:09:10.200455+0000, chain.objs.size()=1 2024-09-12T18:36:00.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.972+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.A8LQcHfZ2AFp9ciRvnf_TaSJtw_TDQt_0 2024-09-12T18:36:00.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.972+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14453916751459135466', time=2024-09-12T20:09:11.116576+0000, chain.objs.size()=1 2024-09-12T18:36:00.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.972+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.oqivmwsuEsJ227jFSRou52p3jXSjqz9_0 2024-09-12T18:36:00.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.972+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18176977328105400416', time=2024-09-12T20:09:12.248512+0000, chain.objs.size()=1 2024-09-12T18:36:00.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.972+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Y6BL6Tkbs2e2JiFRuoA5pQ0DTPQoBWl_0 2024-09-12T18:36:00.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.972+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.19841632866678662', time=2024-09-12T20:09:13.564731+0000, chain.objs.size()=1 2024-09-12T18:36:00.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.972+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.nEFvMQuEAOY2JRORasgEZMhQsGHqADf_0 2024-09-12T18:36:00.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.972+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9943114780948639830', time=2024-09-12T20:09:13.690780+0000, chain.objs.size()=1 2024-09-12T18:36:00.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.972+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.QcZ9n6YAA00xElY1KciPThBwUE6SsvD_0 2024-09-12T18:36:00.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.976+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6930066872952975373', time=2024-09-12T20:09:14.606118+0000, chain.objs.size()=1 2024-09-12T18:36:00.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.976+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.F4FwbJ9bltqppLfFMJCQreBV42NAOgg_0 2024-09-12T18:36:00.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.976+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11395410345564033272', time=2024-09-12T20:09:16.959701+0000, chain.objs.size()=1 2024-09-12T18:36:00.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.976+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.1tYjwjUb2kMbrWAd9eSi7Rs5-0vPdsG_0 2024-09-12T18:36:00.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.976+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3997692798062325191', time=2024-09-12T20:09:17.049589+0000, chain.objs.size()=1 2024-09-12T18:36:00.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.976+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.InDr4OK9CC0N1doxvwVYz3ROnBCYD6w_0 2024-09-12T18:36:00.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.976+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15198393087206736632', time=2024-09-12T20:09:18.565639+0000, chain.objs.size()=1 2024-09-12T18:36:00.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.976+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.kqWBoSEYP6XZwX3NjlPwVL6o1cexx6v_0 2024-09-12T18:36:00.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.976+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14336951137808908914', time=2024-09-12T20:09:18.619779+0000, chain.objs.size()=1 2024-09-12T18:36:00.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.976+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.3kOZclh9J_irkYIR16vxJNbjCE0BnIC_0 2024-09-12T18:36:00.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.976+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.199456968731251848', time=2024-09-12T20:09:19.624606+0000, chain.objs.size()=1 2024-09-12T18:36:00.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.976+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.U9ujdxkpCy_-u0sigMpFeUEJ8wye2RZ_0 2024-09-12T18:36:00.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.976+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12595808979705643469', time=2024-09-12T20:09:19.769007+0000, chain.objs.size()=1 2024-09-12T18:36:00.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.976+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.aSGo1aMYLz3QyAH6gnDdo92RneFT7hz_0 2024-09-12T18:36:00.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.980+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45273 2024-09-12T18:36:00.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T18:36:00.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11529363576863736144', time=2024-09-12T20:09:20.649029+0000, chain.objs.size()=1 2024-09-12T18:36:00.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.JQTwG9Vogd8lmF4YmWNkVjzqpotN7Kb_0 2024-09-12T18:36:00.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9692974909575579779', time=2024-09-12T20:09:21.402249+0000, chain.objs.size()=1 2024-09-12T18:36:00.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.VfdlTudlxcjaOXgcIUv7SmfV1O3Msry_0 2024-09-12T18:36:00.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17340251775325333925', time=2024-09-12T20:09:21.788358+0000, chain.objs.size()=1 2024-09-12T18:36:00.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.OtkZonxGaPNLspxQcURMoIFvAVCafxf_0 2024-09-12T18:36:00.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5158253722533016017', time=2024-09-12T20:09:22.628719+0000, chain.objs.size()=1 2024-09-12T18:36:00.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.GEhYzHw0kJEnpH2xG5h_KI2hcOawdOZ_0 2024-09-12T18:36:00.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13420911087498120770', time=2024-09-12T20:09:24.494348+0000, chain.objs.size()=1 2024-09-12T18:36:00.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.nEMqvISVNtDS2nTauHgSKLW3A6_HHjt_0 2024-09-12T18:36:00.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16424462095649893305', time=2024-09-12T20:09:24.597454+0000, chain.objs.size()=1 2024-09-12T18:36:00.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.hJh0kicO6w0KdH38kP6bhczv31fIf1z_0 2024-09-12T18:36:00.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13958842923476502306', time=2024-09-12T20:09:25.113276+0000, chain.objs.size()=1 2024-09-12T18:36:00.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.VbkCcLGSAr0eJTnSG_WvCa3vG-r1_Cp_0 2024-09-12T18:36:00.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9806556311621729207', time=2024-09-12T20:09:25.166580+0000, chain.objs.size()=1 2024-09-12T18:36:00.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.j-jq8Yglvno8wncCM2SaE91HMeiCGBm_0 2024-09-12T18:36:00.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2069235980242415002', time=2024-09-12T20:09:29.220329+0000, chain.objs.size()=1 2024-09-12T18:36:00.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.4fB5qpJKJpOnsxQiSF3CTsfJN2tSkt0_0 2024-09-12T18:36:00.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16339252204712760884', time=2024-09-12T20:09:39.444791+0000, chain.objs.size()=1 2024-09-12T18:36:00.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.332__shadow_.t3adcuXHy-r9_iU-3AnCnZqSC93E5yB_0 2024-09-12T18:36:00.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8823034119759427312', time=2024-09-12T20:09:44.967377+0000, chain.objs.size()=1 2024-09-12T18:36:00.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.336__shadow_.R5M1KIkQ2-ji-1m9duzMnYWud8SRKNT_0 2024-09-12T18:36:00.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4666852096702743158', time=2024-09-12T20:09:51.077732+0000, chain.objs.size()=1 2024-09-12T18:36:00.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.984+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.341__shadow_.4LRRVaoi-DnOUqE_H4X6maMLbkejTdj_0 2024-09-12T18:36:00.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4772293784831373446', time=2024-09-12T20:11:21.821466+0000, chain.objs.size()=1 2024-09-12T18:36:00.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.410__shadow_.h5j57V8ysDDBB-9YjbusOf783XdhGB2_0 2024-09-12T18:36:00.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7440248955038511985', time=2024-09-12T20:12:47.745066+0000, chain.objs.size()=1 2024-09-12T18:36:00.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.467__shadow_.9Jw9xVQ_3uaxTJa5T_ruvRVc--zcNGP_0 2024-09-12T18:36:00.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16110160968836055369', time=2024-09-12T20:13:17.120405+0000, chain.objs.size()=1 2024-09-12T18:36:00.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.488__shadow_.PWv02-ehkAxvGYXmM5Q2AGCQ1XsabA6_0 2024-09-12T18:36:00.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6912702965979106681', time=2024-09-12T20:13:18.669832+0000, chain.objs.size()=1 2024-09-12T18:36:00.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.489__shadow_.PFNGmtFZ1uUzNK-pbn9YmUaByedfm69_0 2024-09-12T18:36:00.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6191269194128582757', time=2024-09-12T20:13:27.588819+0000, chain.objs.size()=1 2024-09-12T18:36:00.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.496__shadow_.8ZSbBa9UQbz5UE5F_hCxxyiQbUQ5OQ5_0 2024-09-12T18:36:00.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1577622638784948620', time=2024-09-12T20:14:22.011452+0000, chain.objs.size()=1 2024-09-12T18:36:00.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.518__shadow_.LMOSEXqe_mNNvRs4AKfL3bylLqGplny_0 2024-09-12T18:36:00.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17600455909719483945', time=2024-09-12T20:19:59.220601+0000, chain.objs.size()=1 2024-09-12T18:36:00.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.577__shadow:BdtWC2zyVKTwVc09.BI6tftcTfPZpau_.onOW2xMUEWdfaA4OB-GaZ5ynwY35Smx_0 2024-09-12T18:36:00.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18093019221624890278', time=2024-09-12T20:20:04.838737+0000, chain.objs.size()=1 2024-09-12T18:36:00.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:msZqZqrgBmQOgZG9ulvhDkeMW2xJJKO_.MeNncbcHyS7UdJfpBjOWozUQJ0vhf4r_0 2024-09-12T18:36:00.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103779031000320521', time=2024-09-12T20:21:06.865636+0000, chain.objs.size()=1 2024-09-12T18:36:00.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.580__shadow:fDQDXi-r8K4h3ICfBJTFmC1CW-4Hmds_.JTkU_vnTVTxqi_uNYGpKww8wJzsTnpd_0 2024-09-12T18:36:00.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8383354320782666773', time=2024-09-12T20:21:07.233756+0000, chain.objs.size()=1 2024-09-12T18:36:00.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.580__shadow:CdpyR5Ji3HYVEkP00dTdzbIjqGX9Ekd_.ac_uTtKIZ58miJkm4ODSIkaRGTMYZlW_0 2024-09-12T18:36:00.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10850593142092845727', time=2024-09-12T20:24:30.787627+0000, chain.objs.size()=1 2024-09-12T18:36:00.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.618__shadow_.W9oBscisxP6-HA8HXTox7BohwL0q8vn_0 2024-09-12T18:36:00.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12490585806190624096', time=2024-09-12T20:26:39.760090+0000, chain.objs.size()=1 2024-09-12T18:36:00.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.988+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.636__shadow_.P8dZdjyhSOMkybOOLfb60uqFBNfwGpV_0 2024-09-12T18:36:00.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.992+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16068754883749197483', time=2024-09-12T20:27:51.360703+0000, chain.objs.size()=1 2024-09-12T18:36:00.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.992+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.664__shadow_.Xfjj9Jja5RFmL4c4fmWwd3cptABUjB9_0 2024-09-12T18:36:00.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.992+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6195102793824988726', time=2024-09-12T20:28:14.752183+0000, chain.objs.size()=1 2024-09-12T18:36:00.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.992+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.680__shadow_.8cChaNGvpIwUmNEya1FOwolEZBaDJOa_0 2024-09-12T18:36:00.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.992+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4294919344195859378', time=2024-09-12T20:30:46.739014+0000, chain.objs.size()=1 2024-09-12T18:36:00.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.992+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.746__shadow_.DZ2bvV5H7nwwfh9hJhLrtU-h7krZNI2_0 2024-09-12T18:36:00.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:00.996+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:01.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:36:01.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:01.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:01.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/59757' 2024-09-12T18:36:01.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17971872409559917465', time=2024-09-12T19:56:02.341060+0000, chain.objs.size()=1 2024-09-12T18:36:01.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.9KNOEwopt5YlM5VZ6EwEeKujqunQI6d_0 2024-09-12T18:36:01.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_zKMVZfmUrnOP67uigknWtfzftxKP30d', time=2024-09-12T19:56:30.678609+0000, chain.objs.size()=1 2024-09-12T18:36:01.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.166__shadow_.uLgDohsgFcVyJuuDIY580fD-Zmabf_n_0 2024-09-12T18:36:01.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lz_noZE3_NPWnKro2nuh61I7pKK4UhH', time=2024-09-12T19:57:35.109311+0000, chain.objs.size()=2 2024-09-12T18:36:01.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.203__multipart_mymultipart.2~lz_noZE3_NPWnKro2nuh61I7pKK4UhH.1 2024-09-12T18:36:01.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.203__shadow_mymultipart.2~lz_noZE3_NPWnKro2nuh61I7pKK4UhH.1_1 2024-09-12T18:36:01.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5260488290534942179', time=2024-09-12T20:00:13.190916+0000, chain.objs.size()=1 2024-09-12T18:36:01.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.229__shadow_.CbcjSafz8fiZkd4DVpe7kWSOBpfszbU_0 2024-09-12T18:36:01.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16014672840080162900', time=2024-09-12T20:00:20.379231+0000, chain.objs.size()=1 2024-09-12T18:36:01.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.234__shadow_.kW3EFclyFE6xvFTN2ixfz951CnDznn8_0 2024-09-12T18:36:01.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7498483953196334973', time=2024-09-12T20:00:25.517224+0000, chain.objs.size()=1 2024-09-12T18:36:01.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.237__shadow_.OduogKgQgst8VeTyj81occ33YYOwyOA_0 2024-09-12T18:36:01.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7161539403362132540', time=2024-09-12T20:00:46.514535+0000, chain.objs.size()=1 2024-09-12T18:36:01.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.248__shadow_.QnA3ls3zV8ff6MmJ1tfZPR8ibc9A77Y_0 2024-09-12T18:36:01.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.751866690119514609', time=2024-09-12T20:02:53.795540+0000, chain.objs.size()=1 2024-09-12T18:36:01.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.rn0LsDDlChjdScL-Ipf9lWGp7PPY43Q_0 2024-09-12T18:36:01.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10820965843586362045', time=2024-09-12T20:02:54.898127+0000, chain.objs.size()=1 2024-09-12T18:36:01.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.gWLd6IEjVk1ZkIcwtCDUhTS2NL5xH8U_0 2024-09-12T18:36:01.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10460301964414773079', time=2024-09-12T20:02:56.966006+0000, chain.objs.size()=1 2024-09-12T18:36:01.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ewGfhzkA7vzKEx0bM8KBnU-kY5vsIEm_0 2024-09-12T18:36:01.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17662696324789973332', time=2024-09-12T20:02:57.075770+0000, chain.objs.size()=1 2024-09-12T18:36:01.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.000+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.g_wDLicuXhvHTDv9TWezYii4KteT-fc_0 2024-09-12T18:36:01.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11912898892063770529', time=2024-09-12T20:02:58.286547+0000, chain.objs.size()=1 2024-09-12T18:36:01.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qOV6PmVqVTF5VpeavOwbq8q4MONiym7_0 2024-09-12T18:36:01.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17680838913280632983', time=2024-09-12T20:02:58.675276+0000, chain.objs.size()=1 2024-09-12T18:36:01.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.pUl4DSg-mCNfRUrdRnfY0AoPnoJywCc_0 2024-09-12T18:36:01.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5809712873611120916', time=2024-09-12T20:03:01.574494+0000, chain.objs.size()=1 2024-09-12T18:36:01.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.P9RgWo4kPJRHCumP1HfpiKBTm0uZDg__0 2024-09-12T18:36:01.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17681053281070869155', time=2024-09-12T20:03:05.562214+0000, chain.objs.size()=1 2024-09-12T18:36:01.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.8nX5eV9eTd_sXoLnBriFtKCEwNCCt0X_0 2024-09-12T18:36:01.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15442048374801516351', time=2024-09-12T20:03:07.437495+0000, chain.objs.size()=1 2024-09-12T18:36:01.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ywXZIQFY2rWk7qbI1ViKQ5Mbj_B5mQN_0 2024-09-12T18:36:01.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7842617619429967513', time=2024-09-12T20:03:07.917674+0000, chain.objs.size()=1 2024-09-12T18:36:01.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QRaS55Fl4lhYhgwxMiz7983RemgOWP-_0 2024-09-12T18:36:01.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17330028230048127687', time=2024-09-12T20:03:10.057804+0000, chain.objs.size()=1 2024-09-12T18:36:01.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.T1dfbeIZyf0vqsqY6BivQV5Iww3QCVO_0 2024-09-12T18:36:01.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16943125773725100269', time=2024-09-12T20:03:12.551131+0000, chain.objs.size()=1 2024-09-12T18:36:01.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.iw_hmXTq8kg3jgT1bbJQdATZ8_zn2vv_0 2024-09-12T18:36:01.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9188747015163872975', time=2024-09-12T20:03:12.553170+0000, chain.objs.size()=1 2024-09-12T18:36:01.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.BDxkJKGfk2qic_23EoR9bO433VqvOB3_0 2024-09-12T18:36:01.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.372132723454066233', time=2024-09-12T20:03:15.503355+0000, chain.objs.size()=1 2024-09-12T18:36:01.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.S4TzOKkwF7ovFT9Bx-E9J6ewYhnTQ00_0 2024-09-12T18:36:01.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5877334662822092351', time=2024-09-12T20:03:15.907733+0000, chain.objs.size()=1 2024-09-12T18:36:01.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.004+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.leYNSKkZ9ra9oM61Fri9iBUfQbrqMs9_0 2024-09-12T18:36:01.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.008+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11862289519837489852', time=2024-09-12T20:03:16.038664+0000, chain.objs.size()=1 2024-09-12T18:36:01.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.008+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ptg-z3bLHvuOAnvdgGFsx5Byy2aZkRt_0 2024-09-12T18:36:01.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.008+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13712355712001646643', time=2024-09-12T20:03:17.313949+0000, chain.objs.size()=1 2024-09-12T18:36:01.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.008+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Ws827mEuKkWERJJA8Denaj5rIOCX1W9_0 2024-09-12T18:36:01.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.008+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14432144814187671935', time=2024-09-12T20:03:18.120377+0000, chain.objs.size()=1 2024-09-12T18:36:01.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.008+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.suTI2aRWzc-4iqosxpZnb7apFcOvz_7_0 2024-09-12T18:36:01.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18156738072644846086', time=2024-09-12T20:03:18.687201+0000, chain.objs.size()=1 2024-09-12T18:36:01.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.cveK02zOC3QDG1G362qRP2l_QlKmhkK_0 2024-09-12T18:36:01.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9036241785149648267', time=2024-09-12T20:03:19.173518+0000, chain.objs.size()=1 2024-09-12T18:36:01.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.HVMVFZzZZFT3GY3WKrJvEWY0SdNj7l-_0 2024-09-12T18:36:01.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4810531600222205623', time=2024-09-12T20:03:19.560707+0000, chain.objs.size()=1 2024-09-12T18:36:01.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.w9hDAT7E6Z3ZW1VsIFF2wXklbUxy8T7_0 2024-09-12T18:36:01.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1515665573514246671', time=2024-09-12T20:03:19.630228+0000, chain.objs.size()=1 2024-09-12T18:36:01.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.pbMfE7DL9l2u2DYrAZpNK_Onxoniid6_0 2024-09-12T18:36:01.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17918757366017415123', time=2024-09-12T20:03:19.973037+0000, chain.objs.size()=1 2024-09-12T18:36:01.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.i6CHsCoFB9icMuWYUj2NgSY9nrkOcfw_0 2024-09-12T18:36:01.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4769591260738627083', time=2024-09-12T20:03:20.336034+0000, chain.objs.size()=1 2024-09-12T18:36:01.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.mWeBzUbDCVF9VRINbwDUSXksY7gnstv_0 2024-09-12T18:36:01.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1033571667770425993', time=2024-09-12T20:03:23.802906+0000, chain.objs.size()=1 2024-09-12T18:36:01.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.265__shadow_.2v8_8-FFxRiHxheHWLBbu3x44QtsFYG_0 2024-09-12T18:36:01.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4767547411542373939', time=2024-09-12T20:03:46.029258+0000, chain.objs.size()=1 2024-09-12T18:36:01.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.279__shadow_.twYbTWvdE1nUufJ1tiOw-ynROf1h9ka_0 2024-09-12T18:36:01.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10295329792037462164', time=2024-09-12T20:03:47.703110+0000, chain.objs.size()=1 2024-09-12T18:36:01.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.280__shadow_.T26_zSouCIpXHeho_s8_Woh09MrkEfX_0 2024-09-12T18:36:01.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9002271499839273404', time=2024-09-12T20:03:57.932004+0000, chain.objs.size()=1 2024-09-12T18:36:01.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.286__shadow_.coZaSzFUyFUQK5MDRer7AJNHAI5Ny-O_0 2024-09-12T18:36:01.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10008789163061201898', time=2024-09-12T20:04:13.180382+0000, chain.objs.size()=1 2024-09-12T18:36:01.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.012+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.C-Uk9sGZJ0xRZRBHoKlCMfmy-JErFfC_0 2024-09-12T18:36:01.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.016+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4037351041120370547', time=2024-09-12T20:06:52.457558+0000, chain.objs.size()=1 2024-09-12T18:36:01.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.016+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.BXrDiB29tkR98uKitxOxegBiPnkp8VQ_0 2024-09-12T18:36:01.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.016+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17324788408400005134', time=2024-09-12T20:06:53.319312+0000, chain.objs.size()=1 2024-09-12T18:36:01.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.016+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_._YCO8jkT1PChAQv_gBTHNhbb5WJGYdY_0 2024-09-12T18:36:01.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.016+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14970301800556030543', time=2024-09-12T20:06:54.932547+0000, chain.objs.size()=1 2024-09-12T18:36:01.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.016+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.bvaNmRZ94eGFnNS-0YevxiMQFX_vHpY_0 2024-09-12T18:36:01.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.016+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10687653447896889321', time=2024-09-12T20:06:55.027661+0000, chain.objs.size()=1 2024-09-12T18:36:01.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.016+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ZwNwrx1KBELJIz-2Zn2m5itNCKaetN2_0 2024-09-12T18:36:01.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.016+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5612646772969340194', time=2024-09-12T20:06:55.273183+0000, chain.objs.size()=1 2024-09-12T18:36:01.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.016+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.PIYpzHTom45f4TGUS27g_mFvtzRRBvY_0 2024-09-12T18:36:01.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.016+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3910068566855736742', time=2024-09-12T20:06:55.965758+0000, chain.objs.size()=1 2024-09-12T18:36:01.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.016+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.dqiytKMGHDT44CgsU5H3G6q_-YEhORU_0 2024-09-12T18:36:01.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.016+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4044938136598785132', time=2024-09-12T20:06:56.327765+0000, chain.objs.size()=1 2024-09-12T18:36:01.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.016+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ub74vcdiIAvF4q8CzXYI1k6ZpkctuFo_0 2024-09-12T18:36:01.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.020+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8560657911064459165', time=2024-09-12T20:06:56.474242+0000, chain.objs.size()=1 2024-09-12T18:36:01.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.020+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.raA_SIojjcqGQPnH5kCzaooIN9RYp_h_0 2024-09-12T18:36:01.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.020+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8985300611218342760', time=2024-09-12T20:06:56.660510+0000, chain.objs.size()=1 2024-09-12T18:36:01.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.020+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-lfHvBfCIuDVD7QmEYpLm89Sd9xRhCD_0 2024-09-12T18:36:01.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.020+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4859230845957957819', time=2024-09-12T20:06:57.750371+0000, chain.objs.size()=1 2024-09-12T18:36:01.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.020+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.n7oc79xp40o8JNxo-rbWSPY0oV163m8_0 2024-09-12T18:36:01.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.020+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4686674520177852929', time=2024-09-12T20:06:59.140962+0000, chain.objs.size()=1 2024-09-12T18:36:01.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.020+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.643dfFbekAXIlQlfYWiVWd-SlKPbJbE_0 2024-09-12T18:36:01.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.024+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2525161441904574496', time=2024-09-12T20:06:59.327603+0000, chain.objs.size()=1 2024-09-12T18:36:01.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.024+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.8sAmfPDfDvVNGCOpqTX3L5hxkIsd3Fs_0 2024-09-12T18:36:01.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.024+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10950448698355284970', time=2024-09-12T20:07:01.377288+0000, chain.objs.size()=1 2024-09-12T18:36:01.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.024+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.LvkZKcqjTRURk-MmLPhbMocyOC-wqW-_0 2024-09-12T18:36:01.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.024+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9734931998181201564', time=2024-09-12T20:07:03.368771+0000, chain.objs.size()=1 2024-09-12T18:36:01.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.024+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.qEbDFZTVAuUhC0rUIHgXSFVyH1ja_sW_0 2024-09-12T18:36:01.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.024+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13262378437897068082', time=2024-09-12T20:07:03.884876+0000, chain.objs.size()=1 2024-09-12T18:36:01.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.024+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.YM52yJd1cjKPJekw2QtB6ZN5a7W5PqR_0 2024-09-12T18:36:01.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.024+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5525401083815136120', time=2024-09-12T20:07:04.018377+0000, chain.objs.size()=1 2024-09-12T18:36:01.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.024+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.CMxutl1c9Pf2w0OrV8eKcBihW-ePwv7_0 2024-09-12T18:36:01.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.024+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10696283376037832483', time=2024-09-12T20:07:04.405372+0000, chain.objs.size()=1 2024-09-12T18:36:01.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.024+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.UMBBO8aqy3oeQ2jIUCpEch_2YpP77LR_0 2024-09-12T18:36:01.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.024+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12176805364484137799', time=2024-09-12T20:07:04.835913+0000, chain.objs.size()=1 2024-09-12T18:36:01.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.024+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.TO77peTng_oPI_wy8JIMQH4ZRIbAxVJ_0 2024-09-12T18:36:01.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10500806732823954182', time=2024-09-12T20:07:04.837253+0000, chain.objs.size()=1 2024-09-12T18:36:01.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.0OYv7YnceYKaMZQS0p9nXmkUkmRhsem_0 2024-09-12T18:36:01.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11102926975091324075', time=2024-09-12T20:07:05.381027+0000, chain.objs.size()=1 2024-09-12T18:36:01.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.2LinYwISDrXgZpK-SxMgZDWKyUbLh-v_0 2024-09-12T18:36:01.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7056840795487800183', time=2024-09-12T20:07:06.303543+0000, chain.objs.size()=1 2024-09-12T18:36:01.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.G7jzz6eGIJ7GFvJrmSc_xd3TWsEc1l7_0 2024-09-12T18:36:01.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11765412482278532885', time=2024-09-12T20:07:06.807815+0000, chain.objs.size()=1 2024-09-12T18:36:01.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.4Os51JFgjnoBpIuV_7-XlF5VAjjZ_HS_0 2024-09-12T18:36:01.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13290260759140360342', time=2024-09-12T20:07:07.451662+0000, chain.objs.size()=1 2024-09-12T18:36:01.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.w72iEEW3BGkrkXh_mV0sbBbrSi84p8l_0 2024-09-12T18:36:01.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1422104064052378529', time=2024-09-12T20:07:07.967364+0000, chain.objs.size()=1 2024-09-12T18:36:01.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.AkEBka88i2vbDjHUwbNYnHAXh4Am3k8_0 2024-09-12T18:36:01.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10146691125851580169', time=2024-09-12T20:07:08.980951+0000, chain.objs.size()=1 2024-09-12T18:36:01.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.3-J-LJMupQgnxS3PMQA8ErGPKHQJT1q_0 2024-09-12T18:36:01.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10144516489582738419', time=2024-09-12T20:07:09.888637+0000, chain.objs.size()=1 2024-09-12T18:36:01.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7mSt2yHtKWCpEtTWabuQnk7oFtdfDUc_0 2024-09-12T18:36:01.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9417433565317712906', time=2024-09-12T20:07:10.619518+0000, chain.objs.size()=1 2024-09-12T18:36:01.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.aVuaqAnYpbDXZBU0tzO8xWT479i2uUr_0 2024-09-12T18:36:01.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16157107716762012931', time=2024-09-12T20:07:11.590328+0000, chain.objs.size()=1 2024-09-12T18:36:01.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Y3lslNmGWjIUxXlafY2uDXS-budVK32_0 2024-09-12T18:36:01.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6710548227721128218', time=2024-09-12T20:07:11.684718+0000, chain.objs.size()=1 2024-09-12T18:36:01.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.028+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.dJm21wrUg9hO1gbpKeIpkxzGisr7Ix1_0 2024-09-12T18:36:01.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.032+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4489990588716704892', time=2024-09-12T20:07:12.215509+0000, chain.objs.size()=1 2024-09-12T18:36:01.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.032+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.i2c5dWKm70Bv-EA9l5CVQSTrMdK285W_0 2024-09-12T18:36:01.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.032+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16626770558432832479', time=2024-09-12T20:07:12.216939+0000, chain.objs.size()=1 2024-09-12T18:36:01.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.032+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.TGRrdiiED3d7rwdm_dPvfIaRETU8XX4_0 2024-09-12T18:36:01.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.032+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9702084965130336028', time=2024-09-12T20:07:13.648071+0000, chain.objs.size()=1 2024-09-12T18:36:01.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.032+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.F6C9kTBWKqLlUsjC_mfVMs-LB6W-lyu_0 2024-09-12T18:36:01.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.032+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7576119455415250016', time=2024-09-12T20:07:13.695569+0000, chain.objs.size()=1 2024-09-12T18:36:01.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.032+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.yan2NBFHfEP0dSnxl-hRg8dufNNZELA_0 2024-09-12T18:36:01.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.032+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5162729521502439789', time=2024-09-12T20:07:13.982668+0000, chain.objs.size()=1 2024-09-12T18:36:01.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.032+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.GbMvj84txzIDGPA5uRUZyHE24JH0Ym2_0 2024-09-12T18:36:01.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1533250595724758055', time=2024-09-12T20:07:15.104592+0000, chain.objs.size()=1 2024-09-12T18:36:01.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.EMvD2Y3Mtx9KYlPgnPXDNMG6ivKpxcj_0 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13721149011239568586', time=2024-09-12T20:07:15.580479+0000, chain.objs.size()=1 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.xBJQ9M36YhQURVcyJaIrjpsOojYEh44_0 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14805538599300300605', time=2024-09-12T20:07:15.850371+0000, chain.objs.size()=1 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.LYXX8vLzI-MBxxpjdM_rJV71vu_lePu_0 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16671234729262456744', time=2024-09-12T20:07:17.863172+0000, chain.objs.size()=1 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.KGRYktSQoFf3glrRujd73yoHKtQDxPk_0 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4538287111544971933', time=2024-09-12T20:07:18.572640+0000, chain.objs.size()=1 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ek_VqV8bS5VD9CQ2AVWSslysuEZf098_0 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9265605510916350400', time=2024-09-12T20:09:03.320958+0000, chain.objs.size()=1 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.F6BXSkgXx6p3dypUSGA2exYd0eBZd8W_0 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15712269832151871472', time=2024-09-12T20:09:04.210063+0000, chain.objs.size()=1 2024-09-12T18:36:01.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cCn2YTdKuNlrAR5A05em_cVfHddjlYz_0 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10759526862799979958', time=2024-09-12T20:09:06.188789+0000, chain.objs.size()=1 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.EfX_n2iK66u0yoLZXtdniMpxhTm1WOX_0 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13284607986040094995', time=2024-09-12T20:09:07.351465+0000, chain.objs.size()=1 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.tJtPAQ8i3rH4mQ_93L7AtySl_gq1M9M_0 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15624317331878520184', time=2024-09-12T20:09:07.614788+0000, chain.objs.size()=1 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.dNAizMXtG9cwsmfemHO87-zOsJLLBht_0 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15441455555153931636', time=2024-09-12T20:09:07.802046+0000, chain.objs.size()=1 2024-09-12T18:36:01.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.036+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.NS_8bTWVfnRfmyrE6uVpkUH2xW-Byg__0 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.040+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.731653400086920696', time=2024-09-12T20:09:08.497809+0000, chain.objs.size()=1 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.040+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5p1hcGKyRh13Ad0e_AqKl_-oH3zhQeH_0 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.040+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15351568376017355912', time=2024-09-12T20:09:08.566530+0000, chain.objs.size()=1 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.040+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.HapRFPHAqt3qMfPjr6isDKKMKNnpE-k_0 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.040+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10581840285139865481', time=2024-09-12T20:09:09.471980+0000, chain.objs.size()=1 2024-09-12T18:36:01.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.040+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.RFGLtAG6mgfNMgM25NCgDdmNG1vhuur_0 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.040+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10393876515493728373', time=2024-09-12T20:09:09.677706+0000, chain.objs.size()=1 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.040+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.gmIpKOrEtkkezcwPPMJYwcEi-UGJJJO_0 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.040+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5950736795250255951', time=2024-09-12T20:09:09.679186+0000, chain.objs.size()=1 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.040+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.oawFpLLVBuY45CrmU0weei1lQnZB6Vj_0 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.040+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.656786884952271913', time=2024-09-12T20:09:10.712316+0000, chain.objs.size()=1 2024-09-12T18:36:01.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.040+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ssbhxAxRZX5S2Wr3Lni3N-DTKHhO-Gx_0 2024-09-12T18:36:01.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4431915409690094617', time=2024-09-12T20:09:10.842817+0000, chain.objs.size()=1 2024-09-12T18:36:01.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.4TmH8h3dxgxEri0tVr6FQEeM82RJu7H_0 2024-09-12T18:36:01.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2689174418171999372', time=2024-09-12T20:09:10.960639+0000, chain.objs.size()=1 2024-09-12T18:36:01.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Q1m-7ID5-ZeBw21nnqdCJPhIqNpGbze_0 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7460216665509285824', time=2024-09-12T20:09:11.345471+0000, chain.objs.size()=1 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.kvj1dFDZp-ZHsI2LjYxKiphwDXvA7pG_0 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1894589722053819235', time=2024-09-12T20:09:11.951980+0000, chain.objs.size()=1 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.d_pXbHDELpFp6sXpIvW47ByM7cA0buD_0 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18364605454168219083', time=2024-09-12T20:09:11.955425+0000, chain.objs.size()=1 2024-09-12T18:36:01.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.HUP-mM2ODg4ReVhWJKy8vT4QQz-NNTp_0 2024-09-12T18:36:01.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2273001403970256985', time=2024-09-12T20:09:14.464174+0000, chain.objs.size()=1 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.u6OTTFU6BbDgxKoynutCtNGPMehhTe7_0 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1832923832074555456', time=2024-09-12T20:09:15.325463+0000, chain.objs.size()=1 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.dRr5kWUVulRNRoB5wW7KwYlQUPFnN5j_0 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13769573366179817711', time=2024-09-12T20:09:15.432638+0000, chain.objs.size()=1 2024-09-12T18:36:01.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FdWN6w5WGXDUSA2WIzeDxx5GXsgMn57_0 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10901625458090877007', time=2024-09-12T20:09:15.805356+0000, chain.objs.size()=1 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.dYCwLLJMneagxK3qHGwFI3WJbETzQTJ_0 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12712401995584756356', time=2024-09-12T20:09:16.056074+0000, chain.objs.size()=1 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.t2Syro5xZRKCL18zn-I4Io14DvKsoR0_0 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6772569030805275207', time=2024-09-12T20:09:17.315272+0000, chain.objs.size()=1 2024-09-12T18:36:01.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.044+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.uQ1cLV_dug2v1xbbAo58ZeIDl_liJN1_0 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.048+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14514894107695607514', time=2024-09-12T20:09:18.287229+0000, chain.objs.size()=1 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.048+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.-XTSl1WLutI_QfiiSdF0sUazqA1i2Fd_0 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.048+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16941270176566057558', time=2024-09-12T20:09:19.123948+0000, chain.objs.size()=1 2024-09-12T18:36:01.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.048+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.34_A8lxdjILuiWXrjphHFOFtBVqFWeA_0 2024-09-12T18:36:01.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/59757 2024-09-12T18:36:01.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-12T18:36:01.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9376150259274254389', time=2024-09-12T20:09:19.323764+0000, chain.objs.size()=1 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.VWXi5jQ2Pw5BrR9OYgi1xSk-f_Rxfzc_0 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5205269991491155354', time=2024-09-12T20:09:19.497887+0000, chain.objs.size()=1 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.m74iOXT02EzfI4H4QEH2c_WuhX7Lm-P_0 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8830528451808274109', time=2024-09-12T20:09:20.566917+0000, chain.objs.size()=1 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.6WIcQi9zr_ogE9NKOFozr_xVZQqJqRQ_0 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8284171975847287106', time=2024-09-12T20:09:20.571367+0000, chain.objs.size()=1 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.42dZIVQYRuaGW8KKiEtl-taU2oELohg_0 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16836830821388912720', time=2024-09-12T20:09:21.142213+0000, chain.objs.size()=1 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ONCPIK1jDNy02n_2y57FKb6mnY3XpET_0 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10675343891547019384', time=2024-09-12T20:09:22.288959+0000, chain.objs.size()=1 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.MeIZh1bPnqV3bji5E_morrStsjmOPqe_0 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8072680921386790702', time=2024-09-12T20:09:22.762279+0000, chain.objs.size()=1 2024-09-12T18:36:01.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.B5F2Dlnq80ERKTRdeoYJMdOu3Vh_Khm_0 2024-09-12T18:36:01.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1814493298133138947', time=2024-09-12T20:09:24.606710+0000, chain.objs.size()=1 2024-09-12T18:36:01.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.q-BwggTTegGYvgxdOw43THaDiOFon42_0 2024-09-12T18:36:01.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2433825795187370772', time=2024-09-12T20:09:26.336458+0000, chain.objs.size()=1 2024-09-12T18:36:01.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.tPCj5OQa3eMZMNADfgDqOA9B2sLNfvq_0 2024-09-12T18:36:01.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14771618681465567210', time=2024-09-12T20:09:26.549712+0000, chain.objs.size()=1 2024-09-12T18:36:01.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.yD1ZH1dOsKz-MzrFXq7ffbtZpigUZ8C_0 2024-09-12T18:36:01.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2854981412022960378', time=2024-09-12T20:09:28.382482+0000, chain.objs.size()=1 2024-09-12T18:36:01.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.EggtgRGU7PilYpbXFuUD4cUv6hYt4uE_0 2024-09-12T18:36:01.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9245511082886346390', time=2024-09-12T20:09:28.386909+0000, chain.objs.size()=1 2024-09-12T18:36:01.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.052+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.D6n_Zyxz_tzCnGY4Ycq3mXoXys62iky_0 2024-09-12T18:36:01.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.056+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2866702974158763491', time=2024-09-12T20:09:28.512721+0000, chain.objs.size()=1 2024-09-12T18:36:01.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.056+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.NUktRCC7W_cCrJHD0B-qjMKMXPrK19B_0 2024-09-12T18:36:01.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.056+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5248535934377937897', time=2024-09-12T20:09:29.343668+0000, chain.objs.size()=1 2024-09-12T18:36:01.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.056+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ZcFs3UnfQhQ54l3XQdF-_8_XdZHTyea_0 2024-09-12T18:36:01.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.056+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2477007294061357255', time=2024-09-12T20:09:29.529359+0000, chain.objs.size()=1 2024-09-12T18:36:01.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.056+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cCeDCvnUKdrKPj1XNvN8zFAFCc2TqgY_0 2024-09-12T18:36:01.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10916329387250957366', time=2024-09-12T20:11:20.261804+0000, chain.objs.size()=1 2024-09-12T18:36:01.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.409__shadow_.kOe0LlR9pgA8YAL6p1wkKfDfn32818w_0 2024-09-12T18:36:01.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7577577402062894364', time=2024-09-12T20:13:07.208073+0000, chain.objs.size()=1 2024-09-12T18:36:01.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.484__shadow_.UnYFeSsUMoABJ57IIAkDuEdr_Cl2ia9_0 2024-09-12T18:36:01.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8433240139976285454', time=2024-09-12T20:13:07.219734+0000, chain.objs.size()=1 2024-09-12T18:36:01.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.484__shadow_.zk9di10_sXEo6Y3Qp1Yc4vSz2Oh-VnK_0 2024-09-12T18:36:01.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2446291502737696504', time=2024-09-12T20:13:25.188522+0000, chain.objs.size()=1 2024-09-12T18:36:01.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.494__shadow_.e4NbfDR8e2g9O9SWEIvFxyti7i_2nS1_0 2024-09-12T18:36:01.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10165411946019264112', time=2024-09-12T20:13:31.555217+0000, chain.objs.size()=1 2024-09-12T18:36:01.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.498__shadow_.oFNreQP0TUDDrdPtmgqqIlsCJbWqkVy_0 2024-09-12T18:36:01.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16435591224688193243', time=2024-09-12T20:13:59.232881+0000, chain.objs.size()=6 2024-09-12T18:36:01.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.1 2024-09-12T18:36:01.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.2 2024-09-12T18:36:01.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.3 2024-09-12T18:36:01.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.4 2024-09-12T18:36:01.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.5 2024-09-12T18:36:01.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.6 2024-09-12T18:36:01.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2934426881311292788', time=2024-09-12T20:18:32.250320+0000, chain.objs.size()=1 2024-09-12T18:36:01.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.558__shadow_.Cy58odEeUMCmjpSo066VLpT6wqQTPGp_0 2024-09-12T18:36:01.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11281176953790317620', time=2024-09-12T20:18:40.998247+0000, chain.objs.size()=1 2024-09-12T18:36:01.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.559__shadow_.cErdsVNjw2_7lPwbHrPI1u2AZslNl5z_0 2024-09-12T18:36:01.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12297169580138993834', time=2024-09-12T20:19:29.028862+0000, chain.objs.size()=1 2024-09-12T18:36:01.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.571__shadow:pwZHOJVdXCQxNIhUWtKiQW6UbTE2UE9_.pPTYQmn8DOFzlbMSt2XiNykDMo-TG9w_0 2024-09-12T18:36:01.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3510469282541130373', time=2024-09-12T20:19:38.533159+0000, chain.objs.size()=1 2024-09-12T18:36:01.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.575__shadow_.DJvCwHI-4OYcqn3DgKIMd4jPwXH57L__0 2024-09-12T18:36:01.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12571919052932270616', time=2024-09-12T20:19:41.642841+0000, chain.objs.size()=1 2024-09-12T18:36:01.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.575__shadow:rjLCfyd9wHN3Bz9jWXMmchbTnjJ8eIQ_.pZpfoa2YlQCkxu6092dxf05ra6OnzeV_0 2024-09-12T18:36:01.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6172798441798682464', time=2024-09-12T20:20:06.009327+0000, chain.objs.size()=1 2024-09-12T18:36:01.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.060+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:JVHCkJSpd.ADt2p.3uC6eUfd.Nmabxz_.LuKowfzncSPwk9rhbc1FZA879gNEOQo_0 2024-09-12T18:36:01.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.064+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2546792610521343877', time=2024-09-12T20:20:10.675856+0000, chain.objs.size()=1 2024-09-12T18:36:01.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.064+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:Nrs-vggEppGeWqq.XxOtYuglGRwjb51_.8jaC8Frt_sTVUA02bGBfqKHS3QpBgma_0 2024-09-12T18:36:01.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.064+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8411197718580248408', time=2024-09-12T20:20:30.119458+0000, chain.objs.size()=1 2024-09-12T18:36:01.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.064+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:phK3jQVWeOiCD43nER2JjZ1fzDwNIuU_.bA9DkhqBTRySO2fwXWwE_DhrIf8LbjQ_0 2024-09-12T18:36:01.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.064+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11041836166405920037', time=2024-09-12T20:20:36.800171+0000, chain.objs.size()=1 2024-09-12T18:36:01.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.064+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:z6qE0svVpbBkzx78acpn.pO3dr8I6o0_.P1PIbJX5Tmvga419JJz83_05qT1HV9f_0 2024-09-12T18:36:01.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.064+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16003844464185338318', time=2024-09-12T20:21:11.790864+0000, chain.objs.size()=1 2024-09-12T18:36:01.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.064+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.581__shadow:55nEXumRUfy6092EtMsxmWtEzxCV5X2_.6pm9kzNxK9LteowoljLHH7aeJFc3b9L_0 2024-09-12T18:36:01.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.068+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16718303077254064978', time=2024-09-12T20:21:14.378927+0000, chain.objs.size()=1 2024-09-12T18:36:01.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.068+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.583__shadow:C6tQe4iTFtE.uEn448P8J6dio-h3Dwg_.sJouyv6fEcK1MYtPVvoMtQ-FH0U_Q42_0 2024-09-12T18:36:01.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.068+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12251696657479013296', time=2024-09-12T20:21:27.897023+0000, chain.objs.size()=1 2024-09-12T18:36:01.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.068+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.588__shadow:8-HNQnifYJ8yno1BiVRqGxiTkRgzean_.BmqJxWO4yLKNEvBV5d_CuGI6K_viIP7_0 2024-09-12T18:36:01.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.068+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17904341438143103400', time=2024-09-12T20:26:35.091332+0000, chain.objs.size()=1 2024-09-12T18:36:01.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.068+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.633__shadow_.koL-7UdjBkGb__MINBlFVNE_TQaM6ia_0 2024-09-12T18:36:01.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.068+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17652421233059393735', time=2024-09-12T20:27:11.108663+0000, chain.objs.size()=2 2024-09-12T18:36:01.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.068+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.651__shadow_._WaTCAXsLe_o8rGS7IXzT0zxzqLceTC_0 2024-09-12T18:36:01.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.068+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.651__shadow_._WaTCAXsLe_o8rGS7IXzT0zxzqLceTC_1 2024-09-12T18:36:01.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.068+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12595519552479574041', time=2024-09-12T20:27:55.964944+0000, chain.objs.size()=1 2024-09-12T18:36:01.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.068+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.666__shadow_.mHYjyMCyMOFY-kryxsaBwwFK_AqddsN_0 2024-09-12T18:36:01.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.068+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16687119925406801031', time=2024-09-12T20:29:28.225481+0000, chain.objs.size()=1 2024-09-12T18:36:01.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.068+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.718__shadow:Dn32qQbsa0eWG3G.2GhTw--pc6kjIXp_.pdTicmtutwQaBLuOoY6XksHpsCe1e1v_0 2024-09-12T18:36:01.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.068+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10218119690330815956', time=2024-09-12T20:30:09.073065+0000, chain.objs.size()=1 2024-09-12T18:36:01.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.068+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.741__shadow_.-hVq97r_huoANeGv9yPcr8Uvh3BSoQ2_0 2024-09-12T18:36:01.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.076+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:01.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.076+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:36:01.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.076+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:01.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:01.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45877' 2024-09-12T18:36:01.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2827701127499213915', time=2024-09-12T20:01:08.013307+0000, chain.objs.size()=1 2024-09-12T18:36:01.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.261__shadow_.l6E9Lr_Kqg-DJ-LhsLiUx1E-9TxD5DK_0 2024-09-12T18:36:01.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3649528007188103389', time=2024-09-12T20:01:09.741736+0000, chain.objs.size()=1 2024-09-12T18:36:01.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.262__shadow_.8S8L_8A2kbvR7pF6Pes5pCSXumJ_ykC_0 2024-09-12T18:36:01.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12647439926487485282', time=2024-09-12T20:02:53.206794+0000, chain.objs.size()=1 2024-09-12T18:36:01.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Y-o4IfNwmr-2IAHnRTtB_6f4bTfgMVO_0 2024-09-12T18:36:01.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15982839800908259410', time=2024-09-12T20:02:53.517044+0000, chain.objs.size()=1 2024-09-12T18:36:01.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qFQLrtQjHGlbwlRS5UMtNwFGkRVf6b5_0 2024-09-12T18:36:01.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17015294570873016503', time=2024-09-12T20:02:54.508445+0000, chain.objs.size()=1 2024-09-12T18:36:01.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.TEadPKoVkuV-gDtozMf1vZQ-9MqmoKL_0 2024-09-12T18:36:01.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11859013769891291946', time=2024-09-12T20:02:54.665293+0000, chain.objs.size()=1 2024-09-12T18:36:01.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._0VZhReY9i0dbuZrhYWOZBGoyaE1rOy_0 2024-09-12T18:36:01.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14265155986412327409', time=2024-09-12T20:02:56.663620+0000, chain.objs.size()=1 2024-09-12T18:36:01.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.z6ni7Cv-WyWxpiumH5LJhfr4PO2bjc0_0 2024-09-12T18:36:01.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16271118296773728021', time=2024-09-12T20:02:57.519258+0000, chain.objs.size()=1 2024-09-12T18:36:01.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.760AsM78qdQXyCIuJMvqVJDfzaReej6_0 2024-09-12T18:36:01.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16782530888028899045', time=2024-09-12T20:02:57.762254+0000, chain.objs.size()=1 2024-09-12T18:36:01.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ArwuxbiofdhMkmTyyhDqYjQrvM251mK_0 2024-09-12T18:36:01.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11479094851896812592', time=2024-09-12T20:03:00.436382+0000, chain.objs.size()=1 2024-09-12T18:36:01.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Uz8Cy-DdYBySd6NHkPptA5EerB27nyl_0 2024-09-12T18:36:01.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1262804842689589349', time=2024-09-12T20:03:02.384476+0000, chain.objs.size()=1 2024-09-12T18:36:01.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.E1uAghJWBRi9V2KfDJlTHvwJ3ZePM56_0 2024-09-12T18:36:01.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4558944936318854105', time=2024-09-12T20:03:06.364435+0000, chain.objs.size()=1 2024-09-12T18:36:01.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.080+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.7aIyJCHCD0Sg-IBTBYCzYdv850ZCT0w_0 2024-09-12T18:36:01.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12315595164091866178', time=2024-09-12T20:03:06.429865+0000, chain.objs.size()=1 2024-09-12T18:36:01.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.9j6BJ-ynxHdT4egyLDw7sK1MUJrCdBt_0 2024-09-12T18:36:01.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13809227264844446648', time=2024-09-12T20:03:07.441807+0000, chain.objs.size()=1 2024-09-12T18:36:01.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.cIOBhyI8hikrHsuAIsfvEiIcvUU2NZr_0 2024-09-12T18:36:01.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12451489078666043268', time=2024-09-12T20:03:08.578606+0000, chain.objs.size()=1 2024-09-12T18:36:01.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ay7KsrFOfYU5StgyeBzp_BTrBKfZrMn_0 2024-09-12T18:36:01.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.604282631341161796', time=2024-09-12T20:03:09.422319+0000, chain.objs.size()=1 2024-09-12T18:36:01.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.c0Iw0lQLWH05Xhe0FcYpDjNfJHw4xxz_0 2024-09-12T18:36:01.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3934858940569119719', time=2024-09-12T20:03:11.036588+0000, chain.objs.size()=1 2024-09-12T18:36:01.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.xtbVZ7k3I5hHlNqO5Fg5mtcVRJTj-kV_0 2024-09-12T18:36:01.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1482437447180475402', time=2024-09-12T20:03:11.392289+0000, chain.objs.size()=1 2024-09-12T18:36:01.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.tb-JbQbj4CN_GZU2DV1wdQr1IzheJYh_0 2024-09-12T18:36:01.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9567594317547252194', time=2024-09-12T20:03:12.076680+0000, chain.objs.size()=1 2024-09-12T18:36:01.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.O_i4jEib9lKXvT3Hg4YnVMRRleZ2MIr_0 2024-09-12T18:36:01.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11047647038489535244', time=2024-09-12T20:03:12.662899+0000, chain.objs.size()=1 2024-09-12T18:36:01.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.pJ_qz7BNIlCONV5AKvQEw_WdR6E4ZqN_0 2024-09-12T18:36:01.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14856364188314724293', time=2024-09-12T20:03:12.867386+0000, chain.objs.size()=1 2024-09-12T18:36:01.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.N4SbPiR89taWzLVVfubky0BswCONQj1_0 2024-09-12T18:36:01.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10463939875279899876', time=2024-09-12T20:03:13.166154+0000, chain.objs.size()=1 2024-09-12T18:36:01.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qKtDNwSlnjfO2ocn1YvkCCRP79_5FNA_0 2024-09-12T18:36:01.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1410514704191979355', time=2024-09-12T20:03:13.662001+0000, chain.objs.size()=1 2024-09-12T18:36:01.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.dq99f0pc3Vb3ReKimCjVYjhv2bNbd1Q_0 2024-09-12T18:36:01.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5482141014342092532', time=2024-09-12T20:03:14.660304+0000, chain.objs.size()=1 2024-09-12T18:36:01.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QvNppm6DbbiCTLrPObkiMarvWnTsZTC_0 2024-09-12T18:36:01.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18391844596878286972', time=2024-09-12T20:03:15.270054+0000, chain.objs.size()=1 2024-09-12T18:36:01.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.084+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.JgoGHoNlUiaQ_By8opqLSgy8mC9oPQM_0 2024-09-12T18:36:01.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15210891615006485563', time=2024-09-12T20:03:15.775779+0000, chain.objs.size()=1 2024-09-12T18:36:01.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wnRyhiwbYuJNuzxbvMicLU86MUdUEbd_0 2024-09-12T18:36:01.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13970505311237306198', time=2024-09-12T20:03:16.635267+0000, chain.objs.size()=1 2024-09-12T18:36:01.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.vgv0iVRtJ-3f13ptjXBPyCEx8lwi0Ij_0 2024-09-12T18:36:01.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4009836584557210346', time=2024-09-12T20:03:16.679150+0000, chain.objs.size()=1 2024-09-12T18:36:01.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.imigFvfhh_PZX_ii4yanZ_9ia5hmuhk_0 2024-09-12T18:36:01.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1353163155508064190', time=2024-09-12T20:03:16.969478+0000, chain.objs.size()=1 2024-09-12T18:36:01.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.VTtdVtygp56voTlRNmn-T8ojN-rrDke_0 2024-09-12T18:36:01.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13012232044565149076', time=2024-09-12T20:03:16.988711+0000, chain.objs.size()=1 2024-09-12T18:36:01.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Zg99jf0qHcTviSVR0ibZwUfRXzTWGVK_0 2024-09-12T18:36:01.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5686029114033328946', time=2024-09-12T20:03:20.107425+0000, chain.objs.size()=1 2024-09-12T18:36:01.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wHF1lZu7O4b1dsqJnqdgTTVu5YiVrtx_0 2024-09-12T18:36:01.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2684844909080951219', time=2024-09-12T20:03:20.686740+0000, chain.objs.size()=1 2024-09-12T18:36:01.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.KxXTDMbCm0DuocmI9xK9wowkqOSGlN-_0 2024-09-12T18:36:01.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11627528025911830664', time=2024-09-12T20:03:20.689044+0000, chain.objs.size()=1 2024-09-12T18:36:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2RGhQCa2Oht7iuureZMBLLNcte5NMi6_0 2024-09-12T18:36:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4089696871475562401', time=2024-09-12T20:03:33.166957+0000, chain.objs.size()=1 2024-09-12T18:36:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.271__shadow_.Zg2HaNVaGqJ5xx_3RxK7L9VZPhx2fet_0 2024-09-12T18:36:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2530244334957094074', time=2024-09-12T20:03:34.780965+0000, chain.objs.size()=1 2024-09-12T18:36:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.272__shadow_.EjVX7IDDVRuj5Sa03n1N0hapqf28Arg_0 2024-09-12T18:36:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5817982646598575095', time=2024-09-12T20:03:59.791930+0000, chain.objs.size()=1 2024-09-12T18:36:01.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.088+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.287__shadow_._VJUZXPmepVJN9HHyJ3NiYdNSvQBNE7_0 2024-09-12T18:36:01.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.391184265134013535', time=2024-09-12T20:04:17.948291+0000, chain.objs.size()=1 2024-09-12T18:36:01.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.XbFf6Vd7MgNxDqHAFokz5l2T_LjjgCr_0 2024-09-12T18:36:01.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11005701705301393181', time=2024-09-12T20:04:21.593878+0000, chain.objs.size()=1 2024-09-12T18:36:01.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.296__shadow_.9YacVV6j084DpbjZ_MUGu6ywdgO288E_0 2024-09-12T18:36:01.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5193122522032993304', time=2024-09-12T20:04:30.245570+0000, chain.objs.size()=1 2024-09-12T18:36:01.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.301__shadow_.r4J4GiR2JvEBnAvdjQi4G2DScpm-W8s_0 2024-09-12T18:36:01.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4052960685039072239', time=2024-09-12T20:04:33.576070+0000, chain.objs.size()=1 2024-09-12T18:36:01.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.303__shadow_.wwZoRcmpn8vzwtWDf5oe9xZXJcrM4wg_0 2024-09-12T18:36:01.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7392791778467349506', time=2024-09-12T20:04:40.734284+0000, chain.objs.size()=1 2024-09-12T18:36:01.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.307__shadow_.kLzZO0l1VOmjR-vLDHvV7BOKz3xvV10_0 2024-09-12T18:36:01.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9232595890606188234', time=2024-09-12T20:04:43.373525+0000, chain.objs.size()=1 2024-09-12T18:36:01.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.308__shadow:IEadQXuPEygxhEDfdy0xD6hXGmDlOPq_.z63BVESY0k2q49e4xqliskKAOFlaTn5_0 2024-09-12T18:36:01.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.792126722934536861', time=2024-09-12T20:06:53.051050+0000, chain.objs.size()=1 2024-09-12T18:36:01.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.vdVBGIYtDcRM3TWAzJ8ce1aNYJbwfy-_0 2024-09-12T18:36:01.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8781862288317000378', time=2024-09-12T20:06:55.843291+0000, chain.objs.size()=1 2024-09-12T18:36:01.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.wmAiswMmvGVa17QjFBPuVleuB_Dp_dV_0 2024-09-12T18:36:01.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5582045299537310798', time=2024-09-12T20:06:56.761999+0000, chain.objs.size()=1 2024-09-12T18:36:01.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.LRWG1LWzGh7TTQ1glCuLt7bqr7zKnjs_0 2024-09-12T18:36:01.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13976390854059189474', time=2024-09-12T20:06:58.846362+0000, chain.objs.size()=1 2024-09-12T18:36:01.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.vcA_W96B0kUOTSa22k5fBvbBlSy_6oq_0 2024-09-12T18:36:01.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4664338995034954113', time=2024-09-12T20:06:59.978811+0000, chain.objs.size()=1 2024-09-12T18:36:01.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.R-BheOEbJ6SJkuet1mit02yBe5Gck3S_0 2024-09-12T18:36:01.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5972757823246780211', time=2024-09-12T20:07:01.182139+0000, chain.objs.size()=1 2024-09-12T18:36:01.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.092+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.UwFluMn9Kg2Glo5jMhEIqGWBXNTMv1K_0 2024-09-12T18:36:01.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.096+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13635979334395919043', time=2024-09-12T20:07:03.120439+0000, chain.objs.size()=1 2024-09-12T18:36:01.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.096+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.FfR6JXwLxLDKE38nf2_MN9coYfEekaO_0 2024-09-12T18:36:01.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13050610688740704893', time=2024-09-12T20:07:03.229353+0000, chain.objs.size()=1 2024-09-12T18:36:01.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.gbVM2zCqSf-XrNaMYZTcfkoOkiAeWLd_0 2024-09-12T18:36:01.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3918547583697346235', time=2024-09-12T20:07:03.678370+0000, chain.objs.size()=1 2024-09-12T18:36:01.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Tcm-Ys4UVn9wy_WcONIVPT4BUsN5tn__0 2024-09-12T18:36:01.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7514107828600538696', time=2024-09-12T20:07:05.194493+0000, chain.objs.size()=1 2024-09-12T18:36:01.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Lb2fqDEf69CDXewcpb_moioYlk5fPHu_0 2024-09-12T18:36:01.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15381258632794637001', time=2024-09-12T20:07:06.643498+0000, chain.objs.size()=1 2024-09-12T18:36:01.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.GgVeyz91zRjIMNVaL69sp0bqGdgAej9_0 2024-09-12T18:36:01.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2663684741001069675', time=2024-09-12T20:07:07.352111+0000, chain.objs.size()=1 2024-09-12T18:36:01.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.muGnsIEQjFLvfB_SIC4cbDUlzoaiJ7q_0 2024-09-12T18:36:01.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3404986682381369982', time=2024-09-12T20:07:07.451587+0000, chain.objs.size()=1 2024-09-12T18:36:01.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.V6JxTfC4aYj0m4DKytOOZVTBH-qIXrB_0 2024-09-12T18:36:01.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5979670895642963986', time=2024-09-12T20:07:07.869940+0000, chain.objs.size()=1 2024-09-12T18:36:01.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.UmeSn8mAv4hY6kh1FS2tO1BreeDU_UM_0 2024-09-12T18:36:01.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4172219247200631282', time=2024-09-12T20:07:08.923866+0000, chain.objs.size()=1 2024-09-12T18:36:01.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.LiTRzUlfoGwS0p3ODnTbaX-EqrFNgqq_0 2024-09-12T18:36:01.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16815019181129074125', time=2024-09-12T20:07:08.925958+0000, chain.objs.size()=1 2024-09-12T18:36:01.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.lm-rSi_s0TY5UALRVL6I71XqO8JfeG4_0 2024-09-12T18:36:01.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3246987364517853456', time=2024-09-12T20:07:10.222958+0000, chain.objs.size()=1 2024-09-12T18:36:01.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.1Anwrd15BRnZWesE7-81Rdk-hppvA5P_0 2024-09-12T18:36:01.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1872765540391335120', time=2024-09-12T20:07:10.549918+0000, chain.objs.size()=1 2024-09-12T18:36:01.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.100+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.rdqe4RKGFcAR3UhrlLOzTNUeX2ErnZH_0 2024-09-12T18:36:01.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17455011603212631156', time=2024-09-12T20:07:11.565392+0000, chain.objs.size()=1 2024-09-12T18:36:01.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.wnnmmv7SQvc89las5FL-1yyM9dhhKb9_0 2024-09-12T18:36:01.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14824997040776114147', time=2024-09-12T20:07:11.598532+0000, chain.objs.size()=1 2024-09-12T18:36:01.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Bf-p99yh8mhcNReVHhSeZOb0nOTaWb1_0 2024-09-12T18:36:01.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5088211917208908081', time=2024-09-12T20:07:11.853302+0000, chain.objs.size()=1 2024-09-12T18:36:01.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.HT5x0dXUEXj2CXQcSVYscpxs9LiBKky_0 2024-09-12T18:36:01.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12504077248004871619', time=2024-09-12T20:07:12.212502+0000, chain.objs.size()=1 2024-09-12T18:36:01.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.vR3TePxcBnwkfzIIWge-b_u4nk7NtRz_0 2024-09-12T18:36:01.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17205010410976341292', time=2024-09-12T20:07:13.436192+0000, chain.objs.size()=1 2024-09-12T18:36:01.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.1QMxeNPLD-bttAbjhFZZr1qBZbnYVaY_0 2024-09-12T18:36:01.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3463906746068736300', time=2024-09-12T20:07:13.532527+0000, chain.objs.size()=1 2024-09-12T18:36:01.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.XDKWiwNgXzrRtO5F10FhzTnuvBYq-RS_0 2024-09-12T18:36:01.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6532858576987865498', time=2024-09-12T20:07:13.799684+0000, chain.objs.size()=1 2024-09-12T18:36:01.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.qyChQSkMGHz927ib2NfYRFSkmTznRhB_0 2024-09-12T18:36:01.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.569270207010887869', time=2024-09-12T20:07:14.707123+0000, chain.objs.size()=1 2024-09-12T18:36:01.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.hggGG3oCO0EZDMC-DJwlLc_sbog5SNp_0 2024-09-12T18:36:01.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7524642093570822663', time=2024-09-12T20:07:15.104540+0000, chain.objs.size()=1 2024-09-12T18:36:01.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.w_seBnwKT9YYKRHBg9iQoc1YugRMCLp_0 2024-09-12T18:36:01.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18145616318123101750', time=2024-09-12T20:07:16.185506+0000, chain.objs.size()=1 2024-09-12T18:36:01.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.104+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.AMnb3xNOZE8YRcHrH1TUlVG_CV-1BaF_0 2024-09-12T18:36:01.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.108+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16420135064774384720', time=2024-09-12T20:07:16.223981+0000, chain.objs.size()=1 2024-09-12T18:36:01.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.108+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.m5UlRwwQq7pwwfirgT1uYFVC-7pefmh_0 2024-09-12T18:36:01.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.108+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17992253211070346737', time=2024-09-12T20:07:17.866326+0000, chain.objs.size()=1 2024-09-12T18:36:01.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.108+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.XVEjNU6dHtZ7IDYBaLSFbadtBsBlMls_0 2024-09-12T18:36:01.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.444562547134560970', time=2024-09-12T20:07:18.190587+0000, chain.objs.size()=1 2024-09-12T18:36:01.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.nyFq-CT_o6u3vT5c_UPzeSk1rvZqQHG_0 2024-09-12T18:36:01.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6933914124309761063', time=2024-09-12T20:07:18.571758+0000, chain.objs.size()=1 2024-09-12T18:36:01.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.PHS9cOa6D0AZYucMTB57VaQLEPUvQU3_0 2024-09-12T18:36:01.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4690335935435421005', time=2024-09-12T20:07:18.930326+0000, chain.objs.size()=1 2024-09-12T18:36:01.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.NlAIfB6AP-OWpzviyH1w2ah3Wgko6A9_0 2024-09-12T18:36:01.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16061352894219846492', time=2024-09-12T20:07:19.160898+0000, chain.objs.size()=1 2024-09-12T18:36:01.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.m1BX1cwc7tuBz3Zk-LFBOQIZhapCM04_0 2024-09-12T18:36:01.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10466274249074953931', time=2024-09-12T20:09:02.166912+0000, chain.objs.size()=1 2024-09-12T18:36:01.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.0ygu3p3Oivsm1j_G_ErSB784L-yMcwz_0 2024-09-12T18:36:01.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5713449299621603353', time=2024-09-12T20:09:03.838238+0000, chain.objs.size()=1 2024-09-12T18:36:01.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.hChZR2VLscslKVM1DXs8CIiBFUEJ9uP_0 2024-09-12T18:36:01.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5318892773723533639', time=2024-09-12T20:09:03.861182+0000, chain.objs.size()=1 2024-09-12T18:36:01.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.sXxAuXIIc-v5m8g4ufeOD-PUdtdVvaR_0 2024-09-12T18:36:01.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13273634765534699663', time=2024-09-12T20:09:04.204608+0000, chain.objs.size()=1 2024-09-12T18:36:01.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xrIJ250H8H3fuHcoGCPYczRqRD5uSXU_0 2024-09-12T18:36:01.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14894530453285463416', time=2024-09-12T20:09:05.767451+0000, chain.objs.size()=1 2024-09-12T18:36:01.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.kr2gnftXinFOEwsCpgZnB1ez7LxWFfL_0 2024-09-12T18:36:01.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17425975840148461295', time=2024-09-12T20:09:05.770684+0000, chain.objs.size()=1 2024-09-12T18:36:01.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2iZj8-8eh5e_2lhatt8F-ch7SKGNhK9_0 2024-09-12T18:36:01.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6694822084050334923', time=2024-09-12T20:09:05.853126+0000, chain.objs.size()=1 2024-09-12T18:36:01.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.112+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.uI-C9L8psw7Ezyjc9buU3LzkPf4Z1J6_0 2024-09-12T18:36:01.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4808814325714857901', time=2024-09-12T20:09:06.996516+0000, chain.objs.size()=1 2024-09-12T18:36:01.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.N6mE8-AePeCOIYNU0aQWneQHEDAMD3j_0 2024-09-12T18:36:01.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5545260571000581024', time=2024-09-12T20:09:07.472575+0000, chain.objs.size()=1 2024-09-12T18:36:01.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ariCBgt_y4ZFueQUZSGGx02dGoU8pfO_0 2024-09-12T18:36:01.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8791619637015848946', time=2024-09-12T20:09:07.754825+0000, chain.objs.size()=1 2024-09-12T18:36:01.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.QK-LD_sTljvERJLokdZzUKzb9KIy5ti_0 2024-09-12T18:36:01.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17943166599202865595', time=2024-09-12T20:09:09.674020+0000, chain.objs.size()=1 2024-09-12T18:36:01.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.0GOvrhrQEryGoJJL9C6ZDraLmVScdiO_0 2024-09-12T18:36:01.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17832829879213860522', time=2024-09-12T20:09:10.829142+0000, chain.objs.size()=1 2024-09-12T18:36:01.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.pQ7B5fCtn7sleucK3vSlklZ96ApL_k8_0 2024-09-12T18:36:01.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8965800467431232411', time=2024-09-12T20:09:11.457942+0000, chain.objs.size()=1 2024-09-12T18:36:01.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vvYpnambUhznB8awmQtat_teuBqlfPC_0 2024-09-12T18:36:01.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1393577114713072929', time=2024-09-12T20:09:13.688687+0000, chain.objs.size()=1 2024-09-12T18:36:01.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.CUzFYPHAhyrfe2aRJAbTxJkT2pQSM9r_0 2024-09-12T18:36:01.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7951479073180191599', time=2024-09-12T20:09:13.690774+0000, chain.objs.size()=1 2024-09-12T18:36:01.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Cl-RXNOA8UDcn3SUB4ER4tSZfCTvggh_0 2024-09-12T18:36:01.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17607061994778394111', time=2024-09-12T20:09:14.063785+0000, chain.objs.size()=1 2024-09-12T18:36:01.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.116+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xh7SDXUnBw8UaYbgUx4oB5RZ7_DqyTK_0 2024-09-12T18:36:01.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.120+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6733330286928237036', time=2024-09-12T20:09:14.065270+0000, chain.objs.size()=1 2024-09-12T18:36:01.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.120+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.OPJAbmyJoL5iCDjcC90GsA9imrJEpnR_0 2024-09-12T18:36:01.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.120+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2324882287592338009', time=2024-09-12T20:09:14.306594+0000, chain.objs.size()=1 2024-09-12T18:36:01.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.120+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.wAsQoOsFyrL1WjR1V_ZpEXxTazgZZVX_0 2024-09-12T18:36:01.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.120+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13082750766789892864', time=2024-09-12T20:09:14.436101+0000, chain.objs.size()=1 2024-09-12T18:36:01.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.120+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.tfqhOVG8yoITjaK4c1HSEB_rF1vxqsP_0 2024-09-12T18:36:01.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.120+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3571328865557758995', time=2024-09-12T20:09:17.775755+0000, chain.objs.size()=1 2024-09-12T18:36:01.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.120+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_._IXN93C0mCJ2ZJC4sreTa77CqqGwOaG_0 2024-09-12T18:36:01.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.120+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15780682084067135830', time=2024-09-12T20:09:18.427225+0000, chain.objs.size()=1 2024-09-12T18:36:01.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.120+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.g2FfDOow4sQPBRrgyZRFmPjC_-R7Le1_0 2024-09-12T18:36:01.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.120+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12480777920363615079', time=2024-09-12T20:09:18.889984+0000, chain.objs.size()=1 2024-09-12T18:36:01.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.120+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.QYoRlEvLyARdcOmSSkq2LWD6j289WAl_0 2024-09-12T18:36:01.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.120+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7840940185351023847', time=2024-09-12T20:09:21.890019+0000, chain.objs.size()=1 2024-09-12T18:36:01.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.120+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.1glrOstS0AORvDn0-Yq5QTcohKCaHaG_0 2024-09-12T18:36:01.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.120+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16017679952752176871', time=2024-09-12T20:09:21.979802+0000, chain.objs.size()=1 2024-09-12T18:36:01.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.120+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_._Y7OTQdw-p7VNZLSDPhRYXEl9g9w43x_0 2024-09-12T18:36:01.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.124+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45877 2024-09-12T18:36:01.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T18:36:01.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14335640260582304624', time=2024-09-12T20:09:22.168785+0000, chain.objs.size()=1 2024-09-12T18:36:01.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Lg_fMU3NVC6z1dm2rQWcApQxZB8P9UN_0 2024-09-12T18:36:01.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4650738108007619898', time=2024-09-12T20:09:23.569377+0000, chain.objs.size()=1 2024-09-12T18:36:01.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.QfKifyij37zgystk-ybRgaykYmQWjhz_0 2024-09-12T18:36:01.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4978746335073713782', time=2024-09-12T20:09:23.794529+0000, chain.objs.size()=1 2024-09-12T18:36:01.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.1N03hM7qI2x3G65yKyYFSGwYojW0TYv_0 2024-09-12T18:36:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16493013655919560579', time=2024-09-12T20:09:25.403204+0000, chain.objs.size()=1 2024-09-12T18:36:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ukEDLdwCI3v-NzzR8KDnRuIsztLKW9w_0 2024-09-12T18:36:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5196817698145182993', time=2024-09-12T20:09:25.509138+0000, chain.objs.size()=1 2024-09-12T18:36:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.WbNUP-WmLm02egVN7V0MkLvjOuADIBU_0 2024-09-12T18:36:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17829427478280946488', time=2024-09-12T20:09:28.507339+0000, chain.objs.size()=1 2024-09-12T18:36:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.AarVmlMhpe2nr-rD7yj4IAw2r_qJJGZ_0 2024-09-12T18:36:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1553614408359120450', time=2024-09-12T20:09:28.953895+0000, chain.objs.size()=1 2024-09-12T18:36:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.RncVJfm7Th6T61m3DhVNdvW7DBa-4PU_0 2024-09-12T18:36:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16812476716687608017', time=2024-09-12T20:09:29.955492+0000, chain.objs.size()=1 2024-09-12T18:36:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Dw4C2gRJ1rmcxlHXH2BoBxClrEsXxfu_0 2024-09-12T18:36:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.471809775183834404', time=2024-09-12T20:09:30.266727+0000, chain.objs.size()=1 2024-09-12T18:36:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_._PQRkIlYcLGT4UVUxairU31ENOshsmx_0 2024-09-12T18:36:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14472703076833120462', time=2024-09-12T20:11:52.060599+0000, chain.objs.size()=1 2024-09-12T18:36:01.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.434__shadow_.yWDZY2x2IBmwKYE-8FfV20IFc36FbsJ_0 2024-09-12T18:36:01.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7800017262096119137', time=2024-09-12T20:12:24.714690+0000, chain.objs.size()=1 2024-09-12T18:36:01.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.456__shadow_.2oMxLOH8gIa6WTJffQl-e7gbs8xOYHX_0 2024-09-12T18:36:01.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5940014379175282842', time=2024-09-12T20:13:40.612405+0000, chain.objs.size()=1 2024-09-12T18:36:01.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.128+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.504__shadow:p--u8yBdmzUFbtwCdiIMSfaVaX-Tsns_.K5_RZa2CGyb4Lrga0hcpjF_NIfZ0MyJ_0 2024-09-12T18:36:01.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2605966835182357263', time=2024-09-12T20:18:41.921994+0000, chain.objs.size()=2 2024-09-12T18:36:01.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.559__shadow_.O2oCkD3gWxVUvge8_9KiNwCZSMS_bME_0 2024-09-12T18:36:01.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.559__shadow_.O2oCkD3gWxVUvge8_9KiNwCZSMS_bME_1 2024-09-12T18:36:01.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14106626272444393972', time=2024-09-12T20:19:04.989276+0000, chain.objs.size()=1 2024-09-12T18:36:01.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:Ex51LiXR-niMFS-TdbGElSUfKLy6O4g_.Ljs-M6guAih3crdxZgJdp88koFr0fJj_0 2024-09-12T18:36:01.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16380604973805872139', time=2024-09-12T20:19:47.334246+0000, chain.objs.size()=1 2024-09-12T18:36:01.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.576__shadow_.teZVyAA0lkhhsiXpKHK4PNlQDAxwr2q_0 2024-09-12T18:36:01.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5626777916513578681', time=2024-09-12T20:20:31.186692+0000, chain.objs.size()=1 2024-09-12T18:36:01.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:bJ4ee--Ki-EZ5HgDWTd-Os1Az.491pV_.4M97uk1u6G1ytWAlK_YXDM5mXvesUiL_0 2024-09-12T18:36:01.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18313873143983488709', time=2024-09-12T20:21:07.274060+0000, chain.objs.size()=1 2024-09-12T18:36:01.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.580__shadow:dM7ae-bOAWGpQ2JcHmonDrUprZ.kIec_.bxOAr9Ofl8BGHaHIBqImIeO8UWd3eMT_0 2024-09-12T18:36:01.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17376755765422827109', time=2024-09-12T20:26:26.524135+0000, chain.objs.size()=1 2024-09-12T18:36:01.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.627__shadow_.KsIEzdTBkugjygNGDlxSIe_EpKIwaHC_0 2024-09-12T18:36:01.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3366347254340786851', time=2024-09-12T20:28:39.584383+0000, chain.objs.size()=1 2024-09-12T18:36:01.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.699__shadow:g1VbnDJqv.ZlYVR0Vbmo31h80GwHrGx_.OSckKSwRvFEaMBahWud5dgZ9q5ZGBR7_0 2024-09-12T18:36:01.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6722927519853208424', time=2024-09-12T20:29:50.177679+0000, chain.objs.size()=1 2024-09-12T18:36:01.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.132+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.735__shadow_.w26iEY4tir0bMxsd25JR10PHebq1C4H_0 2024-09-12T18:36:01.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.136+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:01.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.140+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:36:01.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.140+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:01.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.140+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:01.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54684' 2024-09-12T18:36:01.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17372967621868509791', time=2024-09-12T20:00:15.335627+0000, chain.objs.size()=1 2024-09-12T18:36:01.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.231__shadow_.Ip9HjuS09-LiXg1_4gHL-GTwuuFnEFL_0 2024-09-12T18:36:01.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17782391497416149064', time=2024-09-12T20:00:49.842861+0000, chain.objs.size()=1 2024-09-12T18:36:01.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.250__shadow_.37i2yhYo73vOMJNSExbfFPyXEOnbu6a_0 2024-09-12T18:36:01.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1703923428314935764', time=2024-09-12T20:02:52.398202+0000, chain.objs.size()=1 2024-09-12T18:36:01.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.n0GjFUQjbQ4dD572DyapsUDI-Vt9aFZ_0 2024-09-12T18:36:01.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.145036463958304488', time=2024-09-12T20:02:52.720980+0000, chain.objs.size()=1 2024-09-12T18:36:01.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.IVVTyitF_qbqRkphkMAtX1n0Yxa4G2c_0 2024-09-12T18:36:01.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7957267529654078392', time=2024-09-12T20:02:57.076977+0000, chain.objs.size()=1 2024-09-12T18:36:01.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.OYWdqHG8dLyp3_Asj6_wT3Gzk9yl6Qu_0 2024-09-12T18:36:01.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13607005296937269761', time=2024-09-12T20:02:57.762430+0000, chain.objs.size()=1 2024-09-12T18:36:01.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.xtCE9ERYHRtVMFZDu6uJLPMK9b16B-7_0 2024-09-12T18:36:01.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6931865664430018522', time=2024-09-12T20:03:00.337106+0000, chain.objs.size()=1 2024-09-12T18:36:01.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.sdFbQeW9tUV843ZtMrQ3dcjQaqUqLKs_0 2024-09-12T18:36:01.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13387832248953357508', time=2024-09-12T20:03:00.742960+0000, chain.objs.size()=1 2024-09-12T18:36:01.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.CALwyvyW4emuOVNrlGahttrfgmPutGF_0 2024-09-12T18:36:01.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10029460852098008638', time=2024-09-12T20:03:01.474977+0000, chain.objs.size()=1 2024-09-12T18:36:01.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.NpeN6xIUtgd3XTRh6Au2fv0JtAyhUUe_0 2024-09-12T18:36:01.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11932614651338880243', time=2024-09-12T20:03:01.575176+0000, chain.objs.size()=1 2024-09-12T18:36:01.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Huh_yRSIxcVEQ6Uq0qlfNLF4viv6fJA_0 2024-09-12T18:36:01.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4679244591667608408', time=2024-09-12T20:03:03.928605+0000, chain.objs.size()=1 2024-09-12T18:36:01.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.PL6GrlLk9At-srV8LunK3KW9EMFeIDI_0 2024-09-12T18:36:01.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10121938314068637421', time=2024-09-12T20:03:05.328433+0000, chain.objs.size()=1 2024-09-12T18:36:01.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.144+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._NDkuHCI9r-2dNG47K5N24GhUGBI5Bq_0 2024-09-12T18:36:01.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.148+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1825118750267658200', time=2024-09-12T20:03:05.437326+0000, chain.objs.size()=1 2024-09-12T18:36:01.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.148+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.eVngioeZ5TqUQ-MZ8lxmTYgmfBORL8L_0 2024-09-12T18:36:01.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.148+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16021611983131846095', time=2024-09-12T20:03:06.012371+0000, chain.objs.size()=1 2024-09-12T18:36:01.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.148+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.HAnJ41sXMllAmhSRJEWhHIh5Zcerozn_0 2024-09-12T18:36:01.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.148+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12641320183708699185', time=2024-09-12T20:03:06.229672+0000, chain.objs.size()=1 2024-09-12T18:36:01.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.148+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.6UhY--AHoUZzq5gL_kb7sKGNNI7cfcd_0 2024-09-12T18:36:01.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.148+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13425531958713146504', time=2024-09-12T20:03:07.288649+0000, chain.objs.size()=1 2024-09-12T18:36:01.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.148+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.CylV7SXeBt3g5110WSfP0xPf4zxy6Jb_0 2024-09-12T18:36:01.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.148+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17279003705181739891', time=2024-09-12T20:03:07.919132+0000, chain.objs.size()=1 2024-09-12T18:36:01.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.148+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ai3bMBP73RP6LByGzV6AMJgNIzNyaNB_0 2024-09-12T18:36:01.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2212941814264931700', time=2024-09-12T20:03:11.252568+0000, chain.objs.size()=1 2024-09-12T18:36:01.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.PspAyVOvzO683ol5IvLkYabPzsTtGdQ_0 2024-09-12T18:36:01.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17015259886593200100', time=2024-09-12T20:03:12.192695+0000, chain.objs.size()=1 2024-09-12T18:36:01.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.BbDOYaMudA3V5-bDmPQHCLcF62BPNBH_0 2024-09-12T18:36:01.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12941040521185932235', time=2024-09-12T20:03:12.424994+0000, chain.objs.size()=1 2024-09-12T18:36:01.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.AHMXppGsxzBmrDHqYYMAickZ0kYoy9J_0 2024-09-12T18:36:01.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13412685928832577666', time=2024-09-12T20:03:12.549341+0000, chain.objs.size()=1 2024-09-12T18:36:01.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Nvw-A74pPhjJApgQaanX8qvfBtnUmmc_0 2024-09-12T18:36:01.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3567730734991040376', time=2024-09-12T20:03:12.897601+0000, chain.objs.size()=1 2024-09-12T18:36:01.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.tik3jEumK-oLDrLqXQ-MfsEG-VhFjgT_0 2024-09-12T18:36:01.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11061799051443175985', time=2024-09-12T20:03:13.390635+0000, chain.objs.size()=1 2024-09-12T18:36:01.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.5AjwCRCTJXwbVbxZyyDIKFj7-8UdW39_0 2024-09-12T18:36:01.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10117696846053677715', time=2024-09-12T20:03:13.662035+0000, chain.objs.size()=1 2024-09-12T18:36:01.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.0HgVlFq70z6R6nHKlzlkjxB8Xtji1tR_0 2024-09-12T18:36:01.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4440695948480324834', time=2024-09-12T20:03:16.635297+0000, chain.objs.size()=1 2024-09-12T18:36:01.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.4ppcbYY1Wx8xIjo_occtd62NwIa3Kt0_0 2024-09-12T18:36:01.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14132430045179096708', time=2024-09-12T20:03:16.640507+0000, chain.objs.size()=1 2024-09-12T18:36:01.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.rI3jzPvNZvd5YU38UNxhLg0mAyny4vp_0 2024-09-12T18:36:01.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9698281836317857676', time=2024-09-12T20:03:17.269992+0000, chain.objs.size()=1 2024-09-12T18:36:01.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.boIFItqMQKLyK0nCL-HN_yVVW_poEyX_0 2024-09-12T18:36:01.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.991204623475810155', time=2024-09-12T20:03:18.361452+0000, chain.objs.size()=1 2024-09-12T18:36:01.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.152+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.YdaDeofCNa25D4Js9JSw1DzK-cHMoDv_0 2024-09-12T18:36:01.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.156+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10751306971953048063', time=2024-09-12T20:03:20.329316+0000, chain.objs.size()=1 2024-09-12T18:36:01.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.156+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.P-jhe9NWNgTE4EJCamWhh2d445nJfd__0 2024-09-12T18:36:01.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.156+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2642150871334841624', time=2024-09-12T20:03:20.527641+0000, chain.objs.size()=1 2024-09-12T18:36:01.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.156+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.HvZ80CPMUN8SmwNHyQ5e45qtJpv8iiG_0 2024-09-12T18:36:01.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.156+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3504816775730938004', time=2024-09-12T20:03:20.529310+0000, chain.objs.size()=1 2024-09-12T18:36:01.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.156+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._1MmbSTil56ijrGJXkpVjofye58xJDD_0 2024-09-12T18:36:01.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.156+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4229161276138127547', time=2024-09-12T20:03:25.378055+0000, chain.objs.size()=1 2024-09-12T18:36:01.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.156+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.266__shadow_.8ViFYPy0Vj6nznrUAlW3Jhs-X5ateeN_0 2024-09-12T18:36:01.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.156+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.272082047447951057', time=2024-09-12T20:04:01.432147+0000, chain.objs.size()=1 2024-09-12T18:36:01.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.156+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.288__shadow_.KZvCGNhuZe6K0Applc0U1ZgsBsS37G__0 2024-09-12T18:36:01.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.156+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18290657918902489814', time=2024-09-12T20:04:12.959730+0000, chain.objs.size()=1 2024-09-12T18:36:01.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.156+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.PwvWrC4oXpSMIrbKhi7K4yLOQk1xMlU_0 2024-09-12T18:36:01.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8634324368585897076', time=2024-09-12T20:04:18.212040+0000, chain.objs.size()=1 2024-09-12T18:36:01.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.Wi7MZhUQ_3jaL5M_gIRQG695aZQ_5AW_0 2024-09-12T18:36:01.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17214654657268814903', time=2024-09-12T20:04:36.913224+0000, chain.objs.size()=1 2024-09-12T18:36:01.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.305__shadow_.BQDL20Blmrk3wzaAoCKU0kbySZLQdio_0 2024-09-12T18:36:01.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18249045220649531539', time=2024-09-12T20:04:38.621576+0000, chain.objs.size()=1 2024-09-12T18:36:01.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.306__shadow_.yXTOyTRXZqIhvQeucWP37V1WPnTAK1y_0 2024-09-12T18:36:01.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.666211128413320680', time=2024-09-12T20:04:56.244118+0000, chain.objs.size()=1 2024-09-12T18:36:01.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.316__shadow_.29i4KK_YfOKk8K_kyuEnzUt5k9DtDeP_0 2024-09-12T18:36:01.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15896022162281883173', time=2024-09-12T20:05:07.444687+0000, chain.objs.size()=1 2024-09-12T18:36:01.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.323__shadow_.3zJCGjJt9rpfik8JLi6fYa28sdfSnBY_0 2024-09-12T18:36:01.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7399348567653361057', time=2024-09-12T20:06:50.921598+0000, chain.objs.size()=1 2024-09-12T18:36:01.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.DAvz0FBoNsNezi_ZDTHM_sndk2228LD_0 2024-09-12T18:36:01.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4722860295805704220', time=2024-09-12T20:06:51.276827+0000, chain.objs.size()=1 2024-09-12T18:36:01.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.LQ0un2uu0xJ7RHkknNrSfIdkiUiAY--_0 2024-09-12T18:36:01.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16012180221271711375', time=2024-09-12T20:06:52.888188+0000, chain.objs.size()=1 2024-09-12T18:36:01.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.0i8A_LmPiYe4KZn2GzrMS4spN1XLMJO_0 2024-09-12T18:36:01.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15590787382946064771', time=2024-09-12T20:06:53.256835+0000, chain.objs.size()=1 2024-09-12T18:36:01.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.160+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.u0LcnmXdMFXR1ngzhLMg_KRHDZ3SHaK_0 2024-09-12T18:36:01.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.164+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16790323413400664416', time=2024-09-12T20:06:53.506604+0000, chain.objs.size()=1 2024-09-12T18:36:01.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.164+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.uEyG_kBdigKXYj6tSq3uJhmqWtg80Ys_0 2024-09-12T18:36:01.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.164+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6049012463346828147', time=2024-09-12T20:06:53.646615+0000, chain.objs.size()=1 2024-09-12T18:36:01.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.164+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.0O85jmH0pDZDUnroHUvRh7I2_QCJ2py_0 2024-09-12T18:36:01.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.164+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18319646625936716733', time=2024-09-12T20:06:53.691268+0000, chain.objs.size()=1 2024-09-12T18:36:01.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.164+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.niAeO80v89jYudONXegRFR2IWVtvVDY_0 2024-09-12T18:36:01.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.164+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3418841434027271945', time=2024-09-12T20:06:53.806842+0000, chain.objs.size()=1 2024-09-12T18:36:01.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.164+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.E_tAiMaI-VmY1yL2GrhuFp_fP3v618X_0 2024-09-12T18:36:01.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.164+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9842462733948136093', time=2024-09-12T20:06:55.307118+0000, chain.objs.size()=1 2024-09-12T18:36:01.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.164+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.MfxAciN9gasJH_NlxSYB5UqJGW6WutU_0 2024-09-12T18:36:01.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.164+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8683985827669671776', time=2024-09-12T20:06:57.044564+0000, chain.objs.size()=1 2024-09-12T18:36:01.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.164+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Thbe5BkHJ-FRWh74OJ6hk1o1DkAHq6i_0 2024-09-12T18:36:01.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.164+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1179232188917904534', time=2024-09-12T20:06:58.846341+0000, chain.objs.size()=1 2024-09-12T18:36:01.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.164+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.h0KEU9llPR35MqbT7q44zQwty_Xr32v_0 2024-09-12T18:36:01.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.168+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8763784608027549458', time=2024-09-12T20:06:59.327219+0000, chain.objs.size()=1 2024-09-12T18:36:01.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.168+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_._kjNK6vRVgG8lpQdZ9CMTzxil5bRqv6_0 2024-09-12T18:36:01.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.168+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.94105144906577798', time=2024-09-12T20:07:00.415584+0000, chain.objs.size()=1 2024-09-12T18:36:01.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.168+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Gfuo3qNHpWULvscv0LziukkwsrvDqJp_0 2024-09-12T18:36:01.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.168+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2104580676580296160', time=2024-09-12T20:07:03.028434+0000, chain.objs.size()=1 2024-09-12T18:36:01.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.168+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-0PVlufc6pK9cNkUyYok9KjN0seOT_S_0 2024-09-12T18:36:01.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.168+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15215428813161344252', time=2024-09-12T20:07:04.402238+0000, chain.objs.size()=1 2024-09-12T18:36:01.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.168+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.tLd5XOEbGkP1tNdnzA0P1OMv0gJrHjP_0 2024-09-12T18:36:01.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.168+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17520611561549494056', time=2024-09-12T20:07:05.086943+0000, chain.objs.size()=1 2024-09-12T18:36:01.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.168+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.t7B9Zh2qhUIDXrw_xh6bAIHO5JEHyHD_0 2024-09-12T18:36:01.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.168+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2352024608096981940', time=2024-09-12T20:07:06.429913+0000, chain.objs.size()=1 2024-09-12T18:36:01.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.168+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.8NzjlF-fBL_KiCqHgXhQ9GNaLwnUT8a_0 2024-09-12T18:36:01.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.168+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1843503621906942570', time=2024-09-12T20:07:06.807927+0000, chain.objs.size()=1 2024-09-12T18:36:01.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.168+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.uAmk_BZC8PRrvKWRci999s69qFC4Mqd_0 2024-09-12T18:36:01.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb0731640 0 -- 172.21.15.119:0/22423105 >> [v2:172.21.15.194:6800/1379092354,v1:172.21.15.194:6801/1379092354] conn(0x7f4ea80d3020 msgr2=0x7f4d7c0910b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:36:01.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9943847533873242478', time=2024-09-12T20:07:07.352143+0000, chain.objs.size()=1 2024-09-12T18:36:01.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.NdlL3oSqLhn9HJnvGv4yIipj4YwwsGG_0 2024-09-12T18:36:01.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14964422148327889846', time=2024-09-12T20:07:13.985157+0000, chain.objs.size()=1 2024-09-12T18:36:01.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.kGJfm3gmSl39dEUPkEznwTtkx8bV2GW_0 2024-09-12T18:36:01.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12347076288069518846', time=2024-09-12T20:07:16.132089+0000, chain.objs.size()=1 2024-09-12T18:36:01.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.De3mWeuuBJcC3R1AuIHAuVlQnqccqq8_0 2024-09-12T18:36:01.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8464925673784556927', time=2024-09-12T20:07:17.314245+0000, chain.objs.size()=1 2024-09-12T18:36:01.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.PsD1YCk-PnrDP6VXobrC7UUcUshXbD1_0 2024-09-12T18:36:01.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3874869531178598474', time=2024-09-12T20:07:17.858849+0000, chain.objs.size()=1 2024-09-12T18:36:01.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.fe1n2blZgUFRW8shxJpdKRJ8M9lqVAj_0 2024-09-12T18:36:01.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15474920735472724569', time=2024-09-12T20:09:02.225779+0000, chain.objs.size()=1 2024-09-12T18:36:01.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.triSwHpblcRnKjS9RFN0B13rkysbDTM_0 2024-09-12T18:36:01.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16174768595131025634', time=2024-09-12T20:09:02.839454+0000, chain.objs.size()=1 2024-09-12T18:36:01.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.M-BeAx1lLZrySCG3SMnXdDJEl0Hpixd_0 2024-09-12T18:36:01.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10474623861834266550', time=2024-09-12T20:09:02.845110+0000, chain.objs.size()=1 2024-09-12T18:36:01.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.172+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.21t0sL_tCoaw2MKLiucY_T3mHWRpmNv_0 2024-09-12T18:36:01.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6714412839471575960', time=2024-09-12T20:09:03.191434+0000, chain.objs.size()=1 2024-09-12T18:36:01.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Tz6Gz__TuMmomlWDCaKWsVueon3lZ1Z_0 2024-09-12T18:36:01.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6512118996871737616', time=2024-09-12T20:09:04.097522+0000, chain.objs.size()=1 2024-09-12T18:36:01.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ZuCxIAaICzWGqzfiBsTRGNMq6D3OWIi_0 2024-09-12T18:36:01.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16657059632826446706', time=2024-09-12T20:09:06.645956+0000, chain.objs.size()=1 2024-09-12T18:36:01.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.YGEUt75slf2QmqjqYICCfrWzmZL2csC_0 2024-09-12T18:36:01.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13801205191001759654', time=2024-09-12T20:09:06.649678+0000, chain.objs.size()=1 2024-09-12T18:36:01.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.nsPHwtGwx6YVxbFyDD_GkNuUsN1HsB7_0 2024-09-12T18:36:01.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11774006785534461230', time=2024-09-12T20:09:06.995422+0000, chain.objs.size()=1 2024-09-12T18:36:01.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.XJpbp7_He0d8iT3OLuWfhsja19yIjys_0 2024-09-12T18:36:01.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6768831136614057636', time=2024-09-12T20:09:07.151813+0000, chain.objs.size()=1 2024-09-12T18:36:01.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.I95ztKBhbH6J02c2B8apREMHawPYtYs_0 2024-09-12T18:36:01.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17857691560679785364', time=2024-09-12T20:09:08.552523+0000, chain.objs.size()=1 2024-09-12T18:36:01.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.amFcJwsGbJWxWEgw9i_t_O3CYzR8obr_0 2024-09-12T18:36:01.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7073720580696996402', time=2024-09-12T20:09:10.200521+0000, chain.objs.size()=1 2024-09-12T18:36:01.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.N3AU7MHv075u9MkAvYwgPldq8RGv_yB_0 2024-09-12T18:36:01.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16040597596547886297', time=2024-09-12T20:09:13.511579+0000, chain.objs.size()=1 2024-09-12T18:36:01.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.KeE_F63bfWZmHNe2HrW8ZK-kZtMJZfi_0 2024-09-12T18:36:01.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11786546998465503344', time=2024-09-12T20:09:13.797667+0000, chain.objs.size()=1 2024-09-12T18:36:01.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.oQwD04sDJ7bnUP_wH2DXjaP3q6-WoNI_0 2024-09-12T18:36:01.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.981733560209868276', time=2024-09-12T20:09:14.756336+0000, chain.objs.size()=1 2024-09-12T18:36:01.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.81T6xgHMCQJs_9UUrWltXhyo_nLRFYI_0 2024-09-12T18:36:01.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16876874407633277102', time=2024-09-12T20:09:15.796509+0000, chain.objs.size()=1 2024-09-12T18:36:01.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.176+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.oSvryPaHhA06MCE8mbvNv2hsmMyNMOv_0 2024-09-12T18:36:01.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.180+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16047311857647132238', time=2024-09-12T20:09:17.400775+0000, chain.objs.size()=1 2024-09-12T18:36:01.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.180+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.A7yCq93TBkeG24iJnqdq_owSRqnQvrx_0 2024-09-12T18:36:01.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.180+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4178259036390051736', time=2024-09-12T20:09:17.576006+0000, chain.objs.size()=1 2024-09-12T18:36:01.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.180+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.DODOGj9RS5xz8hYyQbCk5iDn_IXZdWT_0 2024-09-12T18:36:01.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6168785227311871222', time=2024-09-12T20:09:19.212848+0000, chain.objs.size()=1 2024-09-12T18:36:01.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.hHe_9W4uref4yAn0T0_pP-yNtylPKdT_0 2024-09-12T18:36:01.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12157893333023619189', time=2024-09-12T20:09:19.764729+0000, chain.objs.size()=1 2024-09-12T18:36:01.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.wbCEpiYkuLorYR-irI6cPVUt2tNh82p_0 2024-09-12T18:36:01.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16718789793199267869', time=2024-09-12T20:09:21.142290+0000, chain.objs.size()=1 2024-09-12T18:36:01.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.uv8qF5cvm9THTu08CVd4WdM_5e0C5bJ_0 2024-09-12T18:36:01.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12593456822459338121', time=2024-09-12T20:09:21.617136+0000, chain.objs.size()=1 2024-09-12T18:36:01.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.tbVlFKy7rjD7YlABrHtGdzxoQn3IV5r_0 2024-09-12T18:36:01.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.533724307060564235', time=2024-09-12T20:09:21.891263+0000, chain.objs.size()=1 2024-09-12T18:36:01.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5B51BR54zC4M1cH3xiwSeo3j3wX1k2K_0 2024-09-12T18:36:01.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17332604075236635227', time=2024-09-12T20:09:22.224594+0000, chain.objs.size()=1 2024-09-12T18:36:01.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.JAwqmf3Waorzoc4--bpxtV0uagULSYT_0 2024-09-12T18:36:01.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13376952116150098367', time=2024-09-12T20:09:25.401287+0000, chain.objs.size()=1 2024-09-12T18:36:01.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ApQiQUpC-Fh0-wwVs-btSRR8ZqcKQNU_0 2024-09-12T18:36:01.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6100583048185937036', time=2024-09-12T20:09:25.714806+0000, chain.objs.size()=1 2024-09-12T18:36:01.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.NUCUs_dzzO_8LW8UOei5-ZTIcDgsZMa_0 2024-09-12T18:36:01.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9850730861950243274', time=2024-09-12T20:09:26.549513+0000, chain.objs.size()=1 2024-09-12T18:36:01.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.7iUuTirk8-bEI0l7zKczJzvIPKc1ZbX_0 2024-09-12T18:36:01.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1860238916843159590', time=2024-09-12T20:09:30.139109+0000, chain.objs.size()=1 2024-09-12T18:36:01.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.NW82DNc5nui5ZtIXjIOSzF7nnmprGHe_0 2024-09-12T18:36:01.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb0f32640 0 -- 172.21.15.119:0/22423105 >> [v2:172.21.15.119:6816/4034469375,v1:172.21.15.119:6818/4034469375] conn(0x55a112424b90 msgr2=0x7f4d7c0872c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:36:01.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14404932646230777373', time=2024-09-12T20:12:32.833613+0000, chain.objs.size()=1 2024-09-12T18:36:01.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.184+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.460__shadow_.0I0XxzIDX1JDrukCVcc6M9Pdwuo0Xzp_0 2024-09-12T18:36:01.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.188+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14178264748650409150', time=2024-09-12T20:13:07.204435+0000, chain.objs.size()=1 2024-09-12T18:36:01.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.188+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.484__shadow_.6dnwrivzk5JusB7zVrbVShs5z-p-qRm_0 2024-09-12T18:36:01.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.188+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.298013023077003148', time=2024-09-12T20:13:34.998378+0000, chain.objs.size()=1 2024-09-12T18:36:01.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.188+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.501__shadow_.6Q0mY6z4OStZdx0yOChqrfo8ugtiCR6_0 2024-09-12T18:36:01.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb0731640 0 -- 172.21.15.119:0/22423105 >> [v2:172.21.15.194:6816/2881805626,v1:172.21.15.194:6817/2881805626] conn(0x7f4d7c081ff0 msgr2=0x7f4d7c084420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:36:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14793526330028174882', time=2024-09-12T20:13:40.645097+0000, chain.objs.size()=1 2024-09-12T18:36:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.504__shadow:p--u8yBdmzUFbtwCdiIMSfaVaX-Tsns_.K5_RZa2CGyb4Lrga0hcpjF_NIfZ0MyJ_0 2024-09-12T18:36:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13255030000586530358', time=2024-09-12T20:13:41.962782+0000, chain.objs.size()=1 2024-09-12T18:36:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.504__shadow:p--u8yBdmzUFbtwCdiIMSfaVaX-Tsns_.K5_RZa2CGyb4Lrga0hcpjF_NIfZ0MyJ_0 2024-09-12T18:36:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9812151400712309715', time=2024-09-12T20:13:59.861156+0000, chain.objs.size()=6 2024-09-12T18:36:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.1 2024-09-12T18:36:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.2 2024-09-12T18:36:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.3 2024-09-12T18:36:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.4 2024-09-12T18:36:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.5 2024-09-12T18:36:01.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.6 2024-09-12T18:36:01.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8152287506896609437', time=2024-09-12T20:14:18.252425+0000, chain.objs.size()=1 2024-09-12T18:36:01.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.519__multipart_mymultipart.2~JXNqCEXKeAiLtAVzadTy8L2OFcjj-Bo.1 2024-09-12T18:36:01.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10796484250373147738', time=2024-09-12T20:16:37.167049+0000, chain.objs.size()=1 2024-09-12T18:36:01.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.526__multipart_mymultipart.2~KLfOcEMdTIctKrRDwiR-zfDgxkIZRvH.1 2024-09-12T18:36:01.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7756114512309956274', time=2024-09-12T20:18:27.321790+0000, chain.objs.size()=2 2024-09-12T18:36:01.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.192+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.556__shadow_.dh9wHyVs2Vk5VqBbDPMWBmox6u1Qrx__0 2024-09-12T18:36:01.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.196+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.556__shadow_.dh9wHyVs2Vk5VqBbDPMWBmox6u1Qrx__1 2024-09-12T18:36:01.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.200+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12425381690169778133', time=2024-09-12T20:20:03.511897+0000, chain.objs.size()=1 2024-09-12T18:36:01.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.200+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:oag0LMYMKt6oJH12qpsnbGQ3mS-VL6d_.7BGD_unsKDJxsa19VPf812ZLUYmEvNf_0 2024-09-12T18:36:01.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.200+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15450086793270151128', time=2024-09-12T20:20:40.990037+0000, chain.objs.size()=1 2024-09-12T18:36:01.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.200+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:-wB3L9ruk0ajJIvCXU0FYWHGre9kfEc_.2NFga4chiHo7a9sD3ZI_l-KloBpSKho_0 2024-09-12T18:36:01.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.204+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54684 2024-09-12T18:36:01.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.204+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:36:01.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.204+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1786124009687107601', time=2024-09-12T20:21:07.150934+0000, chain.objs.size()=1 2024-09-12T18:36:01.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.204+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.580__shadow:5oa4PXn9fxaxuZmwbwM11toc4TpWZH2_.FBKRN-RWc3O_oaIeJfyTJKHEgSF-qIY_0 2024-09-12T18:36:01.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.208+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:01.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.208+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:36:01.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:01.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:01.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/67938' 2024-09-12T18:36:01.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1157939030429969606', time=2024-09-12T20:00:23.872476+0000, chain.objs.size()=1 2024-09-12T18:36:01.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.236__shadow_.QWfMuElVJQsfz39QW_nIsms_BKe2L40_0 2024-09-12T18:36:01.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9570615487757231503', time=2024-09-12T20:00:43.160583+0000, chain.objs.size()=1 2024-09-12T18:36:01.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.246__shadow_.21XiOdO0GD-yOmZl-fDKHEI4stw8UkG_0 2024-09-12T18:36:01.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3482662991403892931', time=2024-09-12T20:00:43.181224+0000, chain.objs.size()=1 2024-09-12T18:36:01.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.246__shadow_.VCyVZ5_Lr2RAvWU77fdkvFjn8nJDSHD_0 2024-09-12T18:36:01.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18018773918241332129', time=2024-09-12T20:02:52.243662+0000, chain.objs.size()=1 2024-09-12T18:36:01.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.td7AYjh5yQWjoxuQT7jsWgQKXzeI1Hw_0 2024-09-12T18:36:01.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.731922207013640418', time=2024-09-12T20:02:52.390838+0000, chain.objs.size()=1 2024-09-12T18:36:01.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.xE3-K3yP5O2MO9apppaGL9oot5AeEAT_0 2024-09-12T18:36:01.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7419971875652462160', time=2024-09-12T20:02:52.482527+0000, chain.objs.size()=1 2024-09-12T18:36:01.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QemuB77YcWolmPGViuUP82U9a-P0AJN_0 2024-09-12T18:36:01.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8214310075226128792', time=2024-09-12T20:02:53.169764+0000, chain.objs.size()=1 2024-09-12T18:36:01.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.GubbN5GR9cZzTwMhMfTPY97V_LlPfmF_0 2024-09-12T18:36:01.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.321167748775240127', time=2024-09-12T20:02:53.534008+0000, chain.objs.size()=1 2024-09-12T18:36:01.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.75rTIiL1J8FXCCxUjAJdtc4rX_0YQZ0_0 2024-09-12T18:36:01.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12603322237675982555', time=2024-09-12T20:02:54.591014+0000, chain.objs.size()=1 2024-09-12T18:36:01.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.1YU8-1xxBKrjC6gyNoNj5E20kJ6ESUH_0 2024-09-12T18:36:01.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11691786593188152597', time=2024-09-12T20:02:54.819268+0000, chain.objs.size()=1 2024-09-12T18:36:01.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.HN-W6MclNidmuqLndBBgBfqUfIsoOvj_0 2024-09-12T18:36:01.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18230105928818262547', time=2024-09-12T20:02:56.023209+0000, chain.objs.size()=1 2024-09-12T18:36:01.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.uYsvJUeE02sCRa9hCTDsoMfEPUfl5bi_0 2024-09-12T18:36:01.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8481011684843778503', time=2024-09-12T20:02:56.696376+0000, chain.objs.size()=1 2024-09-12T18:36:01.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.212+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.cDVyS0k6s8Ph_R-Ay1VxWkjRDGjH9AK_0 2024-09-12T18:36:01.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18203125849825359119', time=2024-09-12T20:02:56.752147+0000, chain.objs.size()=1 2024-09-12T18:36:01.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.TNJAt-avqUsG4vrmNvt15SS_qYDeGvD_0 2024-09-12T18:36:01.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2010983997503492431', time=2024-09-12T20:02:57.077905+0000, chain.objs.size()=1 2024-09-12T18:36:01.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.fldbamb2E5KbQtewUerUD38D5R8i6Pw_0 2024-09-12T18:36:01.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1432479547134151776', time=2024-09-12T20:02:57.186147+0000, chain.objs.size()=1 2024-09-12T18:36:01.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.PGUIThuGdnzNZZBah_yPfxnFoB5WuLf_0 2024-09-12T18:36:01.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13929078822748644359', time=2024-09-12T20:03:00.594459+0000, chain.objs.size()=1 2024-09-12T18:36:01.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.F2djkLIkdhsAYSwOM5vCQC2sO1zVhRE_0 2024-09-12T18:36:01.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13308614556448089802', time=2024-09-12T20:03:01.344399+0000, chain.objs.size()=1 2024-09-12T18:36:01.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.VWf4bNhy36xn2WXPY7fBWVmyKO0TKrt_0 2024-09-12T18:36:01.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6448525192655676351', time=2024-09-12T20:03:01.346682+0000, chain.objs.size()=1 2024-09-12T18:36:01.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.yJqSIZtxVicvm_lDZd-gh4-SbMULR9B_0 2024-09-12T18:36:01.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9512612286503321235', time=2024-09-12T20:03:01.663564+0000, chain.objs.size()=1 2024-09-12T18:36:01.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.58nNshomNAFG7JEp362bjvRKwp0KHwj_0 2024-09-12T18:36:01.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6363374218393455179', time=2024-09-12T20:03:05.575190+0000, chain.objs.size()=1 2024-09-12T18:36:01.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XpzRJpfdaQBgLk6Bsia2Ofe4Ff72_yL_0 2024-09-12T18:36:01.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18254954744608973466', time=2024-09-12T20:03:06.005304+0000, chain.objs.size()=1 2024-09-12T18:36:01.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qSIEckFBQ4IAF-UtQiSJm0QnB3gCXWh_0 2024-09-12T18:36:01.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10079012279701072977', time=2024-09-12T20:03:07.914303+0000, chain.objs.size()=1 2024-09-12T18:36:01.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.lmff3KhwWyFdbGXLUkh1HeclJO8SGFt_0 2024-09-12T18:36:01.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12273640755566809737', time=2024-09-12T20:03:09.729288+0000, chain.objs.size()=1 2024-09-12T18:36:01.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.OcEPhgMF8LZkpI0249aBPJxNu2R5sa4_0 2024-09-12T18:36:01.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17144214759048215286', time=2024-09-12T20:03:10.990152+0000, chain.objs.size()=1 2024-09-12T18:36:01.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.216+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.s4Yax-Te-I4amY_rp7ZYzyC7I8osAIe_0 2024-09-12T18:36:01.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10953182024047028712', time=2024-09-12T20:03:11.086187+0000, chain.objs.size()=1 2024-09-12T18:36:01.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Dwi4IGBvnDxfz4H90kKV4lWz8oA2PN4_0 2024-09-12T18:36:01.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14520829257777955090', time=2024-09-12T20:03:11.746957+0000, chain.objs.size()=1 2024-09-12T18:36:01.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2spZmbEkfUOcj_OodNx8B8quocyvduv_0 2024-09-12T18:36:01.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10214743061550821569', time=2024-09-12T20:03:12.143075+0000, chain.objs.size()=1 2024-09-12T18:36:01.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Xsky6IWriaUw9uULyqcpfkkM-n_8DNB_0 2024-09-12T18:36:01.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12561745688298149629', time=2024-09-12T20:03:13.536182+0000, chain.objs.size()=1 2024-09-12T18:36:01.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.zPB3ZwQKcWcX7n02v8CR7MwN2NW0AAD_0 2024-09-12T18:36:01.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18381482930814445133', time=2024-09-12T20:03:14.613548+0000, chain.objs.size()=1 2024-09-12T18:36:01.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.iVu-gG5ROqr7dbF3qZfjwKgVQZe2F8u_0 2024-09-12T18:36:01.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.964142430508068560', time=2024-09-12T20:03:14.674317+0000, chain.objs.size()=1 2024-09-12T18:36:01.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.UUGXWiOd-icRNHofYXhH0Pse7VgNDlG_0 2024-09-12T18:36:01.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.466354045987650878', time=2024-09-12T20:03:14.998888+0000, chain.objs.size()=1 2024-09-12T18:36:01.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.u84aSpjQmoVWRgR-xLJQRhx8UFbn4hb_0 2024-09-12T18:36:01.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13733323912868534064', time=2024-09-12T20:03:19.734638+0000, chain.objs.size()=1 2024-09-12T18:36:01.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.42ZZMvtm8ghoB4oHzqkk8VMj-bK7OGr_0 2024-09-12T18:36:01.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2969333066646639546', time=2024-09-12T20:03:19.806001+0000, chain.objs.size()=1 2024-09-12T18:36:01.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.DZIVK0VgmEj6lYrUTq2DcqSk8ZvIJpn_0 2024-09-12T18:36:01.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10736848618059770066', time=2024-09-12T20:03:20.285726+0000, chain.objs.size()=1 2024-09-12T18:36:01.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.lBftBBg5mSawMCFLgEobbq-3xW42pdn_0 2024-09-12T18:36:01.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7767902999149876679', time=2024-09-12T20:03:39.328207+0000, chain.objs.size()=1 2024-09-12T18:36:01.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.220+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.275__shadow_.r7lwIM1UfI7kbSVmZJ-nUIDpKJxI6wA_0 2024-09-12T18:36:01.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.224+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9036107600731326209', time=2024-09-12T20:03:41.011799+0000, chain.objs.size()=1 2024-09-12T18:36:01.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.224+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.276__shadow_.rd0IbgxuDcjk3Z702Aa0eLBRCmtZWs8_0 2024-09-12T18:36:01.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.224+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9036405594336702654', time=2024-09-12T20:03:52.787019+0000, chain.objs.size()=1 2024-09-12T18:36:01.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.224+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.283__shadow_.voMUibrkQIRL7RbdeBRck7tQ2i6odYi_0 2024-09-12T18:36:01.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.224+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16361354444733916245', time=2024-09-12T20:03:56.152736+0000, chain.objs.size()=1 2024-09-12T18:36:01.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.224+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.285__shadow_.6J0q1C86vFzGrg6xks7dOcprGkkcJfR_0 2024-09-12T18:36:01.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.224+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.524527754482545246', time=2024-09-12T20:04:13.228947+0000, chain.objs.size()=1 2024-09-12T18:36:01.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.224+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.SyF2Y5bBw87b0gVPHlyo0zbNpYxr1hd_0 2024-09-12T18:36:01.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.224+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1523032417051183864', time=2024-09-12T20:04:18.165262+0000, chain.objs.size()=1 2024-09-12T18:36:01.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.224+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.VkwEtY1fsoVjMKxssdiCuOmjdp8guPW_0 2024-09-12T18:36:01.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.224+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2385916473133314602', time=2024-09-12T20:04:19.928452+0000, chain.objs.size()=1 2024-09-12T18:36:01.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.224+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.295__shadow_.sl761CWTl5u-nbeAdNV-OUEFThLi7KU_0 2024-09-12T18:36:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6989468421274441074', time=2024-09-12T20:05:02.305541+0000, chain.objs.size()=1 2024-09-12T18:36:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.320__shadow:I0Yum.u24ABC.J9CSBUjIdXucETzdYi_.meGDyhU8rJ5ccsABTgYYk2aXh1ayqwm_0 2024-09-12T18:36:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13069477285534122576', time=2024-09-12T20:06:51.000371+0000, chain.objs.size()=1 2024-09-12T18:36:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.664Mo7lIJb9Kq1bmSEFUssISMD7ryYs_0 2024-09-12T18:36:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11233102192596346430', time=2024-09-12T20:06:51.002930+0000, chain.objs.size()=1 2024-09-12T18:36:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.abGEJ5fvZStcNH8TlVzbWC3TylCuiU__0 2024-09-12T18:36:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1604503395881900798', time=2024-09-12T20:06:51.879222+0000, chain.objs.size()=1 2024-09-12T18:36:01.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.SeWK7uMPO5x0WvQOSfGxeecpexBlE97_0 2024-09-12T18:36:01.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10317924754562604263', time=2024-09-12T20:06:52.091818+0000, chain.objs.size()=1 2024-09-12T18:36:01.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-CkJaS1VUXKkzkuaxIFEi9SSWvMrGQC_0 2024-09-12T18:36:01.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1242109842535348488', time=2024-09-12T20:06:52.600769+0000, chain.objs.size()=1 2024-09-12T18:36:01.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.gzRbN6MbbBGjUoh3bF7RQdBOeq3txqI_0 2024-09-12T18:36:01.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3425648733436143658', time=2024-09-12T20:06:52.898254+0000, chain.objs.size()=1 2024-09-12T18:36:01.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.5-lFvCqOleWQzfBZvjxEt7YYBoNOq1F_0 2024-09-12T18:36:01.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8237416615309201357', time=2024-09-12T20:06:54.971616+0000, chain.objs.size()=1 2024-09-12T18:36:01.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.VG1sOM6cIOn_zP1jGrMnEqVtSY06IIS_0 2024-09-12T18:36:01.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11282449657048869382', time=2024-09-12T20:06:55.303115+0000, chain.objs.size()=1 2024-09-12T18:36:01.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Wos56xofm7kMK_gFviVJMbvqWaz56Di_0 2024-09-12T18:36:01.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6029663984631710470', time=2024-09-12T20:06:55.606890+0000, chain.objs.size()=1 2024-09-12T18:36:01.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.DBoevQN6yxvhgMGnUYRXIVa7PlHUHN8_0 2024-09-12T18:36:01.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4097080645906071046', time=2024-09-12T20:06:55.997430+0000, chain.objs.size()=1 2024-09-12T18:36:01.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.228+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.aXL6H0tD-TvL8Kkf7HC6HAVTiyuzlyG_0 2024-09-12T18:36:01.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16487455931189361818', time=2024-09-12T20:06:56.130734+0000, chain.objs.size()=1 2024-09-12T18:36:01.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.RWg0J6ooKagT2fC6JPmNv5wt3guLzZz_0 2024-09-12T18:36:01.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5433065187221886356', time=2024-09-12T20:06:56.980585+0000, chain.objs.size()=1 2024-09-12T18:36:01.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-TsIbDYjykgSs-cnwdTZ6P3UYudwIBG_0 2024-09-12T18:36:01.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15699421278958270359', time=2024-09-12T20:06:58.855668+0000, chain.objs.size()=1 2024-09-12T18:36:01.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.TA7XS-tlFQdDU6COKjcu0mcnuMPnYCe_0 2024-09-12T18:36:01.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10061545574028019628', time=2024-09-12T20:06:59.437690+0000, chain.objs.size()=1 2024-09-12T18:36:01.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.N4yQ6Pm8NKqDbbHknXEFBCDGAXcm5Fv_0 2024-09-12T18:36:01.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9515733568889418498', time=2024-09-12T20:07:00.656980+0000, chain.objs.size()=1 2024-09-12T18:36:01.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.q81mrLRq9KG9KAvQXfJgkOVjiYywO_v_0 2024-09-12T18:36:01.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15620405655508144494', time=2024-09-12T20:07:02.625639+0000, chain.objs.size()=1 2024-09-12T18:36:01.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.SNofsan5Cu5LOfRNvNmmz0qKcV05z1C_0 2024-09-12T18:36:01.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12203990330052777404', time=2024-09-12T20:07:02.988297+0000, chain.objs.size()=1 2024-09-12T18:36:01.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.CR1TdWElOaaGdkX6EM8hK6UoXV4inXZ_0 2024-09-12T18:36:01.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14467774382903144902', time=2024-09-12T20:07:03.103318+0000, chain.objs.size()=1 2024-09-12T18:36:01.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.RXPg4DKvaLQx78Bs2I7160THWODmpTN_0 2024-09-12T18:36:01.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1348131332163834211', time=2024-09-12T20:07:03.926089+0000, chain.objs.size()=1 2024-09-12T18:36:01.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ZJCz0hHTlDc31m2pDm6PT01LVJ8jLso_0 2024-09-12T18:36:01.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17373444712716682336', time=2024-09-12T20:07:04.142069+0000, chain.objs.size()=1 2024-09-12T18:36:01.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.0UlJ2jIwVnwzo2TfGlZ2UjBTF0AVwUO_0 2024-09-12T18:36:01.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7189289646885047135', time=2024-09-12T20:07:04.237194+0000, chain.objs.size()=1 2024-09-12T18:36:01.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.232+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.tbAw7m1E_EfQcOI8hlOFJ5RGeX_Ip1X_0 2024-09-12T18:36:01.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.236+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4676283701795344809', time=2024-09-12T20:07:04.389258+0000, chain.objs.size()=1 2024-09-12T18:36:01.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.236+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.BgiUnVaTwXol2LWTK20xpBrhsvBlkX9_0 2024-09-12T18:36:01.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.236+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1684084791211405843', time=2024-09-12T20:07:04.659106+0000, chain.objs.size()=1 2024-09-12T18:36:01.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.236+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.DV-fX3z_TyMtDt1Qtn2RWW8Y-CxP_Rw_0 2024-09-12T18:36:01.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.236+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8982486666212092945', time=2024-09-12T20:07:05.290490+0000, chain.objs.size()=1 2024-09-12T18:36:01.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.236+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.auAXB9K802_pA53NK7gesHP3DxLt3xd_0 2024-09-12T18:36:01.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.236+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1970505364174841144', time=2024-09-12T20:07:06.543493+0000, chain.objs.size()=1 2024-09-12T18:36:01.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.236+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.zlgZVoBYVRBturTMZMAkLx-fQd1X5an_0 2024-09-12T18:36:01.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.236+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13006250328082978648', time=2024-09-12T20:07:06.670861+0000, chain.objs.size()=1 2024-09-12T18:36:01.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.236+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.FTd_8meW97rnKuepA1MJahsXSCuH3ZF_0 2024-09-12T18:36:01.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5500193476533740679', time=2024-09-12T20:07:07.491158+0000, chain.objs.size()=1 2024-09-12T18:36:01.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.iltg3B7CVM7z2rBB2zHrqBghxm4Mhau_0 2024-09-12T18:36:01.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4034187044950263114', time=2024-09-12T20:07:08.452955+0000, chain.objs.size()=1 2024-09-12T18:36:01.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.SP_JrorhKGSg5x-JEewI5noM0v-_jKN_0 2024-09-12T18:36:01.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6356459599796945244', time=2024-09-12T20:07:08.542433+0000, chain.objs.size()=1 2024-09-12T18:36:01.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.EDugHtFXQgT3MW0xOCrgHHnqh-aBkud_0 2024-09-12T18:36:01.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11611004785907861935', time=2024-09-12T20:07:08.544440+0000, chain.objs.size()=1 2024-09-12T18:36:01.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.keJ4PE4EX-5GDu7wb4apznsgJLM70a1_0 2024-09-12T18:36:01.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2720385758110226203', time=2024-09-12T20:07:10.274099+0000, chain.objs.size()=1 2024-09-12T18:36:01.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ePX0YnSNOPACgkmL2ztfXU5VSHhN6uS_0 2024-09-12T18:36:01.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2771583410168133953', time=2024-09-12T20:07:10.633010+0000, chain.objs.size()=1 2024-09-12T18:36:01.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.tuLfN9LIBCkEeujk3ca4xlQNMARUmT7_0 2024-09-12T18:36:01.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14996093330390650726', time=2024-09-12T20:07:11.689060+0000, chain.objs.size()=1 2024-09-12T18:36:01.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.F9-wpBZtX5vHmrA20D1bsieJWBQkJh6_0 2024-09-12T18:36:01.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9250941733572239782', time=2024-09-12T20:07:12.435688+0000, chain.objs.size()=1 2024-09-12T18:36:01.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.BzJglQDwBr3qEPQ1LxD9zuQsQV2nVpZ_0 2024-09-12T18:36:01.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12385361442960336955', time=2024-09-12T20:07:12.606647+0000, chain.objs.size()=1 2024-09-12T18:36:01.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.gb5FVEqsYmRACIf2ZSIcaVa1IxVwfBc_0 2024-09-12T18:36:01.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2558868523116911514', time=2024-09-12T20:07:13.530218+0000, chain.objs.size()=1 2024-09-12T18:36:01.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.tyRe2EaUEXZWy1e4_PbAQaxzny_yr2l_0 2024-09-12T18:36:01.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16910281633357344924', time=2024-09-12T20:07:14.156914+0000, chain.objs.size()=1 2024-09-12T18:36:01.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.240+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.qN4k-8ZrvQg-vld3r0uSRImToze7jOg_0 2024-09-12T18:36:01.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13312288775103358664', time=2024-09-12T20:07:14.820048+0000, chain.objs.size()=1 2024-09-12T18:36:01.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.2xG5f2d94DyQWfwN7tM-bDtV9tN8Ozj_0 2024-09-12T18:36:01.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6353371193495282958', time=2024-09-12T20:07:16.148434+0000, chain.objs.size()=1 2024-09-12T18:36:01.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.CA5bJdVQWMTMjatRlBIMkRhJuLELsCo_0 2024-09-12T18:36:01.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12421171721691463031', time=2024-09-12T20:07:17.741764+0000, chain.objs.size()=1 2024-09-12T18:36:01.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.TNTgBC9MZLXYgdesuawVXB902gOSeQK_0 2024-09-12T18:36:01.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3727905698448628368', time=2024-09-12T20:07:18.697077+0000, chain.objs.size()=1 2024-09-12T18:36:01.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.WuVg4uNh6nkxkb-DMNC7UQ3ILKJLwOU_0 2024-09-12T18:36:01.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2010327021279874341', time=2024-09-12T20:07:19.010364+0000, chain.objs.size()=1 2024-09-12T18:36:01.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.X2jqMbZwFBU-3gFWh42BNxCUsgkC1yD_0 2024-09-12T18:36:01.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6400386163215631424', time=2024-09-12T20:09:01.905287+0000, chain.objs.size()=1 2024-09-12T18:36:01.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.DtC8TI0VxcsgT-EGLk8Rosb6WZe-6p1_0 2024-09-12T18:36:01.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14876124637074260937', time=2024-09-12T20:09:01.909663+0000, chain.objs.size()=1 2024-09-12T18:36:01.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.hJswtdoROIONr7Qy5pfh3-VlqMbbryt_0 2024-09-12T18:36:01.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1146048575973523049', time=2024-09-12T20:09:01.944869+0000, chain.objs.size()=1 2024-09-12T18:36:01.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.-jEtPJhqPG3Bx0SXK9LDBNoIysP3qSW_0 2024-09-12T18:36:01.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13318834953489631942', time=2024-09-12T20:09:02.798578+0000, chain.objs.size()=1 2024-09-12T18:36:01.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Q1nO3Ulg9zvDCFUOcwsLgYBUsnl0zqt_0 2024-09-12T18:36:01.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11822906582042518190', time=2024-09-12T20:09:02.800800+0000, chain.objs.size()=1 2024-09-12T18:36:01.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_._c5NtN4wp4loSRYtgF3bVp24S9Y1QWh_0 2024-09-12T18:36:01.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1531395799583401119', time=2024-09-12T20:09:03.317870+0000, chain.objs.size()=1 2024-09-12T18:36:01.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.244+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.CzzIjX-ldz6X438n50db74SZbtaHt9W_0 2024-09-12T18:36:01.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.248+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5657716970574351930', time=2024-09-12T20:09:04.689267+0000, chain.objs.size()=1 2024-09-12T18:36:01.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.248+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.GmKd_QJEDL-_ANkZ71OqIt7L0zyqxbD_0 2024-09-12T18:36:01.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.248+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3157522394707873409', time=2024-09-12T20:09:07.224466+0000, chain.objs.size()=1 2024-09-12T18:36:01.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.248+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.DI1a6XerJ6T_3C6S8WSGWFMzUvGWiZ4_0 2024-09-12T18:36:01.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.248+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2223535874237828999', time=2024-09-12T20:09:07.869809+0000, chain.objs.size()=1 2024-09-12T18:36:01.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.248+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.NkioT7KlhvLjRv75nlKIXyqA--g7n6H_0 2024-09-12T18:36:01.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.252+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17611479293687960904', time=2024-09-12T20:09:09.935318+0000, chain.objs.size()=1 2024-09-12T18:36:01.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.252+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vfgXogS_DkLkI-DpeEgqXGonS5fHKwf_0 2024-09-12T18:36:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.252+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7424162613264220647', time=2024-09-12T20:09:10.528983+0000, chain.objs.size()=1 2024-09-12T18:36:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.252+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.jgYAdJPHwrUkItnbSflfu46fKjsPf-B_0 2024-09-12T18:36:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.252+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11259951606924187073', time=2024-09-12T20:09:11.272389+0000, chain.objs.size()=1 2024-09-12T18:36:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.252+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.y7w_FHLYfWKiUVKsUk-jZoIVF_OejeC_0 2024-09-12T18:36:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.252+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13721216769173878448', time=2024-09-12T20:09:11.377946+0000, chain.objs.size()=1 2024-09-12T18:36:01.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.252+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.HCvvcacbiF6xieshJAbeMiK5tBE2f6H_0 2024-09-12T18:36:01.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.252+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4622968558455632833', time=2024-09-12T20:09:12.223286+0000, chain.objs.size()=1 2024-09-12T18:36:01.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.252+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FCLABVKfodZ0BF3rWDiLj8PelwpCL6L_0 2024-09-12T18:36:01.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.252+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1947980541162011284', time=2024-09-12T20:09:13.292629+0000, chain.objs.size()=1 2024-09-12T18:36:01.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.252+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.jkdLLUVuZI3VmlN9MUWgn-PvWEPY70v_0 2024-09-12T18:36:01.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.252+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9164349339825860549', time=2024-09-12T20:09:13.748470+0000, chain.objs.size()=1 2024-09-12T18:36:01.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.252+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.yuJU6OI451UUZ1gyaaH067iSQAXDlkr_0 2024-09-12T18:36:01.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.256+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/67938 2024-09-12T18:36:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=50, truncated=0, next_marker='' 2024-09-12T18:36:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10655511948202401464', time=2024-09-12T20:09:13.775069+0000, chain.objs.size()=1 2024-09-12T18:36:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.bFHhgDKBD4WxQafjPTeC0BKBtaClGMQ_0 2024-09-12T18:36:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8358960236065411763', time=2024-09-12T20:09:15.035207+0000, chain.objs.size()=1 2024-09-12T18:36:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.YSG3YJSFFs5bODZPX3IiRqvpwUXSxub_0 2024-09-12T18:36:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14906461130425377857', time=2024-09-12T20:09:15.164130+0000, chain.objs.size()=1 2024-09-12T18:36:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.sN2Noq14171AIRbFOSJP_zzfjeT7xf5_0 2024-09-12T18:36:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9062271285951966739', time=2024-09-12T20:09:15.881127+0000, chain.objs.size()=1 2024-09-12T18:36:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ToJEPsaOygheCms-VJHV_GWFNGNhsvY_0 2024-09-12T18:36:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15101036383946563973', time=2024-09-12T20:09:16.025698+0000, chain.objs.size()=1 2024-09-12T18:36:01.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.DKijbuPLwXGQsGEJI1E6QmgFJ8odPKu_0 2024-09-12T18:36:01.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1744569652578955977', time=2024-09-12T20:09:17.045889+0000, chain.objs.size()=1 2024-09-12T18:36:01.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.-FlWH8KDwRNcRBSKGGBA0cC08ZMgLeu_0 2024-09-12T18:36:01.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18333470593163641747', time=2024-09-12T20:09:17.398586+0000, chain.objs.size()=1 2024-09-12T18:36:01.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.6obHFqDbqqAcSRzpZtL1CHCN76EYWQb_0 2024-09-12T18:36:01.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1585005214910204491', time=2024-09-12T20:09:18.734131+0000, chain.objs.size()=1 2024-09-12T18:36:01.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.LYFdj02H-1bPTWBC4x51DKP-7oBgZh9_0 2024-09-12T18:36:01.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1378094044471087863', time=2024-09-12T20:09:20.629674+0000, chain.objs.size()=1 2024-09-12T18:36:01.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Q3GWRbkiT9ZErA8501l5y2V-kmX9eNz_0 2024-09-12T18:36:01.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7214411489440867921', time=2024-09-12T20:09:20.862561+0000, chain.objs.size()=1 2024-09-12T18:36:01.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.YZfV-x3zE09S8Q8wduBYuSbnbcgXht7_0 2024-09-12T18:36:01.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15945998794974658318', time=2024-09-12T20:09:21.407131+0000, chain.objs.size()=1 2024-09-12T18:36:01.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.EwAzuPtc61I_Fh9cFk65TurxDzRHzzq_0 2024-09-12T18:36:01.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12539480964097702576', time=2024-09-12T20:09:21.801941+0000, chain.objs.size()=1 2024-09-12T18:36:01.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.260+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.iMJE0SF8fCAP-2V5NTy_Pp2fpUB5B4B_0 2024-09-12T18:36:01.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17420422423304171252', time=2024-09-12T20:09:21.803324+0000, chain.objs.size()=1 2024-09-12T18:36:01.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_._Z1SQUQ4_lS40nJfNAUk1BiIL2tX7hL_0 2024-09-12T18:36:01.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12609079209645711109', time=2024-09-12T20:09:22.019044+0000, chain.objs.size()=1 2024-09-12T18:36:01.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2BnX59NFjqXxX_9iRomygbbiXZW5Rbv_0 2024-09-12T18:36:01.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8832521688713850949', time=2024-09-12T20:09:22.636843+0000, chain.objs.size()=1 2024-09-12T18:36:01.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.k1fuQp3pPEMdzPT0UPMHp6dGMQnV9Jz_0 2024-09-12T18:36:01.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10097841748359158743', time=2024-09-12T20:09:22.651716+0000, chain.objs.size()=1 2024-09-12T18:36:01.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FgjcwAmseizb2lU92QKVQe2gbfJaNt8_0 2024-09-12T18:36:01.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13774302615300204996', time=2024-09-12T20:09:24.521574+0000, chain.objs.size()=1 2024-09-12T18:36:01.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Ew_2iq0O5ZBIUK91uSScdxVNuqC00w9_0 2024-09-12T18:36:01.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16101944194012280777', time=2024-09-12T20:09:25.398033+0000, chain.objs.size()=1 2024-09-12T18:36:01.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.rxbTVgbFyZ1s-zUyXqbIvH3VA0K6aWq_0 2024-09-12T18:36:01.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5881195628116770899', time=2024-09-12T20:09:26.059808+0000, chain.objs.size()=1 2024-09-12T18:36:01.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cTp2D-KDtH8sTb9EU4Nmg5pkxMfceTK_0 2024-09-12T18:36:01.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14759695554937228711', time=2024-09-12T20:09:27.133786+0000, chain.objs.size()=1 2024-09-12T18:36:01.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.TN5GRXB52585Mu_9sZKBEiy4772DP_7_0 2024-09-12T18:36:01.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5434352925131109571', time=2024-09-12T20:09:28.624238+0000, chain.objs.size()=1 2024-09-12T18:36:01.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.264+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.idLOQSvlCTUEmtHl8FtWvBAzDQgq89O_0 2024-09-12T18:36:01.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.268+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16082735154649093649', time=2024-09-12T20:09:36.660039+0000, chain.objs.size()=1 2024-09-12T18:36:01.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.268+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.330__shadow_.hUUQce3SuZsCVgNrEqTOCGrOxTGK5XA_0 2024-09-12T18:36:01.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.268+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1963925137168885551', time=2024-09-12T20:09:53.989433+0000, chain.objs.size()=1 2024-09-12T18:36:01.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.268+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.343__shadow_.1XhrQSFqhL7mWQx3P8qBiU0KZ9p5hNM_0 2024-09-12T18:36:01.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.268+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11170723957389284862', time=2024-09-12T20:10:35.997575+0000, chain.objs.size()=1 2024-09-12T18:36:01.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.268+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.378__shadow_.g_VcYgUjoIQzBtfoWA-pAY2F_GWRuDw_0 2024-09-12T18:36:01.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.268+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16302446692666646976', time=2024-09-12T20:10:39.148623+0000, chain.objs.size()=1 2024-09-12T18:36:01.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.268+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.380__shadow_.EQmif4PCC1e_tIaZn28on38zIwOsRIA_0 2024-09-12T18:36:01.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2577092504022257124', time=2024-09-12T20:13:15.532046+0000, chain.objs.size()=4 2024-09-12T18:36:01.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.487__shadow_.HqLmY8cIRrURRVHwv1zCRi8Tojevr2c_0 2024-09-12T18:36:01.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.487__shadow_.HqLmY8cIRrURRVHwv1zCRi8Tojevr2c_1 2024-09-12T18:36:01.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.487__shadow_.HqLmY8cIRrURRVHwv1zCRi8Tojevr2c_2 2024-09-12T18:36:01.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.487__shadow_.HqLmY8cIRrURRVHwv1zCRi8Tojevr2c_3 2024-09-12T18:36:01.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8337493703423387980', time=2024-09-12T20:13:21.105658+0000, chain.objs.size()=1 2024-09-12T18:36:01.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.491__shadow_.W6q2-btRRIp8agzsydkYlhMp3t2koyh_0 2024-09-12T18:36:01.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8337493703423387980', time=2024-09-12T20:13:21.526880+0000, chain.objs.size()=1 2024-09-12T18:36:01.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.491__shadow_.W6q2-btRRIp8agzsydkYlhMp3t2koyh_0 2024-09-12T18:36:01.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18194541055701419852', time=2024-09-12T20:13:41.366983+0000, chain.objs.size()=1 2024-09-12T18:36:01.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.504__shadow:p--u8yBdmzUFbtwCdiIMSfaVaX-Tsns_.K5_RZa2CGyb4Lrga0hcpjF_NIfZ0MyJ_0 2024-09-12T18:36:01.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.116086467767243347', time=2024-09-12T20:14:02.659504+0000, chain.objs.size()=1 2024-09-12T18:36:01.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.512__multipart_mymultipart.2~bFI0dE0FyrnLsmuyMDDMaDL08QqZHOj.1 2024-09-12T18:36:01.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8531404835986948875', time=2024-09-12T20:14:10.456852+0000, chain.objs.size()=1 2024-09-12T18:36:01.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.516__shadow_.tC8K0Ad1KfHZXDBHUEKyZLqpkCU70D7_0 2024-09-12T18:36:01.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8zBNN_csIm0T-FlRJQsfxqq1Z9u9MSg', time=2024-09-12T20:16:13.987994+0000, chain.objs.size()=1 2024-09-12T18:36:01.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~8zBNN_csIm0T-FlRJQsfxqq1Z9u9MSg.1 2024-09-12T18:36:01.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8zBNN_csIm0T-FlRJQsfxqq1Z9u9MSg', time=2024-09-12T20:16:13.998174+0000, chain.objs.size()=1 2024-09-12T18:36:01.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.272+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~8zBNN_csIm0T-FlRJQsfxqq1Z9u9MSg.2 2024-09-12T18:36:01.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.276+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8zBNN_csIm0T-FlRJQsfxqq1Z9u9MSg', time=2024-09-12T20:16:14.008804+0000, chain.objs.size()=1 2024-09-12T18:36:01.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.276+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~8zBNN_csIm0T-FlRJQsfxqq1Z9u9MSg.3 2024-09-12T18:36:01.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.276+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8zBNN_csIm0T-FlRJQsfxqq1Z9u9MSg', time=2024-09-12T20:16:14.018405+0000, chain.objs.size()=1 2024-09-12T18:36:01.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.276+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~8zBNN_csIm0T-FlRJQsfxqq1Z9u9MSg.4 2024-09-12T18:36:01.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.276+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8zBNN_csIm0T-FlRJQsfxqq1Z9u9MSg', time=2024-09-12T20:16:14.028008+0000, chain.objs.size()=1 2024-09-12T18:36:01.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.276+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~8zBNN_csIm0T-FlRJQsfxqq1Z9u9MSg.5 2024-09-12T18:36:01.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.276+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8zBNN_csIm0T-FlRJQsfxqq1Z9u9MSg', time=2024-09-12T20:16:14.037320+0000, chain.objs.size()=1 2024-09-12T18:36:01.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.276+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~8zBNN_csIm0T-FlRJQsfxqq1Z9u9MSg.6 2024-09-12T18:36:01.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15735623710599635118', time=2024-09-12T20:19:26.285445+0000, chain.objs.size()=1 2024-09-12T18:36:01.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:qwNzNWb4yD2mtqaU.mmZu56njFzr0Ig_.08xg8mmeJ_e4IWEb0fN4nxxHnB5aXTW_0 2024-09-12T18:36:01.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5931456987157123855', time=2024-09-12T20:19:33.046891+0000, chain.objs.size()=1 2024-09-12T18:36:01.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.573__shadow_.-yqj_G3US7e2cBSWeCopxY6_rF0bYq8_0 2024-09-12T18:36:01.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15822053042489083995', time=2024-09-12T20:20:08.009290+0000, chain.objs.size()=1 2024-09-12T18:36:01.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:MNFxT4kaY4XvUxgELsf1jVAyy9SKKZj_.Y2CbDUH3faqBTVcaWB6NPe7AA3CYeY5_0 2024-09-12T18:36:01.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11704095114442804188', time=2024-09-12T20:21:11.548566+0000, chain.objs.size()=1 2024-09-12T18:36:01.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.581__shadow:55nEXumRUfy6092EtMsxmWtEzxCV5X2_.6pm9kzNxK9LteowoljLHH7aeJFc3b9L_0 2024-09-12T18:36:01.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15348023967321969541', time=2024-09-12T20:21:12.618530+0000, chain.objs.size()=1 2024-09-12T18:36:01.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.581__shadow:55nEXumRUfy6092EtMsxmWtEzxCV5X2_.6pm9kzNxK9LteowoljLHH7aeJFc3b9L_0 2024-09-12T18:36:01.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8936204655576390615', time=2024-09-12T20:21:45.965087+0000, chain.objs.size()=1 2024-09-12T18:36:01.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.603__shadow_.xukStQl_MAsFgdRc3pokd5nhWPXABYt_0 2024-09-12T18:36:01.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8443947970228181787', time=2024-09-12T20:21:49.149734+0000, chain.objs.size()=1 2024-09-12T18:36:01.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.605__shadow_.yoOSLPBVEneIu64kbROjpG_Sydb-VdV_0 2024-09-12T18:36:01.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14797608286004469848', time=2024-09-12T20:24:31.070869+0000, chain.objs.size()=1 2024-09-12T18:36:01.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.618__shadow_.faCs-NKGciZKTsMDY9mBYF2XWo7vKqe_0 2024-09-12T18:36:01.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1394557154462372592', time=2024-09-12T20:27:17.671494+0000, chain.objs.size()=1 2024-09-12T18:36:01.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.655__shadow_.SjTo7RamlDn9BUtPJr_V5sbcojwUsw-_0 2024-09-12T18:36:01.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4645319483324263306', time=2024-09-12T20:27:59.070631+0000, chain.objs.size()=1 2024-09-12T18:36:01.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.667__shadow_.JAS3aC08SQIFpLlRMEqeQ0g5JWrrFY5_0 2024-09-12T18:36:01.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5400784218110461608', time=2024-09-12T20:28:03.098652+0000, chain.objs.size()=1 2024-09-12T18:36:01.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.280+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.671__shadow_.h5RUQbDMuJKr_r9O9YCcV08WBi-sCHb_0 2024-09-12T18:36:01.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.284+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7899967651978562860', time=2024-09-12T20:28:36.215599+0000, chain.objs.size()=1 2024-09-12T18:36:01.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.284+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.697__shadow:RtBQ-apee5LfBzVZByzw5uJNTwVQvyq_.61hxg3Y-6xH7Jxl1SuIpcVEQNhjhWVT_0 2024-09-12T18:36:01.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.284+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2450037394220601047', time=2024-09-12T20:28:47.719703+0000, chain.objs.size()=1 2024-09-12T18:36:01.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.284+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.704__shadow:w-c-EW8KYD5aE7XIlCSEKaT-2ZciPl8_.2R_tT_nMOcpy4fT3NMpmiCptVfWS43F_0 2024-09-12T18:36:01.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.284+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:01.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.288+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:36:01.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.288+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:01.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.288+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:01.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46675' 2024-09-12T18:36:01.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4426819895777429564', time=2024-09-12T19:55:53.389012+0000, chain.objs.size()=1 2024-09-12T18:36:01.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.159__shadow_.c4433fFZx8dgRSzqXZo3EN79mz75sNM_0 2024-09-12T18:36:01.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_UhowajHbQ7Ysgt6Xs7Hwb5ywXkJ2h9C', time=2024-09-12T19:56:16.260326+0000, chain.objs.size()=3 2024-09-12T18:36:01.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_.iinUqxTM5gqAbIC-DBmDCeEI6mrzsgb_0 2024-09-12T18:36:01.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_.iinUqxTM5gqAbIC-DBmDCeEI6mrzsgb_1 2024-09-12T18:36:01.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_.iinUqxTM5gqAbIC-DBmDCeEI6mrzsgb_2 2024-09-12T18:36:01.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_C5Xbgpga8wUnCq3oHGsradvJ_cGpyDc', time=2024-09-12T19:56:20.766974+0000, chain.objs.size()=3 2024-09-12T18:36:01.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_.aY_tKy8P1mLN9FVLjqxKuFDP-RIN1k0_0 2024-09-12T18:36:01.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_.aY_tKy8P1mLN9FVLjqxKuFDP-RIN1k0_1 2024-09-12T18:36:01.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.162__shadow_.aY_tKy8P1mLN9FVLjqxKuFDP-RIN1k0_2 2024-09-12T18:36:01.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6510103340061414650', time=2024-09-12T20:00:25.489166+0000, chain.objs.size()=1 2024-09-12T18:36:01.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.237__shadow_.z3YHkk3OJxZPKlgF39WLPfNCUCm-48F_0 2024-09-12T18:36:01.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16746974078776274171', time=2024-09-12T20:00:30.532963+0000, chain.objs.size()=1 2024-09-12T18:36:01.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.239__shadow_.zpQCbKQCkcLEHaYOkmb-ktGq96sd_86_0 2024-09-12T18:36:01.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.271533088349618414', time=2024-09-12T20:00:51.495327+0000, chain.objs.size()=1 2024-09-12T18:36:01.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.251__shadow_.7t8wbhEXbvvOfk0nqvHl8nWyROXfA4G_0 2024-09-12T18:36:01.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14522638398059681246', time=2024-09-12T20:00:54.902129+0000, chain.objs.size()=1 2024-09-12T18:36:01.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.253__shadow_.ccojpswaGpFOWbGvILlKYoHJzQY4NSb_0 2024-09-12T18:36:01.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10359562239265774258', time=2024-09-12T20:00:54.906030+0000, chain.objs.size()=1 2024-09-12T18:36:01.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.253__shadow_._rfQAllsqkN002ROcxJR7fjB83oErUQ_0 2024-09-12T18:36:01.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17073412289736083449', time=2024-09-12T20:01:09.724294+0000, chain.objs.size()=1 2024-09-12T18:36:01.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.292+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.262__shadow_.ijS5Z7AXTPwyxUxepbglXYVzTIWniD-_0 2024-09-12T18:36:01.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4027094482318700340', time=2024-09-12T20:02:52.482917+0000, chain.objs.size()=1 2024-09-12T18:36:01.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.5uT_QTtHH-S0VjDFPoUlB-Gjontxg-Y_0 2024-09-12T18:36:01.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5046901217649687902', time=2024-09-12T20:02:52.627670+0000, chain.objs.size()=1 2024-09-12T18:36:01.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.zUaRmVFwgxnD0AqxkGs-rLcn0YdHEAH_0 2024-09-12T18:36:01.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10583374090093511601', time=2024-09-12T20:02:52.667449+0000, chain.objs.size()=1 2024-09-12T18:36:01.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.CsXZfZkd-o5cWpqjiBHb9QKFWRaJKRm_0 2024-09-12T18:36:01.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18381868619748320286', time=2024-09-12T20:02:52.805308+0000, chain.objs.size()=1 2024-09-12T18:36:01.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XFth3gYO001ko4Cq41cA7zNri2yUpcd_0 2024-09-12T18:36:01.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1716880739521495415', time=2024-09-12T20:02:53.773810+0000, chain.objs.size()=1 2024-09-12T18:36:01.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.sHiMNnM-BViAvDFo2MhqQSVhN_jb-9x_0 2024-09-12T18:36:01.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12986088515783743598', time=2024-09-12T20:02:53.775241+0000, chain.objs.size()=1 2024-09-12T18:36:01.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.P6eGSbrsjpDkdtnmqR9K10dDQ3G4lbZ_0 2024-09-12T18:36:01.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9089326871060814453', time=2024-09-12T20:02:54.441481+0000, chain.objs.size()=1 2024-09-12T18:36:01.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.m0Z7mZ6IPLTW3TwZAk2I3lQSuasg6hM_0 2024-09-12T18:36:01.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5713492374185689627', time=2024-09-12T20:02:56.061033+0000, chain.objs.size()=1 2024-09-12T18:36:01.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.E0wASwHMctqbkyszDYC0sZ0A7mXDZ0R_0 2024-09-12T18:36:01.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4932690948013332895', time=2024-09-12T20:02:57.443541+0000, chain.objs.size()=1 2024-09-12T18:36:01.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Zf6BQNOWTz1Mjc4JWmifWmCgj1idvPe_0 2024-09-12T18:36:01.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16466022418514303363', time=2024-09-12T20:02:57.445103+0000, chain.objs.size()=1 2024-09-12T18:36:01.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.296+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.dN56d6Yka-bYokFmMdznEb3WbZcZ2Bv_0 2024-09-12T18:36:01.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5673244081755627120', time=2024-09-12T20:02:57.520151+0000, chain.objs.size()=1 2024-09-12T18:36:01.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wFyEdsJSt4EPSWOZet4yWbUNb3r1RVC_0 2024-09-12T18:36:01.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12691751764372475992', time=2024-09-12T20:03:00.566254+0000, chain.objs.size()=1 2024-09-12T18:36:01.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ZYIu4B9G_24LyDz0c2WT8mNr3ATZStB_0 2024-09-12T18:36:01.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14872915835454685306', time=2024-09-12T20:03:02.387878+0000, chain.objs.size()=1 2024-09-12T18:36:01.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.LpceYNia9rnlmwgW6MeGqiXgLZ9Qybv_0 2024-09-12T18:36:01.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9566815586637934010', time=2024-09-12T20:03:02.598950+0000, chain.objs.size()=1 2024-09-12T18:36:01.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.0DZOa9e5wwJog40HIE4mGzVbjgOa8R4_0 2024-09-12T18:36:01.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9877410129817175921', time=2024-09-12T20:03:03.627449+0000, chain.objs.size()=1 2024-09-12T18:36:01.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.MNiPPefYaZF9pgf3wqjTEGlHD79L1aQ_0 2024-09-12T18:36:01.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16596157711838387189', time=2024-09-12T20:03:03.977230+0000, chain.objs.size()=1 2024-09-12T18:36:01.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.lAm1f96U4We4zbef9rO7fQ-aUzUhovn_0 2024-09-12T18:36:01.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3142736214132925891', time=2024-09-12T20:03:04.227220+0000, chain.objs.size()=1 2024-09-12T18:36:01.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Xi_EUgYiPTL_0ENT_EW4B8kzb-c6vig_0 2024-09-12T18:36:01.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14396428190098801642', time=2024-09-12T20:03:04.747471+0000, chain.objs.size()=1 2024-09-12T18:36:01.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.gZAY8pqp1xtHKbWelzxl5hnu64n1_i8_0 2024-09-12T18:36:01.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11635240174636624345', time=2024-09-12T20:03:04.918049+0000, chain.objs.size()=1 2024-09-12T18:36:01.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.HMkNrtVz-DwWKpfTeSea271-X8Y3nef_0 2024-09-12T18:36:01.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.534057008568262066', time=2024-09-12T20:03:04.919880+0000, chain.objs.size()=1 2024-09-12T18:36:01.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.JHCe3OajdfSZfTRzihfeK6F-dGZYfUm_0 2024-09-12T18:36:01.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12517035364524084339', time=2024-09-12T20:03:05.223275+0000, chain.objs.size()=1 2024-09-12T18:36:01.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.300+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-tK10PFaMK67BFaPN2UeOHosT8PNAQI_0 2024-09-12T18:36:01.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17331481402802248210', time=2024-09-12T20:03:05.694100+0000, chain.objs.size()=1 2024-09-12T18:36:01.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Ovx_bIbuVWjHPb96JoAds9nHqxFBRE4_0 2024-09-12T18:36:01.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7012974100086742737', time=2024-09-12T20:03:05.783702+0000, chain.objs.size()=1 2024-09-12T18:36:01.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.eour64G93qD7RQGe4xmgbqOpZjAAbpA_0 2024-09-12T18:36:01.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15598827092062471801', time=2024-09-12T20:03:05.935528+0000, chain.objs.size()=1 2024-09-12T18:36:01.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.dfLTUP_n24igs99Tg5VPQyRB3tGux_W_0 2024-09-12T18:36:01.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14154924036527922847', time=2024-09-12T20:03:06.229715+0000, chain.objs.size()=1 2024-09-12T18:36:01.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.cjtOj1bjW6qXE9ygo4wugsHXIM5Cond_0 2024-09-12T18:36:01.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8380956303664170804', time=2024-09-12T20:03:07.285084+0000, chain.objs.size()=1 2024-09-12T18:36:01.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.vOCO6gFjfqUBuzOduQhk_REuxeIZ7HG_0 2024-09-12T18:36:01.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8926316917092537246', time=2024-09-12T20:03:07.291561+0000, chain.objs.size()=1 2024-09-12T18:36:01.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.1QT4rs_V5LvVJKiCR1HDlO2mlcyYavj_0 2024-09-12T18:36:01.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11671170309663033257', time=2024-09-12T20:03:07.547952+0000, chain.objs.size()=1 2024-09-12T18:36:01.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.FU3e58Lch7BO5v-DQua__TeNx1EJBPb_0 2024-09-12T18:36:01.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14520970507472750712', time=2024-09-12T20:03:08.273253+0000, chain.objs.size()=1 2024-09-12T18:36:01.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.cHn4nm7FsWuaz9NaWDwISm9BeZDo7Yw_0 2024-09-12T18:36:01.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16110110906305495033', time=2024-09-12T20:03:08.310443+0000, chain.objs.size()=1 2024-09-12T18:36:01.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.UHWvVtVJrcLIXOdS8rLlf4oxuJNnTWp_0 2024-09-12T18:36:01.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18347708126027822307', time=2024-09-12T20:03:08.690199+0000, chain.objs.size()=1 2024-09-12T18:36:01.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.X3wJXyLgEyVYDBkYAnLey7CgWMhlmc__0 2024-09-12T18:36:01.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13480981393230706525', time=2024-09-12T20:03:09.606564+0000, chain.objs.size()=1 2024-09-12T18:36:01.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.cN1nOW83k4w6Jd9VrcEXcfAbbntajsN_0 2024-09-12T18:36:01.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10443608320249858800', time=2024-09-12T20:03:10.052723+0000, chain.objs.size()=1 2024-09-12T18:36:01.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.304+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ihtaW3KKWA8-JPMaVY52BqvHeY2PhfU_0 2024-09-12T18:36:01.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.308+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6565454799165807452', time=2024-09-12T20:03:11.522191+0000, chain.objs.size()=1 2024-09-12T18:36:01.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.308+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Y3ZqHU38uZCg8T2oOEAxuz5laTpltua_0 2024-09-12T18:36:01.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.308+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8275806374947101902', time=2024-09-12T20:03:11.525109+0000, chain.objs.size()=1 2024-09-12T18:36:01.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.308+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ZubkwUl3YYBobxb9XlaeksamG0e8_9R_0 2024-09-12T18:36:01.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.308+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4441434259136116652', time=2024-09-12T20:03:13.224339+0000, chain.objs.size()=1 2024-09-12T18:36:01.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.308+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.eLRVcK1Xieyq1sBgX_cUpwvTfFBrHis_0 2024-09-12T18:36:01.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.308+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18025133942698320749', time=2024-09-12T20:03:14.656650+0000, chain.objs.size()=1 2024-09-12T18:36:01.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.308+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.PDBIwHQ_uHfWP4VqXdSz6S-fbPkSuhX_0 2024-09-12T18:36:01.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.308+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6091130150626327084', time=2024-09-12T20:03:14.662659+0000, chain.objs.size()=1 2024-09-12T18:36:01.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.308+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.oz5DmY3Y79DtbI7OhJyXKfR88vzyBat_0 2024-09-12T18:36:01.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.308+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18405750405347475816', time=2024-09-12T20:03:15.273648+0000, chain.objs.size()=1 2024-09-12T18:36:01.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.308+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Auf5uFmBlKjhL5mXQi0NSweu6y8gwsI_0 2024-09-12T18:36:01.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.308+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5848823828326186063', time=2024-09-12T20:03:16.304399+0000, chain.objs.size()=1 2024-09-12T18:36:01.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.308+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.L2QEhV5lSturqBul9FCqppCu_IAGoV6_0 2024-09-12T18:36:01.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.312+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16977982164967443316', time=2024-09-12T20:03:16.641493+0000, chain.objs.size()=1 2024-09-12T18:36:01.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.312+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-7vnDeZKCMQrK00L7zeCrgwLG3pVFry_0 2024-09-12T18:36:01.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.312+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6885706312577706999', time=2024-09-12T20:03:16.841048+0000, chain.objs.size()=1 2024-09-12T18:36:01.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.312+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.s35tnwgFxu5W1kYN7d7ajSQ0kEzWKFl_0 2024-09-12T18:36:01.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.312+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13923144686286527405', time=2024-09-12T20:03:17.315689+0000, chain.objs.size()=1 2024-09-12T18:36:01.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.312+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-tqhNSUXkEXrNb74TrVem9__jM3vj8R_0 2024-09-12T18:36:01.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.312+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16265986006915788537', time=2024-09-12T20:03:20.335888+0000, chain.objs.size()=1 2024-09-12T18:36:01.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.312+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Ax1g6se86xfmNqzlVebjklUtzxDfXGp_0 2024-09-12T18:36:01.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.312+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4085167803757418770', time=2024-09-12T20:03:28.510594+0000, chain.objs.size()=1 2024-09-12T18:36:01.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.312+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.268__shadow_.n5R14Roa9kCCRJAxbj4cz6UOoaKFdcJ_0 2024-09-12T18:36:01.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.312+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10942126938676847761', time=2024-09-12T20:03:46.057598+0000, chain.objs.size()=1 2024-09-12T18:36:01.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.312+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.279__shadow_.lMLdKyZ6bM7YiFLy7k8mUFTxfRMvA5E_0 2024-09-12T18:36:01.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.312+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17454671301700830158', time=2024-09-12T20:04:12.958373+0000, chain.objs.size()=1 2024-09-12T18:36:01.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.312+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.4zvS_-qJrE2OnVwB2z_4YLqjX34Zl8n_0 2024-09-12T18:36:01.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.312+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2412052996768225588', time=2024-09-12T20:04:28.547077+0000, chain.objs.size()=1 2024-09-12T18:36:01.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.312+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.300__shadow_.Iw7JEiW053OqXLvqatC6pwjlGJaKYdb_0 2024-09-12T18:36:01.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10659607186469015041', time=2024-09-12T20:04:31.930209+0000, chain.objs.size()=1 2024-09-12T18:36:01.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.302__shadow_.o17-IZP0bB6DNOJByzQohoRRYhSey_e_0 2024-09-12T18:36:01.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9204164608117046071', time=2024-09-12T20:04:40.742896+0000, chain.objs.size()=1 2024-09-12T18:36:01.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.307__shadow_.ZXHeOcGy9MTsPlYUqnxvbgoPMNXPAYD_0 2024-09-12T18:36:01.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11763553874323855068', time=2024-09-12T20:06:51.017271+0000, chain.objs.size()=1 2024-09-12T18:36:01.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.dWPSgAfLVLdUR8CSinA6Sd7V6F--D6S_0 2024-09-12T18:36:01.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6042586931536004409', time=2024-09-12T20:06:51.471185+0000, chain.objs.size()=1 2024-09-12T18:36:01.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.J2LwWBWZTwdW7M9ufN3oENYQbRNUnsa_0 2024-09-12T18:36:01.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9429839999708018579', time=2024-09-12T20:06:51.684437+0000, chain.objs.size()=1 2024-09-12T18:36:01.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.LcQEHxj4Qw5LYtzSl6ieTJ4Yd0SH1ug_0 2024-09-12T18:36:01.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8266800788846882744', time=2024-09-12T20:06:51.852023+0000, chain.objs.size()=1 2024-09-12T18:36:01.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.S826ddYzd_X_j2F3L_RaEAyY47sForF_0 2024-09-12T18:36:01.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4140677686117729835', time=2024-09-12T20:06:52.698107+0000, chain.objs.size()=1 2024-09-12T18:36:01.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.AqZjryKySaFVugaePL6LjGzoni3Y2kJ_0 2024-09-12T18:36:01.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6836318466526665835', time=2024-09-12T20:06:53.782832+0000, chain.objs.size()=1 2024-09-12T18:36:01.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.2i_4_U3FM4uZyDR1BNBgD7w-jjCosQ-_0 2024-09-12T18:36:01.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7631834069731264642', time=2024-09-12T20:06:53.823049+0000, chain.objs.size()=1 2024-09-12T18:36:01.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Cwcpc3kwMUbabiv_okz_awnvr3ECx6t_0 2024-09-12T18:36:01.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5337191775409704351', time=2024-09-12T20:06:55.297121+0000, chain.objs.size()=1 2024-09-12T18:36:01.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.GvqSAPP3VmxtteYkrYLtqVo27RFFqtF_0 2024-09-12T18:36:01.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1709541012472778253', time=2024-09-12T20:06:55.833825+0000, chain.objs.size()=1 2024-09-12T18:36:01.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.FJEUV51Hl9UVIBPwVd-GmbNBxJQrtIb_0 2024-09-12T18:36:01.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8510477751163734592', time=2024-09-12T20:06:56.216237+0000, chain.objs.size()=1 2024-09-12T18:36:01.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.2GQ4X4QpXneONXV0XwzKwfZYNnPnNvk_0 2024-09-12T18:36:01.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1906134025207214016', time=2024-09-12T20:06:57.177231+0000, chain.objs.size()=1 2024-09-12T18:36:01.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.316+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.mBJUL8WQtx49AvLAuYSWqBtTLVpW5Kx_0 2024-09-12T18:36:01.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13005095172556739553', time=2024-09-12T20:06:57.749672+0000, chain.objs.size()=1 2024-09-12T18:36:01.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.J__oAB5sj4HFmCRpVUs0n1nGHEazzg2_0 2024-09-12T18:36:01.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7217405461557609985', time=2024-09-12T20:06:59.113985+0000, chain.objs.size()=1 2024-09-12T18:36:01.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.I0oiXhc3WTgAV6ztgmFi8A7EMDxdAVo_0 2024-09-12T18:36:01.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16249382922844960462', time=2024-09-12T20:06:59.609975+0000, chain.objs.size()=1 2024-09-12T18:36:01.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.syHLIYKz781aibpgHt9L6xsFWRwh-l9_0 2024-09-12T18:36:01.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15041347650389501776', time=2024-09-12T20:07:00.199686+0000, chain.objs.size()=1 2024-09-12T18:36:01.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Egd-RY_Owg49tP-9uk3hGCi8AnzeQZX_0 2024-09-12T18:36:01.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2093991379763403615', time=2024-09-12T20:07:01.181009+0000, chain.objs.size()=1 2024-09-12T18:36:01.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.dBNzBuCeNGMsPUiiNxFlhC6TpAvcB_o_0 2024-09-12T18:36:01.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9463659867644147157', time=2024-09-12T20:07:02.666428+0000, chain.objs.size()=1 2024-09-12T18:36:01.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.0wVe_D81DwurQIaKITMo_glO7eSW6vh_0 2024-09-12T18:36:01.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6948538391940537387', time=2024-09-12T20:07:02.668635+0000, chain.objs.size()=1 2024-09-12T18:36:01.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Jon6W2bw4XmBs2U0ZYLCrCMjxNyZq0T_0 2024-09-12T18:36:01.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4479913853012967093', time=2024-09-12T20:07:03.118636+0000, chain.objs.size()=1 2024-09-12T18:36:01.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.V3ntZ-cMD4bFQKc3oysYbRWeqceBpKk_0 2024-09-12T18:36:01.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2465387609347044462', time=2024-09-12T20:07:03.910771+0000, chain.objs.size()=1 2024-09-12T18:36:01.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.zmmQpuilT0ViUau0iu9YpRaPmyr_RZJ_0 2024-09-12T18:36:01.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12899452991638299926', time=2024-09-12T20:07:04.403253+0000, chain.objs.size()=1 2024-09-12T18:36:01.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.vP2hyHTprJXXxbf5FIUXDqo3w-iemZ1_0 2024-09-12T18:36:01.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6549288860287225669', time=2024-09-12T20:07:07.349493+0000, chain.objs.size()=1 2024-09-12T18:36:01.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.320+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.nAJrp0lEwLB_3WZXdmrMtboV-My4ip0_0 2024-09-12T18:36:01.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.324+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6648026146491206545', time=2024-09-12T20:07:10.340925+0000, chain.objs.size()=1 2024-09-12T18:36:01.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.324+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.iwMqksGV-8g909wqFaBmk8akIpFzr9n_0 2024-09-12T18:36:01.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.324+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9846151495476472671', time=2024-09-12T20:07:10.909225+0000, chain.objs.size()=1 2024-09-12T18:36:01.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.324+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.nzw56paJYdq3gW89sXPgwrBLaZiTAni_0 2024-09-12T18:36:01.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.324+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3820443621147010913', time=2024-09-12T20:07:11.982077+0000, chain.objs.size()=1 2024-09-12T18:36:01.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.324+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.kx1K7V89v8-XaVVkwcZyDI-SRgQfHtc_0 2024-09-12T18:36:01.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.324+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14009605983720219187', time=2024-09-12T20:07:12.599147+0000, chain.objs.size()=1 2024-09-12T18:36:01.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.324+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.XTBEasiIl_DvES35IsdWO0f7hYs9xR0_0 2024-09-12T18:36:01.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13276657711727553603', time=2024-09-12T20:07:13.469373+0000, chain.objs.size()=1 2024-09-12T18:36:01.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.jhNgETSmo5-gG3XJGG9FV1VopHDrrtC_0 2024-09-12T18:36:01.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17380012660315047675', time=2024-09-12T20:07:13.803235+0000, chain.objs.size()=1 2024-09-12T18:36:01.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.x5JAbsrrXch263urEy7OnLPzSiudxV4_0 2024-09-12T18:36:01.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16790162879151784048', time=2024-09-12T20:07:13.838586+0000, chain.objs.size()=1 2024-09-12T18:36:01.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.1v6AgIUVL3aGT3KagbuXHmBY98zrJqL_0 2024-09-12T18:36:01.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17112484731178041300', time=2024-09-12T20:07:14.260212+0000, chain.objs.size()=1 2024-09-12T18:36:01.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.G02w_vIdYDk_6tx1uDlDvClZXn97IVa_0 2024-09-12T18:36:01.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.838866973659435302', time=2024-09-12T20:07:14.354936+0000, chain.objs.size()=1 2024-09-12T18:36:01.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.czk7KR1kx7ykX_WEmh6LtV81FlfyIfX_0 2024-09-12T18:36:01.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15399389122267744450', time=2024-09-12T20:07:14.461317+0000, chain.objs.size()=1 2024-09-12T18:36:01.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.2Gy-UHXxmWXamnoO0b6SAcM62n6RDrA_0 2024-09-12T18:36:01.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7234303874185735526', time=2024-09-12T20:07:15.103969+0000, chain.objs.size()=1 2024-09-12T18:36:01.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ataGvj3MxA2SF-yHTZ3ysF54EHG4wPR_0 2024-09-12T18:36:01.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10651195966216706758', time=2024-09-12T20:07:15.359970+0000, chain.objs.size()=1 2024-09-12T18:36:01.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Ewb0wtQh9upPRxANJnZcFrXEi__OiFW_0 2024-09-12T18:36:01.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5436246734913212964', time=2024-09-12T20:07:15.482061+0000, chain.objs.size()=1 2024-09-12T18:36:01.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.KmlgcUDn0S9Elp-vJPGyhXMhIjQyow__0 2024-09-12T18:36:01.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3292004963394253057', time=2024-09-12T20:07:17.019592+0000, chain.objs.size()=1 2024-09-12T18:36:01.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.kP72IiHsuvpd03ma0GlQSqM6zkQ7qN8_0 2024-09-12T18:36:01.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12797503345406492798', time=2024-09-12T20:07:17.176793+0000, chain.objs.size()=1 2024-09-12T18:36:01.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.328+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.STlDDeM5dgwJ0exwiF2x3IMCptfZOTd_0 2024-09-12T18:36:01.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.332+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10847406375975418329', time=2024-09-12T20:07:17.866527+0000, chain.objs.size()=1 2024-09-12T18:36:01.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.332+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.CjLpVi_YEhw3FV-hsHjRU2qNhwxqy2m_0 2024-09-12T18:36:01.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.332+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12536313323619309596', time=2024-09-12T20:07:18.260791+0000, chain.objs.size()=1 2024-09-12T18:36:01.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.332+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-pZVHcr_bnewrAgqXzKgyuUl0v8IRRe_0 2024-09-12T18:36:01.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.332+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9057688526427497202', time=2024-09-12T20:07:19.054338+0000, chain.objs.size()=1 2024-09-12T18:36:01.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.332+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.mGIL3xUXAwUcfLmXq8aIqc3VnRzwJ-U_0 2024-09-12T18:36:01.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.332+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12540106092889602676', time=2024-09-12T20:09:01.806319+0000, chain.objs.size()=1 2024-09-12T18:36:01.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.332+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.UMfybFnFBJwGfDBxsj1w_lbgqO4ziNL_0 2024-09-12T18:36:01.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.336+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46675 2024-09-12T18:36:01.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=53, truncated=0, next_marker='' 2024-09-12T18:36:01.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10312213303159961144', time=2024-09-12T20:09:01.897841+0000, chain.objs.size()=1 2024-09-12T18:36:01.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.rZjyeBQwvbUAba85fJl3F2bhZfytslf_0 2024-09-12T18:36:01.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7143376205309625448', time=2024-09-12T20:09:02.169334+0000, chain.objs.size()=1 2024-09-12T18:36:01.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.yf-wYckh-4x5zOkzsS3egWPDWme8zcO_0 2024-09-12T18:36:01.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5857452663389415454', time=2024-09-12T20:09:03.730569+0000, chain.objs.size()=1 2024-09-12T18:36:01.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.HrIuYGilpEHwXHYH_578OJOH8VDDAWQ_0 2024-09-12T18:36:01.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15113934750560672874', time=2024-09-12T20:09:03.836847+0000, chain.objs.size()=1 2024-09-12T18:36:01.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.d4NU5Cfhzm11kvuH_QO6Elyt0ewBFL1_0 2024-09-12T18:36:01.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13215396831743757424', time=2024-09-12T20:09:04.654176+0000, chain.objs.size()=1 2024-09-12T18:36:01.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.I7FTrHecoXgaauZtAsjhN_4qYv4G9IC_0 2024-09-12T18:36:01.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3511930121871884912', time=2024-09-12T20:09:07.052647+0000, chain.objs.size()=1 2024-09-12T18:36:01.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.8qW_k-fXx610JLe7sRFzhkHjLdBgvig_0 2024-09-12T18:36:01.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9368808928042715642', time=2024-09-12T20:09:07.153079+0000, chain.objs.size()=1 2024-09-12T18:36:01.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.jJIdKbAssX72mc4ehYlq_lu3xt2MEup_0 2024-09-12T18:36:01.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12070563008729061932', time=2024-09-12T20:09:07.251185+0000, chain.objs.size()=1 2024-09-12T18:36:01.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.yBoVu0gRxxhHGtkRQCH-jYHjedU1CU8_0 2024-09-12T18:36:01.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7541742736316624020', time=2024-09-12T20:09:07.851804+0000, chain.objs.size()=1 2024-09-12T18:36:01.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vtZIfbH_QoshZVmK-wW-KFGLcYohIiI_0 2024-09-12T18:36:01.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17635047900706036826', time=2024-09-12T20:09:08.023784+0000, chain.objs.size()=1 2024-09-12T18:36:01.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.VAadpz7qhpPekDHER7F5yWlIRP6CXbu_0 2024-09-12T18:36:01.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.727763136443561869', time=2024-09-12T20:09:08.551906+0000, chain.objs.size()=1 2024-09-12T18:36:01.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.pT-5O2E5tch6mMOCsxR_-Caxseozf_N_0 2024-09-12T18:36:01.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17701501368065508629', time=2024-09-12T20:09:09.961346+0000, chain.objs.size()=1 2024-09-12T18:36:01.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.tSwkeNtZEbi6nXG8pu01eSNStawS9m0_0 2024-09-12T18:36:01.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14370397667086267542', time=2024-09-12T20:09:10.712003+0000, chain.objs.size()=1 2024-09-12T18:36:01.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.340+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ZQzHtg3i_tRUEuNpEzifjX9tZvgTUFa_0 2024-09-12T18:36:01.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5591544937444280295', time=2024-09-12T20:09:11.272951+0000, chain.objs.size()=1 2024-09-12T18:36:01.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.E2-SB7Ib7Bqw-OuFt7hYAIVa67OqHFF_0 2024-09-12T18:36:01.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3117802202704243556', time=2024-09-12T20:09:11.348141+0000, chain.objs.size()=1 2024-09-12T18:36:01.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.C4u9_EpRW7X0ZJFKBLGcIQrHDCFajd8_0 2024-09-12T18:36:01.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12638010775987901410', time=2024-09-12T20:09:14.436081+0000, chain.objs.size()=1 2024-09-12T18:36:01.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.PMjC5tm-Dzk5opONvJtddLAjElm32ah_0 2024-09-12T18:36:01.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10766475162793594745', time=2024-09-12T20:09:15.073381+0000, chain.objs.size()=1 2024-09-12T18:36:01.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.bJFcXTLQaNZ2dtbyEJn_w5nd4odX8iP_0 2024-09-12T18:36:01.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10903852774693348106', time=2024-09-12T20:09:15.474427+0000, chain.objs.size()=1 2024-09-12T18:36:01.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.WX1_No565HDBWAvNbsF9Px5u-pJohtF_0 2024-09-12T18:36:01.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15600890812080433360', time=2024-09-12T20:09:16.001971+0000, chain.objs.size()=1 2024-09-12T18:36:01.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.oVgq-lWZpqUR_HkLZiwJEa00_735C8e_0 2024-09-12T18:36:01.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5989641536234304967', time=2024-09-12T20:09:16.083744+0000, chain.objs.size()=1 2024-09-12T18:36:01.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.NSmxaQgb8AOGpmzyHelarC3uFPKz5x2_0 2024-09-12T18:36:01.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14158324614232969090', time=2024-09-12T20:09:17.638963+0000, chain.objs.size()=1 2024-09-12T18:36:01.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.EMKEkt0aVZSqN5wlPwO9aM7jsCSfrge_0 2024-09-12T18:36:01.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.830029416584660676', time=2024-09-12T20:09:19.101416+0000, chain.objs.size()=1 2024-09-12T18:36:01.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.GzalDlUHUt4XOGEbRFlXSjCuEkW0ltJ_0 2024-09-12T18:36:01.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8734966367431781226', time=2024-09-12T20:09:19.327307+0000, chain.objs.size()=1 2024-09-12T18:36:01.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.344+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.KObp5sFlz7Ez3vsQQEOvbwi_8opcwqD_0 2024-09-12T18:36:01.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2419656462642593392', time=2024-09-12T20:09:20.567603+0000, chain.objs.size()=1 2024-09-12T18:36:01.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.7zpJmDR7DyNE2_xtPVNhVvezRu9KhY8_0 2024-09-12T18:36:01.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13060736677367332247', time=2024-09-12T20:09:23.469483+0000, chain.objs.size()=1 2024-09-12T18:36:01.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.TREL3XRTayzLlnxveYqiAgwtyQtqBsT_0 2024-09-12T18:36:01.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.945393495264470747', time=2024-09-12T20:09:24.620313+0000, chain.objs.size()=1 2024-09-12T18:36:01.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.zZ8NC0rI6G5kErFvWn-LSDeeEam2k4r_0 2024-09-12T18:36:01.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3265409276244951170', time=2024-09-12T20:09:24.825340+0000, chain.objs.size()=1 2024-09-12T18:36:01.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.WP64ykrXXPwZgifan0E2dbXS9rEqm_U_0 2024-09-12T18:36:01.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.269756974477358945', time=2024-09-12T20:09:25.009080+0000, chain.objs.size()=1 2024-09-12T18:36:01.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.u1et9NPuWI9ASWyPBI-gCJoiCUNPeXe_0 2024-09-12T18:36:01.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15000904994135922792', time=2024-09-12T20:09:25.475176+0000, chain.objs.size()=1 2024-09-12T18:36:01.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.OkM0omCKiCrN2B57pKFu5YhrjoHIi9L_0 2024-09-12T18:36:01.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6103665924673932847', time=2024-09-12T20:09:26.049875+0000, chain.objs.size()=1 2024-09-12T18:36:01.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ukxGNtxpekhjgVoZqFNbcnkf-dcGlvf_0 2024-09-12T18:36:01.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17109780847717508188', time=2024-09-12T20:09:26.338668+0000, chain.objs.size()=1 2024-09-12T18:36:01.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ioTXdU3PzVQjc9YoqDP0w8b_qqtvBTh_0 2024-09-12T18:36:01.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2355501306103085221', time=2024-09-12T20:09:26.694369+0000, chain.objs.size()=1 2024-09-12T18:36:01.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.GDj-sdJfR-6JRy7svVEBymTppeHDL9O_0 2024-09-12T18:36:01.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3675156378528289638', time=2024-09-12T20:09:27.346051+0000, chain.objs.size()=1 2024-09-12T18:36:01.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.7BNNYQtuu1VP3x5d34_dx4v-oMNVI97_0 2024-09-12T18:36:01.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9866457866768701416', time=2024-09-12T20:09:27.991493+0000, chain.objs.size()=1 2024-09-12T18:36:01.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xsXQcxkHgwqrFLSvCyT487pBgQOVVBo_0 2024-09-12T18:36:01.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.50170902026271690', time=2024-09-12T20:09:27.993378+0000, chain.objs.size()=1 2024-09-12T18:36:01.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.348+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ogbleNwlUOkkZaVZJep-mZ2nPk7OL77_0 2024-09-12T18:36:01.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5102508482713041158', time=2024-09-12T20:09:28.233588+0000, chain.objs.size()=1 2024-09-12T18:36:01.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Xn9CDYRji2yiMjZvYgPDOIuLPLeHFcE_0 2024-09-12T18:36:01.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5435157986543481988', time=2024-09-12T20:09:29.948897+0000, chain.objs.size()=1 2024-09-12T18:36:01.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Epil1qYdjX0lQ3CCiSOlomhavrKT8SP_0 2024-09-12T18:36:01.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7874669995708155417', time=2024-09-12T20:09:40.540245+0000, chain.objs.size()=1 2024-09-12T18:36:01.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.333__shadow_.048tQrr10Y7PrP2hiF1yaggvD0qKWVk_0 2024-09-12T18:36:01.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2557209684244390375', time=2024-09-12T20:10:41.902043+0000, chain.objs.size()=1 2024-09-12T18:36:01.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.382__shadow_.6bRBfWXcESRpHfuNj6uh9cVs81mF-JZ_0 2024-09-12T18:36:01.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18397375694750385792', time=2024-09-12T20:11:53.131217+0000, chain.objs.size()=1 2024-09-12T18:36:01.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.435__shadow_.7gfvL_mUevM2UA6VPMVm8jcQFOcUMNP_0 2024-09-12T18:36:01.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14191332900945349943', time=2024-09-12T20:12:34.819566+0000, chain.objs.size()=1 2024-09-12T18:36:01.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.461__shadow_.sIblkk1Ewhdu_wpklPRzKX3UVZJqlcU_0 2024-09-12T18:36:01.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2810214860244534189', time=2024-09-12T20:13:07.208018+0000, chain.objs.size()=1 2024-09-12T18:36:01.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.484__shadow_.Tj5Ayd7nEIgAO1Q1m8C2SbiJjnoyukX_0 2024-09-12T18:36:01.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12845763843914660764', time=2024-09-12T20:13:23.228657+0000, chain.objs.size()=1 2024-09-12T18:36:01.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.492__shadow_.jprt9Co3MoOur-hqdPaiaR2RM-Pi4dt_0 2024-09-12T18:36:01.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ExV0SaIrZm1_VTo3oSp8xjb22dq9ITL', time=2024-09-12T20:17:14.820041+0000, chain.objs.size()=1 2024-09-12T18:36:01.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.535__multipart_mymultipart.2~ExV0SaIrZm1_VTo3oSp8xjb22dq9ITL.1 2024-09-12T18:36:01.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2411928952847059402', time=2024-09-12T20:18:18.025633+0000, chain.objs.size()=1 2024-09-12T18:36:01.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.554__shadow_.C8JrXqUTcH8PjTHH9RzLDkx_v8NAWrQ_0 2024-09-12T18:36:01.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10918550014389517370', time=2024-09-12T20:19:20.747444+0000, chain.objs.size()=1 2024-09-12T18:36:01.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.352+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:pTyif.WNwW3rHa49hol4smf.PvkiFB-_.-iFHMsNbEbNasW5llypQZM5igfgfaAO_0 2024-09-12T18:36:01.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.356+0000 7f4eb0731640 0 -- 172.21.15.119:0/22423105 >> [v2:172.21.15.194:6816/2881805626,v1:172.21.15.194:6817/2881805626] conn(0x55a112424b90 msgr2=0x7f4d7c0872c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:36:01.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.356+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9610381172410457708', time=2024-09-12T20:19:58.155396+0000, chain.objs.size()=1 2024-09-12T18:36:01.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.356+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.577__shadow:YJqHfHUdVU6iil8lM78Xt41re9iyeVo_.i-mOwkDIGzjNh9JyRU6iexE38Zk3C0u_0 2024-09-12T18:36:01.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.356+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16052922724423540937', time=2024-09-12T20:21:14.441845+0000, chain.objs.size()=1 2024-09-12T18:36:01.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.356+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.583__shadow:BHPxZrDBeps9JWSIHANH6xqEddK9LFv_.7WKN-grPMqd9H51y1Q6QIYSz_xOviEK_0 2024-09-12T18:36:01.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.356+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7169392501131675229', time=2024-09-12T20:21:16.842813+0000, chain.objs.size()=1 2024-09-12T18:36:01.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.356+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.584__shadow:LC1TELI34F6i.0q9JSQd8EpU3VfPvpx_.JA9EQvskU3-Vo891ECnfTKA4iaBNnfl_0 2024-09-12T18:36:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.356+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2671905106445601683', time=2024-09-12T20:21:51.958596+0000, chain.objs.size()=1 2024-09-12T18:36:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.356+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.607__shadow_.JaONjKbBCjodixMDPYDgV8Gylmtdq_P_0 2024-09-12T18:36:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.356+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2218739638135811285', time=2024-09-12T20:26:57.440263+0000, chain.objs.size()=1 2024-09-12T18:36:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.356+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.646__shadow_.S3478ItJuTgTu7MohAGTI5-t7zxGvyc_0 2024-09-12T18:36:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.356+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5818435709064162217', time=2024-09-12T20:27:05.577296+0000, chain.objs.size()=1 2024-09-12T18:36:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.356+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.649__shadow_.efz7QJx4FgYRHCsuC1DOZcYVTKLmk3C_0 2024-09-12T18:36:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.356+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3599410116210514004', time=2024-09-12T20:27:51.378075+0000, chain.objs.size()=1 2024-09-12T18:36:01.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.356+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.664__shadow_._rJuEiYe508RiDcQYuxU3kV0LIbc8O2_0 2024-09-12T18:36:01.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.360+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:01.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:36:01.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:01.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51274' 2024-09-12T18:36:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10360593619308403792', time=2024-09-12T19:57:36.753830+0000, chain.objs.size()=1 2024-09-12T18:36:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.204__shadow_.0i_zhuzE16w-Uy3jTo0WbVZvL524K1R_0 2024-09-12T18:36:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.82944851341720730', time=2024-09-12T20:00:20.407071+0000, chain.objs.size()=1 2024-09-12T18:36:01.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.234__shadow_.41Cv2fz59i-_ZvbE5H1cy14YbG9v8ZB_0 2024-09-12T18:36:01.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13152903668754935849', time=2024-09-12T20:00:22.121595+0000, chain.objs.size()=1 2024-09-12T18:36:01.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.235__shadow_.p7w0h-e8oqchpBki3X0ezq0nT0Kbn8e_0 2024-09-12T18:36:01.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11221117258857470138', time=2024-09-12T20:02:51.932394+0000, chain.objs.size()=1 2024-09-12T18:36:01.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.seEEuudeRVhUxlBY6LcPh000HpK1tDd_0 2024-09-12T18:36:01.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14432239123817565883', time=2024-09-12T20:02:52.927900+0000, chain.objs.size()=1 2024-09-12T18:36:01.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.NpTHeACfkWEvvqYR2cVMFadoqHcr9Rl_0 2024-09-12T18:36:01.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5323476746585775927', time=2024-09-12T20:02:52.931721+0000, chain.objs.size()=1 2024-09-12T18:36:01.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.aInmtEN-NTqLwIG7C6w5ox-1JyS9ZO6_0 2024-09-12T18:36:01.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17399670321112901927', time=2024-09-12T20:02:54.017226+0000, chain.objs.size()=1 2024-09-12T18:36:01.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.yo82hVX2QxrcunZDE25Qx2S2uCkQqq-_0 2024-09-12T18:36:01.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13642910752888472797', time=2024-09-12T20:02:54.757930+0000, chain.objs.size()=1 2024-09-12T18:36:01.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.A42-fZASJi5kXmB0yrjfGYzde7WkCok_0 2024-09-12T18:36:01.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16077695239523156766', time=2024-09-12T20:02:54.831687+0000, chain.objs.size()=1 2024-09-12T18:36:01.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.djO50CDUkcTeYtCwg-dcImo3FvgrgOn_0 2024-09-12T18:36:01.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1844005696775385317', time=2024-09-12T20:02:56.293498+0000, chain.objs.size()=1 2024-09-12T18:36:01.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.TEQzC6drN83nFXYf9uU4Z5ogcAHzXAJ_0 2024-09-12T18:36:01.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4319364290313843240', time=2024-09-12T20:02:59.796619+0000, chain.objs.size()=1 2024-09-12T18:36:01.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ad938w59Wjw6rcHNkCBZTiB8ERLPBAS_0 2024-09-12T18:36:01.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3269615005557372050', time=2024-09-12T20:03:00.324834+0000, chain.objs.size()=1 2024-09-12T18:36:01.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.364+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Geg3-X2YApFhhlzxZNwiK9p-L-qLRQ0_0 2024-09-12T18:36:01.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9122533342000017670', time=2024-09-12T20:03:02.075015+0000, chain.objs.size()=1 2024-09-12T18:36:01.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wThvbuW8ZL5rUsnuS8JFqIfe5jemqJ1_0 2024-09-12T18:36:01.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7446479736475737706', time=2024-09-12T20:03:02.291247+0000, chain.objs.size()=1 2024-09-12T18:36:01.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3P_-Lbdj9v8lyCkfu9hQ7Zj9cl8nVLp_0 2024-09-12T18:36:01.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15728264591621827366', time=2024-09-12T20:03:03.596598+0000, chain.objs.size()=1 2024-09-12T18:36:01.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.IOFLkpwN91XFGRiXAXLHh6zoot0PObv_0 2024-09-12T18:36:01.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3455570864427336969', time=2024-09-12T20:03:04.997608+0000, chain.objs.size()=1 2024-09-12T18:36:01.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.1iMj52Y0AxZHr9uiroYkgHHURCzkaFI_0 2024-09-12T18:36:01.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7361583724204815765', time=2024-09-12T20:03:05.917714+0000, chain.objs.size()=1 2024-09-12T18:36:01.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2vRQSKIKkqRGgj2opfzKz0G5cW20wRs_0 2024-09-12T18:36:01.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.328613386251298343', time=2024-09-12T20:03:06.011718+0000, chain.objs.size()=1 2024-09-12T18:36:01.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.UhkYJyUyNhxpP7Mwv2-yH9OTrTfYcWA_0 2024-09-12T18:36:01.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8667337978951900916', time=2024-09-12T20:03:06.390257+0000, chain.objs.size()=1 2024-09-12T18:36:01.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.WwfbjeE0-8y1eFfMfcVEy3W2gZCfXXY_0 2024-09-12T18:36:01.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3699193885827810363', time=2024-09-12T20:03:06.400574+0000, chain.objs.size()=1 2024-09-12T18:36:01.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-etg2efhNxporGk0NvqbvVsX03tZnES_0 2024-09-12T18:36:01.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17700836295765165923', time=2024-09-12T20:03:07.852247+0000, chain.objs.size()=1 2024-09-12T18:36:01.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XgzwLo3_eH6sqajTvN6EYj83TDqybDS_0 2024-09-12T18:36:01.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17401197543977642796', time=2024-09-12T20:03:08.288785+0000, chain.objs.size()=1 2024-09-12T18:36:01.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.fs5DGqklCHXkg0JSd-DJ6SkBuqO3L3G_0 2024-09-12T18:36:01.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12822284263675381216', time=2024-09-12T20:03:08.982408+0000, chain.objs.size()=1 2024-09-12T18:36:01.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.368+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.aC-DAwulO-w-1e9tT98Oj7NrFbE9AV__0 2024-09-12T18:36:01.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.372+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12233986073064498649', time=2024-09-12T20:03:11.310897+0000, chain.objs.size()=1 2024-09-12T18:36:01.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.372+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.l7yxd0_0_t9YK8EZpWFG_NXFs9AFoWl_0 2024-09-12T18:36:01.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.372+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6559564574792936636', time=2024-09-12T20:03:13.318173+0000, chain.objs.size()=1 2024-09-12T18:36:01.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.372+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._qNDWZ76v-Lgid7a3fiZdqpLU29JvGL_0 2024-09-12T18:36:01.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.372+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1177530305546303463', time=2024-09-12T20:03:13.777754+0000, chain.objs.size()=1 2024-09-12T18:36:01.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.372+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._CBiVesKf9w2VLayxakMQhgDanW_bSR_0 2024-09-12T18:36:01.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.372+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18203545905208983631', time=2024-09-12T20:03:15.089757+0000, chain.objs.size()=1 2024-09-12T18:36:01.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.372+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.iCRLVWq3C1b0pT7JIh82xWkkM91KT0T_0 2024-09-12T18:36:01.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.372+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11839238080321040361', time=2024-09-12T20:03:15.683213+0000, chain.objs.size()=1 2024-09-12T18:36:01.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.372+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.forRAMnOESYNMeVmK4rQ6hTmDsGExWu_0 2024-09-12T18:36:01.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.372+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5492986720565572824', time=2024-09-12T20:03:16.561737+0000, chain.objs.size()=1 2024-09-12T18:36:01.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.372+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.7mxyaogMjspJEvlWj-YCLA7jsREuL8m_0 2024-09-12T18:36:01.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.376+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17229547693171319601', time=2024-09-12T20:03:17.202857+0000, chain.objs.size()=1 2024-09-12T18:36:01.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.376+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.EtaOF42aDfUy4G1hER8RpxUGOChDqMX_0 2024-09-12T18:36:01.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.376+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6570524205915465384', time=2024-09-12T20:03:17.457500+0000, chain.objs.size()=1 2024-09-12T18:36:01.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.376+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Wq-VRfTonnShvO35FplWoF0gkEdT2Eo_0 2024-09-12T18:36:01.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.376+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5928394819015996323', time=2024-09-12T20:03:20.097531+0000, chain.objs.size()=1 2024-09-12T18:36:01.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.376+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QOxIv-_9crtEfN0BYjJh2fIHHFE2AFm_0 2024-09-12T18:36:01.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.376+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12796665974849804996', time=2024-09-12T20:03:26.961809+0000, chain.objs.size()=1 2024-09-12T18:36:01.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.376+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.267__shadow_.aGjKm-hwBHNWf6KjmsfnXdZ7OnN2fgX_0 2024-09-12T18:36:01.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.376+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3479471837943040054', time=2024-09-12T20:03:39.349832+0000, chain.objs.size()=1 2024-09-12T18:36:01.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.376+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.275__shadow_.pvJ5mcbZbiskifNo8WmraFNP778Sk2t_0 2024-09-12T18:36:01.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.376+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16121130287333127600', time=2024-09-12T20:03:51.112890+0000, chain.objs.size()=1 2024-09-12T18:36:01.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.376+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.282__shadow_.xdAmlJeZLKbiLvEO-CoEpm9JVRG7SHU_0 2024-09-12T18:36:01.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.376+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14391470135542632666', time=2024-09-12T20:03:52.762864+0000, chain.objs.size()=1 2024-09-12T18:36:01.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.376+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.283__shadow_.aG2ECIbWmPSOYWtnp2oLt_nL3BYucop_0 2024-09-12T18:36:01.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.380+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11057118408848025096', time=2024-09-12T20:03:57.949760+0000, chain.objs.size()=1 2024-09-12T18:36:01.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.380+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.286__shadow_.W-2XhkANDqFjlzUXlYDnHJRx1QrXhv0_0 2024-09-12T18:36:01.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.380+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9125238303505778188', time=2024-09-12T20:04:06.532600+0000, chain.objs.size()=1 2024-09-12T18:36:01.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.380+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.291__shadow_.3vFrL62yjP13Q5KyclitQFLkpPoRQIY_0 2024-09-12T18:36:01.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.380+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4924544400749389115', time=2024-09-12T20:04:12.981014+0000, chain.objs.size()=1 2024-09-12T18:36:01.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.380+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.oi_6YlkMnQA2PX1ygWlKwJMU3YfAyDc_0 2024-09-12T18:36:01.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.380+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5858498264180027948', time=2024-09-12T20:04:12.983475+0000, chain.objs.size()=1 2024-09-12T18:36:01.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.380+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.gLycOKCQW3O3d87BngKt2qfDRBIGovt_0 2024-09-12T18:36:01.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.380+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1534161408649454810', time=2024-09-12T20:05:02.401478+0000, chain.objs.size()=1 2024-09-12T18:36:01.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.380+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.320__shadow:uBw010-jdafd28RGq5jPlqdBVycssry_.L2zzRvOq-Va-PixoIZsFYbiDpbtiFzs_0 2024-09-12T18:36:01.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4067919374325426053', time=2024-09-12T20:06:51.017274+0000, chain.objs.size()=1 2024-09-12T18:36:01.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.T-KJNY2fZkUZP_FCjFLkq0c4NLa47hM_0 2024-09-12T18:36:01.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15083855456896327211', time=2024-09-12T20:06:51.137069+0000, chain.objs.size()=1 2024-09-12T18:36:01.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.TojILHAQ6rABggPzla3W9eT2lBBwyqM_0 2024-09-12T18:36:01.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8873872406944029589', time=2024-09-12T20:06:52.510998+0000, chain.objs.size()=1 2024-09-12T18:36:01.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.wQQsKqt7G1eitk5q7Tc39SOCvHZKzZi_0 2024-09-12T18:36:01.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10392798669983797278', time=2024-09-12T20:06:52.883687+0000, chain.objs.size()=1 2024-09-12T18:36:01.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.6jKsYXmsEZAP5z7sTuE6ce0nkiXM9Mr_0 2024-09-12T18:36:01.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2055621699254738620', time=2024-09-12T20:06:52.937152+0000, chain.objs.size()=1 2024-09-12T18:36:01.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.HC20eQ4W_sUzWxgCYJ76cEpa8Adx4tH_0 2024-09-12T18:36:01.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8286574876381796391', time=2024-09-12T20:06:53.243376+0000, chain.objs.size()=1 2024-09-12T18:36:01.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-wICqeWk74EVQZCwwyp_Kn7n_fMb4ap_0 2024-09-12T18:36:01.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18385218065467563793', time=2024-09-12T20:06:55.833962+0000, chain.objs.size()=1 2024-09-12T18:36:01.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.F_kXDew27HTyFF3MDtXBwB7KfvydeuC_0 2024-09-12T18:36:01.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13274944626993589684', time=2024-09-12T20:06:55.959881+0000, chain.objs.size()=1 2024-09-12T18:36:01.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.UjaNVrgCVhZKd_hp3MOatCwR7cLePYC_0 2024-09-12T18:36:01.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13302862543056890419', time=2024-09-12T20:06:57.168119+0000, chain.objs.size()=1 2024-09-12T18:36:01.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.3HlB13C1fen8s01tpcL9Mxuc8gNwoJ8_0 2024-09-12T18:36:01.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7050971328854308065', time=2024-09-12T20:06:57.740327+0000, chain.objs.size()=1 2024-09-12T18:36:01.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.384+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.gNkLeHIXEEMpvpLInXo_5sgVXYSY5GT_0 2024-09-12T18:36:01.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15964607184903609093', time=2024-09-12T20:06:57.742734+0000, chain.objs.size()=1 2024-09-12T18:36:01.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.aPoBVSebLqv60l9UbRBtbwV3MidonTI_0 2024-09-12T18:36:01.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2483716220769461138', time=2024-09-12T20:06:58.738911+0000, chain.objs.size()=1 2024-09-12T18:36:01.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.CQWWhVu2lhxNnhK-fp4sMs1XC4adcxZ_0 2024-09-12T18:36:01.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10874563739720735525', time=2024-09-12T20:06:58.742075+0000, chain.objs.size()=1 2024-09-12T18:36:01.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.GZiEMhNpSWRehyoShDF54ap70saG3oj_0 2024-09-12T18:36:01.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8176462630320159308', time=2024-09-12T20:06:59.354228+0000, chain.objs.size()=1 2024-09-12T18:36:01.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.omkAlL69MDvCf0EWQVzQEfmVTX61EDT_0 2024-09-12T18:36:01.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7779717767100340898', time=2024-09-12T20:07:01.091783+0000, chain.objs.size()=1 2024-09-12T18:36:01.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.GG8wcCtFdEkhQXfsR3GhUP1E-IEa9dX_0 2024-09-12T18:36:01.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7286954598065259314', time=2024-09-12T20:07:01.592624+0000, chain.objs.size()=1 2024-09-12T18:36:01.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.lD3gdaNDwu7qp3KTIJlQgpyw0v99LSi_0 2024-09-12T18:36:01.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4305669220359124998', time=2024-09-12T20:07:03.117438+0000, chain.objs.size()=1 2024-09-12T18:36:01.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.DJO82Of997nYNhRhjSFwvBnEIP1KsbL_0 2024-09-12T18:36:01.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3959273759403248444', time=2024-09-12T20:07:03.541481+0000, chain.objs.size()=1 2024-09-12T18:36:01.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.fpb5xgV8KohGBOG8FLPcnXxdozpfdvF_0 2024-09-12T18:36:01.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13753885445869604169', time=2024-09-12T20:07:06.297819+0000, chain.objs.size()=1 2024-09-12T18:36:01.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.edKWIn55UnDRzEEIEvcbjxO4L5Jte6a_0 2024-09-12T18:36:01.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13816658962895064441', time=2024-09-12T20:07:06.746751+0000, chain.objs.size()=1 2024-09-12T18:36:01.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.9fCDYErPO7i6Ii4xa97iLn1FNxw55Z6_0 2024-09-12T18:36:01.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6830996784308775375', time=2024-09-12T20:07:07.049756+0000, chain.objs.size()=1 2024-09-12T18:36:01.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.tsauTdp19x6C65tMQIBeSnB_8eXgJ9S_0 2024-09-12T18:36:01.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1805175220651985141', time=2024-09-12T20:07:07.247491+0000, chain.objs.size()=1 2024-09-12T18:36:01.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.388+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.c0ox7Qz_gouTLkW6igMGO4ky4Zvdx0W_0 2024-09-12T18:36:01.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4579223748737769501', time=2024-09-12T20:07:07.822467+0000, chain.objs.size()=1 2024-09-12T18:36:01.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.EvE7-ZYj8T0wxxN32CR62puj2nXmIny_0 2024-09-12T18:36:01.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15149661457164153196', time=2024-09-12T20:07:07.824432+0000, chain.objs.size()=1 2024-09-12T18:36:01.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.yqWGB0E_KsF1gL8WjMJGo9rqiUiYaUK_0 2024-09-12T18:36:01.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13578661441339103294', time=2024-09-12T20:07:08.069261+0000, chain.objs.size()=1 2024-09-12T18:36:01.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.kh10Ku0qTyutbwKWkX9YJSzZe6hl7mp_0 2024-09-12T18:36:01.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2550166417485726216', time=2024-09-12T20:07:08.195578+0000, chain.objs.size()=1 2024-09-12T18:36:01.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ntKTT14yYjqXcCc90t-k9HeJ1fx14xX_0 2024-09-12T18:36:01.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10115899596481943014', time=2024-09-12T20:07:09.968631+0000, chain.objs.size()=1 2024-09-12T18:36:01.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.SuqAzj3z4-HmRso0ONR3EFmHD84kLbY_0 2024-09-12T18:36:01.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17499948426006991615', time=2024-09-12T20:07:11.514095+0000, chain.objs.size()=1 2024-09-12T18:36:01.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7dtvtzyK8ke2Hp6rx8uv-_yYKg599Ee_0 2024-09-12T18:36:01.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16039497221610702779', time=2024-09-12T20:07:11.982753+0000, chain.objs.size()=1 2024-09-12T18:36:01.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.yuVNqxF7w5cPmhmqSM6WXneSR4dqImt_0 2024-09-12T18:36:01.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8250913400104575944', time=2024-09-12T20:07:13.469918+0000, chain.objs.size()=1 2024-09-12T18:36:01.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.PH0W8FXWpaJzCxCLSj-4M7ug_cGguzW_0 2024-09-12T18:36:01.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15049777779383281918', time=2024-09-12T20:07:13.851600+0000, chain.objs.size()=1 2024-09-12T18:36:01.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.392+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.5SnGSx0QtHoVJZiss2pRZtwfkz8E1pM_0 2024-09-12T18:36:01.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.396+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2016838465993820797', time=2024-09-12T20:07:14.165658+0000, chain.objs.size()=1 2024-09-12T18:36:01.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.396+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.QoMrXdEL9w621PpY8hKL9xmoAFbmpTO_0 2024-09-12T18:36:01.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.396+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14283184929179014300', time=2024-09-12T20:07:17.038825+0000, chain.objs.size()=1 2024-09-12T18:36:01.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.396+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.EEiMbqYiLOGmvXN0xaUZEna_NFou0fl_0 2024-09-12T18:36:01.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.396+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13328981251028043317', time=2024-09-12T20:07:17.978050+0000, chain.objs.size()=1 2024-09-12T18:36:01.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.396+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.yN_znkH2QXVpcxs48Cb9v4EWxC0CQyJ_0 2024-09-12T18:36:01.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14229389808750520947', time=2024-09-12T20:07:18.125480+0000, chain.objs.size()=1 2024-09-12T18:36:01.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.0BmI-yAmWVSpCeL5-j9raY2Pya77og-_0 2024-09-12T18:36:01.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1134005769244938860', time=2024-09-12T20:07:18.254050+0000, chain.objs.size()=1 2024-09-12T18:36:01.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ODVthkO2bzXWwFSHwCBNqmdJj0DIvYU_0 2024-09-12T18:36:01.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15507007508265668174', time=2024-09-12T20:07:18.397969+0000, chain.objs.size()=1 2024-09-12T18:36:01.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.SFINtRR2ocR8f5iMDk3FNZne9o2177p_0 2024-09-12T18:36:01.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3549982668103619067', time=2024-09-12T20:09:01.868720+0000, chain.objs.size()=1 2024-09-12T18:36:01.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_._sJGm0vUOXrcfarvo3GNalQFRMHz0vG_0 2024-09-12T18:36:01.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7631388182064690993', time=2024-09-12T20:09:03.726339+0000, chain.objs.size()=1 2024-09-12T18:36:01.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.VQtt8CkTfXQUwSrn3RizK192Yn3YzCr_0 2024-09-12T18:36:01.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12742370903430816913', time=2024-09-12T20:09:04.326687+0000, chain.objs.size()=1 2024-09-12T18:36:01.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.z0Sh3it1FBvWdfFItRRvA9R2xQJc2WI_0 2024-09-12T18:36:01.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16914389226194064610', time=2024-09-12T20:09:06.275791+0000, chain.objs.size()=1 2024-09-12T18:36:01.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.dL7w8vL_JJIWcEIplaj17msCdTOY8Fw_0 2024-09-12T18:36:01.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7648604678164930794', time=2024-09-12T20:09:07.011471+0000, chain.objs.size()=1 2024-09-12T18:36:01.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.9zriaympFwVsoRc-0s23we7pOw7acDQ_0 2024-09-12T18:36:01.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17220349128385376151', time=2024-09-12T20:09:07.477995+0000, chain.objs.size()=1 2024-09-12T18:36:01.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Ek_jSoxBSJfVA8O8ENimVlVQTJWGUTo_0 2024-09-12T18:36:01.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10374424003266665564', time=2024-09-12T20:09:07.771141+0000, chain.objs.size()=1 2024-09-12T18:36:01.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.CihuWpGEEFl-mT9fNhRXu8FgLlloV7p_0 2024-09-12T18:36:01.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6064253731480289966', time=2024-09-12T20:09:10.152992+0000, chain.objs.size()=1 2024-09-12T18:36:01.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.400+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.0CDVnoeCnofJoKedTz1p9bSkHrVjPJm_0 2024-09-12T18:36:01.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.404+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12565666927488042528', time=2024-09-12T20:09:10.324171+0000, chain.objs.size()=1 2024-09-12T18:36:01.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.404+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.rJPCLWs5xxOAkKo66wBdmDXXEEh3oN6_0 2024-09-12T18:36:01.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.404+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15208618122849257252', time=2024-09-12T20:09:12.165515+0000, chain.objs.size()=1 2024-09-12T18:36:01.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.404+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vxSZGcJUrQReiH3IEjYFgOacjSkEU16_0 2024-09-12T18:36:01.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5647446680654768435', time=2024-09-12T20:09:14.054012+0000, chain.objs.size()=1 2024-09-12T18:36:01.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.utvIoXTy3gGOx-_CIBtE_1jCy4Y32Bc_0 2024-09-12T18:36:01.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6456660594392269061', time=2024-09-12T20:09:14.168395+0000, chain.objs.size()=1 2024-09-12T18:36:01.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Lzd3NoUXrktISK6lktNMPTM0vB7P3Es_0 2024-09-12T18:36:01.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.674183766795596420', time=2024-09-12T20:09:14.258817+0000, chain.objs.size()=1 2024-09-12T18:36:01.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.fsxmVEeCXVsjEbXL4eDExbnyq_ewAOK_0 2024-09-12T18:36:01.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8726923954612287063', time=2024-09-12T20:09:14.822298+0000, chain.objs.size()=1 2024-09-12T18:36:01.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.WLz3EpmS67Zayb6tLbN7T5AqUFsWokR_0 2024-09-12T18:36:01.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4766932066762520901', time=2024-09-12T20:09:15.613485+0000, chain.objs.size()=1 2024-09-12T18:36:01.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.qf8mCrZK-TazR9GPvDqlmg0DZNpwZI1_0 2024-09-12T18:36:01.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7177453086099985872', time=2024-09-12T20:09:16.934658+0000, chain.objs.size()=1 2024-09-12T18:36:01.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Dvg6_6hK8CXPjcGnqE94pxffa1N4Voq_0 2024-09-12T18:36:01.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1590249580669285592', time=2024-09-12T20:09:17.632365+0000, chain.objs.size()=1 2024-09-12T18:36:01.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.v-e0tVKl0siHAHP-rQjskFVTDZUSFRv_0 2024-09-12T18:36:01.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17458676020675849332', time=2024-09-12T20:09:19.620626+0000, chain.objs.size()=1 2024-09-12T18:36:01.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.7IKjYPfFaJpehryre-PMgKg7W_A-_j3_0 2024-09-12T18:36:01.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13237729457761044690', time=2024-09-12T20:09:21.623436+0000, chain.objs.size()=1 2024-09-12T18:36:01.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.rKHBNVVKOoOKMH8HtVAxdilDFBySUj2_0 2024-09-12T18:36:01.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5221015673121053237', time=2024-09-12T20:09:22.127578+0000, chain.objs.size()=1 2024-09-12T18:36:01.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Ff8j5j_ggyDfU76gDLeS6lQA8AGWk7i_0 2024-09-12T18:36:01.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14282611752718073176', time=2024-09-12T20:09:22.296986+0000, chain.objs.size()=1 2024-09-12T18:36:01.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.408+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.z3ig-rqK156yl6vrB2cUPHJGjFGTG7e_0 2024-09-12T18:36:01.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.416+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4004315575642256526', time=2024-09-12T20:09:22.629328+0000, chain.objs.size()=1 2024-09-12T18:36:01.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.416+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.J5tdGF1J48CiLMtJEWD2U0gKXV8o9ij_0 2024-09-12T18:36:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51274 2024-09-12T18:36:01.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T18:36:01.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10333725272616569501', time=2024-09-12T20:09:23.509402+0000, chain.objs.size()=1 2024-09-12T18:36:01.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.EssxGPHxv_X0XcwzMJfENDxDdc8zuQ0_0 2024-09-12T18:36:01.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6719251819422610186', time=2024-09-12T20:09:25.317342+0000, chain.objs.size()=1 2024-09-12T18:36:01.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.RhN-F8qbUqDk83K5TVuyLoWxKtaZT3S_0 2024-09-12T18:36:01.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12585288806633348894', time=2024-09-12T20:09:26.358873+0000, chain.objs.size()=1 2024-09-12T18:36:01.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.GP18dGD1T1x6dqpcj4oyIHnder__UpG_0 2024-09-12T18:36:01.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7184437837766306687', time=2024-09-12T20:09:26.836559+0000, chain.objs.size()=1 2024-09-12T18:36:01.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.mmJPhz45TX9hpt4zCp92dpkwIL5rNhQ_0 2024-09-12T18:36:01.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12017702978717869693', time=2024-09-12T20:09:27.206865+0000, chain.objs.size()=1 2024-09-12T18:36:01.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.laY5yYJjLrKACLuXbJGkoNqwz-_eQQl_0 2024-09-12T18:36:01.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16060478034747750669', time=2024-09-12T20:09:30.208996+0000, chain.objs.size()=1 2024-09-12T18:36:01.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.diBiAa66_7M3fLw5ch7wuSwNZuJY6Lz_0 2024-09-12T18:36:01.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18374056038869841154', time=2024-09-12T20:12:18.804055+0000, chain.objs.size()=1 2024-09-12T18:36:01.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.452__shadow_._b5W9vJzJta6Hi3hsMWLVUGSw3fhhKF_0 2024-09-12T18:36:01.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.103428159491273051', time=2024-09-12T20:13:31.544929+0000, chain.objs.size()=1 2024-09-12T18:36:01.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.498__shadow_.oFNreQP0TUDDrdPtmgqqIlsCJbWqkVy_0 2024-09-12T18:36:01.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.594308339999033909', time=2024-09-12T20:15:20.273875+0000, chain.objs.size()=6 2024-09-12T18:36:01.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.-OnIG40KxNE5CWMnG6bgZ_NyBBnfVPA6.1 2024-09-12T18:36:01.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~i5C_z-Jkfvxg4U8NibcfNSg4UEp56c9.2 2024-09-12T18:36:01.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~i5C_z-Jkfvxg4U8NibcfNSg4UEp56c9.3 2024-09-12T18:36:01.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.420+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~i5C_z-Jkfvxg4U8NibcfNSg4UEp56c9.4 2024-09-12T18:36:01.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.424+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~i5C_z-Jkfvxg4U8NibcfNSg4UEp56c9.5 2024-09-12T18:36:01.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.424+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~i5C_z-Jkfvxg4U8NibcfNSg4UEp56c9.6 2024-09-12T18:36:01.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.424+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~WieOGQHMsUqBaS46A3CNqFDdYVyavPb', time=2024-09-12T20:17:09.847461+0000, chain.objs.size()=1 2024-09-12T18:36:01.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.424+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.532__multipart_mymultipart.2~WieOGQHMsUqBaS46A3CNqFDdYVyavPb.1 2024-09-12T18:36:01.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.424+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12467596826724850110', time=2024-09-12T20:19:21.447195+0000, chain.objs.size()=1 2024-09-12T18:36:01.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.424+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:HHNkWk.ijbC0kmZOESmJ9Y7jMVrYhmP_.Z0hCzi7IfWKHE0_Hq6KDwXS_hT4sfl4_0 2024-09-12T18:36:01.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.424+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5152661051527945587', time=2024-09-12T20:19:22.060988+0000, chain.objs.size()=1 2024-09-12T18:36:01.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.424+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:IZGbu0sORlB3cnCLUdhOD.RAxZL6O2F_.qZDZAH4HdHZpz5lORkkoTXQcr9sIoye_0 2024-09-12T18:36:01.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.424+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4419075729968382106', time=2024-09-12T20:20:28.535430+0000, chain.objs.size()=1 2024-09-12T18:36:01.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.424+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:ThQLvvqlCVeYXt--2Pp7PA7pz4rqdqC_.PVmNEjIMdAE9UdAFiYJIMmG5G7oSatC_0 2024-09-12T18:36:01.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.424+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2623209990353237412', time=2024-09-12T20:21:16.813765+0000, chain.objs.size()=1 2024-09-12T18:36:01.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.424+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.584__shadow:2aay.brhkxicl2wNhONo3oVkJOkSB55_.WzaAWNJkiq6TVZEB4sh_0CLkMvNopTQ_0 2024-09-12T18:36:01.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.428+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4396990448758287280', time=2024-09-12T20:21:47.346700+0000, chain.objs.size()=1 2024-09-12T18:36:01.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.428+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.604__shadow_.tzDNKykiXWUutetC2kN4OrSKcKnbiuk_0 2024-09-12T18:36:01.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.428+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12816102640671025118', time=2024-09-12T20:27:58.394527+0000, chain.objs.size()=1 2024-09-12T18:36:01.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.428+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.667__shadow_.JAS3aC08SQIFpLlRMEqeQ0g5JWrrFY5_0 2024-09-12T18:36:01.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.428+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16376057186326262901', time=2024-09-12T20:28:49.476489+0000, chain.objs.size()=1 2024-09-12T18:36:01.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.428+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.705__shadow:1oZpa3ZDXtplPuOmT1NBuuNyXuAlq0V_.UIUr8wWuBC3a8XxCTKJW2m4qU6lwCeT_0 2024-09-12T18:36:01.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.428+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9969555706330279013', time=2024-09-12T20:28:58.646111+0000, chain.objs.size()=1 2024-09-12T18:36:01.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.428+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.711__shadow:cgZ0z98dDFWccwdwXXGa8MTVj.CCVpJ_.kSxnfywnOFdNy68BCG42CRWd0o_wdIQ_0 2024-09-12T18:36:01.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.428+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15295238221498963831', time=2024-09-12T20:29:31.274072+0000, chain.objs.size()=1 2024-09-12T18:36:01.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.428+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.720__shadow_.Qpgl_d0S7m7WRN038xNX5K9ta_rMqnD_0 2024-09-12T18:36:01.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.432+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10760340670981697444', time=2024-09-12T20:35:15.584141+0000, chain.objs.size()=1 2024-09-12T18:36:01.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.432+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.783__shadow_.GJV39NT0kBhzb0vG3-PoWu6IgxRvD07_0 2024-09-12T18:36:01.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.432+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:01.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.436+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:36:01.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.436+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:01.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.436+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:01.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54256' 2024-09-12T18:36:01.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16299188981724254270', time=2024-09-12T19:56:57.106655+0000, chain.objs.size()=1 2024-09-12T18:36:01.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.183__shadow_.MkZ8ne1Nl1a-RJ_1hjMs1h6E4yV0Zq0_0 2024-09-12T18:36:01.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8025098562719205141', time=2024-09-12T19:57:05.347495+0000, chain.objs.size()=1 2024-09-12T18:36:01.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.190__shadow_.i0shEiIXxIQe16ZPVQT1oxeLe6ctXuq_0 2024-09-12T18:36:01.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.186945508683791757', time=2024-09-12T19:57:38.547118+0000, chain.objs.size()=1 2024-09-12T18:36:01.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.205__shadow_.nNaY7qOWB9peGYcmz8q7ohcAoF8e9Io_0 2024-09-12T18:36:01.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4299426189579315365', time=2024-09-12T20:00:16.976765+0000, chain.objs.size()=1 2024-09-12T18:36:01.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.232__shadow_.97I-Eeq-Xc2bOlwtj636RgVqPEjbfG3_0 2024-09-12T18:36:01.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4390811696962053649', time=2024-09-12T20:01:04.755193+0000, chain.objs.size()=1 2024-09-12T18:36:01.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.259__shadow_.jWidXwMJBrp73xL2cOr6yPR6UjPtfR0_0 2024-09-12T18:36:01.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2971207825952224376', time=2024-09-12T20:02:51.926264+0000, chain.objs.size()=1 2024-09-12T18:36:01.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.WT_OBAMIkWpX7rFXw8vmTVrUN9mUAqZ_0 2024-09-12T18:36:01.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3608260008527890662', time=2024-09-12T20:02:52.933477+0000, chain.objs.size()=1 2024-09-12T18:36:01.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.euGf6MKMSYxJr4CulLEhFxl9d3OpXAe_0 2024-09-12T18:36:01.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4985457817307373541', time=2024-09-12T20:02:53.434057+0000, chain.objs.size()=1 2024-09-12T18:36:01.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.u7ddHOwiKAqCrRlX-ZnJk7vObfORsRu_0 2024-09-12T18:36:01.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12529180697219295654', time=2024-09-12T20:02:53.664414+0000, chain.objs.size()=1 2024-09-12T18:36:01.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.8aBR2gVpilgE-7CRcZq9iS51TczaU_l_0 2024-09-12T18:36:01.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18425418352672499938', time=2024-09-12T20:02:54.227480+0000, chain.objs.size()=1 2024-09-12T18:36:01.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.N-2zmTMS7y8qFKEqpcQWhGN_0mg0egM_0 2024-09-12T18:36:01.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.372141513173420362', time=2024-09-12T20:02:54.428585+0000, chain.objs.size()=1 2024-09-12T18:36:01.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.PFPoS9kR_QgB_zbCgABV6KTGVu9DeYZ_0 2024-09-12T18:36:01.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11957133338327436025', time=2024-09-12T20:02:54.769776+0000, chain.objs.size()=1 2024-09-12T18:36:01.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.iZGtfsjs3eT4eQrxS7F8s_nCDBdA2Nb_0 2024-09-12T18:36:01.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2278476275985478553', time=2024-09-12T20:02:58.213029+0000, chain.objs.size()=1 2024-09-12T18:36:01.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.b2buF7Qk4g6tqYpuF3XszgCU_eE6VIG_0 2024-09-12T18:36:01.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4838203636073622864', time=2024-09-12T20:02:58.399563+0000, chain.objs.size()=1 2024-09-12T18:36:01.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.SKfTKUmtwPJ6x_r08wKh_mjOJjjZave_0 2024-09-12T18:36:01.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9993923335989453516', time=2024-09-12T20:02:58.728987+0000, chain.objs.size()=1 2024-09-12T18:36:01.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.1aEzlpWAvbSQqh7YB_WgOdh_wJEjnFq_0 2024-09-12T18:36:01.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2114426538805299223', time=2024-09-12T20:03:00.311627+0000, chain.objs.size()=1 2024-09-12T18:36:01.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.440+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.AJmHNlFSsOHaJs-daug3kjolktRS_rq_0 2024-09-12T18:36:01.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15773417845954359330', time=2024-09-12T20:03:00.669148+0000, chain.objs.size()=1 2024-09-12T18:36:01.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.BHcRwYLNIzCiZD-GFrGhMvTRMfk_mMR_0 2024-09-12T18:36:01.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14235034131436486933', time=2024-09-12T20:03:00.673323+0000, chain.objs.size()=1 2024-09-12T18:36:01.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wAUt2Tm-Lqll03DoJPEgIL0xyaUwxMU_0 2024-09-12T18:36:01.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15598342968150332487', time=2024-09-12T20:03:01.345691+0000, chain.objs.size()=1 2024-09-12T18:36:01.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.x3cNYMaarsXZ8ml_UtC8yhfgtNe6b3i_0 2024-09-12T18:36:01.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9522640488696804428', time=2024-09-12T20:03:01.473782+0000, chain.objs.size()=1 2024-09-12T18:36:01.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2nUR3X4Mq1LElfBWOaeWgGsp6XdFABW_0 2024-09-12T18:36:01.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3555707565006598419', time=2024-09-12T20:03:03.897769+0000, chain.objs.size()=1 2024-09-12T18:36:01.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.oj-WFAD4ikrQxTq51v6fULXc14hnYki_0 2024-09-12T18:36:01.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7113675835952727988', time=2024-09-12T20:03:04.545371+0000, chain.objs.size()=1 2024-09-12T18:36:01.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ELwRlwPMDnd1NgBfekJ2Qp0rANBTOaO_0 2024-09-12T18:36:01.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11056619447855256005', time=2024-09-12T20:03:04.772681+0000, chain.objs.size()=1 2024-09-12T18:36:01.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XEUte4MR_RBLoZtKTJWmPevKSNW_qlD_0 2024-09-12T18:36:01.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17657405673953628722', time=2024-09-12T20:03:05.410250+0000, chain.objs.size()=1 2024-09-12T18:36:01.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.rlPuEXwxl-kIaQAGMmpacf6HTlBTcjd_0 2024-09-12T18:36:01.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18076217719249707268', time=2024-09-12T20:03:05.584661+0000, chain.objs.size()=1 2024-09-12T18:36:01.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.20ZRsZwsB4Kahc7n3izkFxLnAUDCHun_0 2024-09-12T18:36:01.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8096561966098289947', time=2024-09-12T20:03:05.586298+0000, chain.objs.size()=1 2024-09-12T18:36:01.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.1A_sCGOL_UPsRDeMJbaahQ_pymZb6qr_0 2024-09-12T18:36:01.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13790446649674166179', time=2024-09-12T20:03:06.329262+0000, chain.objs.size()=1 2024-09-12T18:36:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.444+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.aJRkn-CkfGtq05l0CryoomE11g0MlWg_0 2024-09-12T18:36:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.448+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.444652935428627740', time=2024-09-12T20:03:06.349447+0000, chain.objs.size()=1 2024-09-12T18:36:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.448+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-vC2qCzVDOXPsaqjt-ao7Ea9mombaFf_0 2024-09-12T18:36:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.448+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.21353883358261215', time=2024-09-12T20:03:09.357188+0000, chain.objs.size()=1 2024-09-12T18:36:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.448+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Z7vBii_EhI3YKHig7BLM0C7Ug0Rbcbd_0 2024-09-12T18:36:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.448+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4550705002850194361', time=2024-09-12T20:03:12.046177+0000, chain.objs.size()=1 2024-09-12T18:36:01.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.448+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2zY3QRUqQL_pHlFSn5tAJd1JRrqcoSC_0 2024-09-12T18:36:01.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.448+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10604616816680808277', time=2024-09-12T20:03:13.214017+0000, chain.objs.size()=1 2024-09-12T18:36:01.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.448+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.J1QPruNswVGImrwmRp2qxhB7ansdljv_0 2024-09-12T18:36:01.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.448+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7796836934185066639', time=2024-09-12T20:03:14.937447+0000, chain.objs.size()=1 2024-09-12T18:36:01.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.448+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.IXJLLdNbgHVDWRVc9An54jB2DWLxlNd_0 2024-09-12T18:36:01.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.448+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9637255701756096186', time=2024-09-12T20:03:15.181398+0000, chain.objs.size()=1 2024-09-12T18:36:01.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.448+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.cR_sjNQlXe7GCcYoM_Eqq9059e_Zemg_0 2024-09-12T18:36:01.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.448+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7696223729025256313', time=2024-09-12T20:03:17.401322+0000, chain.objs.size()=1 2024-09-12T18:36:01.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.448+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._2YppVTf-4v9Yws-iI-L-2ecaBzZ4pR_0 2024-09-12T18:36:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.448+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10764019813855505035', time=2024-09-12T20:03:18.124725+0000, chain.objs.size()=1 2024-09-12T18:36:01.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.448+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.36tafqEdiRC_DwKoWnxnZBmslzFchlV_0 2024-09-12T18:36:01.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16837277634628198418', time=2024-09-12T20:03:19.738712+0000, chain.objs.size()=1 2024-09-12T18:36:01.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.tI_z-S6EPJPH5JzfRmBlvKcC0t_YKyp_0 2024-09-12T18:36:01.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4055497823679431713', time=2024-09-12T20:03:20.102368+0000, chain.objs.size()=1 2024-09-12T18:36:01.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qUIWcJ3rV7XRwM_HxYAFhDMy2oER4Pv_0 2024-09-12T18:36:01.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8988039870453838141', time=2024-09-12T20:03:42.708886+0000, chain.objs.size()=1 2024-09-12T18:36:01.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.277__shadow_.UVGyYY0326SnhiGKV8dBkm46L4v2WRn_0 2024-09-12T18:36:01.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11349898469393335767', time=2024-09-12T20:03:47.688396+0000, chain.objs.size()=1 2024-09-12T18:36:01.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.280__shadow_.MM_FgCwoj7j-tedoWMpNAxvi6OB_8cD_0 2024-09-12T18:36:01.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15003512585823643837', time=2024-09-12T20:04:12.962066+0000, chain.objs.size()=1 2024-09-12T18:36:01.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.VgAa0rmGOEYdRp6C9_lfb_FXjv5rDlQ_0 2024-09-12T18:36:01.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2218302853723641097', time=2024-09-12T20:04:17.958121+0000, chain.objs.size()=1 2024-09-12T18:36:01.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.uBVqwxy6fIjAAwSNl05CO5quLQZ4yio_0 2024-09-12T18:36:01.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3655240412080947640', time=2024-09-12T20:05:02.604559+0000, chain.objs.size()=1 2024-09-12T18:36:01.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.320__shadow:QXYGBogSjDj9RdyywMrW0vR8yD9iA.K_.-NE6ZrjaOTQTYpvn6oCnTxQrpluWSv5_0 2024-09-12T18:36:01.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4101332147043163974', time=2024-09-12T20:06:51.897146+0000, chain.objs.size()=1 2024-09-12T18:36:01.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.dYIMLGLiID7rX6T7nUaUL-ZP4baP4wy_0 2024-09-12T18:36:01.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11121675371312324991', time=2024-09-12T20:06:52.208164+0000, chain.objs.size()=1 2024-09-12T18:36:01.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.P_-pU1AFowd7N2xfdX86pF1MkNm8ZbJ_0 2024-09-12T18:36:01.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15423077933476176594', time=2024-09-12T20:06:53.091310+0000, chain.objs.size()=1 2024-09-12T18:36:01.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.452+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.LRAHneo1DMEkFdVvdqOtXVrVR6A8qeY_0 2024-09-12T18:36:01.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.456+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14793106489394578864', time=2024-09-12T20:06:53.499358+0000, chain.objs.size()=1 2024-09-12T18:36:01.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.456+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.UU2LE2hOeWAbBRqg3q7OLTKimaXxfqI_0 2024-09-12T18:36:01.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.456+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14339357828681717744', time=2024-09-12T20:06:56.054337+0000, chain.objs.size()=1 2024-09-12T18:36:01.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.456+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.XGx-AzYxMrCcNTX-KM2-2MfsNJ9cFcO_0 2024-09-12T18:36:01.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.456+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7062988745685036435', time=2024-09-12T20:06:56.992911+0000, chain.objs.size()=1 2024-09-12T18:36:01.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.456+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.m762aGOWL5EuuFkvREEEEE4pdkNoDlL_0 2024-09-12T18:36:01.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.456+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7996745500786596663', time=2024-09-12T20:06:57.369505+0000, chain.objs.size()=1 2024-09-12T18:36:01.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.456+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ibitfHak5PAXKI_f3ukVIts4M2Fbtja_0 2024-09-12T18:36:01.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.456+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3838243185095295162', time=2024-09-12T20:07:00.539417+0000, chain.objs.size()=1 2024-09-12T18:36:01.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.456+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.43nd4RErVW2QKSrUZRKiEUlBuMqNwAn_0 2024-09-12T18:36:01.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.456+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1545868692054729120', time=2024-09-12T20:07:00.950847+0000, chain.objs.size()=1 2024-09-12T18:36:01.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.456+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.pcLgciz1RJp0aGB7TxyYH2HhdcqU8EL_0 2024-09-12T18:36:01.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.460+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16516451486602550160', time=2024-09-12T20:07:00.980293+0000, chain.objs.size()=1 2024-09-12T18:36:01.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.460+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.76OXrtxQAtK2aIgWoM40YEsbv1Pyr9F_0 2024-09-12T18:36:01.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.460+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13095729192220889605', time=2024-09-12T20:07:01.307555+0000, chain.objs.size()=1 2024-09-12T18:36:01.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.460+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ZYkI8qnIeumktfgZ_97OdUH7le1EKMr_0 2024-09-12T18:36:01.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.460+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9139606569755036029', time=2024-09-12T20:07:01.509752+0000, chain.objs.size()=1 2024-09-12T18:36:01.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.460+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.1AgAPFa3cEfDkyIEWkxelSK4J6Eklfv_0 2024-09-12T18:36:01.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.460+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1533433277145810212', time=2024-09-12T20:07:02.612949+0000, chain.objs.size()=1 2024-09-12T18:36:01.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.460+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.uSL9C3NjAOzhfQsyPCAiZUoFkVKPigg_0 2024-09-12T18:36:01.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.460+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3003546294388278199', time=2024-09-12T20:07:03.442872+0000, chain.objs.size()=1 2024-09-12T18:36:01.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.460+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.wn8n2GyJJTken334wmt_AxZJDCK762W_0 2024-09-12T18:36:01.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.460+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12350368545851698963', time=2024-09-12T20:07:04.192889+0000, chain.objs.size()=1 2024-09-12T18:36:01.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.460+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.2jltr4XQD9Hfknnvw5cpIr7T116mzIu_0 2024-09-12T18:36:01.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.460+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13514125932404345675', time=2024-09-12T20:07:04.625155+0000, chain.objs.size()=1 2024-09-12T18:36:01.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.460+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.bGJCtk6WVOKs8DGAUTwTu8uAsvz1hSJ_0 2024-09-12T18:36:01.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.460+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13223094194927932200', time=2024-09-12T20:07:04.891393+0000, chain.objs.size()=1 2024-09-12T18:36:01.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.460+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.H3g2BhZSntLlqm5vWeOO0-zTmG-pLBR_0 2024-09-12T18:36:01.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.464+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13093805448429971845', time=2024-09-12T20:07:06.134161+0000, chain.objs.size()=1 2024-09-12T18:36:01.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.464+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.68KI_iS4hb7mn19hsN_uhOMq0PKqJmZ_0 2024-09-12T18:36:01.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.464+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7638284798164903429', time=2024-09-12T20:07:06.997981+0000, chain.objs.size()=1 2024-09-12T18:36:01.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.464+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.6_YifLxQc4vW2CNKVDx0pv-A9XyndX3_0 2024-09-12T18:36:01.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.464+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1340489692321413879', time=2024-09-12T20:07:07.372168+0000, chain.objs.size()=1 2024-09-12T18:36:01.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.464+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.2_1Lm6Zujr2XvamMC2S76tnA6LGuDxB_0 2024-09-12T18:36:01.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.464+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10025501331565040561', time=2024-09-12T20:07:07.373967+0000, chain.objs.size()=1 2024-09-12T18:36:01.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.464+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.F07D4skRPUnNfAS26ZJSDYIPH1YZuXq_0 2024-09-12T18:36:01.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.464+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9121623156145469997', time=2024-09-12T20:07:07.509905+0000, chain.objs.size()=1 2024-09-12T18:36:01.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.464+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.n0n1yvlGgGuM7baL2aCWMJwudwch-pG_0 2024-09-12T18:36:01.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.464+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14946709379905431304', time=2024-09-12T20:07:11.338385+0000, chain.objs.size()=1 2024-09-12T18:36:01.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.464+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.xDPyXLVXqz6QUgPoYsCiILUBSiXET9Z_0 2024-09-12T18:36:01.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.464+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16806318078380600378', time=2024-09-12T20:07:11.922583+0000, chain.objs.size()=1 2024-09-12T18:36:01.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.464+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.rwHSNaWMj-aTXUpJcshPa2i-rHdQFU__0 2024-09-12T18:36:01.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.464+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9915432608895084429', time=2024-09-12T20:07:11.977975+0000, chain.objs.size()=1 2024-09-12T18:36:01.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.464+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.NiPemBMnFHOY_s3IEYkJLL1RhtDYHQI_0 2024-09-12T18:36:01.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3206804263759042670', time=2024-09-12T20:07:12.644905+0000, chain.objs.size()=1 2024-09-12T18:36:01.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.P7rCybbKDKVpoLVkZbQTcBfM3sW69sk_0 2024-09-12T18:36:01.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11997658413500883890', time=2024-09-12T20:07:14.180159+0000, chain.objs.size()=1 2024-09-12T18:36:01.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.407GmBKy5fddJH7gRqKVjkT3GBw6C0s_0 2024-09-12T18:36:01.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5861180112138412827', time=2024-09-12T20:07:14.406832+0000, chain.objs.size()=1 2024-09-12T18:36:01.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.iTMjq6A3qDl7LKb2RdjdbOF9zIPTN0g_0 2024-09-12T18:36:01.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12565637966296933370', time=2024-09-12T20:07:14.767976+0000, chain.objs.size()=1 2024-09-12T18:36:01.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.BuPNIl9dGiXtRK4UKnbT5DRbR-_mm4I_0 2024-09-12T18:36:01.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3524173565272791985', time=2024-09-12T20:07:16.048329+0000, chain.objs.size()=1 2024-09-12T18:36:01.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.rEBvhO6aWmnBAnbaozRjGR9tW86vWGx_0 2024-09-12T18:36:01.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3232729758966938705', time=2024-09-12T20:07:16.081688+0000, chain.objs.size()=1 2024-09-12T18:36:01.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.chr1fs4ecW3X-pvod5WAnNUcGUMEFsX_0 2024-09-12T18:36:01.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17821529959464533494', time=2024-09-12T20:07:17.480910+0000, chain.objs.size()=1 2024-09-12T18:36:01.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.z1JuLxbRJz2Z9PmIIhitld3YX61PRQ8_0 2024-09-12T18:36:01.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13780890596930296372', time=2024-09-12T20:07:17.964459+0000, chain.objs.size()=1 2024-09-12T18:36:01.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.gXxG-OcnsGjyrRC87baf78AtfXUfcC__0 2024-09-12T18:36:01.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.98095881506147489', time=2024-09-12T20:09:01.810721+0000, chain.objs.size()=1 2024-09-12T18:36:01.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cp81Zl_oxNiXfHuq-0rfrY0RMOrIdi7_0 2024-09-12T18:36:01.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7982586409671479640', time=2024-09-12T20:09:02.364413+0000, chain.objs.size()=1 2024-09-12T18:36:01.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.NisW1-BsPKb4Jo0xYvbL4EDtVLsfX_C_0 2024-09-12T18:36:01.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18413866239059957596', time=2024-09-12T20:09:02.572978+0000, chain.objs.size()=1 2024-09-12T18:36:01.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.468+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.jpLsnNPi4P_SZ7Vag7fPl92fVJ2mfT0_0 2024-09-12T18:36:01.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16744629197261486781', time=2024-09-12T20:09:02.631860+0000, chain.objs.size()=1 2024-09-12T18:36:01.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.utVwKlkGCS02StWFKjtdGxesmN4VT8u_0 2024-09-12T18:36:01.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10835574421578828751', time=2024-09-12T20:09:03.216583+0000, chain.objs.size()=1 2024-09-12T18:36:01.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.U7XDEjiZKyu6rkcM5t-CDcZzojgEFOA_0 2024-09-12T18:36:01.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9984179613180979233', time=2024-09-12T20:09:03.524247+0000, chain.objs.size()=1 2024-09-12T18:36:01.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vpT1yb2WY69GyiWKFKmItsUmK0x3l2Y_0 2024-09-12T18:36:01.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5003839321665947607', time=2024-09-12T20:09:05.753557+0000, chain.objs.size()=1 2024-09-12T18:36:01.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.90POg-g4bV4o_gBGpfq3JVpcZaRbIH9_0 2024-09-12T18:36:01.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8992503984873280334', time=2024-09-12T20:09:05.755335+0000, chain.objs.size()=1 2024-09-12T18:36:01.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.OSGXFOXIxuv3Z_9d8wZo3zM9pkt1ce6_0 2024-09-12T18:36:01.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5019059134122383503', time=2024-09-12T20:09:06.170330+0000, chain.objs.size()=1 2024-09-12T18:36:01.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.6ReUElaQFFTbSq7KL6Ncx4i1iAQKesG_0 2024-09-12T18:36:01.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10686746801123088192', time=2024-09-12T20:09:06.672961+0000, chain.objs.size()=1 2024-09-12T18:36:01.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.K0fxuz69Y7tZpDtQywyzP7Y55y--IfI_0 2024-09-12T18:36:01.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7039358990739061791', time=2024-09-12T20:09:07.916118+0000, chain.objs.size()=1 2024-09-12T18:36:01.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.096iapImFpM8l_klqBly6reaape9ebx_0 2024-09-12T18:36:01.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13791943122479920541', time=2024-09-12T20:09:08.466158+0000, chain.objs.size()=1 2024-09-12T18:36:01.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.RvSzeXgJsM3_2AGLVfVboC_1Pcnt3fl_0 2024-09-12T18:36:01.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1860097312810789223', time=2024-09-12T20:09:09.482225+0000, chain.objs.size()=1 2024-09-12T18:36:01.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.HhFVbhIdK4ffgfNLzgHaFkJEFiR_8Z4_0 2024-09-12T18:36:01.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1619680861776903987', time=2024-09-12T20:09:10.129310+0000, chain.objs.size()=1 2024-09-12T18:36:01.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.472+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.GDeKbGWPql0-vumb1_rSGz36rnCC_y6_0 2024-09-12T18:36:01.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3285831734969184542', time=2024-09-12T20:09:10.332424+0000, chain.objs.size()=1 2024-09-12T18:36:01.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.0oZt6D8xAioFw4GV1z681i-eSeJXiQx_0 2024-09-12T18:36:01.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5563827782608345524', time=2024-09-12T20:09:11.528535+0000, chain.objs.size()=1 2024-09-12T18:36:01.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.N_hS_cUwgXW239eYghaoQxuXEEujzfY_0 2024-09-12T18:36:01.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9613409049264351736', time=2024-09-12T20:09:11.607745+0000, chain.objs.size()=1 2024-09-12T18:36:01.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.UJ4jal7Tck3iQdwrAXobhepS1CXMUcL_0 2024-09-12T18:36:01.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16585472889906344298', time=2024-09-12T20:09:13.343894+0000, chain.objs.size()=1 2024-09-12T18:36:01.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.DPW5b5_489pr3sBFmPU1AzinvTcxV_M_0 2024-09-12T18:36:01.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1272068453116736910', time=2024-09-12T20:09:13.755257+0000, chain.objs.size()=1 2024-09-12T18:36:01.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vNbF7CZpBmHMddLtenmiRNcNXcMeyup_0 2024-09-12T18:36:01.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8649871646943926389', time=2024-09-12T20:09:14.079323+0000, chain.objs.size()=1 2024-09-12T18:36:01.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.u59brct5Tv2Sac8mrlzOH9_UvqopLKU_0 2024-09-12T18:36:01.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2906381923416193479', time=2024-09-12T20:09:14.196644+0000, chain.objs.size()=1 2024-09-12T18:36:01.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.dPZPPJm0RHvJ7klQQa5hvgILiXPudLB_0 2024-09-12T18:36:01.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17748100124280526194', time=2024-09-12T20:09:14.948433+0000, chain.objs.size()=1 2024-09-12T18:36:01.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.lm4QvoKnlvYx2datRrTEzeTONAwmb-4_0 2024-09-12T18:36:01.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14428359475268946235', time=2024-09-12T20:09:15.091528+0000, chain.objs.size()=1 2024-09-12T18:36:01.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.MtzlC02-sFMZXy5k3b3MId5QBpZA8Ip_0 2024-09-12T18:36:01.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16337721180772201399', time=2024-09-12T20:09:15.570808+0000, chain.objs.size()=1 2024-09-12T18:36:01.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.jQ5Naf4H1oOcwDQvDjU8yguxKIXmQZb_0 2024-09-12T18:36:01.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8282665731914454788', time=2024-09-12T20:09:15.722825+0000, chain.objs.size()=1 2024-09-12T18:36:01.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.476+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.4UfcZVOg0UQ3eHI_sxQ-RrXuuJjjMX4_0 2024-09-12T18:36:01.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.484+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54256 2024-09-12T18:36:01.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=44, truncated=0, next_marker='' 2024-09-12T18:36:01.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5190412685701204476', time=2024-09-12T20:09:16.013876+0000, chain.objs.size()=1 2024-09-12T18:36:01.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.K_3Ve8ZkkS5f2kloeajpNpCDL-5NPoc_0 2024-09-12T18:36:01.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5830577416778625674', time=2024-09-12T20:09:16.977162+0000, chain.objs.size()=1 2024-09-12T18:36:01.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.EQZyU3pxOFTnNEyX_2R6X3UTRPPywCk_0 2024-09-12T18:36:01.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6160078324164690728', time=2024-09-12T20:09:18.070499+0000, chain.objs.size()=1 2024-09-12T18:36:01.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.tEwxmwT9kUHHw4mskyDogsj8xJ8tJqC_0 2024-09-12T18:36:01.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12153076077187167511', time=2024-09-12T20:09:18.670715+0000, chain.objs.size()=1 2024-09-12T18:36:01.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.V9LiLCFNHpX3lxZL3FqnIUciB26WXwG_0 2024-09-12T18:36:01.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17932154055816675380', time=2024-09-12T20:09:19.769307+0000, chain.objs.size()=1 2024-09-12T18:36:01.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.j2RO7RrcTBsGM9bFF_eKuQA-JWsYCYy_0 2024-09-12T18:36:01.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2589113438458710702', time=2024-09-12T20:09:20.649311+0000, chain.objs.size()=1 2024-09-12T18:36:01.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.tyTMv4fduqhMlAX5lZ8R_yeN5Xccrji_0 2024-09-12T18:36:01.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9618525636598978884', time=2024-09-12T20:09:21.516983+0000, chain.objs.size()=1 2024-09-12T18:36:01.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.hhm-mowqvRE9XIwTRzsblzm2KunIR0C_0 2024-09-12T18:36:01.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2366328878832740381', time=2024-09-12T20:09:21.634842+0000, chain.objs.size()=1 2024-09-12T18:36:01.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.eajkt-VJG6auDmN36-tq_xQcEx1-C-Q_0 2024-09-12T18:36:01.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11942376662261212274', time=2024-09-12T20:09:22.564144+0000, chain.objs.size()=1 2024-09-12T18:36:01.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.fWqyGA_RO-YDVv68BH2lcRr2nmJFfBY_0 2024-09-12T18:36:01.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.45852398875061968', time=2024-09-12T20:09:22.628482+0000, chain.objs.size()=1 2024-09-12T18:36:01.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.BrqZz5XOvVaISy_DiklccxeCAGsjB-0_0 2024-09-12T18:36:01.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4012584601299553061', time=2024-09-12T20:09:23.061984+0000, chain.objs.size()=1 2024-09-12T18:36:01.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.QBFXYdbRlHbvf9TFR5oFShARNpxv6Iq_0 2024-09-12T18:36:01.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10955505475654778809', time=2024-09-12T20:09:23.466719+0000, chain.objs.size()=1 2024-09-12T18:36:01.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.488+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.DIUffv_9AR_8pQrOUg6cH1Dtx21XwjT_0 2024-09-12T18:36:01.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16823834653309173293', time=2024-09-12T20:09:24.599420+0000, chain.objs.size()=1 2024-09-12T18:36:01.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.rVUsMfAjbhGflkDs3q4RipXGXO0_0pb_0 2024-09-12T18:36:01.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2704001560170587412', time=2024-09-12T20:09:25.114498+0000, chain.objs.size()=1 2024-09-12T18:36:01.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cEg6QT2y3IVXYl30_KcbWQhGtQxHsd9_0 2024-09-12T18:36:01.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13377937073675435400', time=2024-09-12T20:09:25.116051+0000, chain.objs.size()=1 2024-09-12T18:36:01.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_._8KxEoYL_HD2kHSbdpbNHXY-Ae81O2e_0 2024-09-12T18:36:01.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6156768433256274222', time=2024-09-12T20:09:25.600684+0000, chain.objs.size()=1 2024-09-12T18:36:01.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Tm8xz9ku6fYrOUcCBvO7FlMrnVuDUyf_0 2024-09-12T18:36:01.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5442212151866928316', time=2024-09-12T20:09:25.992369+0000, chain.objs.size()=1 2024-09-12T18:36:01.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.SeHkmYMaZRAkjKMN070L6WEbdlG7tRh_0 2024-09-12T18:36:01.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.915837472298022135', time=2024-09-12T20:09:26.133595+0000, chain.objs.size()=1 2024-09-12T18:36:01.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.I05ov_q3XkXhM1TCMs4zo-WGd-8sfcY_0 2024-09-12T18:36:01.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9419219373007017217', time=2024-09-12T20:09:27.002082+0000, chain.objs.size()=1 2024-09-12T18:36:01.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2ZtqhVdgH21r58rcjC_t0CxQdxP70VU_0 2024-09-12T18:36:01.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10143864420397638628', time=2024-09-12T20:09:28.461609+0000, chain.objs.size()=1 2024-09-12T18:36:01.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.NmlUSNIvfeSUtyp4atIq3mlbSNs7FgA_0 2024-09-12T18:36:01.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4871519777713460338', time=2024-09-12T20:09:28.792609+0000, chain.objs.size()=1 2024-09-12T18:36:01.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5z0NCAuu7YB0SzKIpZ2Jb1rT-B54xv7_0 2024-09-12T18:36:01.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9577333223512193592', time=2024-09-12T20:09:29.265971+0000, chain.objs.size()=1 2024-09-12T18:36:01.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.QJUKQRjRRj91Ky9udsFc1cZUv5B03XD_0 2024-09-12T18:36:01.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4103594321872988169', time=2024-09-12T20:09:29.498850+0000, chain.objs.size()=1 2024-09-12T18:36:01.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.492+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.RBRfio6dBalDnsPD_PEE1rMHx4_RLiN_0 2024-09-12T18:36:01.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13006923219432453921', time=2024-09-12T20:09:29.631597+0000, chain.objs.size()=1 2024-09-12T18:36:01.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.KNBGZW4X8IrBgS8tigUSuXn9fEGSjTr_0 2024-09-12T18:36:01.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11086116899894332689', time=2024-09-12T20:09:30.212763+0000, chain.objs.size()=1 2024-09-12T18:36:01.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.o5jZSS8v2G_JUMHhv9hezAhibHDhVOw_0 2024-09-12T18:36:01.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.287098199551426245', time=2024-09-12T20:09:34.012242+0000, chain.objs.size()=1 2024-09-12T18:36:01.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.328__shadow_.I8MB1Neoo4J5X55z02oevoDy5BYe4K5_0 2024-09-12T18:36:01.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16284225866439466823', time=2024-09-12T20:09:42.246370+0000, chain.objs.size()=1 2024-09-12T18:36:01.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.334__shadow_.Iq8nuRTQpz8OKr3N7T9jrqnSmcBlr1v_0 2024-09-12T18:36:01.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4167699355751906514', time=2024-09-12T20:09:52.692836+0000, chain.objs.size()=1 2024-09-12T18:36:01.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.342__shadow_.ipLcL88mHOvpU0ZCKbAZ9lJaUwY1bQU_0 2024-09-12T18:36:01.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.137167732385463959', time=2024-09-12T20:12:02.335053+0000, chain.objs.size()=1 2024-09-12T18:36:01.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.441__shadow_.pNPWGKIo-cx9_wZ28I1ibkVmAVXFahI_0 2024-09-12T18:36:01.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11066862859659152946', time=2024-09-12T20:12:45.569200+0000, chain.objs.size()=1 2024-09-12T18:36:01.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.466__shadow_.Nnraqr8TRWtACFX-O5YcPszEJEtfAT0_0 2024-09-12T18:36:01.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4190761431838099714', time=2024-09-12T20:13:09.201647+0000, chain.objs.size()=1 2024-09-12T18:36:01.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.485__shadow_.SkOa3tlKB8ahUfLcJD1YGo7iI_YkMwJ_0 2024-09-12T18:36:01.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~70hIeWCywSLhqBYyLIvAXanpTa6e3PI', time=2024-09-12T20:15:20.223604+0000, chain.objs.size()=2 2024-09-12T18:36:01.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~70hIeWCywSLhqBYyLIvAXanpTa6e3PI.2 2024-09-12T18:36:01.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__shadow_mymultipart.2~70hIeWCywSLhqBYyLIvAXanpTa6e3PI.2_1 2024-09-12T18:36:01.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8B821QMXUexFzCv3OGL_qfk5EmkjvRz', time=2024-09-12T20:15:55.507349+0000, chain.objs.size()=2 2024-09-12T18:36:01.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.496+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~8B821QMXUexFzCv3OGL_qfk5EmkjvRz.2 2024-09-12T18:36:01.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__shadow_mymultipart.2~8B821QMXUexFzCv3OGL_qfk5EmkjvRz.2_1 2024-09-12T18:36:01.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8B821QMXUexFzCv3OGL_qfk5EmkjvRz', time=2024-09-12T20:15:55.518616+0000, chain.objs.size()=2 2024-09-12T18:36:01.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~8B821QMXUexFzCv3OGL_qfk5EmkjvRz.3 2024-09-12T18:36:01.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__shadow_mymultipart.2~8B821QMXUexFzCv3OGL_qfk5EmkjvRz.3_1 2024-09-12T18:36:01.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10366702727664946633', time=2024-09-12T20:16:25.029819+0000, chain.objs.size()=2 2024-09-12T18:36:01.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.524__multipart_mymultipart.2~ZJh-HiMUMp_224gBgNO7sitQb1JKmKF.1 2024-09-12T18:36:01.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.524__multipart_mymultipart.2~ZJh-HiMUMp_224gBgNO7sitQb1JKmKF.2 2024-09-12T18:36:01.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6862002458128601590', time=2024-09-12T20:17:00.630171+0000, chain.objs.size()=1 2024-09-12T18:36:01.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.529__shadow_.4KNc1iHToVUhYkuPTDYgSMQSAYTHr_o_0 2024-09-12T18:36:01.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~xVifiRvlGCOqg8yXTQXybQ55DRBpi_m', time=2024-09-12T20:17:10.033166+0000, chain.objs.size()=2 2024-09-12T18:36:01.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.532__multipart_mymultipart2.2~xVifiRvlGCOqg8yXTQXybQ55DRBpi_m.1 2024-09-12T18:36:01.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.532__shadow_mymultipart2.2~xVifiRvlGCOqg8yXTQXybQ55DRBpi_m.1_1 2024-09-12T18:36:01.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13526413577807093653', time=2024-09-12T20:18:18.466215+0000, chain.objs.size()=1 2024-09-12T18:36:01.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.554__shadow_.GnamwmKYoKSHmLjBkR07rX3g0Z4G5fi_0 2024-09-12T18:36:01.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11076450759834740743', time=2024-09-12T20:19:47.575847+0000, chain.objs.size()=1 2024-09-12T18:36:01.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.576__shadow_.teZVyAA0lkhhsiXpKHK4PNlQDAxwr2q_0 2024-09-12T18:36:01.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4198883111046814560', time=2024-09-12T20:20:17.306244+0000, chain.objs.size()=1 2024-09-12T18:36:01.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.500+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:kmqhuHFYB5EZ3VrBHDLocXG00n52U4E_.bJ5F1H9VhQreiEQTlttBwdv4_VCWht9_0 2024-09-12T18:36:01.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.504+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2063966239617964447', time=2024-09-12T20:20:19.066293+0000, chain.objs.size()=1 2024-09-12T18:36:01.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.504+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:-QKegy9C.6BdYGStCrl7vUufL3Z8AJC_.aZ1x2k0l35leUk1VhWBoT08FXVC2qnL_0 2024-09-12T18:36:01.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.504+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17072045452942674885', time=2024-09-12T20:21:27.607597+0000, chain.objs.size()=1 2024-09-12T18:36:01.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.504+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.588__shadow:-AW-ILt1.N6V5Do6JnYsCLMNP7k7EpC_.t63CYpTBQMfHO8o0O7Tw5IlFhC13HL6_0 2024-09-12T18:36:01.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.504+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13736755156880032341', time=2024-09-12T20:25:36.000072+0000, chain.objs.size()=1 2024-09-12T18:36:01.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.504+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.621__shadow_.nmbbFo2OrUvYsxVC06dQ2znhLrtxn1O_0 2024-09-12T18:36:01.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.504+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17890091207108744251', time=2024-09-12T20:27:20.145649+0000, chain.objs.size()=1 2024-09-12T18:36:01.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.504+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.656__shadow_.Oby1lmwugOrnLNPVCLpooL2dHrkaI3z_0 2024-09-12T18:36:01.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.512+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:01.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:36:01.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:01.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:01.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43697' 2024-09-12T18:36:01.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12966225068607480168', time=2024-09-12T20:00:22.132324+0000, chain.objs.size()=1 2024-09-12T18:36:01.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.235__shadow_.V3D0tXlr7JFX32WsGU_yX8cJZdH_G9S_0 2024-09-12T18:36:01.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4074369656078953810', time=2024-09-12T20:00:36.498077+0000, chain.objs.size()=1 2024-09-12T18:36:01.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.243__shadow_.tlrR9HCoWywSzmECGfxc7UHMD5fI6O8_0 2024-09-12T18:36:01.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16910815755375047790', time=2024-09-12T20:00:56.545699+0000, chain.objs.size()=1 2024-09-12T18:36:01.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.254__shadow_.oGTg7oCwU18yg4T_imYoEkj4zW0NpoD_0 2024-09-12T18:36:01.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8568396310834790318', time=2024-09-12T20:02:52.810629+0000, chain.objs.size()=1 2024-09-12T18:36:01.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.eIdRSzBM5JaoVVlRzgU2KCHAWyMcVm3_0 2024-09-12T18:36:01.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12685940673243814579', time=2024-09-12T20:02:52.933394+0000, chain.objs.size()=1 2024-09-12T18:36:01.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.pTRq6YEPeZ2vgtcrZ0lW7CB-8zzFBQk_0 2024-09-12T18:36:01.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14281637891327576794', time=2024-09-12T20:02:53.080871+0000, chain.objs.size()=1 2024-09-12T18:36:01.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.P-WbqqWYnuLfEGARk5b7FEv654GrA-q_0 2024-09-12T18:36:01.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6635533483515194757', time=2024-09-12T20:02:54.124271+0000, chain.objs.size()=1 2024-09-12T18:36:01.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XIpxr_3x_ukCDQu4IamXEaSGH_cj0Gk_0 2024-09-12T18:36:01.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7993628356633872331', time=2024-09-12T20:02:56.344732+0000, chain.objs.size()=1 2024-09-12T18:36:01.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.IJMFImMGyztWDejvGRxAGyoXiF5xDFN_0 2024-09-12T18:36:01.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9477894091210129644', time=2024-09-12T20:02:57.205532+0000, chain.objs.size()=1 2024-09-12T18:36:01.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ynOvv8aLbtPt3njKBaWTXbcMop-sYkA_0 2024-09-12T18:36:01.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6602459513353958446', time=2024-09-12T20:02:57.883315+0000, chain.objs.size()=1 2024-09-12T18:36:01.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.BHSHcIOodq6nm7YN7ySSRD7QRvoRwVi_0 2024-09-12T18:36:01.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12072723263187386747', time=2024-09-12T20:03:00.896338+0000, chain.objs.size()=1 2024-09-12T18:36:01.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.d6Z0SWOK2ruKt9-W7Mdi4ntYkCk0GSY_0 2024-09-12T18:36:01.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.799084089675081020', time=2024-09-12T20:03:01.958834+0000, chain.objs.size()=1 2024-09-12T18:36:01.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.516+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.lCSiXjpMZtGL2Q28dD78sJz59imn1lN_0 2024-09-12T18:36:01.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.520+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6698990826962470590', time=2024-09-12T20:03:04.541837+0000, chain.objs.size()=1 2024-09-12T18:36:01.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.520+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3TwlwPOeWzd3BVn8Fzoh0u2DJQAxM9O_0 2024-09-12T18:36:01.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.520+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8254657427557087283', time=2024-09-12T20:03:04.546113+0000, chain.objs.size()=1 2024-09-12T18:36:01.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.520+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qg08Y7_1YHiJV8U2UymKrzHVoGEPGo-_0 2024-09-12T18:36:01.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9703606376858867885', time=2024-09-12T20:03:04.801341+0000, chain.objs.size()=1 2024-09-12T18:36:01.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.amITSwpQZlKi6uLXRd5mUqWG7aX40l8_0 2024-09-12T18:36:01.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.670925226918028856', time=2024-09-12T20:03:04.940279+0000, chain.objs.size()=1 2024-09-12T18:36:01.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.sJrx9kh71NslBNaybrEgy9OOOiwDkSM_0 2024-09-12T18:36:01.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11220300334652595349', time=2024-09-12T20:03:05.779902+0000, chain.objs.size()=1 2024-09-12T18:36:01.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Gojx4Eakf-5k25W8HXZAby9f9jLvjoW_0 2024-09-12T18:36:01.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15887141500578015931', time=2024-09-12T20:03:05.829265+0000, chain.objs.size()=1 2024-09-12T18:36:01.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.hycXTluQw3hcLFgj6KfXjZzxLXhY0Mf_0 2024-09-12T18:36:01.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11036140361691577476', time=2024-09-12T20:03:05.831030+0000, chain.objs.size()=1 2024-09-12T18:36:01.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.VWgTgmFsDNDCG8ObonvM5nK8faO3Hej_0 2024-09-12T18:36:01.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7651182902783957064', time=2024-09-12T20:03:07.466683+0000, chain.objs.size()=1 2024-09-12T18:36:01.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.NFAfYr4p4YktBjPOmPsv8o8xP9tqtv1_0 2024-09-12T18:36:01.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7539266698359170108', time=2024-09-12T20:03:08.250249+0000, chain.objs.size()=1 2024-09-12T18:36:01.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.fjo5bC7XN4CvbK0d90h7C11ssv5fkct_0 2024-09-12T18:36:01.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6524992194780520551', time=2024-09-12T20:03:08.733056+0000, chain.objs.size()=1 2024-09-12T18:36:01.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Vu1mKdwpOYWUvnFnCT183ilvbiKFbif_0 2024-09-12T18:36:01.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1235013508892990246', time=2024-09-12T20:03:08.887179+0000, chain.objs.size()=1 2024-09-12T18:36:01.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.524+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.OCrvPfDNarPG38mhVFinm3auF6wZf4T_0 2024-09-12T18:36:01.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17525125162969391987', time=2024-09-12T20:03:08.890384+0000, chain.objs.size()=1 2024-09-12T18:36:01.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.fihk6aK9jR-VXukxGQzxRCuujeIvJxD_0 2024-09-12T18:36:01.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7394366132524549172', time=2024-09-12T20:03:08.984962+0000, chain.objs.size()=1 2024-09-12T18:36:01.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.edOdrmVZJKpqNiT1bOoBX6ikIhu7GA1_0 2024-09-12T18:36:01.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4815680752253702063', time=2024-09-12T20:03:09.259067+0000, chain.objs.size()=1 2024-09-12T18:36:01.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.fqlYWDyO42mU7pt4x22R9fMLYao1Yq9_0 2024-09-12T18:36:01.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5042170368641446326', time=2024-09-12T20:03:09.868840+0000, chain.objs.size()=1 2024-09-12T18:36:01.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.xN-8tH8vG3YvGCz5QCWI3WRbkVvCi3a_0 2024-09-12T18:36:01.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4073539883378868722', time=2024-09-12T20:03:09.969027+0000, chain.objs.size()=1 2024-09-12T18:36:01.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.MkhvOXKN3dl8WYRuhiT8d8XHMYkMML0_0 2024-09-12T18:36:01.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16370475057400916248', time=2024-09-12T20:03:11.002901+0000, chain.objs.size()=1 2024-09-12T18:36:01.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.PaK3HgrlUP-vgcTi81sn3C-XLOZQshP_0 2024-09-12T18:36:01.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8719715613788801700', time=2024-09-12T20:03:11.464542+0000, chain.objs.size()=1 2024-09-12T18:36:01.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wP9YOTT0IvefsQCsHLz1PMBnRrziuIO_0 2024-09-12T18:36:01.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8067690894843877462', time=2024-09-12T20:03:12.078089+0000, chain.objs.size()=1 2024-09-12T18:36:01.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.T9Uz8vnjkCF8dDaPUUPxlzXsnJt1i9N_0 2024-09-12T18:36:01.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10987974222205813877', time=2024-09-12T20:03:12.242771+0000, chain.objs.size()=1 2024-09-12T18:36:01.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-jCzcFuSzVnnWttuxCQUQA543MbMID0_0 2024-09-12T18:36:01.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14474035877891849429', time=2024-09-12T20:03:12.536498+0000, chain.objs.size()=1 2024-09-12T18:36:01.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.OncgA_oqYNvXulxTfCERIa9OnInsUla_0 2024-09-12T18:36:01.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17589760210697646609', time=2024-09-12T20:03:15.210098+0000, chain.objs.size()=1 2024-09-12T18:36:01.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.528+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.TTLx9SQfJfXLt5PQtWU1LsvhfgQ7sBe_0 2024-09-12T18:36:01.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.863194004822529034', time=2024-09-12T20:03:18.342058+0000, chain.objs.size()=1 2024-09-12T18:36:01.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Ollvio80ofWMawpLgeRIO9uky0p7HoB_0 2024-09-12T18:36:01.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2365668485935901568', time=2024-09-12T20:03:18.926617+0000, chain.objs.size()=1 2024-09-12T18:36:01.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Pg_-1t_ddidKrcHQ-9F9u9XBUseoCS4_0 2024-09-12T18:36:01.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18432568502676210360', time=2024-09-12T20:03:19.328409+0000, chain.objs.size()=1 2024-09-12T18:36:01.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.456RCZ8BySG8vuX2IHlSxe6XBkh16Ry_0 2024-09-12T18:36:01.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8354172065975095517', time=2024-09-12T20:03:19.698352+0000, chain.objs.size()=1 2024-09-12T18:36:01.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QgX6TFs4S0zs2hUEbM3DHO6BHxhIJRH_0 2024-09-12T18:36:01.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12486192550696129091', time=2024-09-12T20:03:19.983046+0000, chain.objs.size()=1 2024-09-12T18:36:01.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.zevaouvimGyv5vtDiTE4EKTXCZ2vwfx_0 2024-09-12T18:36:01.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4533411877491273355', time=2024-09-12T20:03:19.986760+0000, chain.objs.size()=1 2024-09-12T18:36:01.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.j2naOxXS1uY98Yoap0i16J4P1nLP1xD_0 2024-09-12T18:36:01.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15698932069765041535', time=2024-09-12T20:04:17.965944+0000, chain.objs.size()=1 2024-09-12T18:36:01.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.WVJfEioLzaVOXFTn6cQVmfD8ObOf81x_0 2024-09-12T18:36:01.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.468828950064865606', time=2024-09-12T20:06:51.272808+0000, chain.objs.size()=1 2024-09-12T18:36:01.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.RQql2IN-HWAc7ibMga3XOUPoJDJRWNN_0 2024-09-12T18:36:01.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8899407228869482252', time=2024-09-12T20:06:52.078027+0000, chain.objs.size()=1 2024-09-12T18:36:01.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.aeGamVFVE-FtL9mAyheaiHPUJ8c34Aa_0 2024-09-12T18:36:01.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6266600550768820173', time=2024-09-12T20:06:55.037586+0000, chain.objs.size()=1 2024-09-12T18:36:01.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.bae6dRnTY9tJVMX5FGyOqRVB1fKr4CL_0 2024-09-12T18:36:01.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.532+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2238550654088514720', time=2024-09-12T20:06:56.930781+0000, chain.objs.size()=1 2024-09-12T18:36:01.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.V1yGBAWimcUbEEVfoVaYnclSNSbIOJJ_0 2024-09-12T18:36:01.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17399637558845974153', time=2024-09-12T20:06:57.142292+0000, chain.objs.size()=1 2024-09-12T18:36:01.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ugdApUXEzq8GC3gZJUig4SgchJZvFGu_0 2024-09-12T18:36:01.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7975382434716398420', time=2024-09-12T20:06:57.245846+0000, chain.objs.size()=1 2024-09-12T18:36:01.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Bi2d6bEE2Mm9Pw3yhNpJtrV1c3FOby8_0 2024-09-12T18:36:01.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13090674055611741858', time=2024-09-12T20:06:59.840719+0000, chain.objs.size()=1 2024-09-12T18:36:01.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.QuoQtRDvztVNf8a7j1dXipGdT5jLeT0_0 2024-09-12T18:36:01.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3467034428006200309', time=2024-09-12T20:07:00.194903+0000, chain.objs.size()=1 2024-09-12T18:36:01.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.HuqiYbcAJuEDkq9mEUuyiH-HhTRkB9T_0 2024-09-12T18:36:01.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2372832100767452300', time=2024-09-12T20:07:02.618709+0000, chain.objs.size()=1 2024-09-12T18:36:01.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.NC0w_s7ZMH1Cjf7rc9kjGNocKYiDcKB_0 2024-09-12T18:36:01.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.908784846732400608', time=2024-09-12T20:07:02.626027+0000, chain.objs.size()=1 2024-09-12T18:36:01.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.3ezuNJicL9ZE9n6wB_1Nxx6O7cy_SDI_0 2024-09-12T18:36:01.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.445006489165724201', time=2024-09-12T20:07:04.509983+0000, chain.objs.size()=1 2024-09-12T18:36:01.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.LCjXALj-uhXlRoVtH76VttXl3PRs3D-_0 2024-09-12T18:36:01.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2533368778463858153', time=2024-09-12T20:07:06.271788+0000, chain.objs.size()=1 2024-09-12T18:36:01.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.536+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.p4Y4SMzvPZZbUHL1PDbyAfQ8PuixbtP_0 2024-09-12T18:36:01.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.540+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12595391220000003214', time=2024-09-12T20:07:06.273988+0000, chain.objs.size()=1 2024-09-12T18:36:01.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.540+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.x47ExCiDykevZuU7yxbI23oiLSwg6Nn_0 2024-09-12T18:36:01.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.540+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8715344537678985279', time=2024-09-12T20:07:07.007675+0000, chain.objs.size()=1 2024-09-12T18:36:01.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.540+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.QRpLkQYaQ4fCxY6703G2JyFSo7aKtWp_0 2024-09-12T18:36:01.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.540+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17355114971709027382', time=2024-09-12T20:07:09.014638+0000, chain.objs.size()=1 2024-09-12T18:36:01.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.540+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.adhdzktXQSSKkWmGA_BhKLx0_cGVb2t_0 2024-09-12T18:36:01.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.540+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.262230595279252029', time=2024-09-12T20:07:09.046914+0000, chain.objs.size()=1 2024-09-12T18:36:01.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.540+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.QuiWQrvub5Lvnkls-shUp322LqtXO4U_0 2024-09-12T18:36:01.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.540+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16314343864504493711', time=2024-09-12T20:07:10.133740+0000, chain.objs.size()=1 2024-09-12T18:36:01.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.540+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.mV25Btnyu0LyS_vdzuZKRA_BcXpdQDT_0 2024-09-12T18:36:01.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.540+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4439324928356033826', time=2024-09-12T20:07:11.046070+0000, chain.objs.size()=1 2024-09-12T18:36:01.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.540+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Jkz3qoI-yrkgCjn7qww7S9IfxssE-c5_0 2024-09-12T18:36:01.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.540+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16055027199705099530', time=2024-09-12T20:07:11.048723+0000, chain.objs.size()=1 2024-09-12T18:36:01.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.540+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.laJzM0eqlZ3GHu9Mzlej5HYJWe5dqxm_0 2024-09-12T18:36:01.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1394421872671319051', time=2024-09-12T20:07:12.030065+0000, chain.objs.size()=1 2024-09-12T18:36:01.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7OzAHzUpoJw6oo7RkFNsGno2lX06loj_0 2024-09-12T18:36:01.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10980483085637657950', time=2024-09-12T20:07:13.353233+0000, chain.objs.size()=1 2024-09-12T18:36:01.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.U8wE6kPT7u2YTZSFnHLZrdQ2R81E6tY_0 2024-09-12T18:36:01.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17992831816412433045', time=2024-09-12T20:07:14.120462+0000, chain.objs.size()=1 2024-09-12T18:36:01.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.hu7APYmFU0wC81yu_a8hnvLzwnE-nUy_0 2024-09-12T18:36:01.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3777041986296588306', time=2024-09-12T20:07:14.664366+0000, chain.objs.size()=1 2024-09-12T18:36:01.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Xal_rkxrIEvg-xq9Ph3o1rbNPS4R7zf_0 2024-09-12T18:36:01.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9680570545375710798', time=2024-09-12T20:07:15.105256+0000, chain.objs.size()=1 2024-09-12T18:36:01.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.vMjbq1Nf7iZ9-vGRivTUyY3kJBhmRQC_0 2024-09-12T18:36:01.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12773055706322940874', time=2024-09-12T20:07:15.353327+0000, chain.objs.size()=1 2024-09-12T18:36:01.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.HPe_XZSUt-rapj52C-xPYv4dVMjQDRx_0 2024-09-12T18:36:01.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5235790577171122052', time=2024-09-12T20:07:15.743572+0000, chain.objs.size()=1 2024-09-12T18:36:01.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.dZkiAoqcAWkzMnjNKbJMOZ6VLgsqv5J_0 2024-09-12T18:36:01.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1696377528337727884', time=2024-09-12T20:07:16.009739+0000, chain.objs.size()=1 2024-09-12T18:36:01.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.JiKrAaBmz1Mfa-yNQ2MRG9lY0Z5-7kX_0 2024-09-12T18:36:01.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2200638041133798498', time=2024-09-12T20:07:17.013965+0000, chain.objs.size()=1 2024-09-12T18:36:01.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.I9wdiwWBteSXSQw9Pm60HVAkKRNwvdf_0 2024-09-12T18:36:01.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8068238045746828679', time=2024-09-12T20:07:17.939860+0000, chain.objs.size()=1 2024-09-12T18:36:01.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.XNwKCrtoy7omWkYqbsb84Ub94S5tYvk_0 2024-09-12T18:36:01.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6392256957017845619', time=2024-09-12T20:07:18.020268+0000, chain.objs.size()=1 2024-09-12T18:36:01.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.BI7BttK2rXz5_h6lGyJXTiPfj_XJ40o_0 2024-09-12T18:36:01.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14477988749763431824', time=2024-09-12T20:07:18.142333+0000, chain.objs.size()=1 2024-09-12T18:36:01.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.2uq25xUMAnn8Dy_ZVvMA7dGWk1bDIMV_0 2024-09-12T18:36:01.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2809330818060501338', time=2024-09-12T20:09:02.191525+0000, chain.objs.size()=1 2024-09-12T18:36:01.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.uh6NsE5WnyubCOwVIrKV3CtavA2Xqge_0 2024-09-12T18:36:01.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6928389986486647222', time=2024-09-12T20:09:02.808018+0000, chain.objs.size()=1 2024-09-12T18:36:01.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.544+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.RAMOm5T7RQlUmI4mL4uUlclfhrB9iKl_0 2024-09-12T18:36:01.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.548+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16789892270472184259', time=2024-09-12T20:09:03.990337+0000, chain.objs.size()=1 2024-09-12T18:36:01.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.548+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.1ZM0voBxd6lSi8eUt_9MxN-yYIbwway_0 2024-09-12T18:36:01.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.548+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15021971769568603819', time=2024-09-12T20:09:04.607644+0000, chain.objs.size()=1 2024-09-12T18:36:01.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.548+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vQBdJOPdVGGAcjklUVftkJ6jqEC1_Ne_0 2024-09-12T18:36:01.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.548+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.844168986920676735', time=2024-09-12T20:09:04.609608+0000, chain.objs.size()=1 2024-09-12T18:36:01.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.548+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2URRklkI8MRmi3w1avx7lE6ceqrpVZE_0 2024-09-12T18:36:01.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.548+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2268785912120776767', time=2024-09-12T20:09:06.674974+0000, chain.objs.size()=1 2024-09-12T18:36:01.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.548+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.CSt3KfSZBbxgL-NVKBelvwxKCWkSSZV_0 2024-09-12T18:36:01.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16226049104198928289', time=2024-09-12T20:09:07.159649+0000, chain.objs.size()=1 2024-09-12T18:36:01.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Mxe_q1X2v18u8J2STX1nJfY3iRixTJY_0 2024-09-12T18:36:01.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13297819685855332926', time=2024-09-12T20:09:08.308888+0000, chain.objs.size()=1 2024-09-12T18:36:01.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Q6LqR94iYToiNNlF-1gCW3sbQgZ17Dd_0 2024-09-12T18:36:01.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15657353585489317262', time=2024-09-12T20:09:08.505292+0000, chain.objs.size()=1 2024-09-12T18:36:01.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.wIzr42S_pLkEQB6FvbQRcWpENP8aLMH_0 2024-09-12T18:36:01.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.129698575484444487', time=2024-09-12T20:09:10.519446+0000, chain.objs.size()=1 2024-09-12T18:36:01.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cwhD-4R56KO0Kjt-R6fQWuVml3m1X8w_0 2024-09-12T18:36:01.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.390841794646755007', time=2024-09-12T20:09:11.130869+0000, chain.objs.size()=1 2024-09-12T18:36:01.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.dTEwjqGoUQvgoYktsYmuRlYNneF6rgC_0 2024-09-12T18:36:01.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17032117131637641631', time=2024-09-12T20:09:12.204428+0000, chain.objs.size()=1 2024-09-12T18:36:01.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.gpuVqr3C8aTYZZrTyAie7MYW5hFrX2L_0 2024-09-12T18:36:01.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17351456599459601207', time=2024-09-12T20:09:13.247588+0000, chain.objs.size()=1 2024-09-12T18:36:01.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.kx96jWO2NPGuqc6apRB6hETTroR4Cik_0 2024-09-12T18:36:01.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4746766262259960530', time=2024-09-12T20:09:13.473256+0000, chain.objs.size()=1 2024-09-12T18:36:01.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.IXLWvG2lfydktw2S9zL7PVfrXcdp7XN_0 2024-09-12T18:36:01.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13224611236493042202', time=2024-09-12T20:09:17.435231+0000, chain.objs.size()=1 2024-09-12T18:36:01.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.YkgbQp5UFValB3PD5nL7zkFS8Hdk6DZ_0 2024-09-12T18:36:01.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7002868695251957388', time=2024-09-12T20:09:18.011326+0000, chain.objs.size()=1 2024-09-12T18:36:01.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.AgRK2u7byloqUkURX_PE7tb6zvO9MJO_0 2024-09-12T18:36:01.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5382056440041326751', time=2024-09-12T20:09:18.329927+0000, chain.objs.size()=1 2024-09-12T18:36:01.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.yxLhc1e9yzR4iZupMgEZKn3tadbAN3t_0 2024-09-12T18:36:01.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6119278310950713020', time=2024-09-12T20:09:19.200408+0000, chain.objs.size()=1 2024-09-12T18:36:01.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FgubMHBbyC8WKWTqZzQNukX5IpUU0T-_0 2024-09-12T18:36:01.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16798353123754962278', time=2024-09-12T20:09:22.077824+0000, chain.objs.size()=1 2024-09-12T18:36:01.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.R4Z80h8p5YhgW0YP0z9ZxBLr1qQjtIg_0 2024-09-12T18:36:01.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5294291407967537357', time=2024-09-12T20:09:24.999693+0000, chain.objs.size()=1 2024-09-12T18:36:01.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.552+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.UnwOo-4xxj15mb4YT8E23d41YCbJRVg_0 2024-09-12T18:36:01.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.556+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17370135019378324312', time=2024-09-12T20:09:25.302933+0000, chain.objs.size()=1 2024-09-12T18:36:01.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.556+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_._dL_dYWgd4rTWV6PwsXXt_SO5IyxPav_0 2024-09-12T18:36:01.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.556+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3824987090003192362', time=2024-09-12T20:09:26.251183+0000, chain.objs.size()=1 2024-09-12T18:36:01.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.556+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2BrKM_XQJSxZlW_MU4hOfa9tPfsFOF6_0 2024-09-12T18:36:01.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.556+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10974261222769830344', time=2024-09-12T20:09:27.174791+0000, chain.objs.size()=1 2024-09-12T18:36:01.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.556+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.pPpUK5KvAh1QpxxDc1HunM_qKIdFwAH_0 2024-09-12T18:36:01.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.560+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6841151989679065794', time=2024-09-12T20:09:27.936680+0000, chain.objs.size()=1 2024-09-12T18:36:01.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.560+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.hJlEDc7TAZzOiZy2O84KhItfBHaMOUF_0 2024-09-12T18:36:01.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.560+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3975848146425506274', time=2024-09-12T20:09:28.879272+0000, chain.objs.size()=1 2024-09-12T18:36:01.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.560+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.A8ErZps_K5WwJVoY3tajetQ3AzpFVYT_0 2024-09-12T18:36:01.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.560+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2385679133530732689', time=2024-09-12T20:10:32.236248+0000, chain.objs.size()=1 2024-09-12T18:36:01.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.560+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.375__shadow_.8JzPSameH4KqmVHNWWHjwmPSg9dKuJp_0 2024-09-12T18:36:01.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.560+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18297920144807341853', time=2024-09-12T20:12:43.332031+0000, chain.objs.size()=1 2024-09-12T18:36:01.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.560+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.465__shadow_.CD7t0J9Fexiq7noXd_Bdwfv74GSXR8I_0 2024-09-12T18:36:01.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.560+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8477027781590650258', time=2024-09-12T20:13:34.402236+0000, chain.objs.size()=1 2024-09-12T18:36:01.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.560+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.500__shadow_.gpKv18PuD4gHOpKKrZppOayzi46ioVj_0 2024-09-12T18:36:01.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.564+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43697 2024-09-12T18:36:01.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:36:01.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3207923553880233018', time=2024-09-12T20:16:57.137185+0000, chain.objs.size()=4 2024-09-12T18:36:01.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.528__multipart_mymultipart.2~O-S5BFrDpU4reif-sYX3f1s3dOIjx2f.1 2024-09-12T18:36:01.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.528__multipart_mymultipart.2~O-S5BFrDpU4reif-sYX3f1s3dOIjx2f.2 2024-09-12T18:36:01.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.528__multipart_mymultipart.2~O-S5BFrDpU4reif-sYX3f1s3dOIjx2f.3 2024-09-12T18:36:01.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.528__multipart_mymultipart.2~O-S5BFrDpU4reif-sYX3f1s3dOIjx2f.4 2024-09-12T18:36:01.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3967003244899199194', time=2024-09-12T20:17:01.266982+0000, chain.objs.size()=2 2024-09-12T18:36:01.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.529__multipart_mymultipart.2~HMbiofgUwNIPtS_7H7HjlzH0VO1lFxF.1 2024-09-12T18:36:01.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.529__multipart_mymultipart.2~HMbiofgUwNIPtS_7H7HjlzH0VO1lFxF.2 2024-09-12T18:36:01.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~KS7m6GJPNzn6b4ue_fQpl4aqtlexRY5', time=2024-09-12T20:17:09.943042+0000, chain.objs.size()=2 2024-09-12T18:36:01.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.532__multipart_mymultipart.2~KS7m6GJPNzn6b4ue_fQpl4aqtlexRY5.1 2024-09-12T18:36:01.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.532__multipart_mymultipart.2~KS7m6GJPNzn6b4ue_fQpl4aqtlexRY5.2 2024-09-12T18:36:01.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1815704237131161976', time=2024-09-12T20:18:11.234263+0000, chain.objs.size()=1 2024-09-12T18:36:01.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.552__shadow_.ZwN7vVWo0Dqyb560lxzxuR1VWjPunsD_0 2024-09-12T18:36:01.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.322753211852283162', time=2024-09-12T20:18:57.379642+0000, chain.objs.size()=1 2024-09-12T18:36:01.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.565__shadow_.RY6lPY09AgoJ3MMRlCJVkwkFrGQTU0S_0 2024-09-12T18:36:01.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10384385035940996629', time=2024-09-12T20:19:08.717351+0000, chain.objs.size()=1 2024-09-12T18:36:01.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:mybYP9wMx-FCrarkUSUSix9sdZYUmWn_.qTA4R0d-5-3qvO4TeVjo-w3-yOBYoMB_0 2024-09-12T18:36:01.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2165713960677160085', time=2024-09-12T20:19:15.063093+0000, chain.objs.size()=1 2024-09-12T18:36:01.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.568+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:syrvl56lPzmqkRCrVY23HKbr6IsXHaQ_.qv0th0lXAXihvzRV2wyHm9tIoe_xFt3_0 2024-09-12T18:36:01.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.572+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7580066325023066276', time=2024-09-12T20:19:19.922233+0000, chain.objs.size()=1 2024-09-12T18:36:01.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.572+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:PeiGxgePoUJQ7nU.73D8SS2lgTpSK.._.cZlGjZGNCOQ9ErF9C39MglFD6IrB4Ym_0 2024-09-12T18:36:01.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.572+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10348001037431314820', time=2024-09-12T20:19:24.494264+0000, chain.objs.size()=1 2024-09-12T18:36:01.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.572+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:u1mEYpOyQW0psI432UvaWeJQNGU3KGU_.08_ZA4TECV35xE_DyZpMjaEYwvbTTf2_0 2024-09-12T18:36:01.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.572+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9293460902503962040', time=2024-09-12T20:19:40.590897+0000, chain.objs.size()=1 2024-09-12T18:36:01.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.572+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.575__shadow:t3uloYrvAzLiNRqC5jb8DuBIqkIqvfN_.NhaR5NtPltAv6p6ZZ7-_cPvu2-o82Xv_0 2024-09-12T18:36:01.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.572+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11398619022628582629', time=2024-09-12T20:19:44.164991+0000, chain.objs.size()=1 2024-09-12T18:36:01.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.572+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.575__shadow:DOjZOOVpQnKqx.m1WhXXnYZI8W4CzYY_.6gOXvmRMMTPlnlBWITbcXTb_HuF8N1d_0 2024-09-12T18:36:01.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.572+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16194985662616916374', time=2024-09-12T20:21:24.000802+0000, chain.objs.size()=1 2024-09-12T18:36:01.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.572+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.587__shadow:HKo7PEXDeI51qOia5s.iowdu1UmSUIB_.6B2gFixNaYjXAVRRiMDTyd12QUn9jhU_0 2024-09-12T18:36:01.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.572+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11275334496270039689', time=2024-09-12T20:28:41.104602+0000, chain.objs.size()=1 2024-09-12T18:36:01.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.572+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.700__shadow:eBNeW2T7L9LiyGi1WrCD6VXJWK3RTxS_.6bx7MGN1AUyPXlB6NjcqIsSPaSgqEFg_0 2024-09-12T18:36:01.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.572+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11548628464123703990', time=2024-09-12T20:28:45.940516+0000, chain.objs.size()=1 2024-09-12T18:36:01.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.572+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.703__multipart_file1.2~965e1iMspyuEFmSoz_Jq_eHEDhWCQTk.1 2024-09-12T18:36:01.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.576+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:01.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.580+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:36:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.580+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:01.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.580+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44020' 2024-09-12T18:36:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14733741476498320052', time=2024-09-12T20:00:20.379341+0000, chain.objs.size()=1 2024-09-12T18:36:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.234__shadow_.7gVoaCPSf3sF5ikhY5b8csYHLEmR3zf_0 2024-09-12T18:36:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11357476663482372667', time=2024-09-12T20:00:30.532967+0000, chain.objs.size()=1 2024-09-12T18:36:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.239__shadow_.5heT6ABUPTgxpth_NwAxsHWh-IzoI3Y_0 2024-09-12T18:36:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8232609626672415472', time=2024-09-12T20:00:31.817068+0000, chain.objs.size()=1 2024-09-12T18:36:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.240__shadow_.4Vk9KC3mo3I97V71c-KwWv8cltgUT34_0 2024-09-12T18:36:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5825142483976829000', time=2024-09-12T20:00:41.462609+0000, chain.objs.size()=1 2024-09-12T18:36:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.245__shadow_.colhJCzcQFMbH4LFAEes4pPfTkiWA5o_0 2024-09-12T18:36:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17860862108873774900', time=2024-09-12T20:01:06.298292+0000, chain.objs.size()=1 2024-09-12T18:36:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.260__shadow_.oT1n6oLCLVEBS9ml_i1FqMVmFmrL4x8_0 2024-09-12T18:36:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10155093644432052896', time=2024-09-12T20:02:53.496050+0000, chain.objs.size()=1 2024-09-12T18:36:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.aP-mwrZdKfg9HNWsvviDRRkTLguW8da_0 2024-09-12T18:36:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16716183103461753890', time=2024-09-12T20:02:54.394271+0000, chain.objs.size()=1 2024-09-12T18:36:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Td3FOnFb7XohD2DIHKUrsOX9B8T0Iqy_0 2024-09-12T18:36:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5095468198832523022', time=2024-09-12T20:02:56.323792+0000, chain.objs.size()=1 2024-09-12T18:36:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3vALxXrabw26a8Ahs5PiKVVvS8O0-rd_0 2024-09-12T18:36:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10918994740258362752', time=2024-09-12T20:02:57.811917+0000, chain.objs.size()=1 2024-09-12T18:36:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wMvUPjhrxZIX4dYF4LwctbtMwiWfbyx_0 2024-09-12T18:36:01.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14546395254967483954', time=2024-09-12T20:02:57.927018+0000, chain.objs.size()=1 2024-09-12T18:36:01.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.SUtEPJBJL_NCEk9ydbZh0znjo44ITUS_0 2024-09-12T18:36:01.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6205633212621961370', time=2024-09-12T20:02:58.429413+0000, chain.objs.size()=1 2024-09-12T18:36:01.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.8rqjAEC7uUTGPAzS1xVwCSZiPQSvUfC_0 2024-09-12T18:36:01.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5346608745286718807', time=2024-09-12T20:02:58.545156+0000, chain.objs.size()=1 2024-09-12T18:36:01.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.584+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.WGndscOvsLuW6GKb1m4MEnUiIP9aIMc_0 2024-09-12T18:36:01.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6680682180851765455', time=2024-09-12T20:02:58.630032+0000, chain.objs.size()=1 2024-09-12T18:36:01.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-NbugZHLTSagxx_Tp3bvRfK1XMbpB9__0 2024-09-12T18:36:01.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13051748041488188618', time=2024-09-12T20:02:59.775278+0000, chain.objs.size()=1 2024-09-12T18:36:01.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.bQHjWMlKG98Ds7vW-13vN-yQ8wys_EO_0 2024-09-12T18:36:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16639584798864178752', time=2024-09-12T20:03:01.134290+0000, chain.objs.size()=1 2024-09-12T18:36:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ULt5G1AZl1UjLyQsrYl4BbIRJCruH9O_0 2024-09-12T18:36:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13500500001226711768', time=2024-09-12T20:03:04.747083+0000, chain.objs.size()=1 2024-09-12T18:36:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.vjOtPBNSkXVrjN9U702l20C0JTXtioz_0 2024-09-12T18:36:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11853865247077428235', time=2024-09-12T20:03:05.938684+0000, chain.objs.size()=1 2024-09-12T18:36:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.y3iE6SDncL-GaurDWu0V9-K8kBiZGAq_0 2024-09-12T18:36:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2857537276867270012', time=2024-09-12T20:03:06.402672+0000, chain.objs.size()=1 2024-09-12T18:36:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.d2kitdBSz_2WcXnOlcl5Iw0NPr6dr7u_0 2024-09-12T18:36:01.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17011203253942230104', time=2024-09-12T20:03:07.443537+0000, chain.objs.size()=1 2024-09-12T18:36:01.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.OOWGEbF55mH9N0n2stiI4vw_3pi4zUx_0 2024-09-12T18:36:01.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17435615739900034840', time=2024-09-12T20:03:08.579653+0000, chain.objs.size()=1 2024-09-12T18:36:01.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.JIwhX8n3oyK-VSSf1FFMtruy8vO4PGG_0 2024-09-12T18:36:01.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.560753993313931963', time=2024-09-12T20:03:09.679453+0000, chain.objs.size()=1 2024-09-12T18:36:01.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qQ_LZ1F6djbp4V05UkX5lJtBQVRJhJm_0 2024-09-12T18:36:01.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10295019954967087424', time=2024-09-12T20:03:11.035670+0000, chain.objs.size()=1 2024-09-12T18:36:01.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.CG52P6CDGWGPXFzfmPZFPkScGuyUyt3_0 2024-09-12T18:36:01.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11944417618774355227', time=2024-09-12T20:03:11.115418+0000, chain.objs.size()=1 2024-09-12T18:36:01.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.588+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.25yT0uSuV2OlJAjvWtRDkC-REPC9vi2_0 2024-09-12T18:36:01.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14849638725853115504', time=2024-09-12T20:03:13.765489+0000, chain.objs.size()=1 2024-09-12T18:36:01.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.xfsD2uA5ZR5a37jCNDldGDIzxyXQr4A_0 2024-09-12T18:36:01.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9045909402689551877', time=2024-09-12T20:03:16.073361+0000, chain.objs.size()=1 2024-09-12T18:36:01.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ZPEvWMeikmrnr48b5LMGFsPpYCJsWSj_0 2024-09-12T18:36:01.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11364804770406138646', time=2024-09-12T20:03:17.170906+0000, chain.objs.size()=1 2024-09-12T18:36:01.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QaIoBmjRhWU6SM3dXApAOMXvsPjq0aA_0 2024-09-12T18:36:01.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8272981838468617891', time=2024-09-12T20:03:18.220385+0000, chain.objs.size()=1 2024-09-12T18:36:01.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.gfeaG-yZnsIoyXDRtCvjbWuyNFiv8id_0 2024-09-12T18:36:01.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6862997721508595764', time=2024-09-12T20:03:19.173707+0000, chain.objs.size()=1 2024-09-12T18:36:01.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ElU1rDQkumUp2uOZLKu1z42scHMEyq0_0 2024-09-12T18:36:01.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12963900575462010366', time=2024-09-12T20:03:19.567559+0000, chain.objs.size()=1 2024-09-12T18:36:01.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.BJT0T9UTKHCjcc-ychKePNvB8iVU0qg_0 2024-09-12T18:36:01.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.110817824515524275', time=2024-09-12T20:03:20.544879+0000, chain.objs.size()=1 2024-09-12T18:36:01.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.EdK4eOZl9qz5AIrGhBP2wwR5Eo9Tr6K_0 2024-09-12T18:36:01.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3411684371219603316', time=2024-09-12T20:03:30.142366+0000, chain.objs.size()=1 2024-09-12T18:36:01.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.269__shadow_.91xptk2T9kxE3N_XPKecr4wV-vC2jbK_0 2024-09-12T18:36:01.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15381683249469223685', time=2024-09-12T20:03:31.643136+0000, chain.objs.size()=1 2024-09-12T18:36:01.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.270__shadow_.T02I3ZZ_pxxLGNQHu0_aIU8qPTfNDED_0 2024-09-12T18:36:01.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.633371792004095502', time=2024-09-12T20:03:46.057613+0000, chain.objs.size()=1 2024-09-12T18:36:01.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.279__shadow_.QKJ_PHH5b6y5eBeBj4xItnVOJ1HsoD6_0 2024-09-12T18:36:01.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.766711710059373874', time=2024-09-12T20:03:54.421424+0000, chain.objs.size()=1 2024-09-12T18:36:01.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.284__shadow_.fwNOGEqnkaQ9b-UTQ2wEqsiN_sQSqvX_0 2024-09-12T18:36:01.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.584711431059045777', time=2024-09-12T20:04:06.547076+0000, chain.objs.size()=1 2024-09-12T18:36:01.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.592+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.291__shadow_.EKp0YSmVGrJ4HTHB4yaAeROiGIwpTIl_0 2024-09-12T18:36:01.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18169213289327160896', time=2024-09-12T20:04:19.906181+0000, chain.objs.size()=1 2024-09-12T18:36:01.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.295__shadow_.LzFXPMghIVlFgKlKdeOtuRZrfuUY0CG_0 2024-09-12T18:36:01.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18375123445380053410', time=2024-09-12T20:04:33.576113+0000, chain.objs.size()=1 2024-09-12T18:36:01.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.303__shadow_.jAebF5ekFMvYVtbfPZgFKqggzZTlXNt_0 2024-09-12T18:36:01.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16798918408151738627', time=2024-09-12T20:04:35.266228+0000, chain.objs.size()=1 2024-09-12T18:36:01.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.304__shadow_.hA9BJK-1ms2Lx2Me0vPIhyizxck8znl_0 2024-09-12T18:36:01.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6509136458047407324', time=2024-09-12T20:06:51.016999+0000, chain.objs.size()=1 2024-09-12T18:36:01.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.4d_ZzISTOz-at_EoPDbgKvOVo2n7zuG_0 2024-09-12T18:36:01.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1058593299365091181', time=2024-09-12T20:06:51.703422+0000, chain.objs.size()=1 2024-09-12T18:36:01.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.8rW6aSCqGntdIFeVhhkySR239EQ6CHi_0 2024-09-12T18:36:01.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7386437470656566772', time=2024-09-12T20:06:52.811772+0000, chain.objs.size()=1 2024-09-12T18:36:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.9gt5feZ5whb0lZ21xjLpmS3GR8hxXH2_0 2024-09-12T18:36:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3497050426242194250', time=2024-09-12T20:06:53.255072+0000, chain.objs.size()=1 2024-09-12T18:36:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.xcATz2M7zqa3BAxQkzUxC_Rbvh88_Mm_0 2024-09-12T18:36:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2375548551400636368', time=2024-09-12T20:06:53.643310+0000, chain.objs.size()=1 2024-09-12T18:36:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.imiIfxUa2J2I8gnuzDyMPC1jSKiZlH8_0 2024-09-12T18:36:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4799276281909786952', time=2024-09-12T20:06:55.025032+0000, chain.objs.size()=1 2024-09-12T18:36:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Ty_BCbcO0hgbagC-OvgcCDapCkP_OtA_0 2024-09-12T18:36:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.471175538842513131', time=2024-09-12T20:06:55.300580+0000, chain.objs.size()=1 2024-09-12T18:36:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.RC97i94WqBoiqzhmrPQMtJeMF8wmAUq_0 2024-09-12T18:36:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8627266863899229527', time=2024-09-12T20:06:55.516033+0000, chain.objs.size()=1 2024-09-12T18:36:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.adguiF9ZLLGOExG5DNUjgGAJ7GLrOD3_0 2024-09-12T18:36:01.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4561891175943027338', time=2024-09-12T20:06:56.327758+0000, chain.objs.size()=1 2024-09-12T18:36:01.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.596+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.fCrqKHnN2DjhhHz04zmCT_4Js5g7dKb_0 2024-09-12T18:36:01.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1159517140465444763', time=2024-09-12T20:06:56.474428+0000, chain.objs.size()=1 2024-09-12T18:36:01.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.EbSgo_vMZXEEiTp70SQLFd8HqmTW24a_0 2024-09-12T18:36:01.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8679046892310035859', time=2024-09-12T20:06:56.846419+0000, chain.objs.size()=1 2024-09-12T18:36:01.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.FJqVuDydbPJoD7ewv7_3Xr7YE5KPDlL_0 2024-09-12T18:36:01.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.54792569963965487', time=2024-09-12T20:06:59.113789+0000, chain.objs.size()=1 2024-09-12T18:36:01.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.YC90MT0UzALi4_lBnK1Gu2LMvnOBrxS_0 2024-09-12T18:36:01.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15985326299340419885', time=2024-09-12T20:06:59.329013+0000, chain.objs.size()=1 2024-09-12T18:36:01.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.oC-rUFiis_NTDlju9Gl3xxCDHWGe2yo_0 2024-09-12T18:36:01.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16338371297879389413', time=2024-09-12T20:07:00.200848+0000, chain.objs.size()=1 2024-09-12T18:36:01.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.UWIc-Ht8Uc9WrcznLihCyA7WBmXORmQ_0 2024-09-12T18:36:01.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11551396405375249639', time=2024-09-12T20:07:00.576189+0000, chain.objs.size()=1 2024-09-12T18:36:01.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Q2JjSuBD5JnZVOus6QHD32txcrNwKii_0 2024-09-12T18:36:01.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9961497975390070407', time=2024-09-12T20:07:02.557135+0000, chain.objs.size()=1 2024-09-12T18:36:01.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7HoGfU8IUwAsX3F0kHjf4EQEI5oZvOV_0 2024-09-12T18:36:01.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1342762170858411568', time=2024-09-12T20:07:03.443143+0000, chain.objs.size()=1 2024-09-12T18:36:01.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.aFk4ZUSN2BHxohRfFPejpzkzD-OVKmx_0 2024-09-12T18:36:01.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6199316232664052682', time=2024-09-12T20:07:03.884726+0000, chain.objs.size()=1 2024-09-12T18:36:01.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.600+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.XHrto5kTtqhPbI4T6u7uI98UCcsfn8c_0 2024-09-12T18:36:01.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8950174204006524952', time=2024-09-12T20:07:04.120102+0000, chain.objs.size()=1 2024-09-12T18:36:01.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.1WHCEXp1kKsh8MCqnNc4JHzBoBK2zMb_0 2024-09-12T18:36:01.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1736687877088380732', time=2024-09-12T20:07:04.198341+0000, chain.objs.size()=1 2024-09-12T18:36:01.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.PiSocC-r52sgOqEo7cXrUQAiEZE5vlR_0 2024-09-12T18:36:01.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5304829420326111809', time=2024-09-12T20:07:04.200139+0000, chain.objs.size()=1 2024-09-12T18:36:01.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.1S5bJdde-SMzN6bIE3gmKk1a2mFa-5r_0 2024-09-12T18:36:01.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.58471337025210609', time=2024-09-12T20:07:05.380955+0000, chain.objs.size()=1 2024-09-12T18:36:01.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.5ipEZTa6YfHGJGchScPublAFiVDsYoA_0 2024-09-12T18:36:01.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1084842190961222198', time=2024-09-12T20:07:06.164422+0000, chain.objs.size()=1 2024-09-12T18:36:01.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.NrLKTnbf1EFPMITSLyttTsU3DJFKM8Y_0 2024-09-12T18:36:01.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7796384011306992156', time=2024-09-12T20:07:06.541185+0000, chain.objs.size()=1 2024-09-12T18:36:01.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-dnKpCt98L0RQiCTShiBTrbwRdcCsNp_0 2024-09-12T18:36:01.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7820573097778487433', time=2024-09-12T20:07:07.252612+0000, chain.objs.size()=1 2024-09-12T18:36:01.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_._xqQHSRRwFie8NkIpGNFfVvyCjM7Fl__0 2024-09-12T18:36:01.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9693417833691545094', time=2024-09-12T20:07:07.996557+0000, chain.objs.size()=1 2024-09-12T18:36:01.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.yMRVLP9aVsQdq4v3TommMjyXariblQH_0 2024-09-12T18:36:01.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1729039747499591434', time=2024-09-12T20:07:08.584632+0000, chain.objs.size()=1 2024-09-12T18:36:01.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.qB2FX4nZlAIiCL26JBqYGDaheFVzd21_0 2024-09-12T18:36:01.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7378927214891877786', time=2024-09-12T20:07:10.222682+0000, chain.objs.size()=1 2024-09-12T18:36:01.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.OsVoOcQSxGXpnvEUIcB9Bp0SBZAr5CN_0 2024-09-12T18:36:01.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.531844846876487788', time=2024-09-12T20:07:10.344004+0000, chain.objs.size()=1 2024-09-12T18:36:01.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.40oC_Zey2vgFgQUxuxmpqR_adBoZSbi_0 2024-09-12T18:36:01.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14306431746139177278', time=2024-09-12T20:07:10.550012+0000, chain.objs.size()=1 2024-09-12T18:36:01.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.oZO1MDJCDr8WTMzVJOFMCSkNZR0fB-I_0 2024-09-12T18:36:01.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11250748485142282357', time=2024-09-12T20:07:10.768783+0000, chain.objs.size()=1 2024-09-12T18:36:01.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.604+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ZK-ugRzX8TL8qBhCQmiydAxvg0H2XZi_0 2024-09-12T18:36:01.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15287144023853562832', time=2024-09-12T20:07:11.235806+0000, chain.objs.size()=1 2024-09-12T18:36:01.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.GEaJFzaMThZ1MCMa-pZkQlFHtRdPoYk_0 2024-09-12T18:36:01.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16781763332711955079', time=2024-09-12T20:07:11.735673+0000, chain.objs.size()=1 2024-09-12T18:36:01.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.jcQA8HVqUId1I-EjeeBSwQMn-1ct-Gq_0 2024-09-12T18:36:01.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3989352810400042918', time=2024-09-12T20:07:11.854558+0000, chain.objs.size()=1 2024-09-12T18:36:01.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Jck2fPqsO8nNi1XAsnunZ8nT4_Biji2_0 2024-09-12T18:36:01.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17369387968395688784', time=2024-09-12T20:07:12.638460+0000, chain.objs.size()=1 2024-09-12T18:36:01.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.3mHd28WWYhbn5Lxpzv0hXG-NAUtvBmq_0 2024-09-12T18:36:01.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4449699064955023042', time=2024-09-12T20:07:13.437478+0000, chain.objs.size()=1 2024-09-12T18:36:01.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.--L9MAk8zcSnuVSditZ2C1tr6T-vBqO_0 2024-09-12T18:36:01.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15517449535943978532', time=2024-09-12T20:07:16.185440+0000, chain.objs.size()=1 2024-09-12T18:36:01.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.IZk_59j52Z_OUn16vz5w6zXflowt_Dl_0 2024-09-12T18:36:01.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.172368492505482792', time=2024-09-12T20:07:17.316397+0000, chain.objs.size()=1 2024-09-12T18:36:01.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.sEyP2kpf5tSgCuFz2XG4_4F1Q7iYDZM_0 2024-09-12T18:36:01.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4407305202674750140', time=2024-09-12T20:07:18.850258+0000, chain.objs.size()=1 2024-09-12T18:36:01.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.JFuynII3iKvyxtN7Ypfv3TNRKGXyMyg_0 2024-09-12T18:36:01.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6542667976802693880', time=2024-09-12T20:09:02.292313+0000, chain.objs.size()=1 2024-09-12T18:36:01.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.608+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.4ymUtEr6Z5rEFLD3HABvERY9MU833MI_0 2024-09-12T18:36:01.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4360262059895941961', time=2024-09-12T20:09:03.734097+0000, chain.objs.size()=1 2024-09-12T18:36:01.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.1rOml_B97zmPUzq2Wbq5Xk44klL7DtW_0 2024-09-12T18:36:01.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.105948504678090065', time=2024-09-12T20:09:04.402877+0000, chain.objs.size()=1 2024-09-12T18:36:01.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.WFmLXBJuriNk8Kxy1cPtiH2wv7U8UJT_0 2024-09-12T18:36:01.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14869084754776310706', time=2024-09-12T20:09:06.508316+0000, chain.objs.size()=1 2024-09-12T18:36:01.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.GEpZKmzwV4rzdx3matSDwZc2-DkFHPv_0 2024-09-12T18:36:01.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15760166786750818815', time=2024-09-12T20:09:06.513510+0000, chain.objs.size()=1 2024-09-12T18:36:01.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.UyYkjCafrZAzM91UckpXcP40tPufLUa_0 2024-09-12T18:36:01.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2870237738429615439', time=2024-09-12T20:09:06.877964+0000, chain.objs.size()=1 2024-09-12T18:36:01.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.V8K5bOTTp8x5J2xduw0eOWd3k_gkuXc_0 2024-09-12T18:36:01.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18162697188832232336', time=2024-09-12T20:09:06.993158+0000, chain.objs.size()=1 2024-09-12T18:36:01.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.bAWJgkujC_JaZuTm7NATQtuxFec0F2M_0 2024-09-12T18:36:01.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17368719833759716906', time=2024-09-12T20:09:07.153904+0000, chain.objs.size()=1 2024-09-12T18:36:01.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.7ayyANzjamNqAT4O-ovX4JDnL77-L1M_0 2024-09-12T18:36:01.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8689498800637930470', time=2024-09-12T20:09:07.354126+0000, chain.objs.size()=1 2024-09-12T18:36:01.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.4fM--FedtMPAEE3QsmoGuxAIKJzrDvr_0 2024-09-12T18:36:01.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17259812986144917306', time=2024-09-12T20:09:08.284505+0000, chain.objs.size()=1 2024-09-12T18:36:01.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.liBwLEqMLzRt8NKavC_k5pvxi2b9Hkq_0 2024-09-12T18:36:01.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5961478330521762119', time=2024-09-12T20:09:08.416749+0000, chain.objs.size()=1 2024-09-12T18:36:01.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.NbqbzTvgcV51DY-GPnWhSakNATQO7lF_0 2024-09-12T18:36:01.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1568158735285533849', time=2024-09-12T20:09:11.114986+0000, chain.objs.size()=1 2024-09-12T18:36:01.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.612+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.zXfF3dOoJttDQ6AQxD5fHAU55aWVntu_0 2024-09-12T18:36:01.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13242102372131248879', time=2024-09-12T20:09:11.592767+0000, chain.objs.size()=1 2024-09-12T18:36:01.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Sn_M2cd5ukczNWehMlrCQsLIiWIRSDj_0 2024-09-12T18:36:01.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16022928551234650835', time=2024-09-12T20:09:12.290609+0000, chain.objs.size()=1 2024-09-12T18:36:01.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.z5_D8GNS6fzbmdLBxia5VOsCyO8ZqYX_0 2024-09-12T18:36:01.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2051191577619966964', time=2024-09-12T20:09:13.505786+0000, chain.objs.size()=1 2024-09-12T18:36:01.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.R884bY9HAm6TM2241vWnRrr1rFlI_gs_0 2024-09-12T18:36:01.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12976089523891422111', time=2024-09-12T20:09:16.002121+0000, chain.objs.size()=1 2024-09-12T18:36:01.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.t0Nmgg28028BkVz4TUeoKpDuXG79LV-_0 2024-09-12T18:36:01.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13836145981159422861', time=2024-09-12T20:09:16.989579+0000, chain.objs.size()=1 2024-09-12T18:36:01.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2ak3o8oNG2OB-OaWF9el72xJOvHN58J_0 2024-09-12T18:36:01.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18010519965889715201', time=2024-09-12T20:09:17.095335+0000, chain.objs.size()=1 2024-09-12T18:36:01.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.74LGO9tYSrZMf-vjEX8F99p5226XmOD_0 2024-09-12T18:36:01.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5997653035784778195', time=2024-09-12T20:09:18.893263+0000, chain.objs.size()=1 2024-09-12T18:36:01.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.iYu3-LLBM17RSyDf4oPku58suuCpU-7_0 2024-09-12T18:36:01.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10950929506526724852', time=2024-09-12T20:09:21.013980+0000, chain.objs.size()=1 2024-09-12T18:36:01.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.0HRQmUn2fu5v7GeoYO3vJXCxnKVWfhI_0 2024-09-12T18:36:01.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7277361324843538111', time=2024-09-12T20:09:21.437136+0000, chain.objs.size()=1 2024-09-12T18:36:01.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Yxm7W0hxreO7Ypn5cfi90qehF_DmJe6_0 2024-09-12T18:36:01.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12823852460848765325', time=2024-09-12T20:09:21.893472+0000, chain.objs.size()=1 2024-09-12T18:36:01.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.EsWCojtqjIvNLA29JffG0gUlLDGwW4O_0 2024-09-12T18:36:01.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10757908648193528220', time=2024-09-12T20:09:22.762385+0000, chain.objs.size()=1 2024-09-12T18:36:01.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.616+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.WTSAbKoiEobL6k1XTvQzTVtAUMc4tty_0 2024-09-12T18:36:01.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.620+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44020 2024-09-12T18:36:01.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T18:36:01.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6811682092218284747', time=2024-09-12T20:09:23.463680+0000, chain.objs.size()=1 2024-09-12T18:36:01.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_._-lDEcGxnN1XVaPYzlddKkBHuMhHh5V_0 2024-09-12T18:36:01.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15437726719119624819', time=2024-09-12T20:09:24.481386+0000, chain.objs.size()=1 2024-09-12T18:36:01.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.roLGOPJfRJUip9-Xz1F4-saG-hnDfeI_0 2024-09-12T18:36:01.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8703865308084317304', time=2024-09-12T20:09:24.609890+0000, chain.objs.size()=1 2024-09-12T18:36:01.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cjal2HICwvmVv0HawiUKzfYVUZba3Nj_0 2024-09-12T18:36:01.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1728482404559490279', time=2024-09-12T20:09:24.829823+0000, chain.objs.size()=1 2024-09-12T18:36:01.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.EVVhl7pBW8Vlv-tQpmbTDhY5LoO2rz-_0 2024-09-12T18:36:01.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12568189892625395396', time=2024-09-12T20:09:25.261862+0000, chain.objs.size()=1 2024-09-12T18:36:01.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xoH6YUo2sRRMB8_QZxc-iqyhi0uIAfL_0 2024-09-12T18:36:01.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2388799531146643316', time=2024-09-12T20:09:25.471564+0000, chain.objs.size()=1 2024-09-12T18:36:01.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5IQdSvOwbWRO4rw2F5DQ84gkHWmm-jz_0 2024-09-12T18:36:01.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14637042352909392776', time=2024-09-12T20:09:26.810650+0000, chain.objs.size()=1 2024-09-12T18:36:01.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.V_t-I0j47-L_esr01kf8CiRS6E3_Adw_0 2024-09-12T18:36:01.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15303819521639649261', time=2024-09-12T20:09:28.116330+0000, chain.objs.size()=1 2024-09-12T18:36:01.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ipGU54U_o30QFiiIzaKoS_Za767JnmA_0 2024-09-12T18:36:01.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4628920736069055440', time=2024-09-12T20:09:28.506629+0000, chain.objs.size()=1 2024-09-12T18:36:01.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.LNeZIrrRxt-l8_FYp-2sdJS_0MEdFfe_0 2024-09-12T18:36:01.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17047499559270896852', time=2024-09-12T20:09:29.343649+0000, chain.objs.size()=1 2024-09-12T18:36:01.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.CUeeNmpK4TwaZmI0utw5TUlzJUZM72e_0 2024-09-12T18:36:01.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10192617675769783774', time=2024-09-12T20:09:29.585574+0000, chain.objs.size()=1 2024-09-12T18:36:01.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.6Uj4KMrEG2TZ0GtqbkB4OYRpeLP-dNG_0 2024-09-12T18:36:01.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17625269293900220817', time=2024-09-12T20:09:29.705935+0000, chain.objs.size()=1 2024-09-12T18:36:01.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.624+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xHgzKoOsxYvi0n7x4xubSKlwt3FW5bO_0 2024-09-12T18:36:01.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1416322110209863420', time=2024-09-12T20:09:30.142650+0000, chain.objs.size()=1 2024-09-12T18:36:01.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.usmmlTneTiWvatEqjx7sJdOqqC7wSEJ_0 2024-09-12T18:36:01.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17569735855607423989', time=2024-09-12T20:11:46.588407+0000, chain.objs.size()=1 2024-09-12T18:36:01.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.430__shadow_.Rg7kTAm5h13lEsiWX0t-VX7r_FtgwM4_0 2024-09-12T18:36:01.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.876688255567385887', time=2024-09-12T20:12:24.724890+0000, chain.objs.size()=1 2024-09-12T18:36:01.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.456__shadow_.HPGfN7BByxZe0zTh1XE_M_G2xoD4QXA_0 2024-09-12T18:36:01.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.634798067315042200', time=2024-09-12T20:13:18.663941+0000, chain.objs.size()=1 2024-09-12T18:36:01.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.489__shadow_.PFNGmtFZ1uUzNK-pbn9YmUaByedfm69_0 2024-09-12T18:36:01.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16347945627999614703', time=2024-09-12T20:14:53.957250+0000, chain.objs.size()=3 2024-09-12T18:36:01.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.522__multipart_mymultipart.2~m1L37QkoojifK7jsXc00ZEf11VGY6Nk.1 2024-09-12T18:36:01.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.522__multipart_mymultipart.2~m1L37QkoojifK7jsXc00ZEf11VGY6Nk.2 2024-09-12T18:36:01.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.522__multipart_mymultipart.2~m1L37QkoojifK7jsXc00ZEf11VGY6Nk.3 2024-09-12T18:36:01.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11017250778053294075', time=2024-09-12T20:16:47.569041+0000, chain.objs.size()=1 2024-09-12T18:36:01.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.525__shadow_.Vfw5bLeiJ0YGznUXHqrHCCXQhbJLfMM_0 2024-09-12T18:36:01.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6920744867693493030', time=2024-09-12T20:21:06.673645+0000, chain.objs.size()=1 2024-09-12T18:36:01.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.580__shadow:M7ZhXjqXVb2CE-hhiQRpkeGZ3ygEV4._.c6ynR72v9lUyUOhXSTbaW_G2q5o17T__0 2024-09-12T18:36:01.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5571856595307454032', time=2024-09-12T20:26:52.428343+0000, chain.objs.size()=1 2024-09-12T18:36:01.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.628+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.644__shadow_.74DE-PxhlqhHOSuQ13TFuEHfhXqKu15_0 2024-09-12T18:36:01.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.632+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:01.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.636+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:36:01.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.636+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:01.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:01.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49246' 2024-09-12T18:36:01.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_GAlxymCo-c-kdcAxhbFcynEjvYxukP0', time=2024-09-12T19:56:02.754903+0000, chain.objs.size()=1 2024-09-12T18:36:01.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.MLfumJV07LDinM8Gi9HB7yhp-QLpR-5_0 2024-09-12T18:36:01.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6095058019150135200', time=2024-09-12T19:57:04.051103+0000, chain.objs.size()=1 2024-09-12T18:36:01.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.189__shadow_.arXV6Rr0GHqe-gRiAraRP6dYgSO24Tl_0 2024-09-12T18:36:01.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2333885316019517644', time=2024-09-12T20:00:28.028728+0000, chain.objs.size()=1 2024-09-12T18:36:01.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.238__shadow_.NSQCPCqPP_trUERWbiAptMsEmeHnW7f_0 2024-09-12T18:36:01.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.736354160466298483', time=2024-09-12T20:00:34.815794+0000, chain.objs.size()=1 2024-09-12T18:36:01.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.242__shadow_.2DirPIo-ig4lKzvRGZEM5js_vqXbBqI_0 2024-09-12T18:36:01.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12748797352224334082', time=2024-09-12T20:00:43.184827+0000, chain.objs.size()=1 2024-09-12T18:36:01.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.246__shadow_.5AQHcz051IOW9_H70T1iA_NZ7UflIQD_0 2024-09-12T18:36:01.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1407402447750286051', time=2024-09-12T20:00:51.513774+0000, chain.objs.size()=1 2024-09-12T18:36:01.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.251__shadow_.IIcEDQ9CMhdZGo2yUUL8ob5rGVRrvGT_0 2024-09-12T18:36:01.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17809807643556071378', time=2024-09-12T20:02:52.676470+0000, chain.objs.size()=1 2024-09-12T18:36:01.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.GYPa_3m5vvQv1nqeBvllEiY-Su5-P6o_0 2024-09-12T18:36:01.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3484693949154926716', time=2024-09-12T20:02:52.927832+0000, chain.objs.size()=1 2024-09-12T18:36:01.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.8ahM2WtdnVbdgv_JJH0qST1adnmM_R3_0 2024-09-12T18:36:01.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2684588768111903291', time=2024-09-12T20:02:53.534646+0000, chain.objs.size()=1 2024-09-12T18:36:01.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.rA74_x3eZr-sgqCIz2TfzZ5ocwYQQcy_0 2024-09-12T18:36:01.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1473775220632719120', time=2024-09-12T20:02:53.723089+0000, chain.objs.size()=1 2024-09-12T18:36:01.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.CzyYV85BT-XO2vca3Ej8ocaE05V7r-N_0 2024-09-12T18:36:01.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2082848268349654194', time=2024-09-12T20:02:53.724928+0000, chain.objs.size()=1 2024-09-12T18:36:01.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.tnNSR2wCIuPXGu57wiMY5LhWSG5uz6p_0 2024-09-12T18:36:01.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5607261196170471625', time=2024-09-12T20:02:54.235331+0000, chain.objs.size()=1 2024-09-12T18:36:01.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.BiQ3KNstssZzMhiYzp2udYH6U65ZFVP_0 2024-09-12T18:36:01.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17126376409094249404', time=2024-09-12T20:02:54.676495+0000, chain.objs.size()=1 2024-09-12T18:36:01.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.OvfypJw_jgDLdnGbS5tSdx5bnofmDya_0 2024-09-12T18:36:01.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1844542462366145826', time=2024-09-12T20:02:54.757712+0000, chain.objs.size()=1 2024-09-12T18:36:01.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.6coMAbr0FPc24WgBlH3z4-CTHZxsRJg_0 2024-09-12T18:36:01.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.640+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10744848145295201013', time=2024-09-12T20:02:55.850260+0000, chain.objs.size()=1 2024-09-12T18:36:01.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3OiadZ72L6Jj0M8W8hcm0iya7e9-oHp_0 2024-09-12T18:36:01.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1409800348903740752', time=2024-09-12T20:02:55.976676+0000, chain.objs.size()=1 2024-09-12T18:36:01.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ggVuW7rKhA0uZ0zapHbVILH5MzqQL9r_0 2024-09-12T18:36:01.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18420124293752919611', time=2024-09-12T20:02:56.767632+0000, chain.objs.size()=1 2024-09-12T18:36:01.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.lXV3YftIrb5YJq2dL9BjK4PicrNXqFP_0 2024-09-12T18:36:01.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1777584394677715354', time=2024-09-12T20:02:58.436817+0000, chain.objs.size()=1 2024-09-12T18:36:01.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Hrnl7DTDKE25tzVzshVyfRQsONL1Zlc_0 2024-09-12T18:36:01.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6396993636489800284', time=2024-09-12T20:02:58.639187+0000, chain.objs.size()=1 2024-09-12T18:36:01.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.9UYyZIE5IfOhYP8_wS7vieAv71dHfea_0 2024-09-12T18:36:01.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17132866630061202055', time=2024-09-12T20:03:00.142296+0000, chain.objs.size()=1 2024-09-12T18:36:01.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.osyZpgA8zBBE5UJCHbdxYoqh4x4uafu_0 2024-09-12T18:36:01.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16666437155267640005', time=2024-09-12T20:03:00.655759+0000, chain.objs.size()=1 2024-09-12T18:36:01.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._iP31vZn2Ptn8dVoaSXSVab9dJOwgJz_0 2024-09-12T18:36:01.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14820134751855163059', time=2024-09-12T20:03:02.205394+0000, chain.objs.size()=1 2024-09-12T18:36:01.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.m7VdkLZDfJVL2eQeEqO-RPGhvLNCkeJ_0 2024-09-12T18:36:01.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5046249616619686865', time=2024-09-12T20:03:03.542626+0000, chain.objs.size()=1 2024-09-12T18:36:01.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-8V1ftD6aQX99BG4NgGxtpsPAmz1oK6_0 2024-09-12T18:36:01.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11634021324246949270', time=2024-09-12T20:03:03.596368+0000, chain.objs.size()=1 2024-09-12T18:36:01.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.w0U3zDdnGwAqZlBO8IR0ibSuHnmrvlk_0 2024-09-12T18:36:01.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17738417764150012739', time=2024-09-12T20:03:03.955224+0000, chain.objs.size()=1 2024-09-12T18:36:01.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qfHrDqZMlxYcXZ7xXp34Cb56RXVX5ii_0 2024-09-12T18:36:01.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13580375979930873894', time=2024-09-12T20:03:04.099840+0000, chain.objs.size()=1 2024-09-12T18:36:01.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.644+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-dLyS9QDb-oJVwOQ82BpHAypmE7qwtu_0 2024-09-12T18:36:01.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18132464116955431443', time=2024-09-12T20:03:06.212401+0000, chain.objs.size()=1 2024-09-12T18:36:01.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Ga_Tn7z4XImxtO-RmHkGsWs9uMOEfzq_0 2024-09-12T18:36:01.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9281814743404064663', time=2024-09-12T20:03:07.425684+0000, chain.objs.size()=1 2024-09-12T18:36:01.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.rp0NZ-3LJ0aVXbLJAA3H05VMKo_co-I_0 2024-09-12T18:36:01.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.554163449715800158', time=2024-09-12T20:03:07.783248+0000, chain.objs.size()=1 2024-09-12T18:36:01.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.LNU9YB5UT6MLGVH7s4FhbJFz6ZKVm7p_0 2024-09-12T18:36:01.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2589272033514682011', time=2024-09-12T20:03:08.288775+0000, chain.objs.size()=1 2024-09-12T18:36:01.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.aJzXG2rwY6c2u7hevg1cum0hXQ3oZXR_0 2024-09-12T18:36:01.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4037455428969907230', time=2024-09-12T20:03:09.502484+0000, chain.objs.size()=1 2024-09-12T18:36:01.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.cdBexhq7HSCCALrqxUV8MgTYQ_FqCC8_0 2024-09-12T18:36:01.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8586424405338798274', time=2024-09-12T20:03:11.633689+0000, chain.objs.size()=1 2024-09-12T18:36:01.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XnzKyyUuv1t5rsYKfIxhINvETiYyoBW_0 2024-09-12T18:36:01.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11291776187091806196', time=2024-09-12T20:03:11.801694+0000, chain.objs.size()=1 2024-09-12T18:36:01.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2DfVGwMsUvRg4hhFWCa1vsxChEFeGS2_0 2024-09-12T18:36:01.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3949746556180464239', time=2024-09-12T20:03:13.497758+0000, chain.objs.size()=1 2024-09-12T18:36:01.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.N9Y7KgS73Yo2AmAF--nlX-Gx5ZNTXk__0 2024-09-12T18:36:01.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16221715197026969198', time=2024-09-12T20:03:14.990181+0000, chain.objs.size()=1 2024-09-12T18:36:01.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qNpWUdd_sX2zxl_2XmE4KNkTWSOY4SZ_0 2024-09-12T18:36:01.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.179909174056589882', time=2024-09-12T20:03:16.273950+0000, chain.objs.size()=1 2024-09-12T18:36:01.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.4tJi-wkHhjivcWJDx6zRoOQefS7qL1K_0 2024-09-12T18:36:01.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3054400168131151544', time=2024-09-12T20:03:16.560455+0000, chain.objs.size()=1 2024-09-12T18:36:01.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.648+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.8trj-j63OgXsEmCq3nhhc-SbNK04ctB_0 2024-09-12T18:36:01.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.652+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1342510163827735665', time=2024-09-12T20:03:16.867264+0000, chain.objs.size()=1 2024-09-12T18:36:01.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.652+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.yGNkAwr_GPnB8vpZV1rG6_EFxVgWjIc_0 2024-09-12T18:36:01.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.652+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9853333250244349894', time=2024-09-12T20:03:18.094361+0000, chain.objs.size()=1 2024-09-12T18:36:01.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.652+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.LndtiNX9XSvhKQZmgD7chv_gDcWr0dQ_0 2024-09-12T18:36:01.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7458389967263839134', time=2024-09-12T20:03:18.268954+0000, chain.objs.size()=1 2024-09-12T18:36:01.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.hquRJc53naLIRer6HMurQOA2k2WM9g-_0 2024-09-12T18:36:01.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14133059640771955854', time=2024-09-12T20:03:18.368379+0000, chain.objs.size()=1 2024-09-12T18:36:01.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.9gH5JTIugSjUEUBQ2h6x6y5fyEWy8vH_0 2024-09-12T18:36:01.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13666586539506674302', time=2024-09-12T20:03:19.449903+0000, chain.objs.size()=1 2024-09-12T18:36:01.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.EkOD160O0FnE8L_t5LD-UiFpPoPFBaB_0 2024-09-12T18:36:01.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12572905730605470502', time=2024-09-12T20:03:19.913484+0000, chain.objs.size()=1 2024-09-12T18:36:01.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.kWNdVAO9XvBjkWmRZvZH1H3e_ai6oS8_0 2024-09-12T18:36:01.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2070293746623110547', time=2024-09-12T20:03:36.279295+0000, chain.objs.size()=1 2024-09-12T18:36:01.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.273__shadow_.Vk-ndQaQ2HarLZ1N0wlbGVe0rRIpND2_0 2024-09-12T18:36:01.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1186543571108142549', time=2024-09-12T20:03:39.350105+0000, chain.objs.size()=1 2024-09-12T18:36:01.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.275__shadow_.M4cWNjalGfN_RGvlhZDGDGvlelwAbZu_0 2024-09-12T18:36:01.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14712459098462642378', time=2024-09-12T20:04:12.980816+0000, chain.objs.size()=1 2024-09-12T18:36:01.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.XUGqxRqBtrEUm8L6a4VlWpYLSEe5jU4_0 2024-09-12T18:36:01.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2843618774522903485', time=2024-09-12T20:04:13.235079+0000, chain.objs.size()=1 2024-09-12T18:36:01.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.293__shadow_.rC4P1VukY0YeHkHPdBCd7kmE3w3XWlh_0 2024-09-12T18:36:01.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12126260312043924925', time=2024-09-12T20:04:38.635347+0000, chain.objs.size()=1 2024-09-12T18:36:01.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.656+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.306__shadow_.yosUtVklWCgIa9mlJurpUwAE89dpR07_0 2024-09-12T18:36:01.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6216466770435379041', time=2024-09-12T20:05:05.588430+0000, chain.objs.size()=1 2024-09-12T18:36:01.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.322__shadow_.hHYZbKi9dCboXrFmLdlteAd_4N35Hrs_0 2024-09-12T18:36:01.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11214430747759094669', time=2024-09-12T20:06:51.017141+0000, chain.objs.size()=1 2024-09-12T18:36:01.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.K_zx29kUmzqJrK6Zz_Soy2PsanKH0Ob_0 2024-09-12T18:36:01.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10223690068133683793', time=2024-09-12T20:06:51.083411+0000, chain.objs.size()=1 2024-09-12T18:36:01.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.NsfLLd4V8Lm8kR3zFuWzH06wo8J_9Ze_0 2024-09-12T18:36:01.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5671317383004086032', time=2024-09-12T20:06:51.515034+0000, chain.objs.size()=1 2024-09-12T18:36:01.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.BNds_F-7YJ1zehdkVGqcwoVmqVnkVSV_0 2024-09-12T18:36:01.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17744399542909696304', time=2024-09-12T20:06:52.585077+0000, chain.objs.size()=1 2024-09-12T18:36:01.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ffSXA7grsc_JqzcAncYHD0cWvFp816X_0 2024-09-12T18:36:01.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10360463304685914846', time=2024-09-12T20:06:53.765655+0000, chain.objs.size()=1 2024-09-12T18:36:01.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Srjx-FXIggQ0Y1yzQG7CzOelrF_ULJ4_0 2024-09-12T18:36:01.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9124672127896313844', time=2024-09-12T20:06:55.324960+0000, chain.objs.size()=1 2024-09-12T18:36:01.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.aLbYAhtKt25qInjOd3PAbml3n1mZelz_0 2024-09-12T18:36:01.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16971239264802156167', time=2024-09-12T20:06:55.505460+0000, chain.objs.size()=1 2024-09-12T18:36:01.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.cdFu7tgN1Ez4nijIjHOsOwcSG03UQ5p_0 2024-09-12T18:36:01.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18091200164186072168', time=2024-09-12T20:06:55.652511+0000, chain.objs.size()=1 2024-09-12T18:36:01.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.KejdHxAL6cy4SbdT7xhMR2s6k8hmOjr_0 2024-09-12T18:36:01.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17530359884303938665', time=2024-09-12T20:06:55.732376+0000, chain.objs.size()=1 2024-09-12T18:36:01.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.9tnckkbSpxHGs6Ko4JeeVdrGqa0fdTl_0 2024-09-12T18:36:01.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5416572379446837090', time=2024-09-12T20:06:56.387209+0000, chain.objs.size()=1 2024-09-12T18:36:01.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.qQPR3gvMvQJU1eUbZqQOYQah6C3NEYi_0 2024-09-12T18:36:01.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3109033346316477659', time=2024-09-12T20:06:57.413129+0000, chain.objs.size()=1 2024-09-12T18:36:01.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.D1TEyWdoliWzZOgpONA5qR3wPALEW44_0 2024-09-12T18:36:01.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7323196863692526770', time=2024-09-12T20:06:59.143269+0000, chain.objs.size()=1 2024-09-12T18:36:01.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.660+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.80Bs35qCRtyP_GTv93Y20owk-sSEBon_0 2024-09-12T18:36:01.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6487720866263629154', time=2024-09-12T20:06:59.660355+0000, chain.objs.size()=1 2024-09-12T18:36:01.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Lp-nyUguBMcLF2fmhdsIvJHNs7VF2HO_0 2024-09-12T18:36:01.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12295493548377845977', time=2024-09-12T20:06:59.819247+0000, chain.objs.size()=1 2024-09-12T18:36:01.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Pux0Xf96vCAMx3C-wHYLYbgwV3xfFkO_0 2024-09-12T18:36:01.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14029760616925423052', time=2024-09-12T20:07:00.227447+0000, chain.objs.size()=1 2024-09-12T18:36:01.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.iNFG1s1hxX_xp80a-tRoLeRYIBqz68O_0 2024-09-12T18:36:01.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7889803283223839490', time=2024-09-12T20:07:01.534486+0000, chain.objs.size()=1 2024-09-12T18:36:01.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.a45ewQqEUJqVHdaZ3uyvqCjYcfDGgyb_0 2024-09-12T18:36:01.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5524147080990545888', time=2024-09-12T20:07:01.593451+0000, chain.objs.size()=1 2024-09-12T18:36:01.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.DF03GQhVJcAI_s-kJMs91yBxyD3RS2F_0 2024-09-12T18:36:01.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1217810271460547267', time=2024-09-12T20:07:02.649438+0000, chain.objs.size()=1 2024-09-12T18:36:01.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.m2ucl47pzTWNTEAi05KzWkKdtlUw1Lb_0 2024-09-12T18:36:01.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8176009625837067611', time=2024-09-12T20:07:03.920641+0000, chain.objs.size()=1 2024-09-12T18:36:01.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.8DXe5bvnmaEATJwnWDMGNc6yIIAVJVn_0 2024-09-12T18:36:01.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11107273477353456817', time=2024-09-12T20:07:04.243134+0000, chain.objs.size()=1 2024-09-12T18:36:01.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.TBN8VcVj24Thdl_-dNVUntbnu24YHtn_0 2024-09-12T18:36:01.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8755438841441548162', time=2024-09-12T20:07:04.390945+0000, chain.objs.size()=1 2024-09-12T18:36:01.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.urho0CiMjngCt6jG24QS2g9C81xkIAZ_0 2024-09-12T18:36:01.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7622360910504897441', time=2024-09-12T20:07:04.431673+0000, chain.objs.size()=1 2024-09-12T18:36:01.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.664+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.c3Txvkt4QE4LKW_y00wvf1eXx0sWxGl_0 2024-09-12T18:36:01.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12006231559582349279', time=2024-09-12T20:07:05.295823+0000, chain.objs.size()=1 2024-09-12T18:36:01.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.A2RbwLc-mrAxqyyOzGxhyOChr5f3C7D_0 2024-09-12T18:36:01.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4805004071495876495', time=2024-09-12T20:07:07.348642+0000, chain.objs.size()=1 2024-09-12T18:36:01.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.GgQlVJqnVc9u3kX9tflQvDke6f7M7Xf_0 2024-09-12T18:36:01.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10339116170921577410', time=2024-09-12T20:07:07.477806+0000, chain.objs.size()=1 2024-09-12T18:36:01.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Fjlbtmb8ObRSNJm8Y_fOP1QrAp4inok_0 2024-09-12T18:36:01.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3305951578667049807', time=2024-09-12T20:07:08.562324+0000, chain.objs.size()=1 2024-09-12T18:36:01.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.hSQtvFb9tRLRU1o5QEJzqOgwM31MF7D_0 2024-09-12T18:36:01.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1352652041810214766', time=2024-09-12T20:07:09.018028+0000, chain.objs.size()=1 2024-09-12T18:36:01.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.yqrR072Vl1oPE6gFSwdrwHjcNjPh2N9_0 2024-09-12T18:36:01.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15610865472792622357', time=2024-09-12T20:07:10.519945+0000, chain.objs.size()=1 2024-09-12T18:36:01.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.AJcAo5lBqTwacNC1Z_UZ5joqwJBVHRX_0 2024-09-12T18:36:01.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15111678017496996581', time=2024-09-12T20:07:11.070740+0000, chain.objs.size()=1 2024-09-12T18:36:01.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.upbk9zu7T_5Gb5Jl465byty1T7Bg4lW_0 2024-09-12T18:36:01.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15313146146172606007', time=2024-09-12T20:07:13.469854+0000, chain.objs.size()=1 2024-09-12T18:36:01.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.68P5HbME8xH4sl10depNMbTvBWtQ21o_0 2024-09-12T18:36:01.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12001834333359516677', time=2024-09-12T20:07:14.165348+0000, chain.objs.size()=1 2024-09-12T18:36:01.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.4riHyP3CkP0dvYAIGoFRDrf_ik64ota_0 2024-09-12T18:36:01.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13081343696575497345', time=2024-09-12T20:07:14.852198+0000, chain.objs.size()=1 2024-09-12T18:36:01.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.cDxCu8h0u-Hi1RTV_OxDwvaPHyu32ej_0 2024-09-12T18:36:01.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.394639157420517054', time=2024-09-12T20:07:15.617624+0000, chain.objs.size()=1 2024-09-12T18:36:01.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.668+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.aOPWF_rH2_SEqF-26Jji65XL7-WO3vZ_0 2024-09-12T18:36:01.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15981128711202216328', time=2024-09-12T20:07:16.065035+0000, chain.objs.size()=1 2024-09-12T18:36:01.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.6Zs6TVHGiyGaUEbVNJRmu3VDIxijxY2_0 2024-09-12T18:36:01.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12439464910093890666', time=2024-09-12T20:07:17.038482+0000, chain.objs.size()=1 2024-09-12T18:36:01.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.IAZ75n_nP0OEd43yWo-rU6UItAwK8nm_0 2024-09-12T18:36:01.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10004306541482855751', time=2024-09-12T20:09:02.734755+0000, chain.objs.size()=1 2024-09-12T18:36:01.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Qd9zZlAf3ET7l65d95JhFhFuyjKSI74_0 2024-09-12T18:36:01.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9788607915154532987', time=2024-09-12T20:09:03.513636+0000, chain.objs.size()=1 2024-09-12T18:36:01.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.n-uQ8hCgCnCCHdGnCO8b-Il5_ndJMRr_0 2024-09-12T18:36:01.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2506852574601339508', time=2024-09-12T20:09:07.716182+0000, chain.objs.size()=1 2024-09-12T18:36:01.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.NhlZUeuSbuRhthl8ZKMwW4qAzdG3snS_0 2024-09-12T18:36:01.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6196796909687451296', time=2024-09-12T20:09:07.863605+0000, chain.objs.size()=1 2024-09-12T18:36:01.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.H1sv2Xbhx0_WNb9Jnwu7CkLEM2FNVfc_0 2024-09-12T18:36:01.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17565258095970103434', time=2024-09-12T20:09:09.992357+0000, chain.objs.size()=1 2024-09-12T18:36:01.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_._XAtnMjwHlU7ZesoeFL9Ff7vQ1pbrf0_0 2024-09-12T18:36:01.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17107917407886811121', time=2024-09-12T20:09:11.600288+0000, chain.objs.size()=1 2024-09-12T18:36:01.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.lIyy-Y-S2QwC5FGaClCku_3MY1gFe-5_0 2024-09-12T18:36:01.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5704704673481448655', time=2024-09-12T20:09:12.165272+0000, chain.objs.size()=1 2024-09-12T18:36:01.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.i0LN-C1EyE_8bo-SXWUKV9PadNySdRM_0 2024-09-12T18:36:01.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15564843502986807409', time=2024-09-12T20:09:12.270227+0000, chain.objs.size()=1 2024-09-12T18:36:01.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.fUzi9_tGuI99VhFTYfOJjeriCg-AKVf_0 2024-09-12T18:36:01.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13558356124469596972', time=2024-09-12T20:09:14.054029+0000, chain.objs.size()=1 2024-09-12T18:36:01.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.672+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.kfQeBrEfiTow-oyibBygcZJvXE_KaNi_0 2024-09-12T18:36:01.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.676+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17490323659691127167', time=2024-09-12T20:09:14.440336+0000, chain.objs.size()=1 2024-09-12T18:36:01.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.676+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.aqj9iY8sRGT78aYUzNNOxg20XJJeLb3_0 2024-09-12T18:36:01.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.680+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9094229756330345859', time=2024-09-12T20:09:16.953618+0000, chain.objs.size()=1 2024-09-12T18:36:01.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.680+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.wbobuujKsgZl1i8tGvxwJIX2uTd0nyg_0 2024-09-12T18:36:01.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.680+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2370708899281943547', time=2024-09-12T20:09:17.092750+0000, chain.objs.size()=1 2024-09-12T18:36:01.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.680+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cP6pGZwyfG_ZgDIWK0DKUrjcsA9sMKo_0 2024-09-12T18:36:01.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.680+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18186454780185189970', time=2024-09-12T20:09:17.572358+0000, chain.objs.size()=1 2024-09-12T18:36:01.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.680+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.VjDzNVD-IBYbdfmWKZEU04A9kK5rZj-_0 2024-09-12T18:36:01.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.680+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15562734994699398082', time=2024-09-12T20:09:17.901989+0000, chain.objs.size()=1 2024-09-12T18:36:01.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.680+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.JOi3lbnDZE7rSIxkFoVFARxa5N5GUOp_0 2024-09-12T18:36:01.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.680+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9077654529635394100', time=2024-09-12T20:09:17.907823+0000, chain.objs.size()=1 2024-09-12T18:36:01.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.680+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.NkUiPqPJVaIpW2_EPQ-2ecThGAmKnpl_0 2024-09-12T18:36:01.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.680+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2356390802938268692', time=2024-09-12T20:09:18.417902+0000, chain.objs.size()=1 2024-09-12T18:36:01.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.680+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.IKEzG-fO69BnVgMecYKg_7BS6WkKEk2_0 2024-09-12T18:36:01.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.684+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49246 2024-09-12T18:36:01.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T18:36:01.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7831598362957361220', time=2024-09-12T20:09:19.065747+0000, chain.objs.size()=1 2024-09-12T18:36:01.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.3QuYJpZNO8UWL-DZ_gO0I0PPTu6efPQ_0 2024-09-12T18:36:01.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8151192550103068838', time=2024-09-12T20:09:20.823446+0000, chain.objs.size()=1 2024-09-12T18:36:01.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.37yODnjfjSbb8mo8ZaRIwSoU2zPnRcn_0 2024-09-12T18:36:01.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7608781500629576873', time=2024-09-12T20:09:22.158754+0000, chain.objs.size()=1 2024-09-12T18:36:01.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xsFiFO9l2dW0BXliPZ4xyODazG034am_0 2024-09-12T18:36:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9131191108189349877', time=2024-09-12T20:09:22.456656+0000, chain.objs.size()=1 2024-09-12T18:36:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.impwwDCeVLyWKgS6DhMFOR-NZ3d1uWm_0 2024-09-12T18:36:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7652310630434410443', time=2024-09-12T20:09:23.367826+0000, chain.objs.size()=1 2024-09-12T18:36:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.k9vNEWnbfJO-enBVnbv-8kr0JhnFKaZ_0 2024-09-12T18:36:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11612966280609242982', time=2024-09-12T20:09:23.712267+0000, chain.objs.size()=1 2024-09-12T18:36:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.7gdrCNBmD_D9jLlB2qH9g1ktpLj0Rcx_0 2024-09-12T18:36:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13832604916122241810', time=2024-09-12T20:09:25.817704+0000, chain.objs.size()=1 2024-09-12T18:36:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.YrY3vtklmw9HEmkts8djgxs1IXR5xr1_0 2024-09-12T18:36:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2769052290971561044', time=2024-09-12T20:09:26.449769+0000, chain.objs.size()=1 2024-09-12T18:36:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.dcWHoVrrTuea6_t2Ituh6IKzUfRXj7m_0 2024-09-12T18:36:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8065388920388141012', time=2024-09-12T20:09:26.836460+0000, chain.objs.size()=1 2024-09-12T18:36:01.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.tf7D3pvYHFAE039Hc1wqii4AyfPKA5O_0 2024-09-12T18:36:01.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17791423538574448729', time=2024-09-12T20:09:27.090956+0000, chain.objs.size()=1 2024-09-12T18:36:01.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.kSyvJ_DA5N5RoZFjepxfx__qBn7fPWV_0 2024-09-12T18:36:01.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.552687603651896861', time=2024-09-12T20:09:27.311401+0000, chain.objs.size()=1 2024-09-12T18:36:01.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.KZismDcmRAK82d4ml3mtzRBnVokphSi_0 2024-09-12T18:36:01.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16664630340728904448', time=2024-09-12T20:09:28.482188+0000, chain.objs.size()=1 2024-09-12T18:36:01.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.2czPxhZiLjNnhz80E5Eim0V9IQMlovl_0 2024-09-12T18:36:01.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10601597735988769737', time=2024-09-12T20:09:28.832687+0000, chain.objs.size()=1 2024-09-12T18:36:01.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.692+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.yfc98UK-OPm2TjqdcbBdVxd0zaKV4JG_0 2024-09-12T18:36:01.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17929881328169625143', time=2024-09-12T20:09:43.603528+0000, chain.objs.size()=1 2024-09-12T18:36:01.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.335__shadow_.G6bZfB1wJnlmaKJ_4jM7k3ZnyFRcLEy_0 2024-09-12T18:36:01.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5179759144260759983', time=2024-09-12T20:10:54.927716+0000, chain.objs.size()=1 2024-09-12T18:36:01.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.391__shadow_.n_7_7B-rlA9PgE1R7qLG1KkNOVhdfWM_0 2024-09-12T18:36:01.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.881621212285760652', time=2024-09-12T20:13:09.236482+0000, chain.objs.size()=1 2024-09-12T18:36:01.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.485__shadow_.rBjlV5pYn1EDaqoPFBmNqm8d2kCKq8X_0 2024-09-12T18:36:01.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14269264650851773142', time=2024-09-12T20:13:32.152145+0000, chain.objs.size()=1 2024-09-12T18:36:01.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.499__shadow_.65GsMNLzzd89hIhsTeHQY31S7fPZOuh_0 2024-09-12T18:36:01.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17156009724896985586', time=2024-09-12T20:14:22.013262+0000, chain.objs.size()=1 2024-09-12T18:36:01.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.518__shadow_.ZTPsEwXnzTwtx7b4jvHEGtqWiB2BII2_0 2024-09-12T18:36:01.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.660516337319208741', time=2024-09-12T20:16:38.892761+0000, chain.objs.size()=3 2024-09-12T18:36:01.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.526__multipart_mymultipart.2~9n-b7sYUO8ifV_bpSdnObkWTH9oWgPo.1 2024-09-12T18:36:01.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.526__shadow_mymultipart.2~9n-b7sYUO8ifV_bpSdnObkWTH9oWgPo.1_1 2024-09-12T18:36:01.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.526__multipart_mymultipart.2~9n-b7sYUO8ifV_bpSdnObkWTH9oWgPo.2 2024-09-12T18:36:01.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6371428025850352960', time=2024-09-12T20:19:38.078784+0000, chain.objs.size()=1 2024-09-12T18:36:01.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.575__shadow_.Sn65ptbqZAyw36dOvOu_xjLwsZOdjoC_0 2024-09-12T18:36:01.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12692744727779485003', time=2024-09-12T20:20:34.299018+0000, chain.objs.size()=1 2024-09-12T18:36:01.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:k65CbrSMuq256c1728SCOntOf8etxVD_.2jvSv7hxZgN4rOAMtIKwumI5sVklvEg_0 2024-09-12T18:36:01.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9364286582000973095', time=2024-09-12T20:21:21.551135+0000, chain.objs.size()=1 2024-09-12T18:36:01.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.586__shadow:lNa7o4Ju9DZNxX2tEDjfVp97VCDe9ei_.qygXo2oeLTvTk3McnQR5pTjv4CBX1YI_0 2024-09-12T18:36:01.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11985625861086962776', time=2024-09-12T20:26:46.982380+0000, chain.objs.size()=1 2024-09-12T18:36:01.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.696+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.641__shadow_.AxTvrvyr3slvem_0EzE92mgnuXnuQ-a_0 2024-09-12T18:36:01.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.700+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3420545872924412086', time=2024-09-12T20:26:54.981810+0000, chain.objs.size()=2 2024-09-12T18:36:01.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.700+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.645__shadow_.aSVTPOHl78C0yyuXxfDMmQk7NE_5RZe_0 2024-09-12T18:36:01.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.700+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.645__shadow_.aSVTPOHl78C0yyuXxfDMmQk7NE_5RZe_1 2024-09-12T18:36:01.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.700+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7455288532076928497', time=2024-09-12T20:27:03.263702+0000, chain.objs.size()=1 2024-09-12T18:36:01.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.700+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.648__shadow_.fM9NJtD7dI3xw4cxTPPPHeijNQaKK_w_0 2024-09-12T18:36:01.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.700+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9571425778333206975', time=2024-09-12T20:27:22.665709+0000, chain.objs.size()=1 2024-09-12T18:36:01.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.700+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.657__shadow_.kr4t74ZNRLyLlD5JRIlpO8y1rBLr28h_0 2024-09-12T18:36:01.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.700+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.705238487378268702', time=2024-09-12T20:29:31.284297+0000, chain.objs.size()=1 2024-09-12T18:36:01.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.700+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.720__shadow_.Qpgl_d0S7m7WRN038xNX5K9ta_rMqnD_0 2024-09-12T18:36:01.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.700+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~m2tIfq6ZZ45XQ4sgKUtJTRvN98inc8H', time=2024-09-12T20:30:13.137741+0000, chain.objs.size()=1 2024-09-12T18:36:01.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.700+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.743__multipart_mymultipart.2~m2tIfq6ZZ45XQ4sgKUtJTRvN98inc8H.1 2024-09-12T18:36:01.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.704+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2321411639095027635', time=2024-09-12T20:30:20.303821+0000, chain.objs.size()=1 2024-09-12T18:36:01.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.704+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.745__shadow_.bKh0HoRVB-cQL3zkpBAOSoXkesdKxFh_0 2024-09-12T18:36:01.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.704+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:01.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.708+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:36:01.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.708+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:01.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:01.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45147' 2024-09-12T18:36:01.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13025025295327067727', time=2024-09-12T19:55:37.647750+0000, chain.objs.size()=1 2024-09-12T18:36:01.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.152__shadow_.gBDNs6H_a46jbGHPD6APZoEGTEHCWP7_0 2024-09-12T18:36:01.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.741937786199460877', time=2024-09-12T19:56:50.881935+0000, chain.objs.size()=1 2024-09-12T18:36:01.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.178__shadow_.miFNbnnzDRS9QmwtkxmV61e1uew0jza_0 2024-09-12T18:36:01.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-uDgC85o4L68LmoqNMdHllXJP4p8D4I', time=2024-09-12T19:57:32.469593+0000, chain.objs.size()=2 2024-09-12T18:36:01.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.202__multipart_mymultipart.2~-uDgC85o4L68LmoqNMdHllXJP4p8D4I.1 2024-09-12T18:36:01.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.202__shadow_mymultipart.2~-uDgC85o4L68LmoqNMdHllXJP4p8D4I.1_1 2024-09-12T18:36:01.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12236857148025316429', time=2024-09-12T20:00:16.993739+0000, chain.objs.size()=1 2024-09-12T18:36:01.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.232__shadow_.eZbfzn8F7VdUg68o_ClCeiJpkJMZJ0I_0 2024-09-12T18:36:01.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.536381364273702876', time=2024-09-12T20:00:20.382122+0000, chain.objs.size()=1 2024-09-12T18:36:01.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.234__shadow_.SgUY-jCOO2ApzG2EZ_puUyBAze2Wgsm_0 2024-09-12T18:36:01.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9091798538854846510', time=2024-09-12T20:01:03.197116+0000, chain.objs.size()=1 2024-09-12T18:36:01.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.258__shadow_.2vF6qXzG3dcEXhY23W72If713M9GoD8_0 2024-09-12T18:36:01.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5320113258361053447', time=2024-09-12T20:01:08.014573+0000, chain.objs.size()=1 2024-09-12T18:36:01.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.261__shadow_.7UrDeDC0-vUGRiRSae4XnMVe47LbucQ_0 2024-09-12T18:36:01.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17770698159878816536', time=2024-09-12T20:01:09.743021+0000, chain.objs.size()=1 2024-09-12T18:36:01.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.262__shadow_.AOLQfvTLXJhP05NpXfshUM-nXc9wU38_0 2024-09-12T18:36:01.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16482988395801697996', time=2024-09-12T20:02:52.043147+0000, chain.objs.size()=1 2024-09-12T18:36:01.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._EgZun-tglZ3rQOWzsQKt0mel-nDHoi_0 2024-09-12T18:36:01.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1693517506561741695', time=2024-09-12T20:02:52.810617+0000, chain.objs.size()=1 2024-09-12T18:36:01.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.1qxrrdnHpP7msi1LQJFbY27s1Aj3oDX_0 2024-09-12T18:36:01.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10466554762026642956', time=2024-09-12T20:02:54.125510+0000, chain.objs.size()=1 2024-09-12T18:36:01.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.712+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.95AeoJD_sEBmHbg3Rkym7Tntn7r03aN_0 2024-09-12T18:36:01.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2146924270169965238', time=2024-09-12T20:02:54.127046+0000, chain.objs.size()=1 2024-09-12T18:36:01.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.7TT8biUszvDLKVWEQXpe3uFPdisrcbb_0 2024-09-12T18:36:01.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6711220307315432257', time=2024-09-12T20:02:54.897007+0000, chain.objs.size()=1 2024-09-12T18:36:01.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.b_HBDrk2Wh4CbRofdtk_1DdTdv6b7sM_0 2024-09-12T18:36:01.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5000942047199603227', time=2024-09-12T20:02:57.069949+0000, chain.objs.size()=1 2024-09-12T18:36:01.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.IsTN_iua3YwcUYzK71mdNpL48Xcexsd_0 2024-09-12T18:36:01.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5918642480435721410', time=2024-09-12T20:02:57.153730+0000, chain.objs.size()=1 2024-09-12T18:36:01.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.CwqwHCR1YwItFgntBWXwR_cAUDKt1lS_0 2024-09-12T18:36:01.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8600099409049283684', time=2024-09-12T20:02:57.712582+0000, chain.objs.size()=1 2024-09-12T18:36:01.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.YUc_iINqOyGh0lVqGJMT_h-8vc55Pzo_0 2024-09-12T18:36:01.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7822777966558723323', time=2024-09-12T20:02:57.830837+0000, chain.objs.size()=1 2024-09-12T18:36:01.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.FsHyZBrO-4sy512t6F-AreypY9Tiq0Y_0 2024-09-12T18:36:01.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5271207453146728993', time=2024-09-12T20:02:58.173543+0000, chain.objs.size()=1 2024-09-12T18:36:01.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Lqrx5GhVv-9mVEK9FFvRx9MohJlVYgA_0 2024-09-12T18:36:01.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10310205630756322432', time=2024-09-12T20:02:58.347433+0000, chain.objs.size()=1 2024-09-12T18:36:01.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.tIiPJtZGhOoFTKQSMCqXrB-N7kHvoHh_0 2024-09-12T18:36:01.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15096724999759355946', time=2024-09-12T20:03:01.924297+0000, chain.objs.size()=1 2024-09-12T18:36:01.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.716+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.t9tFfvNquKgsw93hpLtMTfUamewpWzX_0 2024-09-12T18:36:01.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16255761085090791926', time=2024-09-12T20:03:02.143097+0000, chain.objs.size()=1 2024-09-12T18:36:01.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.6S2i9QFrRYjlgfE2rpk7kh0CAwOtd16_0 2024-09-12T18:36:01.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6839277430091023093', time=2024-09-12T20:03:03.534783+0000, chain.objs.size()=1 2024-09-12T18:36:01.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.jM_QQOoFDe584n6PpAsvXDThFGLcKFf_0 2024-09-12T18:36:01.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9885119823948951823', time=2024-09-12T20:03:04.302435+0000, chain.objs.size()=1 2024-09-12T18:36:01.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.iaX05GJHSyT1i4bJmSUiFth11TQnJkS_0 2024-09-12T18:36:01.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5392630669995041048', time=2024-09-12T20:03:04.303719+0000, chain.objs.size()=1 2024-09-12T18:36:01.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.m4t7baHHUdnhtqJh6GczI4NVJtk6R8u_0 2024-09-12T18:36:01.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2902758349264090910', time=2024-09-12T20:03:04.538416+0000, chain.objs.size()=1 2024-09-12T18:36:01.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.8TyEFVAdXWN1CtM9bcbIu4FTE0XSgKy_0 2024-09-12T18:36:01.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14856579786622703228', time=2024-09-12T20:03:09.069854+0000, chain.objs.size()=1 2024-09-12T18:36:01.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.h50cyRFSZJBUoLX-OuY9Y0lV8t7AECM_0 2024-09-12T18:36:01.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5934844568189428542', time=2024-09-12T20:03:09.507822+0000, chain.objs.size()=1 2024-09-12T18:36:01.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wMrsVmN0VCNHXahCN1KkYjcXoVyF8Be_0 2024-09-12T18:36:01.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2451062984601992487', time=2024-09-12T20:03:09.904658+0000, chain.objs.size()=1 2024-09-12T18:36:01.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.LzcIyWVPlyrd_Z6O4h7reZrItIUCndv_0 2024-09-12T18:36:01.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13710321949615021240', time=2024-09-12T20:03:11.006561+0000, chain.objs.size()=1 2024-09-12T18:36:01.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.720+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.i9mYhho98DTt3G1u9KT7eD5QbNF85WO_0 2024-09-12T18:36:01.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.724+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7121130754925744070', time=2024-09-12T20:03:11.008248+0000, chain.objs.size()=1 2024-09-12T18:36:01.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.724+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.l9GHjoHH_sHx6QN8jYTdZXA9eE8d6Qt_0 2024-09-12T18:36:01.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.724+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4240004742518652166', time=2024-09-12T20:03:12.651415+0000, chain.objs.size()=1 2024-09-12T18:36:01.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.724+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.1HuaIk1rmrtlZJLHvrC0CrUit1xbF3S_0 2024-09-12T18:36:01.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.724+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9431958431595021219', time=2024-09-12T20:03:14.668675+0000, chain.objs.size()=1 2024-09-12T18:36:01.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.724+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.cBqGf4h8jdtFtQldBdsSHJG3x1ZashW_0 2024-09-12T18:36:01.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.724+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6280837274025329952', time=2024-09-12T20:03:14.782483+0000, chain.objs.size()=1 2024-09-12T18:36:01.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.724+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.4NPvU3Tq-F-UlSj0ZZHS-zxAkrC4P1x_0 2024-09-12T18:36:01.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.724+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.761655832562553036', time=2024-09-12T20:03:14.904345+0000, chain.objs.size()=1 2024-09-12T18:36:01.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.724+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._KCQY11w97ipNTs5pVTnWTC3uxjbhSt_0 2024-09-12T18:36:01.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1667406128009634886', time=2024-09-12T20:03:15.095341+0000, chain.objs.size()=1 2024-09-12T18:36:01.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2ezqDc_W7ef-hcympHU2NWtlUHbGmZR_0 2024-09-12T18:36:01.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8939261107071312261', time=2024-09-12T20:03:17.444670+0000, chain.objs.size()=1 2024-09-12T18:36:01.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.voY3YcL1hhSV9vP5CfqeDLfqcE4I8Ng_0 2024-09-12T18:36:01.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4715437256476912923', time=2024-09-12T20:03:18.341503+0000, chain.objs.size()=1 2024-09-12T18:36:01.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.8fDUy0Lof8Jr2m2Ska-gImwDcadipTE_0 2024-09-12T18:36:01.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6663883427277162285', time=2024-09-12T20:03:19.477908+0000, chain.objs.size()=1 2024-09-12T18:36:01.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wygoyZhQJuNjZmC5-BP0sqFggxJOQiG_0 2024-09-12T18:36:01.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14962918101288037753', time=2024-09-12T20:03:19.693021+0000, chain.objs.size()=1 2024-09-12T18:36:01.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.HBVPYOnj1idrMrvF7nllXNdcGZPhF2C_0 2024-09-12T18:36:01.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15575591439957163970', time=2024-09-12T20:03:19.979053+0000, chain.objs.size()=1 2024-09-12T18:36:01.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.jp_R5bDSxnBMgkc9mbBoyhSgO7eIdY__0 2024-09-12T18:36:01.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7728361792719019370', time=2024-09-12T20:03:20.210681+0000, chain.objs.size()=1 2024-09-12T18:36:01.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.MQ7fX1P5WdgcZ3yvvWE7aanOolkpwTl_0 2024-09-12T18:36:01.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4971200542471528552', time=2024-09-12T20:03:37.776653+0000, chain.objs.size()=1 2024-09-12T18:36:01.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.274__shadow_.E6QWG6SHjhwTRMTf9svvcRoNWnF6fYB_0 2024-09-12T18:36:01.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12864068070469433625', time=2024-09-12T20:03:37.794700+0000, chain.objs.size()=1 2024-09-12T18:36:01.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.274__shadow_.BEZwS6HjS1HyJrCf48hKEc4-pFIjDlz_0 2024-09-12T18:36:01.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4900523480743367362', time=2024-09-12T20:03:46.039179+0000, chain.objs.size()=1 2024-09-12T18:36:01.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.279__shadow_.5zZtZfZOJ3ibSqwjd-7-vFfSOIZCoia_0 2024-09-12T18:36:01.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10423577655803305266', time=2024-09-12T20:04:01.455127+0000, chain.objs.size()=1 2024-09-12T18:36:01.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.728+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.288__shadow_.tqKREtN2ucl_HVuKwbE6tBowyPSO0uF_0 2024-09-12T18:36:01.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13426435218878733252', time=2024-09-12T20:04:04.865698+0000, chain.objs.size()=1 2024-09-12T18:36:01.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.290__shadow_.Uk4q0OyYwEhJ93GPs613l042KB1s2ph_0 2024-09-12T18:36:01.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3025198626622011895', time=2024-09-12T20:04:26.714672+0000, chain.objs.size()=1 2024-09-12T18:36:01.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.299__shadow_.Zg_4Be8BAIZoTBjpvO5lbup_xKmKoss_0 2024-09-12T18:36:01.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.593005140086565900', time=2024-09-12T20:06:51.404109+0000, chain.objs.size()=1 2024-09-12T18:36:01.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.H74qTRxB7H0z1YK-yo3_Bo7dV0TgnVK_0 2024-09-12T18:36:01.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15770698708798108559', time=2024-09-12T20:06:55.828132+0000, chain.objs.size()=1 2024-09-12T18:36:01.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.nTLb6YpGQQ6XBTsbHP0RF-6EvEOYcKB_0 2024-09-12T18:36:01.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17467721880999564052', time=2024-09-12T20:06:57.146204+0000, chain.objs.size()=1 2024-09-12T18:36:01.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.hlW738kAlSewSwawgPTjtjE8tQ42PJ2_0 2024-09-12T18:36:01.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2434260384854077994', time=2024-09-12T20:06:57.372331+0000, chain.objs.size()=1 2024-09-12T18:36:01.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.osVvuHgWnW0r7w1iiOC67xnQMFoiR2B_0 2024-09-12T18:36:01.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16611678045508249517', time=2024-09-12T20:06:58.746132+0000, chain.objs.size()=1 2024-09-12T18:36:01.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.f35f8rfFgOsKx59wevczJ_EFXElWEI9_0 2024-09-12T18:36:01.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9442998609017040638', time=2024-09-12T20:06:59.662054+0000, chain.objs.size()=1 2024-09-12T18:36:01.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.EQvFPuVfXn-ABq1Fe1S0uMSlLJVvv4i_0 2024-09-12T18:36:01.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4224290504590387109', time=2024-09-12T20:07:00.183634+0000, chain.objs.size()=1 2024-09-12T18:36:01.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.-tEtn8xgxSpm4_R13uC8kcsbQwIqyus_0 2024-09-12T18:36:01.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9106572326204679765', time=2024-09-12T20:07:00.497413+0000, chain.objs.size()=1 2024-09-12T18:36:01.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.scdmUZDNFg8qadNii4hekD-el-xiv92_0 2024-09-12T18:36:01.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2255904070522653701', time=2024-09-12T20:07:00.868106+0000, chain.objs.size()=1 2024-09-12T18:36:01.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.732+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.YKzKypGWGLr2MZHnQqS_fGIwQI2wqPu_0 2024-09-12T18:36:01.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1073156762668058069', time=2024-09-12T20:07:03.023836+0000, chain.objs.size()=1 2024-09-12T18:36:01.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.lRvxErh6A6r25IjiSy2HvH2TxcPojwj_0 2024-09-12T18:36:01.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13044007191419840592', time=2024-09-12T20:07:04.293100+0000, chain.objs.size()=1 2024-09-12T18:36:01.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.LTTNunLimMA2nhchzKWGHq3NqpqpKrV_0 2024-09-12T18:36:01.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9150428249743464963', time=2024-09-12T20:07:05.321432+0000, chain.objs.size()=1 2024-09-12T18:36:01.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.YeMxVAJfMSlyQq7dLc5RKDBMaZmVLT3_0 2024-09-12T18:36:01.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16152002474672278982', time=2024-09-12T20:07:06.746367+0000, chain.objs.size()=1 2024-09-12T18:36:01.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.HouGWwx_tJUwH1jxR7L3dsFPTiEU-Px_0 2024-09-12T18:36:01.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1146744598050394391', time=2024-09-12T20:07:08.670359+0000, chain.objs.size()=1 2024-09-12T18:36:01.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.SvVAn8cEhd7EV75Qv2tXQOBWJpe_N0e_0 2024-09-12T18:36:01.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10368152133703289400', time=2024-09-12T20:07:09.014365+0000, chain.objs.size()=1 2024-09-12T18:36:01.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.e4BNnd-WmJTN9wszMMasyp3e4F2YWY7_0 2024-09-12T18:36:01.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17677709801107884082', time=2024-09-12T20:07:09.889318+0000, chain.objs.size()=1 2024-09-12T18:36:01.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.yhbbIFT7b-oOIyv3NiTig7dV1ZLmlrr_0 2024-09-12T18:36:01.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2902380926059459354', time=2024-09-12T20:07:10.283756+0000, chain.objs.size()=1 2024-09-12T18:36:01.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.HJS4AlKvNqjZlVBOysnornjH-PQaCLZ_0 2024-09-12T18:36:01.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12664728325197909235', time=2024-09-12T20:07:11.396828+0000, chain.objs.size()=1 2024-09-12T18:36:01.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.I-vkWKN9Yo229mg2nJ4MIQAlhA0sOMB_0 2024-09-12T18:36:01.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4191127681597891117', time=2024-09-12T20:07:13.686703+0000, chain.objs.size()=1 2024-09-12T18:36:01.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.QZ29IVODrpOcZzKfvQDEEwS0U52w2Pd_0 2024-09-12T18:36:01.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2043544090133813113', time=2024-09-12T20:07:13.979211+0000, chain.objs.size()=1 2024-09-12T18:36:01.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.736+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Li1IjTwngjL-mOioP79A8z7GumBKNQS_0 2024-09-12T18:36:01.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11522406265958203763', time=2024-09-12T20:07:14.726893+0000, chain.objs.size()=1 2024-09-12T18:36:01.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.uMYyPFA8-cdMmW_aPFaGh5UPRi_CMxl_0 2024-09-12T18:36:01.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6717080632039479148', time=2024-09-12T20:07:16.983651+0000, chain.objs.size()=1 2024-09-12T18:36:01.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ClAjpwUdj6RoZf6KvmIJIqLu59904Xy_0 2024-09-12T18:36:01.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10069251078386411727', time=2024-09-12T20:07:17.013270+0000, chain.objs.size()=1 2024-09-12T18:36:01.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ukmSM_9956Qa47NBjBWso7cyBDzhsRZ_0 2024-09-12T18:36:01.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7120101981948664478', time=2024-09-12T20:07:17.017821+0000, chain.objs.size()=1 2024-09-12T18:36:01.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.iXQhVUu_IhHfuDlT1O2PtJp01qDePfH_0 2024-09-12T18:36:01.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9028858541151751513', time=2024-09-12T20:07:17.779749+0000, chain.objs.size()=1 2024-09-12T18:36:01.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.o8HVzFf7b-qlYHB4RI5maKxJB1YP0D0_0 2024-09-12T18:36:01.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1755802709901678850', time=2024-09-12T20:09:02.415449+0000, chain.objs.size()=1 2024-09-12T18:36:01.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.AXqJbvpAJ05f25KQpY-RrAvaIjJZ6zp_0 2024-09-12T18:36:01.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1073640201527552876', time=2024-09-12T20:09:02.425810+0000, chain.objs.size()=1 2024-09-12T18:36:01.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.f-TwdSiaEy1bNOTPwHdtCB6Yo3leRab_0 2024-09-12T18:36:01.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5446761341664333363', time=2024-09-12T20:09:03.401014+0000, chain.objs.size()=1 2024-09-12T18:36:01.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Mtyv8gScKYCQnv1vXXwjj5LBnp75Nfo_0 2024-09-12T18:36:01.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14186448647389748765', time=2024-09-12T20:09:04.416038+0000, chain.objs.size()=1 2024-09-12T18:36:01.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.uytkTzBlpguerhhAWBmtWQ6McDC3Dtt_0 2024-09-12T18:36:01.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2285133181642625770', time=2024-09-12T20:09:05.754048+0000, chain.objs.size()=1 2024-09-12T18:36:01.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.4hoKeXnneTHlIiuDxCsrSS-f1ZVpjTq_0 2024-09-12T18:36:01.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17213131398689910272', time=2024-09-12T20:09:05.763843+0000, chain.objs.size()=1 2024-09-12T18:36:01.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.740+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.aN6BCx-gTN4zS0UyYSmw5fhrk1_WD8d_0 2024-09-12T18:36:01.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3677845201568145861', time=2024-09-12T20:09:06.251378+0000, chain.objs.size()=1 2024-09-12T18:36:01.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.umjK3rDJXfR5d4-hyLMlkeXkY30oZui_0 2024-09-12T18:36:01.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6246295725676917588', time=2024-09-12T20:09:07.746942+0000, chain.objs.size()=1 2024-09-12T18:36:01.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.k4l9a02uItCY-PH0En9ySAYJUr_LmQf_0 2024-09-12T18:36:01.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3854148578481399914', time=2024-09-12T20:09:10.030876+0000, chain.objs.size()=1 2024-09-12T18:36:01.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.usjonNM7CdR891G_qPO0GaLjaTXSRD0_0 2024-09-12T18:36:01.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13849536033034782895', time=2024-09-12T20:09:11.298288+0000, chain.objs.size()=1 2024-09-12T18:36:01.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.UetrK3PK4t7_FKIvmobN4Hlwu0JQWnb_0 2024-09-12T18:36:01.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12958258754614055319', time=2024-09-12T20:09:12.093288+0000, chain.objs.size()=1 2024-09-12T18:36:01.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.zj36gxDgi6krMrrk8llXi9g9vWWXptb_0 2024-09-12T18:36:01.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3906360679688365746', time=2024-09-12T20:09:12.254861+0000, chain.objs.size()=1 2024-09-12T18:36:01.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.HodWXWbaur9qF16pkfS64mXM8i1u0YF_0 2024-09-12T18:36:01.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17476300350734652428', time=2024-09-12T20:09:13.364244+0000, chain.objs.size()=1 2024-09-12T18:36:01.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.lsy-UyNSV71YtzsQ4_Dqjj0Z3qi4QDr_0 2024-09-12T18:36:01.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17601269462348647524', time=2024-09-12T20:09:14.723517+0000, chain.objs.size()=1 2024-09-12T18:36:01.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.6NTeXDDEWcGSE8djS92bj5h1RYeSV1W_0 2024-09-12T18:36:01.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12899930477626539017', time=2024-09-12T20:09:15.236255+0000, chain.objs.size()=1 2024-09-12T18:36:01.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.aIkIUJ-EvZqchOM40nOPxcwnof4KajJ_0 2024-09-12T18:36:01.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1518028552015351492', time=2024-09-12T20:09:17.346837+0000, chain.objs.size()=1 2024-09-12T18:36:01.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.egkMKyUGRVDpip4-MxuDz3JDzH8kCwL_0 2024-09-12T18:36:01.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7020810593382766024', time=2024-09-12T20:09:18.880156+0000, chain.objs.size()=1 2024-09-12T18:36:01.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.4c62Fc1WAERVN7GIy6OAh_pfRWLP8Hz_0 2024-09-12T18:36:01.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5526030587065475787', time=2024-09-12T20:09:19.187556+0000, chain.objs.size()=1 2024-09-12T18:36:01.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.744+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.7l-p88FbaEimVt8p_A0w1q0x1ft4ri5_0 2024-09-12T18:36:01.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.748+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11887741458982958980', time=2024-09-12T20:09:19.504568+0000, chain.objs.size()=1 2024-09-12T18:36:01.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.748+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.fs7JD6Q-ixzr4nlWIF4wfdGj6hjLqEE_0 2024-09-12T18:36:01.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.748+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17391558814613832942', time=2024-09-12T20:09:20.659149+0000, chain.objs.size()=1 2024-09-12T18:36:01.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.748+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.koOPbeFFDOk8h58Sg8p0C8lLoAgAKX9_0 2024-09-12T18:36:01.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.748+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8904545458713674734', time=2024-09-12T20:09:20.858021+0000, chain.objs.size()=1 2024-09-12T18:36:01.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.748+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.lLcl-8_JgWsVDtbmyv-aedkOrXqGjcc_0 2024-09-12T18:36:01.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.748+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11088527278025436126', time=2024-09-12T20:09:20.984615+0000, chain.objs.size()=1 2024-09-12T18:36:01.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.748+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.3gRnYh_vzJpzfWZCFoQWExko6zUp-7t_0 2024-09-12T18:36:01.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.752+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16482441356568770335', time=2024-09-12T20:09:22.631113+0000, chain.objs.size()=1 2024-09-12T18:36:01.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.752+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.oH1ol8J6rONkv6Blw3pagiEWJr4ULz1_0 2024-09-12T18:36:01.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.752+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17969847937260234934', time=2024-09-12T20:09:24.522036+0000, chain.objs.size()=1 2024-09-12T18:36:01.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.752+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Jv36OnBosto8DineGwjYf5EysXeRtUU_0 2024-09-12T18:36:01.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.752+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17720159010917348959', time=2024-09-12T20:09:25.003521+0000, chain.objs.size()=1 2024-09-12T18:36:01.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.752+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Sml-PDN5P2j_fMVaGbDwsb_29M5mGOy_0 2024-09-12T18:36:01.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.752+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6377532439770905543', time=2024-09-12T20:09:25.713478+0000, chain.objs.size()=1 2024-09-12T18:36:01.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.752+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5EVvGxtEQv-wptMT-Iw93A6ogwP-o3a_0 2024-09-12T18:36:01.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.752+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3858095237634154974', time=2024-09-12T20:09:26.006885+0000, chain.objs.size()=1 2024-09-12T18:36:01.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.752+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cCsPSivCnPCpvMNObk-JzbKrl11cUWa_0 2024-09-12T18:36:01.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.752+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10579827954807761018', time=2024-09-12T20:09:26.490194+0000, chain.objs.size()=1 2024-09-12T18:36:01.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.752+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.3WnXK-_IhwnpQaeHGiuvy44d8i7WstS_0 2024-09-12T18:36:01.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.756+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45147 2024-09-12T18:36:01.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:36:01.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7567684329187898937', time=2024-09-12T20:09:27.964982+0000, chain.objs.size()=1 2024-09-12T18:36:01.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5-19I4sqXOfVL9otvEXF_47iXvIHajh_0 2024-09-12T18:36:01.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17639605362675186829', time=2024-09-12T20:09:28.091701+0000, chain.objs.size()=1 2024-09-12T18:36:01.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.pEaXqI0rLRIWGwZ5FC2OkazDwNgsiC6_0 2024-09-12T18:36:01.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12875025375848971774', time=2024-09-12T20:09:29.508587+0000, chain.objs.size()=1 2024-09-12T18:36:01.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vb9FawYByRBH58x6Tv-_KH-9XlU-Y8f_0 2024-09-12T18:36:01.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6288239156179658293', time=2024-09-12T20:09:29.570161+0000, chain.objs.size()=1 2024-09-12T18:36:01.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.-rKd29SBKaX03CGkVFNj8LMPlEqHX6__0 2024-09-12T18:36:01.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17181459855847073288', time=2024-09-12T20:09:29.859725+0000, chain.objs.size()=1 2024-09-12T18:36:01.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.TbyF8nAzNL4O32xtiviYccYI-llRwQP_0 2024-09-12T18:36:01.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7576057274539633401', time=2024-09-12T20:09:30.042933+0000, chain.objs.size()=1 2024-09-12T18:36:01.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.paX_68dkRUZ9aZVt3bUiBhRb4LujDtB_0 2024-09-12T18:36:01.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1378292336072932877', time=2024-09-12T20:12:30.833869+0000, chain.objs.size()=1 2024-09-12T18:36:01.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.459__shadow_.PjDX0gHdpq7VGfWPrfKkNb8L_82QdhE_0 2024-09-12T18:36:01.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12555816615642084043', time=2024-09-12T20:13:29.309482+0000, chain.objs.size()=1 2024-09-12T18:36:01.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.497__shadow_.jbnJkG3iatHGBXOj2pLszSXTsG2jUAU_0 2024-09-12T18:36:01.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9831298888417512957', time=2024-09-12T20:16:48.129190+0000, chain.objs.size()=2 2024-09-12T18:36:01.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.526__multipart_mymultipart.2~MvfK1qOh66X_crfeawbPXZjkvnK3H47.1 2024-09-12T18:36:01.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.526__multipart_mymultipart.2~MvfK1qOh66X_crfeawbPXZjkvnK3H47.2 2024-09-12T18:36:01.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4336362288980492556', time=2024-09-12T20:17:34.873189+0000, chain.objs.size()=4 2024-09-12T18:36:01.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.536__multipart_mymultipart.2~G7lm1_WeWXtn_-qX_81PHEj5mbNorpX.1 2024-09-12T18:36:01.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.760+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.536__multipart_mymultipart.2~G7lm1_WeWXtn_-qX_81PHEj5mbNorpX.2 2024-09-12T18:36:01.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.536__multipart_mymultipart.1MoQtRu1gp3I1qsHPdKyNMOjlqyCrg0C.3 2024-09-12T18:36:01.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.536__multipart_mymultipart.2~G7lm1_WeWXtn_-qX_81PHEj5mbNorpX.4 2024-09-12T18:36:01.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2618429478249519758', time=2024-09-12T20:18:34.495312+0000, chain.objs.size()=1 2024-09-12T18:36:01.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.558__shadow_.csMabfHS2Pl4PUjPnSNs9tfy7tVxB_j_0 2024-09-12T18:36:01.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5369684902533382328', time=2024-09-12T20:19:14.585078+0000, chain.objs.size()=1 2024-09-12T18:36:01.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:Qyp2XiPBUL5yDzEsLO51myZP1Mm2ZId_.N2b5Ru1vbiyk-NDY2rqUOuM5FTwoWaD_0 2024-09-12T18:36:01.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15074839753921473970', time=2024-09-12T20:19:52.146162+0000, chain.objs.size()=1 2024-09-12T18:36:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.577__shadow:sAfhGhbk2nS8GO15IDgCR24K.ILV3VG_.WQX2XdR6M5koSb0wJI41WY2jse1f-pG_0 2024-09-12T18:36:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2378469620171999988', time=2024-09-12T20:20:15.080537+0000, chain.objs.size()=1 2024-09-12T18:36:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:PuXPVTQ9o8f36Gmtb5yK4z0JpMVzMjV_.DbDhVp-xn5Dd8Et0S_vmKl7TSOIidFx_0 2024-09-12T18:36:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4181408401639572880', time=2024-09-12T20:20:19.802753+0000, chain.objs.size()=1 2024-09-12T18:36:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:rnv7EewwhHIjHsbHyabdRH6JjF.D-ro_.XUUnx0IAoXpH2-weRqnHn_niNWNKACG_0 2024-09-12T18:36:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8773833344620364237', time=2024-09-12T20:21:27.807530+0000, chain.objs.size()=1 2024-09-12T18:36:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.588__shadow:InXReGHnRO3qYleEWqoEmfFDpbMyvy._.FylfM4lN97v-8o0cDrInyJ4LExqYY-M_0 2024-09-12T18:36:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5820609071865252144', time=2024-09-12T20:26:27.925549+0000, chain.objs.size()=1 2024-09-12T18:36:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.628__shadow_.QHA6-Vv4rLetEa7qaInAq4ITYcCd2p__0 2024-09-12T18:36:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5605970086685537200', time=2024-09-12T20:27:47.891125+0000, chain.objs.size()=12 2024-09-12T18:36:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.661__multipart_bar.2~etOpbQVSXo7K8tnqvq7H3YN5qph1op1.1 2024-09-12T18:36:01.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.764+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.661__shadow_bar.2~etOpbQVSXo7K8tnqvq7H3YN5qph1op1.1_1 2024-09-12T18:36:01.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.768+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.661__multipart_bar.2~etOpbQVSXo7K8tnqvq7H3YN5qph1op1.2 2024-09-12T18:36:01.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.768+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.661__shadow_bar.2~etOpbQVSXo7K8tnqvq7H3YN5qph1op1.2_1 2024-09-12T18:36:01.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.768+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.661__multipart_bar.2~etOpbQVSXo7K8tnqvq7H3YN5qph1op1.3 2024-09-12T18:36:01.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.768+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.661__shadow_bar.2~etOpbQVSXo7K8tnqvq7H3YN5qph1op1.3_1 2024-09-12T18:36:01.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.768+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.661__multipart_bar.2~etOpbQVSXo7K8tnqvq7H3YN5qph1op1.4 2024-09-12T18:36:01.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.772+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.661__shadow_bar.2~etOpbQVSXo7K8tnqvq7H3YN5qph1op1.4_1 2024-09-12T18:36:01.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.772+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.661__multipart_bar.2~etOpbQVSXo7K8tnqvq7H3YN5qph1op1.5 2024-09-12T18:36:01.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.772+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.661__shadow_bar.2~etOpbQVSXo7K8tnqvq7H3YN5qph1op1.5_1 2024-09-12T18:36:01.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.772+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.661__multipart_bar.2~etOpbQVSXo7K8tnqvq7H3YN5qph1op1.6 2024-09-12T18:36:01.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.772+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.661__shadow_bar.2~etOpbQVSXo7K8tnqvq7H3YN5qph1op1.6_1 2024-09-12T18:36:01.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.776+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:01.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:36:01.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:01.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:01.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/56150' 2024-09-12T18:36:01.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_8s46vlaBiLvKvYuVWizbk_F_8A-m-Qk', time=2024-09-12T19:56:08.387934+0000, chain.objs.size()=3 2024-09-12T18:36:01.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.8KjSNoj6b3ych3R_s6yMEPNLDjjNLtS_0 2024-09-12T18:36:01.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.8KjSNoj6b3ych3R_s6yMEPNLDjjNLtS_1 2024-09-12T18:36:01.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.161__shadow_.8KjSNoj6b3ych3R_s6yMEPNLDjjNLtS_2 2024-09-12T18:36:01.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.494957613848118612', time=2024-09-12T20:00:39.014997+0000, chain.objs.size()=1 2024-09-12T18:36:01.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.244__shadow_.9htzT1eeIgSaTv2rR6LgzFzrwuhBs3d_0 2024-09-12T18:36:01.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15656305755593217748', time=2024-09-12T20:00:39.016689+0000, chain.objs.size()=1 2024-09-12T18:36:01.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.244__shadow_.o0YVVyBJZ7Wf5nI42jXmZTMtq7OR8IM_0 2024-09-12T18:36:01.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17167351308302618073', time=2024-09-12T20:01:01.622572+0000, chain.objs.size()=1 2024-09-12T18:36:01.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.257__shadow_.qVG4sfSCBk3W6vCfjeLsWucPnNyufIq_0 2024-09-12T18:36:01.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13414413369607069890', time=2024-09-12T20:02:52.343197+0000, chain.objs.size()=1 2024-09-12T18:36:01.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.h4MKFgXcrzF4eXZzWXWMme6brfidHs5_0 2024-09-12T18:36:01.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4065341834759044290', time=2024-09-12T20:02:53.178875+0000, chain.objs.size()=1 2024-09-12T18:36:01.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.uczHWrJrnAJYi4j3yjBwkauIR-GOwYF_0 2024-09-12T18:36:01.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12157140653442296348', time=2024-09-12T20:02:57.423193+0000, chain.objs.size()=1 2024-09-12T18:36:01.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.NbpxU4f46QNTLaZMw7fwXU3ikVhRZZ9_0 2024-09-12T18:36:01.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10503255742340706636', time=2024-09-12T20:03:01.240248+0000, chain.objs.size()=1 2024-09-12T18:36:01.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.hR60heg9awldabYWPqUHb2vmDNabmEN_0 2024-09-12T18:36:01.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2203047412087172672', time=2024-09-12T20:03:02.048689+0000, chain.objs.size()=1 2024-09-12T18:36:01.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qyA7C8XGBSRN_Rq_d8ZP_DKMSMQSeHj_0 2024-09-12T18:36:01.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15945786271887311273', time=2024-09-12T20:03:03.541810+0000, chain.objs.size()=1 2024-09-12T18:36:01.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.780+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.3a4_GRkdpowoxNlCXKzos4Ach7XKhnE_0 2024-09-12T18:36:01.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5552803011354559121', time=2024-09-12T20:03:03.942458+0000, chain.objs.size()=1 2024-09-12T18:36:01.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Rzwfu2P3XrdFpTrRFA0zcqxFjW1-mij_0 2024-09-12T18:36:01.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13756827313182838288', time=2024-09-12T20:03:07.376367+0000, chain.objs.size()=1 2024-09-12T18:36:01.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.FvaJdvf1khMEqA0i3c73NdZjiZNpW_p_0 2024-09-12T18:36:01.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10898615783450822607', time=2024-09-12T20:03:09.358969+0000, chain.objs.size()=1 2024-09-12T18:36:01.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ph0WD29IO7ZM1JoOhcSVCf3RPuxk8P2_0 2024-09-12T18:36:01.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14153525382367802635', time=2024-09-12T20:03:10.172267+0000, chain.objs.size()=1 2024-09-12T18:36:01.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.opDuS0R6srLh24MGvDpl5t9UPAwhKfE_0 2024-09-12T18:36:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15078813555332454497', time=2024-09-12T20:03:11.531929+0000, chain.objs.size()=1 2024-09-12T18:36:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.mrnxQ5g_lYHSphFPttZs-sU8zkx2qdo_0 2024-09-12T18:36:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17974115789465777004', time=2024-09-12T20:03:12.220783+0000, chain.objs.size()=1 2024-09-12T18:36:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.9Lc3XVMRAkxQ8V8C3twT8fnCvuejz5N_0 2024-09-12T18:36:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5697462277595779618', time=2024-09-12T20:03:12.643218+0000, chain.objs.size()=1 2024-09-12T18:36:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.6iuIi_zdXAOvqoADAqw43CsuD70BOay_0 2024-09-12T18:36:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2103540201873248171', time=2024-09-12T20:03:13.698447+0000, chain.objs.size()=1 2024-09-12T18:36:01.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.QlnsmFIV70LQ44I4KKBPx1Kvnl822yX_0 2024-09-12T18:36:01.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5090202379543899645', time=2024-09-12T20:03:15.090196+0000, chain.objs.size()=1 2024-09-12T18:36:01.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.56HZbGhW-yJALM_x_2NNnSmkyo3jiQD_0 2024-09-12T18:36:01.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5753482451161266608', time=2024-09-12T20:03:15.398051+0000, chain.objs.size()=1 2024-09-12T18:36:01.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.KanjrSYj6JX2Q3rXeKIBJ8wvp6i-vSF_0 2024-09-12T18:36:01.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17525543334995119218', time=2024-09-12T20:03:15.451124+0000, chain.objs.size()=1 2024-09-12T18:36:01.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.784+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.zL8o7MqjcbgIc9tXchAuR6wZMxpklEC_0 2024-09-12T18:36:01.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16069685099340470287', time=2024-09-12T20:03:15.491903+0000, chain.objs.size()=1 2024-09-12T18:36:01.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.pJPDrOFjQm_xxQ5sIpkQal-HMCXe1go_0 2024-09-12T18:36:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15852952445101493052', time=2024-09-12T20:03:15.887884+0000, chain.objs.size()=1 2024-09-12T18:36:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Txezcw8VvYdVsKqJ2jgcnHUTxTFRCfx_0 2024-09-12T18:36:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17094349635316462166', time=2024-09-12T20:03:16.336620+0000, chain.objs.size()=1 2024-09-12T18:36:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2-VJs7TtCBigMtxFE1ZMDFOq4HY2ELd_0 2024-09-12T18:36:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18152347928878507478', time=2024-09-12T20:03:17.399110+0000, chain.objs.size()=1 2024-09-12T18:36:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.nBlo-Awp_aBlEcmk7ihJLEhdUz3_Dkm_0 2024-09-12T18:36:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11506837478235620396', time=2024-09-12T20:03:18.407333+0000, chain.objs.size()=1 2024-09-12T18:36:01.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.-5HBrWujFg3B4V6naliUAEzxf210YFF_0 2024-09-12T18:36:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.969573772689107818', time=2024-09-12T20:03:20.668832+0000, chain.objs.size()=1 2024-09-12T18:36:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.T8hCSLJ-4pimJIQFMefC4naPDYHLn97_0 2024-09-12T18:36:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11782780641303281711', time=2024-09-12T20:03:26.943353+0000, chain.objs.size()=1 2024-09-12T18:36:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.267__shadow_.4pUl1WOVLHcTDXXkWSoDag1CIcxw52W_0 2024-09-12T18:36:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8592949078655535210', time=2024-09-12T20:03:34.775962+0000, chain.objs.size()=1 2024-09-12T18:36:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.272__shadow_.3u6IX-UUTo8u1m26a7TvtGt2Nf_ZZdn_0 2024-09-12T18:36:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11379618454019387735', time=2024-09-12T20:03:37.787926+0000, chain.objs.size()=1 2024-09-12T18:36:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.274__shadow_.hKoi6EtpxFFyPpZ3tBTMpLANVGQ_S9m_0 2024-09-12T18:36:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11849503982897181571', time=2024-09-12T20:03:41.038565+0000, chain.objs.size()=1 2024-09-12T18:36:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.276__shadow_.LvxtJV-Guj8jyqDfv3HpksUX_IdbANv_0 2024-09-12T18:36:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17415198198951838838', time=2024-09-12T20:03:59.799161+0000, chain.objs.size()=1 2024-09-12T18:36:01.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.788+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.287__shadow_.0IY9NLn_a1MZodJkVWzfhe9VCzrjcWT_0 2024-09-12T18:36:01.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.792+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11803399443846432420', time=2024-09-12T20:04:17.960095+0000, chain.objs.size()=1 2024-09-12T18:36:01.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.792+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.K-OoYMAok2WYXGsDQysCeJkL0ZU9a0h_0 2024-09-12T18:36:01.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7025099042265152817', time=2024-09-12T20:04:17.961978+0000, chain.objs.size()=1 2024-09-12T18:36:01.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.294__shadow_.YA24otu4bLdxx5cBIPTwBEANI4eKwu7_0 2024-09-12T18:36:01.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10836705933125080316', time=2024-09-12T20:04:30.258338+0000, chain.objs.size()=1 2024-09-12T18:36:01.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.301__shadow_.QMHLXbn0se8niKOk_9d7VovATXilRv-_0 2024-09-12T18:36:01.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9098400253750334821', time=2024-09-12T20:04:35.262530+0000, chain.objs.size()=1 2024-09-12T18:36:01.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.304__shadow_.g4_nAo1gd8V6AV_TSr2zW0f30_hyf4D_0 2024-09-12T18:36:01.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.818091420763202411', time=2024-09-12T20:06:51.022221+0000, chain.objs.size()=1 2024-09-12T18:36:01.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.fgFiOp5fYOYvDjhURQ4hKO5jjuAiMl4_0 2024-09-12T18:36:01.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10161433989194890224', time=2024-09-12T20:06:51.328884+0000, chain.objs.size()=1 2024-09-12T18:36:01.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.42gaqCm3lrXxrGlJaVwFUHwnFszRRu2_0 2024-09-12T18:36:01.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15695864247255221254', time=2024-09-12T20:06:51.330652+0000, chain.objs.size()=1 2024-09-12T18:36:01.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.sejvcW_8CZap0XPBKc2qiEIpzD4-68__0 2024-09-12T18:36:01.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6533814846054650904', time=2024-09-12T20:06:52.096242+0000, chain.objs.size()=1 2024-09-12T18:36:01.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.icKvH6__7iA3Bc1Kz3mozqTQG-TTGuL_0 2024-09-12T18:36:01.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16937977021128688087', time=2024-09-12T20:06:52.422396+0000, chain.objs.size()=1 2024-09-12T18:36:01.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.9WheWQPle5pJA1vsbAFjBv3cEZSx78D_0 2024-09-12T18:36:01.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3570174450919176185', time=2024-09-12T20:06:53.029436+0000, chain.objs.size()=1 2024-09-12T18:36:01.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.JkAHUNJwpJlstr0xHHDSwBLrIUtELdb_0 2024-09-12T18:36:01.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3351745438827246642', time=2024-09-12T20:06:53.809157+0000, chain.objs.size()=1 2024-09-12T18:36:01.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.796+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.RWRlEnFsj1QDwPXmbFTFJ_apWzWgWdu_0 2024-09-12T18:36:01.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1035888135706719740', time=2024-09-12T20:06:55.025544+0000, chain.objs.size()=1 2024-09-12T18:36:01.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.pZroAOE2VWgyzoWKREWol-sQ8pzSuBi_0 2024-09-12T18:36:01.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.771781415311594773', time=2024-09-12T20:06:56.264187+0000, chain.objs.size()=1 2024-09-12T18:36:01.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Ame4Br6u9Ey2TUSmNBCD_O9hFwir5em_0 2024-09-12T18:36:01.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6465830099202082515', time=2024-09-12T20:06:56.572586+0000, chain.objs.size()=1 2024-09-12T18:36:01.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.jd9Sj8jXwvvOkFNZnbnLWH_a8bt0RAN_0 2024-09-12T18:36:01.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5939708121988146447', time=2024-09-12T20:06:57.633487+0000, chain.objs.size()=1 2024-09-12T18:36:01.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.TvxltuDiR0CLWJRUC7Hzrxb45fZkgih_0 2024-09-12T18:36:01.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15550614278801879506', time=2024-09-12T20:07:01.457458+0000, chain.objs.size()=1 2024-09-12T18:36:01.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.0fHwbxXeTaFtQKo9776rmDkWyJQpZz-_0 2024-09-12T18:36:01.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9303997390137198056', time=2024-09-12T20:07:03.234151+0000, chain.objs.size()=1 2024-09-12T18:36:01.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.JS_4o172V6utWbafUg2jpxUJKt558kD_0 2024-09-12T18:36:01.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10943014569334154381', time=2024-09-12T20:07:03.602777+0000, chain.objs.size()=1 2024-09-12T18:36:01.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.F8o_IUGPG9MVyoLyAgXUTKJyIdEyW7v_0 2024-09-12T18:36:01.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17212401291485848914', time=2024-09-12T20:07:03.604658+0000, chain.objs.size()=1 2024-09-12T18:36:01.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Cz8S7QXGjS0eJBbSsz0MISEG473sGaz_0 2024-09-12T18:36:01.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2433019567682252376', time=2024-09-12T20:07:04.717858+0000, chain.objs.size()=1 2024-09-12T18:36:01.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.IxoLOmfgJ4QBm9a6lEsMPPWlk7RrdAm_0 2024-09-12T18:36:01.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12576423198907657182', time=2024-09-12T20:07:06.588838+0000, chain.objs.size()=1 2024-09-12T18:36:01.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.W-YKyeKcrpR1eYdC29wUfqWxhjGEqlB_0 2024-09-12T18:36:01.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6079821870657736527', time=2024-09-12T20:07:09.006257+0000, chain.objs.size()=1 2024-09-12T18:36:01.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.tii0HRW0jzGl7H6Nd96fiQ8oj38xhny_0 2024-09-12T18:36:01.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6612645039283144772', time=2024-09-12T20:07:09.833017+0000, chain.objs.size()=1 2024-09-12T18:36:01.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.q9PVLtqLCtfTmpr2_GC4-o3RZ4DOzAC_0 2024-09-12T18:36:01.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17371103110435086677', time=2024-09-12T20:07:09.970031+0000, chain.objs.size()=1 2024-09-12T18:36:01.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.800+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.I6u4w2He2dIhmqQnv5W6wcxuy8tpEja_0 2024-09-12T18:36:01.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.804+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4461991260911230927', time=2024-09-12T20:07:14.824729+0000, chain.objs.size()=1 2024-09-12T18:36:01.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.804+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.c5zkgdcPevwHkptTHnRnX2lbtreQmKM_0 2024-09-12T18:36:01.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.804+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16820792364579739182', time=2024-09-12T20:07:15.182502+0000, chain.objs.size()=1 2024-09-12T18:36:01.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.804+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.FnhLj7wiW6frBBfORkuRysk8d7Ek1p__0 2024-09-12T18:36:01.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.804+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2252572970899780173', time=2024-09-12T20:07:18.825528+0000, chain.objs.size()=1 2024-09-12T18:36:01.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.804+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.lEtaotJkIQsuDSU7N8ndQrQIoTXMk8X_0 2024-09-12T18:36:01.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.804+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11572152091744775021', time=2024-09-12T20:09:02.630417+0000, chain.objs.size()=1 2024-09-12T18:36:01.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.804+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.OKdZbB8FwyWrr6QhN83KcmfUFuieTJ6_0 2024-09-12T18:36:01.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.804+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13134556758481175966', time=2024-09-12T20:09:03.325193+0000, chain.objs.size()=1 2024-09-12T18:36:01.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.804+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.iZhmq1rt9RQqZjurAWDGsAoXcRu8dVt_0 2024-09-12T18:36:01.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16047203703081817799', time=2024-09-12T20:09:03.383975+0000, chain.objs.size()=1 2024-09-12T18:36:01.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.eURuqyuf0EypaKwA4-V5Yfk-QiCE7-i_0 2024-09-12T18:36:01.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3866873732003953935', time=2024-09-12T20:09:03.962236+0000, chain.objs.size()=1 2024-09-12T18:36:01.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.7iHki9oS8TfL13x8frBw62bxfyildPZ_0 2024-09-12T18:36:01.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7439834042918472408', time=2024-09-12T20:09:04.523958+0000, chain.objs.size()=1 2024-09-12T18:36:01.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.eJWWJL95zq_N2S-6-sQ5d-Lvt_d2v45_0 2024-09-12T18:36:01.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1104351416527748284', time=2024-09-12T20:09:04.698943+0000, chain.objs.size()=1 2024-09-12T18:36:01.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.1tizBs-xd6SZ7X9iIrPb-dNun_1nER4_0 2024-09-12T18:36:01.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9624376703448572892', time=2024-09-12T20:09:07.023101+0000, chain.objs.size()=1 2024-09-12T18:36:01.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.emFAW9yaMpwgImT4QdkuZJP17Iu4Dh5_0 2024-09-12T18:36:01.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11674196092703985610', time=2024-09-12T20:09:08.188203+0000, chain.objs.size()=1 2024-09-12T18:36:01.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.R6nEvDodF3kvEMQVdNr_UBJczxUbs8T_0 2024-09-12T18:36:01.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1486321227519966622', time=2024-09-12T20:09:09.689486+0000, chain.objs.size()=1 2024-09-12T18:36:01.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.iZ5rGrBu-kb66qj1f-aetKLQ0INI601_0 2024-09-12T18:36:01.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5595075460401720762', time=2024-09-12T20:09:10.056466+0000, chain.objs.size()=1 2024-09-12T18:36:01.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.6N-XsDhTL-k8lCw7zqpVmtCrTTpWVEe_0 2024-09-12T18:36:01.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11826625537427240754', time=2024-09-12T20:09:11.609125+0000, chain.objs.size()=1 2024-09-12T18:36:01.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ZwouTrYHcf3wX7MAPb2o3NPGzLBFRlu_0 2024-09-12T18:36:01.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13549327710439562424', time=2024-09-12T20:09:14.363899+0000, chain.objs.size()=1 2024-09-12T18:36:01.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.808+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.DAK-jXBKE4YN2r9SUmJLDP_ki4558VJ_0 2024-09-12T18:36:01.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8505029793771707279', time=2024-09-12T20:09:14.474818+0000, chain.objs.size()=1 2024-09-12T18:36:01.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.BXWF5TL5GLu-1-e3-lPM_okzJOdvMgG_0 2024-09-12T18:36:01.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1167528816110938331', time=2024-09-12T20:09:14.893738+0000, chain.objs.size()=1 2024-09-12T18:36:01.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.yIvQsN6yuqT6qnV3eowrXlxZ0ikzShp_0 2024-09-12T18:36:01.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18191227765299803053', time=2024-09-12T20:09:15.036372+0000, chain.objs.size()=1 2024-09-12T18:36:01.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.F9Pxsa_TadDyNAkxRkvHse_METCDiN5_0 2024-09-12T18:36:01.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7914995024771904973', time=2024-09-12T20:09:15.344640+0000, chain.objs.size()=1 2024-09-12T18:36:01.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.6dlBBzNf6FO-3vqFRGsl7foCalGDSjT_0 2024-09-12T18:36:01.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11331643100621385915', time=2024-09-12T20:09:15.938217+0000, chain.objs.size()=1 2024-09-12T18:36:01.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.NdAHj1PEKX2GDmeLQMQqNwgPm9vmzQ9_0 2024-09-12T18:36:01.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13596024115647695158', time=2024-09-12T20:09:17.048875+0000, chain.objs.size()=1 2024-09-12T18:36:01.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.xGizRDuBeEfqDJ-Q9LuhvQOnrbi-ozZ_0 2024-09-12T18:36:01.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15827787334706545222', time=2024-09-12T20:09:17.881851+0000, chain.objs.size()=1 2024-09-12T18:36:01.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.DPKpefb6cCYoLLLFRqioALOrredk17q_0 2024-09-12T18:36:01.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12297717454749597712', time=2024-09-12T20:09:19.671488+0000, chain.objs.size()=1 2024-09-12T18:36:01.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Uv7euAWms7LJEXI5kE2ICIomBkPNFvu_0 2024-09-12T18:36:01.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16024888519063209799', time=2024-09-12T20:09:21.737201+0000, chain.objs.size()=1 2024-09-12T18:36:01.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.812+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.fLoFjl6VBqgSa4dLgFvz7ar7tvAqTBI_0 2024-09-12T18:36:01.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9185842999693623434', time=2024-09-12T20:09:22.118671+0000, chain.objs.size()=1 2024-09-12T18:36:01.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.LjcMp2QKS-h2gwHXdBFr-z5JMj8hega_0 2024-09-12T18:36:01.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10981543020993811025', time=2024-09-12T20:09:23.788562+0000, chain.objs.size()=1 2024-09-12T18:36:01.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.E-_bHgvMQU4sRX-MdKJ4pTf02rymtPE_0 2024-09-12T18:36:01.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16486182418323139275', time=2024-09-12T20:09:24.597454+0000, chain.objs.size()=1 2024-09-12T18:36:01.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.vYzmYUByxChLU8CQDaWxMK8aaQuAp9D_0 2024-09-12T18:36:01.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3541147952171960566', time=2024-09-12T20:09:26.727429+0000, chain.objs.size()=1 2024-09-12T18:36:01.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.6IxqtpGyegxPKBKy4Ydajfx-lVJFf2J_0 2024-09-12T18:36:01.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14039326730708915164', time=2024-09-12T20:09:27.004234+0000, chain.objs.size()=1 2024-09-12T18:36:01.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.tG028ub3JUENGZAumATAimEAhOmgEdV_0 2024-09-12T18:36:01.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7878230005994332833', time=2024-09-12T20:09:27.094464+0000, chain.objs.size()=1 2024-09-12T18:36:01.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.ZirLhMPjV7bUIl6BwgPbBdkc2gxRLFu_0 2024-09-12T18:36:01.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11639146488698385700', time=2024-09-12T20:09:27.277325+0000, chain.objs.size()=1 2024-09-12T18:36:01.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.f_8gfy-MnjhChqkOZL_3WU0Prlda7yI_0 2024-09-12T18:36:01.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2190658563578076616', time=2024-09-12T20:09:29.774627+0000, chain.objs.size()=1 2024-09-12T18:36:01.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.4ctJThSlxTcLc6CRYysYrYXaNebKK6Q_0 2024-09-12T18:36:01.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1582026883039261626', time=2024-09-12T20:09:30.188586+0000, chain.objs.size()=1 2024-09-12T18:36:01.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.JWvkHyuEbJGsWq24X7dVRaBU1TF_dKE_0 2024-09-12T18:36:01.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17928086634123429512', time=2024-09-12T20:11:19.017371+0000, chain.objs.size()=1 2024-09-12T18:36:01.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.408__shadow_.qftPFmyZCp2CSpqkLBUDZnTcWAEy0md_0 2024-09-12T18:36:01.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2930993414636808850', time=2024-09-12T20:12:05.380192+0000, chain.objs.size()=1 2024-09-12T18:36:01.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.443__shadow_.kcEeRIs-mBCHdV7aLimyD6wzO7Ex6Vy_0 2024-09-12T18:36:01.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15906774308353127614', time=2024-09-12T20:13:15.530594+0000, chain.objs.size()=4 2024-09-12T18:36:01.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.487__shadow_.HqLmY8cIRrURRVHwv1zCRi8Tojevr2c_0 2024-09-12T18:36:01.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.816+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.487__shadow_.HqLmY8cIRrURRVHwv1zCRi8Tojevr2c_1 2024-09-12T18:36:01.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.820+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.487__shadow_.HqLmY8cIRrURRVHwv1zCRi8Tojevr2c_2 2024-09-12T18:36:01.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.820+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.487__shadow_.HqLmY8cIRrURRVHwv1zCRi8Tojevr2c_3 2024-09-12T18:36:01.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.820+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4293156053048804772', time=2024-09-12T20:13:58.523421+0000, chain.objs.size()=6 2024-09-12T18:36:01.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.820+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.1 2024-09-12T18:36:01.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.820+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.2 2024-09-12T18:36:01.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.820+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.3 2024-09-12T18:36:01.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.820+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.4 2024-09-12T18:36:01.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.820+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.5 2024-09-12T18:36:01.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.508__multipart_srcmultipart.2~hysJulq9sYv4UxB_zRdRGuk2A3DVMom.6 2024-09-12T18:36:01.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.824+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~yJym7Ux88Sjfzu_Cx8dqjzlxRs2b0WM', time=2024-09-12T20:15:37.203632+0000, chain.objs.size()=1 2024-09-12T18:36:01.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~yJym7Ux88Sjfzu_Cx8dqjzlxRs2b0WM.3 2024-09-12T18:36:01.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.824+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14168011013811834638', time=2024-09-12T20:16:31.647078+0000, chain.objs.size()=2 2024-09-12T18:36:01.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.524__multipart_mymultipart.2~xZsnAxK6kosdQLd-2Aqr7hirpE49-LJ.1 2024-09-12T18:36:01.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.524__multipart_mymultipart.2~xZsnAxK6kosdQLd-2Aqr7hirpE49-LJ.2 2024-09-12T18:36:01.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.824+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5177494656572947907', time=2024-09-12T20:19:05.806257+0000, chain.objs.size()=1 2024-09-12T18:36:01.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.570__shadow:IjNr2rcEBgklba-wtIQnHQOVOsb4QmG_.s2yQuxgAvwJ2UrYRP0ETQ09HO5PhHQw_0 2024-09-12T18:36:01.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.824+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13074018538169853335', time=2024-09-12T20:19:50.753187+0000, chain.objs.size()=1 2024-09-12T18:36:01.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.824+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.577__shadow:IEGa1TzOy0uKkZHuuCx.K5h5CTkxUrB_.upArsCquzeqHx-by3-9xZyVZbDWivqV_0 2024-09-12T18:36:01.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.828+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17993808714368569969', time=2024-09-12T20:20:22.610289+0000, chain.objs.size()=1 2024-09-12T18:36:01.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.828+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.578__shadow:EVO.0-9J-CYzF8X-Lzzb58jkPhBp9Xr_.9jKzwmJ89Udb10Dm7xcKxX9BsoGltTf_0 2024-09-12T18:36:01.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.828+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11299206925209721498', time=2024-09-12T20:21:54.603939+0000, chain.objs.size()=1 2024-09-12T18:36:01.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.828+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.609__shadow_.Uq5WrwHHZ5WDK06D3svQsSxbNYOhfZd_0 2024-09-12T18:36:01.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.828+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4483061719307188849', time=2024-09-12T20:27:51.381063+0000, chain.objs.size()=1 2024-09-12T18:36:01.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.828+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.664__shadow_.xoDwUtlGkdMVH7uDfonja3Dq2FeksXM_0 2024-09-12T18:36:01.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.832+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/56150 2024-09-12T18:36:01.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.836+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:36:01.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.836+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18129902571972440430', time=2024-09-12T20:28:44.179754+0000, chain.objs.size()=1 2024-09-12T18:36:01.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.836+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.702__shadow:nl50iqdqfajO.gjXbve2HsB17tki25Y_.IlqQf5GpbPIT20GAl-Q1f4KqR2dvApW_0 2024-09-12T18:36:01.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.836+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15936291053536274050', time=2024-09-12T20:28:51.212848+0000, chain.objs.size()=1 2024-09-12T18:36:01.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.836+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.706__shadow:6GWRK63AlSkqyMEBHUDs5Zxsffboyll_.-in2tm5NYKvMvfKuiTAZFzz_BrD97x6_0 2024-09-12T18:36:01.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.836+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17848975384625632010', time=2024-09-12T20:29:04.936080+0000, chain.objs.size()=1 2024-09-12T18:36:01.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.836+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.715__shadow:rbf99nVBqG7.cdehfz.Av0pV6fqG8a._.Oukb24yHSezdlRwQLSA77zz6TIz2AJW_0 2024-09-12T18:36:01.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.836+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11037696812037500481', time=2024-09-12T20:30:12.902575+0000, chain.objs.size()=1 2024-09-12T18:36:01.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.836+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.743__multipart_mymultipart3.2~dPkyW3hnq_f_3kU-a5kbdnu6ZIRs6F3.1 2024-09-12T18:36:01.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.836+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:01.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:36:01.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:36:01.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:36:01.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48700' 2024-09-12T18:36:01.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10901283973306326406', time=2024-09-12T20:00:34.830063+0000, chain.objs.size()=1 2024-09-12T18:36:01.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.242__shadow_.SYrUnNb1p44Vv0ODxiYojyETwiCAUBf_0 2024-09-12T18:36:01.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7244387479743422472', time=2024-09-12T20:00:48.231915+0000, chain.objs.size()=1 2024-09-12T18:36:01.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.249__shadow_.YbWEl3fHs-0S_ew0X56d1By7JQfyadG_0 2024-09-12T18:36:01.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2261998996786204930', time=2024-09-12T20:01:07.994149+0000, chain.objs.size()=1 2024-09-12T18:36:01.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.261__shadow_.fjpPVoyWRozuUx-179KcJCOF3JOB8Wm_0 2024-09-12T18:36:01.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2348215569363256932', time=2024-09-12T20:02:52.272102+0000, chain.objs.size()=1 2024-09-12T18:36:01.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.qIRbJRd_qKNOkhFOtIV9YtBCuXVTGA1_0 2024-09-12T18:36:01.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15033132703088612687', time=2024-09-12T20:02:54.312381+0000, chain.objs.size()=1 2024-09-12T18:36:01.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.0TeO46-3XYFgwmC8MStvOviQgDTGVhX_0 2024-09-12T18:36:01.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5510527377564225681', time=2024-09-12T20:02:54.910038+0000, chain.objs.size()=1 2024-09-12T18:36:01.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.P75NM3QSdKZAAi1eGSg-9xzKvhdsPtR_0 2024-09-12T18:36:01.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5937577114338507845', time=2024-09-12T20:02:56.661397+0000, chain.objs.size()=1 2024-09-12T18:36:01.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.15FYyiser0F1Zd9_nOcjdC50IYKnr7h_0 2024-09-12T18:36:01.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1286553511178147962', time=2024-09-12T20:02:56.663048+0000, chain.objs.size()=1 2024-09-12T18:36:01.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.30VGAX6t29szdl6J_ytJSI6wIACRItD_0 2024-09-12T18:36:01.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7672229476679859914', time=2024-09-12T20:02:58.012468+0000, chain.objs.size()=1 2024-09-12T18:36:01.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.cRLXaP6B0F7N6KQeSGtUCLgly36r9lv_0 2024-09-12T18:36:01.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13127700405866956827', time=2024-09-12T20:02:58.259120+0000, chain.objs.size()=1 2024-09-12T18:36:01.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Om7_QFUv-LRAypuy5bv6Wn9rX5LQBWh_0 2024-09-12T18:36:01.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4414614617754556401', time=2024-09-12T20:02:58.742055+0000, chain.objs.size()=1 2024-09-12T18:36:01.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.YsH0AD4igXVHKyyy7vTweyPE9hNsNoA_0 2024-09-12T18:36:01.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5763879621850114702', time=2024-09-12T20:02:59.926967+0000, chain.objs.size()=1 2024-09-12T18:36:01.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.840+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.EDbkxYLi_lR5lBk5tIyHYldwZ7b1JHf_0 2024-09-12T18:36:01.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8309043434882757651', time=2024-09-12T20:03:00.890417+0000, chain.objs.size()=1 2024-09-12T18:36:01.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.BR5n6FOkc4fM7TgxT80ZW8aIsBKA-rn_0 2024-09-12T18:36:01.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14804115884545104981', time=2024-09-12T20:03:01.681598+0000, chain.objs.size()=1 2024-09-12T18:36:01.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.HjzY65F9jr3PByWyUmsHGbMq6ge-ozb_0 2024-09-12T18:36:01.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9409104555677746369', time=2024-09-12T20:03:01.950776+0000, chain.objs.size()=1 2024-09-12T18:36:01.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.pzPqkHl7kxQ6Uy7cBKptkjSIzu55kAC_0 2024-09-12T18:36:01.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6567177266329250528', time=2024-09-12T20:03:02.542910+0000, chain.objs.size()=1 2024-09-12T18:36:01.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.S-oXb7VsAeQ_60Xz63EUdhdNAPeGt9v_0 2024-09-12T18:36:01.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6257118472973054857', time=2024-09-12T20:03:03.625310+0000, chain.objs.size()=1 2024-09-12T18:36:01.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.L-1MW47pJ8C0ksX9t9CH1D_8RJbHYRh_0 2024-09-12T18:36:01.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12382718054587581659', time=2024-09-12T20:03:04.550025+0000, chain.objs.size()=1 2024-09-12T18:36:01.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.4GQOwepfBGO_wbv6WjpvETwUEoK0mhP_0 2024-09-12T18:36:01.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11518678102091555541', time=2024-09-12T20:03:04.830259+0000, chain.objs.size()=1 2024-09-12T18:36:01.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.u_rVWy0li0Avk8D1WldYG5EjzQ5XR2b_0 2024-09-12T18:36:01.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12312351079039847757', time=2024-09-12T20:03:05.278226+0000, chain.objs.size()=1 2024-09-12T18:36:01.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.hJnChQB6EFcKmhycCtcItkOIj2pC0K2_0 2024-09-12T18:36:01.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10426454243397769091', time=2024-09-12T20:03:07.849557+0000, chain.objs.size()=1 2024-09-12T18:36:01.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.844+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.vmmqyjYYFu6gR_06IiqB72K3L4VD6du_0 2024-09-12T18:36:01.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6626834442367172696', time=2024-09-12T20:03:08.231006+0000, chain.objs.size()=1 2024-09-12T18:36:01.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.0fmveE9b0Jg9HYu6c529WUx822clnZU_0 2024-09-12T18:36:01.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7009614649162888703', time=2024-09-12T20:03:08.896414+0000, chain.objs.size()=1 2024-09-12T18:36:01.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_._pKffFafBbnsFRq_5Mhs_xyRnv1MtyW_0 2024-09-12T18:36:01.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13605540684448236107', time=2024-09-12T20:03:09.683177+0000, chain.objs.size()=1 2024-09-12T18:36:01.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.2bHRF47sqP5sX4rXU9HLrDyVamJUwqh_0 2024-09-12T18:36:01.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8558766207980300165', time=2024-09-12T20:03:10.207925+0000, chain.objs.size()=1 2024-09-12T18:36:01.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.Qi0hkmQD6WtR4EDva1ysjZdEc17QVhE_0 2024-09-12T18:36:01.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11819809965846624085', time=2024-09-12T20:03:13.355552+0000, chain.objs.size()=1 2024-09-12T18:36:01.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.NiHmz34KfoU7lp7vdwpAFtY4In2oJKY_0 2024-09-12T18:36:01.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8380770776805035228', time=2024-09-12T20:03:13.388622+0000, chain.objs.size()=1 2024-09-12T18:36:01.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.LDRUXmxFOQeJDH0qBnvr0_y41Ard02f_0 2024-09-12T18:36:01.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10734540600537775680', time=2024-09-12T20:03:13.668448+0000, chain.objs.size()=1 2024-09-12T18:36:01.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.eRfsPIxC9dvsWwefUNaLMLzr1rij711_0 2024-09-12T18:36:01.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14226249085042805869', time=2024-09-12T20:03:14.679543+0000, chain.objs.size()=1 2024-09-12T18:36:01.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.8cwoMEAXk3BFiwrFydyWeQEjmkyGF_G_0 2024-09-12T18:36:01.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18341088080068450382', time=2024-09-12T20:03:14.784931+0000, chain.objs.size()=1 2024-09-12T18:36:01.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.GwAEiXmfAH2RC2IfTToQpxJIz16np_7_0 2024-09-12T18:36:01.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13035106244426694312', time=2024-09-12T20:03:16.304106+0000, chain.objs.size()=1 2024-09-12T18:36:01.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.848+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.ul6_lG8aapiZ6qCHUF77osPFsZzKQY6_0 2024-09-12T18:36:01.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.852+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9681019942058024649', time=2024-09-12T20:03:16.565878+0000, chain.objs.size()=1 2024-09-12T18:36:01.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.852+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.XSby1axKNBJT5KfG93rY6Xzm8-T5-xT_0 2024-09-12T18:36:01.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.852+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15626031623507755495', time=2024-09-12T20:03:16.872763+0000, chain.objs.size()=1 2024-09-12T18:36:01.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.852+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.WE0hrJlVPQBWLmO7TdSMatt98LD5qBI_0 2024-09-12T18:36:01.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.852+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10699470565212849122', time=2024-09-12T20:03:17.359868+0000, chain.objs.size()=1 2024-09-12T18:36:01.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.852+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.wGxGkgCcILazPQDZzX2A4bLTQ8VYIm2_0 2024-09-12T18:36:01.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.852+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17686450014134607865', time=2024-09-12T20:03:17.417596+0000, chain.objs.size()=1 2024-09-12T18:36:01.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.852+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.6hXx11OxCDZq_0FtheRtufil8Yowlo3_0 2024-09-12T18:36:01.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.852+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6774580787754758719', time=2024-09-12T20:03:18.929919+0000, chain.objs.size()=1 2024-09-12T18:36:01.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.852+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.dDPVCakRt8A01AWviZd4XsjVliSfqFB_0 2024-09-12T18:36:01.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.852+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6209475906982785794', time=2024-09-12T20:03:19.147566+0000, chain.objs.size()=1 2024-09-12T18:36:01.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.852+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.LZHFBQHwbHbNqXKWlPyYliYe1woqqsQ_0 2024-09-12T18:36:01.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.852+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1540216565352116932', time=2024-09-12T20:03:20.625914+0000, chain.objs.size()=1 2024-09-12T18:36:01.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.852+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.263__shadow_.4SgE8vKN5TSPJ8mS0CS8ROPyOzcCPOt_0 2024-09-12T18:36:01.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17942235872506484977', time=2024-09-12T20:03:22.259783+0000, chain.objs.size()=1 2024-09-12T18:36:01.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.264__shadow_.EV5eTALOlDyQ8vnOf3bNJiogcOA36Cs_0 2024-09-12T18:36:01.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4045513595852707795', time=2024-09-12T20:03:22.273175+0000, chain.objs.size()=1 2024-09-12T18:36:01.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.264__shadow_.M4gVfhT1OtOXRjnkZRVb7XlYNmlWuen_0 2024-09-12T18:36:01.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5466533794951402277', time=2024-09-12T20:03:52.756956+0000, chain.objs.size()=1 2024-09-12T18:36:01.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.283__shadow_.i2MZexkIaFZdfiXwwX9lAlej0k-6Ujm_0 2024-09-12T18:36:01.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17304955814362733149', time=2024-09-12T20:04:24.951891+0000, chain.objs.size()=1 2024-09-12T18:36:01.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.298__shadow_.rhwG2-CtdOMmkuzRGPQ4MIU53ggDuDg_0 2024-09-12T18:36:01.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3375259804278863884', time=2024-09-12T20:04:43.346326+0000, chain.objs.size()=1 2024-09-12T18:36:01.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.308__shadow:K6kPF8r-AeKQE8UWxhi2PBYFxlSOqe0_.8r5tLU-HxwkzqO3ZiY6nPNBjMVV6q2X_0 2024-09-12T18:36:01.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15408158421040603665', time=2024-09-12T20:06:52.928198+0000, chain.objs.size()=1 2024-09-12T18:36:01.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Dcociqolvc5tq6lminvmBQQgarQR2Nd_0 2024-09-12T18:36:01.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10202498357567148585', time=2024-09-12T20:06:53.460612+0000, chain.objs.size()=1 2024-09-12T18:36:01.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.q7w6QfIMaijjmpvfddMmho4mR2KrSQq_0 2024-09-12T18:36:01.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9719729088700814425', time=2024-09-12T20:06:53.464133+0000, chain.objs.size()=1 2024-09-12T18:36:01.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.kHaKtA2fZbWKg787QyGA2UAT2pgXQtV_0 2024-09-12T18:36:01.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7241307388563514202', time=2024-09-12T20:06:55.710067+0000, chain.objs.size()=1 2024-09-12T18:36:01.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.856+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.PEn30578aYUWwG-Fkn_HvHKSDB1H9Cm_0 2024-09-12T18:36:01.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11162802725872869842', time=2024-09-12T20:06:57.766239+0000, chain.objs.size()=1 2024-09-12T18:36:01.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.d_rIKo9aa-RSiHu9xA78jR2O9MrzAk4_0 2024-09-12T18:36:01.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12015338277921418372', time=2024-09-12T20:07:01.282796+0000, chain.objs.size()=1 2024-09-12T18:36:01.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.cUPS-WntydVH5ti8L40p7r6gfl_S50g_0 2024-09-12T18:36:01.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14944182070374662017', time=2024-09-12T20:07:01.284311+0000, chain.objs.size()=1 2024-09-12T18:36:01.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.mKEV7XfHyYB_Dv3TTWMNcfSPCjA3Mu1_0 2024-09-12T18:36:01.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6630525697143535207', time=2024-09-12T20:07:02.617124+0000, chain.objs.size()=1 2024-09-12T18:36:01.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.F08roZOA85DIECaDPhLk54KatdeqQTE_0 2024-09-12T18:36:01.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14175113781365550068', time=2024-09-12T20:07:04.629474+0000, chain.objs.size()=1 2024-09-12T18:36:01.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.Rf65dbp38EQkyzUvdc53WKJtcRD0JHe_0 2024-09-12T18:36:01.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.8010589484865244090', time=2024-09-12T20:07:05.384806+0000, chain.objs.size()=1 2024-09-12T18:36:01.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.x1iTYLTq8BXmgFn00cCQAWhSHdlswrb_0 2024-09-12T18:36:01.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12176791775101271215', time=2024-09-12T20:07:07.588394+0000, chain.objs.size()=1 2024-09-12T18:36:01.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ohYc1d5lwqXi78smg0DTiqrUehSbbkQ_0 2024-09-12T18:36:01.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.7057574832617673725', time=2024-09-12T20:07:09.821171+0000, chain.objs.size()=1 2024-09-12T18:36:01.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.hWjm5L6rkhuhDsC_B9zMNqzzZAwmdD7_0 2024-09-12T18:36:01.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15098238390573679042', time=2024-09-12T20:07:10.314129+0000, chain.objs.size()=1 2024-09-12T18:36:01.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.7xDX95kRhTSsDHshLl54YEpbTz8YHBr_0 2024-09-12T18:36:01.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6872117780120478893', time=2024-09-12T20:07:11.441491+0000, chain.objs.size()=1 2024-09-12T18:36:01.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.860+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.uV15fMQdtvY3fX_HQ1YqvDRYJ5CdwnZ_0 2024-09-12T18:36:01.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17967753963255908317', time=2024-09-12T20:07:12.175439+0000, chain.objs.size()=1 2024-09-12T18:36:01.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.aFgwt1UKjYwAQeVFmzq9Fa5kA-CKrUr_0 2024-09-12T18:36:01.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16785848267271378356', time=2024-09-12T20:07:12.688057+0000, chain.objs.size()=1 2024-09-12T18:36:01.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.ImiGdQjjFavsHgRqiGWYIyZE7OtJ4tl_0 2024-09-12T18:36:01.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6453486799177594589', time=2024-09-12T20:07:15.146912+0000, chain.objs.size()=1 2024-09-12T18:36:01.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.oGmhbCo1PV1GevH1XsQo_l3EpNSQkkj_0 2024-09-12T18:36:01.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11368127292912202892', time=2024-09-12T20:07:15.903348+0000, chain.objs.size()=1 2024-09-12T18:36:01.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.p8wiVVlLN1O3viLtPMpdo2EFSPaG4l9_0 2024-09-12T18:36:01.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11936960249503322272', time=2024-09-12T20:07:16.072385+0000, chain.objs.size()=1 2024-09-12T18:36:01.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_._Lrv_Q6scpc1c00VVw82xxzNkqAZeEk_0 2024-09-12T18:36:01.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13332500662818156768', time=2024-09-12T20:07:16.188671+0000, chain.objs.size()=1 2024-09-12T18:36:01.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.slvbO5-3mA-4-2l5ChkLayP4TAsokVd_0 2024-09-12T18:36:01.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12440260028579165693', time=2024-09-12T20:07:18.998437+0000, chain.objs.size()=1 2024-09-12T18:36:01.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.324__shadow_.08ghJYr7vT2t-4dCYuZtkLeB9zKSdwh_0 2024-09-12T18:36:01.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16028764420223538962', time=2024-09-12T20:09:02.731716+0000, chain.objs.size()=1 2024-09-12T18:36:01.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.FIXgCOSMoPlnvOh6ZWt65E6GAODRrq1_0 2024-09-12T18:36:01.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17806309290155400045', time=2024-09-12T20:09:03.813777+0000, chain.objs.size()=1 2024-09-12T18:36:01.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.jDQIG2iG3wSBZCqihSmIY_55Hqj2SJU_0 2024-09-12T18:36:01.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.310499945784287261', time=2024-09-12T20:09:03.968768+0000, chain.objs.size()=1 2024-09-12T18:36:01.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.0S4e2UKnNrrpUx1ZSoetuophTRi1KDl_0 2024-09-12T18:36:01.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13102122698357440948', time=2024-09-12T20:09:04.085501+0000, chain.objs.size()=1 2024-09-12T18:36:01.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.864+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.X2ickD7ofcFXAgyUypZVIHcPh50TSqB_0 2024-09-12T18:36:01.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.18374149395009533970', time=2024-09-12T20:09:04.317077+0000, chain.objs.size()=1 2024-09-12T18:36:01.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.sxbuGCCn7SooaoCF01AAWufUQR9FG4g_0 2024-09-12T18:36:01.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.13047932008345488189', time=2024-09-12T20:09:06.094194+0000, chain.objs.size()=1 2024-09-12T18:36:01.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.fQ05oHKRCWdfA3KZbb0lL4cCHRe6elK_0 2024-09-12T18:36:01.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4213263096206044422', time=2024-09-12T20:09:06.520698+0000, chain.objs.size()=1 2024-09-12T18:36:01.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.zDoAiQfsdOC4n2uuIeTfCFseZETl7T5_0 2024-09-12T18:36:01.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2887315847453163467', time=2024-09-12T20:09:08.166963+0000, chain.objs.size()=1 2024-09-12T18:36:01.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.tjANdWgNXZ7c2o-AzIxYA7qgfxOVFnA_0 2024-09-12T18:36:01.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3202964316051314439', time=2024-09-12T20:09:10.064457+0000, chain.objs.size()=1 2024-09-12T18:36:01.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.Kgg6QlT9fdDT89gerkLerBuh_ilcYyN_0 2024-09-12T18:36:01.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6176016131922633062', time=2024-09-12T20:09:10.285372+0000, chain.objs.size()=1 2024-09-12T18:36:01.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.47SNPlt1A4lN4WbbsIQ_tgveI_umuxp_0 2024-09-12T18:36:01.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.9288695006288344310', time=2024-09-12T20:09:10.649604+0000, chain.objs.size()=1 2024-09-12T18:36:01.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.6PpYcP3jzwblTItnwrg3TTDskI-fBH3_0 2024-09-12T18:36:01.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.6567039413980171552', time=2024-09-12T20:09:10.858399+0000, chain.objs.size()=1 2024-09-12T18:36:01.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.kS5-E9Gy6zU3ALhSNJdso_upD6A8A0A_0 2024-09-12T18:36:01.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5622339385267033077', time=2024-09-12T20:09:10.999235+0000, chain.objs.size()=1 2024-09-12T18:36:01.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.868+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_._cxWlHM2wDN6BHwcWXScmepxmMwdp-5_0 2024-09-12T18:36:01.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.872+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12380034699083878774', time=2024-09-12T20:09:16.919131+0000, chain.objs.size()=1 2024-09-12T18:36:01.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.872+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cC0WVTv-M7aTUxl_INyX8Sh_E7swhsm_0 2024-09-12T18:36:01.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.872+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.896428384677619439', time=2024-09-12T20:09:17.537998+0000, chain.objs.size()=1 2024-09-12T18:36:01.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.872+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.MdC0kr5utRhAiLKeVUdBSv_p7xdcP0u_0 2024-09-12T18:36:01.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.872+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12748946405935775906', time=2024-09-12T20:09:17.688351+0000, chain.objs.size()=1 2024-09-12T18:36:01.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.872+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.A6Yf-GbH9kGTcsxq0n6HKKgHF7_TLN2_0 2024-09-12T18:36:01.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.872+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11553329954653235797', time=2024-09-12T20:09:19.598560+0000, chain.objs.size()=1 2024-09-12T18:36:01.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.872+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.XjJZ3-BPmWGNwr_joht7KqxBBFAWZpI_0 2024-09-12T18:36:01.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.2698629250629500671', time=2024-09-12T20:09:19.685749+0000, chain.objs.size()=1 2024-09-12T18:36:01.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.hlARXMFTULh17KxIknaYijn3G6a3uEv_0 2024-09-12T18:36:01.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15732704181586096299', time=2024-09-12T20:09:21.991616+0000, chain.objs.size()=1 2024-09-12T18:36:01.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.aQaeSy6A1CI4zlrFdo6tsumDUOYdAuD_0 2024-09-12T18:36:01.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17193042925678645625', time=2024-09-12T20:09:25.788061+0000, chain.objs.size()=1 2024-09-12T18:36:01.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.OgzYBoMHc5QjzpcQz7bUYG4jEftEe41_0 2024-09-12T18:36:01.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.10040018561330738006', time=2024-09-12T20:09:26.400025+0000, chain.objs.size()=1 2024-09-12T18:36:01.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.7EWDagTNCaTdfxC2EBFu0B6AHJipFDO_0 2024-09-12T18:36:01.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15857116190780057782', time=2024-09-12T20:09:26.403969+0000, chain.objs.size()=1 2024-09-12T18:36:01.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.CO0xONoa4G4en8VUwTifODPOVGo2HEe_0 2024-09-12T18:36:01.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3974579181965259991', time=2024-09-12T20:09:27.309448+0000, chain.objs.size()=1 2024-09-12T18:36:01.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.91gcaD5w6CNfwH_w3EkxZNgsqcm9-kQ_0 2024-09-12T18:36:01.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.15130580112472919160', time=2024-09-12T20:09:27.969721+0000, chain.objs.size()=1 2024-09-12T18:36:01.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.5nw4NjkKKLI5usWLWuZUN9MU9bcFWee_0 2024-09-12T18:36:01.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12453978132623742813', time=2024-09-12T20:09:28.089528+0000, chain.objs.size()=1 2024-09-12T18:36:01.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.cqzqWMNBIboPp0ZTdaIqAfW0Gxj9pvZ_0 2024-09-12T18:36:01.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.4554509409425442248', time=2024-09-12T20:09:28.115418+0000, chain.objs.size()=1 2024-09-12T18:36:01.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.o4wsMzS3Z0u_34wfOLSD4Ve8COY0rQR_0 2024-09-12T18:36:01.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11916912093665579053', time=2024-09-12T20:09:28.978358+0000, chain.objs.size()=1 2024-09-12T18:36:01.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.O7UTOY4cSK_zOFkuU5H2P2I_zd1MBo9_0 2024-09-12T18:36:01.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.988312116460471435', time=2024-09-12T20:09:29.185798+0000, chain.objs.size()=1 2024-09-12T18:36:01.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.l2vNqnb-IsjX34tSXYuLx3dJVsTfO75_0 2024-09-12T18:36:01.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.250671225262679000', time=2024-09-12T20:09:29.261455+0000, chain.objs.size()=1 2024-09-12T18:36:01.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.876+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.jiUIwLkf99KfSeQOy20Hdn0Iuulo6Dm_0 2024-09-12T18:36:01.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.3670816076099981513', time=2024-09-12T20:09:29.708574+0000, chain.objs.size()=1 2024-09-12T18:36:01.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.325__shadow_.jYW_-UGDosX-b0s2pjHxZOiMeT1qEVX_0 2024-09-12T18:36:01.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.5828425054384465634', time=2024-09-12T20:09:41.931138+0000, chain.objs.size()=1 2024-09-12T18:36:01.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.334__shadow_.2lw4dEY7IQJgOdRPCnAxG4u2bn_w_pO_0 2024-09-12T18:36:01.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.17259051280619190506', time=2024-09-12T20:10:29.863180+0000, chain.objs.size()=1 2024-09-12T18:36:01.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.374__shadow_.lgjrrAl9I_7H70p6IF4CSAgj3DCgSKW_0 2024-09-12T18:36:01.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.14845189373351787233', time=2024-09-12T20:10:33.543580+0000, chain.objs.size()=1 2024-09-12T18:36:01.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.376__shadow_.PR3agVv_yBlzLOVgxoX1IDOHGczKzpG_0 2024-09-12T18:36:01.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12886976269558150757', time=2024-09-12T20:12:26.764724+0000, chain.objs.size()=1 2024-09-12T18:36:01.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.457__shadow_.7sSTs_5ZfQFgSLghWB4obVq0eJjfrAl_0 2024-09-12T18:36:01.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.258113147562953526', time=2024-09-12T20:12:28.749520+0000, chain.objs.size()=1 2024-09-12T18:36:01.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.458__shadow_.2sAdKc0VkKWFlUh_JUJI-foCI6PMc1A_0 2024-09-12T18:36:01.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.880+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12141130696111634573', time=2024-09-12T20:12:39.080604+0000, chain.objs.size()=1 2024-09-12T18:36:01.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.880+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.463__shadow_.xt2lXwoQqiyMxEMZpLBculvvKas_0dD_0 2024-09-12T18:36:01.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.888+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48700 2024-09-12T18:36:01.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.892+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:36:01.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.892+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11376674963195794342', time=2024-09-12T20:16:14.100934+0000, chain.objs.size()=12 2024-09-12T18:36:01.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~8B821QMXUexFzCv3OGL_qfk5EmkjvRz.1 2024-09-12T18:36:01.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__shadow_mymultipart.2~8B821QMXUexFzCv3OGL_qfk5EmkjvRz.1_1 2024-09-12T18:36:01.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.ieS5F_5UOAN3OSf9S78dYaVXYVbrJigN.2 2024-09-12T18:36:01.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__shadow_mymultipart.ieS5F_5UOAN3OSf9S78dYaVXYVbrJigN.2_1 2024-09-12T18:36:01.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.ypoqffM3d8r8MHxzO0kgWfUYVWsG1C0x.3 2024-09-12T18:36:01.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__shadow_mymultipart.ypoqffM3d8r8MHxzO0kgWfUYVWsG1C0x.3_1 2024-09-12T18:36:01.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~8B821QMXUexFzCv3OGL_qfk5EmkjvRz.4 2024-09-12T18:36:01.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__shadow_mymultipart.2~8B821QMXUexFzCv3OGL_qfk5EmkjvRz.4_1 2024-09-12T18:36:01.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~8B821QMXUexFzCv3OGL_qfk5EmkjvRz.5 2024-09-12T18:36:01.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__shadow_mymultipart.2~8B821QMXUexFzCv3OGL_qfk5EmkjvRz.5_1 2024-09-12T18:36:01.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__multipart_mymultipart.2~8B821QMXUexFzCv3OGL_qfk5EmkjvRz.6 2024-09-12T18:36:01.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.892+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.523__shadow_mymultipart.2~8B821QMXUexFzCv3OGL_qfk5EmkjvRz.6_1 2024-09-12T18:36:01.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.896+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.11884479777312228677', time=2024-09-12T20:18:29.510078+0000, chain.objs.size()=1 2024-09-12T18:36:01.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.896+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.557__shadow_.nnH7ZvS7uK8k9vCMac-hg5UM54DUkB6_0 2024-09-12T18:36:01.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.896+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.1732353617726330543', time=2024-09-12T20:19:00.052509+0000, chain.objs.size()=1 2024-09-12T18:36:01.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.896+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.567__shadow_.ujvZvaqL_KUNoRIE-PktTnz168VjVdh_0 2024-09-12T18:36:01.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.896+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.136019227668127805', time=2024-09-12T20:21:26.593657+0000, chain.objs.size()=1 2024-09-12T18:36:01.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.896+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.588__shadow:mTwF.0rOVUAlazIHOHB1oKQ.lFfCnZv_.k--xc8uMfRgxJt0Gzc7iQO59UQDXYPW_0 2024-09-12T18:36:01.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.896+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.16518756050943816122', time=2024-09-12T20:22:38.580844+0000, chain.objs.size()=12 2024-09-12T18:36:01.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.896+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.614__multipart_multipart_enc.2~X-SWr9MTtlAxrSrjmKNt9cpH4lrpQPF.1 2024-09-12T18:36:01.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.896+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.614__shadow_multipart_enc.2~X-SWr9MTtlAxrSrjmKNt9cpH4lrpQPF.1_1 2024-09-12T18:36:01.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.896+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.614__multipart_multipart_enc.2~X-SWr9MTtlAxrSrjmKNt9cpH4lrpQPF.2 2024-09-12T18:36:01.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.896+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.614__shadow_multipart_enc.2~X-SWr9MTtlAxrSrjmKNt9cpH4lrpQPF.2_1 2024-09-12T18:36:01.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.896+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.614__multipart_multipart_enc.2~X-SWr9MTtlAxrSrjmKNt9cpH4lrpQPF.3 2024-09-12T18:36:01.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.896+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.614__shadow_multipart_enc.2~X-SWr9MTtlAxrSrjmKNt9cpH4lrpQPF.3_1 2024-09-12T18:36:01.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.896+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.614__multipart_multipart_enc.2~X-SWr9MTtlAxrSrjmKNt9cpH4lrpQPF.4 2024-09-12T18:36:01.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.896+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.614__shadow_multipart_enc.2~X-SWr9MTtlAxrSrjmKNt9cpH4lrpQPF.4_1 2024-09-12T18:36:01.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.900+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.614__multipart_multipart_enc.2~X-SWr9MTtlAxrSrjmKNt9cpH4lrpQPF.5 2024-09-12T18:36:01.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.900+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.614__shadow_multipart_enc.2~X-SWr9MTtlAxrSrjmKNt9cpH4lrpQPF.5_1 2024-09-12T18:36:01.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.900+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.614__multipart_multipart_enc.2~X-SWr9MTtlAxrSrjmKNt9cpH4lrpQPF.6 2024-09-12T18:36:01.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.900+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.614__shadow_multipart_enc.2~X-SWr9MTtlAxrSrjmKNt9cpH4lrpQPF.6_1 2024-09-12T18:36:01.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.900+0000 7f4eb342c9c0 20 garbage collection: RGWGC::process iterating over entry tag='4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.12747186076191845987', time=2024-09-12T20:29:17.595340+0000, chain.objs.size()=1 2024-09-12T18:36:01.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.900+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4832a6ae-eda0-431a-85d5-6b1af8837fa3.4665.717__shadow:wGNbywtRdPT.g1uOTm1kHpWu6ZSu52g_.fnB2iA6e-ihBjklTPfiimG0K_6LRXPy_0 2024-09-12T18:36:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.908+0000 7f4eb342c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:36:01.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.912+0000 7f4d677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:36:01.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.912+0000 7f4eb342c9c0 20 remove_watcher() i=0 2024-09-12T18:36:01.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.912+0000 7f4eb342c9c0 2 removed watcher, disabling cache 2024-09-12T18:36:01.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.916+0000 7f4eb342c9c0 20 remove_watcher() i=1 2024-09-12T18:36:01.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.916+0000 7f4eb342c9c0 20 remove_watcher() i=2 2024-09-12T18:36:01.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.916+0000 7f4eb342c9c0 20 remove_watcher() i=3 2024-09-12T18:36:01.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.916+0000 7f4eb342c9c0 20 remove_watcher() i=4 2024-09-12T18:36:01.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.920+0000 7f4eb342c9c0 20 remove_watcher() i=5 2024-09-12T18:36:01.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.920+0000 7f4eb342c9c0 20 remove_watcher() i=6 2024-09-12T18:36:01.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T18:36:01.920+0000 7f4eb342c9c0 20 remove_watcher() i=7 2024-09-12T18:36:01.935 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T18:36:01.946 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T18:36:02.014 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:36:02.014 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:36:02.352 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:36:02.367 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T18:36:02.375 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":2835,"stamp":"2024-09-12T18:36:00.841384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":933755108,"num_objects":4888,"num_object_clones":0,"num_object_copies":14139,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4888,"num_whiteouts":0,"num_read":289798,"num_read_kb":2879897,"num_write":159175,"num_write_kb":2776108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":213,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13343,"ondisk_log_size":13343,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3103128,"kb_used_data":1529324,"kb_used_omap":12,"kb_used_meta":1573619,"kb_avail":751871592,"statfs":{"total":773094113280,"available":769916510208,"internally_reserved":0,"allocated":1566027776,"data_stored":1548807839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1611386417},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-54138882,"num_objects":-183,"num_object_clones":0,"num_object_copies":-539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-183,"num_whiteouts":0,"num_read":220,"num_read_kb":292,"num_write":203,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008174"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.416560+0000","last_change":"2024-09-12T17:53:27.147438+0000","last_active":"2024-09-12T18:33:26.416560+0000","last_peered":"2024-09-12T18:33:26.416560+0000","last_clean":"2024-09-12T18:33:26.416560+0000","last_became_active":"2024-09-12T17:53:27.146780+0000","last_became_peered":"2024-09-12T17:53:27.146780+0000","last_unstale":"2024-09-12T18:33:26.416560+0000","last_undegraded":"2024-09-12T18:33:26.416560+0000","last_fullsized":"2024-09-12T18:33:26.416560+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:27.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"268'9","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:16.385996+0000","last_change":"2024-09-12T17:31:16.246161+0000","last_active":"2024-09-12T18:31:16.385996+0000","last_peered":"2024-09-12T18:31:16.385996+0000","last_clean":"2024-09-12T18:31:16.385996+0000","last_became_active":"2024-09-12T17:31:16.245482+0000","last_became_peered":"2024-09-12T17:31:16.245482+0000","last_unstale":"2024-09-12T18:31:16.385996+0000","last_undegraded":"2024-09-12T18:31:16.385996+0000","last_fullsized":"2024-09-12T18:31:16.385996+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:05.233527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099035,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":5245,"num_write":14,"num_write_kb":2121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:14.384819+0000","last_change":"2024-09-12T17:31:12.096770+0000","last_active":"2024-09-12T18:31:14.384819+0000","last_peered":"2024-09-12T18:31:14.384819+0000","last_clean":"2024-09-12T18:31:14.384819+0000","last_became_active":"2024-09-12T17:31:12.094935+0000","last_became_peered":"2024-09-12T17:31:12.094935+0000","last_unstale":"2024-09-12T18:31:14.384819+0000","last_undegraded":"2024-09-12T18:31:14.384819+0000","last_fullsized":"2024-09-12T18:31:14.384819+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:30.818530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'30","reported_seq":143,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.403621+0000","last_change":"2024-09-12T17:27:32.584697+0000","last_active":"2024-09-12T18:32:11.403621+0000","last_peered":"2024-09-12T18:32:11.403621+0000","last_clean":"2024-09-12T18:32:11.403621+0000","last_became_active":"2024-09-12T17:27:32.583903+0000","last_became_peered":"2024-09-12T17:27:32.583903+0000","last_unstale":"2024-09-12T18:32:11.403621+0000","last_undegraded":"2024-09-12T18:32:11.403621+0000","last_fullsized":"2024-09-12T18:32:11.403621+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:29.126608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":98,"num_write":57,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.805836+0000","last_change":"2024-09-12T17:53:27.168477+0000","last_active":"2024-09-12T18:33:26.805836+0000","last_peered":"2024-09-12T18:33:26.805836+0000","last_clean":"2024-09-12T18:33:26.805836+0000","last_became_active":"2024-09-12T17:53:27.167810+0000","last_became_peered":"2024-09-12T17:53:27.167810+0000","last_unstale":"2024-09-12T18:33:26.805836+0000","last_undegraded":"2024-09-12T18:33:26.805836+0000","last_fullsized":"2024-09-12T18:33:26.805836+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:15.873940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'7","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.602979+0000","last_change":"2024-09-12T17:31:16.238350+0000","last_active":"2024-09-12T18:33:45.602979+0000","last_peered":"2024-09-12T18:33:45.602979+0000","last_clean":"2024-09-12T18:33:45.602979+0000","last_became_active":"2024-09-12T17:31:16.237721+0000","last_became_peered":"2024-09-12T17:31:16.237721+0000","last_unstale":"2024-09-12T18:33:45.602979+0000","last_undegraded":"2024-09-12T18:33:45.602979+0000","last_fullsized":"2024-09-12T18:33:45.602979+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:31.469770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'2","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:11.617448+0000","last_change":"2024-09-12T17:31:12.106211+0000","last_active":"2024-09-12T18:31:11.617448+0000","last_peered":"2024-09-12T18:31:11.617448+0000","last_clean":"2024-09-12T18:31:11.617448+0000","last_became_active":"2024-09-12T17:31:12.105548+0000","last_became_peered":"2024-09-12T17:31:12.105548+0000","last_unstale":"2024-09-12T18:31:11.617448+0000","last_undegraded":"2024-09-12T18:31:11.617448+0000","last_fullsized":"2024-09-12T18:31:11.617448+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:03.366287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'16","reported_seq":114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.809510+0000","last_change":"2024-09-12T17:27:32.564047+0000","last_active":"2024-09-12T18:33:46.809510+0000","last_peered":"2024-09-12T18:33:46.809510+0000","last_clean":"2024-09-12T18:33:46.809510+0000","last_became_active":"2024-09-12T17:27:32.563281+0000","last_became_peered":"2024-09-12T17:27:32.563281+0000","last_unstale":"2024-09-12T18:33:46.809510+0000","last_undegraded":"2024-09-12T18:33:46.809510+0000","last_fullsized":"2024-09-12T18:33:46.809510+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:23.103744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.570655+0000","last_change":"2024-09-12T17:53:27.146120+0000","last_active":"2024-09-12T18:32:06.570655+0000","last_peered":"2024-09-12T18:32:06.570655+0000","last_clean":"2024-09-12T18:32:06.570655+0000","last_became_active":"2024-09-12T17:53:27.143812+0000","last_became_peered":"2024-09-12T17:53:27.143812+0000","last_unstale":"2024-09-12T18:32:06.570655+0000","last_undegraded":"2024-09-12T18:32:06.570655+0000","last_fullsized":"2024-09-12T18:32:06.570655+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:47.856070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.422572+0000","last_change":"2024-09-12T17:31:16.209712+0000","last_active":"2024-09-12T18:33:46.422572+0000","last_peered":"2024-09-12T18:33:46.422572+0000","last_clean":"2024-09-12T18:33:46.422572+0000","last_became_active":"2024-09-12T17:31:16.208994+0000","last_became_peered":"2024-09-12T17:31:16.208994+0000","last_unstale":"2024-09-12T18:33:46.422572+0000","last_undegraded":"2024-09-12T18:33:46.422572+0000","last_fullsized":"2024-09-12T18:33:46.422572+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:21.511571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'10","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.804901+0000","last_change":"2024-09-12T17:31:12.092194+0000","last_active":"2024-09-12T18:33:21.804901+0000","last_peered":"2024-09-12T18:33:21.804901+0000","last_clean":"2024-09-12T18:33:21.804901+0000","last_became_active":"2024-09-12T17:31:12.090602+0000","last_became_peered":"2024-09-12T17:31:12.090602+0000","last_unstale":"2024-09-12T18:33:21.804901+0000","last_undegraded":"2024-09-12T18:33:21.804901+0000","last_fullsized":"2024-09-12T18:33:21.804901+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:37.853518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7388451,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":10290,"num_write":15,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'40","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.408679+0000","last_change":"2024-09-12T17:27:32.554962+0000","last_active":"2024-09-12T18:32:36.408679+0000","last_peered":"2024-09-12T18:32:36.408679+0000","last_clean":"2024-09-12T18:32:36.408679+0000","last_became_active":"2024-09-12T17:27:32.554228+0000","last_became_peered":"2024-09-12T17:27:32.554228+0000","last_unstale":"2024-09-12T18:32:36.408679+0000","last_undegraded":"2024-09-12T18:32:36.408679+0000","last_fullsized":"2024-09-12T18:32:36.408679+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:30.083918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":136,"num_write":75,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:19.399599+0000","last_change":"2024-09-12T17:53:27.171122+0000","last_active":"2024-09-12T18:32:19.399599+0000","last_peered":"2024-09-12T18:32:19.399599+0000","last_clean":"2024-09-12T18:32:19.399599+0000","last_became_active":"2024-09-12T17:53:27.165849+0000","last_became_peered":"2024-09-12T17:53:27.165849+0000","last_unstale":"2024-09-12T18:32:19.399599+0000","last_undegraded":"2024-09-12T18:32:19.399599+0000","last_fullsized":"2024-09-12T18:32:19.399599+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:27.566630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"268'6","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.417613+0000","last_change":"2024-09-12T17:31:16.234725+0000","last_active":"2024-09-12T18:33:34.417613+0000","last_peered":"2024-09-12T18:33:34.417613+0000","last_clean":"2024-09-12T18:33:34.417613+0000","last_became_active":"2024-09-12T17:31:16.233989+0000","last_became_peered":"2024-09-12T17:31:16.233989+0000","last_unstale":"2024-09-12T18:33:34.417613+0000","last_undegraded":"2024-09-12T18:33:34.417613+0000","last_fullsized":"2024-09-12T18:33:34.417613+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:22.667547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'10","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.388434+0000","last_change":"2024-09-12T17:31:12.078149+0000","last_active":"2024-09-12T18:35:59.388434+0000","last_peered":"2024-09-12T18:35:59.388434+0000","last_clean":"2024-09-12T18:35:59.388434+0000","last_became_active":"2024-09-12T17:31:12.076980+0000","last_became_peered":"2024-09-12T17:31:12.076980+0000","last_unstale":"2024-09-12T18:35:59.388434+0000","last_undegraded":"2024-09-12T18:35:59.388434+0000","last_fullsized":"2024-09-12T18:35:59.388434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:20.927562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11264,"num_write":20,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'22","reported_seq":123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403144+0000","last_change":"2024-09-12T17:27:32.597852+0000","last_active":"2024-09-12T18:32:34.403144+0000","last_peered":"2024-09-12T18:32:34.403144+0000","last_clean":"2024-09-12T18:32:34.403144+0000","last_became_active":"2024-09-12T17:27:32.597092+0000","last_became_peered":"2024-09-12T17:27:32.597092+0000","last_unstale":"2024-09-12T18:32:34.403144+0000","last_undegraded":"2024-09-12T18:32:34.403144+0000","last_fullsized":"2024-09-12T18:32:34.403144+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:46.150508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":80,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.418737+0000","last_change":"2024-09-12T17:53:27.172827+0000","last_active":"2024-09-12T18:33:39.418737+0000","last_peered":"2024-09-12T18:33:39.418737+0000","last_clean":"2024-09-12T18:33:39.418737+0000","last_became_active":"2024-09-12T17:53:27.166248+0000","last_became_peered":"2024-09-12T17:53:27.166248+0000","last_unstale":"2024-09-12T18:33:39.418737+0000","last_undegraded":"2024-09-12T18:33:39.418737+0000","last_fullsized":"2024-09-12T18:33:39.418737+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:16.950414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:01.396099+0000","last_change":"2024-09-12T17:32:06.560970+0000","last_active":"2024-09-12T18:32:01.396099+0000","last_peered":"2024-09-12T18:32:01.396099+0000","last_clean":"2024-09-12T18:32:01.396099+0000","last_became_active":"2024-09-12T17:32:06.560465+0000","last_became_peered":"2024-09-12T17:32:06.560465+0000","last_unstale":"2024-09-12T18:32:01.396099+0000","last_undegraded":"2024-09-12T18:32:01.396099+0000","last_fullsized":"2024-09-12T18:32:01.396099+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:44.091888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'7","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.394772+0000","last_change":"2024-09-12T17:31:12.068624+0000","last_active":"2024-09-12T18:31:36.394772+0000","last_peered":"2024-09-12T18:31:36.394772+0000","last_clean":"2024-09-12T18:31:36.394772+0000","last_became_active":"2024-09-12T17:31:12.067819+0000","last_became_peered":"2024-09-12T17:31:12.067819+0000","last_unstale":"2024-09-12T18:31:36.394772+0000","last_undegraded":"2024-09-12T18:31:36.394772+0000","last_fullsized":"2024-09-12T18:31:36.394772+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:31.755207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":19458,"num_write":7,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'26","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403079+0000","last_change":"2024-09-12T17:27:32.591166+0000","last_active":"2024-09-12T18:32:34.403079+0000","last_peered":"2024-09-12T18:32:34.403079+0000","last_clean":"2024-09-12T18:32:34.403079+0000","last_became_active":"2024-09-12T17:27:32.578575+0000","last_became_peered":"2024-09-12T17:27:32.578575+0000","last_unstale":"2024-09-12T18:32:34.403079+0000","last_undegraded":"2024-09-12T18:32:34.403079+0000","last_fullsized":"2024-09-12T18:32:34.403079+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:56.541481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":95,"num_write":44,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642338+0000","last_change":"2024-09-12T17:53:27.156978+0000","last_active":"2024-09-12T18:33:01.642338+0000","last_peered":"2024-09-12T18:33:01.642338+0000","last_clean":"2024-09-12T18:33:01.642338+0000","last_became_active":"2024-09-12T17:53:27.156155+0000","last_became_peered":"2024-09-12T17:53:27.156155+0000","last_unstale":"2024-09-12T18:33:01.642338+0000","last_undegraded":"2024-09-12T18:33:01.642338+0000","last_fullsized":"2024-09-12T18:33:01.642338+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:51.477046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"268'1","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.565354+0000","last_change":"2024-09-12T17:31:16.227134+0000","last_active":"2024-09-12T18:31:41.565354+0000","last_peered":"2024-09-12T18:31:41.565354+0000","last_clean":"2024-09-12T18:31:41.565354+0000","last_became_active":"2024-09-12T17:31:16.226398+0000","last_became_peered":"2024-09-12T17:31:16.226398+0000","last_unstale":"2024-09-12T18:31:41.565354+0000","last_undegraded":"2024-09-12T18:31:41.565354+0000","last_fullsized":"2024-09-12T18:31:41.565354+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:46.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:00.578262+0000","last_change":"2024-09-12T17:31:12.077317+0000","last_active":"2024-09-12T18:32:00.578262+0000","last_peered":"2024-09-12T18:32:00.578262+0000","last_clean":"2024-09-12T18:32:00.578262+0000","last_became_active":"2024-09-12T17:31:12.076502+0000","last_became_peered":"2024-09-12T17:31:12.076502+0000","last_unstale":"2024-09-12T18:32:00.578262+0000","last_undegraded":"2024-09-12T18:32:00.578262+0000","last_fullsized":"2024-09-12T18:32:00.578262+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:49.794829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'36","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.577178+0000","last_change":"2024-09-12T17:27:32.569576+0000","last_active":"2024-09-12T18:32:36.577178+0000","last_peered":"2024-09-12T18:32:36.577178+0000","last_clean":"2024-09-12T18:32:36.577178+0000","last_became_active":"2024-09-12T17:27:32.568740+0000","last_became_peered":"2024-09-12T17:27:32.568740+0000","last_unstale":"2024-09-12T18:32:36.577178+0000","last_undegraded":"2024-09-12T18:32:36.577178+0000","last_fullsized":"2024-09-12T18:32:36.577178+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:55.258084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":126,"num_write":62,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.409921+0000","last_change":"2024-09-12T17:53:27.170601+0000","last_active":"2024-09-12T18:33:26.409921+0000","last_peered":"2024-09-12T18:33:26.409921+0000","last_clean":"2024-09-12T18:33:26.409921+0000","last_became_active":"2024-09-12T17:53:27.169805+0000","last_became_peered":"2024-09-12T17:53:27.169805+0000","last_unstale":"2024-09-12T18:33:26.409921+0000","last_undegraded":"2024-09-12T18:33:26.409921+0000","last_fullsized":"2024-09-12T18:33:26.409921+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:47.368175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"268'1","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:16.560345+0000","last_change":"2024-09-12T17:31:16.221214+0000","last_active":"2024-09-12T18:31:16.560345+0000","last_peered":"2024-09-12T18:31:16.560345+0000","last_clean":"2024-09-12T18:31:16.560345+0000","last_became_active":"2024-09-12T17:31:16.220449+0000","last_became_peered":"2024-09-12T17:31:16.220449+0000","last_unstale":"2024-09-12T18:31:16.560345+0000","last_undegraded":"2024-09-12T18:31:16.560345+0000","last_fullsized":"2024-09-12T18:31:16.560345+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:06.706199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:15.567669+0000","last_change":"2024-09-12T17:31:12.086822+0000","last_active":"2024-09-12T18:31:15.567669+0000","last_peered":"2024-09-12T18:31:15.567669+0000","last_clean":"2024-09-12T18:31:15.567669+0000","last_became_active":"2024-09-12T17:31:12.086091+0000","last_became_peered":"2024-09-12T17:31:12.086091+0000","last_unstale":"2024-09-12T18:31:15.567669+0000","last_undegraded":"2024-09-12T18:31:15.567669+0000","last_fullsized":"2024-09-12T18:31:15.567669+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:29.857815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'57","reported_seq":217,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.414339+0000","last_change":"2024-09-12T17:27:32.569293+0000","last_active":"2024-09-12T18:33:06.414339+0000","last_peered":"2024-09-12T18:33:06.414339+0000","last_clean":"2024-09-12T18:33:06.414339+0000","last_became_active":"2024-09-12T17:27:32.568506+0000","last_became_peered":"2024-09-12T17:27:32.568506+0000","last_unstale":"2024-09-12T18:33:06.414339+0000","last_undegraded":"2024-09-12T18:33:06.414339+0000","last_fullsized":"2024-09-12T18:33:06.414339+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:54.976967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":207,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.410077+0000","last_change":"2024-09-12T17:53:27.171469+0000","last_active":"2024-09-12T18:33:26.410077+0000","last_peered":"2024-09-12T18:33:26.410077+0000","last_clean":"2024-09-12T18:33:26.410077+0000","last_became_active":"2024-09-12T17:53:27.170636+0000","last_became_peered":"2024-09-12T17:53:27.170636+0000","last_unstale":"2024-09-12T18:33:26.410077+0000","last_undegraded":"2024-09-12T18:33:26.410077+0000","last_fullsized":"2024-09-12T18:33:26.410077+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:42.171510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"268'3","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.420948+0000","last_change":"2024-09-12T17:31:16.239144+0000","last_active":"2024-09-12T18:33:49.420948+0000","last_peered":"2024-09-12T18:33:49.420948+0000","last_clean":"2024-09-12T18:33:49.420948+0000","last_became_active":"2024-09-12T17:31:16.238450+0000","last_became_peered":"2024-09-12T17:31:16.238450+0000","last_unstale":"2024-09-12T18:33:49.420948+0000","last_undegraded":"2024-09-12T18:33:49.420948+0000","last_fullsized":"2024-09-12T18:33:49.420948+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:24.540079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:11.389062+0000","last_change":"2024-09-12T17:31:12.091121+0000","last_active":"2024-09-12T18:31:11.389062+0000","last_peered":"2024-09-12T18:31:11.389062+0000","last_clean":"2024-09-12T18:31:11.389062+0000","last_became_active":"2024-09-12T17:31:12.090201+0000","last_became_peered":"2024-09-12T17:31:12.090201+0000","last_unstale":"2024-09-12T18:31:11.389062+0000","last_undegraded":"2024-09-12T18:31:11.389062+0000","last_fullsized":"2024-09-12T18:31:11.389062+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:59.375478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.639470+0000","last_change":"2024-09-12T17:27:32.568403+0000","last_active":"2024-09-12T18:32:51.639470+0000","last_peered":"2024-09-12T18:32:51.639470+0000","last_clean":"2024-09-12T18:32:51.639470+0000","last_became_active":"2024-09-12T17:27:32.567672+0000","last_became_peered":"2024-09-12T17:27:32.567672+0000","last_unstale":"2024-09-12T18:32:51.639470+0000","last_undegraded":"2024-09-12T18:32:51.639470+0000","last_fullsized":"2024-09-12T18:32:51.639470+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:49.181661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.643457+0000","last_change":"2024-09-12T17:53:27.142791+0000","last_active":"2024-09-12T18:33:06.643457+0000","last_peered":"2024-09-12T18:33:06.643457+0000","last_clean":"2024-09-12T18:33:06.643457+0000","last_became_active":"2024-09-12T17:53:27.142060+0000","last_became_peered":"2024-09-12T17:53:27.142060+0000","last_unstale":"2024-09-12T18:33:06.643457+0000","last_undegraded":"2024-09-12T18:33:06.643457+0000","last_fullsized":"2024-09-12T18:33:06.643457+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:50.140663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"268'4","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:44.391228+0000","last_change":"2024-09-12T17:31:16.235658+0000","last_active":"2024-09-12T18:31:44.391228+0000","last_peered":"2024-09-12T18:31:44.391228+0000","last_clean":"2024-09-12T18:31:44.391228+0000","last_became_active":"2024-09-12T17:31:16.228226+0000","last_became_peered":"2024-09-12T17:31:16.228226+0000","last_unstale":"2024-09-12T18:31:44.391228+0000","last_undegraded":"2024-09-12T18:31:44.391228+0000","last_fullsized":"2024-09-12T18:31:44.391228+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:12.245863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1072,"num_write":9,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'4","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.399518+0000","last_change":"2024-09-12T17:31:12.091577+0000","last_active":"2024-09-12T18:32:11.399518+0000","last_peered":"2024-09-12T18:32:11.399518+0000","last_clean":"2024-09-12T18:32:11.399518+0000","last_became_active":"2024-09-12T17:31:12.090779+0000","last_became_peered":"2024-09-12T17:31:12.090779+0000","last_unstale":"2024-09-12T18:32:11.399518+0000","last_undegraded":"2024-09-12T18:32:11.399518+0000","last_fullsized":"2024-09-12T18:32:11.399518+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:37.345815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'62","reported_seq":234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411872+0000","last_change":"2024-09-12T17:27:32.571784+0000","last_active":"2024-09-12T18:32:51.411872+0000","last_peered":"2024-09-12T18:32:51.411872+0000","last_clean":"2024-09-12T18:32:51.411872+0000","last_became_active":"2024-09-12T17:27:32.567884+0000","last_became_peered":"2024-09-12T17:27:32.567884+0000","last_unstale":"2024-09-12T18:32:51.411872+0000","last_undegraded":"2024-09-12T18:32:51.411872+0000","last_fullsized":"2024-09-12T18:32:51.411872+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:13.840706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":230,"num_write":101,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.801783+0000","last_change":"2024-09-12T17:53:27.140297+0000","last_active":"2024-09-12T18:33:06.801783+0000","last_peered":"2024-09-12T18:33:06.801783+0000","last_clean":"2024-09-12T18:33:06.801783+0000","last_became_active":"2024-09-12T17:53:27.139551+0000","last_became_peered":"2024-09-12T17:53:27.139551+0000","last_unstale":"2024-09-12T18:33:06.801783+0000","last_undegraded":"2024-09-12T18:33:06.801783+0000","last_fullsized":"2024-09-12T18:33:06.801783+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:49.095002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'3","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:14.398487+0000","last_change":"2024-09-12T17:31:16.237383+0000","last_active":"2024-09-12T18:32:14.398487+0000","last_peered":"2024-09-12T18:32:14.398487+0000","last_clean":"2024-09-12T18:32:14.398487+0000","last_became_active":"2024-09-12T17:31:16.236796+0000","last_became_peered":"2024-09-12T17:31:16.236796+0000","last_unstale":"2024-09-12T18:32:14.398487+0000","last_undegraded":"2024-09-12T18:32:14.398487+0000","last_fullsized":"2024-09-12T18:32:14.398487+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:49.523071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'3","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.383391+0000","last_change":"2024-09-12T17:31:12.093519+0000","last_active":"2024-09-12T18:31:36.383391+0000","last_peered":"2024-09-12T18:31:36.383391+0000","last_clean":"2024-09-12T18:31:36.383391+0000","last_became_active":"2024-09-12T17:31:12.092655+0000","last_became_peered":"2024-09-12T17:31:12.092655+0000","last_unstale":"2024-09-12T18:31:36.383391+0000","last_undegraded":"2024-09-12T18:31:36.383391+0000","last_fullsized":"2024-09-12T18:31:36.383391+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:42.350728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4144,"num_write":3,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'23","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:49.407673+0000","last_change":"2024-09-12T17:27:32.579819+0000","last_active":"2024-09-12T18:32:49.407673+0000","last_peered":"2024-09-12T18:32:49.407673+0000","last_clean":"2024-09-12T18:32:49.407673+0000","last_became_active":"2024-09-12T17:27:32.578393+0000","last_became_peered":"2024-09-12T17:27:32.578393+0000","last_unstale":"2024-09-12T18:32:49.407673+0000","last_undegraded":"2024-09-12T18:32:49.407673+0000","last_fullsized":"2024-09-12T18:32:49.407673+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:12.325555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":84,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.404631+0000","last_change":"2024-09-12T17:53:27.151852+0000","last_active":"2024-09-12T18:33:06.404631+0000","last_peered":"2024-09-12T18:33:06.404631+0000","last_clean":"2024-09-12T18:33:06.404631+0000","last_became_active":"2024-09-12T17:53:27.142159+0000","last_became_peered":"2024-09-12T17:53:27.142159+0000","last_unstale":"2024-09-12T18:33:06.404631+0000","last_undegraded":"2024-09-12T18:33:06.404631+0000","last_fullsized":"2024-09-12T18:33:06.404631+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:32.788357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:09.425500+0000","last_change":"2024-09-12T17:31:16.237254+0000","last_active":"2024-09-12T18:34:09.425500+0000","last_peered":"2024-09-12T18:34:09.425500+0000","last_clean":"2024-09-12T18:34:09.425500+0000","last_became_active":"2024-09-12T17:31:16.236478+0000","last_became_peered":"2024-09-12T17:31:16.236478+0000","last_unstale":"2024-09-12T18:34:09.425500+0000","last_undegraded":"2024-09-12T18:34:09.425500+0000","last_fullsized":"2024-09-12T18:34:09.425500+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:03.647540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.781224+0000","last_change":"2024-09-12T17:31:12.092360+0000","last_active":"2024-09-12T18:31:36.781224+0000","last_peered":"2024-09-12T18:31:36.781224+0000","last_clean":"2024-09-12T18:31:36.781224+0000","last_became_active":"2024-09-12T17:31:12.091488+0000","last_became_peered":"2024-09-12T17:31:12.091488+0000","last_unstale":"2024-09-12T18:31:36.781224+0000","last_undegraded":"2024-09-12T18:31:36.781224+0000","last_fullsized":"2024-09-12T18:31:36.781224+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:42.860474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'49","reported_seq":200,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.798942+0000","last_change":"2024-09-12T17:27:32.573661+0000","last_active":"2024-09-12T18:32:51.798942+0000","last_peered":"2024-09-12T18:32:51.798942+0000","last_clean":"2024-09-12T18:32:51.798942+0000","last_became_active":"2024-09-12T17:27:32.572859+0000","last_became_peered":"2024-09-12T17:27:32.572859+0000","last_unstale":"2024-09-12T18:32:51.798942+0000","last_undegraded":"2024-09-12T18:32:51.798942+0000","last_fullsized":"2024-09-12T18:32:51.798942+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:51.245414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":198,"num_write":77,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.412028+0000","last_change":"2024-09-12T17:53:27.156462+0000","last_active":"2024-09-12T18:33:06.412028+0000","last_peered":"2024-09-12T18:33:06.412028+0000","last_clean":"2024-09-12T18:33:06.412028+0000","last_became_active":"2024-09-12T17:53:27.155646+0000","last_became_peered":"2024-09-12T17:53:27.155646+0000","last_unstale":"2024-09-12T18:33:06.412028+0000","last_undegraded":"2024-09-12T18:33:06.412028+0000","last_fullsized":"2024-09-12T18:33:06.412028+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:44.968007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:40.573394+0000","last_change":"2024-09-12T17:31:16.221542+0000","last_active":"2024-09-12T18:31:40.573394+0000","last_peered":"2024-09-12T18:31:40.573394+0000","last_clean":"2024-09-12T18:31:40.573394+0000","last_became_active":"2024-09-12T17:31:16.220797+0000","last_became_peered":"2024-09-12T17:31:16.220797+0000","last_unstale":"2024-09-12T18:31:40.573394+0000","last_undegraded":"2024-09-12T18:31:40.573394+0000","last_fullsized":"2024-09-12T18:31:40.573394+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:34.381182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.395227+0000","last_change":"2024-09-12T17:31:12.098496+0000","last_active":"2024-09-12T18:31:36.395227+0000","last_peered":"2024-09-12T18:31:36.395227+0000","last_clean":"2024-09-12T18:31:36.395227+0000","last_became_active":"2024-09-12T17:31:12.090174+0000","last_became_peered":"2024-09-12T17:31:12.090174+0000","last_unstale":"2024-09-12T18:31:36.395227+0000","last_undegraded":"2024-09-12T18:31:36.395227+0000","last_fullsized":"2024-09-12T18:31:36.395227+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:11.213746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'100","reported_seq":394,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.407333+0000","last_change":"2024-09-12T17:27:32.574809+0000","last_active":"2024-09-12T18:33:16.407333+0000","last_peered":"2024-09-12T18:33:16.407333+0000","last_clean":"2024-09-12T18:33:16.407333+0000","last_became_active":"2024-09-12T17:27:32.574023+0000","last_became_peered":"2024-09-12T17:27:32.574023+0000","last_unstale":"2024-09-12T18:33:16.407333+0000","last_undegraded":"2024-09-12T18:33:16.407333+0000","last_fullsized":"2024-09-12T18:33:16.407333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:43.524925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":651,"num_read_kb":453,"num_write":126,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:09.397336+0000","last_change":"2024-09-12T17:53:27.165446+0000","last_active":"2024-09-12T18:32:09.397336+0000","last_peered":"2024-09-12T18:32:09.397336+0000","last_clean":"2024-09-12T18:32:09.397336+0000","last_became_active":"2024-09-12T17:53:27.164643+0000","last_became_peered":"2024-09-12T17:53:27.164643+0000","last_unstale":"2024-09-12T18:32:09.397336+0000","last_undegraded":"2024-09-12T18:32:09.397336+0000","last_fullsized":"2024-09-12T18:32:09.397336+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:32.358718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"265'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.627015+0000","last_change":"2024-09-12T17:31:16.241953+0000","last_active":"2024-09-12T18:31:56.627015+0000","last_peered":"2024-09-12T18:31:56.627015+0000","last_clean":"2024-09-12T18:31:56.627015+0000","last_became_active":"2024-09-12T17:31:16.240666+0000","last_became_peered":"2024-09-12T17:31:16.240666+0000","last_unstale":"2024-09-12T18:31:56.627015+0000","last_undegraded":"2024-09-12T18:31:56.627015+0000","last_fullsized":"2024-09-12T18:31:56.627015+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:19.000830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'2","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:15.609579+0000","last_change":"2024-09-12T17:31:12.079972+0000","last_active":"2024-09-12T18:34:15.609579+0000","last_peered":"2024-09-12T18:34:15.609579+0000","last_clean":"2024-09-12T18:34:15.609579+0000","last_became_active":"2024-09-12T17:31:12.077055+0000","last_became_peered":"2024-09-12T17:31:12.077055+0000","last_unstale":"2024-09-12T18:34:15.609579+0000","last_undegraded":"2024-09-12T18:34:15.609579+0000","last_fullsized":"2024-09-12T18:34:15.609579+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:54.359866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'36","reported_seq":161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.402360+0000","last_change":"2024-09-12T17:27:32.575114+0000","last_active":"2024-09-12T18:32:56.402360+0000","last_peered":"2024-09-12T18:32:56.402360+0000","last_clean":"2024-09-12T18:32:56.402360+0000","last_became_active":"2024-09-12T17:27:32.574128+0000","last_became_peered":"2024-09-12T17:27:32.574128+0000","last_unstale":"2024-09-12T18:32:56.402360+0000","last_undegraded":"2024-09-12T18:32:56.402360+0000","last_fullsized":"2024-09-12T18:32:56.402360+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:30.567491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":129,"num_write":75,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.402547+0000","last_change":"2024-09-12T17:53:27.170202+0000","last_active":"2024-09-12T18:32:06.402547+0000","last_peered":"2024-09-12T18:32:06.402547+0000","last_clean":"2024-09-12T18:32:06.402547+0000","last_became_active":"2024-09-12T17:53:27.169499+0000","last_became_peered":"2024-09-12T17:53:27.169499+0000","last_unstale":"2024-09-12T18:32:06.402547+0000","last_undegraded":"2024-09-12T18:32:06.402547+0000","last_fullsized":"2024-09-12T18:32:06.402547+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:09.313257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"268'3","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.626905+0000","last_change":"2024-09-12T17:31:16.233694+0000","last_active":"2024-09-12T18:31:56.626905+0000","last_peered":"2024-09-12T18:31:56.626905+0000","last_clean":"2024-09-12T18:31:56.626905+0000","last_became_active":"2024-09-12T17:31:16.232949+0000","last_became_peered":"2024-09-12T17:31:16.232949+0000","last_unstale":"2024-09-12T18:31:56.626905+0000","last_undegraded":"2024-09-12T18:31:56.626905+0000","last_fullsized":"2024-09-12T18:31:56.626905+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:20.006807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'3","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:14.426601+0000","last_change":"2024-09-12T17:31:12.087042+0000","last_active":"2024-09-12T18:34:14.426601+0000","last_peered":"2024-09-12T18:34:14.426601+0000","last_clean":"2024-09-12T18:34:14.426601+0000","last_became_active":"2024-09-12T17:31:12.086300+0000","last_became_peered":"2024-09-12T17:31:12.086300+0000","last_unstale":"2024-09-12T18:34:14.426601+0000","last_undegraded":"2024-09-12T18:34:14.426601+0000","last_fullsized":"2024-09-12T18:34:14.426601+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:18.726386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'15","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.412585+0000","last_change":"2024-09-12T17:27:32.592754+0000","last_active":"2024-09-12T18:32:56.412585+0000","last_peered":"2024-09-12T18:32:56.412585+0000","last_clean":"2024-09-12T18:32:56.412585+0000","last_became_active":"2024-09-12T17:27:32.591878+0000","last_became_peered":"2024-09-12T17:27:32.591878+0000","last_unstale":"2024-09-12T18:32:56.412585+0000","last_undegraded":"2024-09-12T18:32:56.412585+0000","last_fullsized":"2024-09-12T18:32:56.412585+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:19.824090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.416384+0000","last_change":"2024-09-12T17:53:27.158764+0000","last_active":"2024-09-12T18:33:16.416384+0000","last_peered":"2024-09-12T18:33:16.416384+0000","last_clean":"2024-09-12T18:33:16.416384+0000","last_became_active":"2024-09-12T17:53:27.157992+0000","last_became_peered":"2024-09-12T17:53:27.157992+0000","last_unstale":"2024-09-12T18:33:16.416384+0000","last_undegraded":"2024-09-12T18:33:16.416384+0000","last_fullsized":"2024-09-12T18:33:16.416384+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:50.572142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428001+0000","last_change":"2024-09-12T17:31:16.228882+0000","last_active":"2024-09-12T18:34:19.428001+0000","last_peered":"2024-09-12T18:34:19.428001+0000","last_clean":"2024-09-12T18:34:19.428001+0000","last_became_active":"2024-09-12T17:31:16.227946+0000","last_became_peered":"2024-09-12T17:31:16.227946+0000","last_unstale":"2024-09-12T18:34:19.428001+0000","last_undegraded":"2024-09-12T18:34:19.428001+0000","last_fullsized":"2024-09-12T18:34:19.428001+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:58.107920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'5","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.567511+0000","last_change":"2024-09-12T17:31:12.106194+0000","last_active":"2024-09-12T18:31:51.567511+0000","last_peered":"2024-09-12T18:31:51.567511+0000","last_clean":"2024-09-12T18:31:51.567511+0000","last_became_active":"2024-09-12T17:31:12.105448+0000","last_became_peered":"2024-09-12T17:31:12.105448+0000","last_unstale":"2024-09-12T18:31:51.567511+0000","last_undegraded":"2024-09-12T18:31:51.567511+0000","last_fullsized":"2024-09-12T18:31:51.567511+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:55.162506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'22","reported_seq":120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:55.591164+0000","last_change":"2024-09-12T17:27:32.568251+0000","last_active":"2024-09-12T18:32:55.591164+0000","last_peered":"2024-09-12T18:32:55.591164+0000","last_clean":"2024-09-12T18:32:55.591164+0000","last_became_active":"2024-09-12T17:27:32.567500+0000","last_became_peered":"2024-09-12T17:27:32.567500+0000","last_unstale":"2024-09-12T18:32:55.591164+0000","last_undegraded":"2024-09-12T18:32:55.591164+0000","last_fullsized":"2024-09-12T18:32:55.591164+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:19.895653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:09.397287+0000","last_change":"2024-09-12T17:53:27.167094+0000","last_active":"2024-09-12T18:32:09.397287+0000","last_peered":"2024-09-12T18:32:09.397287+0000","last_clean":"2024-09-12T18:32:09.397287+0000","last_became_active":"2024-09-12T17:53:27.164083+0000","last_became_peered":"2024-09-12T17:53:27.164083+0000","last_unstale":"2024-09-12T18:32:09.397287+0000","last_undegraded":"2024-09-12T18:32:09.397287+0000","last_fullsized":"2024-09-12T18:32:09.397287+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:57.760600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"268'1","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.568603+0000","last_change":"2024-09-12T17:31:16.239173+0000","last_active":"2024-09-12T18:31:56.568603+0000","last_peered":"2024-09-12T18:31:56.568603+0000","last_clean":"2024-09-12T18:31:56.568603+0000","last_became_active":"2024-09-12T17:31:16.238356+0000","last_became_peered":"2024-09-12T17:31:16.238356+0000","last_unstale":"2024-09-12T18:31:56.568603+0000","last_undegraded":"2024-09-12T18:31:56.568603+0000","last_fullsized":"2024-09-12T18:31:56.568603+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:23.384787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'4","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.393847+0000","last_change":"2024-09-12T17:31:12.106100+0000","last_active":"2024-09-12T18:31:51.393847+0000","last_peered":"2024-09-12T18:31:51.393847+0000","last_clean":"2024-09-12T18:31:51.393847+0000","last_became_active":"2024-09-12T17:31:12.105300+0000","last_became_peered":"2024-09-12T17:31:12.105300+0000","last_unstale":"2024-09-12T18:31:51.393847+0000","last_undegraded":"2024-09-12T18:31:51.393847+0000","last_fullsized":"2024-09-12T18:31:51.393847+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:18.610444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'42","reported_seq":176,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:54.408584+0000","last_change":"2024-09-12T17:27:32.598060+0000","last_active":"2024-09-12T18:32:54.408584+0000","last_peered":"2024-09-12T18:32:54.408584+0000","last_clean":"2024-09-12T18:32:54.408584+0000","last_became_active":"2024-09-12T17:27:32.597518+0000","last_became_peered":"2024-09-12T17:27:32.597518+0000","last_unstale":"2024-09-12T18:32:54.408584+0000","last_undegraded":"2024-09-12T18:32:54.408584+0000","last_fullsized":"2024-09-12T18:32:54.408584+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:46.388068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":146,"num_write":82,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:31.795139+0000","last_change":"2024-09-12T17:53:27.140361+0000","last_active":"2024-09-12T18:32:31.795139+0000","last_peered":"2024-09-12T18:32:31.795139+0000","last_clean":"2024-09-12T18:32:31.795139+0000","last_became_active":"2024-09-12T17:53:27.139633+0000","last_became_peered":"2024-09-12T17:53:27.139633+0000","last_unstale":"2024-09-12T18:32:31.795139+0000","last_undegraded":"2024-09-12T18:32:31.795139+0000","last_fullsized":"2024-09-12T18:32:31.795139+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:33.101556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"265'4","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:04.395968+0000","last_change":"2024-09-12T17:31:16.233015+0000","last_active":"2024-09-12T18:32:04.395968+0000","last_peered":"2024-09-12T18:32:04.395968+0000","last_clean":"2024-09-12T18:32:04.395968+0000","last_became_active":"2024-09-12T17:31:16.229063+0000","last_became_peered":"2024-09-12T17:31:16.229063+0000","last_unstale":"2024-09-12T18:32:04.395968+0000","last_undegraded":"2024-09-12T18:32:04.395968+0000","last_fullsized":"2024-09-12T18:32:04.395968+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:10.227429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.388112+0000","last_change":"2024-09-12T17:31:12.094349+0000","last_active":"2024-09-12T18:31:56.388112+0000","last_peered":"2024-09-12T18:31:56.388112+0000","last_clean":"2024-09-12T18:31:56.388112+0000","last_became_active":"2024-09-12T17:31:12.093496+0000","last_became_peered":"2024-09-12T17:31:12.093496+0000","last_unstale":"2024-09-12T18:31:56.388112+0000","last_undegraded":"2024-09-12T18:31:56.388112+0000","last_fullsized":"2024-09-12T18:31:56.388112+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:37.609875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":4,"num_write_kb":1047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'15","reported_seq":104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.411590+0000","last_change":"2024-09-12T17:27:32.598394+0000","last_active":"2024-09-12T18:33:04.411590+0000","last_peered":"2024-09-12T18:33:04.411590+0000","last_clean":"2024-09-12T18:33:04.411590+0000","last_became_active":"2024-09-12T17:27:32.597694+0000","last_became_peered":"2024-09-12T17:27:32.597694+0000","last_unstale":"2024-09-12T18:33:04.411590+0000","last_undegraded":"2024-09-12T18:33:04.411590+0000","last_fullsized":"2024-09-12T18:33:04.411590+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:30.364314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.384432+0000","last_change":"2024-09-12T17:53:27.162772+0000","last_active":"2024-09-12T18:31:41.384432+0000","last_peered":"2024-09-12T18:31:41.384432+0000","last_clean":"2024-09-12T18:31:41.384432+0000","last_became_active":"2024-09-12T17:53:27.161396+0000","last_became_peered":"2024-09-12T17:53:27.161396+0000","last_unstale":"2024-09-12T18:31:41.384432+0000","last_undegraded":"2024-09-12T18:31:41.384432+0000","last_fullsized":"2024-09-12T18:31:41.384432+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:42.269208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'3","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428076+0000","last_change":"2024-09-12T17:31:16.239207+0000","last_active":"2024-09-12T18:34:19.428076+0000","last_peered":"2024-09-12T18:34:19.428076+0000","last_clean":"2024-09-12T18:34:19.428076+0000","last_became_active":"2024-09-12T17:31:16.238011+0000","last_became_peered":"2024-09-12T17:31:16.238011+0000","last_unstale":"2024-09-12T18:34:19.428076+0000","last_undegraded":"2024-09-12T18:34:19.428076+0000","last_fullsized":"2024-09-12T18:34:19.428076+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:16.439195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.785438+0000","last_change":"2024-09-12T17:31:12.094454+0000","last_active":"2024-09-12T18:31:56.785438+0000","last_peered":"2024-09-12T18:31:56.785438+0000","last_clean":"2024-09-12T18:31:56.785438+0000","last_became_active":"2024-09-12T17:31:12.093705+0000","last_became_peered":"2024-09-12T17:31:12.093705+0000","last_unstale":"2024-09-12T18:31:56.785438+0000","last_undegraded":"2024-09-12T18:31:56.785438+0000","last_fullsized":"2024-09-12T18:31:56.785438+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:41.345776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'6","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.408420+0000","last_change":"2024-09-12T17:27:32.580514+0000","last_active":"2024-09-12T18:32:51.408420+0000","last_peered":"2024-09-12T18:32:51.408420+0000","last_clean":"2024-09-12T18:32:51.408420+0000","last_became_active":"2024-09-12T17:27:32.579749+0000","last_became_peered":"2024-09-12T17:27:32.579749+0000","last_unstale":"2024-09-12T18:32:51.408420+0000","last_undegraded":"2024-09-12T18:32:51.408420+0000","last_fullsized":"2024-09-12T18:32:51.408420+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:28.676196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.575100+0000","last_change":"2024-09-12T17:53:27.145612+0000","last_active":"2024-09-12T18:32:26.575100+0000","last_peered":"2024-09-12T18:32:26.575100+0000","last_clean":"2024-09-12T18:32:26.575100+0000","last_became_active":"2024-09-12T17:53:27.142745+0000","last_became_peered":"2024-09-12T17:53:27.142745+0000","last_unstale":"2024-09-12T18:32:26.575100+0000","last_undegraded":"2024-09-12T18:32:26.575100+0000","last_fullsized":"2024-09-12T18:32:26.575100+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:38.589340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.632168+0000","last_change":"2024-09-12T17:31:16.242998+0000","last_active":"2024-09-12T18:32:16.632168+0000","last_peered":"2024-09-12T18:32:16.632168+0000","last_clean":"2024-09-12T18:32:16.632168+0000","last_became_active":"2024-09-12T17:31:16.242306+0000","last_became_peered":"2024-09-12T17:31:16.242306+0000","last_unstale":"2024-09-12T18:32:16.632168+0000","last_undegraded":"2024-09-12T18:32:16.632168+0000","last_fullsized":"2024-09-12T18:32:16.632168+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:38.335802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'5","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.400501+0000","last_change":"2024-09-12T17:31:12.078680+0000","last_active":"2024-09-12T18:31:56.400501+0000","last_peered":"2024-09-12T18:31:56.400501+0000","last_clean":"2024-09-12T18:31:56.400501+0000","last_became_active":"2024-09-12T17:31:12.077726+0000","last_became_peered":"2024-09-12T17:31:12.077726+0000","last_unstale":"2024-09-12T18:31:56.400501+0000","last_undegraded":"2024-09-12T18:31:56.400501+0000","last_fullsized":"2024-09-12T18:31:56.400501+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:51.018109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":11266,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.580495+0000","last_change":"2024-09-12T17:27:32.583911+0000","last_active":"2024-09-12T18:32:51.580495+0000","last_peered":"2024-09-12T18:32:51.580495+0000","last_clean":"2024-09-12T18:32:51.580495+0000","last_became_active":"2024-09-12T17:27:32.583062+0000","last_became_peered":"2024-09-12T17:27:32.583062+0000","last_unstale":"2024-09-12T18:32:51.580495+0000","last_undegraded":"2024-09-12T18:32:51.580495+0000","last_fullsized":"2024-09-12T18:32:51.580495+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:20.224440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.395058+0000","last_change":"2024-09-12T17:53:27.165755+0000","last_active":"2024-09-12T18:32:26.395058+0000","last_peered":"2024-09-12T18:32:26.395058+0000","last_clean":"2024-09-12T18:32:26.395058+0000","last_became_active":"2024-09-12T17:53:27.163419+0000","last_became_peered":"2024-09-12T17:53:27.163419+0000","last_unstale":"2024-09-12T18:32:26.395058+0000","last_undegraded":"2024-09-12T18:32:26.395058+0000","last_fullsized":"2024-09-12T18:32:26.395058+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:39.501106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:04.396028+0000","last_change":"2024-09-12T17:31:16.237342+0000","last_active":"2024-09-12T18:32:04.396028+0000","last_peered":"2024-09-12T18:32:04.396028+0000","last_clean":"2024-09-12T18:32:04.396028+0000","last_became_active":"2024-09-12T17:31:16.236619+0000","last_became_peered":"2024-09-12T17:31:16.236619+0000","last_unstale":"2024-09-12T18:32:04.396028+0000","last_undegraded":"2024-09-12T18:32:04.396028+0000","last_fullsized":"2024-09-12T18:32:04.396028+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:58.072849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"268'5","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.631014+0000","last_change":"2024-09-12T17:31:12.107461+0000","last_active":"2024-09-12T18:32:11.631014+0000","last_peered":"2024-09-12T18:32:11.631014+0000","last_clean":"2024-09-12T18:32:11.631014+0000","last_became_active":"2024-09-12T17:31:12.105793+0000","last_became_peered":"2024-09-12T17:31:12.105793+0000","last_unstale":"2024-09-12T18:32:11.631014+0000","last_undegraded":"2024-09-12T18:32:11.631014+0000","last_fullsized":"2024-09-12T18:32:11.631014+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:10.448109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'53","reported_seq":206,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.798887+0000","last_change":"2024-09-12T17:27:32.570407+0000","last_active":"2024-09-12T18:32:51.798887+0000","last_peered":"2024-09-12T18:32:51.798887+0000","last_clean":"2024-09-12T18:32:51.798887+0000","last_became_active":"2024-09-12T17:27:32.569594+0000","last_became_peered":"2024-09-12T17:27:32.569594+0000","last_unstale":"2024-09-12T18:32:51.798887+0000","last_undegraded":"2024-09-12T18:32:51.798887+0000","last_fullsized":"2024-09-12T18:32:51.798887+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:44.112049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":187,"num_write":95,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:44.391279+0000","last_change":"2024-09-12T17:53:27.166701+0000","last_active":"2024-09-12T18:31:44.391279+0000","last_peered":"2024-09-12T18:31:44.391279+0000","last_clean":"2024-09-12T18:31:44.391279+0000","last_became_active":"2024-09-12T17:53:27.165129+0000","last_became_peered":"2024-09-12T17:53:27.165129+0000","last_unstale":"2024-09-12T18:31:44.391279+0000","last_undegraded":"2024-09-12T18:31:44.391279+0000","last_fullsized":"2024-09-12T18:31:44.391279+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:59.004034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"268'2","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:05.607436+0000","last_change":"2024-09-12T17:31:16.240818+0000","last_active":"2024-09-12T18:34:05.607436+0000","last_peered":"2024-09-12T18:34:05.607436+0000","last_clean":"2024-09-12T18:34:05.607436+0000","last_became_active":"2024-09-12T17:31:16.240152+0000","last_became_peered":"2024-09-12T17:31:16.240152+0000","last_unstale":"2024-09-12T18:34:05.607436+0000","last_undegraded":"2024-09-12T18:34:05.607436+0000","last_fullsized":"2024-09-12T18:34:05.607436+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:20.290016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'3","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.399053+0000","last_change":"2024-09-12T17:31:12.098113+0000","last_active":"2024-09-12T18:31:51.399053+0000","last_peered":"2024-09-12T18:31:51.399053+0000","last_clean":"2024-09-12T18:31:51.399053+0000","last_became_active":"2024-09-12T17:31:12.089200+0000","last_became_peered":"2024-09-12T17:31:12.089200+0000","last_unstale":"2024-09-12T18:31:51.399053+0000","last_undegraded":"2024-09-12T18:31:51.399053+0000","last_fullsized":"2024-09-12T18:31:51.399053+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:44.577058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4244763,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8242,"num_write":8,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'48","reported_seq":193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411678+0000","last_change":"2024-09-12T17:27:32.570665+0000","last_active":"2024-09-12T18:32:51.411678+0000","last_peered":"2024-09-12T18:32:51.411678+0000","last_clean":"2024-09-12T18:32:51.411678+0000","last_became_active":"2024-09-12T17:27:32.568661+0000","last_became_peered":"2024-09-12T17:27:32.568661+0000","last_unstale":"2024-09-12T18:32:51.411678+0000","last_undegraded":"2024-09-12T18:32:51.411678+0000","last_fullsized":"2024-09-12T18:32:51.411678+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:42.609534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":169,"num_write":85,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.388216+0000","last_change":"2024-09-12T17:53:27.171856+0000","last_active":"2024-09-12T18:31:56.388216+0000","last_peered":"2024-09-12T18:31:56.388216+0000","last_clean":"2024-09-12T18:31:56.388216+0000","last_became_active":"2024-09-12T17:53:27.170493+0000","last_became_peered":"2024-09-12T17:53:27.170493+0000","last_unstale":"2024-09-12T18:31:56.388216+0000","last_undegraded":"2024-09-12T18:31:56.388216+0000","last_fullsized":"2024-09-12T18:31:56.388216+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:44.616138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'4","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.387933+0000","last_change":"2024-09-12T17:31:16.229295+0000","last_active":"2024-09-12T18:31:56.387933+0000","last_peered":"2024-09-12T18:31:56.387933+0000","last_clean":"2024-09-12T18:31:56.387933+0000","last_became_active":"2024-09-12T17:31:16.228566+0000","last_became_peered":"2024-09-12T17:31:16.228566+0000","last_unstale":"2024-09-12T18:31:56.387933+0000","last_undegraded":"2024-09-12T18:31:56.387933+0000","last_fullsized":"2024-09-12T18:31:56.387933+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:12.639985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8972971,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":5238,"num_write":9,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'2","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.625595+0000","last_change":"2024-09-12T17:31:12.106105+0000","last_active":"2024-09-12T18:31:51.625595+0000","last_peered":"2024-09-12T18:31:51.625595+0000","last_clean":"2024-09-12T18:31:51.625595+0000","last_became_active":"2024-09-12T17:31:12.105384+0000","last_became_peered":"2024-09-12T17:31:12.105384+0000","last_unstale":"2024-09-12T18:31:51.625595+0000","last_undegraded":"2024-09-12T18:31:51.625595+0000","last_fullsized":"2024-09-12T18:31:51.625595+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:47.101516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'110","reported_seq":479,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.402295+0000","last_change":"2024-09-12T17:27:32.587346+0000","last_active":"2024-09-12T18:32:56.402295+0000","last_peered":"2024-09-12T18:32:56.402295+0000","last_clean":"2024-09-12T18:32:56.402295+0000","last_became_active":"2024-09-12T17:27:32.586640+0000","last_became_peered":"2024-09-12T17:27:32.586640+0000","last_unstale":"2024-09-12T18:32:56.402295+0000","last_undegraded":"2024-09-12T18:32:56.402295+0000","last_fullsized":"2024-09-12T18:32:56.402295+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:13.010550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":815,"num_read_kb":525,"num_write":139,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.384492+0000","last_change":"2024-09-12T17:53:27.171182+0000","last_active":"2024-09-12T18:31:41.384492+0000","last_peered":"2024-09-12T18:31:41.384492+0000","last_clean":"2024-09-12T18:31:41.384492+0000","last_became_active":"2024-09-12T17:53:27.170381+0000","last_became_peered":"2024-09-12T17:53:27.170381+0000","last_unstale":"2024-09-12T18:31:41.384492+0000","last_undegraded":"2024-09-12T18:31:41.384492+0000","last_fullsized":"2024-09-12T18:31:41.384492+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:22.200905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'4","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:01.628355+0000","last_change":"2024-09-12T17:31:16.245927+0000","last_active":"2024-09-12T18:32:01.628355+0000","last_peered":"2024-09-12T18:32:01.628355+0000","last_clean":"2024-09-12T18:32:01.628355+0000","last_became_active":"2024-09-12T17:31:16.245228+0000","last_became_peered":"2024-09-12T17:31:16.245228+0000","last_unstale":"2024-09-12T18:32:01.628355+0000","last_undegraded":"2024-09-12T18:32:01.628355+0000","last_fullsized":"2024-09-12T18:32:01.628355+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:57.083185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2145571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":9,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'1","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.402422+0000","last_change":"2024-09-12T17:31:12.091353+0000","last_active":"2024-09-12T18:32:06.402422+0000","last_peered":"2024-09-12T18:32:06.402422+0000","last_clean":"2024-09-12T18:32:06.402422+0000","last_became_active":"2024-09-12T17:31:12.089735+0000","last_became_peered":"2024-09-12T17:31:12.089735+0000","last_unstale":"2024-09-12T18:32:06.402422+0000","last_undegraded":"2024-09-12T18:32:06.402422+0000","last_fullsized":"2024-09-12T18:32:06.402422+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:58.780190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'45","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.402987+0000","last_change":"2024-09-12T17:27:32.576354+0000","last_active":"2024-09-12T18:32:34.402987+0000","last_peered":"2024-09-12T18:32:34.402987+0000","last_clean":"2024-09-12T18:32:34.402987+0000","last_became_active":"2024-09-12T17:27:32.575300+0000","last_became_peered":"2024-09-12T17:27:32.575300+0000","last_unstale":"2024-09-12T18:32:34.402987+0000","last_undegraded":"2024-09-12T18:32:34.402987+0000","last_fullsized":"2024-09-12T18:32:34.402987+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:55.469608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":157,"num_write":84,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.396512+0000","last_change":"2024-09-12T17:53:27.174556+0000","last_active":"2024-09-12T18:31:41.396512+0000","last_peered":"2024-09-12T18:31:41.396512+0000","last_clean":"2024-09-12T18:31:41.396512+0000","last_became_active":"2024-09-12T17:53:27.173955+0000","last_became_peered":"2024-09-12T17:53:27.173955+0000","last_unstale":"2024-09-12T18:31:41.396512+0000","last_undegraded":"2024-09-12T18:31:41.396512+0000","last_fullsized":"2024-09-12T18:31:41.396512+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:48.495953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.392719+0000","last_change":"2024-09-12T17:31:16.232804+0000","last_active":"2024-09-12T18:32:16.392719+0000","last_peered":"2024-09-12T18:32:16.392719+0000","last_clean":"2024-09-12T18:32:16.392719+0000","last_became_active":"2024-09-12T17:31:16.231516+0000","last_became_peered":"2024-09-12T17:31:16.231516+0000","last_unstale":"2024-09-12T18:32:16.392719+0000","last_undegraded":"2024-09-12T18:32:16.392719+0000","last_fullsized":"2024-09-12T18:32:16.392719+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:15.629748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:00.578348+0000","last_change":"2024-09-12T17:31:12.084858+0000","last_active":"2024-09-12T18:32:00.578348+0000","last_peered":"2024-09-12T18:32:00.578348+0000","last_clean":"2024-09-12T18:32:00.578348+0000","last_became_active":"2024-09-12T17:31:12.084158+0000","last_became_peered":"2024-09-12T17:31:12.084158+0000","last_unstale":"2024-09-12T18:32:00.578348+0000","last_undegraded":"2024-09-12T18:32:00.578348+0000","last_fullsized":"2024-09-12T18:32:00.578348+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:57.119863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'55","reported_seq":211,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.577105+0000","last_change":"2024-09-12T17:27:32.577701+0000","last_active":"2024-09-12T18:32:36.577105+0000","last_peered":"2024-09-12T18:32:36.577105+0000","last_clean":"2024-09-12T18:32:36.577105+0000","last_became_active":"2024-09-12T17:27:32.569924+0000","last_became_peered":"2024-09-12T17:27:32.569924+0000","last_unstale":"2024-09-12T18:32:36.577105+0000","last_undegraded":"2024-09-12T18:32:36.577105+0000","last_fullsized":"2024-09-12T18:32:36.577105+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:22.820241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":184,"num_write":101,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.403508+0000","last_change":"2024-09-12T17:53:27.163286+0000","last_active":"2024-09-12T18:33:01.403508+0000","last_peered":"2024-09-12T18:33:01.403508+0000","last_clean":"2024-09-12T18:33:01.403508+0000","last_became_active":"2024-09-12T17:53:27.162527+0000","last_became_peered":"2024-09-12T17:53:27.162527+0000","last_unstale":"2024-09-12T18:33:01.403508+0000","last_undegraded":"2024-09-12T18:33:01.403508+0000","last_fullsized":"2024-09-12T18:33:01.403508+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:27.017224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.400455+0000","last_change":"2024-09-12T17:31:16.245393+0000","last_active":"2024-09-12T18:31:56.400455+0000","last_peered":"2024-09-12T18:31:56.400455+0000","last_clean":"2024-09-12T18:31:56.400455+0000","last_became_active":"2024-09-12T17:31:16.244556+0000","last_became_peered":"2024-09-12T17:31:16.244556+0000","last_unstale":"2024-09-12T18:31:56.400455+0000","last_undegraded":"2024-09-12T18:31:56.400455+0000","last_fullsized":"2024-09-12T18:31:56.400455+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:52.690426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'7","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.413674+0000","last_change":"2024-09-12T17:31:12.081797+0000","last_active":"2024-09-12T18:33:41.413674+0000","last_peered":"2024-09-12T18:33:41.413674+0000","last_clean":"2024-09-12T18:33:41.413674+0000","last_became_active":"2024-09-12T17:31:12.081025+0000","last_became_peered":"2024-09-12T17:31:12.081025+0000","last_unstale":"2024-09-12T18:33:41.413674+0000","last_undegraded":"2024-09-12T18:33:41.413674+0000","last_fullsized":"2024-09-12T18:33:41.413674+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:23.240064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.408791+0000","last_change":"2024-09-12T17:27:32.562776+0000","last_active":"2024-09-12T18:32:36.408791+0000","last_peered":"2024-09-12T18:32:36.408791+0000","last_clean":"2024-09-12T18:32:36.408791+0000","last_became_active":"2024-09-12T17:27:32.561993+0000","last_became_peered":"2024-09-12T17:27:32.561993+0000","last_unstale":"2024-09-12T18:32:36.408791+0000","last_undegraded":"2024-09-12T18:32:36.408791+0000","last_fullsized":"2024-09-12T18:32:36.408791+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:55.063772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":121,"num_write":59,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.410789+0000","last_change":"2024-09-12T17:53:27.153890+0000","last_active":"2024-09-12T18:33:01.410789+0000","last_peered":"2024-09-12T18:33:01.410789+0000","last_clean":"2024-09-12T18:33:01.410789+0000","last_became_active":"2024-09-12T17:53:27.153125+0000","last_became_peered":"2024-09-12T17:53:27.153125+0000","last_unstale":"2024-09-12T18:33:01.410789+0000","last_undegraded":"2024-09-12T18:33:01.410789+0000","last_fullsized":"2024-09-12T18:33:01.410789+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:29.571163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'5","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.422511+0000","last_change":"2024-09-12T17:31:16.223351+0000","last_active":"2024-09-12T18:33:46.422511+0000","last_peered":"2024-09-12T18:33:46.422511+0000","last_clean":"2024-09-12T18:33:46.422511+0000","last_became_active":"2024-09-12T17:31:16.212330+0000","last_became_peered":"2024-09-12T17:31:16.212330+0000","last_unstale":"2024-09-12T18:33:46.422511+0000","last_undegraded":"2024-09-12T18:33:46.422511+0000","last_fullsized":"2024-09-12T18:33:46.422511+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:36.131170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":7170,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'2","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.810431+0000","last_change":"2024-09-12T17:31:12.094672+0000","last_active":"2024-09-12T18:33:51.810431+0000","last_peered":"2024-09-12T18:33:51.810431+0000","last_clean":"2024-09-12T18:33:51.810431+0000","last_became_active":"2024-09-12T17:31:12.093752+0000","last_became_peered":"2024-09-12T17:31:12.093752+0000","last_unstale":"2024-09-12T18:33:51.810431+0000","last_undegraded":"2024-09-12T18:33:51.810431+0000","last_fullsized":"2024-09-12T18:33:51.810431+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:44.826244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.577266+0000","last_change":"2024-09-12T17:27:32.583969+0000","last_active":"2024-09-12T18:32:36.577266+0000","last_peered":"2024-09-12T18:32:36.577266+0000","last_clean":"2024-09-12T18:32:36.577266+0000","last_became_active":"2024-09-12T17:27:32.583070+0000","last_became_peered":"2024-09-12T17:27:32.583070+0000","last_unstale":"2024-09-12T18:32:36.577266+0000","last_undegraded":"2024-09-12T18:32:36.577266+0000","last_fullsized":"2024-09-12T18:32:36.577266+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:54.241847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.649994+0000","last_change":"2024-09-12T17:53:27.155092+0000","last_active":"2024-09-12T18:33:36.649994+0000","last_peered":"2024-09-12T18:33:36.649994+0000","last_clean":"2024-09-12T18:33:36.649994+0000","last_became_active":"2024-09-12T17:53:27.154309+0000","last_became_peered":"2024-09-12T17:53:27.154309+0000","last_unstale":"2024-09-12T18:33:36.649994+0000","last_undegraded":"2024-09-12T18:33:36.649994+0000","last_fullsized":"2024-09-12T18:33:36.649994+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:16.746183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'7","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.388237+0000","last_change":"2024-09-12T17:31:16.231548+0000","last_active":"2024-09-12T18:31:56.388237+0000","last_peered":"2024-09-12T18:31:56.388237+0000","last_clean":"2024-09-12T18:31:56.388237+0000","last_became_active":"2024-09-12T17:31:16.230809+0000","last_became_peered":"2024-09-12T17:31:16.230809+0000","last_unstale":"2024-09-12T18:31:56.388237+0000","last_undegraded":"2024-09-12T18:31:56.388237+0000","last_fullsized":"2024-09-12T18:31:56.388237+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:50.950013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":16386,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"265'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.394003+0000","last_change":"2024-09-12T17:31:12.084859+0000","last_active":"2024-09-12T18:31:51.394003+0000","last_peered":"2024-09-12T18:31:51.394003+0000","last_clean":"2024-09-12T18:31:51.394003+0000","last_became_active":"2024-09-12T17:31:12.084101+0000","last_became_peered":"2024-09-12T17:31:12.084101+0000","last_unstale":"2024-09-12T18:31:51.394003+0000","last_undegraded":"2024-09-12T18:31:51.394003+0000","last_fullsized":"2024-09-12T18:31:51.394003+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:18.901928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'37","reported_seq":163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:31.396318+0000","last_change":"2024-09-12T17:27:32.582926+0000","last_active":"2024-09-12T18:32:31.396318+0000","last_peered":"2024-09-12T18:32:31.396318+0000","last_clean":"2024-09-12T18:32:31.396318+0000","last_became_active":"2024-09-12T17:27:32.582183+0000","last_became_peered":"2024-09-12T17:27:32.582183+0000","last_unstale":"2024-09-12T18:32:31.396318+0000","last_undegraded":"2024-09-12T18:32:31.396318+0000","last_fullsized":"2024-09-12T18:32:31.396318+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:44.094594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":125,"num_write":74,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.593556+0000","last_change":"2024-09-12T17:53:27.160005+0000","last_active":"2024-09-12T18:33:05.593556+0000","last_peered":"2024-09-12T18:33:05.593556+0000","last_clean":"2024-09-12T18:33:05.593556+0000","last_became_active":"2024-09-12T17:53:27.159240+0000","last_became_peered":"2024-09-12T17:53:27.159240+0000","last_unstale":"2024-09-12T18:33:05.593556+0000","last_undegraded":"2024-09-12T18:33:05.593556+0000","last_fullsized":"2024-09-12T18:33:05.593556+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:37.529736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'3","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:55.577221+0000","last_change":"2024-09-12T17:31:16.226574+0000","last_active":"2024-09-12T18:31:55.577221+0000","last_peered":"2024-09-12T18:31:55.577221+0000","last_clean":"2024-09-12T18:31:55.577221+0000","last_became_active":"2024-09-12T17:31:16.225754+0000","last_became_peered":"2024-09-12T17:31:16.225754+0000","last_unstale":"2024-09-12T18:31:55.577221+0000","last_undegraded":"2024-09-12T18:31:55.577221+0000","last_fullsized":"2024-09-12T18:31:55.577221+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:30.610378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.386970+0000","last_change":"2024-09-12T17:31:12.088188+0000","last_active":"2024-09-12T18:31:51.386970+0000","last_peered":"2024-09-12T18:31:51.386970+0000","last_clean":"2024-09-12T18:31:51.386970+0000","last_became_active":"2024-09-12T17:31:12.087356+0000","last_became_peered":"2024-09-12T17:31:12.087356+0000","last_unstale":"2024-09-12T18:31:51.386970+0000","last_undegraded":"2024-09-12T18:31:51.386970+0000","last_fullsized":"2024-09-12T18:31:51.386970+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:57.783040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'23","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.630906+0000","last_change":"2024-09-12T17:27:32.584476+0000","last_active":"2024-09-12T18:32:11.630906+0000","last_peered":"2024-09-12T18:32:11.630906+0000","last_clean":"2024-09-12T18:32:11.630906+0000","last_became_active":"2024-09-12T17:27:32.583631+0000","last_became_peered":"2024-09-12T17:27:32.583631+0000","last_unstale":"2024-09-12T18:32:11.630906+0000","last_undegraded":"2024-09-12T18:32:11.630906+0000","last_fullsized":"2024-09-12T18:32:11.630906+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:24.021549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":83,"num_write":39,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'1","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.790817+0000","last_change":"2024-09-12T17:53:27.156217+0000","last_active":"2024-09-12T18:32:26.790817+0000","last_peered":"2024-09-12T18:32:26.790817+0000","last_clean":"2024-09-12T18:32:26.790817+0000","last_became_active":"2024-09-12T17:53:27.152651+0000","last_became_peered":"2024-09-12T17:53:27.152651+0000","last_unstale":"2024-09-12T18:32:26.790817+0000","last_undegraded":"2024-09-12T18:32:26.790817+0000","last_fullsized":"2024-09-12T18:32:26.790817+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:24.443187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'7","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.652324+0000","last_change":"2024-09-12T17:31:16.243687+0000","last_active":"2024-09-12T18:33:46.652324+0000","last_peered":"2024-09-12T18:33:46.652324+0000","last_clean":"2024-09-12T18:33:46.652324+0000","last_became_active":"2024-09-12T17:31:16.242981+0000","last_became_peered":"2024-09-12T17:31:16.242981+0000","last_unstale":"2024-09-12T18:33:46.652324+0000","last_undegraded":"2024-09-12T18:33:46.652324+0000","last_fullsized":"2024-09-12T18:33:46.652324+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:07.505703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":15362,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.411117+0000","last_change":"2024-09-12T17:31:12.097913+0000","last_active":"2024-09-12T18:33:31.411117+0000","last_peered":"2024-09-12T18:33:31.411117+0000","last_clean":"2024-09-12T18:33:31.411117+0000","last_became_active":"2024-09-12T17:31:12.097216+0000","last_became_peered":"2024-09-12T17:31:12.097216+0000","last_unstale":"2024-09-12T18:33:31.411117+0000","last_undegraded":"2024-09-12T18:33:31.411117+0000","last_fullsized":"2024-09-12T18:33:31.411117+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:29.988488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'30","reported_seq":143,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.399472+0000","last_change":"2024-09-12T17:27:32.572524+0000","last_active":"2024-09-12T18:32:11.399472+0000","last_peered":"2024-09-12T18:32:11.399472+0000","last_clean":"2024-09-12T18:32:11.399472+0000","last_became_active":"2024-09-12T17:27:32.571830+0000","last_became_peered":"2024-09-12T17:27:32.571830+0000","last_unstale":"2024-09-12T18:32:11.399472+0000","last_undegraded":"2024-09-12T18:32:11.399472+0000","last_fullsized":"2024-09-12T18:32:11.399472+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:50.997968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":95,"num_write":63,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.406561+0000","last_change":"2024-09-12T17:53:27.163946+0000","last_active":"2024-09-12T18:32:26.406561+0000","last_peered":"2024-09-12T18:32:26.406561+0000","last_clean":"2024-09-12T18:32:26.406561+0000","last_became_active":"2024-09-12T17:53:27.163113+0000","last_became_peered":"2024-09-12T17:53:27.163113+0000","last_unstale":"2024-09-12T18:32:26.406561+0000","last_undegraded":"2024-09-12T18:32:26.406561+0000","last_fullsized":"2024-09-12T18:32:26.406561+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:01.071160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.418774+0000","last_change":"2024-09-12T17:31:16.234271+0000","last_active":"2024-09-12T18:33:36.418774+0000","last_peered":"2024-09-12T18:33:36.418774+0000","last_clean":"2024-09-12T18:33:36.418774+0000","last_became_active":"2024-09-12T17:31:16.233558+0000","last_became_peered":"2024-09-12T17:31:16.233558+0000","last_unstale":"2024-09-12T18:33:36.418774+0000","last_undegraded":"2024-09-12T18:33:36.418774+0000","last_fullsized":"2024-09-12T18:33:36.418774+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:03.391887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'6","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.413526+0000","last_change":"2024-09-12T17:31:12.094815+0000","last_active":"2024-09-12T18:33:41.413526+0000","last_peered":"2024-09-12T18:33:41.413526+0000","last_clean":"2024-09-12T18:33:41.413526+0000","last_became_active":"2024-09-12T17:31:12.094159+0000","last_became_peered":"2024-09-12T17:31:12.094159+0000","last_unstale":"2024-09-12T18:33:41.413526+0000","last_undegraded":"2024-09-12T18:33:41.413526+0000","last_fullsized":"2024-09-12T18:33:41.413526+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:09.522281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'20","reported_seq":124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:10.580606+0000","last_change":"2024-09-12T17:27:32.596142+0000","last_active":"2024-09-12T18:32:10.580606+0000","last_peered":"2024-09-12T18:32:10.580606+0000","last_clean":"2024-09-12T18:32:10.580606+0000","last_became_active":"2024-09-12T17:27:32.595524+0000","last_became_peered":"2024-09-12T17:27:32.595524+0000","last_unstale":"2024-09-12T18:32:10.580606+0000","last_undegraded":"2024-09-12T18:32:10.580606+0000","last_fullsized":"2024-09-12T18:32:10.580606+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:10.999486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":74,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.413732+0000","last_change":"2024-09-12T17:53:27.175841+0000","last_active":"2024-09-12T18:33:01.413732+0000","last_peered":"2024-09-12T18:33:01.413732+0000","last_clean":"2024-09-12T18:33:01.413732+0000","last_became_active":"2024-09-12T17:53:27.175125+0000","last_became_peered":"2024-09-12T17:53:27.175125+0000","last_unstale":"2024-09-12T18:33:01.413732+0000","last_undegraded":"2024-09-12T18:33:01.413732+0000","last_fullsized":"2024-09-12T18:33:01.413732+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:18.938638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'4","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.591667+0000","last_change":"2024-09-12T17:31:16.212462+0000","last_active":"2024-09-12T18:33:46.591667+0000","last_peered":"2024-09-12T18:33:46.591667+0000","last_clean":"2024-09-12T18:33:46.591667+0000","last_became_active":"2024-09-12T17:31:16.211664+0000","last_became_peered":"2024-09-12T17:31:16.211664+0000","last_unstale":"2024-09-12T18:33:46.591667+0000","last_undegraded":"2024-09-12T18:33:46.591667+0000","last_fullsized":"2024-09-12T18:33:46.591667+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:00.841100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1069,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'2","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.651197+0000","last_change":"2024-09-12T17:31:12.101932+0000","last_active":"2024-09-12T18:33:41.651197+0000","last_peered":"2024-09-12T18:33:41.651197+0000","last_clean":"2024-09-12T18:33:41.651197+0000","last_became_active":"2024-09-12T17:31:12.099608+0000","last_became_peered":"2024-09-12T17:31:12.099608+0000","last_unstale":"2024-09-12T18:33:41.651197+0000","last_undegraded":"2024-09-12T18:33:41.651197+0000","last_fullsized":"2024-09-12T18:33:41.651197+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:36.462019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'56","reported_seq":218,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.571812+0000","last_change":"2024-09-12T17:27:32.569526+0000","last_active":"2024-09-12T18:32:11.571812+0000","last_peered":"2024-09-12T18:32:11.571812+0000","last_clean":"2024-09-12T18:32:11.571812+0000","last_became_active":"2024-09-12T17:27:32.568785+0000","last_became_peered":"2024-09-12T17:27:32.568785+0000","last_unstale":"2024-09-12T18:32:11.571812+0000","last_undegraded":"2024-09-12T18:32:11.571812+0000","last_fullsized":"2024-09-12T18:32:11.571812+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:14.598346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":196,"num_write":113,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.407392+0000","last_change":"2024-09-12T17:53:27.175493+0000","last_active":"2024-09-12T18:33:16.407392+0000","last_peered":"2024-09-12T18:33:16.407392+0000","last_clean":"2024-09-12T18:33:16.407392+0000","last_became_active":"2024-09-12T17:53:27.175073+0000","last_became_peered":"2024-09-12T17:53:27.175073+0000","last_unstale":"2024-09-12T18:33:16.407392+0000","last_undegraded":"2024-09-12T18:33:16.407392+0000","last_fullsized":"2024-09-12T18:33:16.407392+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:43.723718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.602853+0000","last_change":"2024-09-12T17:31:16.229188+0000","last_active":"2024-09-12T18:33:45.602853+0000","last_peered":"2024-09-12T18:33:45.602853+0000","last_clean":"2024-09-12T18:33:45.602853+0000","last_became_active":"2024-09-12T17:31:16.228416+0000","last_became_peered":"2024-09-12T17:31:16.228416+0000","last_unstale":"2024-09-12T18:33:45.602853+0000","last_undegraded":"2024-09-12T18:33:45.602853+0000","last_fullsized":"2024-09-12T18:33:45.602853+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:54.390718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.590617+0000","last_change":"2024-09-12T17:31:12.089066+0000","last_active":"2024-09-12T18:33:41.590617+0000","last_peered":"2024-09-12T18:33:41.590617+0000","last_clean":"2024-09-12T18:33:41.590617+0000","last_became_active":"2024-09-12T17:31:12.088297+0000","last_became_peered":"2024-09-12T17:31:12.088297+0000","last_unstale":"2024-09-12T18:33:41.590617+0000","last_undegraded":"2024-09-12T18:33:41.590617+0000","last_fullsized":"2024-09-12T18:33:41.590617+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:37.483806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'16","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.417452+0000","last_change":"2024-09-12T17:27:32.585156+0000","last_active":"2024-09-12T18:33:56.417452+0000","last_peered":"2024-09-12T18:33:56.417452+0000","last_clean":"2024-09-12T18:33:56.417452+0000","last_became_active":"2024-09-12T17:27:32.584404+0000","last_became_peered":"2024-09-12T17:27:32.584404+0000","last_unstale":"2024-09-12T18:33:56.417452+0000","last_undegraded":"2024-09-12T18:33:56.417452+0000","last_fullsized":"2024-09-12T18:33:56.417452+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:00.210204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":55,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'254","reported_seq":900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.416405+0000","last_change":"2024-09-12T17:10:30.407868+0000","last_active":"2024-09-12T18:33:51.416405+0000","last_peered":"2024-09-12T18:33:51.416405+0000","last_clean":"2024-09-12T18:33:51.416405+0000","last_became_active":"2024-09-12T17:10:30.407181+0000","last_became_peered":"2024-09-12T17:10:30.407181+0000","last_unstale":"2024-09-12T18:33:51.416405+0000","last_undegraded":"2024-09-12T18:33:51.416405+0000","last_fullsized":"2024-09-12T18:33:51.416405+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:59.494627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10955125,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":417,"num_read_kb":10653,"num_write":856,"num_write_kb":47496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'781","reported_seq":2314,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.923295+0000","last_change":"2024-09-12T17:10:32.347708+0000","last_active":"2024-09-12T18:33:59.923295+0000","last_peered":"2024-09-12T18:33:59.923295+0000","last_clean":"2024-09-12T18:33:59.923295+0000","last_became_active":"2024-09-12T17:10:32.346911+0000","last_became_peered":"2024-09-12T17:10:32.346911+0000","last_unstale":"2024-09-12T18:33:59.923295+0000","last_undegraded":"2024-09-12T18:33:59.923295+0000","last_fullsized":"2024-09-12T18:33:59.923295+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:26.413533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3659,"num_read_kb":3307,"num_write":1011,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'320","reported_seq":1035,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.653638+0000","last_change":"2024-09-12T17:10:30.405881+0000","last_active":"2024-09-12T18:33:51.653638+0000","last_peered":"2024-09-12T18:33:51.653638+0000","last_clean":"2024-09-12T18:33:51.653638+0000","last_became_active":"2024-09-12T17:10:30.405515+0000","last_became_peered":"2024-09-12T17:10:30.405515+0000","last_unstale":"2024-09-12T18:33:51.653638+0000","last_undegraded":"2024-09-12T18:33:51.653638+0000","last_fullsized":"2024-09-12T18:33:51.653638+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:23.617786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4864546,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":602,"num_read_kb":13611,"num_write":1157,"num_write_kb":42248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'453","reported_seq":1933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.627333+0000","last_change":"2024-09-12T17:10:32.376635+0000","last_active":"2024-09-12T18:33:18.627333+0000","last_peered":"2024-09-12T18:33:18.627333+0000","last_clean":"2024-09-12T18:33:18.627333+0000","last_became_active":"2024-09-12T17:10:32.375908+0000","last_became_peered":"2024-09-12T17:10:32.375908+0000","last_unstale":"2024-09-12T18:33:18.627333+0000","last_undegraded":"2024-09-12T18:33:18.627333+0000","last_fullsized":"2024-09-12T18:33:18.627333+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:27.899807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2460,"num_read_kb":2294,"num_write":575,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'290","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.423591+0000","last_change":"2024-09-12T17:10:30.351588+0000","last_active":"2024-09-12T18:33:51.423591+0000","last_peered":"2024-09-12T18:33:51.423591+0000","last_clean":"2024-09-12T18:33:51.423591+0000","last_became_active":"2024-09-12T17:10:30.351202+0000","last_became_peered":"2024-09-12T17:10:30.351202+0000","last_unstale":"2024-09-12T18:33:51.423591+0000","last_undegraded":"2024-09-12T18:33:51.423591+0000","last_fullsized":"2024-09-12T18:33:51.423591+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:24.152184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29388745,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":395,"num_read_kb":96757,"num_write":967,"num_write_kb":52334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'557","reported_seq":2193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.626934+0000","last_change":"2024-09-12T17:10:32.371846+0000","last_active":"2024-09-12T18:33:18.626934+0000","last_peered":"2024-09-12T18:33:18.626934+0000","last_clean":"2024-09-12T18:33:18.626934+0000","last_became_active":"2024-09-12T17:10:32.370962+0000","last_became_peered":"2024-09-12T17:10:32.370962+0000","last_unstale":"2024-09-12T18:33:18.626934+0000","last_undegraded":"2024-09-12T18:33:18.626934+0000","last_fullsized":"2024-09-12T18:33:18.626934+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:19.779809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2855,"num_read_kb":2656,"num_write":715,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'343","reported_seq":1069,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.409580+0000","last_change":"2024-09-12T17:10:30.376632+0000","last_active":"2024-09-12T18:32:56.409580+0000","last_peered":"2024-09-12T18:32:56.409580+0000","last_clean":"2024-09-12T18:32:56.409580+0000","last_became_active":"2024-09-12T17:10:30.374789+0000","last_became_peered":"2024-09-12T17:10:30.374789+0000","last_unstale":"2024-09-12T18:32:56.409580+0000","last_undegraded":"2024-09-12T18:32:56.409580+0000","last_fullsized":"2024-09-12T18:32:56.409580+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:10.377494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12234279,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":722,"num_read_kb":12010,"num_write":1197,"num_write_kb":48882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'284","reported_seq":1673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.928533+0000","last_change":"2024-09-12T17:10:32.357514+0000","last_active":"2024-09-12T18:33:59.928533+0000","last_peered":"2024-09-12T18:33:59.928533+0000","last_clean":"2024-09-12T18:33:59.928533+0000","last_became_active":"2024-09-12T17:10:32.357199+0000","last_became_peered":"2024-09-12T17:10:32.357199+0000","last_unstale":"2024-09-12T18:33:59.928533+0000","last_undegraded":"2024-09-12T18:33:59.928533+0000","last_fullsized":"2024-09-12T18:33:59.928533+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:17.757987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1623,"num_read_kb":1593,"num_write":300,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'244","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.930068+0000","last_change":"2024-09-12T17:10:30.387768+0000","last_active":"2024-09-12T18:33:18.930068+0000","last_peered":"2024-09-12T18:33:18.930068+0000","last_clean":"2024-09-12T18:33:18.930068+0000","last_became_active":"2024-09-12T17:10:30.385216+0000","last_became_peered":"2024-09-12T17:10:30.385216+0000","last_unstale":"2024-09-12T18:33:18.930068+0000","last_undegraded":"2024-09-12T18:33:18.930068+0000","last_fullsized":"2024-09-12T18:33:18.930068+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:48.266095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3574308,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":334,"num_read_kb":5414,"num_write":859,"num_write_kb":15383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'549","reported_seq":2122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.927415+0000","last_change":"2024-09-12T17:10:32.352752+0000","last_active":"2024-09-12T18:33:59.927415+0000","last_peered":"2024-09-12T18:33:59.927415+0000","last_clean":"2024-09-12T18:33:59.927415+0000","last_became_active":"2024-09-12T17:10:32.351972+0000","last_became_peered":"2024-09-12T17:10:32.351972+0000","last_unstale":"2024-09-12T18:33:59.927415+0000","last_undegraded":"2024-09-12T18:33:59.927415+0000","last_fullsized":"2024-09-12T18:33:59.927415+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:26.765589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2788,"num_read_kb":2550,"num_write":700,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'292","reported_seq":944,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.410729+0000","last_change":"2024-09-12T17:10:30.362938+0000","last_active":"2024-09-12T18:33:01.410729+0000","last_peered":"2024-09-12T18:33:01.410729+0000","last_clean":"2024-09-12T18:33:01.410729+0000","last_became_active":"2024-09-12T17:10:30.350813+0000","last_became_peered":"2024-09-12T17:10:30.350813+0000","last_unstale":"2024-09-12T18:33:01.410729+0000","last_undegraded":"2024-09-12T18:33:01.410729+0000","last_fullsized":"2024-09-12T18:33:01.410729+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:45.963449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53593,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":459,"num_read_kb":3741,"num_write":1035,"num_write_kb":26406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'434","reported_seq":2148,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605409+0000","last_change":"2024-09-12T17:10:32.363876+0000","last_active":"2024-09-12T18:33:55.605409+0000","last_peered":"2024-09-12T18:33:55.605409+0000","last_clean":"2024-09-12T18:33:55.605409+0000","last_became_active":"2024-09-12T17:10:32.362980+0000","last_became_peered":"2024-09-12T17:10:32.362980+0000","last_unstale":"2024-09-12T18:33:55.605409+0000","last_undegraded":"2024-09-12T18:33:55.605409+0000","last_fullsized":"2024-09-12T18:33:55.605409+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:44.556208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2502,"num_read_kb":2403,"num_write":488,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'292","reported_seq":1189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.403424+0000","last_change":"2024-09-12T17:11:04.871628+0000","last_active":"2024-09-12T18:33:01.403424+0000","last_peered":"2024-09-12T18:33:01.403424+0000","last_clean":"2024-09-12T18:33:01.403424+0000","last_became_active":"2024-09-12T17:11:04.870569+0000","last_became_peered":"2024-09-12T17:11:04.870569+0000","last_unstale":"2024-09-12T18:33:01.403424+0000","last_undegraded":"2024-09-12T18:33:01.403424+0000","last_fullsized":"2024-09-12T18:33:01.403424+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:14.018442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17004998,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":925,"num_read_kb":89435,"num_write":1144,"num_write_kb":38550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'426","reported_seq":1940,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:38.177955+0000","last_change":"2024-09-12T17:10:32.369695+0000","last_active":"2024-09-12T18:32:38.177955+0000","last_peered":"2024-09-12T18:32:38.177955+0000","last_clean":"2024-09-12T18:32:38.177955+0000","last_became_active":"2024-09-12T17:10:32.368909+0000","last_became_peered":"2024-09-12T17:10:32.368909+0000","last_unstale":"2024-09-12T18:32:38.177955+0000","last_undegraded":"2024-09-12T18:32:38.177955+0000","last_fullsized":"2024-09-12T18:32:38.177955+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:18.380922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2227,"num_read_kb":2101,"num_write":505,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'326","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.207633+0000","last_change":"2024-09-12T17:10:30.395510+0000","last_active":"2024-09-12T18:35:59.207633+0000","last_peered":"2024-09-12T18:35:59.207633+0000","last_clean":"2024-09-12T18:35:59.207633+0000","last_became_active":"2024-09-12T17:10:30.395061+0000","last_became_peered":"2024-09-12T17:10:30.395061+0000","last_unstale":"2024-09-12T18:35:59.207633+0000","last_undegraded":"2024-09-12T18:35:59.207633+0000","last_fullsized":"2024-09-12T18:35:59.207633+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:41.200923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14709348,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":585,"num_read_kb":20147,"num_write":1087,"num_write_kb":23715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'421","reported_seq":1782,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.461932+0000","last_change":"2024-09-12T17:11:05.125681+0000","last_active":"2024-09-12T18:33:28.461932+0000","last_peered":"2024-09-12T18:33:28.461932+0000","last_clean":"2024-09-12T18:33:28.461932+0000","last_became_active":"2024-09-12T17:11:05.124718+0000","last_became_peered":"2024-09-12T17:11:05.124718+0000","last_unstale":"2024-09-12T18:33:28.461932+0000","last_undegraded":"2024-09-12T18:33:28.461932+0000","last_fullsized":"2024-09-12T18:33:28.461932+0000","mapping_epoch":38,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:17.850798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2066,"num_read_kb":1911,"num_write":507,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'652","reported_seq":2390,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.928419+0000","last_change":"2024-09-12T17:10:32.363944+0000","last_active":"2024-09-12T18:33:59.928419+0000","last_peered":"2024-09-12T18:33:59.928419+0000","last_clean":"2024-09-12T18:33:59.928419+0000","last_became_active":"2024-09-12T17:10:32.363179+0000","last_became_peered":"2024-09-12T17:10:32.363179+0000","last_unstale":"2024-09-12T18:33:59.928419+0000","last_undegraded":"2024-09-12T18:33:59.928419+0000","last_fullsized":"2024-09-12T18:33:59.928419+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":600,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:03.623272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3427,"num_read_kb":3148,"num_write":833,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'266","reported_seq":952,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.920243+0000","last_change":"2024-09-12T17:10:30.387578+0000","last_active":"2024-09-12T18:33:38.920243+0000","last_peered":"2024-09-12T18:33:38.920243+0000","last_clean":"2024-09-12T18:33:38.920243+0000","last_became_active":"2024-09-12T17:10:30.385785+0000","last_became_peered":"2024-09-12T17:10:30.385785+0000","last_unstale":"2024-09-12T18:33:38.920243+0000","last_undegraded":"2024-09-12T18:33:38.920243+0000","last_fullsized":"2024-09-12T18:33:38.920243+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:57.879527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17126668,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":476,"num_read_kb":51058,"num_write":980,"num_write_kb":34693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'508","reported_seq":2186,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.815743+0000","last_change":"2024-09-12T17:10:32.380268+0000","last_active":"2024-09-12T18:34:01.815743+0000","last_peered":"2024-09-12T18:34:01.815743+0000","last_clean":"2024-09-12T18:34:01.815743+0000","last_became_active":"2024-09-12T17:10:32.379669+0000","last_became_peered":"2024-09-12T17:10:32.379669+0000","last_unstale":"2024-09-12T18:34:01.815743+0000","last_undegraded":"2024-09-12T18:34:01.815743+0000","last_fullsized":"2024-09-12T18:34:01.815743+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:43.664634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2752,"num_read_kb":2572,"num_write":584,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'280","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:12.992823+0000","last_change":"2024-09-12T17:12:05.835283+0000","last_active":"2024-09-12T18:35:12.992823+0000","last_peered":"2024-09-12T18:35:12.992823+0000","last_clean":"2024-09-12T18:35:12.992823+0000","last_became_active":"2024-09-12T17:12:05.834873+0000","last_became_peered":"2024-09-12T17:12:05.834873+0000","last_unstale":"2024-09-12T18:35:12.992823+0000","last_undegraded":"2024-09-12T18:35:12.992823+0000","last_fullsized":"2024-09-12T18:35:12.992823+0000","mapping_epoch":40,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:29.427065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24402696,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":491,"num_read_kb":40640,"num_write":1055,"num_write_kb":40250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"268'1939","reported_seq":3530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.814002+0000","last_change":"2024-09-12T17:10:32.359245+0000","last_active":"2024-09-12T18:34:01.814002+0000","last_peered":"2024-09-12T18:34:01.814002+0000","last_clean":"2024-09-12T18:34:01.814002+0000","last_became_active":"2024-09-12T17:10:32.358342+0000","last_became_peered":"2024-09-12T17:10:32.358342+0000","last_unstale":"2024-09-12T18:34:01.814002+0000","last_undegraded":"2024-09-12T18:34:01.814002+0000","last_fullsized":"2024-09-12T18:34:01.814002+0000","mapping_epoch":27,"log_start":"268'1900","ondisk_log_start":"268'1900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1900,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:01.927050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8411,"num_read_kb":7313,"num_write":2747,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'313","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.578322+0000","last_change":"2024-09-12T17:10:30.401167+0000","last_active":"2024-09-12T18:32:41.578322+0000","last_peered":"2024-09-12T18:32:41.578322+0000","last_clean":"2024-09-12T18:32:41.578322+0000","last_became_active":"2024-09-12T17:10:30.395938+0000","last_became_peered":"2024-09-12T17:10:30.395938+0000","last_unstale":"2024-09-12T18:32:41.578322+0000","last_undegraded":"2024-09-12T18:32:41.578322+0000","last_fullsized":"2024-09-12T18:32:41.578322+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:51.897394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13685157,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":457,"num_read_kb":40772,"num_write":1141,"num_write_kb":34948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'778","reported_seq":2224,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.797878+0000","last_change":"2024-09-12T17:10:32.354888+0000","last_active":"2024-09-12T18:32:46.797878+0000","last_peered":"2024-09-12T18:32:46.797878+0000","last_clean":"2024-09-12T18:32:46.797878+0000","last_became_active":"2024-09-12T17:10:32.354271+0000","last_became_peered":"2024-09-12T17:10:32.354271+0000","last_unstale":"2024-09-12T18:32:46.797878+0000","last_undegraded":"2024-09-12T18:32:46.797878+0000","last_fullsized":"2024-09-12T18:32:46.797878+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:40.309416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3730,"num_read_kb":3333,"num_write":1060,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'497","reported_seq":1246,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.568314+0000","last_change":"2024-09-12T17:10:30.396067+0000","last_active":"2024-09-12T18:36:00.568314+0000","last_peered":"2024-09-12T18:36:00.568314+0000","last_clean":"2024-09-12T18:36:00.568314+0000","last_became_active":"2024-09-12T17:10:30.394905+0000","last_became_peered":"2024-09-12T17:10:30.394905+0000","last_unstale":"2024-09-12T18:36:00.568314+0000","last_undegraded":"2024-09-12T18:36:00.568314+0000","last_fullsized":"2024-09-12T18:36:00.568314+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:58.605567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21306835,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":911,"num_read_kb":40764,"num_write":1540,"num_write_kb":41950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'786","reported_seq":2379,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.627433+0000","last_change":"2024-09-12T17:10:32.372409+0000","last_active":"2024-09-12T18:33:18.627433+0000","last_peered":"2024-09-12T18:33:18.627433+0000","last_clean":"2024-09-12T18:33:18.627433+0000","last_became_active":"2024-09-12T17:10:32.372137+0000","last_became_peered":"2024-09-12T17:10:32.372137+0000","last_unstale":"2024-09-12T18:33:18.627433+0000","last_undegraded":"2024-09-12T18:33:18.627433+0000","last_fullsized":"2024-09-12T18:33:18.627433+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:07.405740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3748,"num_read_kb":3393,"num_write":1031,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'276","reported_seq":910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.313257+0000","last_change":"2024-09-12T17:10:30.394449+0000","last_active":"2024-09-12T18:35:59.313257+0000","last_peered":"2024-09-12T18:35:59.313257+0000","last_clean":"2024-09-12T18:35:59.313257+0000","last_became_active":"2024-09-12T17:10:30.394096+0000","last_became_peered":"2024-09-12T17:10:30.394096+0000","last_unstale":"2024-09-12T18:35:59.313257+0000","last_undegraded":"2024-09-12T18:35:59.313257+0000","last_fullsized":"2024-09-12T18:35:59.313257+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:17.229735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9140561,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":377,"num_read_kb":10348,"num_write":972,"num_write_kb":23725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'862","reported_seq":2531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:45.588918+0000","last_change":"2024-09-12T17:10:32.361908+0000","last_active":"2024-09-12T18:32:45.588918+0000","last_peered":"2024-09-12T18:32:45.588918+0000","last_clean":"2024-09-12T18:32:45.588918+0000","last_became_active":"2024-09-12T17:10:32.361126+0000","last_became_peered":"2024-09-12T17:10:32.361126+0000","last_unstale":"2024-09-12T18:32:45.588918+0000","last_undegraded":"2024-09-12T18:32:45.588918+0000","last_fullsized":"2024-09-12T18:32:45.588918+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:09.763728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4216,"num_read_kb":3793,"num_write":1162,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'260","reported_seq":878,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.806139+0000","last_change":"2024-09-12T17:10:30.353547+0000","last_active":"2024-09-12T18:33:12.806139+0000","last_peered":"2024-09-12T18:33:12.806139+0000","last_clean":"2024-09-12T18:33:12.806139+0000","last_became_active":"2024-09-12T17:10:30.353147+0000","last_became_peered":"2024-09-12T17:10:30.353147+0000","last_unstale":"2024-09-12T18:33:12.806139+0000","last_undegraded":"2024-09-12T18:33:12.806139+0000","last_fullsized":"2024-09-12T18:33:12.806139+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:15.129856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10488727,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":338,"num_read_kb":13692,"num_write":934,"num_write_kb":32545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'134","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.133975+0000","last_change":"2024-09-12T17:10:40.422258+0000","last_active":"2024-09-12T18:34:02.133975+0000","last_peered":"2024-09-12T18:34:02.133975+0000","last_clean":"2024-09-12T18:34:02.133975+0000","last_became_active":"2024-09-12T17:10:40.421380+0000","last_became_peered":"2024-09-12T17:10:40.421380+0000","last_unstale":"2024-09-12T18:34:02.133975+0000","last_undegraded":"2024-09-12T18:34:02.133975+0000","last_fullsized":"2024-09-12T18:34:02.133975+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:26.392127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":207,"num_write":318,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'456","reported_seq":2070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.622792+0000","last_change":"2024-09-12T17:10:32.370396+0000","last_active":"2024-09-12T18:33:18.622792+0000","last_peered":"2024-09-12T18:33:18.622792+0000","last_clean":"2024-09-12T18:33:18.622792+0000","last_became_active":"2024-09-12T17:10:32.370058+0000","last_became_peered":"2024-09-12T17:10:32.370058+0000","last_unstale":"2024-09-12T18:33:18.622792+0000","last_undegraded":"2024-09-12T18:33:18.622792+0000","last_fullsized":"2024-09-12T18:33:18.622792+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:48.973947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2398,"num_read_kb":2269,"num_write":525,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'257","reported_seq":868,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.797916+0000","last_change":"2024-09-12T17:11:04.871757+0000","last_active":"2024-09-12T18:32:46.797916+0000","last_peered":"2024-09-12T18:32:46.797916+0000","last_clean":"2024-09-12T18:32:46.797916+0000","last_became_active":"2024-09-12T17:11:04.871007+0000","last_became_peered":"2024-09-12T17:11:04.871007+0000","last_unstale":"2024-09-12T18:32:46.797916+0000","last_undegraded":"2024-09-12T18:32:46.797916+0000","last_fullsized":"2024-09-12T18:32:46.797916+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:22.664826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9028569,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":369,"num_read_kb":10233,"num_write":967,"num_write_kb":32687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.407279+0000","last_change":"2024-09-12T17:10:34.371764+0000","last_active":"2024-09-12T18:32:46.407279+0000","last_peered":"2024-09-12T18:32:46.407279+0000","last_clean":"2024-09-12T18:32:46.407279+0000","last_became_active":"2024-09-12T17:10:34.371022+0000","last_became_peered":"2024-09-12T17:10:34.371022+0000","last_unstale":"2024-09-12T18:32:46.407279+0000","last_undegraded":"2024-09-12T18:32:46.407279+0000","last_fullsized":"2024-09-12T18:32:46.407279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:04.412145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'363","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:11.439798+0000","last_change":"2024-09-12T17:10:36.399853+0000","last_active":"2024-09-12T18:35:11.439798+0000","last_peered":"2024-09-12T18:35:11.439798+0000","last_clean":"2024-09-12T18:35:11.439798+0000","last_became_active":"2024-09-12T17:10:36.399464+0000","last_became_peered":"2024-09-12T17:10:36.399464+0000","last_unstale":"2024-09-12T18:35:11.439798+0000","last_undegraded":"2024-09-12T18:35:11.439798+0000","last_fullsized":"2024-09-12T18:35:11.439798+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:12.028942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59801,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":589,"num_read_kb":1157,"num_write":470,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.401248+0000","last_change":"2024-09-12T17:10:38.405144+0000","last_active":"2024-09-12T18:32:51.401248+0000","last_peered":"2024-09-12T18:32:51.401248+0000","last_clean":"2024-09-12T18:32:51.401248+0000","last_became_active":"2024-09-12T17:10:38.404423+0000","last_became_peered":"2024-09-12T17:10:38.404423+0000","last_unstale":"2024-09-12T18:32:51.401248+0000","last_undegraded":"2024-09-12T18:32:51.401248+0000","last_fullsized":"2024-09-12T18:32:51.401248+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:04.302118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'170","reported_seq":740,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.772365+0000","last_change":"2024-09-12T17:10:40.426221+0000","last_active":"2024-09-12T18:34:01.772365+0000","last_peered":"2024-09-12T18:34:01.772365+0000","last_clean":"2024-09-12T18:34:01.772365+0000","last_became_active":"2024-09-12T17:10:40.425532+0000","last_became_peered":"2024-09-12T17:10:40.425532+0000","last_unstale":"2024-09-12T18:34:01.772365+0000","last_undegraded":"2024-09-12T18:34:01.772365+0000","last_fullsized":"2024-09-12T18:34:01.772365+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:09.048645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":265,"num_read_kb":256,"num_write":326,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'733","reported_seq":2463,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.923583+0000","last_change":"2024-09-12T17:10:32.382421+0000","last_active":"2024-09-12T18:33:59.923583+0000","last_peered":"2024-09-12T18:33:59.923583+0000","last_clean":"2024-09-12T18:33:59.923583+0000","last_became_active":"2024-09-12T17:10:32.381838+0000","last_became_peered":"2024-09-12T17:10:32.381838+0000","last_unstale":"2024-09-12T18:33:59.923583+0000","last_undegraded":"2024-09-12T18:33:59.923583+0000","last_fullsized":"2024-09-12T18:33:59.923583+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:23.645321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3756,"num_read_kb":3395,"num_write":1068,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'328","reported_seq":1049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.403441+0000","last_change":"2024-09-12T17:10:30.362609+0000","last_active":"2024-09-12T18:32:11.403441+0000","last_peered":"2024-09-12T18:32:11.403441+0000","last_clean":"2024-09-12T18:32:11.403441+0000","last_became_active":"2024-09-12T17:10:30.362010+0000","last_became_peered":"2024-09-12T17:10:30.362010+0000","last_unstale":"2024-09-12T18:32:11.403441+0000","last_undegraded":"2024-09-12T18:32:11.403441+0000","last_fullsized":"2024-09-12T18:32:11.403441+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:57.522595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15988764,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":639,"num_read_kb":52712,"num_write":1359,"num_write_kb":39491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403196+0000","last_change":"2024-09-12T17:10:34.362183+0000","last_active":"2024-09-12T18:32:34.403196+0000","last_peered":"2024-09-12T18:32:34.403196+0000","last_clean":"2024-09-12T18:32:34.403196+0000","last_became_active":"2024-09-12T17:10:34.361102+0000","last_became_peered":"2024-09-12T17:10:34.361102+0000","last_unstale":"2024-09-12T18:32:34.403196+0000","last_undegraded":"2024-09-12T18:32:34.403196+0000","last_fullsized":"2024-09-12T18:32:34.403196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:20.467248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'110","reported_seq":666,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.590229+0000","last_change":"2024-09-12T17:10:36.391217+0000","last_active":"2024-09-12T18:32:50.590229+0000","last_peered":"2024-09-12T18:32:50.590229+0000","last_clean":"2024-09-12T18:32:50.590229+0000","last_became_active":"2024-09-12T17:10:36.390398+0000","last_became_peered":"2024-09-12T17:10:36.390398+0000","last_unstale":"2024-09-12T18:32:50.590229+0000","last_undegraded":"2024-09-12T18:32:50.590229+0000","last_fullsized":"2024-09-12T18:32:50.590229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:54.025550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.590198+0000","last_change":"2024-09-12T17:10:38.414637+0000","last_active":"2024-09-12T18:32:50.590198+0000","last_peered":"2024-09-12T18:32:50.590198+0000","last_clean":"2024-09-12T18:32:50.590198+0000","last_became_active":"2024-09-12T17:10:38.414063+0000","last_became_peered":"2024-09-12T17:10:38.414063+0000","last_unstale":"2024-09-12T18:32:50.590198+0000","last_undegraded":"2024-09-12T18:32:50.590198+0000","last_fullsized":"2024-09-12T18:32:50.590198+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:48.781233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'138","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.548387+0000","last_change":"2024-09-12T17:10:40.423061+0000","last_active":"2024-09-12T18:33:57.548387+0000","last_peered":"2024-09-12T18:33:57.548387+0000","last_clean":"2024-09-12T18:33:57.548387+0000","last_became_active":"2024-09-12T17:10:40.422118+0000","last_became_peered":"2024-09-12T17:10:40.422118+0000","last_unstale":"2024-09-12T18:33:57.548387+0000","last_undegraded":"2024-09-12T18:33:57.548387+0000","last_fullsized":"2024-09-12T18:33:57.548387+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:39.157083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":180,"num_write":349,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'871","reported_seq":2493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.814191+0000","last_change":"2024-09-12T17:10:32.352650+0000","last_active":"2024-09-12T18:34:01.814191+0000","last_peered":"2024-09-12T18:34:01.814191+0000","last_clean":"2024-09-12T18:34:01.814191+0000","last_became_active":"2024-09-12T17:10:32.351650+0000","last_became_peered":"2024-09-12T17:10:32.351650+0000","last_unstale":"2024-09-12T18:34:01.814191+0000","last_undegraded":"2024-09-12T18:34:01.814191+0000","last_fullsized":"2024-09-12T18:34:01.814191+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:03.003509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4313,"num_read_kb":3885,"num_write":1184,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'329","reported_seq":1064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.973849+0000","last_change":"2024-09-12T17:10:30.394677+0000","last_active":"2024-09-12T18:32:51.973849+0000","last_peered":"2024-09-12T18:32:51.973849+0000","last_clean":"2024-09-12T18:32:51.973849+0000","last_became_active":"2024-09-12T17:10:30.393670+0000","last_became_peered":"2024-09-12T17:10:30.393670+0000","last_unstale":"2024-09-12T18:32:51.973849+0000","last_undegraded":"2024-09-12T18:32:51.973849+0000","last_fullsized":"2024-09-12T18:32:51.973849+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:39.112583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12845816,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":720,"num_read_kb":43186,"num_write":1162,"num_write_kb":22438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:44.406536+0000","last_change":"2024-09-12T17:10:34.358839+0000","last_active":"2024-09-12T18:32:44.406536+0000","last_peered":"2024-09-12T18:32:44.406536+0000","last_clean":"2024-09-12T18:32:44.406536+0000","last_became_active":"2024-09-12T17:10:34.358119+0000","last_became_peered":"2024-09-12T17:10:34.358119+0000","last_unstale":"2024-09-12T18:32:44.406536+0000","last_undegraded":"2024-09-12T18:32:44.406536+0000","last_fullsized":"2024-09-12T18:32:44.406536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:56.480463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'152","reported_seq":726,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.790757+0000","last_change":"2024-09-12T17:10:36.385198+0000","last_active":"2024-09-12T18:32:26.790757+0000","last_peered":"2024-09-12T18:32:26.790757+0000","last_clean":"2024-09-12T18:32:26.790757+0000","last_became_active":"2024-09-12T17:10:36.384465+0000","last_became_peered":"2024-09-12T17:10:36.384465+0000","last_unstale":"2024-09-12T18:32:26.790757+0000","last_undegraded":"2024-09-12T18:32:26.790757+0000","last_fullsized":"2024-09-12T18:32:26.790757+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:48.249397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":178,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'788","reported_seq":2914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.783548+0000","last_change":"2024-09-12T17:10:38.407657+0000","last_active":"2024-09-12T18:35:21.783548+0000","last_peered":"2024-09-12T18:35:21.783548+0000","last_clean":"2024-09-12T18:35:21.783548+0000","last_became_active":"2024-09-12T17:10:38.406964+0000","last_became_peered":"2024-09-12T17:10:38.406964+0000","last_unstale":"2024-09-12T18:35:21.783548+0000","last_undegraded":"2024-09-12T18:35:21.783548+0000","last_fullsized":"2024-09-12T18:35:21.783548+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:41.454994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'254","reported_seq":1111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.224603+0000","last_change":"2024-09-12T17:10:40.769418+0000","last_active":"2024-09-12T18:34:02.224603+0000","last_peered":"2024-09-12T18:34:02.224603+0000","last_clean":"2024-09-12T18:34:02.224603+0000","last_became_active":"2024-09-12T17:10:40.768896+0000","last_became_peered":"2024-09-12T17:10:40.768896+0000","last_unstale":"2024-09-12T18:34:02.224603+0000","last_undegraded":"2024-09-12T18:34:02.224603+0000","last_fullsized":"2024-09-12T18:34:02.224603+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:14.019332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":705,"num_read_kb":685,"num_write":456,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'529","reported_seq":2333,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.722899+0000","last_change":"2024-09-12T17:10:32.383037+0000","last_active":"2024-09-12T18:33:13.722899+0000","last_peered":"2024-09-12T18:33:13.722899+0000","last_clean":"2024-09-12T18:33:13.722899+0000","last_became_active":"2024-09-12T17:10:32.382671+0000","last_became_peered":"2024-09-12T17:10:32.382671+0000","last_unstale":"2024-09-12T18:33:13.722899+0000","last_undegraded":"2024-09-12T18:33:13.722899+0000","last_fullsized":"2024-09-12T18:33:13.722899+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:57.340586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3129,"num_read_kb":2937,"num_write":633,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'312","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.251341+0000","last_change":"2024-09-12T17:10:30.391255+0000","last_active":"2024-09-12T18:33:05.251341+0000","last_peered":"2024-09-12T18:33:05.251341+0000","last_clean":"2024-09-12T18:33:05.251341+0000","last_became_active":"2024-09-12T17:10:30.390677+0000","last_became_peered":"2024-09-12T17:10:30.390677+0000","last_unstale":"2024-09-12T18:33:05.251341+0000","last_undegraded":"2024-09-12T18:33:05.251341+0000","last_fullsized":"2024-09-12T18:33:05.251341+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:46.541083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12847960,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":515,"num_read_kb":63186,"num_write":1059,"num_write_kb":46639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.407341+0000","last_change":"2024-09-12T17:10:34.373089+0000","last_active":"2024-09-12T18:32:46.407341+0000","last_peered":"2024-09-12T18:32:46.407341+0000","last_clean":"2024-09-12T18:32:46.407341+0000","last_became_active":"2024-09-12T17:10:34.371937+0000","last_became_peered":"2024-09-12T17:10:34.371937+0000","last_unstale":"2024-09-12T18:32:46.407341+0000","last_undegraded":"2024-09-12T18:32:46.407341+0000","last_fullsized":"2024-09-12T18:32:46.407341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:36.719820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'313","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:11.436453+0000","last_change":"2024-09-12T17:10:36.921222+0000","last_active":"2024-09-12T18:35:11.436453+0000","last_peered":"2024-09-12T18:35:11.436453+0000","last_clean":"2024-09-12T18:35:11.436453+0000","last_became_active":"2024-09-12T17:10:36.920487+0000","last_became_peered":"2024-09-12T17:10:36.920487+0000","last_unstale":"2024-09-12T18:35:11.436453+0000","last_undegraded":"2024-09-12T18:35:11.436453+0000","last_fullsized":"2024-09-12T18:35:11.436453+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:45.222423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64544,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":532,"num_read_kb":1149,"num_write":444,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'804","reported_seq":2812,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.015508+0000","last_change":"2024-09-12T17:10:38.398227+0000","last_active":"2024-09-12T18:35:59.015508+0000","last_peered":"2024-09-12T18:35:59.015508+0000","last_clean":"2024-09-12T18:35:59.015508+0000","last_became_active":"2024-09-12T17:10:38.393524+0000","last_became_peered":"2024-09-12T17:10:38.393524+0000","last_unstale":"2024-09-12T18:35:59.015508+0000","last_undegraded":"2024-09-12T18:35:59.015508+0000","last_fullsized":"2024-09-12T18:35:59.015508+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:55.682578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'401","reported_seq":1970,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.625087+0000","last_change":"2024-09-12T17:10:32.378803+0000","last_active":"2024-09-12T18:33:18.625087+0000","last_peered":"2024-09-12T18:33:18.625087+0000","last_clean":"2024-09-12T18:33:18.625087+0000","last_became_active":"2024-09-12T17:10:32.378027+0000","last_became_peered":"2024-09-12T17:10:32.378027+0000","last_unstale":"2024-09-12T18:33:18.625087+0000","last_undegraded":"2024-09-12T18:33:18.625087+0000","last_fullsized":"2024-09-12T18:33:18.625087+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:52.446776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2313,"num_read_kb":2218,"num_write":459,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'280","reported_seq":951,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:59.386439+0000","last_change":"2024-09-12T17:10:30.387735+0000","last_active":"2024-09-12T18:32:59.386439+0000","last_peered":"2024-09-12T18:32:59.386439+0000","last_clean":"2024-09-12T18:32:59.386439+0000","last_became_active":"2024-09-12T17:10:30.386707+0000","last_became_peered":"2024-09-12T17:10:30.386707+0000","last_unstale":"2024-09-12T18:32:59.386439+0000","last_undegraded":"2024-09-12T18:32:59.386439+0000","last_fullsized":"2024-09-12T18:32:59.386439+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:19.438334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9274013,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":464,"num_read_kb":31049,"num_write":1054,"num_write_kb":31528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.402246+0000","last_change":"2024-09-12T17:10:34.369825+0000","last_active":"2024-09-12T18:32:56.402246+0000","last_peered":"2024-09-12T18:32:56.402246+0000","last_clean":"2024-09-12T18:32:56.402246+0000","last_became_active":"2024-09-12T17:10:34.369066+0000","last_became_peered":"2024-09-12T17:10:34.369066+0000","last_unstale":"2024-09-12T18:32:56.402246+0000","last_undegraded":"2024-09-12T18:32:56.402246+0000","last_fullsized":"2024-09-12T18:32:56.402246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'380","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.710779+0000","last_change":"2024-09-12T17:10:36.920855+0000","last_active":"2024-09-12T18:35:21.710779+0000","last_peered":"2024-09-12T18:35:21.710779+0000","last_clean":"2024-09-12T18:35:21.710779+0000","last_became_active":"2024-09-12T17:10:36.920136+0000","last_became_peered":"2024-09-12T17:10:36.920136+0000","last_unstale":"2024-09-12T18:35:21.710779+0000","last_undegraded":"2024-09-12T18:35:21.710779+0000","last_fullsized":"2024-09-12T18:35:21.710779+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:53.763125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60606,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":610,"num_read_kb":1074,"num_write":460,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.623483+0000","last_change":"2024-09-12T17:10:38.395526+0000","last_active":"2024-09-12T18:31:41.623483+0000","last_peered":"2024-09-12T18:31:41.623483+0000","last_clean":"2024-09-12T18:31:41.623483+0000","last_became_active":"2024-09-12T17:10:38.394381+0000","last_became_peered":"2024-09-12T17:10:38.394381+0000","last_unstale":"2024-09-12T18:31:41.623483+0000","last_undegraded":"2024-09-12T18:31:41.623483+0000","last_fullsized":"2024-09-12T18:31:41.623483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:07.549215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'531","reported_seq":1356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.744047+0000","last_change":"2024-09-12T17:10:40.423104+0000","last_active":"2024-09-12T18:35:21.744047+0000","last_peered":"2024-09-12T18:35:21.744047+0000","last_clean":"2024-09-12T18:35:21.744047+0000","last_became_active":"2024-09-12T17:10:40.422353+0000","last_became_peered":"2024-09-12T17:10:40.422353+0000","last_unstale":"2024-09-12T18:35:21.744047+0000","last_undegraded":"2024-09-12T18:35:21.744047+0000","last_fullsized":"2024-09-12T18:35:21.744047+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:50.482047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1294,"num_read_kb":1291,"num_write":1098,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'422","reported_seq":2030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.510810+0000","last_change":"2024-09-12T17:10:32.370427+0000","last_active":"2024-09-12T18:33:01.510810+0000","last_peered":"2024-09-12T18:33:01.510810+0000","last_clean":"2024-09-12T18:33:01.510810+0000","last_became_active":"2024-09-12T17:10:32.369188+0000","last_became_peered":"2024-09-12T17:10:32.369188+0000","last_unstale":"2024-09-12T18:33:01.510810+0000","last_undegraded":"2024-09-12T18:33:01.510810+0000","last_fullsized":"2024-09-12T18:33:01.510810+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:45.905435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2274,"num_read_kb":2176,"num_write":482,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'268","reported_seq":1044,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.631922+0000","last_change":"2024-09-12T17:10:30.384287+0000","last_active":"2024-09-12T18:32:41.631922+0000","last_peered":"2024-09-12T18:32:41.631922+0000","last_clean":"2024-09-12T18:32:41.631922+0000","last_became_active":"2024-09-12T17:10:30.381728+0000","last_became_peered":"2024-09-12T17:10:30.381728+0000","last_unstale":"2024-09-12T18:32:41.631922+0000","last_undegraded":"2024-09-12T18:32:41.631922+0000","last_fullsized":"2024-09-12T18:32:41.631922+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:55.748760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18875113,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":516,"num_read_kb":127583,"num_write":954,"num_write_kb":57035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.799633+0000","last_change":"2024-09-12T17:10:34.346640+0000","last_active":"2024-09-12T18:32:56.799633+0000","last_peered":"2024-09-12T18:32:56.799633+0000","last_clean":"2024-09-12T18:32:56.799633+0000","last_became_active":"2024-09-12T17:10:34.346229+0000","last_became_peered":"2024-09-12T17:10:34.346229+0000","last_unstale":"2024-09-12T18:32:56.799633+0000","last_undegraded":"2024-09-12T18:32:56.799633+0000","last_fullsized":"2024-09-12T18:32:56.799633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:33.485742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'294","reported_seq":890,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.654783+0000","last_change":"2024-09-12T17:10:36.399143+0000","last_active":"2024-09-12T18:35:21.654783+0000","last_peered":"2024-09-12T18:35:21.654783+0000","last_clean":"2024-09-12T18:35:21.654783+0000","last_became_active":"2024-09-12T17:10:36.398641+0000","last_became_peered":"2024-09-12T17:10:36.398641+0000","last_unstale":"2024-09-12T18:35:21.654783+0000","last_undegraded":"2024-09-12T18:35:21.654783+0000","last_fullsized":"2024-09-12T18:35:21.654783+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:50.236212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66018,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":492,"num_read_kb":1063,"num_write":404,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.414508+0000","last_change":"2024-09-12T17:10:38.395735+0000","last_active":"2024-09-12T18:33:19.414508+0000","last_peered":"2024-09-12T18:33:19.414508+0000","last_clean":"2024-09-12T18:33:19.414508+0000","last_became_active":"2024-09-12T17:10:38.393114+0000","last_became_peered":"2024-09-12T17:10:38.393114+0000","last_unstale":"2024-09-12T18:33:19.414508+0000","last_undegraded":"2024-09-12T18:33:19.414508+0000","last_fullsized":"2024-09-12T18:33:19.414508+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:32.570846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'2402","reported_seq":4243,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:21.599376+0000","last_change":"2024-09-12T17:10:40.426099+0000","last_active":"2024-09-12T18:34:21.599376+0000","last_peered":"2024-09-12T18:34:21.599376+0000","last_clean":"2024-09-12T18:34:21.599376+0000","last_became_active":"2024-09-12T17:10:40.425351+0000","last_became_peered":"2024-09-12T17:10:40.425351+0000","last_unstale":"2024-09-12T18:34:21.599376+0000","last_undegraded":"2024-09-12T18:34:21.599376+0000","last_fullsized":"2024-09-12T18:34:21.599376+0000","mapping_epoch":35,"log_start":"268'2300","ondisk_log_start":"268'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":2300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:37.392452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6030,"num_read_kb":6033,"num_write":4839,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'767","reported_seq":2271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.455307+0000","last_change":"2024-09-12T17:11:04.374050+0000","last_active":"2024-09-12T18:33:28.455307+0000","last_peered":"2024-09-12T18:33:28.455307+0000","last_clean":"2024-09-12T18:33:28.455307+0000","last_became_active":"2024-09-12T17:11:04.373050+0000","last_became_peered":"2024-09-12T17:11:04.373050+0000","last_unstale":"2024-09-12T18:33:28.455307+0000","last_undegraded":"2024-09-12T18:33:28.455307+0000","last_fullsized":"2024-09-12T18:33:28.455307+0000","mapping_epoch":38,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:03.588680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3705,"num_read_kb":3333,"num_write":1034,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'280","reported_seq":954,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:31.382065+0000","last_change":"2024-09-12T17:10:30.382937+0000","last_active":"2024-09-12T18:31:31.382065+0000","last_peered":"2024-09-12T18:31:31.382065+0000","last_clean":"2024-09-12T18:31:31.382065+0000","last_became_active":"2024-09-12T17:10:30.381997+0000","last_became_peered":"2024-09-12T17:10:30.381997+0000","last_unstale":"2024-09-12T18:31:31.382065+0000","last_undegraded":"2024-09-12T18:31:31.382065+0000","last_fullsized":"2024-09-12T18:31:31.382065+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:26.528780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11535381,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":475,"num_read_kb":9736,"num_write":1050,"num_write_kb":58445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.781056+0000","last_change":"2024-09-12T17:10:34.359567+0000","last_active":"2024-09-12T18:31:36.781056+0000","last_peered":"2024-09-12T18:31:36.781056+0000","last_clean":"2024-09-12T18:31:36.781056+0000","last_became_active":"2024-09-12T17:10:34.358798+0000","last_became_peered":"2024-09-12T17:10:34.358798+0000","last_unstale":"2024-09-12T18:31:36.781056+0000","last_undegraded":"2024-09-12T18:31:36.781056+0000","last_fullsized":"2024-09-12T18:31:36.781056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:55.082548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'345","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:06.434993+0000","last_change":"2024-09-12T17:10:36.397286+0000","last_active":"2024-09-12T18:35:06.434993+0000","last_peered":"2024-09-12T18:35:06.434993+0000","last_clean":"2024-09-12T18:35:06.434993+0000","last_became_active":"2024-09-12T17:10:36.396261+0000","last_became_peered":"2024-09-12T17:10:36.396261+0000","last_unstale":"2024-09-12T18:35:06.434993+0000","last_undegraded":"2024-09-12T18:35:06.434993+0000","last_fullsized":"2024-09-12T18:35:06.434993+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:04.653529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58948,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":1123,"num_write":458,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'797","reported_seq":2778,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.791102+0000","last_change":"2024-09-12T17:10:38.409388+0000","last_active":"2024-09-12T18:35:21.791102+0000","last_peered":"2024-09-12T18:35:21.791102+0000","last_clean":"2024-09-12T18:35:21.791102+0000","last_became_active":"2024-09-12T17:10:38.408710+0000","last_became_peered":"2024-09-12T17:10:38.408710+0000","last_unstale":"2024-09-12T18:35:21.791102+0000","last_undegraded":"2024-09-12T18:35:21.791102+0000","last_fullsized":"2024-09-12T18:35:21.791102+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:10.552245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'126","reported_seq":639,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.149525+0000","last_change":"2024-09-12T17:10:40.423220+0000","last_active":"2024-09-12T18:35:20.149525+0000","last_peered":"2024-09-12T18:35:20.149525+0000","last_clean":"2024-09-12T18:35:20.149525+0000","last_became_active":"2024-09-12T17:10:40.417664+0000","last_became_peered":"2024-09-12T17:10:40.417664+0000","last_unstale":"2024-09-12T18:35:20.149525+0000","last_undegraded":"2024-09-12T18:35:20.149525+0000","last_fullsized":"2024-09-12T18:35:20.149525+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:22.188666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":285,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'884","reported_seq":2344,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.455949+0000","last_change":"2024-09-12T17:10:32.365377+0000","last_active":"2024-09-12T18:35:20.455949+0000","last_peered":"2024-09-12T18:35:20.455949+0000","last_clean":"2024-09-12T18:35:20.455949+0000","last_became_active":"2024-09-12T17:10:32.364995+0000","last_became_peered":"2024-09-12T17:10:32.364995+0000","last_unstale":"2024-09-12T18:35:20.455949+0000","last_undegraded":"2024-09-12T18:35:20.455949+0000","last_fullsized":"2024-09-12T18:35:20.455949+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":800,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:55.164024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4158,"num_read_kb":3733,"num_write":1245,"num_write_kb":492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'265","reported_seq":931,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:45.898614+0000","last_change":"2024-09-12T17:10:30.394063+0000","last_active":"2024-09-12T18:31:45.898614+0000","last_peered":"2024-09-12T18:31:45.898614+0000","last_clean":"2024-09-12T18:31:45.898614+0000","last_became_active":"2024-09-12T17:10:30.393495+0000","last_became_peered":"2024-09-12T17:10:30.393495+0000","last_unstale":"2024-09-12T18:31:45.898614+0000","last_undegraded":"2024-09-12T18:31:45.898614+0000","last_fullsized":"2024-09-12T18:31:45.898614+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:24.386647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20160543,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":424,"num_read_kb":51876,"num_write":917,"num_write_kb":56464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.801736+0000","last_change":"2024-09-12T17:10:34.361146+0000","last_active":"2024-09-12T18:33:06.801736+0000","last_peered":"2024-09-12T18:33:06.801736+0000","last_clean":"2024-09-12T18:33:06.801736+0000","last_became_active":"2024-09-12T17:10:34.360732+0000","last_became_peered":"2024-09-12T17:10:34.360732+0000","last_unstale":"2024-09-12T18:33:06.801736+0000","last_undegraded":"2024-09-12T18:33:06.801736+0000","last_fullsized":"2024-09-12T18:33:06.801736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:35.010373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'501","reported_seq":1157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.663417+0000","last_change":"2024-09-12T17:10:36.400168+0000","last_active":"2024-09-12T18:35:21.663417+0000","last_peered":"2024-09-12T18:35:21.663417+0000","last_clean":"2024-09-12T18:35:21.663417+0000","last_became_active":"2024-09-12T17:10:36.399536+0000","last_became_peered":"2024-09-12T17:10:36.399536+0000","last_unstale":"2024-09-12T18:35:21.663417+0000","last_undegraded":"2024-09-12T18:35:21.663417+0000","last_fullsized":"2024-09-12T18:35:21.663417+0000","mapping_epoch":31,"log_start":"268'400","ondisk_log_start":"268'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:17.679689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111602,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":860,"num_read_kb":1892,"num_write":712,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.800568+0000","last_change":"2024-09-12T17:10:38.405811+0000","last_active":"2024-09-12T18:33:01.800568+0000","last_peered":"2024-09-12T18:33:01.800568+0000","last_clean":"2024-09-12T18:33:01.800568+0000","last_became_active":"2024-09-12T17:10:38.405169+0000","last_became_peered":"2024-09-12T17:10:38.405169+0000","last_unstale":"2024-09-12T18:33:01.800568+0000","last_undegraded":"2024-09-12T18:33:01.800568+0000","last_fullsized":"2024-09-12T18:33:01.800568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:36.239505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'149","reported_seq":749,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642360+0000","last_change":"2024-09-12T17:10:40.410614+0000","last_active":"2024-09-12T18:33:01.642360+0000","last_peered":"2024-09-12T18:33:01.642360+0000","last_clean":"2024-09-12T18:33:01.642360+0000","last_became_active":"2024-09-12T17:10:40.409722+0000","last_became_peered":"2024-09-12T17:10:40.409722+0000","last_unstale":"2024-09-12T18:33:01.642360+0000","last_undegraded":"2024-09-12T18:33:01.642360+0000","last_fullsized":"2024-09-12T18:33:01.642360+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:32.816448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":508,"num_read_kb":430,"num_write":364,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'823","reported_seq":2340,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.627107+0000","last_change":"2024-09-12T17:10:32.371896+0000","last_active":"2024-09-12T18:33:18.627107+0000","last_peered":"2024-09-12T18:33:18.627107+0000","last_clean":"2024-09-12T18:33:18.627107+0000","last_became_active":"2024-09-12T17:10:32.370915+0000","last_became_peered":"2024-09-12T17:10:32.370915+0000","last_unstale":"2024-09-12T18:33:18.627107+0000","last_undegraded":"2024-09-12T18:33:18.627107+0000","last_fullsized":"2024-09-12T18:33:18.627107+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:10.387733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3877,"num_read_kb":3457,"num_write":1088,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'297","reported_seq":954,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.787076+0000","last_change":"2024-09-12T17:11:04.869761+0000","last_active":"2024-09-12T18:32:06.787076+0000","last_peered":"2024-09-12T18:32:06.787076+0000","last_clean":"2024-09-12T18:32:06.787076+0000","last_became_active":"2024-09-12T17:11:04.868662+0000","last_became_peered":"2024-09-12T17:11:04.868662+0000","last_unstale":"2024-09-12T18:32:06.787076+0000","last_undegraded":"2024-09-12T18:32:06.787076+0000","last_fullsized":"2024-09-12T18:32:06.787076+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:32.791583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6603921,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":490,"num_read_kb":17196,"num_write":1168,"num_write_kb":37960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.781150+0000","last_change":"2024-09-12T17:10:34.364569+0000","last_active":"2024-09-12T18:31:36.781150+0000","last_peered":"2024-09-12T18:31:36.781150+0000","last_clean":"2024-09-12T18:31:36.781150+0000","last_became_active":"2024-09-12T17:10:34.363822+0000","last_became_peered":"2024-09-12T17:10:34.363822+0000","last_unstale":"2024-09-12T18:31:36.781150+0000","last_undegraded":"2024-09-12T18:31:36.781150+0000","last_fullsized":"2024-09-12T18:31:36.781150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:31.296872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'300","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.666917+0000","last_change":"2024-09-12T17:10:36.378654+0000","last_active":"2024-09-12T18:35:21.666917+0000","last_peered":"2024-09-12T18:35:21.666917+0000","last_clean":"2024-09-12T18:35:21.666917+0000","last_became_active":"2024-09-12T17:10:36.377677+0000","last_became_peered":"2024-09-12T17:10:36.377677+0000","last_unstale":"2024-09-12T18:35:21.666917+0000","last_undegraded":"2024-09-12T18:35:21.666917+0000","last_fullsized":"2024-09-12T18:35:21.666917+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:08.577663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55691,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":1015,"num_write":454,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.400571+0000","last_change":"2024-09-12T17:10:38.414306+0000","last_active":"2024-09-12T18:31:56.400571+0000","last_peered":"2024-09-12T18:31:56.400571+0000","last_clean":"2024-09-12T18:31:56.400571+0000","last_became_active":"2024-09-12T17:10:38.413429+0000","last_became_peered":"2024-09-12T17:10:38.413429+0000","last_unstale":"2024-09-12T18:31:56.400571+0000","last_undegraded":"2024-09-12T18:31:56.400571+0000","last_fullsized":"2024-09-12T18:31:56.400571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:21.822547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'113","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:04.436186+0000","last_change":"2024-09-12T17:10:40.416006+0000","last_active":"2024-09-12T18:35:04.436186+0000","last_peered":"2024-09-12T18:35:04.436186+0000","last_clean":"2024-09-12T18:35:04.436186+0000","last_became_active":"2024-09-12T17:10:40.415270+0000","last_became_peered":"2024-09-12T17:10:40.415270+0000","last_unstale":"2024-09-12T18:35:04.436186+0000","last_undegraded":"2024-09-12T18:35:04.436186+0000","last_fullsized":"2024-09-12T18:35:04.436186+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:27.216064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":272,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'511","reported_seq":2174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.472032+0000","last_change":"2024-09-12T17:10:32.357942+0000","last_active":"2024-09-12T18:35:20.472032+0000","last_peered":"2024-09-12T18:35:20.472032+0000","last_clean":"2024-09-12T18:35:20.472032+0000","last_became_active":"2024-09-12T17:10:32.357121+0000","last_became_peered":"2024-09-12T17:10:32.357121+0000","last_unstale":"2024-09-12T18:35:20.472032+0000","last_undegraded":"2024-09-12T18:35:20.472032+0000","last_fullsized":"2024-09-12T18:35:20.472032+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:38.419513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2802,"num_read_kb":2611,"num_write":616,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'330","reported_seq":1013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.584563+0000","last_change":"2024-09-12T17:10:30.392231+0000","last_active":"2024-09-12T18:33:11.584563+0000","last_peered":"2024-09-12T18:33:11.584563+0000","last_clean":"2024-09-12T18:33:11.584563+0000","last_became_active":"2024-09-12T17:10:30.391780+0000","last_became_peered":"2024-09-12T17:10:30.391780+0000","last_unstale":"2024-09-12T18:33:11.584563+0000","last_undegraded":"2024-09-12T18:33:11.584563+0000","last_fullsized":"2024-09-12T18:33:11.584563+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:06.306117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2276955,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":600,"num_read_kb":4836,"num_write":1122,"num_write_kb":23965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.622390+0000","last_change":"2024-09-12T17:10:34.363001+0000","last_active":"2024-09-12T18:31:36.622390+0000","last_peered":"2024-09-12T18:31:36.622390+0000","last_clean":"2024-09-12T18:31:36.622390+0000","last_became_active":"2024-09-12T17:10:34.362337+0000","last_became_peered":"2024-09-12T17:10:34.362337+0000","last_unstale":"2024-09-12T18:31:36.622390+0000","last_undegraded":"2024-09-12T18:31:36.622390+0000","last_fullsized":"2024-09-12T18:31:36.622390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:55.735353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'336","reported_seq":961,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.812880+0000","last_change":"2024-09-12T17:10:36.390545+0000","last_active":"2024-09-12T18:34:01.812880+0000","last_peered":"2024-09-12T18:34:01.812880+0000","last_clean":"2024-09-12T18:34:01.812880+0000","last_became_active":"2024-09-12T17:10:36.389965+0000","last_became_peered":"2024-09-12T17:10:36.389965+0000","last_unstale":"2024-09-12T18:34:01.812880+0000","last_undegraded":"2024-09-12T18:34:01.812880+0000","last_fullsized":"2024-09-12T18:34:01.812880+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:10.492872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68763,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":561,"num_read_kb":1121,"num_write":446,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'762","reported_seq":6956,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.784809+0000","last_change":"2024-09-12T17:10:38.398211+0000","last_active":"2024-09-12T18:35:21.784809+0000","last_peered":"2024-09-12T18:35:21.784809+0000","last_clean":"2024-09-12T18:35:21.784809+0000","last_became_active":"2024-09-12T17:10:38.397332+0000","last_became_peered":"2024-09-12T17:10:38.397332+0000","last_unstale":"2024-09-12T18:35:21.784809+0000","last_undegraded":"2024-09-12T18:35:21.784809+0000","last_fullsized":"2024-09-12T18:35:21.784809+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:01.068948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'149","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.554935+0000","last_change":"2024-09-12T17:10:40.424715+0000","last_active":"2024-09-12T18:33:57.554935+0000","last_peered":"2024-09-12T18:33:57.554935+0000","last_clean":"2024-09-12T18:33:57.554935+0000","last_became_active":"2024-09-12T17:10:40.423894+0000","last_became_peered":"2024-09-12T17:10:40.423894+0000","last_unstale":"2024-09-12T18:33:57.554935+0000","last_undegraded":"2024-09-12T18:33:57.554935+0000","last_fullsized":"2024-09-12T18:33:57.554935+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:15.998229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1683,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":214,"num_read_kb":204,"num_write":362,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'506","reported_seq":2219,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.480069+0000","last_change":"2024-09-12T17:10:32.362015+0000","last_active":"2024-09-12T18:35:20.480069+0000","last_peered":"2024-09-12T18:35:20.480069+0000","last_clean":"2024-09-12T18:35:20.480069+0000","last_became_active":"2024-09-12T17:10:32.361164+0000","last_became_peered":"2024-09-12T17:10:32.361164+0000","last_unstale":"2024-09-12T18:35:20.480069+0000","last_undegraded":"2024-09-12T18:35:20.480069+0000","last_fullsized":"2024-09-12T18:35:20.480069+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:51.658105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2673,"num_read_kb":2535,"num_write":607,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'355","reported_seq":1086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.392143+0000","last_change":"2024-09-12T17:10:30.362031+0000","last_active":"2024-09-12T18:36:00.392143+0000","last_peered":"2024-09-12T18:36:00.392143+0000","last_clean":"2024-09-12T18:36:00.392143+0000","last_became_active":"2024-09-12T17:10:30.361126+0000","last_became_peered":"2024-09-12T17:10:30.361126+0000","last_unstale":"2024-09-12T18:36:00.392143+0000","last_undegraded":"2024-09-12T18:36:00.392143+0000","last_fullsized":"2024-09-12T18:36:00.392143+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:31.446390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21496170,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":655,"num_read_kb":57356,"num_write":1261,"num_write_kb":69062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1473,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.380040+0000","last_change":"2024-09-12T17:10:34.371001+0000","last_active":"2024-09-12T18:35:21.380040+0000","last_peered":"2024-09-12T18:35:21.380040+0000","last_clean":"2024-09-12T18:35:21.380040+0000","last_became_active":"2024-09-12T17:10:34.367608+0000","last_became_peered":"2024-09-12T17:10:34.367608+0000","last_unstale":"2024-09-12T18:35:21.380040+0000","last_undegraded":"2024-09-12T18:35:21.380040+0000","last_fullsized":"2024-09-12T18:35:21.380040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:28.182336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'122","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:39.390262+0000","last_change":"2024-09-12T17:10:36.922117+0000","last_active":"2024-09-12T18:31:39.390262+0000","last_peered":"2024-09-12T18:31:39.390262+0000","last_clean":"2024-09-12T18:31:39.390262+0000","last_became_active":"2024-09-12T17:10:36.921242+0000","last_became_peered":"2024-09-12T17:10:36.921242+0000","last_unstale":"2024-09-12T18:31:39.390262+0000","last_undegraded":"2024-09-12T18:31:39.390262+0000","last_fullsized":"2024-09-12T18:31:39.390262+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:20.309744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'777","reported_seq":2882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.787639+0000","last_change":"2024-09-12T17:10:38.398167+0000","last_active":"2024-09-12T18:35:21.787639+0000","last_peered":"2024-09-12T18:35:21.787639+0000","last_clean":"2024-09-12T18:35:21.787639+0000","last_became_active":"2024-09-12T17:10:38.397242+0000","last_became_peered":"2024-09-12T17:10:38.397242+0000","last_unstale":"2024-09-12T18:35:21.787639+0000","last_undegraded":"2024-09-12T18:35:21.787639+0000","last_fullsized":"2024-09-12T18:35:21.787639+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:54.313987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'138","reported_seq":654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.767388+0000","last_change":"2024-09-12T17:10:40.420601+0000","last_active":"2024-09-12T18:33:55.767388+0000","last_peered":"2024-09-12T18:33:55.767388+0000","last_clean":"2024-09-12T18:33:55.767388+0000","last_became_active":"2024-09-12T17:10:40.415831+0000","last_became_peered":"2024-09-12T17:10:40.415831+0000","last_unstale":"2024-09-12T18:33:55.767388+0000","last_undegraded":"2024-09-12T18:33:55.767388+0000","last_fullsized":"2024-09-12T18:33:55.767388+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:03.855689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":150,"num_write":326,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'562","reported_seq":2078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.813907+0000","last_change":"2024-09-12T17:10:32.367243+0000","last_active":"2024-09-12T18:34:01.813907+0000","last_peered":"2024-09-12T18:34:01.813907+0000","last_clean":"2024-09-12T18:34:01.813907+0000","last_became_active":"2024-09-12T17:10:32.366967+0000","last_became_peered":"2024-09-12T17:10:32.366967+0000","last_unstale":"2024-09-12T18:34:01.813907+0000","last_undegraded":"2024-09-12T18:34:01.813907+0000","last_fullsized":"2024-09-12T18:34:01.813907+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:36.021339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2878,"num_read_kb":2622,"num_write":716,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'332","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.415203+0000","last_change":"2024-09-12T17:10:30.360774+0000","last_active":"2024-09-12T18:35:59.415203+0000","last_peered":"2024-09-12T18:35:59.415203+0000","last_clean":"2024-09-12T18:35:59.415203+0000","last_became_active":"2024-09-12T17:10:30.360368+0000","last_became_peered":"2024-09-12T17:10:30.360368+0000","last_unstale":"2024-09-12T18:35:59.415203+0000","last_undegraded":"2024-09-12T18:35:59.415203+0000","last_fullsized":"2024-09-12T18:35:59.415203+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:43.197601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4335157,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":557,"num_read_kb":11059,"num_write":1189,"num_write_kb":24095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:35.572162+0000","last_change":"2024-09-12T17:10:34.354809+0000","last_active":"2024-09-12T18:31:35.572162+0000","last_peered":"2024-09-12T18:31:35.572162+0000","last_clean":"2024-09-12T18:31:35.572162+0000","last_became_active":"2024-09-12T17:10:34.354009+0000","last_became_peered":"2024-09-12T17:10:34.354009+0000","last_unstale":"2024-09-12T18:31:35.572162+0000","last_undegraded":"2024-09-12T18:31:35.572162+0000","last_fullsized":"2024-09-12T18:31:35.572162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:37.358212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'373","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.548547+0000","last_change":"2024-09-12T17:10:36.393717+0000","last_active":"2024-09-12T18:35:20.548547+0000","last_peered":"2024-09-12T18:35:20.548547+0000","last_clean":"2024-09-12T18:35:20.548547+0000","last_became_active":"2024-09-12T17:10:36.392271+0000","last_became_peered":"2024-09-12T17:10:36.392271+0000","last_unstale":"2024-09-12T18:35:20.548547+0000","last_undegraded":"2024-09-12T18:35:20.548547+0000","last_fullsized":"2024-09-12T18:35:20.548547+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:38.244171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55298,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":602,"num_read_kb":1087,"num_write":462,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.565485+0000","last_change":"2024-09-12T17:10:38.399541+0000","last_active":"2024-09-12T18:31:41.565485+0000","last_peered":"2024-09-12T18:31:41.565485+0000","last_clean":"2024-09-12T18:31:41.565485+0000","last_became_active":"2024-09-12T17:10:38.398743+0000","last_became_peered":"2024-09-12T17:10:38.398743+0000","last_unstale":"2024-09-12T18:31:41.565485+0000","last_undegraded":"2024-09-12T18:31:41.565485+0000","last_fullsized":"2024-09-12T18:31:41.565485+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:42.789598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'104","reported_seq":613,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.057275+0000","last_change":"2024-09-12T17:10:40.411608+0000","last_active":"2024-09-12T18:34:00.057275+0000","last_peered":"2024-09-12T18:34:00.057275+0000","last_clean":"2024-09-12T18:34:00.057275+0000","last_became_active":"2024-09-12T17:10:40.410710+0000","last_became_peered":"2024-09-12T17:10:40.410710+0000","last_unstale":"2024-09-12T18:34:00.057275+0000","last_undegraded":"2024-09-12T18:34:00.057275+0000","last_fullsized":"2024-09-12T18:34:00.057275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:48.629817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":239,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'447","reported_seq":2001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:59.059999+0000","last_change":"2024-09-12T17:10:32.367439+0000","last_active":"2024-09-12T18:32:59.059999+0000","last_peered":"2024-09-12T18:32:59.059999+0000","last_clean":"2024-09-12T18:32:59.059999+0000","last_became_active":"2024-09-12T17:10:32.366571+0000","last_became_peered":"2024-09-12T17:10:32.366571+0000","last_unstale":"2024-09-12T18:32:59.059999+0000","last_undegraded":"2024-09-12T18:32:59.059999+0000","last_fullsized":"2024-09-12T18:32:59.059999+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:11.374807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2259,"num_read_kb":2146,"num_write":500,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.398388+0000","last_change":"2024-09-12T17:10:13.025471+0000","last_active":"2024-09-12T18:32:41.398388+0000","last_peered":"2024-09-12T18:32:41.398388+0000","last_clean":"2024-09-12T18:32:41.398388+0000","last_became_active":"2024-09-12T17:10:13.024652+0000","last_became_peered":"2024-09-12T17:10:13.024652+0000","last_unstale":"2024-09-12T18:32:41.398388+0000","last_undegraded":"2024-09-12T18:32:41.398388+0000","last_fullsized":"2024-09-12T18:32:41.398388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:11.999189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:11.999189+0000","last_clean_scrub_stamp":"2024-09-12T17:10:11.999189+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:01.776648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.420031+0000","last_change":"2024-09-12T17:10:20.094438+0000","last_active":"2024-09-12T18:33:41.420031+0000","last_peered":"2024-09-12T18:33:41.420031+0000","last_clean":"2024-09-12T18:33:41.420031+0000","last_became_active":"2024-09-12T17:10:18.073547+0000","last_became_peered":"2024-09-12T17:10:18.073547+0000","last_unstale":"2024-09-12T18:33:41.420031+0000","last_undegraded":"2024-09-12T18:33:41.420031+0000","last_fullsized":"2024-09-12T18:33:41.420031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:46.358663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010552039999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'267","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.445636+0000","last_change":"2024-09-12T17:10:30.395390+0000","last_active":"2024-09-12T18:35:59.445636+0000","last_peered":"2024-09-12T18:35:59.445636+0000","last_clean":"2024-09-12T18:35:59.445636+0000","last_became_active":"2024-09-12T17:10:30.395026+0000","last_became_peered":"2024-09-12T17:10:30.395026+0000","last_unstale":"2024-09-12T18:35:59.445636+0000","last_undegraded":"2024-09-12T18:35:59.445636+0000","last_fullsized":"2024-09-12T18:35:59.445636+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:10.168440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10567119,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":452,"num_read_kb":151053,"num_write":946,"num_write_kb":34461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"37'3","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.367419+0000","last_change":"2024-09-12T17:10:34.364363+0000","last_active":"2024-09-12T18:35:21.367419+0000","last_peered":"2024-09-12T18:35:21.367419+0000","last_clean":"2024-09-12T18:35:21.367419+0000","last_became_active":"2024-09-12T17:10:34.363615+0000","last_became_peered":"2024-09-12T17:10:34.363615+0000","last_unstale":"2024-09-12T18:35:21.367419+0000","last_undegraded":"2024-09-12T18:35:21.367419+0000","last_fullsized":"2024-09-12T18:35:21.367419+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:00.136965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":731,"num_read_kb":729,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'738","reported_seq":1453,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.707847+0000","last_change":"2024-09-12T17:10:36.395832+0000","last_active":"2024-09-12T18:35:21.707847+0000","last_peered":"2024-09-12T18:35:21.707847+0000","last_clean":"2024-09-12T18:35:21.707847+0000","last_became_active":"2024-09-12T17:10:36.395060+0000","last_became_peered":"2024-09-12T17:10:36.395060+0000","last_unstale":"2024-09-12T18:35:21.707847+0000","last_undegraded":"2024-09-12T18:35:21.707847+0000","last_fullsized":"2024-09-12T18:35:21.707847+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:34.192269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168921,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1429,"num_read_kb":2955,"num_write":1410,"num_write_kb":1250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.413770+0000","last_change":"2024-09-12T17:10:38.413654+0000","last_active":"2024-09-12T18:33:01.413770+0000","last_peered":"2024-09-12T18:33:01.413770+0000","last_clean":"2024-09-12T18:33:01.413770+0000","last_became_active":"2024-09-12T17:10:38.413042+0000","last_became_peered":"2024-09-12T17:10:38.413042+0000","last_unstale":"2024-09-12T18:33:01.413770+0000","last_undegraded":"2024-09-12T18:33:01.413770+0000","last_fullsized":"2024-09-12T18:33:01.413770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:03.626589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'214","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.891133+0000","last_change":"2024-09-12T17:10:40.416972+0000","last_active":"2024-09-12T18:34:01.891133+0000","last_peered":"2024-09-12T18:34:01.891133+0000","last_clean":"2024-09-12T18:34:01.891133+0000","last_became_active":"2024-09-12T17:10:40.413341+0000","last_became_peered":"2024-09-12T17:10:40.413341+0000","last_unstale":"2024-09-12T18:34:01.891133+0000","last_undegraded":"2024-09-12T18:34:01.891133+0000","last_fullsized":"2024-09-12T18:34:01.891133+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:47.293584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":511,"num_write":461,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'391","reported_seq":1829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.412715+0000","last_change":"2024-09-12T17:10:32.365399+0000","last_active":"2024-09-12T18:32:56.412715+0000","last_peered":"2024-09-12T18:32:56.412715+0000","last_clean":"2024-09-12T18:32:56.412715+0000","last_became_active":"2024-09-12T17:10:32.364798+0000","last_became_peered":"2024-09-12T17:10:32.364798+0000","last_unstale":"2024-09-12T18:32:56.412715+0000","last_undegraded":"2024-09-12T18:32:56.412715+0000","last_fullsized":"2024-09-12T18:32:56.412715+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:26.942345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2015,"num_read_kb":1907,"num_write":451,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.399689+0000","last_change":"2024-09-12T17:10:20.396952+0000","last_active":"2024-09-12T18:32:46.399689+0000","last_peered":"2024-09-12T18:32:46.399689+0000","last_clean":"2024-09-12T18:32:46.399689+0000","last_became_active":"2024-09-12T17:10:18.073016+0000","last_became_peered":"2024-09-12T17:10:18.073016+0000","last_unstale":"2024-09-12T18:32:46.399689+0000","last_undegraded":"2024-09-12T18:32:46.399689+0000","last_fullsized":"2024-09-12T18:32:46.399689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:57.171583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098613699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'291","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.423414+0000","last_change":"2024-09-12T17:10:30.355852+0000","last_active":"2024-09-12T18:33:51.423414+0000","last_peered":"2024-09-12T18:33:51.423414+0000","last_clean":"2024-09-12T18:33:51.423414+0000","last_became_active":"2024-09-12T17:10:30.355237+0000","last_became_peered":"2024-09-12T17:10:30.355237+0000","last_unstale":"2024-09-12T18:33:51.423414+0000","last_undegraded":"2024-09-12T18:33:51.423414+0000","last_fullsized":"2024-09-12T18:33:51.423414+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:24.811371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9738901,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":498,"num_read_kb":28524,"num_write":1102,"num_write_kb":35154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.409737+0000","last_change":"2024-09-12T17:10:34.368316+0000","last_active":"2024-09-12T18:32:56.409737+0000","last_peered":"2024-09-12T18:32:56.409737+0000","last_clean":"2024-09-12T18:32:56.409737+0000","last_became_active":"2024-09-12T17:10:34.366826+0000","last_became_peered":"2024-09-12T17:10:34.366826+0000","last_unstale":"2024-09-12T18:32:56.409737+0000","last_undegraded":"2024-09-12T18:32:56.409737+0000","last_fullsized":"2024-09-12T18:32:56.409737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:41.209887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1366","reported_seq":3339,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.774919+0000","last_change":"2024-09-12T17:10:36.399027+0000","last_active":"2024-09-12T18:35:21.774919+0000","last_peered":"2024-09-12T18:35:21.774919+0000","last_clean":"2024-09-12T18:35:21.774919+0000","last_became_active":"2024-09-12T17:10:36.398283+0000","last_became_peered":"2024-09-12T17:10:36.398283+0000","last_unstale":"2024-09-12T18:35:21.774919+0000","last_undegraded":"2024-09-12T18:35:21.774919+0000","last_fullsized":"2024-09-12T18:35:21.774919+0000","mapping_epoch":31,"log_start":"268'1300","ondisk_log_start":"268'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":1300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:36.074991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186915,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2152,"num_read_kb":3818,"num_write":1268,"num_write_kb":1074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.394022+0000","last_change":"2024-09-12T17:10:38.407976+0000","last_active":"2024-09-12T18:32:21.394022+0000","last_peered":"2024-09-12T18:32:21.394022+0000","last_clean":"2024-09-12T18:32:21.394022+0000","last_became_active":"2024-09-12T17:10:38.407002+0000","last_became_peered":"2024-09-12T17:10:38.407002+0000","last_unstale":"2024-09-12T18:32:21.394022+0000","last_undegraded":"2024-09-12T18:32:21.394022+0000","last_fullsized":"2024-09-12T18:32:21.394022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:39.734129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'125","reported_seq":641,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.101124+0000","last_change":"2024-09-12T17:10:40.771071+0000","last_active":"2024-09-12T18:34:02.101124+0000","last_peered":"2024-09-12T18:34:02.101124+0000","last_clean":"2024-09-12T18:34:02.101124+0000","last_became_active":"2024-09-12T17:10:40.770362+0000","last_became_peered":"2024-09-12T17:10:40.770362+0000","last_unstale":"2024-09-12T18:34:02.101124+0000","last_undegraded":"2024-09-12T18:34:02.101124+0000","last_fullsized":"2024-09-12T18:34:02.101124+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:15.034623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":150,"num_write":307,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'424","reported_seq":2035,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:59.053173+0000","last_change":"2024-09-12T17:10:32.365161+0000","last_active":"2024-09-12T18:32:59.053173+0000","last_peered":"2024-09-12T18:32:59.053173+0000","last_clean":"2024-09-12T18:32:59.053173+0000","last_became_active":"2024-09-12T17:10:32.361184+0000","last_became_peered":"2024-09-12T17:10:32.361184+0000","last_unstale":"2024-09-12T18:32:59.053173+0000","last_undegraded":"2024-09-12T18:32:59.053173+0000","last_fullsized":"2024-09-12T18:32:59.053173+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:45.804037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2375,"num_read_kb":2259,"num_write":493,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":547,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.808600+0000","last_change":"2024-09-12T17:10:20.089534+0000","last_active":"2024-09-12T18:33:41.808600+0000","last_peered":"2024-09-12T18:33:41.808600+0000","last_clean":"2024-09-12T18:33:41.808600+0000","last_became_active":"2024-09-12T17:10:18.210168+0000","last_became_peered":"2024-09-12T17:10:18.210168+0000","last_unstale":"2024-09-12T18:33:41.808600+0000","last_undegraded":"2024-09-12T18:33:41.808600+0000","last_fullsized":"2024-09-12T18:33:41.808600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:46.762850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001219171,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'263","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.639527+0000","last_change":"2024-09-12T17:10:30.405973+0000","last_active":"2024-09-12T18:32:51.639527+0000","last_peered":"2024-09-12T18:32:51.639527+0000","last_clean":"2024-09-12T18:32:51.639527+0000","last_became_active":"2024-09-12T17:10:30.405641+0000","last_became_peered":"2024-09-12T17:10:30.405641+0000","last_unstale":"2024-09-12T18:32:51.639527+0000","last_undegraded":"2024-09-12T18:32:51.639527+0000","last_fullsized":"2024-09-12T18:32:51.639527+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:49.395336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7452521,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":363,"num_read_kb":15806,"num_write":940,"num_write_kb":36297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.799717+0000","last_change":"2024-09-12T17:10:34.368266+0000","last_active":"2024-09-12T18:32:56.799717+0000","last_peered":"2024-09-12T18:32:56.799717+0000","last_clean":"2024-09-12T18:32:56.799717+0000","last_became_active":"2024-09-12T17:10:34.367870+0000","last_became_peered":"2024-09-12T17:10:34.367870+0000","last_unstale":"2024-09-12T18:32:56.799717+0000","last_undegraded":"2024-09-12T18:32:56.799717+0000","last_fullsized":"2024-09-12T18:32:56.799717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:51.335257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'345","reported_seq":1937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.757234+0000","last_change":"2024-09-12T17:10:36.923069+0000","last_active":"2024-09-12T18:35:21.757234+0000","last_peered":"2024-09-12T18:35:21.757234+0000","last_clean":"2024-09-12T18:35:21.757234+0000","last_became_active":"2024-09-12T17:10:36.922321+0000","last_became_peered":"2024-09-12T17:10:36.922321+0000","last_unstale":"2024-09-12T18:35:21.757234+0000","last_undegraded":"2024-09-12T18:35:21.757234+0000","last_fullsized":"2024-09-12T18:35:21.757234+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:40.884164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":291,"num_read_kb":281,"num_write":273,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.400401+0000","last_change":"2024-09-12T17:10:38.415538+0000","last_active":"2024-09-12T18:31:56.400401+0000","last_peered":"2024-09-12T18:31:56.400401+0000","last_clean":"2024-09-12T18:31:56.400401+0000","last_became_active":"2024-09-12T17:10:38.413459+0000","last_became_peered":"2024-09-12T17:10:38.413459+0000","last_unstale":"2024-09-12T18:31:56.400401+0000","last_undegraded":"2024-09-12T18:31:56.400401+0000","last_fullsized":"2024-09-12T18:31:56.400401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:23.614741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'231","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.307485+0000","last_change":"2024-09-12T17:10:40.415650+0000","last_active":"2024-09-12T18:34:00.307485+0000","last_peered":"2024-09-12T18:34:00.307485+0000","last_clean":"2024-09-12T18:34:00.307485+0000","last_became_active":"2024-09-12T17:10:40.414712+0000","last_became_peered":"2024-09-12T17:10:40.414712+0000","last_unstale":"2024-09-12T18:34:00.307485+0000","last_undegraded":"2024-09-12T18:34:00.307485+0000","last_fullsized":"2024-09-12T18:34:00.307485+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:26.385614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":496,"num_read_kb":517,"num_write":496,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'462","reported_seq":1980,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.835567+0000","last_change":"2024-09-12T17:10:32.361139+0000","last_active":"2024-09-12T18:33:59.835567+0000","last_peered":"2024-09-12T18:33:59.835567+0000","last_clean":"2024-09-12T18:33:59.835567+0000","last_became_active":"2024-09-12T17:10:32.360853+0000","last_became_peered":"2024-09-12T17:10:32.360853+0000","last_unstale":"2024-09-12T18:33:59.835567+0000","last_undegraded":"2024-09-12T18:33:59.835567+0000","last_fullsized":"2024-09-12T18:33:59.835567+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:48.894459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2461,"num_read_kb":2304,"num_write":540,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":542,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.419958+0000","last_change":"2024-09-12T17:10:20.095430+0000","last_active":"2024-09-12T18:33:41.419958+0000","last_peered":"2024-09-12T18:33:41.419958+0000","last_clean":"2024-09-12T18:33:41.419958+0000","last_became_active":"2024-09-12T17:10:18.072719+0000","last_became_peered":"2024-09-12T17:10:18.072719+0000","last_unstale":"2024-09-12T18:33:41.419958+0000","last_undegraded":"2024-09-12T18:33:41.419958+0000","last_fullsized":"2024-09-12T18:33:41.419958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:14.576392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022239349999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'352","reported_seq":1062,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.603931+0000","last_change":"2024-09-12T17:10:30.358580+0000","last_active":"2024-09-12T18:36:00.603931+0000","last_peered":"2024-09-12T18:36:00.603931+0000","last_clean":"2024-09-12T18:36:00.603931+0000","last_became_active":"2024-09-12T17:10:30.354850+0000","last_became_peered":"2024-09-12T17:10:30.354850+0000","last_unstale":"2024-09-12T18:36:00.603931+0000","last_undegraded":"2024-09-12T18:36:00.603931+0000","last_fullsized":"2024-09-12T18:36:00.603931+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:31.523584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4245763,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":577,"num_read_kb":44142,"num_write":1291,"num_write_kb":42918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.402501+0000","last_change":"2024-09-12T17:10:34.359604+0000","last_active":"2024-09-12T18:32:06.402501+0000","last_peered":"2024-09-12T18:32:06.402501+0000","last_clean":"2024-09-12T18:32:06.402501+0000","last_became_active":"2024-09-12T17:10:34.358926+0000","last_became_peered":"2024-09-12T17:10:34.358926+0000","last_unstale":"2024-09-12T18:32:06.402501+0000","last_undegraded":"2024-09-12T18:32:06.402501+0000","last_fullsized":"2024-09-12T18:32:06.402501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:31.601357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'171","reported_seq":755,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:09.437593+0000","last_change":"2024-09-12T17:10:36.396445+0000","last_active":"2024-09-12T18:35:09.437593+0000","last_peered":"2024-09-12T18:35:09.437593+0000","last_clean":"2024-09-12T18:35:09.437593+0000","last_became_active":"2024-09-12T17:10:36.395658+0000","last_became_peered":"2024-09-12T17:10:36.395658+0000","last_unstale":"2024-09-12T18:35:09.437593+0000","last_undegraded":"2024-09-12T18:35:09.437593+0000","last_fullsized":"2024-09-12T18:35:09.437593+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:53.937530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":215,"num_read_kb":209,"num_write":154,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.582583+0000","last_change":"2024-09-12T17:10:38.414758+0000","last_active":"2024-09-12T18:33:01.582583+0000","last_peered":"2024-09-12T18:33:01.582583+0000","last_clean":"2024-09-12T18:33:01.582583+0000","last_became_active":"2024-09-12T17:10:38.414045+0000","last_became_peered":"2024-09-12T17:10:38.414045+0000","last_unstale":"2024-09-12T18:33:01.582583+0000","last_undegraded":"2024-09-12T18:33:01.582583+0000","last_fullsized":"2024-09-12T18:33:01.582583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:17.692176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'151","reported_seq":739,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.894081+0000","last_change":"2024-09-12T17:10:40.422450+0000","last_active":"2024-09-12T18:33:10.894081+0000","last_peered":"2024-09-12T18:33:10.894081+0000","last_clean":"2024-09-12T18:33:10.894081+0000","last_became_active":"2024-09-12T17:10:40.420995+0000","last_became_peered":"2024-09-12T17:10:40.420995+0000","last_unstale":"2024-09-12T18:33:10.894081+0000","last_undegraded":"2024-09-12T18:33:10.894081+0000","last_fullsized":"2024-09-12T18:33:10.894081+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:49.058635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":383,"num_read_kb":354,"num_write":368,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'864","reported_seq":2541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.475561+0000","last_change":"2024-09-12T17:10:32.362173+0000","last_active":"2024-09-12T18:35:20.475561+0000","last_peered":"2024-09-12T18:35:20.475561+0000","last_clean":"2024-09-12T18:35:20.475561+0000","last_became_active":"2024-09-12T17:10:32.361696+0000","last_became_peered":"2024-09-12T17:10:32.361696+0000","last_unstale":"2024-09-12T18:35:20.475561+0000","last_undegraded":"2024-09-12T18:35:20.475561+0000","last_fullsized":"2024-09-12T18:35:20.475561+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:49.188465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4191,"num_read_kb":3806,"num_write":1162,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'248","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.535429+0000","last_change":"2024-09-12T17:10:30.355665+0000","last_active":"2024-09-12T18:32:56.535429+0000","last_peered":"2024-09-12T18:32:56.535429+0000","last_clean":"2024-09-12T18:32:56.535429+0000","last_became_active":"2024-09-12T17:10:30.354730+0000","last_became_peered":"2024-09-12T17:10:30.354730+0000","last_unstale":"2024-09-12T18:32:56.535429+0000","last_undegraded":"2024-09-12T18:32:56.535429+0000","last_fullsized":"2024-09-12T18:32:56.535429+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:16.166371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4289546,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":322,"num_read_kb":12992,"num_write":862,"num_write_kb":30670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.651271+0000","last_change":"2024-09-12T17:10:20.100416+0000","last_active":"2024-09-12T18:33:41.651271+0000","last_peered":"2024-09-12T18:33:41.651271+0000","last_clean":"2024-09-12T18:33:41.651271+0000","last_became_active":"2024-09-12T17:10:18.209658+0000","last_became_peered":"2024-09-12T17:10:18.209658+0000","last_unstale":"2024-09-12T18:33:41.651271+0000","last_undegraded":"2024-09-12T18:33:41.651271+0000","last_fullsized":"2024-09-12T18:33:41.651271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:28.458806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010531659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.399240+0000","last_change":"2024-09-12T17:10:34.362549+0000","last_active":"2024-09-12T18:31:51.399240+0000","last_peered":"2024-09-12T18:31:51.399240+0000","last_clean":"2024-09-12T18:31:51.399240+0000","last_became_active":"2024-09-12T17:10:34.361845+0000","last_became_peered":"2024-09-12T17:10:34.361845+0000","last_unstale":"2024-09-12T18:31:51.399240+0000","last_undegraded":"2024-09-12T18:31:51.399240+0000","last_fullsized":"2024-09-12T18:31:51.399240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:05.948451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'668","reported_seq":1370,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.686718+0000","last_change":"2024-09-12T17:10:36.400065+0000","last_active":"2024-09-12T18:35:21.686718+0000","last_peered":"2024-09-12T18:35:21.686718+0000","last_clean":"2024-09-12T18:35:21.686718+0000","last_became_active":"2024-09-12T17:10:36.398917+0000","last_became_peered":"2024-09-12T17:10:36.398917+0000","last_unstale":"2024-09-12T18:35:21.686718+0000","last_undegraded":"2024-09-12T18:35:21.686718+0000","last_fullsized":"2024-09-12T18:35:21.686718+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":600,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.596681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130155,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1807,"num_read_kb":2951,"num_write":2388,"num_write_kb":2197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:55.577010+0000","last_change":"2024-09-12T17:10:38.401627+0000","last_active":"2024-09-12T18:31:55.577010+0000","last_peered":"2024-09-12T18:31:55.577010+0000","last_clean":"2024-09-12T18:31:55.577010+0000","last_became_active":"2024-09-12T17:10:38.400868+0000","last_became_peered":"2024-09-12T17:10:38.400868+0000","last_unstale":"2024-09-12T18:31:55.577010+0000","last_undegraded":"2024-09-12T18:31:55.577010+0000","last_fullsized":"2024-09-12T18:31:55.577010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:50.604824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'135","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.773259+0000","last_change":"2024-09-12T17:10:40.774323+0000","last_active":"2024-09-12T18:33:55.773259+0000","last_peered":"2024-09-12T18:33:55.773259+0000","last_clean":"2024-09-12T18:33:55.773259+0000","last_became_active":"2024-09-12T17:10:40.771185+0000","last_became_peered":"2024-09-12T17:10:40.771185+0000","last_unstale":"2024-09-12T18:33:55.773259+0000","last_undegraded":"2024-09-12T18:33:55.773259+0000","last_fullsized":"2024-09-12T18:33:55.773259+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:03.269283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":180,"num_write":328,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'473","reported_seq":2162,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.467099+0000","last_change":"2024-09-12T17:10:32.355390+0000","last_active":"2024-09-12T18:35:20.467099+0000","last_peered":"2024-09-12T18:35:20.467099+0000","last_clean":"2024-09-12T18:35:20.467099+0000","last_became_active":"2024-09-12T17:10:32.354795+0000","last_became_peered":"2024-09-12T17:10:32.354795+0000","last_unstale":"2024-09-12T18:35:20.467099+0000","last_undegraded":"2024-09-12T18:35:20.467099+0000","last_fullsized":"2024-09-12T18:35:20.467099+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:17.098153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2620,"num_read_kb":2476,"num_write":562,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'272","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.653512+0000","last_change":"2024-09-12T17:10:30.405893+0000","last_active":"2024-09-12T18:33:51.653512+0000","last_peered":"2024-09-12T18:33:51.653512+0000","last_clean":"2024-09-12T18:33:51.653512+0000","last_became_active":"2024-09-12T17:10:30.405460+0000","last_became_peered":"2024-09-12T17:10:30.405460+0000","last_unstale":"2024-09-12T18:33:51.653512+0000","last_undegraded":"2024-09-12T18:33:51.653512+0000","last_fullsized":"2024-09-12T18:33:51.653512+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:16.200605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6315397,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":420,"num_read_kb":16852,"num_write":1022,"num_write_kb":30938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:01.389327+0000","last_change":"2024-09-12T17:10:20.397111+0000","last_active":"2024-09-12T18:32:01.389327+0000","last_peered":"2024-09-12T18:32:01.389327+0000","last_clean":"2024-09-12T18:32:01.389327+0000","last_became_active":"2024-09-12T17:10:18.208762+0000","last_became_peered":"2024-09-12T17:10:18.208762+0000","last_unstale":"2024-09-12T18:32:01.389327+0000","last_undegraded":"2024-09-12T18:32:01.389327+0000","last_fullsized":"2024-09-12T18:32:01.389327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:07.303527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091554,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.567539+0000","last_change":"2024-09-12T17:10:34.356303+0000","last_active":"2024-09-12T18:31:51.567539+0000","last_peered":"2024-09-12T18:31:51.567539+0000","last_clean":"2024-09-12T18:31:51.567539+0000","last_became_active":"2024-09-12T17:10:34.355590+0000","last_became_peered":"2024-09-12T17:10:34.355590+0000","last_unstale":"2024-09-12T18:31:51.567539+0000","last_undegraded":"2024-09-12T18:31:51.567539+0000","last_fullsized":"2024-09-12T18:31:51.567539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:49.016297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'223","reported_seq":831,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.654620+0000","last_change":"2024-09-12T17:10:36.922068+0000","last_active":"2024-09-12T18:33:56.654620+0000","last_peered":"2024-09-12T18:33:56.654620+0000","last_clean":"2024-09-12T18:33:56.654620+0000","last_became_active":"2024-09-12T17:10:36.921234+0000","last_became_peered":"2024-09-12T17:10:36.921234+0000","last_unstale":"2024-09-12T18:33:56.654620+0000","last_undegraded":"2024-09-12T18:33:56.654620+0000","last_fullsized":"2024-09-12T18:33:56.654620+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:56.087478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":277,"num_write":196,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'786","reported_seq":2941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.780843+0000","last_change":"2024-09-12T17:10:38.396157+0000","last_active":"2024-09-12T18:35:21.780843+0000","last_peered":"2024-09-12T18:35:21.780843+0000","last_clean":"2024-09-12T18:35:21.780843+0000","last_became_active":"2024-09-12T17:10:38.395439+0000","last_became_peered":"2024-09-12T17:10:38.395439+0000","last_unstale":"2024-09-12T18:35:21.780843+0000","last_undegraded":"2024-09-12T18:35:21.780843+0000","last_fullsized":"2024-09-12T18:35:21.780843+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:28.386160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'180","reported_seq":718,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428311+0000","last_change":"2024-09-12T17:10:40.770840+0000","last_active":"2024-09-12T18:34:19.428311+0000","last_peered":"2024-09-12T18:34:19.428311+0000","last_clean":"2024-09-12T18:34:19.428311+0000","last_became_active":"2024-09-12T17:10:40.770042+0000","last_became_peered":"2024-09-12T17:10:40.770042+0000","last_unstale":"2024-09-12T18:34:19.428311+0000","last_undegraded":"2024-09-12T18:34:19.428311+0000","last_fullsized":"2024-09-12T18:34:19.428311+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:24.561136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":293,"num_read_kb":273,"num_write":449,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'899","reported_seq":2633,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.926166+0000","last_change":"2024-09-12T17:10:32.383031+0000","last_active":"2024-09-12T18:33:59.926166+0000","last_peered":"2024-09-12T18:33:59.926166+0000","last_clean":"2024-09-12T18:33:59.926166+0000","last_became_active":"2024-09-12T17:10:32.382755+0000","last_became_peered":"2024-09-12T17:10:32.382755+0000","last_unstale":"2024-09-12T18:33:59.926166+0000","last_undegraded":"2024-09-12T18:33:59.926166+0000","last_fullsized":"2024-09-12T18:33:59.926166+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:55.069573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4651,"num_read_kb":4208,"num_write":1244,"num_write_kb":526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'264","reported_seq":895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.428295+0000","last_change":"2024-09-12T17:10:30.365199+0000","last_active":"2024-09-12T18:35:59.428295+0000","last_peered":"2024-09-12T18:35:59.428295+0000","last_clean":"2024-09-12T18:35:59.428295+0000","last_became_active":"2024-09-12T17:10:30.364767+0000","last_became_peered":"2024-09-12T17:10:30.364767+0000","last_unstale":"2024-09-12T18:35:59.428295+0000","last_undegraded":"2024-09-12T18:35:59.428295+0000","last_fullsized":"2024-09-12T18:35:59.428295+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:56.519220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16805003,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":398,"num_read_kb":23955,"num_write":988,"num_write_kb":32355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.637356+0000","last_change":"2024-09-12T17:10:20.100539+0000","last_active":"2024-09-12T18:32:41.637356+0000","last_peered":"2024-09-12T18:32:41.637356+0000","last_clean":"2024-09-12T18:32:41.637356+0000","last_became_active":"2024-09-12T17:10:18.073132+0000","last_became_peered":"2024-09-12T17:10:18.073132+0000","last_unstale":"2024-09-12T18:32:41.637356+0000","last_undegraded":"2024-09-12T18:32:41.637356+0000","last_fullsized":"2024-09-12T18:32:41.637356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:05.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001154721,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605276+0000","last_change":"2024-09-12T17:10:34.349876+0000","last_active":"2024-09-12T18:33:55.605276+0000","last_peered":"2024-09-12T18:33:55.605276+0000","last_clean":"2024-09-12T18:33:55.605276+0000","last_became_active":"2024-09-12T17:10:34.349093+0000","last_became_peered":"2024-09-12T17:10:34.349093+0000","last_unstale":"2024-09-12T18:33:55.605276+0000","last_undegraded":"2024-09-12T18:33:55.605276+0000","last_fullsized":"2024-09-12T18:33:55.605276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:46.757080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'169","reported_seq":748,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:55.577053+0000","last_change":"2024-09-12T17:10:36.391287+0000","last_active":"2024-09-12T18:31:55.577053+0000","last_peered":"2024-09-12T18:31:55.577053+0000","last_clean":"2024-09-12T18:31:55.577053+0000","last_became_active":"2024-09-12T17:10:36.390439+0000","last_became_peered":"2024-09-12T17:10:36.390439+0000","last_unstale":"2024-09-12T18:31:55.577053+0000","last_undegraded":"2024-09-12T18:31:55.577053+0000","last_fullsized":"2024-09-12T18:31:55.577053+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:24.707986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":183,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'804","reported_seq":2855,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.012975+0000","last_change":"2024-09-12T17:10:38.394233+0000","last_active":"2024-09-12T18:35:59.012975+0000","last_peered":"2024-09-12T18:35:59.012975+0000","last_clean":"2024-09-12T18:35:59.012975+0000","last_became_active":"2024-09-12T17:10:38.393426+0000","last_became_peered":"2024-09-12T17:10:38.393426+0000","last_unstale":"2024-09-12T18:35:59.012975+0000","last_undegraded":"2024-09-12T18:35:59.012975+0000","last_fullsized":"2024-09-12T18:35:59.012975+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:37.818377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'254","reported_seq":797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.396389+0000","last_change":"2024-09-12T17:10:40.429154+0000","last_active":"2024-09-12T18:31:41.396389+0000","last_peered":"2024-09-12T18:31:41.396389+0000","last_clean":"2024-09-12T18:31:41.396389+0000","last_became_active":"2024-09-12T17:10:40.423742+0000","last_became_peered":"2024-09-12T17:10:40.423742+0000","last_unstale":"2024-09-12T18:31:41.396389+0000","last_undegraded":"2024-09-12T18:31:41.396389+0000","last_fullsized":"2024-09-12T18:31:41.396389+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:48.699774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":353,"num_read_kb":347,"num_write":533,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'873","reported_seq":2667,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605231+0000","last_change":"2024-09-12T17:10:32.368938+0000","last_active":"2024-09-12T18:33:55.605231+0000","last_peered":"2024-09-12T18:33:55.605231+0000","last_clean":"2024-09-12T18:33:55.605231+0000","last_became_active":"2024-09-12T17:10:32.368217+0000","last_became_peered":"2024-09-12T17:10:32.368217+0000","last_unstale":"2024-09-12T18:33:55.605231+0000","last_undegraded":"2024-09-12T18:33:55.605231+0000","last_fullsized":"2024-09-12T18:33:55.605231+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":800,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:33.300045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4306,"num_read_kb":3903,"num_write":1124,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'304","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411769+0000","last_change":"2024-09-12T17:10:30.362722+0000","last_active":"2024-09-12T18:32:51.411769+0000","last_peered":"2024-09-12T18:32:51.411769+0000","last_clean":"2024-09-12T18:32:51.411769+0000","last_became_active":"2024-09-12T17:10:30.361736+0000","last_became_peered":"2024-09-12T17:10:30.361736+0000","last_unstale":"2024-09-12T18:32:51.411769+0000","last_undegraded":"2024-09-12T18:32:51.411769+0000","last_fullsized":"2024-09-12T18:32:51.411769+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:20.821477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11388570,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":554,"num_read_kb":21637,"num_write":1130,"num_write_kb":30222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.578380+0000","last_change":"2024-09-12T17:10:20.088329+0000","last_active":"2024-09-12T18:32:41.578380+0000","last_peered":"2024-09-12T18:32:41.578380+0000","last_clean":"2024-09-12T18:32:41.578380+0000","last_became_active":"2024-09-12T17:10:18.074669+0000","last_became_peered":"2024-09-12T17:10:18.074669+0000","last_unstale":"2024-09-12T18:32:41.578380+0000","last_undegraded":"2024-09-12T18:32:41.578380+0000","last_fullsized":"2024-09-12T18:32:41.578380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:20.175198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:54.408665+0000","last_change":"2024-09-12T17:10:34.358853+0000","last_active":"2024-09-12T18:32:54.408665+0000","last_peered":"2024-09-12T18:32:54.408665+0000","last_clean":"2024-09-12T18:32:54.408665+0000","last_became_active":"2024-09-12T17:10:34.358250+0000","last_became_peered":"2024-09-12T17:10:34.358250+0000","last_unstale":"2024-09-12T18:32:54.408665+0000","last_undegraded":"2024-09-12T18:32:54.408665+0000","last_fullsized":"2024-09-12T18:32:54.408665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:35.137706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'729","reported_seq":1473,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.677938+0000","last_change":"2024-09-12T17:10:36.921037+0000","last_active":"2024-09-12T18:35:21.677938+0000","last_peered":"2024-09-12T18:35:21.677938+0000","last_clean":"2024-09-12T18:35:21.677938+0000","last_became_active":"2024-09-12T17:10:36.920239+0000","last_became_peered":"2024-09-12T17:10:36.920239+0000","last_unstale":"2024-09-12T18:35:21.677938+0000","last_undegraded":"2024-09-12T18:35:21.677938+0000","last_fullsized":"2024-09-12T18:35:21.677938+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":700,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:47.311658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164600,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1259,"num_read_kb":2698,"num_write":1016,"num_write_kb":809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:54.393429+0000","last_change":"2024-09-12T17:10:38.392174+0000","last_active":"2024-09-12T18:31:54.393429+0000","last_peered":"2024-09-12T18:31:54.393429+0000","last_clean":"2024-09-12T18:31:54.393429+0000","last_became_active":"2024-09-12T17:10:38.391661+0000","last_became_peered":"2024-09-12T17:10:38.391661+0000","last_unstale":"2024-09-12T18:31:54.393429+0000","last_undegraded":"2024-09-12T18:31:54.393429+0000","last_fullsized":"2024-09-12T18:31:54.393429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:44.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'98","reported_seq":607,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.423470+0000","last_change":"2024-09-12T17:10:40.435786+0000","last_active":"2024-09-12T18:33:56.423470+0000","last_peered":"2024-09-12T18:33:56.423470+0000","last_clean":"2024-09-12T18:33:56.423470+0000","last_became_active":"2024-09-12T17:10:40.435114+0000","last_became_peered":"2024-09-12T17:10:40.435114+0000","last_unstale":"2024-09-12T18:33:56.423470+0000","last_undegraded":"2024-09-12T18:33:56.423470+0000","last_fullsized":"2024-09-12T18:33:56.423470+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:14.936129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":238,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'127","reported_seq":723,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.426151+0000","last_change":"2024-09-12T17:10:40.422967+0000","last_active":"2024-09-12T18:34:01.426151+0000","last_peered":"2024-09-12T18:34:01.426151+0000","last_clean":"2024-09-12T18:34:01.426151+0000","last_became_active":"2024-09-12T17:10:40.417972+0000","last_became_peered":"2024-09-12T17:10:40.417972+0000","last_unstale":"2024-09-12T18:34:01.426151+0000","last_undegraded":"2024-09-12T18:34:01.426151+0000","last_fullsized":"2024-09-12T18:34:01.426151+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:44.119704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":319,"num_read_kb":297,"num_write":314,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'794","reported_seq":2315,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.135941+0000","last_change":"2024-09-12T17:10:32.368759+0000","last_active":"2024-09-12T18:33:06.135941+0000","last_peered":"2024-09-12T18:33:06.135941+0000","last_clean":"2024-09-12T18:33:06.135941+0000","last_became_active":"2024-09-12T17:10:32.368063+0000","last_became_peered":"2024-09-12T17:10:32.368063+0000","last_unstale":"2024-09-12T18:33:06.135941+0000","last_undegraded":"2024-09-12T18:33:06.135941+0000","last_fullsized":"2024-09-12T18:33:06.135941+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:01.539950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3740,"num_read_kb":3358,"num_write":1050,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'344","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.586131+0000","last_change":"2024-09-12T17:10:30.395497+0000","last_active":"2024-09-12T18:36:00.586131+0000","last_peered":"2024-09-12T18:36:00.586131+0000","last_clean":"2024-09-12T18:36:00.586131+0000","last_became_active":"2024-09-12T17:10:30.394117+0000","last_became_peered":"2024-09-12T17:10:30.394117+0000","last_unstale":"2024-09-12T18:36:00.586131+0000","last_undegraded":"2024-09-12T18:36:00.586131+0000","last_fullsized":"2024-09-12T18:36:00.586131+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:18.220639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357778,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":497,"num_read_kb":2118,"num_write":1119,"num_write_kb":20675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.631995+0000","last_change":"2024-09-12T17:10:34.360352+0000","last_active":"2024-09-12T18:32:16.631995+0000","last_peered":"2024-09-12T18:32:16.631995+0000","last_clean":"2024-09-12T18:32:16.631995+0000","last_became_active":"2024-09-12T17:10:34.359923+0000","last_became_peered":"2024-09-12T17:10:34.359923+0000","last_unstale":"2024-09-12T18:32:16.631995+0000","last_undegraded":"2024-09-12T18:32:16.631995+0000","last_fullsized":"2024-09-12T18:32:16.631995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:14.364530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'303","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.376919+0000","last_change":"2024-09-12T17:10:36.395453+0000","last_active":"2024-09-12T18:35:59.376919+0000","last_peered":"2024-09-12T18:35:59.376919+0000","last_clean":"2024-09-12T18:35:59.376919+0000","last_became_active":"2024-09-12T17:10:36.394731+0000","last_became_peered":"2024-09-12T17:10:36.394731+0000","last_unstale":"2024-09-12T18:35:59.376919+0000","last_undegraded":"2024-09-12T18:35:59.376919+0000","last_fullsized":"2024-09-12T18:35:59.376919+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:03.802691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56497,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":1193,"num_write":404,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:19.399496+0000","last_change":"2024-09-12T17:10:38.393630+0000","last_active":"2024-09-12T18:32:19.399496+0000","last_peered":"2024-09-12T18:32:19.399496+0000","last_clean":"2024-09-12T18:32:19.399496+0000","last_became_active":"2024-09-12T17:10:38.393112+0000","last_became_peered":"2024-09-12T17:10:38.393112+0000","last_unstale":"2024-09-12T18:32:19.399496+0000","last_undegraded":"2024-09-12T18:32:19.399496+0000","last_fullsized":"2024-09-12T18:32:19.399496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:11.857461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'117","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.411553+0000","last_change":"2024-09-12T17:10:40.430432+0000","last_active":"2024-09-12T18:33:04.411553+0000","last_peered":"2024-09-12T18:33:04.411553+0000","last_clean":"2024-09-12T18:33:04.411553+0000","last_became_active":"2024-09-12T17:10:40.429366+0000","last_became_peered":"2024-09-12T17:10:40.429366+0000","last_unstale":"2024-09-12T18:33:04.411553+0000","last_undegraded":"2024-09-12T18:33:04.411553+0000","last_fullsized":"2024-09-12T18:33:04.411553+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:03.623489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":137,"num_write":282,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'499","reported_seq":2099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.813533+0000","last_change":"2024-09-12T17:10:32.366756+0000","last_active":"2024-09-12T18:34:01.813533+0000","last_peered":"2024-09-12T18:34:01.813533+0000","last_clean":"2024-09-12T18:34:01.813533+0000","last_became_active":"2024-09-12T17:10:32.364033+0000","last_became_peered":"2024-09-12T17:10:32.364033+0000","last_unstale":"2024-09-12T18:34:01.813533+0000","last_undegraded":"2024-09-12T18:34:01.813533+0000","last_fullsized":"2024-09-12T18:34:01.813533+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:44.259351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2497,"num_read_kb":2341,"num_write":588,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'238","reported_seq":943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.927982+0000","last_change":"2024-09-12T17:10:30.406049+0000","last_active":"2024-09-12T18:33:38.927982+0000","last_peered":"2024-09-12T18:33:38.927982+0000","last_clean":"2024-09-12T18:33:38.927982+0000","last_became_active":"2024-09-12T17:10:30.405137+0000","last_became_peered":"2024-09-12T17:10:30.405137+0000","last_unstale":"2024-09-12T18:33:38.927982+0000","last_undegraded":"2024-09-12T18:33:38.927982+0000","last_fullsized":"2024-09-12T18:33:38.927982+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:51.883704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25232252,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":537,"num_read_kb":36707,"num_write":900,"num_write_kb":52863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:14.398461+0000","last_change":"2024-09-12T17:10:34.356731+0000","last_active":"2024-09-12T18:32:14.398461+0000","last_peered":"2024-09-12T18:32:14.398461+0000","last_clean":"2024-09-12T18:32:14.398461+0000","last_became_active":"2024-09-12T17:10:34.355684+0000","last_became_peered":"2024-09-12T17:10:34.355684+0000","last_unstale":"2024-09-12T18:32:14.398461+0000","last_undegraded":"2024-09-12T18:32:14.398461+0000","last_fullsized":"2024-09-12T18:32:14.398461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:22.182263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'58","reported_seq":588,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.404344+0000","last_change":"2024-09-12T17:10:36.402010+0000","last_active":"2024-09-12T18:32:16.404344+0000","last_peered":"2024-09-12T18:32:16.404344+0000","last_clean":"2024-09-12T18:32:16.404344+0000","last_became_active":"2024-09-12T17:10:36.400358+0000","last_became_peered":"2024-09-12T17:10:36.400358+0000","last_unstale":"2024-09-12T18:32:16.404344+0000","last_undegraded":"2024-09-12T18:32:16.404344+0000","last_fullsized":"2024-09-12T18:32:16.404344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:54.812329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":54,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.393889+0000","last_change":"2024-09-12T17:10:38.405067+0000","last_active":"2024-09-12T18:32:21.393889+0000","last_peered":"2024-09-12T18:32:21.393889+0000","last_clean":"2024-09-12T18:32:21.393889+0000","last_became_active":"2024-09-12T17:10:38.404309+0000","last_became_peered":"2024-09-12T17:10:38.404309+0000","last_unstale":"2024-09-12T18:32:21.393889+0000","last_undegraded":"2024-09-12T18:32:21.393889+0000","last_fullsized":"2024-09-12T18:32:21.393889+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:21.478649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'194","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.504598+0000","last_change":"2024-09-12T17:10:40.422558+0000","last_active":"2024-09-12T18:35:20.504598+0000","last_peered":"2024-09-12T18:35:20.504598+0000","last_clean":"2024-09-12T18:35:20.504598+0000","last_became_active":"2024-09-12T17:10:40.418473+0000","last_became_peered":"2024-09-12T17:10:40.418473+0000","last_unstale":"2024-09-12T18:35:20.504598+0000","last_undegraded":"2024-09-12T18:35:20.504598+0000","last_fullsized":"2024-09-12T18:35:20.504598+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:29.988283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":350,"num_read_kb":341,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'358","reported_seq":1681,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:39.694476+0000","last_change":"2024-09-12T17:10:32.383157+0000","last_active":"2024-09-12T18:32:39.694476+0000","last_peered":"2024-09-12T18:32:39.694476+0000","last_clean":"2024-09-12T18:32:39.694476+0000","last_became_active":"2024-09-12T17:10:32.382581+0000","last_became_peered":"2024-09-12T17:10:32.382581+0000","last_unstale":"2024-09-12T18:32:39.694476+0000","last_undegraded":"2024-09-12T18:32:39.694476+0000","last_fullsized":"2024-09-12T18:32:39.694476+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:16.772362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1854,"num_read_kb":1737,"num_write":414,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'301","reported_seq":974,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.406182+0000","last_change":"2024-09-12T17:10:30.375484+0000","last_active":"2024-09-12T18:32:41.406182+0000","last_peered":"2024-09-12T18:32:41.406182+0000","last_clean":"2024-09-12T18:32:41.406182+0000","last_became_active":"2024-09-12T17:10:30.374846+0000","last_became_peered":"2024-09-12T17:10:30.374846+0000","last_unstale":"2024-09-12T18:32:41.406182+0000","last_undegraded":"2024-09-12T18:32:41.406182+0000","last_fullsized":"2024-09-12T18:32:41.406182+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:37.286683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3700245,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":543,"num_read_kb":15626,"num_write":1146,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.392627+0000","last_change":"2024-09-12T17:10:34.362906+0000","last_active":"2024-09-12T18:32:16.392627+0000","last_peered":"2024-09-12T18:32:16.392627+0000","last_clean":"2024-09-12T18:32:16.392627+0000","last_became_active":"2024-09-12T17:10:34.362168+0000","last_became_peered":"2024-09-12T17:10:34.362168+0000","last_unstale":"2024-09-12T18:32:16.392627+0000","last_undegraded":"2024-09-12T18:32:16.392627+0000","last_fullsized":"2024-09-12T18:32:16.392627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:22.148212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'376","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.680160+0000","last_change":"2024-09-12T17:10:36.395016+0000","last_active":"2024-09-12T18:35:21.680160+0000","last_peered":"2024-09-12T18:35:21.680160+0000","last_clean":"2024-09-12T18:35:21.680160+0000","last_became_active":"2024-09-12T17:10:36.394639+0000","last_became_peered":"2024-09-12T17:10:36.394639+0000","last_unstale":"2024-09-12T18:35:21.680160+0000","last_undegraded":"2024-09-12T18:35:21.680160+0000","last_fullsized":"2024-09-12T18:35:21.680160+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:40.165567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85752,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":599,"num_read_kb":1247,"num_write":486,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.574124+0000","last_change":"2024-09-12T17:10:38.413916+0000","last_active":"2024-09-12T18:32:21.574124+0000","last_peered":"2024-09-12T18:32:21.574124+0000","last_clean":"2024-09-12T18:32:21.574124+0000","last_became_active":"2024-09-12T17:10:38.413131+0000","last_became_peered":"2024-09-12T17:10:38.413131+0000","last_unstale":"2024-09-12T18:32:21.574124+0000","last_undegraded":"2024-09-12T18:32:21.574124+0000","last_fullsized":"2024-09-12T18:32:21.574124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:09.828750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'132","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.413271+0000","last_change":"2024-09-12T17:10:40.429935+0000","last_active":"2024-09-12T18:33:11.413271+0000","last_peered":"2024-09-12T18:33:11.413271+0000","last_clean":"2024-09-12T18:33:11.413271+0000","last_became_active":"2024-09-12T17:10:40.429224+0000","last_became_peered":"2024-09-12T17:10:40.429224+0000","last_unstale":"2024-09-12T18:33:11.413271+0000","last_undegraded":"2024-09-12T18:33:11.413271+0000","last_fullsized":"2024-09-12T18:33:11.413271+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:11.523864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'949","reported_seq":2625,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.876011+0000","last_change":"2024-09-12T17:10:32.369486+0000","last_active":"2024-09-12T18:33:10.876011+0000","last_peered":"2024-09-12T18:33:10.876011+0000","last_clean":"2024-09-12T18:33:10.876011+0000","last_became_active":"2024-09-12T17:10:32.369282+0000","last_became_peered":"2024-09-12T17:10:32.369282+0000","last_unstale":"2024-09-12T18:33:10.876011+0000","last_undegraded":"2024-09-12T18:33:10.876011+0000","last_fullsized":"2024-09-12T18:33:10.876011+0000","mapping_epoch":27,"log_start":"268'900","ondisk_log_start":"268'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":900,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:33.793287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4532,"num_read_kb":4046,"num_write":1302,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'295","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.327151+0000","last_change":"2024-09-12T17:10:30.357595+0000","last_active":"2024-09-12T18:33:19.327151+0000","last_peered":"2024-09-12T18:33:19.327151+0000","last_clean":"2024-09-12T18:33:19.327151+0000","last_became_active":"2024-09-12T17:10:30.356383+0000","last_became_peered":"2024-09-12T17:10:30.356383+0000","last_unstale":"2024-09-12T18:33:19.327151+0000","last_undegraded":"2024-09-12T18:33:19.327151+0000","last_fullsized":"2024-09-12T18:33:19.327151+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:13.378425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10048763,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":469,"num_read_kb":17276,"num_write":1078,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.573012+0000","last_change":"2024-09-12T17:10:34.364021+0000","last_active":"2024-09-12T18:32:16.573012+0000","last_peered":"2024-09-12T18:32:16.573012+0000","last_clean":"2024-09-12T18:32:16.573012+0000","last_became_active":"2024-09-12T17:10:34.363279+0000","last_became_peered":"2024-09-12T17:10:34.363279+0000","last_unstale":"2024-09-12T18:32:16.573012+0000","last_undegraded":"2024-09-12T18:32:16.573012+0000","last_fullsized":"2024-09-12T18:32:16.573012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:56.824582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'315","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:36.427729+0000","last_change":"2024-09-12T17:10:36.397496+0000","last_active":"2024-09-12T18:34:36.427729+0000","last_peered":"2024-09-12T18:34:36.427729+0000","last_clean":"2024-09-12T18:34:36.427729+0000","last_became_active":"2024-09-12T17:10:36.396758+0000","last_became_peered":"2024-09-12T17:10:36.396758+0000","last_unstale":"2024-09-12T18:34:36.427729+0000","last_undegraded":"2024-09-12T18:34:36.427729+0000","last_fullsized":"2024-09-12T18:34:36.427729+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:17.261131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74627,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":1150,"num_write":436,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.405399+0000","last_change":"2024-09-12T17:10:38.414645+0000","last_active":"2024-09-12T18:32:21.405399+0000","last_peered":"2024-09-12T18:32:21.405399+0000","last_clean":"2024-09-12T18:32:21.405399+0000","last_became_active":"2024-09-12T17:10:38.413004+0000","last_became_peered":"2024-09-12T17:10:38.413004+0000","last_unstale":"2024-09-12T18:32:21.405399+0000","last_undegraded":"2024-09-12T18:32:21.405399+0000","last_fullsized":"2024-09-12T18:32:21.405399+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:16.768442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'438","reported_seq":1941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:59.060285+0000","last_change":"2024-09-12T17:10:32.351572+0000","last_active":"2024-09-12T18:32:59.060285+0000","last_peered":"2024-09-12T18:32:59.060285+0000","last_clean":"2024-09-12T18:32:59.060285+0000","last_became_active":"2024-09-12T17:10:32.350751+0000","last_became_peered":"2024-09-12T17:10:32.350751+0000","last_unstale":"2024-09-12T18:32:59.060285+0000","last_undegraded":"2024-09-12T18:32:59.060285+0000","last_fullsized":"2024-09-12T18:32:59.060285+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:37.740261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2256,"num_read_kb":2119,"num_write":496,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'232","reported_seq":879,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.353393+0000","last_change":"2024-09-12T17:10:30.353713+0000","last_active":"2024-09-12T18:35:59.353393+0000","last_peered":"2024-09-12T18:35:59.353393+0000","last_clean":"2024-09-12T18:35:59.353393+0000","last_became_active":"2024-09-12T17:10:30.353308+0000","last_became_peered":"2024-09-12T17:10:30.353308+0000","last_unstale":"2024-09-12T18:35:59.353393+0000","last_undegraded":"2024-09-12T18:35:59.353393+0000","last_fullsized":"2024-09-12T18:35:59.353393+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:18.517236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1690410,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":355,"num_read_kb":20512,"num_write":804,"num_write_kb":25251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411828+0000","last_change":"2024-09-12T17:10:34.358634+0000","last_active":"2024-09-12T18:32:51.411828+0000","last_peered":"2024-09-12T18:32:51.411828+0000","last_clean":"2024-09-12T18:32:51.411828+0000","last_became_active":"2024-09-12T17:10:34.357883+0000","last_became_peered":"2024-09-12T17:10:34.357883+0000","last_unstale":"2024-09-12T18:32:51.411828+0000","last_undegraded":"2024-09-12T18:32:51.411828+0000","last_fullsized":"2024-09-12T18:32:51.411828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:42.544648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'509","reported_seq":1157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.730698+0000","last_change":"2024-09-12T17:10:36.402382+0000","last_active":"2024-09-12T18:35:21.730698+0000","last_peered":"2024-09-12T18:35:21.730698+0000","last_clean":"2024-09-12T18:35:21.730698+0000","last_became_active":"2024-09-12T17:10:36.401608+0000","last_became_peered":"2024-09-12T17:10:36.401608+0000","last_unstale":"2024-09-12T18:35:21.730698+0000","last_undegraded":"2024-09-12T18:35:21.730698+0000","last_fullsized":"2024-09-12T18:35:21.730698+0000","mapping_epoch":31,"log_start":"268'400","ondisk_log_start":"268'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:02.237080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106830,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":877,"num_read_kb":1875,"num_write":764,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.413301+0000","last_change":"2024-09-12T17:10:38.399567+0000","last_active":"2024-09-12T18:33:11.413301+0000","last_peered":"2024-09-12T18:33:11.413301+0000","last_clean":"2024-09-12T18:33:11.413301+0000","last_became_active":"2024-09-12T17:10:38.398862+0000","last_became_peered":"2024-09-12T17:10:38.398862+0000","last_unstale":"2024-09-12T18:33:11.413301+0000","last_undegraded":"2024-09-12T18:33:11.413301+0000","last_fullsized":"2024-09-12T18:33:11.413301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:54.103985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'157","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.787915+0000","last_change":"2024-09-12T17:10:40.771008+0000","last_active":"2024-09-12T18:34:01.787915+0000","last_peered":"2024-09-12T18:34:01.787915+0000","last_clean":"2024-09-12T18:34:01.787915+0000","last_became_active":"2024-09-12T17:10:40.770075+0000","last_became_peered":"2024-09-12T17:10:40.770075+0000","last_unstale":"2024-09-12T18:34:01.787915+0000","last_undegraded":"2024-09-12T18:34:01.787915+0000","last_fullsized":"2024-09-12T18:34:01.787915+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:20.570103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":234,"num_write":361,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'1461","reported_seq":3047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.814470+0000","last_change":"2024-09-12T17:10:32.377189+0000","last_active":"2024-09-12T18:34:01.814470+0000","last_peered":"2024-09-12T18:34:01.814470+0000","last_clean":"2024-09-12T18:34:01.814470+0000","last_became_active":"2024-09-12T17:10:32.376892+0000","last_became_peered":"2024-09-12T17:10:32.376892+0000","last_unstale":"2024-09-12T18:34:01.814470+0000","last_undegraded":"2024-09-12T18:34:01.814470+0000","last_fullsized":"2024-09-12T18:34:01.814470+0000","mapping_epoch":27,"log_start":"268'1400","ondisk_log_start":"268'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":1400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:44.187578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6636,"num_read_kb":5839,"num_write":2046,"num_write_kb":883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'238","reported_seq":875,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642125+0000","last_change":"2024-09-12T17:10:30.378429+0000","last_active":"2024-09-12T18:33:01.642125+0000","last_peered":"2024-09-12T18:33:01.642125+0000","last_clean":"2024-09-12T18:33:01.642125+0000","last_became_active":"2024-09-12T17:10:30.378075+0000","last_became_peered":"2024-09-12T17:10:30.378075+0000","last_unstale":"2024-09-12T18:33:01.642125+0000","last_undegraded":"2024-09-12T18:33:01.642125+0000","last_fullsized":"2024-09-12T18:33:01.642125+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:26.384876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14545181,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":339,"num_read_kb":47843,"num_write":862,"num_write_kb":30557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.567644+0000","last_change":"2024-09-12T17:10:34.362259+0000","last_active":"2024-09-12T18:31:51.567644+0000","last_peered":"2024-09-12T18:31:51.567644+0000","last_clean":"2024-09-12T18:31:51.567644+0000","last_became_active":"2024-09-12T17:10:34.361495+0000","last_became_peered":"2024-09-12T17:10:34.361495+0000","last_unstale":"2024-09-12T18:31:51.567644+0000","last_undegraded":"2024-09-12T18:31:51.567644+0000","last_fullsized":"2024-09-12T18:31:51.567644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:28.400359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'333","reported_seq":950,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.675146+0000","last_change":"2024-09-12T17:10:36.399101+0000","last_active":"2024-09-12T18:35:21.675146+0000","last_peered":"2024-09-12T18:35:21.675146+0000","last_clean":"2024-09-12T18:35:21.675146+0000","last_became_active":"2024-09-12T17:10:36.398415+0000","last_became_peered":"2024-09-12T17:10:36.398415+0000","last_unstale":"2024-09-12T18:35:21.675146+0000","last_undegraded":"2024-09-12T18:35:21.675146+0000","last_fullsized":"2024-09-12T18:35:21.675146+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:16.776403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53077,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":567,"num_read_kb":1086,"num_write":468,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.644654+0000","last_change":"2024-09-12T17:10:38.404690+0000","last_active":"2024-09-12T18:33:11.644654+0000","last_peered":"2024-09-12T18:33:11.644654+0000","last_clean":"2024-09-12T18:33:11.644654+0000","last_became_active":"2024-09-12T17:10:38.401047+0000","last_became_peered":"2024-09-12T17:10:38.401047+0000","last_unstale":"2024-09-12T18:33:11.644654+0000","last_undegraded":"2024-09-12T18:33:11.644654+0000","last_fullsized":"2024-09-12T18:33:11.644654+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:40.635802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'196","reported_seq":744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:58.343759+0000","last_change":"2024-09-12T17:10:40.429587+0000","last_active":"2024-09-12T18:33:58.343759+0000","last_peered":"2024-09-12T18:33:58.343759+0000","last_clean":"2024-09-12T18:33:58.343759+0000","last_became_active":"2024-09-12T17:10:40.428841+0000","last_became_peered":"2024-09-12T17:10:40.428841+0000","last_unstale":"2024-09-12T18:33:58.343759+0000","last_undegraded":"2024-09-12T18:33:58.343759+0000","last_fullsized":"2024-09-12T18:33:58.343759+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:22.728668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1669,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":376,"num_read_kb":345,"num_write":581,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'1124","reported_seq":2870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.926010+0000","last_change":"2024-09-12T17:10:32.369642+0000","last_active":"2024-09-12T18:33:59.926010+0000","last_peered":"2024-09-12T18:33:59.926010+0000","last_clean":"2024-09-12T18:33:59.926010+0000","last_became_active":"2024-09-12T17:10:32.369344+0000","last_became_peered":"2024-09-12T17:10:32.369344+0000","last_unstale":"2024-09-12T18:33:59.926010+0000","last_undegraded":"2024-09-12T18:33:59.926010+0000","last_fullsized":"2024-09-12T18:33:59.926010+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:38.641315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5513,"num_read_kb":4854,"num_write":1595,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'277","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:06.775195+0000","last_change":"2024-09-12T17:11:05.124261+0000","last_active":"2024-09-12T18:31:06.775195+0000","last_peered":"2024-09-12T18:31:06.775195+0000","last_clean":"2024-09-12T18:31:06.775195+0000","last_became_active":"2024-09-12T17:11:05.123283+0000","last_became_peered":"2024-09-12T17:11:05.123283+0000","last_unstale":"2024-09-12T18:31:06.775195+0000","last_undegraded":"2024-09-12T18:31:06.775195+0000","last_fullsized":"2024-09-12T18:31:06.775195+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:41.264064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26617172,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":436,"num_read_kb":48131,"num_write":1039,"num_write_kb":35281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"37'5","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:58.750296+0000","last_change":"2024-09-12T17:10:34.352955+0000","last_active":"2024-09-12T18:35:58.750296+0000","last_peered":"2024-09-12T18:35:58.750296+0000","last_clean":"2024-09-12T18:35:58.750296+0000","last_became_active":"2024-09-12T17:10:34.352213+0000","last_became_peered":"2024-09-12T17:10:34.352213+0000","last_unstale":"2024-09-12T18:35:58.750296+0000","last_undegraded":"2024-09-12T18:35:58.750296+0000","last_fullsized":"2024-09-12T18:35:58.750296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:10.177818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'294","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.724781+0000","last_change":"2024-09-12T17:10:36.922284+0000","last_active":"2024-09-12T18:35:21.724781+0000","last_peered":"2024-09-12T18:35:21.724781+0000","last_clean":"2024-09-12T18:35:21.724781+0000","last_became_active":"2024-09-12T17:10:36.921450+0000","last_became_peered":"2024-09-12T17:10:36.921450+0000","last_unstale":"2024-09-12T18:35:21.724781+0000","last_undegraded":"2024-09-12T18:35:21.724781+0000","last_fullsized":"2024-09-12T18:35:21.724781+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:10.318840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48044,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":897,"num_write":360,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642311+0000","last_change":"2024-09-12T17:10:38.396118+0000","last_active":"2024-09-12T18:33:01.642311+0000","last_peered":"2024-09-12T18:33:01.642311+0000","last_clean":"2024-09-12T18:33:01.642311+0000","last_became_active":"2024-09-12T17:10:38.395457+0000","last_became_peered":"2024-09-12T17:10:38.395457+0000","last_unstale":"2024-09-12T18:33:01.642311+0000","last_undegraded":"2024-09-12T18:33:01.642311+0000","last_fullsized":"2024-09-12T18:33:01.642311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:35.393797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'130","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.742743+0000","last_change":"2024-09-12T17:10:40.430012+0000","last_active":"2024-09-12T18:35:21.742743+0000","last_peered":"2024-09-12T18:35:21.742743+0000","last_clean":"2024-09-12T18:35:21.742743+0000","last_became_active":"2024-09-12T17:10:40.429303+0000","last_became_peered":"2024-09-12T17:10:40.429303+0000","last_unstale":"2024-09-12T18:35:21.742743+0000","last_undegraded":"2024-09-12T18:35:21.742743+0000","last_fullsized":"2024-09-12T18:35:21.742743+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:37.352428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":233,"num_read_kb":212,"num_write":334,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'904","reported_seq":2419,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.879000+0000","last_change":"2024-09-12T17:10:32.363317+0000","last_active":"2024-09-12T18:33:10.879000+0000","last_peered":"2024-09-12T18:33:10.879000+0000","last_clean":"2024-09-12T18:33:10.879000+0000","last_became_active":"2024-09-12T17:10:32.362957+0000","last_became_peered":"2024-09-12T17:10:32.362957+0000","last_unstale":"2024-09-12T18:33:10.879000+0000","last_undegraded":"2024-09-12T18:33:10.879000+0000","last_fullsized":"2024-09-12T18:33:10.879000+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":800,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:46.722218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4274,"num_read_kb":3831,"num_write":1263,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'278","reported_seq":909,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.413710+0000","last_change":"2024-09-12T17:10:30.374981+0000","last_active":"2024-09-12T18:33:01.413710+0000","last_peered":"2024-09-12T18:33:01.413710+0000","last_clean":"2024-09-12T18:33:01.413710+0000","last_became_active":"2024-09-12T17:10:30.374618+0000","last_became_peered":"2024-09-12T17:10:30.374618+0000","last_unstale":"2024-09-12T18:33:01.413710+0000","last_undegraded":"2024-09-12T18:33:01.413710+0000","last_fullsized":"2024-09-12T18:33:01.413710+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:21.346521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244129,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":358,"num_read_kb":21889,"num_write":907,"num_write_kb":37331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.643558+0000","last_change":"2024-09-12T17:10:34.362059+0000","last_active":"2024-09-12T18:33:06.643558+0000","last_peered":"2024-09-12T18:33:06.643558+0000","last_clean":"2024-09-12T18:33:06.643558+0000","last_became_active":"2024-09-12T17:10:34.361536+0000","last_became_peered":"2024-09-12T17:10:34.361536+0000","last_unstale":"2024-09-12T18:33:06.643558+0000","last_undegraded":"2024-09-12T18:33:06.643558+0000","last_fullsized":"2024-09-12T18:33:06.643558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:33.573141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'114","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:00.592520+0000","last_change":"2024-09-12T17:10:36.923878+0000","last_active":"2024-09-12T18:33:00.592520+0000","last_peered":"2024-09-12T18:33:00.592520+0000","last_clean":"2024-09-12T18:33:00.592520+0000","last_became_active":"2024-09-12T17:10:36.923087+0000","last_became_peered":"2024-09-12T17:10:36.923087+0000","last_unstale":"2024-09-12T18:33:00.592520+0000","last_undegraded":"2024-09-12T18:33:00.592520+0000","last_fullsized":"2024-09-12T18:33:00.592520+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:34.787955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":134,"num_write":98,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'777","reported_seq":2881,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.778299+0000","last_change":"2024-09-12T17:10:38.410583+0000","last_active":"2024-09-12T18:35:21.778299+0000","last_peered":"2024-09-12T18:35:21.778299+0000","last_clean":"2024-09-12T18:35:21.778299+0000","last_became_active":"2024-09-12T17:10:38.407830+0000","last_became_peered":"2024-09-12T17:10:38.407830+0000","last_unstale":"2024-09-12T18:35:21.778299+0000","last_undegraded":"2024-09-12T18:35:21.778299+0000","last_fullsized":"2024-09-12T18:35:21.778299+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:25.369785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'146","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.883725+0000","last_change":"2024-09-12T17:10:40.432466+0000","last_active":"2024-09-12T18:33:59.883725+0000","last_peered":"2024-09-12T18:33:59.883725+0000","last_clean":"2024-09-12T18:33:59.883725+0000","last_became_active":"2024-09-12T17:10:40.431693+0000","last_became_peered":"2024-09-12T17:10:40.431693+0000","last_unstale":"2024-09-12T18:33:59.883725+0000","last_undegraded":"2024-09-12T18:33:59.883725+0000","last_fullsized":"2024-09-12T18:33:59.883725+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:18.379860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":232,"num_write":366,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'807","reported_seq":2326,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.812602+0000","last_change":"2024-09-12T17:10:32.370640+0000","last_active":"2024-09-12T18:34:01.812602+0000","last_peered":"2024-09-12T18:34:01.812602+0000","last_clean":"2024-09-12T18:34:01.812602+0000","last_became_active":"2024-09-12T17:10:32.369824+0000","last_became_peered":"2024-09-12T17:10:32.369824+0000","last_unstale":"2024-09-12T18:34:01.812602+0000","last_undegraded":"2024-09-12T18:34:01.812602+0000","last_fullsized":"2024-09-12T18:34:01.812602+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:05.486073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3803,"num_read_kb":3411,"num_write":1089,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'312","reported_seq":1117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.410878+0000","last_change":"2024-09-12T17:10:30.361138+0000","last_active":"2024-09-12T18:33:01.410878+0000","last_peered":"2024-09-12T18:33:01.410878+0000","last_clean":"2024-09-12T18:33:01.410878+0000","last_became_active":"2024-09-12T17:10:30.357942+0000","last_became_peered":"2024-09-12T17:10:30.357942+0000","last_unstale":"2024-09-12T18:33:01.410878+0000","last_undegraded":"2024-09-12T18:33:01.410878+0000","last_fullsized":"2024-09-12T18:33:01.410878+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:46.703023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11822081,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":890,"num_read_kb":26001,"num_write":1222,"num_write_kb":43743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.404767+0000","last_change":"2024-09-12T17:10:34.362432+0000","last_active":"2024-09-12T18:33:06.404767+0000","last_peered":"2024-09-12T18:33:06.404767+0000","last_clean":"2024-09-12T18:33:06.404767+0000","last_became_active":"2024-09-12T17:10:34.361686+0000","last_became_peered":"2024-09-12T17:10:34.361686+0000","last_unstale":"2024-09-12T18:33:06.404767+0000","last_undegraded":"2024-09-12T18:33:06.404767+0000","last_fullsized":"2024-09-12T18:33:06.404767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:20.692641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'362","reported_seq":978,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.650116+0000","last_change":"2024-09-12T17:10:36.392913+0000","last_active":"2024-09-12T18:35:21.650116+0000","last_peered":"2024-09-12T18:35:21.650116+0000","last_clean":"2024-09-12T18:35:21.650116+0000","last_became_active":"2024-09-12T17:10:36.392089+0000","last_became_peered":"2024-09-12T17:10:36.392089+0000","last_unstale":"2024-09-12T18:35:21.650116+0000","last_undegraded":"2024-09-12T18:35:21.650116+0000","last_fullsized":"2024-09-12T18:35:21.650116+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:00.724692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65339,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":587,"num_read_kb":1152,"num_write":476,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411609+0000","last_change":"2024-09-12T17:10:38.411770+0000","last_active":"2024-09-12T18:32:51.411609+0000","last_peered":"2024-09-12T18:32:51.411609+0000","last_clean":"2024-09-12T18:32:51.411609+0000","last_became_active":"2024-09-12T17:10:38.411191+0000","last_became_peered":"2024-09-12T17:10:38.411191+0000","last_unstale":"2024-09-12T18:32:51.411609+0000","last_undegraded":"2024-09-12T18:32:51.411609+0000","last_fullsized":"2024-09-12T18:32:51.411609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:29.140092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'100","reported_seq":612,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.845108+0000","last_change":"2024-09-12T17:10:40.437458+0000","last_active":"2024-09-12T18:33:55.845108+0000","last_peered":"2024-09-12T18:33:55.845108+0000","last_clean":"2024-09-12T18:33:55.845108+0000","last_became_active":"2024-09-12T17:10:40.436748+0000","last_became_peered":"2024-09-12T17:10:40.436748+0000","last_unstale":"2024-09-12T18:33:55.845108+0000","last_undegraded":"2024-09-12T18:33:55.845108+0000","last_fullsized":"2024-09-12T18:33:55.845108+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:53.015779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":136,"num_write":243,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'577","reported_seq":2227,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.808541+0000","last_change":"2024-09-12T17:10:32.371759+0000","last_active":"2024-09-12T18:34:01.808541+0000","last_peered":"2024-09-12T18:34:01.808541+0000","last_clean":"2024-09-12T18:34:01.808541+0000","last_became_active":"2024-09-12T17:10:32.370173+0000","last_became_peered":"2024-09-12T17:10:32.370173+0000","last_unstale":"2024-09-12T18:34:01.808541+0000","last_undegraded":"2024-09-12T18:34:01.808541+0000","last_fullsized":"2024-09-12T18:34:01.808541+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:20.201508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2773,"num_read_kb":2563,"num_write":696,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'296","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:14.647195+0000","last_change":"2024-09-12T17:10:30.358739+0000","last_active":"2024-09-12T18:35:14.647195+0000","last_peered":"2024-09-12T18:35:14.647195+0000","last_clean":"2024-09-12T18:35:14.647195+0000","last_became_active":"2024-09-12T17:10:30.355723+0000","last_became_peered":"2024-09-12T17:10:30.355723+0000","last_unstale":"2024-09-12T18:35:14.647195+0000","last_undegraded":"2024-09-12T18:35:14.647195+0000","last_fullsized":"2024-09-12T18:35:14.647195+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:21.953441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9762647,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":417,"num_read_kb":22337,"num_write":1073,"num_write_kb":39083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.412100+0000","last_change":"2024-09-12T17:10:34.364113+0000","last_active":"2024-09-12T18:33:06.412100+0000","last_peered":"2024-09-12T18:33:06.412100+0000","last_clean":"2024-09-12T18:33:06.412100+0000","last_became_active":"2024-09-12T17:10:34.363439+0000","last_became_peered":"2024-09-12T17:10:34.363439+0000","last_unstale":"2024-09-12T18:33:06.412100+0000","last_undegraded":"2024-09-12T18:33:06.412100+0000","last_fullsized":"2024-09-12T18:33:06.412100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:02.164079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'284","reported_seq":879,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:11.439582+0000","last_change":"2024-09-12T17:10:36.397893+0000","last_active":"2024-09-12T18:35:11.439582+0000","last_peered":"2024-09-12T18:35:11.439582+0000","last_clean":"2024-09-12T18:35:11.439582+0000","last_became_active":"2024-09-12T17:10:36.397148+0000","last_became_peered":"2024-09-12T17:10:36.397148+0000","last_unstale":"2024-09-12T18:35:11.439582+0000","last_undegraded":"2024-09-12T18:35:11.439582+0000","last_fullsized":"2024-09-12T18:35:11.439582+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:04.236115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74938,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":465,"num_read_kb":1009,"num_write":378,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.584512+0000","last_change":"2024-09-12T17:10:38.407655+0000","last_active":"2024-09-12T18:33:11.584512+0000","last_peered":"2024-09-12T18:33:11.584512+0000","last_clean":"2024-09-12T18:33:11.584512+0000","last_became_active":"2024-09-12T17:10:38.406892+0000","last_became_peered":"2024-09-12T17:10:38.406892+0000","last_unstale":"2024-09-12T18:33:11.584512+0000","last_undegraded":"2024-09-12T18:33:11.584512+0000","last_fullsized":"2024-09-12T18:33:11.584512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:15.244866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'157","reported_seq":692,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:19.439905+0000","last_change":"2024-09-12T17:10:40.770908+0000","last_active":"2024-09-12T18:35:19.439905+0000","last_peered":"2024-09-12T18:35:19.439905+0000","last_clean":"2024-09-12T18:35:19.439905+0000","last_became_active":"2024-09-12T17:10:40.770159+0000","last_became_peered":"2024-09-12T17:10:40.770159+0000","last_unstale":"2024-09-12T18:35:19.439905+0000","last_undegraded":"2024-09-12T18:35:19.439905+0000","last_fullsized":"2024-09-12T18:35:19.439905+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:17.022501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":169,"num_write":336,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'1195","reported_seq":2722,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.926177+0000","last_change":"2024-09-12T17:10:32.358404+0000","last_active":"2024-09-12T18:33:59.926177+0000","last_peered":"2024-09-12T18:33:59.926177+0000","last_clean":"2024-09-12T18:33:59.926177+0000","last_became_active":"2024-09-12T17:10:32.357738+0000","last_became_peered":"2024-09-12T17:10:32.357738+0000","last_unstale":"2024-09-12T18:33:59.926177+0000","last_undegraded":"2024-09-12T18:33:59.926177+0000","last_fullsized":"2024-09-12T18:33:59.926177+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":1100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:54.644317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5279,"num_read_kb":4649,"num_write":1626,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'273","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.404017+0000","last_change":"2024-09-12T17:10:30.402255+0000","last_active":"2024-09-12T18:35:59.404017+0000","last_peered":"2024-09-12T18:35:59.404017+0000","last_clean":"2024-09-12T18:35:59.404017+0000","last_became_active":"2024-09-12T17:10:30.401941+0000","last_became_peered":"2024-09-12T17:10:30.401941+0000","last_unstale":"2024-09-12T18:35:59.404017+0000","last_undegraded":"2024-09-12T18:35:59.404017+0000","last_fullsized":"2024-09-12T18:35:59.404017+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:55.543009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22284010,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":402,"num_read_kb":28040,"num_write":923,"num_write_kb":46600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:45.588684+0000","last_change":"2024-09-12T17:10:34.358478+0000","last_active":"2024-09-12T18:32:45.588684+0000","last_peered":"2024-09-12T18:32:45.588684+0000","last_clean":"2024-09-12T18:32:45.588684+0000","last_became_active":"2024-09-12T17:10:34.357688+0000","last_became_peered":"2024-09-12T17:10:34.357688+0000","last_unstale":"2024-09-12T18:32:45.588684+0000","last_undegraded":"2024-09-12T18:32:45.588684+0000","last_fullsized":"2024-09-12T18:32:45.588684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:01.686198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'245","reported_seq":820,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:39.444434+0000","last_change":"2024-09-12T17:10:36.400271+0000","last_active":"2024-09-12T18:35:39.444434+0000","last_peered":"2024-09-12T18:35:39.444434+0000","last_clean":"2024-09-12T18:35:39.444434+0000","last_became_active":"2024-09-12T17:10:36.398639+0000","last_became_peered":"2024-09-12T17:10:36.398639+0000","last_unstale":"2024-09-12T18:35:39.444434+0000","last_undegraded":"2024-09-12T18:35:39.444434+0000","last_fullsized":"2024-09-12T18:35:39.444434+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:36.210475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55585,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":394,"num_read_kb":897,"num_write":324,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.595054+0000","last_change":"2024-09-12T17:10:38.401463+0000","last_active":"2024-09-12T18:33:10.595054+0000","last_peered":"2024-09-12T18:33:10.595054+0000","last_clean":"2024-09-12T18:33:10.595054+0000","last_became_active":"2024-09-12T17:10:38.400703+0000","last_became_peered":"2024-09-12T17:10:38.400703+0000","last_unstale":"2024-09-12T18:33:10.595054+0000","last_undegraded":"2024-09-12T18:33:10.595054+0000","last_fullsized":"2024-09-12T18:33:10.595054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:10.103057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'171","reported_seq":1654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.714827+0000","last_change":"2024-09-12T17:10:40.435581+0000","last_active":"2024-09-12T18:33:55.714827+0000","last_peered":"2024-09-12T18:33:55.714827+0000","last_clean":"2024-09-12T18:33:55.714827+0000","last_became_active":"2024-09-12T17:10:40.434195+0000","last_became_peered":"2024-09-12T17:10:40.434195+0000","last_unstale":"2024-09-12T18:33:55.714827+0000","last_undegraded":"2024-09-12T18:33:55.714827+0000","last_fullsized":"2024-09-12T18:33:55.714827+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:34.304171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1233,"num_read_kb":1222,"num_write":385,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'393","reported_seq":1910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.525932+0000","last_change":"2024-09-12T17:10:32.362342+0000","last_active":"2024-09-12T18:35:20.525932+0000","last_peered":"2024-09-12T18:35:20.525932+0000","last_clean":"2024-09-12T18:35:20.525932+0000","last_became_active":"2024-09-12T17:10:32.361716+0000","last_became_peered":"2024-09-12T17:10:32.361716+0000","last_unstale":"2024-09-12T18:35:20.525932+0000","last_undegraded":"2024-09-12T18:35:20.525932+0000","last_fullsized":"2024-09-12T18:35:20.525932+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:33.025425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2161,"num_read_kb":2069,"num_write":462,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'256","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.423667+0000","last_change":"2024-09-12T17:10:30.388057+0000","last_active":"2024-09-12T18:33:51.423667+0000","last_peered":"2024-09-12T18:33:51.423667+0000","last_clean":"2024-09-12T18:33:51.423667+0000","last_became_active":"2024-09-12T17:10:30.387788+0000","last_became_peered":"2024-09-12T17:10:30.387788+0000","last_unstale":"2024-09-12T18:33:51.423667+0000","last_undegraded":"2024-09-12T18:33:51.423667+0000","last_fullsized":"2024-09-12T18:33:51.423667+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:57.145079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12876123,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":412,"num_read_kb":40433,"num_write":971,"num_write_kb":46438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.643399+0000","last_change":"2024-09-12T17:10:34.357090+0000","last_active":"2024-09-12T18:33:06.643399+0000","last_peered":"2024-09-12T18:33:06.643399+0000","last_clean":"2024-09-12T18:33:06.643399+0000","last_became_active":"2024-09-12T17:10:34.356290+0000","last_became_peered":"2024-09-12T17:10:34.356290+0000","last_unstale":"2024-09-12T18:33:06.643399+0000","last_undegraded":"2024-09-12T18:33:06.643399+0000","last_fullsized":"2024-09-12T18:33:06.643399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:58.022339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'309","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.841400+0000","last_change":"2024-09-12T17:10:36.392771+0000","last_active":"2024-09-12T18:35:59.841400+0000","last_peered":"2024-09-12T18:35:59.841400+0000","last_clean":"2024-09-12T18:35:59.841400+0000","last_became_active":"2024-09-12T17:10:36.391455+0000","last_became_peered":"2024-09-12T17:10:36.391455+0000","last_unstale":"2024-09-12T18:35:59.841400+0000","last_undegraded":"2024-09-12T18:35:59.841400+0000","last_fullsized":"2024-09-12T18:35:59.841400+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:23.461018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44113,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":1099,"num_write":400,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.415277+0000","last_change":"2024-09-12T17:10:38.414101+0000","last_active":"2024-09-12T18:33:11.415277+0000","last_peered":"2024-09-12T18:33:11.415277+0000","last_clean":"2024-09-12T18:33:11.415277+0000","last_became_active":"2024-09-12T17:10:38.413592+0000","last_became_peered":"2024-09-12T17:10:38.413592+0000","last_unstale":"2024-09-12T18:33:11.415277+0000","last_undegraded":"2024-09-12T18:33:11.415277+0000","last_fullsized":"2024-09-12T18:33:11.415277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:44.432349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'148","reported_seq":661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.433937+0000","last_change":"2024-09-12T17:10:40.432069+0000","last_active":"2024-09-12T18:35:20.433937+0000","last_peered":"2024-09-12T18:35:20.433937+0000","last_clean":"2024-09-12T18:35:20.433937+0000","last_became_active":"2024-09-12T17:10:40.425063+0000","last_became_peered":"2024-09-12T17:10:40.425063+0000","last_unstale":"2024-09-12T18:35:20.433937+0000","last_undegraded":"2024-09-12T18:35:20.433937+0000","last_fullsized":"2024-09-12T18:35:20.433937+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:02.872786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":181,"num_read_kb":173,"num_write":358,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'373","reported_seq":1793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.509133+0000","last_change":"2024-09-12T17:10:32.365153+0000","last_active":"2024-09-12T18:33:01.509133+0000","last_peered":"2024-09-12T18:33:01.509133+0000","last_clean":"2024-09-12T18:33:01.509133+0000","last_became_active":"2024-09-12T17:10:32.361445+0000","last_became_peered":"2024-09-12T17:10:32.361445+0000","last_unstale":"2024-09-12T18:33:01.509133+0000","last_undegraded":"2024-09-12T18:33:01.509133+0000","last_fullsized":"2024-09-12T18:33:01.509133+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:31.834987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1921,"num_read_kb":1829,"num_write":410,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'296","reported_seq":939,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:15.593459+0000","last_change":"2024-09-12T17:11:04.373385+0000","last_active":"2024-09-12T18:35:15.593459+0000","last_peered":"2024-09-12T18:35:15.593459+0000","last_clean":"2024-09-12T18:35:15.593459+0000","last_became_active":"2024-09-12T17:11:04.372622+0000","last_became_peered":"2024-09-12T17:11:04.372622+0000","last_unstale":"2024-09-12T18:35:15.593459+0000","last_undegraded":"2024-09-12T18:35:15.593459+0000","last_fullsized":"2024-09-12T18:35:15.593459+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:19.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13931842,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":462,"num_read_kb":34257,"num_write":1018,"num_write_kb":35279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'377","reported_seq":1894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.641114+0000","last_change":"2024-09-12T17:10:32.364419+0000","last_active":"2024-09-12T18:32:56.641114+0000","last_peered":"2024-09-12T18:32:56.641114+0000","last_clean":"2024-09-12T18:32:56.641114+0000","last_became_active":"2024-09-12T17:10:32.364080+0000","last_became_peered":"2024-09-12T17:10:32.364080+0000","last_unstale":"2024-09-12T18:32:56.641114+0000","last_undegraded":"2024-09-12T18:32:56.641114+0000","last_fullsized":"2024-09-12T18:32:56.641114+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:41.911462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2111,"num_read_kb":2018,"num_write":410,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'291","reported_seq":1066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.810322+0000","last_change":"2024-09-12T17:10:30.394272+0000","last_active":"2024-09-12T18:33:51.810322+0000","last_peered":"2024-09-12T18:33:51.810322+0000","last_clean":"2024-09-12T18:33:51.810322+0000","last_became_active":"2024-09-12T17:10:30.393924+0000","last_became_peered":"2024-09-12T17:10:30.393924+0000","last_unstale":"2024-09-12T18:33:51.810322+0000","last_undegraded":"2024-09-12T18:33:51.810322+0000","last_fullsized":"2024-09-12T18:33:51.810322+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:07.405582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7917549,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":669,"num_read_kb":31225,"num_write":1081,"num_write_kb":33307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'812","reported_seq":2200,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.879138+0000","last_change":"2024-09-12T17:10:32.382803+0000","last_active":"2024-09-12T18:33:10.879138+0000","last_peered":"2024-09-12T18:33:10.879138+0000","last_clean":"2024-09-12T18:33:10.879138+0000","last_became_active":"2024-09-12T17:10:32.382110+0000","last_became_peered":"2024-09-12T17:10:32.382110+0000","last_unstale":"2024-09-12T18:33:10.879138+0000","last_undegraded":"2024-09-12T18:33:10.879138+0000","last_fullsized":"2024-09-12T18:33:10.879138+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:57.022415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3583,"num_read_kb":3191,"num_write":1046,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'288","reported_seq":964,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.422338+0000","last_change":"2024-09-12T17:10:30.359981+0000","last_active":"2024-09-12T18:33:51.422338+0000","last_peered":"2024-09-12T18:33:51.422338+0000","last_clean":"2024-09-12T18:33:51.422338+0000","last_became_active":"2024-09-12T17:10:30.352353+0000","last_became_peered":"2024-09-12T17:10:30.352353+0000","last_unstale":"2024-09-12T18:33:51.422338+0000","last_undegraded":"2024-09-12T18:33:51.422338+0000","last_fullsized":"2024-09-12T18:33:51.422338+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:03.651567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12825621,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":473,"num_read_kb":44546,"num_write":1118,"num_write_kb":40457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'442","reported_seq":1987,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.641022+0000","last_change":"2024-09-12T17:10:32.379036+0000","last_active":"2024-09-12T18:32:56.641022+0000","last_peered":"2024-09-12T18:32:56.641022+0000","last_clean":"2024-09-12T18:32:56.641022+0000","last_became_active":"2024-09-12T17:10:32.378659+0000","last_became_peered":"2024-09-12T17:10:32.378659+0000","last_unstale":"2024-09-12T18:32:56.641022+0000","last_undegraded":"2024-09-12T18:32:56.641022+0000","last_fullsized":"2024-09-12T18:32:56.641022+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:58.217683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2290,"num_read_kb":2161,"num_write":510,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'305","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:14.627743+0000","last_change":"2024-09-12T17:11:04.869478+0000","last_active":"2024-09-12T18:35:14.627743+0000","last_peered":"2024-09-12T18:35:14.627743+0000","last_clean":"2024-09-12T18:35:14.627743+0000","last_became_active":"2024-09-12T17:11:04.868302+0000","last_became_peered":"2024-09-12T17:11:04.868302+0000","last_unstale":"2024-09-12T18:35:14.627743+0000","last_undegraded":"2024-09-12T18:35:14.627743+0000","last_fullsized":"2024-09-12T18:35:14.627743+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:22.742268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29387654,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":419,"num_read_kb":35312,"num_write":1141,"num_write_kb":68294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'520","reported_seq":2242,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.460046+0000","last_change":"2024-09-12T17:10:32.383452+0000","last_active":"2024-09-12T18:35:20.460046+0000","last_peered":"2024-09-12T18:35:20.460046+0000","last_clean":"2024-09-12T18:35:20.460046+0000","last_became_active":"2024-09-12T17:10:32.382841+0000","last_became_peered":"2024-09-12T17:10:32.382841+0000","last_unstale":"2024-09-12T18:35:20.460046+0000","last_undegraded":"2024-09-12T18:35:20.460046+0000","last_fullsized":"2024-09-12T18:35:20.460046+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:08.070690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2888,"num_read_kb":2690,"num_write":642,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'266","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.333977+0000","last_change":"2024-09-12T17:11:04.373500+0000","last_active":"2024-09-12T18:35:59.333977+0000","last_peered":"2024-09-12T18:35:59.333977+0000","last_clean":"2024-09-12T18:35:59.333977+0000","last_became_active":"2024-09-12T17:11:04.373103+0000","last_became_peered":"2024-09-12T17:11:04.373103+0000","last_unstale":"2024-09-12T18:35:59.333977+0000","last_undegraded":"2024-09-12T18:35:59.333977+0000","last_fullsized":"2024-09-12T18:35:59.333977+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:02.210085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437830,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":423,"num_read_kb":30230,"num_write":1002,"num_write_kb":31529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'444","reported_seq":2070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605323+0000","last_change":"2024-09-12T17:10:32.371035+0000","last_active":"2024-09-12T18:33:55.605323+0000","last_peered":"2024-09-12T18:33:55.605323+0000","last_clean":"2024-09-12T18:33:55.605323+0000","last_became_active":"2024-09-12T17:10:32.370112+0000","last_became_peered":"2024-09-12T17:10:32.370112+0000","last_unstale":"2024-09-12T18:33:55.605323+0000","last_undegraded":"2024-09-12T18:33:55.605323+0000","last_fullsized":"2024-09-12T18:33:55.605323+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:03.389218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2345,"num_read_kb":2230,"num_write":501,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'311","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:09.990398+0000","last_change":"2024-09-12T17:10:30.349073+0000","last_active":"2024-09-12T18:33:09.990398+0000","last_peered":"2024-09-12T18:33:09.990398+0000","last_clean":"2024-09-12T18:33:09.990398+0000","last_became_active":"2024-09-12T17:10:30.348702+0000","last_became_peered":"2024-09-12T17:10:30.348702+0000","last_unstale":"2024-09-12T18:33:09.990398+0000","last_undegraded":"2024-09-12T18:33:09.990398+0000","last_fullsized":"2024-09-12T18:33:09.990398+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:53.542082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15043845,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":492,"num_read_kb":10243,"num_write":1194,"num_write_kb":63527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'738","reported_seq":2624,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:54.421771+0000","last_change":"2024-09-12T17:10:32.371291+0000","last_active":"2024-09-12T18:33:54.421771+0000","last_peered":"2024-09-12T18:33:54.421771+0000","last_clean":"2024-09-12T18:33:54.421771+0000","last_became_active":"2024-09-12T17:10:32.371017+0000","last_became_peered":"2024-09-12T17:10:32.371017+0000","last_unstale":"2024-09-12T18:33:54.421771+0000","last_undegraded":"2024-09-12T18:33:54.421771+0000","last_fullsized":"2024-09-12T18:33:54.421771+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:50.198581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4018,"num_read_kb":3683,"num_write":976,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'264","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.580554+0000","last_change":"2024-09-12T17:10:30.400783+0000","last_active":"2024-09-12T18:32:51.580554+0000","last_peered":"2024-09-12T18:32:51.580554+0000","last_clean":"2024-09-12T18:32:51.580554+0000","last_became_active":"2024-09-12T17:10:30.396958+0000","last_became_peered":"2024-09-12T17:10:30.396958+0000","last_unstale":"2024-09-12T18:32:51.580554+0000","last_undegraded":"2024-09-12T18:32:51.580554+0000","last_fullsized":"2024-09-12T18:32:51.580554+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:01.387221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20441624,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":414,"num_read_kb":23680,"num_write":958,"num_write_kb":41122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'720","reported_seq":2417,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.628564+0000","last_change":"2024-09-12T17:10:32.348966+0000","last_active":"2024-09-12T18:33:18.628564+0000","last_peered":"2024-09-12T18:33:18.628564+0000","last_clean":"2024-09-12T18:33:18.628564+0000","last_became_active":"2024-09-12T17:10:32.348200+0000","last_became_peered":"2024-09-12T17:10:32.348200+0000","last_unstale":"2024-09-12T18:33:18.628564+0000","last_undegraded":"2024-09-12T18:33:18.628564+0000","last_fullsized":"2024-09-12T18:33:18.628564+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":700,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:53.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3587,"num_read_kb":3235,"num_write":983,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'322","reported_seq":1018,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.412111+0000","last_change":"2024-09-12T17:10:30.370508+0000","last_active":"2024-09-12T18:35:59.412111+0000","last_peered":"2024-09-12T18:35:59.412111+0000","last_clean":"2024-09-12T18:35:59.412111+0000","last_became_active":"2024-09-12T17:10:30.370015+0000","last_became_peered":"2024-09-12T17:10:30.370015+0000","last_unstale":"2024-09-12T18:35:59.412111+0000","last_undegraded":"2024-09-12T18:35:59.412111+0000","last_fullsized":"2024-09-12T18:35:59.412111+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:13.056343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16182623,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":490,"num_read_kb":40384,"num_write":1096,"num_write_kb":51606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'836","reported_seq":2470,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.531341+0000","last_change":"2024-09-12T17:10:32.350274+0000","last_active":"2024-09-12T18:35:20.531341+0000","last_peered":"2024-09-12T18:35:20.531341+0000","last_clean":"2024-09-12T18:35:20.531341+0000","last_became_active":"2024-09-12T17:10:32.348842+0000","last_became_peered":"2024-09-12T17:10:32.348842+0000","last_unstale":"2024-09-12T18:35:20.531341+0000","last_undegraded":"2024-09-12T18:35:20.531341+0000","last_fullsized":"2024-09-12T18:35:20.531341+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:40.714584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4030,"num_read_kb":3642,"num_write":1104,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'257","reported_seq":909,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.414245+0000","last_change":"2024-09-12T17:10:30.351530+0000","last_active":"2024-09-12T18:33:16.414245+0000","last_peered":"2024-09-12T18:33:16.414245+0000","last_clean":"2024-09-12T18:33:16.414245+0000","last_became_active":"2024-09-12T17:10:30.349523+0000","last_became_peered":"2024-09-12T17:10:30.349523+0000","last_unstale":"2024-09-12T18:33:16.414245+0000","last_undegraded":"2024-09-12T18:33:16.414245+0000","last_fullsized":"2024-09-12T18:33:16.414245+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:13.854677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13239365,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":402,"num_read_kb":103976,"num_write":935,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'519","reported_seq":2350,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.627374+0000","last_change":"2024-09-12T17:10:32.363610+0000","last_active":"2024-09-12T18:33:18.627374+0000","last_peered":"2024-09-12T18:33:18.627374+0000","last_clean":"2024-09-12T18:33:18.627374+0000","last_became_active":"2024-09-12T17:10:32.362881+0000","last_became_peered":"2024-09-12T17:10:32.362881+0000","last_unstale":"2024-09-12T18:33:18.627374+0000","last_undegraded":"2024-09-12T18:33:18.627374+0000","last_fullsized":"2024-09-12T18:33:18.627374+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:27.711767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2930,"num_read_kb":2778,"num_write":610,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'313","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.284645+0000","last_change":"2024-09-12T17:10:30.379084+0000","last_active":"2024-09-12T18:35:59.284645+0000","last_peered":"2024-09-12T18:35:59.284645+0000","last_clean":"2024-09-12T18:35:59.284645+0000","last_became_active":"2024-09-12T17:10:30.378766+0000","last_became_peered":"2024-09-12T17:10:30.378766+0000","last_unstale":"2024-09-12T18:35:59.284645+0000","last_undegraded":"2024-09-12T18:35:59.284645+0000","last_fullsized":"2024-09-12T18:35:59.284645+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:25.386692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11833783,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":550,"num_read_kb":26410,"num_write":1159,"num_write_kb":29487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'523","reported_seq":2172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.554813+0000","last_change":"2024-09-12T17:10:32.342457+0000","last_active":"2024-09-12T18:32:48.554813+0000","last_peered":"2024-09-12T18:32:48.554813+0000","last_clean":"2024-09-12T18:32:48.554813+0000","last_became_active":"2024-09-12T17:10:32.341480+0000","last_became_peered":"2024-09-12T17:10:32.341480+0000","last_unstale":"2024-09-12T18:32:48.554813+0000","last_undegraded":"2024-09-12T18:32:48.554813+0000","last_fullsized":"2024-09-12T18:32:48.554813+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:37.744373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2856,"num_read_kb":2663,"num_write":671,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'276","reported_seq":1025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:31.389096+0000","last_change":"2024-09-12T17:10:30.405089+0000","last_active":"2024-09-12T18:31:31.389096+0000","last_peered":"2024-09-12T18:31:31.389096+0000","last_clean":"2024-09-12T18:31:31.389096+0000","last_became_active":"2024-09-12T17:10:30.404567+0000","last_became_peered":"2024-09-12T17:10:30.404567+0000","last_unstale":"2024-09-12T18:31:31.389096+0000","last_undegraded":"2024-09-12T18:31:31.389096+0000","last_fullsized":"2024-09-12T18:31:31.389096+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:28.951703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18903230,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":716,"num_read_kb":46881,"num_write":1010,"num_write_kb":42596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'378","reported_seq":1776,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.736954+0000","last_change":"2024-09-12T17:10:32.371681+0000","last_active":"2024-09-12T18:34:01.736954+0000","last_peered":"2024-09-12T18:34:01.736954+0000","last_clean":"2024-09-12T18:34:01.736954+0000","last_became_active":"2024-09-12T17:10:32.370799+0000","last_became_peered":"2024-09-12T17:10:32.370799+0000","last_unstale":"2024-09-12T18:34:01.736954+0000","last_undegraded":"2024-09-12T18:34:01.736954+0000","last_fullsized":"2024-09-12T18:34:01.736954+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:01.601445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2049,"num_read_kb":1938,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'267","reported_seq":896,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.957117+0000","last_change":"2024-09-12T17:10:30.375100+0000","last_active":"2024-09-12T18:33:40.957117+0000","last_peered":"2024-09-12T18:33:40.957117+0000","last_clean":"2024-09-12T18:33:40.957117+0000","last_became_active":"2024-09-12T17:10:30.374689+0000","last_became_peered":"2024-09-12T17:10:30.374689+0000","last_unstale":"2024-09-12T18:33:40.957117+0000","last_undegraded":"2024-09-12T18:33:40.957117+0000","last_fullsized":"2024-09-12T18:33:40.957117+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:34.230883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18343484,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":350,"num_read_kb":28127,"num_write":1010,"num_write_kb":52007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1583","reported_seq":3062,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.884976+0000","last_change":"2024-09-12T17:10:32.385251+0000","last_active":"2024-09-12T18:33:10.884976+0000","last_peered":"2024-09-12T18:33:10.884976+0000","last_clean":"2024-09-12T18:33:10.884976+0000","last_became_active":"2024-09-12T17:10:32.384842+0000","last_became_peered":"2024-09-12T17:10:32.384842+0000","last_unstale":"2024-09-12T18:33:10.884976+0000","last_undegraded":"2024-09-12T18:33:10.884976+0000","last_fullsized":"2024-09-12T18:33:10.884976+0000","mapping_epoch":27,"log_start":"268'1500","ondisk_log_start":"268'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":1500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:41.827736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6992,"num_read_kb":6083,"num_write":2272,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'414","reported_seq":1224,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:31.563413+0000","last_change":"2024-09-12T17:12:05.373752+0000","last_active":"2024-09-12T18:31:31.563413+0000","last_peered":"2024-09-12T18:31:31.563413+0000","last_clean":"2024-09-12T18:31:31.563413+0000","last_became_active":"2024-09-12T17:12:05.372879+0000","last_became_peered":"2024-09-12T17:12:05.372879+0000","last_unstale":"2024-09-12T18:31:31.563413+0000","last_undegraded":"2024-09-12T18:31:31.563413+0000","last_fullsized":"2024-09-12T18:31:31.563413+0000","mapping_epoch":40,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:28.746471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15729611,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":878,"num_read_kb":72647,"num_write":1599,"num_write_kb":47468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,0],"acting":[6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'1142","reported_seq":2648,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:23.683290+0000","last_change":"2024-09-12T17:10:32.361735+0000","last_active":"2024-09-12T18:32:23.683290+0000","last_peered":"2024-09-12T18:32:23.683290+0000","last_clean":"2024-09-12T18:32:23.683290+0000","last_became_active":"2024-09-12T17:10:32.361416+0000","last_became_peered":"2024-09-12T17:10:32.361416+0000","last_unstale":"2024-09-12T18:32:23.683290+0000","last_undegraded":"2024-09-12T18:32:23.683290+0000","last_fullsized":"2024-09-12T18:32:23.683290+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:10.998239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5102,"num_read_kb":4502,"num_write":1588,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'362","reported_seq":1155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:39.040595+0000","last_change":"2024-09-12T17:10:30.405641+0000","last_active":"2024-09-12T18:32:39.040595+0000","last_peered":"2024-09-12T18:32:39.040595+0000","last_clean":"2024-09-12T18:32:39.040595+0000","last_became_active":"2024-09-12T17:10:30.404403+0000","last_became_peered":"2024-09-12T17:10:30.404403+0000","last_unstale":"2024-09-12T18:32:39.040595+0000","last_undegraded":"2024-09-12T18:32:39.040595+0000","last_fullsized":"2024-09-12T18:32:39.040595+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:16.546068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12611539,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":708,"num_read_kb":38614,"num_write":1207,"num_write_kb":36952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'389","reported_seq":1945,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.441613+0000","last_change":"2024-09-12T17:10:32.353298+0000","last_active":"2024-09-12T18:35:20.441613+0000","last_peered":"2024-09-12T18:35:20.441613+0000","last_clean":"2024-09-12T18:35:20.441613+0000","last_became_active":"2024-09-12T17:10:32.352916+0000","last_became_peered":"2024-09-12T17:10:32.352916+0000","last_unstale":"2024-09-12T18:35:20.441613+0000","last_undegraded":"2024-09-12T18:35:20.441613+0000","last_fullsized":"2024-09-12T18:35:20.441613+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:14.122659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2283,"num_read_kb":2176,"num_write":460,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'274","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.788089+0000","last_change":"2024-09-12T17:10:30.402433+0000","last_active":"2024-09-12T18:32:11.788089+0000","last_peered":"2024-09-12T18:32:11.788089+0000","last_clean":"2024-09-12T18:32:11.788089+0000","last_became_active":"2024-09-12T17:10:30.402024+0000","last_became_peered":"2024-09-12T17:10:30.402024+0000","last_unstale":"2024-09-12T18:32:11.788089+0000","last_undegraded":"2024-09-12T18:32:11.788089+0000","last_fullsized":"2024-09-12T18:32:11.788089+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:43.146846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19200717,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":385,"num_read_kb":33472,"num_write":937,"num_write_kb":44244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'828","reported_seq":2396,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.408504+0000","last_change":"2024-09-12T17:10:32.376676+0000","last_active":"2024-09-12T18:33:21.408504+0000","last_peered":"2024-09-12T18:33:21.408504+0000","last_clean":"2024-09-12T18:33:21.408504+0000","last_became_active":"2024-09-12T17:10:32.375891+0000","last_became_peered":"2024-09-12T17:10:32.375891+0000","last_unstale":"2024-09-12T18:33:21.408504+0000","last_undegraded":"2024-09-12T18:33:21.408504+0000","last_fullsized":"2024-09-12T18:33:21.408504+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:45.205202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3808,"num_read_kb":3437,"num_write":1089,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'345","reported_seq":1067,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.888940+0000","last_change":"2024-09-12T17:10:30.379099+0000","last_active":"2024-09-12T18:33:38.888940+0000","last_peered":"2024-09-12T18:33:38.888940+0000","last_clean":"2024-09-12T18:33:38.888940+0000","last_became_active":"2024-09-12T17:10:30.378109+0000","last_became_peered":"2024-09-12T17:10:30.378109+0000","last_unstale":"2024-09-12T18:33:38.888940+0000","last_undegraded":"2024-09-12T18:33:38.888940+0000","last_fullsized":"2024-09-12T18:33:38.888940+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:36.314866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8653557,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":583,"num_read_kb":82540,"num_write":1220,"num_write_kb":46419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'323","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:14.362520+0000","last_change":"2024-09-12T17:10:30.357091+0000","last_active":"2024-09-12T18:32:14.362520+0000","last_peered":"2024-09-12T18:32:14.362520+0000","last_clean":"2024-09-12T18:32:14.362520+0000","last_became_active":"2024-09-12T17:10:30.356199+0000","last_became_peered":"2024-09-12T17:10:30.356199+0000","last_unstale":"2024-09-12T18:32:14.362520+0000","last_undegraded":"2024-09-12T18:32:14.362520+0000","last_fullsized":"2024-09-12T18:32:14.362520+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:59.039701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21986890,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":513,"num_read_kb":25743,"num_write":1159,"num_write_kb":44098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'457","reported_seq":2245,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.814149+0000","last_change":"2024-09-12T17:10:32.350936+0000","last_active":"2024-09-12T18:34:01.814149+0000","last_peered":"2024-09-12T18:34:01.814149+0000","last_clean":"2024-09-12T18:34:01.814149+0000","last_became_active":"2024-09-12T17:10:32.349687+0000","last_became_peered":"2024-09-12T17:10:32.349687+0000","last_unstale":"2024-09-12T18:34:01.814149+0000","last_undegraded":"2024-09-12T18:34:01.814149+0000","last_fullsized":"2024-09-12T18:34:01.814149+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:14.030096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2918,"num_read_kb":2789,"num_write":551,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'314","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:22.979962+0000","last_change":"2024-09-12T17:11:05.122501+0000","last_active":"2024-09-12T18:32:22.979962+0000","last_peered":"2024-09-12T18:32:22.979962+0000","last_clean":"2024-09-12T18:32:22.979962+0000","last_became_active":"2024-09-12T17:11:05.121473+0000","last_became_peered":"2024-09-12T17:11:05.121473+0000","last_unstale":"2024-09-12T18:32:22.979962+0000","last_undegraded":"2024-09-12T18:32:22.979962+0000","last_fullsized":"2024-09-12T18:32:22.979962+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:52.213656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15293424,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":460,"num_read_kb":29048,"num_write":1159,"num_write_kb":43104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'468","reported_seq":1964,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.515670+0000","last_change":"2024-09-12T17:10:32.353257+0000","last_active":"2024-09-12T18:33:01.515670+0000","last_peered":"2024-09-12T18:33:01.515670+0000","last_clean":"2024-09-12T18:33:01.515670+0000","last_became_active":"2024-09-12T17:10:32.352369+0000","last_became_peered":"2024-09-12T17:10:32.352369+0000","last_unstale":"2024-09-12T18:33:01.515670+0000","last_undegraded":"2024-09-12T18:33:01.515670+0000","last_fullsized":"2024-09-12T18:33:01.515670+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:04.294268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2354,"num_read_kb":2191,"num_write":554,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6108,"num_read_kb":4244,"num_write":1960,"num_write_kb":858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1131,"ondisk_log_size":1131,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":16274,"num_read_kb":15945,"num_write":16744,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1671,"ondisk_log_size":1671,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":695,"ondisk_log_size":695,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1916818,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":19100,"num_read_kb":36278,"num_write":16087,"num_write_kb":12052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3231744,"data_stored":2721043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2000,"ondisk_log_size":2000,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2426,"num_read_kb":2893,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":213001,"num_read_kb":194600,"num_write":55405,"num_write_kb":18906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3776,"ondisk_log_size":3776,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":830151747,"num_objects":4363,"num_object_clones":0,"num_object_copies":13089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4363,"num_whiteouts":0,"num_read":32539,"num_read_kb":2308259,"num_write":68514,"num_write_kb":2504748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1235550208,"data_stored":1235550208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3775,"ondisk_log_size":3775,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":47917582,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":138,"num_read_kb":159116,"num_write":162,"num_write_kb":116497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":107380736,"data_stored":107369500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":53160462,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":134,"num_read_kb":158495,"num_write":160,"num_write_kb":116497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":107380736,"data_stored":107369500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510472,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":477688,"kb_used_data":197992,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":93894152,"statfs":{"total":96636764160,"available":96147611648,"internally_reserved":0,"allocated":202743808,"data_stored":200547088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":286390730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510476,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465860,"kb_used_data":191732,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93905980,"statfs":{"total":96636764160,"available":96159723520,"internally_reserved":0,"allocated":196333568,"data_stored":194224467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280689094},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510473,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321816,"kb_used_data":182408,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94050024,"statfs":{"total":96636764160,"available":96307224576,"internally_reserved":0,"allocated":186785792,"data_stored":184556322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510475,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263572,"kb_used_data":178244,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94108268,"statfs":{"total":96636764160,"available":96366866432,"internally_reserved":0,"allocated":182521856,"data_stored":180425075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510476,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":377000,"kb_used_data":219544,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":93994840,"statfs":{"total":96636764160,"available":96250716160,"internally_reserved":0,"allocated":224813056,"data_stored":222665947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510473,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":466288,"kb_used_data":210208,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93905552,"statfs":{"total":96636764160,"available":96159285248,"internally_reserved":0,"allocated":215252992,"data_stored":213075792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543180,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254660,"kb_used_data":147080,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94117180,"statfs":{"total":96636764160,"available":96375992320,"internally_reserved":0,"allocated":150609920,"data_stored":148529106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575881,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":476244,"kb_used_data":202116,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93895596,"statfs":{"total":96636764160,"available":96149090304,"internally_reserved":0,"allocated":206966784,"data_stored":204784042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280689095},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":177704960,"data_stored":177704960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":166338560,"data_stored":166338560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":142692352,"data_stored":142692352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":145809408,"data_stored":145809408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106315776,"data_stored":106315776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163704832,"data_stored":163704832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":162713600,"data_stored":162713600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":170270720,"data_stored":170270720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":375467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":390413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":135603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":437530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":38781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":671744,"data_stored":562791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":255442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":618496,"data_stored":525016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14270464,"data_stored":14266310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32555008,"data_stored":32554275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15777059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16879616,"data_stored":16876096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14217216,"data_stored":14215851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8437760,"data_stored":8437029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21073920,"data_stored":21070398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19509248,"data_stored":19507152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9486336,"data_stored":9485605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1101824,"data_stored":1099035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14729216,"data_stored":14728483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18411520,"data_stored":18410155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:36:02.390 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:36:02.757 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:36:02.770 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T18:36:02.772 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":2835,"stamp":"2024-09-12T18:36:00.841384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":933755108,"num_objects":4888,"num_object_clones":0,"num_object_copies":14139,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4888,"num_whiteouts":0,"num_read":289798,"num_read_kb":2879897,"num_write":159175,"num_write_kb":2776108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":213,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13343,"ondisk_log_size":13343,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3103128,"kb_used_data":1529324,"kb_used_omap":12,"kb_used_meta":1573619,"kb_avail":751871592,"statfs":{"total":773094113280,"available":769916510208,"internally_reserved":0,"allocated":1566027776,"data_stored":1548807839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1611386417},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-54138882,"num_objects":-183,"num_object_clones":0,"num_object_copies":-539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-183,"num_whiteouts":0,"num_read":220,"num_read_kb":292,"num_write":203,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008174"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.416560+0000","last_change":"2024-09-12T17:53:27.147438+0000","last_active":"2024-09-12T18:33:26.416560+0000","last_peered":"2024-09-12T18:33:26.416560+0000","last_clean":"2024-09-12T18:33:26.416560+0000","last_became_active":"2024-09-12T17:53:27.146780+0000","last_became_peered":"2024-09-12T17:53:27.146780+0000","last_unstale":"2024-09-12T18:33:26.416560+0000","last_undegraded":"2024-09-12T18:33:26.416560+0000","last_fullsized":"2024-09-12T18:33:26.416560+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:27.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"268'9","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:16.385996+0000","last_change":"2024-09-12T17:31:16.246161+0000","last_active":"2024-09-12T18:31:16.385996+0000","last_peered":"2024-09-12T18:31:16.385996+0000","last_clean":"2024-09-12T18:31:16.385996+0000","last_became_active":"2024-09-12T17:31:16.245482+0000","last_became_peered":"2024-09-12T17:31:16.245482+0000","last_unstale":"2024-09-12T18:31:16.385996+0000","last_undegraded":"2024-09-12T18:31:16.385996+0000","last_fullsized":"2024-09-12T18:31:16.385996+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:05.233527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099035,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":5245,"num_write":14,"num_write_kb":2121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:14.384819+0000","last_change":"2024-09-12T17:31:12.096770+0000","last_active":"2024-09-12T18:31:14.384819+0000","last_peered":"2024-09-12T18:31:14.384819+0000","last_clean":"2024-09-12T18:31:14.384819+0000","last_became_active":"2024-09-12T17:31:12.094935+0000","last_became_peered":"2024-09-12T17:31:12.094935+0000","last_unstale":"2024-09-12T18:31:14.384819+0000","last_undegraded":"2024-09-12T18:31:14.384819+0000","last_fullsized":"2024-09-12T18:31:14.384819+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:30.818530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'30","reported_seq":143,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.403621+0000","last_change":"2024-09-12T17:27:32.584697+0000","last_active":"2024-09-12T18:32:11.403621+0000","last_peered":"2024-09-12T18:32:11.403621+0000","last_clean":"2024-09-12T18:32:11.403621+0000","last_became_active":"2024-09-12T17:27:32.583903+0000","last_became_peered":"2024-09-12T17:27:32.583903+0000","last_unstale":"2024-09-12T18:32:11.403621+0000","last_undegraded":"2024-09-12T18:32:11.403621+0000","last_fullsized":"2024-09-12T18:32:11.403621+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:29.126608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":98,"num_write":57,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.805836+0000","last_change":"2024-09-12T17:53:27.168477+0000","last_active":"2024-09-12T18:33:26.805836+0000","last_peered":"2024-09-12T18:33:26.805836+0000","last_clean":"2024-09-12T18:33:26.805836+0000","last_became_active":"2024-09-12T17:53:27.167810+0000","last_became_peered":"2024-09-12T17:53:27.167810+0000","last_unstale":"2024-09-12T18:33:26.805836+0000","last_undegraded":"2024-09-12T18:33:26.805836+0000","last_fullsized":"2024-09-12T18:33:26.805836+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:15.873940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'7","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.602979+0000","last_change":"2024-09-12T17:31:16.238350+0000","last_active":"2024-09-12T18:33:45.602979+0000","last_peered":"2024-09-12T18:33:45.602979+0000","last_clean":"2024-09-12T18:33:45.602979+0000","last_became_active":"2024-09-12T17:31:16.237721+0000","last_became_peered":"2024-09-12T17:31:16.237721+0000","last_unstale":"2024-09-12T18:33:45.602979+0000","last_undegraded":"2024-09-12T18:33:45.602979+0000","last_fullsized":"2024-09-12T18:33:45.602979+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:31.469770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'2","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:11.617448+0000","last_change":"2024-09-12T17:31:12.106211+0000","last_active":"2024-09-12T18:31:11.617448+0000","last_peered":"2024-09-12T18:31:11.617448+0000","last_clean":"2024-09-12T18:31:11.617448+0000","last_became_active":"2024-09-12T17:31:12.105548+0000","last_became_peered":"2024-09-12T17:31:12.105548+0000","last_unstale":"2024-09-12T18:31:11.617448+0000","last_undegraded":"2024-09-12T18:31:11.617448+0000","last_fullsized":"2024-09-12T18:31:11.617448+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:03.366287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'16","reported_seq":114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.809510+0000","last_change":"2024-09-12T17:27:32.564047+0000","last_active":"2024-09-12T18:33:46.809510+0000","last_peered":"2024-09-12T18:33:46.809510+0000","last_clean":"2024-09-12T18:33:46.809510+0000","last_became_active":"2024-09-12T17:27:32.563281+0000","last_became_peered":"2024-09-12T17:27:32.563281+0000","last_unstale":"2024-09-12T18:33:46.809510+0000","last_undegraded":"2024-09-12T18:33:46.809510+0000","last_fullsized":"2024-09-12T18:33:46.809510+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:23.103744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.570655+0000","last_change":"2024-09-12T17:53:27.146120+0000","last_active":"2024-09-12T18:32:06.570655+0000","last_peered":"2024-09-12T18:32:06.570655+0000","last_clean":"2024-09-12T18:32:06.570655+0000","last_became_active":"2024-09-12T17:53:27.143812+0000","last_became_peered":"2024-09-12T17:53:27.143812+0000","last_unstale":"2024-09-12T18:32:06.570655+0000","last_undegraded":"2024-09-12T18:32:06.570655+0000","last_fullsized":"2024-09-12T18:32:06.570655+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:47.856070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.422572+0000","last_change":"2024-09-12T17:31:16.209712+0000","last_active":"2024-09-12T18:33:46.422572+0000","last_peered":"2024-09-12T18:33:46.422572+0000","last_clean":"2024-09-12T18:33:46.422572+0000","last_became_active":"2024-09-12T17:31:16.208994+0000","last_became_peered":"2024-09-12T17:31:16.208994+0000","last_unstale":"2024-09-12T18:33:46.422572+0000","last_undegraded":"2024-09-12T18:33:46.422572+0000","last_fullsized":"2024-09-12T18:33:46.422572+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:21.511571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'10","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.804901+0000","last_change":"2024-09-12T17:31:12.092194+0000","last_active":"2024-09-12T18:33:21.804901+0000","last_peered":"2024-09-12T18:33:21.804901+0000","last_clean":"2024-09-12T18:33:21.804901+0000","last_became_active":"2024-09-12T17:31:12.090602+0000","last_became_peered":"2024-09-12T17:31:12.090602+0000","last_unstale":"2024-09-12T18:33:21.804901+0000","last_undegraded":"2024-09-12T18:33:21.804901+0000","last_fullsized":"2024-09-12T18:33:21.804901+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:37.853518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7388451,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":10290,"num_write":15,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'40","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.408679+0000","last_change":"2024-09-12T17:27:32.554962+0000","last_active":"2024-09-12T18:32:36.408679+0000","last_peered":"2024-09-12T18:32:36.408679+0000","last_clean":"2024-09-12T18:32:36.408679+0000","last_became_active":"2024-09-12T17:27:32.554228+0000","last_became_peered":"2024-09-12T17:27:32.554228+0000","last_unstale":"2024-09-12T18:32:36.408679+0000","last_undegraded":"2024-09-12T18:32:36.408679+0000","last_fullsized":"2024-09-12T18:32:36.408679+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:30.083918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":136,"num_write":75,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:19.399599+0000","last_change":"2024-09-12T17:53:27.171122+0000","last_active":"2024-09-12T18:32:19.399599+0000","last_peered":"2024-09-12T18:32:19.399599+0000","last_clean":"2024-09-12T18:32:19.399599+0000","last_became_active":"2024-09-12T17:53:27.165849+0000","last_became_peered":"2024-09-12T17:53:27.165849+0000","last_unstale":"2024-09-12T18:32:19.399599+0000","last_undegraded":"2024-09-12T18:32:19.399599+0000","last_fullsized":"2024-09-12T18:32:19.399599+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:27.566630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"268'6","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.417613+0000","last_change":"2024-09-12T17:31:16.234725+0000","last_active":"2024-09-12T18:33:34.417613+0000","last_peered":"2024-09-12T18:33:34.417613+0000","last_clean":"2024-09-12T18:33:34.417613+0000","last_became_active":"2024-09-12T17:31:16.233989+0000","last_became_peered":"2024-09-12T17:31:16.233989+0000","last_unstale":"2024-09-12T18:33:34.417613+0000","last_undegraded":"2024-09-12T18:33:34.417613+0000","last_fullsized":"2024-09-12T18:33:34.417613+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:22.667547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'10","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.388434+0000","last_change":"2024-09-12T17:31:12.078149+0000","last_active":"2024-09-12T18:35:59.388434+0000","last_peered":"2024-09-12T18:35:59.388434+0000","last_clean":"2024-09-12T18:35:59.388434+0000","last_became_active":"2024-09-12T17:31:12.076980+0000","last_became_peered":"2024-09-12T17:31:12.076980+0000","last_unstale":"2024-09-12T18:35:59.388434+0000","last_undegraded":"2024-09-12T18:35:59.388434+0000","last_fullsized":"2024-09-12T18:35:59.388434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:20.927562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11264,"num_write":20,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'22","reported_seq":123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403144+0000","last_change":"2024-09-12T17:27:32.597852+0000","last_active":"2024-09-12T18:32:34.403144+0000","last_peered":"2024-09-12T18:32:34.403144+0000","last_clean":"2024-09-12T18:32:34.403144+0000","last_became_active":"2024-09-12T17:27:32.597092+0000","last_became_peered":"2024-09-12T17:27:32.597092+0000","last_unstale":"2024-09-12T18:32:34.403144+0000","last_undegraded":"2024-09-12T18:32:34.403144+0000","last_fullsized":"2024-09-12T18:32:34.403144+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:46.150508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":80,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.418737+0000","last_change":"2024-09-12T17:53:27.172827+0000","last_active":"2024-09-12T18:33:39.418737+0000","last_peered":"2024-09-12T18:33:39.418737+0000","last_clean":"2024-09-12T18:33:39.418737+0000","last_became_active":"2024-09-12T17:53:27.166248+0000","last_became_peered":"2024-09-12T17:53:27.166248+0000","last_unstale":"2024-09-12T18:33:39.418737+0000","last_undegraded":"2024-09-12T18:33:39.418737+0000","last_fullsized":"2024-09-12T18:33:39.418737+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:16.950414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:01.396099+0000","last_change":"2024-09-12T17:32:06.560970+0000","last_active":"2024-09-12T18:32:01.396099+0000","last_peered":"2024-09-12T18:32:01.396099+0000","last_clean":"2024-09-12T18:32:01.396099+0000","last_became_active":"2024-09-12T17:32:06.560465+0000","last_became_peered":"2024-09-12T17:32:06.560465+0000","last_unstale":"2024-09-12T18:32:01.396099+0000","last_undegraded":"2024-09-12T18:32:01.396099+0000","last_fullsized":"2024-09-12T18:32:01.396099+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:44.091888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'7","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.394772+0000","last_change":"2024-09-12T17:31:12.068624+0000","last_active":"2024-09-12T18:31:36.394772+0000","last_peered":"2024-09-12T18:31:36.394772+0000","last_clean":"2024-09-12T18:31:36.394772+0000","last_became_active":"2024-09-12T17:31:12.067819+0000","last_became_peered":"2024-09-12T17:31:12.067819+0000","last_unstale":"2024-09-12T18:31:36.394772+0000","last_undegraded":"2024-09-12T18:31:36.394772+0000","last_fullsized":"2024-09-12T18:31:36.394772+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:31.755207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":19458,"num_write":7,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'26","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403079+0000","last_change":"2024-09-12T17:27:32.591166+0000","last_active":"2024-09-12T18:32:34.403079+0000","last_peered":"2024-09-12T18:32:34.403079+0000","last_clean":"2024-09-12T18:32:34.403079+0000","last_became_active":"2024-09-12T17:27:32.578575+0000","last_became_peered":"2024-09-12T17:27:32.578575+0000","last_unstale":"2024-09-12T18:32:34.403079+0000","last_undegraded":"2024-09-12T18:32:34.403079+0000","last_fullsized":"2024-09-12T18:32:34.403079+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:56.541481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":95,"num_write":44,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642338+0000","last_change":"2024-09-12T17:53:27.156978+0000","last_active":"2024-09-12T18:33:01.642338+0000","last_peered":"2024-09-12T18:33:01.642338+0000","last_clean":"2024-09-12T18:33:01.642338+0000","last_became_active":"2024-09-12T17:53:27.156155+0000","last_became_peered":"2024-09-12T17:53:27.156155+0000","last_unstale":"2024-09-12T18:33:01.642338+0000","last_undegraded":"2024-09-12T18:33:01.642338+0000","last_fullsized":"2024-09-12T18:33:01.642338+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:51.477046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"268'1","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.565354+0000","last_change":"2024-09-12T17:31:16.227134+0000","last_active":"2024-09-12T18:31:41.565354+0000","last_peered":"2024-09-12T18:31:41.565354+0000","last_clean":"2024-09-12T18:31:41.565354+0000","last_became_active":"2024-09-12T17:31:16.226398+0000","last_became_peered":"2024-09-12T17:31:16.226398+0000","last_unstale":"2024-09-12T18:31:41.565354+0000","last_undegraded":"2024-09-12T18:31:41.565354+0000","last_fullsized":"2024-09-12T18:31:41.565354+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:46.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:00.578262+0000","last_change":"2024-09-12T17:31:12.077317+0000","last_active":"2024-09-12T18:32:00.578262+0000","last_peered":"2024-09-12T18:32:00.578262+0000","last_clean":"2024-09-12T18:32:00.578262+0000","last_became_active":"2024-09-12T17:31:12.076502+0000","last_became_peered":"2024-09-12T17:31:12.076502+0000","last_unstale":"2024-09-12T18:32:00.578262+0000","last_undegraded":"2024-09-12T18:32:00.578262+0000","last_fullsized":"2024-09-12T18:32:00.578262+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:49.794829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'36","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.577178+0000","last_change":"2024-09-12T17:27:32.569576+0000","last_active":"2024-09-12T18:32:36.577178+0000","last_peered":"2024-09-12T18:32:36.577178+0000","last_clean":"2024-09-12T18:32:36.577178+0000","last_became_active":"2024-09-12T17:27:32.568740+0000","last_became_peered":"2024-09-12T17:27:32.568740+0000","last_unstale":"2024-09-12T18:32:36.577178+0000","last_undegraded":"2024-09-12T18:32:36.577178+0000","last_fullsized":"2024-09-12T18:32:36.577178+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:55.258084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":126,"num_write":62,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.409921+0000","last_change":"2024-09-12T17:53:27.170601+0000","last_active":"2024-09-12T18:33:26.409921+0000","last_peered":"2024-09-12T18:33:26.409921+0000","last_clean":"2024-09-12T18:33:26.409921+0000","last_became_active":"2024-09-12T17:53:27.169805+0000","last_became_peered":"2024-09-12T17:53:27.169805+0000","last_unstale":"2024-09-12T18:33:26.409921+0000","last_undegraded":"2024-09-12T18:33:26.409921+0000","last_fullsized":"2024-09-12T18:33:26.409921+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:47.368175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"268'1","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:16.560345+0000","last_change":"2024-09-12T17:31:16.221214+0000","last_active":"2024-09-12T18:31:16.560345+0000","last_peered":"2024-09-12T18:31:16.560345+0000","last_clean":"2024-09-12T18:31:16.560345+0000","last_became_active":"2024-09-12T17:31:16.220449+0000","last_became_peered":"2024-09-12T17:31:16.220449+0000","last_unstale":"2024-09-12T18:31:16.560345+0000","last_undegraded":"2024-09-12T18:31:16.560345+0000","last_fullsized":"2024-09-12T18:31:16.560345+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:06.706199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:15.567669+0000","last_change":"2024-09-12T17:31:12.086822+0000","last_active":"2024-09-12T18:31:15.567669+0000","last_peered":"2024-09-12T18:31:15.567669+0000","last_clean":"2024-09-12T18:31:15.567669+0000","last_became_active":"2024-09-12T17:31:12.086091+0000","last_became_peered":"2024-09-12T17:31:12.086091+0000","last_unstale":"2024-09-12T18:31:15.567669+0000","last_undegraded":"2024-09-12T18:31:15.567669+0000","last_fullsized":"2024-09-12T18:31:15.567669+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:29.857815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'57","reported_seq":217,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.414339+0000","last_change":"2024-09-12T17:27:32.569293+0000","last_active":"2024-09-12T18:33:06.414339+0000","last_peered":"2024-09-12T18:33:06.414339+0000","last_clean":"2024-09-12T18:33:06.414339+0000","last_became_active":"2024-09-12T17:27:32.568506+0000","last_became_peered":"2024-09-12T17:27:32.568506+0000","last_unstale":"2024-09-12T18:33:06.414339+0000","last_undegraded":"2024-09-12T18:33:06.414339+0000","last_fullsized":"2024-09-12T18:33:06.414339+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:54.976967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":207,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.410077+0000","last_change":"2024-09-12T17:53:27.171469+0000","last_active":"2024-09-12T18:33:26.410077+0000","last_peered":"2024-09-12T18:33:26.410077+0000","last_clean":"2024-09-12T18:33:26.410077+0000","last_became_active":"2024-09-12T17:53:27.170636+0000","last_became_peered":"2024-09-12T17:53:27.170636+0000","last_unstale":"2024-09-12T18:33:26.410077+0000","last_undegraded":"2024-09-12T18:33:26.410077+0000","last_fullsized":"2024-09-12T18:33:26.410077+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:42.171510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"268'3","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.420948+0000","last_change":"2024-09-12T17:31:16.239144+0000","last_active":"2024-09-12T18:33:49.420948+0000","last_peered":"2024-09-12T18:33:49.420948+0000","last_clean":"2024-09-12T18:33:49.420948+0000","last_became_active":"2024-09-12T17:31:16.238450+0000","last_became_peered":"2024-09-12T17:31:16.238450+0000","last_unstale":"2024-09-12T18:33:49.420948+0000","last_undegraded":"2024-09-12T18:33:49.420948+0000","last_fullsized":"2024-09-12T18:33:49.420948+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:24.540079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:11.389062+0000","last_change":"2024-09-12T17:31:12.091121+0000","last_active":"2024-09-12T18:31:11.389062+0000","last_peered":"2024-09-12T18:31:11.389062+0000","last_clean":"2024-09-12T18:31:11.389062+0000","last_became_active":"2024-09-12T17:31:12.090201+0000","last_became_peered":"2024-09-12T17:31:12.090201+0000","last_unstale":"2024-09-12T18:31:11.389062+0000","last_undegraded":"2024-09-12T18:31:11.389062+0000","last_fullsized":"2024-09-12T18:31:11.389062+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:59.375478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.639470+0000","last_change":"2024-09-12T17:27:32.568403+0000","last_active":"2024-09-12T18:32:51.639470+0000","last_peered":"2024-09-12T18:32:51.639470+0000","last_clean":"2024-09-12T18:32:51.639470+0000","last_became_active":"2024-09-12T17:27:32.567672+0000","last_became_peered":"2024-09-12T17:27:32.567672+0000","last_unstale":"2024-09-12T18:32:51.639470+0000","last_undegraded":"2024-09-12T18:32:51.639470+0000","last_fullsized":"2024-09-12T18:32:51.639470+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:49.181661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.643457+0000","last_change":"2024-09-12T17:53:27.142791+0000","last_active":"2024-09-12T18:33:06.643457+0000","last_peered":"2024-09-12T18:33:06.643457+0000","last_clean":"2024-09-12T18:33:06.643457+0000","last_became_active":"2024-09-12T17:53:27.142060+0000","last_became_peered":"2024-09-12T17:53:27.142060+0000","last_unstale":"2024-09-12T18:33:06.643457+0000","last_undegraded":"2024-09-12T18:33:06.643457+0000","last_fullsized":"2024-09-12T18:33:06.643457+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:50.140663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"268'4","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:44.391228+0000","last_change":"2024-09-12T17:31:16.235658+0000","last_active":"2024-09-12T18:31:44.391228+0000","last_peered":"2024-09-12T18:31:44.391228+0000","last_clean":"2024-09-12T18:31:44.391228+0000","last_became_active":"2024-09-12T17:31:16.228226+0000","last_became_peered":"2024-09-12T17:31:16.228226+0000","last_unstale":"2024-09-12T18:31:44.391228+0000","last_undegraded":"2024-09-12T18:31:44.391228+0000","last_fullsized":"2024-09-12T18:31:44.391228+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:12.245863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1072,"num_write":9,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'4","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.399518+0000","last_change":"2024-09-12T17:31:12.091577+0000","last_active":"2024-09-12T18:32:11.399518+0000","last_peered":"2024-09-12T18:32:11.399518+0000","last_clean":"2024-09-12T18:32:11.399518+0000","last_became_active":"2024-09-12T17:31:12.090779+0000","last_became_peered":"2024-09-12T17:31:12.090779+0000","last_unstale":"2024-09-12T18:32:11.399518+0000","last_undegraded":"2024-09-12T18:32:11.399518+0000","last_fullsized":"2024-09-12T18:32:11.399518+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:37.345815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'62","reported_seq":234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411872+0000","last_change":"2024-09-12T17:27:32.571784+0000","last_active":"2024-09-12T18:32:51.411872+0000","last_peered":"2024-09-12T18:32:51.411872+0000","last_clean":"2024-09-12T18:32:51.411872+0000","last_became_active":"2024-09-12T17:27:32.567884+0000","last_became_peered":"2024-09-12T17:27:32.567884+0000","last_unstale":"2024-09-12T18:32:51.411872+0000","last_undegraded":"2024-09-12T18:32:51.411872+0000","last_fullsized":"2024-09-12T18:32:51.411872+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:13.840706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":230,"num_write":101,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.801783+0000","last_change":"2024-09-12T17:53:27.140297+0000","last_active":"2024-09-12T18:33:06.801783+0000","last_peered":"2024-09-12T18:33:06.801783+0000","last_clean":"2024-09-12T18:33:06.801783+0000","last_became_active":"2024-09-12T17:53:27.139551+0000","last_became_peered":"2024-09-12T17:53:27.139551+0000","last_unstale":"2024-09-12T18:33:06.801783+0000","last_undegraded":"2024-09-12T18:33:06.801783+0000","last_fullsized":"2024-09-12T18:33:06.801783+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:49.095002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'3","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:14.398487+0000","last_change":"2024-09-12T17:31:16.237383+0000","last_active":"2024-09-12T18:32:14.398487+0000","last_peered":"2024-09-12T18:32:14.398487+0000","last_clean":"2024-09-12T18:32:14.398487+0000","last_became_active":"2024-09-12T17:31:16.236796+0000","last_became_peered":"2024-09-12T17:31:16.236796+0000","last_unstale":"2024-09-12T18:32:14.398487+0000","last_undegraded":"2024-09-12T18:32:14.398487+0000","last_fullsized":"2024-09-12T18:32:14.398487+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:49.523071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'3","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.383391+0000","last_change":"2024-09-12T17:31:12.093519+0000","last_active":"2024-09-12T18:31:36.383391+0000","last_peered":"2024-09-12T18:31:36.383391+0000","last_clean":"2024-09-12T18:31:36.383391+0000","last_became_active":"2024-09-12T17:31:12.092655+0000","last_became_peered":"2024-09-12T17:31:12.092655+0000","last_unstale":"2024-09-12T18:31:36.383391+0000","last_undegraded":"2024-09-12T18:31:36.383391+0000","last_fullsized":"2024-09-12T18:31:36.383391+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:42.350728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4144,"num_write":3,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'23","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:49.407673+0000","last_change":"2024-09-12T17:27:32.579819+0000","last_active":"2024-09-12T18:32:49.407673+0000","last_peered":"2024-09-12T18:32:49.407673+0000","last_clean":"2024-09-12T18:32:49.407673+0000","last_became_active":"2024-09-12T17:27:32.578393+0000","last_became_peered":"2024-09-12T17:27:32.578393+0000","last_unstale":"2024-09-12T18:32:49.407673+0000","last_undegraded":"2024-09-12T18:32:49.407673+0000","last_fullsized":"2024-09-12T18:32:49.407673+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:12.325555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":84,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.404631+0000","last_change":"2024-09-12T17:53:27.151852+0000","last_active":"2024-09-12T18:33:06.404631+0000","last_peered":"2024-09-12T18:33:06.404631+0000","last_clean":"2024-09-12T18:33:06.404631+0000","last_became_active":"2024-09-12T17:53:27.142159+0000","last_became_peered":"2024-09-12T17:53:27.142159+0000","last_unstale":"2024-09-12T18:33:06.404631+0000","last_undegraded":"2024-09-12T18:33:06.404631+0000","last_fullsized":"2024-09-12T18:33:06.404631+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:32.788357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:09.425500+0000","last_change":"2024-09-12T17:31:16.237254+0000","last_active":"2024-09-12T18:34:09.425500+0000","last_peered":"2024-09-12T18:34:09.425500+0000","last_clean":"2024-09-12T18:34:09.425500+0000","last_became_active":"2024-09-12T17:31:16.236478+0000","last_became_peered":"2024-09-12T17:31:16.236478+0000","last_unstale":"2024-09-12T18:34:09.425500+0000","last_undegraded":"2024-09-12T18:34:09.425500+0000","last_fullsized":"2024-09-12T18:34:09.425500+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:03.647540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.781224+0000","last_change":"2024-09-12T17:31:12.092360+0000","last_active":"2024-09-12T18:31:36.781224+0000","last_peered":"2024-09-12T18:31:36.781224+0000","last_clean":"2024-09-12T18:31:36.781224+0000","last_became_active":"2024-09-12T17:31:12.091488+0000","last_became_peered":"2024-09-12T17:31:12.091488+0000","last_unstale":"2024-09-12T18:31:36.781224+0000","last_undegraded":"2024-09-12T18:31:36.781224+0000","last_fullsized":"2024-09-12T18:31:36.781224+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:42.860474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'49","reported_seq":200,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.798942+0000","last_change":"2024-09-12T17:27:32.573661+0000","last_active":"2024-09-12T18:32:51.798942+0000","last_peered":"2024-09-12T18:32:51.798942+0000","last_clean":"2024-09-12T18:32:51.798942+0000","last_became_active":"2024-09-12T17:27:32.572859+0000","last_became_peered":"2024-09-12T17:27:32.572859+0000","last_unstale":"2024-09-12T18:32:51.798942+0000","last_undegraded":"2024-09-12T18:32:51.798942+0000","last_fullsized":"2024-09-12T18:32:51.798942+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:51.245414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":198,"num_write":77,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.412028+0000","last_change":"2024-09-12T17:53:27.156462+0000","last_active":"2024-09-12T18:33:06.412028+0000","last_peered":"2024-09-12T18:33:06.412028+0000","last_clean":"2024-09-12T18:33:06.412028+0000","last_became_active":"2024-09-12T17:53:27.155646+0000","last_became_peered":"2024-09-12T17:53:27.155646+0000","last_unstale":"2024-09-12T18:33:06.412028+0000","last_undegraded":"2024-09-12T18:33:06.412028+0000","last_fullsized":"2024-09-12T18:33:06.412028+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:44.968007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:40.573394+0000","last_change":"2024-09-12T17:31:16.221542+0000","last_active":"2024-09-12T18:31:40.573394+0000","last_peered":"2024-09-12T18:31:40.573394+0000","last_clean":"2024-09-12T18:31:40.573394+0000","last_became_active":"2024-09-12T17:31:16.220797+0000","last_became_peered":"2024-09-12T17:31:16.220797+0000","last_unstale":"2024-09-12T18:31:40.573394+0000","last_undegraded":"2024-09-12T18:31:40.573394+0000","last_fullsized":"2024-09-12T18:31:40.573394+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:34.381182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.395227+0000","last_change":"2024-09-12T17:31:12.098496+0000","last_active":"2024-09-12T18:31:36.395227+0000","last_peered":"2024-09-12T18:31:36.395227+0000","last_clean":"2024-09-12T18:31:36.395227+0000","last_became_active":"2024-09-12T17:31:12.090174+0000","last_became_peered":"2024-09-12T17:31:12.090174+0000","last_unstale":"2024-09-12T18:31:36.395227+0000","last_undegraded":"2024-09-12T18:31:36.395227+0000","last_fullsized":"2024-09-12T18:31:36.395227+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:11.213746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'100","reported_seq":394,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.407333+0000","last_change":"2024-09-12T17:27:32.574809+0000","last_active":"2024-09-12T18:33:16.407333+0000","last_peered":"2024-09-12T18:33:16.407333+0000","last_clean":"2024-09-12T18:33:16.407333+0000","last_became_active":"2024-09-12T17:27:32.574023+0000","last_became_peered":"2024-09-12T17:27:32.574023+0000","last_unstale":"2024-09-12T18:33:16.407333+0000","last_undegraded":"2024-09-12T18:33:16.407333+0000","last_fullsized":"2024-09-12T18:33:16.407333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:43.524925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":651,"num_read_kb":453,"num_write":126,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:09.397336+0000","last_change":"2024-09-12T17:53:27.165446+0000","last_active":"2024-09-12T18:32:09.397336+0000","last_peered":"2024-09-12T18:32:09.397336+0000","last_clean":"2024-09-12T18:32:09.397336+0000","last_became_active":"2024-09-12T17:53:27.164643+0000","last_became_peered":"2024-09-12T17:53:27.164643+0000","last_unstale":"2024-09-12T18:32:09.397336+0000","last_undegraded":"2024-09-12T18:32:09.397336+0000","last_fullsized":"2024-09-12T18:32:09.397336+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:32.358718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"265'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.627015+0000","last_change":"2024-09-12T17:31:16.241953+0000","last_active":"2024-09-12T18:31:56.627015+0000","last_peered":"2024-09-12T18:31:56.627015+0000","last_clean":"2024-09-12T18:31:56.627015+0000","last_became_active":"2024-09-12T17:31:16.240666+0000","last_became_peered":"2024-09-12T17:31:16.240666+0000","last_unstale":"2024-09-12T18:31:56.627015+0000","last_undegraded":"2024-09-12T18:31:56.627015+0000","last_fullsized":"2024-09-12T18:31:56.627015+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:19.000830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'2","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:15.609579+0000","last_change":"2024-09-12T17:31:12.079972+0000","last_active":"2024-09-12T18:34:15.609579+0000","last_peered":"2024-09-12T18:34:15.609579+0000","last_clean":"2024-09-12T18:34:15.609579+0000","last_became_active":"2024-09-12T17:31:12.077055+0000","last_became_peered":"2024-09-12T17:31:12.077055+0000","last_unstale":"2024-09-12T18:34:15.609579+0000","last_undegraded":"2024-09-12T18:34:15.609579+0000","last_fullsized":"2024-09-12T18:34:15.609579+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:54.359866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'36","reported_seq":161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.402360+0000","last_change":"2024-09-12T17:27:32.575114+0000","last_active":"2024-09-12T18:32:56.402360+0000","last_peered":"2024-09-12T18:32:56.402360+0000","last_clean":"2024-09-12T18:32:56.402360+0000","last_became_active":"2024-09-12T17:27:32.574128+0000","last_became_peered":"2024-09-12T17:27:32.574128+0000","last_unstale":"2024-09-12T18:32:56.402360+0000","last_undegraded":"2024-09-12T18:32:56.402360+0000","last_fullsized":"2024-09-12T18:32:56.402360+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:30.567491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":129,"num_write":75,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.402547+0000","last_change":"2024-09-12T17:53:27.170202+0000","last_active":"2024-09-12T18:32:06.402547+0000","last_peered":"2024-09-12T18:32:06.402547+0000","last_clean":"2024-09-12T18:32:06.402547+0000","last_became_active":"2024-09-12T17:53:27.169499+0000","last_became_peered":"2024-09-12T17:53:27.169499+0000","last_unstale":"2024-09-12T18:32:06.402547+0000","last_undegraded":"2024-09-12T18:32:06.402547+0000","last_fullsized":"2024-09-12T18:32:06.402547+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:09.313257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"268'3","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.626905+0000","last_change":"2024-09-12T17:31:16.233694+0000","last_active":"2024-09-12T18:31:56.626905+0000","last_peered":"2024-09-12T18:31:56.626905+0000","last_clean":"2024-09-12T18:31:56.626905+0000","last_became_active":"2024-09-12T17:31:16.232949+0000","last_became_peered":"2024-09-12T17:31:16.232949+0000","last_unstale":"2024-09-12T18:31:56.626905+0000","last_undegraded":"2024-09-12T18:31:56.626905+0000","last_fullsized":"2024-09-12T18:31:56.626905+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:20.006807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'3","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:14.426601+0000","last_change":"2024-09-12T17:31:12.087042+0000","last_active":"2024-09-12T18:34:14.426601+0000","last_peered":"2024-09-12T18:34:14.426601+0000","last_clean":"2024-09-12T18:34:14.426601+0000","last_became_active":"2024-09-12T17:31:12.086300+0000","last_became_peered":"2024-09-12T17:31:12.086300+0000","last_unstale":"2024-09-12T18:34:14.426601+0000","last_undegraded":"2024-09-12T18:34:14.426601+0000","last_fullsized":"2024-09-12T18:34:14.426601+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:18.726386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'15","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.412585+0000","last_change":"2024-09-12T17:27:32.592754+0000","last_active":"2024-09-12T18:32:56.412585+0000","last_peered":"2024-09-12T18:32:56.412585+0000","last_clean":"2024-09-12T18:32:56.412585+0000","last_became_active":"2024-09-12T17:27:32.591878+0000","last_became_peered":"2024-09-12T17:27:32.591878+0000","last_unstale":"2024-09-12T18:32:56.412585+0000","last_undegraded":"2024-09-12T18:32:56.412585+0000","last_fullsized":"2024-09-12T18:32:56.412585+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:19.824090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.416384+0000","last_change":"2024-09-12T17:53:27.158764+0000","last_active":"2024-09-12T18:33:16.416384+0000","last_peered":"2024-09-12T18:33:16.416384+0000","last_clean":"2024-09-12T18:33:16.416384+0000","last_became_active":"2024-09-12T17:53:27.157992+0000","last_became_peered":"2024-09-12T17:53:27.157992+0000","last_unstale":"2024-09-12T18:33:16.416384+0000","last_undegraded":"2024-09-12T18:33:16.416384+0000","last_fullsized":"2024-09-12T18:33:16.416384+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:50.572142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428001+0000","last_change":"2024-09-12T17:31:16.228882+0000","last_active":"2024-09-12T18:34:19.428001+0000","last_peered":"2024-09-12T18:34:19.428001+0000","last_clean":"2024-09-12T18:34:19.428001+0000","last_became_active":"2024-09-12T17:31:16.227946+0000","last_became_peered":"2024-09-12T17:31:16.227946+0000","last_unstale":"2024-09-12T18:34:19.428001+0000","last_undegraded":"2024-09-12T18:34:19.428001+0000","last_fullsized":"2024-09-12T18:34:19.428001+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:58.107920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'5","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.567511+0000","last_change":"2024-09-12T17:31:12.106194+0000","last_active":"2024-09-12T18:31:51.567511+0000","last_peered":"2024-09-12T18:31:51.567511+0000","last_clean":"2024-09-12T18:31:51.567511+0000","last_became_active":"2024-09-12T17:31:12.105448+0000","last_became_peered":"2024-09-12T17:31:12.105448+0000","last_unstale":"2024-09-12T18:31:51.567511+0000","last_undegraded":"2024-09-12T18:31:51.567511+0000","last_fullsized":"2024-09-12T18:31:51.567511+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:55.162506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'22","reported_seq":120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:55.591164+0000","last_change":"2024-09-12T17:27:32.568251+0000","last_active":"2024-09-12T18:32:55.591164+0000","last_peered":"2024-09-12T18:32:55.591164+0000","last_clean":"2024-09-12T18:32:55.591164+0000","last_became_active":"2024-09-12T17:27:32.567500+0000","last_became_peered":"2024-09-12T17:27:32.567500+0000","last_unstale":"2024-09-12T18:32:55.591164+0000","last_undegraded":"2024-09-12T18:32:55.591164+0000","last_fullsized":"2024-09-12T18:32:55.591164+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:19.895653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:09.397287+0000","last_change":"2024-09-12T17:53:27.167094+0000","last_active":"2024-09-12T18:32:09.397287+0000","last_peered":"2024-09-12T18:32:09.397287+0000","last_clean":"2024-09-12T18:32:09.397287+0000","last_became_active":"2024-09-12T17:53:27.164083+0000","last_became_peered":"2024-09-12T17:53:27.164083+0000","last_unstale":"2024-09-12T18:32:09.397287+0000","last_undegraded":"2024-09-12T18:32:09.397287+0000","last_fullsized":"2024-09-12T18:32:09.397287+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:57.760600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"268'1","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.568603+0000","last_change":"2024-09-12T17:31:16.239173+0000","last_active":"2024-09-12T18:31:56.568603+0000","last_peered":"2024-09-12T18:31:56.568603+0000","last_clean":"2024-09-12T18:31:56.568603+0000","last_became_active":"2024-09-12T17:31:16.238356+0000","last_became_peered":"2024-09-12T17:31:16.238356+0000","last_unstale":"2024-09-12T18:31:56.568603+0000","last_undegraded":"2024-09-12T18:31:56.568603+0000","last_fullsized":"2024-09-12T18:31:56.568603+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:23.384787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'4","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.393847+0000","last_change":"2024-09-12T17:31:12.106100+0000","last_active":"2024-09-12T18:31:51.393847+0000","last_peered":"2024-09-12T18:31:51.393847+0000","last_clean":"2024-09-12T18:31:51.393847+0000","last_became_active":"2024-09-12T17:31:12.105300+0000","last_became_peered":"2024-09-12T17:31:12.105300+0000","last_unstale":"2024-09-12T18:31:51.393847+0000","last_undegraded":"2024-09-12T18:31:51.393847+0000","last_fullsized":"2024-09-12T18:31:51.393847+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:18.610444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'42","reported_seq":176,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:54.408584+0000","last_change":"2024-09-12T17:27:32.598060+0000","last_active":"2024-09-12T18:32:54.408584+0000","last_peered":"2024-09-12T18:32:54.408584+0000","last_clean":"2024-09-12T18:32:54.408584+0000","last_became_active":"2024-09-12T17:27:32.597518+0000","last_became_peered":"2024-09-12T17:27:32.597518+0000","last_unstale":"2024-09-12T18:32:54.408584+0000","last_undegraded":"2024-09-12T18:32:54.408584+0000","last_fullsized":"2024-09-12T18:32:54.408584+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:46.388068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":146,"num_write":82,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:31.795139+0000","last_change":"2024-09-12T17:53:27.140361+0000","last_active":"2024-09-12T18:32:31.795139+0000","last_peered":"2024-09-12T18:32:31.795139+0000","last_clean":"2024-09-12T18:32:31.795139+0000","last_became_active":"2024-09-12T17:53:27.139633+0000","last_became_peered":"2024-09-12T17:53:27.139633+0000","last_unstale":"2024-09-12T18:32:31.795139+0000","last_undegraded":"2024-09-12T18:32:31.795139+0000","last_fullsized":"2024-09-12T18:32:31.795139+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:33.101556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"265'4","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:04.395968+0000","last_change":"2024-09-12T17:31:16.233015+0000","last_active":"2024-09-12T18:32:04.395968+0000","last_peered":"2024-09-12T18:32:04.395968+0000","last_clean":"2024-09-12T18:32:04.395968+0000","last_became_active":"2024-09-12T17:31:16.229063+0000","last_became_peered":"2024-09-12T17:31:16.229063+0000","last_unstale":"2024-09-12T18:32:04.395968+0000","last_undegraded":"2024-09-12T18:32:04.395968+0000","last_fullsized":"2024-09-12T18:32:04.395968+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:10.227429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.388112+0000","last_change":"2024-09-12T17:31:12.094349+0000","last_active":"2024-09-12T18:31:56.388112+0000","last_peered":"2024-09-12T18:31:56.388112+0000","last_clean":"2024-09-12T18:31:56.388112+0000","last_became_active":"2024-09-12T17:31:12.093496+0000","last_became_peered":"2024-09-12T17:31:12.093496+0000","last_unstale":"2024-09-12T18:31:56.388112+0000","last_undegraded":"2024-09-12T18:31:56.388112+0000","last_fullsized":"2024-09-12T18:31:56.388112+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:37.609875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":4,"num_write_kb":1047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'15","reported_seq":104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.411590+0000","last_change":"2024-09-12T17:27:32.598394+0000","last_active":"2024-09-12T18:33:04.411590+0000","last_peered":"2024-09-12T18:33:04.411590+0000","last_clean":"2024-09-12T18:33:04.411590+0000","last_became_active":"2024-09-12T17:27:32.597694+0000","last_became_peered":"2024-09-12T17:27:32.597694+0000","last_unstale":"2024-09-12T18:33:04.411590+0000","last_undegraded":"2024-09-12T18:33:04.411590+0000","last_fullsized":"2024-09-12T18:33:04.411590+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:30.364314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.384432+0000","last_change":"2024-09-12T17:53:27.162772+0000","last_active":"2024-09-12T18:31:41.384432+0000","last_peered":"2024-09-12T18:31:41.384432+0000","last_clean":"2024-09-12T18:31:41.384432+0000","last_became_active":"2024-09-12T17:53:27.161396+0000","last_became_peered":"2024-09-12T17:53:27.161396+0000","last_unstale":"2024-09-12T18:31:41.384432+0000","last_undegraded":"2024-09-12T18:31:41.384432+0000","last_fullsized":"2024-09-12T18:31:41.384432+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:42.269208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'3","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428076+0000","last_change":"2024-09-12T17:31:16.239207+0000","last_active":"2024-09-12T18:34:19.428076+0000","last_peered":"2024-09-12T18:34:19.428076+0000","last_clean":"2024-09-12T18:34:19.428076+0000","last_became_active":"2024-09-12T17:31:16.238011+0000","last_became_peered":"2024-09-12T17:31:16.238011+0000","last_unstale":"2024-09-12T18:34:19.428076+0000","last_undegraded":"2024-09-12T18:34:19.428076+0000","last_fullsized":"2024-09-12T18:34:19.428076+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:16.439195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.785438+0000","last_change":"2024-09-12T17:31:12.094454+0000","last_active":"2024-09-12T18:31:56.785438+0000","last_peered":"2024-09-12T18:31:56.785438+0000","last_clean":"2024-09-12T18:31:56.785438+0000","last_became_active":"2024-09-12T17:31:12.093705+0000","last_became_peered":"2024-09-12T17:31:12.093705+0000","last_unstale":"2024-09-12T18:31:56.785438+0000","last_undegraded":"2024-09-12T18:31:56.785438+0000","last_fullsized":"2024-09-12T18:31:56.785438+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:41.345776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'6","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.408420+0000","last_change":"2024-09-12T17:27:32.580514+0000","last_active":"2024-09-12T18:32:51.408420+0000","last_peered":"2024-09-12T18:32:51.408420+0000","last_clean":"2024-09-12T18:32:51.408420+0000","last_became_active":"2024-09-12T17:27:32.579749+0000","last_became_peered":"2024-09-12T17:27:32.579749+0000","last_unstale":"2024-09-12T18:32:51.408420+0000","last_undegraded":"2024-09-12T18:32:51.408420+0000","last_fullsized":"2024-09-12T18:32:51.408420+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:28.676196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.575100+0000","last_change":"2024-09-12T17:53:27.145612+0000","last_active":"2024-09-12T18:32:26.575100+0000","last_peered":"2024-09-12T18:32:26.575100+0000","last_clean":"2024-09-12T18:32:26.575100+0000","last_became_active":"2024-09-12T17:53:27.142745+0000","last_became_peered":"2024-09-12T17:53:27.142745+0000","last_unstale":"2024-09-12T18:32:26.575100+0000","last_undegraded":"2024-09-12T18:32:26.575100+0000","last_fullsized":"2024-09-12T18:32:26.575100+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:38.589340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.632168+0000","last_change":"2024-09-12T17:31:16.242998+0000","last_active":"2024-09-12T18:32:16.632168+0000","last_peered":"2024-09-12T18:32:16.632168+0000","last_clean":"2024-09-12T18:32:16.632168+0000","last_became_active":"2024-09-12T17:31:16.242306+0000","last_became_peered":"2024-09-12T17:31:16.242306+0000","last_unstale":"2024-09-12T18:32:16.632168+0000","last_undegraded":"2024-09-12T18:32:16.632168+0000","last_fullsized":"2024-09-12T18:32:16.632168+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:38.335802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'5","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.400501+0000","last_change":"2024-09-12T17:31:12.078680+0000","last_active":"2024-09-12T18:31:56.400501+0000","last_peered":"2024-09-12T18:31:56.400501+0000","last_clean":"2024-09-12T18:31:56.400501+0000","last_became_active":"2024-09-12T17:31:12.077726+0000","last_became_peered":"2024-09-12T17:31:12.077726+0000","last_unstale":"2024-09-12T18:31:56.400501+0000","last_undegraded":"2024-09-12T18:31:56.400501+0000","last_fullsized":"2024-09-12T18:31:56.400501+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:51.018109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":11266,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.580495+0000","last_change":"2024-09-12T17:27:32.583911+0000","last_active":"2024-09-12T18:32:51.580495+0000","last_peered":"2024-09-12T18:32:51.580495+0000","last_clean":"2024-09-12T18:32:51.580495+0000","last_became_active":"2024-09-12T17:27:32.583062+0000","last_became_peered":"2024-09-12T17:27:32.583062+0000","last_unstale":"2024-09-12T18:32:51.580495+0000","last_undegraded":"2024-09-12T18:32:51.580495+0000","last_fullsized":"2024-09-12T18:32:51.580495+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:20.224440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.395058+0000","last_change":"2024-09-12T17:53:27.165755+0000","last_active":"2024-09-12T18:32:26.395058+0000","last_peered":"2024-09-12T18:32:26.395058+0000","last_clean":"2024-09-12T18:32:26.395058+0000","last_became_active":"2024-09-12T17:53:27.163419+0000","last_became_peered":"2024-09-12T17:53:27.163419+0000","last_unstale":"2024-09-12T18:32:26.395058+0000","last_undegraded":"2024-09-12T18:32:26.395058+0000","last_fullsized":"2024-09-12T18:32:26.395058+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:39.501106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:04.396028+0000","last_change":"2024-09-12T17:31:16.237342+0000","last_active":"2024-09-12T18:32:04.396028+0000","last_peered":"2024-09-12T18:32:04.396028+0000","last_clean":"2024-09-12T18:32:04.396028+0000","last_became_active":"2024-09-12T17:31:16.236619+0000","last_became_peered":"2024-09-12T17:31:16.236619+0000","last_unstale":"2024-09-12T18:32:04.396028+0000","last_undegraded":"2024-09-12T18:32:04.396028+0000","last_fullsized":"2024-09-12T18:32:04.396028+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:58.072849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"268'5","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.631014+0000","last_change":"2024-09-12T17:31:12.107461+0000","last_active":"2024-09-12T18:32:11.631014+0000","last_peered":"2024-09-12T18:32:11.631014+0000","last_clean":"2024-09-12T18:32:11.631014+0000","last_became_active":"2024-09-12T17:31:12.105793+0000","last_became_peered":"2024-09-12T17:31:12.105793+0000","last_unstale":"2024-09-12T18:32:11.631014+0000","last_undegraded":"2024-09-12T18:32:11.631014+0000","last_fullsized":"2024-09-12T18:32:11.631014+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:10.448109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'53","reported_seq":206,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.798887+0000","last_change":"2024-09-12T17:27:32.570407+0000","last_active":"2024-09-12T18:32:51.798887+0000","last_peered":"2024-09-12T18:32:51.798887+0000","last_clean":"2024-09-12T18:32:51.798887+0000","last_became_active":"2024-09-12T17:27:32.569594+0000","last_became_peered":"2024-09-12T17:27:32.569594+0000","last_unstale":"2024-09-12T18:32:51.798887+0000","last_undegraded":"2024-09-12T18:32:51.798887+0000","last_fullsized":"2024-09-12T18:32:51.798887+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:44.112049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":187,"num_write":95,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:44.391279+0000","last_change":"2024-09-12T17:53:27.166701+0000","last_active":"2024-09-12T18:31:44.391279+0000","last_peered":"2024-09-12T18:31:44.391279+0000","last_clean":"2024-09-12T18:31:44.391279+0000","last_became_active":"2024-09-12T17:53:27.165129+0000","last_became_peered":"2024-09-12T17:53:27.165129+0000","last_unstale":"2024-09-12T18:31:44.391279+0000","last_undegraded":"2024-09-12T18:31:44.391279+0000","last_fullsized":"2024-09-12T18:31:44.391279+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:59.004034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"268'2","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:05.607436+0000","last_change":"2024-09-12T17:31:16.240818+0000","last_active":"2024-09-12T18:34:05.607436+0000","last_peered":"2024-09-12T18:34:05.607436+0000","last_clean":"2024-09-12T18:34:05.607436+0000","last_became_active":"2024-09-12T17:31:16.240152+0000","last_became_peered":"2024-09-12T17:31:16.240152+0000","last_unstale":"2024-09-12T18:34:05.607436+0000","last_undegraded":"2024-09-12T18:34:05.607436+0000","last_fullsized":"2024-09-12T18:34:05.607436+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:20.290016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'3","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.399053+0000","last_change":"2024-09-12T17:31:12.098113+0000","last_active":"2024-09-12T18:31:51.399053+0000","last_peered":"2024-09-12T18:31:51.399053+0000","last_clean":"2024-09-12T18:31:51.399053+0000","last_became_active":"2024-09-12T17:31:12.089200+0000","last_became_peered":"2024-09-12T17:31:12.089200+0000","last_unstale":"2024-09-12T18:31:51.399053+0000","last_undegraded":"2024-09-12T18:31:51.399053+0000","last_fullsized":"2024-09-12T18:31:51.399053+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:44.577058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4244763,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8242,"num_write":8,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'48","reported_seq":193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411678+0000","last_change":"2024-09-12T17:27:32.570665+0000","last_active":"2024-09-12T18:32:51.411678+0000","last_peered":"2024-09-12T18:32:51.411678+0000","last_clean":"2024-09-12T18:32:51.411678+0000","last_became_active":"2024-09-12T17:27:32.568661+0000","last_became_peered":"2024-09-12T17:27:32.568661+0000","last_unstale":"2024-09-12T18:32:51.411678+0000","last_undegraded":"2024-09-12T18:32:51.411678+0000","last_fullsized":"2024-09-12T18:32:51.411678+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:42.609534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":169,"num_write":85,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.388216+0000","last_change":"2024-09-12T17:53:27.171856+0000","last_active":"2024-09-12T18:31:56.388216+0000","last_peered":"2024-09-12T18:31:56.388216+0000","last_clean":"2024-09-12T18:31:56.388216+0000","last_became_active":"2024-09-12T17:53:27.170493+0000","last_became_peered":"2024-09-12T17:53:27.170493+0000","last_unstale":"2024-09-12T18:31:56.388216+0000","last_undegraded":"2024-09-12T18:31:56.388216+0000","last_fullsized":"2024-09-12T18:31:56.388216+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:44.616138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'4","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.387933+0000","last_change":"2024-09-12T17:31:16.229295+0000","last_active":"2024-09-12T18:31:56.387933+0000","last_peered":"2024-09-12T18:31:56.387933+0000","last_clean":"2024-09-12T18:31:56.387933+0000","last_became_active":"2024-09-12T17:31:16.228566+0000","last_became_peered":"2024-09-12T17:31:16.228566+0000","last_unstale":"2024-09-12T18:31:56.387933+0000","last_undegraded":"2024-09-12T18:31:56.387933+0000","last_fullsized":"2024-09-12T18:31:56.387933+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:12.639985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8972971,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":5238,"num_write":9,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'2","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.625595+0000","last_change":"2024-09-12T17:31:12.106105+0000","last_active":"2024-09-12T18:31:51.625595+0000","last_peered":"2024-09-12T18:31:51.625595+0000","last_clean":"2024-09-12T18:31:51.625595+0000","last_became_active":"2024-09-12T17:31:12.105384+0000","last_became_peered":"2024-09-12T17:31:12.105384+0000","last_unstale":"2024-09-12T18:31:51.625595+0000","last_undegraded":"2024-09-12T18:31:51.625595+0000","last_fullsized":"2024-09-12T18:31:51.625595+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:47.101516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'110","reported_seq":479,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.402295+0000","last_change":"2024-09-12T17:27:32.587346+0000","last_active":"2024-09-12T18:32:56.402295+0000","last_peered":"2024-09-12T18:32:56.402295+0000","last_clean":"2024-09-12T18:32:56.402295+0000","last_became_active":"2024-09-12T17:27:32.586640+0000","last_became_peered":"2024-09-12T17:27:32.586640+0000","last_unstale":"2024-09-12T18:32:56.402295+0000","last_undegraded":"2024-09-12T18:32:56.402295+0000","last_fullsized":"2024-09-12T18:32:56.402295+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:13.010550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":815,"num_read_kb":525,"num_write":139,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.384492+0000","last_change":"2024-09-12T17:53:27.171182+0000","last_active":"2024-09-12T18:31:41.384492+0000","last_peered":"2024-09-12T18:31:41.384492+0000","last_clean":"2024-09-12T18:31:41.384492+0000","last_became_active":"2024-09-12T17:53:27.170381+0000","last_became_peered":"2024-09-12T17:53:27.170381+0000","last_unstale":"2024-09-12T18:31:41.384492+0000","last_undegraded":"2024-09-12T18:31:41.384492+0000","last_fullsized":"2024-09-12T18:31:41.384492+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:22.200905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'4","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:01.628355+0000","last_change":"2024-09-12T17:31:16.245927+0000","last_active":"2024-09-12T18:32:01.628355+0000","last_peered":"2024-09-12T18:32:01.628355+0000","last_clean":"2024-09-12T18:32:01.628355+0000","last_became_active":"2024-09-12T17:31:16.245228+0000","last_became_peered":"2024-09-12T17:31:16.245228+0000","last_unstale":"2024-09-12T18:32:01.628355+0000","last_undegraded":"2024-09-12T18:32:01.628355+0000","last_fullsized":"2024-09-12T18:32:01.628355+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:57.083185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2145571,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":9,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'1","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.402422+0000","last_change":"2024-09-12T17:31:12.091353+0000","last_active":"2024-09-12T18:32:06.402422+0000","last_peered":"2024-09-12T18:32:06.402422+0000","last_clean":"2024-09-12T18:32:06.402422+0000","last_became_active":"2024-09-12T17:31:12.089735+0000","last_became_peered":"2024-09-12T17:31:12.089735+0000","last_unstale":"2024-09-12T18:32:06.402422+0000","last_undegraded":"2024-09-12T18:32:06.402422+0000","last_fullsized":"2024-09-12T18:32:06.402422+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:58.780190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'45","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.402987+0000","last_change":"2024-09-12T17:27:32.576354+0000","last_active":"2024-09-12T18:32:34.402987+0000","last_peered":"2024-09-12T18:32:34.402987+0000","last_clean":"2024-09-12T18:32:34.402987+0000","last_became_active":"2024-09-12T17:27:32.575300+0000","last_became_peered":"2024-09-12T17:27:32.575300+0000","last_unstale":"2024-09-12T18:32:34.402987+0000","last_undegraded":"2024-09-12T18:32:34.402987+0000","last_fullsized":"2024-09-12T18:32:34.402987+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:55.469608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":157,"num_write":84,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.396512+0000","last_change":"2024-09-12T17:53:27.174556+0000","last_active":"2024-09-12T18:31:41.396512+0000","last_peered":"2024-09-12T18:31:41.396512+0000","last_clean":"2024-09-12T18:31:41.396512+0000","last_became_active":"2024-09-12T17:53:27.173955+0000","last_became_peered":"2024-09-12T17:53:27.173955+0000","last_unstale":"2024-09-12T18:31:41.396512+0000","last_undegraded":"2024-09-12T18:31:41.396512+0000","last_fullsized":"2024-09-12T18:31:41.396512+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:48.495953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.392719+0000","last_change":"2024-09-12T17:31:16.232804+0000","last_active":"2024-09-12T18:32:16.392719+0000","last_peered":"2024-09-12T18:32:16.392719+0000","last_clean":"2024-09-12T18:32:16.392719+0000","last_became_active":"2024-09-12T17:31:16.231516+0000","last_became_peered":"2024-09-12T17:31:16.231516+0000","last_unstale":"2024-09-12T18:32:16.392719+0000","last_undegraded":"2024-09-12T18:32:16.392719+0000","last_fullsized":"2024-09-12T18:32:16.392719+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:15.629748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:00.578348+0000","last_change":"2024-09-12T17:31:12.084858+0000","last_active":"2024-09-12T18:32:00.578348+0000","last_peered":"2024-09-12T18:32:00.578348+0000","last_clean":"2024-09-12T18:32:00.578348+0000","last_became_active":"2024-09-12T17:31:12.084158+0000","last_became_peered":"2024-09-12T17:31:12.084158+0000","last_unstale":"2024-09-12T18:32:00.578348+0000","last_undegraded":"2024-09-12T18:32:00.578348+0000","last_fullsized":"2024-09-12T18:32:00.578348+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:57.119863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'55","reported_seq":211,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.577105+0000","last_change":"2024-09-12T17:27:32.577701+0000","last_active":"2024-09-12T18:32:36.577105+0000","last_peered":"2024-09-12T18:32:36.577105+0000","last_clean":"2024-09-12T18:32:36.577105+0000","last_became_active":"2024-09-12T17:27:32.569924+0000","last_became_peered":"2024-09-12T17:27:32.569924+0000","last_unstale":"2024-09-12T18:32:36.577105+0000","last_undegraded":"2024-09-12T18:32:36.577105+0000","last_fullsized":"2024-09-12T18:32:36.577105+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:22.820241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":184,"num_write":101,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.403508+0000","last_change":"2024-09-12T17:53:27.163286+0000","last_active":"2024-09-12T18:33:01.403508+0000","last_peered":"2024-09-12T18:33:01.403508+0000","last_clean":"2024-09-12T18:33:01.403508+0000","last_became_active":"2024-09-12T17:53:27.162527+0000","last_became_peered":"2024-09-12T17:53:27.162527+0000","last_unstale":"2024-09-12T18:33:01.403508+0000","last_undegraded":"2024-09-12T18:33:01.403508+0000","last_fullsized":"2024-09-12T18:33:01.403508+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:27.017224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.400455+0000","last_change":"2024-09-12T17:31:16.245393+0000","last_active":"2024-09-12T18:31:56.400455+0000","last_peered":"2024-09-12T18:31:56.400455+0000","last_clean":"2024-09-12T18:31:56.400455+0000","last_became_active":"2024-09-12T17:31:16.244556+0000","last_became_peered":"2024-09-12T17:31:16.244556+0000","last_unstale":"2024-09-12T18:31:56.400455+0000","last_undegraded":"2024-09-12T18:31:56.400455+0000","last_fullsized":"2024-09-12T18:31:56.400455+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:52.690426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'7","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.413674+0000","last_change":"2024-09-12T17:31:12.081797+0000","last_active":"2024-09-12T18:33:41.413674+0000","last_peered":"2024-09-12T18:33:41.413674+0000","last_clean":"2024-09-12T18:33:41.413674+0000","last_became_active":"2024-09-12T17:31:12.081025+0000","last_became_peered":"2024-09-12T17:31:12.081025+0000","last_unstale":"2024-09-12T18:33:41.413674+0000","last_undegraded":"2024-09-12T18:33:41.413674+0000","last_fullsized":"2024-09-12T18:33:41.413674+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:23.240064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.408791+0000","last_change":"2024-09-12T17:27:32.562776+0000","last_active":"2024-09-12T18:32:36.408791+0000","last_peered":"2024-09-12T18:32:36.408791+0000","last_clean":"2024-09-12T18:32:36.408791+0000","last_became_active":"2024-09-12T17:27:32.561993+0000","last_became_peered":"2024-09-12T17:27:32.561993+0000","last_unstale":"2024-09-12T18:32:36.408791+0000","last_undegraded":"2024-09-12T18:32:36.408791+0000","last_fullsized":"2024-09-12T18:32:36.408791+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:55.063772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":121,"num_write":59,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.410789+0000","last_change":"2024-09-12T17:53:27.153890+0000","last_active":"2024-09-12T18:33:01.410789+0000","last_peered":"2024-09-12T18:33:01.410789+0000","last_clean":"2024-09-12T18:33:01.410789+0000","last_became_active":"2024-09-12T17:53:27.153125+0000","last_became_peered":"2024-09-12T17:53:27.153125+0000","last_unstale":"2024-09-12T18:33:01.410789+0000","last_undegraded":"2024-09-12T18:33:01.410789+0000","last_fullsized":"2024-09-12T18:33:01.410789+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:29.571163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'5","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.422511+0000","last_change":"2024-09-12T17:31:16.223351+0000","last_active":"2024-09-12T18:33:46.422511+0000","last_peered":"2024-09-12T18:33:46.422511+0000","last_clean":"2024-09-12T18:33:46.422511+0000","last_became_active":"2024-09-12T17:31:16.212330+0000","last_became_peered":"2024-09-12T17:31:16.212330+0000","last_unstale":"2024-09-12T18:33:46.422511+0000","last_undegraded":"2024-09-12T18:33:46.422511+0000","last_fullsized":"2024-09-12T18:33:46.422511+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:36.131170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":7170,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'2","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.810431+0000","last_change":"2024-09-12T17:31:12.094672+0000","last_active":"2024-09-12T18:33:51.810431+0000","last_peered":"2024-09-12T18:33:51.810431+0000","last_clean":"2024-09-12T18:33:51.810431+0000","last_became_active":"2024-09-12T17:31:12.093752+0000","last_became_peered":"2024-09-12T17:31:12.093752+0000","last_unstale":"2024-09-12T18:33:51.810431+0000","last_undegraded":"2024-09-12T18:33:51.810431+0000","last_fullsized":"2024-09-12T18:33:51.810431+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:44.826244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.577266+0000","last_change":"2024-09-12T17:27:32.583969+0000","last_active":"2024-09-12T18:32:36.577266+0000","last_peered":"2024-09-12T18:32:36.577266+0000","last_clean":"2024-09-12T18:32:36.577266+0000","last_became_active":"2024-09-12T17:27:32.583070+0000","last_became_peered":"2024-09-12T17:27:32.583070+0000","last_unstale":"2024-09-12T18:32:36.577266+0000","last_undegraded":"2024-09-12T18:32:36.577266+0000","last_fullsized":"2024-09-12T18:32:36.577266+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:54.241847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.649994+0000","last_change":"2024-09-12T17:53:27.155092+0000","last_active":"2024-09-12T18:33:36.649994+0000","last_peered":"2024-09-12T18:33:36.649994+0000","last_clean":"2024-09-12T18:33:36.649994+0000","last_became_active":"2024-09-12T17:53:27.154309+0000","last_became_peered":"2024-09-12T17:53:27.154309+0000","last_unstale":"2024-09-12T18:33:36.649994+0000","last_undegraded":"2024-09-12T18:33:36.649994+0000","last_fullsized":"2024-09-12T18:33:36.649994+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:16.746183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'7","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.388237+0000","last_change":"2024-09-12T17:31:16.231548+0000","last_active":"2024-09-12T18:31:56.388237+0000","last_peered":"2024-09-12T18:31:56.388237+0000","last_clean":"2024-09-12T18:31:56.388237+0000","last_became_active":"2024-09-12T17:31:16.230809+0000","last_became_peered":"2024-09-12T17:31:16.230809+0000","last_unstale":"2024-09-12T18:31:56.388237+0000","last_undegraded":"2024-09-12T18:31:56.388237+0000","last_fullsized":"2024-09-12T18:31:56.388237+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:50.950013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":16386,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"265'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.394003+0000","last_change":"2024-09-12T17:31:12.084859+0000","last_active":"2024-09-12T18:31:51.394003+0000","last_peered":"2024-09-12T18:31:51.394003+0000","last_clean":"2024-09-12T18:31:51.394003+0000","last_became_active":"2024-09-12T17:31:12.084101+0000","last_became_peered":"2024-09-12T17:31:12.084101+0000","last_unstale":"2024-09-12T18:31:51.394003+0000","last_undegraded":"2024-09-12T18:31:51.394003+0000","last_fullsized":"2024-09-12T18:31:51.394003+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:18.901928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'37","reported_seq":163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:31.396318+0000","last_change":"2024-09-12T17:27:32.582926+0000","last_active":"2024-09-12T18:32:31.396318+0000","last_peered":"2024-09-12T18:32:31.396318+0000","last_clean":"2024-09-12T18:32:31.396318+0000","last_became_active":"2024-09-12T17:27:32.582183+0000","last_became_peered":"2024-09-12T17:27:32.582183+0000","last_unstale":"2024-09-12T18:32:31.396318+0000","last_undegraded":"2024-09-12T18:32:31.396318+0000","last_fullsized":"2024-09-12T18:32:31.396318+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:44.094594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":125,"num_write":74,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.593556+0000","last_change":"2024-09-12T17:53:27.160005+0000","last_active":"2024-09-12T18:33:05.593556+0000","last_peered":"2024-09-12T18:33:05.593556+0000","last_clean":"2024-09-12T18:33:05.593556+0000","last_became_active":"2024-09-12T17:53:27.159240+0000","last_became_peered":"2024-09-12T17:53:27.159240+0000","last_unstale":"2024-09-12T18:33:05.593556+0000","last_undegraded":"2024-09-12T18:33:05.593556+0000","last_fullsized":"2024-09-12T18:33:05.593556+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:37.529736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'3","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:55.577221+0000","last_change":"2024-09-12T17:31:16.226574+0000","last_active":"2024-09-12T18:31:55.577221+0000","last_peered":"2024-09-12T18:31:55.577221+0000","last_clean":"2024-09-12T18:31:55.577221+0000","last_became_active":"2024-09-12T17:31:16.225754+0000","last_became_peered":"2024-09-12T17:31:16.225754+0000","last_unstale":"2024-09-12T18:31:55.577221+0000","last_undegraded":"2024-09-12T18:31:55.577221+0000","last_fullsized":"2024-09-12T18:31:55.577221+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:30.610378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.386970+0000","last_change":"2024-09-12T17:31:12.088188+0000","last_active":"2024-09-12T18:31:51.386970+0000","last_peered":"2024-09-12T18:31:51.386970+0000","last_clean":"2024-09-12T18:31:51.386970+0000","last_became_active":"2024-09-12T17:31:12.087356+0000","last_became_peered":"2024-09-12T17:31:12.087356+0000","last_unstale":"2024-09-12T18:31:51.386970+0000","last_undegraded":"2024-09-12T18:31:51.386970+0000","last_fullsized":"2024-09-12T18:31:51.386970+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:57.783040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'23","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.630906+0000","last_change":"2024-09-12T17:27:32.584476+0000","last_active":"2024-09-12T18:32:11.630906+0000","last_peered":"2024-09-12T18:32:11.630906+0000","last_clean":"2024-09-12T18:32:11.630906+0000","last_became_active":"2024-09-12T17:27:32.583631+0000","last_became_peered":"2024-09-12T17:27:32.583631+0000","last_unstale":"2024-09-12T18:32:11.630906+0000","last_undegraded":"2024-09-12T18:32:11.630906+0000","last_fullsized":"2024-09-12T18:32:11.630906+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:24.021549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":83,"num_write":39,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'1","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.790817+0000","last_change":"2024-09-12T17:53:27.156217+0000","last_active":"2024-09-12T18:32:26.790817+0000","last_peered":"2024-09-12T18:32:26.790817+0000","last_clean":"2024-09-12T18:32:26.790817+0000","last_became_active":"2024-09-12T17:53:27.152651+0000","last_became_peered":"2024-09-12T17:53:27.152651+0000","last_unstale":"2024-09-12T18:32:26.790817+0000","last_undegraded":"2024-09-12T18:32:26.790817+0000","last_fullsized":"2024-09-12T18:32:26.790817+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:24.443187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'7","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.652324+0000","last_change":"2024-09-12T17:31:16.243687+0000","last_active":"2024-09-12T18:33:46.652324+0000","last_peered":"2024-09-12T18:33:46.652324+0000","last_clean":"2024-09-12T18:33:46.652324+0000","last_became_active":"2024-09-12T17:31:16.242981+0000","last_became_peered":"2024-09-12T17:31:16.242981+0000","last_unstale":"2024-09-12T18:33:46.652324+0000","last_undegraded":"2024-09-12T18:33:46.652324+0000","last_fullsized":"2024-09-12T18:33:46.652324+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:07.505703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":15362,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.411117+0000","last_change":"2024-09-12T17:31:12.097913+0000","last_active":"2024-09-12T18:33:31.411117+0000","last_peered":"2024-09-12T18:33:31.411117+0000","last_clean":"2024-09-12T18:33:31.411117+0000","last_became_active":"2024-09-12T17:31:12.097216+0000","last_became_peered":"2024-09-12T17:31:12.097216+0000","last_unstale":"2024-09-12T18:33:31.411117+0000","last_undegraded":"2024-09-12T18:33:31.411117+0000","last_fullsized":"2024-09-12T18:33:31.411117+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:29.988488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'30","reported_seq":143,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.399472+0000","last_change":"2024-09-12T17:27:32.572524+0000","last_active":"2024-09-12T18:32:11.399472+0000","last_peered":"2024-09-12T18:32:11.399472+0000","last_clean":"2024-09-12T18:32:11.399472+0000","last_became_active":"2024-09-12T17:27:32.571830+0000","last_became_peered":"2024-09-12T17:27:32.571830+0000","last_unstale":"2024-09-12T18:32:11.399472+0000","last_undegraded":"2024-09-12T18:32:11.399472+0000","last_fullsized":"2024-09-12T18:32:11.399472+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:50.997968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":95,"num_write":63,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.406561+0000","last_change":"2024-09-12T17:53:27.163946+0000","last_active":"2024-09-12T18:32:26.406561+0000","last_peered":"2024-09-12T18:32:26.406561+0000","last_clean":"2024-09-12T18:32:26.406561+0000","last_became_active":"2024-09-12T17:53:27.163113+0000","last_became_peered":"2024-09-12T17:53:27.163113+0000","last_unstale":"2024-09-12T18:32:26.406561+0000","last_undegraded":"2024-09-12T18:32:26.406561+0000","last_fullsized":"2024-09-12T18:32:26.406561+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:01.071160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.418774+0000","last_change":"2024-09-12T17:31:16.234271+0000","last_active":"2024-09-12T18:33:36.418774+0000","last_peered":"2024-09-12T18:33:36.418774+0000","last_clean":"2024-09-12T18:33:36.418774+0000","last_became_active":"2024-09-12T17:31:16.233558+0000","last_became_peered":"2024-09-12T17:31:16.233558+0000","last_unstale":"2024-09-12T18:33:36.418774+0000","last_undegraded":"2024-09-12T18:33:36.418774+0000","last_fullsized":"2024-09-12T18:33:36.418774+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:03.391887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'6","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.413526+0000","last_change":"2024-09-12T17:31:12.094815+0000","last_active":"2024-09-12T18:33:41.413526+0000","last_peered":"2024-09-12T18:33:41.413526+0000","last_clean":"2024-09-12T18:33:41.413526+0000","last_became_active":"2024-09-12T17:31:12.094159+0000","last_became_peered":"2024-09-12T17:31:12.094159+0000","last_unstale":"2024-09-12T18:33:41.413526+0000","last_undegraded":"2024-09-12T18:33:41.413526+0000","last_fullsized":"2024-09-12T18:33:41.413526+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:09.522281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'20","reported_seq":124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:10.580606+0000","last_change":"2024-09-12T17:27:32.596142+0000","last_active":"2024-09-12T18:32:10.580606+0000","last_peered":"2024-09-12T18:32:10.580606+0000","last_clean":"2024-09-12T18:32:10.580606+0000","last_became_active":"2024-09-12T17:27:32.595524+0000","last_became_peered":"2024-09-12T17:27:32.595524+0000","last_unstale":"2024-09-12T18:32:10.580606+0000","last_undegraded":"2024-09-12T18:32:10.580606+0000","last_fullsized":"2024-09-12T18:32:10.580606+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:10.999486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":74,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.413732+0000","last_change":"2024-09-12T17:53:27.175841+0000","last_active":"2024-09-12T18:33:01.413732+0000","last_peered":"2024-09-12T18:33:01.413732+0000","last_clean":"2024-09-12T18:33:01.413732+0000","last_became_active":"2024-09-12T17:53:27.175125+0000","last_became_peered":"2024-09-12T17:53:27.175125+0000","last_unstale":"2024-09-12T18:33:01.413732+0000","last_undegraded":"2024-09-12T18:33:01.413732+0000","last_fullsized":"2024-09-12T18:33:01.413732+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:18.938638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'4","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.591667+0000","last_change":"2024-09-12T17:31:16.212462+0000","last_active":"2024-09-12T18:33:46.591667+0000","last_peered":"2024-09-12T18:33:46.591667+0000","last_clean":"2024-09-12T18:33:46.591667+0000","last_became_active":"2024-09-12T17:31:16.211664+0000","last_became_peered":"2024-09-12T17:31:16.211664+0000","last_unstale":"2024-09-12T18:33:46.591667+0000","last_undegraded":"2024-09-12T18:33:46.591667+0000","last_fullsized":"2024-09-12T18:33:46.591667+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:00.841100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1069,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'2","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.651197+0000","last_change":"2024-09-12T17:31:12.101932+0000","last_active":"2024-09-12T18:33:41.651197+0000","last_peered":"2024-09-12T18:33:41.651197+0000","last_clean":"2024-09-12T18:33:41.651197+0000","last_became_active":"2024-09-12T17:31:12.099608+0000","last_became_peered":"2024-09-12T17:31:12.099608+0000","last_unstale":"2024-09-12T18:33:41.651197+0000","last_undegraded":"2024-09-12T18:33:41.651197+0000","last_fullsized":"2024-09-12T18:33:41.651197+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:36.462019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'56","reported_seq":218,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.571812+0000","last_change":"2024-09-12T17:27:32.569526+0000","last_active":"2024-09-12T18:32:11.571812+0000","last_peered":"2024-09-12T18:32:11.571812+0000","last_clean":"2024-09-12T18:32:11.571812+0000","last_became_active":"2024-09-12T17:27:32.568785+0000","last_became_peered":"2024-09-12T17:27:32.568785+0000","last_unstale":"2024-09-12T18:32:11.571812+0000","last_undegraded":"2024-09-12T18:32:11.571812+0000","last_fullsized":"2024-09-12T18:32:11.571812+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:14.598346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":196,"num_write":113,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.407392+0000","last_change":"2024-09-12T17:53:27.175493+0000","last_active":"2024-09-12T18:33:16.407392+0000","last_peered":"2024-09-12T18:33:16.407392+0000","last_clean":"2024-09-12T18:33:16.407392+0000","last_became_active":"2024-09-12T17:53:27.175073+0000","last_became_peered":"2024-09-12T17:53:27.175073+0000","last_unstale":"2024-09-12T18:33:16.407392+0000","last_undegraded":"2024-09-12T18:33:16.407392+0000","last_fullsized":"2024-09-12T18:33:16.407392+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:43.723718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.602853+0000","last_change":"2024-09-12T17:31:16.229188+0000","last_active":"2024-09-12T18:33:45.602853+0000","last_peered":"2024-09-12T18:33:45.602853+0000","last_clean":"2024-09-12T18:33:45.602853+0000","last_became_active":"2024-09-12T17:31:16.228416+0000","last_became_peered":"2024-09-12T17:31:16.228416+0000","last_unstale":"2024-09-12T18:33:45.602853+0000","last_undegraded":"2024-09-12T18:33:45.602853+0000","last_fullsized":"2024-09-12T18:33:45.602853+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:54.390718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.590617+0000","last_change":"2024-09-12T17:31:12.089066+0000","last_active":"2024-09-12T18:33:41.590617+0000","last_peered":"2024-09-12T18:33:41.590617+0000","last_clean":"2024-09-12T18:33:41.590617+0000","last_became_active":"2024-09-12T17:31:12.088297+0000","last_became_peered":"2024-09-12T17:31:12.088297+0000","last_unstale":"2024-09-12T18:33:41.590617+0000","last_undegraded":"2024-09-12T18:33:41.590617+0000","last_fullsized":"2024-09-12T18:33:41.590617+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:37.483806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'16","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.417452+0000","last_change":"2024-09-12T17:27:32.585156+0000","last_active":"2024-09-12T18:33:56.417452+0000","last_peered":"2024-09-12T18:33:56.417452+0000","last_clean":"2024-09-12T18:33:56.417452+0000","last_became_active":"2024-09-12T17:27:32.584404+0000","last_became_peered":"2024-09-12T17:27:32.584404+0000","last_unstale":"2024-09-12T18:33:56.417452+0000","last_undegraded":"2024-09-12T18:33:56.417452+0000","last_fullsized":"2024-09-12T18:33:56.417452+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:00.210204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":55,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'254","reported_seq":900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.416405+0000","last_change":"2024-09-12T17:10:30.407868+0000","last_active":"2024-09-12T18:33:51.416405+0000","last_peered":"2024-09-12T18:33:51.416405+0000","last_clean":"2024-09-12T18:33:51.416405+0000","last_became_active":"2024-09-12T17:10:30.407181+0000","last_became_peered":"2024-09-12T17:10:30.407181+0000","last_unstale":"2024-09-12T18:33:51.416405+0000","last_undegraded":"2024-09-12T18:33:51.416405+0000","last_fullsized":"2024-09-12T18:33:51.416405+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:59.494627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10955125,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":417,"num_read_kb":10653,"num_write":856,"num_write_kb":47496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'781","reported_seq":2314,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.923295+0000","last_change":"2024-09-12T17:10:32.347708+0000","last_active":"2024-09-12T18:33:59.923295+0000","last_peered":"2024-09-12T18:33:59.923295+0000","last_clean":"2024-09-12T18:33:59.923295+0000","last_became_active":"2024-09-12T17:10:32.346911+0000","last_became_peered":"2024-09-12T17:10:32.346911+0000","last_unstale":"2024-09-12T18:33:59.923295+0000","last_undegraded":"2024-09-12T18:33:59.923295+0000","last_fullsized":"2024-09-12T18:33:59.923295+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:26.413533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3659,"num_read_kb":3307,"num_write":1011,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'320","reported_seq":1035,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.653638+0000","last_change":"2024-09-12T17:10:30.405881+0000","last_active":"2024-09-12T18:33:51.653638+0000","last_peered":"2024-09-12T18:33:51.653638+0000","last_clean":"2024-09-12T18:33:51.653638+0000","last_became_active":"2024-09-12T17:10:30.405515+0000","last_became_peered":"2024-09-12T17:10:30.405515+0000","last_unstale":"2024-09-12T18:33:51.653638+0000","last_undegraded":"2024-09-12T18:33:51.653638+0000","last_fullsized":"2024-09-12T18:33:51.653638+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:23.617786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4864546,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":602,"num_read_kb":13611,"num_write":1157,"num_write_kb":42248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'453","reported_seq":1933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.627333+0000","last_change":"2024-09-12T17:10:32.376635+0000","last_active":"2024-09-12T18:33:18.627333+0000","last_peered":"2024-09-12T18:33:18.627333+0000","last_clean":"2024-09-12T18:33:18.627333+0000","last_became_active":"2024-09-12T17:10:32.375908+0000","last_became_peered":"2024-09-12T17:10:32.375908+0000","last_unstale":"2024-09-12T18:33:18.627333+0000","last_undegraded":"2024-09-12T18:33:18.627333+0000","last_fullsized":"2024-09-12T18:33:18.627333+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:27.899807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2460,"num_read_kb":2294,"num_write":575,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'290","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.423591+0000","last_change":"2024-09-12T17:10:30.351588+0000","last_active":"2024-09-12T18:33:51.423591+0000","last_peered":"2024-09-12T18:33:51.423591+0000","last_clean":"2024-09-12T18:33:51.423591+0000","last_became_active":"2024-09-12T17:10:30.351202+0000","last_became_peered":"2024-09-12T17:10:30.351202+0000","last_unstale":"2024-09-12T18:33:51.423591+0000","last_undegraded":"2024-09-12T18:33:51.423591+0000","last_fullsized":"2024-09-12T18:33:51.423591+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:24.152184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29388745,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":395,"num_read_kb":96757,"num_write":967,"num_write_kb":52334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'557","reported_seq":2193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.626934+0000","last_change":"2024-09-12T17:10:32.371846+0000","last_active":"2024-09-12T18:33:18.626934+0000","last_peered":"2024-09-12T18:33:18.626934+0000","last_clean":"2024-09-12T18:33:18.626934+0000","last_became_active":"2024-09-12T17:10:32.370962+0000","last_became_peered":"2024-09-12T17:10:32.370962+0000","last_unstale":"2024-09-12T18:33:18.626934+0000","last_undegraded":"2024-09-12T18:33:18.626934+0000","last_fullsized":"2024-09-12T18:33:18.626934+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:19.779809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2855,"num_read_kb":2656,"num_write":715,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'343","reported_seq":1069,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.409580+0000","last_change":"2024-09-12T17:10:30.376632+0000","last_active":"2024-09-12T18:32:56.409580+0000","last_peered":"2024-09-12T18:32:56.409580+0000","last_clean":"2024-09-12T18:32:56.409580+0000","last_became_active":"2024-09-12T17:10:30.374789+0000","last_became_peered":"2024-09-12T17:10:30.374789+0000","last_unstale":"2024-09-12T18:32:56.409580+0000","last_undegraded":"2024-09-12T18:32:56.409580+0000","last_fullsized":"2024-09-12T18:32:56.409580+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:10.377494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12234279,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":722,"num_read_kb":12010,"num_write":1197,"num_write_kb":48882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'284","reported_seq":1673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.928533+0000","last_change":"2024-09-12T17:10:32.357514+0000","last_active":"2024-09-12T18:33:59.928533+0000","last_peered":"2024-09-12T18:33:59.928533+0000","last_clean":"2024-09-12T18:33:59.928533+0000","last_became_active":"2024-09-12T17:10:32.357199+0000","last_became_peered":"2024-09-12T17:10:32.357199+0000","last_unstale":"2024-09-12T18:33:59.928533+0000","last_undegraded":"2024-09-12T18:33:59.928533+0000","last_fullsized":"2024-09-12T18:33:59.928533+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:17.757987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1623,"num_read_kb":1593,"num_write":300,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'244","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.930068+0000","last_change":"2024-09-12T17:10:30.387768+0000","last_active":"2024-09-12T18:33:18.930068+0000","last_peered":"2024-09-12T18:33:18.930068+0000","last_clean":"2024-09-12T18:33:18.930068+0000","last_became_active":"2024-09-12T17:10:30.385216+0000","last_became_peered":"2024-09-12T17:10:30.385216+0000","last_unstale":"2024-09-12T18:33:18.930068+0000","last_undegraded":"2024-09-12T18:33:18.930068+0000","last_fullsized":"2024-09-12T18:33:18.930068+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:48.266095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3574308,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":334,"num_read_kb":5414,"num_write":859,"num_write_kb":15383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'549","reported_seq":2122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.927415+0000","last_change":"2024-09-12T17:10:32.352752+0000","last_active":"2024-09-12T18:33:59.927415+0000","last_peered":"2024-09-12T18:33:59.927415+0000","last_clean":"2024-09-12T18:33:59.927415+0000","last_became_active":"2024-09-12T17:10:32.351972+0000","last_became_peered":"2024-09-12T17:10:32.351972+0000","last_unstale":"2024-09-12T18:33:59.927415+0000","last_undegraded":"2024-09-12T18:33:59.927415+0000","last_fullsized":"2024-09-12T18:33:59.927415+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:26.765589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2788,"num_read_kb":2550,"num_write":700,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'292","reported_seq":944,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.410729+0000","last_change":"2024-09-12T17:10:30.362938+0000","last_active":"2024-09-12T18:33:01.410729+0000","last_peered":"2024-09-12T18:33:01.410729+0000","last_clean":"2024-09-12T18:33:01.410729+0000","last_became_active":"2024-09-12T17:10:30.350813+0000","last_became_peered":"2024-09-12T17:10:30.350813+0000","last_unstale":"2024-09-12T18:33:01.410729+0000","last_undegraded":"2024-09-12T18:33:01.410729+0000","last_fullsized":"2024-09-12T18:33:01.410729+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:45.963449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53593,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":459,"num_read_kb":3741,"num_write":1035,"num_write_kb":26406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'434","reported_seq":2148,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605409+0000","last_change":"2024-09-12T17:10:32.363876+0000","last_active":"2024-09-12T18:33:55.605409+0000","last_peered":"2024-09-12T18:33:55.605409+0000","last_clean":"2024-09-12T18:33:55.605409+0000","last_became_active":"2024-09-12T17:10:32.362980+0000","last_became_peered":"2024-09-12T17:10:32.362980+0000","last_unstale":"2024-09-12T18:33:55.605409+0000","last_undegraded":"2024-09-12T18:33:55.605409+0000","last_fullsized":"2024-09-12T18:33:55.605409+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:44.556208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2502,"num_read_kb":2403,"num_write":488,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'292","reported_seq":1189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.403424+0000","last_change":"2024-09-12T17:11:04.871628+0000","last_active":"2024-09-12T18:33:01.403424+0000","last_peered":"2024-09-12T18:33:01.403424+0000","last_clean":"2024-09-12T18:33:01.403424+0000","last_became_active":"2024-09-12T17:11:04.870569+0000","last_became_peered":"2024-09-12T17:11:04.870569+0000","last_unstale":"2024-09-12T18:33:01.403424+0000","last_undegraded":"2024-09-12T18:33:01.403424+0000","last_fullsized":"2024-09-12T18:33:01.403424+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:14.018442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17004998,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":925,"num_read_kb":89435,"num_write":1144,"num_write_kb":38550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'426","reported_seq":1940,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:38.177955+0000","last_change":"2024-09-12T17:10:32.369695+0000","last_active":"2024-09-12T18:32:38.177955+0000","last_peered":"2024-09-12T18:32:38.177955+0000","last_clean":"2024-09-12T18:32:38.177955+0000","last_became_active":"2024-09-12T17:10:32.368909+0000","last_became_peered":"2024-09-12T17:10:32.368909+0000","last_unstale":"2024-09-12T18:32:38.177955+0000","last_undegraded":"2024-09-12T18:32:38.177955+0000","last_fullsized":"2024-09-12T18:32:38.177955+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:18.380922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2227,"num_read_kb":2101,"num_write":505,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'326","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.207633+0000","last_change":"2024-09-12T17:10:30.395510+0000","last_active":"2024-09-12T18:35:59.207633+0000","last_peered":"2024-09-12T18:35:59.207633+0000","last_clean":"2024-09-12T18:35:59.207633+0000","last_became_active":"2024-09-12T17:10:30.395061+0000","last_became_peered":"2024-09-12T17:10:30.395061+0000","last_unstale":"2024-09-12T18:35:59.207633+0000","last_undegraded":"2024-09-12T18:35:59.207633+0000","last_fullsized":"2024-09-12T18:35:59.207633+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:41.200923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14709348,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":585,"num_read_kb":20147,"num_write":1087,"num_write_kb":23715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'421","reported_seq":1782,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.461932+0000","last_change":"2024-09-12T17:11:05.125681+0000","last_active":"2024-09-12T18:33:28.461932+0000","last_peered":"2024-09-12T18:33:28.461932+0000","last_clean":"2024-09-12T18:33:28.461932+0000","last_became_active":"2024-09-12T17:11:05.124718+0000","last_became_peered":"2024-09-12T17:11:05.124718+0000","last_unstale":"2024-09-12T18:33:28.461932+0000","last_undegraded":"2024-09-12T18:33:28.461932+0000","last_fullsized":"2024-09-12T18:33:28.461932+0000","mapping_epoch":38,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:17.850798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2066,"num_read_kb":1911,"num_write":507,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'652","reported_seq":2390,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.928419+0000","last_change":"2024-09-12T17:10:32.363944+0000","last_active":"2024-09-12T18:33:59.928419+0000","last_peered":"2024-09-12T18:33:59.928419+0000","last_clean":"2024-09-12T18:33:59.928419+0000","last_became_active":"2024-09-12T17:10:32.363179+0000","last_became_peered":"2024-09-12T17:10:32.363179+0000","last_unstale":"2024-09-12T18:33:59.928419+0000","last_undegraded":"2024-09-12T18:33:59.928419+0000","last_fullsized":"2024-09-12T18:33:59.928419+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":600,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:03.623272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3427,"num_read_kb":3148,"num_write":833,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'266","reported_seq":952,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.920243+0000","last_change":"2024-09-12T17:10:30.387578+0000","last_active":"2024-09-12T18:33:38.920243+0000","last_peered":"2024-09-12T18:33:38.920243+0000","last_clean":"2024-09-12T18:33:38.920243+0000","last_became_active":"2024-09-12T17:10:30.385785+0000","last_became_peered":"2024-09-12T17:10:30.385785+0000","last_unstale":"2024-09-12T18:33:38.920243+0000","last_undegraded":"2024-09-12T18:33:38.920243+0000","last_fullsized":"2024-09-12T18:33:38.920243+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:57.879527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17126668,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":476,"num_read_kb":51058,"num_write":980,"num_write_kb":34693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'508","reported_seq":2186,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.815743+0000","last_change":"2024-09-12T17:10:32.380268+0000","last_active":"2024-09-12T18:34:01.815743+0000","last_peered":"2024-09-12T18:34:01.815743+0000","last_clean":"2024-09-12T18:34:01.815743+0000","last_became_active":"2024-09-12T17:10:32.379669+0000","last_became_peered":"2024-09-12T17:10:32.379669+0000","last_unstale":"2024-09-12T18:34:01.815743+0000","last_undegraded":"2024-09-12T18:34:01.815743+0000","last_fullsized":"2024-09-12T18:34:01.815743+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:43.664634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2752,"num_read_kb":2572,"num_write":584,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'280","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:12.992823+0000","last_change":"2024-09-12T17:12:05.835283+0000","last_active":"2024-09-12T18:35:12.992823+0000","last_peered":"2024-09-12T18:35:12.992823+0000","last_clean":"2024-09-12T18:35:12.992823+0000","last_became_active":"2024-09-12T17:12:05.834873+0000","last_became_peered":"2024-09-12T17:12:05.834873+0000","last_unstale":"2024-09-12T18:35:12.992823+0000","last_undegraded":"2024-09-12T18:35:12.992823+0000","last_fullsized":"2024-09-12T18:35:12.992823+0000","mapping_epoch":40,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:29.427065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24402696,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":491,"num_read_kb":40640,"num_write":1055,"num_write_kb":40250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"268'1939","reported_seq":3530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.814002+0000","last_change":"2024-09-12T17:10:32.359245+0000","last_active":"2024-09-12T18:34:01.814002+0000","last_peered":"2024-09-12T18:34:01.814002+0000","last_clean":"2024-09-12T18:34:01.814002+0000","last_became_active":"2024-09-12T17:10:32.358342+0000","last_became_peered":"2024-09-12T17:10:32.358342+0000","last_unstale":"2024-09-12T18:34:01.814002+0000","last_undegraded":"2024-09-12T18:34:01.814002+0000","last_fullsized":"2024-09-12T18:34:01.814002+0000","mapping_epoch":27,"log_start":"268'1900","ondisk_log_start":"268'1900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1900,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:01.927050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8411,"num_read_kb":7313,"num_write":2747,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'313","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.578322+0000","last_change":"2024-09-12T17:10:30.401167+0000","last_active":"2024-09-12T18:32:41.578322+0000","last_peered":"2024-09-12T18:32:41.578322+0000","last_clean":"2024-09-12T18:32:41.578322+0000","last_became_active":"2024-09-12T17:10:30.395938+0000","last_became_peered":"2024-09-12T17:10:30.395938+0000","last_unstale":"2024-09-12T18:32:41.578322+0000","last_undegraded":"2024-09-12T18:32:41.578322+0000","last_fullsized":"2024-09-12T18:32:41.578322+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:51.897394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13685157,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":457,"num_read_kb":40772,"num_write":1141,"num_write_kb":34948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'778","reported_seq":2224,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.797878+0000","last_change":"2024-09-12T17:10:32.354888+0000","last_active":"2024-09-12T18:32:46.797878+0000","last_peered":"2024-09-12T18:32:46.797878+0000","last_clean":"2024-09-12T18:32:46.797878+0000","last_became_active":"2024-09-12T17:10:32.354271+0000","last_became_peered":"2024-09-12T17:10:32.354271+0000","last_unstale":"2024-09-12T18:32:46.797878+0000","last_undegraded":"2024-09-12T18:32:46.797878+0000","last_fullsized":"2024-09-12T18:32:46.797878+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:40.309416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3730,"num_read_kb":3333,"num_write":1060,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'497","reported_seq":1246,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.568314+0000","last_change":"2024-09-12T17:10:30.396067+0000","last_active":"2024-09-12T18:36:00.568314+0000","last_peered":"2024-09-12T18:36:00.568314+0000","last_clean":"2024-09-12T18:36:00.568314+0000","last_became_active":"2024-09-12T17:10:30.394905+0000","last_became_peered":"2024-09-12T17:10:30.394905+0000","last_unstale":"2024-09-12T18:36:00.568314+0000","last_undegraded":"2024-09-12T18:36:00.568314+0000","last_fullsized":"2024-09-12T18:36:00.568314+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:58.605567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21306835,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":911,"num_read_kb":40764,"num_write":1540,"num_write_kb":41950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'786","reported_seq":2379,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.627433+0000","last_change":"2024-09-12T17:10:32.372409+0000","last_active":"2024-09-12T18:33:18.627433+0000","last_peered":"2024-09-12T18:33:18.627433+0000","last_clean":"2024-09-12T18:33:18.627433+0000","last_became_active":"2024-09-12T17:10:32.372137+0000","last_became_peered":"2024-09-12T17:10:32.372137+0000","last_unstale":"2024-09-12T18:33:18.627433+0000","last_undegraded":"2024-09-12T18:33:18.627433+0000","last_fullsized":"2024-09-12T18:33:18.627433+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:07.405740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3748,"num_read_kb":3393,"num_write":1031,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'276","reported_seq":910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.313257+0000","last_change":"2024-09-12T17:10:30.394449+0000","last_active":"2024-09-12T18:35:59.313257+0000","last_peered":"2024-09-12T18:35:59.313257+0000","last_clean":"2024-09-12T18:35:59.313257+0000","last_became_active":"2024-09-12T17:10:30.394096+0000","last_became_peered":"2024-09-12T17:10:30.394096+0000","last_unstale":"2024-09-12T18:35:59.313257+0000","last_undegraded":"2024-09-12T18:35:59.313257+0000","last_fullsized":"2024-09-12T18:35:59.313257+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:17.229735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9140561,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":377,"num_read_kb":10348,"num_write":972,"num_write_kb":23725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'862","reported_seq":2531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:45.588918+0000","last_change":"2024-09-12T17:10:32.361908+0000","last_active":"2024-09-12T18:32:45.588918+0000","last_peered":"2024-09-12T18:32:45.588918+0000","last_clean":"2024-09-12T18:32:45.588918+0000","last_became_active":"2024-09-12T17:10:32.361126+0000","last_became_peered":"2024-09-12T17:10:32.361126+0000","last_unstale":"2024-09-12T18:32:45.588918+0000","last_undegraded":"2024-09-12T18:32:45.588918+0000","last_fullsized":"2024-09-12T18:32:45.588918+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:09.763728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4216,"num_read_kb":3793,"num_write":1162,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'260","reported_seq":878,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:12.806139+0000","last_change":"2024-09-12T17:10:30.353547+0000","last_active":"2024-09-12T18:33:12.806139+0000","last_peered":"2024-09-12T18:33:12.806139+0000","last_clean":"2024-09-12T18:33:12.806139+0000","last_became_active":"2024-09-12T17:10:30.353147+0000","last_became_peered":"2024-09-12T17:10:30.353147+0000","last_unstale":"2024-09-12T18:33:12.806139+0000","last_undegraded":"2024-09-12T18:33:12.806139+0000","last_fullsized":"2024-09-12T18:33:12.806139+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:15.129856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10488727,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":338,"num_read_kb":13692,"num_write":934,"num_write_kb":32545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'134","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.133975+0000","last_change":"2024-09-12T17:10:40.422258+0000","last_active":"2024-09-12T18:34:02.133975+0000","last_peered":"2024-09-12T18:34:02.133975+0000","last_clean":"2024-09-12T18:34:02.133975+0000","last_became_active":"2024-09-12T17:10:40.421380+0000","last_became_peered":"2024-09-12T17:10:40.421380+0000","last_unstale":"2024-09-12T18:34:02.133975+0000","last_undegraded":"2024-09-12T18:34:02.133975+0000","last_fullsized":"2024-09-12T18:34:02.133975+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:26.392127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":207,"num_write":318,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'456","reported_seq":2070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.622792+0000","last_change":"2024-09-12T17:10:32.370396+0000","last_active":"2024-09-12T18:33:18.622792+0000","last_peered":"2024-09-12T18:33:18.622792+0000","last_clean":"2024-09-12T18:33:18.622792+0000","last_became_active":"2024-09-12T17:10:32.370058+0000","last_became_peered":"2024-09-12T17:10:32.370058+0000","last_unstale":"2024-09-12T18:33:18.622792+0000","last_undegraded":"2024-09-12T18:33:18.622792+0000","last_fullsized":"2024-09-12T18:33:18.622792+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:48.973947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2398,"num_read_kb":2269,"num_write":525,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'257","reported_seq":868,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.797916+0000","last_change":"2024-09-12T17:11:04.871757+0000","last_active":"2024-09-12T18:32:46.797916+0000","last_peered":"2024-09-12T18:32:46.797916+0000","last_clean":"2024-09-12T18:32:46.797916+0000","last_became_active":"2024-09-12T17:11:04.871007+0000","last_became_peered":"2024-09-12T17:11:04.871007+0000","last_unstale":"2024-09-12T18:32:46.797916+0000","last_undegraded":"2024-09-12T18:32:46.797916+0000","last_fullsized":"2024-09-12T18:32:46.797916+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:22.664826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9028569,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":369,"num_read_kb":10233,"num_write":967,"num_write_kb":32687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.407279+0000","last_change":"2024-09-12T17:10:34.371764+0000","last_active":"2024-09-12T18:32:46.407279+0000","last_peered":"2024-09-12T18:32:46.407279+0000","last_clean":"2024-09-12T18:32:46.407279+0000","last_became_active":"2024-09-12T17:10:34.371022+0000","last_became_peered":"2024-09-12T17:10:34.371022+0000","last_unstale":"2024-09-12T18:32:46.407279+0000","last_undegraded":"2024-09-12T18:32:46.407279+0000","last_fullsized":"2024-09-12T18:32:46.407279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:04.412145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'363","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:11.439798+0000","last_change":"2024-09-12T17:10:36.399853+0000","last_active":"2024-09-12T18:35:11.439798+0000","last_peered":"2024-09-12T18:35:11.439798+0000","last_clean":"2024-09-12T18:35:11.439798+0000","last_became_active":"2024-09-12T17:10:36.399464+0000","last_became_peered":"2024-09-12T17:10:36.399464+0000","last_unstale":"2024-09-12T18:35:11.439798+0000","last_undegraded":"2024-09-12T18:35:11.439798+0000","last_fullsized":"2024-09-12T18:35:11.439798+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:12.028942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59801,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":589,"num_read_kb":1157,"num_write":470,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.401248+0000","last_change":"2024-09-12T17:10:38.405144+0000","last_active":"2024-09-12T18:32:51.401248+0000","last_peered":"2024-09-12T18:32:51.401248+0000","last_clean":"2024-09-12T18:32:51.401248+0000","last_became_active":"2024-09-12T17:10:38.404423+0000","last_became_peered":"2024-09-12T17:10:38.404423+0000","last_unstale":"2024-09-12T18:32:51.401248+0000","last_undegraded":"2024-09-12T18:32:51.401248+0000","last_fullsized":"2024-09-12T18:32:51.401248+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:04.302118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'170","reported_seq":740,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.772365+0000","last_change":"2024-09-12T17:10:40.426221+0000","last_active":"2024-09-12T18:34:01.772365+0000","last_peered":"2024-09-12T18:34:01.772365+0000","last_clean":"2024-09-12T18:34:01.772365+0000","last_became_active":"2024-09-12T17:10:40.425532+0000","last_became_peered":"2024-09-12T17:10:40.425532+0000","last_unstale":"2024-09-12T18:34:01.772365+0000","last_undegraded":"2024-09-12T18:34:01.772365+0000","last_fullsized":"2024-09-12T18:34:01.772365+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:09.048645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":265,"num_read_kb":256,"num_write":326,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'733","reported_seq":2463,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.923583+0000","last_change":"2024-09-12T17:10:32.382421+0000","last_active":"2024-09-12T18:33:59.923583+0000","last_peered":"2024-09-12T18:33:59.923583+0000","last_clean":"2024-09-12T18:33:59.923583+0000","last_became_active":"2024-09-12T17:10:32.381838+0000","last_became_peered":"2024-09-12T17:10:32.381838+0000","last_unstale":"2024-09-12T18:33:59.923583+0000","last_undegraded":"2024-09-12T18:33:59.923583+0000","last_fullsized":"2024-09-12T18:33:59.923583+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:23.645321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3756,"num_read_kb":3395,"num_write":1068,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'328","reported_seq":1049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.403441+0000","last_change":"2024-09-12T17:10:30.362609+0000","last_active":"2024-09-12T18:32:11.403441+0000","last_peered":"2024-09-12T18:32:11.403441+0000","last_clean":"2024-09-12T18:32:11.403441+0000","last_became_active":"2024-09-12T17:10:30.362010+0000","last_became_peered":"2024-09-12T17:10:30.362010+0000","last_unstale":"2024-09-12T18:32:11.403441+0000","last_undegraded":"2024-09-12T18:32:11.403441+0000","last_fullsized":"2024-09-12T18:32:11.403441+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:57.522595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15988764,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":639,"num_read_kb":52712,"num_write":1359,"num_write_kb":39491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403196+0000","last_change":"2024-09-12T17:10:34.362183+0000","last_active":"2024-09-12T18:32:34.403196+0000","last_peered":"2024-09-12T18:32:34.403196+0000","last_clean":"2024-09-12T18:32:34.403196+0000","last_became_active":"2024-09-12T17:10:34.361102+0000","last_became_peered":"2024-09-12T17:10:34.361102+0000","last_unstale":"2024-09-12T18:32:34.403196+0000","last_undegraded":"2024-09-12T18:32:34.403196+0000","last_fullsized":"2024-09-12T18:32:34.403196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:20.467248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'110","reported_seq":666,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.590229+0000","last_change":"2024-09-12T17:10:36.391217+0000","last_active":"2024-09-12T18:32:50.590229+0000","last_peered":"2024-09-12T18:32:50.590229+0000","last_clean":"2024-09-12T18:32:50.590229+0000","last_became_active":"2024-09-12T17:10:36.390398+0000","last_became_peered":"2024-09-12T17:10:36.390398+0000","last_unstale":"2024-09-12T18:32:50.590229+0000","last_undegraded":"2024-09-12T18:32:50.590229+0000","last_fullsized":"2024-09-12T18:32:50.590229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:54.025550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.590198+0000","last_change":"2024-09-12T17:10:38.414637+0000","last_active":"2024-09-12T18:32:50.590198+0000","last_peered":"2024-09-12T18:32:50.590198+0000","last_clean":"2024-09-12T18:32:50.590198+0000","last_became_active":"2024-09-12T17:10:38.414063+0000","last_became_peered":"2024-09-12T17:10:38.414063+0000","last_unstale":"2024-09-12T18:32:50.590198+0000","last_undegraded":"2024-09-12T18:32:50.590198+0000","last_fullsized":"2024-09-12T18:32:50.590198+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:48.781233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'138","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.548387+0000","last_change":"2024-09-12T17:10:40.423061+0000","last_active":"2024-09-12T18:33:57.548387+0000","last_peered":"2024-09-12T18:33:57.548387+0000","last_clean":"2024-09-12T18:33:57.548387+0000","last_became_active":"2024-09-12T17:10:40.422118+0000","last_became_peered":"2024-09-12T17:10:40.422118+0000","last_unstale":"2024-09-12T18:33:57.548387+0000","last_undegraded":"2024-09-12T18:33:57.548387+0000","last_fullsized":"2024-09-12T18:33:57.548387+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:39.157083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":180,"num_write":349,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'871","reported_seq":2493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.814191+0000","last_change":"2024-09-12T17:10:32.352650+0000","last_active":"2024-09-12T18:34:01.814191+0000","last_peered":"2024-09-12T18:34:01.814191+0000","last_clean":"2024-09-12T18:34:01.814191+0000","last_became_active":"2024-09-12T17:10:32.351650+0000","last_became_peered":"2024-09-12T17:10:32.351650+0000","last_unstale":"2024-09-12T18:34:01.814191+0000","last_undegraded":"2024-09-12T18:34:01.814191+0000","last_fullsized":"2024-09-12T18:34:01.814191+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:03.003509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4313,"num_read_kb":3885,"num_write":1184,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'329","reported_seq":1064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.973849+0000","last_change":"2024-09-12T17:10:30.394677+0000","last_active":"2024-09-12T18:32:51.973849+0000","last_peered":"2024-09-12T18:32:51.973849+0000","last_clean":"2024-09-12T18:32:51.973849+0000","last_became_active":"2024-09-12T17:10:30.393670+0000","last_became_peered":"2024-09-12T17:10:30.393670+0000","last_unstale":"2024-09-12T18:32:51.973849+0000","last_undegraded":"2024-09-12T18:32:51.973849+0000","last_fullsized":"2024-09-12T18:32:51.973849+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:39.112583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12845816,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":720,"num_read_kb":43186,"num_write":1162,"num_write_kb":22438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:44.406536+0000","last_change":"2024-09-12T17:10:34.358839+0000","last_active":"2024-09-12T18:32:44.406536+0000","last_peered":"2024-09-12T18:32:44.406536+0000","last_clean":"2024-09-12T18:32:44.406536+0000","last_became_active":"2024-09-12T17:10:34.358119+0000","last_became_peered":"2024-09-12T17:10:34.358119+0000","last_unstale":"2024-09-12T18:32:44.406536+0000","last_undegraded":"2024-09-12T18:32:44.406536+0000","last_fullsized":"2024-09-12T18:32:44.406536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:56.480463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'152","reported_seq":726,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.790757+0000","last_change":"2024-09-12T17:10:36.385198+0000","last_active":"2024-09-12T18:32:26.790757+0000","last_peered":"2024-09-12T18:32:26.790757+0000","last_clean":"2024-09-12T18:32:26.790757+0000","last_became_active":"2024-09-12T17:10:36.384465+0000","last_became_peered":"2024-09-12T17:10:36.384465+0000","last_unstale":"2024-09-12T18:32:26.790757+0000","last_undegraded":"2024-09-12T18:32:26.790757+0000","last_fullsized":"2024-09-12T18:32:26.790757+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:48.249397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":178,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'788","reported_seq":2914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.783548+0000","last_change":"2024-09-12T17:10:38.407657+0000","last_active":"2024-09-12T18:35:21.783548+0000","last_peered":"2024-09-12T18:35:21.783548+0000","last_clean":"2024-09-12T18:35:21.783548+0000","last_became_active":"2024-09-12T17:10:38.406964+0000","last_became_peered":"2024-09-12T17:10:38.406964+0000","last_unstale":"2024-09-12T18:35:21.783548+0000","last_undegraded":"2024-09-12T18:35:21.783548+0000","last_fullsized":"2024-09-12T18:35:21.783548+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:41.454994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'254","reported_seq":1111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.224603+0000","last_change":"2024-09-12T17:10:40.769418+0000","last_active":"2024-09-12T18:34:02.224603+0000","last_peered":"2024-09-12T18:34:02.224603+0000","last_clean":"2024-09-12T18:34:02.224603+0000","last_became_active":"2024-09-12T17:10:40.768896+0000","last_became_peered":"2024-09-12T17:10:40.768896+0000","last_unstale":"2024-09-12T18:34:02.224603+0000","last_undegraded":"2024-09-12T18:34:02.224603+0000","last_fullsized":"2024-09-12T18:34:02.224603+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:14.019332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":705,"num_read_kb":685,"num_write":456,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'529","reported_seq":2333,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.722899+0000","last_change":"2024-09-12T17:10:32.383037+0000","last_active":"2024-09-12T18:33:13.722899+0000","last_peered":"2024-09-12T18:33:13.722899+0000","last_clean":"2024-09-12T18:33:13.722899+0000","last_became_active":"2024-09-12T17:10:32.382671+0000","last_became_peered":"2024-09-12T17:10:32.382671+0000","last_unstale":"2024-09-12T18:33:13.722899+0000","last_undegraded":"2024-09-12T18:33:13.722899+0000","last_fullsized":"2024-09-12T18:33:13.722899+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:57.340586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3129,"num_read_kb":2937,"num_write":633,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'312","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.251341+0000","last_change":"2024-09-12T17:10:30.391255+0000","last_active":"2024-09-12T18:33:05.251341+0000","last_peered":"2024-09-12T18:33:05.251341+0000","last_clean":"2024-09-12T18:33:05.251341+0000","last_became_active":"2024-09-12T17:10:30.390677+0000","last_became_peered":"2024-09-12T17:10:30.390677+0000","last_unstale":"2024-09-12T18:33:05.251341+0000","last_undegraded":"2024-09-12T18:33:05.251341+0000","last_fullsized":"2024-09-12T18:33:05.251341+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:46.541083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12847960,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":515,"num_read_kb":63186,"num_write":1059,"num_write_kb":46639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.407341+0000","last_change":"2024-09-12T17:10:34.373089+0000","last_active":"2024-09-12T18:32:46.407341+0000","last_peered":"2024-09-12T18:32:46.407341+0000","last_clean":"2024-09-12T18:32:46.407341+0000","last_became_active":"2024-09-12T17:10:34.371937+0000","last_became_peered":"2024-09-12T17:10:34.371937+0000","last_unstale":"2024-09-12T18:32:46.407341+0000","last_undegraded":"2024-09-12T18:32:46.407341+0000","last_fullsized":"2024-09-12T18:32:46.407341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:36.719820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'313","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:11.436453+0000","last_change":"2024-09-12T17:10:36.921222+0000","last_active":"2024-09-12T18:35:11.436453+0000","last_peered":"2024-09-12T18:35:11.436453+0000","last_clean":"2024-09-12T18:35:11.436453+0000","last_became_active":"2024-09-12T17:10:36.920487+0000","last_became_peered":"2024-09-12T17:10:36.920487+0000","last_unstale":"2024-09-12T18:35:11.436453+0000","last_undegraded":"2024-09-12T18:35:11.436453+0000","last_fullsized":"2024-09-12T18:35:11.436453+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:45.222423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64544,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":532,"num_read_kb":1149,"num_write":444,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'804","reported_seq":2812,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.015508+0000","last_change":"2024-09-12T17:10:38.398227+0000","last_active":"2024-09-12T18:35:59.015508+0000","last_peered":"2024-09-12T18:35:59.015508+0000","last_clean":"2024-09-12T18:35:59.015508+0000","last_became_active":"2024-09-12T17:10:38.393524+0000","last_became_peered":"2024-09-12T17:10:38.393524+0000","last_unstale":"2024-09-12T18:35:59.015508+0000","last_undegraded":"2024-09-12T18:35:59.015508+0000","last_fullsized":"2024-09-12T18:35:59.015508+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:55.682578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'401","reported_seq":1970,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.625087+0000","last_change":"2024-09-12T17:10:32.378803+0000","last_active":"2024-09-12T18:33:18.625087+0000","last_peered":"2024-09-12T18:33:18.625087+0000","last_clean":"2024-09-12T18:33:18.625087+0000","last_became_active":"2024-09-12T17:10:32.378027+0000","last_became_peered":"2024-09-12T17:10:32.378027+0000","last_unstale":"2024-09-12T18:33:18.625087+0000","last_undegraded":"2024-09-12T18:33:18.625087+0000","last_fullsized":"2024-09-12T18:33:18.625087+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:52.446776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2313,"num_read_kb":2218,"num_write":459,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'280","reported_seq":951,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:59.386439+0000","last_change":"2024-09-12T17:10:30.387735+0000","last_active":"2024-09-12T18:32:59.386439+0000","last_peered":"2024-09-12T18:32:59.386439+0000","last_clean":"2024-09-12T18:32:59.386439+0000","last_became_active":"2024-09-12T17:10:30.386707+0000","last_became_peered":"2024-09-12T17:10:30.386707+0000","last_unstale":"2024-09-12T18:32:59.386439+0000","last_undegraded":"2024-09-12T18:32:59.386439+0000","last_fullsized":"2024-09-12T18:32:59.386439+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:19.438334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9274013,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":464,"num_read_kb":31049,"num_write":1054,"num_write_kb":31528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.402246+0000","last_change":"2024-09-12T17:10:34.369825+0000","last_active":"2024-09-12T18:32:56.402246+0000","last_peered":"2024-09-12T18:32:56.402246+0000","last_clean":"2024-09-12T18:32:56.402246+0000","last_became_active":"2024-09-12T17:10:34.369066+0000","last_became_peered":"2024-09-12T17:10:34.369066+0000","last_unstale":"2024-09-12T18:32:56.402246+0000","last_undegraded":"2024-09-12T18:32:56.402246+0000","last_fullsized":"2024-09-12T18:32:56.402246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'380","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.710779+0000","last_change":"2024-09-12T17:10:36.920855+0000","last_active":"2024-09-12T18:35:21.710779+0000","last_peered":"2024-09-12T18:35:21.710779+0000","last_clean":"2024-09-12T18:35:21.710779+0000","last_became_active":"2024-09-12T17:10:36.920136+0000","last_became_peered":"2024-09-12T17:10:36.920136+0000","last_unstale":"2024-09-12T18:35:21.710779+0000","last_undegraded":"2024-09-12T18:35:21.710779+0000","last_fullsized":"2024-09-12T18:35:21.710779+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:53.763125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60606,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":610,"num_read_kb":1074,"num_write":460,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.623483+0000","last_change":"2024-09-12T17:10:38.395526+0000","last_active":"2024-09-12T18:31:41.623483+0000","last_peered":"2024-09-12T18:31:41.623483+0000","last_clean":"2024-09-12T18:31:41.623483+0000","last_became_active":"2024-09-12T17:10:38.394381+0000","last_became_peered":"2024-09-12T17:10:38.394381+0000","last_unstale":"2024-09-12T18:31:41.623483+0000","last_undegraded":"2024-09-12T18:31:41.623483+0000","last_fullsized":"2024-09-12T18:31:41.623483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:07.549215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'531","reported_seq":1356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.744047+0000","last_change":"2024-09-12T17:10:40.423104+0000","last_active":"2024-09-12T18:35:21.744047+0000","last_peered":"2024-09-12T18:35:21.744047+0000","last_clean":"2024-09-12T18:35:21.744047+0000","last_became_active":"2024-09-12T17:10:40.422353+0000","last_became_peered":"2024-09-12T17:10:40.422353+0000","last_unstale":"2024-09-12T18:35:21.744047+0000","last_undegraded":"2024-09-12T18:35:21.744047+0000","last_fullsized":"2024-09-12T18:35:21.744047+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:50.482047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1294,"num_read_kb":1291,"num_write":1098,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'422","reported_seq":2030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.510810+0000","last_change":"2024-09-12T17:10:32.370427+0000","last_active":"2024-09-12T18:33:01.510810+0000","last_peered":"2024-09-12T18:33:01.510810+0000","last_clean":"2024-09-12T18:33:01.510810+0000","last_became_active":"2024-09-12T17:10:32.369188+0000","last_became_peered":"2024-09-12T17:10:32.369188+0000","last_unstale":"2024-09-12T18:33:01.510810+0000","last_undegraded":"2024-09-12T18:33:01.510810+0000","last_fullsized":"2024-09-12T18:33:01.510810+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:45.905435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2274,"num_read_kb":2176,"num_write":482,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'268","reported_seq":1044,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.631922+0000","last_change":"2024-09-12T17:10:30.384287+0000","last_active":"2024-09-12T18:32:41.631922+0000","last_peered":"2024-09-12T18:32:41.631922+0000","last_clean":"2024-09-12T18:32:41.631922+0000","last_became_active":"2024-09-12T17:10:30.381728+0000","last_became_peered":"2024-09-12T17:10:30.381728+0000","last_unstale":"2024-09-12T18:32:41.631922+0000","last_undegraded":"2024-09-12T18:32:41.631922+0000","last_fullsized":"2024-09-12T18:32:41.631922+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:55.748760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18875113,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":516,"num_read_kb":127583,"num_write":954,"num_write_kb":57035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.799633+0000","last_change":"2024-09-12T17:10:34.346640+0000","last_active":"2024-09-12T18:32:56.799633+0000","last_peered":"2024-09-12T18:32:56.799633+0000","last_clean":"2024-09-12T18:32:56.799633+0000","last_became_active":"2024-09-12T17:10:34.346229+0000","last_became_peered":"2024-09-12T17:10:34.346229+0000","last_unstale":"2024-09-12T18:32:56.799633+0000","last_undegraded":"2024-09-12T18:32:56.799633+0000","last_fullsized":"2024-09-12T18:32:56.799633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:33.485742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'294","reported_seq":890,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.654783+0000","last_change":"2024-09-12T17:10:36.399143+0000","last_active":"2024-09-12T18:35:21.654783+0000","last_peered":"2024-09-12T18:35:21.654783+0000","last_clean":"2024-09-12T18:35:21.654783+0000","last_became_active":"2024-09-12T17:10:36.398641+0000","last_became_peered":"2024-09-12T17:10:36.398641+0000","last_unstale":"2024-09-12T18:35:21.654783+0000","last_undegraded":"2024-09-12T18:35:21.654783+0000","last_fullsized":"2024-09-12T18:35:21.654783+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:50.236212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66018,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":492,"num_read_kb":1063,"num_write":404,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.414508+0000","last_change":"2024-09-12T17:10:38.395735+0000","last_active":"2024-09-12T18:33:19.414508+0000","last_peered":"2024-09-12T18:33:19.414508+0000","last_clean":"2024-09-12T18:33:19.414508+0000","last_became_active":"2024-09-12T17:10:38.393114+0000","last_became_peered":"2024-09-12T17:10:38.393114+0000","last_unstale":"2024-09-12T18:33:19.414508+0000","last_undegraded":"2024-09-12T18:33:19.414508+0000","last_fullsized":"2024-09-12T18:33:19.414508+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:32.570846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'2402","reported_seq":4243,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:21.599376+0000","last_change":"2024-09-12T17:10:40.426099+0000","last_active":"2024-09-12T18:34:21.599376+0000","last_peered":"2024-09-12T18:34:21.599376+0000","last_clean":"2024-09-12T18:34:21.599376+0000","last_became_active":"2024-09-12T17:10:40.425351+0000","last_became_peered":"2024-09-12T17:10:40.425351+0000","last_unstale":"2024-09-12T18:34:21.599376+0000","last_undegraded":"2024-09-12T18:34:21.599376+0000","last_fullsized":"2024-09-12T18:34:21.599376+0000","mapping_epoch":35,"log_start":"268'2300","ondisk_log_start":"268'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":2300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:37.392452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6030,"num_read_kb":6033,"num_write":4839,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'767","reported_seq":2271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.455307+0000","last_change":"2024-09-12T17:11:04.374050+0000","last_active":"2024-09-12T18:33:28.455307+0000","last_peered":"2024-09-12T18:33:28.455307+0000","last_clean":"2024-09-12T18:33:28.455307+0000","last_became_active":"2024-09-12T17:11:04.373050+0000","last_became_peered":"2024-09-12T17:11:04.373050+0000","last_unstale":"2024-09-12T18:33:28.455307+0000","last_undegraded":"2024-09-12T18:33:28.455307+0000","last_fullsized":"2024-09-12T18:33:28.455307+0000","mapping_epoch":38,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:03.588680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3705,"num_read_kb":3333,"num_write":1034,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'280","reported_seq":954,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:31.382065+0000","last_change":"2024-09-12T17:10:30.382937+0000","last_active":"2024-09-12T18:31:31.382065+0000","last_peered":"2024-09-12T18:31:31.382065+0000","last_clean":"2024-09-12T18:31:31.382065+0000","last_became_active":"2024-09-12T17:10:30.381997+0000","last_became_peered":"2024-09-12T17:10:30.381997+0000","last_unstale":"2024-09-12T18:31:31.382065+0000","last_undegraded":"2024-09-12T18:31:31.382065+0000","last_fullsized":"2024-09-12T18:31:31.382065+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:26.528780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11535381,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":475,"num_read_kb":9736,"num_write":1050,"num_write_kb":58445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.781056+0000","last_change":"2024-09-12T17:10:34.359567+0000","last_active":"2024-09-12T18:31:36.781056+0000","last_peered":"2024-09-12T18:31:36.781056+0000","last_clean":"2024-09-12T18:31:36.781056+0000","last_became_active":"2024-09-12T17:10:34.358798+0000","last_became_peered":"2024-09-12T17:10:34.358798+0000","last_unstale":"2024-09-12T18:31:36.781056+0000","last_undegraded":"2024-09-12T18:31:36.781056+0000","last_fullsized":"2024-09-12T18:31:36.781056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:55.082548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'345","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:06.434993+0000","last_change":"2024-09-12T17:10:36.397286+0000","last_active":"2024-09-12T18:35:06.434993+0000","last_peered":"2024-09-12T18:35:06.434993+0000","last_clean":"2024-09-12T18:35:06.434993+0000","last_became_active":"2024-09-12T17:10:36.396261+0000","last_became_peered":"2024-09-12T17:10:36.396261+0000","last_unstale":"2024-09-12T18:35:06.434993+0000","last_undegraded":"2024-09-12T18:35:06.434993+0000","last_fullsized":"2024-09-12T18:35:06.434993+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:04.653529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58948,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":572,"num_read_kb":1123,"num_write":458,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'797","reported_seq":2778,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.791102+0000","last_change":"2024-09-12T17:10:38.409388+0000","last_active":"2024-09-12T18:35:21.791102+0000","last_peered":"2024-09-12T18:35:21.791102+0000","last_clean":"2024-09-12T18:35:21.791102+0000","last_became_active":"2024-09-12T17:10:38.408710+0000","last_became_peered":"2024-09-12T17:10:38.408710+0000","last_unstale":"2024-09-12T18:35:21.791102+0000","last_undegraded":"2024-09-12T18:35:21.791102+0000","last_fullsized":"2024-09-12T18:35:21.791102+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:10.552245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'126","reported_seq":639,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.149525+0000","last_change":"2024-09-12T17:10:40.423220+0000","last_active":"2024-09-12T18:35:20.149525+0000","last_peered":"2024-09-12T18:35:20.149525+0000","last_clean":"2024-09-12T18:35:20.149525+0000","last_became_active":"2024-09-12T17:10:40.417664+0000","last_became_peered":"2024-09-12T17:10:40.417664+0000","last_unstale":"2024-09-12T18:35:20.149525+0000","last_undegraded":"2024-09-12T18:35:20.149525+0000","last_fullsized":"2024-09-12T18:35:20.149525+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:22.188666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":285,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'884","reported_seq":2344,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.455949+0000","last_change":"2024-09-12T17:10:32.365377+0000","last_active":"2024-09-12T18:35:20.455949+0000","last_peered":"2024-09-12T18:35:20.455949+0000","last_clean":"2024-09-12T18:35:20.455949+0000","last_became_active":"2024-09-12T17:10:32.364995+0000","last_became_peered":"2024-09-12T17:10:32.364995+0000","last_unstale":"2024-09-12T18:35:20.455949+0000","last_undegraded":"2024-09-12T18:35:20.455949+0000","last_fullsized":"2024-09-12T18:35:20.455949+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":800,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:55.164024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4158,"num_read_kb":3733,"num_write":1245,"num_write_kb":492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'265","reported_seq":931,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:45.898614+0000","last_change":"2024-09-12T17:10:30.394063+0000","last_active":"2024-09-12T18:31:45.898614+0000","last_peered":"2024-09-12T18:31:45.898614+0000","last_clean":"2024-09-12T18:31:45.898614+0000","last_became_active":"2024-09-12T17:10:30.393495+0000","last_became_peered":"2024-09-12T17:10:30.393495+0000","last_unstale":"2024-09-12T18:31:45.898614+0000","last_undegraded":"2024-09-12T18:31:45.898614+0000","last_fullsized":"2024-09-12T18:31:45.898614+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:24.386647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20160543,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":424,"num_read_kb":51876,"num_write":917,"num_write_kb":56464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.801736+0000","last_change":"2024-09-12T17:10:34.361146+0000","last_active":"2024-09-12T18:33:06.801736+0000","last_peered":"2024-09-12T18:33:06.801736+0000","last_clean":"2024-09-12T18:33:06.801736+0000","last_became_active":"2024-09-12T17:10:34.360732+0000","last_became_peered":"2024-09-12T17:10:34.360732+0000","last_unstale":"2024-09-12T18:33:06.801736+0000","last_undegraded":"2024-09-12T18:33:06.801736+0000","last_fullsized":"2024-09-12T18:33:06.801736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:35.010373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'501","reported_seq":1157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.663417+0000","last_change":"2024-09-12T17:10:36.400168+0000","last_active":"2024-09-12T18:35:21.663417+0000","last_peered":"2024-09-12T18:35:21.663417+0000","last_clean":"2024-09-12T18:35:21.663417+0000","last_became_active":"2024-09-12T17:10:36.399536+0000","last_became_peered":"2024-09-12T17:10:36.399536+0000","last_unstale":"2024-09-12T18:35:21.663417+0000","last_undegraded":"2024-09-12T18:35:21.663417+0000","last_fullsized":"2024-09-12T18:35:21.663417+0000","mapping_epoch":31,"log_start":"268'400","ondisk_log_start":"268'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:17.679689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111602,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":860,"num_read_kb":1892,"num_write":712,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.800568+0000","last_change":"2024-09-12T17:10:38.405811+0000","last_active":"2024-09-12T18:33:01.800568+0000","last_peered":"2024-09-12T18:33:01.800568+0000","last_clean":"2024-09-12T18:33:01.800568+0000","last_became_active":"2024-09-12T17:10:38.405169+0000","last_became_peered":"2024-09-12T17:10:38.405169+0000","last_unstale":"2024-09-12T18:33:01.800568+0000","last_undegraded":"2024-09-12T18:33:01.800568+0000","last_fullsized":"2024-09-12T18:33:01.800568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:36.239505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'149","reported_seq":749,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642360+0000","last_change":"2024-09-12T17:10:40.410614+0000","last_active":"2024-09-12T18:33:01.642360+0000","last_peered":"2024-09-12T18:33:01.642360+0000","last_clean":"2024-09-12T18:33:01.642360+0000","last_became_active":"2024-09-12T17:10:40.409722+0000","last_became_peered":"2024-09-12T17:10:40.409722+0000","last_unstale":"2024-09-12T18:33:01.642360+0000","last_undegraded":"2024-09-12T18:33:01.642360+0000","last_fullsized":"2024-09-12T18:33:01.642360+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:32.816448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":508,"num_read_kb":430,"num_write":364,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'823","reported_seq":2340,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.627107+0000","last_change":"2024-09-12T17:10:32.371896+0000","last_active":"2024-09-12T18:33:18.627107+0000","last_peered":"2024-09-12T18:33:18.627107+0000","last_clean":"2024-09-12T18:33:18.627107+0000","last_became_active":"2024-09-12T17:10:32.370915+0000","last_became_peered":"2024-09-12T17:10:32.370915+0000","last_unstale":"2024-09-12T18:33:18.627107+0000","last_undegraded":"2024-09-12T18:33:18.627107+0000","last_fullsized":"2024-09-12T18:33:18.627107+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:10.387733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3877,"num_read_kb":3457,"num_write":1088,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'297","reported_seq":954,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.787076+0000","last_change":"2024-09-12T17:11:04.869761+0000","last_active":"2024-09-12T18:32:06.787076+0000","last_peered":"2024-09-12T18:32:06.787076+0000","last_clean":"2024-09-12T18:32:06.787076+0000","last_became_active":"2024-09-12T17:11:04.868662+0000","last_became_peered":"2024-09-12T17:11:04.868662+0000","last_unstale":"2024-09-12T18:32:06.787076+0000","last_undegraded":"2024-09-12T18:32:06.787076+0000","last_fullsized":"2024-09-12T18:32:06.787076+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:32.791583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6603921,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":490,"num_read_kb":17196,"num_write":1168,"num_write_kb":37960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.781150+0000","last_change":"2024-09-12T17:10:34.364569+0000","last_active":"2024-09-12T18:31:36.781150+0000","last_peered":"2024-09-12T18:31:36.781150+0000","last_clean":"2024-09-12T18:31:36.781150+0000","last_became_active":"2024-09-12T17:10:34.363822+0000","last_became_peered":"2024-09-12T17:10:34.363822+0000","last_unstale":"2024-09-12T18:31:36.781150+0000","last_undegraded":"2024-09-12T18:31:36.781150+0000","last_fullsized":"2024-09-12T18:31:36.781150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:31.296872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'300","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.666917+0000","last_change":"2024-09-12T17:10:36.378654+0000","last_active":"2024-09-12T18:35:21.666917+0000","last_peered":"2024-09-12T18:35:21.666917+0000","last_clean":"2024-09-12T18:35:21.666917+0000","last_became_active":"2024-09-12T17:10:36.377677+0000","last_became_peered":"2024-09-12T17:10:36.377677+0000","last_unstale":"2024-09-12T18:35:21.666917+0000","last_undegraded":"2024-09-12T18:35:21.666917+0000","last_fullsized":"2024-09-12T18:35:21.666917+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:08.577663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55691,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":1015,"num_write":454,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.400571+0000","last_change":"2024-09-12T17:10:38.414306+0000","last_active":"2024-09-12T18:31:56.400571+0000","last_peered":"2024-09-12T18:31:56.400571+0000","last_clean":"2024-09-12T18:31:56.400571+0000","last_became_active":"2024-09-12T17:10:38.413429+0000","last_became_peered":"2024-09-12T17:10:38.413429+0000","last_unstale":"2024-09-12T18:31:56.400571+0000","last_undegraded":"2024-09-12T18:31:56.400571+0000","last_fullsized":"2024-09-12T18:31:56.400571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:21.822547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'113","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:04.436186+0000","last_change":"2024-09-12T17:10:40.416006+0000","last_active":"2024-09-12T18:35:04.436186+0000","last_peered":"2024-09-12T18:35:04.436186+0000","last_clean":"2024-09-12T18:35:04.436186+0000","last_became_active":"2024-09-12T17:10:40.415270+0000","last_became_peered":"2024-09-12T17:10:40.415270+0000","last_unstale":"2024-09-12T18:35:04.436186+0000","last_undegraded":"2024-09-12T18:35:04.436186+0000","last_fullsized":"2024-09-12T18:35:04.436186+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:27.216064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":272,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'511","reported_seq":2174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.472032+0000","last_change":"2024-09-12T17:10:32.357942+0000","last_active":"2024-09-12T18:35:20.472032+0000","last_peered":"2024-09-12T18:35:20.472032+0000","last_clean":"2024-09-12T18:35:20.472032+0000","last_became_active":"2024-09-12T17:10:32.357121+0000","last_became_peered":"2024-09-12T17:10:32.357121+0000","last_unstale":"2024-09-12T18:35:20.472032+0000","last_undegraded":"2024-09-12T18:35:20.472032+0000","last_fullsized":"2024-09-12T18:35:20.472032+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:38.419513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2802,"num_read_kb":2611,"num_write":616,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'330","reported_seq":1013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.584563+0000","last_change":"2024-09-12T17:10:30.392231+0000","last_active":"2024-09-12T18:33:11.584563+0000","last_peered":"2024-09-12T18:33:11.584563+0000","last_clean":"2024-09-12T18:33:11.584563+0000","last_became_active":"2024-09-12T17:10:30.391780+0000","last_became_peered":"2024-09-12T17:10:30.391780+0000","last_unstale":"2024-09-12T18:33:11.584563+0000","last_undegraded":"2024-09-12T18:33:11.584563+0000","last_fullsized":"2024-09-12T18:33:11.584563+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:06.306117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2276955,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":600,"num_read_kb":4836,"num_write":1122,"num_write_kb":23965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.622390+0000","last_change":"2024-09-12T17:10:34.363001+0000","last_active":"2024-09-12T18:31:36.622390+0000","last_peered":"2024-09-12T18:31:36.622390+0000","last_clean":"2024-09-12T18:31:36.622390+0000","last_became_active":"2024-09-12T17:10:34.362337+0000","last_became_peered":"2024-09-12T17:10:34.362337+0000","last_unstale":"2024-09-12T18:31:36.622390+0000","last_undegraded":"2024-09-12T18:31:36.622390+0000","last_fullsized":"2024-09-12T18:31:36.622390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:55.735353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'336","reported_seq":961,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.812880+0000","last_change":"2024-09-12T17:10:36.390545+0000","last_active":"2024-09-12T18:34:01.812880+0000","last_peered":"2024-09-12T18:34:01.812880+0000","last_clean":"2024-09-12T18:34:01.812880+0000","last_became_active":"2024-09-12T17:10:36.389965+0000","last_became_peered":"2024-09-12T17:10:36.389965+0000","last_unstale":"2024-09-12T18:34:01.812880+0000","last_undegraded":"2024-09-12T18:34:01.812880+0000","last_fullsized":"2024-09-12T18:34:01.812880+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:10.492872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68763,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":561,"num_read_kb":1121,"num_write":446,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'762","reported_seq":6956,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.784809+0000","last_change":"2024-09-12T17:10:38.398211+0000","last_active":"2024-09-12T18:35:21.784809+0000","last_peered":"2024-09-12T18:35:21.784809+0000","last_clean":"2024-09-12T18:35:21.784809+0000","last_became_active":"2024-09-12T17:10:38.397332+0000","last_became_peered":"2024-09-12T17:10:38.397332+0000","last_unstale":"2024-09-12T18:35:21.784809+0000","last_undegraded":"2024-09-12T18:35:21.784809+0000","last_fullsized":"2024-09-12T18:35:21.784809+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:01.068948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'149","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.554935+0000","last_change":"2024-09-12T17:10:40.424715+0000","last_active":"2024-09-12T18:33:57.554935+0000","last_peered":"2024-09-12T18:33:57.554935+0000","last_clean":"2024-09-12T18:33:57.554935+0000","last_became_active":"2024-09-12T17:10:40.423894+0000","last_became_peered":"2024-09-12T17:10:40.423894+0000","last_unstale":"2024-09-12T18:33:57.554935+0000","last_undegraded":"2024-09-12T18:33:57.554935+0000","last_fullsized":"2024-09-12T18:33:57.554935+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:15.998229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1683,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":214,"num_read_kb":204,"num_write":362,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'506","reported_seq":2219,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.480069+0000","last_change":"2024-09-12T17:10:32.362015+0000","last_active":"2024-09-12T18:35:20.480069+0000","last_peered":"2024-09-12T18:35:20.480069+0000","last_clean":"2024-09-12T18:35:20.480069+0000","last_became_active":"2024-09-12T17:10:32.361164+0000","last_became_peered":"2024-09-12T17:10:32.361164+0000","last_unstale":"2024-09-12T18:35:20.480069+0000","last_undegraded":"2024-09-12T18:35:20.480069+0000","last_fullsized":"2024-09-12T18:35:20.480069+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:51.658105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2673,"num_read_kb":2535,"num_write":607,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'355","reported_seq":1086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.392143+0000","last_change":"2024-09-12T17:10:30.362031+0000","last_active":"2024-09-12T18:36:00.392143+0000","last_peered":"2024-09-12T18:36:00.392143+0000","last_clean":"2024-09-12T18:36:00.392143+0000","last_became_active":"2024-09-12T17:10:30.361126+0000","last_became_peered":"2024-09-12T17:10:30.361126+0000","last_unstale":"2024-09-12T18:36:00.392143+0000","last_undegraded":"2024-09-12T18:36:00.392143+0000","last_fullsized":"2024-09-12T18:36:00.392143+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:31.446390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21496170,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":655,"num_read_kb":57356,"num_write":1261,"num_write_kb":69062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1473,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.380040+0000","last_change":"2024-09-12T17:10:34.371001+0000","last_active":"2024-09-12T18:35:21.380040+0000","last_peered":"2024-09-12T18:35:21.380040+0000","last_clean":"2024-09-12T18:35:21.380040+0000","last_became_active":"2024-09-12T17:10:34.367608+0000","last_became_peered":"2024-09-12T17:10:34.367608+0000","last_unstale":"2024-09-12T18:35:21.380040+0000","last_undegraded":"2024-09-12T18:35:21.380040+0000","last_fullsized":"2024-09-12T18:35:21.380040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:28.182336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'122","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:39.390262+0000","last_change":"2024-09-12T17:10:36.922117+0000","last_active":"2024-09-12T18:31:39.390262+0000","last_peered":"2024-09-12T18:31:39.390262+0000","last_clean":"2024-09-12T18:31:39.390262+0000","last_became_active":"2024-09-12T17:10:36.921242+0000","last_became_peered":"2024-09-12T17:10:36.921242+0000","last_unstale":"2024-09-12T18:31:39.390262+0000","last_undegraded":"2024-09-12T18:31:39.390262+0000","last_fullsized":"2024-09-12T18:31:39.390262+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:20.309744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'777","reported_seq":2882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.787639+0000","last_change":"2024-09-12T17:10:38.398167+0000","last_active":"2024-09-12T18:35:21.787639+0000","last_peered":"2024-09-12T18:35:21.787639+0000","last_clean":"2024-09-12T18:35:21.787639+0000","last_became_active":"2024-09-12T17:10:38.397242+0000","last_became_peered":"2024-09-12T17:10:38.397242+0000","last_unstale":"2024-09-12T18:35:21.787639+0000","last_undegraded":"2024-09-12T18:35:21.787639+0000","last_fullsized":"2024-09-12T18:35:21.787639+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:54.313987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'138","reported_seq":654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.767388+0000","last_change":"2024-09-12T17:10:40.420601+0000","last_active":"2024-09-12T18:33:55.767388+0000","last_peered":"2024-09-12T18:33:55.767388+0000","last_clean":"2024-09-12T18:33:55.767388+0000","last_became_active":"2024-09-12T17:10:40.415831+0000","last_became_peered":"2024-09-12T17:10:40.415831+0000","last_unstale":"2024-09-12T18:33:55.767388+0000","last_undegraded":"2024-09-12T18:33:55.767388+0000","last_fullsized":"2024-09-12T18:33:55.767388+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:03.855689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":150,"num_write":326,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'562","reported_seq":2078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.813907+0000","last_change":"2024-09-12T17:10:32.367243+0000","last_active":"2024-09-12T18:34:01.813907+0000","last_peered":"2024-09-12T18:34:01.813907+0000","last_clean":"2024-09-12T18:34:01.813907+0000","last_became_active":"2024-09-12T17:10:32.366967+0000","last_became_peered":"2024-09-12T17:10:32.366967+0000","last_unstale":"2024-09-12T18:34:01.813907+0000","last_undegraded":"2024-09-12T18:34:01.813907+0000","last_fullsized":"2024-09-12T18:34:01.813907+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:36.021339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2878,"num_read_kb":2622,"num_write":716,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'332","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.415203+0000","last_change":"2024-09-12T17:10:30.360774+0000","last_active":"2024-09-12T18:35:59.415203+0000","last_peered":"2024-09-12T18:35:59.415203+0000","last_clean":"2024-09-12T18:35:59.415203+0000","last_became_active":"2024-09-12T17:10:30.360368+0000","last_became_peered":"2024-09-12T17:10:30.360368+0000","last_unstale":"2024-09-12T18:35:59.415203+0000","last_undegraded":"2024-09-12T18:35:59.415203+0000","last_fullsized":"2024-09-12T18:35:59.415203+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:43.197601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4335157,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":557,"num_read_kb":11059,"num_write":1189,"num_write_kb":24095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:35.572162+0000","last_change":"2024-09-12T17:10:34.354809+0000","last_active":"2024-09-12T18:31:35.572162+0000","last_peered":"2024-09-12T18:31:35.572162+0000","last_clean":"2024-09-12T18:31:35.572162+0000","last_became_active":"2024-09-12T17:10:34.354009+0000","last_became_peered":"2024-09-12T17:10:34.354009+0000","last_unstale":"2024-09-12T18:31:35.572162+0000","last_undegraded":"2024-09-12T18:31:35.572162+0000","last_fullsized":"2024-09-12T18:31:35.572162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:37.358212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'373","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.548547+0000","last_change":"2024-09-12T17:10:36.393717+0000","last_active":"2024-09-12T18:35:20.548547+0000","last_peered":"2024-09-12T18:35:20.548547+0000","last_clean":"2024-09-12T18:35:20.548547+0000","last_became_active":"2024-09-12T17:10:36.392271+0000","last_became_peered":"2024-09-12T17:10:36.392271+0000","last_unstale":"2024-09-12T18:35:20.548547+0000","last_undegraded":"2024-09-12T18:35:20.548547+0000","last_fullsized":"2024-09-12T18:35:20.548547+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:38.244171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55298,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":602,"num_read_kb":1087,"num_write":462,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.565485+0000","last_change":"2024-09-12T17:10:38.399541+0000","last_active":"2024-09-12T18:31:41.565485+0000","last_peered":"2024-09-12T18:31:41.565485+0000","last_clean":"2024-09-12T18:31:41.565485+0000","last_became_active":"2024-09-12T17:10:38.398743+0000","last_became_peered":"2024-09-12T17:10:38.398743+0000","last_unstale":"2024-09-12T18:31:41.565485+0000","last_undegraded":"2024-09-12T18:31:41.565485+0000","last_fullsized":"2024-09-12T18:31:41.565485+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:42.789598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'104","reported_seq":613,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.057275+0000","last_change":"2024-09-12T17:10:40.411608+0000","last_active":"2024-09-12T18:34:00.057275+0000","last_peered":"2024-09-12T18:34:00.057275+0000","last_clean":"2024-09-12T18:34:00.057275+0000","last_became_active":"2024-09-12T17:10:40.410710+0000","last_became_peered":"2024-09-12T17:10:40.410710+0000","last_unstale":"2024-09-12T18:34:00.057275+0000","last_undegraded":"2024-09-12T18:34:00.057275+0000","last_fullsized":"2024-09-12T18:34:00.057275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:48.629817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":239,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'447","reported_seq":2001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:59.059999+0000","last_change":"2024-09-12T17:10:32.367439+0000","last_active":"2024-09-12T18:32:59.059999+0000","last_peered":"2024-09-12T18:32:59.059999+0000","last_clean":"2024-09-12T18:32:59.059999+0000","last_became_active":"2024-09-12T17:10:32.366571+0000","last_became_peered":"2024-09-12T17:10:32.366571+0000","last_unstale":"2024-09-12T18:32:59.059999+0000","last_undegraded":"2024-09-12T18:32:59.059999+0000","last_fullsized":"2024-09-12T18:32:59.059999+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:11.374807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2259,"num_read_kb":2146,"num_write":500,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.398388+0000","last_change":"2024-09-12T17:10:13.025471+0000","last_active":"2024-09-12T18:32:41.398388+0000","last_peered":"2024-09-12T18:32:41.398388+0000","last_clean":"2024-09-12T18:32:41.398388+0000","last_became_active":"2024-09-12T17:10:13.024652+0000","last_became_peered":"2024-09-12T17:10:13.024652+0000","last_unstale":"2024-09-12T18:32:41.398388+0000","last_undegraded":"2024-09-12T18:32:41.398388+0000","last_fullsized":"2024-09-12T18:32:41.398388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:11.999189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:11.999189+0000","last_clean_scrub_stamp":"2024-09-12T17:10:11.999189+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:01.776648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.420031+0000","last_change":"2024-09-12T17:10:20.094438+0000","last_active":"2024-09-12T18:33:41.420031+0000","last_peered":"2024-09-12T18:33:41.420031+0000","last_clean":"2024-09-12T18:33:41.420031+0000","last_became_active":"2024-09-12T17:10:18.073547+0000","last_became_peered":"2024-09-12T17:10:18.073547+0000","last_unstale":"2024-09-12T18:33:41.420031+0000","last_undegraded":"2024-09-12T18:33:41.420031+0000","last_fullsized":"2024-09-12T18:33:41.420031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:46.358663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010552039999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'267","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.445636+0000","last_change":"2024-09-12T17:10:30.395390+0000","last_active":"2024-09-12T18:35:59.445636+0000","last_peered":"2024-09-12T18:35:59.445636+0000","last_clean":"2024-09-12T18:35:59.445636+0000","last_became_active":"2024-09-12T17:10:30.395026+0000","last_became_peered":"2024-09-12T17:10:30.395026+0000","last_unstale":"2024-09-12T18:35:59.445636+0000","last_undegraded":"2024-09-12T18:35:59.445636+0000","last_fullsized":"2024-09-12T18:35:59.445636+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:10.168440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10567119,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":452,"num_read_kb":151053,"num_write":946,"num_write_kb":34461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"37'3","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.367419+0000","last_change":"2024-09-12T17:10:34.364363+0000","last_active":"2024-09-12T18:35:21.367419+0000","last_peered":"2024-09-12T18:35:21.367419+0000","last_clean":"2024-09-12T18:35:21.367419+0000","last_became_active":"2024-09-12T17:10:34.363615+0000","last_became_peered":"2024-09-12T17:10:34.363615+0000","last_unstale":"2024-09-12T18:35:21.367419+0000","last_undegraded":"2024-09-12T18:35:21.367419+0000","last_fullsized":"2024-09-12T18:35:21.367419+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:00.136965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":731,"num_read_kb":729,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'738","reported_seq":1453,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.707847+0000","last_change":"2024-09-12T17:10:36.395832+0000","last_active":"2024-09-12T18:35:21.707847+0000","last_peered":"2024-09-12T18:35:21.707847+0000","last_clean":"2024-09-12T18:35:21.707847+0000","last_became_active":"2024-09-12T17:10:36.395060+0000","last_became_peered":"2024-09-12T17:10:36.395060+0000","last_unstale":"2024-09-12T18:35:21.707847+0000","last_undegraded":"2024-09-12T18:35:21.707847+0000","last_fullsized":"2024-09-12T18:35:21.707847+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:34.192269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168921,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1429,"num_read_kb":2955,"num_write":1410,"num_write_kb":1250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.413770+0000","last_change":"2024-09-12T17:10:38.413654+0000","last_active":"2024-09-12T18:33:01.413770+0000","last_peered":"2024-09-12T18:33:01.413770+0000","last_clean":"2024-09-12T18:33:01.413770+0000","last_became_active":"2024-09-12T17:10:38.413042+0000","last_became_peered":"2024-09-12T17:10:38.413042+0000","last_unstale":"2024-09-12T18:33:01.413770+0000","last_undegraded":"2024-09-12T18:33:01.413770+0000","last_fullsized":"2024-09-12T18:33:01.413770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:03.626589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'214","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.891133+0000","last_change":"2024-09-12T17:10:40.416972+0000","last_active":"2024-09-12T18:34:01.891133+0000","last_peered":"2024-09-12T18:34:01.891133+0000","last_clean":"2024-09-12T18:34:01.891133+0000","last_became_active":"2024-09-12T17:10:40.413341+0000","last_became_peered":"2024-09-12T17:10:40.413341+0000","last_unstale":"2024-09-12T18:34:01.891133+0000","last_undegraded":"2024-09-12T18:34:01.891133+0000","last_fullsized":"2024-09-12T18:34:01.891133+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:47.293584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":511,"num_write":461,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'391","reported_seq":1829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.412715+0000","last_change":"2024-09-12T17:10:32.365399+0000","last_active":"2024-09-12T18:32:56.412715+0000","last_peered":"2024-09-12T18:32:56.412715+0000","last_clean":"2024-09-12T18:32:56.412715+0000","last_became_active":"2024-09-12T17:10:32.364798+0000","last_became_peered":"2024-09-12T17:10:32.364798+0000","last_unstale":"2024-09-12T18:32:56.412715+0000","last_undegraded":"2024-09-12T18:32:56.412715+0000","last_fullsized":"2024-09-12T18:32:56.412715+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:26.942345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2015,"num_read_kb":1907,"num_write":451,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.399689+0000","last_change":"2024-09-12T17:10:20.396952+0000","last_active":"2024-09-12T18:32:46.399689+0000","last_peered":"2024-09-12T18:32:46.399689+0000","last_clean":"2024-09-12T18:32:46.399689+0000","last_became_active":"2024-09-12T17:10:18.073016+0000","last_became_peered":"2024-09-12T17:10:18.073016+0000","last_unstale":"2024-09-12T18:32:46.399689+0000","last_undegraded":"2024-09-12T18:32:46.399689+0000","last_fullsized":"2024-09-12T18:32:46.399689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:57.171583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098613699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'291","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.423414+0000","last_change":"2024-09-12T17:10:30.355852+0000","last_active":"2024-09-12T18:33:51.423414+0000","last_peered":"2024-09-12T18:33:51.423414+0000","last_clean":"2024-09-12T18:33:51.423414+0000","last_became_active":"2024-09-12T17:10:30.355237+0000","last_became_peered":"2024-09-12T17:10:30.355237+0000","last_unstale":"2024-09-12T18:33:51.423414+0000","last_undegraded":"2024-09-12T18:33:51.423414+0000","last_fullsized":"2024-09-12T18:33:51.423414+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:24.811371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9738901,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":498,"num_read_kb":28524,"num_write":1102,"num_write_kb":35154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.409737+0000","last_change":"2024-09-12T17:10:34.368316+0000","last_active":"2024-09-12T18:32:56.409737+0000","last_peered":"2024-09-12T18:32:56.409737+0000","last_clean":"2024-09-12T18:32:56.409737+0000","last_became_active":"2024-09-12T17:10:34.366826+0000","last_became_peered":"2024-09-12T17:10:34.366826+0000","last_unstale":"2024-09-12T18:32:56.409737+0000","last_undegraded":"2024-09-12T18:32:56.409737+0000","last_fullsized":"2024-09-12T18:32:56.409737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:41.209887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1366","reported_seq":3339,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.774919+0000","last_change":"2024-09-12T17:10:36.399027+0000","last_active":"2024-09-12T18:35:21.774919+0000","last_peered":"2024-09-12T18:35:21.774919+0000","last_clean":"2024-09-12T18:35:21.774919+0000","last_became_active":"2024-09-12T17:10:36.398283+0000","last_became_peered":"2024-09-12T17:10:36.398283+0000","last_unstale":"2024-09-12T18:35:21.774919+0000","last_undegraded":"2024-09-12T18:35:21.774919+0000","last_fullsized":"2024-09-12T18:35:21.774919+0000","mapping_epoch":31,"log_start":"268'1300","ondisk_log_start":"268'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":1300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:36.074991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186915,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2152,"num_read_kb":3818,"num_write":1268,"num_write_kb":1074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.394022+0000","last_change":"2024-09-12T17:10:38.407976+0000","last_active":"2024-09-12T18:32:21.394022+0000","last_peered":"2024-09-12T18:32:21.394022+0000","last_clean":"2024-09-12T18:32:21.394022+0000","last_became_active":"2024-09-12T17:10:38.407002+0000","last_became_peered":"2024-09-12T17:10:38.407002+0000","last_unstale":"2024-09-12T18:32:21.394022+0000","last_undegraded":"2024-09-12T18:32:21.394022+0000","last_fullsized":"2024-09-12T18:32:21.394022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:39.734129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'125","reported_seq":641,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.101124+0000","last_change":"2024-09-12T17:10:40.771071+0000","last_active":"2024-09-12T18:34:02.101124+0000","last_peered":"2024-09-12T18:34:02.101124+0000","last_clean":"2024-09-12T18:34:02.101124+0000","last_became_active":"2024-09-12T17:10:40.770362+0000","last_became_peered":"2024-09-12T17:10:40.770362+0000","last_unstale":"2024-09-12T18:34:02.101124+0000","last_undegraded":"2024-09-12T18:34:02.101124+0000","last_fullsized":"2024-09-12T18:34:02.101124+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:15.034623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":150,"num_write":307,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'424","reported_seq":2035,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:59.053173+0000","last_change":"2024-09-12T17:10:32.365161+0000","last_active":"2024-09-12T18:32:59.053173+0000","last_peered":"2024-09-12T18:32:59.053173+0000","last_clean":"2024-09-12T18:32:59.053173+0000","last_became_active":"2024-09-12T17:10:32.361184+0000","last_became_peered":"2024-09-12T17:10:32.361184+0000","last_unstale":"2024-09-12T18:32:59.053173+0000","last_undegraded":"2024-09-12T18:32:59.053173+0000","last_fullsized":"2024-09-12T18:32:59.053173+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:45.804037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2375,"num_read_kb":2259,"num_write":493,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":547,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.808600+0000","last_change":"2024-09-12T17:10:20.089534+0000","last_active":"2024-09-12T18:33:41.808600+0000","last_peered":"2024-09-12T18:33:41.808600+0000","last_clean":"2024-09-12T18:33:41.808600+0000","last_became_active":"2024-09-12T17:10:18.210168+0000","last_became_peered":"2024-09-12T17:10:18.210168+0000","last_unstale":"2024-09-12T18:33:41.808600+0000","last_undegraded":"2024-09-12T18:33:41.808600+0000","last_fullsized":"2024-09-12T18:33:41.808600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:46.762850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001219171,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'263","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.639527+0000","last_change":"2024-09-12T17:10:30.405973+0000","last_active":"2024-09-12T18:32:51.639527+0000","last_peered":"2024-09-12T18:32:51.639527+0000","last_clean":"2024-09-12T18:32:51.639527+0000","last_became_active":"2024-09-12T17:10:30.405641+0000","last_became_peered":"2024-09-12T17:10:30.405641+0000","last_unstale":"2024-09-12T18:32:51.639527+0000","last_undegraded":"2024-09-12T18:32:51.639527+0000","last_fullsized":"2024-09-12T18:32:51.639527+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:49.395336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7452521,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":363,"num_read_kb":15806,"num_write":940,"num_write_kb":36297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.799717+0000","last_change":"2024-09-12T17:10:34.368266+0000","last_active":"2024-09-12T18:32:56.799717+0000","last_peered":"2024-09-12T18:32:56.799717+0000","last_clean":"2024-09-12T18:32:56.799717+0000","last_became_active":"2024-09-12T17:10:34.367870+0000","last_became_peered":"2024-09-12T17:10:34.367870+0000","last_unstale":"2024-09-12T18:32:56.799717+0000","last_undegraded":"2024-09-12T18:32:56.799717+0000","last_fullsized":"2024-09-12T18:32:56.799717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:51.335257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'345","reported_seq":1937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.757234+0000","last_change":"2024-09-12T17:10:36.923069+0000","last_active":"2024-09-12T18:35:21.757234+0000","last_peered":"2024-09-12T18:35:21.757234+0000","last_clean":"2024-09-12T18:35:21.757234+0000","last_became_active":"2024-09-12T17:10:36.922321+0000","last_became_peered":"2024-09-12T17:10:36.922321+0000","last_unstale":"2024-09-12T18:35:21.757234+0000","last_undegraded":"2024-09-12T18:35:21.757234+0000","last_fullsized":"2024-09-12T18:35:21.757234+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:40.884164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":291,"num_read_kb":281,"num_write":273,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.400401+0000","last_change":"2024-09-12T17:10:38.415538+0000","last_active":"2024-09-12T18:31:56.400401+0000","last_peered":"2024-09-12T18:31:56.400401+0000","last_clean":"2024-09-12T18:31:56.400401+0000","last_became_active":"2024-09-12T17:10:38.413459+0000","last_became_peered":"2024-09-12T17:10:38.413459+0000","last_unstale":"2024-09-12T18:31:56.400401+0000","last_undegraded":"2024-09-12T18:31:56.400401+0000","last_fullsized":"2024-09-12T18:31:56.400401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:23.614741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'231","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.307485+0000","last_change":"2024-09-12T17:10:40.415650+0000","last_active":"2024-09-12T18:34:00.307485+0000","last_peered":"2024-09-12T18:34:00.307485+0000","last_clean":"2024-09-12T18:34:00.307485+0000","last_became_active":"2024-09-12T17:10:40.414712+0000","last_became_peered":"2024-09-12T17:10:40.414712+0000","last_unstale":"2024-09-12T18:34:00.307485+0000","last_undegraded":"2024-09-12T18:34:00.307485+0000","last_fullsized":"2024-09-12T18:34:00.307485+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:26.385614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":496,"num_read_kb":517,"num_write":496,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'462","reported_seq":1980,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.835567+0000","last_change":"2024-09-12T17:10:32.361139+0000","last_active":"2024-09-12T18:33:59.835567+0000","last_peered":"2024-09-12T18:33:59.835567+0000","last_clean":"2024-09-12T18:33:59.835567+0000","last_became_active":"2024-09-12T17:10:32.360853+0000","last_became_peered":"2024-09-12T17:10:32.360853+0000","last_unstale":"2024-09-12T18:33:59.835567+0000","last_undegraded":"2024-09-12T18:33:59.835567+0000","last_fullsized":"2024-09-12T18:33:59.835567+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:48.894459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2461,"num_read_kb":2304,"num_write":540,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":542,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.419958+0000","last_change":"2024-09-12T17:10:20.095430+0000","last_active":"2024-09-12T18:33:41.419958+0000","last_peered":"2024-09-12T18:33:41.419958+0000","last_clean":"2024-09-12T18:33:41.419958+0000","last_became_active":"2024-09-12T17:10:18.072719+0000","last_became_peered":"2024-09-12T17:10:18.072719+0000","last_unstale":"2024-09-12T18:33:41.419958+0000","last_undegraded":"2024-09-12T18:33:41.419958+0000","last_fullsized":"2024-09-12T18:33:41.419958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:14.576392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022239349999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'352","reported_seq":1062,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.603931+0000","last_change":"2024-09-12T17:10:30.358580+0000","last_active":"2024-09-12T18:36:00.603931+0000","last_peered":"2024-09-12T18:36:00.603931+0000","last_clean":"2024-09-12T18:36:00.603931+0000","last_became_active":"2024-09-12T17:10:30.354850+0000","last_became_peered":"2024-09-12T17:10:30.354850+0000","last_unstale":"2024-09-12T18:36:00.603931+0000","last_undegraded":"2024-09-12T18:36:00.603931+0000","last_fullsized":"2024-09-12T18:36:00.603931+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:31.523584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4245763,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":577,"num_read_kb":44142,"num_write":1291,"num_write_kb":42918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.402501+0000","last_change":"2024-09-12T17:10:34.359604+0000","last_active":"2024-09-12T18:32:06.402501+0000","last_peered":"2024-09-12T18:32:06.402501+0000","last_clean":"2024-09-12T18:32:06.402501+0000","last_became_active":"2024-09-12T17:10:34.358926+0000","last_became_peered":"2024-09-12T17:10:34.358926+0000","last_unstale":"2024-09-12T18:32:06.402501+0000","last_undegraded":"2024-09-12T18:32:06.402501+0000","last_fullsized":"2024-09-12T18:32:06.402501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:31.601357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'171","reported_seq":755,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:09.437593+0000","last_change":"2024-09-12T17:10:36.396445+0000","last_active":"2024-09-12T18:35:09.437593+0000","last_peered":"2024-09-12T18:35:09.437593+0000","last_clean":"2024-09-12T18:35:09.437593+0000","last_became_active":"2024-09-12T17:10:36.395658+0000","last_became_peered":"2024-09-12T17:10:36.395658+0000","last_unstale":"2024-09-12T18:35:09.437593+0000","last_undegraded":"2024-09-12T18:35:09.437593+0000","last_fullsized":"2024-09-12T18:35:09.437593+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:53.937530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":215,"num_read_kb":209,"num_write":154,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.582583+0000","last_change":"2024-09-12T17:10:38.414758+0000","last_active":"2024-09-12T18:33:01.582583+0000","last_peered":"2024-09-12T18:33:01.582583+0000","last_clean":"2024-09-12T18:33:01.582583+0000","last_became_active":"2024-09-12T17:10:38.414045+0000","last_became_peered":"2024-09-12T17:10:38.414045+0000","last_unstale":"2024-09-12T18:33:01.582583+0000","last_undegraded":"2024-09-12T18:33:01.582583+0000","last_fullsized":"2024-09-12T18:33:01.582583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:17.692176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'151","reported_seq":739,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.894081+0000","last_change":"2024-09-12T17:10:40.422450+0000","last_active":"2024-09-12T18:33:10.894081+0000","last_peered":"2024-09-12T18:33:10.894081+0000","last_clean":"2024-09-12T18:33:10.894081+0000","last_became_active":"2024-09-12T17:10:40.420995+0000","last_became_peered":"2024-09-12T17:10:40.420995+0000","last_unstale":"2024-09-12T18:33:10.894081+0000","last_undegraded":"2024-09-12T18:33:10.894081+0000","last_fullsized":"2024-09-12T18:33:10.894081+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:49.058635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":383,"num_read_kb":354,"num_write":368,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'864","reported_seq":2541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.475561+0000","last_change":"2024-09-12T17:10:32.362173+0000","last_active":"2024-09-12T18:35:20.475561+0000","last_peered":"2024-09-12T18:35:20.475561+0000","last_clean":"2024-09-12T18:35:20.475561+0000","last_became_active":"2024-09-12T17:10:32.361696+0000","last_became_peered":"2024-09-12T17:10:32.361696+0000","last_unstale":"2024-09-12T18:35:20.475561+0000","last_undegraded":"2024-09-12T18:35:20.475561+0000","last_fullsized":"2024-09-12T18:35:20.475561+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:49.188465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4191,"num_read_kb":3806,"num_write":1162,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'248","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.535429+0000","last_change":"2024-09-12T17:10:30.355665+0000","last_active":"2024-09-12T18:32:56.535429+0000","last_peered":"2024-09-12T18:32:56.535429+0000","last_clean":"2024-09-12T18:32:56.535429+0000","last_became_active":"2024-09-12T17:10:30.354730+0000","last_became_peered":"2024-09-12T17:10:30.354730+0000","last_unstale":"2024-09-12T18:32:56.535429+0000","last_undegraded":"2024-09-12T18:32:56.535429+0000","last_fullsized":"2024-09-12T18:32:56.535429+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:16.166371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4289546,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":322,"num_read_kb":12992,"num_write":862,"num_write_kb":30670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.651271+0000","last_change":"2024-09-12T17:10:20.100416+0000","last_active":"2024-09-12T18:33:41.651271+0000","last_peered":"2024-09-12T18:33:41.651271+0000","last_clean":"2024-09-12T18:33:41.651271+0000","last_became_active":"2024-09-12T17:10:18.209658+0000","last_became_peered":"2024-09-12T17:10:18.209658+0000","last_unstale":"2024-09-12T18:33:41.651271+0000","last_undegraded":"2024-09-12T18:33:41.651271+0000","last_fullsized":"2024-09-12T18:33:41.651271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:28.458806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010531659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.399240+0000","last_change":"2024-09-12T17:10:34.362549+0000","last_active":"2024-09-12T18:31:51.399240+0000","last_peered":"2024-09-12T18:31:51.399240+0000","last_clean":"2024-09-12T18:31:51.399240+0000","last_became_active":"2024-09-12T17:10:34.361845+0000","last_became_peered":"2024-09-12T17:10:34.361845+0000","last_unstale":"2024-09-12T18:31:51.399240+0000","last_undegraded":"2024-09-12T18:31:51.399240+0000","last_fullsized":"2024-09-12T18:31:51.399240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:05.948451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'668","reported_seq":1370,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.686718+0000","last_change":"2024-09-12T17:10:36.400065+0000","last_active":"2024-09-12T18:35:21.686718+0000","last_peered":"2024-09-12T18:35:21.686718+0000","last_clean":"2024-09-12T18:35:21.686718+0000","last_became_active":"2024-09-12T17:10:36.398917+0000","last_became_peered":"2024-09-12T17:10:36.398917+0000","last_unstale":"2024-09-12T18:35:21.686718+0000","last_undegraded":"2024-09-12T18:35:21.686718+0000","last_fullsized":"2024-09-12T18:35:21.686718+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":600,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.596681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130155,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1807,"num_read_kb":2951,"num_write":2388,"num_write_kb":2197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:55.577010+0000","last_change":"2024-09-12T17:10:38.401627+0000","last_active":"2024-09-12T18:31:55.577010+0000","last_peered":"2024-09-12T18:31:55.577010+0000","last_clean":"2024-09-12T18:31:55.577010+0000","last_became_active":"2024-09-12T17:10:38.400868+0000","last_became_peered":"2024-09-12T17:10:38.400868+0000","last_unstale":"2024-09-12T18:31:55.577010+0000","last_undegraded":"2024-09-12T18:31:55.577010+0000","last_fullsized":"2024-09-12T18:31:55.577010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:50.604824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'135","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.773259+0000","last_change":"2024-09-12T17:10:40.774323+0000","last_active":"2024-09-12T18:33:55.773259+0000","last_peered":"2024-09-12T18:33:55.773259+0000","last_clean":"2024-09-12T18:33:55.773259+0000","last_became_active":"2024-09-12T17:10:40.771185+0000","last_became_peered":"2024-09-12T17:10:40.771185+0000","last_unstale":"2024-09-12T18:33:55.773259+0000","last_undegraded":"2024-09-12T18:33:55.773259+0000","last_fullsized":"2024-09-12T18:33:55.773259+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:03.269283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":180,"num_write":328,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'473","reported_seq":2162,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.467099+0000","last_change":"2024-09-12T17:10:32.355390+0000","last_active":"2024-09-12T18:35:20.467099+0000","last_peered":"2024-09-12T18:35:20.467099+0000","last_clean":"2024-09-12T18:35:20.467099+0000","last_became_active":"2024-09-12T17:10:32.354795+0000","last_became_peered":"2024-09-12T17:10:32.354795+0000","last_unstale":"2024-09-12T18:35:20.467099+0000","last_undegraded":"2024-09-12T18:35:20.467099+0000","last_fullsized":"2024-09-12T18:35:20.467099+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:17.098153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2620,"num_read_kb":2476,"num_write":562,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'272","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.653512+0000","last_change":"2024-09-12T17:10:30.405893+0000","last_active":"2024-09-12T18:33:51.653512+0000","last_peered":"2024-09-12T18:33:51.653512+0000","last_clean":"2024-09-12T18:33:51.653512+0000","last_became_active":"2024-09-12T17:10:30.405460+0000","last_became_peered":"2024-09-12T17:10:30.405460+0000","last_unstale":"2024-09-12T18:33:51.653512+0000","last_undegraded":"2024-09-12T18:33:51.653512+0000","last_fullsized":"2024-09-12T18:33:51.653512+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:16.200605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6315397,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":420,"num_read_kb":16852,"num_write":1022,"num_write_kb":30938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:01.389327+0000","last_change":"2024-09-12T17:10:20.397111+0000","last_active":"2024-09-12T18:32:01.389327+0000","last_peered":"2024-09-12T18:32:01.389327+0000","last_clean":"2024-09-12T18:32:01.389327+0000","last_became_active":"2024-09-12T17:10:18.208762+0000","last_became_peered":"2024-09-12T17:10:18.208762+0000","last_unstale":"2024-09-12T18:32:01.389327+0000","last_undegraded":"2024-09-12T18:32:01.389327+0000","last_fullsized":"2024-09-12T18:32:01.389327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:07.303527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091554,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.567539+0000","last_change":"2024-09-12T17:10:34.356303+0000","last_active":"2024-09-12T18:31:51.567539+0000","last_peered":"2024-09-12T18:31:51.567539+0000","last_clean":"2024-09-12T18:31:51.567539+0000","last_became_active":"2024-09-12T17:10:34.355590+0000","last_became_peered":"2024-09-12T17:10:34.355590+0000","last_unstale":"2024-09-12T18:31:51.567539+0000","last_undegraded":"2024-09-12T18:31:51.567539+0000","last_fullsized":"2024-09-12T18:31:51.567539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:49.016297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'223","reported_seq":831,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.654620+0000","last_change":"2024-09-12T17:10:36.922068+0000","last_active":"2024-09-12T18:33:56.654620+0000","last_peered":"2024-09-12T18:33:56.654620+0000","last_clean":"2024-09-12T18:33:56.654620+0000","last_became_active":"2024-09-12T17:10:36.921234+0000","last_became_peered":"2024-09-12T17:10:36.921234+0000","last_unstale":"2024-09-12T18:33:56.654620+0000","last_undegraded":"2024-09-12T18:33:56.654620+0000","last_fullsized":"2024-09-12T18:33:56.654620+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:56.087478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":277,"num_write":196,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'786","reported_seq":2941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.780843+0000","last_change":"2024-09-12T17:10:38.396157+0000","last_active":"2024-09-12T18:35:21.780843+0000","last_peered":"2024-09-12T18:35:21.780843+0000","last_clean":"2024-09-12T18:35:21.780843+0000","last_became_active":"2024-09-12T17:10:38.395439+0000","last_became_peered":"2024-09-12T17:10:38.395439+0000","last_unstale":"2024-09-12T18:35:21.780843+0000","last_undegraded":"2024-09-12T18:35:21.780843+0000","last_fullsized":"2024-09-12T18:35:21.780843+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:28.386160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'180","reported_seq":718,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428311+0000","last_change":"2024-09-12T17:10:40.770840+0000","last_active":"2024-09-12T18:34:19.428311+0000","last_peered":"2024-09-12T18:34:19.428311+0000","last_clean":"2024-09-12T18:34:19.428311+0000","last_became_active":"2024-09-12T17:10:40.770042+0000","last_became_peered":"2024-09-12T17:10:40.770042+0000","last_unstale":"2024-09-12T18:34:19.428311+0000","last_undegraded":"2024-09-12T18:34:19.428311+0000","last_fullsized":"2024-09-12T18:34:19.428311+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:24.561136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":293,"num_read_kb":273,"num_write":449,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'899","reported_seq":2633,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.926166+0000","last_change":"2024-09-12T17:10:32.383031+0000","last_active":"2024-09-12T18:33:59.926166+0000","last_peered":"2024-09-12T18:33:59.926166+0000","last_clean":"2024-09-12T18:33:59.926166+0000","last_became_active":"2024-09-12T17:10:32.382755+0000","last_became_peered":"2024-09-12T17:10:32.382755+0000","last_unstale":"2024-09-12T18:33:59.926166+0000","last_undegraded":"2024-09-12T18:33:59.926166+0000","last_fullsized":"2024-09-12T18:33:59.926166+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:55.069573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4651,"num_read_kb":4208,"num_write":1244,"num_write_kb":526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'264","reported_seq":895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.428295+0000","last_change":"2024-09-12T17:10:30.365199+0000","last_active":"2024-09-12T18:35:59.428295+0000","last_peered":"2024-09-12T18:35:59.428295+0000","last_clean":"2024-09-12T18:35:59.428295+0000","last_became_active":"2024-09-12T17:10:30.364767+0000","last_became_peered":"2024-09-12T17:10:30.364767+0000","last_unstale":"2024-09-12T18:35:59.428295+0000","last_undegraded":"2024-09-12T18:35:59.428295+0000","last_fullsized":"2024-09-12T18:35:59.428295+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:56.519220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16805003,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":398,"num_read_kb":23955,"num_write":988,"num_write_kb":32355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.637356+0000","last_change":"2024-09-12T17:10:20.100539+0000","last_active":"2024-09-12T18:32:41.637356+0000","last_peered":"2024-09-12T18:32:41.637356+0000","last_clean":"2024-09-12T18:32:41.637356+0000","last_became_active":"2024-09-12T17:10:18.073132+0000","last_became_peered":"2024-09-12T17:10:18.073132+0000","last_unstale":"2024-09-12T18:32:41.637356+0000","last_undegraded":"2024-09-12T18:32:41.637356+0000","last_fullsized":"2024-09-12T18:32:41.637356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:05.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001154721,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605276+0000","last_change":"2024-09-12T17:10:34.349876+0000","last_active":"2024-09-12T18:33:55.605276+0000","last_peered":"2024-09-12T18:33:55.605276+0000","last_clean":"2024-09-12T18:33:55.605276+0000","last_became_active":"2024-09-12T17:10:34.349093+0000","last_became_peered":"2024-09-12T17:10:34.349093+0000","last_unstale":"2024-09-12T18:33:55.605276+0000","last_undegraded":"2024-09-12T18:33:55.605276+0000","last_fullsized":"2024-09-12T18:33:55.605276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:46.757080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'169","reported_seq":748,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:55.577053+0000","last_change":"2024-09-12T17:10:36.391287+0000","last_active":"2024-09-12T18:31:55.577053+0000","last_peered":"2024-09-12T18:31:55.577053+0000","last_clean":"2024-09-12T18:31:55.577053+0000","last_became_active":"2024-09-12T17:10:36.390439+0000","last_became_peered":"2024-09-12T17:10:36.390439+0000","last_unstale":"2024-09-12T18:31:55.577053+0000","last_undegraded":"2024-09-12T18:31:55.577053+0000","last_fullsized":"2024-09-12T18:31:55.577053+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:24.707986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":183,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'804","reported_seq":2855,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.012975+0000","last_change":"2024-09-12T17:10:38.394233+0000","last_active":"2024-09-12T18:35:59.012975+0000","last_peered":"2024-09-12T18:35:59.012975+0000","last_clean":"2024-09-12T18:35:59.012975+0000","last_became_active":"2024-09-12T17:10:38.393426+0000","last_became_peered":"2024-09-12T17:10:38.393426+0000","last_unstale":"2024-09-12T18:35:59.012975+0000","last_undegraded":"2024-09-12T18:35:59.012975+0000","last_fullsized":"2024-09-12T18:35:59.012975+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:37.818377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'254","reported_seq":797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.396389+0000","last_change":"2024-09-12T17:10:40.429154+0000","last_active":"2024-09-12T18:31:41.396389+0000","last_peered":"2024-09-12T18:31:41.396389+0000","last_clean":"2024-09-12T18:31:41.396389+0000","last_became_active":"2024-09-12T17:10:40.423742+0000","last_became_peered":"2024-09-12T17:10:40.423742+0000","last_unstale":"2024-09-12T18:31:41.396389+0000","last_undegraded":"2024-09-12T18:31:41.396389+0000","last_fullsized":"2024-09-12T18:31:41.396389+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:48.699774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":353,"num_read_kb":347,"num_write":533,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'873","reported_seq":2667,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605231+0000","last_change":"2024-09-12T17:10:32.368938+0000","last_active":"2024-09-12T18:33:55.605231+0000","last_peered":"2024-09-12T18:33:55.605231+0000","last_clean":"2024-09-12T18:33:55.605231+0000","last_became_active":"2024-09-12T17:10:32.368217+0000","last_became_peered":"2024-09-12T17:10:32.368217+0000","last_unstale":"2024-09-12T18:33:55.605231+0000","last_undegraded":"2024-09-12T18:33:55.605231+0000","last_fullsized":"2024-09-12T18:33:55.605231+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":800,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:33.300045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4306,"num_read_kb":3903,"num_write":1124,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'304","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411769+0000","last_change":"2024-09-12T17:10:30.362722+0000","last_active":"2024-09-12T18:32:51.411769+0000","last_peered":"2024-09-12T18:32:51.411769+0000","last_clean":"2024-09-12T18:32:51.411769+0000","last_became_active":"2024-09-12T17:10:30.361736+0000","last_became_peered":"2024-09-12T17:10:30.361736+0000","last_unstale":"2024-09-12T18:32:51.411769+0000","last_undegraded":"2024-09-12T18:32:51.411769+0000","last_fullsized":"2024-09-12T18:32:51.411769+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:20.821477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11388570,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":554,"num_read_kb":21637,"num_write":1130,"num_write_kb":30222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.578380+0000","last_change":"2024-09-12T17:10:20.088329+0000","last_active":"2024-09-12T18:32:41.578380+0000","last_peered":"2024-09-12T18:32:41.578380+0000","last_clean":"2024-09-12T18:32:41.578380+0000","last_became_active":"2024-09-12T17:10:18.074669+0000","last_became_peered":"2024-09-12T17:10:18.074669+0000","last_unstale":"2024-09-12T18:32:41.578380+0000","last_undegraded":"2024-09-12T18:32:41.578380+0000","last_fullsized":"2024-09-12T18:32:41.578380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:20.175198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:54.408665+0000","last_change":"2024-09-12T17:10:34.358853+0000","last_active":"2024-09-12T18:32:54.408665+0000","last_peered":"2024-09-12T18:32:54.408665+0000","last_clean":"2024-09-12T18:32:54.408665+0000","last_became_active":"2024-09-12T17:10:34.358250+0000","last_became_peered":"2024-09-12T17:10:34.358250+0000","last_unstale":"2024-09-12T18:32:54.408665+0000","last_undegraded":"2024-09-12T18:32:54.408665+0000","last_fullsized":"2024-09-12T18:32:54.408665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:35.137706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'729","reported_seq":1473,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.677938+0000","last_change":"2024-09-12T17:10:36.921037+0000","last_active":"2024-09-12T18:35:21.677938+0000","last_peered":"2024-09-12T18:35:21.677938+0000","last_clean":"2024-09-12T18:35:21.677938+0000","last_became_active":"2024-09-12T17:10:36.920239+0000","last_became_peered":"2024-09-12T17:10:36.920239+0000","last_unstale":"2024-09-12T18:35:21.677938+0000","last_undegraded":"2024-09-12T18:35:21.677938+0000","last_fullsized":"2024-09-12T18:35:21.677938+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":700,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:47.311658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164600,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1259,"num_read_kb":2698,"num_write":1016,"num_write_kb":809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:54.393429+0000","last_change":"2024-09-12T17:10:38.392174+0000","last_active":"2024-09-12T18:31:54.393429+0000","last_peered":"2024-09-12T18:31:54.393429+0000","last_clean":"2024-09-12T18:31:54.393429+0000","last_became_active":"2024-09-12T17:10:38.391661+0000","last_became_peered":"2024-09-12T17:10:38.391661+0000","last_unstale":"2024-09-12T18:31:54.393429+0000","last_undegraded":"2024-09-12T18:31:54.393429+0000","last_fullsized":"2024-09-12T18:31:54.393429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:44.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'98","reported_seq":607,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.423470+0000","last_change":"2024-09-12T17:10:40.435786+0000","last_active":"2024-09-12T18:33:56.423470+0000","last_peered":"2024-09-12T18:33:56.423470+0000","last_clean":"2024-09-12T18:33:56.423470+0000","last_became_active":"2024-09-12T17:10:40.435114+0000","last_became_peered":"2024-09-12T17:10:40.435114+0000","last_unstale":"2024-09-12T18:33:56.423470+0000","last_undegraded":"2024-09-12T18:33:56.423470+0000","last_fullsized":"2024-09-12T18:33:56.423470+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:14.936129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":238,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'127","reported_seq":723,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.426151+0000","last_change":"2024-09-12T17:10:40.422967+0000","last_active":"2024-09-12T18:34:01.426151+0000","last_peered":"2024-09-12T18:34:01.426151+0000","last_clean":"2024-09-12T18:34:01.426151+0000","last_became_active":"2024-09-12T17:10:40.417972+0000","last_became_peered":"2024-09-12T17:10:40.417972+0000","last_unstale":"2024-09-12T18:34:01.426151+0000","last_undegraded":"2024-09-12T18:34:01.426151+0000","last_fullsized":"2024-09-12T18:34:01.426151+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:44.119704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":319,"num_read_kb":297,"num_write":314,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'794","reported_seq":2315,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.135941+0000","last_change":"2024-09-12T17:10:32.368759+0000","last_active":"2024-09-12T18:33:06.135941+0000","last_peered":"2024-09-12T18:33:06.135941+0000","last_clean":"2024-09-12T18:33:06.135941+0000","last_became_active":"2024-09-12T17:10:32.368063+0000","last_became_peered":"2024-09-12T17:10:32.368063+0000","last_unstale":"2024-09-12T18:33:06.135941+0000","last_undegraded":"2024-09-12T18:33:06.135941+0000","last_fullsized":"2024-09-12T18:33:06.135941+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:01.539950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3740,"num_read_kb":3358,"num_write":1050,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'344","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.586131+0000","last_change":"2024-09-12T17:10:30.395497+0000","last_active":"2024-09-12T18:36:00.586131+0000","last_peered":"2024-09-12T18:36:00.586131+0000","last_clean":"2024-09-12T18:36:00.586131+0000","last_became_active":"2024-09-12T17:10:30.394117+0000","last_became_peered":"2024-09-12T17:10:30.394117+0000","last_unstale":"2024-09-12T18:36:00.586131+0000","last_undegraded":"2024-09-12T18:36:00.586131+0000","last_fullsized":"2024-09-12T18:36:00.586131+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:18.220639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357778,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":497,"num_read_kb":2118,"num_write":1119,"num_write_kb":20675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.631995+0000","last_change":"2024-09-12T17:10:34.360352+0000","last_active":"2024-09-12T18:32:16.631995+0000","last_peered":"2024-09-12T18:32:16.631995+0000","last_clean":"2024-09-12T18:32:16.631995+0000","last_became_active":"2024-09-12T17:10:34.359923+0000","last_became_peered":"2024-09-12T17:10:34.359923+0000","last_unstale":"2024-09-12T18:32:16.631995+0000","last_undegraded":"2024-09-12T18:32:16.631995+0000","last_fullsized":"2024-09-12T18:32:16.631995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:14.364530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'303","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.376919+0000","last_change":"2024-09-12T17:10:36.395453+0000","last_active":"2024-09-12T18:35:59.376919+0000","last_peered":"2024-09-12T18:35:59.376919+0000","last_clean":"2024-09-12T18:35:59.376919+0000","last_became_active":"2024-09-12T17:10:36.394731+0000","last_became_peered":"2024-09-12T17:10:36.394731+0000","last_unstale":"2024-09-12T18:35:59.376919+0000","last_undegraded":"2024-09-12T18:35:59.376919+0000","last_fullsized":"2024-09-12T18:35:59.376919+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:03.802691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56497,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":1193,"num_write":404,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:19.399496+0000","last_change":"2024-09-12T17:10:38.393630+0000","last_active":"2024-09-12T18:32:19.399496+0000","last_peered":"2024-09-12T18:32:19.399496+0000","last_clean":"2024-09-12T18:32:19.399496+0000","last_became_active":"2024-09-12T17:10:38.393112+0000","last_became_peered":"2024-09-12T17:10:38.393112+0000","last_unstale":"2024-09-12T18:32:19.399496+0000","last_undegraded":"2024-09-12T18:32:19.399496+0000","last_fullsized":"2024-09-12T18:32:19.399496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:11.857461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'117","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.411553+0000","last_change":"2024-09-12T17:10:40.430432+0000","last_active":"2024-09-12T18:33:04.411553+0000","last_peered":"2024-09-12T18:33:04.411553+0000","last_clean":"2024-09-12T18:33:04.411553+0000","last_became_active":"2024-09-12T17:10:40.429366+0000","last_became_peered":"2024-09-12T17:10:40.429366+0000","last_unstale":"2024-09-12T18:33:04.411553+0000","last_undegraded":"2024-09-12T18:33:04.411553+0000","last_fullsized":"2024-09-12T18:33:04.411553+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:03.623489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":137,"num_write":282,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'499","reported_seq":2099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.813533+0000","last_change":"2024-09-12T17:10:32.366756+0000","last_active":"2024-09-12T18:34:01.813533+0000","last_peered":"2024-09-12T18:34:01.813533+0000","last_clean":"2024-09-12T18:34:01.813533+0000","last_became_active":"2024-09-12T17:10:32.364033+0000","last_became_peered":"2024-09-12T17:10:32.364033+0000","last_unstale":"2024-09-12T18:34:01.813533+0000","last_undegraded":"2024-09-12T18:34:01.813533+0000","last_fullsized":"2024-09-12T18:34:01.813533+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:44.259351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2497,"num_read_kb":2341,"num_write":588,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'238","reported_seq":943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.927982+0000","last_change":"2024-09-12T17:10:30.406049+0000","last_active":"2024-09-12T18:33:38.927982+0000","last_peered":"2024-09-12T18:33:38.927982+0000","last_clean":"2024-09-12T18:33:38.927982+0000","last_became_active":"2024-09-12T17:10:30.405137+0000","last_became_peered":"2024-09-12T17:10:30.405137+0000","last_unstale":"2024-09-12T18:33:38.927982+0000","last_undegraded":"2024-09-12T18:33:38.927982+0000","last_fullsized":"2024-09-12T18:33:38.927982+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:51.883704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25232252,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":537,"num_read_kb":36707,"num_write":900,"num_write_kb":52863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:14.398461+0000","last_change":"2024-09-12T17:10:34.356731+0000","last_active":"2024-09-12T18:32:14.398461+0000","last_peered":"2024-09-12T18:32:14.398461+0000","last_clean":"2024-09-12T18:32:14.398461+0000","last_became_active":"2024-09-12T17:10:34.355684+0000","last_became_peered":"2024-09-12T17:10:34.355684+0000","last_unstale":"2024-09-12T18:32:14.398461+0000","last_undegraded":"2024-09-12T18:32:14.398461+0000","last_fullsized":"2024-09-12T18:32:14.398461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:22.182263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'58","reported_seq":588,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.404344+0000","last_change":"2024-09-12T17:10:36.402010+0000","last_active":"2024-09-12T18:32:16.404344+0000","last_peered":"2024-09-12T18:32:16.404344+0000","last_clean":"2024-09-12T18:32:16.404344+0000","last_became_active":"2024-09-12T17:10:36.400358+0000","last_became_peered":"2024-09-12T17:10:36.400358+0000","last_unstale":"2024-09-12T18:32:16.404344+0000","last_undegraded":"2024-09-12T18:32:16.404344+0000","last_fullsized":"2024-09-12T18:32:16.404344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:54.812329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":54,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.393889+0000","last_change":"2024-09-12T17:10:38.405067+0000","last_active":"2024-09-12T18:32:21.393889+0000","last_peered":"2024-09-12T18:32:21.393889+0000","last_clean":"2024-09-12T18:32:21.393889+0000","last_became_active":"2024-09-12T17:10:38.404309+0000","last_became_peered":"2024-09-12T17:10:38.404309+0000","last_unstale":"2024-09-12T18:32:21.393889+0000","last_undegraded":"2024-09-12T18:32:21.393889+0000","last_fullsized":"2024-09-12T18:32:21.393889+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:21.478649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'194","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.504598+0000","last_change":"2024-09-12T17:10:40.422558+0000","last_active":"2024-09-12T18:35:20.504598+0000","last_peered":"2024-09-12T18:35:20.504598+0000","last_clean":"2024-09-12T18:35:20.504598+0000","last_became_active":"2024-09-12T17:10:40.418473+0000","last_became_peered":"2024-09-12T17:10:40.418473+0000","last_unstale":"2024-09-12T18:35:20.504598+0000","last_undegraded":"2024-09-12T18:35:20.504598+0000","last_fullsized":"2024-09-12T18:35:20.504598+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:29.988283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":350,"num_read_kb":341,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'358","reported_seq":1681,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:39.694476+0000","last_change":"2024-09-12T17:10:32.383157+0000","last_active":"2024-09-12T18:32:39.694476+0000","last_peered":"2024-09-12T18:32:39.694476+0000","last_clean":"2024-09-12T18:32:39.694476+0000","last_became_active":"2024-09-12T17:10:32.382581+0000","last_became_peered":"2024-09-12T17:10:32.382581+0000","last_unstale":"2024-09-12T18:32:39.694476+0000","last_undegraded":"2024-09-12T18:32:39.694476+0000","last_fullsized":"2024-09-12T18:32:39.694476+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:16.772362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1854,"num_read_kb":1737,"num_write":414,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'301","reported_seq":974,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.406182+0000","last_change":"2024-09-12T17:10:30.375484+0000","last_active":"2024-09-12T18:32:41.406182+0000","last_peered":"2024-09-12T18:32:41.406182+0000","last_clean":"2024-09-12T18:32:41.406182+0000","last_became_active":"2024-09-12T17:10:30.374846+0000","last_became_peered":"2024-09-12T17:10:30.374846+0000","last_unstale":"2024-09-12T18:32:41.406182+0000","last_undegraded":"2024-09-12T18:32:41.406182+0000","last_fullsized":"2024-09-12T18:32:41.406182+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:37.286683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3700245,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":543,"num_read_kb":15626,"num_write":1146,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.392627+0000","last_change":"2024-09-12T17:10:34.362906+0000","last_active":"2024-09-12T18:32:16.392627+0000","last_peered":"2024-09-12T18:32:16.392627+0000","last_clean":"2024-09-12T18:32:16.392627+0000","last_became_active":"2024-09-12T17:10:34.362168+0000","last_became_peered":"2024-09-12T17:10:34.362168+0000","last_unstale":"2024-09-12T18:32:16.392627+0000","last_undegraded":"2024-09-12T18:32:16.392627+0000","last_fullsized":"2024-09-12T18:32:16.392627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:22.148212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'376","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.680160+0000","last_change":"2024-09-12T17:10:36.395016+0000","last_active":"2024-09-12T18:35:21.680160+0000","last_peered":"2024-09-12T18:35:21.680160+0000","last_clean":"2024-09-12T18:35:21.680160+0000","last_became_active":"2024-09-12T17:10:36.394639+0000","last_became_peered":"2024-09-12T17:10:36.394639+0000","last_unstale":"2024-09-12T18:35:21.680160+0000","last_undegraded":"2024-09-12T18:35:21.680160+0000","last_fullsized":"2024-09-12T18:35:21.680160+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:40.165567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85752,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":599,"num_read_kb":1247,"num_write":486,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.574124+0000","last_change":"2024-09-12T17:10:38.413916+0000","last_active":"2024-09-12T18:32:21.574124+0000","last_peered":"2024-09-12T18:32:21.574124+0000","last_clean":"2024-09-12T18:32:21.574124+0000","last_became_active":"2024-09-12T17:10:38.413131+0000","last_became_peered":"2024-09-12T17:10:38.413131+0000","last_unstale":"2024-09-12T18:32:21.574124+0000","last_undegraded":"2024-09-12T18:32:21.574124+0000","last_fullsized":"2024-09-12T18:32:21.574124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:09.828750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'132","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.413271+0000","last_change":"2024-09-12T17:10:40.429935+0000","last_active":"2024-09-12T18:33:11.413271+0000","last_peered":"2024-09-12T18:33:11.413271+0000","last_clean":"2024-09-12T18:33:11.413271+0000","last_became_active":"2024-09-12T17:10:40.429224+0000","last_became_peered":"2024-09-12T17:10:40.429224+0000","last_unstale":"2024-09-12T18:33:11.413271+0000","last_undegraded":"2024-09-12T18:33:11.413271+0000","last_fullsized":"2024-09-12T18:33:11.413271+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:11.523864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'949","reported_seq":2625,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.876011+0000","last_change":"2024-09-12T17:10:32.369486+0000","last_active":"2024-09-12T18:33:10.876011+0000","last_peered":"2024-09-12T18:33:10.876011+0000","last_clean":"2024-09-12T18:33:10.876011+0000","last_became_active":"2024-09-12T17:10:32.369282+0000","last_became_peered":"2024-09-12T17:10:32.369282+0000","last_unstale":"2024-09-12T18:33:10.876011+0000","last_undegraded":"2024-09-12T18:33:10.876011+0000","last_fullsized":"2024-09-12T18:33:10.876011+0000","mapping_epoch":27,"log_start":"268'900","ondisk_log_start":"268'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":900,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:33.793287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4532,"num_read_kb":4046,"num_write":1302,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'295","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.327151+0000","last_change":"2024-09-12T17:10:30.357595+0000","last_active":"2024-09-12T18:33:19.327151+0000","last_peered":"2024-09-12T18:33:19.327151+0000","last_clean":"2024-09-12T18:33:19.327151+0000","last_became_active":"2024-09-12T17:10:30.356383+0000","last_became_peered":"2024-09-12T17:10:30.356383+0000","last_unstale":"2024-09-12T18:33:19.327151+0000","last_undegraded":"2024-09-12T18:33:19.327151+0000","last_fullsized":"2024-09-12T18:33:19.327151+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:13.378425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10048763,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":469,"num_read_kb":17276,"num_write":1078,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.573012+0000","last_change":"2024-09-12T17:10:34.364021+0000","last_active":"2024-09-12T18:32:16.573012+0000","last_peered":"2024-09-12T18:32:16.573012+0000","last_clean":"2024-09-12T18:32:16.573012+0000","last_became_active":"2024-09-12T17:10:34.363279+0000","last_became_peered":"2024-09-12T17:10:34.363279+0000","last_unstale":"2024-09-12T18:32:16.573012+0000","last_undegraded":"2024-09-12T18:32:16.573012+0000","last_fullsized":"2024-09-12T18:32:16.573012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:56.824582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'315","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:36.427729+0000","last_change":"2024-09-12T17:10:36.397496+0000","last_active":"2024-09-12T18:34:36.427729+0000","last_peered":"2024-09-12T18:34:36.427729+0000","last_clean":"2024-09-12T18:34:36.427729+0000","last_became_active":"2024-09-12T17:10:36.396758+0000","last_became_peered":"2024-09-12T17:10:36.396758+0000","last_unstale":"2024-09-12T18:34:36.427729+0000","last_undegraded":"2024-09-12T18:34:36.427729+0000","last_fullsized":"2024-09-12T18:34:36.427729+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:17.261131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74627,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":1150,"num_write":436,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.405399+0000","last_change":"2024-09-12T17:10:38.414645+0000","last_active":"2024-09-12T18:32:21.405399+0000","last_peered":"2024-09-12T18:32:21.405399+0000","last_clean":"2024-09-12T18:32:21.405399+0000","last_became_active":"2024-09-12T17:10:38.413004+0000","last_became_peered":"2024-09-12T17:10:38.413004+0000","last_unstale":"2024-09-12T18:32:21.405399+0000","last_undegraded":"2024-09-12T18:32:21.405399+0000","last_fullsized":"2024-09-12T18:32:21.405399+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:16.768442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'438","reported_seq":1941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:59.060285+0000","last_change":"2024-09-12T17:10:32.351572+0000","last_active":"2024-09-12T18:32:59.060285+0000","last_peered":"2024-09-12T18:32:59.060285+0000","last_clean":"2024-09-12T18:32:59.060285+0000","last_became_active":"2024-09-12T17:10:32.350751+0000","last_became_peered":"2024-09-12T17:10:32.350751+0000","last_unstale":"2024-09-12T18:32:59.060285+0000","last_undegraded":"2024-09-12T18:32:59.060285+0000","last_fullsized":"2024-09-12T18:32:59.060285+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:37.740261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2256,"num_read_kb":2119,"num_write":496,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'232","reported_seq":879,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.353393+0000","last_change":"2024-09-12T17:10:30.353713+0000","last_active":"2024-09-12T18:35:59.353393+0000","last_peered":"2024-09-12T18:35:59.353393+0000","last_clean":"2024-09-12T18:35:59.353393+0000","last_became_active":"2024-09-12T17:10:30.353308+0000","last_became_peered":"2024-09-12T17:10:30.353308+0000","last_unstale":"2024-09-12T18:35:59.353393+0000","last_undegraded":"2024-09-12T18:35:59.353393+0000","last_fullsized":"2024-09-12T18:35:59.353393+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:18.517236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1690410,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":355,"num_read_kb":20512,"num_write":804,"num_write_kb":25251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411828+0000","last_change":"2024-09-12T17:10:34.358634+0000","last_active":"2024-09-12T18:32:51.411828+0000","last_peered":"2024-09-12T18:32:51.411828+0000","last_clean":"2024-09-12T18:32:51.411828+0000","last_became_active":"2024-09-12T17:10:34.357883+0000","last_became_peered":"2024-09-12T17:10:34.357883+0000","last_unstale":"2024-09-12T18:32:51.411828+0000","last_undegraded":"2024-09-12T18:32:51.411828+0000","last_fullsized":"2024-09-12T18:32:51.411828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:42.544648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'509","reported_seq":1157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.730698+0000","last_change":"2024-09-12T17:10:36.402382+0000","last_active":"2024-09-12T18:35:21.730698+0000","last_peered":"2024-09-12T18:35:21.730698+0000","last_clean":"2024-09-12T18:35:21.730698+0000","last_became_active":"2024-09-12T17:10:36.401608+0000","last_became_peered":"2024-09-12T17:10:36.401608+0000","last_unstale":"2024-09-12T18:35:21.730698+0000","last_undegraded":"2024-09-12T18:35:21.730698+0000","last_fullsized":"2024-09-12T18:35:21.730698+0000","mapping_epoch":31,"log_start":"268'400","ondisk_log_start":"268'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:02.237080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106830,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":877,"num_read_kb":1875,"num_write":764,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.413301+0000","last_change":"2024-09-12T17:10:38.399567+0000","last_active":"2024-09-12T18:33:11.413301+0000","last_peered":"2024-09-12T18:33:11.413301+0000","last_clean":"2024-09-12T18:33:11.413301+0000","last_became_active":"2024-09-12T17:10:38.398862+0000","last_became_peered":"2024-09-12T17:10:38.398862+0000","last_unstale":"2024-09-12T18:33:11.413301+0000","last_undegraded":"2024-09-12T18:33:11.413301+0000","last_fullsized":"2024-09-12T18:33:11.413301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:54.103985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'157","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.787915+0000","last_change":"2024-09-12T17:10:40.771008+0000","last_active":"2024-09-12T18:34:01.787915+0000","last_peered":"2024-09-12T18:34:01.787915+0000","last_clean":"2024-09-12T18:34:01.787915+0000","last_became_active":"2024-09-12T17:10:40.770075+0000","last_became_peered":"2024-09-12T17:10:40.770075+0000","last_unstale":"2024-09-12T18:34:01.787915+0000","last_undegraded":"2024-09-12T18:34:01.787915+0000","last_fullsized":"2024-09-12T18:34:01.787915+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:20.570103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":234,"num_write":361,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'1461","reported_seq":3047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.814470+0000","last_change":"2024-09-12T17:10:32.377189+0000","last_active":"2024-09-12T18:34:01.814470+0000","last_peered":"2024-09-12T18:34:01.814470+0000","last_clean":"2024-09-12T18:34:01.814470+0000","last_became_active":"2024-09-12T17:10:32.376892+0000","last_became_peered":"2024-09-12T17:10:32.376892+0000","last_unstale":"2024-09-12T18:34:01.814470+0000","last_undegraded":"2024-09-12T18:34:01.814470+0000","last_fullsized":"2024-09-12T18:34:01.814470+0000","mapping_epoch":27,"log_start":"268'1400","ondisk_log_start":"268'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":1400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:44.187578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6636,"num_read_kb":5839,"num_write":2046,"num_write_kb":883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'238","reported_seq":875,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642125+0000","last_change":"2024-09-12T17:10:30.378429+0000","last_active":"2024-09-12T18:33:01.642125+0000","last_peered":"2024-09-12T18:33:01.642125+0000","last_clean":"2024-09-12T18:33:01.642125+0000","last_became_active":"2024-09-12T17:10:30.378075+0000","last_became_peered":"2024-09-12T17:10:30.378075+0000","last_unstale":"2024-09-12T18:33:01.642125+0000","last_undegraded":"2024-09-12T18:33:01.642125+0000","last_fullsized":"2024-09-12T18:33:01.642125+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:26.384876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14545181,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":339,"num_read_kb":47843,"num_write":862,"num_write_kb":30557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.567644+0000","last_change":"2024-09-12T17:10:34.362259+0000","last_active":"2024-09-12T18:31:51.567644+0000","last_peered":"2024-09-12T18:31:51.567644+0000","last_clean":"2024-09-12T18:31:51.567644+0000","last_became_active":"2024-09-12T17:10:34.361495+0000","last_became_peered":"2024-09-12T17:10:34.361495+0000","last_unstale":"2024-09-12T18:31:51.567644+0000","last_undegraded":"2024-09-12T18:31:51.567644+0000","last_fullsized":"2024-09-12T18:31:51.567644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:28.400359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'333","reported_seq":950,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.675146+0000","last_change":"2024-09-12T17:10:36.399101+0000","last_active":"2024-09-12T18:35:21.675146+0000","last_peered":"2024-09-12T18:35:21.675146+0000","last_clean":"2024-09-12T18:35:21.675146+0000","last_became_active":"2024-09-12T17:10:36.398415+0000","last_became_peered":"2024-09-12T17:10:36.398415+0000","last_unstale":"2024-09-12T18:35:21.675146+0000","last_undegraded":"2024-09-12T18:35:21.675146+0000","last_fullsized":"2024-09-12T18:35:21.675146+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:16.776403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53077,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":567,"num_read_kb":1086,"num_write":468,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.644654+0000","last_change":"2024-09-12T17:10:38.404690+0000","last_active":"2024-09-12T18:33:11.644654+0000","last_peered":"2024-09-12T18:33:11.644654+0000","last_clean":"2024-09-12T18:33:11.644654+0000","last_became_active":"2024-09-12T17:10:38.401047+0000","last_became_peered":"2024-09-12T17:10:38.401047+0000","last_unstale":"2024-09-12T18:33:11.644654+0000","last_undegraded":"2024-09-12T18:33:11.644654+0000","last_fullsized":"2024-09-12T18:33:11.644654+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:40.635802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'196","reported_seq":744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:58.343759+0000","last_change":"2024-09-12T17:10:40.429587+0000","last_active":"2024-09-12T18:33:58.343759+0000","last_peered":"2024-09-12T18:33:58.343759+0000","last_clean":"2024-09-12T18:33:58.343759+0000","last_became_active":"2024-09-12T17:10:40.428841+0000","last_became_peered":"2024-09-12T17:10:40.428841+0000","last_unstale":"2024-09-12T18:33:58.343759+0000","last_undegraded":"2024-09-12T18:33:58.343759+0000","last_fullsized":"2024-09-12T18:33:58.343759+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:22.728668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1669,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":376,"num_read_kb":345,"num_write":581,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'1124","reported_seq":2870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.926010+0000","last_change":"2024-09-12T17:10:32.369642+0000","last_active":"2024-09-12T18:33:59.926010+0000","last_peered":"2024-09-12T18:33:59.926010+0000","last_clean":"2024-09-12T18:33:59.926010+0000","last_became_active":"2024-09-12T17:10:32.369344+0000","last_became_peered":"2024-09-12T17:10:32.369344+0000","last_unstale":"2024-09-12T18:33:59.926010+0000","last_undegraded":"2024-09-12T18:33:59.926010+0000","last_fullsized":"2024-09-12T18:33:59.926010+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:38.641315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5513,"num_read_kb":4854,"num_write":1595,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'277","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:06.775195+0000","last_change":"2024-09-12T17:11:05.124261+0000","last_active":"2024-09-12T18:31:06.775195+0000","last_peered":"2024-09-12T18:31:06.775195+0000","last_clean":"2024-09-12T18:31:06.775195+0000","last_became_active":"2024-09-12T17:11:05.123283+0000","last_became_peered":"2024-09-12T17:11:05.123283+0000","last_unstale":"2024-09-12T18:31:06.775195+0000","last_undegraded":"2024-09-12T18:31:06.775195+0000","last_fullsized":"2024-09-12T18:31:06.775195+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:41.264064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26617172,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":436,"num_read_kb":48131,"num_write":1039,"num_write_kb":35281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"37'5","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:58.750296+0000","last_change":"2024-09-12T17:10:34.352955+0000","last_active":"2024-09-12T18:35:58.750296+0000","last_peered":"2024-09-12T18:35:58.750296+0000","last_clean":"2024-09-12T18:35:58.750296+0000","last_became_active":"2024-09-12T17:10:34.352213+0000","last_became_peered":"2024-09-12T17:10:34.352213+0000","last_unstale":"2024-09-12T18:35:58.750296+0000","last_undegraded":"2024-09-12T18:35:58.750296+0000","last_fullsized":"2024-09-12T18:35:58.750296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:10.177818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'294","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.724781+0000","last_change":"2024-09-12T17:10:36.922284+0000","last_active":"2024-09-12T18:35:21.724781+0000","last_peered":"2024-09-12T18:35:21.724781+0000","last_clean":"2024-09-12T18:35:21.724781+0000","last_became_active":"2024-09-12T17:10:36.921450+0000","last_became_peered":"2024-09-12T17:10:36.921450+0000","last_unstale":"2024-09-12T18:35:21.724781+0000","last_undegraded":"2024-09-12T18:35:21.724781+0000","last_fullsized":"2024-09-12T18:35:21.724781+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:10.318840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48044,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":897,"num_write":360,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642311+0000","last_change":"2024-09-12T17:10:38.396118+0000","last_active":"2024-09-12T18:33:01.642311+0000","last_peered":"2024-09-12T18:33:01.642311+0000","last_clean":"2024-09-12T18:33:01.642311+0000","last_became_active":"2024-09-12T17:10:38.395457+0000","last_became_peered":"2024-09-12T17:10:38.395457+0000","last_unstale":"2024-09-12T18:33:01.642311+0000","last_undegraded":"2024-09-12T18:33:01.642311+0000","last_fullsized":"2024-09-12T18:33:01.642311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:35.393797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'130","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.742743+0000","last_change":"2024-09-12T17:10:40.430012+0000","last_active":"2024-09-12T18:35:21.742743+0000","last_peered":"2024-09-12T18:35:21.742743+0000","last_clean":"2024-09-12T18:35:21.742743+0000","last_became_active":"2024-09-12T17:10:40.429303+0000","last_became_peered":"2024-09-12T17:10:40.429303+0000","last_unstale":"2024-09-12T18:35:21.742743+0000","last_undegraded":"2024-09-12T18:35:21.742743+0000","last_fullsized":"2024-09-12T18:35:21.742743+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:37.352428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":233,"num_read_kb":212,"num_write":334,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'904","reported_seq":2419,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.879000+0000","last_change":"2024-09-12T17:10:32.363317+0000","last_active":"2024-09-12T18:33:10.879000+0000","last_peered":"2024-09-12T18:33:10.879000+0000","last_clean":"2024-09-12T18:33:10.879000+0000","last_became_active":"2024-09-12T17:10:32.362957+0000","last_became_peered":"2024-09-12T17:10:32.362957+0000","last_unstale":"2024-09-12T18:33:10.879000+0000","last_undegraded":"2024-09-12T18:33:10.879000+0000","last_fullsized":"2024-09-12T18:33:10.879000+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":800,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:46.722218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4274,"num_read_kb":3831,"num_write":1263,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'278","reported_seq":909,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.413710+0000","last_change":"2024-09-12T17:10:30.374981+0000","last_active":"2024-09-12T18:33:01.413710+0000","last_peered":"2024-09-12T18:33:01.413710+0000","last_clean":"2024-09-12T18:33:01.413710+0000","last_became_active":"2024-09-12T17:10:30.374618+0000","last_became_peered":"2024-09-12T17:10:30.374618+0000","last_unstale":"2024-09-12T18:33:01.413710+0000","last_undegraded":"2024-09-12T18:33:01.413710+0000","last_fullsized":"2024-09-12T18:33:01.413710+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:21.346521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244129,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":358,"num_read_kb":21889,"num_write":907,"num_write_kb":37331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.643558+0000","last_change":"2024-09-12T17:10:34.362059+0000","last_active":"2024-09-12T18:33:06.643558+0000","last_peered":"2024-09-12T18:33:06.643558+0000","last_clean":"2024-09-12T18:33:06.643558+0000","last_became_active":"2024-09-12T17:10:34.361536+0000","last_became_peered":"2024-09-12T17:10:34.361536+0000","last_unstale":"2024-09-12T18:33:06.643558+0000","last_undegraded":"2024-09-12T18:33:06.643558+0000","last_fullsized":"2024-09-12T18:33:06.643558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:33.573141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'114","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:00.592520+0000","last_change":"2024-09-12T17:10:36.923878+0000","last_active":"2024-09-12T18:33:00.592520+0000","last_peered":"2024-09-12T18:33:00.592520+0000","last_clean":"2024-09-12T18:33:00.592520+0000","last_became_active":"2024-09-12T17:10:36.923087+0000","last_became_peered":"2024-09-12T17:10:36.923087+0000","last_unstale":"2024-09-12T18:33:00.592520+0000","last_undegraded":"2024-09-12T18:33:00.592520+0000","last_fullsized":"2024-09-12T18:33:00.592520+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:34.787955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":134,"num_write":98,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'777","reported_seq":2881,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.778299+0000","last_change":"2024-09-12T17:10:38.410583+0000","last_active":"2024-09-12T18:35:21.778299+0000","last_peered":"2024-09-12T18:35:21.778299+0000","last_clean":"2024-09-12T18:35:21.778299+0000","last_became_active":"2024-09-12T17:10:38.407830+0000","last_became_peered":"2024-09-12T17:10:38.407830+0000","last_unstale":"2024-09-12T18:35:21.778299+0000","last_undegraded":"2024-09-12T18:35:21.778299+0000","last_fullsized":"2024-09-12T18:35:21.778299+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:25.369785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'146","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.883725+0000","last_change":"2024-09-12T17:10:40.432466+0000","last_active":"2024-09-12T18:33:59.883725+0000","last_peered":"2024-09-12T18:33:59.883725+0000","last_clean":"2024-09-12T18:33:59.883725+0000","last_became_active":"2024-09-12T17:10:40.431693+0000","last_became_peered":"2024-09-12T17:10:40.431693+0000","last_unstale":"2024-09-12T18:33:59.883725+0000","last_undegraded":"2024-09-12T18:33:59.883725+0000","last_fullsized":"2024-09-12T18:33:59.883725+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:18.379860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":232,"num_write":366,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'807","reported_seq":2326,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.812602+0000","last_change":"2024-09-12T17:10:32.370640+0000","last_active":"2024-09-12T18:34:01.812602+0000","last_peered":"2024-09-12T18:34:01.812602+0000","last_clean":"2024-09-12T18:34:01.812602+0000","last_became_active":"2024-09-12T17:10:32.369824+0000","last_became_peered":"2024-09-12T17:10:32.369824+0000","last_unstale":"2024-09-12T18:34:01.812602+0000","last_undegraded":"2024-09-12T18:34:01.812602+0000","last_fullsized":"2024-09-12T18:34:01.812602+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:05.486073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3803,"num_read_kb":3411,"num_write":1089,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'312","reported_seq":1117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.410878+0000","last_change":"2024-09-12T17:10:30.361138+0000","last_active":"2024-09-12T18:33:01.410878+0000","last_peered":"2024-09-12T18:33:01.410878+0000","last_clean":"2024-09-12T18:33:01.410878+0000","last_became_active":"2024-09-12T17:10:30.357942+0000","last_became_peered":"2024-09-12T17:10:30.357942+0000","last_unstale":"2024-09-12T18:33:01.410878+0000","last_undegraded":"2024-09-12T18:33:01.410878+0000","last_fullsized":"2024-09-12T18:33:01.410878+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:46.703023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11822081,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":890,"num_read_kb":26001,"num_write":1222,"num_write_kb":43743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.404767+0000","last_change":"2024-09-12T17:10:34.362432+0000","last_active":"2024-09-12T18:33:06.404767+0000","last_peered":"2024-09-12T18:33:06.404767+0000","last_clean":"2024-09-12T18:33:06.404767+0000","last_became_active":"2024-09-12T17:10:34.361686+0000","last_became_peered":"2024-09-12T17:10:34.361686+0000","last_unstale":"2024-09-12T18:33:06.404767+0000","last_undegraded":"2024-09-12T18:33:06.404767+0000","last_fullsized":"2024-09-12T18:33:06.404767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:20.692641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'362","reported_seq":978,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.650116+0000","last_change":"2024-09-12T17:10:36.392913+0000","last_active":"2024-09-12T18:35:21.650116+0000","last_peered":"2024-09-12T18:35:21.650116+0000","last_clean":"2024-09-12T18:35:21.650116+0000","last_became_active":"2024-09-12T17:10:36.392089+0000","last_became_peered":"2024-09-12T17:10:36.392089+0000","last_unstale":"2024-09-12T18:35:21.650116+0000","last_undegraded":"2024-09-12T18:35:21.650116+0000","last_fullsized":"2024-09-12T18:35:21.650116+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:00.724692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65339,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":587,"num_read_kb":1152,"num_write":476,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411609+0000","last_change":"2024-09-12T17:10:38.411770+0000","last_active":"2024-09-12T18:32:51.411609+0000","last_peered":"2024-09-12T18:32:51.411609+0000","last_clean":"2024-09-12T18:32:51.411609+0000","last_became_active":"2024-09-12T17:10:38.411191+0000","last_became_peered":"2024-09-12T17:10:38.411191+0000","last_unstale":"2024-09-12T18:32:51.411609+0000","last_undegraded":"2024-09-12T18:32:51.411609+0000","last_fullsized":"2024-09-12T18:32:51.411609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:29.140092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'100","reported_seq":612,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.845108+0000","last_change":"2024-09-12T17:10:40.437458+0000","last_active":"2024-09-12T18:33:55.845108+0000","last_peered":"2024-09-12T18:33:55.845108+0000","last_clean":"2024-09-12T18:33:55.845108+0000","last_became_active":"2024-09-12T17:10:40.436748+0000","last_became_peered":"2024-09-12T17:10:40.436748+0000","last_unstale":"2024-09-12T18:33:55.845108+0000","last_undegraded":"2024-09-12T18:33:55.845108+0000","last_fullsized":"2024-09-12T18:33:55.845108+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:53.015779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":136,"num_write":243,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'577","reported_seq":2227,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.808541+0000","last_change":"2024-09-12T17:10:32.371759+0000","last_active":"2024-09-12T18:34:01.808541+0000","last_peered":"2024-09-12T18:34:01.808541+0000","last_clean":"2024-09-12T18:34:01.808541+0000","last_became_active":"2024-09-12T17:10:32.370173+0000","last_became_peered":"2024-09-12T17:10:32.370173+0000","last_unstale":"2024-09-12T18:34:01.808541+0000","last_undegraded":"2024-09-12T18:34:01.808541+0000","last_fullsized":"2024-09-12T18:34:01.808541+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:20.201508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2773,"num_read_kb":2563,"num_write":696,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'296","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:14.647195+0000","last_change":"2024-09-12T17:10:30.358739+0000","last_active":"2024-09-12T18:35:14.647195+0000","last_peered":"2024-09-12T18:35:14.647195+0000","last_clean":"2024-09-12T18:35:14.647195+0000","last_became_active":"2024-09-12T17:10:30.355723+0000","last_became_peered":"2024-09-12T17:10:30.355723+0000","last_unstale":"2024-09-12T18:35:14.647195+0000","last_undegraded":"2024-09-12T18:35:14.647195+0000","last_fullsized":"2024-09-12T18:35:14.647195+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:21.953441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9762647,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":417,"num_read_kb":22337,"num_write":1073,"num_write_kb":39083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.412100+0000","last_change":"2024-09-12T17:10:34.364113+0000","last_active":"2024-09-12T18:33:06.412100+0000","last_peered":"2024-09-12T18:33:06.412100+0000","last_clean":"2024-09-12T18:33:06.412100+0000","last_became_active":"2024-09-12T17:10:34.363439+0000","last_became_peered":"2024-09-12T17:10:34.363439+0000","last_unstale":"2024-09-12T18:33:06.412100+0000","last_undegraded":"2024-09-12T18:33:06.412100+0000","last_fullsized":"2024-09-12T18:33:06.412100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:02.164079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'284","reported_seq":879,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:11.439582+0000","last_change":"2024-09-12T17:10:36.397893+0000","last_active":"2024-09-12T18:35:11.439582+0000","last_peered":"2024-09-12T18:35:11.439582+0000","last_clean":"2024-09-12T18:35:11.439582+0000","last_became_active":"2024-09-12T17:10:36.397148+0000","last_became_peered":"2024-09-12T17:10:36.397148+0000","last_unstale":"2024-09-12T18:35:11.439582+0000","last_undegraded":"2024-09-12T18:35:11.439582+0000","last_fullsized":"2024-09-12T18:35:11.439582+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:04.236115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74938,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":465,"num_read_kb":1009,"num_write":378,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.584512+0000","last_change":"2024-09-12T17:10:38.407655+0000","last_active":"2024-09-12T18:33:11.584512+0000","last_peered":"2024-09-12T18:33:11.584512+0000","last_clean":"2024-09-12T18:33:11.584512+0000","last_became_active":"2024-09-12T17:10:38.406892+0000","last_became_peered":"2024-09-12T17:10:38.406892+0000","last_unstale":"2024-09-12T18:33:11.584512+0000","last_undegraded":"2024-09-12T18:33:11.584512+0000","last_fullsized":"2024-09-12T18:33:11.584512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:15.244866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'157","reported_seq":692,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:19.439905+0000","last_change":"2024-09-12T17:10:40.770908+0000","last_active":"2024-09-12T18:35:19.439905+0000","last_peered":"2024-09-12T18:35:19.439905+0000","last_clean":"2024-09-12T18:35:19.439905+0000","last_became_active":"2024-09-12T17:10:40.770159+0000","last_became_peered":"2024-09-12T17:10:40.770159+0000","last_unstale":"2024-09-12T18:35:19.439905+0000","last_undegraded":"2024-09-12T18:35:19.439905+0000","last_fullsized":"2024-09-12T18:35:19.439905+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:17.022501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":169,"num_write":336,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'1195","reported_seq":2722,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.926177+0000","last_change":"2024-09-12T17:10:32.358404+0000","last_active":"2024-09-12T18:33:59.926177+0000","last_peered":"2024-09-12T18:33:59.926177+0000","last_clean":"2024-09-12T18:33:59.926177+0000","last_became_active":"2024-09-12T17:10:32.357738+0000","last_became_peered":"2024-09-12T17:10:32.357738+0000","last_unstale":"2024-09-12T18:33:59.926177+0000","last_undegraded":"2024-09-12T18:33:59.926177+0000","last_fullsized":"2024-09-12T18:33:59.926177+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":1100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:54.644317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5279,"num_read_kb":4649,"num_write":1626,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'273","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.404017+0000","last_change":"2024-09-12T17:10:30.402255+0000","last_active":"2024-09-12T18:35:59.404017+0000","last_peered":"2024-09-12T18:35:59.404017+0000","last_clean":"2024-09-12T18:35:59.404017+0000","last_became_active":"2024-09-12T17:10:30.401941+0000","last_became_peered":"2024-09-12T17:10:30.401941+0000","last_unstale":"2024-09-12T18:35:59.404017+0000","last_undegraded":"2024-09-12T18:35:59.404017+0000","last_fullsized":"2024-09-12T18:35:59.404017+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:55.543009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22284010,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":402,"num_read_kb":28040,"num_write":923,"num_write_kb":46600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:45.588684+0000","last_change":"2024-09-12T17:10:34.358478+0000","last_active":"2024-09-12T18:32:45.588684+0000","last_peered":"2024-09-12T18:32:45.588684+0000","last_clean":"2024-09-12T18:32:45.588684+0000","last_became_active":"2024-09-12T17:10:34.357688+0000","last_became_peered":"2024-09-12T17:10:34.357688+0000","last_unstale":"2024-09-12T18:32:45.588684+0000","last_undegraded":"2024-09-12T18:32:45.588684+0000","last_fullsized":"2024-09-12T18:32:45.588684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:01.686198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'245","reported_seq":820,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:39.444434+0000","last_change":"2024-09-12T17:10:36.400271+0000","last_active":"2024-09-12T18:35:39.444434+0000","last_peered":"2024-09-12T18:35:39.444434+0000","last_clean":"2024-09-12T18:35:39.444434+0000","last_became_active":"2024-09-12T17:10:36.398639+0000","last_became_peered":"2024-09-12T17:10:36.398639+0000","last_unstale":"2024-09-12T18:35:39.444434+0000","last_undegraded":"2024-09-12T18:35:39.444434+0000","last_fullsized":"2024-09-12T18:35:39.444434+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:36.210475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55585,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":394,"num_read_kb":897,"num_write":324,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.595054+0000","last_change":"2024-09-12T17:10:38.401463+0000","last_active":"2024-09-12T18:33:10.595054+0000","last_peered":"2024-09-12T18:33:10.595054+0000","last_clean":"2024-09-12T18:33:10.595054+0000","last_became_active":"2024-09-12T17:10:38.400703+0000","last_became_peered":"2024-09-12T17:10:38.400703+0000","last_unstale":"2024-09-12T18:33:10.595054+0000","last_undegraded":"2024-09-12T18:33:10.595054+0000","last_fullsized":"2024-09-12T18:33:10.595054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:10.103057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'171","reported_seq":1654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.714827+0000","last_change":"2024-09-12T17:10:40.435581+0000","last_active":"2024-09-12T18:33:55.714827+0000","last_peered":"2024-09-12T18:33:55.714827+0000","last_clean":"2024-09-12T18:33:55.714827+0000","last_became_active":"2024-09-12T17:10:40.434195+0000","last_became_peered":"2024-09-12T17:10:40.434195+0000","last_unstale":"2024-09-12T18:33:55.714827+0000","last_undegraded":"2024-09-12T18:33:55.714827+0000","last_fullsized":"2024-09-12T18:33:55.714827+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:34.304171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1233,"num_read_kb":1222,"num_write":385,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'393","reported_seq":1910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.525932+0000","last_change":"2024-09-12T17:10:32.362342+0000","last_active":"2024-09-12T18:35:20.525932+0000","last_peered":"2024-09-12T18:35:20.525932+0000","last_clean":"2024-09-12T18:35:20.525932+0000","last_became_active":"2024-09-12T17:10:32.361716+0000","last_became_peered":"2024-09-12T17:10:32.361716+0000","last_unstale":"2024-09-12T18:35:20.525932+0000","last_undegraded":"2024-09-12T18:35:20.525932+0000","last_fullsized":"2024-09-12T18:35:20.525932+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:33.025425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2161,"num_read_kb":2069,"num_write":462,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'256","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.423667+0000","last_change":"2024-09-12T17:10:30.388057+0000","last_active":"2024-09-12T18:33:51.423667+0000","last_peered":"2024-09-12T18:33:51.423667+0000","last_clean":"2024-09-12T18:33:51.423667+0000","last_became_active":"2024-09-12T17:10:30.387788+0000","last_became_peered":"2024-09-12T17:10:30.387788+0000","last_unstale":"2024-09-12T18:33:51.423667+0000","last_undegraded":"2024-09-12T18:33:51.423667+0000","last_fullsized":"2024-09-12T18:33:51.423667+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:57.145079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12876123,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":412,"num_read_kb":40433,"num_write":971,"num_write_kb":46438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.643399+0000","last_change":"2024-09-12T17:10:34.357090+0000","last_active":"2024-09-12T18:33:06.643399+0000","last_peered":"2024-09-12T18:33:06.643399+0000","last_clean":"2024-09-12T18:33:06.643399+0000","last_became_active":"2024-09-12T17:10:34.356290+0000","last_became_peered":"2024-09-12T17:10:34.356290+0000","last_unstale":"2024-09-12T18:33:06.643399+0000","last_undegraded":"2024-09-12T18:33:06.643399+0000","last_fullsized":"2024-09-12T18:33:06.643399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:58.022339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'309","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.841400+0000","last_change":"2024-09-12T17:10:36.392771+0000","last_active":"2024-09-12T18:35:59.841400+0000","last_peered":"2024-09-12T18:35:59.841400+0000","last_clean":"2024-09-12T18:35:59.841400+0000","last_became_active":"2024-09-12T17:10:36.391455+0000","last_became_peered":"2024-09-12T17:10:36.391455+0000","last_unstale":"2024-09-12T18:35:59.841400+0000","last_undegraded":"2024-09-12T18:35:59.841400+0000","last_fullsized":"2024-09-12T18:35:59.841400+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:23.461018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44113,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":1099,"num_write":400,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.415277+0000","last_change":"2024-09-12T17:10:38.414101+0000","last_active":"2024-09-12T18:33:11.415277+0000","last_peered":"2024-09-12T18:33:11.415277+0000","last_clean":"2024-09-12T18:33:11.415277+0000","last_became_active":"2024-09-12T17:10:38.413592+0000","last_became_peered":"2024-09-12T17:10:38.413592+0000","last_unstale":"2024-09-12T18:33:11.415277+0000","last_undegraded":"2024-09-12T18:33:11.415277+0000","last_fullsized":"2024-09-12T18:33:11.415277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:44.432349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'148","reported_seq":661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.433937+0000","last_change":"2024-09-12T17:10:40.432069+0000","last_active":"2024-09-12T18:35:20.433937+0000","last_peered":"2024-09-12T18:35:20.433937+0000","last_clean":"2024-09-12T18:35:20.433937+0000","last_became_active":"2024-09-12T17:10:40.425063+0000","last_became_peered":"2024-09-12T17:10:40.425063+0000","last_unstale":"2024-09-12T18:35:20.433937+0000","last_undegraded":"2024-09-12T18:35:20.433937+0000","last_fullsized":"2024-09-12T18:35:20.433937+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:02.872786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":181,"num_read_kb":173,"num_write":358,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'373","reported_seq":1793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.509133+0000","last_change":"2024-09-12T17:10:32.365153+0000","last_active":"2024-09-12T18:33:01.509133+0000","last_peered":"2024-09-12T18:33:01.509133+0000","last_clean":"2024-09-12T18:33:01.509133+0000","last_became_active":"2024-09-12T17:10:32.361445+0000","last_became_peered":"2024-09-12T17:10:32.361445+0000","last_unstale":"2024-09-12T18:33:01.509133+0000","last_undegraded":"2024-09-12T18:33:01.509133+0000","last_fullsized":"2024-09-12T18:33:01.509133+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:31.834987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1921,"num_read_kb":1829,"num_write":410,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'296","reported_seq":939,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:15.593459+0000","last_change":"2024-09-12T17:11:04.373385+0000","last_active":"2024-09-12T18:35:15.593459+0000","last_peered":"2024-09-12T18:35:15.593459+0000","last_clean":"2024-09-12T18:35:15.593459+0000","last_became_active":"2024-09-12T17:11:04.372622+0000","last_became_peered":"2024-09-12T17:11:04.372622+0000","last_unstale":"2024-09-12T18:35:15.593459+0000","last_undegraded":"2024-09-12T18:35:15.593459+0000","last_fullsized":"2024-09-12T18:35:15.593459+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:19.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13931842,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":462,"num_read_kb":34257,"num_write":1018,"num_write_kb":35279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'377","reported_seq":1894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.641114+0000","last_change":"2024-09-12T17:10:32.364419+0000","last_active":"2024-09-12T18:32:56.641114+0000","last_peered":"2024-09-12T18:32:56.641114+0000","last_clean":"2024-09-12T18:32:56.641114+0000","last_became_active":"2024-09-12T17:10:32.364080+0000","last_became_peered":"2024-09-12T17:10:32.364080+0000","last_unstale":"2024-09-12T18:32:56.641114+0000","last_undegraded":"2024-09-12T18:32:56.641114+0000","last_fullsized":"2024-09-12T18:32:56.641114+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:41.911462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2111,"num_read_kb":2018,"num_write":410,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'291","reported_seq":1066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.810322+0000","last_change":"2024-09-12T17:10:30.394272+0000","last_active":"2024-09-12T18:33:51.810322+0000","last_peered":"2024-09-12T18:33:51.810322+0000","last_clean":"2024-09-12T18:33:51.810322+0000","last_became_active":"2024-09-12T17:10:30.393924+0000","last_became_peered":"2024-09-12T17:10:30.393924+0000","last_unstale":"2024-09-12T18:33:51.810322+0000","last_undegraded":"2024-09-12T18:33:51.810322+0000","last_fullsized":"2024-09-12T18:33:51.810322+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:07.405582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7917549,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":669,"num_read_kb":31225,"num_write":1081,"num_write_kb":33307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'812","reported_seq":2200,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.879138+0000","last_change":"2024-09-12T17:10:32.382803+0000","last_active":"2024-09-12T18:33:10.879138+0000","last_peered":"2024-09-12T18:33:10.879138+0000","last_clean":"2024-09-12T18:33:10.879138+0000","last_became_active":"2024-09-12T17:10:32.382110+0000","last_became_peered":"2024-09-12T17:10:32.382110+0000","last_unstale":"2024-09-12T18:33:10.879138+0000","last_undegraded":"2024-09-12T18:33:10.879138+0000","last_fullsized":"2024-09-12T18:33:10.879138+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:57.022415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3583,"num_read_kb":3191,"num_write":1046,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'288","reported_seq":964,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.422338+0000","last_change":"2024-09-12T17:10:30.359981+0000","last_active":"2024-09-12T18:33:51.422338+0000","last_peered":"2024-09-12T18:33:51.422338+0000","last_clean":"2024-09-12T18:33:51.422338+0000","last_became_active":"2024-09-12T17:10:30.352353+0000","last_became_peered":"2024-09-12T17:10:30.352353+0000","last_unstale":"2024-09-12T18:33:51.422338+0000","last_undegraded":"2024-09-12T18:33:51.422338+0000","last_fullsized":"2024-09-12T18:33:51.422338+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:03.651567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12825621,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":473,"num_read_kb":44546,"num_write":1118,"num_write_kb":40457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'442","reported_seq":1987,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.641022+0000","last_change":"2024-09-12T17:10:32.379036+0000","last_active":"2024-09-12T18:32:56.641022+0000","last_peered":"2024-09-12T18:32:56.641022+0000","last_clean":"2024-09-12T18:32:56.641022+0000","last_became_active":"2024-09-12T17:10:32.378659+0000","last_became_peered":"2024-09-12T17:10:32.378659+0000","last_unstale":"2024-09-12T18:32:56.641022+0000","last_undegraded":"2024-09-12T18:32:56.641022+0000","last_fullsized":"2024-09-12T18:32:56.641022+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:58.217683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2290,"num_read_kb":2161,"num_write":510,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'305","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:14.627743+0000","last_change":"2024-09-12T17:11:04.869478+0000","last_active":"2024-09-12T18:35:14.627743+0000","last_peered":"2024-09-12T18:35:14.627743+0000","last_clean":"2024-09-12T18:35:14.627743+0000","last_became_active":"2024-09-12T17:11:04.868302+0000","last_became_peered":"2024-09-12T17:11:04.868302+0000","last_unstale":"2024-09-12T18:35:14.627743+0000","last_undegraded":"2024-09-12T18:35:14.627743+0000","last_fullsized":"2024-09-12T18:35:14.627743+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:22.742268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29387654,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":419,"num_read_kb":35312,"num_write":1141,"num_write_kb":68294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'520","reported_seq":2242,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.460046+0000","last_change":"2024-09-12T17:10:32.383452+0000","last_active":"2024-09-12T18:35:20.460046+0000","last_peered":"2024-09-12T18:35:20.460046+0000","last_clean":"2024-09-12T18:35:20.460046+0000","last_became_active":"2024-09-12T17:10:32.382841+0000","last_became_peered":"2024-09-12T17:10:32.382841+0000","last_unstale":"2024-09-12T18:35:20.460046+0000","last_undegraded":"2024-09-12T18:35:20.460046+0000","last_fullsized":"2024-09-12T18:35:20.460046+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:08.070690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2888,"num_read_kb":2690,"num_write":642,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'266","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.333977+0000","last_change":"2024-09-12T17:11:04.373500+0000","last_active":"2024-09-12T18:35:59.333977+0000","last_peered":"2024-09-12T18:35:59.333977+0000","last_clean":"2024-09-12T18:35:59.333977+0000","last_became_active":"2024-09-12T17:11:04.373103+0000","last_became_peered":"2024-09-12T17:11:04.373103+0000","last_unstale":"2024-09-12T18:35:59.333977+0000","last_undegraded":"2024-09-12T18:35:59.333977+0000","last_fullsized":"2024-09-12T18:35:59.333977+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:02.210085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437830,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":423,"num_read_kb":30230,"num_write":1002,"num_write_kb":31529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'444","reported_seq":2070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605323+0000","last_change":"2024-09-12T17:10:32.371035+0000","last_active":"2024-09-12T18:33:55.605323+0000","last_peered":"2024-09-12T18:33:55.605323+0000","last_clean":"2024-09-12T18:33:55.605323+0000","last_became_active":"2024-09-12T17:10:32.370112+0000","last_became_peered":"2024-09-12T17:10:32.370112+0000","last_unstale":"2024-09-12T18:33:55.605323+0000","last_undegraded":"2024-09-12T18:33:55.605323+0000","last_fullsized":"2024-09-12T18:33:55.605323+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:03.389218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2345,"num_read_kb":2230,"num_write":501,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'311","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:09.990398+0000","last_change":"2024-09-12T17:10:30.349073+0000","last_active":"2024-09-12T18:33:09.990398+0000","last_peered":"2024-09-12T18:33:09.990398+0000","last_clean":"2024-09-12T18:33:09.990398+0000","last_became_active":"2024-09-12T17:10:30.348702+0000","last_became_peered":"2024-09-12T17:10:30.348702+0000","last_unstale":"2024-09-12T18:33:09.990398+0000","last_undegraded":"2024-09-12T18:33:09.990398+0000","last_fullsized":"2024-09-12T18:33:09.990398+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:53.542082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15043845,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":492,"num_read_kb":10243,"num_write":1194,"num_write_kb":63527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'738","reported_seq":2624,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:54.421771+0000","last_change":"2024-09-12T17:10:32.371291+0000","last_active":"2024-09-12T18:33:54.421771+0000","last_peered":"2024-09-12T18:33:54.421771+0000","last_clean":"2024-09-12T18:33:54.421771+0000","last_became_active":"2024-09-12T17:10:32.371017+0000","last_became_peered":"2024-09-12T17:10:32.371017+0000","last_unstale":"2024-09-12T18:33:54.421771+0000","last_undegraded":"2024-09-12T18:33:54.421771+0000","last_fullsized":"2024-09-12T18:33:54.421771+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:50.198581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4018,"num_read_kb":3683,"num_write":976,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'264","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.580554+0000","last_change":"2024-09-12T17:10:30.400783+0000","last_active":"2024-09-12T18:32:51.580554+0000","last_peered":"2024-09-12T18:32:51.580554+0000","last_clean":"2024-09-12T18:32:51.580554+0000","last_became_active":"2024-09-12T17:10:30.396958+0000","last_became_peered":"2024-09-12T17:10:30.396958+0000","last_unstale":"2024-09-12T18:32:51.580554+0000","last_undegraded":"2024-09-12T18:32:51.580554+0000","last_fullsized":"2024-09-12T18:32:51.580554+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:01.387221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20441624,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":414,"num_read_kb":23680,"num_write":958,"num_write_kb":41122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'720","reported_seq":2417,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.628564+0000","last_change":"2024-09-12T17:10:32.348966+0000","last_active":"2024-09-12T18:33:18.628564+0000","last_peered":"2024-09-12T18:33:18.628564+0000","last_clean":"2024-09-12T18:33:18.628564+0000","last_became_active":"2024-09-12T17:10:32.348200+0000","last_became_peered":"2024-09-12T17:10:32.348200+0000","last_unstale":"2024-09-12T18:33:18.628564+0000","last_undegraded":"2024-09-12T18:33:18.628564+0000","last_fullsized":"2024-09-12T18:33:18.628564+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":700,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:53.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3587,"num_read_kb":3235,"num_write":983,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'322","reported_seq":1018,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.412111+0000","last_change":"2024-09-12T17:10:30.370508+0000","last_active":"2024-09-12T18:35:59.412111+0000","last_peered":"2024-09-12T18:35:59.412111+0000","last_clean":"2024-09-12T18:35:59.412111+0000","last_became_active":"2024-09-12T17:10:30.370015+0000","last_became_peered":"2024-09-12T17:10:30.370015+0000","last_unstale":"2024-09-12T18:35:59.412111+0000","last_undegraded":"2024-09-12T18:35:59.412111+0000","last_fullsized":"2024-09-12T18:35:59.412111+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:13.056343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16182623,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":490,"num_read_kb":40384,"num_write":1096,"num_write_kb":51606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'836","reported_seq":2470,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.531341+0000","last_change":"2024-09-12T17:10:32.350274+0000","last_active":"2024-09-12T18:35:20.531341+0000","last_peered":"2024-09-12T18:35:20.531341+0000","last_clean":"2024-09-12T18:35:20.531341+0000","last_became_active":"2024-09-12T17:10:32.348842+0000","last_became_peered":"2024-09-12T17:10:32.348842+0000","last_unstale":"2024-09-12T18:35:20.531341+0000","last_undegraded":"2024-09-12T18:35:20.531341+0000","last_fullsized":"2024-09-12T18:35:20.531341+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:40.714584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4030,"num_read_kb":3642,"num_write":1104,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'257","reported_seq":909,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.414245+0000","last_change":"2024-09-12T17:10:30.351530+0000","last_active":"2024-09-12T18:33:16.414245+0000","last_peered":"2024-09-12T18:33:16.414245+0000","last_clean":"2024-09-12T18:33:16.414245+0000","last_became_active":"2024-09-12T17:10:30.349523+0000","last_became_peered":"2024-09-12T17:10:30.349523+0000","last_unstale":"2024-09-12T18:33:16.414245+0000","last_undegraded":"2024-09-12T18:33:16.414245+0000","last_fullsized":"2024-09-12T18:33:16.414245+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:13.854677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13239365,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":402,"num_read_kb":103976,"num_write":935,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'519","reported_seq":2350,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.627374+0000","last_change":"2024-09-12T17:10:32.363610+0000","last_active":"2024-09-12T18:33:18.627374+0000","last_peered":"2024-09-12T18:33:18.627374+0000","last_clean":"2024-09-12T18:33:18.627374+0000","last_became_active":"2024-09-12T17:10:32.362881+0000","last_became_peered":"2024-09-12T17:10:32.362881+0000","last_unstale":"2024-09-12T18:33:18.627374+0000","last_undegraded":"2024-09-12T18:33:18.627374+0000","last_fullsized":"2024-09-12T18:33:18.627374+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:27.711767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2930,"num_read_kb":2778,"num_write":610,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'313","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.284645+0000","last_change":"2024-09-12T17:10:30.379084+0000","last_active":"2024-09-12T18:35:59.284645+0000","last_peered":"2024-09-12T18:35:59.284645+0000","last_clean":"2024-09-12T18:35:59.284645+0000","last_became_active":"2024-09-12T17:10:30.378766+0000","last_became_peered":"2024-09-12T17:10:30.378766+0000","last_unstale":"2024-09-12T18:35:59.284645+0000","last_undegraded":"2024-09-12T18:35:59.284645+0000","last_fullsized":"2024-09-12T18:35:59.284645+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:25.386692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11833783,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":550,"num_read_kb":26410,"num_write":1159,"num_write_kb":29487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'523","reported_seq":2172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.554813+0000","last_change":"2024-09-12T17:10:32.342457+0000","last_active":"2024-09-12T18:32:48.554813+0000","last_peered":"2024-09-12T18:32:48.554813+0000","last_clean":"2024-09-12T18:32:48.554813+0000","last_became_active":"2024-09-12T17:10:32.341480+0000","last_became_peered":"2024-09-12T17:10:32.341480+0000","last_unstale":"2024-09-12T18:32:48.554813+0000","last_undegraded":"2024-09-12T18:32:48.554813+0000","last_fullsized":"2024-09-12T18:32:48.554813+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:37.744373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2856,"num_read_kb":2663,"num_write":671,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'276","reported_seq":1025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:31.389096+0000","last_change":"2024-09-12T17:10:30.405089+0000","last_active":"2024-09-12T18:31:31.389096+0000","last_peered":"2024-09-12T18:31:31.389096+0000","last_clean":"2024-09-12T18:31:31.389096+0000","last_became_active":"2024-09-12T17:10:30.404567+0000","last_became_peered":"2024-09-12T17:10:30.404567+0000","last_unstale":"2024-09-12T18:31:31.389096+0000","last_undegraded":"2024-09-12T18:31:31.389096+0000","last_fullsized":"2024-09-12T18:31:31.389096+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:28.951703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18903230,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":716,"num_read_kb":46881,"num_write":1010,"num_write_kb":42596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'378","reported_seq":1776,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.736954+0000","last_change":"2024-09-12T17:10:32.371681+0000","last_active":"2024-09-12T18:34:01.736954+0000","last_peered":"2024-09-12T18:34:01.736954+0000","last_clean":"2024-09-12T18:34:01.736954+0000","last_became_active":"2024-09-12T17:10:32.370799+0000","last_became_peered":"2024-09-12T17:10:32.370799+0000","last_unstale":"2024-09-12T18:34:01.736954+0000","last_undegraded":"2024-09-12T18:34:01.736954+0000","last_fullsized":"2024-09-12T18:34:01.736954+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:01.601445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2049,"num_read_kb":1938,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'267","reported_seq":896,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:40.957117+0000","last_change":"2024-09-12T17:10:30.375100+0000","last_active":"2024-09-12T18:33:40.957117+0000","last_peered":"2024-09-12T18:33:40.957117+0000","last_clean":"2024-09-12T18:33:40.957117+0000","last_became_active":"2024-09-12T17:10:30.374689+0000","last_became_peered":"2024-09-12T17:10:30.374689+0000","last_unstale":"2024-09-12T18:33:40.957117+0000","last_undegraded":"2024-09-12T18:33:40.957117+0000","last_fullsized":"2024-09-12T18:33:40.957117+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:34.230883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18343484,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":350,"num_read_kb":28127,"num_write":1010,"num_write_kb":52007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1583","reported_seq":3062,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.884976+0000","last_change":"2024-09-12T17:10:32.385251+0000","last_active":"2024-09-12T18:33:10.884976+0000","last_peered":"2024-09-12T18:33:10.884976+0000","last_clean":"2024-09-12T18:33:10.884976+0000","last_became_active":"2024-09-12T17:10:32.384842+0000","last_became_peered":"2024-09-12T17:10:32.384842+0000","last_unstale":"2024-09-12T18:33:10.884976+0000","last_undegraded":"2024-09-12T18:33:10.884976+0000","last_fullsized":"2024-09-12T18:33:10.884976+0000","mapping_epoch":27,"log_start":"268'1500","ondisk_log_start":"268'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":1500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:41.827736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6992,"num_read_kb":6083,"num_write":2272,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'414","reported_seq":1224,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:31.563413+0000","last_change":"2024-09-12T17:12:05.373752+0000","last_active":"2024-09-12T18:31:31.563413+0000","last_peered":"2024-09-12T18:31:31.563413+0000","last_clean":"2024-09-12T18:31:31.563413+0000","last_became_active":"2024-09-12T17:12:05.372879+0000","last_became_peered":"2024-09-12T17:12:05.372879+0000","last_unstale":"2024-09-12T18:31:31.563413+0000","last_undegraded":"2024-09-12T18:31:31.563413+0000","last_fullsized":"2024-09-12T18:31:31.563413+0000","mapping_epoch":40,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:28.746471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15729611,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":878,"num_read_kb":72647,"num_write":1599,"num_write_kb":47468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,0],"acting":[6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'1142","reported_seq":2648,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:23.683290+0000","last_change":"2024-09-12T17:10:32.361735+0000","last_active":"2024-09-12T18:32:23.683290+0000","last_peered":"2024-09-12T18:32:23.683290+0000","last_clean":"2024-09-12T18:32:23.683290+0000","last_became_active":"2024-09-12T17:10:32.361416+0000","last_became_peered":"2024-09-12T17:10:32.361416+0000","last_unstale":"2024-09-12T18:32:23.683290+0000","last_undegraded":"2024-09-12T18:32:23.683290+0000","last_fullsized":"2024-09-12T18:32:23.683290+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:10.998239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5102,"num_read_kb":4502,"num_write":1588,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'362","reported_seq":1155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:39.040595+0000","last_change":"2024-09-12T17:10:30.405641+0000","last_active":"2024-09-12T18:32:39.040595+0000","last_peered":"2024-09-12T18:32:39.040595+0000","last_clean":"2024-09-12T18:32:39.040595+0000","last_became_active":"2024-09-12T17:10:30.404403+0000","last_became_peered":"2024-09-12T17:10:30.404403+0000","last_unstale":"2024-09-12T18:32:39.040595+0000","last_undegraded":"2024-09-12T18:32:39.040595+0000","last_fullsized":"2024-09-12T18:32:39.040595+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:16.546068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12611539,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":708,"num_read_kb":38614,"num_write":1207,"num_write_kb":36952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'389","reported_seq":1945,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.441613+0000","last_change":"2024-09-12T17:10:32.353298+0000","last_active":"2024-09-12T18:35:20.441613+0000","last_peered":"2024-09-12T18:35:20.441613+0000","last_clean":"2024-09-12T18:35:20.441613+0000","last_became_active":"2024-09-12T17:10:32.352916+0000","last_became_peered":"2024-09-12T17:10:32.352916+0000","last_unstale":"2024-09-12T18:35:20.441613+0000","last_undegraded":"2024-09-12T18:35:20.441613+0000","last_fullsized":"2024-09-12T18:35:20.441613+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:14.122659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2283,"num_read_kb":2176,"num_write":460,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'274","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.788089+0000","last_change":"2024-09-12T17:10:30.402433+0000","last_active":"2024-09-12T18:32:11.788089+0000","last_peered":"2024-09-12T18:32:11.788089+0000","last_clean":"2024-09-12T18:32:11.788089+0000","last_became_active":"2024-09-12T17:10:30.402024+0000","last_became_peered":"2024-09-12T17:10:30.402024+0000","last_unstale":"2024-09-12T18:32:11.788089+0000","last_undegraded":"2024-09-12T18:32:11.788089+0000","last_fullsized":"2024-09-12T18:32:11.788089+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:43.146846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19200717,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":385,"num_read_kb":33472,"num_write":937,"num_write_kb":44244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'828","reported_seq":2396,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.408504+0000","last_change":"2024-09-12T17:10:32.376676+0000","last_active":"2024-09-12T18:33:21.408504+0000","last_peered":"2024-09-12T18:33:21.408504+0000","last_clean":"2024-09-12T18:33:21.408504+0000","last_became_active":"2024-09-12T17:10:32.375891+0000","last_became_peered":"2024-09-12T17:10:32.375891+0000","last_unstale":"2024-09-12T18:33:21.408504+0000","last_undegraded":"2024-09-12T18:33:21.408504+0000","last_fullsized":"2024-09-12T18:33:21.408504+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:45.205202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3808,"num_read_kb":3437,"num_write":1089,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'345","reported_seq":1067,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:38.888940+0000","last_change":"2024-09-12T17:10:30.379099+0000","last_active":"2024-09-12T18:33:38.888940+0000","last_peered":"2024-09-12T18:33:38.888940+0000","last_clean":"2024-09-12T18:33:38.888940+0000","last_became_active":"2024-09-12T17:10:30.378109+0000","last_became_peered":"2024-09-12T17:10:30.378109+0000","last_unstale":"2024-09-12T18:33:38.888940+0000","last_undegraded":"2024-09-12T18:33:38.888940+0000","last_fullsized":"2024-09-12T18:33:38.888940+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:36.314866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8653557,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":583,"num_read_kb":82540,"num_write":1220,"num_write_kb":46419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'323","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:14.362520+0000","last_change":"2024-09-12T17:10:30.357091+0000","last_active":"2024-09-12T18:32:14.362520+0000","last_peered":"2024-09-12T18:32:14.362520+0000","last_clean":"2024-09-12T18:32:14.362520+0000","last_became_active":"2024-09-12T17:10:30.356199+0000","last_became_peered":"2024-09-12T17:10:30.356199+0000","last_unstale":"2024-09-12T18:32:14.362520+0000","last_undegraded":"2024-09-12T18:32:14.362520+0000","last_fullsized":"2024-09-12T18:32:14.362520+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:59.039701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21986890,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":513,"num_read_kb":25743,"num_write":1159,"num_write_kb":44098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'457","reported_seq":2245,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.814149+0000","last_change":"2024-09-12T17:10:32.350936+0000","last_active":"2024-09-12T18:34:01.814149+0000","last_peered":"2024-09-12T18:34:01.814149+0000","last_clean":"2024-09-12T18:34:01.814149+0000","last_became_active":"2024-09-12T17:10:32.349687+0000","last_became_peered":"2024-09-12T17:10:32.349687+0000","last_unstale":"2024-09-12T18:34:01.814149+0000","last_undegraded":"2024-09-12T18:34:01.814149+0000","last_fullsized":"2024-09-12T18:34:01.814149+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:14.030096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2918,"num_read_kb":2789,"num_write":551,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'314","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:22.979962+0000","last_change":"2024-09-12T17:11:05.122501+0000","last_active":"2024-09-12T18:32:22.979962+0000","last_peered":"2024-09-12T18:32:22.979962+0000","last_clean":"2024-09-12T18:32:22.979962+0000","last_became_active":"2024-09-12T17:11:05.121473+0000","last_became_peered":"2024-09-12T17:11:05.121473+0000","last_unstale":"2024-09-12T18:32:22.979962+0000","last_undegraded":"2024-09-12T18:32:22.979962+0000","last_fullsized":"2024-09-12T18:32:22.979962+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:52.213656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15293424,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":460,"num_read_kb":29048,"num_write":1159,"num_write_kb":43104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'468","reported_seq":1964,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.515670+0000","last_change":"2024-09-12T17:10:32.353257+0000","last_active":"2024-09-12T18:33:01.515670+0000","last_peered":"2024-09-12T18:33:01.515670+0000","last_clean":"2024-09-12T18:33:01.515670+0000","last_became_active":"2024-09-12T17:10:32.352369+0000","last_became_peered":"2024-09-12T17:10:32.352369+0000","last_unstale":"2024-09-12T18:33:01.515670+0000","last_undegraded":"2024-09-12T18:33:01.515670+0000","last_fullsized":"2024-09-12T18:33:01.515670+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:04.294268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2354,"num_read_kb":2191,"num_write":554,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6108,"num_read_kb":4244,"num_write":1960,"num_write_kb":858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1131,"ondisk_log_size":1131,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":16274,"num_read_kb":15945,"num_write":16744,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1671,"ondisk_log_size":1671,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":695,"ondisk_log_size":695,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1916818,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":19100,"num_read_kb":36278,"num_write":16087,"num_write_kb":12052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3231744,"data_stored":2721043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2000,"ondisk_log_size":2000,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2426,"num_read_kb":2893,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":213001,"num_read_kb":194600,"num_write":55405,"num_write_kb":18906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3776,"ondisk_log_size":3776,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":830151747,"num_objects":4363,"num_object_clones":0,"num_object_copies":13089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4363,"num_whiteouts":0,"num_read":32539,"num_read_kb":2308259,"num_write":68514,"num_write_kb":2504748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1235550208,"data_stored":1235550208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3775,"ondisk_log_size":3775,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":47917582,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":138,"num_read_kb":159116,"num_write":162,"num_write_kb":116497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":107380736,"data_stored":107369500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":53160462,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":134,"num_read_kb":158495,"num_write":160,"num_write_kb":116497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":107380736,"data_stored":107369500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510472,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":477688,"kb_used_data":197992,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":93894152,"statfs":{"total":96636764160,"available":96147611648,"internally_reserved":0,"allocated":202743808,"data_stored":200547088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":286390730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510476,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465860,"kb_used_data":191732,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93905980,"statfs":{"total":96636764160,"available":96159723520,"internally_reserved":0,"allocated":196333568,"data_stored":194224467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":280689094},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510473,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321816,"kb_used_data":182408,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94050024,"statfs":{"total":96636764160,"available":96307224576,"internally_reserved":0,"allocated":186785792,"data_stored":184556322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510475,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263572,"kb_used_data":178244,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94108268,"statfs":{"total":96636764160,"available":96366866432,"internally_reserved":0,"allocated":182521856,"data_stored":180425075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510476,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":377000,"kb_used_data":219544,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":93994840,"statfs":{"total":96636764160,"available":96250716160,"internally_reserved":0,"allocated":224813056,"data_stored":222665947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510473,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":466288,"kb_used_data":210208,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93905552,"statfs":{"total":96636764160,"available":96159285248,"internally_reserved":0,"allocated":215252992,"data_stored":213075792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543180,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254660,"kb_used_data":147080,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94117180,"statfs":{"total":96636764160,"available":96375992320,"internally_reserved":0,"allocated":150609920,"data_stored":148529106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575881,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":476244,"kb_used_data":202116,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93895596,"statfs":{"total":96636764160,"available":96149090304,"internally_reserved":0,"allocated":206966784,"data_stored":204784042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280689095},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":177704960,"data_stored":177704960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":166338560,"data_stored":166338560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":142692352,"data_stored":142692352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":145809408,"data_stored":145809408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106315776,"data_stored":106315776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163704832,"data_stored":163704832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":162713600,"data_stored":162713600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":170270720,"data_stored":170270720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":375467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":390413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":135603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":437530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":38781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":671744,"data_stored":562791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":255442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":618496,"data_stored":525016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14270464,"data_stored":14266310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32555008,"data_stored":32554275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15777059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16879616,"data_stored":16876096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14217216,"data_stored":14215851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8437760,"data_stored":8437029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21073920,"data_stored":21070398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19509248,"data_stored":19507152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9486336,"data_stored":9485605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1101824,"data_stored":1099035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14729216,"data_stored":14728483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18411520,"data_stored":18410155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:36:02.787 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:36:02.787 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:36:03.135 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:36:03.154 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T18:36:03.169 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":2836,"stamp":"2024-09-12T18:36:02.842143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":419244143,"num_objects":2165,"num_object_clones":0,"num_object_copies":6006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2165,"num_whiteouts":0,"num_read":292814,"num_read_kb":2882460,"num_write":162047,"num_write_kb":2776146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":213,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13129,"ondisk_log_size":13129,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2411876,"kb_used_data":828512,"kb_used_omap":12,"kb_used_meta":1581939,"kb_avail":752562844,"statfs":{"total":773094113280,"available":770624352256,"internally_reserved":0,"allocated":848396288,"data_stored":831288939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1619906097},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,4,5,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-568649847,"num_objects":-2906,"num_object_clones":0,"num_object_copies":-8672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2906,"num_whiteouts":0,"num_read":3236,"num_read_kb":2855,"num_write":3075,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007974"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.416560+0000","last_change":"2024-09-12T17:53:27.147438+0000","last_active":"2024-09-12T18:33:26.416560+0000","last_peered":"2024-09-12T18:33:26.416560+0000","last_clean":"2024-09-12T18:33:26.416560+0000","last_became_active":"2024-09-12T17:53:27.146780+0000","last_became_peered":"2024-09-12T17:53:27.146780+0000","last_unstale":"2024-09-12T18:33:26.416560+0000","last_undegraded":"2024-09-12T18:33:26.416560+0000","last_fullsized":"2024-09-12T18:33:26.416560+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:27.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"268'11","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.134067+0000","last_change":"2024-09-12T17:31:16.246161+0000","last_active":"2024-09-12T18:35:59.134067+0000","last_peered":"2024-09-12T18:35:59.134067+0000","last_clean":"2024-09-12T18:35:59.134067+0000","last_became_active":"2024-09-12T17:31:16.245482+0000","last_became_peered":"2024-09-12T17:31:16.245482+0000","last_unstale":"2024-09-12T18:35:59.134067+0000","last_undegraded":"2024-09-12T18:35:59.134067+0000","last_fullsized":"2024-09-12T18:35:59.134067+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:05.233527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5245,"num_write":16,"num_write_kb":2121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:14.384819+0000","last_change":"2024-09-12T17:31:12.096770+0000","last_active":"2024-09-12T18:31:14.384819+0000","last_peered":"2024-09-12T18:31:14.384819+0000","last_clean":"2024-09-12T18:31:14.384819+0000","last_became_active":"2024-09-12T17:31:12.094935+0000","last_became_peered":"2024-09-12T17:31:12.094935+0000","last_unstale":"2024-09-12T18:31:14.384819+0000","last_undegraded":"2024-09-12T18:31:14.384819+0000","last_fullsized":"2024-09-12T18:31:14.384819+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:30.818530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'30","reported_seq":143,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.403621+0000","last_change":"2024-09-12T17:27:32.584697+0000","last_active":"2024-09-12T18:32:11.403621+0000","last_peered":"2024-09-12T18:32:11.403621+0000","last_clean":"2024-09-12T18:32:11.403621+0000","last_became_active":"2024-09-12T17:27:32.583903+0000","last_became_peered":"2024-09-12T17:27:32.583903+0000","last_unstale":"2024-09-12T18:32:11.403621+0000","last_undegraded":"2024-09-12T18:32:11.403621+0000","last_fullsized":"2024-09-12T18:32:11.403621+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:29.126608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":98,"num_write":57,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.805836+0000","last_change":"2024-09-12T17:53:27.168477+0000","last_active":"2024-09-12T18:33:26.805836+0000","last_peered":"2024-09-12T18:33:26.805836+0000","last_clean":"2024-09-12T18:33:26.805836+0000","last_became_active":"2024-09-12T17:53:27.167810+0000","last_became_peered":"2024-09-12T17:53:27.167810+0000","last_unstale":"2024-09-12T18:33:26.805836+0000","last_undegraded":"2024-09-12T18:33:26.805836+0000","last_fullsized":"2024-09-12T18:33:26.805836+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:15.873940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'7","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.602979+0000","last_change":"2024-09-12T17:31:16.238350+0000","last_active":"2024-09-12T18:33:45.602979+0000","last_peered":"2024-09-12T18:33:45.602979+0000","last_clean":"2024-09-12T18:33:45.602979+0000","last_became_active":"2024-09-12T17:31:16.237721+0000","last_became_peered":"2024-09-12T17:31:16.237721+0000","last_unstale":"2024-09-12T18:33:45.602979+0000","last_undegraded":"2024-09-12T18:33:45.602979+0000","last_fullsized":"2024-09-12T18:33:45.602979+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:31.469770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'2","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:11.617448+0000","last_change":"2024-09-12T17:31:12.106211+0000","last_active":"2024-09-12T18:31:11.617448+0000","last_peered":"2024-09-12T18:31:11.617448+0000","last_clean":"2024-09-12T18:31:11.617448+0000","last_became_active":"2024-09-12T17:31:12.105548+0000","last_became_peered":"2024-09-12T17:31:12.105548+0000","last_unstale":"2024-09-12T18:31:11.617448+0000","last_undegraded":"2024-09-12T18:31:11.617448+0000","last_fullsized":"2024-09-12T18:31:11.617448+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:03.366287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'16","reported_seq":114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.809510+0000","last_change":"2024-09-12T17:27:32.564047+0000","last_active":"2024-09-12T18:33:46.809510+0000","last_peered":"2024-09-12T18:33:46.809510+0000","last_clean":"2024-09-12T18:33:46.809510+0000","last_became_active":"2024-09-12T17:27:32.563281+0000","last_became_peered":"2024-09-12T17:27:32.563281+0000","last_unstale":"2024-09-12T18:33:46.809510+0000","last_undegraded":"2024-09-12T18:33:46.809510+0000","last_fullsized":"2024-09-12T18:33:46.809510+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:23.103744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.570655+0000","last_change":"2024-09-12T17:53:27.146120+0000","last_active":"2024-09-12T18:32:06.570655+0000","last_peered":"2024-09-12T18:32:06.570655+0000","last_clean":"2024-09-12T18:32:06.570655+0000","last_became_active":"2024-09-12T17:53:27.143812+0000","last_became_peered":"2024-09-12T17:53:27.143812+0000","last_unstale":"2024-09-12T18:32:06.570655+0000","last_undegraded":"2024-09-12T18:32:06.570655+0000","last_fullsized":"2024-09-12T18:32:06.570655+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:47.856070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.422572+0000","last_change":"2024-09-12T17:31:16.209712+0000","last_active":"2024-09-12T18:33:46.422572+0000","last_peered":"2024-09-12T18:33:46.422572+0000","last_clean":"2024-09-12T18:33:46.422572+0000","last_became_active":"2024-09-12T17:31:16.208994+0000","last_became_peered":"2024-09-12T17:31:16.208994+0000","last_unstale":"2024-09-12T18:33:46.422572+0000","last_undegraded":"2024-09-12T18:33:46.422572+0000","last_fullsized":"2024-09-12T18:33:46.422572+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:21.511571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'15","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.853266+0000","last_change":"2024-09-12T17:31:12.092194+0000","last_active":"2024-09-12T18:36:00.853266+0000","last_peered":"2024-09-12T18:36:00.853266+0000","last_clean":"2024-09-12T18:36:00.853266+0000","last_became_active":"2024-09-12T17:31:12.090602+0000","last_became_peered":"2024-09-12T17:31:12.090602+0000","last_unstale":"2024-09-12T18:36:00.853266+0000","last_undegraded":"2024-09-12T18:36:00.853266+0000","last_fullsized":"2024-09-12T18:36:00.853266+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:37.853518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10290,"num_write":20,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'40","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.408679+0000","last_change":"2024-09-12T17:27:32.554962+0000","last_active":"2024-09-12T18:32:36.408679+0000","last_peered":"2024-09-12T18:32:36.408679+0000","last_clean":"2024-09-12T18:32:36.408679+0000","last_became_active":"2024-09-12T17:27:32.554228+0000","last_became_peered":"2024-09-12T17:27:32.554228+0000","last_unstale":"2024-09-12T18:32:36.408679+0000","last_undegraded":"2024-09-12T18:32:36.408679+0000","last_fullsized":"2024-09-12T18:32:36.408679+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:30.083918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":136,"num_write":75,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:19.399599+0000","last_change":"2024-09-12T17:53:27.171122+0000","last_active":"2024-09-12T18:32:19.399599+0000","last_peered":"2024-09-12T18:32:19.399599+0000","last_clean":"2024-09-12T18:32:19.399599+0000","last_became_active":"2024-09-12T17:53:27.165849+0000","last_became_peered":"2024-09-12T17:53:27.165849+0000","last_unstale":"2024-09-12T18:32:19.399599+0000","last_undegraded":"2024-09-12T18:32:19.399599+0000","last_fullsized":"2024-09-12T18:32:19.399599+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:27.566630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"268'6","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:34.417613+0000","last_change":"2024-09-12T17:31:16.234725+0000","last_active":"2024-09-12T18:33:34.417613+0000","last_peered":"2024-09-12T18:33:34.417613+0000","last_clean":"2024-09-12T18:33:34.417613+0000","last_became_active":"2024-09-12T17:31:16.233989+0000","last_became_peered":"2024-09-12T17:31:16.233989+0000","last_unstale":"2024-09-12T18:33:34.417613+0000","last_undegraded":"2024-09-12T18:33:34.417613+0000","last_fullsized":"2024-09-12T18:33:34.417613+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:22.667547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'10","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.388434+0000","last_change":"2024-09-12T17:31:12.078149+0000","last_active":"2024-09-12T18:35:59.388434+0000","last_peered":"2024-09-12T18:35:59.388434+0000","last_clean":"2024-09-12T18:35:59.388434+0000","last_became_active":"2024-09-12T17:31:12.076980+0000","last_became_peered":"2024-09-12T17:31:12.076980+0000","last_unstale":"2024-09-12T18:35:59.388434+0000","last_undegraded":"2024-09-12T18:35:59.388434+0000","last_fullsized":"2024-09-12T18:35:59.388434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:20.927562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11264,"num_write":20,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'22","reported_seq":123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403144+0000","last_change":"2024-09-12T17:27:32.597852+0000","last_active":"2024-09-12T18:32:34.403144+0000","last_peered":"2024-09-12T18:32:34.403144+0000","last_clean":"2024-09-12T18:32:34.403144+0000","last_became_active":"2024-09-12T17:27:32.597092+0000","last_became_peered":"2024-09-12T17:27:32.597092+0000","last_unstale":"2024-09-12T18:32:34.403144+0000","last_undegraded":"2024-09-12T18:32:34.403144+0000","last_fullsized":"2024-09-12T18:32:34.403144+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:46.150508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":80,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.418737+0000","last_change":"2024-09-12T17:53:27.172827+0000","last_active":"2024-09-12T18:33:39.418737+0000","last_peered":"2024-09-12T18:33:39.418737+0000","last_clean":"2024-09-12T18:33:39.418737+0000","last_became_active":"2024-09-12T17:53:27.166248+0000","last_became_peered":"2024-09-12T17:53:27.166248+0000","last_unstale":"2024-09-12T18:33:39.418737+0000","last_undegraded":"2024-09-12T18:33:39.418737+0000","last_fullsized":"2024-09-12T18:33:39.418737+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:16.950414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:01.396099+0000","last_change":"2024-09-12T17:32:06.560970+0000","last_active":"2024-09-12T18:32:01.396099+0000","last_peered":"2024-09-12T18:32:01.396099+0000","last_clean":"2024-09-12T18:32:01.396099+0000","last_became_active":"2024-09-12T17:32:06.560465+0000","last_became_peered":"2024-09-12T17:32:06.560465+0000","last_unstale":"2024-09-12T18:32:01.396099+0000","last_undegraded":"2024-09-12T18:32:01.396099+0000","last_fullsized":"2024-09-12T18:32:01.396099+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:44.091888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'8","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.425827+0000","last_change":"2024-09-12T17:31:12.068624+0000","last_active":"2024-09-12T18:34:01.425827+0000","last_peered":"2024-09-12T18:34:01.425827+0000","last_clean":"2024-09-12T18:34:01.425827+0000","last_became_active":"2024-09-12T17:31:12.067819+0000","last_became_peered":"2024-09-12T17:31:12.067819+0000","last_unstale":"2024-09-12T18:34:01.425827+0000","last_undegraded":"2024-09-12T18:34:01.425827+0000","last_fullsized":"2024-09-12T18:34:01.425827+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:31.755207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":19458,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'26","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403079+0000","last_change":"2024-09-12T17:27:32.591166+0000","last_active":"2024-09-12T18:32:34.403079+0000","last_peered":"2024-09-12T18:32:34.403079+0000","last_clean":"2024-09-12T18:32:34.403079+0000","last_became_active":"2024-09-12T17:27:32.578575+0000","last_became_peered":"2024-09-12T17:27:32.578575+0000","last_unstale":"2024-09-12T18:32:34.403079+0000","last_undegraded":"2024-09-12T18:32:34.403079+0000","last_fullsized":"2024-09-12T18:32:34.403079+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:56.541481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":95,"num_write":44,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642338+0000","last_change":"2024-09-12T17:53:27.156978+0000","last_active":"2024-09-12T18:33:01.642338+0000","last_peered":"2024-09-12T18:33:01.642338+0000","last_clean":"2024-09-12T18:33:01.642338+0000","last_became_active":"2024-09-12T17:53:27.156155+0000","last_became_peered":"2024-09-12T17:53:27.156155+0000","last_unstale":"2024-09-12T18:33:01.642338+0000","last_undegraded":"2024-09-12T18:33:01.642338+0000","last_fullsized":"2024-09-12T18:33:01.642338+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:51.477046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:06.596158+0000","last_change":"2024-09-12T17:31:16.227134+0000","last_active":"2024-09-12T18:34:06.596158+0000","last_peered":"2024-09-12T18:34:06.596158+0000","last_clean":"2024-09-12T18:34:06.596158+0000","last_became_active":"2024-09-12T17:31:16.226398+0000","last_became_peered":"2024-09-12T17:31:16.226398+0000","last_unstale":"2024-09-12T18:34:06.596158+0000","last_undegraded":"2024-09-12T18:34:06.596158+0000","last_fullsized":"2024-09-12T18:34:06.596158+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:46.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:00.578262+0000","last_change":"2024-09-12T17:31:12.077317+0000","last_active":"2024-09-12T18:32:00.578262+0000","last_peered":"2024-09-12T18:32:00.578262+0000","last_clean":"2024-09-12T18:32:00.578262+0000","last_became_active":"2024-09-12T17:31:12.076502+0000","last_became_peered":"2024-09-12T17:31:12.076502+0000","last_unstale":"2024-09-12T18:32:00.578262+0000","last_undegraded":"2024-09-12T18:32:00.578262+0000","last_fullsized":"2024-09-12T18:32:00.578262+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:49.794829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'36","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.577178+0000","last_change":"2024-09-12T17:27:32.569576+0000","last_active":"2024-09-12T18:32:36.577178+0000","last_peered":"2024-09-12T18:32:36.577178+0000","last_clean":"2024-09-12T18:32:36.577178+0000","last_became_active":"2024-09-12T17:27:32.568740+0000","last_became_peered":"2024-09-12T17:27:32.568740+0000","last_unstale":"2024-09-12T18:32:36.577178+0000","last_undegraded":"2024-09-12T18:32:36.577178+0000","last_fullsized":"2024-09-12T18:32:36.577178+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:55.258084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":126,"num_write":62,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.409921+0000","last_change":"2024-09-12T17:53:27.170601+0000","last_active":"2024-09-12T18:33:26.409921+0000","last_peered":"2024-09-12T18:33:26.409921+0000","last_clean":"2024-09-12T18:33:26.409921+0000","last_became_active":"2024-09-12T17:53:27.169805+0000","last_became_peered":"2024-09-12T17:53:27.169805+0000","last_unstale":"2024-09-12T18:33:26.409921+0000","last_undegraded":"2024-09-12T18:33:26.409921+0000","last_fullsized":"2024-09-12T18:33:26.409921+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:47.368175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"268'2","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.591724+0000","last_change":"2024-09-12T17:31:16.221214+0000","last_active":"2024-09-12T18:33:46.591724+0000","last_peered":"2024-09-12T18:33:46.591724+0000","last_clean":"2024-09-12T18:33:46.591724+0000","last_became_active":"2024-09-12T17:31:16.220449+0000","last_became_peered":"2024-09-12T17:31:16.220449+0000","last_unstale":"2024-09-12T18:33:46.591724+0000","last_undegraded":"2024-09-12T18:33:46.591724+0000","last_fullsized":"2024-09-12T18:33:46.591724+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:06.706199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:15.567669+0000","last_change":"2024-09-12T17:31:12.086822+0000","last_active":"2024-09-12T18:31:15.567669+0000","last_peered":"2024-09-12T18:31:15.567669+0000","last_clean":"2024-09-12T18:31:15.567669+0000","last_became_active":"2024-09-12T17:31:12.086091+0000","last_became_peered":"2024-09-12T17:31:12.086091+0000","last_unstale":"2024-09-12T18:31:15.567669+0000","last_undegraded":"2024-09-12T18:31:15.567669+0000","last_fullsized":"2024-09-12T18:31:15.567669+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:29.857815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'57","reported_seq":217,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.414339+0000","last_change":"2024-09-12T17:27:32.569293+0000","last_active":"2024-09-12T18:33:06.414339+0000","last_peered":"2024-09-12T18:33:06.414339+0000","last_clean":"2024-09-12T18:33:06.414339+0000","last_became_active":"2024-09-12T17:27:32.568506+0000","last_became_peered":"2024-09-12T17:27:32.568506+0000","last_unstale":"2024-09-12T18:33:06.414339+0000","last_undegraded":"2024-09-12T18:33:06.414339+0000","last_fullsized":"2024-09-12T18:33:06.414339+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:54.976967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":207,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.410077+0000","last_change":"2024-09-12T17:53:27.171469+0000","last_active":"2024-09-12T18:33:26.410077+0000","last_peered":"2024-09-12T18:33:26.410077+0000","last_clean":"2024-09-12T18:33:26.410077+0000","last_became_active":"2024-09-12T17:53:27.170636+0000","last_became_peered":"2024-09-12T17:53:27.170636+0000","last_unstale":"2024-09-12T18:33:26.410077+0000","last_undegraded":"2024-09-12T18:33:26.410077+0000","last_fullsized":"2024-09-12T18:33:26.410077+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:42.171510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"268'3","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.420948+0000","last_change":"2024-09-12T17:31:16.239144+0000","last_active":"2024-09-12T18:33:49.420948+0000","last_peered":"2024-09-12T18:33:49.420948+0000","last_clean":"2024-09-12T18:33:49.420948+0000","last_became_active":"2024-09-12T17:31:16.238450+0000","last_became_peered":"2024-09-12T17:31:16.238450+0000","last_unstale":"2024-09-12T18:33:49.420948+0000","last_undegraded":"2024-09-12T18:33:49.420948+0000","last_fullsized":"2024-09-12T18:33:49.420948+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:24.540079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:11.389062+0000","last_change":"2024-09-12T17:31:12.091121+0000","last_active":"2024-09-12T18:31:11.389062+0000","last_peered":"2024-09-12T18:31:11.389062+0000","last_clean":"2024-09-12T18:31:11.389062+0000","last_became_active":"2024-09-12T17:31:12.090201+0000","last_became_peered":"2024-09-12T17:31:12.090201+0000","last_unstale":"2024-09-12T18:31:11.389062+0000","last_undegraded":"2024-09-12T18:31:11.389062+0000","last_fullsized":"2024-09-12T18:31:11.389062+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:59.375478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.639470+0000","last_change":"2024-09-12T17:27:32.568403+0000","last_active":"2024-09-12T18:32:51.639470+0000","last_peered":"2024-09-12T18:32:51.639470+0000","last_clean":"2024-09-12T18:32:51.639470+0000","last_became_active":"2024-09-12T17:27:32.567672+0000","last_became_peered":"2024-09-12T17:27:32.567672+0000","last_unstale":"2024-09-12T18:32:51.639470+0000","last_undegraded":"2024-09-12T18:32:51.639470+0000","last_fullsized":"2024-09-12T18:32:51.639470+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:49.181661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.643457+0000","last_change":"2024-09-12T17:53:27.142791+0000","last_active":"2024-09-12T18:33:06.643457+0000","last_peered":"2024-09-12T18:33:06.643457+0000","last_clean":"2024-09-12T18:33:06.643457+0000","last_became_active":"2024-09-12T17:53:27.142060+0000","last_became_peered":"2024-09-12T17:53:27.142060+0000","last_unstale":"2024-09-12T18:33:06.643457+0000","last_undegraded":"2024-09-12T18:33:06.643457+0000","last_fullsized":"2024-09-12T18:33:06.643457+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:50.140663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"268'4","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:44.391228+0000","last_change":"2024-09-12T17:31:16.235658+0000","last_active":"2024-09-12T18:31:44.391228+0000","last_peered":"2024-09-12T18:31:44.391228+0000","last_clean":"2024-09-12T18:31:44.391228+0000","last_became_active":"2024-09-12T17:31:16.228226+0000","last_became_peered":"2024-09-12T17:31:16.228226+0000","last_unstale":"2024-09-12T18:31:44.391228+0000","last_undegraded":"2024-09-12T18:31:44.391228+0000","last_fullsized":"2024-09-12T18:31:44.391228+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:12.245863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1072,"num_write":9,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'5","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:31.431352+0000","last_change":"2024-09-12T17:31:12.091577+0000","last_active":"2024-09-12T18:34:31.431352+0000","last_peered":"2024-09-12T18:34:31.431352+0000","last_clean":"2024-09-12T18:34:31.431352+0000","last_became_active":"2024-09-12T17:31:12.090779+0000","last_became_peered":"2024-09-12T17:31:12.090779+0000","last_unstale":"2024-09-12T18:34:31.431352+0000","last_undegraded":"2024-09-12T18:34:31.431352+0000","last_fullsized":"2024-09-12T18:34:31.431352+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:37.345815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'62","reported_seq":234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411872+0000","last_change":"2024-09-12T17:27:32.571784+0000","last_active":"2024-09-12T18:32:51.411872+0000","last_peered":"2024-09-12T18:32:51.411872+0000","last_clean":"2024-09-12T18:32:51.411872+0000","last_became_active":"2024-09-12T17:27:32.567884+0000","last_became_peered":"2024-09-12T17:27:32.567884+0000","last_unstale":"2024-09-12T18:32:51.411872+0000","last_undegraded":"2024-09-12T18:32:51.411872+0000","last_fullsized":"2024-09-12T18:32:51.411872+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:13.840706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":230,"num_write":101,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.801783+0000","last_change":"2024-09-12T17:53:27.140297+0000","last_active":"2024-09-12T18:33:06.801783+0000","last_peered":"2024-09-12T18:33:06.801783+0000","last_clean":"2024-09-12T18:33:06.801783+0000","last_became_active":"2024-09-12T17:53:27.139551+0000","last_became_peered":"2024-09-12T17:53:27.139551+0000","last_unstale":"2024-09-12T18:33:06.801783+0000","last_undegraded":"2024-09-12T18:33:06.801783+0000","last_fullsized":"2024-09-12T18:33:06.801783+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:49.095002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'3","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:14.398487+0000","last_change":"2024-09-12T17:31:16.237383+0000","last_active":"2024-09-12T18:32:14.398487+0000","last_peered":"2024-09-12T18:32:14.398487+0000","last_clean":"2024-09-12T18:32:14.398487+0000","last_became_active":"2024-09-12T17:31:16.236796+0000","last_became_peered":"2024-09-12T17:31:16.236796+0000","last_unstale":"2024-09-12T18:32:14.398487+0000","last_undegraded":"2024-09-12T18:32:14.398487+0000","last_fullsized":"2024-09-12T18:32:14.398487+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:49.523071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'4","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.419021+0000","last_change":"2024-09-12T17:31:12.093519+0000","last_active":"2024-09-12T18:34:01.419021+0000","last_peered":"2024-09-12T18:34:01.419021+0000","last_clean":"2024-09-12T18:34:01.419021+0000","last_became_active":"2024-09-12T17:31:12.092655+0000","last_became_peered":"2024-09-12T17:31:12.092655+0000","last_unstale":"2024-09-12T18:34:01.419021+0000","last_undegraded":"2024-09-12T18:34:01.419021+0000","last_fullsized":"2024-09-12T18:34:01.419021+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:42.350728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'23","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:49.407673+0000","last_change":"2024-09-12T17:27:32.579819+0000","last_active":"2024-09-12T18:32:49.407673+0000","last_peered":"2024-09-12T18:32:49.407673+0000","last_clean":"2024-09-12T18:32:49.407673+0000","last_became_active":"2024-09-12T17:27:32.578393+0000","last_became_peered":"2024-09-12T17:27:32.578393+0000","last_unstale":"2024-09-12T18:32:49.407673+0000","last_undegraded":"2024-09-12T18:32:49.407673+0000","last_fullsized":"2024-09-12T18:32:49.407673+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:12.325555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":84,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.404631+0000","last_change":"2024-09-12T17:53:27.151852+0000","last_active":"2024-09-12T18:33:06.404631+0000","last_peered":"2024-09-12T18:33:06.404631+0000","last_clean":"2024-09-12T18:33:06.404631+0000","last_became_active":"2024-09-12T17:53:27.142159+0000","last_became_peered":"2024-09-12T17:53:27.142159+0000","last_unstale":"2024-09-12T18:33:06.404631+0000","last_undegraded":"2024-09-12T18:33:06.404631+0000","last_fullsized":"2024-09-12T18:33:06.404631+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:32.788357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:09.425500+0000","last_change":"2024-09-12T17:31:16.237254+0000","last_active":"2024-09-12T18:34:09.425500+0000","last_peered":"2024-09-12T18:34:09.425500+0000","last_clean":"2024-09-12T18:34:09.425500+0000","last_became_active":"2024-09-12T17:31:16.236478+0000","last_became_peered":"2024-09-12T17:31:16.236478+0000","last_unstale":"2024-09-12T18:34:09.425500+0000","last_undegraded":"2024-09-12T18:34:09.425500+0000","last_fullsized":"2024-09-12T18:34:09.425500+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:03.647540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.781224+0000","last_change":"2024-09-12T17:31:12.092360+0000","last_active":"2024-09-12T18:31:36.781224+0000","last_peered":"2024-09-12T18:31:36.781224+0000","last_clean":"2024-09-12T18:31:36.781224+0000","last_became_active":"2024-09-12T17:31:12.091488+0000","last_became_peered":"2024-09-12T17:31:12.091488+0000","last_unstale":"2024-09-12T18:31:36.781224+0000","last_undegraded":"2024-09-12T18:31:36.781224+0000","last_fullsized":"2024-09-12T18:31:36.781224+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:42.860474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'49","reported_seq":200,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.798942+0000","last_change":"2024-09-12T17:27:32.573661+0000","last_active":"2024-09-12T18:32:51.798942+0000","last_peered":"2024-09-12T18:32:51.798942+0000","last_clean":"2024-09-12T18:32:51.798942+0000","last_became_active":"2024-09-12T17:27:32.572859+0000","last_became_peered":"2024-09-12T17:27:32.572859+0000","last_unstale":"2024-09-12T18:32:51.798942+0000","last_undegraded":"2024-09-12T18:32:51.798942+0000","last_fullsized":"2024-09-12T18:32:51.798942+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:51.245414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":198,"num_write":77,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.412028+0000","last_change":"2024-09-12T17:53:27.156462+0000","last_active":"2024-09-12T18:33:06.412028+0000","last_peered":"2024-09-12T18:33:06.412028+0000","last_clean":"2024-09-12T18:33:06.412028+0000","last_became_active":"2024-09-12T17:53:27.155646+0000","last_became_peered":"2024-09-12T17:53:27.155646+0000","last_unstale":"2024-09-12T18:33:06.412028+0000","last_undegraded":"2024-09-12T18:33:06.412028+0000","last_fullsized":"2024-09-12T18:33:06.412028+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:44.968007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:40.573394+0000","last_change":"2024-09-12T17:31:16.221542+0000","last_active":"2024-09-12T18:31:40.573394+0000","last_peered":"2024-09-12T18:31:40.573394+0000","last_clean":"2024-09-12T18:31:40.573394+0000","last_became_active":"2024-09-12T17:31:16.220797+0000","last_became_peered":"2024-09-12T17:31:16.220797+0000","last_unstale":"2024-09-12T18:31:40.573394+0000","last_undegraded":"2024-09-12T18:31:40.573394+0000","last_fullsized":"2024-09-12T18:31:40.573394+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:34.381182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.395227+0000","last_change":"2024-09-12T17:31:12.098496+0000","last_active":"2024-09-12T18:31:36.395227+0000","last_peered":"2024-09-12T18:31:36.395227+0000","last_clean":"2024-09-12T18:31:36.395227+0000","last_became_active":"2024-09-12T17:31:12.090174+0000","last_became_peered":"2024-09-12T17:31:12.090174+0000","last_unstale":"2024-09-12T18:31:36.395227+0000","last_undegraded":"2024-09-12T18:31:36.395227+0000","last_fullsized":"2024-09-12T18:31:36.395227+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:11.213746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'100","reported_seq":394,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.407333+0000","last_change":"2024-09-12T17:27:32.574809+0000","last_active":"2024-09-12T18:33:16.407333+0000","last_peered":"2024-09-12T18:33:16.407333+0000","last_clean":"2024-09-12T18:33:16.407333+0000","last_became_active":"2024-09-12T17:27:32.574023+0000","last_became_peered":"2024-09-12T17:27:32.574023+0000","last_unstale":"2024-09-12T18:33:16.407333+0000","last_undegraded":"2024-09-12T18:33:16.407333+0000","last_fullsized":"2024-09-12T18:33:16.407333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:43.524925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":651,"num_read_kb":453,"num_write":126,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:09.397336+0000","last_change":"2024-09-12T17:53:27.165446+0000","last_active":"2024-09-12T18:32:09.397336+0000","last_peered":"2024-09-12T18:32:09.397336+0000","last_clean":"2024-09-12T18:32:09.397336+0000","last_became_active":"2024-09-12T17:53:27.164643+0000","last_became_peered":"2024-09-12T17:53:27.164643+0000","last_unstale":"2024-09-12T18:32:09.397336+0000","last_undegraded":"2024-09-12T18:32:09.397336+0000","last_fullsized":"2024-09-12T18:32:09.397336+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:32.358718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"265'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.627015+0000","last_change":"2024-09-12T17:31:16.241953+0000","last_active":"2024-09-12T18:31:56.627015+0000","last_peered":"2024-09-12T18:31:56.627015+0000","last_clean":"2024-09-12T18:31:56.627015+0000","last_became_active":"2024-09-12T17:31:16.240666+0000","last_became_peered":"2024-09-12T17:31:16.240666+0000","last_unstale":"2024-09-12T18:31:56.627015+0000","last_undegraded":"2024-09-12T18:31:56.627015+0000","last_fullsized":"2024-09-12T18:31:56.627015+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:19.000830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'2","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:15.609579+0000","last_change":"2024-09-12T17:31:12.079972+0000","last_active":"2024-09-12T18:34:15.609579+0000","last_peered":"2024-09-12T18:34:15.609579+0000","last_clean":"2024-09-12T18:34:15.609579+0000","last_became_active":"2024-09-12T17:31:12.077055+0000","last_became_peered":"2024-09-12T17:31:12.077055+0000","last_unstale":"2024-09-12T18:34:15.609579+0000","last_undegraded":"2024-09-12T18:34:15.609579+0000","last_fullsized":"2024-09-12T18:34:15.609579+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:54.359866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'36","reported_seq":161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.402360+0000","last_change":"2024-09-12T17:27:32.575114+0000","last_active":"2024-09-12T18:32:56.402360+0000","last_peered":"2024-09-12T18:32:56.402360+0000","last_clean":"2024-09-12T18:32:56.402360+0000","last_became_active":"2024-09-12T17:27:32.574128+0000","last_became_peered":"2024-09-12T17:27:32.574128+0000","last_unstale":"2024-09-12T18:32:56.402360+0000","last_undegraded":"2024-09-12T18:32:56.402360+0000","last_fullsized":"2024-09-12T18:32:56.402360+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:30.567491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":129,"num_write":75,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.402547+0000","last_change":"2024-09-12T17:53:27.170202+0000","last_active":"2024-09-12T18:32:06.402547+0000","last_peered":"2024-09-12T18:32:06.402547+0000","last_clean":"2024-09-12T18:32:06.402547+0000","last_became_active":"2024-09-12T17:53:27.169499+0000","last_became_peered":"2024-09-12T17:53:27.169499+0000","last_unstale":"2024-09-12T18:32:06.402547+0000","last_undegraded":"2024-09-12T18:32:06.402547+0000","last_fullsized":"2024-09-12T18:32:06.402547+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:09.313257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"268'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:16.659287+0000","last_change":"2024-09-12T17:31:16.233694+0000","last_active":"2024-09-12T18:34:16.659287+0000","last_peered":"2024-09-12T18:34:16.659287+0000","last_clean":"2024-09-12T18:34:16.659287+0000","last_became_active":"2024-09-12T17:31:16.232949+0000","last_became_peered":"2024-09-12T17:31:16.232949+0000","last_unstale":"2024-09-12T18:34:16.659287+0000","last_undegraded":"2024-09-12T18:34:16.659287+0000","last_fullsized":"2024-09-12T18:34:16.659287+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:20.006807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'3","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:14.426601+0000","last_change":"2024-09-12T17:31:12.087042+0000","last_active":"2024-09-12T18:34:14.426601+0000","last_peered":"2024-09-12T18:34:14.426601+0000","last_clean":"2024-09-12T18:34:14.426601+0000","last_became_active":"2024-09-12T17:31:12.086300+0000","last_became_peered":"2024-09-12T17:31:12.086300+0000","last_unstale":"2024-09-12T18:34:14.426601+0000","last_undegraded":"2024-09-12T18:34:14.426601+0000","last_fullsized":"2024-09-12T18:34:14.426601+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:18.726386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'15","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.412585+0000","last_change":"2024-09-12T17:27:32.592754+0000","last_active":"2024-09-12T18:32:56.412585+0000","last_peered":"2024-09-12T18:32:56.412585+0000","last_clean":"2024-09-12T18:32:56.412585+0000","last_became_active":"2024-09-12T17:27:32.591878+0000","last_became_peered":"2024-09-12T17:27:32.591878+0000","last_unstale":"2024-09-12T18:32:56.412585+0000","last_undegraded":"2024-09-12T18:32:56.412585+0000","last_fullsized":"2024-09-12T18:32:56.412585+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:19.824090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.416384+0000","last_change":"2024-09-12T17:53:27.158764+0000","last_active":"2024-09-12T18:33:16.416384+0000","last_peered":"2024-09-12T18:33:16.416384+0000","last_clean":"2024-09-12T18:33:16.416384+0000","last_became_active":"2024-09-12T17:53:27.157992+0000","last_became_peered":"2024-09-12T17:53:27.157992+0000","last_unstale":"2024-09-12T18:33:16.416384+0000","last_undegraded":"2024-09-12T18:33:16.416384+0000","last_fullsized":"2024-09-12T18:33:16.416384+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:50.572142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428001+0000","last_change":"2024-09-12T17:31:16.228882+0000","last_active":"2024-09-12T18:34:19.428001+0000","last_peered":"2024-09-12T18:34:19.428001+0000","last_clean":"2024-09-12T18:34:19.428001+0000","last_became_active":"2024-09-12T17:31:16.227946+0000","last_became_peered":"2024-09-12T17:31:16.227946+0000","last_unstale":"2024-09-12T18:34:19.428001+0000","last_undegraded":"2024-09-12T18:34:19.428001+0000","last_fullsized":"2024-09-12T18:34:19.428001+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:58.107920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'5","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.567511+0000","last_change":"2024-09-12T17:31:12.106194+0000","last_active":"2024-09-12T18:31:51.567511+0000","last_peered":"2024-09-12T18:31:51.567511+0000","last_clean":"2024-09-12T18:31:51.567511+0000","last_became_active":"2024-09-12T17:31:12.105448+0000","last_became_peered":"2024-09-12T17:31:12.105448+0000","last_unstale":"2024-09-12T18:31:51.567511+0000","last_undegraded":"2024-09-12T18:31:51.567511+0000","last_fullsized":"2024-09-12T18:31:51.567511+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:55.162506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'22","reported_seq":120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:55.591164+0000","last_change":"2024-09-12T17:27:32.568251+0000","last_active":"2024-09-12T18:32:55.591164+0000","last_peered":"2024-09-12T18:32:55.591164+0000","last_clean":"2024-09-12T18:32:55.591164+0000","last_became_active":"2024-09-12T17:27:32.567500+0000","last_became_peered":"2024-09-12T17:27:32.567500+0000","last_unstale":"2024-09-12T18:32:55.591164+0000","last_undegraded":"2024-09-12T18:32:55.591164+0000","last_fullsized":"2024-09-12T18:32:55.591164+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:19.895653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:09.397287+0000","last_change":"2024-09-12T17:53:27.167094+0000","last_active":"2024-09-12T18:32:09.397287+0000","last_peered":"2024-09-12T18:32:09.397287+0000","last_clean":"2024-09-12T18:32:09.397287+0000","last_became_active":"2024-09-12T17:53:27.164083+0000","last_became_peered":"2024-09-12T17:53:27.164083+0000","last_unstale":"2024-09-12T18:32:09.397287+0000","last_undegraded":"2024-09-12T18:32:09.397287+0000","last_fullsized":"2024-09-12T18:32:09.397287+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:57.760600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"268'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:16.598266+0000","last_change":"2024-09-12T17:31:16.239173+0000","last_active":"2024-09-12T18:34:16.598266+0000","last_peered":"2024-09-12T18:34:16.598266+0000","last_clean":"2024-09-12T18:34:16.598266+0000","last_became_active":"2024-09-12T17:31:16.238356+0000","last_became_peered":"2024-09-12T17:31:16.238356+0000","last_unstale":"2024-09-12T18:34:16.598266+0000","last_undegraded":"2024-09-12T18:34:16.598266+0000","last_fullsized":"2024-09-12T18:34:16.598266+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:23.384787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'5","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:11.426742+0000","last_change":"2024-09-12T17:31:12.106100+0000","last_active":"2024-09-12T18:34:11.426742+0000","last_peered":"2024-09-12T18:34:11.426742+0000","last_clean":"2024-09-12T18:34:11.426742+0000","last_became_active":"2024-09-12T17:31:12.105300+0000","last_became_peered":"2024-09-12T17:31:12.105300+0000","last_unstale":"2024-09-12T18:34:11.426742+0000","last_undegraded":"2024-09-12T18:34:11.426742+0000","last_fullsized":"2024-09-12T18:34:11.426742+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:18.610444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'42","reported_seq":176,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:54.408584+0000","last_change":"2024-09-12T17:27:32.598060+0000","last_active":"2024-09-12T18:32:54.408584+0000","last_peered":"2024-09-12T18:32:54.408584+0000","last_clean":"2024-09-12T18:32:54.408584+0000","last_became_active":"2024-09-12T17:27:32.597518+0000","last_became_peered":"2024-09-12T17:27:32.597518+0000","last_unstale":"2024-09-12T18:32:54.408584+0000","last_undegraded":"2024-09-12T18:32:54.408584+0000","last_fullsized":"2024-09-12T18:32:54.408584+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:46.388068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":146,"num_write":82,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:31.795139+0000","last_change":"2024-09-12T17:53:27.140361+0000","last_active":"2024-09-12T18:32:31.795139+0000","last_peered":"2024-09-12T18:32:31.795139+0000","last_clean":"2024-09-12T18:32:31.795139+0000","last_became_active":"2024-09-12T17:53:27.139633+0000","last_became_peered":"2024-09-12T17:53:27.139633+0000","last_unstale":"2024-09-12T18:32:31.795139+0000","last_undegraded":"2024-09-12T18:32:31.795139+0000","last_fullsized":"2024-09-12T18:32:31.795139+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:33.101556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"265'4","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:04.395968+0000","last_change":"2024-09-12T17:31:16.233015+0000","last_active":"2024-09-12T18:32:04.395968+0000","last_peered":"2024-09-12T18:32:04.395968+0000","last_clean":"2024-09-12T18:32:04.395968+0000","last_became_active":"2024-09-12T17:31:16.229063+0000","last_became_peered":"2024-09-12T17:31:16.229063+0000","last_unstale":"2024-09-12T18:32:04.395968+0000","last_undegraded":"2024-09-12T18:32:04.395968+0000","last_fullsized":"2024-09-12T18:32:04.395968+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:10.227429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.388112+0000","last_change":"2024-09-12T17:31:12.094349+0000","last_active":"2024-09-12T18:31:56.388112+0000","last_peered":"2024-09-12T18:31:56.388112+0000","last_clean":"2024-09-12T18:31:56.388112+0000","last_became_active":"2024-09-12T17:31:12.093496+0000","last_became_peered":"2024-09-12T17:31:12.093496+0000","last_unstale":"2024-09-12T18:31:56.388112+0000","last_undegraded":"2024-09-12T18:31:56.388112+0000","last_fullsized":"2024-09-12T18:31:56.388112+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:37.609875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":4,"num_write_kb":1047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'15","reported_seq":104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.411590+0000","last_change":"2024-09-12T17:27:32.598394+0000","last_active":"2024-09-12T18:33:04.411590+0000","last_peered":"2024-09-12T18:33:04.411590+0000","last_clean":"2024-09-12T18:33:04.411590+0000","last_became_active":"2024-09-12T17:27:32.597694+0000","last_became_peered":"2024-09-12T17:27:32.597694+0000","last_unstale":"2024-09-12T18:33:04.411590+0000","last_undegraded":"2024-09-12T18:33:04.411590+0000","last_fullsized":"2024-09-12T18:33:04.411590+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:30.364314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.384432+0000","last_change":"2024-09-12T17:53:27.162772+0000","last_active":"2024-09-12T18:31:41.384432+0000","last_peered":"2024-09-12T18:31:41.384432+0000","last_clean":"2024-09-12T18:31:41.384432+0000","last_became_active":"2024-09-12T17:53:27.161396+0000","last_became_peered":"2024-09-12T17:53:27.161396+0000","last_unstale":"2024-09-12T18:31:41.384432+0000","last_undegraded":"2024-09-12T18:31:41.384432+0000","last_fullsized":"2024-09-12T18:31:41.384432+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:42.269208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'3","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428076+0000","last_change":"2024-09-12T17:31:16.239207+0000","last_active":"2024-09-12T18:34:19.428076+0000","last_peered":"2024-09-12T18:34:19.428076+0000","last_clean":"2024-09-12T18:34:19.428076+0000","last_became_active":"2024-09-12T17:31:16.238011+0000","last_became_peered":"2024-09-12T17:31:16.238011+0000","last_unstale":"2024-09-12T18:34:19.428076+0000","last_undegraded":"2024-09-12T18:34:19.428076+0000","last_fullsized":"2024-09-12T18:34:19.428076+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:16.439195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"268'7","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:11.814919+0000","last_change":"2024-09-12T17:31:12.094454+0000","last_active":"2024-09-12T18:34:11.814919+0000","last_peered":"2024-09-12T18:34:11.814919+0000","last_clean":"2024-09-12T18:34:11.814919+0000","last_became_active":"2024-09-12T17:31:12.093705+0000","last_became_peered":"2024-09-12T17:31:12.093705+0000","last_unstale":"2024-09-12T18:34:11.814919+0000","last_undegraded":"2024-09-12T18:34:11.814919+0000","last_fullsized":"2024-09-12T18:34:11.814919+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:41.345776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'6","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.408420+0000","last_change":"2024-09-12T17:27:32.580514+0000","last_active":"2024-09-12T18:32:51.408420+0000","last_peered":"2024-09-12T18:32:51.408420+0000","last_clean":"2024-09-12T18:32:51.408420+0000","last_became_active":"2024-09-12T17:27:32.579749+0000","last_became_peered":"2024-09-12T17:27:32.579749+0000","last_unstale":"2024-09-12T18:32:51.408420+0000","last_undegraded":"2024-09-12T18:32:51.408420+0000","last_fullsized":"2024-09-12T18:32:51.408420+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:28.676196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.575100+0000","last_change":"2024-09-12T17:53:27.145612+0000","last_active":"2024-09-12T18:32:26.575100+0000","last_peered":"2024-09-12T18:32:26.575100+0000","last_clean":"2024-09-12T18:32:26.575100+0000","last_became_active":"2024-09-12T17:53:27.142745+0000","last_became_peered":"2024-09-12T17:53:27.142745+0000","last_unstale":"2024-09-12T18:32:26.575100+0000","last_undegraded":"2024-09-12T18:32:26.575100+0000","last_fullsized":"2024-09-12T18:32:26.575100+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:38.589340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.632168+0000","last_change":"2024-09-12T17:31:16.242998+0000","last_active":"2024-09-12T18:32:16.632168+0000","last_peered":"2024-09-12T18:32:16.632168+0000","last_clean":"2024-09-12T18:32:16.632168+0000","last_became_active":"2024-09-12T17:31:16.242306+0000","last_became_peered":"2024-09-12T17:31:16.242306+0000","last_unstale":"2024-09-12T18:32:16.632168+0000","last_undegraded":"2024-09-12T18:32:16.632168+0000","last_fullsized":"2024-09-12T18:32:16.632168+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:38.335802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:11.428425+0000","last_change":"2024-09-12T17:31:12.078680+0000","last_active":"2024-09-12T18:34:11.428425+0000","last_peered":"2024-09-12T18:34:11.428425+0000","last_clean":"2024-09-12T18:34:11.428425+0000","last_became_active":"2024-09-12T17:31:12.077726+0000","last_became_peered":"2024-09-12T17:31:12.077726+0000","last_unstale":"2024-09-12T18:34:11.428425+0000","last_undegraded":"2024-09-12T18:34:11.428425+0000","last_fullsized":"2024-09-12T18:34:11.428425+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:51.018109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.580495+0000","last_change":"2024-09-12T17:27:32.583911+0000","last_active":"2024-09-12T18:32:51.580495+0000","last_peered":"2024-09-12T18:32:51.580495+0000","last_clean":"2024-09-12T18:32:51.580495+0000","last_became_active":"2024-09-12T17:27:32.583062+0000","last_became_peered":"2024-09-12T17:27:32.583062+0000","last_unstale":"2024-09-12T18:32:51.580495+0000","last_undegraded":"2024-09-12T18:32:51.580495+0000","last_fullsized":"2024-09-12T18:32:51.580495+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:20.224440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.395058+0000","last_change":"2024-09-12T17:53:27.165755+0000","last_active":"2024-09-12T18:32:26.395058+0000","last_peered":"2024-09-12T18:32:26.395058+0000","last_clean":"2024-09-12T18:32:26.395058+0000","last_became_active":"2024-09-12T17:53:27.163419+0000","last_became_peered":"2024-09-12T17:53:27.163419+0000","last_unstale":"2024-09-12T18:32:26.395058+0000","last_undegraded":"2024-09-12T18:32:26.395058+0000","last_fullsized":"2024-09-12T18:32:26.395058+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:39.501106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:04.396028+0000","last_change":"2024-09-12T17:31:16.237342+0000","last_active":"2024-09-12T18:32:04.396028+0000","last_peered":"2024-09-12T18:32:04.396028+0000","last_clean":"2024-09-12T18:32:04.396028+0000","last_became_active":"2024-09-12T17:31:16.236619+0000","last_became_peered":"2024-09-12T17:31:16.236619+0000","last_unstale":"2024-09-12T18:32:04.396028+0000","last_undegraded":"2024-09-12T18:32:04.396028+0000","last_fullsized":"2024-09-12T18:32:04.396028+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:58.072849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"268'7","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.386741+0000","last_change":"2024-09-12T17:31:12.107461+0000","last_active":"2024-09-12T18:35:59.386741+0000","last_peered":"2024-09-12T18:35:59.386741+0000","last_clean":"2024-09-12T18:35:59.386741+0000","last_became_active":"2024-09-12T17:31:12.105793+0000","last_became_peered":"2024-09-12T17:31:12.105793+0000","last_unstale":"2024-09-12T18:35:59.386741+0000","last_undegraded":"2024-09-12T18:35:59.386741+0000","last_fullsized":"2024-09-12T18:35:59.386741+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:10.448109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'53","reported_seq":206,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.798887+0000","last_change":"2024-09-12T17:27:32.570407+0000","last_active":"2024-09-12T18:32:51.798887+0000","last_peered":"2024-09-12T18:32:51.798887+0000","last_clean":"2024-09-12T18:32:51.798887+0000","last_became_active":"2024-09-12T17:27:32.569594+0000","last_became_peered":"2024-09-12T17:27:32.569594+0000","last_unstale":"2024-09-12T18:32:51.798887+0000","last_undegraded":"2024-09-12T18:32:51.798887+0000","last_fullsized":"2024-09-12T18:32:51.798887+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:44.112049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":187,"num_write":95,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:44.391279+0000","last_change":"2024-09-12T17:53:27.166701+0000","last_active":"2024-09-12T18:31:44.391279+0000","last_peered":"2024-09-12T18:31:44.391279+0000","last_clean":"2024-09-12T18:31:44.391279+0000","last_became_active":"2024-09-12T17:53:27.165129+0000","last_became_peered":"2024-09-12T17:53:27.165129+0000","last_unstale":"2024-09-12T18:31:44.391279+0000","last_undegraded":"2024-09-12T18:31:44.391279+0000","last_fullsized":"2024-09-12T18:31:44.391279+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:59.004034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"268'2","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:05.607436+0000","last_change":"2024-09-12T17:31:16.240818+0000","last_active":"2024-09-12T18:34:05.607436+0000","last_peered":"2024-09-12T18:34:05.607436+0000","last_clean":"2024-09-12T18:34:05.607436+0000","last_became_active":"2024-09-12T17:31:16.240152+0000","last_became_peered":"2024-09-12T17:31:16.240152+0000","last_unstale":"2024-09-12T18:34:05.607436+0000","last_undegraded":"2024-09-12T18:34:05.607436+0000","last_fullsized":"2024-09-12T18:34:05.607436+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:20.290016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'5","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.942432+0000","last_change":"2024-09-12T17:31:12.098113+0000","last_active":"2024-09-12T18:35:59.942432+0000","last_peered":"2024-09-12T18:35:59.942432+0000","last_clean":"2024-09-12T18:35:59.942432+0000","last_became_active":"2024-09-12T17:31:12.089200+0000","last_became_peered":"2024-09-12T17:31:12.089200+0000","last_unstale":"2024-09-12T18:35:59.942432+0000","last_undegraded":"2024-09-12T18:35:59.942432+0000","last_fullsized":"2024-09-12T18:35:59.942432+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:44.577058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8242,"num_write":10,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'48","reported_seq":193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411678+0000","last_change":"2024-09-12T17:27:32.570665+0000","last_active":"2024-09-12T18:32:51.411678+0000","last_peered":"2024-09-12T18:32:51.411678+0000","last_clean":"2024-09-12T18:32:51.411678+0000","last_became_active":"2024-09-12T17:27:32.568661+0000","last_became_peered":"2024-09-12T17:27:32.568661+0000","last_unstale":"2024-09-12T18:32:51.411678+0000","last_undegraded":"2024-09-12T18:32:51.411678+0000","last_fullsized":"2024-09-12T18:32:51.411678+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:42.609534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":169,"num_write":85,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.388216+0000","last_change":"2024-09-12T17:53:27.171856+0000","last_active":"2024-09-12T18:31:56.388216+0000","last_peered":"2024-09-12T18:31:56.388216+0000","last_clean":"2024-09-12T18:31:56.388216+0000","last_became_active":"2024-09-12T17:53:27.170493+0000","last_became_peered":"2024-09-12T17:53:27.170493+0000","last_unstale":"2024-09-12T18:31:56.388216+0000","last_undegraded":"2024-09-12T18:31:56.388216+0000","last_fullsized":"2024-09-12T18:31:56.388216+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:44.616138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'6","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.488880+0000","last_change":"2024-09-12T17:31:16.229295+0000","last_active":"2024-09-12T18:35:59.488880+0000","last_peered":"2024-09-12T18:35:59.488880+0000","last_clean":"2024-09-12T18:35:59.488880+0000","last_became_active":"2024-09-12T17:31:16.228566+0000","last_became_peered":"2024-09-12T17:31:16.228566+0000","last_unstale":"2024-09-12T18:35:59.488880+0000","last_undegraded":"2024-09-12T18:35:59.488880+0000","last_fullsized":"2024-09-12T18:35:59.488880+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:12.639985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5238,"num_write":11,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'4","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.387491+0000","last_change":"2024-09-12T17:31:12.106105+0000","last_active":"2024-09-12T18:35:59.387491+0000","last_peered":"2024-09-12T18:35:59.387491+0000","last_clean":"2024-09-12T18:35:59.387491+0000","last_became_active":"2024-09-12T17:31:12.105384+0000","last_became_peered":"2024-09-12T17:31:12.105384+0000","last_unstale":"2024-09-12T18:35:59.387491+0000","last_undegraded":"2024-09-12T18:35:59.387491+0000","last_fullsized":"2024-09-12T18:35:59.387491+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:47.101516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'110","reported_seq":479,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.402295+0000","last_change":"2024-09-12T17:27:32.587346+0000","last_active":"2024-09-12T18:32:56.402295+0000","last_peered":"2024-09-12T18:32:56.402295+0000","last_clean":"2024-09-12T18:32:56.402295+0000","last_became_active":"2024-09-12T17:27:32.586640+0000","last_became_peered":"2024-09-12T17:27:32.586640+0000","last_unstale":"2024-09-12T18:32:56.402295+0000","last_undegraded":"2024-09-12T18:32:56.402295+0000","last_fullsized":"2024-09-12T18:32:56.402295+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:13.010550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":815,"num_read_kb":525,"num_write":139,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.384492+0000","last_change":"2024-09-12T17:53:27.171182+0000","last_active":"2024-09-12T18:31:41.384492+0000","last_peered":"2024-09-12T18:31:41.384492+0000","last_clean":"2024-09-12T18:31:41.384492+0000","last_became_active":"2024-09-12T17:53:27.170381+0000","last_became_peered":"2024-09-12T17:53:27.170381+0000","last_unstale":"2024-09-12T18:31:41.384492+0000","last_undegraded":"2024-09-12T18:31:41.384492+0000","last_fullsized":"2024-09-12T18:31:41.384492+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:22.200905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'7","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.757389+0000","last_change":"2024-09-12T17:31:16.245927+0000","last_active":"2024-09-12T18:36:00.757389+0000","last_peered":"2024-09-12T18:36:00.757389+0000","last_clean":"2024-09-12T18:36:00.757389+0000","last_became_active":"2024-09-12T17:31:16.245228+0000","last_became_peered":"2024-09-12T17:31:16.245228+0000","last_unstale":"2024-09-12T18:36:00.757389+0000","last_undegraded":"2024-09-12T18:36:00.757389+0000","last_fullsized":"2024-09-12T18:36:00.757389+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:57.083185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":48,"num_write":12,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'2","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:16.429502+0000","last_change":"2024-09-12T17:31:12.091353+0000","last_active":"2024-09-12T18:34:16.429502+0000","last_peered":"2024-09-12T18:34:16.429502+0000","last_clean":"2024-09-12T18:34:16.429502+0000","last_became_active":"2024-09-12T17:31:12.089735+0000","last_became_peered":"2024-09-12T17:31:12.089735+0000","last_unstale":"2024-09-12T18:34:16.429502+0000","last_undegraded":"2024-09-12T18:34:16.429502+0000","last_fullsized":"2024-09-12T18:34:16.429502+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:58.780190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'45","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.402987+0000","last_change":"2024-09-12T17:27:32.576354+0000","last_active":"2024-09-12T18:32:34.402987+0000","last_peered":"2024-09-12T18:32:34.402987+0000","last_clean":"2024-09-12T18:32:34.402987+0000","last_became_active":"2024-09-12T17:27:32.575300+0000","last_became_peered":"2024-09-12T17:27:32.575300+0000","last_unstale":"2024-09-12T18:32:34.402987+0000","last_undegraded":"2024-09-12T18:32:34.402987+0000","last_fullsized":"2024-09-12T18:32:34.402987+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:55.469608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":157,"num_write":84,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.396512+0000","last_change":"2024-09-12T17:53:27.174556+0000","last_active":"2024-09-12T18:31:41.396512+0000","last_peered":"2024-09-12T18:31:41.396512+0000","last_clean":"2024-09-12T18:31:41.396512+0000","last_became_active":"2024-09-12T17:53:27.173955+0000","last_became_peered":"2024-09-12T17:53:27.173955+0000","last_unstale":"2024-09-12T18:31:41.396512+0000","last_undegraded":"2024-09-12T18:31:41.396512+0000","last_fullsized":"2024-09-12T18:31:41.396512+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:48.495953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.392719+0000","last_change":"2024-09-12T17:31:16.232804+0000","last_active":"2024-09-12T18:32:16.392719+0000","last_peered":"2024-09-12T18:32:16.392719+0000","last_clean":"2024-09-12T18:32:16.392719+0000","last_became_active":"2024-09-12T17:31:16.231516+0000","last_became_peered":"2024-09-12T17:31:16.231516+0000","last_unstale":"2024-09-12T18:32:16.392719+0000","last_undegraded":"2024-09-12T18:32:16.392719+0000","last_fullsized":"2024-09-12T18:32:16.392719+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:15.629748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:00.578348+0000","last_change":"2024-09-12T17:31:12.084858+0000","last_active":"2024-09-12T18:32:00.578348+0000","last_peered":"2024-09-12T18:32:00.578348+0000","last_clean":"2024-09-12T18:32:00.578348+0000","last_became_active":"2024-09-12T17:31:12.084158+0000","last_became_peered":"2024-09-12T17:31:12.084158+0000","last_unstale":"2024-09-12T18:32:00.578348+0000","last_undegraded":"2024-09-12T18:32:00.578348+0000","last_fullsized":"2024-09-12T18:32:00.578348+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:57.119863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'55","reported_seq":211,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.577105+0000","last_change":"2024-09-12T17:27:32.577701+0000","last_active":"2024-09-12T18:32:36.577105+0000","last_peered":"2024-09-12T18:32:36.577105+0000","last_clean":"2024-09-12T18:32:36.577105+0000","last_became_active":"2024-09-12T17:27:32.569924+0000","last_became_peered":"2024-09-12T17:27:32.569924+0000","last_unstale":"2024-09-12T18:32:36.577105+0000","last_undegraded":"2024-09-12T18:32:36.577105+0000","last_fullsized":"2024-09-12T18:32:36.577105+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:22.820241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":184,"num_write":101,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.403508+0000","last_change":"2024-09-12T17:53:27.163286+0000","last_active":"2024-09-12T18:33:01.403508+0000","last_peered":"2024-09-12T18:33:01.403508+0000","last_clean":"2024-09-12T18:33:01.403508+0000","last_became_active":"2024-09-12T17:53:27.162527+0000","last_became_peered":"2024-09-12T17:53:27.162527+0000","last_unstale":"2024-09-12T18:33:01.403508+0000","last_undegraded":"2024-09-12T18:33:01.403508+0000","last_fullsized":"2024-09-12T18:33:01.403508+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:27.017224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.400455+0000","last_change":"2024-09-12T17:31:16.245393+0000","last_active":"2024-09-12T18:31:56.400455+0000","last_peered":"2024-09-12T18:31:56.400455+0000","last_clean":"2024-09-12T18:31:56.400455+0000","last_became_active":"2024-09-12T17:31:16.244556+0000","last_became_peered":"2024-09-12T17:31:16.244556+0000","last_unstale":"2024-09-12T18:31:56.400455+0000","last_undegraded":"2024-09-12T18:31:56.400455+0000","last_fullsized":"2024-09-12T18:31:56.400455+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:52.690426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'7","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.413674+0000","last_change":"2024-09-12T17:31:12.081797+0000","last_active":"2024-09-12T18:33:41.413674+0000","last_peered":"2024-09-12T18:33:41.413674+0000","last_clean":"2024-09-12T18:33:41.413674+0000","last_became_active":"2024-09-12T17:31:12.081025+0000","last_became_peered":"2024-09-12T17:31:12.081025+0000","last_unstale":"2024-09-12T18:33:41.413674+0000","last_undegraded":"2024-09-12T18:33:41.413674+0000","last_fullsized":"2024-09-12T18:33:41.413674+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:23.240064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.408791+0000","last_change":"2024-09-12T17:27:32.562776+0000","last_active":"2024-09-12T18:32:36.408791+0000","last_peered":"2024-09-12T18:32:36.408791+0000","last_clean":"2024-09-12T18:32:36.408791+0000","last_became_active":"2024-09-12T17:27:32.561993+0000","last_became_peered":"2024-09-12T17:27:32.561993+0000","last_unstale":"2024-09-12T18:32:36.408791+0000","last_undegraded":"2024-09-12T18:32:36.408791+0000","last_fullsized":"2024-09-12T18:32:36.408791+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:55.063772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":121,"num_write":59,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.410789+0000","last_change":"2024-09-12T17:53:27.153890+0000","last_active":"2024-09-12T18:33:01.410789+0000","last_peered":"2024-09-12T18:33:01.410789+0000","last_clean":"2024-09-12T18:33:01.410789+0000","last_became_active":"2024-09-12T17:53:27.153125+0000","last_became_peered":"2024-09-12T17:53:27.153125+0000","last_unstale":"2024-09-12T18:33:01.410789+0000","last_undegraded":"2024-09-12T18:33:01.410789+0000","last_fullsized":"2024-09-12T18:33:01.410789+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:29.571163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'6","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:51.449584+0000","last_change":"2024-09-12T17:31:16.223351+0000","last_active":"2024-09-12T18:35:51.449584+0000","last_peered":"2024-09-12T18:35:51.449584+0000","last_clean":"2024-09-12T18:35:51.449584+0000","last_became_active":"2024-09-12T17:31:16.212330+0000","last_became_peered":"2024-09-12T17:31:16.212330+0000","last_unstale":"2024-09-12T18:35:51.449584+0000","last_undegraded":"2024-09-12T18:35:51.449584+0000","last_fullsized":"2024-09-12T18:35:51.449584+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:36.131170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'2","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.810431+0000","last_change":"2024-09-12T17:31:12.094672+0000","last_active":"2024-09-12T18:33:51.810431+0000","last_peered":"2024-09-12T18:33:51.810431+0000","last_clean":"2024-09-12T18:33:51.810431+0000","last_became_active":"2024-09-12T17:31:12.093752+0000","last_became_peered":"2024-09-12T17:31:12.093752+0000","last_unstale":"2024-09-12T18:33:51.810431+0000","last_undegraded":"2024-09-12T18:33:51.810431+0000","last_fullsized":"2024-09-12T18:33:51.810431+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:44.826244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.577266+0000","last_change":"2024-09-12T17:27:32.583969+0000","last_active":"2024-09-12T18:32:36.577266+0000","last_peered":"2024-09-12T18:32:36.577266+0000","last_clean":"2024-09-12T18:32:36.577266+0000","last_became_active":"2024-09-12T17:27:32.583070+0000","last_became_peered":"2024-09-12T17:27:32.583070+0000","last_unstale":"2024-09-12T18:32:36.577266+0000","last_undegraded":"2024-09-12T18:32:36.577266+0000","last_fullsized":"2024-09-12T18:32:36.577266+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:54.241847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.649994+0000","last_change":"2024-09-12T17:53:27.155092+0000","last_active":"2024-09-12T18:33:36.649994+0000","last_peered":"2024-09-12T18:33:36.649994+0000","last_clean":"2024-09-12T18:33:36.649994+0000","last_became_active":"2024-09-12T17:53:27.154309+0000","last_became_peered":"2024-09-12T17:53:27.154309+0000","last_unstale":"2024-09-12T18:33:36.649994+0000","last_undegraded":"2024-09-12T18:33:36.649994+0000","last_fullsized":"2024-09-12T18:33:36.649994+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:16.746183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'8","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:06.420402+0000","last_change":"2024-09-12T17:31:16.231548+0000","last_active":"2024-09-12T18:34:06.420402+0000","last_peered":"2024-09-12T18:34:06.420402+0000","last_clean":"2024-09-12T18:34:06.420402+0000","last_became_active":"2024-09-12T17:31:16.230809+0000","last_became_peered":"2024-09-12T17:31:16.230809+0000","last_unstale":"2024-09-12T18:34:06.420402+0000","last_undegraded":"2024-09-12T18:34:06.420402+0000","last_fullsized":"2024-09-12T18:34:06.420402+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:50.950013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":16386,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"265'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.394003+0000","last_change":"2024-09-12T17:31:12.084859+0000","last_active":"2024-09-12T18:31:51.394003+0000","last_peered":"2024-09-12T18:31:51.394003+0000","last_clean":"2024-09-12T18:31:51.394003+0000","last_became_active":"2024-09-12T17:31:12.084101+0000","last_became_peered":"2024-09-12T17:31:12.084101+0000","last_unstale":"2024-09-12T18:31:51.394003+0000","last_undegraded":"2024-09-12T18:31:51.394003+0000","last_fullsized":"2024-09-12T18:31:51.394003+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:18.901928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'37","reported_seq":163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:31.396318+0000","last_change":"2024-09-12T17:27:32.582926+0000","last_active":"2024-09-12T18:32:31.396318+0000","last_peered":"2024-09-12T18:32:31.396318+0000","last_clean":"2024-09-12T18:32:31.396318+0000","last_became_active":"2024-09-12T17:27:32.582183+0000","last_became_peered":"2024-09-12T17:27:32.582183+0000","last_unstale":"2024-09-12T18:32:31.396318+0000","last_undegraded":"2024-09-12T18:32:31.396318+0000","last_fullsized":"2024-09-12T18:32:31.396318+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:44.094594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":125,"num_write":74,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.593556+0000","last_change":"2024-09-12T17:53:27.160005+0000","last_active":"2024-09-12T18:33:05.593556+0000","last_peered":"2024-09-12T18:33:05.593556+0000","last_clean":"2024-09-12T18:33:05.593556+0000","last_became_active":"2024-09-12T17:53:27.159240+0000","last_became_peered":"2024-09-12T17:53:27.159240+0000","last_unstale":"2024-09-12T18:33:05.593556+0000","last_undegraded":"2024-09-12T18:33:05.593556+0000","last_fullsized":"2024-09-12T18:33:05.593556+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:37.529736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'3","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:55.577221+0000","last_change":"2024-09-12T17:31:16.226574+0000","last_active":"2024-09-12T18:31:55.577221+0000","last_peered":"2024-09-12T18:31:55.577221+0000","last_clean":"2024-09-12T18:31:55.577221+0000","last_became_active":"2024-09-12T17:31:16.225754+0000","last_became_peered":"2024-09-12T17:31:16.225754+0000","last_unstale":"2024-09-12T18:31:55.577221+0000","last_undegraded":"2024-09-12T18:31:55.577221+0000","last_fullsized":"2024-09-12T18:31:55.577221+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:30.610378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.386970+0000","last_change":"2024-09-12T17:31:12.088188+0000","last_active":"2024-09-12T18:31:51.386970+0000","last_peered":"2024-09-12T18:31:51.386970+0000","last_clean":"2024-09-12T18:31:51.386970+0000","last_became_active":"2024-09-12T17:31:12.087356+0000","last_became_peered":"2024-09-12T17:31:12.087356+0000","last_unstale":"2024-09-12T18:31:51.386970+0000","last_undegraded":"2024-09-12T18:31:51.386970+0000","last_fullsized":"2024-09-12T18:31:51.386970+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:57.783040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'23","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.630906+0000","last_change":"2024-09-12T17:27:32.584476+0000","last_active":"2024-09-12T18:32:11.630906+0000","last_peered":"2024-09-12T18:32:11.630906+0000","last_clean":"2024-09-12T18:32:11.630906+0000","last_became_active":"2024-09-12T17:27:32.583631+0000","last_became_peered":"2024-09-12T17:27:32.583631+0000","last_unstale":"2024-09-12T18:32:11.630906+0000","last_undegraded":"2024-09-12T18:32:11.630906+0000","last_fullsized":"2024-09-12T18:32:11.630906+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:24.021549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":83,"num_write":39,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'1","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.790817+0000","last_change":"2024-09-12T17:53:27.156217+0000","last_active":"2024-09-12T18:32:26.790817+0000","last_peered":"2024-09-12T18:32:26.790817+0000","last_clean":"2024-09-12T18:32:26.790817+0000","last_became_active":"2024-09-12T17:53:27.152651+0000","last_became_peered":"2024-09-12T17:53:27.152651+0000","last_unstale":"2024-09-12T18:32:26.790817+0000","last_undegraded":"2024-09-12T18:32:26.790817+0000","last_fullsized":"2024-09-12T18:32:26.790817+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:24.443187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'9","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.486208+0000","last_change":"2024-09-12T17:31:16.243687+0000","last_active":"2024-09-12T18:35:59.486208+0000","last_peered":"2024-09-12T18:35:59.486208+0000","last_clean":"2024-09-12T18:35:59.486208+0000","last_became_active":"2024-09-12T17:31:16.242981+0000","last_became_peered":"2024-09-12T17:31:16.242981+0000","last_unstale":"2024-09-12T18:35:59.486208+0000","last_undegraded":"2024-09-12T18:35:59.486208+0000","last_fullsized":"2024-09-12T18:35:59.486208+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:07.505703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15362,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.411117+0000","last_change":"2024-09-12T17:31:12.097913+0000","last_active":"2024-09-12T18:33:31.411117+0000","last_peered":"2024-09-12T18:33:31.411117+0000","last_clean":"2024-09-12T18:33:31.411117+0000","last_became_active":"2024-09-12T17:31:12.097216+0000","last_became_peered":"2024-09-12T17:31:12.097216+0000","last_unstale":"2024-09-12T18:33:31.411117+0000","last_undegraded":"2024-09-12T18:33:31.411117+0000","last_fullsized":"2024-09-12T18:33:31.411117+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:29.988488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'30","reported_seq":143,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.399472+0000","last_change":"2024-09-12T17:27:32.572524+0000","last_active":"2024-09-12T18:32:11.399472+0000","last_peered":"2024-09-12T18:32:11.399472+0000","last_clean":"2024-09-12T18:32:11.399472+0000","last_became_active":"2024-09-12T17:27:32.571830+0000","last_became_peered":"2024-09-12T17:27:32.571830+0000","last_unstale":"2024-09-12T18:32:11.399472+0000","last_undegraded":"2024-09-12T18:32:11.399472+0000","last_fullsized":"2024-09-12T18:32:11.399472+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:50.997968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":95,"num_write":63,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.406561+0000","last_change":"2024-09-12T17:53:27.163946+0000","last_active":"2024-09-12T18:32:26.406561+0000","last_peered":"2024-09-12T18:32:26.406561+0000","last_clean":"2024-09-12T18:32:26.406561+0000","last_became_active":"2024-09-12T17:53:27.163113+0000","last_became_peered":"2024-09-12T17:53:27.163113+0000","last_unstale":"2024-09-12T18:32:26.406561+0000","last_undegraded":"2024-09-12T18:32:26.406561+0000","last_fullsized":"2024-09-12T18:32:26.406561+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:01.071160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.418774+0000","last_change":"2024-09-12T17:31:16.234271+0000","last_active":"2024-09-12T18:33:36.418774+0000","last_peered":"2024-09-12T18:33:36.418774+0000","last_clean":"2024-09-12T18:33:36.418774+0000","last_became_active":"2024-09-12T17:31:16.233558+0000","last_became_peered":"2024-09-12T17:31:16.233558+0000","last_unstale":"2024-09-12T18:33:36.418774+0000","last_undegraded":"2024-09-12T18:33:36.418774+0000","last_fullsized":"2024-09-12T18:33:36.418774+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:03.391887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'7","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:46.444961+0000","last_change":"2024-09-12T17:31:12.094815+0000","last_active":"2024-09-12T18:35:46.444961+0000","last_peered":"2024-09-12T18:35:46.444961+0000","last_clean":"2024-09-12T18:35:46.444961+0000","last_became_active":"2024-09-12T17:31:12.094159+0000","last_became_peered":"2024-09-12T17:31:12.094159+0000","last_unstale":"2024-09-12T18:35:46.444961+0000","last_undegraded":"2024-09-12T18:35:46.444961+0000","last_fullsized":"2024-09-12T18:35:46.444961+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:09.522281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3074,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'20","reported_seq":124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:10.580606+0000","last_change":"2024-09-12T17:27:32.596142+0000","last_active":"2024-09-12T18:32:10.580606+0000","last_peered":"2024-09-12T18:32:10.580606+0000","last_clean":"2024-09-12T18:32:10.580606+0000","last_became_active":"2024-09-12T17:27:32.595524+0000","last_became_peered":"2024-09-12T17:27:32.595524+0000","last_unstale":"2024-09-12T18:32:10.580606+0000","last_undegraded":"2024-09-12T18:32:10.580606+0000","last_fullsized":"2024-09-12T18:32:10.580606+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:10.999486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":74,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.413732+0000","last_change":"2024-09-12T17:53:27.175841+0000","last_active":"2024-09-12T18:33:01.413732+0000","last_peered":"2024-09-12T18:33:01.413732+0000","last_clean":"2024-09-12T18:33:01.413732+0000","last_became_active":"2024-09-12T17:53:27.175125+0000","last_became_peered":"2024-09-12T17:53:27.175125+0000","last_unstale":"2024-09-12T18:33:01.413732+0000","last_undegraded":"2024-09-12T18:33:01.413732+0000","last_fullsized":"2024-09-12T18:33:01.413732+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:18.938638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'4","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.591667+0000","last_change":"2024-09-12T17:31:16.212462+0000","last_active":"2024-09-12T18:33:46.591667+0000","last_peered":"2024-09-12T18:33:46.591667+0000","last_clean":"2024-09-12T18:33:46.591667+0000","last_became_active":"2024-09-12T17:31:16.211664+0000","last_became_peered":"2024-09-12T17:31:16.211664+0000","last_unstale":"2024-09-12T18:33:46.591667+0000","last_undegraded":"2024-09-12T18:33:46.591667+0000","last_fullsized":"2024-09-12T18:33:46.591667+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:00.841100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1069,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'4","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.387515+0000","last_change":"2024-09-12T17:31:12.101932+0000","last_active":"2024-09-12T18:35:59.387515+0000","last_peered":"2024-09-12T18:35:59.387515+0000","last_clean":"2024-09-12T18:35:59.387515+0000","last_became_active":"2024-09-12T17:31:12.099608+0000","last_became_peered":"2024-09-12T17:31:12.099608+0000","last_unstale":"2024-09-12T18:35:59.387515+0000","last_undegraded":"2024-09-12T18:35:59.387515+0000","last_fullsized":"2024-09-12T18:35:59.387515+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:36.462019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'56","reported_seq":218,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.571812+0000","last_change":"2024-09-12T17:27:32.569526+0000","last_active":"2024-09-12T18:32:11.571812+0000","last_peered":"2024-09-12T18:32:11.571812+0000","last_clean":"2024-09-12T18:32:11.571812+0000","last_became_active":"2024-09-12T17:27:32.568785+0000","last_became_peered":"2024-09-12T17:27:32.568785+0000","last_unstale":"2024-09-12T18:32:11.571812+0000","last_undegraded":"2024-09-12T18:32:11.571812+0000","last_fullsized":"2024-09-12T18:32:11.571812+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:14.598346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":196,"num_write":113,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.407392+0000","last_change":"2024-09-12T17:53:27.175493+0000","last_active":"2024-09-12T18:33:16.407392+0000","last_peered":"2024-09-12T18:33:16.407392+0000","last_clean":"2024-09-12T18:33:16.407392+0000","last_became_active":"2024-09-12T17:53:27.175073+0000","last_became_peered":"2024-09-12T17:53:27.175073+0000","last_unstale":"2024-09-12T18:33:16.407392+0000","last_undegraded":"2024-09-12T18:33:16.407392+0000","last_fullsized":"2024-09-12T18:33:16.407392+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:43.723718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.602853+0000","last_change":"2024-09-12T17:31:16.229188+0000","last_active":"2024-09-12T18:33:45.602853+0000","last_peered":"2024-09-12T18:33:45.602853+0000","last_clean":"2024-09-12T18:33:45.602853+0000","last_became_active":"2024-09-12T17:31:16.228416+0000","last_became_peered":"2024-09-12T17:31:16.228416+0000","last_unstale":"2024-09-12T18:33:45.602853+0000","last_undegraded":"2024-09-12T18:33:45.602853+0000","last_fullsized":"2024-09-12T18:33:45.602853+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:54.390718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.590617+0000","last_change":"2024-09-12T17:31:12.089066+0000","last_active":"2024-09-12T18:33:41.590617+0000","last_peered":"2024-09-12T18:33:41.590617+0000","last_clean":"2024-09-12T18:33:41.590617+0000","last_became_active":"2024-09-12T17:31:12.088297+0000","last_became_peered":"2024-09-12T17:31:12.088297+0000","last_unstale":"2024-09-12T18:33:41.590617+0000","last_undegraded":"2024-09-12T18:33:41.590617+0000","last_fullsized":"2024-09-12T18:33:41.590617+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:37.483806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'16","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.417452+0000","last_change":"2024-09-12T17:27:32.585156+0000","last_active":"2024-09-12T18:33:56.417452+0000","last_peered":"2024-09-12T18:33:56.417452+0000","last_clean":"2024-09-12T18:33:56.417452+0000","last_became_active":"2024-09-12T17:27:32.584404+0000","last_became_peered":"2024-09-12T17:27:32.584404+0000","last_unstale":"2024-09-12T18:33:56.417452+0000","last_undegraded":"2024-09-12T18:33:56.417452+0000","last_fullsized":"2024-09-12T18:33:56.417452+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:00.210204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":55,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'297","reported_seq":943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.372754+0000","last_change":"2024-09-12T17:10:30.407868+0000","last_active":"2024-09-12T18:36:01.372754+0000","last_peered":"2024-09-12T18:36:01.372754+0000","last_clean":"2024-09-12T18:36:01.372754+0000","last_became_active":"2024-09-12T17:10:30.407181+0000","last_became_peered":"2024-09-12T17:10:30.407181+0000","last_unstale":"2024-09-12T18:36:01.372754+0000","last_undegraded":"2024-09-12T18:36:01.372754+0000","last_fullsized":"2024-09-12T18:36:01.372754+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:59.494627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10755813,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":460,"num_read_kb":10654,"num_write":899,"num_write_kb":47496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'781","reported_seq":2314,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.923295+0000","last_change":"2024-09-12T17:10:32.347708+0000","last_active":"2024-09-12T18:33:59.923295+0000","last_peered":"2024-09-12T18:33:59.923295+0000","last_clean":"2024-09-12T18:33:59.923295+0000","last_became_active":"2024-09-12T17:10:32.346911+0000","last_became_peered":"2024-09-12T17:10:32.346911+0000","last_unstale":"2024-09-12T18:33:59.923295+0000","last_undegraded":"2024-09-12T18:33:59.923295+0000","last_fullsized":"2024-09-12T18:33:59.923295+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:26.413533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3659,"num_read_kb":3307,"num_write":1011,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'374","reported_seq":1089,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.655457+0000","last_change":"2024-09-12T17:10:30.405881+0000","last_active":"2024-09-12T18:36:01.655457+0000","last_peered":"2024-09-12T18:36:01.655457+0000","last_clean":"2024-09-12T18:36:01.655457+0000","last_became_active":"2024-09-12T17:10:30.405515+0000","last_became_peered":"2024-09-12T17:10:30.405515+0000","last_unstale":"2024-09-12T18:36:01.655457+0000","last_undegraded":"2024-09-12T18:36:01.655457+0000","last_fullsized":"2024-09-12T18:36:01.655457+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:23.617786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262279,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":656,"num_read_kb":13611,"num_write":1211,"num_write_kb":42248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'453","reported_seq":1933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.627333+0000","last_change":"2024-09-12T17:10:32.376635+0000","last_active":"2024-09-12T18:33:18.627333+0000","last_peered":"2024-09-12T18:33:18.627333+0000","last_clean":"2024-09-12T18:33:18.627333+0000","last_became_active":"2024-09-12T17:10:32.375908+0000","last_became_peered":"2024-09-12T17:10:32.375908+0000","last_unstale":"2024-09-12T18:33:18.627333+0000","last_undegraded":"2024-09-12T18:33:18.627333+0000","last_fullsized":"2024-09-12T18:33:18.627333+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:27.899807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2460,"num_read_kb":2294,"num_write":575,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'350","reported_seq":1035,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.429530+0000","last_change":"2024-09-12T17:10:30.351588+0000","last_active":"2024-09-12T18:36:01.429530+0000","last_peered":"2024-09-12T18:36:01.429530+0000","last_clean":"2024-09-12T18:36:01.429530+0000","last_became_active":"2024-09-12T17:10:30.351202+0000","last_became_peered":"2024-09-12T17:10:30.351202+0000","last_unstale":"2024-09-12T18:36:01.429530+0000","last_undegraded":"2024-09-12T18:36:01.429530+0000","last_fullsized":"2024-09-12T18:36:01.429530+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:24.152184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437401,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":455,"num_read_kb":96763,"num_write":1027,"num_write_kb":52334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'557","reported_seq":2193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.626934+0000","last_change":"2024-09-12T17:10:32.371846+0000","last_active":"2024-09-12T18:33:18.626934+0000","last_peered":"2024-09-12T18:33:18.626934+0000","last_clean":"2024-09-12T18:33:18.626934+0000","last_became_active":"2024-09-12T17:10:32.370962+0000","last_became_peered":"2024-09-12T17:10:32.370962+0000","last_unstale":"2024-09-12T18:33:18.626934+0000","last_undegraded":"2024-09-12T18:33:18.626934+0000","last_fullsized":"2024-09-12T18:33:18.626934+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:19.779809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2855,"num_read_kb":2656,"num_write":715,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'395","reported_seq":1121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.434680+0000","last_change":"2024-09-12T17:10:30.376632+0000","last_active":"2024-09-12T18:36:01.434680+0000","last_peered":"2024-09-12T18:36:01.434680+0000","last_clean":"2024-09-12T18:36:01.434680+0000","last_became_active":"2024-09-12T17:10:30.374789+0000","last_became_peered":"2024-09-12T17:10:30.374789+0000","last_unstale":"2024-09-12T18:36:01.434680+0000","last_undegraded":"2024-09-12T18:36:01.434680+0000","last_fullsized":"2024-09-12T18:36:01.434680+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:10.377494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2724113,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":774,"num_read_kb":12016,"num_write":1249,"num_write_kb":48882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'284","reported_seq":1673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.928533+0000","last_change":"2024-09-12T17:10:32.357514+0000","last_active":"2024-09-12T18:33:59.928533+0000","last_peered":"2024-09-12T18:33:59.928533+0000","last_clean":"2024-09-12T18:33:59.928533+0000","last_became_active":"2024-09-12T17:10:32.357199+0000","last_became_peered":"2024-09-12T17:10:32.357199+0000","last_unstale":"2024-09-12T18:33:59.928533+0000","last_undegraded":"2024-09-12T18:33:59.928533+0000","last_fullsized":"2024-09-12T18:33:59.928533+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:17.757987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1623,"num_read_kb":1593,"num_write":300,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'296","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.358604+0000","last_change":"2024-09-12T17:10:30.387768+0000","last_active":"2024-09-12T18:36:01.358604+0000","last_peered":"2024-09-12T18:36:01.358604+0000","last_clean":"2024-09-12T18:36:01.358604+0000","last_became_active":"2024-09-12T17:10:30.385216+0000","last_became_peered":"2024-09-12T17:10:30.385216+0000","last_unstale":"2024-09-12T18:36:01.358604+0000","last_undegraded":"2024-09-12T18:36:01.358604+0000","last_fullsized":"2024-09-12T18:36:01.358604+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:48.266095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2152003,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":386,"num_read_kb":5414,"num_write":911,"num_write_kb":15383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'549","reported_seq":2122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.927415+0000","last_change":"2024-09-12T17:10:32.352752+0000","last_active":"2024-09-12T18:33:59.927415+0000","last_peered":"2024-09-12T18:33:59.927415+0000","last_clean":"2024-09-12T18:33:59.927415+0000","last_became_active":"2024-09-12T17:10:32.351972+0000","last_became_peered":"2024-09-12T17:10:32.351972+0000","last_unstale":"2024-09-12T18:33:59.927415+0000","last_undegraded":"2024-09-12T18:33:59.927415+0000","last_fullsized":"2024-09-12T18:33:59.927415+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:26.765589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2788,"num_read_kb":2550,"num_write":700,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'341","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.377110+0000","last_change":"2024-09-12T17:10:30.362938+0000","last_active":"2024-09-12T18:36:01.377110+0000","last_peered":"2024-09-12T18:36:01.377110+0000","last_clean":"2024-09-12T18:36:01.377110+0000","last_became_active":"2024-09-12T17:10:30.350813+0000","last_became_peered":"2024-09-12T17:10:30.350813+0000","last_unstale":"2024-09-12T18:36:01.377110+0000","last_undegraded":"2024-09-12T18:36:01.377110+0000","last_fullsized":"2024-09-12T18:36:01.377110+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:45.963449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":508,"num_read_kb":3741,"num_write":1084,"num_write_kb":26406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'434","reported_seq":2148,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605409+0000","last_change":"2024-09-12T17:10:32.363876+0000","last_active":"2024-09-12T18:33:55.605409+0000","last_peered":"2024-09-12T18:33:55.605409+0000","last_clean":"2024-09-12T18:33:55.605409+0000","last_became_active":"2024-09-12T17:10:32.362980+0000","last_became_peered":"2024-09-12T17:10:32.362980+0000","last_unstale":"2024-09-12T18:33:55.605409+0000","last_undegraded":"2024-09-12T18:33:55.605409+0000","last_fullsized":"2024-09-12T18:33:55.605409+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:44.556208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2502,"num_read_kb":2403,"num_write":488,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'341","reported_seq":1238,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.372568+0000","last_change":"2024-09-12T17:11:04.871628+0000","last_active":"2024-09-12T18:36:01.372568+0000","last_peered":"2024-09-12T18:36:01.372568+0000","last_clean":"2024-09-12T18:36:01.372568+0000","last_became_active":"2024-09-12T17:11:04.870569+0000","last_became_peered":"2024-09-12T17:11:04.870569+0000","last_unstale":"2024-09-12T18:36:01.372568+0000","last_undegraded":"2024-09-12T18:36:01.372568+0000","last_fullsized":"2024-09-12T18:36:01.372568+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:14.018442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4414118,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":974,"num_read_kb":89436,"num_write":1193,"num_write_kb":38550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'426","reported_seq":1941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.423534+0000","last_change":"2024-09-12T17:10:32.369695+0000","last_active":"2024-09-12T18:33:56.423534+0000","last_peered":"2024-09-12T18:33:56.423534+0000","last_clean":"2024-09-12T18:33:56.423534+0000","last_became_active":"2024-09-12T17:10:32.368909+0000","last_became_peered":"2024-09-12T17:10:32.368909+0000","last_unstale":"2024-09-12T18:33:56.423534+0000","last_undegraded":"2024-09-12T18:33:56.423534+0000","last_fullsized":"2024-09-12T18:33:56.423534+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:18.380922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2227,"num_read_kb":2101,"num_write":505,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'326","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.207633+0000","last_change":"2024-09-12T17:10:30.395510+0000","last_active":"2024-09-12T18:35:59.207633+0000","last_peered":"2024-09-12T18:35:59.207633+0000","last_clean":"2024-09-12T18:35:59.207633+0000","last_became_active":"2024-09-12T17:10:30.395061+0000","last_became_peered":"2024-09-12T17:10:30.395061+0000","last_unstale":"2024-09-12T18:35:59.207633+0000","last_undegraded":"2024-09-12T18:35:59.207633+0000","last_fullsized":"2024-09-12T18:35:59.207633+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:41.200923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14709348,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":585,"num_read_kb":20147,"num_write":1087,"num_write_kb":23715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'421","reported_seq":1783,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.811554+0000","last_change":"2024-09-12T17:11:05.125681+0000","last_active":"2024-09-12T18:33:56.811554+0000","last_peered":"2024-09-12T18:33:56.811554+0000","last_clean":"2024-09-12T18:33:56.811554+0000","last_became_active":"2024-09-12T17:11:05.124718+0000","last_became_peered":"2024-09-12T17:11:05.124718+0000","last_unstale":"2024-09-12T18:33:56.811554+0000","last_undegraded":"2024-09-12T18:33:56.811554+0000","last_fullsized":"2024-09-12T18:33:56.811554+0000","mapping_epoch":38,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:17.850798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2066,"num_read_kb":1911,"num_write":507,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'652","reported_seq":2390,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.928419+0000","last_change":"2024-09-12T17:10:32.363944+0000","last_active":"2024-09-12T18:33:59.928419+0000","last_peered":"2024-09-12T18:33:59.928419+0000","last_clean":"2024-09-12T18:33:59.928419+0000","last_became_active":"2024-09-12T17:10:32.363179+0000","last_became_peered":"2024-09-12T17:10:32.363179+0000","last_unstale":"2024-09-12T18:33:59.928419+0000","last_undegraded":"2024-09-12T18:33:59.928419+0000","last_fullsized":"2024-09-12T18:33:59.928419+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":600,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:03.623272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3427,"num_read_kb":3148,"num_write":833,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'312","reported_seq":998,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.409016+0000","last_change":"2024-09-12T17:10:30.387578+0000","last_active":"2024-09-12T18:36:01.409016+0000","last_peered":"2024-09-12T18:36:01.409016+0000","last_clean":"2024-09-12T18:36:01.409016+0000","last_became_active":"2024-09-12T17:10:30.385785+0000","last_became_peered":"2024-09-12T17:10:30.385785+0000","last_unstale":"2024-09-12T18:36:01.409016+0000","last_undegraded":"2024-09-12T18:36:01.409016+0000","last_fullsized":"2024-09-12T18:36:01.409016+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:57.879527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12590770,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":522,"num_read_kb":51059,"num_write":1026,"num_write_kb":34693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'508","reported_seq":2186,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.815743+0000","last_change":"2024-09-12T17:10:32.380268+0000","last_active":"2024-09-12T18:34:01.815743+0000","last_peered":"2024-09-12T18:34:01.815743+0000","last_clean":"2024-09-12T18:34:01.815743+0000","last_became_active":"2024-09-12T17:10:32.379669+0000","last_became_peered":"2024-09-12T17:10:32.379669+0000","last_unstale":"2024-09-12T18:34:01.815743+0000","last_undegraded":"2024-09-12T18:34:01.815743+0000","last_fullsized":"2024-09-12T18:34:01.815743+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:43.664634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2752,"num_read_kb":2572,"num_write":584,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'340","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.725768+0000","last_change":"2024-09-12T17:12:05.835283+0000","last_active":"2024-09-12T18:36:01.725768+0000","last_peered":"2024-09-12T18:36:01.725768+0000","last_clean":"2024-09-12T18:36:01.725768+0000","last_became_active":"2024-09-12T17:12:05.834873+0000","last_became_peered":"2024-09-12T17:12:05.834873+0000","last_unstale":"2024-09-12T18:36:01.725768+0000","last_undegraded":"2024-09-12T18:36:01.725768+0000","last_fullsized":"2024-09-12T18:36:01.725768+0000","mapping_epoch":40,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:29.427065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699356,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":551,"num_read_kb":40642,"num_write":1115,"num_write_kb":40250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"268'1939","reported_seq":3530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.814002+0000","last_change":"2024-09-12T17:10:32.359245+0000","last_active":"2024-09-12T18:34:01.814002+0000","last_peered":"2024-09-12T18:34:01.814002+0000","last_clean":"2024-09-12T18:34:01.814002+0000","last_became_active":"2024-09-12T17:10:32.358342+0000","last_became_peered":"2024-09-12T17:10:32.358342+0000","last_unstale":"2024-09-12T18:34:01.814002+0000","last_undegraded":"2024-09-12T18:34:01.814002+0000","last_fullsized":"2024-09-12T18:34:01.814002+0000","mapping_epoch":27,"log_start":"268'1900","ondisk_log_start":"268'1900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1900,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:01.927050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8411,"num_read_kb":7313,"num_write":2747,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'374","reported_seq":1030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.534284+0000","last_change":"2024-09-12T17:10:30.401167+0000","last_active":"2024-09-12T18:36:01.534284+0000","last_peered":"2024-09-12T18:36:01.534284+0000","last_clean":"2024-09-12T18:36:01.534284+0000","last_became_active":"2024-09-12T17:10:30.395938+0000","last_became_peered":"2024-09-12T17:10:30.395938+0000","last_unstale":"2024-09-12T18:36:01.534284+0000","last_undegraded":"2024-09-12T18:36:01.534284+0000","last_fullsized":"2024-09-12T18:36:01.534284+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:51.897394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221615,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":518,"num_read_kb":40777,"num_write":1202,"num_write_kb":34948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'778","reported_seq":2224,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.797878+0000","last_change":"2024-09-12T17:10:32.354888+0000","last_active":"2024-09-12T18:32:46.797878+0000","last_peered":"2024-09-12T18:32:46.797878+0000","last_clean":"2024-09-12T18:32:46.797878+0000","last_became_active":"2024-09-12T17:10:32.354271+0000","last_became_peered":"2024-09-12T17:10:32.354271+0000","last_unstale":"2024-09-12T18:32:46.797878+0000","last_undegraded":"2024-09-12T18:32:46.797878+0000","last_fullsized":"2024-09-12T18:32:46.797878+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:40.309416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3730,"num_read_kb":3333,"num_write":1060,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'497","reported_seq":1246,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.568314+0000","last_change":"2024-09-12T17:10:30.396067+0000","last_active":"2024-09-12T18:36:00.568314+0000","last_peered":"2024-09-12T18:36:00.568314+0000","last_clean":"2024-09-12T18:36:00.568314+0000","last_became_active":"2024-09-12T17:10:30.394905+0000","last_became_peered":"2024-09-12T17:10:30.394905+0000","last_unstale":"2024-09-12T18:36:00.568314+0000","last_undegraded":"2024-09-12T18:36:00.568314+0000","last_fullsized":"2024-09-12T18:36:00.568314+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:58.605567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21306835,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":911,"num_read_kb":40764,"num_write":1540,"num_write_kb":41950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'786","reported_seq":2379,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.627433+0000","last_change":"2024-09-12T17:10:32.372409+0000","last_active":"2024-09-12T18:33:18.627433+0000","last_peered":"2024-09-12T18:33:18.627433+0000","last_clean":"2024-09-12T18:33:18.627433+0000","last_became_active":"2024-09-12T17:10:32.372137+0000","last_became_peered":"2024-09-12T17:10:32.372137+0000","last_unstale":"2024-09-12T18:33:18.627433+0000","last_undegraded":"2024-09-12T18:33:18.627433+0000","last_fullsized":"2024-09-12T18:33:18.627433+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:07.405740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3748,"num_read_kb":3393,"num_write":1031,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'276","reported_seq":910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.313257+0000","last_change":"2024-09-12T17:10:30.394449+0000","last_active":"2024-09-12T18:35:59.313257+0000","last_peered":"2024-09-12T18:35:59.313257+0000","last_clean":"2024-09-12T18:35:59.313257+0000","last_became_active":"2024-09-12T17:10:30.394096+0000","last_became_peered":"2024-09-12T17:10:30.394096+0000","last_unstale":"2024-09-12T18:35:59.313257+0000","last_undegraded":"2024-09-12T18:35:59.313257+0000","last_fullsized":"2024-09-12T18:35:59.313257+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:17.229735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9140561,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":377,"num_read_kb":10348,"num_write":972,"num_write_kb":23725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'862","reported_seq":2531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:45.588918+0000","last_change":"2024-09-12T17:10:32.361908+0000","last_active":"2024-09-12T18:32:45.588918+0000","last_peered":"2024-09-12T18:32:45.588918+0000","last_clean":"2024-09-12T18:32:45.588918+0000","last_became_active":"2024-09-12T17:10:32.361126+0000","last_became_peered":"2024-09-12T17:10:32.361126+0000","last_unstale":"2024-09-12T18:32:45.588918+0000","last_undegraded":"2024-09-12T18:32:45.588918+0000","last_fullsized":"2024-09-12T18:32:45.588918+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:09.763728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4216,"num_read_kb":3793,"num_write":1162,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'323","reported_seq":941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.389505+0000","last_change":"2024-09-12T17:10:30.353547+0000","last_active":"2024-09-12T18:36:01.389505+0000","last_peered":"2024-09-12T18:36:01.389505+0000","last_clean":"2024-09-12T18:36:01.389505+0000","last_became_active":"2024-09-12T17:10:30.353147+0000","last_became_peered":"2024-09-12T17:10:30.353147+0000","last_unstale":"2024-09-12T18:36:01.389505+0000","last_undegraded":"2024-09-12T18:36:01.389505+0000","last_fullsized":"2024-09-12T18:36:01.389505+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:15.129856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1050804,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":401,"num_read_kb":13692,"num_write":997,"num_write_kb":32545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'134","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.133975+0000","last_change":"2024-09-12T17:10:40.422258+0000","last_active":"2024-09-12T18:34:02.133975+0000","last_peered":"2024-09-12T18:34:02.133975+0000","last_clean":"2024-09-12T18:34:02.133975+0000","last_became_active":"2024-09-12T17:10:40.421380+0000","last_became_peered":"2024-09-12T17:10:40.421380+0000","last_unstale":"2024-09-12T18:34:02.133975+0000","last_undegraded":"2024-09-12T18:34:02.133975+0000","last_fullsized":"2024-09-12T18:34:02.133975+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:26.392127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":207,"num_write":318,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'456","reported_seq":2070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.622792+0000","last_change":"2024-09-12T17:10:32.370396+0000","last_active":"2024-09-12T18:33:18.622792+0000","last_peered":"2024-09-12T18:33:18.622792+0000","last_clean":"2024-09-12T18:33:18.622792+0000","last_became_active":"2024-09-12T17:10:32.370058+0000","last_became_peered":"2024-09-12T17:10:32.370058+0000","last_unstale":"2024-09-12T18:33:18.622792+0000","last_undegraded":"2024-09-12T18:33:18.622792+0000","last_fullsized":"2024-09-12T18:33:18.622792+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:48.973947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2398,"num_read_kb":2269,"num_write":525,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'309","reported_seq":920,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.770277+0000","last_change":"2024-09-12T17:11:04.871757+0000","last_active":"2024-09-12T18:36:01.770277+0000","last_peered":"2024-09-12T18:36:01.770277+0000","last_clean":"2024-09-12T18:36:01.770277+0000","last_became_active":"2024-09-12T17:11:04.871007+0000","last_became_peered":"2024-09-12T17:11:04.871007+0000","last_unstale":"2024-09-12T18:36:01.770277+0000","last_undegraded":"2024-09-12T18:36:01.770277+0000","last_fullsized":"2024-09-12T18:36:01.770277+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:22.664826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":421,"num_read_kb":10233,"num_write":1019,"num_write_kb":32687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.407279+0000","last_change":"2024-09-12T17:10:34.371764+0000","last_active":"2024-09-12T18:32:46.407279+0000","last_peered":"2024-09-12T18:32:46.407279+0000","last_clean":"2024-09-12T18:32:46.407279+0000","last_became_active":"2024-09-12T17:10:34.371022+0000","last_became_peered":"2024-09-12T17:10:34.371022+0000","last_unstale":"2024-09-12T18:32:46.407279+0000","last_undegraded":"2024-09-12T18:32:46.407279+0000","last_fullsized":"2024-09-12T18:32:46.407279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:04.412145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'364","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.698565+0000","last_change":"2024-09-12T17:10:36.399853+0000","last_active":"2024-09-12T18:35:21.698565+0000","last_peered":"2024-09-12T18:35:21.698565+0000","last_clean":"2024-09-12T18:35:21.698565+0000","last_became_active":"2024-09-12T17:10:36.399464+0000","last_became_peered":"2024-09-12T17:10:36.399464+0000","last_unstale":"2024-09-12T18:35:21.698565+0000","last_undegraded":"2024-09-12T18:35:21.698565+0000","last_fullsized":"2024-09-12T18:35:21.698565+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:12.028942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59801,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":589,"num_read_kb":1157,"num_write":470,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.401248+0000","last_change":"2024-09-12T17:10:38.405144+0000","last_active":"2024-09-12T18:32:51.401248+0000","last_peered":"2024-09-12T18:32:51.401248+0000","last_clean":"2024-09-12T18:32:51.401248+0000","last_became_active":"2024-09-12T17:10:38.404423+0000","last_became_peered":"2024-09-12T17:10:38.404423+0000","last_unstale":"2024-09-12T18:32:51.401248+0000","last_undegraded":"2024-09-12T18:32:51.401248+0000","last_fullsized":"2024-09-12T18:32:51.401248+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:04.302118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'170","reported_seq":740,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.772365+0000","last_change":"2024-09-12T17:10:40.426221+0000","last_active":"2024-09-12T18:34:01.772365+0000","last_peered":"2024-09-12T18:34:01.772365+0000","last_clean":"2024-09-12T18:34:01.772365+0000","last_became_active":"2024-09-12T17:10:40.425532+0000","last_became_peered":"2024-09-12T17:10:40.425532+0000","last_unstale":"2024-09-12T18:34:01.772365+0000","last_undegraded":"2024-09-12T18:34:01.772365+0000","last_fullsized":"2024-09-12T18:34:01.772365+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:09.048645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":265,"num_read_kb":256,"num_write":326,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'733","reported_seq":2463,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.923583+0000","last_change":"2024-09-12T17:10:32.382421+0000","last_active":"2024-09-12T18:33:59.923583+0000","last_peered":"2024-09-12T18:33:59.923583+0000","last_clean":"2024-09-12T18:33:59.923583+0000","last_became_active":"2024-09-12T17:10:32.381838+0000","last_became_peered":"2024-09-12T17:10:32.381838+0000","last_unstale":"2024-09-12T18:33:59.923583+0000","last_undegraded":"2024-09-12T18:33:59.923583+0000","last_fullsized":"2024-09-12T18:33:59.923583+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:23.645321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3756,"num_read_kb":3395,"num_write":1068,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'377","reported_seq":1098,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.375939+0000","last_change":"2024-09-12T17:10:30.362609+0000","last_active":"2024-09-12T18:36:01.375939+0000","last_peered":"2024-09-12T18:36:01.375939+0000","last_clean":"2024-09-12T18:36:01.375939+0000","last_became_active":"2024-09-12T17:10:30.362010+0000","last_became_peered":"2024-09-12T17:10:30.362010+0000","last_unstale":"2024-09-12T18:36:01.375939+0000","last_undegraded":"2024-09-12T18:36:01.375939+0000","last_fullsized":"2024-09-12T18:36:01.375939+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:57.522595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10716445,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":688,"num_read_kb":52712,"num_write":1408,"num_write_kb":39491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403196+0000","last_change":"2024-09-12T17:10:34.362183+0000","last_active":"2024-09-12T18:32:34.403196+0000","last_peered":"2024-09-12T18:32:34.403196+0000","last_clean":"2024-09-12T18:32:34.403196+0000","last_became_active":"2024-09-12T17:10:34.361102+0000","last_became_peered":"2024-09-12T17:10:34.361102+0000","last_unstale":"2024-09-12T18:32:34.403196+0000","last_undegraded":"2024-09-12T18:32:34.403196+0000","last_fullsized":"2024-09-12T18:32:34.403196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:20.467248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'110","reported_seq":666,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.590229+0000","last_change":"2024-09-12T17:10:36.391217+0000","last_active":"2024-09-12T18:32:50.590229+0000","last_peered":"2024-09-12T18:32:50.590229+0000","last_clean":"2024-09-12T18:32:50.590229+0000","last_became_active":"2024-09-12T17:10:36.390398+0000","last_became_peered":"2024-09-12T17:10:36.390398+0000","last_unstale":"2024-09-12T18:32:50.590229+0000","last_undegraded":"2024-09-12T18:32:50.590229+0000","last_fullsized":"2024-09-12T18:32:50.590229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:54.025550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.590198+0000","last_change":"2024-09-12T17:10:38.414637+0000","last_active":"2024-09-12T18:32:50.590198+0000","last_peered":"2024-09-12T18:32:50.590198+0000","last_clean":"2024-09-12T18:32:50.590198+0000","last_became_active":"2024-09-12T17:10:38.414063+0000","last_became_peered":"2024-09-12T17:10:38.414063+0000","last_unstale":"2024-09-12T18:32:50.590198+0000","last_undegraded":"2024-09-12T18:32:50.590198+0000","last_fullsized":"2024-09-12T18:32:50.590198+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:48.781233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'138","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.548387+0000","last_change":"2024-09-12T17:10:40.423061+0000","last_active":"2024-09-12T18:33:57.548387+0000","last_peered":"2024-09-12T18:33:57.548387+0000","last_clean":"2024-09-12T18:33:57.548387+0000","last_became_active":"2024-09-12T17:10:40.422118+0000","last_became_peered":"2024-09-12T17:10:40.422118+0000","last_unstale":"2024-09-12T18:33:57.548387+0000","last_undegraded":"2024-09-12T18:33:57.548387+0000","last_fullsized":"2024-09-12T18:33:57.548387+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:39.157083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":180,"num_write":349,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'871","reported_seq":2493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.814191+0000","last_change":"2024-09-12T17:10:32.352650+0000","last_active":"2024-09-12T18:34:01.814191+0000","last_peered":"2024-09-12T18:34:01.814191+0000","last_clean":"2024-09-12T18:34:01.814191+0000","last_became_active":"2024-09-12T17:10:32.351650+0000","last_became_peered":"2024-09-12T17:10:32.351650+0000","last_unstale":"2024-09-12T18:34:01.814191+0000","last_undegraded":"2024-09-12T18:34:01.814191+0000","last_fullsized":"2024-09-12T18:34:01.814191+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:03.003509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4313,"num_read_kb":3885,"num_write":1184,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'380","reported_seq":1115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.407108+0000","last_change":"2024-09-12T17:10:30.394677+0000","last_active":"2024-09-12T18:36:01.407108+0000","last_peered":"2024-09-12T18:36:01.407108+0000","last_clean":"2024-09-12T18:36:01.407108+0000","last_became_active":"2024-09-12T17:10:30.393670+0000","last_became_peered":"2024-09-12T17:10:30.393670+0000","last_unstale":"2024-09-12T18:36:01.407108+0000","last_undegraded":"2024-09-12T18:36:01.407108+0000","last_fullsized":"2024-09-12T18:36:01.407108+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:39.112583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12365588,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":771,"num_read_kb":43186,"num_write":1213,"num_write_kb":22438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:44.406536+0000","last_change":"2024-09-12T17:10:34.358839+0000","last_active":"2024-09-12T18:32:44.406536+0000","last_peered":"2024-09-12T18:32:44.406536+0000","last_clean":"2024-09-12T18:32:44.406536+0000","last_became_active":"2024-09-12T17:10:34.358119+0000","last_became_peered":"2024-09-12T17:10:34.358119+0000","last_unstale":"2024-09-12T18:32:44.406536+0000","last_undegraded":"2024-09-12T18:32:44.406536+0000","last_fullsized":"2024-09-12T18:32:44.406536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:56.480463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'152","reported_seq":726,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.790757+0000","last_change":"2024-09-12T17:10:36.385198+0000","last_active":"2024-09-12T18:32:26.790757+0000","last_peered":"2024-09-12T18:32:26.790757+0000","last_clean":"2024-09-12T18:32:26.790757+0000","last_became_active":"2024-09-12T17:10:36.384465+0000","last_became_peered":"2024-09-12T17:10:36.384465+0000","last_unstale":"2024-09-12T18:32:26.790757+0000","last_undegraded":"2024-09-12T18:32:26.790757+0000","last_fullsized":"2024-09-12T18:32:26.790757+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:48.249397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":178,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'793","reported_seq":2919,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.780665+0000","last_change":"2024-09-12T17:10:38.407657+0000","last_active":"2024-09-12T18:36:00.780665+0000","last_peered":"2024-09-12T18:36:00.780665+0000","last_clean":"2024-09-12T18:36:00.780665+0000","last_became_active":"2024-09-12T17:10:38.406964+0000","last_became_peered":"2024-09-12T17:10:38.406964+0000","last_unstale":"2024-09-12T18:36:00.780665+0000","last_undegraded":"2024-09-12T18:36:00.780665+0000","last_fullsized":"2024-09-12T18:36:00.780665+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:41.454994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'254","reported_seq":1111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.224603+0000","last_change":"2024-09-12T17:10:40.769418+0000","last_active":"2024-09-12T18:34:02.224603+0000","last_peered":"2024-09-12T18:34:02.224603+0000","last_clean":"2024-09-12T18:34:02.224603+0000","last_became_active":"2024-09-12T17:10:40.768896+0000","last_became_peered":"2024-09-12T17:10:40.768896+0000","last_unstale":"2024-09-12T18:34:02.224603+0000","last_undegraded":"2024-09-12T18:34:02.224603+0000","last_fullsized":"2024-09-12T18:34:02.224603+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:14.019332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":705,"num_read_kb":685,"num_write":456,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'529","reported_seq":2333,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.722899+0000","last_change":"2024-09-12T17:10:32.383037+0000","last_active":"2024-09-12T18:33:13.722899+0000","last_peered":"2024-09-12T18:33:13.722899+0000","last_clean":"2024-09-12T18:33:13.722899+0000","last_became_active":"2024-09-12T17:10:32.382671+0000","last_became_peered":"2024-09-12T17:10:32.382671+0000","last_unstale":"2024-09-12T18:33:13.722899+0000","last_undegraded":"2024-09-12T18:33:13.722899+0000","last_fullsized":"2024-09-12T18:33:13.722899+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:57.340586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3129,"num_read_kb":2937,"num_write":633,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'373","reported_seq":1049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.581417+0000","last_change":"2024-09-12T17:10:30.391255+0000","last_active":"2024-09-12T18:36:01.581417+0000","last_peered":"2024-09-12T18:36:01.581417+0000","last_clean":"2024-09-12T18:36:01.581417+0000","last_became_active":"2024-09-12T17:10:30.390677+0000","last_became_peered":"2024-09-12T17:10:30.390677+0000","last_unstale":"2024-09-12T18:36:01.581417+0000","last_undegraded":"2024-09-12T18:36:01.581417+0000","last_fullsized":"2024-09-12T18:36:01.581417+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:46.541083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310924,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":576,"num_read_kb":63186,"num_write":1120,"num_write_kb":46639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.407341+0000","last_change":"2024-09-12T17:10:34.373089+0000","last_active":"2024-09-12T18:32:46.407341+0000","last_peered":"2024-09-12T18:32:46.407341+0000","last_clean":"2024-09-12T18:32:46.407341+0000","last_became_active":"2024-09-12T17:10:34.371937+0000","last_became_peered":"2024-09-12T17:10:34.371937+0000","last_unstale":"2024-09-12T18:32:46.407341+0000","last_undegraded":"2024-09-12T18:32:46.407341+0000","last_fullsized":"2024-09-12T18:32:46.407341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:36.719820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'318","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.366440+0000","last_change":"2024-09-12T17:10:36.921222+0000","last_active":"2024-09-12T18:36:01.366440+0000","last_peered":"2024-09-12T18:36:01.366440+0000","last_clean":"2024-09-12T18:36:01.366440+0000","last_became_active":"2024-09-12T17:10:36.920487+0000","last_became_peered":"2024-09-12T17:10:36.920487+0000","last_unstale":"2024-09-12T18:36:01.366440+0000","last_undegraded":"2024-09-12T18:36:01.366440+0000","last_fullsized":"2024-09-12T18:36:01.366440+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:45.222423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46675,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":545,"num_read_kb":1308,"num_write":450,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'804","reported_seq":2812,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.015508+0000","last_change":"2024-09-12T17:10:38.398227+0000","last_active":"2024-09-12T18:35:59.015508+0000","last_peered":"2024-09-12T18:35:59.015508+0000","last_clean":"2024-09-12T18:35:59.015508+0000","last_became_active":"2024-09-12T17:10:38.393524+0000","last_became_peered":"2024-09-12T17:10:38.393524+0000","last_unstale":"2024-09-12T18:35:59.015508+0000","last_undegraded":"2024-09-12T18:35:59.015508+0000","last_fullsized":"2024-09-12T18:35:59.015508+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:55.682578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'401","reported_seq":1970,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.625087+0000","last_change":"2024-09-12T17:10:32.378803+0000","last_active":"2024-09-12T18:33:18.625087+0000","last_peered":"2024-09-12T18:33:18.625087+0000","last_clean":"2024-09-12T18:33:18.625087+0000","last_became_active":"2024-09-12T17:10:32.378027+0000","last_became_peered":"2024-09-12T17:10:32.378027+0000","last_unstale":"2024-09-12T18:33:18.625087+0000","last_undegraded":"2024-09-12T18:33:18.625087+0000","last_fullsized":"2024-09-12T18:33:18.625087+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:52.446776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2313,"num_read_kb":2218,"num_write":459,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'330","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.389623+0000","last_change":"2024-09-12T17:10:30.387735+0000","last_active":"2024-09-12T18:36:01.389623+0000","last_peered":"2024-09-12T18:36:01.389623+0000","last_clean":"2024-09-12T18:36:01.389623+0000","last_became_active":"2024-09-12T17:10:30.386707+0000","last_became_peered":"2024-09-12T17:10:30.386707+0000","last_unstale":"2024-09-12T18:36:01.389623+0000","last_undegraded":"2024-09-12T18:36:01.389623+0000","last_fullsized":"2024-09-12T18:36:01.389623+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:19.438334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4658475,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":514,"num_read_kb":31049,"num_write":1104,"num_write_kb":31528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.402246+0000","last_change":"2024-09-12T17:10:34.369825+0000","last_active":"2024-09-12T18:32:56.402246+0000","last_peered":"2024-09-12T18:32:56.402246+0000","last_clean":"2024-09-12T18:32:56.402246+0000","last_became_active":"2024-09-12T17:10:34.369066+0000","last_became_peered":"2024-09-12T17:10:34.369066+0000","last_unstale":"2024-09-12T18:32:56.402246+0000","last_undegraded":"2024-09-12T18:32:56.402246+0000","last_fullsized":"2024-09-12T18:32:56.402246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'385","reported_seq":1044,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.257475+0000","last_change":"2024-09-12T17:10:36.920855+0000","last_active":"2024-09-12T18:35:59.257475+0000","last_peered":"2024-09-12T18:35:59.257475+0000","last_clean":"2024-09-12T18:35:59.257475+0000","last_became_active":"2024-09-12T17:10:36.920136+0000","last_became_peered":"2024-09-12T17:10:36.920136+0000","last_unstale":"2024-09-12T18:35:59.257475+0000","last_undegraded":"2024-09-12T18:35:59.257475+0000","last_fullsized":"2024-09-12T18:35:59.257475+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:53.763125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54168,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":623,"num_read_kb":1195,"num_write":466,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.623483+0000","last_change":"2024-09-12T17:10:38.395526+0000","last_active":"2024-09-12T18:31:41.623483+0000","last_peered":"2024-09-12T18:31:41.623483+0000","last_clean":"2024-09-12T18:31:41.623483+0000","last_became_active":"2024-09-12T17:10:38.394381+0000","last_became_peered":"2024-09-12T17:10:38.394381+0000","last_unstale":"2024-09-12T18:31:41.623483+0000","last_undegraded":"2024-09-12T18:31:41.623483+0000","last_fullsized":"2024-09-12T18:31:41.623483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:07.549215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'531","reported_seq":1356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.744047+0000","last_change":"2024-09-12T17:10:40.423104+0000","last_active":"2024-09-12T18:35:21.744047+0000","last_peered":"2024-09-12T18:35:21.744047+0000","last_clean":"2024-09-12T18:35:21.744047+0000","last_became_active":"2024-09-12T17:10:40.422353+0000","last_became_peered":"2024-09-12T17:10:40.422353+0000","last_unstale":"2024-09-12T18:35:21.744047+0000","last_undegraded":"2024-09-12T18:35:21.744047+0000","last_fullsized":"2024-09-12T18:35:21.744047+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:50.482047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1294,"num_read_kb":1291,"num_write":1098,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'422","reported_seq":2030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.510810+0000","last_change":"2024-09-12T17:10:32.370427+0000","last_active":"2024-09-12T18:33:01.510810+0000","last_peered":"2024-09-12T18:33:01.510810+0000","last_clean":"2024-09-12T18:33:01.510810+0000","last_became_active":"2024-09-12T17:10:32.369188+0000","last_became_peered":"2024-09-12T17:10:32.369188+0000","last_unstale":"2024-09-12T18:33:01.510810+0000","last_undegraded":"2024-09-12T18:33:01.510810+0000","last_fullsized":"2024-09-12T18:33:01.510810+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:45.905435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2274,"num_read_kb":2176,"num_write":482,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'318","reported_seq":1095,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.445843+0000","last_change":"2024-09-12T17:10:30.384287+0000","last_active":"2024-09-12T18:36:01.445843+0000","last_peered":"2024-09-12T18:36:01.445843+0000","last_clean":"2024-09-12T18:36:01.445843+0000","last_became_active":"2024-09-12T17:10:30.381728+0000","last_became_peered":"2024-09-12T17:10:30.381728+0000","last_unstale":"2024-09-12T18:36:01.445843+0000","last_undegraded":"2024-09-12T18:36:01.445843+0000","last_fullsized":"2024-09-12T18:36:01.445843+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:55.748760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9112715,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":566,"num_read_kb":127583,"num_write":1004,"num_write_kb":57035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.799633+0000","last_change":"2024-09-12T17:10:34.346640+0000","last_active":"2024-09-12T18:32:56.799633+0000","last_peered":"2024-09-12T18:32:56.799633+0000","last_clean":"2024-09-12T18:32:56.799633+0000","last_became_active":"2024-09-12T17:10:34.346229+0000","last_became_peered":"2024-09-12T17:10:34.346229+0000","last_unstale":"2024-09-12T18:32:56.799633+0000","last_undegraded":"2024-09-12T18:32:56.799633+0000","last_fullsized":"2024-09-12T18:32:56.799633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:33.485742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'294","reported_seq":890,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.654783+0000","last_change":"2024-09-12T17:10:36.399143+0000","last_active":"2024-09-12T18:35:21.654783+0000","last_peered":"2024-09-12T18:35:21.654783+0000","last_clean":"2024-09-12T18:35:21.654783+0000","last_became_active":"2024-09-12T17:10:36.398641+0000","last_became_peered":"2024-09-12T17:10:36.398641+0000","last_unstale":"2024-09-12T18:35:21.654783+0000","last_undegraded":"2024-09-12T18:35:21.654783+0000","last_fullsized":"2024-09-12T18:35:21.654783+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:50.236212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66018,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":492,"num_read_kb":1063,"num_write":404,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.414508+0000","last_change":"2024-09-12T17:10:38.395735+0000","last_active":"2024-09-12T18:33:19.414508+0000","last_peered":"2024-09-12T18:33:19.414508+0000","last_clean":"2024-09-12T18:33:19.414508+0000","last_became_active":"2024-09-12T17:10:38.393114+0000","last_became_peered":"2024-09-12T17:10:38.393114+0000","last_unstale":"2024-09-12T18:33:19.414508+0000","last_undegraded":"2024-09-12T18:33:19.414508+0000","last_fullsized":"2024-09-12T18:33:19.414508+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:32.570846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'2402","reported_seq":4243,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:21.599376+0000","last_change":"2024-09-12T17:10:40.426099+0000","last_active":"2024-09-12T18:34:21.599376+0000","last_peered":"2024-09-12T18:34:21.599376+0000","last_clean":"2024-09-12T18:34:21.599376+0000","last_became_active":"2024-09-12T17:10:40.425351+0000","last_became_peered":"2024-09-12T17:10:40.425351+0000","last_unstale":"2024-09-12T18:34:21.599376+0000","last_undegraded":"2024-09-12T18:34:21.599376+0000","last_fullsized":"2024-09-12T18:34:21.599376+0000","mapping_epoch":35,"log_start":"268'2300","ondisk_log_start":"268'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":2300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:37.392452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6030,"num_read_kb":6033,"num_write":4839,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'767","reported_seq":2271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.455307+0000","last_change":"2024-09-12T17:11:04.374050+0000","last_active":"2024-09-12T18:33:28.455307+0000","last_peered":"2024-09-12T18:33:28.455307+0000","last_clean":"2024-09-12T18:33:28.455307+0000","last_became_active":"2024-09-12T17:11:04.373050+0000","last_became_peered":"2024-09-12T17:11:04.373050+0000","last_unstale":"2024-09-12T18:33:28.455307+0000","last_undegraded":"2024-09-12T18:33:28.455307+0000","last_fullsized":"2024-09-12T18:33:28.455307+0000","mapping_epoch":38,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:03.588680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3705,"num_read_kb":3333,"num_write":1034,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'328","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.434732+0000","last_change":"2024-09-12T17:10:30.382937+0000","last_active":"2024-09-12T18:36:01.434732+0000","last_peered":"2024-09-12T18:36:01.434732+0000","last_clean":"2024-09-12T18:36:01.434732+0000","last_became_active":"2024-09-12T17:10:30.381997+0000","last_became_peered":"2024-09-12T17:10:30.381997+0000","last_unstale":"2024-09-12T18:36:01.434732+0000","last_undegraded":"2024-09-12T18:36:01.434732+0000","last_fullsized":"2024-09-12T18:36:01.434732+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:26.528780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194444,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":523,"num_read_kb":9738,"num_write":1098,"num_write_kb":58445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.781056+0000","last_change":"2024-09-12T17:10:34.359567+0000","last_active":"2024-09-12T18:31:36.781056+0000","last_peered":"2024-09-12T18:31:36.781056+0000","last_clean":"2024-09-12T18:31:36.781056+0000","last_became_active":"2024-09-12T17:10:34.358798+0000","last_became_peered":"2024-09-12T17:10:34.358798+0000","last_unstale":"2024-09-12T18:31:36.781056+0000","last_undegraded":"2024-09-12T18:31:36.781056+0000","last_fullsized":"2024-09-12T18:31:36.781056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:55.082548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'350","reported_seq":977,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.478205+0000","last_change":"2024-09-12T17:10:36.397286+0000","last_active":"2024-09-12T18:35:59.478205+0000","last_peered":"2024-09-12T18:35:59.478205+0000","last_clean":"2024-09-12T18:35:59.478205+0000","last_became_active":"2024-09-12T17:10:36.396261+0000","last_became_peered":"2024-09-12T17:10:36.396261+0000","last_unstale":"2024-09-12T18:35:59.478205+0000","last_undegraded":"2024-09-12T18:35:59.478205+0000","last_fullsized":"2024-09-12T18:35:59.478205+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:04.653529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49048,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1254,"num_write":464,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'800","reported_seq":2781,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.020572+0000","last_change":"2024-09-12T17:10:38.409388+0000","last_active":"2024-09-12T18:35:59.020572+0000","last_peered":"2024-09-12T18:35:59.020572+0000","last_clean":"2024-09-12T18:35:59.020572+0000","last_became_active":"2024-09-12T17:10:38.408710+0000","last_became_peered":"2024-09-12T17:10:38.408710+0000","last_unstale":"2024-09-12T18:35:59.020572+0000","last_undegraded":"2024-09-12T18:35:59.020572+0000","last_fullsized":"2024-09-12T18:35:59.020572+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:10.552245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'126","reported_seq":639,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.149525+0000","last_change":"2024-09-12T17:10:40.423220+0000","last_active":"2024-09-12T18:35:20.149525+0000","last_peered":"2024-09-12T18:35:20.149525+0000","last_clean":"2024-09-12T18:35:20.149525+0000","last_became_active":"2024-09-12T17:10:40.417664+0000","last_became_peered":"2024-09-12T17:10:40.417664+0000","last_unstale":"2024-09-12T18:35:20.149525+0000","last_undegraded":"2024-09-12T18:35:20.149525+0000","last_fullsized":"2024-09-12T18:35:20.149525+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:22.188666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":285,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'884","reported_seq":2344,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.455949+0000","last_change":"2024-09-12T17:10:32.365377+0000","last_active":"2024-09-12T18:35:20.455949+0000","last_peered":"2024-09-12T18:35:20.455949+0000","last_clean":"2024-09-12T18:35:20.455949+0000","last_became_active":"2024-09-12T17:10:32.364995+0000","last_became_peered":"2024-09-12T17:10:32.364995+0000","last_unstale":"2024-09-12T18:35:20.455949+0000","last_undegraded":"2024-09-12T18:35:20.455949+0000","last_fullsized":"2024-09-12T18:35:20.455949+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":800,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:55.164024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4158,"num_read_kb":3733,"num_write":1245,"num_write_kb":492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'319","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.434619+0000","last_change":"2024-09-12T17:10:30.394063+0000","last_active":"2024-09-12T18:36:01.434619+0000","last_peered":"2024-09-12T18:36:01.434619+0000","last_clean":"2024-09-12T18:36:01.434619+0000","last_became_active":"2024-09-12T17:10:30.393495+0000","last_became_peered":"2024-09-12T17:10:30.393495+0000","last_unstale":"2024-09-12T18:36:01.434619+0000","last_undegraded":"2024-09-12T18:36:01.434619+0000","last_fullsized":"2024-09-12T18:36:01.434619+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:24.386647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209780,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":478,"num_read_kb":51876,"num_write":971,"num_write_kb":56464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.801736+0000","last_change":"2024-09-12T17:10:34.361146+0000","last_active":"2024-09-12T18:33:06.801736+0000","last_peered":"2024-09-12T18:33:06.801736+0000","last_clean":"2024-09-12T18:33:06.801736+0000","last_became_active":"2024-09-12T17:10:34.360732+0000","last_became_peered":"2024-09-12T17:10:34.360732+0000","last_unstale":"2024-09-12T18:33:06.801736+0000","last_undegraded":"2024-09-12T18:33:06.801736+0000","last_fullsized":"2024-09-12T18:33:06.801736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:35.010373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'511","reported_seq":1177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.844836+0000","last_change":"2024-09-12T17:10:36.400168+0000","last_active":"2024-09-12T18:36:00.844836+0000","last_peered":"2024-09-12T18:36:00.844836+0000","last_clean":"2024-09-12T18:36:00.844836+0000","last_became_active":"2024-09-12T17:10:36.399536+0000","last_became_peered":"2024-09-12T17:10:36.399536+0000","last_unstale":"2024-09-12T18:36:00.844836+0000","last_undegraded":"2024-09-12T18:36:00.844836+0000","last_fullsized":"2024-09-12T18:36:00.844836+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:17.679689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89531,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":886,"num_read_kb":2156,"num_write":724,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.800568+0000","last_change":"2024-09-12T17:10:38.405811+0000","last_active":"2024-09-12T18:33:01.800568+0000","last_peered":"2024-09-12T18:33:01.800568+0000","last_clean":"2024-09-12T18:33:01.800568+0000","last_became_active":"2024-09-12T17:10:38.405169+0000","last_became_peered":"2024-09-12T17:10:38.405169+0000","last_unstale":"2024-09-12T18:33:01.800568+0000","last_undegraded":"2024-09-12T18:33:01.800568+0000","last_fullsized":"2024-09-12T18:33:01.800568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:36.239505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'149","reported_seq":749,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642360+0000","last_change":"2024-09-12T17:10:40.410614+0000","last_active":"2024-09-12T18:33:01.642360+0000","last_peered":"2024-09-12T18:33:01.642360+0000","last_clean":"2024-09-12T18:33:01.642360+0000","last_became_active":"2024-09-12T17:10:40.409722+0000","last_became_peered":"2024-09-12T17:10:40.409722+0000","last_unstale":"2024-09-12T18:33:01.642360+0000","last_undegraded":"2024-09-12T18:33:01.642360+0000","last_fullsized":"2024-09-12T18:33:01.642360+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:32.816448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":508,"num_read_kb":430,"num_write":364,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'823","reported_seq":2340,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.627107+0000","last_change":"2024-09-12T17:10:32.371896+0000","last_active":"2024-09-12T18:33:18.627107+0000","last_peered":"2024-09-12T18:33:18.627107+0000","last_clean":"2024-09-12T18:33:18.627107+0000","last_became_active":"2024-09-12T17:10:32.370915+0000","last_became_peered":"2024-09-12T17:10:32.370915+0000","last_unstale":"2024-09-12T18:33:18.627107+0000","last_undegraded":"2024-09-12T18:33:18.627107+0000","last_fullsized":"2024-09-12T18:33:18.627107+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:10.387733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3877,"num_read_kb":3457,"num_write":1088,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'357","reported_seq":1014,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.772982+0000","last_change":"2024-09-12T17:11:04.869761+0000","last_active":"2024-09-12T18:36:01.772982+0000","last_peered":"2024-09-12T18:36:01.772982+0000","last_clean":"2024-09-12T18:36:01.772982+0000","last_became_active":"2024-09-12T17:11:04.868662+0000","last_became_peered":"2024-09-12T17:11:04.868662+0000","last_unstale":"2024-09-12T18:36:01.772982+0000","last_undegraded":"2024-09-12T18:36:01.772982+0000","last_fullsized":"2024-09-12T18:36:01.772982+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:32.791583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456559,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":550,"num_read_kb":17196,"num_write":1228,"num_write_kb":37960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.781150+0000","last_change":"2024-09-12T17:10:34.364569+0000","last_active":"2024-09-12T18:31:36.781150+0000","last_peered":"2024-09-12T18:31:36.781150+0000","last_clean":"2024-09-12T18:31:36.781150+0000","last_became_active":"2024-09-12T17:10:34.363822+0000","last_became_peered":"2024-09-12T17:10:34.363822+0000","last_unstale":"2024-09-12T18:31:36.781150+0000","last_undegraded":"2024-09-12T18:31:36.781150+0000","last_fullsized":"2024-09-12T18:31:36.781150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:31.296872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'300","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.666917+0000","last_change":"2024-09-12T17:10:36.378654+0000","last_active":"2024-09-12T18:35:21.666917+0000","last_peered":"2024-09-12T18:35:21.666917+0000","last_clean":"2024-09-12T18:35:21.666917+0000","last_became_active":"2024-09-12T17:10:36.377677+0000","last_became_peered":"2024-09-12T17:10:36.377677+0000","last_unstale":"2024-09-12T18:35:21.666917+0000","last_undegraded":"2024-09-12T18:35:21.666917+0000","last_fullsized":"2024-09-12T18:35:21.666917+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:08.577663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55691,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":1015,"num_write":454,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.400571+0000","last_change":"2024-09-12T17:10:38.414306+0000","last_active":"2024-09-12T18:31:56.400571+0000","last_peered":"2024-09-12T18:31:56.400571+0000","last_clean":"2024-09-12T18:31:56.400571+0000","last_became_active":"2024-09-12T17:10:38.413429+0000","last_became_peered":"2024-09-12T17:10:38.413429+0000","last_unstale":"2024-09-12T18:31:56.400571+0000","last_undegraded":"2024-09-12T18:31:56.400571+0000","last_fullsized":"2024-09-12T18:31:56.400571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:21.822547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'113","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:04.436186+0000","last_change":"2024-09-12T17:10:40.416006+0000","last_active":"2024-09-12T18:35:04.436186+0000","last_peered":"2024-09-12T18:35:04.436186+0000","last_clean":"2024-09-12T18:35:04.436186+0000","last_became_active":"2024-09-12T17:10:40.415270+0000","last_became_peered":"2024-09-12T17:10:40.415270+0000","last_unstale":"2024-09-12T18:35:04.436186+0000","last_undegraded":"2024-09-12T18:35:04.436186+0000","last_fullsized":"2024-09-12T18:35:04.436186+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:27.216064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":272,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'511","reported_seq":2174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.472032+0000","last_change":"2024-09-12T17:10:32.357942+0000","last_active":"2024-09-12T18:35:20.472032+0000","last_peered":"2024-09-12T18:35:20.472032+0000","last_clean":"2024-09-12T18:35:20.472032+0000","last_became_active":"2024-09-12T17:10:32.357121+0000","last_became_peered":"2024-09-12T17:10:32.357121+0000","last_unstale":"2024-09-12T18:35:20.472032+0000","last_undegraded":"2024-09-12T18:35:20.472032+0000","last_fullsized":"2024-09-12T18:35:20.472032+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:38.419513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2802,"num_read_kb":2611,"num_write":616,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'379","reported_seq":1062,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.596430+0000","last_change":"2024-09-12T17:10:30.392231+0000","last_active":"2024-09-12T18:36:01.596430+0000","last_peered":"2024-09-12T18:36:01.596430+0000","last_clean":"2024-09-12T18:36:01.596430+0000","last_became_active":"2024-09-12T17:10:30.391780+0000","last_became_peered":"2024-09-12T17:10:30.391780+0000","last_unstale":"2024-09-12T18:36:01.596430+0000","last_undegraded":"2024-09-12T18:36:01.596430+0000","last_fullsized":"2024-09-12T18:36:01.596430+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:06.306117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170569,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":649,"num_read_kb":4836,"num_write":1171,"num_write_kb":23965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.622390+0000","last_change":"2024-09-12T17:10:34.363001+0000","last_active":"2024-09-12T18:31:36.622390+0000","last_peered":"2024-09-12T18:31:36.622390+0000","last_clean":"2024-09-12T18:31:36.622390+0000","last_became_active":"2024-09-12T17:10:34.362337+0000","last_became_peered":"2024-09-12T17:10:34.362337+0000","last_unstale":"2024-09-12T18:31:36.622390+0000","last_undegraded":"2024-09-12T18:31:36.622390+0000","last_fullsized":"2024-09-12T18:31:36.622390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:55.735353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'341","reported_seq":971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.253897+0000","last_change":"2024-09-12T17:10:36.390545+0000","last_active":"2024-09-12T18:36:00.253897+0000","last_peered":"2024-09-12T18:36:00.253897+0000","last_clean":"2024-09-12T18:36:00.253897+0000","last_became_active":"2024-09-12T17:10:36.389965+0000","last_became_peered":"2024-09-12T17:10:36.389965+0000","last_unstale":"2024-09-12T18:36:00.253897+0000","last_undegraded":"2024-09-12T18:36:00.253897+0000","last_fullsized":"2024-09-12T18:36:00.253897+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:10.492872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60342,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":574,"num_read_kb":1242,"num_write":452,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'765","reported_seq":6959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.010785+0000","last_change":"2024-09-12T17:10:38.398211+0000","last_active":"2024-09-12T18:35:59.010785+0000","last_peered":"2024-09-12T18:35:59.010785+0000","last_clean":"2024-09-12T18:35:59.010785+0000","last_became_active":"2024-09-12T17:10:38.397332+0000","last_became_peered":"2024-09-12T17:10:38.397332+0000","last_unstale":"2024-09-12T18:35:59.010785+0000","last_undegraded":"2024-09-12T18:35:59.010785+0000","last_fullsized":"2024-09-12T18:35:59.010785+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:01.068948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'149","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.554935+0000","last_change":"2024-09-12T17:10:40.424715+0000","last_active":"2024-09-12T18:33:57.554935+0000","last_peered":"2024-09-12T18:33:57.554935+0000","last_clean":"2024-09-12T18:33:57.554935+0000","last_became_active":"2024-09-12T17:10:40.423894+0000","last_became_peered":"2024-09-12T17:10:40.423894+0000","last_unstale":"2024-09-12T18:33:57.554935+0000","last_undegraded":"2024-09-12T18:33:57.554935+0000","last_fullsized":"2024-09-12T18:33:57.554935+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:15.998229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1683,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":214,"num_read_kb":204,"num_write":362,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'506","reported_seq":2219,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.480069+0000","last_change":"2024-09-12T17:10:32.362015+0000","last_active":"2024-09-12T18:35:20.480069+0000","last_peered":"2024-09-12T18:35:20.480069+0000","last_clean":"2024-09-12T18:35:20.480069+0000","last_became_active":"2024-09-12T17:10:32.361164+0000","last_became_peered":"2024-09-12T17:10:32.361164+0000","last_unstale":"2024-09-12T18:35:20.480069+0000","last_undegraded":"2024-09-12T18:35:20.480069+0000","last_fullsized":"2024-09-12T18:35:20.480069+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:51.658105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2673,"num_read_kb":2535,"num_write":607,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'355","reported_seq":1086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.392143+0000","last_change":"2024-09-12T17:10:30.362031+0000","last_active":"2024-09-12T18:36:00.392143+0000","last_peered":"2024-09-12T18:36:00.392143+0000","last_clean":"2024-09-12T18:36:00.392143+0000","last_became_active":"2024-09-12T17:10:30.361126+0000","last_became_peered":"2024-09-12T17:10:30.361126+0000","last_unstale":"2024-09-12T18:36:00.392143+0000","last_undegraded":"2024-09-12T18:36:00.392143+0000","last_fullsized":"2024-09-12T18:36:00.392143+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:31.446390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21496170,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":655,"num_read_kb":57356,"num_write":1261,"num_write_kb":69062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1477,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:58.765520+0000","last_change":"2024-09-12T17:10:34.371001+0000","last_active":"2024-09-12T18:35:58.765520+0000","last_peered":"2024-09-12T18:35:58.765520+0000","last_clean":"2024-09-12T18:35:58.765520+0000","last_became_active":"2024-09-12T17:10:34.367608+0000","last_became_peered":"2024-09-12T17:10:34.367608+0000","last_unstale":"2024-09-12T18:35:58.765520+0000","last_undegraded":"2024-09-12T18:35:58.765520+0000","last_fullsized":"2024-09-12T18:35:58.765520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:28.182336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'122","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:39.390262+0000","last_change":"2024-09-12T17:10:36.922117+0000","last_active":"2024-09-12T18:31:39.390262+0000","last_peered":"2024-09-12T18:31:39.390262+0000","last_clean":"2024-09-12T18:31:39.390262+0000","last_became_active":"2024-09-12T17:10:36.921242+0000","last_became_peered":"2024-09-12T17:10:36.921242+0000","last_unstale":"2024-09-12T18:31:39.390262+0000","last_undegraded":"2024-09-12T18:31:39.390262+0000","last_fullsized":"2024-09-12T18:31:39.390262+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:20.309744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'780","reported_seq":2885,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.013155+0000","last_change":"2024-09-12T17:10:38.398167+0000","last_active":"2024-09-12T18:35:59.013155+0000","last_peered":"2024-09-12T18:35:59.013155+0000","last_clean":"2024-09-12T18:35:59.013155+0000","last_became_active":"2024-09-12T17:10:38.397242+0000","last_became_peered":"2024-09-12T17:10:38.397242+0000","last_unstale":"2024-09-12T18:35:59.013155+0000","last_undegraded":"2024-09-12T18:35:59.013155+0000","last_fullsized":"2024-09-12T18:35:59.013155+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:54.313987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'138","reported_seq":654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.767388+0000","last_change":"2024-09-12T17:10:40.420601+0000","last_active":"2024-09-12T18:33:55.767388+0000","last_peered":"2024-09-12T18:33:55.767388+0000","last_clean":"2024-09-12T18:33:55.767388+0000","last_became_active":"2024-09-12T17:10:40.415831+0000","last_became_peered":"2024-09-12T17:10:40.415831+0000","last_unstale":"2024-09-12T18:33:55.767388+0000","last_undegraded":"2024-09-12T18:33:55.767388+0000","last_fullsized":"2024-09-12T18:33:55.767388+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:03.855689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":150,"num_write":326,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'562","reported_seq":2078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.813907+0000","last_change":"2024-09-12T17:10:32.367243+0000","last_active":"2024-09-12T18:34:01.813907+0000","last_peered":"2024-09-12T18:34:01.813907+0000","last_clean":"2024-09-12T18:34:01.813907+0000","last_became_active":"2024-09-12T17:10:32.366967+0000","last_became_peered":"2024-09-12T17:10:32.366967+0000","last_unstale":"2024-09-12T18:34:01.813907+0000","last_undegraded":"2024-09-12T18:34:01.813907+0000","last_fullsized":"2024-09-12T18:34:01.813907+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:36.021339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2878,"num_read_kb":2622,"num_write":716,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'332","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.415203+0000","last_change":"2024-09-12T17:10:30.360774+0000","last_active":"2024-09-12T18:35:59.415203+0000","last_peered":"2024-09-12T18:35:59.415203+0000","last_clean":"2024-09-12T18:35:59.415203+0000","last_became_active":"2024-09-12T17:10:30.360368+0000","last_became_peered":"2024-09-12T17:10:30.360368+0000","last_unstale":"2024-09-12T18:35:59.415203+0000","last_undegraded":"2024-09-12T18:35:59.415203+0000","last_fullsized":"2024-09-12T18:35:59.415203+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:43.197601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4335157,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":557,"num_read_kb":11059,"num_write":1189,"num_write_kb":24095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:35.572162+0000","last_change":"2024-09-12T17:10:34.354809+0000","last_active":"2024-09-12T18:31:35.572162+0000","last_peered":"2024-09-12T18:31:35.572162+0000","last_clean":"2024-09-12T18:31:35.572162+0000","last_became_active":"2024-09-12T17:10:34.354009+0000","last_became_peered":"2024-09-12T17:10:34.354009+0000","last_unstale":"2024-09-12T18:31:35.572162+0000","last_undegraded":"2024-09-12T18:31:35.572162+0000","last_fullsized":"2024-09-12T18:31:35.572162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:37.358212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'374","reported_seq":1017,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.702025+0000","last_change":"2024-09-12T17:10:36.393717+0000","last_active":"2024-09-12T18:35:21.702025+0000","last_peered":"2024-09-12T18:35:21.702025+0000","last_clean":"2024-09-12T18:35:21.702025+0000","last_became_active":"2024-09-12T17:10:36.392271+0000","last_became_peered":"2024-09-12T17:10:36.392271+0000","last_unstale":"2024-09-12T18:35:21.702025+0000","last_undegraded":"2024-09-12T18:35:21.702025+0000","last_fullsized":"2024-09-12T18:35:21.702025+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:38.244171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55298,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":602,"num_read_kb":1087,"num_write":462,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.565485+0000","last_change":"2024-09-12T17:10:38.399541+0000","last_active":"2024-09-12T18:31:41.565485+0000","last_peered":"2024-09-12T18:31:41.565485+0000","last_clean":"2024-09-12T18:31:41.565485+0000","last_became_active":"2024-09-12T17:10:38.398743+0000","last_became_peered":"2024-09-12T17:10:38.398743+0000","last_unstale":"2024-09-12T18:31:41.565485+0000","last_undegraded":"2024-09-12T18:31:41.565485+0000","last_fullsized":"2024-09-12T18:31:41.565485+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:42.789598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'104","reported_seq":613,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.057275+0000","last_change":"2024-09-12T17:10:40.411608+0000","last_active":"2024-09-12T18:34:00.057275+0000","last_peered":"2024-09-12T18:34:00.057275+0000","last_clean":"2024-09-12T18:34:00.057275+0000","last_became_active":"2024-09-12T17:10:40.410710+0000","last_became_peered":"2024-09-12T17:10:40.410710+0000","last_unstale":"2024-09-12T18:34:00.057275+0000","last_undegraded":"2024-09-12T18:34:00.057275+0000","last_fullsized":"2024-09-12T18:34:00.057275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:48.629817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":239,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'447","reported_seq":2001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:59.059999+0000","last_change":"2024-09-12T17:10:32.367439+0000","last_active":"2024-09-12T18:32:59.059999+0000","last_peered":"2024-09-12T18:32:59.059999+0000","last_clean":"2024-09-12T18:32:59.059999+0000","last_became_active":"2024-09-12T17:10:32.366571+0000","last_became_peered":"2024-09-12T17:10:32.366571+0000","last_unstale":"2024-09-12T18:32:59.059999+0000","last_undegraded":"2024-09-12T18:32:59.059999+0000","last_fullsized":"2024-09-12T18:32:59.059999+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:11.374807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2259,"num_read_kb":2146,"num_write":500,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.398388+0000","last_change":"2024-09-12T17:10:13.025471+0000","last_active":"2024-09-12T18:32:41.398388+0000","last_peered":"2024-09-12T18:32:41.398388+0000","last_clean":"2024-09-12T18:32:41.398388+0000","last_became_active":"2024-09-12T17:10:13.024652+0000","last_became_peered":"2024-09-12T17:10:13.024652+0000","last_unstale":"2024-09-12T18:32:41.398388+0000","last_undegraded":"2024-09-12T18:32:41.398388+0000","last_fullsized":"2024-09-12T18:32:41.398388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:11.999189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:11.999189+0000","last_clean_scrub_stamp":"2024-09-12T17:10:11.999189+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:01.776648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.420031+0000","last_change":"2024-09-12T17:10:20.094438+0000","last_active":"2024-09-12T18:33:41.420031+0000","last_peered":"2024-09-12T18:33:41.420031+0000","last_clean":"2024-09-12T18:33:41.420031+0000","last_became_active":"2024-09-12T17:10:18.073547+0000","last_became_peered":"2024-09-12T17:10:18.073547+0000","last_unstale":"2024-09-12T18:33:41.420031+0000","last_undegraded":"2024-09-12T18:33:41.420031+0000","last_fullsized":"2024-09-12T18:33:41.420031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:46.358663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010552039999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'267","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.445636+0000","last_change":"2024-09-12T17:10:30.395390+0000","last_active":"2024-09-12T18:35:59.445636+0000","last_peered":"2024-09-12T18:35:59.445636+0000","last_clean":"2024-09-12T18:35:59.445636+0000","last_became_active":"2024-09-12T17:10:30.395026+0000","last_became_peered":"2024-09-12T17:10:30.395026+0000","last_unstale":"2024-09-12T18:35:59.445636+0000","last_undegraded":"2024-09-12T18:35:59.445636+0000","last_fullsized":"2024-09-12T18:35:59.445636+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:10.168440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10567119,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":452,"num_read_kb":151053,"num_write":946,"num_write_kb":34461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"37'3","reported_seq":1004,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:58.995249+0000","last_change":"2024-09-12T17:10:34.364363+0000","last_active":"2024-09-12T18:35:58.995249+0000","last_peered":"2024-09-12T18:35:58.995249+0000","last_clean":"2024-09-12T18:35:58.995249+0000","last_became_active":"2024-09-12T17:10:34.363615+0000","last_became_peered":"2024-09-12T17:10:34.363615+0000","last_unstale":"2024-09-12T18:35:58.995249+0000","last_undegraded":"2024-09-12T18:35:58.995249+0000","last_fullsized":"2024-09-12T18:35:58.995249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:00.136965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":734,"num_read_kb":732,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'745","reported_seq":1465,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.041386+0000","last_change":"2024-09-12T17:10:36.395832+0000","last_active":"2024-09-12T18:36:00.041386+0000","last_peered":"2024-09-12T18:36:00.041386+0000","last_clean":"2024-09-12T18:36:00.041386+0000","last_became_active":"2024-09-12T17:10:36.395060+0000","last_became_peered":"2024-09-12T17:10:36.395060+0000","last_unstale":"2024-09-12T18:36:00.041386+0000","last_undegraded":"2024-09-12T18:36:00.041386+0000","last_fullsized":"2024-09-12T18:36:00.041386+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:34.192269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156895,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1442,"num_read_kb":3092,"num_write":1416,"num_write_kb":1252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.413770+0000","last_change":"2024-09-12T17:10:38.413654+0000","last_active":"2024-09-12T18:33:01.413770+0000","last_peered":"2024-09-12T18:33:01.413770+0000","last_clean":"2024-09-12T18:33:01.413770+0000","last_became_active":"2024-09-12T17:10:38.413042+0000","last_became_peered":"2024-09-12T17:10:38.413042+0000","last_unstale":"2024-09-12T18:33:01.413770+0000","last_undegraded":"2024-09-12T18:33:01.413770+0000","last_fullsized":"2024-09-12T18:33:01.413770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:03.626589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'214","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.891133+0000","last_change":"2024-09-12T17:10:40.416972+0000","last_active":"2024-09-12T18:34:01.891133+0000","last_peered":"2024-09-12T18:34:01.891133+0000","last_clean":"2024-09-12T18:34:01.891133+0000","last_became_active":"2024-09-12T17:10:40.413341+0000","last_became_peered":"2024-09-12T17:10:40.413341+0000","last_unstale":"2024-09-12T18:34:01.891133+0000","last_undegraded":"2024-09-12T18:34:01.891133+0000","last_fullsized":"2024-09-12T18:34:01.891133+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:47.293584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":511,"num_write":461,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'391","reported_seq":1829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.412715+0000","last_change":"2024-09-12T17:10:32.365399+0000","last_active":"2024-09-12T18:32:56.412715+0000","last_peered":"2024-09-12T18:32:56.412715+0000","last_clean":"2024-09-12T18:32:56.412715+0000","last_became_active":"2024-09-12T17:10:32.364798+0000","last_became_peered":"2024-09-12T17:10:32.364798+0000","last_unstale":"2024-09-12T18:32:56.412715+0000","last_undegraded":"2024-09-12T18:32:56.412715+0000","last_fullsized":"2024-09-12T18:32:56.412715+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:26.942345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2015,"num_read_kb":1907,"num_write":451,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.399689+0000","last_change":"2024-09-12T17:10:20.396952+0000","last_active":"2024-09-12T18:32:46.399689+0000","last_peered":"2024-09-12T18:32:46.399689+0000","last_clean":"2024-09-12T18:32:46.399689+0000","last_became_active":"2024-09-12T17:10:18.073016+0000","last_became_peered":"2024-09-12T17:10:18.073016+0000","last_unstale":"2024-09-12T18:32:46.399689+0000","last_undegraded":"2024-09-12T18:32:46.399689+0000","last_fullsized":"2024-09-12T18:32:46.399689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:57.171583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098613699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'338","reported_seq":1015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.344334+0000","last_change":"2024-09-12T17:10:30.355852+0000","last_active":"2024-09-12T18:36:01.344334+0000","last_peered":"2024-09-12T18:36:01.344334+0000","last_clean":"2024-09-12T18:36:01.344334+0000","last_became_active":"2024-09-12T17:10:30.355237+0000","last_became_peered":"2024-09-12T17:10:30.355237+0000","last_unstale":"2024-09-12T18:36:01.344334+0000","last_undegraded":"2024-09-12T18:36:01.344334+0000","last_fullsized":"2024-09-12T18:36:01.344334+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:24.811371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262459,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":545,"num_read_kb":28524,"num_write":1149,"num_write_kb":35154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.409737+0000","last_change":"2024-09-12T17:10:34.368316+0000","last_active":"2024-09-12T18:32:56.409737+0000","last_peered":"2024-09-12T18:32:56.409737+0000","last_clean":"2024-09-12T18:32:56.409737+0000","last_became_active":"2024-09-12T17:10:34.366826+0000","last_became_peered":"2024-09-12T17:10:34.366826+0000","last_unstale":"2024-09-12T18:32:56.409737+0000","last_undegraded":"2024-09-12T18:32:56.409737+0000","last_fullsized":"2024-09-12T18:32:56.409737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:41.209887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1381","reported_seq":3366,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.518565+0000","last_change":"2024-09-12T17:10:36.399027+0000","last_active":"2024-09-12T18:36:01.518565+0000","last_peered":"2024-09-12T18:36:01.518565+0000","last_clean":"2024-09-12T18:36:01.518565+0000","last_became_active":"2024-09-12T17:10:36.398283+0000","last_became_peered":"2024-09-12T17:10:36.398283+0000","last_unstale":"2024-09-12T18:36:01.518565+0000","last_undegraded":"2024-09-12T18:36:01.518565+0000","last_fullsized":"2024-09-12T18:36:01.518565+0000","mapping_epoch":31,"log_start":"268'1300","ondisk_log_start":"268'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":1300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:36.074991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159323,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2181,"num_read_kb":4105,"num_write":1280,"num_write_kb":1078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.394022+0000","last_change":"2024-09-12T17:10:38.407976+0000","last_active":"2024-09-12T18:32:21.394022+0000","last_peered":"2024-09-12T18:32:21.394022+0000","last_clean":"2024-09-12T18:32:21.394022+0000","last_became_active":"2024-09-12T17:10:38.407002+0000","last_became_peered":"2024-09-12T17:10:38.407002+0000","last_unstale":"2024-09-12T18:32:21.394022+0000","last_undegraded":"2024-09-12T18:32:21.394022+0000","last_fullsized":"2024-09-12T18:32:21.394022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:39.734129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'125","reported_seq":641,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.101124+0000","last_change":"2024-09-12T17:10:40.771071+0000","last_active":"2024-09-12T18:34:02.101124+0000","last_peered":"2024-09-12T18:34:02.101124+0000","last_clean":"2024-09-12T18:34:02.101124+0000","last_became_active":"2024-09-12T17:10:40.770362+0000","last_became_peered":"2024-09-12T17:10:40.770362+0000","last_unstale":"2024-09-12T18:34:02.101124+0000","last_undegraded":"2024-09-12T18:34:02.101124+0000","last_fullsized":"2024-09-12T18:34:02.101124+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:15.034623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":150,"num_write":307,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'424","reported_seq":2035,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:59.053173+0000","last_change":"2024-09-12T17:10:32.365161+0000","last_active":"2024-09-12T18:32:59.053173+0000","last_peered":"2024-09-12T18:32:59.053173+0000","last_clean":"2024-09-12T18:32:59.053173+0000","last_became_active":"2024-09-12T17:10:32.361184+0000","last_became_peered":"2024-09-12T17:10:32.361184+0000","last_unstale":"2024-09-12T18:32:59.053173+0000","last_undegraded":"2024-09-12T18:32:59.053173+0000","last_fullsized":"2024-09-12T18:32:59.053173+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:45.804037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2375,"num_read_kb":2259,"num_write":493,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":547,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.808600+0000","last_change":"2024-09-12T17:10:20.089534+0000","last_active":"2024-09-12T18:33:41.808600+0000","last_peered":"2024-09-12T18:33:41.808600+0000","last_clean":"2024-09-12T18:33:41.808600+0000","last_became_active":"2024-09-12T17:10:18.210168+0000","last_became_peered":"2024-09-12T17:10:18.210168+0000","last_unstale":"2024-09-12T18:33:41.808600+0000","last_undegraded":"2024-09-12T18:33:41.808600+0000","last_fullsized":"2024-09-12T18:33:41.808600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:46.762850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001219171,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'326","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.606417+0000","last_change":"2024-09-12T17:10:30.405973+0000","last_active":"2024-09-12T18:36:01.606417+0000","last_peered":"2024-09-12T18:36:01.606417+0000","last_clean":"2024-09-12T18:36:01.606417+0000","last_became_active":"2024-09-12T17:10:30.405641+0000","last_became_peered":"2024-09-12T17:10:30.405641+0000","last_unstale":"2024-09-12T18:36:01.606417+0000","last_undegraded":"2024-09-12T18:36:01.606417+0000","last_fullsized":"2024-09-12T18:36:01.606417+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:49.395336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097286,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":426,"num_read_kb":15806,"num_write":1003,"num_write_kb":36297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.799717+0000","last_change":"2024-09-12T17:10:34.368266+0000","last_active":"2024-09-12T18:32:56.799717+0000","last_peered":"2024-09-12T18:32:56.799717+0000","last_clean":"2024-09-12T18:32:56.799717+0000","last_became_active":"2024-09-12T17:10:34.367870+0000","last_became_peered":"2024-09-12T17:10:34.367870+0000","last_unstale":"2024-09-12T18:32:56.799717+0000","last_undegraded":"2024-09-12T18:32:56.799717+0000","last_fullsized":"2024-09-12T18:32:56.799717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:51.335257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'345","reported_seq":1937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.757234+0000","last_change":"2024-09-12T17:10:36.923069+0000","last_active":"2024-09-12T18:35:21.757234+0000","last_peered":"2024-09-12T18:35:21.757234+0000","last_clean":"2024-09-12T18:35:21.757234+0000","last_became_active":"2024-09-12T17:10:36.922321+0000","last_became_peered":"2024-09-12T17:10:36.922321+0000","last_unstale":"2024-09-12T18:35:21.757234+0000","last_undegraded":"2024-09-12T18:35:21.757234+0000","last_fullsized":"2024-09-12T18:35:21.757234+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:40.884164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":291,"num_read_kb":281,"num_write":273,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.400401+0000","last_change":"2024-09-12T17:10:38.415538+0000","last_active":"2024-09-12T18:31:56.400401+0000","last_peered":"2024-09-12T18:31:56.400401+0000","last_clean":"2024-09-12T18:31:56.400401+0000","last_became_active":"2024-09-12T17:10:38.413459+0000","last_became_peered":"2024-09-12T17:10:38.413459+0000","last_unstale":"2024-09-12T18:31:56.400401+0000","last_undegraded":"2024-09-12T18:31:56.400401+0000","last_fullsized":"2024-09-12T18:31:56.400401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:23.614741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'231","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.307485+0000","last_change":"2024-09-12T17:10:40.415650+0000","last_active":"2024-09-12T18:34:00.307485+0000","last_peered":"2024-09-12T18:34:00.307485+0000","last_clean":"2024-09-12T18:34:00.307485+0000","last_became_active":"2024-09-12T17:10:40.414712+0000","last_became_peered":"2024-09-12T17:10:40.414712+0000","last_unstale":"2024-09-12T18:34:00.307485+0000","last_undegraded":"2024-09-12T18:34:00.307485+0000","last_fullsized":"2024-09-12T18:34:00.307485+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:26.385614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":496,"num_read_kb":517,"num_write":496,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'462","reported_seq":1981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.917826+0000","last_change":"2024-09-12T17:10:32.361139+0000","last_active":"2024-09-12T18:33:59.917826+0000","last_peered":"2024-09-12T18:33:59.917826+0000","last_clean":"2024-09-12T18:33:59.917826+0000","last_became_active":"2024-09-12T17:10:32.360853+0000","last_became_peered":"2024-09-12T17:10:32.360853+0000","last_unstale":"2024-09-12T18:33:59.917826+0000","last_undegraded":"2024-09-12T18:33:59.917826+0000","last_fullsized":"2024-09-12T18:33:59.917826+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:48.894459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2461,"num_read_kb":2304,"num_write":540,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":542,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.419958+0000","last_change":"2024-09-12T17:10:20.095430+0000","last_active":"2024-09-12T18:33:41.419958+0000","last_peered":"2024-09-12T18:33:41.419958+0000","last_clean":"2024-09-12T18:33:41.419958+0000","last_became_active":"2024-09-12T17:10:18.072719+0000","last_became_peered":"2024-09-12T17:10:18.072719+0000","last_unstale":"2024-09-12T18:33:41.419958+0000","last_undegraded":"2024-09-12T18:33:41.419958+0000","last_fullsized":"2024-09-12T18:33:41.419958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:14.576392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022239349999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'352","reported_seq":1062,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.603931+0000","last_change":"2024-09-12T17:10:30.358580+0000","last_active":"2024-09-12T18:36:00.603931+0000","last_peered":"2024-09-12T18:36:00.603931+0000","last_clean":"2024-09-12T18:36:00.603931+0000","last_became_active":"2024-09-12T17:10:30.354850+0000","last_became_peered":"2024-09-12T17:10:30.354850+0000","last_unstale":"2024-09-12T18:36:00.603931+0000","last_undegraded":"2024-09-12T18:36:00.603931+0000","last_fullsized":"2024-09-12T18:36:00.603931+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:31.523584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4245763,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":577,"num_read_kb":44142,"num_write":1291,"num_write_kb":42918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.402501+0000","last_change":"2024-09-12T17:10:34.359604+0000","last_active":"2024-09-12T18:32:06.402501+0000","last_peered":"2024-09-12T18:32:06.402501+0000","last_clean":"2024-09-12T18:32:06.402501+0000","last_became_active":"2024-09-12T17:10:34.358926+0000","last_became_peered":"2024-09-12T17:10:34.358926+0000","last_unstale":"2024-09-12T18:32:06.402501+0000","last_undegraded":"2024-09-12T18:32:06.402501+0000","last_fullsized":"2024-09-12T18:32:06.402501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:31.601357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'171","reported_seq":755,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:09.437593+0000","last_change":"2024-09-12T17:10:36.396445+0000","last_active":"2024-09-12T18:35:09.437593+0000","last_peered":"2024-09-12T18:35:09.437593+0000","last_clean":"2024-09-12T18:35:09.437593+0000","last_became_active":"2024-09-12T17:10:36.395658+0000","last_became_peered":"2024-09-12T17:10:36.395658+0000","last_unstale":"2024-09-12T18:35:09.437593+0000","last_undegraded":"2024-09-12T18:35:09.437593+0000","last_fullsized":"2024-09-12T18:35:09.437593+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:53.937530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":215,"num_read_kb":209,"num_write":154,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.582583+0000","last_change":"2024-09-12T17:10:38.414758+0000","last_active":"2024-09-12T18:33:01.582583+0000","last_peered":"2024-09-12T18:33:01.582583+0000","last_clean":"2024-09-12T18:33:01.582583+0000","last_became_active":"2024-09-12T17:10:38.414045+0000","last_became_peered":"2024-09-12T17:10:38.414045+0000","last_unstale":"2024-09-12T18:33:01.582583+0000","last_undegraded":"2024-09-12T18:33:01.582583+0000","last_fullsized":"2024-09-12T18:33:01.582583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:17.692176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'151","reported_seq":739,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.894081+0000","last_change":"2024-09-12T17:10:40.422450+0000","last_active":"2024-09-12T18:33:10.894081+0000","last_peered":"2024-09-12T18:33:10.894081+0000","last_clean":"2024-09-12T18:33:10.894081+0000","last_became_active":"2024-09-12T17:10:40.420995+0000","last_became_peered":"2024-09-12T17:10:40.420995+0000","last_unstale":"2024-09-12T18:33:10.894081+0000","last_undegraded":"2024-09-12T18:33:10.894081+0000","last_fullsized":"2024-09-12T18:33:10.894081+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:49.058635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":383,"num_read_kb":354,"num_write":368,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'864","reported_seq":2542,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.526321+0000","last_change":"2024-09-12T17:10:32.362173+0000","last_active":"2024-09-12T18:35:20.526321+0000","last_peered":"2024-09-12T18:35:20.526321+0000","last_clean":"2024-09-12T18:35:20.526321+0000","last_became_active":"2024-09-12T17:10:32.361696+0000","last_became_peered":"2024-09-12T17:10:32.361696+0000","last_unstale":"2024-09-12T18:35:20.526321+0000","last_undegraded":"2024-09-12T18:35:20.526321+0000","last_fullsized":"2024-09-12T18:35:20.526321+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:49.188465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4191,"num_read_kb":3806,"num_write":1162,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'301","reported_seq":910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.417845+0000","last_change":"2024-09-12T17:10:30.355665+0000","last_active":"2024-09-12T18:36:01.417845+0000","last_peered":"2024-09-12T18:36:01.417845+0000","last_clean":"2024-09-12T18:36:01.417845+0000","last_became_active":"2024-09-12T17:10:30.354730+0000","last_became_peered":"2024-09-12T17:10:30.354730+0000","last_unstale":"2024-09-12T18:36:01.417845+0000","last_undegraded":"2024-09-12T18:36:01.417845+0000","last_fullsized":"2024-09-12T18:36:01.417845+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:16.166371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":375,"num_read_kb":12992,"num_write":915,"num_write_kb":30670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.651271+0000","last_change":"2024-09-12T17:10:20.100416+0000","last_active":"2024-09-12T18:33:41.651271+0000","last_peered":"2024-09-12T18:33:41.651271+0000","last_clean":"2024-09-12T18:33:41.651271+0000","last_became_active":"2024-09-12T17:10:18.209658+0000","last_became_peered":"2024-09-12T17:10:18.209658+0000","last_unstale":"2024-09-12T18:33:41.651271+0000","last_undegraded":"2024-09-12T18:33:41.651271+0000","last_fullsized":"2024-09-12T18:33:41.651271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:28.458806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010531659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.424736+0000","last_change":"2024-09-12T17:10:34.362549+0000","last_active":"2024-09-12T18:33:56.424736+0000","last_peered":"2024-09-12T18:33:56.424736+0000","last_clean":"2024-09-12T18:33:56.424736+0000","last_became_active":"2024-09-12T17:10:34.361845+0000","last_became_peered":"2024-09-12T17:10:34.361845+0000","last_unstale":"2024-09-12T18:33:56.424736+0000","last_undegraded":"2024-09-12T18:33:56.424736+0000","last_fullsized":"2024-09-12T18:33:56.424736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:05.948451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'678","reported_seq":1390,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.438251+0000","last_change":"2024-09-12T17:10:36.400065+0000","last_active":"2024-09-12T18:36:01.438251+0000","last_peered":"2024-09-12T18:36:01.438251+0000","last_clean":"2024-09-12T18:36:01.438251+0000","last_became_active":"2024-09-12T17:10:36.398917+0000","last_became_peered":"2024-09-12T17:10:36.398917+0000","last_unstale":"2024-09-12T18:36:01.438251+0000","last_undegraded":"2024-09-12T18:36:01.438251+0000","last_fullsized":"2024-09-12T18:36:01.438251+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.596681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100883,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1833,"num_read_kb":3243,"num_write":2400,"num_write_kb":2201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:55.577010+0000","last_change":"2024-09-12T17:10:38.401627+0000","last_active":"2024-09-12T18:31:55.577010+0000","last_peered":"2024-09-12T18:31:55.577010+0000","last_clean":"2024-09-12T18:31:55.577010+0000","last_became_active":"2024-09-12T17:10:38.400868+0000","last_became_peered":"2024-09-12T17:10:38.400868+0000","last_unstale":"2024-09-12T18:31:55.577010+0000","last_undegraded":"2024-09-12T18:31:55.577010+0000","last_fullsized":"2024-09-12T18:31:55.577010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:50.604824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'135","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.773259+0000","last_change":"2024-09-12T17:10:40.774323+0000","last_active":"2024-09-12T18:33:55.773259+0000","last_peered":"2024-09-12T18:33:55.773259+0000","last_clean":"2024-09-12T18:33:55.773259+0000","last_became_active":"2024-09-12T17:10:40.771185+0000","last_became_peered":"2024-09-12T17:10:40.771185+0000","last_unstale":"2024-09-12T18:33:55.773259+0000","last_undegraded":"2024-09-12T18:33:55.773259+0000","last_fullsized":"2024-09-12T18:33:55.773259+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:03.269283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":180,"num_write":328,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'473","reported_seq":2163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.529320+0000","last_change":"2024-09-12T17:10:32.355390+0000","last_active":"2024-09-12T18:35:20.529320+0000","last_peered":"2024-09-12T18:35:20.529320+0000","last_clean":"2024-09-12T18:35:20.529320+0000","last_became_active":"2024-09-12T17:10:32.354795+0000","last_became_peered":"2024-09-12T17:10:32.354795+0000","last_unstale":"2024-09-12T18:35:20.529320+0000","last_undegraded":"2024-09-12T18:35:20.529320+0000","last_fullsized":"2024-09-12T18:35:20.529320+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:17.098153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2620,"num_read_kb":2476,"num_write":562,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'316","reported_seq":971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.573626+0000","last_change":"2024-09-12T17:10:30.405893+0000","last_active":"2024-09-12T18:36:01.573626+0000","last_peered":"2024-09-12T18:36:01.573626+0000","last_clean":"2024-09-12T18:36:01.573626+0000","last_became_active":"2024-09-12T17:10:30.405460+0000","last_became_peered":"2024-09-12T17:10:30.405460+0000","last_unstale":"2024-09-12T18:36:01.573626+0000","last_undegraded":"2024-09-12T18:36:01.573626+0000","last_fullsized":"2024-09-12T18:36:01.573626+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:16.200605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291735,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":464,"num_read_kb":16852,"num_write":1066,"num_write_kb":30938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:01.389327+0000","last_change":"2024-09-12T17:10:20.397111+0000","last_active":"2024-09-12T18:32:01.389327+0000","last_peered":"2024-09-12T18:32:01.389327+0000","last_clean":"2024-09-12T18:32:01.389327+0000","last_became_active":"2024-09-12T17:10:18.208762+0000","last_became_peered":"2024-09-12T17:10:18.208762+0000","last_unstale":"2024-09-12T18:32:01.389327+0000","last_undegraded":"2024-09-12T18:32:01.389327+0000","last_fullsized":"2024-09-12T18:32:01.389327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:07.303527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091554,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.593917+0000","last_change":"2024-09-12T17:10:34.356303+0000","last_active":"2024-09-12T18:33:56.593917+0000","last_peered":"2024-09-12T18:33:56.593917+0000","last_clean":"2024-09-12T18:33:56.593917+0000","last_became_active":"2024-09-12T17:10:34.355590+0000","last_became_peered":"2024-09-12T17:10:34.355590+0000","last_unstale":"2024-09-12T18:33:56.593917+0000","last_undegraded":"2024-09-12T18:33:56.593917+0000","last_fullsized":"2024-09-12T18:33:56.593917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:49.016297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'223","reported_seq":832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.832386+0000","last_change":"2024-09-12T17:10:36.922068+0000","last_active":"2024-09-12T18:34:01.832386+0000","last_peered":"2024-09-12T18:34:01.832386+0000","last_clean":"2024-09-12T18:34:01.832386+0000","last_became_active":"2024-09-12T17:10:36.921234+0000","last_became_peered":"2024-09-12T17:10:36.921234+0000","last_unstale":"2024-09-12T18:34:01.832386+0000","last_undegraded":"2024-09-12T18:34:01.832386+0000","last_fullsized":"2024-09-12T18:34:01.832386+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:56.087478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":277,"num_write":196,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'791","reported_seq":2946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.199708+0000","last_change":"2024-09-12T17:10:38.396157+0000","last_active":"2024-09-12T18:36:01.199708+0000","last_peered":"2024-09-12T18:36:01.199708+0000","last_clean":"2024-09-12T18:36:01.199708+0000","last_became_active":"2024-09-12T17:10:38.395439+0000","last_became_peered":"2024-09-12T17:10:38.395439+0000","last_unstale":"2024-09-12T18:36:01.199708+0000","last_undegraded":"2024-09-12T18:36:01.199708+0000","last_fullsized":"2024-09-12T18:36:01.199708+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:28.386160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'180","reported_seq":718,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428311+0000","last_change":"2024-09-12T17:10:40.770840+0000","last_active":"2024-09-12T18:34:19.428311+0000","last_peered":"2024-09-12T18:34:19.428311+0000","last_clean":"2024-09-12T18:34:19.428311+0000","last_became_active":"2024-09-12T17:10:40.770042+0000","last_became_peered":"2024-09-12T17:10:40.770042+0000","last_unstale":"2024-09-12T18:34:19.428311+0000","last_undegraded":"2024-09-12T18:34:19.428311+0000","last_fullsized":"2024-09-12T18:34:19.428311+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:24.561136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":293,"num_read_kb":273,"num_write":449,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'899","reported_seq":2633,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.926166+0000","last_change":"2024-09-12T17:10:32.383031+0000","last_active":"2024-09-12T18:33:59.926166+0000","last_peered":"2024-09-12T18:33:59.926166+0000","last_clean":"2024-09-12T18:33:59.926166+0000","last_became_active":"2024-09-12T17:10:32.382755+0000","last_became_peered":"2024-09-12T17:10:32.382755+0000","last_unstale":"2024-09-12T18:33:59.926166+0000","last_undegraded":"2024-09-12T18:33:59.926166+0000","last_fullsized":"2024-09-12T18:33:59.926166+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:55.069573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4651,"num_read_kb":4208,"num_write":1244,"num_write_kb":526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'264","reported_seq":895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.428295+0000","last_change":"2024-09-12T17:10:30.365199+0000","last_active":"2024-09-12T18:35:59.428295+0000","last_peered":"2024-09-12T18:35:59.428295+0000","last_clean":"2024-09-12T18:35:59.428295+0000","last_became_active":"2024-09-12T17:10:30.364767+0000","last_became_peered":"2024-09-12T17:10:30.364767+0000","last_unstale":"2024-09-12T18:35:59.428295+0000","last_undegraded":"2024-09-12T18:35:59.428295+0000","last_fullsized":"2024-09-12T18:35:59.428295+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:56.519220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16805003,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":398,"num_read_kb":23955,"num_write":988,"num_write_kb":32355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.637356+0000","last_change":"2024-09-12T17:10:20.100539+0000","last_active":"2024-09-12T18:32:41.637356+0000","last_peered":"2024-09-12T18:32:41.637356+0000","last_clean":"2024-09-12T18:32:41.637356+0000","last_became_active":"2024-09-12T17:10:18.073132+0000","last_became_peered":"2024-09-12T17:10:18.073132+0000","last_unstale":"2024-09-12T18:32:41.637356+0000","last_undegraded":"2024-09-12T18:32:41.637356+0000","last_fullsized":"2024-09-12T18:32:41.637356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:05.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001154721,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605276+0000","last_change":"2024-09-12T17:10:34.349876+0000","last_active":"2024-09-12T18:33:55.605276+0000","last_peered":"2024-09-12T18:33:55.605276+0000","last_clean":"2024-09-12T18:33:55.605276+0000","last_became_active":"2024-09-12T17:10:34.349093+0000","last_became_peered":"2024-09-12T17:10:34.349093+0000","last_unstale":"2024-09-12T18:33:55.605276+0000","last_undegraded":"2024-09-12T18:33:55.605276+0000","last_fullsized":"2024-09-12T18:33:55.605276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:46.757080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'169","reported_seq":748,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:55.577053+0000","last_change":"2024-09-12T17:10:36.391287+0000","last_active":"2024-09-12T18:31:55.577053+0000","last_peered":"2024-09-12T18:31:55.577053+0000","last_clean":"2024-09-12T18:31:55.577053+0000","last_became_active":"2024-09-12T17:10:36.390439+0000","last_became_peered":"2024-09-12T17:10:36.390439+0000","last_unstale":"2024-09-12T18:31:55.577053+0000","last_undegraded":"2024-09-12T18:31:55.577053+0000","last_fullsized":"2024-09-12T18:31:55.577053+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:24.707986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":183,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'804","reported_seq":2855,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.012975+0000","last_change":"2024-09-12T17:10:38.394233+0000","last_active":"2024-09-12T18:35:59.012975+0000","last_peered":"2024-09-12T18:35:59.012975+0000","last_clean":"2024-09-12T18:35:59.012975+0000","last_became_active":"2024-09-12T17:10:38.393426+0000","last_became_peered":"2024-09-12T17:10:38.393426+0000","last_unstale":"2024-09-12T18:35:59.012975+0000","last_undegraded":"2024-09-12T18:35:59.012975+0000","last_fullsized":"2024-09-12T18:35:59.012975+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:37.818377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'254","reported_seq":797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.396389+0000","last_change":"2024-09-12T17:10:40.429154+0000","last_active":"2024-09-12T18:31:41.396389+0000","last_peered":"2024-09-12T18:31:41.396389+0000","last_clean":"2024-09-12T18:31:41.396389+0000","last_became_active":"2024-09-12T17:10:40.423742+0000","last_became_peered":"2024-09-12T17:10:40.423742+0000","last_unstale":"2024-09-12T18:31:41.396389+0000","last_undegraded":"2024-09-12T18:31:41.396389+0000","last_fullsized":"2024-09-12T18:31:41.396389+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:48.699774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":353,"num_read_kb":347,"num_write":533,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'873","reported_seq":2667,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605231+0000","last_change":"2024-09-12T17:10:32.368938+0000","last_active":"2024-09-12T18:33:55.605231+0000","last_peered":"2024-09-12T18:33:55.605231+0000","last_clean":"2024-09-12T18:33:55.605231+0000","last_became_active":"2024-09-12T17:10:32.368217+0000","last_became_peered":"2024-09-12T17:10:32.368217+0000","last_unstale":"2024-09-12T18:33:55.605231+0000","last_undegraded":"2024-09-12T18:33:55.605231+0000","last_fullsized":"2024-09-12T18:33:55.605231+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":800,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:33.300045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4306,"num_read_kb":3903,"num_write":1124,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'351","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.448243+0000","last_change":"2024-09-12T17:10:30.362722+0000","last_active":"2024-09-12T18:36:01.448243+0000","last_peered":"2024-09-12T18:36:01.448243+0000","last_clean":"2024-09-12T18:36:01.448243+0000","last_became_active":"2024-09-12T17:10:30.361736+0000","last_became_peered":"2024-09-12T17:10:30.361736+0000","last_unstale":"2024-09-12T18:36:01.448243+0000","last_undegraded":"2024-09-12T18:36:01.448243+0000","last_fullsized":"2024-09-12T18:36:01.448243+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:20.821477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6785181,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":601,"num_read_kb":21637,"num_write":1177,"num_write_kb":30222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.578380+0000","last_change":"2024-09-12T17:10:20.088329+0000","last_active":"2024-09-12T18:32:41.578380+0000","last_peered":"2024-09-12T18:32:41.578380+0000","last_clean":"2024-09-12T18:32:41.578380+0000","last_became_active":"2024-09-12T17:10:18.074669+0000","last_became_peered":"2024-09-12T17:10:18.074669+0000","last_unstale":"2024-09-12T18:32:41.578380+0000","last_undegraded":"2024-09-12T18:32:41.578380+0000","last_fullsized":"2024-09-12T18:32:41.578380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:20.175198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:54.408665+0000","last_change":"2024-09-12T17:10:34.358853+0000","last_active":"2024-09-12T18:32:54.408665+0000","last_peered":"2024-09-12T18:32:54.408665+0000","last_clean":"2024-09-12T18:32:54.408665+0000","last_became_active":"2024-09-12T17:10:34.358250+0000","last_became_peered":"2024-09-12T17:10:34.358250+0000","last_unstale":"2024-09-12T18:32:54.408665+0000","last_undegraded":"2024-09-12T18:32:54.408665+0000","last_fullsized":"2024-09-12T18:32:54.408665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:35.137706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'740","reported_seq":1495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.212697+0000","last_change":"2024-09-12T17:10:36.921037+0000","last_active":"2024-09-12T18:36:01.212697+0000","last_peered":"2024-09-12T18:36:01.212697+0000","last_clean":"2024-09-12T18:36:01.212697+0000","last_became_active":"2024-09-12T17:10:36.920239+0000","last_became_peered":"2024-09-12T17:10:36.920239+0000","last_unstale":"2024-09-12T18:36:01.212697+0000","last_undegraded":"2024-09-12T18:36:01.212697+0000","last_fullsized":"2024-09-12T18:36:01.212697+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:47.311658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1285,"num_read_kb":2928,"num_write":1028,"num_write_kb":813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:54.393429+0000","last_change":"2024-09-12T17:10:38.392174+0000","last_active":"2024-09-12T18:31:54.393429+0000","last_peered":"2024-09-12T18:31:54.393429+0000","last_clean":"2024-09-12T18:31:54.393429+0000","last_became_active":"2024-09-12T17:10:38.391661+0000","last_became_peered":"2024-09-12T17:10:38.391661+0000","last_unstale":"2024-09-12T18:31:54.393429+0000","last_undegraded":"2024-09-12T18:31:54.393429+0000","last_fullsized":"2024-09-12T18:31:54.393429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:44.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'98","reported_seq":607,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.423470+0000","last_change":"2024-09-12T17:10:40.435786+0000","last_active":"2024-09-12T18:33:56.423470+0000","last_peered":"2024-09-12T18:33:56.423470+0000","last_clean":"2024-09-12T18:33:56.423470+0000","last_became_active":"2024-09-12T17:10:40.435114+0000","last_became_peered":"2024-09-12T17:10:40.435114+0000","last_unstale":"2024-09-12T18:33:56.423470+0000","last_undegraded":"2024-09-12T18:33:56.423470+0000","last_fullsized":"2024-09-12T18:33:56.423470+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:14.936129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":238,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'127","reported_seq":723,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.426151+0000","last_change":"2024-09-12T17:10:40.422967+0000","last_active":"2024-09-12T18:34:01.426151+0000","last_peered":"2024-09-12T18:34:01.426151+0000","last_clean":"2024-09-12T18:34:01.426151+0000","last_became_active":"2024-09-12T17:10:40.417972+0000","last_became_peered":"2024-09-12T17:10:40.417972+0000","last_unstale":"2024-09-12T18:34:01.426151+0000","last_undegraded":"2024-09-12T18:34:01.426151+0000","last_fullsized":"2024-09-12T18:34:01.426151+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:44.119704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":319,"num_read_kb":297,"num_write":314,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'794","reported_seq":2315,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.135941+0000","last_change":"2024-09-12T17:10:32.368759+0000","last_active":"2024-09-12T18:33:06.135941+0000","last_peered":"2024-09-12T18:33:06.135941+0000","last_clean":"2024-09-12T18:33:06.135941+0000","last_became_active":"2024-09-12T17:10:32.368063+0000","last_became_peered":"2024-09-12T17:10:32.368063+0000","last_unstale":"2024-09-12T18:33:06.135941+0000","last_undegraded":"2024-09-12T18:33:06.135941+0000","last_fullsized":"2024-09-12T18:33:06.135941+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:01.539950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3740,"num_read_kb":3358,"num_write":1050,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'344","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.586131+0000","last_change":"2024-09-12T17:10:30.395497+0000","last_active":"2024-09-12T18:36:00.586131+0000","last_peered":"2024-09-12T18:36:00.586131+0000","last_clean":"2024-09-12T18:36:00.586131+0000","last_became_active":"2024-09-12T17:10:30.394117+0000","last_became_peered":"2024-09-12T17:10:30.394117+0000","last_unstale":"2024-09-12T18:36:00.586131+0000","last_undegraded":"2024-09-12T18:36:00.586131+0000","last_fullsized":"2024-09-12T18:36:00.586131+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:18.220639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357778,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":497,"num_read_kb":2118,"num_write":1119,"num_write_kb":20675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.631995+0000","last_change":"2024-09-12T17:10:34.360352+0000","last_active":"2024-09-12T18:32:16.631995+0000","last_peered":"2024-09-12T18:32:16.631995+0000","last_clean":"2024-09-12T18:32:16.631995+0000","last_became_active":"2024-09-12T17:10:34.359923+0000","last_became_peered":"2024-09-12T17:10:34.359923+0000","last_unstale":"2024-09-12T18:32:16.631995+0000","last_undegraded":"2024-09-12T18:32:16.631995+0000","last_fullsized":"2024-09-12T18:32:16.631995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:14.364530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'303","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.376919+0000","last_change":"2024-09-12T17:10:36.395453+0000","last_active":"2024-09-12T18:35:59.376919+0000","last_peered":"2024-09-12T18:35:59.376919+0000","last_clean":"2024-09-12T18:35:59.376919+0000","last_became_active":"2024-09-12T17:10:36.394731+0000","last_became_peered":"2024-09-12T17:10:36.394731+0000","last_unstale":"2024-09-12T18:35:59.376919+0000","last_undegraded":"2024-09-12T18:35:59.376919+0000","last_fullsized":"2024-09-12T18:35:59.376919+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:03.802691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56497,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":1193,"num_write":404,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:19.399496+0000","last_change":"2024-09-12T17:10:38.393630+0000","last_active":"2024-09-12T18:32:19.399496+0000","last_peered":"2024-09-12T18:32:19.399496+0000","last_clean":"2024-09-12T18:32:19.399496+0000","last_became_active":"2024-09-12T17:10:38.393112+0000","last_became_peered":"2024-09-12T17:10:38.393112+0000","last_unstale":"2024-09-12T18:32:19.399496+0000","last_undegraded":"2024-09-12T18:32:19.399496+0000","last_fullsized":"2024-09-12T18:32:19.399496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:11.857461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'117","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.411553+0000","last_change":"2024-09-12T17:10:40.430432+0000","last_active":"2024-09-12T18:33:04.411553+0000","last_peered":"2024-09-12T18:33:04.411553+0000","last_clean":"2024-09-12T18:33:04.411553+0000","last_became_active":"2024-09-12T17:10:40.429366+0000","last_became_peered":"2024-09-12T17:10:40.429366+0000","last_unstale":"2024-09-12T18:33:04.411553+0000","last_undegraded":"2024-09-12T18:33:04.411553+0000","last_fullsized":"2024-09-12T18:33:04.411553+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:03.623489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":137,"num_write":282,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'499","reported_seq":2099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.813533+0000","last_change":"2024-09-12T17:10:32.366756+0000","last_active":"2024-09-12T18:34:01.813533+0000","last_peered":"2024-09-12T18:34:01.813533+0000","last_clean":"2024-09-12T18:34:01.813533+0000","last_became_active":"2024-09-12T17:10:32.364033+0000","last_became_peered":"2024-09-12T17:10:32.364033+0000","last_unstale":"2024-09-12T18:34:01.813533+0000","last_undegraded":"2024-09-12T18:34:01.813533+0000","last_fullsized":"2024-09-12T18:34:01.813533+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:44.259351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2497,"num_read_kb":2341,"num_write":588,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'283","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.397601+0000","last_change":"2024-09-12T17:10:30.406049+0000","last_active":"2024-09-12T18:36:01.397601+0000","last_peered":"2024-09-12T18:36:01.397601+0000","last_clean":"2024-09-12T18:36:01.397601+0000","last_became_active":"2024-09-12T17:10:30.405137+0000","last_became_peered":"2024-09-12T17:10:30.405137+0000","last_unstale":"2024-09-12T18:36:01.397601+0000","last_undegraded":"2024-09-12T18:36:01.397601+0000","last_fullsized":"2024-09-12T18:36:01.397601+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:51.883704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728708,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":582,"num_read_kb":36707,"num_write":945,"num_write_kb":52863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:14.398461+0000","last_change":"2024-09-12T17:10:34.356731+0000","last_active":"2024-09-12T18:32:14.398461+0000","last_peered":"2024-09-12T18:32:14.398461+0000","last_clean":"2024-09-12T18:32:14.398461+0000","last_became_active":"2024-09-12T17:10:34.355684+0000","last_became_peered":"2024-09-12T17:10:34.355684+0000","last_unstale":"2024-09-12T18:32:14.398461+0000","last_undegraded":"2024-09-12T18:32:14.398461+0000","last_fullsized":"2024-09-12T18:32:14.398461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:22.182263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'58","reported_seq":588,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.404344+0000","last_change":"2024-09-12T17:10:36.402010+0000","last_active":"2024-09-12T18:32:16.404344+0000","last_peered":"2024-09-12T18:32:16.404344+0000","last_clean":"2024-09-12T18:32:16.404344+0000","last_became_active":"2024-09-12T17:10:36.400358+0000","last_became_peered":"2024-09-12T17:10:36.400358+0000","last_unstale":"2024-09-12T18:32:16.404344+0000","last_undegraded":"2024-09-12T18:32:16.404344+0000","last_fullsized":"2024-09-12T18:32:16.404344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:54.812329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":54,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.393889+0000","last_change":"2024-09-12T17:10:38.405067+0000","last_active":"2024-09-12T18:32:21.393889+0000","last_peered":"2024-09-12T18:32:21.393889+0000","last_clean":"2024-09-12T18:32:21.393889+0000","last_became_active":"2024-09-12T17:10:38.404309+0000","last_became_peered":"2024-09-12T17:10:38.404309+0000","last_unstale":"2024-09-12T18:32:21.393889+0000","last_undegraded":"2024-09-12T18:32:21.393889+0000","last_fullsized":"2024-09-12T18:32:21.393889+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:21.478649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'194","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.504598+0000","last_change":"2024-09-12T17:10:40.422558+0000","last_active":"2024-09-12T18:35:20.504598+0000","last_peered":"2024-09-12T18:35:20.504598+0000","last_clean":"2024-09-12T18:35:20.504598+0000","last_became_active":"2024-09-12T17:10:40.418473+0000","last_became_peered":"2024-09-12T17:10:40.418473+0000","last_unstale":"2024-09-12T18:35:20.504598+0000","last_undegraded":"2024-09-12T18:35:20.504598+0000","last_fullsized":"2024-09-12T18:35:20.504598+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:29.988283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":350,"num_read_kb":341,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'358","reported_seq":1681,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:39.694476+0000","last_change":"2024-09-12T17:10:32.383157+0000","last_active":"2024-09-12T18:32:39.694476+0000","last_peered":"2024-09-12T18:32:39.694476+0000","last_clean":"2024-09-12T18:32:39.694476+0000","last_became_active":"2024-09-12T17:10:32.382581+0000","last_became_peered":"2024-09-12T17:10:32.382581+0000","last_unstale":"2024-09-12T18:32:39.694476+0000","last_undegraded":"2024-09-12T18:32:39.694476+0000","last_fullsized":"2024-09-12T18:32:39.694476+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:16.772362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1854,"num_read_kb":1737,"num_write":414,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'362","reported_seq":1035,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.355972+0000","last_change":"2024-09-12T17:10:30.375484+0000","last_active":"2024-09-12T18:36:01.355972+0000","last_peered":"2024-09-12T18:36:01.355972+0000","last_clean":"2024-09-12T18:36:01.355972+0000","last_became_active":"2024-09-12T17:10:30.374846+0000","last_became_peered":"2024-09-12T17:10:30.374846+0000","last_unstale":"2024-09-12T18:36:01.355972+0000","last_undegraded":"2024-09-12T18:36:01.355972+0000","last_fullsized":"2024-09-12T18:36:01.355972+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:37.286683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2648784,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":604,"num_read_kb":15631,"num_write":1207,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.392627+0000","last_change":"2024-09-12T17:10:34.362906+0000","last_active":"2024-09-12T18:32:16.392627+0000","last_peered":"2024-09-12T18:32:16.392627+0000","last_clean":"2024-09-12T18:32:16.392627+0000","last_became_active":"2024-09-12T17:10:34.362168+0000","last_became_peered":"2024-09-12T17:10:34.362168+0000","last_unstale":"2024-09-12T18:32:16.392627+0000","last_undegraded":"2024-09-12T18:32:16.392627+0000","last_fullsized":"2024-09-12T18:32:16.392627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:22.148212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'376","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.680160+0000","last_change":"2024-09-12T17:10:36.395016+0000","last_active":"2024-09-12T18:35:21.680160+0000","last_peered":"2024-09-12T18:35:21.680160+0000","last_clean":"2024-09-12T18:35:21.680160+0000","last_became_active":"2024-09-12T17:10:36.394639+0000","last_became_peered":"2024-09-12T17:10:36.394639+0000","last_unstale":"2024-09-12T18:35:21.680160+0000","last_undegraded":"2024-09-12T18:35:21.680160+0000","last_fullsized":"2024-09-12T18:35:21.680160+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:40.165567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85752,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":599,"num_read_kb":1247,"num_write":486,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.574124+0000","last_change":"2024-09-12T17:10:38.413916+0000","last_active":"2024-09-12T18:32:21.574124+0000","last_peered":"2024-09-12T18:32:21.574124+0000","last_clean":"2024-09-12T18:32:21.574124+0000","last_became_active":"2024-09-12T17:10:38.413131+0000","last_became_peered":"2024-09-12T17:10:38.413131+0000","last_unstale":"2024-09-12T18:32:21.574124+0000","last_undegraded":"2024-09-12T18:32:21.574124+0000","last_fullsized":"2024-09-12T18:32:21.574124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:09.828750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'132","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.413271+0000","last_change":"2024-09-12T17:10:40.429935+0000","last_active":"2024-09-12T18:33:11.413271+0000","last_peered":"2024-09-12T18:33:11.413271+0000","last_clean":"2024-09-12T18:33:11.413271+0000","last_became_active":"2024-09-12T17:10:40.429224+0000","last_became_peered":"2024-09-12T17:10:40.429224+0000","last_unstale":"2024-09-12T18:33:11.413271+0000","last_undegraded":"2024-09-12T18:33:11.413271+0000","last_fullsized":"2024-09-12T18:33:11.413271+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:11.523864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'949","reported_seq":2625,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.876011+0000","last_change":"2024-09-12T17:10:32.369486+0000","last_active":"2024-09-12T18:33:10.876011+0000","last_peered":"2024-09-12T18:33:10.876011+0000","last_clean":"2024-09-12T18:33:10.876011+0000","last_became_active":"2024-09-12T17:10:32.369282+0000","last_became_peered":"2024-09-12T17:10:32.369282+0000","last_unstale":"2024-09-12T18:33:10.876011+0000","last_undegraded":"2024-09-12T18:33:10.876011+0000","last_fullsized":"2024-09-12T18:33:10.876011+0000","mapping_epoch":27,"log_start":"268'900","ondisk_log_start":"268'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":900,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:33.793287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4532,"num_read_kb":4046,"num_write":1302,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'357","reported_seq":1031,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.397132+0000","last_change":"2024-09-12T17:10:30.357595+0000","last_active":"2024-09-12T18:36:01.397132+0000","last_peered":"2024-09-12T18:36:01.397132+0000","last_clean":"2024-09-12T18:36:01.397132+0000","last_became_active":"2024-09-12T17:10:30.356383+0000","last_became_peered":"2024-09-12T17:10:30.356383+0000","last_unstale":"2024-09-12T18:36:01.397132+0000","last_undegraded":"2024-09-12T18:36:01.397132+0000","last_fullsized":"2024-09-12T18:36:01.397132+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:13.378425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456722,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":531,"num_read_kb":17278,"num_write":1140,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.573012+0000","last_change":"2024-09-12T17:10:34.364021+0000","last_active":"2024-09-12T18:32:16.573012+0000","last_peered":"2024-09-12T18:32:16.573012+0000","last_clean":"2024-09-12T18:32:16.573012+0000","last_became_active":"2024-09-12T17:10:34.363279+0000","last_became_peered":"2024-09-12T17:10:34.363279+0000","last_unstale":"2024-09-12T18:32:16.573012+0000","last_undegraded":"2024-09-12T18:32:16.573012+0000","last_fullsized":"2024-09-12T18:32:16.573012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:56.824582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'320","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.079295+0000","last_change":"2024-09-12T17:10:36.397496+0000","last_active":"2024-09-12T18:36:01.079295+0000","last_peered":"2024-09-12T18:36:01.079295+0000","last_clean":"2024-09-12T18:36:01.079295+0000","last_became_active":"2024-09-12T17:10:36.396758+0000","last_became_peered":"2024-09-12T17:10:36.396758+0000","last_unstale":"2024-09-12T18:36:01.079295+0000","last_undegraded":"2024-09-12T18:36:01.079295+0000","last_fullsized":"2024-09-12T18:36:01.079295+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:17.261131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59757,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1297,"num_write":442,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.405399+0000","last_change":"2024-09-12T17:10:38.414645+0000","last_active":"2024-09-12T18:32:21.405399+0000","last_peered":"2024-09-12T18:32:21.405399+0000","last_clean":"2024-09-12T18:32:21.405399+0000","last_became_active":"2024-09-12T17:10:38.413004+0000","last_became_peered":"2024-09-12T17:10:38.413004+0000","last_unstale":"2024-09-12T18:32:21.405399+0000","last_undegraded":"2024-09-12T18:32:21.405399+0000","last_fullsized":"2024-09-12T18:32:21.405399+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:16.768442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'438","reported_seq":1942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.594044+0000","last_change":"2024-09-12T17:10:32.351572+0000","last_active":"2024-09-12T18:33:56.594044+0000","last_peered":"2024-09-12T18:33:56.594044+0000","last_clean":"2024-09-12T18:33:56.594044+0000","last_became_active":"2024-09-12T17:10:32.350751+0000","last_became_peered":"2024-09-12T17:10:32.350751+0000","last_unstale":"2024-09-12T18:33:56.594044+0000","last_undegraded":"2024-09-12T18:33:56.594044+0000","last_fullsized":"2024-09-12T18:33:56.594044+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:37.740261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2256,"num_read_kb":2119,"num_write":496,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'232","reported_seq":879,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.353393+0000","last_change":"2024-09-12T17:10:30.353713+0000","last_active":"2024-09-12T18:35:59.353393+0000","last_peered":"2024-09-12T18:35:59.353393+0000","last_clean":"2024-09-12T18:35:59.353393+0000","last_became_active":"2024-09-12T17:10:30.353308+0000","last_became_peered":"2024-09-12T17:10:30.353308+0000","last_unstale":"2024-09-12T18:35:59.353393+0000","last_undegraded":"2024-09-12T18:35:59.353393+0000","last_fullsized":"2024-09-12T18:35:59.353393+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:18.517236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1690410,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":355,"num_read_kb":20512,"num_write":804,"num_write_kb":25251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411828+0000","last_change":"2024-09-12T17:10:34.358634+0000","last_active":"2024-09-12T18:32:51.411828+0000","last_peered":"2024-09-12T18:32:51.411828+0000","last_clean":"2024-09-12T18:32:51.411828+0000","last_became_active":"2024-09-12T17:10:34.357883+0000","last_became_peered":"2024-09-12T17:10:34.357883+0000","last_unstale":"2024-09-12T18:32:51.411828+0000","last_undegraded":"2024-09-12T18:32:51.411828+0000","last_fullsized":"2024-09-12T18:32:51.411828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:42.544648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'519","reported_seq":1177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.001199+0000","last_change":"2024-09-12T17:10:36.402382+0000","last_active":"2024-09-12T18:36:01.001199+0000","last_peered":"2024-09-12T18:36:01.001199+0000","last_clean":"2024-09-12T18:36:01.001199+0000","last_became_active":"2024-09-12T17:10:36.401608+0000","last_became_peered":"2024-09-12T17:10:36.401608+0000","last_unstale":"2024-09-12T18:36:01.001199+0000","last_undegraded":"2024-09-12T18:36:01.001199+0000","last_fullsized":"2024-09-12T18:36:01.001199+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:02.237080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95576,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":903,"num_read_kb":2101,"num_write":776,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.413301+0000","last_change":"2024-09-12T17:10:38.399567+0000","last_active":"2024-09-12T18:33:11.413301+0000","last_peered":"2024-09-12T18:33:11.413301+0000","last_clean":"2024-09-12T18:33:11.413301+0000","last_became_active":"2024-09-12T17:10:38.398862+0000","last_became_peered":"2024-09-12T17:10:38.398862+0000","last_unstale":"2024-09-12T18:33:11.413301+0000","last_undegraded":"2024-09-12T18:33:11.413301+0000","last_fullsized":"2024-09-12T18:33:11.413301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:54.103985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'157","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.787915+0000","last_change":"2024-09-12T17:10:40.771008+0000","last_active":"2024-09-12T18:34:01.787915+0000","last_peered":"2024-09-12T18:34:01.787915+0000","last_clean":"2024-09-12T18:34:01.787915+0000","last_became_active":"2024-09-12T17:10:40.770075+0000","last_became_peered":"2024-09-12T17:10:40.770075+0000","last_unstale":"2024-09-12T18:34:01.787915+0000","last_undegraded":"2024-09-12T18:34:01.787915+0000","last_fullsized":"2024-09-12T18:34:01.787915+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:20.570103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":234,"num_write":361,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'1461","reported_seq":3047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.814470+0000","last_change":"2024-09-12T17:10:32.377189+0000","last_active":"2024-09-12T18:34:01.814470+0000","last_peered":"2024-09-12T18:34:01.814470+0000","last_clean":"2024-09-12T18:34:01.814470+0000","last_became_active":"2024-09-12T17:10:32.376892+0000","last_became_peered":"2024-09-12T17:10:32.376892+0000","last_unstale":"2024-09-12T18:34:01.814470+0000","last_undegraded":"2024-09-12T18:34:01.814470+0000","last_fullsized":"2024-09-12T18:34:01.814470+0000","mapping_epoch":27,"log_start":"268'1400","ondisk_log_start":"268'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":1400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:44.187578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6636,"num_read_kb":5839,"num_write":2046,"num_write_kb":883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'293","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.612383+0000","last_change":"2024-09-12T17:10:30.378429+0000","last_active":"2024-09-12T18:36:01.612383+0000","last_peered":"2024-09-12T18:36:01.612383+0000","last_clean":"2024-09-12T18:36:01.612383+0000","last_became_active":"2024-09-12T17:10:30.378075+0000","last_became_peered":"2024-09-12T17:10:30.378075+0000","last_unstale":"2024-09-12T18:36:01.612383+0000","last_undegraded":"2024-09-12T18:36:01.612383+0000","last_fullsized":"2024-09-12T18:36:01.612383+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:26.384876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5548934,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":394,"num_read_kb":47843,"num_write":917,"num_write_kb":30557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.594090+0000","last_change":"2024-09-12T17:10:34.362259+0000","last_active":"2024-09-12T18:33:56.594090+0000","last_peered":"2024-09-12T18:33:56.594090+0000","last_clean":"2024-09-12T18:33:56.594090+0000","last_became_active":"2024-09-12T17:10:34.361495+0000","last_became_peered":"2024-09-12T17:10:34.361495+0000","last_unstale":"2024-09-12T18:33:56.594090+0000","last_undegraded":"2024-09-12T18:33:56.594090+0000","last_fullsized":"2024-09-12T18:33:56.594090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:28.400359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'338","reported_seq":960,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.142261+0000","last_change":"2024-09-12T17:10:36.399101+0000","last_active":"2024-09-12T18:36:01.142261+0000","last_peered":"2024-09-12T18:36:01.142261+0000","last_clean":"2024-09-12T18:36:01.142261+0000","last_became_active":"2024-09-12T17:10:36.398415+0000","last_became_peered":"2024-09-12T17:10:36.398415+0000","last_unstale":"2024-09-12T18:36:01.142261+0000","last_undegraded":"2024-09-12T18:36:01.142261+0000","last_fullsized":"2024-09-12T18:36:01.142261+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:16.776403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45877,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":580,"num_read_kb":1203,"num_write":474,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.644654+0000","last_change":"2024-09-12T17:10:38.404690+0000","last_active":"2024-09-12T18:33:11.644654+0000","last_peered":"2024-09-12T18:33:11.644654+0000","last_clean":"2024-09-12T18:33:11.644654+0000","last_became_active":"2024-09-12T17:10:38.401047+0000","last_became_peered":"2024-09-12T17:10:38.401047+0000","last_unstale":"2024-09-12T18:33:11.644654+0000","last_undegraded":"2024-09-12T18:33:11.644654+0000","last_fullsized":"2024-09-12T18:33:11.644654+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:40.635802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'196","reported_seq":744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:58.343759+0000","last_change":"2024-09-12T17:10:40.429587+0000","last_active":"2024-09-12T18:33:58.343759+0000","last_peered":"2024-09-12T18:33:58.343759+0000","last_clean":"2024-09-12T18:33:58.343759+0000","last_became_active":"2024-09-12T17:10:40.428841+0000","last_became_peered":"2024-09-12T17:10:40.428841+0000","last_unstale":"2024-09-12T18:33:58.343759+0000","last_undegraded":"2024-09-12T18:33:58.343759+0000","last_fullsized":"2024-09-12T18:33:58.343759+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:22.728668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1669,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":376,"num_read_kb":345,"num_write":581,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'1124","reported_seq":2870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.926010+0000","last_change":"2024-09-12T17:10:32.369642+0000","last_active":"2024-09-12T18:33:59.926010+0000","last_peered":"2024-09-12T18:33:59.926010+0000","last_clean":"2024-09-12T18:33:59.926010+0000","last_became_active":"2024-09-12T17:10:32.369344+0000","last_became_peered":"2024-09-12T17:10:32.369344+0000","last_unstale":"2024-09-12T18:33:59.926010+0000","last_undegraded":"2024-09-12T18:33:59.926010+0000","last_fullsized":"2024-09-12T18:33:59.926010+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:38.641315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5513,"num_read_kb":4854,"num_write":1595,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'340","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.792799+0000","last_change":"2024-09-12T17:11:05.124261+0000","last_active":"2024-09-12T18:36:01.792799+0000","last_peered":"2024-09-12T18:36:01.792799+0000","last_clean":"2024-09-12T18:36:01.792799+0000","last_became_active":"2024-09-12T17:11:05.123283+0000","last_became_peered":"2024-09-12T17:11:05.123283+0000","last_unstale":"2024-09-12T18:36:01.792799+0000","last_undegraded":"2024-09-12T18:36:01.792799+0000","last_fullsized":"2024-09-12T18:36:01.792799+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:41.264064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048670,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":499,"num_read_kb":48133,"num_write":1102,"num_write_kb":35281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"37'5","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:58.750296+0000","last_change":"2024-09-12T17:10:34.352955+0000","last_active":"2024-09-12T18:35:58.750296+0000","last_peered":"2024-09-12T18:35:58.750296+0000","last_clean":"2024-09-12T18:35:58.750296+0000","last_became_active":"2024-09-12T17:10:34.352213+0000","last_became_peered":"2024-09-12T17:10:34.352213+0000","last_unstale":"2024-09-12T18:35:58.750296+0000","last_undegraded":"2024-09-12T18:35:58.750296+0000","last_fullsized":"2024-09-12T18:35:58.750296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:10.177818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'294","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.724781+0000","last_change":"2024-09-12T17:10:36.922284+0000","last_active":"2024-09-12T18:35:21.724781+0000","last_peered":"2024-09-12T18:35:21.724781+0000","last_clean":"2024-09-12T18:35:21.724781+0000","last_became_active":"2024-09-12T17:10:36.921450+0000","last_became_peered":"2024-09-12T17:10:36.921450+0000","last_unstale":"2024-09-12T18:35:21.724781+0000","last_undegraded":"2024-09-12T18:35:21.724781+0000","last_fullsized":"2024-09-12T18:35:21.724781+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:10.318840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48044,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":897,"num_write":360,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642311+0000","last_change":"2024-09-12T17:10:38.396118+0000","last_active":"2024-09-12T18:33:01.642311+0000","last_peered":"2024-09-12T18:33:01.642311+0000","last_clean":"2024-09-12T18:33:01.642311+0000","last_became_active":"2024-09-12T17:10:38.395457+0000","last_became_peered":"2024-09-12T17:10:38.395457+0000","last_unstale":"2024-09-12T18:33:01.642311+0000","last_undegraded":"2024-09-12T18:33:01.642311+0000","last_fullsized":"2024-09-12T18:33:01.642311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:35.393797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'130","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.742743+0000","last_change":"2024-09-12T17:10:40.430012+0000","last_active":"2024-09-12T18:35:21.742743+0000","last_peered":"2024-09-12T18:35:21.742743+0000","last_clean":"2024-09-12T18:35:21.742743+0000","last_became_active":"2024-09-12T17:10:40.429303+0000","last_became_peered":"2024-09-12T17:10:40.429303+0000","last_unstale":"2024-09-12T18:35:21.742743+0000","last_undegraded":"2024-09-12T18:35:21.742743+0000","last_fullsized":"2024-09-12T18:35:21.742743+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:37.352428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":233,"num_read_kb":212,"num_write":334,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'904","reported_seq":2419,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.879000+0000","last_change":"2024-09-12T17:10:32.363317+0000","last_active":"2024-09-12T18:33:10.879000+0000","last_peered":"2024-09-12T18:33:10.879000+0000","last_clean":"2024-09-12T18:33:10.879000+0000","last_became_active":"2024-09-12T17:10:32.362957+0000","last_became_peered":"2024-09-12T17:10:32.362957+0000","last_unstale":"2024-09-12T18:33:10.879000+0000","last_undegraded":"2024-09-12T18:33:10.879000+0000","last_fullsized":"2024-09-12T18:33:10.879000+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":800,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:46.722218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4274,"num_read_kb":3831,"num_write":1263,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'347","reported_seq":978,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.436245+0000","last_change":"2024-09-12T17:10:30.374981+0000","last_active":"2024-09-12T18:36:01.436245+0000","last_peered":"2024-09-12T18:36:01.436245+0000","last_clean":"2024-09-12T18:36:01.436245+0000","last_became_active":"2024-09-12T17:10:30.374618+0000","last_became_peered":"2024-09-12T17:10:30.374618+0000","last_unstale":"2024-09-12T18:36:01.436245+0000","last_undegraded":"2024-09-12T18:36:01.436245+0000","last_fullsized":"2024-09-12T18:36:01.436245+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:21.346521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048936,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":427,"num_read_kb":21889,"num_write":976,"num_write_kb":37331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.643558+0000","last_change":"2024-09-12T17:10:34.362059+0000","last_active":"2024-09-12T18:33:06.643558+0000","last_peered":"2024-09-12T18:33:06.643558+0000","last_clean":"2024-09-12T18:33:06.643558+0000","last_became_active":"2024-09-12T17:10:34.361536+0000","last_became_peered":"2024-09-12T17:10:34.361536+0000","last_unstale":"2024-09-12T18:33:06.643558+0000","last_undegraded":"2024-09-12T18:33:06.643558+0000","last_fullsized":"2024-09-12T18:33:06.643558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:33.573141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'114","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:00.592520+0000","last_change":"2024-09-12T17:10:36.923878+0000","last_active":"2024-09-12T18:33:00.592520+0000","last_peered":"2024-09-12T18:33:00.592520+0000","last_clean":"2024-09-12T18:33:00.592520+0000","last_became_active":"2024-09-12T17:10:36.923087+0000","last_became_peered":"2024-09-12T17:10:36.923087+0000","last_unstale":"2024-09-12T18:33:00.592520+0000","last_undegraded":"2024-09-12T18:33:00.592520+0000","last_fullsized":"2024-09-12T18:33:00.592520+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:34.787955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":134,"num_write":98,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'780","reported_seq":2884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.003745+0000","last_change":"2024-09-12T17:10:38.410583+0000","last_active":"2024-09-12T18:35:59.003745+0000","last_peered":"2024-09-12T18:35:59.003745+0000","last_clean":"2024-09-12T18:35:59.003745+0000","last_became_active":"2024-09-12T17:10:38.407830+0000","last_became_peered":"2024-09-12T17:10:38.407830+0000","last_unstale":"2024-09-12T18:35:59.003745+0000","last_undegraded":"2024-09-12T18:35:59.003745+0000","last_fullsized":"2024-09-12T18:35:59.003745+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:25.369785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'146","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.883725+0000","last_change":"2024-09-12T17:10:40.432466+0000","last_active":"2024-09-12T18:33:59.883725+0000","last_peered":"2024-09-12T18:33:59.883725+0000","last_clean":"2024-09-12T18:33:59.883725+0000","last_became_active":"2024-09-12T17:10:40.431693+0000","last_became_peered":"2024-09-12T17:10:40.431693+0000","last_unstale":"2024-09-12T18:33:59.883725+0000","last_undegraded":"2024-09-12T18:33:59.883725+0000","last_fullsized":"2024-09-12T18:33:59.883725+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:18.379860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":232,"num_write":366,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'807","reported_seq":2326,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.812602+0000","last_change":"2024-09-12T17:10:32.370640+0000","last_active":"2024-09-12T18:34:01.812602+0000","last_peered":"2024-09-12T18:34:01.812602+0000","last_clean":"2024-09-12T18:34:01.812602+0000","last_became_active":"2024-09-12T17:10:32.369824+0000","last_became_peered":"2024-09-12T17:10:32.369824+0000","last_unstale":"2024-09-12T18:34:01.812602+0000","last_undegraded":"2024-09-12T18:34:01.812602+0000","last_fullsized":"2024-09-12T18:34:01.812602+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:05.486073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3803,"num_read_kb":3411,"num_write":1089,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'360","reported_seq":1165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.377203+0000","last_change":"2024-09-12T17:10:30.361138+0000","last_active":"2024-09-12T18:36:01.377203+0000","last_peered":"2024-09-12T18:36:01.377203+0000","last_clean":"2024-09-12T18:36:01.377203+0000","last_became_active":"2024-09-12T17:10:30.357942+0000","last_became_peered":"2024-09-12T17:10:30.357942+0000","last_unstale":"2024-09-12T18:36:01.377203+0000","last_undegraded":"2024-09-12T18:36:01.377203+0000","last_fullsized":"2024-09-12T18:36:01.377203+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:46.703023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1313177,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":938,"num_read_kb":26001,"num_write":1270,"num_write_kb":43743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.404767+0000","last_change":"2024-09-12T17:10:34.362432+0000","last_active":"2024-09-12T18:33:06.404767+0000","last_peered":"2024-09-12T18:33:06.404767+0000","last_clean":"2024-09-12T18:33:06.404767+0000","last_became_active":"2024-09-12T17:10:34.361686+0000","last_became_peered":"2024-09-12T17:10:34.361686+0000","last_unstale":"2024-09-12T18:33:06.404767+0000","last_undegraded":"2024-09-12T18:33:06.404767+0000","last_fullsized":"2024-09-12T18:33:06.404767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:20.692641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'367","reported_seq":989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.360473+0000","last_change":"2024-09-12T17:10:36.392913+0000","last_active":"2024-09-12T18:36:00.360473+0000","last_peered":"2024-09-12T18:36:00.360473+0000","last_clean":"2024-09-12T18:36:00.360473+0000","last_became_active":"2024-09-12T17:10:36.392089+0000","last_became_peered":"2024-09-12T17:10:36.392089+0000","last_unstale":"2024-09-12T18:36:00.360473+0000","last_undegraded":"2024-09-12T18:36:00.360473+0000","last_fullsized":"2024-09-12T18:36:00.360473+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:00.724692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47317,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":601,"num_read_kb":1312,"num_write":482,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411609+0000","last_change":"2024-09-12T17:10:38.411770+0000","last_active":"2024-09-12T18:32:51.411609+0000","last_peered":"2024-09-12T18:32:51.411609+0000","last_clean":"2024-09-12T18:32:51.411609+0000","last_became_active":"2024-09-12T17:10:38.411191+0000","last_became_peered":"2024-09-12T17:10:38.411191+0000","last_unstale":"2024-09-12T18:32:51.411609+0000","last_undegraded":"2024-09-12T18:32:51.411609+0000","last_fullsized":"2024-09-12T18:32:51.411609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:29.140092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'100","reported_seq":612,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.845108+0000","last_change":"2024-09-12T17:10:40.437458+0000","last_active":"2024-09-12T18:33:55.845108+0000","last_peered":"2024-09-12T18:33:55.845108+0000","last_clean":"2024-09-12T18:33:55.845108+0000","last_became_active":"2024-09-12T17:10:40.436748+0000","last_became_peered":"2024-09-12T17:10:40.436748+0000","last_unstale":"2024-09-12T18:33:55.845108+0000","last_undegraded":"2024-09-12T18:33:55.845108+0000","last_fullsized":"2024-09-12T18:33:55.845108+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:53.015779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":136,"num_write":243,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'577","reported_seq":2227,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.808541+0000","last_change":"2024-09-12T17:10:32.371759+0000","last_active":"2024-09-12T18:34:01.808541+0000","last_peered":"2024-09-12T18:34:01.808541+0000","last_clean":"2024-09-12T18:34:01.808541+0000","last_became_active":"2024-09-12T17:10:32.370173+0000","last_became_peered":"2024-09-12T17:10:32.370173+0000","last_unstale":"2024-09-12T18:34:01.808541+0000","last_undegraded":"2024-09-12T18:34:01.808541+0000","last_fullsized":"2024-09-12T18:34:01.808541+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:20.201508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2773,"num_read_kb":2563,"num_write":696,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'350","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.312015+0000","last_change":"2024-09-12T17:10:30.358739+0000","last_active":"2024-09-12T18:36:01.312015+0000","last_peered":"2024-09-12T18:36:01.312015+0000","last_clean":"2024-09-12T18:36:01.312015+0000","last_became_active":"2024-09-12T17:10:30.355723+0000","last_became_peered":"2024-09-12T17:10:30.355723+0000","last_unstale":"2024-09-12T18:36:01.312015+0000","last_undegraded":"2024-09-12T18:36:01.312015+0000","last_fullsized":"2024-09-12T18:36:01.312015+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:21.953441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1373397,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":471,"num_read_kb":22337,"num_write":1127,"num_write_kb":39083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.412100+0000","last_change":"2024-09-12T17:10:34.364113+0000","last_active":"2024-09-12T18:33:06.412100+0000","last_peered":"2024-09-12T18:33:06.412100+0000","last_clean":"2024-09-12T18:33:06.412100+0000","last_became_active":"2024-09-12T17:10:34.363439+0000","last_became_peered":"2024-09-12T17:10:34.363439+0000","last_unstale":"2024-09-12T18:33:06.412100+0000","last_undegraded":"2024-09-12T18:33:06.412100+0000","last_fullsized":"2024-09-12T18:33:06.412100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:02.164079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'289","reported_seq":889,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.452354+0000","last_change":"2024-09-12T17:10:36.397893+0000","last_active":"2024-09-12T18:36:00.452354+0000","last_peered":"2024-09-12T18:36:00.452354+0000","last_clean":"2024-09-12T18:36:00.452354+0000","last_became_active":"2024-09-12T17:10:36.397148+0000","last_became_peered":"2024-09-12T17:10:36.397148+0000","last_unstale":"2024-09-12T18:36:00.452354+0000","last_undegraded":"2024-09-12T18:36:00.452354+0000","last_fullsized":"2024-09-12T18:36:00.452354+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:04.236115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":1130,"num_write":384,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.584512+0000","last_change":"2024-09-12T17:10:38.407655+0000","last_active":"2024-09-12T18:33:11.584512+0000","last_peered":"2024-09-12T18:33:11.584512+0000","last_clean":"2024-09-12T18:33:11.584512+0000","last_became_active":"2024-09-12T17:10:38.406892+0000","last_became_peered":"2024-09-12T17:10:38.406892+0000","last_unstale":"2024-09-12T18:33:11.584512+0000","last_undegraded":"2024-09-12T18:33:11.584512+0000","last_fullsized":"2024-09-12T18:33:11.584512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:15.244866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'157","reported_seq":692,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:19.439905+0000","last_change":"2024-09-12T17:10:40.770908+0000","last_active":"2024-09-12T18:35:19.439905+0000","last_peered":"2024-09-12T18:35:19.439905+0000","last_clean":"2024-09-12T18:35:19.439905+0000","last_became_active":"2024-09-12T17:10:40.770159+0000","last_became_peered":"2024-09-12T17:10:40.770159+0000","last_unstale":"2024-09-12T18:35:19.439905+0000","last_undegraded":"2024-09-12T18:35:19.439905+0000","last_fullsized":"2024-09-12T18:35:19.439905+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:17.022501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":169,"num_write":336,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'1195","reported_seq":2722,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.926177+0000","last_change":"2024-09-12T17:10:32.358404+0000","last_active":"2024-09-12T18:33:59.926177+0000","last_peered":"2024-09-12T18:33:59.926177+0000","last_clean":"2024-09-12T18:33:59.926177+0000","last_became_active":"2024-09-12T17:10:32.357738+0000","last_became_peered":"2024-09-12T17:10:32.357738+0000","last_unstale":"2024-09-12T18:33:59.926177+0000","last_undegraded":"2024-09-12T18:33:59.926177+0000","last_fullsized":"2024-09-12T18:33:59.926177+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":1100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:54.644317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5279,"num_read_kb":4649,"num_write":1626,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'273","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.404017+0000","last_change":"2024-09-12T17:10:30.402255+0000","last_active":"2024-09-12T18:35:59.404017+0000","last_peered":"2024-09-12T18:35:59.404017+0000","last_clean":"2024-09-12T18:35:59.404017+0000","last_became_active":"2024-09-12T17:10:30.401941+0000","last_became_peered":"2024-09-12T17:10:30.401941+0000","last_unstale":"2024-09-12T18:35:59.404017+0000","last_undegraded":"2024-09-12T18:35:59.404017+0000","last_fullsized":"2024-09-12T18:35:59.404017+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:55.543009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22284010,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":402,"num_read_kb":28040,"num_write":923,"num_write_kb":46600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:45.588684+0000","last_change":"2024-09-12T17:10:34.358478+0000","last_active":"2024-09-12T18:32:45.588684+0000","last_peered":"2024-09-12T18:32:45.588684+0000","last_clean":"2024-09-12T18:32:45.588684+0000","last_became_active":"2024-09-12T17:10:34.357688+0000","last_became_peered":"2024-09-12T17:10:34.357688+0000","last_unstale":"2024-09-12T18:32:45.588684+0000","last_undegraded":"2024-09-12T18:32:45.588684+0000","last_fullsized":"2024-09-12T18:32:45.588684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:01.686198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'245","reported_seq":820,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:39.444434+0000","last_change":"2024-09-12T17:10:36.400271+0000","last_active":"2024-09-12T18:35:39.444434+0000","last_peered":"2024-09-12T18:35:39.444434+0000","last_clean":"2024-09-12T18:35:39.444434+0000","last_became_active":"2024-09-12T17:10:36.398639+0000","last_became_peered":"2024-09-12T17:10:36.398639+0000","last_unstale":"2024-09-12T18:35:39.444434+0000","last_undegraded":"2024-09-12T18:35:39.444434+0000","last_fullsized":"2024-09-12T18:35:39.444434+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:36.210475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55585,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":394,"num_read_kb":897,"num_write":324,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.595054+0000","last_change":"2024-09-12T17:10:38.401463+0000","last_active":"2024-09-12T18:33:10.595054+0000","last_peered":"2024-09-12T18:33:10.595054+0000","last_clean":"2024-09-12T18:33:10.595054+0000","last_became_active":"2024-09-12T17:10:38.400703+0000","last_became_peered":"2024-09-12T17:10:38.400703+0000","last_unstale":"2024-09-12T18:33:10.595054+0000","last_undegraded":"2024-09-12T18:33:10.595054+0000","last_fullsized":"2024-09-12T18:33:10.595054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:10.103057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'171","reported_seq":1654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.714827+0000","last_change":"2024-09-12T17:10:40.435581+0000","last_active":"2024-09-12T18:33:55.714827+0000","last_peered":"2024-09-12T18:33:55.714827+0000","last_clean":"2024-09-12T18:33:55.714827+0000","last_became_active":"2024-09-12T17:10:40.434195+0000","last_became_peered":"2024-09-12T17:10:40.434195+0000","last_unstale":"2024-09-12T18:33:55.714827+0000","last_undegraded":"2024-09-12T18:33:55.714827+0000","last_fullsized":"2024-09-12T18:33:55.714827+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:34.304171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1233,"num_read_kb":1222,"num_write":385,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'393","reported_seq":1910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.525932+0000","last_change":"2024-09-12T17:10:32.362342+0000","last_active":"2024-09-12T18:35:20.525932+0000","last_peered":"2024-09-12T18:35:20.525932+0000","last_clean":"2024-09-12T18:35:20.525932+0000","last_became_active":"2024-09-12T17:10:32.361716+0000","last_became_peered":"2024-09-12T17:10:32.361716+0000","last_unstale":"2024-09-12T18:35:20.525932+0000","last_undegraded":"2024-09-12T18:35:20.525932+0000","last_fullsized":"2024-09-12T18:35:20.525932+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:33.025425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2161,"num_read_kb":2069,"num_write":462,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'291","reported_seq":952,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.371686+0000","last_change":"2024-09-12T17:10:30.388057+0000","last_active":"2024-09-12T18:36:01.371686+0000","last_peered":"2024-09-12T18:36:01.371686+0000","last_clean":"2024-09-12T18:36:01.371686+0000","last_became_active":"2024-09-12T17:10:30.387788+0000","last_became_peered":"2024-09-12T17:10:30.387788+0000","last_unstale":"2024-09-12T18:36:01.371686+0000","last_undegraded":"2024-09-12T18:36:01.371686+0000","last_fullsized":"2024-09-12T18:36:01.371686+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:57.145079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10777779,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":447,"num_read_kb":40433,"num_write":1006,"num_write_kb":46438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.643399+0000","last_change":"2024-09-12T17:10:34.357090+0000","last_active":"2024-09-12T18:33:06.643399+0000","last_peered":"2024-09-12T18:33:06.643399+0000","last_clean":"2024-09-12T18:33:06.643399+0000","last_became_active":"2024-09-12T17:10:34.356290+0000","last_became_peered":"2024-09-12T17:10:34.356290+0000","last_unstale":"2024-09-12T18:33:06.643399+0000","last_undegraded":"2024-09-12T18:33:06.643399+0000","last_fullsized":"2024-09-12T18:33:06.643399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:58.022339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'309","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.841400+0000","last_change":"2024-09-12T17:10:36.392771+0000","last_active":"2024-09-12T18:35:59.841400+0000","last_peered":"2024-09-12T18:35:59.841400+0000","last_clean":"2024-09-12T18:35:59.841400+0000","last_became_active":"2024-09-12T17:10:36.391455+0000","last_became_peered":"2024-09-12T17:10:36.391455+0000","last_unstale":"2024-09-12T18:35:59.841400+0000","last_undegraded":"2024-09-12T18:35:59.841400+0000","last_fullsized":"2024-09-12T18:35:59.841400+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:23.461018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44113,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":1099,"num_write":400,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.415277+0000","last_change":"2024-09-12T17:10:38.414101+0000","last_active":"2024-09-12T18:33:11.415277+0000","last_peered":"2024-09-12T18:33:11.415277+0000","last_clean":"2024-09-12T18:33:11.415277+0000","last_became_active":"2024-09-12T17:10:38.413592+0000","last_became_peered":"2024-09-12T17:10:38.413592+0000","last_unstale":"2024-09-12T18:33:11.415277+0000","last_undegraded":"2024-09-12T18:33:11.415277+0000","last_fullsized":"2024-09-12T18:33:11.415277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:44.432349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'148","reported_seq":661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.433937+0000","last_change":"2024-09-12T17:10:40.432069+0000","last_active":"2024-09-12T18:35:20.433937+0000","last_peered":"2024-09-12T18:35:20.433937+0000","last_clean":"2024-09-12T18:35:20.433937+0000","last_became_active":"2024-09-12T17:10:40.425063+0000","last_became_peered":"2024-09-12T17:10:40.425063+0000","last_unstale":"2024-09-12T18:35:20.433937+0000","last_undegraded":"2024-09-12T18:35:20.433937+0000","last_fullsized":"2024-09-12T18:35:20.433937+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:02.872786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":181,"num_read_kb":173,"num_write":358,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'373","reported_seq":1793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.509133+0000","last_change":"2024-09-12T17:10:32.365153+0000","last_active":"2024-09-12T18:33:01.509133+0000","last_peered":"2024-09-12T18:33:01.509133+0000","last_clean":"2024-09-12T18:33:01.509133+0000","last_became_active":"2024-09-12T17:10:32.361445+0000","last_became_peered":"2024-09-12T17:10:32.361445+0000","last_unstale":"2024-09-12T18:33:01.509133+0000","last_undegraded":"2024-09-12T18:33:01.509133+0000","last_fullsized":"2024-09-12T18:33:01.509133+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:31.834987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1921,"num_read_kb":1829,"num_write":410,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'362","reported_seq":1005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.775636+0000","last_change":"2024-09-12T17:11:04.373385+0000","last_active":"2024-09-12T18:36:01.775636+0000","last_peered":"2024-09-12T18:36:01.775636+0000","last_clean":"2024-09-12T18:36:01.775636+0000","last_became_active":"2024-09-12T17:11:04.372622+0000","last_became_peered":"2024-09-12T17:11:04.372622+0000","last_unstale":"2024-09-12T18:36:01.775636+0000","last_undegraded":"2024-09-12T18:36:01.775636+0000","last_fullsized":"2024-09-12T18:36:01.775636+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:19.929941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650858,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":528,"num_read_kb":34257,"num_write":1084,"num_write_kb":35279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'377","reported_seq":1894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.641114+0000","last_change":"2024-09-12T17:10:32.364419+0000","last_active":"2024-09-12T18:32:56.641114+0000","last_peered":"2024-09-12T18:32:56.641114+0000","last_clean":"2024-09-12T18:32:56.641114+0000","last_became_active":"2024-09-12T17:10:32.364080+0000","last_became_peered":"2024-09-12T17:10:32.364080+0000","last_unstale":"2024-09-12T18:32:56.641114+0000","last_undegraded":"2024-09-12T18:32:56.641114+0000","last_fullsized":"2024-09-12T18:32:56.641114+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:41.911462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2111,"num_read_kb":2018,"num_write":410,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'349","reported_seq":1124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.771216+0000","last_change":"2024-09-12T17:10:30.394272+0000","last_active":"2024-09-12T18:36:01.771216+0000","last_peered":"2024-09-12T18:36:01.771216+0000","last_clean":"2024-09-12T18:36:01.771216+0000","last_became_active":"2024-09-12T17:10:30.393924+0000","last_became_peered":"2024-09-12T17:10:30.393924+0000","last_unstale":"2024-09-12T18:36:01.771216+0000","last_undegraded":"2024-09-12T18:36:01.771216+0000","last_fullsized":"2024-09-12T18:36:01.771216+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:07.405582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4748477,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":727,"num_read_kb":31225,"num_write":1139,"num_write_kb":33307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'812","reported_seq":2200,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.879138+0000","last_change":"2024-09-12T17:10:32.382803+0000","last_active":"2024-09-12T18:33:10.879138+0000","last_peered":"2024-09-12T18:33:10.879138+0000","last_clean":"2024-09-12T18:33:10.879138+0000","last_became_active":"2024-09-12T17:10:32.382110+0000","last_became_peered":"2024-09-12T17:10:32.382110+0000","last_unstale":"2024-09-12T18:33:10.879138+0000","last_undegraded":"2024-09-12T18:33:10.879138+0000","last_fullsized":"2024-09-12T18:33:10.879138+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:57.022415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3583,"num_read_kb":3191,"num_write":1046,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'348","reported_seq":1024,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.380081+0000","last_change":"2024-09-12T17:10:30.359981+0000","last_active":"2024-09-12T18:36:01.380081+0000","last_peered":"2024-09-12T18:36:01.380081+0000","last_clean":"2024-09-12T18:36:01.380081+0000","last_became_active":"2024-09-12T17:10:30.352353+0000","last_became_peered":"2024-09-12T17:10:30.352353+0000","last_unstale":"2024-09-12T18:36:01.380081+0000","last_undegraded":"2024-09-12T18:36:01.380081+0000","last_fullsized":"2024-09-12T18:36:01.380081+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:03.651567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267400,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":533,"num_read_kb":44546,"num_write":1178,"num_write_kb":40457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'442","reported_seq":1987,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.641022+0000","last_change":"2024-09-12T17:10:32.379036+0000","last_active":"2024-09-12T18:32:56.641022+0000","last_peered":"2024-09-12T18:32:56.641022+0000","last_clean":"2024-09-12T18:32:56.641022+0000","last_became_active":"2024-09-12T17:10:32.378659+0000","last_became_peered":"2024-09-12T17:10:32.378659+0000","last_unstale":"2024-09-12T18:32:56.641022+0000","last_undegraded":"2024-09-12T18:32:56.641022+0000","last_fullsized":"2024-09-12T18:32:56.641022+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:58.217683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2290,"num_read_kb":2161,"num_write":510,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'361","reported_seq":1024,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.361082+0000","last_change":"2024-09-12T17:11:04.869478+0000","last_active":"2024-09-12T18:36:01.361082+0000","last_peered":"2024-09-12T18:36:01.361082+0000","last_clean":"2024-09-12T18:36:01.361082+0000","last_became_active":"2024-09-12T17:11:04.868302+0000","last_became_peered":"2024-09-12T17:11:04.868302+0000","last_unstale":"2024-09-12T18:36:01.361082+0000","last_undegraded":"2024-09-12T18:36:01.361082+0000","last_fullsized":"2024-09-12T18:36:01.361082+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:22.742268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388780,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":475,"num_read_kb":35312,"num_write":1197,"num_write_kb":68294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'520","reported_seq":2242,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.460046+0000","last_change":"2024-09-12T17:10:32.383452+0000","last_active":"2024-09-12T18:35:20.460046+0000","last_peered":"2024-09-12T18:35:20.460046+0000","last_clean":"2024-09-12T18:35:20.460046+0000","last_became_active":"2024-09-12T17:10:32.382841+0000","last_became_peered":"2024-09-12T17:10:32.382841+0000","last_unstale":"2024-09-12T18:35:20.460046+0000","last_undegraded":"2024-09-12T18:35:20.460046+0000","last_fullsized":"2024-09-12T18:35:20.460046+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:08.070690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2888,"num_read_kb":2690,"num_write":642,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'266","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.333977+0000","last_change":"2024-09-12T17:11:04.373500+0000","last_active":"2024-09-12T18:35:59.333977+0000","last_peered":"2024-09-12T18:35:59.333977+0000","last_clean":"2024-09-12T18:35:59.333977+0000","last_became_active":"2024-09-12T17:11:04.373103+0000","last_became_peered":"2024-09-12T17:11:04.373103+0000","last_unstale":"2024-09-12T18:35:59.333977+0000","last_undegraded":"2024-09-12T18:35:59.333977+0000","last_fullsized":"2024-09-12T18:35:59.333977+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:02.210085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437830,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":423,"num_read_kb":30230,"num_write":1002,"num_write_kb":31529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'444","reported_seq":2070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605323+0000","last_change":"2024-09-12T17:10:32.371035+0000","last_active":"2024-09-12T18:33:55.605323+0000","last_peered":"2024-09-12T18:33:55.605323+0000","last_clean":"2024-09-12T18:33:55.605323+0000","last_became_active":"2024-09-12T17:10:32.370112+0000","last_became_peered":"2024-09-12T17:10:32.370112+0000","last_unstale":"2024-09-12T18:33:55.605323+0000","last_undegraded":"2024-09-12T18:33:55.605323+0000","last_fullsized":"2024-09-12T18:33:55.605323+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:03.389218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2345,"num_read_kb":2230,"num_write":501,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'365","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.634811+0000","last_change":"2024-09-12T17:10:30.349073+0000","last_active":"2024-09-12T18:36:01.634811+0000","last_peered":"2024-09-12T18:36:01.634811+0000","last_clean":"2024-09-12T18:36:01.634811+0000","last_became_active":"2024-09-12T17:10:30.348702+0000","last_became_peered":"2024-09-12T17:10:30.348702+0000","last_unstale":"2024-09-12T18:36:01.634811+0000","last_undegraded":"2024-09-12T18:36:01.634811+0000","last_fullsized":"2024-09-12T18:36:01.634811+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:53.542082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1359250,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":546,"num_read_kb":10243,"num_write":1248,"num_write_kb":63527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'738","reported_seq":2624,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:54.421771+0000","last_change":"2024-09-12T17:10:32.371291+0000","last_active":"2024-09-12T18:33:54.421771+0000","last_peered":"2024-09-12T18:33:54.421771+0000","last_clean":"2024-09-12T18:33:54.421771+0000","last_became_active":"2024-09-12T17:10:32.371017+0000","last_became_peered":"2024-09-12T17:10:32.371017+0000","last_unstale":"2024-09-12T18:33:54.421771+0000","last_undegraded":"2024-09-12T18:33:54.421771+0000","last_fullsized":"2024-09-12T18:33:54.421771+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:50.198581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4018,"num_read_kb":3683,"num_write":976,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'326","reported_seq":983,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.574564+0000","last_change":"2024-09-12T17:10:30.400783+0000","last_active":"2024-09-12T18:36:01.574564+0000","last_peered":"2024-09-12T18:36:01.574564+0000","last_clean":"2024-09-12T18:36:01.574564+0000","last_became_active":"2024-09-12T17:10:30.396958+0000","last_became_peered":"2024-09-12T17:10:30.396958+0000","last_unstale":"2024-09-12T18:36:01.574564+0000","last_undegraded":"2024-09-12T18:36:01.574564+0000","last_fullsized":"2024-09-12T18:36:01.574564+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:01.387221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11002211,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":476,"num_read_kb":23680,"num_write":1020,"num_write_kb":41122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'720","reported_seq":2418,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.593833+0000","last_change":"2024-09-12T17:10:32.348966+0000","last_active":"2024-09-12T18:33:56.593833+0000","last_peered":"2024-09-12T18:33:56.593833+0000","last_clean":"2024-09-12T18:33:56.593833+0000","last_became_active":"2024-09-12T17:10:32.348200+0000","last_became_peered":"2024-09-12T17:10:32.348200+0000","last_unstale":"2024-09-12T18:33:56.593833+0000","last_undegraded":"2024-09-12T18:33:56.593833+0000","last_fullsized":"2024-09-12T18:33:56.593833+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":700,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:53.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3587,"num_read_kb":3235,"num_write":983,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'322","reported_seq":1018,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.412111+0000","last_change":"2024-09-12T17:10:30.370508+0000","last_active":"2024-09-12T18:35:59.412111+0000","last_peered":"2024-09-12T18:35:59.412111+0000","last_clean":"2024-09-12T18:35:59.412111+0000","last_became_active":"2024-09-12T17:10:30.370015+0000","last_became_peered":"2024-09-12T17:10:30.370015+0000","last_unstale":"2024-09-12T18:35:59.412111+0000","last_undegraded":"2024-09-12T18:35:59.412111+0000","last_fullsized":"2024-09-12T18:35:59.412111+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:13.056343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16182623,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":490,"num_read_kb":40384,"num_write":1096,"num_write_kb":51606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'836","reported_seq":2470,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.531341+0000","last_change":"2024-09-12T17:10:32.350274+0000","last_active":"2024-09-12T18:35:20.531341+0000","last_peered":"2024-09-12T18:35:20.531341+0000","last_clean":"2024-09-12T18:35:20.531341+0000","last_became_active":"2024-09-12T17:10:32.348842+0000","last_became_peered":"2024-09-12T17:10:32.348842+0000","last_unstale":"2024-09-12T18:35:20.531341+0000","last_undegraded":"2024-09-12T18:35:20.531341+0000","last_fullsized":"2024-09-12T18:35:20.531341+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:40.714584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4030,"num_read_kb":3642,"num_write":1104,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'301","reported_seq":953,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.321298+0000","last_change":"2024-09-12T17:10:30.351530+0000","last_active":"2024-09-12T18:36:01.321298+0000","last_peered":"2024-09-12T18:36:01.321298+0000","last_clean":"2024-09-12T18:36:01.321298+0000","last_became_active":"2024-09-12T17:10:30.349523+0000","last_became_peered":"2024-09-12T17:10:30.349523+0000","last_unstale":"2024-09-12T18:36:01.321298+0000","last_undegraded":"2024-09-12T18:36:01.321298+0000","last_fullsized":"2024-09-12T18:36:01.321298+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:13.854677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456724,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":446,"num_read_kb":103976,"num_write":979,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'519","reported_seq":2350,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.627374+0000","last_change":"2024-09-12T17:10:32.363610+0000","last_active":"2024-09-12T18:33:18.627374+0000","last_peered":"2024-09-12T18:33:18.627374+0000","last_clean":"2024-09-12T18:33:18.627374+0000","last_became_active":"2024-09-12T17:10:32.362881+0000","last_became_peered":"2024-09-12T17:10:32.362881+0000","last_unstale":"2024-09-12T18:33:18.627374+0000","last_undegraded":"2024-09-12T18:33:18.627374+0000","last_fullsized":"2024-09-12T18:33:18.627374+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:27.711767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2930,"num_read_kb":2778,"num_write":610,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'313","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.284645+0000","last_change":"2024-09-12T17:10:30.379084+0000","last_active":"2024-09-12T18:35:59.284645+0000","last_peered":"2024-09-12T18:35:59.284645+0000","last_clean":"2024-09-12T18:35:59.284645+0000","last_became_active":"2024-09-12T17:10:30.378766+0000","last_became_peered":"2024-09-12T17:10:30.378766+0000","last_unstale":"2024-09-12T18:35:59.284645+0000","last_undegraded":"2024-09-12T18:35:59.284645+0000","last_fullsized":"2024-09-12T18:35:59.284645+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:25.386692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11833783,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":550,"num_read_kb":26410,"num_write":1159,"num_write_kb":29487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'523","reported_seq":2172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.554813+0000","last_change":"2024-09-12T17:10:32.342457+0000","last_active":"2024-09-12T18:32:48.554813+0000","last_peered":"2024-09-12T18:32:48.554813+0000","last_clean":"2024-09-12T18:32:48.554813+0000","last_became_active":"2024-09-12T17:10:32.341480+0000","last_became_peered":"2024-09-12T17:10:32.341480+0000","last_unstale":"2024-09-12T18:32:48.554813+0000","last_undegraded":"2024-09-12T18:32:48.554813+0000","last_fullsized":"2024-09-12T18:32:48.554813+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:37.744373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2856,"num_read_kb":2663,"num_write":671,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'342","reported_seq":1092,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.449917+0000","last_change":"2024-09-12T17:10:30.405089+0000","last_active":"2024-09-12T18:36:01.449917+0000","last_peered":"2024-09-12T18:36:01.449917+0000","last_clean":"2024-09-12T18:36:01.449917+0000","last_became_active":"2024-09-12T17:10:30.404567+0000","last_became_peered":"2024-09-12T17:10:30.404567+0000","last_unstale":"2024-09-12T18:36:01.449917+0000","last_undegraded":"2024-09-12T18:36:01.449917+0000","last_fullsized":"2024-09-12T18:36:01.449917+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:28.951703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8415880,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":782,"num_read_kb":46886,"num_write":1076,"num_write_kb":42596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'378","reported_seq":1776,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.736954+0000","last_change":"2024-09-12T17:10:32.371681+0000","last_active":"2024-09-12T18:34:01.736954+0000","last_peered":"2024-09-12T18:34:01.736954+0000","last_clean":"2024-09-12T18:34:01.736954+0000","last_became_active":"2024-09-12T17:10:32.370799+0000","last_became_peered":"2024-09-12T17:10:32.370799+0000","last_unstale":"2024-09-12T18:34:01.736954+0000","last_undegraded":"2024-09-12T18:34:01.736954+0000","last_fullsized":"2024-09-12T18:34:01.736954+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:01.601445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2049,"num_read_kb":1938,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'317","reported_seq":947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.417354+0000","last_change":"2024-09-12T17:10:30.375100+0000","last_active":"2024-09-12T18:36:01.417354+0000","last_peered":"2024-09-12T18:36:01.417354+0000","last_clean":"2024-09-12T18:36:01.417354+0000","last_became_active":"2024-09-12T17:10:30.374689+0000","last_became_peered":"2024-09-12T17:10:30.374689+0000","last_unstale":"2024-09-12T18:36:01.417354+0000","last_undegraded":"2024-09-12T18:36:01.417354+0000","last_fullsized":"2024-09-12T18:36:01.417354+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:34.230883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8883016,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":400,"num_read_kb":28127,"num_write":1060,"num_write_kb":52007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1583","reported_seq":3062,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.884976+0000","last_change":"2024-09-12T17:10:32.385251+0000","last_active":"2024-09-12T18:33:10.884976+0000","last_peered":"2024-09-12T18:33:10.884976+0000","last_clean":"2024-09-12T18:33:10.884976+0000","last_became_active":"2024-09-12T17:10:32.384842+0000","last_became_peered":"2024-09-12T17:10:32.384842+0000","last_unstale":"2024-09-12T18:33:10.884976+0000","last_undegraded":"2024-09-12T18:33:10.884976+0000","last_fullsized":"2024-09-12T18:33:10.884976+0000","mapping_epoch":27,"log_start":"268'1500","ondisk_log_start":"268'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":1500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:41.827736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6992,"num_read_kb":6083,"num_write":2272,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'478","reported_seq":1289,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.615796+0000","last_change":"2024-09-12T17:12:05.373752+0000","last_active":"2024-09-12T18:36:01.615796+0000","last_peered":"2024-09-12T18:36:01.615796+0000","last_clean":"2024-09-12T18:36:01.615796+0000","last_became_active":"2024-09-12T17:12:05.372879+0000","last_became_peered":"2024-09-12T17:12:05.372879+0000","last_unstale":"2024-09-12T18:36:01.615796+0000","last_undegraded":"2024-09-12T18:36:01.615796+0000","last_fullsized":"2024-09-12T18:36:01.615796+0000","mapping_epoch":40,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:28.746471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048770,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":942,"num_read_kb":72647,"num_write":1663,"num_write_kb":47468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,0],"acting":[6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'1142","reported_seq":2648,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:23.683290+0000","last_change":"2024-09-12T17:10:32.361735+0000","last_active":"2024-09-12T18:32:23.683290+0000","last_peered":"2024-09-12T18:32:23.683290+0000","last_clean":"2024-09-12T18:32:23.683290+0000","last_became_active":"2024-09-12T17:10:32.361416+0000","last_became_peered":"2024-09-12T17:10:32.361416+0000","last_unstale":"2024-09-12T18:32:23.683290+0000","last_undegraded":"2024-09-12T18:32:23.683290+0000","last_fullsized":"2024-09-12T18:32:23.683290+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:10.998239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5102,"num_read_kb":4502,"num_write":1588,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'417","reported_seq":1210,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.372485+0000","last_change":"2024-09-12T17:10:30.405641+0000","last_active":"2024-09-12T18:36:01.372485+0000","last_peered":"2024-09-12T18:36:01.372485+0000","last_clean":"2024-09-12T18:36:01.372485+0000","last_became_active":"2024-09-12T17:10:30.404403+0000","last_became_peered":"2024-09-12T17:10:30.404403+0000","last_unstale":"2024-09-12T18:36:01.372485+0000","last_undegraded":"2024-09-12T18:36:01.372485+0000","last_fullsized":"2024-09-12T18:36:01.372485+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:16.546068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":762,"num_read_kb":38616,"num_write":1261,"num_write_kb":36952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'389","reported_seq":1945,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.441613+0000","last_change":"2024-09-12T17:10:32.353298+0000","last_active":"2024-09-12T18:35:20.441613+0000","last_peered":"2024-09-12T18:35:20.441613+0000","last_clean":"2024-09-12T18:35:20.441613+0000","last_became_active":"2024-09-12T17:10:32.352916+0000","last_became_peered":"2024-09-12T17:10:32.352916+0000","last_unstale":"2024-09-12T18:35:20.441613+0000","last_undegraded":"2024-09-12T18:35:20.441613+0000","last_fullsized":"2024-09-12T18:35:20.441613+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:14.122659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2283,"num_read_kb":2176,"num_write":460,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'342","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.819988+0000","last_change":"2024-09-12T17:10:30.402433+0000","last_active":"2024-09-12T18:36:01.819988+0000","last_peered":"2024-09-12T18:36:01.819988+0000","last_clean":"2024-09-12T18:36:01.819988+0000","last_became_active":"2024-09-12T17:10:30.402024+0000","last_became_peered":"2024-09-12T17:10:30.402024+0000","last_unstale":"2024-09-12T18:36:01.819988+0000","last_undegraded":"2024-09-12T18:36:01.819988+0000","last_fullsized":"2024-09-12T18:36:01.819988+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:43.146846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048618,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":453,"num_read_kb":33472,"num_write":1005,"num_write_kb":44244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'828","reported_seq":2396,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.408504+0000","last_change":"2024-09-12T17:10:32.376676+0000","last_active":"2024-09-12T18:33:21.408504+0000","last_peered":"2024-09-12T18:33:21.408504+0000","last_clean":"2024-09-12T18:33:21.408504+0000","last_became_active":"2024-09-12T17:10:32.375891+0000","last_became_peered":"2024-09-12T17:10:32.375891+0000","last_unstale":"2024-09-12T18:33:21.408504+0000","last_undegraded":"2024-09-12T18:33:21.408504+0000","last_fullsized":"2024-09-12T18:33:21.408504+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:45.205202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3808,"num_read_kb":3437,"num_write":1089,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'390","reported_seq":1112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.335814+0000","last_change":"2024-09-12T17:10:30.379099+0000","last_active":"2024-09-12T18:36:01.335814+0000","last_peered":"2024-09-12T18:36:01.335814+0000","last_clean":"2024-09-12T18:36:01.335814+0000","last_became_active":"2024-09-12T17:10:30.378109+0000","last_became_peered":"2024-09-12T17:10:30.378109+0000","last_unstale":"2024-09-12T18:36:01.335814+0000","last_undegraded":"2024-09-12T18:36:01.335814+0000","last_fullsized":"2024-09-12T18:36:01.335814+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:36.314866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7604419,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":628,"num_read_kb":82540,"num_write":1265,"num_write_kb":46419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'383","reported_seq":1062,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.360245+0000","last_change":"2024-09-12T17:10:30.357091+0000","last_active":"2024-09-12T18:36:01.360245+0000","last_peered":"2024-09-12T18:36:01.360245+0000","last_clean":"2024-09-12T18:36:01.360245+0000","last_became_active":"2024-09-12T17:10:30.356199+0000","last_became_peered":"2024-09-12T17:10:30.356199+0000","last_unstale":"2024-09-12T18:36:01.360245+0000","last_undegraded":"2024-09-12T18:36:01.360245+0000","last_fullsized":"2024-09-12T18:36:01.360245+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:59.039701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9077681,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":573,"num_read_kb":25746,"num_write":1219,"num_write_kb":44098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'457","reported_seq":2245,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.814149+0000","last_change":"2024-09-12T17:10:32.350936+0000","last_active":"2024-09-12T18:34:01.814149+0000","last_peered":"2024-09-12T18:34:01.814149+0000","last_clean":"2024-09-12T18:34:01.814149+0000","last_became_active":"2024-09-12T17:10:32.349687+0000","last_became_peered":"2024-09-12T17:10:32.349687+0000","last_unstale":"2024-09-12T18:34:01.814149+0000","last_undegraded":"2024-09-12T18:34:01.814149+0000","last_fullsized":"2024-09-12T18:34:01.814149+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:14.030096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2918,"num_read_kb":2789,"num_write":551,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'370","reported_seq":1032,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.567411+0000","last_change":"2024-09-12T17:11:05.122501+0000","last_active":"2024-09-12T18:36:01.567411+0000","last_peered":"2024-09-12T18:36:01.567411+0000","last_clean":"2024-09-12T18:36:01.567411+0000","last_became_active":"2024-09-12T17:11:05.121473+0000","last_became_peered":"2024-09-12T17:11:05.121473+0000","last_unstale":"2024-09-12T18:36:01.567411+0000","last_undegraded":"2024-09-12T18:36:01.567411+0000","last_fullsized":"2024-09-12T18:36:01.567411+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:52.213656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574104,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":516,"num_read_kb":29048,"num_write":1215,"num_write_kb":43104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'468","reported_seq":1964,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.515670+0000","last_change":"2024-09-12T17:10:32.353257+0000","last_active":"2024-09-12T18:33:01.515670+0000","last_peered":"2024-09-12T18:33:01.515670+0000","last_clean":"2024-09-12T18:33:01.515670+0000","last_became_active":"2024-09-12T17:10:32.352369+0000","last_became_peered":"2024-09-12T17:10:32.352369+0000","last_unstale":"2024-09-12T18:33:01.515670+0000","last_undegraded":"2024-09-12T18:33:01.515670+0000","last_fullsized":"2024-09-12T18:33:01.515670+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:04.294268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2354,"num_read_kb":2191,"num_write":554,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6108,"num_read_kb":4244,"num_write":1960,"num_write_kb":858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1131,"ondisk_log_size":1131,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":16274,"num_read_kb":15945,"num_write":16744,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1671,"ondisk_log_size":1671,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":717,"ondisk_log_size":717,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1710255,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":19351,"num_read_kb":38791,"num_write":16201,"num_write_kb":12090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1318912,"data_stored":944328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1905,"ondisk_log_size":1905,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":213001,"num_read_kb":194600,"num_write":55405,"num_write_kb":18906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3776,"ondisk_log_size":3776,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":405806845,"num_objects":1676,"num_object_clones":0,"num_object_copies":5028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1676,"num_whiteouts":0,"num_read":35261,"num_read_kb":2308302,"num_write":71236,"num_write_kb":2504748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":601944064,"data_stored":601944064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3598,"ondisk_log_size":3598,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":10069968,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":159116,"num_write":177,"num_write_kb":116497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15314944,"data_stored":15312848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":158495,"num_write":181,"num_write_kb":116497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510473,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":380332,"kb_used_data":96180,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":93991508,"statfs":{"total":96636764160,"available":96247304192,"internally_reserved":0,"allocated":98488320,"data_stored":96312094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":290650570},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510477,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335672,"kb_used_data":73892,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94036168,"statfs":{"total":96636764160,"available":96293036032,"internally_reserved":0,"allocated":75665408,"data_stored":73566987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510474,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217488,"kb_used_data":73592,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94154352,"statfs":{"total":96636764160,"available":96414056448,"internally_reserved":0,"allocated":75358208,"data_stored":73162127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510476,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141316,"kb_used_data":51732,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94230524,"statfs":{"total":96636764160,"available":96492056576,"internally_reserved":0,"allocated":52973568,"data_stored":50890434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510477,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":236392,"kb_used_data":74592,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94135448,"statfs":{"total":96636764160,"available":96394698752,"internally_reserved":0,"allocated":76382208,"data_stored":74249586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510474,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369772,"kb_used_data":109328,"kb_used_omap":1,"kb_used_meta":260222,"kb_avail":94002068,"statfs":{"total":96636764160,"available":96258117632,"internally_reserved":0,"allocated":111951872,"data_stored":109794563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":266467782},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543180,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254660,"kb_used_data":147080,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94117180,"statfs":{"total":96636764160,"available":96375992320,"internally_reserved":0,"allocated":150609920,"data_stored":148529106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575881,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":476244,"kb_used_data":202116,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93895596,"statfs":{"total":96636764160,"available":96149090304,"internally_reserved":0,"allocated":206966784,"data_stored":204784042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280689095},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73023488,"data_stored":73023488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50085888,"data_stored":50085888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32296960,"data_stored":32296960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":145809408,"data_stored":145809408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106315776,"data_stored":106315776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":56213504,"data_stored":56213504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53755904,"data_stored":53755904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":84443136,"data_stored":84443136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":44657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":82463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":437530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":38781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":213496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":41317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":85754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9486336,"data_stored":9485605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":584363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:36:03.182 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:36:03.505 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:36:03.505 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":268,"fsid":"4b851e18-22ea-4fa8-b208-1609edc12f85","created":"2024-09-12T17:09:57.574459+0000","modified":"2024-09-12T17:53:28.117970+0000","last_up_change":"2024-09-12T17:10:10.996031+0000","last_in_change":"2024-09-12T17:10:00.608474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:10:11.279972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:10:16.494714+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T17:10:28.316745+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T17:10:30.681883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T17:10:32.433938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T17:10:34.457697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T17:10:36.402895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T17:10:38.531010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T17:27:31.296349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T17:31:10.780033+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"260","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T17:31:14.381186+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"263","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T17:53:25.476849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"268","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d7e991a-0d17-4cfc-a5a9-b1305c2cab11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":1487028232},{"type":"v1","addr":"172.21.15.119:6820","nonce":1487028232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1487028232},{"type":"v1","addr":"172.21.15.119:6825","nonce":1487028232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":1487028232},{"type":"v1","addr":"172.21.15.119:6831","nonce":1487028232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":1487028232},{"type":"v1","addr":"172.21.15.119:6829","nonce":1487028232}]},"public_addr":"172.21.15.119:6820/1487028232","cluster_addr":"172.21.15.119:6825/1487028232","heartbeat_back_addr":"172.21.15.119:6831/1487028232","heartbeat_front_addr":"172.21.15.119:6829/1487028232","state":["exists","up"]},{"osd":1,"uuid":"b845ed74-bf2a-4cae-bdb2-2a769a71023e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":4034469375},{"type":"v1","addr":"172.21.15.119:6818","nonce":4034469375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":4034469375},{"type":"v1","addr":"172.21.15.119:6821","nonce":4034469375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4034469375},{"type":"v1","addr":"172.21.15.119:6827","nonce":4034469375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":4034469375},{"type":"v1","addr":"172.21.15.119:6824","nonce":4034469375}]},"public_addr":"172.21.15.119:6818/4034469375","cluster_addr":"172.21.15.119:6821/4034469375","heartbeat_back_addr":"172.21.15.119:6827/4034469375","heartbeat_front_addr":"172.21.15.119:6824/4034469375","state":["exists","up"]},{"osd":2,"uuid":"3a8139a6-3a4b-4eeb-8540-93575ad1e62d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":4281878132},{"type":"v1","addr":"172.21.15.119:6809","nonce":4281878132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":4281878132},{"type":"v1","addr":"172.21.15.119:6811","nonce":4281878132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":4281878132},{"type":"v1","addr":"172.21.15.119:6815","nonce":4281878132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":4281878132},{"type":"v1","addr":"172.21.15.119:6813","nonce":4281878132}]},"public_addr":"172.21.15.119:6809/4281878132","cluster_addr":"172.21.15.119:6811/4281878132","heartbeat_back_addr":"172.21.15.119:6815/4281878132","heartbeat_front_addr":"172.21.15.119:6813/4281878132","state":["exists","up"]},{"osd":3,"uuid":"3729a87d-2150-4127-a405-1f4ee9689e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6801","nonce":1732749810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6803","nonce":1732749810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6807","nonce":1732749810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1732749810},{"type":"v1","addr":"172.21.15.119:6805","nonce":1732749810}]},"public_addr":"172.21.15.119:6801/1732749810","cluster_addr":"172.21.15.119:6803/1732749810","heartbeat_back_addr":"172.21.15.119:6807/1732749810","heartbeat_front_addr":"172.21.15.119:6805/1732749810","state":["exists","up"]},{"osd":4,"uuid":"4cf374e8-5640-4636-bc01-e28318e18ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":923639088},{"type":"v1","addr":"172.21.15.194:6809","nonce":923639088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":923639088},{"type":"v1","addr":"172.21.15.194:6811","nonce":923639088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":923639088},{"type":"v1","addr":"172.21.15.194:6815","nonce":923639088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":923639088},{"type":"v1","addr":"172.21.15.194:6813","nonce":923639088}]},"public_addr":"172.21.15.194:6809/923639088","cluster_addr":"172.21.15.194:6811/923639088","heartbeat_back_addr":"172.21.15.194:6815/923639088","heartbeat_front_addr":"172.21.15.194:6813/923639088","state":["exists","up"]},{"osd":5,"uuid":"32b317b4-a8f6-48da-bab4-d5a1607da924","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2881805626},{"type":"v1","addr":"172.21.15.194:6817","nonce":2881805626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2881805626},{"type":"v1","addr":"172.21.15.194:6819","nonce":2881805626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2881805626},{"type":"v1","addr":"172.21.15.194:6823","nonce":2881805626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2881805626},{"type":"v1","addr":"172.21.15.194:6821","nonce":2881805626}]},"public_addr":"172.21.15.194:6817/2881805626","cluster_addr":"172.21.15.194:6819/2881805626","heartbeat_back_addr":"172.21.15.194:6823/2881805626","heartbeat_front_addr":"172.21.15.194:6821/2881805626","state":["exists","up"]},{"osd":6,"uuid":"63603319-1a08-4920-a6b7-1e7b32d7873c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":504391855},{"type":"v1","addr":"172.21.15.194:6825","nonce":504391855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":504391855},{"type":"v1","addr":"172.21.15.194:6827","nonce":504391855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":504391855},{"type":"v1","addr":"172.21.15.194:6831","nonce":504391855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":504391855},{"type":"v1","addr":"172.21.15.194:6829","nonce":504391855}]},"public_addr":"172.21.15.194:6825/504391855","cluster_addr":"172.21.15.194:6827/504391855","heartbeat_back_addr":"172.21.15.194:6831/504391855","heartbeat_front_addr":"172.21.15.194:6829/504391855","state":["exists","up"]},{"osd":7,"uuid":"b652b158-a160-460f-98de-66821bf3621c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":1379092354},{"type":"v1","addr":"172.21.15.194:6801","nonce":1379092354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":1379092354},{"type":"v1","addr":"172.21.15.194:6803","nonce":1379092354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":1379092354},{"type":"v1","addr":"172.21.15.194:6807","nonce":1379092354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1379092354},{"type":"v1","addr":"172.21.15.194:6805","nonce":1379092354}]},"public_addr":"172.21.15.194:6801/1379092354","cluster_addr":"172.21.15.194:6803/1379092354","heartbeat_back_addr":"172.21.15.194:6807/1379092354","heartbeat_front_addr":"172.21.15.194:6805/1379092354","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.880799+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.957343+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.566412+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.186445+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.121241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.272185+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:08.037138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:07.386867+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.1a","mappings":[{"from":4,"to":2}]},{"pgid":"3.20","mappings":[{"from":6,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.24","mappings":[{"from":4,"to":1}]},{"pgid":"3.2c","mappings":[{"from":4,"to":2}]},{"pgid":"3.31","mappings":[{"from":4,"to":2}]},{"pgid":"3.36","mappings":[{"from":6,"to":2}]},{"pgid":"3.39","mappings":[{"from":0,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":5}]},{"pgid":"67.19","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:36:04.524 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T18:36:04.524 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:36:04.685 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T18:36:04.685 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:36:04.685 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T18:36:04.700 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T18:36:04.992 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T18:36:05.012 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T18:36:05.012 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:36:05.156 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T18:36:05.157 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:36:05.157 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T18:36:05.172 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T18:36:05.451 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T18:36:05.471 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T18:36:05.471 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:36:05.610 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T18:36:05.610 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:36:05.611 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T18:36:05.625 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T18:36:05.905 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T18:36:05.923 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T18:36:05.923 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:36:06.074 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T18:36:06.074 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:36:06.074 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T18:36:06.090 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T18:36:06.376 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T18:36:06.397 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T18:36:06.398 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:36:06.545 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T18:36:06.545 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:36:06.545 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T18:36:06.559 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T18:36:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T18:36:06.857 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T18:36:06.857 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:36:07.001 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T18:36:07.001 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:36:07.001 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T18:36:07.016 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T18:36:07.310 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T18:36:07.329 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T18:36:07.329 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:36:07.477 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T18:36:07.478 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:36:07.478 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T18:36:07.494 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T18:36:07.790 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T18:36:07.809 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T18:36:07.809 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:36:07.947 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T18:36:07.947 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:36:07.947 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T18:36:07.962 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T18:36:08.257 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T18:36:08.277 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:36:08.633 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:36:08.646 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T18:36:08.651 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":2838,"stamp":"2024-09-12T18:36:06.845297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":167556499,"num_objects":881,"num_object_clones":0,"num_object_copies":2160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":881,"num_whiteouts":0,"num_read":294260,"num_read_kb":2883804,"num_write":163416,"num_write_kb":2776168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":213,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13491,"ondisk_log_size":13491,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1930624,"kb_used_data":279780,"kb_used_omap":12,"kb_used_meta":1649971,"kb_avail":753044096,"statfs":{"total":773094113280,"available":771117154304,"internally_reserved":0,"allocated":286494720,"data_stored":269542722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1689570865},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-820337491,"num_objects":-4190,"num_object_clones":0,"num_object_copies":-12518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4190,"num_whiteouts":0,"num_read":4682,"num_read_kb":4199,"num_write":4444,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007819"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.416560+0000","last_change":"2024-09-12T17:53:27.147438+0000","last_active":"2024-09-12T18:33:26.416560+0000","last_peered":"2024-09-12T18:33:26.416560+0000","last_clean":"2024-09-12T18:33:26.416560+0000","last_became_active":"2024-09-12T17:53:27.146780+0000","last_became_peered":"2024-09-12T17:53:27.146780+0000","last_unstale":"2024-09-12T18:33:26.416560+0000","last_undegraded":"2024-09-12T18:33:26.416560+0000","last_fullsized":"2024-09-12T18:33:26.416560+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:27.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"268'11","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.134067+0000","last_change":"2024-09-12T17:31:16.246161+0000","last_active":"2024-09-12T18:35:59.134067+0000","last_peered":"2024-09-12T18:35:59.134067+0000","last_clean":"2024-09-12T18:35:59.134067+0000","last_became_active":"2024-09-12T17:31:16.245482+0000","last_became_peered":"2024-09-12T17:31:16.245482+0000","last_unstale":"2024-09-12T18:35:59.134067+0000","last_undegraded":"2024-09-12T18:35:59.134067+0000","last_fullsized":"2024-09-12T18:35:59.134067+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:05.233527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5245,"num_write":16,"num_write_kb":2121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:14.384819+0000","last_change":"2024-09-12T17:31:12.096770+0000","last_active":"2024-09-12T18:31:14.384819+0000","last_peered":"2024-09-12T18:31:14.384819+0000","last_clean":"2024-09-12T18:31:14.384819+0000","last_became_active":"2024-09-12T17:31:12.094935+0000","last_became_peered":"2024-09-12T17:31:12.094935+0000","last_unstale":"2024-09-12T18:31:14.384819+0000","last_undegraded":"2024-09-12T18:31:14.384819+0000","last_fullsized":"2024-09-12T18:31:14.384819+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:30.818530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'30","reported_seq":143,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.403621+0000","last_change":"2024-09-12T17:27:32.584697+0000","last_active":"2024-09-12T18:32:11.403621+0000","last_peered":"2024-09-12T18:32:11.403621+0000","last_clean":"2024-09-12T18:32:11.403621+0000","last_became_active":"2024-09-12T17:27:32.583903+0000","last_became_peered":"2024-09-12T17:27:32.583903+0000","last_unstale":"2024-09-12T18:32:11.403621+0000","last_undegraded":"2024-09-12T18:32:11.403621+0000","last_fullsized":"2024-09-12T18:32:11.403621+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:29.126608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":98,"num_write":57,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.805836+0000","last_change":"2024-09-12T17:53:27.168477+0000","last_active":"2024-09-12T18:33:26.805836+0000","last_peered":"2024-09-12T18:33:26.805836+0000","last_clean":"2024-09-12T18:33:26.805836+0000","last_became_active":"2024-09-12T17:53:27.167810+0000","last_became_peered":"2024-09-12T17:53:27.167810+0000","last_unstale":"2024-09-12T18:33:26.805836+0000","last_undegraded":"2024-09-12T18:33:26.805836+0000","last_fullsized":"2024-09-12T18:33:26.805836+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:15.873940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'7","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.602979+0000","last_change":"2024-09-12T17:31:16.238350+0000","last_active":"2024-09-12T18:33:45.602979+0000","last_peered":"2024-09-12T18:33:45.602979+0000","last_clean":"2024-09-12T18:33:45.602979+0000","last_became_active":"2024-09-12T17:31:16.237721+0000","last_became_peered":"2024-09-12T17:31:16.237721+0000","last_unstale":"2024-09-12T18:33:45.602979+0000","last_undegraded":"2024-09-12T18:33:45.602979+0000","last_fullsized":"2024-09-12T18:33:45.602979+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:31.469770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'2","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:11.617448+0000","last_change":"2024-09-12T17:31:12.106211+0000","last_active":"2024-09-12T18:31:11.617448+0000","last_peered":"2024-09-12T18:31:11.617448+0000","last_clean":"2024-09-12T18:31:11.617448+0000","last_became_active":"2024-09-12T17:31:12.105548+0000","last_became_peered":"2024-09-12T17:31:12.105548+0000","last_unstale":"2024-09-12T18:31:11.617448+0000","last_undegraded":"2024-09-12T18:31:11.617448+0000","last_fullsized":"2024-09-12T18:31:11.617448+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:03.366287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'16","reported_seq":114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.809510+0000","last_change":"2024-09-12T17:27:32.564047+0000","last_active":"2024-09-12T18:33:46.809510+0000","last_peered":"2024-09-12T18:33:46.809510+0000","last_clean":"2024-09-12T18:33:46.809510+0000","last_became_active":"2024-09-12T17:27:32.563281+0000","last_became_peered":"2024-09-12T17:27:32.563281+0000","last_unstale":"2024-09-12T18:33:46.809510+0000","last_undegraded":"2024-09-12T18:33:46.809510+0000","last_fullsized":"2024-09-12T18:33:46.809510+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:23.103744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.570655+0000","last_change":"2024-09-12T17:53:27.146120+0000","last_active":"2024-09-12T18:32:06.570655+0000","last_peered":"2024-09-12T18:32:06.570655+0000","last_clean":"2024-09-12T18:32:06.570655+0000","last_became_active":"2024-09-12T17:53:27.143812+0000","last_became_peered":"2024-09-12T17:53:27.143812+0000","last_unstale":"2024-09-12T18:32:06.570655+0000","last_undegraded":"2024-09-12T18:32:06.570655+0000","last_fullsized":"2024-09-12T18:32:06.570655+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:47.856070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.422572+0000","last_change":"2024-09-12T17:31:16.209712+0000","last_active":"2024-09-12T18:33:46.422572+0000","last_peered":"2024-09-12T18:33:46.422572+0000","last_clean":"2024-09-12T18:33:46.422572+0000","last_became_active":"2024-09-12T17:31:16.208994+0000","last_became_peered":"2024-09-12T17:31:16.208994+0000","last_unstale":"2024-09-12T18:33:46.422572+0000","last_undegraded":"2024-09-12T18:33:46.422572+0000","last_fullsized":"2024-09-12T18:33:46.422572+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:21.511571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'15","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.853266+0000","last_change":"2024-09-12T17:31:12.092194+0000","last_active":"2024-09-12T18:36:00.853266+0000","last_peered":"2024-09-12T18:36:00.853266+0000","last_clean":"2024-09-12T18:36:00.853266+0000","last_became_active":"2024-09-12T17:31:12.090602+0000","last_became_peered":"2024-09-12T17:31:12.090602+0000","last_unstale":"2024-09-12T18:36:00.853266+0000","last_undegraded":"2024-09-12T18:36:00.853266+0000","last_fullsized":"2024-09-12T18:36:00.853266+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:37.853518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10290,"num_write":20,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'40","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.408679+0000","last_change":"2024-09-12T17:27:32.554962+0000","last_active":"2024-09-12T18:32:36.408679+0000","last_peered":"2024-09-12T18:32:36.408679+0000","last_clean":"2024-09-12T18:32:36.408679+0000","last_became_active":"2024-09-12T17:27:32.554228+0000","last_became_peered":"2024-09-12T17:27:32.554228+0000","last_unstale":"2024-09-12T18:32:36.408679+0000","last_undegraded":"2024-09-12T18:32:36.408679+0000","last_fullsized":"2024-09-12T18:32:36.408679+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:30.083918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":136,"num_write":75,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:19.399599+0000","last_change":"2024-09-12T17:53:27.171122+0000","last_active":"2024-09-12T18:32:19.399599+0000","last_peered":"2024-09-12T18:32:19.399599+0000","last_clean":"2024-09-12T18:32:19.399599+0000","last_became_active":"2024-09-12T17:53:27.165849+0000","last_became_peered":"2024-09-12T17:53:27.165849+0000","last_unstale":"2024-09-12T18:32:19.399599+0000","last_undegraded":"2024-09-12T18:32:19.399599+0000","last_fullsized":"2024-09-12T18:32:19.399599+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:27.566630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"268'7","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:34.443405+0000","last_change":"2024-09-12T17:31:16.234725+0000","last_active":"2024-09-12T18:35:34.443405+0000","last_peered":"2024-09-12T18:35:34.443405+0000","last_clean":"2024-09-12T18:35:34.443405+0000","last_became_active":"2024-09-12T17:31:16.233989+0000","last_became_peered":"2024-09-12T17:31:16.233989+0000","last_unstale":"2024-09-12T18:35:34.443405+0000","last_undegraded":"2024-09-12T18:35:34.443405+0000","last_fullsized":"2024-09-12T18:35:34.443405+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:22.667547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'10","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.388434+0000","last_change":"2024-09-12T17:31:12.078149+0000","last_active":"2024-09-12T18:35:59.388434+0000","last_peered":"2024-09-12T18:35:59.388434+0000","last_clean":"2024-09-12T18:35:59.388434+0000","last_became_active":"2024-09-12T17:31:12.076980+0000","last_became_peered":"2024-09-12T17:31:12.076980+0000","last_unstale":"2024-09-12T18:35:59.388434+0000","last_undegraded":"2024-09-12T18:35:59.388434+0000","last_fullsized":"2024-09-12T18:35:59.388434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:20.927562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11264,"num_write":20,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'22","reported_seq":123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403144+0000","last_change":"2024-09-12T17:27:32.597852+0000","last_active":"2024-09-12T18:32:34.403144+0000","last_peered":"2024-09-12T18:32:34.403144+0000","last_clean":"2024-09-12T18:32:34.403144+0000","last_became_active":"2024-09-12T17:27:32.597092+0000","last_became_peered":"2024-09-12T17:27:32.597092+0000","last_unstale":"2024-09-12T18:32:34.403144+0000","last_undegraded":"2024-09-12T18:32:34.403144+0000","last_fullsized":"2024-09-12T18:32:34.403144+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:46.150508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":80,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.418737+0000","last_change":"2024-09-12T17:53:27.172827+0000","last_active":"2024-09-12T18:33:39.418737+0000","last_peered":"2024-09-12T18:33:39.418737+0000","last_clean":"2024-09-12T18:33:39.418737+0000","last_became_active":"2024-09-12T17:53:27.166248+0000","last_became_peered":"2024-09-12T17:53:27.166248+0000","last_unstale":"2024-09-12T18:33:39.418737+0000","last_undegraded":"2024-09-12T18:33:39.418737+0000","last_fullsized":"2024-09-12T18:33:39.418737+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:16.950414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:01.396099+0000","last_change":"2024-09-12T17:32:06.560970+0000","last_active":"2024-09-12T18:32:01.396099+0000","last_peered":"2024-09-12T18:32:01.396099+0000","last_clean":"2024-09-12T18:32:01.396099+0000","last_became_active":"2024-09-12T17:32:06.560465+0000","last_became_peered":"2024-09-12T17:32:06.560465+0000","last_unstale":"2024-09-12T18:32:01.396099+0000","last_undegraded":"2024-09-12T18:32:01.396099+0000","last_fullsized":"2024-09-12T18:32:01.396099+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:44.091888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'8","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.425827+0000","last_change":"2024-09-12T17:31:12.068624+0000","last_active":"2024-09-12T18:34:01.425827+0000","last_peered":"2024-09-12T18:34:01.425827+0000","last_clean":"2024-09-12T18:34:01.425827+0000","last_became_active":"2024-09-12T17:31:12.067819+0000","last_became_peered":"2024-09-12T17:31:12.067819+0000","last_unstale":"2024-09-12T18:34:01.425827+0000","last_undegraded":"2024-09-12T18:34:01.425827+0000","last_fullsized":"2024-09-12T18:34:01.425827+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:31.755207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":19458,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'26","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403079+0000","last_change":"2024-09-12T17:27:32.591166+0000","last_active":"2024-09-12T18:32:34.403079+0000","last_peered":"2024-09-12T18:32:34.403079+0000","last_clean":"2024-09-12T18:32:34.403079+0000","last_became_active":"2024-09-12T17:27:32.578575+0000","last_became_peered":"2024-09-12T17:27:32.578575+0000","last_unstale":"2024-09-12T18:32:34.403079+0000","last_undegraded":"2024-09-12T18:32:34.403079+0000","last_fullsized":"2024-09-12T18:32:34.403079+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:56.541481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":95,"num_write":44,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642338+0000","last_change":"2024-09-12T17:53:27.156978+0000","last_active":"2024-09-12T18:33:01.642338+0000","last_peered":"2024-09-12T18:33:01.642338+0000","last_clean":"2024-09-12T18:33:01.642338+0000","last_became_active":"2024-09-12T17:53:27.156155+0000","last_became_peered":"2024-09-12T17:53:27.156155+0000","last_unstale":"2024-09-12T18:33:01.642338+0000","last_undegraded":"2024-09-12T18:33:01.642338+0000","last_fullsized":"2024-09-12T18:33:01.642338+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:51.477046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:06.596158+0000","last_change":"2024-09-12T17:31:16.227134+0000","last_active":"2024-09-12T18:34:06.596158+0000","last_peered":"2024-09-12T18:34:06.596158+0000","last_clean":"2024-09-12T18:34:06.596158+0000","last_became_active":"2024-09-12T17:31:16.226398+0000","last_became_peered":"2024-09-12T17:31:16.226398+0000","last_unstale":"2024-09-12T18:34:06.596158+0000","last_undegraded":"2024-09-12T18:34:06.596158+0000","last_fullsized":"2024-09-12T18:34:06.596158+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:46.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:00.578262+0000","last_change":"2024-09-12T17:31:12.077317+0000","last_active":"2024-09-12T18:32:00.578262+0000","last_peered":"2024-09-12T18:32:00.578262+0000","last_clean":"2024-09-12T18:32:00.578262+0000","last_became_active":"2024-09-12T17:31:12.076502+0000","last_became_peered":"2024-09-12T17:31:12.076502+0000","last_unstale":"2024-09-12T18:32:00.578262+0000","last_undegraded":"2024-09-12T18:32:00.578262+0000","last_fullsized":"2024-09-12T18:32:00.578262+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:49.794829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'36","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.577178+0000","last_change":"2024-09-12T17:27:32.569576+0000","last_active":"2024-09-12T18:32:36.577178+0000","last_peered":"2024-09-12T18:32:36.577178+0000","last_clean":"2024-09-12T18:32:36.577178+0000","last_became_active":"2024-09-12T17:27:32.568740+0000","last_became_peered":"2024-09-12T17:27:32.568740+0000","last_unstale":"2024-09-12T18:32:36.577178+0000","last_undegraded":"2024-09-12T18:32:36.577178+0000","last_fullsized":"2024-09-12T18:32:36.577178+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:55.258084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":126,"num_write":62,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.409921+0000","last_change":"2024-09-12T17:53:27.170601+0000","last_active":"2024-09-12T18:33:26.409921+0000","last_peered":"2024-09-12T18:33:26.409921+0000","last_clean":"2024-09-12T18:33:26.409921+0000","last_became_active":"2024-09-12T17:53:27.169805+0000","last_became_peered":"2024-09-12T17:53:27.169805+0000","last_unstale":"2024-09-12T18:33:26.409921+0000","last_undegraded":"2024-09-12T18:33:26.409921+0000","last_fullsized":"2024-09-12T18:33:26.409921+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:47.368175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"268'2","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.591724+0000","last_change":"2024-09-12T17:31:16.221214+0000","last_active":"2024-09-12T18:33:46.591724+0000","last_peered":"2024-09-12T18:33:46.591724+0000","last_clean":"2024-09-12T18:33:46.591724+0000","last_became_active":"2024-09-12T17:31:16.220449+0000","last_became_peered":"2024-09-12T17:31:16.220449+0000","last_unstale":"2024-09-12T18:33:46.591724+0000","last_undegraded":"2024-09-12T18:33:46.591724+0000","last_fullsized":"2024-09-12T18:33:46.591724+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:06.706199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:15.567669+0000","last_change":"2024-09-12T17:31:12.086822+0000","last_active":"2024-09-12T18:31:15.567669+0000","last_peered":"2024-09-12T18:31:15.567669+0000","last_clean":"2024-09-12T18:31:15.567669+0000","last_became_active":"2024-09-12T17:31:12.086091+0000","last_became_peered":"2024-09-12T17:31:12.086091+0000","last_unstale":"2024-09-12T18:31:15.567669+0000","last_undegraded":"2024-09-12T18:31:15.567669+0000","last_fullsized":"2024-09-12T18:31:15.567669+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:29.857815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'57","reported_seq":217,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.414339+0000","last_change":"2024-09-12T17:27:32.569293+0000","last_active":"2024-09-12T18:33:06.414339+0000","last_peered":"2024-09-12T18:33:06.414339+0000","last_clean":"2024-09-12T18:33:06.414339+0000","last_became_active":"2024-09-12T17:27:32.568506+0000","last_became_peered":"2024-09-12T17:27:32.568506+0000","last_unstale":"2024-09-12T18:33:06.414339+0000","last_undegraded":"2024-09-12T18:33:06.414339+0000","last_fullsized":"2024-09-12T18:33:06.414339+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:54.976967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":207,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.410077+0000","last_change":"2024-09-12T17:53:27.171469+0000","last_active":"2024-09-12T18:33:26.410077+0000","last_peered":"2024-09-12T18:33:26.410077+0000","last_clean":"2024-09-12T18:33:26.410077+0000","last_became_active":"2024-09-12T17:53:27.170636+0000","last_became_peered":"2024-09-12T17:53:27.170636+0000","last_unstale":"2024-09-12T18:33:26.410077+0000","last_undegraded":"2024-09-12T18:33:26.410077+0000","last_fullsized":"2024-09-12T18:33:26.410077+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:42.171510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"268'3","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:49.420948+0000","last_change":"2024-09-12T17:31:16.239144+0000","last_active":"2024-09-12T18:33:49.420948+0000","last_peered":"2024-09-12T18:33:49.420948+0000","last_clean":"2024-09-12T18:33:49.420948+0000","last_became_active":"2024-09-12T17:31:16.238450+0000","last_became_peered":"2024-09-12T17:31:16.238450+0000","last_unstale":"2024-09-12T18:33:49.420948+0000","last_undegraded":"2024-09-12T18:33:49.420948+0000","last_fullsized":"2024-09-12T18:33:49.420948+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:24.540079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:11.389062+0000","last_change":"2024-09-12T17:31:12.091121+0000","last_active":"2024-09-12T18:31:11.389062+0000","last_peered":"2024-09-12T18:31:11.389062+0000","last_clean":"2024-09-12T18:31:11.389062+0000","last_became_active":"2024-09-12T17:31:12.090201+0000","last_became_peered":"2024-09-12T17:31:12.090201+0000","last_unstale":"2024-09-12T18:31:11.389062+0000","last_undegraded":"2024-09-12T18:31:11.389062+0000","last_fullsized":"2024-09-12T18:31:11.389062+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:59.375478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.639470+0000","last_change":"2024-09-12T17:27:32.568403+0000","last_active":"2024-09-12T18:32:51.639470+0000","last_peered":"2024-09-12T18:32:51.639470+0000","last_clean":"2024-09-12T18:32:51.639470+0000","last_became_active":"2024-09-12T17:27:32.567672+0000","last_became_peered":"2024-09-12T17:27:32.567672+0000","last_unstale":"2024-09-12T18:32:51.639470+0000","last_undegraded":"2024-09-12T18:32:51.639470+0000","last_fullsized":"2024-09-12T18:32:51.639470+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:49.181661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.643457+0000","last_change":"2024-09-12T17:53:27.142791+0000","last_active":"2024-09-12T18:33:06.643457+0000","last_peered":"2024-09-12T18:33:06.643457+0000","last_clean":"2024-09-12T18:33:06.643457+0000","last_became_active":"2024-09-12T17:53:27.142060+0000","last_became_peered":"2024-09-12T17:53:27.142060+0000","last_unstale":"2024-09-12T18:33:06.643457+0000","last_undegraded":"2024-09-12T18:33:06.643457+0000","last_fullsized":"2024-09-12T18:33:06.643457+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:50.140663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"268'5","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:09.425389+0000","last_change":"2024-09-12T17:31:16.235658+0000","last_active":"2024-09-12T18:34:09.425389+0000","last_peered":"2024-09-12T18:34:09.425389+0000","last_clean":"2024-09-12T18:34:09.425389+0000","last_became_active":"2024-09-12T17:31:16.228226+0000","last_became_peered":"2024-09-12T17:31:16.228226+0000","last_unstale":"2024-09-12T18:34:09.425389+0000","last_undegraded":"2024-09-12T18:34:09.425389+0000","last_fullsized":"2024-09-12T18:34:09.425389+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:12.245863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1072,"num_write":10,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'5","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:31.431352+0000","last_change":"2024-09-12T17:31:12.091577+0000","last_active":"2024-09-12T18:34:31.431352+0000","last_peered":"2024-09-12T18:34:31.431352+0000","last_clean":"2024-09-12T18:34:31.431352+0000","last_became_active":"2024-09-12T17:31:12.090779+0000","last_became_peered":"2024-09-12T17:31:12.090779+0000","last_unstale":"2024-09-12T18:34:31.431352+0000","last_undegraded":"2024-09-12T18:34:31.431352+0000","last_fullsized":"2024-09-12T18:34:31.431352+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:37.345815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'62","reported_seq":234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411872+0000","last_change":"2024-09-12T17:27:32.571784+0000","last_active":"2024-09-12T18:32:51.411872+0000","last_peered":"2024-09-12T18:32:51.411872+0000","last_clean":"2024-09-12T18:32:51.411872+0000","last_became_active":"2024-09-12T17:27:32.567884+0000","last_became_peered":"2024-09-12T17:27:32.567884+0000","last_unstale":"2024-09-12T18:32:51.411872+0000","last_undegraded":"2024-09-12T18:32:51.411872+0000","last_fullsized":"2024-09-12T18:32:51.411872+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:13.840706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":230,"num_write":101,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.801783+0000","last_change":"2024-09-12T17:53:27.140297+0000","last_active":"2024-09-12T18:33:06.801783+0000","last_peered":"2024-09-12T18:33:06.801783+0000","last_clean":"2024-09-12T18:33:06.801783+0000","last_became_active":"2024-09-12T17:53:27.139551+0000","last_became_peered":"2024-09-12T17:53:27.139551+0000","last_unstale":"2024-09-12T18:33:06.801783+0000","last_undegraded":"2024-09-12T18:33:06.801783+0000","last_fullsized":"2024-09-12T18:33:06.801783+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:49.095002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'3","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:14.398487+0000","last_change":"2024-09-12T17:31:16.237383+0000","last_active":"2024-09-12T18:32:14.398487+0000","last_peered":"2024-09-12T18:32:14.398487+0000","last_clean":"2024-09-12T18:32:14.398487+0000","last_became_active":"2024-09-12T17:31:16.236796+0000","last_became_peered":"2024-09-12T17:31:16.236796+0000","last_unstale":"2024-09-12T18:32:14.398487+0000","last_undegraded":"2024-09-12T18:32:14.398487+0000","last_fullsized":"2024-09-12T18:32:14.398487+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:49.523071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'4","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.419021+0000","last_change":"2024-09-12T17:31:12.093519+0000","last_active":"2024-09-12T18:34:01.419021+0000","last_peered":"2024-09-12T18:34:01.419021+0000","last_clean":"2024-09-12T18:34:01.419021+0000","last_became_active":"2024-09-12T17:31:12.092655+0000","last_became_peered":"2024-09-12T17:31:12.092655+0000","last_unstale":"2024-09-12T18:34:01.419021+0000","last_undegraded":"2024-09-12T18:34:01.419021+0000","last_fullsized":"2024-09-12T18:34:01.419021+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:42.350728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'23","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:49.407673+0000","last_change":"2024-09-12T17:27:32.579819+0000","last_active":"2024-09-12T18:32:49.407673+0000","last_peered":"2024-09-12T18:32:49.407673+0000","last_clean":"2024-09-12T18:32:49.407673+0000","last_became_active":"2024-09-12T17:27:32.578393+0000","last_became_peered":"2024-09-12T17:27:32.578393+0000","last_unstale":"2024-09-12T18:32:49.407673+0000","last_undegraded":"2024-09-12T18:32:49.407673+0000","last_fullsized":"2024-09-12T18:32:49.407673+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:12.325555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":84,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.404631+0000","last_change":"2024-09-12T17:53:27.151852+0000","last_active":"2024-09-12T18:33:06.404631+0000","last_peered":"2024-09-12T18:33:06.404631+0000","last_clean":"2024-09-12T18:33:06.404631+0000","last_became_active":"2024-09-12T17:53:27.142159+0000","last_became_peered":"2024-09-12T17:53:27.142159+0000","last_unstale":"2024-09-12T18:33:06.404631+0000","last_undegraded":"2024-09-12T18:33:06.404631+0000","last_fullsized":"2024-09-12T18:33:06.404631+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:32.788357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:09.425500+0000","last_change":"2024-09-12T17:31:16.237254+0000","last_active":"2024-09-12T18:34:09.425500+0000","last_peered":"2024-09-12T18:34:09.425500+0000","last_clean":"2024-09-12T18:34:09.425500+0000","last_became_active":"2024-09-12T17:31:16.236478+0000","last_became_peered":"2024-09-12T17:31:16.236478+0000","last_unstale":"2024-09-12T18:34:09.425500+0000","last_undegraded":"2024-09-12T18:34:09.425500+0000","last_fullsized":"2024-09-12T18:34:09.425500+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:03.647540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.781224+0000","last_change":"2024-09-12T17:31:12.092360+0000","last_active":"2024-09-12T18:31:36.781224+0000","last_peered":"2024-09-12T18:31:36.781224+0000","last_clean":"2024-09-12T18:31:36.781224+0000","last_became_active":"2024-09-12T17:31:12.091488+0000","last_became_peered":"2024-09-12T17:31:12.091488+0000","last_unstale":"2024-09-12T18:31:36.781224+0000","last_undegraded":"2024-09-12T18:31:36.781224+0000","last_fullsized":"2024-09-12T18:31:36.781224+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:42.860474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'49","reported_seq":200,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.798942+0000","last_change":"2024-09-12T17:27:32.573661+0000","last_active":"2024-09-12T18:32:51.798942+0000","last_peered":"2024-09-12T18:32:51.798942+0000","last_clean":"2024-09-12T18:32:51.798942+0000","last_became_active":"2024-09-12T17:27:32.572859+0000","last_became_peered":"2024-09-12T17:27:32.572859+0000","last_unstale":"2024-09-12T18:32:51.798942+0000","last_undegraded":"2024-09-12T18:32:51.798942+0000","last_fullsized":"2024-09-12T18:32:51.798942+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:51.245414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":198,"num_write":77,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.412028+0000","last_change":"2024-09-12T17:53:27.156462+0000","last_active":"2024-09-12T18:33:06.412028+0000","last_peered":"2024-09-12T18:33:06.412028+0000","last_clean":"2024-09-12T18:33:06.412028+0000","last_became_active":"2024-09-12T17:53:27.155646+0000","last_became_peered":"2024-09-12T17:53:27.155646+0000","last_unstale":"2024-09-12T18:33:06.412028+0000","last_undegraded":"2024-09-12T18:33:06.412028+0000","last_fullsized":"2024-09-12T18:33:06.412028+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:44.968007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:40.573394+0000","last_change":"2024-09-12T17:31:16.221542+0000","last_active":"2024-09-12T18:31:40.573394+0000","last_peered":"2024-09-12T18:31:40.573394+0000","last_clean":"2024-09-12T18:31:40.573394+0000","last_became_active":"2024-09-12T17:31:16.220797+0000","last_became_peered":"2024-09-12T17:31:16.220797+0000","last_unstale":"2024-09-12T18:31:40.573394+0000","last_undegraded":"2024-09-12T18:31:40.573394+0000","last_fullsized":"2024-09-12T18:31:40.573394+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:34.381182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:36.395227+0000","last_change":"2024-09-12T17:31:12.098496+0000","last_active":"2024-09-12T18:31:36.395227+0000","last_peered":"2024-09-12T18:31:36.395227+0000","last_clean":"2024-09-12T18:31:36.395227+0000","last_became_active":"2024-09-12T17:31:12.090174+0000","last_became_peered":"2024-09-12T17:31:12.090174+0000","last_unstale":"2024-09-12T18:31:36.395227+0000","last_undegraded":"2024-09-12T18:31:36.395227+0000","last_fullsized":"2024-09-12T18:31:36.395227+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:11.213746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'100","reported_seq":394,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.407333+0000","last_change":"2024-09-12T17:27:32.574809+0000","last_active":"2024-09-12T18:33:16.407333+0000","last_peered":"2024-09-12T18:33:16.407333+0000","last_clean":"2024-09-12T18:33:16.407333+0000","last_became_active":"2024-09-12T17:27:32.574023+0000","last_became_peered":"2024-09-12T17:27:32.574023+0000","last_unstale":"2024-09-12T18:33:16.407333+0000","last_undegraded":"2024-09-12T18:33:16.407333+0000","last_fullsized":"2024-09-12T18:33:16.407333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:43.524925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":651,"num_read_kb":453,"num_write":126,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:09.397336+0000","last_change":"2024-09-12T17:53:27.165446+0000","last_active":"2024-09-12T18:32:09.397336+0000","last_peered":"2024-09-12T18:32:09.397336+0000","last_clean":"2024-09-12T18:32:09.397336+0000","last_became_active":"2024-09-12T17:53:27.164643+0000","last_became_peered":"2024-09-12T17:53:27.164643+0000","last_unstale":"2024-09-12T18:32:09.397336+0000","last_undegraded":"2024-09-12T18:32:09.397336+0000","last_fullsized":"2024-09-12T18:32:09.397336+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:32.358718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"265'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.627015+0000","last_change":"2024-09-12T17:31:16.241953+0000","last_active":"2024-09-12T18:31:56.627015+0000","last_peered":"2024-09-12T18:31:56.627015+0000","last_clean":"2024-09-12T18:31:56.627015+0000","last_became_active":"2024-09-12T17:31:16.240666+0000","last_became_peered":"2024-09-12T17:31:16.240666+0000","last_unstale":"2024-09-12T18:31:56.627015+0000","last_undegraded":"2024-09-12T18:31:56.627015+0000","last_fullsized":"2024-09-12T18:31:56.627015+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:19.000830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'2","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:15.609579+0000","last_change":"2024-09-12T17:31:12.079972+0000","last_active":"2024-09-12T18:34:15.609579+0000","last_peered":"2024-09-12T18:34:15.609579+0000","last_clean":"2024-09-12T18:34:15.609579+0000","last_became_active":"2024-09-12T17:31:12.077055+0000","last_became_peered":"2024-09-12T17:31:12.077055+0000","last_unstale":"2024-09-12T18:34:15.609579+0000","last_undegraded":"2024-09-12T18:34:15.609579+0000","last_fullsized":"2024-09-12T18:34:15.609579+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:54.359866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'36","reported_seq":161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.402360+0000","last_change":"2024-09-12T17:27:32.575114+0000","last_active":"2024-09-12T18:32:56.402360+0000","last_peered":"2024-09-12T18:32:56.402360+0000","last_clean":"2024-09-12T18:32:56.402360+0000","last_became_active":"2024-09-12T17:27:32.574128+0000","last_became_peered":"2024-09-12T17:27:32.574128+0000","last_unstale":"2024-09-12T18:32:56.402360+0000","last_undegraded":"2024-09-12T18:32:56.402360+0000","last_fullsized":"2024-09-12T18:32:56.402360+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:30.567491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":129,"num_write":75,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.402547+0000","last_change":"2024-09-12T17:53:27.170202+0000","last_active":"2024-09-12T18:32:06.402547+0000","last_peered":"2024-09-12T18:32:06.402547+0000","last_clean":"2024-09-12T18:32:06.402547+0000","last_became_active":"2024-09-12T17:53:27.169499+0000","last_became_peered":"2024-09-12T17:53:27.169499+0000","last_unstale":"2024-09-12T18:32:06.402547+0000","last_undegraded":"2024-09-12T18:32:06.402547+0000","last_fullsized":"2024-09-12T18:32:06.402547+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:09.313257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"268'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:16.659287+0000","last_change":"2024-09-12T17:31:16.233694+0000","last_active":"2024-09-12T18:34:16.659287+0000","last_peered":"2024-09-12T18:34:16.659287+0000","last_clean":"2024-09-12T18:34:16.659287+0000","last_became_active":"2024-09-12T17:31:16.232949+0000","last_became_peered":"2024-09-12T17:31:16.232949+0000","last_unstale":"2024-09-12T18:34:16.659287+0000","last_undegraded":"2024-09-12T18:34:16.659287+0000","last_fullsized":"2024-09-12T18:34:16.659287+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:20.006807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'4","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.384902+0000","last_change":"2024-09-12T17:31:12.087042+0000","last_active":"2024-09-12T18:35:59.384902+0000","last_peered":"2024-09-12T18:35:59.384902+0000","last_clean":"2024-09-12T18:35:59.384902+0000","last_became_active":"2024-09-12T17:31:12.086300+0000","last_became_peered":"2024-09-12T17:31:12.086300+0000","last_unstale":"2024-09-12T18:35:59.384902+0000","last_undegraded":"2024-09-12T18:35:59.384902+0000","last_fullsized":"2024-09-12T18:35:59.384902+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:18.726386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'15","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.412585+0000","last_change":"2024-09-12T17:27:32.592754+0000","last_active":"2024-09-12T18:32:56.412585+0000","last_peered":"2024-09-12T18:32:56.412585+0000","last_clean":"2024-09-12T18:32:56.412585+0000","last_became_active":"2024-09-12T17:27:32.591878+0000","last_became_peered":"2024-09-12T17:27:32.591878+0000","last_unstale":"2024-09-12T18:32:56.412585+0000","last_undegraded":"2024-09-12T18:32:56.412585+0000","last_fullsized":"2024-09-12T18:32:56.412585+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:19.824090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.416384+0000","last_change":"2024-09-12T17:53:27.158764+0000","last_active":"2024-09-12T18:33:16.416384+0000","last_peered":"2024-09-12T18:33:16.416384+0000","last_clean":"2024-09-12T18:33:16.416384+0000","last_became_active":"2024-09-12T17:53:27.157992+0000","last_became_peered":"2024-09-12T17:53:27.157992+0000","last_unstale":"2024-09-12T18:33:16.416384+0000","last_undegraded":"2024-09-12T18:33:16.416384+0000","last_fullsized":"2024-09-12T18:33:16.416384+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:50.572142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428001+0000","last_change":"2024-09-12T17:31:16.228882+0000","last_active":"2024-09-12T18:34:19.428001+0000","last_peered":"2024-09-12T18:34:19.428001+0000","last_clean":"2024-09-12T18:34:19.428001+0000","last_became_active":"2024-09-12T17:31:16.227946+0000","last_became_peered":"2024-09-12T17:31:16.227946+0000","last_unstale":"2024-09-12T18:34:19.428001+0000","last_undegraded":"2024-09-12T18:34:19.428001+0000","last_fullsized":"2024-09-12T18:34:19.428001+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:58.107920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'5","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.567511+0000","last_change":"2024-09-12T17:31:12.106194+0000","last_active":"2024-09-12T18:31:51.567511+0000","last_peered":"2024-09-12T18:31:51.567511+0000","last_clean":"2024-09-12T18:31:51.567511+0000","last_became_active":"2024-09-12T17:31:12.105448+0000","last_became_peered":"2024-09-12T17:31:12.105448+0000","last_unstale":"2024-09-12T18:31:51.567511+0000","last_undegraded":"2024-09-12T18:31:51.567511+0000","last_fullsized":"2024-09-12T18:31:51.567511+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:55.162506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'22","reported_seq":120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:55.591164+0000","last_change":"2024-09-12T17:27:32.568251+0000","last_active":"2024-09-12T18:32:55.591164+0000","last_peered":"2024-09-12T18:32:55.591164+0000","last_clean":"2024-09-12T18:32:55.591164+0000","last_became_active":"2024-09-12T17:27:32.567500+0000","last_became_peered":"2024-09-12T17:27:32.567500+0000","last_unstale":"2024-09-12T18:32:55.591164+0000","last_undegraded":"2024-09-12T18:32:55.591164+0000","last_fullsized":"2024-09-12T18:32:55.591164+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:19.895653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:09.397287+0000","last_change":"2024-09-12T17:53:27.167094+0000","last_active":"2024-09-12T18:32:09.397287+0000","last_peered":"2024-09-12T18:32:09.397287+0000","last_clean":"2024-09-12T18:32:09.397287+0000","last_became_active":"2024-09-12T17:53:27.164083+0000","last_became_peered":"2024-09-12T17:53:27.164083+0000","last_unstale":"2024-09-12T18:32:09.397287+0000","last_undegraded":"2024-09-12T18:32:09.397287+0000","last_fullsized":"2024-09-12T18:32:09.397287+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:57.760600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"268'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:16.598266+0000","last_change":"2024-09-12T17:31:16.239173+0000","last_active":"2024-09-12T18:34:16.598266+0000","last_peered":"2024-09-12T18:34:16.598266+0000","last_clean":"2024-09-12T18:34:16.598266+0000","last_became_active":"2024-09-12T17:31:16.238356+0000","last_became_peered":"2024-09-12T17:31:16.238356+0000","last_unstale":"2024-09-12T18:34:16.598266+0000","last_undegraded":"2024-09-12T18:34:16.598266+0000","last_fullsized":"2024-09-12T18:34:16.598266+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:23.384787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'5","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:11.426742+0000","last_change":"2024-09-12T17:31:12.106100+0000","last_active":"2024-09-12T18:34:11.426742+0000","last_peered":"2024-09-12T18:34:11.426742+0000","last_clean":"2024-09-12T18:34:11.426742+0000","last_became_active":"2024-09-12T17:31:12.105300+0000","last_became_peered":"2024-09-12T17:31:12.105300+0000","last_unstale":"2024-09-12T18:34:11.426742+0000","last_undegraded":"2024-09-12T18:34:11.426742+0000","last_fullsized":"2024-09-12T18:34:11.426742+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:18.610444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'42","reported_seq":176,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:54.408584+0000","last_change":"2024-09-12T17:27:32.598060+0000","last_active":"2024-09-12T18:32:54.408584+0000","last_peered":"2024-09-12T18:32:54.408584+0000","last_clean":"2024-09-12T18:32:54.408584+0000","last_became_active":"2024-09-12T17:27:32.597518+0000","last_became_peered":"2024-09-12T17:27:32.597518+0000","last_unstale":"2024-09-12T18:32:54.408584+0000","last_undegraded":"2024-09-12T18:32:54.408584+0000","last_fullsized":"2024-09-12T18:32:54.408584+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:46.388068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":146,"num_write":82,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:31.795139+0000","last_change":"2024-09-12T17:53:27.140361+0000","last_active":"2024-09-12T18:32:31.795139+0000","last_peered":"2024-09-12T18:32:31.795139+0000","last_clean":"2024-09-12T18:32:31.795139+0000","last_became_active":"2024-09-12T17:53:27.139633+0000","last_became_peered":"2024-09-12T17:53:27.139633+0000","last_unstale":"2024-09-12T18:32:31.795139+0000","last_undegraded":"2024-09-12T18:32:31.795139+0000","last_fullsized":"2024-09-12T18:32:31.795139+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:33.101556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"265'4","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:04.395968+0000","last_change":"2024-09-12T17:31:16.233015+0000","last_active":"2024-09-12T18:32:04.395968+0000","last_peered":"2024-09-12T18:32:04.395968+0000","last_clean":"2024-09-12T18:32:04.395968+0000","last_became_active":"2024-09-12T17:31:16.229063+0000","last_became_peered":"2024-09-12T17:31:16.229063+0000","last_unstale":"2024-09-12T18:32:04.395968+0000","last_undegraded":"2024-09-12T18:32:04.395968+0000","last_fullsized":"2024-09-12T18:32:04.395968+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:10.227429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.388112+0000","last_change":"2024-09-12T17:31:12.094349+0000","last_active":"2024-09-12T18:31:56.388112+0000","last_peered":"2024-09-12T18:31:56.388112+0000","last_clean":"2024-09-12T18:31:56.388112+0000","last_became_active":"2024-09-12T17:31:12.093496+0000","last_became_peered":"2024-09-12T17:31:12.093496+0000","last_unstale":"2024-09-12T18:31:56.388112+0000","last_undegraded":"2024-09-12T18:31:56.388112+0000","last_fullsized":"2024-09-12T18:31:56.388112+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:37.609875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":4,"num_write_kb":1047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'15","reported_seq":104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.411590+0000","last_change":"2024-09-12T17:27:32.598394+0000","last_active":"2024-09-12T18:33:04.411590+0000","last_peered":"2024-09-12T18:33:04.411590+0000","last_clean":"2024-09-12T18:33:04.411590+0000","last_became_active":"2024-09-12T17:27:32.597694+0000","last_became_peered":"2024-09-12T17:27:32.597694+0000","last_unstale":"2024-09-12T18:33:04.411590+0000","last_undegraded":"2024-09-12T18:33:04.411590+0000","last_fullsized":"2024-09-12T18:33:04.411590+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:30.364314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.384432+0000","last_change":"2024-09-12T17:53:27.162772+0000","last_active":"2024-09-12T18:31:41.384432+0000","last_peered":"2024-09-12T18:31:41.384432+0000","last_clean":"2024-09-12T18:31:41.384432+0000","last_became_active":"2024-09-12T17:53:27.161396+0000","last_became_peered":"2024-09-12T17:53:27.161396+0000","last_unstale":"2024-09-12T18:31:41.384432+0000","last_undegraded":"2024-09-12T18:31:41.384432+0000","last_fullsized":"2024-09-12T18:31:41.384432+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:42.269208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'3","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428076+0000","last_change":"2024-09-12T17:31:16.239207+0000","last_active":"2024-09-12T18:34:19.428076+0000","last_peered":"2024-09-12T18:34:19.428076+0000","last_clean":"2024-09-12T18:34:19.428076+0000","last_became_active":"2024-09-12T17:31:16.238011+0000","last_became_peered":"2024-09-12T17:31:16.238011+0000","last_unstale":"2024-09-12T18:34:19.428076+0000","last_undegraded":"2024-09-12T18:34:19.428076+0000","last_fullsized":"2024-09-12T18:34:19.428076+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:16.439195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"268'7","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:11.814919+0000","last_change":"2024-09-12T17:31:12.094454+0000","last_active":"2024-09-12T18:34:11.814919+0000","last_peered":"2024-09-12T18:34:11.814919+0000","last_clean":"2024-09-12T18:34:11.814919+0000","last_became_active":"2024-09-12T17:31:12.093705+0000","last_became_peered":"2024-09-12T17:31:12.093705+0000","last_unstale":"2024-09-12T18:34:11.814919+0000","last_undegraded":"2024-09-12T18:34:11.814919+0000","last_fullsized":"2024-09-12T18:34:11.814919+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:41.345776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'6","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.408420+0000","last_change":"2024-09-12T17:27:32.580514+0000","last_active":"2024-09-12T18:32:51.408420+0000","last_peered":"2024-09-12T18:32:51.408420+0000","last_clean":"2024-09-12T18:32:51.408420+0000","last_became_active":"2024-09-12T17:27:32.579749+0000","last_became_peered":"2024-09-12T17:27:32.579749+0000","last_unstale":"2024-09-12T18:32:51.408420+0000","last_undegraded":"2024-09-12T18:32:51.408420+0000","last_fullsized":"2024-09-12T18:32:51.408420+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:28.676196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.575100+0000","last_change":"2024-09-12T17:53:27.145612+0000","last_active":"2024-09-12T18:32:26.575100+0000","last_peered":"2024-09-12T18:32:26.575100+0000","last_clean":"2024-09-12T18:32:26.575100+0000","last_became_active":"2024-09-12T17:53:27.142745+0000","last_became_peered":"2024-09-12T17:53:27.142745+0000","last_unstale":"2024-09-12T18:32:26.575100+0000","last_undegraded":"2024-09-12T18:32:26.575100+0000","last_fullsized":"2024-09-12T18:32:26.575100+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:38.589340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.632168+0000","last_change":"2024-09-12T17:31:16.242998+0000","last_active":"2024-09-12T18:32:16.632168+0000","last_peered":"2024-09-12T18:32:16.632168+0000","last_clean":"2024-09-12T18:32:16.632168+0000","last_became_active":"2024-09-12T17:31:16.242306+0000","last_became_peered":"2024-09-12T17:31:16.242306+0000","last_unstale":"2024-09-12T18:32:16.632168+0000","last_undegraded":"2024-09-12T18:32:16.632168+0000","last_fullsized":"2024-09-12T18:32:16.632168+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:38.335802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'6","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:11.428425+0000","last_change":"2024-09-12T17:31:12.078680+0000","last_active":"2024-09-12T18:34:11.428425+0000","last_peered":"2024-09-12T18:34:11.428425+0000","last_clean":"2024-09-12T18:34:11.428425+0000","last_became_active":"2024-09-12T17:31:12.077726+0000","last_became_peered":"2024-09-12T17:31:12.077726+0000","last_unstale":"2024-09-12T18:34:11.428425+0000","last_undegraded":"2024-09-12T18:34:11.428425+0000","last_fullsized":"2024-09-12T18:34:11.428425+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:51.018109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.580495+0000","last_change":"2024-09-12T17:27:32.583911+0000","last_active":"2024-09-12T18:32:51.580495+0000","last_peered":"2024-09-12T18:32:51.580495+0000","last_clean":"2024-09-12T18:32:51.580495+0000","last_became_active":"2024-09-12T17:27:32.583062+0000","last_became_peered":"2024-09-12T17:27:32.583062+0000","last_unstale":"2024-09-12T18:32:51.580495+0000","last_undegraded":"2024-09-12T18:32:51.580495+0000","last_fullsized":"2024-09-12T18:32:51.580495+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:20.224440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.395058+0000","last_change":"2024-09-12T17:53:27.165755+0000","last_active":"2024-09-12T18:32:26.395058+0000","last_peered":"2024-09-12T18:32:26.395058+0000","last_clean":"2024-09-12T18:32:26.395058+0000","last_became_active":"2024-09-12T17:53:27.163419+0000","last_became_peered":"2024-09-12T17:53:27.163419+0000","last_unstale":"2024-09-12T18:32:26.395058+0000","last_undegraded":"2024-09-12T18:32:26.395058+0000","last_fullsized":"2024-09-12T18:32:26.395058+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:39.501106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:04.396028+0000","last_change":"2024-09-12T17:31:16.237342+0000","last_active":"2024-09-12T18:32:04.396028+0000","last_peered":"2024-09-12T18:32:04.396028+0000","last_clean":"2024-09-12T18:32:04.396028+0000","last_became_active":"2024-09-12T17:31:16.236619+0000","last_became_peered":"2024-09-12T17:31:16.236619+0000","last_unstale":"2024-09-12T18:32:04.396028+0000","last_undegraded":"2024-09-12T18:32:04.396028+0000","last_fullsized":"2024-09-12T18:32:04.396028+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:58.072849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"268'7","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.386741+0000","last_change":"2024-09-12T17:31:12.107461+0000","last_active":"2024-09-12T18:35:59.386741+0000","last_peered":"2024-09-12T18:35:59.386741+0000","last_clean":"2024-09-12T18:35:59.386741+0000","last_became_active":"2024-09-12T17:31:12.105793+0000","last_became_peered":"2024-09-12T17:31:12.105793+0000","last_unstale":"2024-09-12T18:35:59.386741+0000","last_undegraded":"2024-09-12T18:35:59.386741+0000","last_fullsized":"2024-09-12T18:35:59.386741+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:10.448109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'53","reported_seq":206,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.798887+0000","last_change":"2024-09-12T17:27:32.570407+0000","last_active":"2024-09-12T18:32:51.798887+0000","last_peered":"2024-09-12T18:32:51.798887+0000","last_clean":"2024-09-12T18:32:51.798887+0000","last_became_active":"2024-09-12T17:27:32.569594+0000","last_became_peered":"2024-09-12T17:27:32.569594+0000","last_unstale":"2024-09-12T18:32:51.798887+0000","last_undegraded":"2024-09-12T18:32:51.798887+0000","last_fullsized":"2024-09-12T18:32:51.798887+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:44.112049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":187,"num_write":95,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:44.391279+0000","last_change":"2024-09-12T17:53:27.166701+0000","last_active":"2024-09-12T18:31:44.391279+0000","last_peered":"2024-09-12T18:31:44.391279+0000","last_clean":"2024-09-12T18:31:44.391279+0000","last_became_active":"2024-09-12T17:53:27.165129+0000","last_became_peered":"2024-09-12T17:53:27.165129+0000","last_unstale":"2024-09-12T18:31:44.391279+0000","last_undegraded":"2024-09-12T18:31:44.391279+0000","last_fullsized":"2024-09-12T18:31:44.391279+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:59.004034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"268'2","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:05.607436+0000","last_change":"2024-09-12T17:31:16.240818+0000","last_active":"2024-09-12T18:34:05.607436+0000","last_peered":"2024-09-12T18:34:05.607436+0000","last_clean":"2024-09-12T18:34:05.607436+0000","last_became_active":"2024-09-12T17:31:16.240152+0000","last_became_peered":"2024-09-12T17:31:16.240152+0000","last_unstale":"2024-09-12T18:34:05.607436+0000","last_undegraded":"2024-09-12T18:34:05.607436+0000","last_fullsized":"2024-09-12T18:34:05.607436+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:20.290016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'5","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.942432+0000","last_change":"2024-09-12T17:31:12.098113+0000","last_active":"2024-09-12T18:35:59.942432+0000","last_peered":"2024-09-12T18:35:59.942432+0000","last_clean":"2024-09-12T18:35:59.942432+0000","last_became_active":"2024-09-12T17:31:12.089200+0000","last_became_peered":"2024-09-12T17:31:12.089200+0000","last_unstale":"2024-09-12T18:35:59.942432+0000","last_undegraded":"2024-09-12T18:35:59.942432+0000","last_fullsized":"2024-09-12T18:35:59.942432+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:44.577058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8242,"num_write":10,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'48","reported_seq":193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411678+0000","last_change":"2024-09-12T17:27:32.570665+0000","last_active":"2024-09-12T18:32:51.411678+0000","last_peered":"2024-09-12T18:32:51.411678+0000","last_clean":"2024-09-12T18:32:51.411678+0000","last_became_active":"2024-09-12T17:27:32.568661+0000","last_became_peered":"2024-09-12T17:27:32.568661+0000","last_unstale":"2024-09-12T18:32:51.411678+0000","last_undegraded":"2024-09-12T18:32:51.411678+0000","last_fullsized":"2024-09-12T18:32:51.411678+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:42.609534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":169,"num_write":85,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.388216+0000","last_change":"2024-09-12T17:53:27.171856+0000","last_active":"2024-09-12T18:31:56.388216+0000","last_peered":"2024-09-12T18:31:56.388216+0000","last_clean":"2024-09-12T18:31:56.388216+0000","last_became_active":"2024-09-12T17:53:27.170493+0000","last_became_peered":"2024-09-12T17:53:27.170493+0000","last_unstale":"2024-09-12T18:31:56.388216+0000","last_undegraded":"2024-09-12T18:31:56.388216+0000","last_fullsized":"2024-09-12T18:31:56.388216+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:44.616138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'7","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.759139+0000","last_change":"2024-09-12T17:31:16.229295+0000","last_active":"2024-09-12T18:36:00.759139+0000","last_peered":"2024-09-12T18:36:00.759139+0000","last_clean":"2024-09-12T18:36:00.759139+0000","last_became_active":"2024-09-12T17:31:16.228566+0000","last_became_peered":"2024-09-12T17:31:16.228566+0000","last_unstale":"2024-09-12T18:36:00.759139+0000","last_undegraded":"2024-09-12T18:36:00.759139+0000","last_fullsized":"2024-09-12T18:36:00.759139+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:12.639985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5238,"num_write":12,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'4","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.387491+0000","last_change":"2024-09-12T17:31:12.106105+0000","last_active":"2024-09-12T18:35:59.387491+0000","last_peered":"2024-09-12T18:35:59.387491+0000","last_clean":"2024-09-12T18:35:59.387491+0000","last_became_active":"2024-09-12T17:31:12.105384+0000","last_became_peered":"2024-09-12T17:31:12.105384+0000","last_unstale":"2024-09-12T18:35:59.387491+0000","last_undegraded":"2024-09-12T18:35:59.387491+0000","last_fullsized":"2024-09-12T18:35:59.387491+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:47.101516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'110","reported_seq":479,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.402295+0000","last_change":"2024-09-12T17:27:32.587346+0000","last_active":"2024-09-12T18:32:56.402295+0000","last_peered":"2024-09-12T18:32:56.402295+0000","last_clean":"2024-09-12T18:32:56.402295+0000","last_became_active":"2024-09-12T17:27:32.586640+0000","last_became_peered":"2024-09-12T17:27:32.586640+0000","last_unstale":"2024-09-12T18:32:56.402295+0000","last_undegraded":"2024-09-12T18:32:56.402295+0000","last_fullsized":"2024-09-12T18:32:56.402295+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:13.010550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":815,"num_read_kb":525,"num_write":139,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.384492+0000","last_change":"2024-09-12T17:53:27.171182+0000","last_active":"2024-09-12T18:31:41.384492+0000","last_peered":"2024-09-12T18:31:41.384492+0000","last_clean":"2024-09-12T18:31:41.384492+0000","last_became_active":"2024-09-12T17:53:27.170381+0000","last_became_peered":"2024-09-12T17:53:27.170381+0000","last_unstale":"2024-09-12T18:31:41.384492+0000","last_undegraded":"2024-09-12T18:31:41.384492+0000","last_fullsized":"2024-09-12T18:31:41.384492+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:22.200905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'7","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.757389+0000","last_change":"2024-09-12T17:31:16.245927+0000","last_active":"2024-09-12T18:36:00.757389+0000","last_peered":"2024-09-12T18:36:00.757389+0000","last_clean":"2024-09-12T18:36:00.757389+0000","last_became_active":"2024-09-12T17:31:16.245228+0000","last_became_peered":"2024-09-12T17:31:16.245228+0000","last_unstale":"2024-09-12T18:36:00.757389+0000","last_undegraded":"2024-09-12T18:36:00.757389+0000","last_fullsized":"2024-09-12T18:36:00.757389+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:57.083185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":48,"num_write":12,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'2","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:16.429502+0000","last_change":"2024-09-12T17:31:12.091353+0000","last_active":"2024-09-12T18:34:16.429502+0000","last_peered":"2024-09-12T18:34:16.429502+0000","last_clean":"2024-09-12T18:34:16.429502+0000","last_became_active":"2024-09-12T17:31:12.089735+0000","last_became_peered":"2024-09-12T17:31:12.089735+0000","last_unstale":"2024-09-12T18:34:16.429502+0000","last_undegraded":"2024-09-12T18:34:16.429502+0000","last_fullsized":"2024-09-12T18:34:16.429502+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:58.780190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'45","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.402987+0000","last_change":"2024-09-12T17:27:32.576354+0000","last_active":"2024-09-12T18:32:34.402987+0000","last_peered":"2024-09-12T18:32:34.402987+0000","last_clean":"2024-09-12T18:32:34.402987+0000","last_became_active":"2024-09-12T17:27:32.575300+0000","last_became_peered":"2024-09-12T17:27:32.575300+0000","last_unstale":"2024-09-12T18:32:34.402987+0000","last_undegraded":"2024-09-12T18:32:34.402987+0000","last_fullsized":"2024-09-12T18:32:34.402987+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:55.469608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":157,"num_write":84,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.396512+0000","last_change":"2024-09-12T17:53:27.174556+0000","last_active":"2024-09-12T18:31:41.396512+0000","last_peered":"2024-09-12T18:31:41.396512+0000","last_clean":"2024-09-12T18:31:41.396512+0000","last_became_active":"2024-09-12T17:53:27.173955+0000","last_became_peered":"2024-09-12T17:53:27.173955+0000","last_unstale":"2024-09-12T18:31:41.396512+0000","last_undegraded":"2024-09-12T18:31:41.396512+0000","last_fullsized":"2024-09-12T18:31:41.396512+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:48.495953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.392719+0000","last_change":"2024-09-12T17:31:16.232804+0000","last_active":"2024-09-12T18:32:16.392719+0000","last_peered":"2024-09-12T18:32:16.392719+0000","last_clean":"2024-09-12T18:32:16.392719+0000","last_became_active":"2024-09-12T17:31:16.231516+0000","last_became_peered":"2024-09-12T17:31:16.231516+0000","last_unstale":"2024-09-12T18:32:16.392719+0000","last_undegraded":"2024-09-12T18:32:16.392719+0000","last_fullsized":"2024-09-12T18:32:16.392719+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:15.629748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:00.578348+0000","last_change":"2024-09-12T17:31:12.084858+0000","last_active":"2024-09-12T18:32:00.578348+0000","last_peered":"2024-09-12T18:32:00.578348+0000","last_clean":"2024-09-12T18:32:00.578348+0000","last_became_active":"2024-09-12T17:31:12.084158+0000","last_became_peered":"2024-09-12T17:31:12.084158+0000","last_unstale":"2024-09-12T18:32:00.578348+0000","last_undegraded":"2024-09-12T18:32:00.578348+0000","last_fullsized":"2024-09-12T18:32:00.578348+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:57.119863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'55","reported_seq":211,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.577105+0000","last_change":"2024-09-12T17:27:32.577701+0000","last_active":"2024-09-12T18:32:36.577105+0000","last_peered":"2024-09-12T18:32:36.577105+0000","last_clean":"2024-09-12T18:32:36.577105+0000","last_became_active":"2024-09-12T17:27:32.569924+0000","last_became_peered":"2024-09-12T17:27:32.569924+0000","last_unstale":"2024-09-12T18:32:36.577105+0000","last_undegraded":"2024-09-12T18:32:36.577105+0000","last_fullsized":"2024-09-12T18:32:36.577105+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:22.820241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":184,"num_write":101,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.403508+0000","last_change":"2024-09-12T17:53:27.163286+0000","last_active":"2024-09-12T18:33:01.403508+0000","last_peered":"2024-09-12T18:33:01.403508+0000","last_clean":"2024-09-12T18:33:01.403508+0000","last_became_active":"2024-09-12T17:53:27.162527+0000","last_became_peered":"2024-09-12T17:53:27.162527+0000","last_unstale":"2024-09-12T18:33:01.403508+0000","last_undegraded":"2024-09-12T18:33:01.403508+0000","last_fullsized":"2024-09-12T18:33:01.403508+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:27.017224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.426025+0000","last_change":"2024-09-12T17:31:16.245393+0000","last_active":"2024-09-12T18:34:01.426025+0000","last_peered":"2024-09-12T18:34:01.426025+0000","last_clean":"2024-09-12T18:34:01.426025+0000","last_became_active":"2024-09-12T17:31:16.244556+0000","last_became_peered":"2024-09-12T17:31:16.244556+0000","last_unstale":"2024-09-12T18:34:01.426025+0000","last_undegraded":"2024-09-12T18:34:01.426025+0000","last_fullsized":"2024-09-12T18:34:01.426025+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'7","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.413674+0000","last_change":"2024-09-12T17:31:12.081797+0000","last_active":"2024-09-12T18:33:41.413674+0000","last_peered":"2024-09-12T18:33:41.413674+0000","last_clean":"2024-09-12T18:33:41.413674+0000","last_became_active":"2024-09-12T17:31:12.081025+0000","last_became_peered":"2024-09-12T17:31:12.081025+0000","last_unstale":"2024-09-12T18:33:41.413674+0000","last_undegraded":"2024-09-12T18:33:41.413674+0000","last_fullsized":"2024-09-12T18:33:41.413674+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:23.240064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.408791+0000","last_change":"2024-09-12T17:27:32.562776+0000","last_active":"2024-09-12T18:32:36.408791+0000","last_peered":"2024-09-12T18:32:36.408791+0000","last_clean":"2024-09-12T18:32:36.408791+0000","last_became_active":"2024-09-12T17:27:32.561993+0000","last_became_peered":"2024-09-12T17:27:32.561993+0000","last_unstale":"2024-09-12T18:32:36.408791+0000","last_undegraded":"2024-09-12T18:32:36.408791+0000","last_fullsized":"2024-09-12T18:32:36.408791+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:55.063772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":121,"num_write":59,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.410789+0000","last_change":"2024-09-12T17:53:27.153890+0000","last_active":"2024-09-12T18:33:01.410789+0000","last_peered":"2024-09-12T18:33:01.410789+0000","last_clean":"2024-09-12T18:33:01.410789+0000","last_became_active":"2024-09-12T17:53:27.153125+0000","last_became_peered":"2024-09-12T17:53:27.153125+0000","last_unstale":"2024-09-12T18:33:01.410789+0000","last_undegraded":"2024-09-12T18:33:01.410789+0000","last_fullsized":"2024-09-12T18:33:01.410789+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:29.571163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'6","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:51.449584+0000","last_change":"2024-09-12T17:31:16.223351+0000","last_active":"2024-09-12T18:35:51.449584+0000","last_peered":"2024-09-12T18:35:51.449584+0000","last_clean":"2024-09-12T18:35:51.449584+0000","last_became_active":"2024-09-12T17:31:16.212330+0000","last_became_peered":"2024-09-12T17:31:16.212330+0000","last_unstale":"2024-09-12T18:35:51.449584+0000","last_undegraded":"2024-09-12T18:35:51.449584+0000","last_fullsized":"2024-09-12T18:35:51.449584+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:36.131170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'2","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.810431+0000","last_change":"2024-09-12T17:31:12.094672+0000","last_active":"2024-09-12T18:33:51.810431+0000","last_peered":"2024-09-12T18:33:51.810431+0000","last_clean":"2024-09-12T18:33:51.810431+0000","last_became_active":"2024-09-12T17:31:12.093752+0000","last_became_peered":"2024-09-12T17:31:12.093752+0000","last_unstale":"2024-09-12T18:33:51.810431+0000","last_undegraded":"2024-09-12T18:33:51.810431+0000","last_fullsized":"2024-09-12T18:33:51.810431+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:44.826244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.577266+0000","last_change":"2024-09-12T17:27:32.583969+0000","last_active":"2024-09-12T18:32:36.577266+0000","last_peered":"2024-09-12T18:32:36.577266+0000","last_clean":"2024-09-12T18:32:36.577266+0000","last_became_active":"2024-09-12T17:27:32.583070+0000","last_became_peered":"2024-09-12T17:27:32.583070+0000","last_unstale":"2024-09-12T18:32:36.577266+0000","last_undegraded":"2024-09-12T18:32:36.577266+0000","last_fullsized":"2024-09-12T18:32:36.577266+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:54.241847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.649994+0000","last_change":"2024-09-12T17:53:27.155092+0000","last_active":"2024-09-12T18:33:36.649994+0000","last_peered":"2024-09-12T18:33:36.649994+0000","last_clean":"2024-09-12T18:33:36.649994+0000","last_became_active":"2024-09-12T17:53:27.154309+0000","last_became_peered":"2024-09-12T17:53:27.154309+0000","last_unstale":"2024-09-12T18:33:36.649994+0000","last_undegraded":"2024-09-12T18:33:36.649994+0000","last_fullsized":"2024-09-12T18:33:36.649994+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:16.746183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'8","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:06.420402+0000","last_change":"2024-09-12T17:31:16.231548+0000","last_active":"2024-09-12T18:34:06.420402+0000","last_peered":"2024-09-12T18:34:06.420402+0000","last_clean":"2024-09-12T18:34:06.420402+0000","last_became_active":"2024-09-12T17:31:16.230809+0000","last_became_peered":"2024-09-12T17:31:16.230809+0000","last_unstale":"2024-09-12T18:34:06.420402+0000","last_undegraded":"2024-09-12T18:34:06.420402+0000","last_fullsized":"2024-09-12T18:34:06.420402+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:50.950013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":16386,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"265'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.394003+0000","last_change":"2024-09-12T17:31:12.084859+0000","last_active":"2024-09-12T18:31:51.394003+0000","last_peered":"2024-09-12T18:31:51.394003+0000","last_clean":"2024-09-12T18:31:51.394003+0000","last_became_active":"2024-09-12T17:31:12.084101+0000","last_became_peered":"2024-09-12T17:31:12.084101+0000","last_unstale":"2024-09-12T18:31:51.394003+0000","last_undegraded":"2024-09-12T18:31:51.394003+0000","last_fullsized":"2024-09-12T18:31:51.394003+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:18.901928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'37","reported_seq":163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:31.396318+0000","last_change":"2024-09-12T17:27:32.582926+0000","last_active":"2024-09-12T18:32:31.396318+0000","last_peered":"2024-09-12T18:32:31.396318+0000","last_clean":"2024-09-12T18:32:31.396318+0000","last_became_active":"2024-09-12T17:27:32.582183+0000","last_became_peered":"2024-09-12T17:27:32.582183+0000","last_unstale":"2024-09-12T18:32:31.396318+0000","last_undegraded":"2024-09-12T18:32:31.396318+0000","last_fullsized":"2024-09-12T18:32:31.396318+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:44.094594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":125,"num_write":74,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.593556+0000","last_change":"2024-09-12T17:53:27.160005+0000","last_active":"2024-09-12T18:33:05.593556+0000","last_peered":"2024-09-12T18:33:05.593556+0000","last_clean":"2024-09-12T18:33:05.593556+0000","last_became_active":"2024-09-12T17:53:27.159240+0000","last_became_peered":"2024-09-12T17:53:27.159240+0000","last_unstale":"2024-09-12T18:33:05.593556+0000","last_undegraded":"2024-09-12T18:33:05.593556+0000","last_fullsized":"2024-09-12T18:33:05.593556+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:37.529736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'5","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.758619+0000","last_change":"2024-09-12T17:31:16.226574+0000","last_active":"2024-09-12T18:36:00.758619+0000","last_peered":"2024-09-12T18:36:00.758619+0000","last_clean":"2024-09-12T18:36:00.758619+0000","last_became_active":"2024-09-12T17:31:16.225754+0000","last_became_peered":"2024-09-12T17:31:16.225754+0000","last_unstale":"2024-09-12T18:36:00.758619+0000","last_undegraded":"2024-09-12T18:36:00.758619+0000","last_fullsized":"2024-09-12T18:36:00.758619+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:30.610378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.386970+0000","last_change":"2024-09-12T17:31:12.088188+0000","last_active":"2024-09-12T18:31:51.386970+0000","last_peered":"2024-09-12T18:31:51.386970+0000","last_clean":"2024-09-12T18:31:51.386970+0000","last_became_active":"2024-09-12T17:31:12.087356+0000","last_became_peered":"2024-09-12T17:31:12.087356+0000","last_unstale":"2024-09-12T18:31:51.386970+0000","last_undegraded":"2024-09-12T18:31:51.386970+0000","last_fullsized":"2024-09-12T18:31:51.386970+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:57.783040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'23","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.630906+0000","last_change":"2024-09-12T17:27:32.584476+0000","last_active":"2024-09-12T18:32:11.630906+0000","last_peered":"2024-09-12T18:32:11.630906+0000","last_clean":"2024-09-12T18:32:11.630906+0000","last_became_active":"2024-09-12T17:27:32.583631+0000","last_became_peered":"2024-09-12T17:27:32.583631+0000","last_unstale":"2024-09-12T18:32:11.630906+0000","last_undegraded":"2024-09-12T18:32:11.630906+0000","last_fullsized":"2024-09-12T18:32:11.630906+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:24.021549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":83,"num_write":39,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'1","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.790817+0000","last_change":"2024-09-12T17:53:27.156217+0000","last_active":"2024-09-12T18:32:26.790817+0000","last_peered":"2024-09-12T18:32:26.790817+0000","last_clean":"2024-09-12T18:32:26.790817+0000","last_became_active":"2024-09-12T17:53:27.152651+0000","last_became_peered":"2024-09-12T17:53:27.152651+0000","last_unstale":"2024-09-12T18:32:26.790817+0000","last_undegraded":"2024-09-12T18:32:26.790817+0000","last_fullsized":"2024-09-12T18:32:26.790817+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:24.443187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'9","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.486208+0000","last_change":"2024-09-12T17:31:16.243687+0000","last_active":"2024-09-12T18:35:59.486208+0000","last_peered":"2024-09-12T18:35:59.486208+0000","last_clean":"2024-09-12T18:35:59.486208+0000","last_became_active":"2024-09-12T17:31:16.242981+0000","last_became_peered":"2024-09-12T17:31:16.242981+0000","last_unstale":"2024-09-12T18:35:59.486208+0000","last_undegraded":"2024-09-12T18:35:59.486208+0000","last_fullsized":"2024-09-12T18:35:59.486208+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:07.505703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15362,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.411117+0000","last_change":"2024-09-12T17:31:12.097913+0000","last_active":"2024-09-12T18:33:31.411117+0000","last_peered":"2024-09-12T18:33:31.411117+0000","last_clean":"2024-09-12T18:33:31.411117+0000","last_became_active":"2024-09-12T17:31:12.097216+0000","last_became_peered":"2024-09-12T17:31:12.097216+0000","last_unstale":"2024-09-12T18:33:31.411117+0000","last_undegraded":"2024-09-12T18:33:31.411117+0000","last_fullsized":"2024-09-12T18:33:31.411117+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:29.988488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'30","reported_seq":143,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.399472+0000","last_change":"2024-09-12T17:27:32.572524+0000","last_active":"2024-09-12T18:32:11.399472+0000","last_peered":"2024-09-12T18:32:11.399472+0000","last_clean":"2024-09-12T18:32:11.399472+0000","last_became_active":"2024-09-12T17:27:32.571830+0000","last_became_peered":"2024-09-12T17:27:32.571830+0000","last_unstale":"2024-09-12T18:32:11.399472+0000","last_undegraded":"2024-09-12T18:32:11.399472+0000","last_fullsized":"2024-09-12T18:32:11.399472+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:50.997968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":95,"num_write":63,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.406561+0000","last_change":"2024-09-12T17:53:27.163946+0000","last_active":"2024-09-12T18:32:26.406561+0000","last_peered":"2024-09-12T18:32:26.406561+0000","last_clean":"2024-09-12T18:32:26.406561+0000","last_became_active":"2024-09-12T17:53:27.163113+0000","last_became_peered":"2024-09-12T17:53:27.163113+0000","last_unstale":"2024-09-12T18:32:26.406561+0000","last_undegraded":"2024-09-12T18:32:26.406561+0000","last_fullsized":"2024-09-12T18:32:26.406561+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:01.071160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.418774+0000","last_change":"2024-09-12T17:31:16.234271+0000","last_active":"2024-09-12T18:33:36.418774+0000","last_peered":"2024-09-12T18:33:36.418774+0000","last_clean":"2024-09-12T18:33:36.418774+0000","last_became_active":"2024-09-12T17:31:16.233558+0000","last_became_peered":"2024-09-12T17:31:16.233558+0000","last_unstale":"2024-09-12T18:33:36.418774+0000","last_undegraded":"2024-09-12T18:33:36.418774+0000","last_fullsized":"2024-09-12T18:33:36.418774+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:03.391887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'7","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:46.444961+0000","last_change":"2024-09-12T17:31:12.094815+0000","last_active":"2024-09-12T18:35:46.444961+0000","last_peered":"2024-09-12T18:35:46.444961+0000","last_clean":"2024-09-12T18:35:46.444961+0000","last_became_active":"2024-09-12T17:31:12.094159+0000","last_became_peered":"2024-09-12T17:31:12.094159+0000","last_unstale":"2024-09-12T18:35:46.444961+0000","last_undegraded":"2024-09-12T18:35:46.444961+0000","last_fullsized":"2024-09-12T18:35:46.444961+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:09.522281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3074,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'20","reported_seq":124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:10.580606+0000","last_change":"2024-09-12T17:27:32.596142+0000","last_active":"2024-09-12T18:32:10.580606+0000","last_peered":"2024-09-12T18:32:10.580606+0000","last_clean":"2024-09-12T18:32:10.580606+0000","last_became_active":"2024-09-12T17:27:32.595524+0000","last_became_peered":"2024-09-12T17:27:32.595524+0000","last_unstale":"2024-09-12T18:32:10.580606+0000","last_undegraded":"2024-09-12T18:32:10.580606+0000","last_fullsized":"2024-09-12T18:32:10.580606+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:10.999486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":74,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.413732+0000","last_change":"2024-09-12T17:53:27.175841+0000","last_active":"2024-09-12T18:33:01.413732+0000","last_peered":"2024-09-12T18:33:01.413732+0000","last_clean":"2024-09-12T18:33:01.413732+0000","last_became_active":"2024-09-12T17:53:27.175125+0000","last_became_peered":"2024-09-12T17:53:27.175125+0000","last_unstale":"2024-09-12T18:33:01.413732+0000","last_undegraded":"2024-09-12T18:33:01.413732+0000","last_fullsized":"2024-09-12T18:33:01.413732+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:18.938638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'4","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.591667+0000","last_change":"2024-09-12T17:31:16.212462+0000","last_active":"2024-09-12T18:33:46.591667+0000","last_peered":"2024-09-12T18:33:46.591667+0000","last_clean":"2024-09-12T18:33:46.591667+0000","last_became_active":"2024-09-12T17:31:16.211664+0000","last_became_peered":"2024-09-12T17:31:16.211664+0000","last_unstale":"2024-09-12T18:33:46.591667+0000","last_undegraded":"2024-09-12T18:33:46.591667+0000","last_fullsized":"2024-09-12T18:33:46.591667+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:00.841100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1069,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'4","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.387515+0000","last_change":"2024-09-12T17:31:12.101932+0000","last_active":"2024-09-12T18:35:59.387515+0000","last_peered":"2024-09-12T18:35:59.387515+0000","last_clean":"2024-09-12T18:35:59.387515+0000","last_became_active":"2024-09-12T17:31:12.099608+0000","last_became_peered":"2024-09-12T17:31:12.099608+0000","last_unstale":"2024-09-12T18:35:59.387515+0000","last_undegraded":"2024-09-12T18:35:59.387515+0000","last_fullsized":"2024-09-12T18:35:59.387515+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:36.462019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'56","reported_seq":218,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:11.571812+0000","last_change":"2024-09-12T17:27:32.569526+0000","last_active":"2024-09-12T18:32:11.571812+0000","last_peered":"2024-09-12T18:32:11.571812+0000","last_clean":"2024-09-12T18:32:11.571812+0000","last_became_active":"2024-09-12T17:27:32.568785+0000","last_became_peered":"2024-09-12T17:27:32.568785+0000","last_unstale":"2024-09-12T18:32:11.571812+0000","last_undegraded":"2024-09-12T18:32:11.571812+0000","last_fullsized":"2024-09-12T18:32:11.571812+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:14.598346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":196,"num_write":113,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.407392+0000","last_change":"2024-09-12T17:53:27.175493+0000","last_active":"2024-09-12T18:33:16.407392+0000","last_peered":"2024-09-12T18:33:16.407392+0000","last_clean":"2024-09-12T18:33:16.407392+0000","last_became_active":"2024-09-12T17:53:27.175073+0000","last_became_peered":"2024-09-12T17:53:27.175073+0000","last_unstale":"2024-09-12T18:33:16.407392+0000","last_undegraded":"2024-09-12T18:33:16.407392+0000","last_fullsized":"2024-09-12T18:33:16.407392+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:43.723718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.602853+0000","last_change":"2024-09-12T17:31:16.229188+0000","last_active":"2024-09-12T18:33:45.602853+0000","last_peered":"2024-09-12T18:33:45.602853+0000","last_clean":"2024-09-12T18:33:45.602853+0000","last_became_active":"2024-09-12T17:31:16.228416+0000","last_became_peered":"2024-09-12T17:31:16.228416+0000","last_unstale":"2024-09-12T18:33:45.602853+0000","last_undegraded":"2024-09-12T18:33:45.602853+0000","last_fullsized":"2024-09-12T18:33:45.602853+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:54.390718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.590617+0000","last_change":"2024-09-12T17:31:12.089066+0000","last_active":"2024-09-12T18:33:41.590617+0000","last_peered":"2024-09-12T18:33:41.590617+0000","last_clean":"2024-09-12T18:33:41.590617+0000","last_became_active":"2024-09-12T17:31:12.088297+0000","last_became_peered":"2024-09-12T17:31:12.088297+0000","last_unstale":"2024-09-12T18:33:41.590617+0000","last_undegraded":"2024-09-12T18:33:41.590617+0000","last_fullsized":"2024-09-12T18:33:41.590617+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:37.483806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'16","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.417452+0000","last_change":"2024-09-12T17:27:32.585156+0000","last_active":"2024-09-12T18:33:56.417452+0000","last_peered":"2024-09-12T18:33:56.417452+0000","last_clean":"2024-09-12T18:33:56.417452+0000","last_became_active":"2024-09-12T17:27:32.584404+0000","last_became_peered":"2024-09-12T17:27:32.584404+0000","last_unstale":"2024-09-12T18:33:56.417452+0000","last_undegraded":"2024-09-12T18:33:56.417452+0000","last_fullsized":"2024-09-12T18:33:56.417452+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:00.210204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":55,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'315","reported_seq":961,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.835069+0000","last_change":"2024-09-12T17:10:30.407868+0000","last_active":"2024-09-12T18:36:01.835069+0000","last_peered":"2024-09-12T18:36:01.835069+0000","last_clean":"2024-09-12T18:36:01.835069+0000","last_became_active":"2024-09-12T17:10:30.407181+0000","last_became_peered":"2024-09-12T17:10:30.407181+0000","last_unstale":"2024-09-12T18:36:01.835069+0000","last_undegraded":"2024-09-12T18:36:01.835069+0000","last_fullsized":"2024-09-12T18:36:01.835069+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:59.494627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262204,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":478,"num_read_kb":10655,"num_write":917,"num_write_kb":47496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'781","reported_seq":2314,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.923295+0000","last_change":"2024-09-12T17:10:32.347708+0000","last_active":"2024-09-12T18:33:59.923295+0000","last_peered":"2024-09-12T18:33:59.923295+0000","last_clean":"2024-09-12T18:33:59.923295+0000","last_became_active":"2024-09-12T17:10:32.346911+0000","last_became_peered":"2024-09-12T17:10:32.346911+0000","last_unstale":"2024-09-12T18:33:59.923295+0000","last_undegraded":"2024-09-12T18:33:59.923295+0000","last_fullsized":"2024-09-12T18:33:59.923295+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:26.413533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3659,"num_read_kb":3307,"num_write":1011,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'379","reported_seq":1094,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.855672+0000","last_change":"2024-09-12T17:10:30.405881+0000","last_active":"2024-09-12T18:36:01.855672+0000","last_peered":"2024-09-12T18:36:01.855672+0000","last_clean":"2024-09-12T18:36:01.855672+0000","last_became_active":"2024-09-12T17:10:30.405515+0000","last_became_peered":"2024-09-12T17:10:30.405515+0000","last_unstale":"2024-09-12T18:36:01.855672+0000","last_undegraded":"2024-09-12T18:36:01.855672+0000","last_fullsized":"2024-09-12T18:36:01.855672+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:23.617786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262215,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":661,"num_read_kb":13611,"num_write":1216,"num_write_kb":42248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'453","reported_seq":1933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.627333+0000","last_change":"2024-09-12T17:10:32.376635+0000","last_active":"2024-09-12T18:33:18.627333+0000","last_peered":"2024-09-12T18:33:18.627333+0000","last_clean":"2024-09-12T18:33:18.627333+0000","last_became_active":"2024-09-12T17:10:32.375908+0000","last_became_peered":"2024-09-12T17:10:32.375908+0000","last_unstale":"2024-09-12T18:33:18.627333+0000","last_undegraded":"2024-09-12T18:33:18.627333+0000","last_fullsized":"2024-09-12T18:33:18.627333+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:27.899807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2460,"num_read_kb":2294,"num_write":575,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'368","reported_seq":1053,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.897018+0000","last_change":"2024-09-12T17:10:30.351588+0000","last_active":"2024-09-12T18:36:01.897018+0000","last_peered":"2024-09-12T18:36:01.897018+0000","last_clean":"2024-09-12T18:36:01.897018+0000","last_became_active":"2024-09-12T17:10:30.351202+0000","last_became_peered":"2024-09-12T17:10:30.351202+0000","last_unstale":"2024-09-12T18:36:01.897018+0000","last_undegraded":"2024-09-12T18:36:01.897018+0000","last_fullsized":"2024-09-12T18:36:01.897018+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:24.152184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":96764,"num_write":1045,"num_write_kb":52334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'557","reported_seq":2193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.626934+0000","last_change":"2024-09-12T17:10:32.371846+0000","last_active":"2024-09-12T18:33:18.626934+0000","last_peered":"2024-09-12T18:33:18.626934+0000","last_clean":"2024-09-12T18:33:18.626934+0000","last_became_active":"2024-09-12T17:10:32.370962+0000","last_became_peered":"2024-09-12T17:10:32.370962+0000","last_unstale":"2024-09-12T18:33:18.626934+0000","last_undegraded":"2024-09-12T18:33:18.626934+0000","last_fullsized":"2024-09-12T18:33:18.626934+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:19.779809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2855,"num_read_kb":2656,"num_write":715,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'407","reported_seq":1133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.818224+0000","last_change":"2024-09-12T17:10:30.376632+0000","last_active":"2024-09-12T18:36:01.818224+0000","last_peered":"2024-09-12T18:36:01.818224+0000","last_clean":"2024-09-12T18:36:01.818224+0000","last_became_active":"2024-09-12T17:10:30.374789+0000","last_became_peered":"2024-09-12T17:10:30.374789+0000","last_unstale":"2024-09-12T18:36:01.818224+0000","last_undegraded":"2024-09-12T18:36:01.818224+0000","last_fullsized":"2024-09-12T18:36:01.818224+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:10.377494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267453,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":786,"num_read_kb":12016,"num_write":1261,"num_write_kb":48882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'284","reported_seq":1673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.928533+0000","last_change":"2024-09-12T17:10:32.357514+0000","last_active":"2024-09-12T18:33:59.928533+0000","last_peered":"2024-09-12T18:33:59.928533+0000","last_clean":"2024-09-12T18:33:59.928533+0000","last_became_active":"2024-09-12T17:10:32.357199+0000","last_became_peered":"2024-09-12T17:10:32.357199+0000","last_unstale":"2024-09-12T18:33:59.928533+0000","last_undegraded":"2024-09-12T18:33:59.928533+0000","last_fullsized":"2024-09-12T18:33:59.928533+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:17.757987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1623,"num_read_kb":1593,"num_write":300,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'311","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.847684+0000","last_change":"2024-09-12T17:10:30.387768+0000","last_active":"2024-09-12T18:36:01.847684+0000","last_peered":"2024-09-12T18:36:01.847684+0000","last_clean":"2024-09-12T18:36:01.847684+0000","last_became_active":"2024-09-12T17:10:30.385216+0000","last_became_peered":"2024-09-12T17:10:30.385216+0000","last_unstale":"2024-09-12T18:36:01.847684+0000","last_undegraded":"2024-09-12T18:36:01.847684+0000","last_fullsized":"2024-09-12T18:36:01.847684+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:48.266095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1826375,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":401,"num_read_kb":5414,"num_write":926,"num_write_kb":15383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'549","reported_seq":2122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.927415+0000","last_change":"2024-09-12T17:10:32.352752+0000","last_active":"2024-09-12T18:33:59.927415+0000","last_peered":"2024-09-12T18:33:59.927415+0000","last_clean":"2024-09-12T18:33:59.927415+0000","last_became_active":"2024-09-12T17:10:32.351972+0000","last_became_peered":"2024-09-12T17:10:32.351972+0000","last_unstale":"2024-09-12T18:33:59.927415+0000","last_undegraded":"2024-09-12T18:33:59.927415+0000","last_fullsized":"2024-09-12T18:33:59.927415+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:26.765589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2788,"num_read_kb":2550,"num_write":700,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'360","reported_seq":1012,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.872520+0000","last_change":"2024-09-12T17:10:30.362938+0000","last_active":"2024-09-12T18:36:01.872520+0000","last_peered":"2024-09-12T18:36:01.872520+0000","last_clean":"2024-09-12T18:36:01.872520+0000","last_became_active":"2024-09-12T17:10:30.350813+0000","last_became_peered":"2024-09-12T17:10:30.350813+0000","last_unstale":"2024-09-12T18:36:01.872520+0000","last_undegraded":"2024-09-12T18:36:01.872520+0000","last_fullsized":"2024-09-12T18:36:01.872520+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:45.963449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":527,"num_read_kb":3741,"num_write":1103,"num_write_kb":26406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'434","reported_seq":2148,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605409+0000","last_change":"2024-09-12T17:10:32.363876+0000","last_active":"2024-09-12T18:33:55.605409+0000","last_peered":"2024-09-12T18:33:55.605409+0000","last_clean":"2024-09-12T18:33:55.605409+0000","last_became_active":"2024-09-12T17:10:32.362980+0000","last_became_peered":"2024-09-12T17:10:32.362980+0000","last_unstale":"2024-09-12T18:33:55.605409+0000","last_undegraded":"2024-09-12T18:33:55.605409+0000","last_fullsized":"2024-09-12T18:33:55.605409+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:44.556208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2502,"num_read_kb":2403,"num_write":488,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'356","reported_seq":1253,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.808607+0000","last_change":"2024-09-12T17:11:04.871628+0000","last_active":"2024-09-12T18:36:01.808607+0000","last_peered":"2024-09-12T18:36:01.808607+0000","last_clean":"2024-09-12T18:36:01.808607+0000","last_became_active":"2024-09-12T17:11:04.870569+0000","last_became_peered":"2024-09-12T17:11:04.870569+0000","last_unstale":"2024-09-12T18:36:01.808607+0000","last_undegraded":"2024-09-12T18:36:01.808607+0000","last_fullsized":"2024-09-12T18:36:01.808607+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:14.018442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170424,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":989,"num_read_kb":89437,"num_write":1208,"num_write_kb":38550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'426","reported_seq":1941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.423534+0000","last_change":"2024-09-12T17:10:32.369695+0000","last_active":"2024-09-12T18:33:56.423534+0000","last_peered":"2024-09-12T18:33:56.423534+0000","last_clean":"2024-09-12T18:33:56.423534+0000","last_became_active":"2024-09-12T17:10:32.368909+0000","last_became_peered":"2024-09-12T17:10:32.368909+0000","last_unstale":"2024-09-12T18:33:56.423534+0000","last_undegraded":"2024-09-12T18:33:56.423534+0000","last_fullsized":"2024-09-12T18:33:56.423534+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:18.380922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2227,"num_read_kb":2101,"num_write":505,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'392","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.891431+0000","last_change":"2024-09-12T17:10:30.395510+0000","last_active":"2024-09-12T18:36:01.891431+0000","last_peered":"2024-09-12T18:36:01.891431+0000","last_clean":"2024-09-12T18:36:01.891431+0000","last_became_active":"2024-09-12T17:10:30.395061+0000","last_became_peered":"2024-09-12T17:10:30.395061+0000","last_unstale":"2024-09-12T18:36:01.891431+0000","last_undegraded":"2024-09-12T18:36:01.891431+0000","last_fullsized":"2024-09-12T18:36:01.891431+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:41.200923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194335,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":651,"num_read_kb":20153,"num_write":1153,"num_write_kb":23715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'421","reported_seq":1783,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.811554+0000","last_change":"2024-09-12T17:11:05.125681+0000","last_active":"2024-09-12T18:33:56.811554+0000","last_peered":"2024-09-12T18:33:56.811554+0000","last_clean":"2024-09-12T18:33:56.811554+0000","last_became_active":"2024-09-12T17:11:05.124718+0000","last_became_peered":"2024-09-12T17:11:05.124718+0000","last_unstale":"2024-09-12T18:33:56.811554+0000","last_undegraded":"2024-09-12T18:33:56.811554+0000","last_fullsized":"2024-09-12T18:33:56.811554+0000","mapping_epoch":38,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:17.850798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2066,"num_read_kb":1911,"num_write":507,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'652","reported_seq":2390,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.928419+0000","last_change":"2024-09-12T17:10:32.363944+0000","last_active":"2024-09-12T18:33:59.928419+0000","last_peered":"2024-09-12T18:33:59.928419+0000","last_clean":"2024-09-12T18:33:59.928419+0000","last_became_active":"2024-09-12T17:10:32.363179+0000","last_became_peered":"2024-09-12T17:10:32.363179+0000","last_unstale":"2024-09-12T18:33:59.928419+0000","last_undegraded":"2024-09-12T18:33:59.928419+0000","last_fullsized":"2024-09-12T18:33:59.928419+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":600,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:03.623272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3427,"num_read_kb":3148,"num_write":833,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'327","reported_seq":1013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.876284+0000","last_change":"2024-09-12T17:10:30.387578+0000","last_active":"2024-09-12T18:36:01.876284+0000","last_peered":"2024-09-12T18:36:01.876284+0000","last_clean":"2024-09-12T18:36:01.876284+0000","last_became_active":"2024-09-12T17:10:30.385785+0000","last_became_peered":"2024-09-12T17:10:30.385785+0000","last_unstale":"2024-09-12T18:36:01.876284+0000","last_undegraded":"2024-09-12T18:36:01.876284+0000","last_fullsized":"2024-09-12T18:36:01.876284+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:57.879527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":51060,"num_write":1041,"num_write_kb":34693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'508","reported_seq":2186,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.815743+0000","last_change":"2024-09-12T17:10:32.380268+0000","last_active":"2024-09-12T18:34:01.815743+0000","last_peered":"2024-09-12T18:34:01.815743+0000","last_clean":"2024-09-12T18:34:01.815743+0000","last_became_active":"2024-09-12T17:10:32.379669+0000","last_became_peered":"2024-09-12T17:10:32.379669+0000","last_unstale":"2024-09-12T18:34:01.815743+0000","last_undegraded":"2024-09-12T18:34:01.815743+0000","last_fullsized":"2024-09-12T18:34:01.815743+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:43.664634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2752,"num_read_kb":2572,"num_write":584,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'342","reported_seq":995,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.874725+0000","last_change":"2024-09-12T17:12:05.835283+0000","last_active":"2024-09-12T18:36:01.874725+0000","last_peered":"2024-09-12T18:36:01.874725+0000","last_clean":"2024-09-12T18:36:01.874725+0000","last_became_active":"2024-09-12T17:12:05.834873+0000","last_became_peered":"2024-09-12T17:12:05.834873+0000","last_unstale":"2024-09-12T18:36:01.874725+0000","last_undegraded":"2024-09-12T18:36:01.874725+0000","last_fullsized":"2024-09-12T18:36:01.874725+0000","mapping_epoch":40,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:29.427065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505043,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":40642,"num_write":1117,"num_write_kb":40250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"268'1939","reported_seq":3530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.814002+0000","last_change":"2024-09-12T17:10:32.359245+0000","last_active":"2024-09-12T18:34:01.814002+0000","last_peered":"2024-09-12T18:34:01.814002+0000","last_clean":"2024-09-12T18:34:01.814002+0000","last_became_active":"2024-09-12T17:10:32.358342+0000","last_became_peered":"2024-09-12T17:10:32.358342+0000","last_unstale":"2024-09-12T18:34:01.814002+0000","last_undegraded":"2024-09-12T18:34:01.814002+0000","last_fullsized":"2024-09-12T18:34:01.814002+0000","mapping_epoch":27,"log_start":"268'1900","ondisk_log_start":"268'1900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1900,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:01.927050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8411,"num_read_kb":7313,"num_write":2747,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'385","reported_seq":1041,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.881329+0000","last_change":"2024-09-12T17:10:30.401167+0000","last_active":"2024-09-12T18:36:01.881329+0000","last_peered":"2024-09-12T18:36:01.881329+0000","last_clean":"2024-09-12T18:36:01.881329+0000","last_became_active":"2024-09-12T17:10:30.395938+0000","last_became_peered":"2024-09-12T17:10:30.395938+0000","last_unstale":"2024-09-12T18:36:01.881329+0000","last_undegraded":"2024-09-12T18:36:01.881329+0000","last_fullsized":"2024-09-12T18:36:01.881329+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:51.897394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":529,"num_read_kb":40778,"num_write":1213,"num_write_kb":34948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'778","reported_seq":2224,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.797878+0000","last_change":"2024-09-12T17:10:32.354888+0000","last_active":"2024-09-12T18:32:46.797878+0000","last_peered":"2024-09-12T18:32:46.797878+0000","last_clean":"2024-09-12T18:32:46.797878+0000","last_became_active":"2024-09-12T17:10:32.354271+0000","last_became_peered":"2024-09-12T17:10:32.354271+0000","last_unstale":"2024-09-12T18:32:46.797878+0000","last_undegraded":"2024-09-12T18:32:46.797878+0000","last_fullsized":"2024-09-12T18:32:46.797878+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:40.309416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3730,"num_read_kb":3333,"num_write":1060,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'534","reported_seq":1283,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.756056+0000","last_change":"2024-09-12T17:10:30.396067+0000","last_active":"2024-09-12T18:36:01.756056+0000","last_peered":"2024-09-12T18:36:01.756056+0000","last_clean":"2024-09-12T18:36:01.756056+0000","last_became_active":"2024-09-12T17:10:30.394905+0000","last_became_peered":"2024-09-12T17:10:30.394905+0000","last_unstale":"2024-09-12T18:36:01.756056+0000","last_undegraded":"2024-09-12T18:36:01.756056+0000","last_fullsized":"2024-09-12T18:36:01.756056+0000","mapping_epoch":25,"log_start":"268'500","ondisk_log_start":"268'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:58.605567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4500387,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":948,"num_read_kb":40764,"num_write":1577,"num_write_kb":41950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'786","reported_seq":2379,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.627433+0000","last_change":"2024-09-12T17:10:32.372409+0000","last_active":"2024-09-12T18:33:18.627433+0000","last_peered":"2024-09-12T18:33:18.627433+0000","last_clean":"2024-09-12T18:33:18.627433+0000","last_became_active":"2024-09-12T17:10:32.372137+0000","last_became_peered":"2024-09-12T17:10:32.372137+0000","last_unstale":"2024-09-12T18:33:18.627433+0000","last_undegraded":"2024-09-12T18:33:18.627433+0000","last_fullsized":"2024-09-12T18:33:18.627433+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:07.405740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3748,"num_read_kb":3393,"num_write":1031,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'350","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.888615+0000","last_change":"2024-09-12T17:10:30.394449+0000","last_active":"2024-09-12T18:36:01.888615+0000","last_peered":"2024-09-12T18:36:01.888615+0000","last_clean":"2024-09-12T18:36:01.888615+0000","last_became_active":"2024-09-12T17:10:30.394096+0000","last_became_peered":"2024-09-12T17:10:30.394096+0000","last_unstale":"2024-09-12T18:36:01.888615+0000","last_undegraded":"2024-09-12T18:36:01.888615+0000","last_fullsized":"2024-09-12T18:36:01.888615+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:17.229735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399199,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":10350,"num_write":1046,"num_write_kb":23725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'862","reported_seq":2531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:45.588918+0000","last_change":"2024-09-12T17:10:32.361908+0000","last_active":"2024-09-12T18:32:45.588918+0000","last_peered":"2024-09-12T18:32:45.588918+0000","last_clean":"2024-09-12T18:32:45.588918+0000","last_became_active":"2024-09-12T17:10:32.361126+0000","last_became_peered":"2024-09-12T17:10:32.361126+0000","last_unstale":"2024-09-12T18:32:45.588918+0000","last_undegraded":"2024-09-12T18:32:45.588918+0000","last_fullsized":"2024-09-12T18:32:45.588918+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:09.763728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4216,"num_read_kb":3793,"num_write":1162,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'338","reported_seq":956,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.873954+0000","last_change":"2024-09-12T17:10:30.353547+0000","last_active":"2024-09-12T18:36:01.873954+0000","last_peered":"2024-09-12T18:36:01.873954+0000","last_clean":"2024-09-12T18:36:01.873954+0000","last_became_active":"2024-09-12T17:10:30.353147+0000","last_became_peered":"2024-09-12T17:10:30.353147+0000","last_unstale":"2024-09-12T18:36:01.873954+0000","last_undegraded":"2024-09-12T18:36:01.873954+0000","last_fullsized":"2024-09-12T18:36:01.873954+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:15.129856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":416,"num_read_kb":13692,"num_write":1012,"num_write_kb":32545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'134","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.133975+0000","last_change":"2024-09-12T17:10:40.422258+0000","last_active":"2024-09-12T18:34:02.133975+0000","last_peered":"2024-09-12T18:34:02.133975+0000","last_clean":"2024-09-12T18:34:02.133975+0000","last_became_active":"2024-09-12T17:10:40.421380+0000","last_became_peered":"2024-09-12T17:10:40.421380+0000","last_unstale":"2024-09-12T18:34:02.133975+0000","last_undegraded":"2024-09-12T18:34:02.133975+0000","last_fullsized":"2024-09-12T18:34:02.133975+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:26.392127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":207,"num_write":318,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'456","reported_seq":2070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.622792+0000","last_change":"2024-09-12T17:10:32.370396+0000","last_active":"2024-09-12T18:33:18.622792+0000","last_peered":"2024-09-12T18:33:18.622792+0000","last_clean":"2024-09-12T18:33:18.622792+0000","last_became_active":"2024-09-12T17:10:32.370058+0000","last_became_peered":"2024-09-12T17:10:32.370058+0000","last_unstale":"2024-09-12T18:33:18.622792+0000","last_undegraded":"2024-09-12T18:33:18.622792+0000","last_fullsized":"2024-09-12T18:33:18.622792+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:48.973947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2398,"num_read_kb":2269,"num_write":525,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'310","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.812475+0000","last_change":"2024-09-12T17:11:04.871757+0000","last_active":"2024-09-12T18:36:01.812475+0000","last_peered":"2024-09-12T18:36:01.812475+0000","last_clean":"2024-09-12T18:36:01.812475+0000","last_became_active":"2024-09-12T17:11:04.871007+0000","last_became_peered":"2024-09-12T17:11:04.871007+0000","last_unstale":"2024-09-12T18:36:01.812475+0000","last_undegraded":"2024-09-12T18:36:01.812475+0000","last_fullsized":"2024-09-12T18:36:01.812475+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:22.664826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":422,"num_read_kb":10233,"num_write":1020,"num_write_kb":32687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.407279+0000","last_change":"2024-09-12T17:10:34.371764+0000","last_active":"2024-09-12T18:32:46.407279+0000","last_peered":"2024-09-12T18:32:46.407279+0000","last_clean":"2024-09-12T18:32:46.407279+0000","last_became_active":"2024-09-12T17:10:34.371022+0000","last_became_peered":"2024-09-12T17:10:34.371022+0000","last_unstale":"2024-09-12T18:32:46.407279+0000","last_undegraded":"2024-09-12T18:32:46.407279+0000","last_fullsized":"2024-09-12T18:32:46.407279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:04.412145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'368","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.710533+0000","last_change":"2024-09-12T17:10:36.399853+0000","last_active":"2024-09-12T18:36:01.710533+0000","last_peered":"2024-09-12T18:36:01.710533+0000","last_clean":"2024-09-12T18:36:01.710533+0000","last_became_active":"2024-09-12T17:10:36.399464+0000","last_became_peered":"2024-09-12T17:10:36.399464+0000","last_unstale":"2024-09-12T18:36:01.710533+0000","last_undegraded":"2024-09-12T18:36:01.710533+0000","last_fullsized":"2024-09-12T18:36:01.710533+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:12.028942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49246,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":602,"num_read_kb":1286,"num_write":476,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.401248+0000","last_change":"2024-09-12T17:10:38.405144+0000","last_active":"2024-09-12T18:32:51.401248+0000","last_peered":"2024-09-12T18:32:51.401248+0000","last_clean":"2024-09-12T18:32:51.401248+0000","last_became_active":"2024-09-12T17:10:38.404423+0000","last_became_peered":"2024-09-12T17:10:38.404423+0000","last_unstale":"2024-09-12T18:32:51.401248+0000","last_undegraded":"2024-09-12T18:32:51.401248+0000","last_fullsized":"2024-09-12T18:32:51.401248+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:04.302118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'170","reported_seq":740,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.772365+0000","last_change":"2024-09-12T17:10:40.426221+0000","last_active":"2024-09-12T18:34:01.772365+0000","last_peered":"2024-09-12T18:34:01.772365+0000","last_clean":"2024-09-12T18:34:01.772365+0000","last_became_active":"2024-09-12T17:10:40.425532+0000","last_became_peered":"2024-09-12T17:10:40.425532+0000","last_unstale":"2024-09-12T18:34:01.772365+0000","last_undegraded":"2024-09-12T18:34:01.772365+0000","last_fullsized":"2024-09-12T18:34:01.772365+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:09.048645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":265,"num_read_kb":256,"num_write":326,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'733","reported_seq":2463,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.923583+0000","last_change":"2024-09-12T17:10:32.382421+0000","last_active":"2024-09-12T18:33:59.923583+0000","last_peered":"2024-09-12T18:33:59.923583+0000","last_clean":"2024-09-12T18:33:59.923583+0000","last_became_active":"2024-09-12T17:10:32.381838+0000","last_became_peered":"2024-09-12T17:10:32.381838+0000","last_unstale":"2024-09-12T18:33:59.923583+0000","last_undegraded":"2024-09-12T18:33:59.923583+0000","last_fullsized":"2024-09-12T18:33:59.923583+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:23.645321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3756,"num_read_kb":3395,"num_write":1068,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'387","reported_seq":1108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.848403+0000","last_change":"2024-09-12T17:10:30.362609+0000","last_active":"2024-09-12T18:36:01.848403+0000","last_peered":"2024-09-12T18:36:01.848403+0000","last_clean":"2024-09-12T18:36:01.848403+0000","last_became_active":"2024-09-12T17:10:30.362010+0000","last_became_peered":"2024-09-12T17:10:30.362010+0000","last_unstale":"2024-09-12T18:36:01.848403+0000","last_undegraded":"2024-09-12T18:36:01.848403+0000","last_fullsized":"2024-09-12T18:36:01.848403+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:57.522595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9667749,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":698,"num_read_kb":52712,"num_write":1418,"num_write_kb":39491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403196+0000","last_change":"2024-09-12T17:10:34.362183+0000","last_active":"2024-09-12T18:32:34.403196+0000","last_peered":"2024-09-12T18:32:34.403196+0000","last_clean":"2024-09-12T18:32:34.403196+0000","last_became_active":"2024-09-12T17:10:34.361102+0000","last_became_peered":"2024-09-12T17:10:34.361102+0000","last_unstale":"2024-09-12T18:32:34.403196+0000","last_undegraded":"2024-09-12T18:32:34.403196+0000","last_fullsized":"2024-09-12T18:32:34.403196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:20.467248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'110","reported_seq":666,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.590229+0000","last_change":"2024-09-12T17:10:36.391217+0000","last_active":"2024-09-12T18:32:50.590229+0000","last_peered":"2024-09-12T18:32:50.590229+0000","last_clean":"2024-09-12T18:32:50.590229+0000","last_became_active":"2024-09-12T17:10:36.390398+0000","last_became_peered":"2024-09-12T17:10:36.390398+0000","last_unstale":"2024-09-12T18:32:50.590229+0000","last_undegraded":"2024-09-12T18:32:50.590229+0000","last_fullsized":"2024-09-12T18:32:50.590229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:54.025550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.590198+0000","last_change":"2024-09-12T17:10:38.414637+0000","last_active":"2024-09-12T18:32:50.590198+0000","last_peered":"2024-09-12T18:32:50.590198+0000","last_clean":"2024-09-12T18:32:50.590198+0000","last_became_active":"2024-09-12T17:10:38.414063+0000","last_became_peered":"2024-09-12T17:10:38.414063+0000","last_unstale":"2024-09-12T18:32:50.590198+0000","last_undegraded":"2024-09-12T18:32:50.590198+0000","last_fullsized":"2024-09-12T18:32:50.590198+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:48.781233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'138","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.548387+0000","last_change":"2024-09-12T17:10:40.423061+0000","last_active":"2024-09-12T18:33:57.548387+0000","last_peered":"2024-09-12T18:33:57.548387+0000","last_clean":"2024-09-12T18:33:57.548387+0000","last_became_active":"2024-09-12T17:10:40.422118+0000","last_became_peered":"2024-09-12T17:10:40.422118+0000","last_unstale":"2024-09-12T18:33:57.548387+0000","last_undegraded":"2024-09-12T18:33:57.548387+0000","last_fullsized":"2024-09-12T18:33:57.548387+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:39.157083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":180,"num_write":349,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'871","reported_seq":2493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.814191+0000","last_change":"2024-09-12T17:10:32.352650+0000","last_active":"2024-09-12T18:34:01.814191+0000","last_peered":"2024-09-12T18:34:01.814191+0000","last_clean":"2024-09-12T18:34:01.814191+0000","last_became_active":"2024-09-12T17:10:32.351650+0000","last_became_peered":"2024-09-12T17:10:32.351650+0000","last_unstale":"2024-09-12T18:34:01.814191+0000","last_undegraded":"2024-09-12T18:34:01.814191+0000","last_fullsized":"2024-09-12T18:34:01.814191+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:03.003509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4313,"num_read_kb":3885,"num_write":1184,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'394","reported_seq":1129,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.776385+0000","last_change":"2024-09-12T17:10:30.394677+0000","last_active":"2024-09-12T18:36:01.776385+0000","last_peered":"2024-09-12T18:36:01.776385+0000","last_clean":"2024-09-12T18:36:01.776385+0000","last_became_active":"2024-09-12T17:10:30.393670+0000","last_became_peered":"2024-09-12T17:10:30.393670+0000","last_unstale":"2024-09-12T18:36:01.776385+0000","last_undegraded":"2024-09-12T18:36:01.776385+0000","last_fullsized":"2024-09-12T18:36:01.776385+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:39.112583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3976825,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":785,"num_read_kb":43186,"num_write":1227,"num_write_kb":22438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:44.406536+0000","last_change":"2024-09-12T17:10:34.358839+0000","last_active":"2024-09-12T18:32:44.406536+0000","last_peered":"2024-09-12T18:32:44.406536+0000","last_clean":"2024-09-12T18:32:44.406536+0000","last_became_active":"2024-09-12T17:10:34.358119+0000","last_became_peered":"2024-09-12T17:10:34.358119+0000","last_unstale":"2024-09-12T18:32:44.406536+0000","last_undegraded":"2024-09-12T18:32:44.406536+0000","last_fullsized":"2024-09-12T18:32:44.406536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:56.480463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'152","reported_seq":726,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.790757+0000","last_change":"2024-09-12T17:10:36.385198+0000","last_active":"2024-09-12T18:32:26.790757+0000","last_peered":"2024-09-12T18:32:26.790757+0000","last_clean":"2024-09-12T18:32:26.790757+0000","last_became_active":"2024-09-12T17:10:36.384465+0000","last_became_peered":"2024-09-12T17:10:36.384465+0000","last_unstale":"2024-09-12T18:32:26.790757+0000","last_undegraded":"2024-09-12T18:32:26.790757+0000","last_fullsized":"2024-09-12T18:32:26.790757+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:48.249397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":178,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'794","reported_seq":2920,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.179861+0000","last_change":"2024-09-12T17:10:38.407657+0000","last_active":"2024-09-12T18:36:01.179861+0000","last_peered":"2024-09-12T18:36:01.179861+0000","last_clean":"2024-09-12T18:36:01.179861+0000","last_became_active":"2024-09-12T17:10:38.406964+0000","last_became_peered":"2024-09-12T17:10:38.406964+0000","last_unstale":"2024-09-12T18:36:01.179861+0000","last_undegraded":"2024-09-12T18:36:01.179861+0000","last_fullsized":"2024-09-12T18:36:01.179861+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:41.454994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'254","reported_seq":1111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.224603+0000","last_change":"2024-09-12T17:10:40.769418+0000","last_active":"2024-09-12T18:34:02.224603+0000","last_peered":"2024-09-12T18:34:02.224603+0000","last_clean":"2024-09-12T18:34:02.224603+0000","last_became_active":"2024-09-12T17:10:40.768896+0000","last_became_peered":"2024-09-12T17:10:40.768896+0000","last_unstale":"2024-09-12T18:34:02.224603+0000","last_undegraded":"2024-09-12T18:34:02.224603+0000","last_fullsized":"2024-09-12T18:34:02.224603+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:14.019332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":705,"num_read_kb":685,"num_write":456,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'529","reported_seq":2333,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:13.722899+0000","last_change":"2024-09-12T17:10:32.383037+0000","last_active":"2024-09-12T18:33:13.722899+0000","last_peered":"2024-09-12T18:33:13.722899+0000","last_clean":"2024-09-12T18:33:13.722899+0000","last_became_active":"2024-09-12T17:10:32.382671+0000","last_became_peered":"2024-09-12T17:10:32.382671+0000","last_unstale":"2024-09-12T18:33:13.722899+0000","last_undegraded":"2024-09-12T18:33:13.722899+0000","last_fullsized":"2024-09-12T18:33:13.722899+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:57.340586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3129,"num_read_kb":2937,"num_write":633,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'384","reported_seq":1060,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.883462+0000","last_change":"2024-09-12T17:10:30.391255+0000","last_active":"2024-09-12T18:36:01.883462+0000","last_peered":"2024-09-12T18:36:01.883462+0000","last_clean":"2024-09-12T18:36:01.883462+0000","last_became_active":"2024-09-12T17:10:30.390677+0000","last_became_peered":"2024-09-12T17:10:30.390677+0000","last_unstale":"2024-09-12T18:36:01.883462+0000","last_undegraded":"2024-09-12T18:36:01.883462+0000","last_fullsized":"2024-09-12T18:36:01.883462+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:46.541083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262215,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":587,"num_read_kb":63186,"num_write":1131,"num_write_kb":46639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.407341+0000","last_change":"2024-09-12T17:10:34.373089+0000","last_active":"2024-09-12T18:32:46.407341+0000","last_peered":"2024-09-12T18:32:46.407341+0000","last_clean":"2024-09-12T18:32:46.407341+0000","last_became_active":"2024-09-12T17:10:34.371937+0000","last_became_peered":"2024-09-12T17:10:34.371937+0000","last_unstale":"2024-09-12T18:32:46.407341+0000","last_undegraded":"2024-09-12T18:32:46.407341+0000","last_fullsized":"2024-09-12T18:32:46.407341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:36.719820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'318","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.366440+0000","last_change":"2024-09-12T17:10:36.921222+0000","last_active":"2024-09-12T18:36:01.366440+0000","last_peered":"2024-09-12T18:36:01.366440+0000","last_clean":"2024-09-12T18:36:01.366440+0000","last_became_active":"2024-09-12T17:10:36.920487+0000","last_became_peered":"2024-09-12T17:10:36.920487+0000","last_unstale":"2024-09-12T18:36:01.366440+0000","last_undegraded":"2024-09-12T18:36:01.366440+0000","last_fullsized":"2024-09-12T18:36:01.366440+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:45.222423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46675,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":545,"num_read_kb":1308,"num_write":450,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'808","reported_seq":2816,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.886475+0000","last_change":"2024-09-12T17:10:38.398227+0000","last_active":"2024-09-12T18:36:01.886475+0000","last_peered":"2024-09-12T18:36:01.886475+0000","last_clean":"2024-09-12T18:36:01.886475+0000","last_became_active":"2024-09-12T17:10:38.393524+0000","last_became_peered":"2024-09-12T17:10:38.393524+0000","last_unstale":"2024-09-12T18:36:01.886475+0000","last_undegraded":"2024-09-12T18:36:01.886475+0000","last_fullsized":"2024-09-12T18:36:01.886475+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:55.682578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'401","reported_seq":1970,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.625087+0000","last_change":"2024-09-12T17:10:32.378803+0000","last_active":"2024-09-12T18:33:18.625087+0000","last_peered":"2024-09-12T18:33:18.625087+0000","last_clean":"2024-09-12T18:33:18.625087+0000","last_became_active":"2024-09-12T17:10:32.378027+0000","last_became_peered":"2024-09-12T17:10:32.378027+0000","last_unstale":"2024-09-12T18:33:18.625087+0000","last_undegraded":"2024-09-12T18:33:18.625087+0000","last_fullsized":"2024-09-12T18:33:18.625087+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:52.446776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2313,"num_read_kb":2218,"num_write":459,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'347","reported_seq":1018,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.870605+0000","last_change":"2024-09-12T17:10:30.387735+0000","last_active":"2024-09-12T18:36:01.870605+0000","last_peered":"2024-09-12T18:36:01.870605+0000","last_clean":"2024-09-12T18:36:01.870605+0000","last_became_active":"2024-09-12T17:10:30.386707+0000","last_became_peered":"2024-09-12T17:10:30.386707+0000","last_unstale":"2024-09-12T18:36:01.870605+0000","last_undegraded":"2024-09-12T18:36:01.870605+0000","last_fullsized":"2024-09-12T18:36:01.870605+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:19.438334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399029,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":531,"num_read_kb":31049,"num_write":1121,"num_write_kb":31528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.402246+0000","last_change":"2024-09-12T17:10:34.369825+0000","last_active":"2024-09-12T18:32:56.402246+0000","last_peered":"2024-09-12T18:32:56.402246+0000","last_clean":"2024-09-12T18:32:56.402246+0000","last_became_active":"2024-09-12T17:10:34.369066+0000","last_became_peered":"2024-09-12T17:10:34.369066+0000","last_unstale":"2024-09-12T18:32:56.402246+0000","last_undegraded":"2024-09-12T18:32:56.402246+0000","last_fullsized":"2024-09-12T18:32:56.402246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'385","reported_seq":1044,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.257475+0000","last_change":"2024-09-12T17:10:36.920855+0000","last_active":"2024-09-12T18:35:59.257475+0000","last_peered":"2024-09-12T18:35:59.257475+0000","last_clean":"2024-09-12T18:35:59.257475+0000","last_became_active":"2024-09-12T17:10:36.920136+0000","last_became_peered":"2024-09-12T17:10:36.920136+0000","last_unstale":"2024-09-12T18:35:59.257475+0000","last_undegraded":"2024-09-12T18:35:59.257475+0000","last_fullsized":"2024-09-12T18:35:59.257475+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:53.763125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54168,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":623,"num_read_kb":1195,"num_write":466,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.623483+0000","last_change":"2024-09-12T17:10:38.395526+0000","last_active":"2024-09-12T18:31:41.623483+0000","last_peered":"2024-09-12T18:31:41.623483+0000","last_clean":"2024-09-12T18:31:41.623483+0000","last_became_active":"2024-09-12T17:10:38.394381+0000","last_became_peered":"2024-09-12T17:10:38.394381+0000","last_unstale":"2024-09-12T18:31:41.623483+0000","last_undegraded":"2024-09-12T18:31:41.623483+0000","last_fullsized":"2024-09-12T18:31:41.623483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:07.549215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'531","reported_seq":1357,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.764323+0000","last_change":"2024-09-12T17:10:40.423104+0000","last_active":"2024-09-12T18:35:21.764323+0000","last_peered":"2024-09-12T18:35:21.764323+0000","last_clean":"2024-09-12T18:35:21.764323+0000","last_became_active":"2024-09-12T17:10:40.422353+0000","last_became_peered":"2024-09-12T17:10:40.422353+0000","last_unstale":"2024-09-12T18:35:21.764323+0000","last_undegraded":"2024-09-12T18:35:21.764323+0000","last_fullsized":"2024-09-12T18:35:21.764323+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:50.482047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1294,"num_read_kb":1291,"num_write":1098,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'422","reported_seq":2030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.510810+0000","last_change":"2024-09-12T17:10:32.370427+0000","last_active":"2024-09-12T18:33:01.510810+0000","last_peered":"2024-09-12T18:33:01.510810+0000","last_clean":"2024-09-12T18:33:01.510810+0000","last_became_active":"2024-09-12T17:10:32.369188+0000","last_became_peered":"2024-09-12T17:10:32.369188+0000","last_unstale":"2024-09-12T18:33:01.510810+0000","last_undegraded":"2024-09-12T18:33:01.510810+0000","last_fullsized":"2024-09-12T18:33:01.510810+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:45.905435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2274,"num_read_kb":2176,"num_write":482,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'333","reported_seq":1110,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.870611+0000","last_change":"2024-09-12T17:10:30.384287+0000","last_active":"2024-09-12T18:36:01.870611+0000","last_peered":"2024-09-12T18:36:01.870611+0000","last_clean":"2024-09-12T18:36:01.870611+0000","last_became_active":"2024-09-12T17:10:30.381728+0000","last_became_peered":"2024-09-12T17:10:30.381728+0000","last_unstale":"2024-09-12T18:36:01.870611+0000","last_undegraded":"2024-09-12T18:36:01.870611+0000","last_fullsized":"2024-09-12T18:36:01.870611+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:55.748760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399298,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":581,"num_read_kb":127583,"num_write":1019,"num_write_kb":57035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.799633+0000","last_change":"2024-09-12T17:10:34.346640+0000","last_active":"2024-09-12T18:32:56.799633+0000","last_peered":"2024-09-12T18:32:56.799633+0000","last_clean":"2024-09-12T18:32:56.799633+0000","last_became_active":"2024-09-12T17:10:34.346229+0000","last_became_peered":"2024-09-12T17:10:34.346229+0000","last_unstale":"2024-09-12T18:32:56.799633+0000","last_undegraded":"2024-09-12T18:32:56.799633+0000","last_fullsized":"2024-09-12T18:32:56.799633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:33.485742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'298","reported_seq":899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.554076+0000","last_change":"2024-09-12T17:10:36.399143+0000","last_active":"2024-09-12T18:36:00.554076+0000","last_peered":"2024-09-12T18:36:00.554076+0000","last_clean":"2024-09-12T18:36:00.554076+0000","last_became_active":"2024-09-12T17:10:36.398641+0000","last_became_peered":"2024-09-12T17:10:36.398641+0000","last_unstale":"2024-09-12T18:36:00.554076+0000","last_undegraded":"2024-09-12T18:36:00.554076+0000","last_fullsized":"2024-09-12T18:36:00.554076+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:50.236212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":1192,"num_write":410,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.414508+0000","last_change":"2024-09-12T17:10:38.395735+0000","last_active":"2024-09-12T18:33:19.414508+0000","last_peered":"2024-09-12T18:33:19.414508+0000","last_clean":"2024-09-12T18:33:19.414508+0000","last_became_active":"2024-09-12T17:10:38.393114+0000","last_became_peered":"2024-09-12T17:10:38.393114+0000","last_unstale":"2024-09-12T18:33:19.414508+0000","last_undegraded":"2024-09-12T18:33:19.414508+0000","last_fullsized":"2024-09-12T18:33:19.414508+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:32.570846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'2402","reported_seq":4243,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:21.599376+0000","last_change":"2024-09-12T17:10:40.426099+0000","last_active":"2024-09-12T18:34:21.599376+0000","last_peered":"2024-09-12T18:34:21.599376+0000","last_clean":"2024-09-12T18:34:21.599376+0000","last_became_active":"2024-09-12T17:10:40.425351+0000","last_became_peered":"2024-09-12T17:10:40.425351+0000","last_unstale":"2024-09-12T18:34:21.599376+0000","last_undegraded":"2024-09-12T18:34:21.599376+0000","last_fullsized":"2024-09-12T18:34:21.599376+0000","mapping_epoch":35,"log_start":"268'2300","ondisk_log_start":"268'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":2300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:37.392452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6030,"num_read_kb":6033,"num_write":4839,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'767","reported_seq":2271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:28.455307+0000","last_change":"2024-09-12T17:11:04.374050+0000","last_active":"2024-09-12T18:33:28.455307+0000","last_peered":"2024-09-12T18:33:28.455307+0000","last_clean":"2024-09-12T18:33:28.455307+0000","last_became_active":"2024-09-12T17:11:04.373050+0000","last_became_peered":"2024-09-12T17:11:04.373050+0000","last_unstale":"2024-09-12T18:33:28.455307+0000","last_undegraded":"2024-09-12T18:33:28.455307+0000","last_fullsized":"2024-09-12T18:33:28.455307+0000","mapping_epoch":38,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:03.588680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3705,"num_read_kb":3333,"num_write":1034,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'339","reported_seq":1014,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.877883+0000","last_change":"2024-09-12T17:10:30.382937+0000","last_active":"2024-09-12T18:36:01.877883+0000","last_peered":"2024-09-12T18:36:01.877883+0000","last_clean":"2024-09-12T18:36:01.877883+0000","last_became_active":"2024-09-12T17:10:30.381997+0000","last_became_peered":"2024-09-12T17:10:30.381997+0000","last_unstale":"2024-09-12T18:36:01.877883+0000","last_undegraded":"2024-09-12T18:36:01.877883+0000","last_fullsized":"2024-09-12T18:36:01.877883+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:26.528780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":534,"num_read_kb":9738,"num_write":1109,"num_write_kb":58445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.810382+0000","last_change":"2024-09-12T17:10:34.359567+0000","last_active":"2024-09-12T18:33:51.810382+0000","last_peered":"2024-09-12T18:33:51.810382+0000","last_clean":"2024-09-12T18:33:51.810382+0000","last_became_active":"2024-09-12T17:10:34.358798+0000","last_became_peered":"2024-09-12T17:10:34.358798+0000","last_unstale":"2024-09-12T18:33:51.810382+0000","last_undegraded":"2024-09-12T18:33:51.810382+0000","last_fullsized":"2024-09-12T18:33:51.810382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'350","reported_seq":977,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.478205+0000","last_change":"2024-09-12T17:10:36.397286+0000","last_active":"2024-09-12T18:35:59.478205+0000","last_peered":"2024-09-12T18:35:59.478205+0000","last_clean":"2024-09-12T18:35:59.478205+0000","last_became_active":"2024-09-12T17:10:36.396261+0000","last_became_peered":"2024-09-12T17:10:36.396261+0000","last_unstale":"2024-09-12T18:35:59.478205+0000","last_undegraded":"2024-09-12T18:35:59.478205+0000","last_fullsized":"2024-09-12T18:35:59.478205+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:04.653529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49048,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1254,"num_write":464,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'801","reported_seq":2782,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.620402+0000","last_change":"2024-09-12T17:10:38.409388+0000","last_active":"2024-09-12T18:36:00.620402+0000","last_peered":"2024-09-12T18:36:00.620402+0000","last_clean":"2024-09-12T18:36:00.620402+0000","last_became_active":"2024-09-12T17:10:38.408710+0000","last_became_peered":"2024-09-12T17:10:38.408710+0000","last_unstale":"2024-09-12T18:36:00.620402+0000","last_undegraded":"2024-09-12T18:36:00.620402+0000","last_fullsized":"2024-09-12T18:36:00.620402+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:10.552245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'126","reported_seq":639,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.149525+0000","last_change":"2024-09-12T17:10:40.423220+0000","last_active":"2024-09-12T18:35:20.149525+0000","last_peered":"2024-09-12T18:35:20.149525+0000","last_clean":"2024-09-12T18:35:20.149525+0000","last_became_active":"2024-09-12T17:10:40.417664+0000","last_became_peered":"2024-09-12T17:10:40.417664+0000","last_unstale":"2024-09-12T18:35:20.149525+0000","last_undegraded":"2024-09-12T18:35:20.149525+0000","last_fullsized":"2024-09-12T18:35:20.149525+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:22.188666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":285,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'884","reported_seq":2345,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.531263+0000","last_change":"2024-09-12T17:10:32.365377+0000","last_active":"2024-09-12T18:35:20.531263+0000","last_peered":"2024-09-12T18:35:20.531263+0000","last_clean":"2024-09-12T18:35:20.531263+0000","last_became_active":"2024-09-12T17:10:32.364995+0000","last_became_peered":"2024-09-12T17:10:32.364995+0000","last_unstale":"2024-09-12T18:35:20.531263+0000","last_undegraded":"2024-09-12T18:35:20.531263+0000","last_fullsized":"2024-09-12T18:35:20.531263+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":800,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4158,"num_read_kb":3733,"num_write":1245,"num_write_kb":492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'333","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.848352+0000","last_change":"2024-09-12T17:10:30.394063+0000","last_active":"2024-09-12T18:36:01.848352+0000","last_peered":"2024-09-12T18:36:01.848352+0000","last_clean":"2024-09-12T18:36:01.848352+0000","last_became_active":"2024-09-12T17:10:30.393495+0000","last_became_peered":"2024-09-12T17:10:30.393495+0000","last_unstale":"2024-09-12T18:36:01.848352+0000","last_undegraded":"2024-09-12T18:36:01.848352+0000","last_fullsized":"2024-09-12T18:36:01.848352+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:24.386647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170230,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":492,"num_read_kb":51876,"num_write":985,"num_write_kb":56464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.801736+0000","last_change":"2024-09-12T17:10:34.361146+0000","last_active":"2024-09-12T18:33:06.801736+0000","last_peered":"2024-09-12T18:33:06.801736+0000","last_clean":"2024-09-12T18:33:06.801736+0000","last_became_active":"2024-09-12T17:10:34.360732+0000","last_became_peered":"2024-09-12T17:10:34.360732+0000","last_unstale":"2024-09-12T18:33:06.801736+0000","last_undegraded":"2024-09-12T18:33:06.801736+0000","last_fullsized":"2024-09-12T18:33:06.801736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:35.010373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'511","reported_seq":1177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.844836+0000","last_change":"2024-09-12T17:10:36.400168+0000","last_active":"2024-09-12T18:36:00.844836+0000","last_peered":"2024-09-12T18:36:00.844836+0000","last_clean":"2024-09-12T18:36:00.844836+0000","last_became_active":"2024-09-12T17:10:36.399536+0000","last_became_peered":"2024-09-12T17:10:36.399536+0000","last_unstale":"2024-09-12T18:36:00.844836+0000","last_undegraded":"2024-09-12T18:36:00.844836+0000","last_fullsized":"2024-09-12T18:36:00.844836+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:17.679689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89531,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":886,"num_read_kb":2156,"num_write":724,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.800568+0000","last_change":"2024-09-12T17:10:38.405811+0000","last_active":"2024-09-12T18:33:01.800568+0000","last_peered":"2024-09-12T18:33:01.800568+0000","last_clean":"2024-09-12T18:33:01.800568+0000","last_became_active":"2024-09-12T17:10:38.405169+0000","last_became_peered":"2024-09-12T17:10:38.405169+0000","last_unstale":"2024-09-12T18:33:01.800568+0000","last_undegraded":"2024-09-12T18:33:01.800568+0000","last_fullsized":"2024-09-12T18:33:01.800568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:36.239505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'149","reported_seq":749,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642360+0000","last_change":"2024-09-12T17:10:40.410614+0000","last_active":"2024-09-12T18:33:01.642360+0000","last_peered":"2024-09-12T18:33:01.642360+0000","last_clean":"2024-09-12T18:33:01.642360+0000","last_became_active":"2024-09-12T17:10:40.409722+0000","last_became_peered":"2024-09-12T17:10:40.409722+0000","last_unstale":"2024-09-12T18:33:01.642360+0000","last_undegraded":"2024-09-12T18:33:01.642360+0000","last_fullsized":"2024-09-12T18:33:01.642360+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:32.816448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":508,"num_read_kb":430,"num_write":364,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'823","reported_seq":2341,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.604185+0000","last_change":"2024-09-12T17:10:32.371896+0000","last_active":"2024-09-12T18:33:50.604185+0000","last_peered":"2024-09-12T18:33:50.604185+0000","last_clean":"2024-09-12T18:33:50.604185+0000","last_became_active":"2024-09-12T17:10:32.370915+0000","last_became_peered":"2024-09-12T17:10:32.370915+0000","last_unstale":"2024-09-12T18:33:50.604185+0000","last_undegraded":"2024-09-12T18:33:50.604185+0000","last_fullsized":"2024-09-12T18:33:50.604185+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:10.387733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3877,"num_read_kb":3457,"num_write":1088,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'360","reported_seq":1017,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.859921+0000","last_change":"2024-09-12T17:11:04.869761+0000","last_active":"2024-09-12T18:36:01.859921+0000","last_peered":"2024-09-12T18:36:01.859921+0000","last_clean":"2024-09-12T18:36:01.859921+0000","last_became_active":"2024-09-12T17:11:04.868662+0000","last_became_peered":"2024-09-12T17:11:04.868662+0000","last_unstale":"2024-09-12T18:36:01.859921+0000","last_undegraded":"2024-09-12T18:36:01.859921+0000","last_fullsized":"2024-09-12T18:36:01.859921+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:32.791583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456511,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":553,"num_read_kb":17196,"num_write":1231,"num_write_kb":37960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.810457+0000","last_change":"2024-09-12T17:10:34.364569+0000","last_active":"2024-09-12T18:33:51.810457+0000","last_peered":"2024-09-12T18:33:51.810457+0000","last_clean":"2024-09-12T18:33:51.810457+0000","last_became_active":"2024-09-12T17:10:34.363822+0000","last_became_peered":"2024-09-12T17:10:34.363822+0000","last_unstale":"2024-09-12T18:33:51.810457+0000","last_undegraded":"2024-09-12T18:33:51.810457+0000","last_fullsized":"2024-09-12T18:33:51.810457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'304","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.923423+0000","last_change":"2024-09-12T17:10:36.378654+0000","last_active":"2024-09-12T18:36:00.923423+0000","last_peered":"2024-09-12T18:36:00.923423+0000","last_clean":"2024-09-12T18:36:00.923423+0000","last_became_active":"2024-09-12T17:10:36.377677+0000","last_became_peered":"2024-09-12T17:10:36.377677+0000","last_unstale":"2024-09-12T18:36:00.923423+0000","last_undegraded":"2024-09-12T18:36:00.923423+0000","last_fullsized":"2024-09-12T18:36:00.923423+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:08.577663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50917,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":528,"num_read_kb":1122,"num_write":460,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.400571+0000","last_change":"2024-09-12T17:10:38.414306+0000","last_active":"2024-09-12T18:31:56.400571+0000","last_peered":"2024-09-12T18:31:56.400571+0000","last_clean":"2024-09-12T18:31:56.400571+0000","last_became_active":"2024-09-12T17:10:38.413429+0000","last_became_peered":"2024-09-12T17:10:38.413429+0000","last_unstale":"2024-09-12T18:31:56.400571+0000","last_undegraded":"2024-09-12T18:31:56.400571+0000","last_fullsized":"2024-09-12T18:31:56.400571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:21.822547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'113","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:04.436186+0000","last_change":"2024-09-12T17:10:40.416006+0000","last_active":"2024-09-12T18:35:04.436186+0000","last_peered":"2024-09-12T18:35:04.436186+0000","last_clean":"2024-09-12T18:35:04.436186+0000","last_became_active":"2024-09-12T17:10:40.415270+0000","last_became_peered":"2024-09-12T17:10:40.415270+0000","last_unstale":"2024-09-12T18:35:04.436186+0000","last_undegraded":"2024-09-12T18:35:04.436186+0000","last_fullsized":"2024-09-12T18:35:04.436186+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:27.216064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":272,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'511","reported_seq":2175,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.529737+0000","last_change":"2024-09-12T17:10:32.357942+0000","last_active":"2024-09-12T18:35:20.529737+0000","last_peered":"2024-09-12T18:35:20.529737+0000","last_clean":"2024-09-12T18:35:20.529737+0000","last_became_active":"2024-09-12T17:10:32.357121+0000","last_became_peered":"2024-09-12T17:10:32.357121+0000","last_unstale":"2024-09-12T18:35:20.529737+0000","last_undegraded":"2024-09-12T18:35:20.529737+0000","last_fullsized":"2024-09-12T18:35:20.529737+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:38.419513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2802,"num_read_kb":2611,"num_write":616,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'390","reported_seq":1073,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.870454+0000","last_change":"2024-09-12T17:10:30.392231+0000","last_active":"2024-09-12T18:36:01.870454+0000","last_peered":"2024-09-12T18:36:01.870454+0000","last_clean":"2024-09-12T18:36:01.870454+0000","last_became_active":"2024-09-12T17:10:30.391780+0000","last_became_peered":"2024-09-12T17:10:30.391780+0000","last_unstale":"2024-09-12T18:36:01.870454+0000","last_undegraded":"2024-09-12T18:36:01.870454+0000","last_fullsized":"2024-09-12T18:36:01.870454+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:06.306117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170426,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":660,"num_read_kb":4836,"num_write":1182,"num_write_kb":23965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.653587+0000","last_change":"2024-09-12T17:10:34.363001+0000","last_active":"2024-09-12T18:33:51.653587+0000","last_peered":"2024-09-12T18:33:51.653587+0000","last_clean":"2024-09-12T18:33:51.653587+0000","last_became_active":"2024-09-12T17:10:34.362337+0000","last_became_peered":"2024-09-12T17:10:34.362337+0000","last_unstale":"2024-09-12T18:33:51.653587+0000","last_undegraded":"2024-09-12T18:33:51.653587+0000","last_fullsized":"2024-09-12T18:33:51.653587+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'341","reported_seq":971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.253897+0000","last_change":"2024-09-12T17:10:36.390545+0000","last_active":"2024-09-12T18:36:00.253897+0000","last_peered":"2024-09-12T18:36:00.253897+0000","last_clean":"2024-09-12T18:36:00.253897+0000","last_became_active":"2024-09-12T17:10:36.389965+0000","last_became_peered":"2024-09-12T17:10:36.389965+0000","last_unstale":"2024-09-12T18:36:00.253897+0000","last_undegraded":"2024-09-12T18:36:00.253897+0000","last_fullsized":"2024-09-12T18:36:00.253897+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:10.492872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60342,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":574,"num_read_kb":1242,"num_write":452,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'766","reported_seq":6960,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.064132+0000","last_change":"2024-09-12T17:10:38.398211+0000","last_active":"2024-09-12T18:36:00.064132+0000","last_peered":"2024-09-12T18:36:00.064132+0000","last_clean":"2024-09-12T18:36:00.064132+0000","last_became_active":"2024-09-12T17:10:38.397332+0000","last_became_peered":"2024-09-12T17:10:38.397332+0000","last_unstale":"2024-09-12T18:36:00.064132+0000","last_undegraded":"2024-09-12T18:36:00.064132+0000","last_fullsized":"2024-09-12T18:36:00.064132+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:01.068948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'149","reported_seq":674,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.655871+0000","last_change":"2024-09-12T17:10:40.424715+0000","last_active":"2024-09-12T18:34:01.655871+0000","last_peered":"2024-09-12T18:34:01.655871+0000","last_clean":"2024-09-12T18:34:01.655871+0000","last_became_active":"2024-09-12T17:10:40.423894+0000","last_became_peered":"2024-09-12T17:10:40.423894+0000","last_unstale":"2024-09-12T18:34:01.655871+0000","last_undegraded":"2024-09-12T18:34:01.655871+0000","last_fullsized":"2024-09-12T18:34:01.655871+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1683,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":214,"num_read_kb":204,"num_write":362,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'506","reported_seq":2220,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.527145+0000","last_change":"2024-09-12T17:10:32.362015+0000","last_active":"2024-09-12T18:35:20.527145+0000","last_peered":"2024-09-12T18:35:20.527145+0000","last_clean":"2024-09-12T18:35:20.527145+0000","last_became_active":"2024-09-12T17:10:32.361164+0000","last_became_peered":"2024-09-12T17:10:32.361164+0000","last_unstale":"2024-09-12T18:35:20.527145+0000","last_undegraded":"2024-09-12T18:35:20.527145+0000","last_fullsized":"2024-09-12T18:35:20.527145+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:51.658105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2673,"num_read_kb":2535,"num_write":607,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'391","reported_seq":1122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.870698+0000","last_change":"2024-09-12T17:10:30.362031+0000","last_active":"2024-09-12T18:36:01.870698+0000","last_peered":"2024-09-12T18:36:01.870698+0000","last_clean":"2024-09-12T18:36:01.870698+0000","last_became_active":"2024-09-12T17:10:30.361126+0000","last_became_peered":"2024-09-12T17:10:30.361126+0000","last_unstale":"2024-09-12T18:36:01.870698+0000","last_undegraded":"2024-09-12T18:36:01.870698+0000","last_fullsized":"2024-09-12T18:36:01.870698+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:31.446390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8882037,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":691,"num_read_kb":57357,"num_write":1297,"num_write_kb":69062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1477,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:58.765520+0000","last_change":"2024-09-12T17:10:34.371001+0000","last_active":"2024-09-12T18:35:58.765520+0000","last_peered":"2024-09-12T18:35:58.765520+0000","last_clean":"2024-09-12T18:35:58.765520+0000","last_became_active":"2024-09-12T17:10:34.367608+0000","last_became_peered":"2024-09-12T17:10:34.367608+0000","last_unstale":"2024-09-12T18:35:58.765520+0000","last_undegraded":"2024-09-12T18:35:58.765520+0000","last_fullsized":"2024-09-12T18:35:58.765520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:28.182336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'122","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:39.390262+0000","last_change":"2024-09-12T17:10:36.922117+0000","last_active":"2024-09-12T18:31:39.390262+0000","last_peered":"2024-09-12T18:31:39.390262+0000","last_clean":"2024-09-12T18:31:39.390262+0000","last_became_active":"2024-09-12T17:10:36.921242+0000","last_became_peered":"2024-09-12T17:10:36.921242+0000","last_unstale":"2024-09-12T18:31:39.390262+0000","last_undegraded":"2024-09-12T18:31:39.390262+0000","last_fullsized":"2024-09-12T18:31:39.390262+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:20.309744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'781","reported_seq":2886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.639534+0000","last_change":"2024-09-12T17:10:38.398167+0000","last_active":"2024-09-12T18:36:00.639534+0000","last_peered":"2024-09-12T18:36:00.639534+0000","last_clean":"2024-09-12T18:36:00.639534+0000","last_became_active":"2024-09-12T17:10:38.397242+0000","last_became_peered":"2024-09-12T17:10:38.397242+0000","last_unstale":"2024-09-12T18:36:00.639534+0000","last_undegraded":"2024-09-12T18:36:00.639534+0000","last_fullsized":"2024-09-12T18:36:00.639534+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:54.313987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'138","reported_seq":655,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.606436+0000","last_change":"2024-09-12T17:10:40.420601+0000","last_active":"2024-09-12T18:34:00.606436+0000","last_peered":"2024-09-12T18:34:00.606436+0000","last_clean":"2024-09-12T18:34:00.606436+0000","last_became_active":"2024-09-12T17:10:40.415831+0000","last_became_peered":"2024-09-12T17:10:40.415831+0000","last_unstale":"2024-09-12T18:34:00.606436+0000","last_undegraded":"2024-09-12T18:34:00.606436+0000","last_fullsized":"2024-09-12T18:34:00.606436+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:03.855689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":150,"num_write":326,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'562","reported_seq":2078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.813907+0000","last_change":"2024-09-12T17:10:32.367243+0000","last_active":"2024-09-12T18:34:01.813907+0000","last_peered":"2024-09-12T18:34:01.813907+0000","last_clean":"2024-09-12T18:34:01.813907+0000","last_became_active":"2024-09-12T17:10:32.366967+0000","last_became_peered":"2024-09-12T17:10:32.366967+0000","last_unstale":"2024-09-12T18:34:01.813907+0000","last_undegraded":"2024-09-12T18:34:01.813907+0000","last_fullsized":"2024-09-12T18:34:01.813907+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:36.021339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2878,"num_read_kb":2622,"num_write":716,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'383","reported_seq":1067,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.851695+0000","last_change":"2024-09-12T17:10:30.360774+0000","last_active":"2024-09-12T18:36:01.851695+0000","last_peered":"2024-09-12T18:36:01.851695+0000","last_clean":"2024-09-12T18:36:01.851695+0000","last_became_active":"2024-09-12T17:10:30.360368+0000","last_became_peered":"2024-09-12T17:10:30.360368+0000","last_unstale":"2024-09-12T18:36:01.851695+0000","last_undegraded":"2024-09-12T18:36:01.851695+0000","last_fullsized":"2024-09-12T18:36:01.851695+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:43.197601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4303946,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":608,"num_read_kb":11061,"num_write":1240,"num_write_kb":24095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.604284+0000","last_change":"2024-09-12T17:10:34.354809+0000","last_active":"2024-09-12T18:33:50.604284+0000","last_peered":"2024-09-12T18:33:50.604284+0000","last_clean":"2024-09-12T18:33:50.604284+0000","last_became_active":"2024-09-12T17:10:34.354009+0000","last_became_peered":"2024-09-12T17:10:34.354009+0000","last_unstale":"2024-09-12T18:33:50.604284+0000","last_undegraded":"2024-09-12T18:33:50.604284+0000","last_fullsized":"2024-09-12T18:33:50.604284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:37.358212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'378","reported_seq":1027,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.781946+0000","last_change":"2024-09-12T17:10:36.393717+0000","last_active":"2024-09-12T18:36:01.781946+0000","last_peered":"2024-09-12T18:36:01.781946+0000","last_clean":"2024-09-12T18:36:01.781946+0000","last_became_active":"2024-09-12T17:10:36.392271+0000","last_became_peered":"2024-09-12T17:10:36.392271+0000","last_unstale":"2024-09-12T18:36:01.781946+0000","last_undegraded":"2024-09-12T18:36:01.781946+0000","last_fullsized":"2024-09-12T18:36:01.781946+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:38.244171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45147,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":615,"num_read_kb":1214,"num_write":468,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.565485+0000","last_change":"2024-09-12T17:10:38.399541+0000","last_active":"2024-09-12T18:31:41.565485+0000","last_peered":"2024-09-12T18:31:41.565485+0000","last_clean":"2024-09-12T18:31:41.565485+0000","last_became_active":"2024-09-12T17:10:38.398743+0000","last_became_peered":"2024-09-12T17:10:38.398743+0000","last_unstale":"2024-09-12T18:31:41.565485+0000","last_undegraded":"2024-09-12T18:31:41.565485+0000","last_fullsized":"2024-09-12T18:31:41.565485+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:42.789598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'104","reported_seq":614,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.655927+0000","last_change":"2024-09-12T17:10:40.411608+0000","last_active":"2024-09-12T18:34:01.655927+0000","last_peered":"2024-09-12T18:34:01.655927+0000","last_clean":"2024-09-12T18:34:01.655927+0000","last_became_active":"2024-09-12T17:10:40.410710+0000","last_became_peered":"2024-09-12T17:10:40.410710+0000","last_unstale":"2024-09-12T18:34:01.655927+0000","last_undegraded":"2024-09-12T18:34:01.655927+0000","last_fullsized":"2024-09-12T18:34:01.655927+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":239,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'447","reported_seq":2001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:59.059999+0000","last_change":"2024-09-12T17:10:32.367439+0000","last_active":"2024-09-12T18:32:59.059999+0000","last_peered":"2024-09-12T18:32:59.059999+0000","last_clean":"2024-09-12T18:32:59.059999+0000","last_became_active":"2024-09-12T17:10:32.366571+0000","last_became_peered":"2024-09-12T17:10:32.366571+0000","last_unstale":"2024-09-12T18:32:59.059999+0000","last_undegraded":"2024-09-12T18:32:59.059999+0000","last_fullsized":"2024-09-12T18:32:59.059999+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:11.374807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2259,"num_read_kb":2146,"num_write":500,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.398388+0000","last_change":"2024-09-12T17:10:13.025471+0000","last_active":"2024-09-12T18:32:41.398388+0000","last_peered":"2024-09-12T18:32:41.398388+0000","last_clean":"2024-09-12T18:32:41.398388+0000","last_became_active":"2024-09-12T17:10:13.024652+0000","last_became_peered":"2024-09-12T17:10:13.024652+0000","last_unstale":"2024-09-12T18:32:41.398388+0000","last_undegraded":"2024-09-12T18:32:41.398388+0000","last_fullsized":"2024-09-12T18:32:41.398388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:11.999189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:11.999189+0000","last_clean_scrub_stamp":"2024-09-12T17:10:11.999189+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:01.776648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.420031+0000","last_change":"2024-09-12T17:10:20.094438+0000","last_active":"2024-09-12T18:33:41.420031+0000","last_peered":"2024-09-12T18:33:41.420031+0000","last_clean":"2024-09-12T18:33:41.420031+0000","last_became_active":"2024-09-12T17:10:18.073547+0000","last_became_peered":"2024-09-12T17:10:18.073547+0000","last_unstale":"2024-09-12T18:33:41.420031+0000","last_undegraded":"2024-09-12T18:33:41.420031+0000","last_fullsized":"2024-09-12T18:33:41.420031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:46.358663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010552039999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'325","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.870417+0000","last_change":"2024-09-12T17:10:30.395390+0000","last_active":"2024-09-12T18:36:01.870417+0000","last_peered":"2024-09-12T18:36:01.870417+0000","last_clean":"2024-09-12T18:36:01.870417+0000","last_became_active":"2024-09-12T17:10:30.395026+0000","last_became_peered":"2024-09-12T17:10:30.395026+0000","last_unstale":"2024-09-12T18:36:01.870417+0000","last_undegraded":"2024-09-12T18:36:01.870417+0000","last_fullsized":"2024-09-12T18:36:01.870417+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:10.168440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048618,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":151053,"num_write":1004,"num_write_kb":34461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"37'3","reported_seq":1004,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:58.995249+0000","last_change":"2024-09-12T17:10:34.364363+0000","last_active":"2024-09-12T18:35:58.995249+0000","last_peered":"2024-09-12T18:35:58.995249+0000","last_clean":"2024-09-12T18:35:58.995249+0000","last_became_active":"2024-09-12T17:10:34.363615+0000","last_became_peered":"2024-09-12T17:10:34.363615+0000","last_unstale":"2024-09-12T18:35:58.995249+0000","last_undegraded":"2024-09-12T18:35:58.995249+0000","last_fullsized":"2024-09-12T18:35:58.995249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:00.136965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":734,"num_read_kb":732,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'753","reported_seq":1483,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.913310+0000","last_change":"2024-09-12T17:10:36.395832+0000","last_active":"2024-09-12T18:36:01.913310+0000","last_peered":"2024-09-12T18:36:01.913310+0000","last_clean":"2024-09-12T18:36:01.913310+0000","last_became_active":"2024-09-12T17:10:36.395060+0000","last_became_peered":"2024-09-12T17:10:36.395060+0000","last_unstale":"2024-09-12T18:36:01.913310+0000","last_undegraded":"2024-09-12T18:36:01.913310+0000","last_fullsized":"2024-09-12T18:36:01.913310+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:34.192269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142312,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1468,"num_read_kb":3324,"num_write":1428,"num_write_kb":1256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.413770+0000","last_change":"2024-09-12T17:10:38.413654+0000","last_active":"2024-09-12T18:33:01.413770+0000","last_peered":"2024-09-12T18:33:01.413770+0000","last_clean":"2024-09-12T18:33:01.413770+0000","last_became_active":"2024-09-12T17:10:38.413042+0000","last_became_peered":"2024-09-12T17:10:38.413042+0000","last_unstale":"2024-09-12T18:33:01.413770+0000","last_undegraded":"2024-09-12T18:33:01.413770+0000","last_fullsized":"2024-09-12T18:33:01.413770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:03.626589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'214","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.891133+0000","last_change":"2024-09-12T17:10:40.416972+0000","last_active":"2024-09-12T18:34:01.891133+0000","last_peered":"2024-09-12T18:34:01.891133+0000","last_clean":"2024-09-12T18:34:01.891133+0000","last_became_active":"2024-09-12T17:10:40.413341+0000","last_became_peered":"2024-09-12T17:10:40.413341+0000","last_unstale":"2024-09-12T18:34:01.891133+0000","last_undegraded":"2024-09-12T18:34:01.891133+0000","last_fullsized":"2024-09-12T18:34:01.891133+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:47.293584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":511,"num_write":461,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'391","reported_seq":1829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.412715+0000","last_change":"2024-09-12T17:10:32.365399+0000","last_active":"2024-09-12T18:32:56.412715+0000","last_peered":"2024-09-12T18:32:56.412715+0000","last_clean":"2024-09-12T18:32:56.412715+0000","last_became_active":"2024-09-12T17:10:32.364798+0000","last_became_peered":"2024-09-12T17:10:32.364798+0000","last_unstale":"2024-09-12T18:32:56.412715+0000","last_undegraded":"2024-09-12T18:32:56.412715+0000","last_fullsized":"2024-09-12T18:32:56.412715+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:26.942345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2015,"num_read_kb":1907,"num_write":451,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.399689+0000","last_change":"2024-09-12T17:10:20.396952+0000","last_active":"2024-09-12T18:32:46.399689+0000","last_peered":"2024-09-12T18:32:46.399689+0000","last_clean":"2024-09-12T18:32:46.399689+0000","last_became_active":"2024-09-12T17:10:18.073016+0000","last_became_peered":"2024-09-12T17:10:18.073016+0000","last_unstale":"2024-09-12T18:32:46.399689+0000","last_undegraded":"2024-09-12T18:32:46.399689+0000","last_fullsized":"2024-09-12T18:32:46.399689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:57.171583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098613699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'345","reported_seq":1030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:05.576045+0000","last_change":"2024-09-12T18:36:05.576045+0000","last_active":"2024-09-12T18:36:05.576045+0000","last_peered":"2024-09-12T18:36:05.576045+0000","last_clean":"2024-09-12T18:36:05.576045+0000","last_became_active":"2024-09-12T17:10:30.355237+0000","last_became_peered":"2024-09-12T17:10:30.355237+0000","last_unstale":"2024-09-12T18:36:05.576045+0000","last_undegraded":"2024-09-12T18:36:05.576045+0000","last_fullsized":"2024-09-12T18:36:05.576045+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'345","last_scrub_stamp":"2024-09-12T18:36:05.575700+0000","last_deep_scrub":"268'345","last_deep_scrub_stamp":"2024-09-12T18:36:05.575700+0000","last_clean_scrub_stamp":"2024-09-12T18:36:05.575700+0000","objects_scrubbed":8,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:37.874770+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262274,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":552,"num_read_kb":28524,"num_write":1156,"num_write_kb":35154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.409737+0000","last_change":"2024-09-12T17:10:34.368316+0000","last_active":"2024-09-12T18:32:56.409737+0000","last_peered":"2024-09-12T18:32:56.409737+0000","last_clean":"2024-09-12T18:32:56.409737+0000","last_became_active":"2024-09-12T17:10:34.366826+0000","last_became_peered":"2024-09-12T17:10:34.366826+0000","last_unstale":"2024-09-12T18:32:56.409737+0000","last_undegraded":"2024-09-12T18:32:56.409737+0000","last_fullsized":"2024-09-12T18:32:56.409737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:41.209887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1386","reported_seq":3376,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.842224+0000","last_change":"2024-09-12T17:10:36.399027+0000","last_active":"2024-09-12T18:36:01.842224+0000","last_peered":"2024-09-12T18:36:01.842224+0000","last_clean":"2024-09-12T18:36:01.842224+0000","last_became_active":"2024-09-12T17:10:36.398283+0000","last_became_peered":"2024-09-12T17:10:36.398283+0000","last_unstale":"2024-09-12T18:36:01.842224+0000","last_undegraded":"2024-09-12T18:36:01.842224+0000","last_fullsized":"2024-09-12T18:36:01.842224+0000","mapping_epoch":31,"log_start":"268'1300","ondisk_log_start":"268'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":1300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:36.074991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157765,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2194,"num_read_kb":4204,"num_write":1286,"num_write_kb":1080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.394022+0000","last_change":"2024-09-12T17:10:38.407976+0000","last_active":"2024-09-12T18:32:21.394022+0000","last_peered":"2024-09-12T18:32:21.394022+0000","last_clean":"2024-09-12T18:32:21.394022+0000","last_became_active":"2024-09-12T17:10:38.407002+0000","last_became_peered":"2024-09-12T17:10:38.407002+0000","last_unstale":"2024-09-12T18:32:21.394022+0000","last_undegraded":"2024-09-12T18:32:21.394022+0000","last_fullsized":"2024-09-12T18:32:21.394022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:39.734129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'125","reported_seq":641,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.101124+0000","last_change":"2024-09-12T17:10:40.771071+0000","last_active":"2024-09-12T18:34:02.101124+0000","last_peered":"2024-09-12T18:34:02.101124+0000","last_clean":"2024-09-12T18:34:02.101124+0000","last_became_active":"2024-09-12T17:10:40.770362+0000","last_became_peered":"2024-09-12T17:10:40.770362+0000","last_unstale":"2024-09-12T18:34:02.101124+0000","last_undegraded":"2024-09-12T18:34:02.101124+0000","last_fullsized":"2024-09-12T18:34:02.101124+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:15.034623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":150,"num_write":307,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'424","reported_seq":2035,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:59.053173+0000","last_change":"2024-09-12T17:10:32.365161+0000","last_active":"2024-09-12T18:32:59.053173+0000","last_peered":"2024-09-12T18:32:59.053173+0000","last_clean":"2024-09-12T18:32:59.053173+0000","last_became_active":"2024-09-12T17:10:32.361184+0000","last_became_peered":"2024-09-12T17:10:32.361184+0000","last_unstale":"2024-09-12T18:32:59.053173+0000","last_undegraded":"2024-09-12T18:32:59.053173+0000","last_fullsized":"2024-09-12T18:32:59.053173+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:45.804037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2375,"num_read_kb":2259,"num_write":493,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":547,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.808600+0000","last_change":"2024-09-12T17:10:20.089534+0000","last_active":"2024-09-12T18:33:41.808600+0000","last_peered":"2024-09-12T18:33:41.808600+0000","last_clean":"2024-09-12T18:33:41.808600+0000","last_became_active":"2024-09-12T17:10:18.210168+0000","last_became_peered":"2024-09-12T17:10:18.210168+0000","last_unstale":"2024-09-12T18:33:41.808600+0000","last_undegraded":"2024-09-12T18:33:41.808600+0000","last_fullsized":"2024-09-12T18:33:41.808600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:46.762850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001219171,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'335","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:05.823972+0000","last_change":"2024-09-12T18:36:05.823972+0000","last_active":"2024-09-12T18:36:05.823972+0000","last_peered":"2024-09-12T18:36:05.823972+0000","last_clean":"2024-09-12T18:36:05.823972+0000","last_became_active":"2024-09-12T17:10:30.405641+0000","last_became_peered":"2024-09-12T17:10:30.405641+0000","last_unstale":"2024-09-12T18:36:05.823972+0000","last_undegraded":"2024-09-12T18:36:05.823972+0000","last_fullsized":"2024-09-12T18:36:05.823972+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'335","last_scrub_stamp":"2024-09-12T18:36:05.823746+0000","last_deep_scrub":"268'335","last_deep_scrub_stamp":"2024-09-12T18:36:05.823746+0000","last_clean_scrub_stamp":"2024-09-12T18:36:05.823746+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:01.852500+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":435,"num_read_kb":15806,"num_write":1012,"num_write_kb":36297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.799717+0000","last_change":"2024-09-12T17:10:34.368266+0000","last_active":"2024-09-12T18:32:56.799717+0000","last_peered":"2024-09-12T18:32:56.799717+0000","last_clean":"2024-09-12T18:32:56.799717+0000","last_became_active":"2024-09-12T17:10:34.367870+0000","last_became_peered":"2024-09-12T17:10:34.367870+0000","last_unstale":"2024-09-12T18:32:56.799717+0000","last_undegraded":"2024-09-12T18:32:56.799717+0000","last_fullsized":"2024-09-12T18:32:56.799717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:51.335257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'345","reported_seq":1937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.757234+0000","last_change":"2024-09-12T17:10:36.923069+0000","last_active":"2024-09-12T18:35:21.757234+0000","last_peered":"2024-09-12T18:35:21.757234+0000","last_clean":"2024-09-12T18:35:21.757234+0000","last_became_active":"2024-09-12T17:10:36.922321+0000","last_became_peered":"2024-09-12T17:10:36.922321+0000","last_unstale":"2024-09-12T18:35:21.757234+0000","last_undegraded":"2024-09-12T18:35:21.757234+0000","last_fullsized":"2024-09-12T18:35:21.757234+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:40.884164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":291,"num_read_kb":281,"num_write":273,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.425982+0000","last_change":"2024-09-12T17:10:38.415538+0000","last_active":"2024-09-12T18:34:01.425982+0000","last_peered":"2024-09-12T18:34:01.425982+0000","last_clean":"2024-09-12T18:34:01.425982+0000","last_became_active":"2024-09-12T17:10:38.413459+0000","last_became_peered":"2024-09-12T17:10:38.413459+0000","last_unstale":"2024-09-12T18:34:01.425982+0000","last_undegraded":"2024-09-12T18:34:01.425982+0000","last_fullsized":"2024-09-12T18:34:01.425982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'231","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.307485+0000","last_change":"2024-09-12T17:10:40.415650+0000","last_active":"2024-09-12T18:34:00.307485+0000","last_peered":"2024-09-12T18:34:00.307485+0000","last_clean":"2024-09-12T18:34:00.307485+0000","last_became_active":"2024-09-12T17:10:40.414712+0000","last_became_peered":"2024-09-12T17:10:40.414712+0000","last_unstale":"2024-09-12T18:34:00.307485+0000","last_undegraded":"2024-09-12T18:34:00.307485+0000","last_fullsized":"2024-09-12T18:34:00.307485+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:26.385614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":496,"num_read_kb":517,"num_write":496,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'462","reported_seq":1981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.917826+0000","last_change":"2024-09-12T17:10:32.361139+0000","last_active":"2024-09-12T18:33:59.917826+0000","last_peered":"2024-09-12T18:33:59.917826+0000","last_clean":"2024-09-12T18:33:59.917826+0000","last_became_active":"2024-09-12T17:10:32.360853+0000","last_became_peered":"2024-09-12T17:10:32.360853+0000","last_unstale":"2024-09-12T18:33:59.917826+0000","last_undegraded":"2024-09-12T18:33:59.917826+0000","last_fullsized":"2024-09-12T18:33:59.917826+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:48.894459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2461,"num_read_kb":2304,"num_write":540,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":542,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.419958+0000","last_change":"2024-09-12T17:10:20.095430+0000","last_active":"2024-09-12T18:33:41.419958+0000","last_peered":"2024-09-12T18:33:41.419958+0000","last_clean":"2024-09-12T18:33:41.419958+0000","last_became_active":"2024-09-12T17:10:18.072719+0000","last_became_peered":"2024-09-12T17:10:18.072719+0000","last_unstale":"2024-09-12T18:33:41.419958+0000","last_undegraded":"2024-09-12T18:33:41.419958+0000","last_fullsized":"2024-09-12T18:33:41.419958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:14.576392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022239349999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'390","reported_seq":1100,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.870429+0000","last_change":"2024-09-12T17:10:30.358580+0000","last_active":"2024-09-12T18:36:01.870429+0000","last_peered":"2024-09-12T18:36:01.870429+0000","last_clean":"2024-09-12T18:36:01.870429+0000","last_became_active":"2024-09-12T17:10:30.354850+0000","last_became_peered":"2024-09-12T17:10:30.354850+0000","last_unstale":"2024-09-12T18:36:01.870429+0000","last_undegraded":"2024-09-12T18:36:01.870429+0000","last_fullsized":"2024-09-12T18:36:01.870429+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:31.523584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194319,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":615,"num_read_kb":44146,"num_write":1329,"num_write_kb":42918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.402501+0000","last_change":"2024-09-12T17:10:34.359604+0000","last_active":"2024-09-12T18:32:06.402501+0000","last_peered":"2024-09-12T18:32:06.402501+0000","last_clean":"2024-09-12T18:32:06.402501+0000","last_became_active":"2024-09-12T17:10:34.358926+0000","last_became_peered":"2024-09-12T17:10:34.358926+0000","last_unstale":"2024-09-12T18:32:06.402501+0000","last_undegraded":"2024-09-12T18:32:06.402501+0000","last_fullsized":"2024-09-12T18:32:06.402501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:31.601357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'171","reported_seq":755,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:09.437593+0000","last_change":"2024-09-12T17:10:36.396445+0000","last_active":"2024-09-12T18:35:09.437593+0000","last_peered":"2024-09-12T18:35:09.437593+0000","last_clean":"2024-09-12T18:35:09.437593+0000","last_became_active":"2024-09-12T17:10:36.395658+0000","last_became_peered":"2024-09-12T17:10:36.395658+0000","last_unstale":"2024-09-12T18:35:09.437593+0000","last_undegraded":"2024-09-12T18:35:09.437593+0000","last_fullsized":"2024-09-12T18:35:09.437593+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:53.937530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":215,"num_read_kb":209,"num_write":154,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.582583+0000","last_change":"2024-09-12T17:10:38.414758+0000","last_active":"2024-09-12T18:33:01.582583+0000","last_peered":"2024-09-12T18:33:01.582583+0000","last_clean":"2024-09-12T18:33:01.582583+0000","last_became_active":"2024-09-12T17:10:38.414045+0000","last_became_peered":"2024-09-12T17:10:38.414045+0000","last_unstale":"2024-09-12T18:33:01.582583+0000","last_undegraded":"2024-09-12T18:33:01.582583+0000","last_fullsized":"2024-09-12T18:33:01.582583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:17.692176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'151","reported_seq":739,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.894081+0000","last_change":"2024-09-12T17:10:40.422450+0000","last_active":"2024-09-12T18:33:10.894081+0000","last_peered":"2024-09-12T18:33:10.894081+0000","last_clean":"2024-09-12T18:33:10.894081+0000","last_became_active":"2024-09-12T17:10:40.420995+0000","last_became_peered":"2024-09-12T17:10:40.420995+0000","last_unstale":"2024-09-12T18:33:10.894081+0000","last_undegraded":"2024-09-12T18:33:10.894081+0000","last_fullsized":"2024-09-12T18:33:10.894081+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:49.058635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":383,"num_read_kb":354,"num_write":368,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'864","reported_seq":2542,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.526321+0000","last_change":"2024-09-12T17:10:32.362173+0000","last_active":"2024-09-12T18:35:20.526321+0000","last_peered":"2024-09-12T18:35:20.526321+0000","last_clean":"2024-09-12T18:35:20.526321+0000","last_became_active":"2024-09-12T17:10:32.361696+0000","last_became_peered":"2024-09-12T17:10:32.361696+0000","last_unstale":"2024-09-12T18:35:20.526321+0000","last_undegraded":"2024-09-12T18:35:20.526321+0000","last_fullsized":"2024-09-12T18:35:20.526321+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:49.188465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4191,"num_read_kb":3806,"num_write":1162,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'312","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.657178+0000","last_change":"2024-09-12T17:10:30.355665+0000","last_active":"2024-09-12T18:36:01.657178+0000","last_peered":"2024-09-12T18:36:01.657178+0000","last_clean":"2024-09-12T18:36:01.657178+0000","last_became_active":"2024-09-12T17:10:30.354730+0000","last_became_peered":"2024-09-12T17:10:30.354730+0000","last_unstale":"2024-09-12T18:36:01.657178+0000","last_undegraded":"2024-09-12T18:36:01.657178+0000","last_fullsized":"2024-09-12T18:36:01.657178+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:16.166371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":12992,"num_write":926,"num_write_kb":30670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.651271+0000","last_change":"2024-09-12T17:10:20.100416+0000","last_active":"2024-09-12T18:33:41.651271+0000","last_peered":"2024-09-12T18:33:41.651271+0000","last_clean":"2024-09-12T18:33:41.651271+0000","last_became_active":"2024-09-12T17:10:18.209658+0000","last_became_peered":"2024-09-12T17:10:18.209658+0000","last_unstale":"2024-09-12T18:33:41.651271+0000","last_undegraded":"2024-09-12T18:33:41.651271+0000","last_fullsized":"2024-09-12T18:33:41.651271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:28.458806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010531659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.424736+0000","last_change":"2024-09-12T17:10:34.362549+0000","last_active":"2024-09-12T18:33:56.424736+0000","last_peered":"2024-09-12T18:33:56.424736+0000","last_clean":"2024-09-12T18:33:56.424736+0000","last_became_active":"2024-09-12T17:10:34.361845+0000","last_became_peered":"2024-09-12T17:10:34.361845+0000","last_unstale":"2024-09-12T18:33:56.424736+0000","last_undegraded":"2024-09-12T18:33:56.424736+0000","last_fullsized":"2024-09-12T18:33:56.424736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:05.948451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'678","reported_seq":1390,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.438251+0000","last_change":"2024-09-12T17:10:36.400065+0000","last_active":"2024-09-12T18:36:01.438251+0000","last_peered":"2024-09-12T18:36:01.438251+0000","last_clean":"2024-09-12T18:36:01.438251+0000","last_became_active":"2024-09-12T17:10:36.398917+0000","last_became_peered":"2024-09-12T17:10:36.398917+0000","last_unstale":"2024-09-12T18:36:01.438251+0000","last_undegraded":"2024-09-12T18:36:01.438251+0000","last_fullsized":"2024-09-12T18:36:01.438251+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.596681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100883,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1833,"num_read_kb":3243,"num_write":2400,"num_write_kb":2201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.606350+0000","last_change":"2024-09-12T17:10:38.401627+0000","last_active":"2024-09-12T18:34:00.606350+0000","last_peered":"2024-09-12T18:34:00.606350+0000","last_clean":"2024-09-12T18:34:00.606350+0000","last_became_active":"2024-09-12T17:10:38.400868+0000","last_became_peered":"2024-09-12T17:10:38.400868+0000","last_unstale":"2024-09-12T18:34:00.606350+0000","last_undegraded":"2024-09-12T18:34:00.606350+0000","last_fullsized":"2024-09-12T18:34:00.606350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:50.604824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'135","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.773259+0000","last_change":"2024-09-12T17:10:40.774323+0000","last_active":"2024-09-12T18:33:55.773259+0000","last_peered":"2024-09-12T18:33:55.773259+0000","last_clean":"2024-09-12T18:33:55.773259+0000","last_became_active":"2024-09-12T17:10:40.771185+0000","last_became_peered":"2024-09-12T17:10:40.771185+0000","last_unstale":"2024-09-12T18:33:55.773259+0000","last_undegraded":"2024-09-12T18:33:55.773259+0000","last_fullsized":"2024-09-12T18:33:55.773259+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:03.269283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":180,"num_write":328,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'473","reported_seq":2163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.529320+0000","last_change":"2024-09-12T17:10:32.355390+0000","last_active":"2024-09-12T18:35:20.529320+0000","last_peered":"2024-09-12T18:35:20.529320+0000","last_clean":"2024-09-12T18:35:20.529320+0000","last_became_active":"2024-09-12T17:10:32.354795+0000","last_became_peered":"2024-09-12T17:10:32.354795+0000","last_unstale":"2024-09-12T18:35:20.529320+0000","last_undegraded":"2024-09-12T18:35:20.529320+0000","last_fullsized":"2024-09-12T18:35:20.529320+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:17.098153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2620,"num_read_kb":2476,"num_write":562,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'325","reported_seq":980,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.846766+0000","last_change":"2024-09-12T17:10:30.405893+0000","last_active":"2024-09-12T18:36:01.846766+0000","last_peered":"2024-09-12T18:36:01.846766+0000","last_clean":"2024-09-12T18:36:01.846766+0000","last_became_active":"2024-09-12T17:10:30.405460+0000","last_became_peered":"2024-09-12T17:10:30.405460+0000","last_unstale":"2024-09-12T18:36:01.846766+0000","last_undegraded":"2024-09-12T18:36:01.846766+0000","last_fullsized":"2024-09-12T18:36:01.846766+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:16.200605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243060,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":16852,"num_write":1075,"num_write_kb":30938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:01.389327+0000","last_change":"2024-09-12T17:10:20.397111+0000","last_active":"2024-09-12T18:32:01.389327+0000","last_peered":"2024-09-12T18:32:01.389327+0000","last_clean":"2024-09-12T18:32:01.389327+0000","last_became_active":"2024-09-12T17:10:18.208762+0000","last_became_peered":"2024-09-12T17:10:18.208762+0000","last_unstale":"2024-09-12T18:32:01.389327+0000","last_undegraded":"2024-09-12T18:32:01.389327+0000","last_fullsized":"2024-09-12T18:32:01.389327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:07.303527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091554,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.593917+0000","last_change":"2024-09-12T17:10:34.356303+0000","last_active":"2024-09-12T18:33:56.593917+0000","last_peered":"2024-09-12T18:33:56.593917+0000","last_clean":"2024-09-12T18:33:56.593917+0000","last_became_active":"2024-09-12T17:10:34.355590+0000","last_became_peered":"2024-09-12T17:10:34.355590+0000","last_unstale":"2024-09-12T18:33:56.593917+0000","last_undegraded":"2024-09-12T18:33:56.593917+0000","last_fullsized":"2024-09-12T18:33:56.593917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:49.016297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'223","reported_seq":832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.832386+0000","last_change":"2024-09-12T17:10:36.922068+0000","last_active":"2024-09-12T18:34:01.832386+0000","last_peered":"2024-09-12T18:34:01.832386+0000","last_clean":"2024-09-12T18:34:01.832386+0000","last_became_active":"2024-09-12T17:10:36.921234+0000","last_became_peered":"2024-09-12T17:10:36.921234+0000","last_unstale":"2024-09-12T18:34:01.832386+0000","last_undegraded":"2024-09-12T18:34:01.832386+0000","last_fullsized":"2024-09-12T18:34:01.832386+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:56.087478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":277,"num_write":196,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'792","reported_seq":2947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.364411+0000","last_change":"2024-09-12T17:10:38.396157+0000","last_active":"2024-09-12T18:36:01.364411+0000","last_peered":"2024-09-12T18:36:01.364411+0000","last_clean":"2024-09-12T18:36:01.364411+0000","last_became_active":"2024-09-12T17:10:38.395439+0000","last_became_peered":"2024-09-12T17:10:38.395439+0000","last_unstale":"2024-09-12T18:36:01.364411+0000","last_undegraded":"2024-09-12T18:36:01.364411+0000","last_fullsized":"2024-09-12T18:36:01.364411+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:28.386160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'180","reported_seq":718,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428311+0000","last_change":"2024-09-12T17:10:40.770840+0000","last_active":"2024-09-12T18:34:19.428311+0000","last_peered":"2024-09-12T18:34:19.428311+0000","last_clean":"2024-09-12T18:34:19.428311+0000","last_became_active":"2024-09-12T17:10:40.770042+0000","last_became_peered":"2024-09-12T17:10:40.770042+0000","last_unstale":"2024-09-12T18:34:19.428311+0000","last_undegraded":"2024-09-12T18:34:19.428311+0000","last_fullsized":"2024-09-12T18:34:19.428311+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:24.561136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":293,"num_read_kb":273,"num_write":449,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'899","reported_seq":2633,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.926166+0000","last_change":"2024-09-12T17:10:32.383031+0000","last_active":"2024-09-12T18:33:59.926166+0000","last_peered":"2024-09-12T18:33:59.926166+0000","last_clean":"2024-09-12T18:33:59.926166+0000","last_became_active":"2024-09-12T17:10:32.382755+0000","last_became_peered":"2024-09-12T17:10:32.382755+0000","last_unstale":"2024-09-12T18:33:59.926166+0000","last_undegraded":"2024-09-12T18:33:59.926166+0000","last_fullsized":"2024-09-12T18:33:59.926166+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:55.069573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4651,"num_read_kb":4208,"num_write":1244,"num_write_kb":526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'316","reported_seq":947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.832402+0000","last_change":"2024-09-12T17:10:30.365199+0000","last_active":"2024-09-12T18:36:01.832402+0000","last_peered":"2024-09-12T18:36:01.832402+0000","last_clean":"2024-09-12T18:36:01.832402+0000","last_became_active":"2024-09-12T17:10:30.364767+0000","last_became_peered":"2024-09-12T17:10:30.364767+0000","last_unstale":"2024-09-12T18:36:01.832402+0000","last_undegraded":"2024-09-12T18:36:01.832402+0000","last_fullsized":"2024-09-12T18:36:01.832402+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:56.519220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":450,"num_read_kb":23959,"num_write":1040,"num_write_kb":32355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.637356+0000","last_change":"2024-09-12T17:10:20.100539+0000","last_active":"2024-09-12T18:32:41.637356+0000","last_peered":"2024-09-12T18:32:41.637356+0000","last_clean":"2024-09-12T18:32:41.637356+0000","last_became_active":"2024-09-12T17:10:18.073132+0000","last_became_peered":"2024-09-12T17:10:18.073132+0000","last_unstale":"2024-09-12T18:32:41.637356+0000","last_undegraded":"2024-09-12T18:32:41.637356+0000","last_fullsized":"2024-09-12T18:32:41.637356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:05.399337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001154721,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605276+0000","last_change":"2024-09-12T17:10:34.349876+0000","last_active":"2024-09-12T18:33:55.605276+0000","last_peered":"2024-09-12T18:33:55.605276+0000","last_clean":"2024-09-12T18:33:55.605276+0000","last_became_active":"2024-09-12T17:10:34.349093+0000","last_became_peered":"2024-09-12T17:10:34.349093+0000","last_unstale":"2024-09-12T18:33:55.605276+0000","last_undegraded":"2024-09-12T18:33:55.605276+0000","last_fullsized":"2024-09-12T18:33:55.605276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:46.757080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'169","reported_seq":749,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.606406+0000","last_change":"2024-09-12T17:10:36.391287+0000","last_active":"2024-09-12T18:34:00.606406+0000","last_peered":"2024-09-12T18:34:00.606406+0000","last_clean":"2024-09-12T18:34:00.606406+0000","last_became_active":"2024-09-12T17:10:36.390439+0000","last_became_peered":"2024-09-12T17:10:36.390439+0000","last_unstale":"2024-09-12T18:34:00.606406+0000","last_undegraded":"2024-09-12T18:34:00.606406+0000","last_fullsized":"2024-09-12T18:34:00.606406+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:24.707986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":183,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'808","reported_seq":2860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.921175+0000","last_change":"2024-09-12T17:10:38.394233+0000","last_active":"2024-09-12T18:36:01.921175+0000","last_peered":"2024-09-12T18:36:01.921175+0000","last_clean":"2024-09-12T18:36:01.921175+0000","last_became_active":"2024-09-12T17:10:38.393426+0000","last_became_peered":"2024-09-12T17:10:38.393426+0000","last_unstale":"2024-09-12T18:36:01.921175+0000","last_undegraded":"2024-09-12T18:36:01.921175+0000","last_fullsized":"2024-09-12T18:36:01.921175+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:37.818377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'254","reported_seq":797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:41.396389+0000","last_change":"2024-09-12T17:10:40.429154+0000","last_active":"2024-09-12T18:31:41.396389+0000","last_peered":"2024-09-12T18:31:41.396389+0000","last_clean":"2024-09-12T18:31:41.396389+0000","last_became_active":"2024-09-12T17:10:40.423742+0000","last_became_peered":"2024-09-12T17:10:40.423742+0000","last_unstale":"2024-09-12T18:31:41.396389+0000","last_undegraded":"2024-09-12T18:31:41.396389+0000","last_fullsized":"2024-09-12T18:31:41.396389+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:48.699774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":353,"num_read_kb":347,"num_write":533,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'873","reported_seq":2667,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605231+0000","last_change":"2024-09-12T17:10:32.368938+0000","last_active":"2024-09-12T18:33:55.605231+0000","last_peered":"2024-09-12T18:33:55.605231+0000","last_clean":"2024-09-12T18:33:55.605231+0000","last_became_active":"2024-09-12T17:10:32.368217+0000","last_became_peered":"2024-09-12T17:10:32.368217+0000","last_unstale":"2024-09-12T18:33:55.605231+0000","last_undegraded":"2024-09-12T18:33:55.605231+0000","last_fullsized":"2024-09-12T18:33:55.605231+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":800,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:33.300045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4306,"num_read_kb":3903,"num_write":1124,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'367","reported_seq":1072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.880200+0000","last_change":"2024-09-12T17:10:30.362722+0000","last_active":"2024-09-12T18:36:01.880200+0000","last_peered":"2024-09-12T18:36:01.880200+0000","last_clean":"2024-09-12T18:36:01.880200+0000","last_became_active":"2024-09-12T17:10:30.361736+0000","last_became_peered":"2024-09-12T17:10:30.361736+0000","last_unstale":"2024-09-12T18:36:01.880200+0000","last_undegraded":"2024-09-12T18:36:01.880200+0000","last_fullsized":"2024-09-12T18:36:01.880200+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:20.821477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5736431,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":617,"num_read_kb":21637,"num_write":1193,"num_write_kb":30222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:41.578380+0000","last_change":"2024-09-12T17:10:20.088329+0000","last_active":"2024-09-12T18:32:41.578380+0000","last_peered":"2024-09-12T18:32:41.578380+0000","last_clean":"2024-09-12T18:32:41.578380+0000","last_became_active":"2024-09-12T17:10:18.074669+0000","last_became_peered":"2024-09-12T17:10:18.074669+0000","last_unstale":"2024-09-12T18:32:41.578380+0000","last_undegraded":"2024-09-12T18:32:41.578380+0000","last_fullsized":"2024-09-12T18:32:41.578380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:17.042870+0000","last_clean_scrub_stamp":"2024-09-12T17:10:17.042870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:20.175198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:54.408665+0000","last_change":"2024-09-12T17:10:34.358853+0000","last_active":"2024-09-12T18:32:54.408665+0000","last_peered":"2024-09-12T18:32:54.408665+0000","last_clean":"2024-09-12T18:32:54.408665+0000","last_became_active":"2024-09-12T17:10:34.358250+0000","last_became_peered":"2024-09-12T17:10:34.358250+0000","last_unstale":"2024-09-12T18:32:54.408665+0000","last_undegraded":"2024-09-12T18:32:54.408665+0000","last_fullsized":"2024-09-12T18:32:54.408665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:35.137706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'744","reported_seq":1504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.638837+0000","last_change":"2024-09-12T17:10:36.921037+0000","last_active":"2024-09-12T18:36:01.638837+0000","last_peered":"2024-09-12T18:36:01.638837+0000","last_clean":"2024-09-12T18:36:01.638837+0000","last_became_active":"2024-09-12T17:10:36.920239+0000","last_became_peered":"2024-09-12T17:10:36.920239+0000","last_unstale":"2024-09-12T18:36:01.638837+0000","last_undegraded":"2024-09-12T18:36:01.638837+0000","last_fullsized":"2024-09-12T18:36:01.638837+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:47.311658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144312,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1298,"num_read_kb":3045,"num_write":1034,"num_write_kb":815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.422907+0000","last_change":"2024-09-12T17:10:38.392174+0000","last_active":"2024-09-12T18:33:59.422907+0000","last_peered":"2024-09-12T18:33:59.422907+0000","last_clean":"2024-09-12T18:33:59.422907+0000","last_became_active":"2024-09-12T17:10:38.391661+0000","last_became_peered":"2024-09-12T17:10:38.391661+0000","last_unstale":"2024-09-12T18:33:59.422907+0000","last_undegraded":"2024-09-12T18:33:59.422907+0000","last_fullsized":"2024-09-12T18:33:59.422907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:44.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'98","reported_seq":607,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.423470+0000","last_change":"2024-09-12T17:10:40.435786+0000","last_active":"2024-09-12T18:33:56.423470+0000","last_peered":"2024-09-12T18:33:56.423470+0000","last_clean":"2024-09-12T18:33:56.423470+0000","last_became_active":"2024-09-12T17:10:40.435114+0000","last_became_peered":"2024-09-12T17:10:40.435114+0000","last_unstale":"2024-09-12T18:33:56.423470+0000","last_undegraded":"2024-09-12T18:33:56.423470+0000","last_fullsized":"2024-09-12T18:33:56.423470+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:14.936129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":238,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'127","reported_seq":724,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.277973+0000","last_change":"2024-09-12T17:10:40.422967+0000","last_active":"2024-09-12T18:34:02.277973+0000","last_peered":"2024-09-12T18:34:02.277973+0000","last_clean":"2024-09-12T18:34:02.277973+0000","last_became_active":"2024-09-12T17:10:40.417972+0000","last_became_peered":"2024-09-12T17:10:40.417972+0000","last_unstale":"2024-09-12T18:34:02.277973+0000","last_undegraded":"2024-09-12T18:34:02.277973+0000","last_fullsized":"2024-09-12T18:34:02.277973+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":319,"num_read_kb":297,"num_write":314,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'794","reported_seq":2315,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.135941+0000","last_change":"2024-09-12T17:10:32.368759+0000","last_active":"2024-09-12T18:33:06.135941+0000","last_peered":"2024-09-12T18:33:06.135941+0000","last_clean":"2024-09-12T18:33:06.135941+0000","last_became_active":"2024-09-12T17:10:32.368063+0000","last_became_peered":"2024-09-12T17:10:32.368063+0000","last_unstale":"2024-09-12T18:33:06.135941+0000","last_undegraded":"2024-09-12T18:33:06.135941+0000","last_fullsized":"2024-09-12T18:33:06.135941+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:01.539950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3740,"num_read_kb":3358,"num_write":1050,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'385","reported_seq":1043,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.860865+0000","last_change":"2024-09-12T17:10:30.395497+0000","last_active":"2024-09-12T18:36:01.860865+0000","last_peered":"2024-09-12T18:36:01.860865+0000","last_clean":"2024-09-12T18:36:01.860865+0000","last_became_active":"2024-09-12T17:10:30.394117+0000","last_became_peered":"2024-09-12T17:10:30.394117+0000","last_unstale":"2024-09-12T18:36:01.860865+0000","last_undegraded":"2024-09-12T18:36:01.860865+0000","last_fullsized":"2024-09-12T18:36:01.860865+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:18.220639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330018,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":538,"num_read_kb":2122,"num_write":1160,"num_write_kb":20675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.631995+0000","last_change":"2024-09-12T17:10:34.360352+0000","last_active":"2024-09-12T18:32:16.631995+0000","last_peered":"2024-09-12T18:32:16.631995+0000","last_clean":"2024-09-12T18:32:16.631995+0000","last_became_active":"2024-09-12T17:10:34.359923+0000","last_became_peered":"2024-09-12T17:10:34.359923+0000","last_unstale":"2024-09-12T18:32:16.631995+0000","last_undegraded":"2024-09-12T18:32:16.631995+0000","last_fullsized":"2024-09-12T18:32:16.631995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:14.364530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'303","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.376919+0000","last_change":"2024-09-12T17:10:36.395453+0000","last_active":"2024-09-12T18:35:59.376919+0000","last_peered":"2024-09-12T18:35:59.376919+0000","last_clean":"2024-09-12T18:35:59.376919+0000","last_became_active":"2024-09-12T17:10:36.394731+0000","last_became_peered":"2024-09-12T17:10:36.394731+0000","last_unstale":"2024-09-12T18:35:59.376919+0000","last_undegraded":"2024-09-12T18:35:59.376919+0000","last_fullsized":"2024-09-12T18:35:59.376919+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:03.802691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56497,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":1193,"num_write":404,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:19.399496+0000","last_change":"2024-09-12T17:10:38.393630+0000","last_active":"2024-09-12T18:32:19.399496+0000","last_peered":"2024-09-12T18:32:19.399496+0000","last_clean":"2024-09-12T18:32:19.399496+0000","last_became_active":"2024-09-12T17:10:38.393112+0000","last_became_peered":"2024-09-12T17:10:38.393112+0000","last_unstale":"2024-09-12T18:32:19.399496+0000","last_undegraded":"2024-09-12T18:32:19.399496+0000","last_fullsized":"2024-09-12T18:32:19.399496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:11.857461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'117","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.411553+0000","last_change":"2024-09-12T17:10:40.430432+0000","last_active":"2024-09-12T18:33:04.411553+0000","last_peered":"2024-09-12T18:33:04.411553+0000","last_clean":"2024-09-12T18:33:04.411553+0000","last_became_active":"2024-09-12T17:10:40.429366+0000","last_became_peered":"2024-09-12T17:10:40.429366+0000","last_unstale":"2024-09-12T18:33:04.411553+0000","last_undegraded":"2024-09-12T18:33:04.411553+0000","last_fullsized":"2024-09-12T18:33:04.411553+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:03.623489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":137,"num_write":282,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'499","reported_seq":2099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.813533+0000","last_change":"2024-09-12T17:10:32.366756+0000","last_active":"2024-09-12T18:34:01.813533+0000","last_peered":"2024-09-12T18:34:01.813533+0000","last_clean":"2024-09-12T18:34:01.813533+0000","last_became_active":"2024-09-12T17:10:32.364033+0000","last_became_peered":"2024-09-12T17:10:32.364033+0000","last_unstale":"2024-09-12T18:34:01.813533+0000","last_undegraded":"2024-09-12T18:34:01.813533+0000","last_fullsized":"2024-09-12T18:34:01.813533+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:44.259351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2497,"num_read_kb":2341,"num_write":588,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'287","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.700883+0000","last_change":"2024-09-12T17:10:30.406049+0000","last_active":"2024-09-12T18:36:01.700883+0000","last_peered":"2024-09-12T18:36:01.700883+0000","last_clean":"2024-09-12T18:36:01.700883+0000","last_became_active":"2024-09-12T17:10:30.405137+0000","last_became_peered":"2024-09-12T17:10:30.405137+0000","last_unstale":"2024-09-12T18:36:01.700883+0000","last_undegraded":"2024-09-12T18:36:01.700883+0000","last_fullsized":"2024-09-12T18:36:01.700883+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:51.883704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728666,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":586,"num_read_kb":36707,"num_write":949,"num_write_kb":52863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:14.398461+0000","last_change":"2024-09-12T17:10:34.356731+0000","last_active":"2024-09-12T18:32:14.398461+0000","last_peered":"2024-09-12T18:32:14.398461+0000","last_clean":"2024-09-12T18:32:14.398461+0000","last_became_active":"2024-09-12T17:10:34.355684+0000","last_became_peered":"2024-09-12T17:10:34.355684+0000","last_unstale":"2024-09-12T18:32:14.398461+0000","last_undegraded":"2024-09-12T18:32:14.398461+0000","last_fullsized":"2024-09-12T18:32:14.398461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:22.182263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'58","reported_seq":588,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.404344+0000","last_change":"2024-09-12T17:10:36.402010+0000","last_active":"2024-09-12T18:32:16.404344+0000","last_peered":"2024-09-12T18:32:16.404344+0000","last_clean":"2024-09-12T18:32:16.404344+0000","last_became_active":"2024-09-12T17:10:36.400358+0000","last_became_peered":"2024-09-12T17:10:36.400358+0000","last_unstale":"2024-09-12T18:32:16.404344+0000","last_undegraded":"2024-09-12T18:32:16.404344+0000","last_fullsized":"2024-09-12T18:32:16.404344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:54.812329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":54,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.393889+0000","last_change":"2024-09-12T17:10:38.405067+0000","last_active":"2024-09-12T18:32:21.393889+0000","last_peered":"2024-09-12T18:32:21.393889+0000","last_clean":"2024-09-12T18:32:21.393889+0000","last_became_active":"2024-09-12T17:10:38.404309+0000","last_became_peered":"2024-09-12T17:10:38.404309+0000","last_unstale":"2024-09-12T18:32:21.393889+0000","last_undegraded":"2024-09-12T18:32:21.393889+0000","last_fullsized":"2024-09-12T18:32:21.393889+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:21.478649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'194","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.504598+0000","last_change":"2024-09-12T17:10:40.422558+0000","last_active":"2024-09-12T18:35:20.504598+0000","last_peered":"2024-09-12T18:35:20.504598+0000","last_clean":"2024-09-12T18:35:20.504598+0000","last_became_active":"2024-09-12T17:10:40.418473+0000","last_became_peered":"2024-09-12T17:10:40.418473+0000","last_unstale":"2024-09-12T18:35:20.504598+0000","last_undegraded":"2024-09-12T18:35:20.504598+0000","last_fullsized":"2024-09-12T18:35:20.504598+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:29.988283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":350,"num_read_kb":341,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'358","reported_seq":1681,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:39.694476+0000","last_change":"2024-09-12T17:10:32.383157+0000","last_active":"2024-09-12T18:32:39.694476+0000","last_peered":"2024-09-12T18:32:39.694476+0000","last_clean":"2024-09-12T18:32:39.694476+0000","last_became_active":"2024-09-12T17:10:32.382581+0000","last_became_peered":"2024-09-12T17:10:32.382581+0000","last_unstale":"2024-09-12T18:32:39.694476+0000","last_undegraded":"2024-09-12T18:32:39.694476+0000","last_fullsized":"2024-09-12T18:32:39.694476+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:16.772362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1854,"num_read_kb":1737,"num_write":414,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'369","reported_seq":1042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.832533+0000","last_change":"2024-09-12T17:10:30.375484+0000","last_active":"2024-09-12T18:36:01.832533+0000","last_peered":"2024-09-12T18:36:01.832533+0000","last_clean":"2024-09-12T18:36:01.832533+0000","last_became_active":"2024-09-12T17:10:30.374846+0000","last_became_peered":"2024-09-12T17:10:30.374846+0000","last_unstale":"2024-09-12T18:36:01.832533+0000","last_undegraded":"2024-09-12T18:36:01.832533+0000","last_fullsized":"2024-09-12T18:36:01.832533+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:37.286683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572943,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":611,"num_read_kb":15632,"num_write":1214,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.392627+0000","last_change":"2024-09-12T17:10:34.362906+0000","last_active":"2024-09-12T18:32:16.392627+0000","last_peered":"2024-09-12T18:32:16.392627+0000","last_clean":"2024-09-12T18:32:16.392627+0000","last_became_active":"2024-09-12T17:10:34.362168+0000","last_became_peered":"2024-09-12T17:10:34.362168+0000","last_unstale":"2024-09-12T18:32:16.392627+0000","last_undegraded":"2024-09-12T18:32:16.392627+0000","last_fullsized":"2024-09-12T18:32:16.392627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:22.148212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'380","reported_seq":1005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.290469+0000","last_change":"2024-09-12T17:10:36.395016+0000","last_active":"2024-09-12T18:36:01.290469+0000","last_peered":"2024-09-12T18:36:01.290469+0000","last_clean":"2024-09-12T18:36:01.290469+0000","last_became_active":"2024-09-12T17:10:36.394639+0000","last_became_peered":"2024-09-12T17:10:36.394639+0000","last_unstale":"2024-09-12T18:36:01.290469+0000","last_undegraded":"2024-09-12T18:36:01.290469+0000","last_fullsized":"2024-09-12T18:36:01.290469+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:40.165567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67938,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":612,"num_read_kb":1404,"num_write":492,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.574124+0000","last_change":"2024-09-12T17:10:38.413916+0000","last_active":"2024-09-12T18:32:21.574124+0000","last_peered":"2024-09-12T18:32:21.574124+0000","last_clean":"2024-09-12T18:32:21.574124+0000","last_became_active":"2024-09-12T17:10:38.413131+0000","last_became_peered":"2024-09-12T17:10:38.413131+0000","last_unstale":"2024-09-12T18:32:21.574124+0000","last_undegraded":"2024-09-12T18:32:21.574124+0000","last_fullsized":"2024-09-12T18:32:21.574124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:09.828750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'132","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.413271+0000","last_change":"2024-09-12T17:10:40.429935+0000","last_active":"2024-09-12T18:33:11.413271+0000","last_peered":"2024-09-12T18:33:11.413271+0000","last_clean":"2024-09-12T18:33:11.413271+0000","last_became_active":"2024-09-12T17:10:40.429224+0000","last_became_peered":"2024-09-12T17:10:40.429224+0000","last_unstale":"2024-09-12T18:33:11.413271+0000","last_undegraded":"2024-09-12T18:33:11.413271+0000","last_fullsized":"2024-09-12T18:33:11.413271+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:11.523864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'949","reported_seq":2625,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.876011+0000","last_change":"2024-09-12T17:10:32.369486+0000","last_active":"2024-09-12T18:33:10.876011+0000","last_peered":"2024-09-12T18:33:10.876011+0000","last_clean":"2024-09-12T18:33:10.876011+0000","last_became_active":"2024-09-12T17:10:32.369282+0000","last_became_peered":"2024-09-12T17:10:32.369282+0000","last_unstale":"2024-09-12T18:33:10.876011+0000","last_undegraded":"2024-09-12T18:33:10.876011+0000","last_fullsized":"2024-09-12T18:33:10.876011+0000","mapping_epoch":27,"log_start":"268'900","ondisk_log_start":"268'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":900,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:33.793287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4532,"num_read_kb":4046,"num_write":1302,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'374","reported_seq":1048,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.852212+0000","last_change":"2024-09-12T17:10:30.357595+0000","last_active":"2024-09-12T18:36:01.852212+0000","last_peered":"2024-09-12T18:36:01.852212+0000","last_clean":"2024-09-12T18:36:01.852212+0000","last_became_active":"2024-09-12T17:10:30.356383+0000","last_became_peered":"2024-09-12T17:10:30.356383+0000","last_unstale":"2024-09-12T18:36:01.852212+0000","last_undegraded":"2024-09-12T18:36:01.852212+0000","last_fullsized":"2024-09-12T18:36:01.852212+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:13.378425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":17278,"num_write":1157,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.573012+0000","last_change":"2024-09-12T17:10:34.364021+0000","last_active":"2024-09-12T18:32:16.573012+0000","last_peered":"2024-09-12T18:32:16.573012+0000","last_clean":"2024-09-12T18:32:16.573012+0000","last_became_active":"2024-09-12T17:10:34.363279+0000","last_became_peered":"2024-09-12T17:10:34.363279+0000","last_unstale":"2024-09-12T18:32:16.573012+0000","last_undegraded":"2024-09-12T18:32:16.573012+0000","last_fullsized":"2024-09-12T18:32:16.573012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:56.824582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'320","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.079295+0000","last_change":"2024-09-12T17:10:36.397496+0000","last_active":"2024-09-12T18:36:01.079295+0000","last_peered":"2024-09-12T18:36:01.079295+0000","last_clean":"2024-09-12T18:36:01.079295+0000","last_became_active":"2024-09-12T17:10:36.396758+0000","last_became_peered":"2024-09-12T17:10:36.396758+0000","last_unstale":"2024-09-12T18:36:01.079295+0000","last_undegraded":"2024-09-12T18:36:01.079295+0000","last_fullsized":"2024-09-12T18:36:01.079295+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:17.261131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59757,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1297,"num_write":442,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.405399+0000","last_change":"2024-09-12T17:10:38.414645+0000","last_active":"2024-09-12T18:32:21.405399+0000","last_peered":"2024-09-12T18:32:21.405399+0000","last_clean":"2024-09-12T18:32:21.405399+0000","last_became_active":"2024-09-12T17:10:38.413004+0000","last_became_peered":"2024-09-12T17:10:38.413004+0000","last_unstale":"2024-09-12T18:32:21.405399+0000","last_undegraded":"2024-09-12T18:32:21.405399+0000","last_fullsized":"2024-09-12T18:32:21.405399+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:16.768442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'438","reported_seq":1942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.594044+0000","last_change":"2024-09-12T17:10:32.351572+0000","last_active":"2024-09-12T18:33:56.594044+0000","last_peered":"2024-09-12T18:33:56.594044+0000","last_clean":"2024-09-12T18:33:56.594044+0000","last_became_active":"2024-09-12T17:10:32.350751+0000","last_became_peered":"2024-09-12T17:10:32.350751+0000","last_unstale":"2024-09-12T18:33:56.594044+0000","last_undegraded":"2024-09-12T18:33:56.594044+0000","last_fullsized":"2024-09-12T18:33:56.594044+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:37.740261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2256,"num_read_kb":2119,"num_write":496,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'284","reported_seq":931,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.755467+0000","last_change":"2024-09-12T17:10:30.353713+0000","last_active":"2024-09-12T18:36:01.755467+0000","last_peered":"2024-09-12T18:36:01.755467+0000","last_clean":"2024-09-12T18:36:01.755467+0000","last_became_active":"2024-09-12T17:10:30.353308+0000","last_became_peered":"2024-09-12T17:10:30.353308+0000","last_unstale":"2024-09-12T18:36:01.755467+0000","last_undegraded":"2024-09-12T18:36:01.755467+0000","last_fullsized":"2024-09-12T18:36:01.755467+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:18.517236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262194,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":407,"num_read_kb":20512,"num_write":856,"num_write_kb":25251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411828+0000","last_change":"2024-09-12T17:10:34.358634+0000","last_active":"2024-09-12T18:32:51.411828+0000","last_peered":"2024-09-12T18:32:51.411828+0000","last_clean":"2024-09-12T18:32:51.411828+0000","last_became_active":"2024-09-12T17:10:34.357883+0000","last_became_peered":"2024-09-12T17:10:34.357883+0000","last_unstale":"2024-09-12T18:32:51.411828+0000","last_undegraded":"2024-09-12T18:32:51.411828+0000","last_fullsized":"2024-09-12T18:32:51.411828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:42.544648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'519","reported_seq":1177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.001199+0000","last_change":"2024-09-12T17:10:36.402382+0000","last_active":"2024-09-12T18:36:01.001199+0000","last_peered":"2024-09-12T18:36:01.001199+0000","last_clean":"2024-09-12T18:36:01.001199+0000","last_became_active":"2024-09-12T17:10:36.401608+0000","last_became_peered":"2024-09-12T17:10:36.401608+0000","last_unstale":"2024-09-12T18:36:01.001199+0000","last_undegraded":"2024-09-12T18:36:01.001199+0000","last_fullsized":"2024-09-12T18:36:01.001199+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:02.237080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95576,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":903,"num_read_kb":2101,"num_write":776,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.413301+0000","last_change":"2024-09-12T17:10:38.399567+0000","last_active":"2024-09-12T18:33:11.413301+0000","last_peered":"2024-09-12T18:33:11.413301+0000","last_clean":"2024-09-12T18:33:11.413301+0000","last_became_active":"2024-09-12T17:10:38.398862+0000","last_became_peered":"2024-09-12T17:10:38.398862+0000","last_unstale":"2024-09-12T18:33:11.413301+0000","last_undegraded":"2024-09-12T18:33:11.413301+0000","last_fullsized":"2024-09-12T18:33:11.413301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:54.103985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'157","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.787915+0000","last_change":"2024-09-12T17:10:40.771008+0000","last_active":"2024-09-12T18:34:01.787915+0000","last_peered":"2024-09-12T18:34:01.787915+0000","last_clean":"2024-09-12T18:34:01.787915+0000","last_became_active":"2024-09-12T17:10:40.770075+0000","last_became_peered":"2024-09-12T17:10:40.770075+0000","last_unstale":"2024-09-12T18:34:01.787915+0000","last_undegraded":"2024-09-12T18:34:01.787915+0000","last_fullsized":"2024-09-12T18:34:01.787915+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:20.570103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":234,"num_write":361,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'1461","reported_seq":3047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.814470+0000","last_change":"2024-09-12T17:10:32.377189+0000","last_active":"2024-09-12T18:34:01.814470+0000","last_peered":"2024-09-12T18:34:01.814470+0000","last_clean":"2024-09-12T18:34:01.814470+0000","last_became_active":"2024-09-12T17:10:32.376892+0000","last_became_peered":"2024-09-12T17:10:32.376892+0000","last_unstale":"2024-09-12T18:34:01.814470+0000","last_undegraded":"2024-09-12T18:34:01.814470+0000","last_fullsized":"2024-09-12T18:34:01.814470+0000","mapping_epoch":27,"log_start":"268'1400","ondisk_log_start":"268'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":1400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:44.187578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6636,"num_read_kb":5839,"num_write":2046,"num_write_kb":883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'297","reported_seq":934,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.755482+0000","last_change":"2024-09-12T17:10:30.378429+0000","last_active":"2024-09-12T18:36:01.755482+0000","last_peered":"2024-09-12T18:36:01.755482+0000","last_clean":"2024-09-12T18:36:01.755482+0000","last_became_active":"2024-09-12T17:10:30.378075+0000","last_became_peered":"2024-09-12T17:10:30.378075+0000","last_unstale":"2024-09-12T18:36:01.755482+0000","last_undegraded":"2024-09-12T18:36:01.755482+0000","last_fullsized":"2024-09-12T18:36:01.755482+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:26.384876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4500309,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":47843,"num_write":921,"num_write_kb":30557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.594090+0000","last_change":"2024-09-12T17:10:34.362259+0000","last_active":"2024-09-12T18:33:56.594090+0000","last_peered":"2024-09-12T18:33:56.594090+0000","last_clean":"2024-09-12T18:33:56.594090+0000","last_became_active":"2024-09-12T17:10:34.361495+0000","last_became_peered":"2024-09-12T17:10:34.361495+0000","last_unstale":"2024-09-12T18:33:56.594090+0000","last_undegraded":"2024-09-12T18:33:56.594090+0000","last_fullsized":"2024-09-12T18:33:56.594090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:28.400359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'338","reported_seq":960,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.142261+0000","last_change":"2024-09-12T17:10:36.399101+0000","last_active":"2024-09-12T18:36:01.142261+0000","last_peered":"2024-09-12T18:36:01.142261+0000","last_clean":"2024-09-12T18:36:01.142261+0000","last_became_active":"2024-09-12T17:10:36.398415+0000","last_became_peered":"2024-09-12T17:10:36.398415+0000","last_unstale":"2024-09-12T18:36:01.142261+0000","last_undegraded":"2024-09-12T18:36:01.142261+0000","last_fullsized":"2024-09-12T18:36:01.142261+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:16.776403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45877,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":580,"num_read_kb":1203,"num_write":474,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.644654+0000","last_change":"2024-09-12T17:10:38.404690+0000","last_active":"2024-09-12T18:33:11.644654+0000","last_peered":"2024-09-12T18:33:11.644654+0000","last_clean":"2024-09-12T18:33:11.644654+0000","last_became_active":"2024-09-12T17:10:38.401047+0000","last_became_peered":"2024-09-12T17:10:38.401047+0000","last_unstale":"2024-09-12T18:33:11.644654+0000","last_undegraded":"2024-09-12T18:33:11.644654+0000","last_fullsized":"2024-09-12T18:33:11.644654+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:40.635802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'196","reported_seq":744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:58.343759+0000","last_change":"2024-09-12T17:10:40.429587+0000","last_active":"2024-09-12T18:33:58.343759+0000","last_peered":"2024-09-12T18:33:58.343759+0000","last_clean":"2024-09-12T18:33:58.343759+0000","last_became_active":"2024-09-12T17:10:40.428841+0000","last_became_peered":"2024-09-12T17:10:40.428841+0000","last_unstale":"2024-09-12T18:33:58.343759+0000","last_undegraded":"2024-09-12T18:33:58.343759+0000","last_fullsized":"2024-09-12T18:33:58.343759+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:22.728668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1669,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":376,"num_read_kb":345,"num_write":581,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'1124","reported_seq":2870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.926010+0000","last_change":"2024-09-12T17:10:32.369642+0000","last_active":"2024-09-12T18:33:59.926010+0000","last_peered":"2024-09-12T18:33:59.926010+0000","last_clean":"2024-09-12T18:33:59.926010+0000","last_became_active":"2024-09-12T17:10:32.369344+0000","last_became_peered":"2024-09-12T17:10:32.369344+0000","last_unstale":"2024-09-12T18:33:59.926010+0000","last_undegraded":"2024-09-12T18:33:59.926010+0000","last_fullsized":"2024-09-12T18:33:59.926010+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:38.641315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5513,"num_read_kb":4854,"num_write":1595,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'341","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.864340+0000","last_change":"2024-09-12T17:11:05.124261+0000","last_active":"2024-09-12T18:36:01.864340+0000","last_peered":"2024-09-12T18:36:01.864340+0000","last_clean":"2024-09-12T18:36:01.864340+0000","last_became_active":"2024-09-12T17:11:05.123283+0000","last_became_peered":"2024-09-12T17:11:05.123283+0000","last_unstale":"2024-09-12T18:36:01.864340+0000","last_undegraded":"2024-09-12T18:36:01.864340+0000","last_fullsized":"2024-09-12T18:36:01.864340+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048663,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":48133,"num_write":1103,"num_write_kb":35281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"37'5","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:58.750296+0000","last_change":"2024-09-12T17:10:34.352955+0000","last_active":"2024-09-12T18:35:58.750296+0000","last_peered":"2024-09-12T18:35:58.750296+0000","last_clean":"2024-09-12T18:35:58.750296+0000","last_became_active":"2024-09-12T17:10:34.352213+0000","last_became_peered":"2024-09-12T17:10:34.352213+0000","last_unstale":"2024-09-12T18:35:58.750296+0000","last_undegraded":"2024-09-12T18:35:58.750296+0000","last_fullsized":"2024-09-12T18:35:58.750296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:10.177818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'298","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.748127+0000","last_change":"2024-09-12T17:10:36.922284+0000","last_active":"2024-09-12T18:35:59.748127+0000","last_peered":"2024-09-12T18:35:59.748127+0000","last_clean":"2024-09-12T18:35:59.748127+0000","last_became_active":"2024-09-12T17:10:36.921450+0000","last_became_peered":"2024-09-12T17:10:36.921450+0000","last_unstale":"2024-09-12T18:35:59.748127+0000","last_undegraded":"2024-09-12T18:35:59.748127+0000","last_fullsized":"2024-09-12T18:35:59.748127+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:10.318840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44011,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":1000,"num_write":366,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642311+0000","last_change":"2024-09-12T17:10:38.396118+0000","last_active":"2024-09-12T18:33:01.642311+0000","last_peered":"2024-09-12T18:33:01.642311+0000","last_clean":"2024-09-12T18:33:01.642311+0000","last_became_active":"2024-09-12T17:10:38.395457+0000","last_became_peered":"2024-09-12T17:10:38.395457+0000","last_unstale":"2024-09-12T18:33:01.642311+0000","last_undegraded":"2024-09-12T18:33:01.642311+0000","last_fullsized":"2024-09-12T18:33:01.642311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:35.393797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'130","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.742743+0000","last_change":"2024-09-12T17:10:40.430012+0000","last_active":"2024-09-12T18:35:21.742743+0000","last_peered":"2024-09-12T18:35:21.742743+0000","last_clean":"2024-09-12T18:35:21.742743+0000","last_became_active":"2024-09-12T17:10:40.429303+0000","last_became_peered":"2024-09-12T17:10:40.429303+0000","last_unstale":"2024-09-12T18:35:21.742743+0000","last_undegraded":"2024-09-12T18:35:21.742743+0000","last_fullsized":"2024-09-12T18:35:21.742743+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:37.352428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":233,"num_read_kb":212,"num_write":334,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'904","reported_seq":2419,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.879000+0000","last_change":"2024-09-12T17:10:32.363317+0000","last_active":"2024-09-12T18:33:10.879000+0000","last_peered":"2024-09-12T18:33:10.879000+0000","last_clean":"2024-09-12T18:33:10.879000+0000","last_became_active":"2024-09-12T17:10:32.362957+0000","last_became_peered":"2024-09-12T17:10:32.362957+0000","last_unstale":"2024-09-12T18:33:10.879000+0000","last_undegraded":"2024-09-12T18:33:10.879000+0000","last_fullsized":"2024-09-12T18:33:10.879000+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":800,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:46.722218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4274,"num_read_kb":3831,"num_write":1263,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'361","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.852586+0000","last_change":"2024-09-12T17:10:30.374981+0000","last_active":"2024-09-12T18:36:01.852586+0000","last_peered":"2024-09-12T18:36:01.852586+0000","last_clean":"2024-09-12T18:36:01.852586+0000","last_became_active":"2024-09-12T17:10:30.374618+0000","last_became_peered":"2024-09-12T17:10:30.374618+0000","last_unstale":"2024-09-12T18:36:01.852586+0000","last_undegraded":"2024-09-12T18:36:01.852586+0000","last_fullsized":"2024-09-12T18:36:01.852586+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:21.346521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048724,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":441,"num_read_kb":21889,"num_write":990,"num_write_kb":37331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.643558+0000","last_change":"2024-09-12T17:10:34.362059+0000","last_active":"2024-09-12T18:33:06.643558+0000","last_peered":"2024-09-12T18:33:06.643558+0000","last_clean":"2024-09-12T18:33:06.643558+0000","last_became_active":"2024-09-12T17:10:34.361536+0000","last_became_peered":"2024-09-12T17:10:34.361536+0000","last_unstale":"2024-09-12T18:33:06.643558+0000","last_undegraded":"2024-09-12T18:33:06.643558+0000","last_fullsized":"2024-09-12T18:33:06.643558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:33.573141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'114","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:00.592520+0000","last_change":"2024-09-12T17:10:36.923878+0000","last_active":"2024-09-12T18:33:00.592520+0000","last_peered":"2024-09-12T18:33:00.592520+0000","last_clean":"2024-09-12T18:33:00.592520+0000","last_became_active":"2024-09-12T17:10:36.923087+0000","last_became_peered":"2024-09-12T17:10:36.923087+0000","last_unstale":"2024-09-12T18:33:00.592520+0000","last_undegraded":"2024-09-12T18:33:00.592520+0000","last_fullsized":"2024-09-12T18:33:00.592520+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:34.787955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":134,"num_write":98,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'781","reported_seq":2886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.917188+0000","last_change":"2024-09-12T17:10:38.410583+0000","last_active":"2024-09-12T18:36:01.917188+0000","last_peered":"2024-09-12T18:36:01.917188+0000","last_clean":"2024-09-12T18:36:01.917188+0000","last_became_active":"2024-09-12T17:10:38.407830+0000","last_became_peered":"2024-09-12T17:10:38.407830+0000","last_unstale":"2024-09-12T18:36:01.917188+0000","last_undegraded":"2024-09-12T18:36:01.917188+0000","last_fullsized":"2024-09-12T18:36:01.917188+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:25.369785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'146","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.883725+0000","last_change":"2024-09-12T17:10:40.432466+0000","last_active":"2024-09-12T18:33:59.883725+0000","last_peered":"2024-09-12T18:33:59.883725+0000","last_clean":"2024-09-12T18:33:59.883725+0000","last_became_active":"2024-09-12T17:10:40.431693+0000","last_became_peered":"2024-09-12T17:10:40.431693+0000","last_unstale":"2024-09-12T18:33:59.883725+0000","last_undegraded":"2024-09-12T18:33:59.883725+0000","last_fullsized":"2024-09-12T18:33:59.883725+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:18.379860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":232,"num_write":366,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'807","reported_seq":2326,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.812602+0000","last_change":"2024-09-12T17:10:32.370640+0000","last_active":"2024-09-12T18:34:01.812602+0000","last_peered":"2024-09-12T18:34:01.812602+0000","last_clean":"2024-09-12T18:34:01.812602+0000","last_became_active":"2024-09-12T17:10:32.369824+0000","last_became_peered":"2024-09-12T17:10:32.369824+0000","last_unstale":"2024-09-12T18:34:01.812602+0000","last_undegraded":"2024-09-12T18:34:01.812602+0000","last_fullsized":"2024-09-12T18:34:01.812602+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:05.486073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3803,"num_read_kb":3411,"num_write":1089,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'371","reported_seq":1176,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.852673+0000","last_change":"2024-09-12T17:10:30.361138+0000","last_active":"2024-09-12T18:36:01.852673+0000","last_peered":"2024-09-12T18:36:01.852673+0000","last_clean":"2024-09-12T18:36:01.852673+0000","last_became_active":"2024-09-12T17:10:30.357942+0000","last_became_peered":"2024-09-12T17:10:30.357942+0000","last_unstale":"2024-09-12T18:36:01.852673+0000","last_undegraded":"2024-09-12T18:36:01.852673+0000","last_fullsized":"2024-09-12T18:36:01.852673+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:46.703023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310810,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":949,"num_read_kb":26001,"num_write":1281,"num_write_kb":43743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.404767+0000","last_change":"2024-09-12T17:10:34.362432+0000","last_active":"2024-09-12T18:33:06.404767+0000","last_peered":"2024-09-12T18:33:06.404767+0000","last_clean":"2024-09-12T18:33:06.404767+0000","last_became_active":"2024-09-12T17:10:34.361686+0000","last_became_peered":"2024-09-12T17:10:34.361686+0000","last_unstale":"2024-09-12T18:33:06.404767+0000","last_undegraded":"2024-09-12T18:33:06.404767+0000","last_fullsized":"2024-09-12T18:33:06.404767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:20.692641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'367","reported_seq":989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.360473+0000","last_change":"2024-09-12T17:10:36.392913+0000","last_active":"2024-09-12T18:36:00.360473+0000","last_peered":"2024-09-12T18:36:00.360473+0000","last_clean":"2024-09-12T18:36:00.360473+0000","last_became_active":"2024-09-12T17:10:36.392089+0000","last_became_peered":"2024-09-12T17:10:36.392089+0000","last_unstale":"2024-09-12T18:36:00.360473+0000","last_undegraded":"2024-09-12T18:36:00.360473+0000","last_fullsized":"2024-09-12T18:36:00.360473+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:00.724692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47317,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":601,"num_read_kb":1312,"num_write":482,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411609+0000","last_change":"2024-09-12T17:10:38.411770+0000","last_active":"2024-09-12T18:32:51.411609+0000","last_peered":"2024-09-12T18:32:51.411609+0000","last_clean":"2024-09-12T18:32:51.411609+0000","last_became_active":"2024-09-12T17:10:38.411191+0000","last_became_peered":"2024-09-12T17:10:38.411191+0000","last_unstale":"2024-09-12T18:32:51.411609+0000","last_undegraded":"2024-09-12T18:32:51.411609+0000","last_fullsized":"2024-09-12T18:32:51.411609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:29.140092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'100","reported_seq":612,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.845108+0000","last_change":"2024-09-12T17:10:40.437458+0000","last_active":"2024-09-12T18:33:55.845108+0000","last_peered":"2024-09-12T18:33:55.845108+0000","last_clean":"2024-09-12T18:33:55.845108+0000","last_became_active":"2024-09-12T17:10:40.436748+0000","last_became_peered":"2024-09-12T17:10:40.436748+0000","last_unstale":"2024-09-12T18:33:55.845108+0000","last_undegraded":"2024-09-12T18:33:55.845108+0000","last_fullsized":"2024-09-12T18:33:55.845108+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:53.015779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":136,"num_write":243,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'577","reported_seq":2227,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.808541+0000","last_change":"2024-09-12T17:10:32.371759+0000","last_active":"2024-09-12T18:34:01.808541+0000","last_peered":"2024-09-12T18:34:01.808541+0000","last_clean":"2024-09-12T18:34:01.808541+0000","last_became_active":"2024-09-12T17:10:32.370173+0000","last_became_peered":"2024-09-12T17:10:32.370173+0000","last_unstale":"2024-09-12T18:34:01.808541+0000","last_undegraded":"2024-09-12T18:34:01.808541+0000","last_fullsized":"2024-09-12T18:34:01.808541+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:20.201508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2773,"num_read_kb":2563,"num_write":696,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'364","reported_seq":998,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.852339+0000","last_change":"2024-09-12T17:10:30.358739+0000","last_active":"2024-09-12T18:36:01.852339+0000","last_peered":"2024-09-12T18:36:01.852339+0000","last_clean":"2024-09-12T18:36:01.852339+0000","last_became_active":"2024-09-12T17:10:30.355723+0000","last_became_peered":"2024-09-12T17:10:30.355723+0000","last_unstale":"2024-09-12T18:36:01.852339+0000","last_undegraded":"2024-09-12T18:36:01.852339+0000","last_fullsized":"2024-09-12T18:36:01.852339+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:21.953441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":22337,"num_write":1141,"num_write_kb":39083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.412100+0000","last_change":"2024-09-12T17:10:34.364113+0000","last_active":"2024-09-12T18:33:06.412100+0000","last_peered":"2024-09-12T18:33:06.412100+0000","last_clean":"2024-09-12T18:33:06.412100+0000","last_became_active":"2024-09-12T17:10:34.363439+0000","last_became_peered":"2024-09-12T17:10:34.363439+0000","last_unstale":"2024-09-12T18:33:06.412100+0000","last_undegraded":"2024-09-12T18:33:06.412100+0000","last_fullsized":"2024-09-12T18:33:06.412100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:02.164079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'289","reported_seq":889,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.452354+0000","last_change":"2024-09-12T17:10:36.397893+0000","last_active":"2024-09-12T18:36:00.452354+0000","last_peered":"2024-09-12T18:36:00.452354+0000","last_clean":"2024-09-12T18:36:00.452354+0000","last_became_active":"2024-09-12T17:10:36.397148+0000","last_became_peered":"2024-09-12T17:10:36.397148+0000","last_unstale":"2024-09-12T18:36:00.452354+0000","last_undegraded":"2024-09-12T18:36:00.452354+0000","last_fullsized":"2024-09-12T18:36:00.452354+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:04.236115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":1130,"num_write":384,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.584512+0000","last_change":"2024-09-12T17:10:38.407655+0000","last_active":"2024-09-12T18:33:11.584512+0000","last_peered":"2024-09-12T18:33:11.584512+0000","last_clean":"2024-09-12T18:33:11.584512+0000","last_became_active":"2024-09-12T17:10:38.406892+0000","last_became_peered":"2024-09-12T17:10:38.406892+0000","last_unstale":"2024-09-12T18:33:11.584512+0000","last_undegraded":"2024-09-12T18:33:11.584512+0000","last_fullsized":"2024-09-12T18:33:11.584512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:15.244866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'157","reported_seq":692,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:19.439905+0000","last_change":"2024-09-12T17:10:40.770908+0000","last_active":"2024-09-12T18:35:19.439905+0000","last_peered":"2024-09-12T18:35:19.439905+0000","last_clean":"2024-09-12T18:35:19.439905+0000","last_became_active":"2024-09-12T17:10:40.770159+0000","last_became_peered":"2024-09-12T17:10:40.770159+0000","last_unstale":"2024-09-12T18:35:19.439905+0000","last_undegraded":"2024-09-12T18:35:19.439905+0000","last_fullsized":"2024-09-12T18:35:19.439905+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:17.022501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":169,"num_write":336,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'1195","reported_seq":2722,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.926177+0000","last_change":"2024-09-12T17:10:32.358404+0000","last_active":"2024-09-12T18:33:59.926177+0000","last_peered":"2024-09-12T18:33:59.926177+0000","last_clean":"2024-09-12T18:33:59.926177+0000","last_became_active":"2024-09-12T17:10:32.357738+0000","last_became_peered":"2024-09-12T17:10:32.357738+0000","last_unstale":"2024-09-12T18:33:59.926177+0000","last_undegraded":"2024-09-12T18:33:59.926177+0000","last_fullsized":"2024-09-12T18:33:59.926177+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":1100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:54.644317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5279,"num_read_kb":4649,"num_write":1626,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'344","reported_seq":998,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.856173+0000","last_change":"2024-09-12T17:10:30.402255+0000","last_active":"2024-09-12T18:36:01.856173+0000","last_peered":"2024-09-12T18:36:01.856173+0000","last_clean":"2024-09-12T18:36:01.856173+0000","last_became_active":"2024-09-12T17:10:30.401941+0000","last_became_peered":"2024-09-12T17:10:30.401941+0000","last_unstale":"2024-09-12T18:36:01.856173+0000","last_undegraded":"2024-09-12T18:36:01.856173+0000","last_fullsized":"2024-09-12T18:36:01.856173+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:55.543009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310809,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":28042,"num_write":994,"num_write_kb":46600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:45.588684+0000","last_change":"2024-09-12T17:10:34.358478+0000","last_active":"2024-09-12T18:32:45.588684+0000","last_peered":"2024-09-12T18:32:45.588684+0000","last_clean":"2024-09-12T18:32:45.588684+0000","last_became_active":"2024-09-12T17:10:34.357688+0000","last_became_peered":"2024-09-12T17:10:34.357688+0000","last_unstale":"2024-09-12T18:32:45.588684+0000","last_undegraded":"2024-09-12T18:32:45.588684+0000","last_fullsized":"2024-09-12T18:32:45.588684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:01.686198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'249","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.561418+0000","last_change":"2024-09-12T17:10:36.400271+0000","last_active":"2024-09-12T18:35:59.561418+0000","last_peered":"2024-09-12T18:35:59.561418+0000","last_clean":"2024-09-12T18:35:59.561418+0000","last_became_active":"2024-09-12T17:10:36.398639+0000","last_became_peered":"2024-09-12T17:10:36.398639+0000","last_unstale":"2024-09-12T18:35:59.561418+0000","last_undegraded":"2024-09-12T18:35:59.561418+0000","last_fullsized":"2024-09-12T18:35:59.561418+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:36.210475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52346,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":1002,"num_write":330,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.595054+0000","last_change":"2024-09-12T17:10:38.401463+0000","last_active":"2024-09-12T18:33:10.595054+0000","last_peered":"2024-09-12T18:33:10.595054+0000","last_clean":"2024-09-12T18:33:10.595054+0000","last_became_active":"2024-09-12T17:10:38.400703+0000","last_became_peered":"2024-09-12T17:10:38.400703+0000","last_unstale":"2024-09-12T18:33:10.595054+0000","last_undegraded":"2024-09-12T18:33:10.595054+0000","last_fullsized":"2024-09-12T18:33:10.595054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:10.103057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'171","reported_seq":1654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.714827+0000","last_change":"2024-09-12T17:10:40.435581+0000","last_active":"2024-09-12T18:33:55.714827+0000","last_peered":"2024-09-12T18:33:55.714827+0000","last_clean":"2024-09-12T18:33:55.714827+0000","last_became_active":"2024-09-12T17:10:40.434195+0000","last_became_peered":"2024-09-12T17:10:40.434195+0000","last_unstale":"2024-09-12T18:33:55.714827+0000","last_undegraded":"2024-09-12T18:33:55.714827+0000","last_fullsized":"2024-09-12T18:33:55.714827+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:34.304171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1233,"num_read_kb":1222,"num_write":385,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'393","reported_seq":1910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.525932+0000","last_change":"2024-09-12T17:10:32.362342+0000","last_active":"2024-09-12T18:35:20.525932+0000","last_peered":"2024-09-12T18:35:20.525932+0000","last_clean":"2024-09-12T18:35:20.525932+0000","last_became_active":"2024-09-12T17:10:32.361716+0000","last_became_peered":"2024-09-12T17:10:32.361716+0000","last_unstale":"2024-09-12T18:35:20.525932+0000","last_undegraded":"2024-09-12T18:35:20.525932+0000","last_fullsized":"2024-09-12T18:35:20.525932+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:33.025425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2161,"num_read_kb":2069,"num_write":462,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'306","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.896387+0000","last_change":"2024-09-12T17:10:30.388057+0000","last_active":"2024-09-12T18:36:01.896387+0000","last_peered":"2024-09-12T18:36:01.896387+0000","last_clean":"2024-09-12T18:36:01.896387+0000","last_became_active":"2024-09-12T17:10:30.387788+0000","last_became_peered":"2024-09-12T17:10:30.387788+0000","last_unstale":"2024-09-12T18:36:01.896387+0000","last_undegraded":"2024-09-12T18:36:01.896387+0000","last_fullsized":"2024-09-12T18:36:01.896387+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:57.145079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1332788,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":40433,"num_write":1021,"num_write_kb":46438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.643399+0000","last_change":"2024-09-12T17:10:34.357090+0000","last_active":"2024-09-12T18:33:06.643399+0000","last_peered":"2024-09-12T18:33:06.643399+0000","last_clean":"2024-09-12T18:33:06.643399+0000","last_became_active":"2024-09-12T17:10:34.356290+0000","last_became_peered":"2024-09-12T17:10:34.356290+0000","last_unstale":"2024-09-12T18:33:06.643399+0000","last_undegraded":"2024-09-12T18:33:06.643399+0000","last_fullsized":"2024-09-12T18:33:06.643399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:58.022339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'309","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.841400+0000","last_change":"2024-09-12T17:10:36.392771+0000","last_active":"2024-09-12T18:35:59.841400+0000","last_peered":"2024-09-12T18:35:59.841400+0000","last_clean":"2024-09-12T18:35:59.841400+0000","last_became_active":"2024-09-12T17:10:36.391455+0000","last_became_peered":"2024-09-12T17:10:36.391455+0000","last_unstale":"2024-09-12T18:35:59.841400+0000","last_undegraded":"2024-09-12T18:35:59.841400+0000","last_fullsized":"2024-09-12T18:35:59.841400+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:23.461018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44113,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":1099,"num_write":400,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.415277+0000","last_change":"2024-09-12T17:10:38.414101+0000","last_active":"2024-09-12T18:33:11.415277+0000","last_peered":"2024-09-12T18:33:11.415277+0000","last_clean":"2024-09-12T18:33:11.415277+0000","last_became_active":"2024-09-12T17:10:38.413592+0000","last_became_peered":"2024-09-12T17:10:38.413592+0000","last_unstale":"2024-09-12T18:33:11.415277+0000","last_undegraded":"2024-09-12T18:33:11.415277+0000","last_fullsized":"2024-09-12T18:33:11.415277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:44.432349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'148","reported_seq":661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.433937+0000","last_change":"2024-09-12T17:10:40.432069+0000","last_active":"2024-09-12T18:35:20.433937+0000","last_peered":"2024-09-12T18:35:20.433937+0000","last_clean":"2024-09-12T18:35:20.433937+0000","last_became_active":"2024-09-12T17:10:40.425063+0000","last_became_peered":"2024-09-12T17:10:40.425063+0000","last_unstale":"2024-09-12T18:35:20.433937+0000","last_undegraded":"2024-09-12T18:35:20.433937+0000","last_fullsized":"2024-09-12T18:35:20.433937+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:02.872786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":181,"num_read_kb":173,"num_write":358,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'373","reported_seq":1793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.509133+0000","last_change":"2024-09-12T17:10:32.365153+0000","last_active":"2024-09-12T18:33:01.509133+0000","last_peered":"2024-09-12T18:33:01.509133+0000","last_clean":"2024-09-12T18:33:01.509133+0000","last_became_active":"2024-09-12T17:10:32.361445+0000","last_became_peered":"2024-09-12T17:10:32.361445+0000","last_unstale":"2024-09-12T18:33:01.509133+0000","last_undegraded":"2024-09-12T18:33:01.509133+0000","last_fullsized":"2024-09-12T18:33:01.509133+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:31.834987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1921,"num_read_kb":1829,"num_write":410,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'364","reported_seq":1015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.393839+0000","last_change":"2024-09-12T18:36:06.393839+0000","last_active":"2024-09-12T18:36:06.393839+0000","last_peered":"2024-09-12T18:36:06.393839+0000","last_clean":"2024-09-12T18:36:06.393839+0000","last_became_active":"2024-09-12T17:11:04.372622+0000","last_became_peered":"2024-09-12T17:11:04.372622+0000","last_unstale":"2024-09-12T18:36:06.393839+0000","last_undegraded":"2024-09-12T18:36:06.393839+0000","last_fullsized":"2024-09-12T18:36:06.393839+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T18:36:06.393728+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T18:36:06.393728+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.393728+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:56.730903+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456544,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":530,"num_read_kb":34257,"num_write":1086,"num_write_kb":35279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'377","reported_seq":1894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.641114+0000","last_change":"2024-09-12T17:10:32.364419+0000","last_active":"2024-09-12T18:32:56.641114+0000","last_peered":"2024-09-12T18:32:56.641114+0000","last_clean":"2024-09-12T18:32:56.641114+0000","last_became_active":"2024-09-12T17:10:32.364080+0000","last_became_peered":"2024-09-12T17:10:32.364080+0000","last_unstale":"2024-09-12T18:32:56.641114+0000","last_undegraded":"2024-09-12T18:32:56.641114+0000","last_fullsized":"2024-09-12T18:32:56.641114+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:41.911462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2111,"num_read_kb":2018,"num_write":410,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'353","reported_seq":1128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.903376+0000","last_change":"2024-09-12T17:10:30.394272+0000","last_active":"2024-09-12T18:36:01.903376+0000","last_peered":"2024-09-12T18:36:01.903376+0000","last_clean":"2024-09-12T18:36:01.903376+0000","last_became_active":"2024-09-12T17:10:30.393924+0000","last_became_peered":"2024-09-12T17:10:30.393924+0000","last_unstale":"2024-09-12T18:36:01.903376+0000","last_undegraded":"2024-09-12T18:36:01.903376+0000","last_fullsized":"2024-09-12T18:36:01.903376+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:07.405582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550017,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":731,"num_read_kb":31225,"num_write":1143,"num_write_kb":33307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'812","reported_seq":2200,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.879138+0000","last_change":"2024-09-12T17:10:32.382803+0000","last_active":"2024-09-12T18:33:10.879138+0000","last_peered":"2024-09-12T18:33:10.879138+0000","last_clean":"2024-09-12T18:33:10.879138+0000","last_became_active":"2024-09-12T17:10:32.382110+0000","last_became_peered":"2024-09-12T17:10:32.382110+0000","last_unstale":"2024-09-12T18:33:10.879138+0000","last_undegraded":"2024-09-12T18:33:10.879138+0000","last_fullsized":"2024-09-12T18:33:10.879138+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:57.022415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3583,"num_read_kb":3191,"num_write":1046,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'356","reported_seq":1032,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.667319+0000","last_change":"2024-09-12T17:10:30.359981+0000","last_active":"2024-09-12T18:36:01.667319+0000","last_peered":"2024-09-12T18:36:01.667319+0000","last_clean":"2024-09-12T18:36:01.667319+0000","last_became_active":"2024-09-12T17:10:30.352353+0000","last_became_peered":"2024-09-12T17:10:30.352353+0000","last_unstale":"2024-09-12T18:36:01.667319+0000","last_undegraded":"2024-09-12T18:36:01.667319+0000","last_fullsized":"2024-09-12T18:36:01.667319+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:03.651567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267294,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":541,"num_read_kb":44546,"num_write":1186,"num_write_kb":40457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'442","reported_seq":1987,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.641022+0000","last_change":"2024-09-12T17:10:32.379036+0000","last_active":"2024-09-12T18:32:56.641022+0000","last_peered":"2024-09-12T18:32:56.641022+0000","last_clean":"2024-09-12T18:32:56.641022+0000","last_became_active":"2024-09-12T17:10:32.378659+0000","last_became_peered":"2024-09-12T17:10:32.378659+0000","last_unstale":"2024-09-12T18:32:56.641022+0000","last_undegraded":"2024-09-12T18:32:56.641022+0000","last_fullsized":"2024-09-12T18:32:56.641022+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:58.217683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2290,"num_read_kb":2161,"num_write":510,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'375","reported_seq":1038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.847829+0000","last_change":"2024-09-12T17:11:04.869478+0000","last_active":"2024-09-12T18:36:01.847829+0000","last_peered":"2024-09-12T18:36:01.847829+0000","last_clean":"2024-09-12T18:36:01.847829+0000","last_became_active":"2024-09-12T17:11:04.868302+0000","last_became_peered":"2024-09-12T17:11:04.868302+0000","last_unstale":"2024-09-12T18:36:01.847829+0000","last_undegraded":"2024-09-12T18:36:01.847829+0000","last_fullsized":"2024-09-12T18:36:01.847829+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:22.742268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194362,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":35312,"num_write":1211,"num_write_kb":68294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'520","reported_seq":2242,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.460046+0000","last_change":"2024-09-12T17:10:32.383452+0000","last_active":"2024-09-12T18:35:20.460046+0000","last_peered":"2024-09-12T18:35:20.460046+0000","last_clean":"2024-09-12T18:35:20.460046+0000","last_became_active":"2024-09-12T17:10:32.382841+0000","last_became_peered":"2024-09-12T17:10:32.382841+0000","last_unstale":"2024-09-12T18:35:20.460046+0000","last_undegraded":"2024-09-12T18:35:20.460046+0000","last_fullsized":"2024-09-12T18:35:20.460046+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:08.070690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2888,"num_read_kb":2690,"num_write":642,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'320","reported_seq":980,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.862357+0000","last_change":"2024-09-12T17:11:04.373500+0000","last_active":"2024-09-12T18:36:01.862357+0000","last_peered":"2024-09-12T18:36:01.862357+0000","last_clean":"2024-09-12T18:36:01.862357+0000","last_became_active":"2024-09-12T17:11:04.373103+0000","last_became_peered":"2024-09-12T17:11:04.373103+0000","last_unstale":"2024-09-12T18:36:01.862357+0000","last_undegraded":"2024-09-12T18:36:01.862357+0000","last_fullsized":"2024-09-12T18:36:01.862357+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:02.210085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":30230,"num_write":1056,"num_write_kb":31529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'444","reported_seq":2070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605323+0000","last_change":"2024-09-12T17:10:32.371035+0000","last_active":"2024-09-12T18:33:55.605323+0000","last_peered":"2024-09-12T18:33:55.605323+0000","last_clean":"2024-09-12T18:33:55.605323+0000","last_became_active":"2024-09-12T17:10:32.370112+0000","last_became_peered":"2024-09-12T17:10:32.370112+0000","last_unstale":"2024-09-12T18:33:55.605323+0000","last_undegraded":"2024-09-12T18:33:55.605323+0000","last_fullsized":"2024-09-12T18:33:55.605323+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:03.389218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2345,"num_read_kb":2230,"num_write":501,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'371","reported_seq":1062,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.819848+0000","last_change":"2024-09-12T17:10:30.349073+0000","last_active":"2024-09-12T18:36:01.819848+0000","last_peered":"2024-09-12T18:36:01.819848+0000","last_clean":"2024-09-12T18:36:01.819848+0000","last_became_active":"2024-09-12T17:10:30.348702+0000","last_became_peered":"2024-09-12T17:10:30.348702+0000","last_unstale":"2024-09-12T18:36:01.819848+0000","last_undegraded":"2024-09-12T18:36:01.819848+0000","last_fullsized":"2024-09-12T18:36:01.819848+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:53.542082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310621,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":552,"num_read_kb":10243,"num_write":1254,"num_write_kb":63527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'738","reported_seq":2624,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:54.421771+0000","last_change":"2024-09-12T17:10:32.371291+0000","last_active":"2024-09-12T18:33:54.421771+0000","last_peered":"2024-09-12T18:33:54.421771+0000","last_clean":"2024-09-12T18:33:54.421771+0000","last_became_active":"2024-09-12T17:10:32.371017+0000","last_became_peered":"2024-09-12T17:10:32.371017+0000","last_unstale":"2024-09-12T18:33:54.421771+0000","last_undegraded":"2024-09-12T18:33:54.421771+0000","last_fullsized":"2024-09-12T18:33:54.421771+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:50.198581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4018,"num_read_kb":3683,"num_write":976,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'331","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.818291+0000","last_change":"2024-09-12T17:10:30.400783+0000","last_active":"2024-09-12T18:36:01.818291+0000","last_peered":"2024-09-12T18:36:01.818291+0000","last_clean":"2024-09-12T18:36:01.818291+0000","last_became_active":"2024-09-12T17:10:30.396958+0000","last_became_peered":"2024-09-12T17:10:30.396958+0000","last_unstale":"2024-09-12T18:36:01.818291+0000","last_undegraded":"2024-09-12T18:36:01.818291+0000","last_fullsized":"2024-09-12T18:36:01.818291+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:01.387221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9953582,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":23680,"num_write":1025,"num_write_kb":41122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'720","reported_seq":2418,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.593833+0000","last_change":"2024-09-12T17:10:32.348966+0000","last_active":"2024-09-12T18:33:56.593833+0000","last_peered":"2024-09-12T18:33:56.593833+0000","last_clean":"2024-09-12T18:33:56.593833+0000","last_became_active":"2024-09-12T17:10:32.348200+0000","last_became_peered":"2024-09-12T17:10:32.348200+0000","last_unstale":"2024-09-12T18:33:56.593833+0000","last_undegraded":"2024-09-12T18:33:56.593833+0000","last_fullsized":"2024-09-12T18:33:56.593833+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":700,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:53.609655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3587,"num_read_kb":3235,"num_write":983,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'407","reported_seq":1103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.867544+0000","last_change":"2024-09-12T17:10:30.370508+0000","last_active":"2024-09-12T18:36:01.867544+0000","last_peered":"2024-09-12T18:36:01.867544+0000","last_clean":"2024-09-12T18:36:01.867544+0000","last_became_active":"2024-09-12T17:10:30.370015+0000","last_became_peered":"2024-09-12T17:10:30.370015+0000","last_unstale":"2024-09-12T18:36:01.867544+0000","last_undegraded":"2024-09-12T18:36:01.867544+0000","last_fullsized":"2024-09-12T18:36:01.867544+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:13.056343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399128,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":575,"num_read_kb":40389,"num_write":1181,"num_write_kb":51606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'836","reported_seq":2470,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.531341+0000","last_change":"2024-09-12T17:10:32.350274+0000","last_active":"2024-09-12T18:35:20.531341+0000","last_peered":"2024-09-12T18:35:20.531341+0000","last_clean":"2024-09-12T18:35:20.531341+0000","last_became_active":"2024-09-12T17:10:32.348842+0000","last_became_peered":"2024-09-12T17:10:32.348842+0000","last_unstale":"2024-09-12T18:35:20.531341+0000","last_undegraded":"2024-09-12T18:35:20.531341+0000","last_fullsized":"2024-09-12T18:35:20.531341+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:40.714584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4030,"num_read_kb":3642,"num_write":1104,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'317","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.873859+0000","last_change":"2024-09-12T17:10:30.351530+0000","last_active":"2024-09-12T18:36:01.873859+0000","last_peered":"2024-09-12T18:36:01.873859+0000","last_clean":"2024-09-12T18:36:01.873859+0000","last_became_active":"2024-09-12T17:10:30.349523+0000","last_became_peered":"2024-09-12T17:10:30.349523+0000","last_unstale":"2024-09-12T18:36:01.873859+0000","last_undegraded":"2024-09-12T18:36:01.873859+0000","last_fullsized":"2024-09-12T18:36:01.873859+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:13.854677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456505,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":103976,"num_write":995,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'519","reported_seq":2350,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.627374+0000","last_change":"2024-09-12T17:10:32.363610+0000","last_active":"2024-09-12T18:33:18.627374+0000","last_peered":"2024-09-12T18:33:18.627374+0000","last_clean":"2024-09-12T18:33:18.627374+0000","last_became_active":"2024-09-12T17:10:32.362881+0000","last_became_peered":"2024-09-12T17:10:32.362881+0000","last_unstale":"2024-09-12T18:33:18.627374+0000","last_undegraded":"2024-09-12T18:33:18.627374+0000","last_fullsized":"2024-09-12T18:33:18.627374+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:27.711767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2930,"num_read_kb":2778,"num_write":610,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'363","reported_seq":1051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.897692+0000","last_change":"2024-09-12T17:10:30.379084+0000","last_active":"2024-09-12T18:36:01.897692+0000","last_peered":"2024-09-12T18:36:01.897692+0000","last_clean":"2024-09-12T18:36:01.897692+0000","last_became_active":"2024-09-12T17:10:30.378766+0000","last_became_peered":"2024-09-12T17:10:30.378766+0000","last_unstale":"2024-09-12T18:36:01.897692+0000","last_undegraded":"2024-09-12T18:36:01.897692+0000","last_fullsized":"2024-09-12T18:36:01.897692+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:25.386692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102155,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":26410,"num_write":1209,"num_write_kb":29487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'523","reported_seq":2172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:48.554813+0000","last_change":"2024-09-12T17:10:32.342457+0000","last_active":"2024-09-12T18:32:48.554813+0000","last_peered":"2024-09-12T18:32:48.554813+0000","last_clean":"2024-09-12T18:32:48.554813+0000","last_became_active":"2024-09-12T17:10:32.341480+0000","last_became_peered":"2024-09-12T17:10:32.341480+0000","last_unstale":"2024-09-12T18:32:48.554813+0000","last_undegraded":"2024-09-12T18:32:48.554813+0000","last_fullsized":"2024-09-12T18:32:48.554813+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:37.744373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2856,"num_read_kb":2663,"num_write":671,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'349","reported_seq":1099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.833429+0000","last_change":"2024-09-12T17:10:30.405089+0000","last_active":"2024-09-12T18:36:01.833429+0000","last_peered":"2024-09-12T18:36:01.833429+0000","last_clean":"2024-09-12T18:36:01.833429+0000","last_became_active":"2024-09-12T17:10:30.404567+0000","last_became_peered":"2024-09-12T17:10:30.404567+0000","last_unstale":"2024-09-12T18:36:01.833429+0000","last_undegraded":"2024-09-12T18:36:01.833429+0000","last_fullsized":"2024-09-12T18:36:01.833429+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:28.951703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":789,"num_read_kb":46887,"num_write":1083,"num_write_kb":42596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'378","reported_seq":1777,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.808337+0000","last_change":"2024-09-12T17:10:32.371681+0000","last_active":"2024-09-12T18:34:01.808337+0000","last_peered":"2024-09-12T18:34:01.808337+0000","last_clean":"2024-09-12T18:34:01.808337+0000","last_became_active":"2024-09-12T17:10:32.370799+0000","last_became_peered":"2024-09-12T17:10:32.370799+0000","last_unstale":"2024-09-12T18:34:01.808337+0000","last_undegraded":"2024-09-12T18:34:01.808337+0000","last_fullsized":"2024-09-12T18:34:01.808337+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:01.601445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2049,"num_read_kb":1938,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'327","reported_seq":957,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.868954+0000","last_change":"2024-09-12T17:10:30.375100+0000","last_active":"2024-09-12T18:36:01.868954+0000","last_peered":"2024-09-12T18:36:01.868954+0000","last_clean":"2024-09-12T18:36:01.868954+0000","last_became_active":"2024-09-12T17:10:30.374689+0000","last_became_peered":"2024-09-12T17:10:30.374689+0000","last_unstale":"2024-09-12T18:36:01.868954+0000","last_undegraded":"2024-09-12T18:36:01.868954+0000","last_fullsized":"2024-09-12T18:36:01.868954+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:34.230883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7813717,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":410,"num_read_kb":28127,"num_write":1070,"num_write_kb":52007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1583","reported_seq":3063,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.416229+0000","last_change":"2024-09-12T17:10:32.385251+0000","last_active":"2024-09-12T18:33:51.416229+0000","last_peered":"2024-09-12T18:33:51.416229+0000","last_clean":"2024-09-12T18:33:51.416229+0000","last_became_active":"2024-09-12T17:10:32.384842+0000","last_became_peered":"2024-09-12T17:10:32.384842+0000","last_unstale":"2024-09-12T18:33:51.416229+0000","last_undegraded":"2024-09-12T18:33:51.416229+0000","last_fullsized":"2024-09-12T18:33:51.416229+0000","mapping_epoch":27,"log_start":"268'1500","ondisk_log_start":"268'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":1500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:41.827736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6992,"num_read_kb":6083,"num_write":2272,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'489","reported_seq":1300,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.824861+0000","last_change":"2024-09-12T17:12:05.373752+0000","last_active":"2024-09-12T18:36:01.824861+0000","last_peered":"2024-09-12T18:36:01.824861+0000","last_clean":"2024-09-12T18:36:01.824861+0000","last_became_active":"2024-09-12T17:12:05.372879+0000","last_became_peered":"2024-09-12T17:12:05.372879+0000","last_unstale":"2024-09-12T18:36:01.824861+0000","last_undegraded":"2024-09-12T18:36:01.824861+0000","last_fullsized":"2024-09-12T18:36:01.824861+0000","mapping_epoch":40,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:28.746471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":953,"num_read_kb":72647,"num_write":1674,"num_write_kb":47468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,0],"acting":[6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'1142","reported_seq":2649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.423471+0000","last_change":"2024-09-12T17:10:32.361735+0000","last_active":"2024-09-12T18:33:51.423471+0000","last_peered":"2024-09-12T18:33:51.423471+0000","last_clean":"2024-09-12T18:33:51.423471+0000","last_became_active":"2024-09-12T17:10:32.361416+0000","last_became_peered":"2024-09-12T17:10:32.361416+0000","last_unstale":"2024-09-12T18:33:51.423471+0000","last_undegraded":"2024-09-12T18:33:51.423471+0000","last_fullsized":"2024-09-12T18:33:51.423471+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5102,"num_read_kb":4502,"num_write":1588,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'428","reported_seq":1221,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.866208+0000","last_change":"2024-09-12T17:10:30.405641+0000","last_active":"2024-09-12T18:36:01.866208+0000","last_peered":"2024-09-12T18:36:01.866208+0000","last_clean":"2024-09-12T18:36:01.866208+0000","last_became_active":"2024-09-12T17:10:30.404403+0000","last_became_peered":"2024-09-12T17:10:30.404403+0000","last_unstale":"2024-09-12T18:36:01.866208+0000","last_undegraded":"2024-09-12T18:36:01.866208+0000","last_fullsized":"2024-09-12T18:36:01.866208+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:16.546068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":773,"num_read_kb":38616,"num_write":1272,"num_write_kb":36952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'389","reported_seq":1946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.526147+0000","last_change":"2024-09-12T17:10:32.353298+0000","last_active":"2024-09-12T18:35:20.526147+0000","last_peered":"2024-09-12T18:35:20.526147+0000","last_clean":"2024-09-12T18:35:20.526147+0000","last_became_active":"2024-09-12T17:10:32.352916+0000","last_became_peered":"2024-09-12T17:10:32.352916+0000","last_unstale":"2024-09-12T18:35:20.526147+0000","last_undegraded":"2024-09-12T18:35:20.526147+0000","last_fullsized":"2024-09-12T18:35:20.526147+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:14.122659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2283,"num_read_kb":2176,"num_write":460,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'343","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.824049+0000","last_change":"2024-09-12T17:10:30.402433+0000","last_active":"2024-09-12T18:36:01.824049+0000","last_peered":"2024-09-12T18:36:01.824049+0000","last_clean":"2024-09-12T18:36:01.824049+0000","last_became_active":"2024-09-12T17:10:30.402024+0000","last_became_peered":"2024-09-12T17:10:30.402024+0000","last_unstale":"2024-09-12T18:36:01.824049+0000","last_undegraded":"2024-09-12T18:36:01.824049+0000","last_fullsized":"2024-09-12T18:36:01.824049+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:43.146846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048602,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":454,"num_read_kb":33472,"num_write":1006,"num_write_kb":44244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'828","reported_seq":2396,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:21.408504+0000","last_change":"2024-09-12T17:10:32.376676+0000","last_active":"2024-09-12T18:33:21.408504+0000","last_peered":"2024-09-12T18:33:21.408504+0000","last_clean":"2024-09-12T18:33:21.408504+0000","last_became_active":"2024-09-12T17:10:32.375891+0000","last_became_peered":"2024-09-12T17:10:32.375891+0000","last_unstale":"2024-09-12T18:33:21.408504+0000","last_undegraded":"2024-09-12T18:33:21.408504+0000","last_fullsized":"2024-09-12T18:33:21.408504+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:45.205202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3808,"num_read_kb":3437,"num_write":1089,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'407","reported_seq":1129,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.896255+0000","last_change":"2024-09-12T17:10:30.379099+0000","last_active":"2024-09-12T18:36:01.896255+0000","last_peered":"2024-09-12T18:36:01.896255+0000","last_clean":"2024-09-12T18:36:01.896255+0000","last_became_active":"2024-09-12T17:10:30.378109+0000","last_became_peered":"2024-09-12T17:10:30.378109+0000","last_unstale":"2024-09-12T18:36:01.896255+0000","last_undegraded":"2024-09-12T18:36:01.896255+0000","last_fullsized":"2024-09-12T18:36:01.896255+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:36.314866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505043,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":645,"num_read_kb":82540,"num_write":1282,"num_write_kb":46419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'405","reported_seq":1084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.856863+0000","last_change":"2024-09-12T17:10:30.357091+0000","last_active":"2024-09-12T18:36:01.856863+0000","last_peered":"2024-09-12T18:36:01.856863+0000","last_clean":"2024-09-12T18:36:01.856863+0000","last_became_active":"2024-09-12T17:10:30.356199+0000","last_became_peered":"2024-09-12T17:10:30.356199+0000","last_unstale":"2024-09-12T18:36:01.856863+0000","last_undegraded":"2024-09-12T18:36:01.856863+0000","last_fullsized":"2024-09-12T18:36:01.856863+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:59.039701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4401467,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":595,"num_read_kb":25748,"num_write":1241,"num_write_kb":44098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'457","reported_seq":2245,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.814149+0000","last_change":"2024-09-12T17:10:32.350936+0000","last_active":"2024-09-12T18:34:01.814149+0000","last_peered":"2024-09-12T18:34:01.814149+0000","last_clean":"2024-09-12T18:34:01.814149+0000","last_became_active":"2024-09-12T17:10:32.349687+0000","last_became_peered":"2024-09-12T17:10:32.349687+0000","last_unstale":"2024-09-12T18:34:01.814149+0000","last_undegraded":"2024-09-12T18:34:01.814149+0000","last_fullsized":"2024-09-12T18:34:01.814149+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:14.030096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2918,"num_read_kb":2789,"num_write":551,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'377","reported_seq":1039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.874406+0000","last_change":"2024-09-12T17:11:05.122501+0000","last_active":"2024-09-12T18:36:01.874406+0000","last_peered":"2024-09-12T18:36:01.874406+0000","last_clean":"2024-09-12T18:36:01.874406+0000","last_became_active":"2024-09-12T17:11:05.121473+0000","last_became_peered":"2024-09-12T17:11:05.121473+0000","last_unstale":"2024-09-12T18:36:01.874406+0000","last_undegraded":"2024-09-12T18:36:01.874406+0000","last_fullsized":"2024-09-12T18:36:01.874406+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:29.310775+0000","last_clean_scrub_stamp":"2024-09-12T17:10:29.310775+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:52.213656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574022,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":29048,"num_write":1222,"num_write_kb":43104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'468","reported_seq":1964,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.515670+0000","last_change":"2024-09-12T17:10:32.353257+0000","last_active":"2024-09-12T18:33:01.515670+0000","last_peered":"2024-09-12T18:33:01.515670+0000","last_clean":"2024-09-12T18:33:01.515670+0000","last_became_active":"2024-09-12T17:10:32.352369+0000","last_became_peered":"2024-09-12T17:10:32.352369+0000","last_unstale":"2024-09-12T18:33:01.515670+0000","last_undegraded":"2024-09-12T18:33:01.515670+0000","last_fullsized":"2024-09-12T18:33:01.515670+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:04.294268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2354,"num_read_kb":2191,"num_write":554,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6108,"num_read_kb":4244,"num_write":1960,"num_write_kb":858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1131,"ondisk_log_size":1131,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":16274,"num_read_kb":15945,"num_write":16744,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1671,"ondisk_log_size":1671,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":731,"ondisk_log_size":731,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1625724,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":19494,"num_read_kb":40096,"num_write":16267,"num_write_kb":12112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1950,"ondisk_log_size":1950,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":213001,"num_read_kb":194600,"num_write":55405,"num_write_kb":18906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3776,"ondisk_log_size":3776,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":165322276,"num_objects":398,"num_object_clones":0,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":0,"num_read":36558,"num_read_kb":2308341,"num_write":72533,"num_write_kb":2504748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":249851904,"data_stored":249851904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3895,"ondisk_log_size":3895,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":159116,"num_write":182,"num_write_kb":116497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":158495,"num_write":182,"num_write_kb":116497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510474,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":340560,"kb_used_data":52360,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94031280,"statfs":{"total":96636764160,"available":96288030720,"internally_reserved":0,"allocated":53616640,"data_stored":51463722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":294910410},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510478,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":295120,"kb_used_data":33428,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94076720,"statfs":{"total":96636764160,"available":96334561280,"internally_reserved":0,"allocated":34230272,"data_stored":32143073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510475,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179180,"kb_used_data":31220,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94192660,"statfs":{"total":96636764160,"available":96453283840,"internally_reserved":0,"allocated":31969280,"data_stored":29799186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510477,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131040,"kb_used_data":23408,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94240800,"statfs":{"total":96636764160,"available":96502579200,"internally_reserved":0,"allocated":23969792,"data_stored":21888023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510478,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209712,"kb_used_data":25844,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94162128,"statfs":{"total":96636764160,"available":96422019072,"internally_reserved":0,"allocated":26464256,"data_stored":24357991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510475,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302328,"kb_used_data":36472,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94069512,"statfs":{"total":96636764160,"available":96327180288,"internally_reserved":0,"allocated":37347328,"data_stored":35205199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":272169414},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543181,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152104,"kb_used_data":40324,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94219736,"statfs":{"total":96636764160,"available":96481009664,"internally_reserved":0,"allocated":41291776,"data_stored":39213361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575882,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320580,"kb_used_data":36724,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94051260,"statfs":{"total":96636764160,"available":96308490240,"internally_reserved":0,"allocated":37605376,"data_stored":35472167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32301056,"data_stored":32301056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22044672,"data_stored":22044672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19574784,"data_stored":19574784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33157120,"data_stored":33157120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36900864,"data_stored":36900864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":27484160,"data_stored":27484160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29831168,"data_stored":29831168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":48558080,"data_stored":48558080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:36:08.669 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.669 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.669 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.670 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.670 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.670 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.670 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.670 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.670 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.670 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.670 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.670 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.671 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.671 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.671 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.671 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.671 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.671 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.671 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.671 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.671 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.672 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.672 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.672 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.672 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.672 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.672 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.672 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.673 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.673 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.673 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.673 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.673 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.673 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.673 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.673 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.673 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.674 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.674 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.674 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.674 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.674 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.674 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.674 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.674 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.674 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.675 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.675 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.675 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.675 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.675 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.675 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.675 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.675 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.675 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.676 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.676 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.676 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.676 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.676 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.676 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.676 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.676 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.677 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.677 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.677 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.677 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.677 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.677 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.677 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.677 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.677 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.678 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.678 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.678 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.678 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.678 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.678 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.678 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.678 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.678 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.679 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.679 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.679 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.679 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.679 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.679 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.679 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.679 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.680 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.680 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.680 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.680 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.680 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.680 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.680 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.680 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.681 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.681 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.681 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.681 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.681 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.681 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.681 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.681 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.681 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.682 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.682 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.682 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.682 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.682 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.682 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.682 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.682 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.682 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.683 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.683 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.683 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.683 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.683 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.683 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.683 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.683 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.683 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.684 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.684 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.684 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.684 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.684 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.684 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.684 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.684 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.684 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.685 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.685 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.685 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.685 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.685 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.685 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.685 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.685 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.686 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.686 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.686 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.686 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.686 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.686 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.686 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.686 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.686 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.687 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.687 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.687 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.687 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.687 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.687 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.687 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.687 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.688 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.688 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.688 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.688 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.688 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.688 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.688 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.688 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.688 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.689 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.689 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.689 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.689 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.689 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.689 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.689 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.689 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.690 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.690 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.690 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.690 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.690 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.690 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.690 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.690 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.690 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.691 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.691 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.691 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.691 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.691 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.691 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.691 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.691 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.692 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.692 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.692 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.692 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.692 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.692 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.692 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.692 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.692 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.693 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.693 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.693 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.693 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.693 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.693 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.693 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.693 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.694 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.694 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.694 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.694 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.694 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.694 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.694 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.694 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.694 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.695 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.695 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.695 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.695 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.695 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.695 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.695 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.695 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.696 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.696 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.696 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.696 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T17:10:11.999189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.696 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T17:10:17.042870+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.696 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.696 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.696 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.696 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.697 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.697 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.697 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T17:10:17.042870+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.697 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.697 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.697 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.697 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.697 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.697 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T17:10:17.042870+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.698 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.698 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.698 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.698 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.698 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.698 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T17:10:17.042870+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.698 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.698 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.698 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.699 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.699 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.699 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.699 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.699 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T17:10:17.042870+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.699 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.699 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.699 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.699 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.700 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.700 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.700 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T17:10:17.042870+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.700 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.700 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.700 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.700 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.701 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.701 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.701 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T17:10:17.042870+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.701 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.701 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.701 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.701 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.701 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.702 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.702 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T17:10:17.042870+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.702 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.702 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.702 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.702 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.702 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.702 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.703 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.703 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.703 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.703 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.703 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.703 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.703 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.703 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.704 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.704 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.704 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.704 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.704 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.704 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.704 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.704 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.704 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.705 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.705 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.705 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.705 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.705 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.705 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.705 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.705 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.706 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.706 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.706 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.706 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.706 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.706 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.706 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.706 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.706 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.707 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.707 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.707 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.707 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.707 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.707 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.707 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.707 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.707 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.707 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.708 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.708 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.708 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.708 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.708 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.708 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.708 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.708 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.709 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.709 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.709 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.709 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.709 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.709 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.709 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.709 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.710 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.710 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.710 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.710 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.710 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.710 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.710 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.710 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.710 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.711 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.711 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.711 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.711 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.711 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.711 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.711 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.711 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.711 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.712 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.712 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.712 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.712 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.712 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.712 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.712 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.712 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.712 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.713 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.713 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.713 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.713 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.713 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.713 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.713 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.713 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.713 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.714 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.714 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.714 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.714 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.714 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.714 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.714 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.714 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T17:10:29.310775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.714 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:08.715 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:36:28.716 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:36:29.080 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:36:29.097 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T18:36:29.108 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":2849,"stamp":"2024-09-12T18:36:28.862276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":167556499,"num_objects":881,"num_object_clones":0,"num_object_copies":2160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":881,"num_whiteouts":0,"num_read":294260,"num_read_kb":2883804,"num_write":163416,"num_write_kb":2776168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":213,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34456,"num_omap_keys":140,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13556,"ondisk_log_size":13556,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1938212,"kb_used_data":279780,"kb_used_omap":12,"kb_used_meta":1658291,"kb_avail":753036508,"statfs":{"total":773094113280,"available":771109384192,"internally_reserved":0,"allocated":286494720,"data_stored":269542722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1698090545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27796,"num_omap_keys":113,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009581"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.416560+0000","last_change":"2024-09-12T17:53:27.147438+0000","last_active":"2024-09-12T18:33:26.416560+0000","last_peered":"2024-09-12T18:33:26.416560+0000","last_clean":"2024-09-12T18:33:26.416560+0000","last_became_active":"2024-09-12T17:53:27.146780+0000","last_became_peered":"2024-09-12T17:53:27.146780+0000","last_unstale":"2024-09-12T18:33:26.416560+0000","last_undegraded":"2024-09-12T18:33:26.416560+0000","last_fullsized":"2024-09-12T18:33:26.416560+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:27.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"268'11","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.268205+0000","last_change":"2024-09-12T17:31:16.246161+0000","last_active":"2024-09-12T18:35:59.268205+0000","last_peered":"2024-09-12T18:35:59.268205+0000","last_clean":"2024-09-12T18:35:59.268205+0000","last_became_active":"2024-09-12T17:31:16.245482+0000","last_became_peered":"2024-09-12T17:31:16.245482+0000","last_unstale":"2024-09-12T18:35:59.268205+0000","last_undegraded":"2024-09-12T18:35:59.268205+0000","last_fullsized":"2024-09-12T18:35:59.268205+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5245,"num_write":16,"num_write_kb":2121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.419803+0000","last_change":"2024-09-12T17:31:12.096770+0000","last_active":"2024-09-12T18:33:44.419803+0000","last_peered":"2024-09-12T18:33:44.419803+0000","last_clean":"2024-09-12T18:33:44.419803+0000","last_became_active":"2024-09-12T17:31:12.094935+0000","last_became_peered":"2024-09-12T17:31:12.094935+0000","last_unstale":"2024-09-12T18:33:44.419803+0000","last_undegraded":"2024-09-12T18:33:44.419803+0000","last_fullsized":"2024-09-12T18:33:44.419803+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'30","reported_seq":144,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:16.429684+0000","last_change":"2024-09-12T17:27:32.584697+0000","last_active":"2024-09-12T18:34:16.429684+0000","last_peered":"2024-09-12T18:34:16.429684+0000","last_clean":"2024-09-12T18:34:16.429684+0000","last_became_active":"2024-09-12T17:27:32.583903+0000","last_became_peered":"2024-09-12T17:27:32.583903+0000","last_unstale":"2024-09-12T18:34:16.429684+0000","last_undegraded":"2024-09-12T18:34:16.429684+0000","last_fullsized":"2024-09-12T18:34:16.429684+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":98,"num_write":57,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.805836+0000","last_change":"2024-09-12T17:53:27.168477+0000","last_active":"2024-09-12T18:33:26.805836+0000","last_peered":"2024-09-12T18:33:26.805836+0000","last_clean":"2024-09-12T18:33:26.805836+0000","last_became_active":"2024-09-12T17:53:27.167810+0000","last_became_peered":"2024-09-12T17:53:27.167810+0000","last_unstale":"2024-09-12T18:33:26.805836+0000","last_undegraded":"2024-09-12T18:33:26.805836+0000","last_fullsized":"2024-09-12T18:33:26.805836+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:15.873940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'7","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.264378+0000","last_change":"2024-09-12T17:31:16.238350+0000","last_active":"2024-09-12T18:36:00.264378+0000","last_peered":"2024-09-12T18:36:00.264378+0000","last_clean":"2024-09-12T18:36:00.264378+0000","last_became_active":"2024-09-12T17:31:16.237721+0000","last_became_peered":"2024-09-12T17:31:16.237721+0000","last_unstale":"2024-09-12T18:36:00.264378+0000","last_undegraded":"2024-09-12T18:36:00.264378+0000","last_fullsized":"2024-09-12T18:36:00.264378+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'2","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.651296+0000","last_change":"2024-09-12T17:31:12.106211+0000","last_active":"2024-09-12T18:33:41.651296+0000","last_peered":"2024-09-12T18:33:41.651296+0000","last_clean":"2024-09-12T18:33:41.651296+0000","last_became_active":"2024-09-12T17:31:12.105548+0000","last_became_peered":"2024-09-12T17:31:12.105548+0000","last_unstale":"2024-09-12T18:33:41.651296+0000","last_undegraded":"2024-09-12T18:33:41.651296+0000","last_fullsized":"2024-09-12T18:33:41.651296+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'16","reported_seq":114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.809510+0000","last_change":"2024-09-12T17:27:32.564047+0000","last_active":"2024-09-12T18:33:46.809510+0000","last_peered":"2024-09-12T18:33:46.809510+0000","last_clean":"2024-09-12T18:33:46.809510+0000","last_became_active":"2024-09-12T17:27:32.563281+0000","last_became_peered":"2024-09-12T17:27:32.563281+0000","last_unstale":"2024-09-12T18:33:46.809510+0000","last_undegraded":"2024-09-12T18:33:46.809510+0000","last_fullsized":"2024-09-12T18:33:46.809510+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:23.103744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.570655+0000","last_change":"2024-09-12T17:53:27.146120+0000","last_active":"2024-09-12T18:32:06.570655+0000","last_peered":"2024-09-12T18:32:06.570655+0000","last_clean":"2024-09-12T18:32:06.570655+0000","last_became_active":"2024-09-12T17:53:27.143812+0000","last_became_peered":"2024-09-12T17:53:27.143812+0000","last_unstale":"2024-09-12T18:32:06.570655+0000","last_undegraded":"2024-09-12T18:32:06.570655+0000","last_fullsized":"2024-09-12T18:32:06.570655+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:47.856070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.422572+0000","last_change":"2024-09-12T17:31:16.209712+0000","last_active":"2024-09-12T18:33:46.422572+0000","last_peered":"2024-09-12T18:33:46.422572+0000","last_clean":"2024-09-12T18:33:46.422572+0000","last_became_active":"2024-09-12T17:31:16.208994+0000","last_became_peered":"2024-09-12T17:31:16.208994+0000","last_unstale":"2024-09-12T18:33:46.422572+0000","last_undegraded":"2024-09-12T18:33:46.422572+0000","last_fullsized":"2024-09-12T18:33:46.422572+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:21.511571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'15","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.853266+0000","last_change":"2024-09-12T17:31:12.092194+0000","last_active":"2024-09-12T18:36:00.853266+0000","last_peered":"2024-09-12T18:36:00.853266+0000","last_clean":"2024-09-12T18:36:00.853266+0000","last_became_active":"2024-09-12T17:31:12.090602+0000","last_became_peered":"2024-09-12T17:31:12.090602+0000","last_unstale":"2024-09-12T18:36:00.853266+0000","last_undegraded":"2024-09-12T18:36:00.853266+0000","last_fullsized":"2024-09-12T18:36:00.853266+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:37.853518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10290,"num_write":20,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'40","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.408679+0000","last_change":"2024-09-12T17:27:32.554962+0000","last_active":"2024-09-12T18:32:36.408679+0000","last_peered":"2024-09-12T18:32:36.408679+0000","last_clean":"2024-09-12T18:32:36.408679+0000","last_became_active":"2024-09-12T17:27:32.554228+0000","last_became_peered":"2024-09-12T17:27:32.554228+0000","last_unstale":"2024-09-12T18:32:36.408679+0000","last_undegraded":"2024-09-12T18:32:36.408679+0000","last_fullsized":"2024-09-12T18:32:36.408679+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:30.083918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":136,"num_write":75,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:19.399599+0000","last_change":"2024-09-12T17:53:27.171122+0000","last_active":"2024-09-12T18:32:19.399599+0000","last_peered":"2024-09-12T18:32:19.399599+0000","last_clean":"2024-09-12T18:32:19.399599+0000","last_became_active":"2024-09-12T17:53:27.165849+0000","last_became_peered":"2024-09-12T17:53:27.165849+0000","last_unstale":"2024-09-12T18:32:19.399599+0000","last_undegraded":"2024-09-12T18:32:19.399599+0000","last_fullsized":"2024-09-12T18:32:19.399599+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:27.566630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"268'7","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:34.443405+0000","last_change":"2024-09-12T17:31:16.234725+0000","last_active":"2024-09-12T18:35:34.443405+0000","last_peered":"2024-09-12T18:35:34.443405+0000","last_clean":"2024-09-12T18:35:34.443405+0000","last_became_active":"2024-09-12T17:31:16.233989+0000","last_became_peered":"2024-09-12T17:31:16.233989+0000","last_unstale":"2024-09-12T18:35:34.443405+0000","last_undegraded":"2024-09-12T18:35:34.443405+0000","last_fullsized":"2024-09-12T18:35:34.443405+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:22.667547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'10","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.388434+0000","last_change":"2024-09-12T17:31:12.078149+0000","last_active":"2024-09-12T18:35:59.388434+0000","last_peered":"2024-09-12T18:35:59.388434+0000","last_clean":"2024-09-12T18:35:59.388434+0000","last_became_active":"2024-09-12T17:31:12.076980+0000","last_became_peered":"2024-09-12T17:31:12.076980+0000","last_unstale":"2024-09-12T18:35:59.388434+0000","last_undegraded":"2024-09-12T18:35:59.388434+0000","last_fullsized":"2024-09-12T18:35:59.388434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:20.927562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11264,"num_write":20,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'22","reported_seq":123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403144+0000","last_change":"2024-09-12T17:27:32.597852+0000","last_active":"2024-09-12T18:32:34.403144+0000","last_peered":"2024-09-12T18:32:34.403144+0000","last_clean":"2024-09-12T18:32:34.403144+0000","last_became_active":"2024-09-12T17:27:32.597092+0000","last_became_peered":"2024-09-12T17:27:32.597092+0000","last_unstale":"2024-09-12T18:32:34.403144+0000","last_undegraded":"2024-09-12T18:32:34.403144+0000","last_fullsized":"2024-09-12T18:32:34.403144+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:46.150508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":80,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.418737+0000","last_change":"2024-09-12T17:53:27.172827+0000","last_active":"2024-09-12T18:33:39.418737+0000","last_peered":"2024-09-12T18:33:39.418737+0000","last_clean":"2024-09-12T18:33:39.418737+0000","last_became_active":"2024-09-12T17:53:27.166248+0000","last_became_peered":"2024-09-12T17:53:27.166248+0000","last_unstale":"2024-09-12T18:33:39.418737+0000","last_undegraded":"2024-09-12T18:33:39.418737+0000","last_fullsized":"2024-09-12T18:33:39.418737+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:16.950414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:01.396099+0000","last_change":"2024-09-12T17:32:06.560970+0000","last_active":"2024-09-12T18:32:01.396099+0000","last_peered":"2024-09-12T18:32:01.396099+0000","last_clean":"2024-09-12T18:32:01.396099+0000","last_became_active":"2024-09-12T17:32:06.560465+0000","last_became_peered":"2024-09-12T17:32:06.560465+0000","last_unstale":"2024-09-12T18:32:01.396099+0000","last_undegraded":"2024-09-12T18:32:01.396099+0000","last_fullsized":"2024-09-12T18:32:01.396099+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:44.091888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'8","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.853947+0000","last_change":"2024-09-12T17:31:12.068624+0000","last_active":"2024-09-12T18:36:00.853947+0000","last_peered":"2024-09-12T18:36:00.853947+0000","last_clean":"2024-09-12T18:36:00.853947+0000","last_became_active":"2024-09-12T17:31:12.067819+0000","last_became_peered":"2024-09-12T17:31:12.067819+0000","last_unstale":"2024-09-12T18:36:00.853947+0000","last_undegraded":"2024-09-12T18:36:00.853947+0000","last_fullsized":"2024-09-12T18:36:00.853947+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":19458,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'26","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403079+0000","last_change":"2024-09-12T17:27:32.591166+0000","last_active":"2024-09-12T18:32:34.403079+0000","last_peered":"2024-09-12T18:32:34.403079+0000","last_clean":"2024-09-12T18:32:34.403079+0000","last_became_active":"2024-09-12T17:27:32.578575+0000","last_became_peered":"2024-09-12T17:27:32.578575+0000","last_unstale":"2024-09-12T18:32:34.403079+0000","last_undegraded":"2024-09-12T18:32:34.403079+0000","last_fullsized":"2024-09-12T18:32:34.403079+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:56.541481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":95,"num_write":44,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642338+0000","last_change":"2024-09-12T17:53:27.156978+0000","last_active":"2024-09-12T18:33:01.642338+0000","last_peered":"2024-09-12T18:33:01.642338+0000","last_clean":"2024-09-12T18:33:01.642338+0000","last_became_active":"2024-09-12T17:53:27.156155+0000","last_became_peered":"2024-09-12T17:53:27.156155+0000","last_unstale":"2024-09-12T18:33:01.642338+0000","last_undegraded":"2024-09-12T18:33:01.642338+0000","last_fullsized":"2024-09-12T18:33:01.642338+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:51.477046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:06.596158+0000","last_change":"2024-09-12T17:31:16.227134+0000","last_active":"2024-09-12T18:34:06.596158+0000","last_peered":"2024-09-12T18:34:06.596158+0000","last_clean":"2024-09-12T18:34:06.596158+0000","last_became_active":"2024-09-12T17:31:16.226398+0000","last_became_peered":"2024-09-12T17:31:16.226398+0000","last_unstale":"2024-09-12T18:34:06.596158+0000","last_undegraded":"2024-09-12T18:34:06.596158+0000","last_fullsized":"2024-09-12T18:34:06.596158+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:46.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:00.578262+0000","last_change":"2024-09-12T17:31:12.077317+0000","last_active":"2024-09-12T18:32:00.578262+0000","last_peered":"2024-09-12T18:32:00.578262+0000","last_clean":"2024-09-12T18:32:00.578262+0000","last_became_active":"2024-09-12T17:31:12.076502+0000","last_became_peered":"2024-09-12T17:31:12.076502+0000","last_unstale":"2024-09-12T18:32:00.578262+0000","last_undegraded":"2024-09-12T18:32:00.578262+0000","last_fullsized":"2024-09-12T18:32:00.578262+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:49.794829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'36","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.577178+0000","last_change":"2024-09-12T17:27:32.569576+0000","last_active":"2024-09-12T18:32:36.577178+0000","last_peered":"2024-09-12T18:32:36.577178+0000","last_clean":"2024-09-12T18:32:36.577178+0000","last_became_active":"2024-09-12T17:27:32.568740+0000","last_became_peered":"2024-09-12T17:27:32.568740+0000","last_unstale":"2024-09-12T18:32:36.577178+0000","last_undegraded":"2024-09-12T18:32:36.577178+0000","last_fullsized":"2024-09-12T18:32:36.577178+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:55.258084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":126,"num_write":62,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.409921+0000","last_change":"2024-09-12T17:53:27.170601+0000","last_active":"2024-09-12T18:33:26.409921+0000","last_peered":"2024-09-12T18:33:26.409921+0000","last_clean":"2024-09-12T18:33:26.409921+0000","last_became_active":"2024-09-12T17:53:27.169805+0000","last_became_peered":"2024-09-12T17:53:27.169805+0000","last_unstale":"2024-09-12T18:33:26.409921+0000","last_undegraded":"2024-09-12T18:33:26.409921+0000","last_fullsized":"2024-09-12T18:33:26.409921+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:47.368175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.487135+0000","last_change":"2024-09-12T17:31:16.221214+0000","last_active":"2024-09-12T18:35:59.487135+0000","last_peered":"2024-09-12T18:35:59.487135+0000","last_clean":"2024-09-12T18:35:59.487135+0000","last_became_active":"2024-09-12T17:31:16.220449+0000","last_became_peered":"2024-09-12T17:31:16.220449+0000","last_unstale":"2024-09-12T18:35:59.487135+0000","last_undegraded":"2024-09-12T18:35:59.487135+0000","last_fullsized":"2024-09-12T18:35:59.487135+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.602895+0000","last_change":"2024-09-12T17:31:12.086822+0000","last_active":"2024-09-12T18:33:45.602895+0000","last_peered":"2024-09-12T18:33:45.602895+0000","last_clean":"2024-09-12T18:33:45.602895+0000","last_became_active":"2024-09-12T17:31:12.086091+0000","last_became_peered":"2024-09-12T17:31:12.086091+0000","last_unstale":"2024-09-12T18:33:45.602895+0000","last_undegraded":"2024-09-12T18:33:45.602895+0000","last_fullsized":"2024-09-12T18:33:45.602895+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'57","reported_seq":217,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.414339+0000","last_change":"2024-09-12T17:27:32.569293+0000","last_active":"2024-09-12T18:33:06.414339+0000","last_peered":"2024-09-12T18:33:06.414339+0000","last_clean":"2024-09-12T18:33:06.414339+0000","last_became_active":"2024-09-12T17:27:32.568506+0000","last_became_peered":"2024-09-12T17:27:32.568506+0000","last_unstale":"2024-09-12T18:33:06.414339+0000","last_undegraded":"2024-09-12T18:33:06.414339+0000","last_fullsized":"2024-09-12T18:33:06.414339+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:54.976967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":207,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.410077+0000","last_change":"2024-09-12T17:53:27.171469+0000","last_active":"2024-09-12T18:33:26.410077+0000","last_peered":"2024-09-12T18:33:26.410077+0000","last_clean":"2024-09-12T18:33:26.410077+0000","last_became_active":"2024-09-12T17:53:27.170636+0000","last_became_peered":"2024-09-12T17:53:27.170636+0000","last_unstale":"2024-09-12T18:33:26.410077+0000","last_undegraded":"2024-09-12T18:33:26.410077+0000","last_fullsized":"2024-09-12T18:33:26.410077+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:42.171510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"268'3","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.132840+0000","last_change":"2024-09-12T17:31:16.239144+0000","last_active":"2024-09-12T18:35:59.132840+0000","last_peered":"2024-09-12T18:35:59.132840+0000","last_clean":"2024-09-12T18:35:59.132840+0000","last_became_active":"2024-09-12T17:31:16.238450+0000","last_became_peered":"2024-09-12T17:31:16.238450+0000","last_unstale":"2024-09-12T18:35:59.132840+0000","last_undegraded":"2024-09-12T18:35:59.132840+0000","last_fullsized":"2024-09-12T18:35:59.132840+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.421610+0000","last_change":"2024-09-12T17:31:12.091121+0000","last_active":"2024-09-12T18:33:41.421610+0000","last_peered":"2024-09-12T18:33:41.421610+0000","last_clean":"2024-09-12T18:33:41.421610+0000","last_became_active":"2024-09-12T17:31:12.090201+0000","last_became_peered":"2024-09-12T17:31:12.090201+0000","last_unstale":"2024-09-12T18:33:41.421610+0000","last_undegraded":"2024-09-12T18:33:41.421610+0000","last_fullsized":"2024-09-12T18:33:41.421610+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.639470+0000","last_change":"2024-09-12T17:27:32.568403+0000","last_active":"2024-09-12T18:32:51.639470+0000","last_peered":"2024-09-12T18:32:51.639470+0000","last_clean":"2024-09-12T18:32:51.639470+0000","last_became_active":"2024-09-12T17:27:32.567672+0000","last_became_peered":"2024-09-12T17:27:32.567672+0000","last_unstale":"2024-09-12T18:32:51.639470+0000","last_undegraded":"2024-09-12T18:32:51.639470+0000","last_fullsized":"2024-09-12T18:32:51.639470+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:49.181661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.643457+0000","last_change":"2024-09-12T17:53:27.142791+0000","last_active":"2024-09-12T18:33:06.643457+0000","last_peered":"2024-09-12T18:33:06.643457+0000","last_clean":"2024-09-12T18:33:06.643457+0000","last_became_active":"2024-09-12T17:53:27.142060+0000","last_became_peered":"2024-09-12T17:53:27.142060+0000","last_unstale":"2024-09-12T18:33:06.643457+0000","last_undegraded":"2024-09-12T18:33:06.643457+0000","last_fullsized":"2024-09-12T18:33:06.643457+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:50.140663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"268'5","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:09.425389+0000","last_change":"2024-09-12T17:31:16.235658+0000","last_active":"2024-09-12T18:34:09.425389+0000","last_peered":"2024-09-12T18:34:09.425389+0000","last_clean":"2024-09-12T18:34:09.425389+0000","last_became_active":"2024-09-12T17:31:16.228226+0000","last_became_peered":"2024-09-12T17:31:16.228226+0000","last_unstale":"2024-09-12T18:34:09.425389+0000","last_undegraded":"2024-09-12T18:34:09.425389+0000","last_fullsized":"2024-09-12T18:34:09.425389+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:12.245863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1072,"num_write":10,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'5","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:31.431352+0000","last_change":"2024-09-12T17:31:12.091577+0000","last_active":"2024-09-12T18:34:31.431352+0000","last_peered":"2024-09-12T18:34:31.431352+0000","last_clean":"2024-09-12T18:34:31.431352+0000","last_became_active":"2024-09-12T17:31:12.090779+0000","last_became_peered":"2024-09-12T17:31:12.090779+0000","last_unstale":"2024-09-12T18:34:31.431352+0000","last_undegraded":"2024-09-12T18:34:31.431352+0000","last_fullsized":"2024-09-12T18:34:31.431352+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:37.345815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'62","reported_seq":234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411872+0000","last_change":"2024-09-12T17:27:32.571784+0000","last_active":"2024-09-12T18:32:51.411872+0000","last_peered":"2024-09-12T18:32:51.411872+0000","last_clean":"2024-09-12T18:32:51.411872+0000","last_became_active":"2024-09-12T17:27:32.567884+0000","last_became_peered":"2024-09-12T17:27:32.567884+0000","last_unstale":"2024-09-12T18:32:51.411872+0000","last_undegraded":"2024-09-12T18:32:51.411872+0000","last_fullsized":"2024-09-12T18:32:51.411872+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:13.840706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":230,"num_write":101,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.801783+0000","last_change":"2024-09-12T17:53:27.140297+0000","last_active":"2024-09-12T18:33:06.801783+0000","last_peered":"2024-09-12T18:33:06.801783+0000","last_clean":"2024-09-12T18:33:06.801783+0000","last_became_active":"2024-09-12T17:53:27.139551+0000","last_became_peered":"2024-09-12T17:53:27.139551+0000","last_unstale":"2024-09-12T18:33:06.801783+0000","last_undegraded":"2024-09-12T18:33:06.801783+0000","last_fullsized":"2024-09-12T18:33:06.801783+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:49.095002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'3","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:14.398487+0000","last_change":"2024-09-12T17:31:16.237383+0000","last_active":"2024-09-12T18:32:14.398487+0000","last_peered":"2024-09-12T18:32:14.398487+0000","last_clean":"2024-09-12T18:32:14.398487+0000","last_became_active":"2024-09-12T17:31:16.236796+0000","last_became_peered":"2024-09-12T17:31:16.236796+0000","last_unstale":"2024-09-12T18:32:14.398487+0000","last_undegraded":"2024-09-12T18:32:14.398487+0000","last_fullsized":"2024-09-12T18:32:14.398487+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:49.523071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'4","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.938902+0000","last_change":"2024-09-12T17:31:12.093519+0000","last_active":"2024-09-12T18:35:59.938902+0000","last_peered":"2024-09-12T18:35:59.938902+0000","last_clean":"2024-09-12T18:35:59.938902+0000","last_became_active":"2024-09-12T17:31:12.092655+0000","last_became_peered":"2024-09-12T17:31:12.092655+0000","last_unstale":"2024-09-12T18:35:59.938902+0000","last_undegraded":"2024-09-12T18:35:59.938902+0000","last_fullsized":"2024-09-12T18:35:59.938902+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'23","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:49.407673+0000","last_change":"2024-09-12T17:27:32.579819+0000","last_active":"2024-09-12T18:32:49.407673+0000","last_peered":"2024-09-12T18:32:49.407673+0000","last_clean":"2024-09-12T18:32:49.407673+0000","last_became_active":"2024-09-12T17:27:32.578393+0000","last_became_peered":"2024-09-12T17:27:32.578393+0000","last_unstale":"2024-09-12T18:32:49.407673+0000","last_undegraded":"2024-09-12T18:32:49.407673+0000","last_fullsized":"2024-09-12T18:32:49.407673+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:12.325555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":84,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.404631+0000","last_change":"2024-09-12T17:53:27.151852+0000","last_active":"2024-09-12T18:33:06.404631+0000","last_peered":"2024-09-12T18:33:06.404631+0000","last_clean":"2024-09-12T18:33:06.404631+0000","last_became_active":"2024-09-12T17:53:27.142159+0000","last_became_peered":"2024-09-12T17:53:27.142159+0000","last_unstale":"2024-09-12T18:33:06.404631+0000","last_undegraded":"2024-09-12T18:33:06.404631+0000","last_fullsized":"2024-09-12T18:33:06.404631+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:32.788357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:09.425500+0000","last_change":"2024-09-12T17:31:16.237254+0000","last_active":"2024-09-12T18:34:09.425500+0000","last_peered":"2024-09-12T18:34:09.425500+0000","last_clean":"2024-09-12T18:34:09.425500+0000","last_became_active":"2024-09-12T17:31:16.236478+0000","last_became_peered":"2024-09-12T17:31:16.236478+0000","last_unstale":"2024-09-12T18:34:09.425500+0000","last_undegraded":"2024-09-12T18:34:09.425500+0000","last_fullsized":"2024-09-12T18:34:09.425500+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:03.647540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.812804+0000","last_change":"2024-09-12T17:31:12.092360+0000","last_active":"2024-09-12T18:34:01.812804+0000","last_peered":"2024-09-12T18:34:01.812804+0000","last_clean":"2024-09-12T18:34:01.812804+0000","last_became_active":"2024-09-12T17:31:12.091488+0000","last_became_peered":"2024-09-12T17:31:12.091488+0000","last_unstale":"2024-09-12T18:34:01.812804+0000","last_undegraded":"2024-09-12T18:34:01.812804+0000","last_fullsized":"2024-09-12T18:34:01.812804+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'49","reported_seq":200,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.798942+0000","last_change":"2024-09-12T17:27:32.573661+0000","last_active":"2024-09-12T18:32:51.798942+0000","last_peered":"2024-09-12T18:32:51.798942+0000","last_clean":"2024-09-12T18:32:51.798942+0000","last_became_active":"2024-09-12T17:27:32.572859+0000","last_became_peered":"2024-09-12T17:27:32.572859+0000","last_unstale":"2024-09-12T18:32:51.798942+0000","last_undegraded":"2024-09-12T18:32:51.798942+0000","last_fullsized":"2024-09-12T18:32:51.798942+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:51.245414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":198,"num_write":77,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.412028+0000","last_change":"2024-09-12T17:53:27.156462+0000","last_active":"2024-09-12T18:33:06.412028+0000","last_peered":"2024-09-12T18:33:06.412028+0000","last_clean":"2024-09-12T18:33:06.412028+0000","last_became_active":"2024-09-12T17:53:27.155646+0000","last_became_peered":"2024-09-12T17:53:27.155646+0000","last_unstale":"2024-09-12T18:33:06.412028+0000","last_undegraded":"2024-09-12T18:33:06.412028+0000","last_fullsized":"2024-09-12T18:33:06.412028+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:44.968007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:40.573394+0000","last_change":"2024-09-12T17:31:16.221542+0000","last_active":"2024-09-12T18:31:40.573394+0000","last_peered":"2024-09-12T18:31:40.573394+0000","last_clean":"2024-09-12T18:31:40.573394+0000","last_became_active":"2024-09-12T17:31:16.220797+0000","last_became_peered":"2024-09-12T17:31:16.220797+0000","last_unstale":"2024-09-12T18:31:40.573394+0000","last_undegraded":"2024-09-12T18:31:40.573394+0000","last_fullsized":"2024-09-12T18:31:40.573394+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:34.381182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.426103+0000","last_change":"2024-09-12T17:31:12.098496+0000","last_active":"2024-09-12T18:34:01.426103+0000","last_peered":"2024-09-12T18:34:01.426103+0000","last_clean":"2024-09-12T18:34:01.426103+0000","last_became_active":"2024-09-12T17:31:12.090174+0000","last_became_peered":"2024-09-12T17:31:12.090174+0000","last_unstale":"2024-09-12T18:34:01.426103+0000","last_undegraded":"2024-09-12T18:34:01.426103+0000","last_fullsized":"2024-09-12T18:34:01.426103+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'100","reported_seq":394,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.407333+0000","last_change":"2024-09-12T17:27:32.574809+0000","last_active":"2024-09-12T18:33:16.407333+0000","last_peered":"2024-09-12T18:33:16.407333+0000","last_clean":"2024-09-12T18:33:16.407333+0000","last_became_active":"2024-09-12T17:27:32.574023+0000","last_became_peered":"2024-09-12T17:27:32.574023+0000","last_unstale":"2024-09-12T18:33:16.407333+0000","last_undegraded":"2024-09-12T18:33:16.407333+0000","last_fullsized":"2024-09-12T18:33:16.407333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:43.524925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":651,"num_read_kb":453,"num_write":126,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:09.397336+0000","last_change":"2024-09-12T17:53:27.165446+0000","last_active":"2024-09-12T18:32:09.397336+0000","last_peered":"2024-09-12T18:32:09.397336+0000","last_clean":"2024-09-12T18:32:09.397336+0000","last_became_active":"2024-09-12T17:53:27.164643+0000","last_became_peered":"2024-09-12T17:53:27.164643+0000","last_unstale":"2024-09-12T18:32:09.397336+0000","last_undegraded":"2024-09-12T18:32:09.397336+0000","last_fullsized":"2024-09-12T18:32:09.397336+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:32.358718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"265'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:56.627015+0000","last_change":"2024-09-12T17:31:16.241953+0000","last_active":"2024-09-12T18:31:56.627015+0000","last_peered":"2024-09-12T18:31:56.627015+0000","last_clean":"2024-09-12T18:31:56.627015+0000","last_became_active":"2024-09-12T17:31:16.240666+0000","last_became_peered":"2024-09-12T17:31:16.240666+0000","last_unstale":"2024-09-12T18:31:56.627015+0000","last_undegraded":"2024-09-12T18:31:56.627015+0000","last_fullsized":"2024-09-12T18:31:56.627015+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:19.000830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'2","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:15.609579+0000","last_change":"2024-09-12T17:31:12.079972+0000","last_active":"2024-09-12T18:34:15.609579+0000","last_peered":"2024-09-12T18:34:15.609579+0000","last_clean":"2024-09-12T18:34:15.609579+0000","last_became_active":"2024-09-12T17:31:12.077055+0000","last_became_peered":"2024-09-12T17:31:12.077055+0000","last_unstale":"2024-09-12T18:34:15.609579+0000","last_undegraded":"2024-09-12T18:34:15.609579+0000","last_fullsized":"2024-09-12T18:34:15.609579+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:54.359866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'36","reported_seq":161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.402360+0000","last_change":"2024-09-12T17:27:32.575114+0000","last_active":"2024-09-12T18:32:56.402360+0000","last_peered":"2024-09-12T18:32:56.402360+0000","last_clean":"2024-09-12T18:32:56.402360+0000","last_became_active":"2024-09-12T17:27:32.574128+0000","last_became_peered":"2024-09-12T17:27:32.574128+0000","last_unstale":"2024-09-12T18:32:56.402360+0000","last_undegraded":"2024-09-12T18:32:56.402360+0000","last_fullsized":"2024-09-12T18:32:56.402360+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:30.567491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":129,"num_write":75,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.402547+0000","last_change":"2024-09-12T17:53:27.170202+0000","last_active":"2024-09-12T18:32:06.402547+0000","last_peered":"2024-09-12T18:32:06.402547+0000","last_clean":"2024-09-12T18:32:06.402547+0000","last_became_active":"2024-09-12T17:53:27.169499+0000","last_became_peered":"2024-09-12T17:53:27.169499+0000","last_unstale":"2024-09-12T18:32:06.402547+0000","last_undegraded":"2024-09-12T18:32:06.402547+0000","last_fullsized":"2024-09-12T18:32:06.402547+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:09.313257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"268'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:16.659287+0000","last_change":"2024-09-12T17:31:16.233694+0000","last_active":"2024-09-12T18:34:16.659287+0000","last_peered":"2024-09-12T18:34:16.659287+0000","last_clean":"2024-09-12T18:34:16.659287+0000","last_became_active":"2024-09-12T17:31:16.232949+0000","last_became_peered":"2024-09-12T17:31:16.232949+0000","last_unstale":"2024-09-12T18:34:16.659287+0000","last_undegraded":"2024-09-12T18:34:16.659287+0000","last_fullsized":"2024-09-12T18:34:16.659287+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:20.006807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'4","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.384902+0000","last_change":"2024-09-12T17:31:12.087042+0000","last_active":"2024-09-12T18:35:59.384902+0000","last_peered":"2024-09-12T18:35:59.384902+0000","last_clean":"2024-09-12T18:35:59.384902+0000","last_became_active":"2024-09-12T17:31:12.086300+0000","last_became_peered":"2024-09-12T17:31:12.086300+0000","last_unstale":"2024-09-12T18:35:59.384902+0000","last_undegraded":"2024-09-12T18:35:59.384902+0000","last_fullsized":"2024-09-12T18:35:59.384902+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:18.726386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'15","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.412585+0000","last_change":"2024-09-12T17:27:32.592754+0000","last_active":"2024-09-12T18:32:56.412585+0000","last_peered":"2024-09-12T18:32:56.412585+0000","last_clean":"2024-09-12T18:32:56.412585+0000","last_became_active":"2024-09-12T17:27:32.591878+0000","last_became_peered":"2024-09-12T17:27:32.591878+0000","last_unstale":"2024-09-12T18:32:56.412585+0000","last_undegraded":"2024-09-12T18:32:56.412585+0000","last_fullsized":"2024-09-12T18:32:56.412585+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:19.824090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.416384+0000","last_change":"2024-09-12T17:53:27.158764+0000","last_active":"2024-09-12T18:33:16.416384+0000","last_peered":"2024-09-12T18:33:16.416384+0000","last_clean":"2024-09-12T18:33:16.416384+0000","last_became_active":"2024-09-12T17:53:27.157992+0000","last_became_peered":"2024-09-12T17:53:27.157992+0000","last_unstale":"2024-09-12T18:33:16.416384+0000","last_undegraded":"2024-09-12T18:33:16.416384+0000","last_fullsized":"2024-09-12T18:33:16.416384+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:50.572142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428001+0000","last_change":"2024-09-12T17:31:16.228882+0000","last_active":"2024-09-12T18:34:19.428001+0000","last_peered":"2024-09-12T18:34:19.428001+0000","last_clean":"2024-09-12T18:34:19.428001+0000","last_became_active":"2024-09-12T17:31:16.227946+0000","last_became_peered":"2024-09-12T17:31:16.227946+0000","last_unstale":"2024-09-12T18:34:19.428001+0000","last_undegraded":"2024-09-12T18:34:19.428001+0000","last_fullsized":"2024-09-12T18:34:19.428001+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:58.107920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'5","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:31:51.567511+0000","last_change":"2024-09-12T17:31:12.106194+0000","last_active":"2024-09-12T18:31:51.567511+0000","last_peered":"2024-09-12T18:31:51.567511+0000","last_clean":"2024-09-12T18:31:51.567511+0000","last_became_active":"2024-09-12T17:31:12.105448+0000","last_became_peered":"2024-09-12T17:31:12.105448+0000","last_unstale":"2024-09-12T18:31:51.567511+0000","last_undegraded":"2024-09-12T18:31:51.567511+0000","last_fullsized":"2024-09-12T18:31:51.567511+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:55.162506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'22","reported_seq":120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:55.591164+0000","last_change":"2024-09-12T17:27:32.568251+0000","last_active":"2024-09-12T18:32:55.591164+0000","last_peered":"2024-09-12T18:32:55.591164+0000","last_clean":"2024-09-12T18:32:55.591164+0000","last_became_active":"2024-09-12T17:27:32.567500+0000","last_became_peered":"2024-09-12T17:27:32.567500+0000","last_unstale":"2024-09-12T18:32:55.591164+0000","last_undegraded":"2024-09-12T18:32:55.591164+0000","last_fullsized":"2024-09-12T18:32:55.591164+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:19.895653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:09.397287+0000","last_change":"2024-09-12T17:53:27.167094+0000","last_active":"2024-09-12T18:32:09.397287+0000","last_peered":"2024-09-12T18:32:09.397287+0000","last_clean":"2024-09-12T18:32:09.397287+0000","last_became_active":"2024-09-12T17:53:27.164083+0000","last_became_peered":"2024-09-12T17:53:27.164083+0000","last_unstale":"2024-09-12T18:32:09.397287+0000","last_undegraded":"2024-09-12T18:32:09.397287+0000","last_fullsized":"2024-09-12T18:32:09.397287+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:57.760600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"268'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:16.598266+0000","last_change":"2024-09-12T17:31:16.239173+0000","last_active":"2024-09-12T18:34:16.598266+0000","last_peered":"2024-09-12T18:34:16.598266+0000","last_clean":"2024-09-12T18:34:16.598266+0000","last_became_active":"2024-09-12T17:31:16.238356+0000","last_became_peered":"2024-09-12T17:31:16.238356+0000","last_unstale":"2024-09-12T18:34:16.598266+0000","last_undegraded":"2024-09-12T18:34:16.598266+0000","last_fullsized":"2024-09-12T18:34:16.598266+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:23.384787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'5","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:11.426742+0000","last_change":"2024-09-12T17:31:12.106100+0000","last_active":"2024-09-12T18:34:11.426742+0000","last_peered":"2024-09-12T18:34:11.426742+0000","last_clean":"2024-09-12T18:34:11.426742+0000","last_became_active":"2024-09-12T17:31:12.105300+0000","last_became_peered":"2024-09-12T17:31:12.105300+0000","last_unstale":"2024-09-12T18:34:11.426742+0000","last_undegraded":"2024-09-12T18:34:11.426742+0000","last_fullsized":"2024-09-12T18:34:11.426742+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:18.610444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'42","reported_seq":176,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:54.408584+0000","last_change":"2024-09-12T17:27:32.598060+0000","last_active":"2024-09-12T18:32:54.408584+0000","last_peered":"2024-09-12T18:32:54.408584+0000","last_clean":"2024-09-12T18:32:54.408584+0000","last_became_active":"2024-09-12T17:27:32.597518+0000","last_became_peered":"2024-09-12T17:27:32.597518+0000","last_unstale":"2024-09-12T18:32:54.408584+0000","last_undegraded":"2024-09-12T18:32:54.408584+0000","last_fullsized":"2024-09-12T18:32:54.408584+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:46.388068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":146,"num_write":82,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:31.795139+0000","last_change":"2024-09-12T17:53:27.140361+0000","last_active":"2024-09-12T18:32:31.795139+0000","last_peered":"2024-09-12T18:32:31.795139+0000","last_clean":"2024-09-12T18:32:31.795139+0000","last_became_active":"2024-09-12T17:53:27.139633+0000","last_became_peered":"2024-09-12T17:53:27.139633+0000","last_unstale":"2024-09-12T18:32:31.795139+0000","last_undegraded":"2024-09-12T18:32:31.795139+0000","last_fullsized":"2024-09-12T18:32:31.795139+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:33.101556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"265'4","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:04.395968+0000","last_change":"2024-09-12T17:31:16.233015+0000","last_active":"2024-09-12T18:32:04.395968+0000","last_peered":"2024-09-12T18:32:04.395968+0000","last_clean":"2024-09-12T18:32:04.395968+0000","last_became_active":"2024-09-12T17:31:16.229063+0000","last_became_peered":"2024-09-12T17:31:16.229063+0000","last_unstale":"2024-09-12T18:32:04.395968+0000","last_undegraded":"2024-09-12T18:32:04.395968+0000","last_fullsized":"2024-09-12T18:32:04.395968+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:10.227429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:11.421536+0000","last_change":"2024-09-12T17:31:12.094349+0000","last_active":"2024-09-12T18:34:11.421536+0000","last_peered":"2024-09-12T18:34:11.421536+0000","last_clean":"2024-09-12T18:34:11.421536+0000","last_became_active":"2024-09-12T17:31:12.093496+0000","last_became_peered":"2024-09-12T17:31:12.093496+0000","last_unstale":"2024-09-12T18:34:11.421536+0000","last_undegraded":"2024-09-12T18:34:11.421536+0000","last_fullsized":"2024-09-12T18:34:11.421536+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":4,"num_write_kb":1047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'15","reported_seq":104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.411590+0000","last_change":"2024-09-12T17:27:32.598394+0000","last_active":"2024-09-12T18:33:04.411590+0000","last_peered":"2024-09-12T18:33:04.411590+0000","last_clean":"2024-09-12T18:33:04.411590+0000","last_became_active":"2024-09-12T17:27:32.597694+0000","last_became_peered":"2024-09-12T17:27:32.597694+0000","last_unstale":"2024-09-12T18:33:04.411590+0000","last_undegraded":"2024-09-12T18:33:04.411590+0000","last_fullsized":"2024-09-12T18:33:04.411590+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:30.364314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.417603+0000","last_change":"2024-09-12T17:53:27.162772+0000","last_active":"2024-09-12T18:33:56.417603+0000","last_peered":"2024-09-12T18:33:56.417603+0000","last_clean":"2024-09-12T18:33:56.417603+0000","last_became_active":"2024-09-12T17:53:27.161396+0000","last_became_peered":"2024-09-12T17:53:27.161396+0000","last_unstale":"2024-09-12T18:33:56.417603+0000","last_undegraded":"2024-09-12T18:33:56.417603+0000","last_fullsized":"2024-09-12T18:33:56.417603+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'3","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428076+0000","last_change":"2024-09-12T17:31:16.239207+0000","last_active":"2024-09-12T18:34:19.428076+0000","last_peered":"2024-09-12T18:34:19.428076+0000","last_clean":"2024-09-12T18:34:19.428076+0000","last_became_active":"2024-09-12T17:31:16.238011+0000","last_became_peered":"2024-09-12T17:31:16.238011+0000","last_unstale":"2024-09-12T18:34:19.428076+0000","last_undegraded":"2024-09-12T18:34:19.428076+0000","last_fullsized":"2024-09-12T18:34:19.428076+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:16.439195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"268'7","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.938677+0000","last_change":"2024-09-12T17:31:12.094454+0000","last_active":"2024-09-12T18:35:59.938677+0000","last_peered":"2024-09-12T18:35:59.938677+0000","last_clean":"2024-09-12T18:35:59.938677+0000","last_became_active":"2024-09-12T17:31:12.093705+0000","last_became_peered":"2024-09-12T17:31:12.093705+0000","last_unstale":"2024-09-12T18:35:59.938677+0000","last_undegraded":"2024-09-12T18:35:59.938677+0000","last_fullsized":"2024-09-12T18:35:59.938677+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'6","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.408420+0000","last_change":"2024-09-12T17:27:32.580514+0000","last_active":"2024-09-12T18:32:51.408420+0000","last_peered":"2024-09-12T18:32:51.408420+0000","last_clean":"2024-09-12T18:32:51.408420+0000","last_became_active":"2024-09-12T17:27:32.579749+0000","last_became_peered":"2024-09-12T17:27:32.579749+0000","last_unstale":"2024-09-12T18:32:51.408420+0000","last_undegraded":"2024-09-12T18:32:51.408420+0000","last_fullsized":"2024-09-12T18:32:51.408420+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:28.676196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.575100+0000","last_change":"2024-09-12T17:53:27.145612+0000","last_active":"2024-09-12T18:32:26.575100+0000","last_peered":"2024-09-12T18:32:26.575100+0000","last_clean":"2024-09-12T18:32:26.575100+0000","last_became_active":"2024-09-12T17:53:27.142745+0000","last_became_peered":"2024-09-12T17:53:27.142745+0000","last_unstale":"2024-09-12T18:32:26.575100+0000","last_undegraded":"2024-09-12T18:32:26.575100+0000","last_fullsized":"2024-09-12T18:32:26.575100+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:38.589340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.632168+0000","last_change":"2024-09-12T17:31:16.242998+0000","last_active":"2024-09-12T18:32:16.632168+0000","last_peered":"2024-09-12T18:32:16.632168+0000","last_clean":"2024-09-12T18:32:16.632168+0000","last_became_active":"2024-09-12T17:31:16.242306+0000","last_became_peered":"2024-09-12T17:31:16.242306+0000","last_unstale":"2024-09-12T18:32:16.632168+0000","last_undegraded":"2024-09-12T18:32:16.632168+0000","last_fullsized":"2024-09-12T18:32:16.632168+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:38.335802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'6","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.049560+0000","last_change":"2024-09-12T17:31:12.078680+0000","last_active":"2024-09-12T18:36:00.049560+0000","last_peered":"2024-09-12T18:36:00.049560+0000","last_clean":"2024-09-12T18:36:00.049560+0000","last_became_active":"2024-09-12T17:31:12.077726+0000","last_became_peered":"2024-09-12T17:31:12.077726+0000","last_unstale":"2024-09-12T18:36:00.049560+0000","last_undegraded":"2024-09-12T18:36:00.049560+0000","last_fullsized":"2024-09-12T18:36:00.049560+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.580495+0000","last_change":"2024-09-12T17:27:32.583911+0000","last_active":"2024-09-12T18:32:51.580495+0000","last_peered":"2024-09-12T18:32:51.580495+0000","last_clean":"2024-09-12T18:32:51.580495+0000","last_became_active":"2024-09-12T17:27:32.583062+0000","last_became_peered":"2024-09-12T17:27:32.583062+0000","last_unstale":"2024-09-12T18:32:51.580495+0000","last_undegraded":"2024-09-12T18:32:51.580495+0000","last_fullsized":"2024-09-12T18:32:51.580495+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:20.224440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.395058+0000","last_change":"2024-09-12T17:53:27.165755+0000","last_active":"2024-09-12T18:32:26.395058+0000","last_peered":"2024-09-12T18:32:26.395058+0000","last_clean":"2024-09-12T18:32:26.395058+0000","last_became_active":"2024-09-12T17:53:27.163419+0000","last_became_peered":"2024-09-12T17:53:27.163419+0000","last_unstale":"2024-09-12T18:32:26.395058+0000","last_undegraded":"2024-09-12T18:32:26.395058+0000","last_fullsized":"2024-09-12T18:32:26.395058+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:39.501106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:04.396028+0000","last_change":"2024-09-12T17:31:16.237342+0000","last_active":"2024-09-12T18:32:04.396028+0000","last_peered":"2024-09-12T18:32:04.396028+0000","last_clean":"2024-09-12T18:32:04.396028+0000","last_became_active":"2024-09-12T17:31:16.236619+0000","last_became_peered":"2024-09-12T17:31:16.236619+0000","last_unstale":"2024-09-12T18:32:04.396028+0000","last_undegraded":"2024-09-12T18:32:04.396028+0000","last_fullsized":"2024-09-12T18:32:04.396028+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:58.072849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"268'7","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.386741+0000","last_change":"2024-09-12T17:31:12.107461+0000","last_active":"2024-09-12T18:35:59.386741+0000","last_peered":"2024-09-12T18:35:59.386741+0000","last_clean":"2024-09-12T18:35:59.386741+0000","last_became_active":"2024-09-12T17:31:12.105793+0000","last_became_peered":"2024-09-12T17:31:12.105793+0000","last_unstale":"2024-09-12T18:35:59.386741+0000","last_undegraded":"2024-09-12T18:35:59.386741+0000","last_fullsized":"2024-09-12T18:35:59.386741+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:10.448109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'53","reported_seq":206,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.798887+0000","last_change":"2024-09-12T17:27:32.570407+0000","last_active":"2024-09-12T18:32:51.798887+0000","last_peered":"2024-09-12T18:32:51.798887+0000","last_clean":"2024-09-12T18:32:51.798887+0000","last_became_active":"2024-09-12T17:27:32.569594+0000","last_became_peered":"2024-09-12T17:27:32.569594+0000","last_unstale":"2024-09-12T18:32:51.798887+0000","last_undegraded":"2024-09-12T18:32:51.798887+0000","last_fullsized":"2024-09-12T18:32:51.798887+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:44.112049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":187,"num_write":95,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.423114+0000","last_change":"2024-09-12T17:53:27.166701+0000","last_active":"2024-09-12T18:33:59.423114+0000","last_peered":"2024-09-12T18:33:59.423114+0000","last_clean":"2024-09-12T18:33:59.423114+0000","last_became_active":"2024-09-12T17:53:27.165129+0000","last_became_peered":"2024-09-12T17:53:27.165129+0000","last_unstale":"2024-09-12T18:33:59.423114+0000","last_undegraded":"2024-09-12T18:33:59.423114+0000","last_fullsized":"2024-09-12T18:33:59.423114+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"268'2","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.486570+0000","last_change":"2024-09-12T17:31:16.240818+0000","last_active":"2024-09-12T18:35:59.486570+0000","last_peered":"2024-09-12T18:35:59.486570+0000","last_clean":"2024-09-12T18:35:59.486570+0000","last_became_active":"2024-09-12T17:31:16.240152+0000","last_became_peered":"2024-09-12T17:31:16.240152+0000","last_unstale":"2024-09-12T18:35:59.486570+0000","last_undegraded":"2024-09-12T18:35:59.486570+0000","last_fullsized":"2024-09-12T18:35:59.486570+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'5","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.660857+0000","last_change":"2024-09-12T17:31:12.098113+0000","last_active":"2024-09-12T18:36:00.660857+0000","last_peered":"2024-09-12T18:36:00.660857+0000","last_clean":"2024-09-12T18:36:00.660857+0000","last_became_active":"2024-09-12T17:31:12.089200+0000","last_became_peered":"2024-09-12T17:31:12.089200+0000","last_unstale":"2024-09-12T18:36:00.660857+0000","last_undegraded":"2024-09-12T18:36:00.660857+0000","last_fullsized":"2024-09-12T18:36:00.660857+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8242,"num_write":10,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'48","reported_seq":193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411678+0000","last_change":"2024-09-12T17:27:32.570665+0000","last_active":"2024-09-12T18:32:51.411678+0000","last_peered":"2024-09-12T18:32:51.411678+0000","last_clean":"2024-09-12T18:32:51.411678+0000","last_became_active":"2024-09-12T17:27:32.568661+0000","last_became_peered":"2024-09-12T17:27:32.568661+0000","last_unstale":"2024-09-12T18:32:51.411678+0000","last_undegraded":"2024-09-12T18:32:51.411678+0000","last_fullsized":"2024-09-12T18:32:51.411678+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:42.609534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":169,"num_write":85,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:11.421688+0000","last_change":"2024-09-12T17:53:27.171856+0000","last_active":"2024-09-12T18:34:11.421688+0000","last_peered":"2024-09-12T18:34:11.421688+0000","last_clean":"2024-09-12T18:34:11.421688+0000","last_became_active":"2024-09-12T17:53:27.170493+0000","last_became_peered":"2024-09-12T17:53:27.170493+0000","last_unstale":"2024-09-12T18:34:11.421688+0000","last_undegraded":"2024-09-12T18:34:11.421688+0000","last_fullsized":"2024-09-12T18:34:11.421688+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'7","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.644453+0000","last_change":"2024-09-12T17:31:16.229295+0000","last_active":"2024-09-12T18:36:01.644453+0000","last_peered":"2024-09-12T18:36:01.644453+0000","last_clean":"2024-09-12T18:36:01.644453+0000","last_became_active":"2024-09-12T17:31:16.228566+0000","last_became_peered":"2024-09-12T17:31:16.228566+0000","last_unstale":"2024-09-12T18:36:01.644453+0000","last_undegraded":"2024-09-12T18:36:01.644453+0000","last_fullsized":"2024-09-12T18:36:01.644453+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5238,"num_write":12,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'4","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.049532+0000","last_change":"2024-09-12T17:31:12.106105+0000","last_active":"2024-09-12T18:36:00.049532+0000","last_peered":"2024-09-12T18:36:00.049532+0000","last_clean":"2024-09-12T18:36:00.049532+0000","last_became_active":"2024-09-12T17:31:12.105384+0000","last_became_peered":"2024-09-12T17:31:12.105384+0000","last_unstale":"2024-09-12T18:36:00.049532+0000","last_undegraded":"2024-09-12T18:36:00.049532+0000","last_fullsized":"2024-09-12T18:36:00.049532+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'110","reported_seq":479,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.402295+0000","last_change":"2024-09-12T17:27:32.587346+0000","last_active":"2024-09-12T18:32:56.402295+0000","last_peered":"2024-09-12T18:32:56.402295+0000","last_clean":"2024-09-12T18:32:56.402295+0000","last_became_active":"2024-09-12T17:27:32.586640+0000","last_became_peered":"2024-09-12T17:27:32.586640+0000","last_unstale":"2024-09-12T18:32:56.402295+0000","last_undegraded":"2024-09-12T18:32:56.402295+0000","last_fullsized":"2024-09-12T18:32:56.402295+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:13.010550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":815,"num_read_kb":525,"num_write":139,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.417721+0000","last_change":"2024-09-12T17:53:27.171182+0000","last_active":"2024-09-12T18:33:56.417721+0000","last_peered":"2024-09-12T18:33:56.417721+0000","last_clean":"2024-09-12T18:33:56.417721+0000","last_became_active":"2024-09-12T17:53:27.170381+0000","last_became_peered":"2024-09-12T17:53:27.170381+0000","last_unstale":"2024-09-12T18:33:56.417721+0000","last_undegraded":"2024-09-12T18:33:56.417721+0000","last_fullsized":"2024-09-12T18:33:56.417721+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'7","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.757389+0000","last_change":"2024-09-12T17:31:16.245927+0000","last_active":"2024-09-12T18:36:00.757389+0000","last_peered":"2024-09-12T18:36:00.757389+0000","last_clean":"2024-09-12T18:36:00.757389+0000","last_became_active":"2024-09-12T17:31:16.245228+0000","last_became_peered":"2024-09-12T17:31:16.245228+0000","last_unstale":"2024-09-12T18:36:00.757389+0000","last_undegraded":"2024-09-12T18:36:00.757389+0000","last_fullsized":"2024-09-12T18:36:00.757389+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:57.083185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":48,"num_write":12,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.270818+0000","last_change":"2024-09-12T17:31:12.091353+0000","last_active":"2024-09-12T18:35:59.270818+0000","last_peered":"2024-09-12T18:35:59.270818+0000","last_clean":"2024-09-12T18:35:59.270818+0000","last_became_active":"2024-09-12T17:31:12.089735+0000","last_became_peered":"2024-09-12T17:31:12.089735+0000","last_unstale":"2024-09-12T18:35:59.270818+0000","last_undegraded":"2024-09-12T18:35:59.270818+0000","last_fullsized":"2024-09-12T18:35:59.270818+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'45","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.402987+0000","last_change":"2024-09-12T17:27:32.576354+0000","last_active":"2024-09-12T18:32:34.402987+0000","last_peered":"2024-09-12T18:32:34.402987+0000","last_clean":"2024-09-12T18:32:34.402987+0000","last_became_active":"2024-09-12T17:27:32.575300+0000","last_became_peered":"2024-09-12T17:27:32.575300+0000","last_unstale":"2024-09-12T18:32:34.402987+0000","last_undegraded":"2024-09-12T18:32:34.402987+0000","last_fullsized":"2024-09-12T18:32:34.402987+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:55.469608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":157,"num_write":84,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.424806+0000","last_change":"2024-09-12T17:53:27.174556+0000","last_active":"2024-09-12T18:33:56.424806+0000","last_peered":"2024-09-12T18:33:56.424806+0000","last_clean":"2024-09-12T18:33:56.424806+0000","last_became_active":"2024-09-12T17:53:27.173955+0000","last_became_peered":"2024-09-12T17:53:27.173955+0000","last_unstale":"2024-09-12T18:33:56.424806+0000","last_undegraded":"2024-09-12T18:33:56.424806+0000","last_fullsized":"2024-09-12T18:33:56.424806+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.392719+0000","last_change":"2024-09-12T17:31:16.232804+0000","last_active":"2024-09-12T18:32:16.392719+0000","last_peered":"2024-09-12T18:32:16.392719+0000","last_clean":"2024-09-12T18:32:16.392719+0000","last_became_active":"2024-09-12T17:31:16.231516+0000","last_became_peered":"2024-09-12T17:31:16.231516+0000","last_unstale":"2024-09-12T18:32:16.392719+0000","last_undegraded":"2024-09-12T18:32:16.392719+0000","last_fullsized":"2024-09-12T18:32:16.392719+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:15.629748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:00.578348+0000","last_change":"2024-09-12T17:31:12.084858+0000","last_active":"2024-09-12T18:32:00.578348+0000","last_peered":"2024-09-12T18:32:00.578348+0000","last_clean":"2024-09-12T18:32:00.578348+0000","last_became_active":"2024-09-12T17:31:12.084158+0000","last_became_peered":"2024-09-12T17:31:12.084158+0000","last_unstale":"2024-09-12T18:32:00.578348+0000","last_undegraded":"2024-09-12T18:32:00.578348+0000","last_fullsized":"2024-09-12T18:32:00.578348+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:57.119863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'55","reported_seq":211,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.577105+0000","last_change":"2024-09-12T17:27:32.577701+0000","last_active":"2024-09-12T18:32:36.577105+0000","last_peered":"2024-09-12T18:32:36.577105+0000","last_clean":"2024-09-12T18:32:36.577105+0000","last_became_active":"2024-09-12T17:27:32.569924+0000","last_became_peered":"2024-09-12T17:27:32.569924+0000","last_unstale":"2024-09-12T18:32:36.577105+0000","last_undegraded":"2024-09-12T18:32:36.577105+0000","last_fullsized":"2024-09-12T18:32:36.577105+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:22.820241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":184,"num_write":101,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.403508+0000","last_change":"2024-09-12T17:53:27.163286+0000","last_active":"2024-09-12T18:33:01.403508+0000","last_peered":"2024-09-12T18:33:01.403508+0000","last_clean":"2024-09-12T18:33:01.403508+0000","last_became_active":"2024-09-12T17:53:27.162527+0000","last_became_peered":"2024-09-12T17:53:27.162527+0000","last_unstale":"2024-09-12T18:33:01.403508+0000","last_undegraded":"2024-09-12T18:33:01.403508+0000","last_fullsized":"2024-09-12T18:33:01.403508+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:27.017224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.426025+0000","last_change":"2024-09-12T17:31:16.245393+0000","last_active":"2024-09-12T18:34:01.426025+0000","last_peered":"2024-09-12T18:34:01.426025+0000","last_clean":"2024-09-12T18:34:01.426025+0000","last_became_active":"2024-09-12T17:31:16.244556+0000","last_became_peered":"2024-09-12T17:31:16.244556+0000","last_unstale":"2024-09-12T18:34:01.426025+0000","last_undegraded":"2024-09-12T18:34:01.426025+0000","last_fullsized":"2024-09-12T18:34:01.426025+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'7","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.413674+0000","last_change":"2024-09-12T17:31:12.081797+0000","last_active":"2024-09-12T18:33:41.413674+0000","last_peered":"2024-09-12T18:33:41.413674+0000","last_clean":"2024-09-12T18:33:41.413674+0000","last_became_active":"2024-09-12T17:31:12.081025+0000","last_became_peered":"2024-09-12T17:31:12.081025+0000","last_unstale":"2024-09-12T18:33:41.413674+0000","last_undegraded":"2024-09-12T18:33:41.413674+0000","last_fullsized":"2024-09-12T18:33:41.413674+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:23.240064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.408791+0000","last_change":"2024-09-12T17:27:32.562776+0000","last_active":"2024-09-12T18:32:36.408791+0000","last_peered":"2024-09-12T18:32:36.408791+0000","last_clean":"2024-09-12T18:32:36.408791+0000","last_became_active":"2024-09-12T17:27:32.561993+0000","last_became_peered":"2024-09-12T17:27:32.561993+0000","last_unstale":"2024-09-12T18:32:36.408791+0000","last_undegraded":"2024-09-12T18:32:36.408791+0000","last_fullsized":"2024-09-12T18:32:36.408791+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:55.063772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":121,"num_write":59,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.410789+0000","last_change":"2024-09-12T17:53:27.153890+0000","last_active":"2024-09-12T18:33:01.410789+0000","last_peered":"2024-09-12T18:33:01.410789+0000","last_clean":"2024-09-12T18:33:01.410789+0000","last_became_active":"2024-09-12T17:53:27.153125+0000","last_became_peered":"2024-09-12T17:53:27.153125+0000","last_unstale":"2024-09-12T18:33:01.410789+0000","last_undegraded":"2024-09-12T18:33:01.410789+0000","last_fullsized":"2024-09-12T18:33:01.410789+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:29.571163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'6","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:51.449584+0000","last_change":"2024-09-12T17:31:16.223351+0000","last_active":"2024-09-12T18:35:51.449584+0000","last_peered":"2024-09-12T18:35:51.449584+0000","last_clean":"2024-09-12T18:35:51.449584+0000","last_became_active":"2024-09-12T17:31:16.212330+0000","last_became_peered":"2024-09-12T17:31:16.212330+0000","last_unstale":"2024-09-12T18:35:51.449584+0000","last_undegraded":"2024-09-12T18:35:51.449584+0000","last_fullsized":"2024-09-12T18:35:51.449584+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:36.131170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'2","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:51.810431+0000","last_change":"2024-09-12T17:31:12.094672+0000","last_active":"2024-09-12T18:33:51.810431+0000","last_peered":"2024-09-12T18:33:51.810431+0000","last_clean":"2024-09-12T18:33:51.810431+0000","last_became_active":"2024-09-12T17:31:12.093752+0000","last_became_peered":"2024-09-12T17:31:12.093752+0000","last_unstale":"2024-09-12T18:33:51.810431+0000","last_undegraded":"2024-09-12T18:33:51.810431+0000","last_fullsized":"2024-09-12T18:33:51.810431+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:44.826244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.577266+0000","last_change":"2024-09-12T17:27:32.583969+0000","last_active":"2024-09-12T18:32:36.577266+0000","last_peered":"2024-09-12T18:32:36.577266+0000","last_clean":"2024-09-12T18:32:36.577266+0000","last_became_active":"2024-09-12T17:27:32.583070+0000","last_became_peered":"2024-09-12T17:27:32.583070+0000","last_unstale":"2024-09-12T18:32:36.577266+0000","last_undegraded":"2024-09-12T18:32:36.577266+0000","last_fullsized":"2024-09-12T18:32:36.577266+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:54.241847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.649994+0000","last_change":"2024-09-12T17:53:27.155092+0000","last_active":"2024-09-12T18:33:36.649994+0000","last_peered":"2024-09-12T18:33:36.649994+0000","last_clean":"2024-09-12T18:33:36.649994+0000","last_became_active":"2024-09-12T17:53:27.154309+0000","last_became_peered":"2024-09-12T17:53:27.154309+0000","last_unstale":"2024-09-12T18:33:36.649994+0000","last_undegraded":"2024-09-12T18:33:36.649994+0000","last_fullsized":"2024-09-12T18:33:36.649994+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:16.746183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'8","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.264328+0000","last_change":"2024-09-12T17:31:16.231548+0000","last_active":"2024-09-12T18:36:00.264328+0000","last_peered":"2024-09-12T18:36:00.264328+0000","last_clean":"2024-09-12T18:36:00.264328+0000","last_became_active":"2024-09-12T17:31:16.230809+0000","last_became_peered":"2024-09-12T17:31:16.230809+0000","last_unstale":"2024-09-12T18:36:00.264328+0000","last_undegraded":"2024-09-12T18:36:00.264328+0000","last_fullsized":"2024-09-12T18:36:00.264328+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":16386,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"265'2","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.424559+0000","last_change":"2024-09-12T17:31:12.084859+0000","last_active":"2024-09-12T18:34:01.424559+0000","last_peered":"2024-09-12T18:34:01.424559+0000","last_clean":"2024-09-12T18:34:01.424559+0000","last_became_active":"2024-09-12T17:31:12.084101+0000","last_became_peered":"2024-09-12T17:31:12.084101+0000","last_unstale":"2024-09-12T18:34:01.424559+0000","last_undegraded":"2024-09-12T18:34:01.424559+0000","last_fullsized":"2024-09-12T18:34:01.424559+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'37","reported_seq":163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:31.396318+0000","last_change":"2024-09-12T17:27:32.582926+0000","last_active":"2024-09-12T18:32:31.396318+0000","last_peered":"2024-09-12T18:32:31.396318+0000","last_clean":"2024-09-12T18:32:31.396318+0000","last_became_active":"2024-09-12T17:27:32.582183+0000","last_became_peered":"2024-09-12T17:27:32.582183+0000","last_unstale":"2024-09-12T18:32:31.396318+0000","last_undegraded":"2024-09-12T18:32:31.396318+0000","last_fullsized":"2024-09-12T18:32:31.396318+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:44.094594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":125,"num_write":74,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.593556+0000","last_change":"2024-09-12T17:53:27.160005+0000","last_active":"2024-09-12T18:33:05.593556+0000","last_peered":"2024-09-12T18:33:05.593556+0000","last_clean":"2024-09-12T18:33:05.593556+0000","last_became_active":"2024-09-12T17:53:27.159240+0000","last_became_peered":"2024-09-12T17:53:27.159240+0000","last_unstale":"2024-09-12T18:33:05.593556+0000","last_undegraded":"2024-09-12T18:33:05.593556+0000","last_fullsized":"2024-09-12T18:33:05.593556+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:37.529736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'5","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.758759+0000","last_change":"2024-09-12T17:31:16.226574+0000","last_active":"2024-09-12T18:36:00.758759+0000","last_peered":"2024-09-12T18:36:00.758759+0000","last_clean":"2024-09-12T18:36:00.758759+0000","last_became_active":"2024-09-12T17:31:16.225754+0000","last_became_peered":"2024-09-12T17:31:16.225754+0000","last_unstale":"2024-09-12T18:36:00.758759+0000","last_undegraded":"2024-09-12T18:36:00.758759+0000","last_fullsized":"2024-09-12T18:36:00.758759+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.419116+0000","last_change":"2024-09-12T17:31:12.088188+0000","last_active":"2024-09-12T18:34:01.419116+0000","last_peered":"2024-09-12T18:34:01.419116+0000","last_clean":"2024-09-12T18:34:01.419116+0000","last_became_active":"2024-09-12T17:31:12.087356+0000","last_became_peered":"2024-09-12T17:31:12.087356+0000","last_unstale":"2024-09-12T18:34:01.419116+0000","last_undegraded":"2024-09-12T18:34:01.419116+0000","last_fullsized":"2024-09-12T18:34:01.419116+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'23","reported_seq":129,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:16.659493+0000","last_change":"2024-09-12T17:27:32.584476+0000","last_active":"2024-09-12T18:34:16.659493+0000","last_peered":"2024-09-12T18:34:16.659493+0000","last_clean":"2024-09-12T18:34:16.659493+0000","last_became_active":"2024-09-12T17:27:32.583631+0000","last_became_peered":"2024-09-12T17:27:32.583631+0000","last_unstale":"2024-09-12T18:34:16.659493+0000","last_undegraded":"2024-09-12T18:34:16.659493+0000","last_fullsized":"2024-09-12T18:34:16.659493+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":83,"num_write":39,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'1","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.790817+0000","last_change":"2024-09-12T17:53:27.156217+0000","last_active":"2024-09-12T18:32:26.790817+0000","last_peered":"2024-09-12T18:32:26.790817+0000","last_clean":"2024-09-12T18:32:26.790817+0000","last_became_active":"2024-09-12T17:53:27.152651+0000","last_became_peered":"2024-09-12T17:53:27.152651+0000","last_unstale":"2024-09-12T18:32:26.790817+0000","last_undegraded":"2024-09-12T18:32:26.790817+0000","last_fullsized":"2024-09-12T18:32:26.790817+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:24.443187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'9","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.486208+0000","last_change":"2024-09-12T17:31:16.243687+0000","last_active":"2024-09-12T18:35:59.486208+0000","last_peered":"2024-09-12T18:35:59.486208+0000","last_clean":"2024-09-12T18:35:59.486208+0000","last_became_active":"2024-09-12T17:31:16.242981+0000","last_became_peered":"2024-09-12T17:31:16.242981+0000","last_unstale":"2024-09-12T18:35:59.486208+0000","last_undegraded":"2024-09-12T18:35:59.486208+0000","last_fullsized":"2024-09-12T18:35:59.486208+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:07.505703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15362,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.411117+0000","last_change":"2024-09-12T17:31:12.097913+0000","last_active":"2024-09-12T18:33:31.411117+0000","last_peered":"2024-09-12T18:33:31.411117+0000","last_clean":"2024-09-12T18:33:31.411117+0000","last_became_active":"2024-09-12T17:31:12.097216+0000","last_became_peered":"2024-09-12T17:31:12.097216+0000","last_unstale":"2024-09-12T18:33:31.411117+0000","last_undegraded":"2024-09-12T18:33:31.411117+0000","last_fullsized":"2024-09-12T18:33:31.411117+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:29.988488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'30","reported_seq":144,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:16.427868+0000","last_change":"2024-09-12T17:27:32.572524+0000","last_active":"2024-09-12T18:34:16.427868+0000","last_peered":"2024-09-12T18:34:16.427868+0000","last_clean":"2024-09-12T18:34:16.427868+0000","last_became_active":"2024-09-12T17:27:32.571830+0000","last_became_peered":"2024-09-12T17:27:32.571830+0000","last_unstale":"2024-09-12T18:34:16.427868+0000","last_undegraded":"2024-09-12T18:34:16.427868+0000","last_fullsized":"2024-09-12T18:34:16.427868+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":95,"num_write":63,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:26.406561+0000","last_change":"2024-09-12T17:53:27.163946+0000","last_active":"2024-09-12T18:32:26.406561+0000","last_peered":"2024-09-12T18:32:26.406561+0000","last_clean":"2024-09-12T18:32:26.406561+0000","last_became_active":"2024-09-12T17:53:27.163113+0000","last_became_peered":"2024-09-12T17:53:27.163113+0000","last_unstale":"2024-09-12T18:32:26.406561+0000","last_undegraded":"2024-09-12T18:32:26.406561+0000","last_fullsized":"2024-09-12T18:32:26.406561+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:01.071160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.418774+0000","last_change":"2024-09-12T17:31:16.234271+0000","last_active":"2024-09-12T18:33:36.418774+0000","last_peered":"2024-09-12T18:33:36.418774+0000","last_clean":"2024-09-12T18:33:36.418774+0000","last_became_active":"2024-09-12T17:31:16.233558+0000","last_became_peered":"2024-09-12T17:31:16.233558+0000","last_unstale":"2024-09-12T18:33:36.418774+0000","last_undegraded":"2024-09-12T18:33:36.418774+0000","last_fullsized":"2024-09-12T18:33:36.418774+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:03.391887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'7","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:46.444961+0000","last_change":"2024-09-12T17:31:12.094815+0000","last_active":"2024-09-12T18:35:46.444961+0000","last_peered":"2024-09-12T18:35:46.444961+0000","last_clean":"2024-09-12T18:35:46.444961+0000","last_became_active":"2024-09-12T17:31:12.094159+0000","last_became_peered":"2024-09-12T17:31:12.094159+0000","last_unstale":"2024-09-12T18:35:46.444961+0000","last_undegraded":"2024-09-12T18:35:46.444961+0000","last_fullsized":"2024-09-12T18:35:46.444961+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:09.522281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3074,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'20","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:15.609729+0000","last_change":"2024-09-12T17:27:32.596142+0000","last_active":"2024-09-12T18:34:15.609729+0000","last_peered":"2024-09-12T18:34:15.609729+0000","last_clean":"2024-09-12T18:34:15.609729+0000","last_became_active":"2024-09-12T17:27:32.595524+0000","last_became_peered":"2024-09-12T17:27:32.595524+0000","last_unstale":"2024-09-12T18:34:15.609729+0000","last_undegraded":"2024-09-12T18:34:15.609729+0000","last_fullsized":"2024-09-12T18:34:15.609729+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":74,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.413732+0000","last_change":"2024-09-12T17:53:27.175841+0000","last_active":"2024-09-12T18:33:01.413732+0000","last_peered":"2024-09-12T18:33:01.413732+0000","last_clean":"2024-09-12T18:33:01.413732+0000","last_became_active":"2024-09-12T17:53:27.175125+0000","last_became_peered":"2024-09-12T17:53:27.175125+0000","last_unstale":"2024-09-12T18:33:01.413732+0000","last_undegraded":"2024-09-12T18:33:01.413732+0000","last_fullsized":"2024-09-12T18:33:01.413732+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:18.938638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'4","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.591667+0000","last_change":"2024-09-12T17:31:16.212462+0000","last_active":"2024-09-12T18:33:46.591667+0000","last_peered":"2024-09-12T18:33:46.591667+0000","last_clean":"2024-09-12T18:33:46.591667+0000","last_became_active":"2024-09-12T17:31:16.211664+0000","last_became_peered":"2024-09-12T17:31:16.211664+0000","last_unstale":"2024-09-12T18:33:46.591667+0000","last_undegraded":"2024-09-12T18:33:46.591667+0000","last_fullsized":"2024-09-12T18:33:46.591667+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:00.841100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1069,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'4","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.387515+0000","last_change":"2024-09-12T17:31:12.101932+0000","last_active":"2024-09-12T18:35:59.387515+0000","last_peered":"2024-09-12T18:35:59.387515+0000","last_clean":"2024-09-12T18:35:59.387515+0000","last_became_active":"2024-09-12T17:31:12.099608+0000","last_became_peered":"2024-09-12T17:31:12.099608+0000","last_unstale":"2024-09-12T18:35:59.387515+0000","last_undegraded":"2024-09-12T18:35:59.387515+0000","last_fullsized":"2024-09-12T18:35:59.387515+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:36.462019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'56","reported_seq":219,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:16.598224+0000","last_change":"2024-09-12T17:27:32.569526+0000","last_active":"2024-09-12T18:34:16.598224+0000","last_peered":"2024-09-12T18:34:16.598224+0000","last_clean":"2024-09-12T18:34:16.598224+0000","last_became_active":"2024-09-12T17:27:32.568785+0000","last_became_peered":"2024-09-12T17:27:32.568785+0000","last_unstale":"2024-09-12T18:34:16.598224+0000","last_undegraded":"2024-09-12T18:34:16.598224+0000","last_fullsized":"2024-09-12T18:34:16.598224+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":196,"num_write":113,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.407392+0000","last_change":"2024-09-12T17:53:27.175493+0000","last_active":"2024-09-12T18:33:16.407392+0000","last_peered":"2024-09-12T18:33:16.407392+0000","last_clean":"2024-09-12T18:33:16.407392+0000","last_became_active":"2024-09-12T17:53:27.175073+0000","last_became_peered":"2024-09-12T17:53:27.175073+0000","last_unstale":"2024-09-12T18:33:16.407392+0000","last_undegraded":"2024-09-12T18:33:16.407392+0000","last_fullsized":"2024-09-12T18:33:16.407392+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:43.723718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.602853+0000","last_change":"2024-09-12T17:31:16.229188+0000","last_active":"2024-09-12T18:33:45.602853+0000","last_peered":"2024-09-12T18:33:45.602853+0000","last_clean":"2024-09-12T18:33:45.602853+0000","last_became_active":"2024-09-12T17:31:16.228416+0000","last_became_peered":"2024-09-12T17:31:16.228416+0000","last_unstale":"2024-09-12T18:33:45.602853+0000","last_undegraded":"2024-09-12T18:33:45.602853+0000","last_fullsized":"2024-09-12T18:33:45.602853+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:54.390718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.590617+0000","last_change":"2024-09-12T17:31:12.089066+0000","last_active":"2024-09-12T18:33:41.590617+0000","last_peered":"2024-09-12T18:33:41.590617+0000","last_clean":"2024-09-12T18:33:41.590617+0000","last_became_active":"2024-09-12T17:31:12.088297+0000","last_became_peered":"2024-09-12T17:31:12.088297+0000","last_unstale":"2024-09-12T18:33:41.590617+0000","last_undegraded":"2024-09-12T18:33:41.590617+0000","last_fullsized":"2024-09-12T18:33:41.590617+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:37.483806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'16","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.417452+0000","last_change":"2024-09-12T17:27:32.585156+0000","last_active":"2024-09-12T18:33:56.417452+0000","last_peered":"2024-09-12T18:33:56.417452+0000","last_clean":"2024-09-12T18:33:56.417452+0000","last_became_active":"2024-09-12T17:27:32.584404+0000","last_became_peered":"2024-09-12T17:27:32.584404+0000","last_unstale":"2024-09-12T18:33:56.417452+0000","last_undegraded":"2024-09-12T18:33:56.417452+0000","last_fullsized":"2024-09-12T18:33:56.417452+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:00.210204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":55,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'315","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.951082+0000","last_change":"2024-09-12T18:36:20.951082+0000","last_active":"2024-09-12T18:36:20.951082+0000","last_peered":"2024-09-12T18:36:20.951082+0000","last_clean":"2024-09-12T18:36:20.951082+0000","last_became_active":"2024-09-12T17:10:30.407181+0000","last_became_peered":"2024-09-12T17:10:30.407181+0000","last_unstale":"2024-09-12T18:36:20.951082+0000","last_undegraded":"2024-09-12T18:36:20.951082+0000","last_fullsized":"2024-09-12T18:36:20.951082+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'315","last_scrub_stamp":"2024-09-12T18:36:20.950828+0000","last_deep_scrub":"268'315","last_deep_scrub_stamp":"2024-09-12T18:36:20.950828+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.950828+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:01.236915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262204,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":478,"num_read_kb":10655,"num_write":917,"num_write_kb":47496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'781","reported_seq":2322,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.976956+0000","last_change":"2024-09-12T18:36:23.976956+0000","last_active":"2024-09-12T18:36:23.976956+0000","last_peered":"2024-09-12T18:36:23.976956+0000","last_clean":"2024-09-12T18:36:23.976956+0000","last_became_active":"2024-09-12T17:10:32.346911+0000","last_became_peered":"2024-09-12T17:10:32.346911+0000","last_unstale":"2024-09-12T18:36:23.976956+0000","last_undegraded":"2024-09-12T18:36:23.976956+0000","last_fullsized":"2024-09-12T18:36:23.976956+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'781","last_scrub_stamp":"2024-09-12T18:36:23.976864+0000","last_deep_scrub":"268'781","last_deep_scrub_stamp":"2024-09-12T18:36:23.976864+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.976864+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:06.388928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3659,"num_read_kb":3307,"num_write":1011,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'379","reported_seq":1102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.899907+0000","last_change":"2024-09-12T18:36:14.899907+0000","last_active":"2024-09-12T18:36:14.899907+0000","last_peered":"2024-09-12T18:36:14.899907+0000","last_clean":"2024-09-12T18:36:14.899907+0000","last_became_active":"2024-09-12T17:10:30.405515+0000","last_became_peered":"2024-09-12T17:10:30.405515+0000","last_unstale":"2024-09-12T18:36:14.899907+0000","last_undegraded":"2024-09-12T18:36:14.899907+0000","last_fullsized":"2024-09-12T18:36:14.899907+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'379","last_scrub_stamp":"2024-09-12T18:36:14.899603+0000","last_deep_scrub":"268'379","last_deep_scrub_stamp":"2024-09-12T18:36:14.899603+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.899603+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:27.598354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262215,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":661,"num_read_kb":13611,"num_write":1216,"num_write_kb":42248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'456","reported_seq":1944,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.985655+0000","last_change":"2024-09-12T18:36:23.985655+0000","last_active":"2024-09-12T18:36:23.985655+0000","last_peered":"2024-09-12T18:36:23.985655+0000","last_clean":"2024-09-12T18:36:23.985655+0000","last_became_active":"2024-09-12T17:10:32.375908+0000","last_became_peered":"2024-09-12T17:10:32.375908+0000","last_unstale":"2024-09-12T18:36:23.985655+0000","last_undegraded":"2024-09-12T18:36:23.985655+0000","last_fullsized":"2024-09-12T18:36:23.985655+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'456","last_scrub_stamp":"2024-09-12T18:36:23.985573+0000","last_deep_scrub":"268'456","last_deep_scrub_stamp":"2024-09-12T18:36:23.985573+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.985573+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:23.461123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2460,"num_read_kb":2294,"num_write":575,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'368","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.537548+0000","last_change":"2024-09-12T18:36:15.537548+0000","last_active":"2024-09-12T18:36:15.537548+0000","last_peered":"2024-09-12T18:36:15.537548+0000","last_clean":"2024-09-12T18:36:15.537548+0000","last_became_active":"2024-09-12T17:10:30.351202+0000","last_became_peered":"2024-09-12T17:10:30.351202+0000","last_unstale":"2024-09-12T18:36:15.537548+0000","last_undegraded":"2024-09-12T18:36:15.537548+0000","last_fullsized":"2024-09-12T18:36:15.537548+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'368","last_scrub_stamp":"2024-09-12T18:36:15.537307+0000","last_deep_scrub":"268'368","last_deep_scrub_stamp":"2024-09-12T18:36:15.537307+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.537307+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:11.681842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":96764,"num_write":1045,"num_write_kb":52334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'557","reported_seq":2193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:18.626934+0000","last_change":"2024-09-12T17:10:32.371846+0000","last_active":"2024-09-12T18:33:18.626934+0000","last_peered":"2024-09-12T18:33:18.626934+0000","last_clean":"2024-09-12T18:33:18.626934+0000","last_became_active":"2024-09-12T17:10:32.370962+0000","last_became_peered":"2024-09-12T17:10:32.370962+0000","last_unstale":"2024-09-12T18:33:18.626934+0000","last_undegraded":"2024-09-12T18:33:18.626934+0000","last_fullsized":"2024-09-12T18:33:18.626934+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:19.779809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2855,"num_read_kb":2656,"num_write":715,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'407","reported_seq":1141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.964533+0000","last_change":"2024-09-12T18:36:20.964533+0000","last_active":"2024-09-12T18:36:20.964533+0000","last_peered":"2024-09-12T18:36:20.964533+0000","last_clean":"2024-09-12T18:36:20.964533+0000","last_became_active":"2024-09-12T17:10:30.374789+0000","last_became_peered":"2024-09-12T17:10:30.374789+0000","last_unstale":"2024-09-12T18:36:20.964533+0000","last_undegraded":"2024-09-12T18:36:20.964533+0000","last_fullsized":"2024-09-12T18:36:20.964533+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'407","last_scrub_stamp":"2024-09-12T18:36:20.964301+0000","last_deep_scrub":"268'407","last_deep_scrub_stamp":"2024-09-12T18:36:20.964301+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.964301+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:34.996196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267453,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":786,"num_read_kb":12016,"num_write":1261,"num_write_kb":48882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'289","reported_seq":1686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.595129+0000","last_change":"2024-09-12T18:36:23.595129+0000","last_active":"2024-09-12T18:36:23.595129+0000","last_peered":"2024-09-12T18:36:23.595129+0000","last_clean":"2024-09-12T18:36:23.595129+0000","last_became_active":"2024-09-12T17:10:32.357199+0000","last_became_peered":"2024-09-12T17:10:32.357199+0000","last_unstale":"2024-09-12T18:36:23.595129+0000","last_undegraded":"2024-09-12T18:36:23.595129+0000","last_fullsized":"2024-09-12T18:36:23.595129+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'289","last_scrub_stamp":"2024-09-12T18:36:23.594944+0000","last_deep_scrub":"268'289","last_deep_scrub_stamp":"2024-09-12T18:36:23.594944+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.594944+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:43.920636+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1623,"num_read_kb":1593,"num_write":300,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'311","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.900501+0000","last_change":"2024-09-12T18:36:18.900501+0000","last_active":"2024-09-12T18:36:18.900501+0000","last_peered":"2024-09-12T18:36:18.900501+0000","last_clean":"2024-09-12T18:36:18.900501+0000","last_became_active":"2024-09-12T17:10:30.385216+0000","last_became_peered":"2024-09-12T17:10:30.385216+0000","last_unstale":"2024-09-12T18:36:18.900501+0000","last_undegraded":"2024-09-12T18:36:18.900501+0000","last_fullsized":"2024-09-12T18:36:18.900501+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'311","last_scrub_stamp":"2024-09-12T18:36:18.900301+0000","last_deep_scrub":"268'311","last_deep_scrub_stamp":"2024-09-12T18:36:18.900301+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.900301+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:13.169294+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1826375,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":401,"num_read_kb":5414,"num_write":926,"num_write_kb":15383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'551","reported_seq":2132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.076590+0000","last_change":"2024-09-12T18:36:18.076590+0000","last_active":"2024-09-12T18:36:18.076590+0000","last_peered":"2024-09-12T18:36:18.076590+0000","last_clean":"2024-09-12T18:36:18.076590+0000","last_became_active":"2024-09-12T17:10:32.351972+0000","last_became_peered":"2024-09-12T17:10:32.351972+0000","last_unstale":"2024-09-12T18:36:18.076590+0000","last_undegraded":"2024-09-12T18:36:18.076590+0000","last_fullsized":"2024-09-12T18:36:18.076590+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'551","last_scrub_stamp":"2024-09-12T18:36:18.076367+0000","last_deep_scrub":"268'551","last_deep_scrub_stamp":"2024-09-12T18:36:18.076367+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.076367+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:24.496910+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2788,"num_read_kb":2550,"num_write":700,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'360","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.946134+0000","last_change":"2024-09-12T18:36:18.946134+0000","last_active":"2024-09-12T18:36:18.946134+0000","last_peered":"2024-09-12T18:36:18.946134+0000","last_clean":"2024-09-12T18:36:18.946134+0000","last_became_active":"2024-09-12T17:10:30.350813+0000","last_became_peered":"2024-09-12T17:10:30.350813+0000","last_unstale":"2024-09-12T18:36:18.946134+0000","last_undegraded":"2024-09-12T18:36:18.946134+0000","last_fullsized":"2024-09-12T18:36:18.946134+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'360","last_scrub_stamp":"2024-09-12T18:36:18.945828+0000","last_deep_scrub":"268'360","last_deep_scrub_stamp":"2024-09-12T18:36:18.945828+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.945828+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:55.758222+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":527,"num_read_kb":3741,"num_write":1103,"num_write_kb":26406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'434","reported_seq":2148,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.605409+0000","last_change":"2024-09-12T17:10:32.363876+0000","last_active":"2024-09-12T18:33:55.605409+0000","last_peered":"2024-09-12T18:33:55.605409+0000","last_clean":"2024-09-12T18:33:55.605409+0000","last_became_active":"2024-09-12T17:10:32.362980+0000","last_became_peered":"2024-09-12T17:10:32.362980+0000","last_unstale":"2024-09-12T18:33:55.605409+0000","last_undegraded":"2024-09-12T18:33:55.605409+0000","last_fullsized":"2024-09-12T18:33:55.605409+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:44.556208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2502,"num_read_kb":2403,"num_write":488,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'356","reported_seq":1261,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.924979+0000","last_change":"2024-09-12T18:36:17.924979+0000","last_active":"2024-09-12T18:36:17.924979+0000","last_peered":"2024-09-12T18:36:17.924979+0000","last_clean":"2024-09-12T18:36:17.924979+0000","last_became_active":"2024-09-12T17:11:04.870569+0000","last_became_peered":"2024-09-12T17:11:04.870569+0000","last_unstale":"2024-09-12T18:36:17.924979+0000","last_undegraded":"2024-09-12T18:36:17.924979+0000","last_fullsized":"2024-09-12T18:36:17.924979+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'356","last_scrub_stamp":"2024-09-12T18:36:17.924678+0000","last_deep_scrub":"268'356","last_deep_scrub_stamp":"2024-09-12T18:36:17.924678+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.924678+0000","objects_scrubbed":10,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.128171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170424,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":989,"num_read_kb":89437,"num_write":1208,"num_write_kb":38550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'426","reported_seq":1941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.423534+0000","last_change":"2024-09-12T17:10:32.369695+0000","last_active":"2024-09-12T18:33:56.423534+0000","last_peered":"2024-09-12T18:33:56.423534+0000","last_clean":"2024-09-12T18:33:56.423534+0000","last_became_active":"2024-09-12T17:10:32.368909+0000","last_became_peered":"2024-09-12T17:10:32.368909+0000","last_unstale":"2024-09-12T18:33:56.423534+0000","last_undegraded":"2024-09-12T18:33:56.423534+0000","last_fullsized":"2024-09-12T18:33:56.423534+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:18.380922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2227,"num_read_kb":2101,"num_write":505,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'392","reported_seq":1066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.853233+0000","last_change":"2024-09-12T18:36:15.853233+0000","last_active":"2024-09-12T18:36:15.853233+0000","last_peered":"2024-09-12T18:36:15.853233+0000","last_clean":"2024-09-12T18:36:15.853233+0000","last_became_active":"2024-09-12T17:10:30.395061+0000","last_became_peered":"2024-09-12T17:10:30.395061+0000","last_unstale":"2024-09-12T18:36:15.853233+0000","last_undegraded":"2024-09-12T18:36:15.853233+0000","last_fullsized":"2024-09-12T18:36:15.853233+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'392","last_scrub_stamp":"2024-09-12T18:36:15.853009+0000","last_deep_scrub":"268'392","last_deep_scrub_stamp":"2024-09-12T18:36:15.853009+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.853009+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:30.721888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194335,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":651,"num_read_kb":20153,"num_write":1153,"num_write_kb":23715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'422","reported_seq":1792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.446660+0000","last_change":"2024-09-12T18:36:19.446660+0000","last_active":"2024-09-12T18:36:19.446660+0000","last_peered":"2024-09-12T18:36:19.446660+0000","last_clean":"2024-09-12T18:36:19.446660+0000","last_became_active":"2024-09-12T17:11:05.124718+0000","last_became_peered":"2024-09-12T17:11:05.124718+0000","last_unstale":"2024-09-12T18:36:19.446660+0000","last_undegraded":"2024-09-12T18:36:19.446660+0000","last_fullsized":"2024-09-12T18:36:19.446660+0000","mapping_epoch":38,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'422","last_scrub_stamp":"2024-09-12T18:36:19.446482+0000","last_deep_scrub":"268'422","last_deep_scrub_stamp":"2024-09-12T18:36:19.446482+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.446482+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:14.866943+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2066,"num_read_kb":1911,"num_write":507,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'655","reported_seq":2401,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.950342+0000","last_change":"2024-09-12T18:36:22.950342+0000","last_active":"2024-09-12T18:36:22.950342+0000","last_peered":"2024-09-12T18:36:22.950342+0000","last_clean":"2024-09-12T18:36:22.950342+0000","last_became_active":"2024-09-12T17:10:32.363179+0000","last_became_peered":"2024-09-12T17:10:32.363179+0000","last_unstale":"2024-09-12T18:36:22.950342+0000","last_undegraded":"2024-09-12T18:36:22.950342+0000","last_fullsized":"2024-09-12T18:36:22.950342+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'655","last_scrub_stamp":"2024-09-12T18:36:22.950172+0000","last_deep_scrub":"268'655","last_deep_scrub_stamp":"2024-09-12T18:36:22.950172+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.950172+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":600,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:34.387389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3427,"num_read_kb":3148,"num_write":833,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'327","reported_seq":1021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.939536+0000","last_change":"2024-09-12T18:36:16.939536+0000","last_active":"2024-09-12T18:36:16.939536+0000","last_peered":"2024-09-12T18:36:16.939536+0000","last_clean":"2024-09-12T18:36:16.939536+0000","last_became_active":"2024-09-12T17:10:30.385785+0000","last_became_peered":"2024-09-12T17:10:30.385785+0000","last_unstale":"2024-09-12T18:36:16.939536+0000","last_undegraded":"2024-09-12T18:36:16.939536+0000","last_fullsized":"2024-09-12T18:36:16.939536+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'327","last_scrub_stamp":"2024-09-12T18:36:16.939330+0000","last_deep_scrub":"268'327","last_deep_scrub_stamp":"2024-09-12T18:36:16.939330+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.939330+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:37.817445+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":51060,"num_write":1041,"num_write_kb":34693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'512","reported_seq":2198,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.981814+0000","last_change":"2024-09-12T18:36:22.981814+0000","last_active":"2024-09-12T18:36:22.981814+0000","last_peered":"2024-09-12T18:36:22.981814+0000","last_clean":"2024-09-12T18:36:22.981814+0000","last_became_active":"2024-09-12T17:10:32.379669+0000","last_became_peered":"2024-09-12T17:10:32.379669+0000","last_unstale":"2024-09-12T18:36:22.981814+0000","last_undegraded":"2024-09-12T18:36:22.981814+0000","last_fullsized":"2024-09-12T18:36:22.981814+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'512","last_scrub_stamp":"2024-09-12T18:36:22.981614+0000","last_deep_scrub":"268'512","last_deep_scrub_stamp":"2024-09-12T18:36:22.981614+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.981614+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:06.503319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2752,"num_read_kb":2572,"num_write":584,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3555,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'342","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.344257+0000","last_change":"2024-09-12T18:36:12.344257+0000","last_active":"2024-09-12T18:36:12.344257+0000","last_peered":"2024-09-12T18:36:12.344257+0000","last_clean":"2024-09-12T18:36:12.344257+0000","last_became_active":"2024-09-12T17:12:05.834873+0000","last_became_peered":"2024-09-12T17:12:05.834873+0000","last_unstale":"2024-09-12T18:36:12.344257+0000","last_undegraded":"2024-09-12T18:36:12.344257+0000","last_fullsized":"2024-09-12T18:36:12.344257+0000","mapping_epoch":40,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-12T18:36:12.344008+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-12T18:36:12.344008+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.344008+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:12.727528+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505043,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":40642,"num_write":1117,"num_write_kb":40250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"268'1947","reported_seq":3546,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.019641+0000","last_change":"2024-09-12T18:36:25.019641+0000","last_active":"2024-09-12T18:36:25.019641+0000","last_peered":"2024-09-12T18:36:25.019641+0000","last_clean":"2024-09-12T18:36:25.019641+0000","last_became_active":"2024-09-12T17:10:32.358342+0000","last_became_peered":"2024-09-12T17:10:32.358342+0000","last_unstale":"2024-09-12T18:36:25.019641+0000","last_undegraded":"2024-09-12T18:36:25.019641+0000","last_fullsized":"2024-09-12T18:36:25.019641+0000","mapping_epoch":27,"log_start":"268'1900","ondisk_log_start":"268'1900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1947","last_scrub_stamp":"2024-09-12T18:36:25.019441+0000","last_deep_scrub":"268'1947","last_deep_scrub_stamp":"2024-09-12T18:36:25.019441+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.019441+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":1900,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:26.178456+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8411,"num_read_kb":7313,"num_write":2747,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1244,"num_omap_keys":5,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'385","reported_seq":1049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.171293+0000","last_change":"2024-09-12T18:36:12.171293+0000","last_active":"2024-09-12T18:36:12.171293+0000","last_peered":"2024-09-12T18:36:12.171293+0000","last_clean":"2024-09-12T18:36:12.171293+0000","last_became_active":"2024-09-12T17:10:30.395938+0000","last_became_peered":"2024-09-12T17:10:30.395938+0000","last_unstale":"2024-09-12T18:36:12.171293+0000","last_undegraded":"2024-09-12T18:36:12.171293+0000","last_fullsized":"2024-09-12T18:36:12.171293+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-12T18:36:12.171022+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-12T18:36:12.171022+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.171022+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:57.800473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":529,"num_read_kb":40778,"num_write":1213,"num_write_kb":34948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'784","reported_seq":2238,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.458241+0000","last_change":"2024-09-12T18:36:17.458241+0000","last_active":"2024-09-12T18:36:17.458241+0000","last_peered":"2024-09-12T18:36:17.458241+0000","last_clean":"2024-09-12T18:36:17.458241+0000","last_became_active":"2024-09-12T17:10:32.354271+0000","last_became_peered":"2024-09-12T17:10:32.354271+0000","last_unstale":"2024-09-12T18:36:17.458241+0000","last_undegraded":"2024-09-12T18:36:17.458241+0000","last_fullsized":"2024-09-12T18:36:17.458241+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'784","last_scrub_stamp":"2024-09-12T18:36:17.458035+0000","last_deep_scrub":"268'784","last_deep_scrub_stamp":"2024-09-12T18:36:17.458035+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.458035+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:22.834719+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3730,"num_read_kb":3333,"num_write":1060,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1463,"num_omap_keys":7,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'534","reported_seq":1291,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.982254+0000","last_change":"2024-09-12T18:36:07.982254+0000","last_active":"2024-09-12T18:36:07.982254+0000","last_peered":"2024-09-12T18:36:07.982254+0000","last_clean":"2024-09-12T18:36:07.982254+0000","last_became_active":"2024-09-12T17:10:30.394905+0000","last_became_peered":"2024-09-12T17:10:30.394905+0000","last_unstale":"2024-09-12T18:36:07.982254+0000","last_undegraded":"2024-09-12T18:36:07.982254+0000","last_fullsized":"2024-09-12T18:36:07.982254+0000","mapping_epoch":25,"log_start":"268'500","ondisk_log_start":"268'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'534","last_scrub_stamp":"2024-09-12T18:36:07.981975+0000","last_deep_scrub":"268'534","last_deep_scrub_stamp":"2024-09-12T18:36:07.981975+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.981975+0000","objects_scrubbed":11,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:02.322234+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4500387,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":948,"num_read_kb":40764,"num_write":1577,"num_write_kb":41950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'789","reported_seq":2390,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.424934+0000","last_change":"2024-09-12T18:36:16.424934+0000","last_active":"2024-09-12T18:36:16.424934+0000","last_peered":"2024-09-12T18:36:16.424934+0000","last_clean":"2024-09-12T18:36:16.424934+0000","last_became_active":"2024-09-12T17:10:32.372137+0000","last_became_peered":"2024-09-12T17:10:32.372137+0000","last_unstale":"2024-09-12T18:36:16.424934+0000","last_undegraded":"2024-09-12T18:36:16.424934+0000","last_fullsized":"2024-09-12T18:36:16.424934+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'789","last_scrub_stamp":"2024-09-12T18:36:16.424682+0000","last_deep_scrub":"268'789","last_deep_scrub_stamp":"2024-09-12T18:36:16.424682+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.424682+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:31.677702+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3748,"num_read_kb":3393,"num_write":1031,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'350","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.873906+0000","last_change":"2024-09-12T18:36:14.873906+0000","last_active":"2024-09-12T18:36:14.873906+0000","last_peered":"2024-09-12T18:36:14.873906+0000","last_clean":"2024-09-12T18:36:14.873906+0000","last_became_active":"2024-09-12T17:10:30.394096+0000","last_became_peered":"2024-09-12T17:10:30.394096+0000","last_unstale":"2024-09-12T18:36:14.873906+0000","last_undegraded":"2024-09-12T18:36:14.873906+0000","last_fullsized":"2024-09-12T18:36:14.873906+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T18:36:14.873700+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T18:36:14.873700+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.873700+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:24.375076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399199,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":10350,"num_write":1046,"num_write_kb":23725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'866","reported_seq":2543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.989539+0000","last_change":"2024-09-12T18:36:21.989539+0000","last_active":"2024-09-12T18:36:21.989539+0000","last_peered":"2024-09-12T18:36:21.989539+0000","last_clean":"2024-09-12T18:36:21.989539+0000","last_became_active":"2024-09-12T17:10:32.361126+0000","last_became_peered":"2024-09-12T17:10:32.361126+0000","last_unstale":"2024-09-12T18:36:21.989539+0000","last_undegraded":"2024-09-12T18:36:21.989539+0000","last_fullsized":"2024-09-12T18:36:21.989539+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'866","last_scrub_stamp":"2024-09-12T18:36:21.989341+0000","last_deep_scrub":"268'866","last_deep_scrub_stamp":"2024-09-12T18:36:21.989341+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.989341+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":800,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:40.716672+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4216,"num_read_kb":3793,"num_write":1162,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'338","reported_seq":964,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.621286+0000","last_change":"2024-09-12T18:36:12.621286+0000","last_active":"2024-09-12T18:36:12.621286+0000","last_peered":"2024-09-12T18:36:12.621286+0000","last_clean":"2024-09-12T18:36:12.621286+0000","last_became_active":"2024-09-12T17:10:30.353147+0000","last_became_peered":"2024-09-12T17:10:30.353147+0000","last_unstale":"2024-09-12T18:36:12.621286+0000","last_undegraded":"2024-09-12T18:36:12.621286+0000","last_fullsized":"2024-09-12T18:36:12.621286+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'338","last_scrub_stamp":"2024-09-12T18:36:12.621045+0000","last_deep_scrub":"268'338","last_deep_scrub_stamp":"2024-09-12T18:36:12.621045+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.621045+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:05.954192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":416,"num_read_kb":13692,"num_write":1012,"num_write_kb":32545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'134","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.133975+0000","last_change":"2024-09-12T17:10:40.422258+0000","last_active":"2024-09-12T18:34:02.133975+0000","last_peered":"2024-09-12T18:34:02.133975+0000","last_clean":"2024-09-12T18:34:02.133975+0000","last_became_active":"2024-09-12T17:10:40.421380+0000","last_became_peered":"2024-09-12T17:10:40.421380+0000","last_unstale":"2024-09-12T18:34:02.133975+0000","last_undegraded":"2024-09-12T18:34:02.133975+0000","last_fullsized":"2024-09-12T18:34:02.133975+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:26.392127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":207,"num_write":318,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'457","reported_seq":2079,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.781267+0000","last_change":"2024-09-12T18:36:20.781267+0000","last_active":"2024-09-12T18:36:20.781267+0000","last_peered":"2024-09-12T18:36:20.781267+0000","last_clean":"2024-09-12T18:36:20.781267+0000","last_became_active":"2024-09-12T17:10:32.370058+0000","last_became_peered":"2024-09-12T17:10:32.370058+0000","last_unstale":"2024-09-12T18:36:20.781267+0000","last_undegraded":"2024-09-12T18:36:20.781267+0000","last_fullsized":"2024-09-12T18:36:20.781267+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'457","last_scrub_stamp":"2024-09-12T18:36:20.781035+0000","last_deep_scrub":"268'457","last_deep_scrub_stamp":"2024-09-12T18:36:20.781035+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.781035+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:40.316776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2398,"num_read_kb":2269,"num_write":525,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'310","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.309364+0000","last_change":"2024-09-12T18:36:11.309364+0000","last_active":"2024-09-12T18:36:11.309364+0000","last_peered":"2024-09-12T18:36:11.309364+0000","last_clean":"2024-09-12T18:36:11.309364+0000","last_became_active":"2024-09-12T17:11:04.871007+0000","last_became_peered":"2024-09-12T17:11:04.871007+0000","last_unstale":"2024-09-12T18:36:11.309364+0000","last_undegraded":"2024-09-12T18:36:11.309364+0000","last_fullsized":"2024-09-12T18:36:11.309364+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-12T18:36:11.309154+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-12T18:36:11.309154+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.309154+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:27.380152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":422,"num_read_kb":10233,"num_write":1020,"num_write_kb":32687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.407279+0000","last_change":"2024-09-12T17:10:34.371764+0000","last_active":"2024-09-12T18:32:46.407279+0000","last_peered":"2024-09-12T18:32:46.407279+0000","last_clean":"2024-09-12T18:32:46.407279+0000","last_became_active":"2024-09-12T17:10:34.371022+0000","last_became_peered":"2024-09-12T17:10:34.371022+0000","last_unstale":"2024-09-12T18:32:46.407279+0000","last_undegraded":"2024-09-12T18:32:46.407279+0000","last_fullsized":"2024-09-12T18:32:46.407279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:04.412145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'368","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.710533+0000","last_change":"2024-09-12T17:10:36.399853+0000","last_active":"2024-09-12T18:36:01.710533+0000","last_peered":"2024-09-12T18:36:01.710533+0000","last_clean":"2024-09-12T18:36:01.710533+0000","last_became_active":"2024-09-12T17:10:36.399464+0000","last_became_peered":"2024-09-12T17:10:36.399464+0000","last_unstale":"2024-09-12T18:36:01.710533+0000","last_undegraded":"2024-09-12T18:36:01.710533+0000","last_fullsized":"2024-09-12T18:36:01.710533+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:12.028942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49246,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":602,"num_read_kb":1286,"num_write":476,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.401248+0000","last_change":"2024-09-12T17:10:38.405144+0000","last_active":"2024-09-12T18:32:51.401248+0000","last_peered":"2024-09-12T18:32:51.401248+0000","last_clean":"2024-09-12T18:32:51.401248+0000","last_became_active":"2024-09-12T17:10:38.404423+0000","last_became_peered":"2024-09-12T17:10:38.404423+0000","last_unstale":"2024-09-12T18:32:51.401248+0000","last_undegraded":"2024-09-12T18:32:51.401248+0000","last_fullsized":"2024-09-12T18:32:51.401248+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:04.302118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'170","reported_seq":740,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.772365+0000","last_change":"2024-09-12T17:10:40.426221+0000","last_active":"2024-09-12T18:34:01.772365+0000","last_peered":"2024-09-12T18:34:01.772365+0000","last_clean":"2024-09-12T18:34:01.772365+0000","last_became_active":"2024-09-12T17:10:40.425532+0000","last_became_peered":"2024-09-12T17:10:40.425532+0000","last_unstale":"2024-09-12T18:34:01.772365+0000","last_undegraded":"2024-09-12T18:34:01.772365+0000","last_fullsized":"2024-09-12T18:34:01.772365+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:09.048645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":265,"num_read_kb":256,"num_write":326,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'734","reported_seq":2472,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.977608+0000","last_change":"2024-09-12T18:36:22.977608+0000","last_active":"2024-09-12T18:36:22.977608+0000","last_peered":"2024-09-12T18:36:22.977608+0000","last_clean":"2024-09-12T18:36:22.977608+0000","last_became_active":"2024-09-12T17:10:32.381838+0000","last_became_peered":"2024-09-12T17:10:32.381838+0000","last_unstale":"2024-09-12T18:36:22.977608+0000","last_undegraded":"2024-09-12T18:36:22.977608+0000","last_fullsized":"2024-09-12T18:36:22.977608+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'734","last_scrub_stamp":"2024-09-12T18:36:22.977435+0000","last_deep_scrub":"268'734","last_deep_scrub_stamp":"2024-09-12T18:36:22.977435+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.977435+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:38.867097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3756,"num_read_kb":3395,"num_write":1068,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'387","reported_seq":1116,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.651608+0000","last_change":"2024-09-12T18:36:08.651608+0000","last_active":"2024-09-12T18:36:08.651608+0000","last_peered":"2024-09-12T18:36:08.651608+0000","last_clean":"2024-09-12T18:36:08.651608+0000","last_became_active":"2024-09-12T17:10:30.362010+0000","last_became_peered":"2024-09-12T17:10:30.362010+0000","last_unstale":"2024-09-12T18:36:08.651608+0000","last_undegraded":"2024-09-12T18:36:08.651608+0000","last_fullsized":"2024-09-12T18:36:08.651608+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'387","last_scrub_stamp":"2024-09-12T18:36:08.651489+0000","last_deep_scrub":"268'387","last_deep_scrub_stamp":"2024-09-12T18:36:08.651489+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.651489+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:16.615443+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9667749,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":698,"num_read_kb":52712,"num_write":1418,"num_write_kb":39491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403196+0000","last_change":"2024-09-12T17:10:34.362183+0000","last_active":"2024-09-12T18:32:34.403196+0000","last_peered":"2024-09-12T18:32:34.403196+0000","last_clean":"2024-09-12T18:32:34.403196+0000","last_became_active":"2024-09-12T17:10:34.361102+0000","last_became_peered":"2024-09-12T17:10:34.361102+0000","last_unstale":"2024-09-12T18:32:34.403196+0000","last_undegraded":"2024-09-12T18:32:34.403196+0000","last_fullsized":"2024-09-12T18:32:34.403196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:20.467248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'110","reported_seq":666,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.590229+0000","last_change":"2024-09-12T17:10:36.391217+0000","last_active":"2024-09-12T18:32:50.590229+0000","last_peered":"2024-09-12T18:32:50.590229+0000","last_clean":"2024-09-12T18:32:50.590229+0000","last_became_active":"2024-09-12T17:10:36.390398+0000","last_became_peered":"2024-09-12T17:10:36.390398+0000","last_unstale":"2024-09-12T18:32:50.590229+0000","last_undegraded":"2024-09-12T18:32:50.590229+0000","last_fullsized":"2024-09-12T18:32:50.590229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:54.025550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:50.590198+0000","last_change":"2024-09-12T17:10:38.414637+0000","last_active":"2024-09-12T18:32:50.590198+0000","last_peered":"2024-09-12T18:32:50.590198+0000","last_clean":"2024-09-12T18:32:50.590198+0000","last_became_active":"2024-09-12T17:10:38.414063+0000","last_became_peered":"2024-09-12T17:10:38.414063+0000","last_unstale":"2024-09-12T18:32:50.590198+0000","last_undegraded":"2024-09-12T18:32:50.590198+0000","last_fullsized":"2024-09-12T18:32:50.590198+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:48.781233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'138","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:57.548387+0000","last_change":"2024-09-12T17:10:40.423061+0000","last_active":"2024-09-12T18:33:57.548387+0000","last_peered":"2024-09-12T18:33:57.548387+0000","last_clean":"2024-09-12T18:33:57.548387+0000","last_became_active":"2024-09-12T17:10:40.422118+0000","last_became_peered":"2024-09-12T17:10:40.422118+0000","last_unstale":"2024-09-12T18:33:57.548387+0000","last_undegraded":"2024-09-12T18:33:57.548387+0000","last_fullsized":"2024-09-12T18:33:57.548387+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:39.157083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":180,"num_write":349,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'874","reported_seq":2504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.499729+0000","last_change":"2024-09-12T18:36:16.499729+0000","last_active":"2024-09-12T18:36:16.499729+0000","last_peered":"2024-09-12T18:36:16.499729+0000","last_clean":"2024-09-12T18:36:16.499729+0000","last_became_active":"2024-09-12T17:10:32.351650+0000","last_became_peered":"2024-09-12T17:10:32.351650+0000","last_unstale":"2024-09-12T18:36:16.499729+0000","last_undegraded":"2024-09-12T18:36:16.499729+0000","last_fullsized":"2024-09-12T18:36:16.499729+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'874","last_scrub_stamp":"2024-09-12T18:36:16.499553+0000","last_deep_scrub":"268'874","last_deep_scrub_stamp":"2024-09-12T18:36:16.499553+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.499553+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:08.094193+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4313,"num_read_kb":3885,"num_write":1184,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'394","reported_seq":1137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.970009+0000","last_change":"2024-09-12T18:36:13.970009+0000","last_active":"2024-09-12T18:36:13.970009+0000","last_peered":"2024-09-12T18:36:13.970009+0000","last_clean":"2024-09-12T18:36:13.970009+0000","last_became_active":"2024-09-12T17:10:30.393670+0000","last_became_peered":"2024-09-12T17:10:30.393670+0000","last_unstale":"2024-09-12T18:36:13.970009+0000","last_undegraded":"2024-09-12T18:36:13.970009+0000","last_fullsized":"2024-09-12T18:36:13.970009+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T18:36:13.969732+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T18:36:13.969732+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.969732+0000","objects_scrubbed":10,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:08.366310+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3976825,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":785,"num_read_kb":43186,"num_write":1227,"num_write_kb":22438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:44.406536+0000","last_change":"2024-09-12T17:10:34.358839+0000","last_active":"2024-09-12T18:32:44.406536+0000","last_peered":"2024-09-12T18:32:44.406536+0000","last_clean":"2024-09-12T18:32:44.406536+0000","last_became_active":"2024-09-12T17:10:34.358119+0000","last_became_peered":"2024-09-12T17:10:34.358119+0000","last_unstale":"2024-09-12T18:32:44.406536+0000","last_undegraded":"2024-09-12T18:32:44.406536+0000","last_fullsized":"2024-09-12T18:32:44.406536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:56.480463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'157","reported_seq":739,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.490785+0000","last_change":"2024-09-12T18:36:24.490785+0000","last_active":"2024-09-12T18:36:24.490785+0000","last_peered":"2024-09-12T18:36:24.490785+0000","last_clean":"2024-09-12T18:36:24.490785+0000","last_became_active":"2024-09-12T17:10:36.384465+0000","last_became_peered":"2024-09-12T17:10:36.384465+0000","last_unstale":"2024-09-12T18:36:24.490785+0000","last_undegraded":"2024-09-12T18:36:24.490785+0000","last_fullsized":"2024-09-12T18:36:24.490785+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'157","last_scrub_stamp":"2024-09-12T18:36:24.490568+0000","last_deep_scrub":"268'157","last_deep_scrub_stamp":"2024-09-12T18:36:24.490568+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.490568+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:59.451113+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":178,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'794","reported_seq":2920,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.179861+0000","last_change":"2024-09-12T17:10:38.407657+0000","last_active":"2024-09-12T18:36:01.179861+0000","last_peered":"2024-09-12T18:36:01.179861+0000","last_clean":"2024-09-12T18:36:01.179861+0000","last_became_active":"2024-09-12T17:10:38.406964+0000","last_became_peered":"2024-09-12T17:10:38.406964+0000","last_unstale":"2024-09-12T18:36:01.179861+0000","last_undegraded":"2024-09-12T18:36:01.179861+0000","last_fullsized":"2024-09-12T18:36:01.179861+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:41.454994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'254","reported_seq":1111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.224603+0000","last_change":"2024-09-12T17:10:40.769418+0000","last_active":"2024-09-12T18:34:02.224603+0000","last_peered":"2024-09-12T18:34:02.224603+0000","last_clean":"2024-09-12T18:34:02.224603+0000","last_became_active":"2024-09-12T17:10:40.768896+0000","last_became_peered":"2024-09-12T17:10:40.768896+0000","last_unstale":"2024-09-12T18:34:02.224603+0000","last_undegraded":"2024-09-12T18:34:02.224603+0000","last_fullsized":"2024-09-12T18:34:02.224603+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:14.019332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":705,"num_read_kb":685,"num_write":456,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'534","reported_seq":2346,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.817370+0000","last_change":"2024-09-12T18:36:19.817370+0000","last_active":"2024-09-12T18:36:19.817370+0000","last_peered":"2024-09-12T18:36:19.817370+0000","last_clean":"2024-09-12T18:36:19.817370+0000","last_became_active":"2024-09-12T17:10:32.382671+0000","last_became_peered":"2024-09-12T17:10:32.382671+0000","last_unstale":"2024-09-12T18:36:19.817370+0000","last_undegraded":"2024-09-12T18:36:19.817370+0000","last_fullsized":"2024-09-12T18:36:19.817370+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'534","last_scrub_stamp":"2024-09-12T18:36:19.817166+0000","last_deep_scrub":"268'534","last_deep_scrub_stamp":"2024-09-12T18:36:19.817166+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.817166+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:25.307712+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3129,"num_read_kb":2937,"num_write":633,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3101,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'384","reported_seq":1068,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.175322+0000","last_change":"2024-09-12T18:36:09.175322+0000","last_active":"2024-09-12T18:36:09.175322+0000","last_peered":"2024-09-12T18:36:09.175322+0000","last_clean":"2024-09-12T18:36:09.175322+0000","last_became_active":"2024-09-12T17:10:30.390677+0000","last_became_peered":"2024-09-12T17:10:30.390677+0000","last_unstale":"2024-09-12T18:36:09.175322+0000","last_undegraded":"2024-09-12T18:36:09.175322+0000","last_fullsized":"2024-09-12T18:36:09.175322+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'384","last_scrub_stamp":"2024-09-12T18:36:09.175054+0000","last_deep_scrub":"268'384","last_deep_scrub_stamp":"2024-09-12T18:36:09.175054+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.175054+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:54.543850+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262215,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":587,"num_read_kb":63186,"num_write":1131,"num_write_kb":46639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:46.407341+0000","last_change":"2024-09-12T17:10:34.373089+0000","last_active":"2024-09-12T18:32:46.407341+0000","last_peered":"2024-09-12T18:32:46.407341+0000","last_clean":"2024-09-12T18:32:46.407341+0000","last_became_active":"2024-09-12T17:10:34.371937+0000","last_became_peered":"2024-09-12T17:10:34.371937+0000","last_unstale":"2024-09-12T18:32:46.407341+0000","last_undegraded":"2024-09-12T18:32:46.407341+0000","last_fullsized":"2024-09-12T18:32:46.407341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:36.719820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'318","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.366440+0000","last_change":"2024-09-12T17:10:36.921222+0000","last_active":"2024-09-12T18:36:01.366440+0000","last_peered":"2024-09-12T18:36:01.366440+0000","last_clean":"2024-09-12T18:36:01.366440+0000","last_became_active":"2024-09-12T17:10:36.920487+0000","last_became_peered":"2024-09-12T17:10:36.920487+0000","last_unstale":"2024-09-12T18:36:01.366440+0000","last_undegraded":"2024-09-12T18:36:01.366440+0000","last_fullsized":"2024-09-12T18:36:01.366440+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:45.222423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46675,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":545,"num_read_kb":1308,"num_write":450,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'808","reported_seq":2816,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.886475+0000","last_change":"2024-09-12T17:10:38.398227+0000","last_active":"2024-09-12T18:36:01.886475+0000","last_peered":"2024-09-12T18:36:01.886475+0000","last_clean":"2024-09-12T18:36:01.886475+0000","last_became_active":"2024-09-12T17:10:38.393524+0000","last_became_peered":"2024-09-12T17:10:38.393524+0000","last_unstale":"2024-09-12T18:36:01.886475+0000","last_undegraded":"2024-09-12T18:36:01.886475+0000","last_fullsized":"2024-09-12T18:36:01.886475+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:55.682578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'402","reported_seq":1979,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.984204+0000","last_change":"2024-09-12T18:36:21.984204+0000","last_active":"2024-09-12T18:36:21.984204+0000","last_peered":"2024-09-12T18:36:21.984204+0000","last_clean":"2024-09-12T18:36:21.984204+0000","last_became_active":"2024-09-12T17:10:32.378027+0000","last_became_peered":"2024-09-12T17:10:32.378027+0000","last_unstale":"2024-09-12T18:36:21.984204+0000","last_undegraded":"2024-09-12T18:36:21.984204+0000","last_fullsized":"2024-09-12T18:36:21.984204+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'402","last_scrub_stamp":"2024-09-12T18:36:21.983901+0000","last_deep_scrub":"268'402","last_deep_scrub_stamp":"2024-09-12T18:36:21.983901+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.983901+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:14.125927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2313,"num_read_kb":2218,"num_write":459,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'347","reported_seq":1027,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.000957+0000","last_change":"2024-09-12T18:36:12.000812+0000","last_active":"2024-09-12T18:36:12.000957+0000","last_peered":"2024-09-12T18:36:12.000957+0000","last_clean":"2024-09-12T18:36:12.000957+0000","last_became_active":"2024-09-12T17:10:30.386707+0000","last_became_peered":"2024-09-12T17:10:30.386707+0000","last_unstale":"2024-09-12T18:36:12.000957+0000","last_undegraded":"2024-09-12T18:36:12.000957+0000","last_fullsized":"2024-09-12T18:36:12.000957+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-12T18:36:12.000536+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-12T18:36:12.000536+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.000536+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:38.013571+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399029,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":531,"num_read_kb":31049,"num_write":1121,"num_write_kb":31528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.402246+0000","last_change":"2024-09-12T17:10:34.369825+0000","last_active":"2024-09-12T18:32:56.402246+0000","last_peered":"2024-09-12T18:32:56.402246+0000","last_clean":"2024-09-12T18:32:56.402246+0000","last_became_active":"2024-09-12T17:10:34.369066+0000","last_became_peered":"2024-09-12T17:10:34.369066+0000","last_unstale":"2024-09-12T18:32:56.402246+0000","last_undegraded":"2024-09-12T18:32:56.402246+0000","last_fullsized":"2024-09-12T18:32:56.402246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:26.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'385","reported_seq":1044,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.257475+0000","last_change":"2024-09-12T17:10:36.920855+0000","last_active":"2024-09-12T18:35:59.257475+0000","last_peered":"2024-09-12T18:35:59.257475+0000","last_clean":"2024-09-12T18:35:59.257475+0000","last_became_active":"2024-09-12T17:10:36.920136+0000","last_became_peered":"2024-09-12T17:10:36.920136+0000","last_unstale":"2024-09-12T18:35:59.257475+0000","last_undegraded":"2024-09-12T18:35:59.257475+0000","last_fullsized":"2024-09-12T18:35:59.257475+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:53.763125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54168,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":623,"num_read_kb":1195,"num_write":466,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.879465+0000","last_change":"2024-09-12T18:36:25.879465+0000","last_active":"2024-09-12T18:36:25.879465+0000","last_peered":"2024-09-12T18:36:25.879465+0000","last_clean":"2024-09-12T18:36:25.879465+0000","last_became_active":"2024-09-12T17:10:38.394381+0000","last_became_peered":"2024-09-12T17:10:38.394381+0000","last_unstale":"2024-09-12T18:36:25.879465+0000","last_undegraded":"2024-09-12T18:36:25.879465+0000","last_fullsized":"2024-09-12T18:36:25.879465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:25.879288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:25.879288+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.879288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:15.785711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'531","reported_seq":1357,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.764323+0000","last_change":"2024-09-12T17:10:40.423104+0000","last_active":"2024-09-12T18:35:21.764323+0000","last_peered":"2024-09-12T18:35:21.764323+0000","last_clean":"2024-09-12T18:35:21.764323+0000","last_became_active":"2024-09-12T17:10:40.422353+0000","last_became_peered":"2024-09-12T17:10:40.422353+0000","last_unstale":"2024-09-12T18:35:21.764323+0000","last_undegraded":"2024-09-12T18:35:21.764323+0000","last_fullsized":"2024-09-12T18:35:21.764323+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:50.482047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1294,"num_read_kb":1291,"num_write":1098,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'425","reported_seq":2041,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.993454+0000","last_change":"2024-09-12T18:36:11.993454+0000","last_active":"2024-09-12T18:36:11.993454+0000","last_peered":"2024-09-12T18:36:11.993454+0000","last_clean":"2024-09-12T18:36:11.993454+0000","last_became_active":"2024-09-12T17:10:32.369188+0000","last_became_peered":"2024-09-12T17:10:32.369188+0000","last_unstale":"2024-09-12T18:36:11.993454+0000","last_undegraded":"2024-09-12T18:36:11.993454+0000","last_fullsized":"2024-09-12T18:36:11.993454+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'425","last_scrub_stamp":"2024-09-12T18:36:11.993172+0000","last_deep_scrub":"268'425","last_deep_scrub_stamp":"2024-09-12T18:36:11.993172+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.993172+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:31.536535+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2274,"num_read_kb":2176,"num_write":482,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'333","reported_seq":1118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.915481+0000","last_change":"2024-09-12T18:36:14.915481+0000","last_active":"2024-09-12T18:36:14.915481+0000","last_peered":"2024-09-12T18:36:14.915481+0000","last_clean":"2024-09-12T18:36:14.915481+0000","last_became_active":"2024-09-12T17:10:30.381728+0000","last_became_peered":"2024-09-12T17:10:30.381728+0000","last_unstale":"2024-09-12T18:36:14.915481+0000","last_undegraded":"2024-09-12T18:36:14.915481+0000","last_fullsized":"2024-09-12T18:36:14.915481+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-12T18:36:14.915264+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-12T18:36:14.915264+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.915264+0000","objects_scrubbed":9,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:17.086755+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399298,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":581,"num_read_kb":127583,"num_write":1019,"num_write_kb":57035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.416236+0000","last_change":"2024-09-12T18:36:21.416236+0000","last_active":"2024-09-12T18:36:21.416236+0000","last_peered":"2024-09-12T18:36:21.416236+0000","last_clean":"2024-09-12T18:36:21.416236+0000","last_became_active":"2024-09-12T17:10:34.346229+0000","last_became_peered":"2024-09-12T17:10:34.346229+0000","last_unstale":"2024-09-12T18:36:21.416236+0000","last_undegraded":"2024-09-12T18:36:21.416236+0000","last_fullsized":"2024-09-12T18:36:21.416236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:21.416056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:21.416056+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.416056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:15.060850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'298","reported_seq":900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.555096+0000","last_change":"2024-09-12T17:10:36.399143+0000","last_active":"2024-09-12T18:36:00.555096+0000","last_peered":"2024-09-12T18:36:00.555096+0000","last_clean":"2024-09-12T18:36:00.555096+0000","last_became_active":"2024-09-12T17:10:36.398641+0000","last_became_peered":"2024-09-12T17:10:36.398641+0000","last_unstale":"2024-09-12T18:36:00.555096+0000","last_undegraded":"2024-09-12T18:36:00.555096+0000","last_fullsized":"2024-09-12T18:36:00.555096+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":1192,"num_write":410,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:19.414508+0000","last_change":"2024-09-12T17:10:38.395735+0000","last_active":"2024-09-12T18:33:19.414508+0000","last_peered":"2024-09-12T18:33:19.414508+0000","last_clean":"2024-09-12T18:33:19.414508+0000","last_became_active":"2024-09-12T17:10:38.393114+0000","last_became_peered":"2024-09-12T17:10:38.393114+0000","last_unstale":"2024-09-12T18:33:19.414508+0000","last_undegraded":"2024-09-12T18:33:19.414508+0000","last_fullsized":"2024-09-12T18:33:19.414508+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:32.570846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'2402","reported_seq":4244,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:08.869297+0000","last_change":"2024-09-12T17:10:40.426099+0000","last_active":"2024-09-12T18:35:08.869297+0000","last_peered":"2024-09-12T18:35:08.869297+0000","last_clean":"2024-09-12T18:35:08.869297+0000","last_became_active":"2024-09-12T17:10:40.425351+0000","last_became_peered":"2024-09-12T17:10:40.425351+0000","last_unstale":"2024-09-12T18:35:08.869297+0000","last_undegraded":"2024-09-12T18:35:08.869297+0000","last_fullsized":"2024-09-12T18:35:08.869297+0000","mapping_epoch":35,"log_start":"268'2300","ondisk_log_start":"268'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":2300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6030,"num_read_kb":6033,"num_write":4839,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'771","reported_seq":2283,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.076189+0000","last_change":"2024-09-12T18:36:16.076189+0000","last_active":"2024-09-12T18:36:16.076189+0000","last_peered":"2024-09-12T18:36:16.076189+0000","last_clean":"2024-09-12T18:36:16.076189+0000","last_became_active":"2024-09-12T17:11:04.373050+0000","last_became_peered":"2024-09-12T17:11:04.373050+0000","last_unstale":"2024-09-12T18:36:16.076189+0000","last_undegraded":"2024-09-12T18:36:16.076189+0000","last_fullsized":"2024-09-12T18:36:16.076189+0000","mapping_epoch":38,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'771","last_scrub_stamp":"2024-09-12T18:36:16.075977+0000","last_deep_scrub":"268'771","last_deep_scrub_stamp":"2024-09-12T18:36:16.075977+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.075977+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:34.465225+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3705,"num_read_kb":3333,"num_write":1034,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":470,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'339","reported_seq":1022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.991290+0000","last_change":"2024-09-12T18:36:12.991290+0000","last_active":"2024-09-12T18:36:12.991290+0000","last_peered":"2024-09-12T18:36:12.991290+0000","last_clean":"2024-09-12T18:36:12.991290+0000","last_became_active":"2024-09-12T17:10:30.381997+0000","last_became_peered":"2024-09-12T17:10:30.381997+0000","last_unstale":"2024-09-12T18:36:12.991290+0000","last_undegraded":"2024-09-12T18:36:12.991290+0000","last_fullsized":"2024-09-12T18:36:12.991290+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T18:36:12.991024+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T18:36:12.991024+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.991024+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:06.763609+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":534,"num_read_kb":9738,"num_write":1109,"num_write_kb":58445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.424294+0000","last_change":"2024-09-12T18:36:20.424294+0000","last_active":"2024-09-12T18:36:20.424294+0000","last_peered":"2024-09-12T18:36:20.424294+0000","last_clean":"2024-09-12T18:36:20.424294+0000","last_became_active":"2024-09-12T17:10:34.358798+0000","last_became_peered":"2024-09-12T17:10:34.358798+0000","last_unstale":"2024-09-12T18:36:20.424294+0000","last_undegraded":"2024-09-12T18:36:20.424294+0000","last_fullsized":"2024-09-12T18:36:20.424294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:20.424121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:20.424121+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.424121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:13.717135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'350","reported_seq":977,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.478205+0000","last_change":"2024-09-12T17:10:36.397286+0000","last_active":"2024-09-12T18:35:59.478205+0000","last_peered":"2024-09-12T18:35:59.478205+0000","last_clean":"2024-09-12T18:35:59.478205+0000","last_became_active":"2024-09-12T17:10:36.396261+0000","last_became_peered":"2024-09-12T17:10:36.396261+0000","last_unstale":"2024-09-12T18:35:59.478205+0000","last_undegraded":"2024-09-12T18:35:59.478205+0000","last_fullsized":"2024-09-12T18:35:59.478205+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:04.653529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49048,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1254,"num_write":464,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'801","reported_seq":2782,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.620402+0000","last_change":"2024-09-12T17:10:38.409388+0000","last_active":"2024-09-12T18:36:00.620402+0000","last_peered":"2024-09-12T18:36:00.620402+0000","last_clean":"2024-09-12T18:36:00.620402+0000","last_became_active":"2024-09-12T17:10:38.408710+0000","last_became_peered":"2024-09-12T17:10:38.408710+0000","last_unstale":"2024-09-12T18:36:00.620402+0000","last_undegraded":"2024-09-12T18:36:00.620402+0000","last_fullsized":"2024-09-12T18:36:00.620402+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:10.552245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'126","reported_seq":639,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.149525+0000","last_change":"2024-09-12T17:10:40.423220+0000","last_active":"2024-09-12T18:35:20.149525+0000","last_peered":"2024-09-12T18:35:20.149525+0000","last_clean":"2024-09-12T18:35:20.149525+0000","last_became_active":"2024-09-12T17:10:40.417664+0000","last_became_peered":"2024-09-12T17:10:40.417664+0000","last_unstale":"2024-09-12T18:35:20.149525+0000","last_undegraded":"2024-09-12T18:35:20.149525+0000","last_fullsized":"2024-09-12T18:35:20.149525+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:22.188666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":285,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'887","reported_seq":2356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.581186+0000","last_change":"2024-09-12T18:36:21.581186+0000","last_active":"2024-09-12T18:36:21.581186+0000","last_peered":"2024-09-12T18:36:21.581186+0000","last_clean":"2024-09-12T18:36:21.581186+0000","last_became_active":"2024-09-12T17:10:32.364995+0000","last_became_peered":"2024-09-12T17:10:32.364995+0000","last_unstale":"2024-09-12T18:36:21.581186+0000","last_undegraded":"2024-09-12T18:36:21.581186+0000","last_fullsized":"2024-09-12T18:36:21.581186+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'887","last_scrub_stamp":"2024-09-12T18:36:21.580992+0000","last_deep_scrub":"268'887","last_deep_scrub_stamp":"2024-09-12T18:36:21.580992+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.580992+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:04.860009+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4158,"num_read_kb":3733,"num_write":1245,"num_write_kb":492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'333","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.931436+0000","last_change":"2024-09-12T18:36:10.931436+0000","last_active":"2024-09-12T18:36:10.931436+0000","last_peered":"2024-09-12T18:36:10.931436+0000","last_clean":"2024-09-12T18:36:10.931436+0000","last_became_active":"2024-09-12T17:10:30.393495+0000","last_became_peered":"2024-09-12T17:10:30.393495+0000","last_unstale":"2024-09-12T18:36:10.931436+0000","last_undegraded":"2024-09-12T18:36:10.931436+0000","last_fullsized":"2024-09-12T18:36:10.931436+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-12T18:36:10.931229+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-12T18:36:10.931229+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.931229+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:44.015657+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170230,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":492,"num_read_kb":51876,"num_write":985,"num_write_kb":56464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.456159+0000","last_change":"2024-09-12T18:36:23.456159+0000","last_active":"2024-09-12T18:36:23.456159+0000","last_peered":"2024-09-12T18:36:23.456159+0000","last_clean":"2024-09-12T18:36:23.456159+0000","last_became_active":"2024-09-12T17:10:34.360732+0000","last_became_peered":"2024-09-12T17:10:34.360732+0000","last_unstale":"2024-09-12T18:36:23.456159+0000","last_undegraded":"2024-09-12T18:36:23.456159+0000","last_fullsized":"2024-09-12T18:36:23.456159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:23.455974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:23.455974+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.455974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:57.486813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'511","reported_seq":1177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.844836+0000","last_change":"2024-09-12T17:10:36.400168+0000","last_active":"2024-09-12T18:36:00.844836+0000","last_peered":"2024-09-12T18:36:00.844836+0000","last_clean":"2024-09-12T18:36:00.844836+0000","last_became_active":"2024-09-12T17:10:36.399536+0000","last_became_peered":"2024-09-12T17:10:36.399536+0000","last_unstale":"2024-09-12T18:36:00.844836+0000","last_undegraded":"2024-09-12T18:36:00.844836+0000","last_fullsized":"2024-09-12T18:36:00.844836+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:17.679689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89531,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":886,"num_read_kb":2156,"num_write":724,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.504638+0000","last_change":"2024-09-12T18:36:26.504638+0000","last_active":"2024-09-12T18:36:26.504638+0000","last_peered":"2024-09-12T18:36:26.504638+0000","last_clean":"2024-09-12T18:36:26.504638+0000","last_became_active":"2024-09-12T17:10:38.405169+0000","last_became_peered":"2024-09-12T17:10:38.405169+0000","last_unstale":"2024-09-12T18:36:26.504638+0000","last_undegraded":"2024-09-12T18:36:26.504638+0000","last_fullsized":"2024-09-12T18:36:26.504638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.504135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.504135+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.504135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:48.917759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'149","reported_seq":749,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642360+0000","last_change":"2024-09-12T17:10:40.410614+0000","last_active":"2024-09-12T18:33:01.642360+0000","last_peered":"2024-09-12T18:33:01.642360+0000","last_clean":"2024-09-12T18:33:01.642360+0000","last_became_active":"2024-09-12T17:10:40.409722+0000","last_became_peered":"2024-09-12T17:10:40.409722+0000","last_unstale":"2024-09-12T18:33:01.642360+0000","last_undegraded":"2024-09-12T18:33:01.642360+0000","last_fullsized":"2024-09-12T18:33:01.642360+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:32.816448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":508,"num_read_kb":430,"num_write":364,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'825","reported_seq":2351,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.972052+0000","last_change":"2024-09-12T18:36:12.972052+0000","last_active":"2024-09-12T18:36:12.972052+0000","last_peered":"2024-09-12T18:36:12.972052+0000","last_clean":"2024-09-12T18:36:12.972052+0000","last_became_active":"2024-09-12T17:10:32.370915+0000","last_became_peered":"2024-09-12T17:10:32.370915+0000","last_unstale":"2024-09-12T18:36:12.972052+0000","last_undegraded":"2024-09-12T18:36:12.972052+0000","last_fullsized":"2024-09-12T18:36:12.972052+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'825","last_scrub_stamp":"2024-09-12T18:36:12.971870+0000","last_deep_scrub":"268'825","last_deep_scrub_stamp":"2024-09-12T18:36:12.971870+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.971870+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:25.914060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3877,"num_read_kb":3457,"num_write":1088,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'360","reported_seq":1025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.366750+0000","last_change":"2024-09-12T18:36:07.366750+0000","last_active":"2024-09-12T18:36:07.366750+0000","last_peered":"2024-09-12T18:36:07.366750+0000","last_clean":"2024-09-12T18:36:07.366750+0000","last_became_active":"2024-09-12T17:11:04.868662+0000","last_became_peered":"2024-09-12T17:11:04.868662+0000","last_unstale":"2024-09-12T18:36:07.366750+0000","last_undegraded":"2024-09-12T18:36:07.366750+0000","last_fullsized":"2024-09-12T18:36:07.366750+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'360","last_scrub_stamp":"2024-09-12T18:36:07.366618+0000","last_deep_scrub":"268'360","last_deep_scrub_stamp":"2024-09-12T18:36:07.366618+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.366618+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:46.462039+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456511,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":553,"num_read_kb":17196,"num_write":1231,"num_write_kb":37960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.462220+0000","last_change":"2024-09-12T18:36:22.462220+0000","last_active":"2024-09-12T18:36:22.462220+0000","last_peered":"2024-09-12T18:36:22.462220+0000","last_clean":"2024-09-12T18:36:22.462220+0000","last_became_active":"2024-09-12T17:10:34.363822+0000","last_became_peered":"2024-09-12T17:10:34.363822+0000","last_unstale":"2024-09-12T18:36:22.462220+0000","last_undegraded":"2024-09-12T18:36:22.462220+0000","last_fullsized":"2024-09-12T18:36:22.462220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:22.462029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:22.462029+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.462029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:34.960157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'304","reported_seq":918,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.926189+0000","last_change":"2024-09-12T17:10:36.378654+0000","last_active":"2024-09-12T18:36:00.926189+0000","last_peered":"2024-09-12T18:36:00.926189+0000","last_clean":"2024-09-12T18:36:00.926189+0000","last_became_active":"2024-09-12T17:10:36.377677+0000","last_became_peered":"2024-09-12T17:10:36.377677+0000","last_unstale":"2024-09-12T18:36:00.926189+0000","last_undegraded":"2024-09-12T18:36:00.926189+0000","last_fullsized":"2024-09-12T18:36:00.926189+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50917,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":528,"num_read_kb":1122,"num_write":460,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:11.428504+0000","last_change":"2024-09-12T17:10:38.414306+0000","last_active":"2024-09-12T18:34:11.428504+0000","last_peered":"2024-09-12T18:34:11.428504+0000","last_clean":"2024-09-12T18:34:11.428504+0000","last_became_active":"2024-09-12T17:10:38.413429+0000","last_became_peered":"2024-09-12T17:10:38.413429+0000","last_unstale":"2024-09-12T18:34:11.428504+0000","last_undegraded":"2024-09-12T18:34:11.428504+0000","last_fullsized":"2024-09-12T18:34:11.428504+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'113","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:04.436186+0000","last_change":"2024-09-12T17:10:40.416006+0000","last_active":"2024-09-12T18:35:04.436186+0000","last_peered":"2024-09-12T18:35:04.436186+0000","last_clean":"2024-09-12T18:35:04.436186+0000","last_became_active":"2024-09-12T17:10:40.415270+0000","last_became_peered":"2024-09-12T17:10:40.415270+0000","last_unstale":"2024-09-12T18:35:04.436186+0000","last_undegraded":"2024-09-12T18:35:04.436186+0000","last_fullsized":"2024-09-12T18:35:04.436186+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:27.216064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":272,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'513","reported_seq":2185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.975512+0000","last_change":"2024-09-12T18:36:13.975512+0000","last_active":"2024-09-12T18:36:13.975512+0000","last_peered":"2024-09-12T18:36:13.975512+0000","last_clean":"2024-09-12T18:36:13.975512+0000","last_became_active":"2024-09-12T17:10:32.357121+0000","last_became_peered":"2024-09-12T17:10:32.357121+0000","last_unstale":"2024-09-12T18:36:13.975512+0000","last_undegraded":"2024-09-12T18:36:13.975512+0000","last_fullsized":"2024-09-12T18:36:13.975512+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'513","last_scrub_stamp":"2024-09-12T18:36:13.975293+0000","last_deep_scrub":"268'513","last_deep_scrub_stamp":"2024-09-12T18:36:13.975293+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.975293+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":500,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:27.406648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2802,"num_read_kb":2611,"num_write":616,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'390","reported_seq":1081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.140455+0000","last_change":"2024-09-12T18:36:14.140455+0000","last_active":"2024-09-12T18:36:14.140455+0000","last_peered":"2024-09-12T18:36:14.140455+0000","last_clean":"2024-09-12T18:36:14.140455+0000","last_became_active":"2024-09-12T17:10:30.391780+0000","last_became_peered":"2024-09-12T17:10:30.391780+0000","last_unstale":"2024-09-12T18:36:14.140455+0000","last_undegraded":"2024-09-12T18:36:14.140455+0000","last_fullsized":"2024-09-12T18:36:14.140455+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'390","last_scrub_stamp":"2024-09-12T18:36:14.140207+0000","last_deep_scrub":"268'390","last_deep_scrub_stamp":"2024-09-12T18:36:14.140207+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.140207+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:53.168988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170426,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":660,"num_read_kb":4836,"num_write":1182,"num_write_kb":23965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.876077+0000","last_change":"2024-09-12T18:36:18.876077+0000","last_active":"2024-09-12T18:36:18.876077+0000","last_peered":"2024-09-12T18:36:18.876077+0000","last_clean":"2024-09-12T18:36:18.876077+0000","last_became_active":"2024-09-12T17:10:34.362337+0000","last_became_peered":"2024-09-12T17:10:34.362337+0000","last_unstale":"2024-09-12T18:36:18.876077+0000","last_undegraded":"2024-09-12T18:36:18.876077+0000","last_fullsized":"2024-09-12T18:36:18.876077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:18.875873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:18.875873+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.875873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:35.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'341","reported_seq":972,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.256627+0000","last_change":"2024-09-12T17:10:36.390545+0000","last_active":"2024-09-12T18:36:00.256627+0000","last_peered":"2024-09-12T18:36:00.256627+0000","last_clean":"2024-09-12T18:36:00.256627+0000","last_became_active":"2024-09-12T17:10:36.389965+0000","last_became_peered":"2024-09-12T17:10:36.389965+0000","last_unstale":"2024-09-12T18:36:00.256627+0000","last_undegraded":"2024-09-12T18:36:00.256627+0000","last_fullsized":"2024-09-12T18:36:00.256627+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60342,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":574,"num_read_kb":1242,"num_write":452,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'766","reported_seq":6969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.495465+0000","last_change":"2024-09-12T18:36:25.495465+0000","last_active":"2024-09-12T18:36:25.495465+0000","last_peered":"2024-09-12T18:36:25.495465+0000","last_clean":"2024-09-12T18:36:25.495465+0000","last_became_active":"2024-09-12T17:10:38.397332+0000","last_became_peered":"2024-09-12T17:10:38.397332+0000","last_unstale":"2024-09-12T18:36:25.495465+0000","last_undegraded":"2024-09-12T18:36:25.495465+0000","last_fullsized":"2024-09-12T18:36:25.495465+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'766","last_scrub_stamp":"2024-09-12T18:36:25.495275+0000","last_deep_scrub":"268'766","last_deep_scrub_stamp":"2024-09-12T18:36:25.495275+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.495275+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:58.308585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'149","reported_seq":674,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.655871+0000","last_change":"2024-09-12T17:10:40.424715+0000","last_active":"2024-09-12T18:34:01.655871+0000","last_peered":"2024-09-12T18:34:01.655871+0000","last_clean":"2024-09-12T18:34:01.655871+0000","last_became_active":"2024-09-12T17:10:40.423894+0000","last_became_peered":"2024-09-12T17:10:40.423894+0000","last_unstale":"2024-09-12T18:34:01.655871+0000","last_undegraded":"2024-09-12T18:34:01.655871+0000","last_fullsized":"2024-09-12T18:34:01.655871+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1683,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":214,"num_read_kb":204,"num_write":362,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'508","reported_seq":2230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.061396+0000","last_change":"2024-09-12T18:36:16.061396+0000","last_active":"2024-09-12T18:36:16.061396+0000","last_peered":"2024-09-12T18:36:16.061396+0000","last_clean":"2024-09-12T18:36:16.061396+0000","last_became_active":"2024-09-12T17:10:32.361164+0000","last_became_peered":"2024-09-12T17:10:32.361164+0000","last_unstale":"2024-09-12T18:36:16.061396+0000","last_undegraded":"2024-09-12T18:36:16.061396+0000","last_fullsized":"2024-09-12T18:36:16.061396+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'508","last_scrub_stamp":"2024-09-12T18:36:16.061192+0000","last_deep_scrub":"268'508","last_deep_scrub_stamp":"2024-09-12T18:36:16.061192+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.061192+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:04.877347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2673,"num_read_kb":2535,"num_write":607,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'391","reported_seq":1130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.012522+0000","last_change":"2024-09-12T18:36:07.012522+0000","last_active":"2024-09-12T18:36:07.012522+0000","last_peered":"2024-09-12T18:36:07.012522+0000","last_clean":"2024-09-12T18:36:07.012522+0000","last_became_active":"2024-09-12T17:10:30.361126+0000","last_became_peered":"2024-09-12T17:10:30.361126+0000","last_unstale":"2024-09-12T18:36:07.012522+0000","last_undegraded":"2024-09-12T18:36:07.012522+0000","last_fullsized":"2024-09-12T18:36:07.012522+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'391","last_scrub_stamp":"2024-09-12T18:36:07.012238+0000","last_deep_scrub":"268'391","last_deep_scrub_stamp":"2024-09-12T18:36:07.012238+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.012238+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:22.284310+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8882037,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":691,"num_read_kb":57357,"num_write":1297,"num_write_kb":69062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1477,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:58.765520+0000","last_change":"2024-09-12T17:10:34.371001+0000","last_active":"2024-09-12T18:35:58.765520+0000","last_peered":"2024-09-12T18:35:58.765520+0000","last_clean":"2024-09-12T18:35:58.765520+0000","last_became_active":"2024-09-12T17:10:34.367608+0000","last_became_peered":"2024-09-12T17:10:34.367608+0000","last_unstale":"2024-09-12T18:35:58.765520+0000","last_undegraded":"2024-09-12T18:35:58.765520+0000","last_fullsized":"2024-09-12T18:35:58.765520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:28.182336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'122","reported_seq":680,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:54.421900+0000","last_change":"2024-09-12T17:10:36.922117+0000","last_active":"2024-09-12T18:33:54.421900+0000","last_peered":"2024-09-12T18:33:54.421900+0000","last_clean":"2024-09-12T18:33:54.421900+0000","last_became_active":"2024-09-12T17:10:36.921242+0000","last_became_peered":"2024-09-12T17:10:36.921242+0000","last_unstale":"2024-09-12T18:33:54.421900+0000","last_undegraded":"2024-09-12T18:33:54.421900+0000","last_fullsized":"2024-09-12T18:33:54.421900+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'781","reported_seq":2895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.125502+0000","last_change":"2024-09-12T18:36:25.125502+0000","last_active":"2024-09-12T18:36:25.125502+0000","last_peered":"2024-09-12T18:36:25.125502+0000","last_clean":"2024-09-12T18:36:25.125502+0000","last_became_active":"2024-09-12T17:10:38.397242+0000","last_became_peered":"2024-09-12T17:10:38.397242+0000","last_unstale":"2024-09-12T18:36:25.125502+0000","last_undegraded":"2024-09-12T18:36:25.125502+0000","last_fullsized":"2024-09-12T18:36:25.125502+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'781","last_scrub_stamp":"2024-09-12T18:36:25.125289+0000","last_deep_scrub":"268'781","last_deep_scrub_stamp":"2024-09-12T18:36:25.125289+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.125289+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:01.514681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'138","reported_seq":655,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.606436+0000","last_change":"2024-09-12T17:10:40.420601+0000","last_active":"2024-09-12T18:34:00.606436+0000","last_peered":"2024-09-12T18:34:00.606436+0000","last_clean":"2024-09-12T18:34:00.606436+0000","last_became_active":"2024-09-12T17:10:40.415831+0000","last_became_peered":"2024-09-12T17:10:40.415831+0000","last_unstale":"2024-09-12T18:34:00.606436+0000","last_undegraded":"2024-09-12T18:34:00.606436+0000","last_fullsized":"2024-09-12T18:34:00.606436+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:03.855689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":150,"num_write":326,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'563","reported_seq":2088,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.989105+0000","last_change":"2024-09-12T18:36:21.988883+0000","last_active":"2024-09-12T18:36:21.989105+0000","last_peered":"2024-09-12T18:36:21.989105+0000","last_clean":"2024-09-12T18:36:21.989105+0000","last_became_active":"2024-09-12T17:10:32.366967+0000","last_became_peered":"2024-09-12T17:10:32.366967+0000","last_unstale":"2024-09-12T18:36:21.989105+0000","last_undegraded":"2024-09-12T18:36:21.989105+0000","last_fullsized":"2024-09-12T18:36:21.989105+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'563","last_scrub_stamp":"2024-09-12T18:36:21.988625+0000","last_deep_scrub":"268'563","last_deep_scrub_stamp":"2024-09-12T18:36:21.988625+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.988625+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:25.834312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2878,"num_read_kb":2622,"num_write":716,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'383","reported_seq":1075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.936973+0000","last_change":"2024-09-12T18:36:06.936973+0000","last_active":"2024-09-12T18:36:06.936973+0000","last_peered":"2024-09-12T18:36:06.936973+0000","last_clean":"2024-09-12T18:36:06.936973+0000","last_became_active":"2024-09-12T17:10:30.360368+0000","last_became_peered":"2024-09-12T17:10:30.360368+0000","last_unstale":"2024-09-12T18:36:06.936973+0000","last_undegraded":"2024-09-12T18:36:06.936973+0000","last_fullsized":"2024-09-12T18:36:06.936973+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-12T18:36:06.936843+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-12T18:36:06.936843+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.936843+0000","objects_scrubbed":8,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:18.264741+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4303946,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":608,"num_read_kb":11061,"num_write":1240,"num_write_kb":24095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:50.604284+0000","last_change":"2024-09-12T17:10:34.354809+0000","last_active":"2024-09-12T18:33:50.604284+0000","last_peered":"2024-09-12T18:33:50.604284+0000","last_clean":"2024-09-12T18:33:50.604284+0000","last_became_active":"2024-09-12T17:10:34.354009+0000","last_became_peered":"2024-09-12T17:10:34.354009+0000","last_unstale":"2024-09-12T18:33:50.604284+0000","last_undegraded":"2024-09-12T18:33:50.604284+0000","last_fullsized":"2024-09-12T18:33:50.604284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:37.358212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'378","reported_seq":1027,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.781946+0000","last_change":"2024-09-12T17:10:36.393717+0000","last_active":"2024-09-12T18:36:01.781946+0000","last_peered":"2024-09-12T18:36:01.781946+0000","last_clean":"2024-09-12T18:36:01.781946+0000","last_became_active":"2024-09-12T17:10:36.392271+0000","last_became_peered":"2024-09-12T17:10:36.392271+0000","last_unstale":"2024-09-12T18:36:01.781946+0000","last_undegraded":"2024-09-12T18:36:01.781946+0000","last_fullsized":"2024-09-12T18:36:01.781946+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:38.244171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45147,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":615,"num_read_kb":1214,"num_write":468,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.096343+0000","last_change":"2024-09-12T18:36:24.096343+0000","last_active":"2024-09-12T18:36:24.096343+0000","last_peered":"2024-09-12T18:36:24.096343+0000","last_clean":"2024-09-12T18:36:24.096343+0000","last_became_active":"2024-09-12T17:10:38.398743+0000","last_became_peered":"2024-09-12T17:10:38.398743+0000","last_unstale":"2024-09-12T18:36:24.096343+0000","last_undegraded":"2024-09-12T18:36:24.096343+0000","last_fullsized":"2024-09-12T18:36:24.096343+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:24.096160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:24.096160+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.096160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:15:10.883351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'104","reported_seq":614,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.655927+0000","last_change":"2024-09-12T17:10:40.411608+0000","last_active":"2024-09-12T18:34:01.655927+0000","last_peered":"2024-09-12T18:34:01.655927+0000","last_clean":"2024-09-12T18:34:01.655927+0000","last_became_active":"2024-09-12T17:10:40.410710+0000","last_became_peered":"2024-09-12T17:10:40.410710+0000","last_unstale":"2024-09-12T18:34:01.655927+0000","last_undegraded":"2024-09-12T18:34:01.655927+0000","last_fullsized":"2024-09-12T18:34:01.655927+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":239,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'450","reported_seq":2013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.163747+0000","last_change":"2024-09-12T18:36:13.163599+0000","last_active":"2024-09-12T18:36:13.163747+0000","last_peered":"2024-09-12T18:36:13.163747+0000","last_clean":"2024-09-12T18:36:13.163747+0000","last_became_active":"2024-09-12T17:10:32.366571+0000","last_became_peered":"2024-09-12T17:10:32.366571+0000","last_unstale":"2024-09-12T18:36:13.163747+0000","last_undegraded":"2024-09-12T18:36:13.163747+0000","last_fullsized":"2024-09-12T18:36:13.163747+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'450","last_scrub_stamp":"2024-09-12T18:36:13.163413+0000","last_deep_scrub":"268'450","last_deep_scrub_stamp":"2024-09-12T18:36:13.163413+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.163413+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:42.296285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2259,"num_read_kb":2146,"num_write":500,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.003372+0000","last_change":"2024-09-12T18:36:09.003372+0000","last_active":"2024-09-12T18:36:09.003372+0000","last_peered":"2024-09-12T18:36:09.003372+0000","last_clean":"2024-09-12T18:36:09.003372+0000","last_became_active":"2024-09-12T17:10:13.024652+0000","last_became_peered":"2024-09-12T17:10:13.024652+0000","last_unstale":"2024-09-12T18:36:09.003372+0000","last_undegraded":"2024-09-12T18:36:09.003372+0000","last_fullsized":"2024-09-12T18:36:09.003372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-12T18:36:09.003177+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-12T18:36:09.003177+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.003177+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:13.554583+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.977110+0000","last_change":"2024-09-12T18:36:08.977110+0000","last_active":"2024-09-12T18:36:08.977110+0000","last_peered":"2024-09-12T18:36:08.977110+0000","last_clean":"2024-09-12T18:36:08.977110+0000","last_became_active":"2024-09-12T17:10:18.073547+0000","last_became_peered":"2024-09-12T17:10:18.073547+0000","last_unstale":"2024-09-12T18:36:08.977110+0000","last_undegraded":"2024-09-12T18:36:08.977110+0000","last_fullsized":"2024-09-12T18:36:08.977110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:08.976931+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:08.976931+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.976931+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:40.637153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010552039999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'325","reported_seq":1042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.967233+0000","last_change":"2024-09-12T18:36:07.967233+0000","last_active":"2024-09-12T18:36:07.967233+0000","last_peered":"2024-09-12T18:36:07.967233+0000","last_clean":"2024-09-12T18:36:07.967233+0000","last_became_active":"2024-09-12T17:10:30.395026+0000","last_became_peered":"2024-09-12T17:10:30.395026+0000","last_unstale":"2024-09-12T18:36:07.967233+0000","last_undegraded":"2024-09-12T18:36:07.967233+0000","last_fullsized":"2024-09-12T18:36:07.967233+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'325","last_scrub_stamp":"2024-09-12T18:36:07.967135+0000","last_deep_scrub":"268'325","last_deep_scrub_stamp":"2024-09-12T18:36:07.967135+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.967135+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:46.811857+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048618,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":151053,"num_write":1004,"num_write_kb":34461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"268'4","reported_seq":1013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.935798+0000","last_change":"2024-09-12T18:36:24.935798+0000","last_active":"2024-09-12T18:36:24.935798+0000","last_peered":"2024-09-12T18:36:24.935798+0000","last_clean":"2024-09-12T18:36:24.935798+0000","last_became_active":"2024-09-12T17:10:34.363615+0000","last_became_peered":"2024-09-12T17:10:34.363615+0000","last_unstale":"2024-09-12T18:36:24.935798+0000","last_undegraded":"2024-09-12T18:36:24.935798+0000","last_fullsized":"2024-09-12T18:36:24.935798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:24.935619+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:24.935619+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.935619+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:43.313804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":734,"num_read_kb":732,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'753","reported_seq":1483,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.913310+0000","last_change":"2024-09-12T17:10:36.395832+0000","last_active":"2024-09-12T18:36:01.913310+0000","last_peered":"2024-09-12T18:36:01.913310+0000","last_clean":"2024-09-12T18:36:01.913310+0000","last_became_active":"2024-09-12T17:10:36.395060+0000","last_became_peered":"2024-09-12T17:10:36.395060+0000","last_unstale":"2024-09-12T18:36:01.913310+0000","last_undegraded":"2024-09-12T18:36:01.913310+0000","last_fullsized":"2024-09-12T18:36:01.913310+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:34.192269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142312,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1468,"num_read_kb":3324,"num_write":1428,"num_write_kb":1256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.413770+0000","last_change":"2024-09-12T17:10:38.413654+0000","last_active":"2024-09-12T18:33:01.413770+0000","last_peered":"2024-09-12T18:33:01.413770+0000","last_clean":"2024-09-12T18:33:01.413770+0000","last_became_active":"2024-09-12T17:10:38.413042+0000","last_became_peered":"2024-09-12T17:10:38.413042+0000","last_unstale":"2024-09-12T18:33:01.413770+0000","last_undegraded":"2024-09-12T18:33:01.413770+0000","last_fullsized":"2024-09-12T18:33:01.413770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:03.626589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'214","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.891133+0000","last_change":"2024-09-12T17:10:40.416972+0000","last_active":"2024-09-12T18:34:01.891133+0000","last_peered":"2024-09-12T18:34:01.891133+0000","last_clean":"2024-09-12T18:34:01.891133+0000","last_became_active":"2024-09-12T17:10:40.413341+0000","last_became_peered":"2024-09-12T17:10:40.413341+0000","last_unstale":"2024-09-12T18:34:01.891133+0000","last_undegraded":"2024-09-12T18:34:01.891133+0000","last_fullsized":"2024-09-12T18:34:01.891133+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:47.293584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":511,"num_write":461,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'396","reported_seq":1842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.589512+0000","last_change":"2024-09-12T18:36:13.589512+0000","last_active":"2024-09-12T18:36:13.589512+0000","last_peered":"2024-09-12T18:36:13.589512+0000","last_clean":"2024-09-12T18:36:13.589512+0000","last_became_active":"2024-09-12T17:10:32.364798+0000","last_became_peered":"2024-09-12T17:10:32.364798+0000","last_unstale":"2024-09-12T18:36:13.589512+0000","last_undegraded":"2024-09-12T18:36:13.589512+0000","last_fullsized":"2024-09-12T18:36:13.589512+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'396","last_scrub_stamp":"2024-09-12T18:36:13.589303+0000","last_deep_scrub":"268'396","last_deep_scrub_stamp":"2024-09-12T18:36:13.589303+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.589303+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:17.430737+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2015,"num_read_kb":1907,"num_write":451,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":551,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.017052+0000","last_change":"2024-09-12T18:36:11.017052+0000","last_active":"2024-09-12T18:36:11.017052+0000","last_peered":"2024-09-12T18:36:11.017052+0000","last_clean":"2024-09-12T18:36:11.017052+0000","last_became_active":"2024-09-12T17:10:18.073016+0000","last_became_peered":"2024-09-12T17:10:18.073016+0000","last_unstale":"2024-09-12T18:36:11.017052+0000","last_undegraded":"2024-09-12T18:36:11.017052+0000","last_fullsized":"2024-09-12T18:36:11.017052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:11.016844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:11.016844+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.016844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:43.713164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098613699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'345","reported_seq":1030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:05.576045+0000","last_change":"2024-09-12T18:36:05.576045+0000","last_active":"2024-09-12T18:36:05.576045+0000","last_peered":"2024-09-12T18:36:05.576045+0000","last_clean":"2024-09-12T18:36:05.576045+0000","last_became_active":"2024-09-12T17:10:30.355237+0000","last_became_peered":"2024-09-12T17:10:30.355237+0000","last_unstale":"2024-09-12T18:36:05.576045+0000","last_undegraded":"2024-09-12T18:36:05.576045+0000","last_fullsized":"2024-09-12T18:36:05.576045+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'345","last_scrub_stamp":"2024-09-12T18:36:05.575700+0000","last_deep_scrub":"268'345","last_deep_scrub_stamp":"2024-09-12T18:36:05.575700+0000","last_clean_scrub_stamp":"2024-09-12T18:36:05.575700+0000","objects_scrubbed":8,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:37.874770+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262274,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":552,"num_read_kb":28524,"num_write":1156,"num_write_kb":35154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.409737+0000","last_change":"2024-09-12T17:10:34.368316+0000","last_active":"2024-09-12T18:32:56.409737+0000","last_peered":"2024-09-12T18:32:56.409737+0000","last_clean":"2024-09-12T18:32:56.409737+0000","last_became_active":"2024-09-12T17:10:34.366826+0000","last_became_peered":"2024-09-12T17:10:34.366826+0000","last_unstale":"2024-09-12T18:32:56.409737+0000","last_undegraded":"2024-09-12T18:32:56.409737+0000","last_fullsized":"2024-09-12T18:32:56.409737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:41.209887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1386","reported_seq":3376,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.842224+0000","last_change":"2024-09-12T17:10:36.399027+0000","last_active":"2024-09-12T18:36:01.842224+0000","last_peered":"2024-09-12T18:36:01.842224+0000","last_clean":"2024-09-12T18:36:01.842224+0000","last_became_active":"2024-09-12T17:10:36.398283+0000","last_became_peered":"2024-09-12T17:10:36.398283+0000","last_unstale":"2024-09-12T18:36:01.842224+0000","last_undegraded":"2024-09-12T18:36:01.842224+0000","last_fullsized":"2024-09-12T18:36:01.842224+0000","mapping_epoch":31,"log_start":"268'1300","ondisk_log_start":"268'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":1300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:36.074991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157765,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2194,"num_read_kb":4204,"num_write":1286,"num_write_kb":1080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.394022+0000","last_change":"2024-09-12T17:10:38.407976+0000","last_active":"2024-09-12T18:32:21.394022+0000","last_peered":"2024-09-12T18:32:21.394022+0000","last_clean":"2024-09-12T18:32:21.394022+0000","last_became_active":"2024-09-12T17:10:38.407002+0000","last_became_peered":"2024-09-12T17:10:38.407002+0000","last_unstale":"2024-09-12T18:32:21.394022+0000","last_undegraded":"2024-09-12T18:32:21.394022+0000","last_fullsized":"2024-09-12T18:32:21.394022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:39.734129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'125","reported_seq":641,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.101124+0000","last_change":"2024-09-12T17:10:40.771071+0000","last_active":"2024-09-12T18:34:02.101124+0000","last_peered":"2024-09-12T18:34:02.101124+0000","last_clean":"2024-09-12T18:34:02.101124+0000","last_became_active":"2024-09-12T17:10:40.770362+0000","last_became_peered":"2024-09-12T17:10:40.770362+0000","last_unstale":"2024-09-12T18:34:02.101124+0000","last_undegraded":"2024-09-12T18:34:02.101124+0000","last_fullsized":"2024-09-12T18:34:02.101124+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:15.034623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":150,"num_write":307,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'427","reported_seq":2046,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.925833+0000","last_change":"2024-09-12T18:36:17.925833+0000","last_active":"2024-09-12T18:36:17.925833+0000","last_peered":"2024-09-12T18:36:17.925833+0000","last_clean":"2024-09-12T18:36:17.925833+0000","last_became_active":"2024-09-12T17:10:32.361184+0000","last_became_peered":"2024-09-12T17:10:32.361184+0000","last_unstale":"2024-09-12T18:36:17.925833+0000","last_undegraded":"2024-09-12T18:36:17.925833+0000","last_fullsized":"2024-09-12T18:36:17.925833+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'427","last_scrub_stamp":"2024-09-12T18:36:17.925631+0000","last_deep_scrub":"268'427","last_deep_scrub_stamp":"2024-09-12T18:36:17.925631+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.925631+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:12.940790+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2375,"num_read_kb":2259,"num_write":493,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":555,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.366031+0000","last_change":"2024-09-12T18:36:08.366031+0000","last_active":"2024-09-12T18:36:08.366031+0000","last_peered":"2024-09-12T18:36:08.366031+0000","last_clean":"2024-09-12T18:36:08.366031+0000","last_became_active":"2024-09-12T17:10:18.210168+0000","last_became_peered":"2024-09-12T17:10:18.210168+0000","last_unstale":"2024-09-12T18:36:08.366031+0000","last_undegraded":"2024-09-12T18:36:08.366031+0000","last_fullsized":"2024-09-12T18:36:08.366031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:08.365841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:08.365841+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.365841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:46.140147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001219171,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'335","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:05.823972+0000","last_change":"2024-09-12T18:36:05.823972+0000","last_active":"2024-09-12T18:36:05.823972+0000","last_peered":"2024-09-12T18:36:05.823972+0000","last_clean":"2024-09-12T18:36:05.823972+0000","last_became_active":"2024-09-12T17:10:30.405641+0000","last_became_peered":"2024-09-12T17:10:30.405641+0000","last_unstale":"2024-09-12T18:36:05.823972+0000","last_undegraded":"2024-09-12T18:36:05.823972+0000","last_fullsized":"2024-09-12T18:36:05.823972+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'335","last_scrub_stamp":"2024-09-12T18:36:05.823746+0000","last_deep_scrub":"268'335","last_deep_scrub_stamp":"2024-09-12T18:36:05.823746+0000","last_clean_scrub_stamp":"2024-09-12T18:36:05.823746+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:01.852500+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":435,"num_read_kb":15806,"num_write":1012,"num_write_kb":36297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.440485+0000","last_change":"2024-09-12T18:36:18.440485+0000","last_active":"2024-09-12T18:36:18.440485+0000","last_peered":"2024-09-12T18:36:18.440485+0000","last_clean":"2024-09-12T18:36:18.440485+0000","last_became_active":"2024-09-12T17:10:34.367870+0000","last_became_peered":"2024-09-12T17:10:34.367870+0000","last_unstale":"2024-09-12T18:36:18.440485+0000","last_undegraded":"2024-09-12T18:36:18.440485+0000","last_fullsized":"2024-09-12T18:36:18.440485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:18.440311+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:18.440311+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.440311+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:10.134048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'345","reported_seq":1938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.987736+0000","last_change":"2024-09-12T17:10:36.923069+0000","last_active":"2024-09-12T18:35:21.987736+0000","last_peered":"2024-09-12T18:35:21.987736+0000","last_clean":"2024-09-12T18:35:21.987736+0000","last_became_active":"2024-09-12T17:10:36.922321+0000","last_became_peered":"2024-09-12T17:10:36.922321+0000","last_unstale":"2024-09-12T18:35:21.987736+0000","last_undegraded":"2024-09-12T18:35:21.987736+0000","last_fullsized":"2024-09-12T18:35:21.987736+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":291,"num_read_kb":281,"num_write":273,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.425982+0000","last_change":"2024-09-12T17:10:38.415538+0000","last_active":"2024-09-12T18:34:01.425982+0000","last_peered":"2024-09-12T18:34:01.425982+0000","last_clean":"2024-09-12T18:34:01.425982+0000","last_became_active":"2024-09-12T17:10:38.413459+0000","last_became_peered":"2024-09-12T17:10:38.413459+0000","last_unstale":"2024-09-12T18:34:01.425982+0000","last_undegraded":"2024-09-12T18:34:01.425982+0000","last_fullsized":"2024-09-12T18:34:01.425982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'231","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.367458+0000","last_change":"2024-09-12T17:10:40.415650+0000","last_active":"2024-09-12T18:34:02.367458+0000","last_peered":"2024-09-12T18:34:02.367458+0000","last_clean":"2024-09-12T18:34:02.367458+0000","last_became_active":"2024-09-12T17:10:40.414712+0000","last_became_peered":"2024-09-12T17:10:40.414712+0000","last_unstale":"2024-09-12T18:34:02.367458+0000","last_undegraded":"2024-09-12T18:34:02.367458+0000","last_fullsized":"2024-09-12T18:34:02.367458+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":496,"num_read_kb":517,"num_write":496,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'463","reported_seq":1990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.909274+0000","last_change":"2024-09-12T18:36:12.909274+0000","last_active":"2024-09-12T18:36:12.909274+0000","last_peered":"2024-09-12T18:36:12.909274+0000","last_clean":"2024-09-12T18:36:12.909274+0000","last_became_active":"2024-09-12T17:10:32.360853+0000","last_became_peered":"2024-09-12T17:10:32.360853+0000","last_unstale":"2024-09-12T18:36:12.909274+0000","last_undegraded":"2024-09-12T18:36:12.909274+0000","last_fullsized":"2024-09-12T18:36:12.909274+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'463","last_scrub_stamp":"2024-09-12T18:36:12.909073+0000","last_deep_scrub":"268'463","last_deep_scrub_stamp":"2024-09-12T18:36:12.909073+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.909073+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:48.700492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2461,"num_read_kb":2304,"num_write":540,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":551,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.993172+0000","last_change":"2024-09-12T18:36:07.993172+0000","last_active":"2024-09-12T18:36:07.993172+0000","last_peered":"2024-09-12T18:36:07.993172+0000","last_clean":"2024-09-12T18:36:07.993172+0000","last_became_active":"2024-09-12T17:10:18.072719+0000","last_became_peered":"2024-09-12T17:10:18.072719+0000","last_unstale":"2024-09-12T18:36:07.993172+0000","last_undegraded":"2024-09-12T18:36:07.993172+0000","last_fullsized":"2024-09-12T18:36:07.993172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T18:36:07.992994+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T18:36:07.992994+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.992994+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:43.943090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022239349999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'390","reported_seq":1108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.978577+0000","last_change":"2024-09-12T18:36:09.978577+0000","last_active":"2024-09-12T18:36:09.978577+0000","last_peered":"2024-09-12T18:36:09.978577+0000","last_clean":"2024-09-12T18:36:09.978577+0000","last_became_active":"2024-09-12T17:10:30.354850+0000","last_became_peered":"2024-09-12T17:10:30.354850+0000","last_unstale":"2024-09-12T18:36:09.978577+0000","last_undegraded":"2024-09-12T18:36:09.978577+0000","last_fullsized":"2024-09-12T18:36:09.978577+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'390","last_scrub_stamp":"2024-09-12T18:36:09.978364+0000","last_deep_scrub":"268'390","last_deep_scrub_stamp":"2024-09-12T18:36:09.978364+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.978364+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:24.725033+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194319,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":615,"num_read_kb":44146,"num_write":1329,"num_write_kb":42918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.628005+0000","last_change":"2024-09-12T18:36:24.628005+0000","last_active":"2024-09-12T18:36:24.628005+0000","last_peered":"2024-09-12T18:36:24.628005+0000","last_clean":"2024-09-12T18:36:24.628005+0000","last_became_active":"2024-09-12T17:10:34.358926+0000","last_became_peered":"2024-09-12T17:10:34.358926+0000","last_unstale":"2024-09-12T18:36:24.628005+0000","last_undegraded":"2024-09-12T18:36:24.628005+0000","last_fullsized":"2024-09-12T18:36:24.628005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:24.627810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:24.627810+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.627810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:40.687387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'171","reported_seq":755,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:09.437593+0000","last_change":"2024-09-12T17:10:36.396445+0000","last_active":"2024-09-12T18:35:09.437593+0000","last_peered":"2024-09-12T18:35:09.437593+0000","last_clean":"2024-09-12T18:35:09.437593+0000","last_became_active":"2024-09-12T17:10:36.395658+0000","last_became_peered":"2024-09-12T17:10:36.395658+0000","last_unstale":"2024-09-12T18:35:09.437593+0000","last_undegraded":"2024-09-12T18:35:09.437593+0000","last_fullsized":"2024-09-12T18:35:09.437593+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:53.937530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":215,"num_read_kb":209,"num_write":154,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.111044+0000","last_change":"2024-09-12T18:36:21.111044+0000","last_active":"2024-09-12T18:36:21.111044+0000","last_peered":"2024-09-12T18:36:21.111044+0000","last_clean":"2024-09-12T18:36:21.111044+0000","last_became_active":"2024-09-12T17:10:38.414045+0000","last_became_peered":"2024-09-12T17:10:38.414045+0000","last_unstale":"2024-09-12T18:36:21.111044+0000","last_undegraded":"2024-09-12T18:36:21.111044+0000","last_fullsized":"2024-09-12T18:36:21.111044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:21.110869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:21.110869+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.110869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:19.693627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'151","reported_seq":739,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.894081+0000","last_change":"2024-09-12T17:10:40.422450+0000","last_active":"2024-09-12T18:33:10.894081+0000","last_peered":"2024-09-12T18:33:10.894081+0000","last_clean":"2024-09-12T18:33:10.894081+0000","last_became_active":"2024-09-12T17:10:40.420995+0000","last_became_peered":"2024-09-12T17:10:40.420995+0000","last_unstale":"2024-09-12T18:33:10.894081+0000","last_undegraded":"2024-09-12T18:33:10.894081+0000","last_fullsized":"2024-09-12T18:33:10.894081+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:49.058635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":383,"num_read_kb":354,"num_write":368,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'864","reported_seq":2550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.911046+0000","last_change":"2024-09-12T18:36:13.911046+0000","last_active":"2024-09-12T18:36:13.911046+0000","last_peered":"2024-09-12T18:36:13.911046+0000","last_clean":"2024-09-12T18:36:13.911046+0000","last_became_active":"2024-09-12T17:10:32.361696+0000","last_became_peered":"2024-09-12T17:10:32.361696+0000","last_unstale":"2024-09-12T18:36:13.911046+0000","last_undegraded":"2024-09-12T18:36:13.911046+0000","last_fullsized":"2024-09-12T18:36:13.911046+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'864","last_scrub_stamp":"2024-09-12T18:36:13.910873+0000","last_deep_scrub":"268'864","last_deep_scrub_stamp":"2024-09-12T18:36:13.910873+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.910873+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:05.088162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4191,"num_read_kb":3806,"num_write":1162,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'312","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.944399+0000","last_change":"2024-09-12T18:36:09.944245+0000","last_active":"2024-09-12T18:36:09.944399+0000","last_peered":"2024-09-12T18:36:09.944399+0000","last_clean":"2024-09-12T18:36:09.944399+0000","last_became_active":"2024-09-12T17:10:30.354730+0000","last_became_peered":"2024-09-12T17:10:30.354730+0000","last_unstale":"2024-09-12T18:36:09.944399+0000","last_undegraded":"2024-09-12T18:36:09.944399+0000","last_fullsized":"2024-09-12T18:36:09.944399+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'312","last_scrub_stamp":"2024-09-12T18:36:09.944018+0000","last_deep_scrub":"268'312","last_deep_scrub_stamp":"2024-09-12T18:36:09.944018+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.944018+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:20.773386+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":12992,"num_write":926,"num_write_kb":30670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":551,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.814786+0000","last_change":"2024-09-12T18:36:06.814786+0000","last_active":"2024-09-12T18:36:06.814786+0000","last_peered":"2024-09-12T18:36:06.814786+0000","last_clean":"2024-09-12T18:36:06.814786+0000","last_became_active":"2024-09-12T17:10:18.209658+0000","last_became_peered":"2024-09-12T17:10:18.209658+0000","last_unstale":"2024-09-12T18:36:06.814786+0000","last_undegraded":"2024-09-12T18:36:06.814786+0000","last_fullsized":"2024-09-12T18:36:06.814786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:06.814685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:06.814685+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.814685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:44.195873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010531659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.424736+0000","last_change":"2024-09-12T17:10:34.362549+0000","last_active":"2024-09-12T18:33:56.424736+0000","last_peered":"2024-09-12T18:33:56.424736+0000","last_clean":"2024-09-12T18:33:56.424736+0000","last_became_active":"2024-09-12T17:10:34.361845+0000","last_became_peered":"2024-09-12T17:10:34.361845+0000","last_unstale":"2024-09-12T18:33:56.424736+0000","last_undegraded":"2024-09-12T18:33:56.424736+0000","last_fullsized":"2024-09-12T18:33:56.424736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:05.948451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'678","reported_seq":1390,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.438251+0000","last_change":"2024-09-12T17:10:36.400065+0000","last_active":"2024-09-12T18:36:01.438251+0000","last_peered":"2024-09-12T18:36:01.438251+0000","last_clean":"2024-09-12T18:36:01.438251+0000","last_became_active":"2024-09-12T17:10:36.398917+0000","last_became_peered":"2024-09-12T17:10:36.398917+0000","last_unstale":"2024-09-12T18:36:01.438251+0000","last_undegraded":"2024-09-12T18:36:01.438251+0000","last_fullsized":"2024-09-12T18:36:01.438251+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:13.596681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100883,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1833,"num_read_kb":3243,"num_write":2400,"num_write_kb":2201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.606350+0000","last_change":"2024-09-12T17:10:38.401627+0000","last_active":"2024-09-12T18:34:00.606350+0000","last_peered":"2024-09-12T18:34:00.606350+0000","last_clean":"2024-09-12T18:34:00.606350+0000","last_became_active":"2024-09-12T17:10:38.400868+0000","last_became_peered":"2024-09-12T17:10:38.400868+0000","last_unstale":"2024-09-12T18:34:00.606350+0000","last_undegraded":"2024-09-12T18:34:00.606350+0000","last_fullsized":"2024-09-12T18:34:00.606350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:50.604824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'135","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.424867+0000","last_change":"2024-09-12T17:10:40.774323+0000","last_active":"2024-09-12T18:33:56.424867+0000","last_peered":"2024-09-12T18:33:56.424867+0000","last_clean":"2024-09-12T18:33:56.424867+0000","last_became_active":"2024-09-12T17:10:40.771185+0000","last_became_peered":"2024-09-12T17:10:40.771185+0000","last_unstale":"2024-09-12T18:33:56.424867+0000","last_undegraded":"2024-09-12T18:33:56.424867+0000","last_fullsized":"2024-09-12T18:33:56.424867+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":180,"num_write":328,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'473","reported_seq":2171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.533222+0000","last_change":"2024-09-12T18:36:18.533222+0000","last_active":"2024-09-12T18:36:18.533222+0000","last_peered":"2024-09-12T18:36:18.533222+0000","last_clean":"2024-09-12T18:36:18.533222+0000","last_became_active":"2024-09-12T17:10:32.354795+0000","last_became_peered":"2024-09-12T17:10:32.354795+0000","last_unstale":"2024-09-12T18:36:18.533222+0000","last_undegraded":"2024-09-12T18:36:18.533222+0000","last_fullsized":"2024-09-12T18:36:18.533222+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'473","last_scrub_stamp":"2024-09-12T18:36:18.532993+0000","last_deep_scrub":"268'473","last_deep_scrub_stamp":"2024-09-12T18:36:18.532993+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.532993+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:56.579630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2620,"num_read_kb":2476,"num_write":562,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'325","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.884981+0000","last_change":"2024-09-12T18:36:09.884981+0000","last_active":"2024-09-12T18:36:09.884981+0000","last_peered":"2024-09-12T18:36:09.884981+0000","last_clean":"2024-09-12T18:36:09.884981+0000","last_became_active":"2024-09-12T17:10:30.405460+0000","last_became_peered":"2024-09-12T17:10:30.405460+0000","last_unstale":"2024-09-12T18:36:09.884981+0000","last_undegraded":"2024-09-12T18:36:09.884981+0000","last_fullsized":"2024-09-12T18:36:09.884981+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'325","last_scrub_stamp":"2024-09-12T18:36:09.884732+0000","last_deep_scrub":"268'325","last_deep_scrub_stamp":"2024-09-12T18:36:09.884732+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.884732+0000","objects_scrubbed":9,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:49.903883+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243060,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":16852,"num_write":1075,"num_write_kb":30938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.983491+0000","last_change":"2024-09-12T18:36:09.983362+0000","last_active":"2024-09-12T18:36:09.983491+0000","last_peered":"2024-09-12T18:36:09.983491+0000","last_clean":"2024-09-12T18:36:09.983491+0000","last_became_active":"2024-09-12T17:10:18.208762+0000","last_became_peered":"2024-09-12T17:10:18.208762+0000","last_unstale":"2024-09-12T18:36:09.983491+0000","last_undegraded":"2024-09-12T18:36:09.983491+0000","last_fullsized":"2024-09-12T18:36:09.983491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:09.983179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:09.983179+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.983179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:05.608460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001091554,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.061203+0000","last_change":"2024-09-12T18:36:19.061203+0000","last_active":"2024-09-12T18:36:19.061203+0000","last_peered":"2024-09-12T18:36:19.061203+0000","last_clean":"2024-09-12T18:36:19.061203+0000","last_became_active":"2024-09-12T17:10:34.355590+0000","last_became_peered":"2024-09-12T17:10:34.355590+0000","last_unstale":"2024-09-12T18:36:19.061203+0000","last_undegraded":"2024-09-12T18:36:19.061203+0000","last_fullsized":"2024-09-12T18:36:19.061203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:19.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:19.060998+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:14.047471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'231","reported_seq":848,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.963144+0000","last_change":"2024-09-12T18:36:23.963144+0000","last_active":"2024-09-12T18:36:23.963144+0000","last_peered":"2024-09-12T18:36:23.963144+0000","last_clean":"2024-09-12T18:36:23.963144+0000","last_became_active":"2024-09-12T17:10:36.921234+0000","last_became_peered":"2024-09-12T17:10:36.921234+0000","last_unstale":"2024-09-12T18:36:23.963144+0000","last_undegraded":"2024-09-12T18:36:23.963144+0000","last_fullsized":"2024-09-12T18:36:23.963144+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'231","last_scrub_stamp":"2024-09-12T18:36:23.962933+0000","last_deep_scrub":"268'231","last_deep_scrub_stamp":"2024-09-12T18:36:23.962933+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.962933+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:00.002043+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":277,"num_write":196,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'792","reported_seq":2947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.364411+0000","last_change":"2024-09-12T17:10:38.396157+0000","last_active":"2024-09-12T18:36:01.364411+0000","last_peered":"2024-09-12T18:36:01.364411+0000","last_clean":"2024-09-12T18:36:01.364411+0000","last_became_active":"2024-09-12T17:10:38.395439+0000","last_became_peered":"2024-09-12T17:10:38.395439+0000","last_unstale":"2024-09-12T18:36:01.364411+0000","last_undegraded":"2024-09-12T18:36:01.364411+0000","last_fullsized":"2024-09-12T18:36:01.364411+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:28.386160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'180","reported_seq":718,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428311+0000","last_change":"2024-09-12T17:10:40.770840+0000","last_active":"2024-09-12T18:34:19.428311+0000","last_peered":"2024-09-12T18:34:19.428311+0000","last_clean":"2024-09-12T18:34:19.428311+0000","last_became_active":"2024-09-12T17:10:40.770042+0000","last_became_peered":"2024-09-12T17:10:40.770042+0000","last_unstale":"2024-09-12T18:34:19.428311+0000","last_undegraded":"2024-09-12T18:34:19.428311+0000","last_fullsized":"2024-09-12T18:34:19.428311+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:24.561136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":293,"num_read_kb":273,"num_write":449,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'902","reported_seq":2644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.834013+0000","last_change":"2024-09-12T18:36:16.834013+0000","last_active":"2024-09-12T18:36:16.834013+0000","last_peered":"2024-09-12T18:36:16.834013+0000","last_clean":"2024-09-12T18:36:16.834013+0000","last_became_active":"2024-09-12T17:10:32.382755+0000","last_became_peered":"2024-09-12T17:10:32.382755+0000","last_unstale":"2024-09-12T18:36:16.834013+0000","last_undegraded":"2024-09-12T18:36:16.834013+0000","last_fullsized":"2024-09-12T18:36:16.834013+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'902","last_scrub_stamp":"2024-09-12T18:36:16.833790+0000","last_deep_scrub":"268'902","last_deep_scrub_stamp":"2024-09-12T18:36:16.833790+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.833790+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:47.335837+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4651,"num_read_kb":4208,"num_write":1244,"num_write_kb":526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4562,"num_omap_keys":18,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'316","reported_seq":955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.947740+0000","last_change":"2024-09-12T18:36:08.947740+0000","last_active":"2024-09-12T18:36:08.947740+0000","last_peered":"2024-09-12T18:36:08.947740+0000","last_clean":"2024-09-12T18:36:08.947740+0000","last_became_active":"2024-09-12T17:10:30.364767+0000","last_became_peered":"2024-09-12T17:10:30.364767+0000","last_unstale":"2024-09-12T18:36:08.947740+0000","last_undegraded":"2024-09-12T18:36:08.947740+0000","last_fullsized":"2024-09-12T18:36:08.947740+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'316","last_scrub_stamp":"2024-09-12T18:36:08.947480+0000","last_deep_scrub":"268'316","last_deep_scrub_stamp":"2024-09-12T18:36:08.947480+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.947480+0000","objects_scrubbed":9,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:50.062268+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":450,"num_read_kb":23959,"num_write":1040,"num_write_kb":32355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":549,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.822491+0000","last_change":"2024-09-12T18:36:07.822491+0000","last_active":"2024-09-12T18:36:07.822491+0000","last_peered":"2024-09-12T18:36:07.822491+0000","last_clean":"2024-09-12T18:36:07.822491+0000","last_became_active":"2024-09-12T17:10:18.073132+0000","last_became_peered":"2024-09-12T17:10:18.073132+0000","last_unstale":"2024-09-12T18:36:07.822491+0000","last_undegraded":"2024-09-12T18:36:07.822491+0000","last_fullsized":"2024-09-12T18:36:07.822491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:07.822365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:07.822365+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.822365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:38.482041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001154721,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.926922+0000","last_change":"2024-09-12T18:36:24.926922+0000","last_active":"2024-09-12T18:36:24.926922+0000","last_peered":"2024-09-12T18:36:24.926922+0000","last_clean":"2024-09-12T18:36:24.926922+0000","last_became_active":"2024-09-12T17:10:34.349093+0000","last_became_peered":"2024-09-12T17:10:34.349093+0000","last_unstale":"2024-09-12T18:36:24.926922+0000","last_undegraded":"2024-09-12T18:36:24.926922+0000","last_fullsized":"2024-09-12T18:36:24.926922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:24.926737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:24.926737+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.926737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:07.858866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'169","reported_seq":749,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:00.606406+0000","last_change":"2024-09-12T17:10:36.391287+0000","last_active":"2024-09-12T18:34:00.606406+0000","last_peered":"2024-09-12T18:34:00.606406+0000","last_clean":"2024-09-12T18:34:00.606406+0000","last_became_active":"2024-09-12T17:10:36.390439+0000","last_became_peered":"2024-09-12T17:10:36.390439+0000","last_unstale":"2024-09-12T18:34:00.606406+0000","last_undegraded":"2024-09-12T18:34:00.606406+0000","last_fullsized":"2024-09-12T18:34:00.606406+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:24.707986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":183,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'808","reported_seq":2860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.921175+0000","last_change":"2024-09-12T17:10:38.394233+0000","last_active":"2024-09-12T18:36:01.921175+0000","last_peered":"2024-09-12T18:36:01.921175+0000","last_clean":"2024-09-12T18:36:01.921175+0000","last_became_active":"2024-09-12T17:10:38.393426+0000","last_became_peered":"2024-09-12T17:10:38.393426+0000","last_unstale":"2024-09-12T18:36:01.921175+0000","last_undegraded":"2024-09-12T18:36:01.921175+0000","last_fullsized":"2024-09-12T18:36:01.921175+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:37.818377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'254","reported_seq":798,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.424768+0000","last_change":"2024-09-12T17:10:40.429154+0000","last_active":"2024-09-12T18:33:56.424768+0000","last_peered":"2024-09-12T18:33:56.424768+0000","last_clean":"2024-09-12T18:33:56.424768+0000","last_became_active":"2024-09-12T17:10:40.423742+0000","last_became_peered":"2024-09-12T17:10:40.423742+0000","last_unstale":"2024-09-12T18:33:56.424768+0000","last_undegraded":"2024-09-12T18:33:56.424768+0000","last_fullsized":"2024-09-12T18:33:56.424768+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":353,"num_read_kb":347,"num_write":533,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'875","reported_seq":2677,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.961775+0000","last_change":"2024-09-12T18:36:10.961775+0000","last_active":"2024-09-12T18:36:10.961775+0000","last_peered":"2024-09-12T18:36:10.961775+0000","last_clean":"2024-09-12T18:36:10.961775+0000","last_became_active":"2024-09-12T17:10:32.368217+0000","last_became_peered":"2024-09-12T17:10:32.368217+0000","last_unstale":"2024-09-12T18:36:10.961775+0000","last_undegraded":"2024-09-12T18:36:10.961775+0000","last_fullsized":"2024-09-12T18:36:10.961775+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'875","last_scrub_stamp":"2024-09-12T18:36:10.961561+0000","last_deep_scrub":"268'875","last_deep_scrub_stamp":"2024-09-12T18:36:10.961561+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.961561+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:02.933031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4306,"num_read_kb":3903,"num_write":1124,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1533,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'367","reported_seq":1080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.599903+0000","last_change":"2024-09-12T18:36:06.599903+0000","last_active":"2024-09-12T18:36:06.599903+0000","last_peered":"2024-09-12T18:36:06.599903+0000","last_clean":"2024-09-12T18:36:06.599903+0000","last_became_active":"2024-09-12T17:10:30.361736+0000","last_became_peered":"2024-09-12T17:10:30.361736+0000","last_unstale":"2024-09-12T18:36:06.599903+0000","last_undegraded":"2024-09-12T18:36:06.599903+0000","last_fullsized":"2024-09-12T18:36:06.599903+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'367","last_scrub_stamp":"2024-09-12T18:36:06.599810+0000","last_deep_scrub":"268'367","last_deep_scrub_stamp":"2024-09-12T18:36:06.599810+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.599810+0000","objects_scrubbed":7,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:40.095034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5736431,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":617,"num_read_kb":21637,"num_write":1193,"num_write_kb":30222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":548,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.128765+0000","last_change":"2024-09-12T18:36:08.128765+0000","last_active":"2024-09-12T18:36:08.128765+0000","last_peered":"2024-09-12T18:36:08.128765+0000","last_clean":"2024-09-12T18:36:08.128765+0000","last_became_active":"2024-09-12T17:10:18.074669+0000","last_became_peered":"2024-09-12T17:10:18.074669+0000","last_unstale":"2024-09-12T18:36:08.128765+0000","last_undegraded":"2024-09-12T18:36:08.128765+0000","last_fullsized":"2024-09-12T18:36:08.128765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:08.128568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:08.128568+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.128568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:13.278072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:54.408665+0000","last_change":"2024-09-12T17:10:34.358853+0000","last_active":"2024-09-12T18:32:54.408665+0000","last_peered":"2024-09-12T18:32:54.408665+0000","last_clean":"2024-09-12T18:32:54.408665+0000","last_became_active":"2024-09-12T17:10:34.358250+0000","last_became_peered":"2024-09-12T17:10:34.358250+0000","last_unstale":"2024-09-12T18:32:54.408665+0000","last_undegraded":"2024-09-12T18:32:54.408665+0000","last_fullsized":"2024-09-12T18:32:54.408665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:35.137706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'744","reported_seq":1504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.638837+0000","last_change":"2024-09-12T17:10:36.921037+0000","last_active":"2024-09-12T18:36:01.638837+0000","last_peered":"2024-09-12T18:36:01.638837+0000","last_clean":"2024-09-12T18:36:01.638837+0000","last_became_active":"2024-09-12T17:10:36.920239+0000","last_became_peered":"2024-09-12T17:10:36.920239+0000","last_unstale":"2024-09-12T18:36:01.638837+0000","last_undegraded":"2024-09-12T18:36:01.638837+0000","last_fullsized":"2024-09-12T18:36:01.638837+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:47.311658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144312,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1298,"num_read_kb":3045,"num_write":1034,"num_write_kb":815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.422907+0000","last_change":"2024-09-12T17:10:38.392174+0000","last_active":"2024-09-12T18:33:59.422907+0000","last_peered":"2024-09-12T18:33:59.422907+0000","last_clean":"2024-09-12T18:33:59.422907+0000","last_became_active":"2024-09-12T17:10:38.391661+0000","last_became_peered":"2024-09-12T17:10:38.391661+0000","last_unstale":"2024-09-12T18:33:59.422907+0000","last_undegraded":"2024-09-12T18:33:59.422907+0000","last_fullsized":"2024-09-12T18:33:59.422907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:44.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'98","reported_seq":608,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.573888+0000","last_change":"2024-09-12T17:10:40.435786+0000","last_active":"2024-09-12T18:33:56.573888+0000","last_peered":"2024-09-12T18:33:56.573888+0000","last_clean":"2024-09-12T18:33:56.573888+0000","last_became_active":"2024-09-12T17:10:40.435114+0000","last_became_peered":"2024-09-12T17:10:40.435114+0000","last_unstale":"2024-09-12T18:33:56.573888+0000","last_undegraded":"2024-09-12T18:33:56.573888+0000","last_fullsized":"2024-09-12T18:33:56.573888+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":238,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'127","reported_seq":724,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.277973+0000","last_change":"2024-09-12T17:10:40.422967+0000","last_active":"2024-09-12T18:34:02.277973+0000","last_peered":"2024-09-12T18:34:02.277973+0000","last_clean":"2024-09-12T18:34:02.277973+0000","last_became_active":"2024-09-12T17:10:40.417972+0000","last_became_peered":"2024-09-12T17:10:40.417972+0000","last_unstale":"2024-09-12T18:34:02.277973+0000","last_undegraded":"2024-09-12T18:34:02.277973+0000","last_fullsized":"2024-09-12T18:34:02.277973+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":319,"num_read_kb":297,"num_write":314,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'794","reported_seq":2323,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.019127+0000","last_change":"2024-09-12T18:36:15.019127+0000","last_active":"2024-09-12T18:36:15.019127+0000","last_peered":"2024-09-12T18:36:15.019127+0000","last_clean":"2024-09-12T18:36:15.019127+0000","last_became_active":"2024-09-12T17:10:32.368063+0000","last_became_peered":"2024-09-12T17:10:32.368063+0000","last_unstale":"2024-09-12T18:36:15.019127+0000","last_undegraded":"2024-09-12T18:36:15.019127+0000","last_fullsized":"2024-09-12T18:36:15.019127+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'794","last_scrub_stamp":"2024-09-12T18:36:15.018950+0000","last_deep_scrub":"268'794","last_deep_scrub_stamp":"2024-09-12T18:36:15.018950+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.018950+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:15.614937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3740,"num_read_kb":3358,"num_write":1050,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'385","reported_seq":1051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.014293+0000","last_change":"2024-09-12T18:36:09.014293+0000","last_active":"2024-09-12T18:36:09.014293+0000","last_peered":"2024-09-12T18:36:09.014293+0000","last_clean":"2024-09-12T18:36:09.014293+0000","last_became_active":"2024-09-12T17:10:30.394117+0000","last_became_peered":"2024-09-12T17:10:30.394117+0000","last_unstale":"2024-09-12T18:36:09.014293+0000","last_undegraded":"2024-09-12T18:36:09.014293+0000","last_fullsized":"2024-09-12T18:36:09.014293+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-12T18:36:09.014036+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-12T18:36:09.014036+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.014036+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:20.531488+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330018,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":538,"num_read_kb":2122,"num_write":1160,"num_write_kb":20675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.975839+0000","last_change":"2024-09-12T18:36:22.975839+0000","last_active":"2024-09-12T18:36:22.975839+0000","last_peered":"2024-09-12T18:36:22.975839+0000","last_clean":"2024-09-12T18:36:22.975839+0000","last_became_active":"2024-09-12T17:10:34.359923+0000","last_became_peered":"2024-09-12T17:10:34.359923+0000","last_unstale":"2024-09-12T18:36:22.975839+0000","last_undegraded":"2024-09-12T18:36:22.975839+0000","last_fullsized":"2024-09-12T18:36:22.975839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:22.975695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:22.975695+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.975695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:10.101003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'303","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.376919+0000","last_change":"2024-09-12T17:10:36.395453+0000","last_active":"2024-09-12T18:35:59.376919+0000","last_peered":"2024-09-12T18:35:59.376919+0000","last_clean":"2024-09-12T18:35:59.376919+0000","last_became_active":"2024-09-12T17:10:36.394731+0000","last_became_peered":"2024-09-12T17:10:36.394731+0000","last_unstale":"2024-09-12T18:35:59.376919+0000","last_undegraded":"2024-09-12T18:35:59.376919+0000","last_fullsized":"2024-09-12T18:35:59.376919+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:03.802691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56497,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":1193,"num_write":404,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:19.399496+0000","last_change":"2024-09-12T17:10:38.393630+0000","last_active":"2024-09-12T18:32:19.399496+0000","last_peered":"2024-09-12T18:32:19.399496+0000","last_clean":"2024-09-12T18:32:19.399496+0000","last_became_active":"2024-09-12T17:10:38.393112+0000","last_became_peered":"2024-09-12T17:10:38.393112+0000","last_unstale":"2024-09-12T18:32:19.399496+0000","last_undegraded":"2024-09-12T18:32:19.399496+0000","last_fullsized":"2024-09-12T18:32:19.399496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:11.857461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'117","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.411553+0000","last_change":"2024-09-12T17:10:40.430432+0000","last_active":"2024-09-12T18:33:04.411553+0000","last_peered":"2024-09-12T18:33:04.411553+0000","last_clean":"2024-09-12T18:33:04.411553+0000","last_became_active":"2024-09-12T17:10:40.429366+0000","last_became_peered":"2024-09-12T17:10:40.429366+0000","last_unstale":"2024-09-12T18:33:04.411553+0000","last_undegraded":"2024-09-12T18:33:04.411553+0000","last_fullsized":"2024-09-12T18:33:04.411553+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:03.623489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":137,"num_write":282,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'500","reported_seq":2108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.917070+0000","last_change":"2024-09-12T18:36:15.917070+0000","last_active":"2024-09-12T18:36:15.917070+0000","last_peered":"2024-09-12T18:36:15.917070+0000","last_clean":"2024-09-12T18:36:15.917070+0000","last_became_active":"2024-09-12T17:10:32.364033+0000","last_became_peered":"2024-09-12T17:10:32.364033+0000","last_unstale":"2024-09-12T18:36:15.917070+0000","last_undegraded":"2024-09-12T18:36:15.917070+0000","last_fullsized":"2024-09-12T18:36:15.917070+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'500","last_scrub_stamp":"2024-09-12T18:36:15.916790+0000","last_deep_scrub":"268'500","last_deep_scrub_stamp":"2024-09-12T18:36:15.916790+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.916790+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:19.758173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2497,"num_read_kb":2341,"num_write":588,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'287","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.956199+0000","last_change":"2024-09-12T18:36:15.956199+0000","last_active":"2024-09-12T18:36:15.956199+0000","last_peered":"2024-09-12T18:36:15.956199+0000","last_clean":"2024-09-12T18:36:15.956199+0000","last_became_active":"2024-09-12T17:10:30.405137+0000","last_became_peered":"2024-09-12T17:10:30.405137+0000","last_unstale":"2024-09-12T18:36:15.956199+0000","last_undegraded":"2024-09-12T18:36:15.956199+0000","last_fullsized":"2024-09-12T18:36:15.956199+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'287","last_scrub_stamp":"2024-09-12T18:36:15.955868+0000","last_deep_scrub":"268'287","last_deep_scrub_stamp":"2024-09-12T18:36:15.955868+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.955868+0000","objects_scrubbed":9,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:38.210429+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728666,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":586,"num_read_kb":36707,"num_write":949,"num_write_kb":52863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:14.398461+0000","last_change":"2024-09-12T17:10:34.356731+0000","last_active":"2024-09-12T18:32:14.398461+0000","last_peered":"2024-09-12T18:32:14.398461+0000","last_clean":"2024-09-12T18:32:14.398461+0000","last_became_active":"2024-09-12T17:10:34.355684+0000","last_became_peered":"2024-09-12T17:10:34.355684+0000","last_unstale":"2024-09-12T18:32:14.398461+0000","last_undegraded":"2024-09-12T18:32:14.398461+0000","last_fullsized":"2024-09-12T18:32:14.398461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:22.182263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'58","reported_seq":588,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.404344+0000","last_change":"2024-09-12T17:10:36.402010+0000","last_active":"2024-09-12T18:32:16.404344+0000","last_peered":"2024-09-12T18:32:16.404344+0000","last_clean":"2024-09-12T18:32:16.404344+0000","last_became_active":"2024-09-12T17:10:36.400358+0000","last_became_peered":"2024-09-12T17:10:36.400358+0000","last_unstale":"2024-09-12T18:32:16.404344+0000","last_undegraded":"2024-09-12T18:32:16.404344+0000","last_fullsized":"2024-09-12T18:32:16.404344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:54.812329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":54,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.393889+0000","last_change":"2024-09-12T17:10:38.405067+0000","last_active":"2024-09-12T18:32:21.393889+0000","last_peered":"2024-09-12T18:32:21.393889+0000","last_clean":"2024-09-12T18:32:21.393889+0000","last_became_active":"2024-09-12T17:10:38.404309+0000","last_became_peered":"2024-09-12T17:10:38.404309+0000","last_unstale":"2024-09-12T18:32:21.393889+0000","last_undegraded":"2024-09-12T18:32:21.393889+0000","last_fullsized":"2024-09-12T18:32:21.393889+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:21.478649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'194","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.504598+0000","last_change":"2024-09-12T17:10:40.422558+0000","last_active":"2024-09-12T18:35:20.504598+0000","last_peered":"2024-09-12T18:35:20.504598+0000","last_clean":"2024-09-12T18:35:20.504598+0000","last_became_active":"2024-09-12T17:10:40.418473+0000","last_became_peered":"2024-09-12T17:10:40.418473+0000","last_unstale":"2024-09-12T18:35:20.504598+0000","last_undegraded":"2024-09-12T18:35:20.504598+0000","last_fullsized":"2024-09-12T18:35:20.504598+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:29.988283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":350,"num_read_kb":341,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'359","reported_seq":1690,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.844725+0000","last_change":"2024-09-12T18:36:18.844725+0000","last_active":"2024-09-12T18:36:18.844725+0000","last_peered":"2024-09-12T18:36:18.844725+0000","last_clean":"2024-09-12T18:36:18.844725+0000","last_became_active":"2024-09-12T17:10:32.382581+0000","last_became_peered":"2024-09-12T17:10:32.382581+0000","last_unstale":"2024-09-12T18:36:18.844725+0000","last_undegraded":"2024-09-12T18:36:18.844725+0000","last_fullsized":"2024-09-12T18:36:18.844725+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T18:36:18.844512+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T18:36:18.844512+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.844512+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:14.341522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1854,"num_read_kb":1737,"num_write":414,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'369","reported_seq":1050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.893176+0000","last_change":"2024-09-12T18:36:11.893176+0000","last_active":"2024-09-12T18:36:11.893176+0000","last_peered":"2024-09-12T18:36:11.893176+0000","last_clean":"2024-09-12T18:36:11.893176+0000","last_became_active":"2024-09-12T17:10:30.374846+0000","last_became_peered":"2024-09-12T17:10:30.374846+0000","last_unstale":"2024-09-12T18:36:11.893176+0000","last_undegraded":"2024-09-12T18:36:11.893176+0000","last_fullsized":"2024-09-12T18:36:11.893176+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'369","last_scrub_stamp":"2024-09-12T18:36:11.892901+0000","last_deep_scrub":"268'369","last_deep_scrub_stamp":"2024-09-12T18:36:11.892901+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.892901+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:09.620432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572943,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":611,"num_read_kb":15632,"num_write":1214,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:16.392627+0000","last_change":"2024-09-12T17:10:34.362906+0000","last_active":"2024-09-12T18:32:16.392627+0000","last_peered":"2024-09-12T18:32:16.392627+0000","last_clean":"2024-09-12T18:32:16.392627+0000","last_became_active":"2024-09-12T17:10:34.362168+0000","last_became_peered":"2024-09-12T17:10:34.362168+0000","last_unstale":"2024-09-12T18:32:16.392627+0000","last_undegraded":"2024-09-12T18:32:16.392627+0000","last_fullsized":"2024-09-12T18:32:16.392627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:22.148212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'380","reported_seq":1005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.290469+0000","last_change":"2024-09-12T17:10:36.395016+0000","last_active":"2024-09-12T18:36:01.290469+0000","last_peered":"2024-09-12T18:36:01.290469+0000","last_clean":"2024-09-12T18:36:01.290469+0000","last_became_active":"2024-09-12T17:10:36.394639+0000","last_became_peered":"2024-09-12T17:10:36.394639+0000","last_unstale":"2024-09-12T18:36:01.290469+0000","last_undegraded":"2024-09-12T18:36:01.290469+0000","last_fullsized":"2024-09-12T18:36:01.290469+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:40.165567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67938,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":612,"num_read_kb":1404,"num_write":492,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.138026+0000","last_change":"2024-09-12T18:36:23.138026+0000","last_active":"2024-09-12T18:36:23.138026+0000","last_peered":"2024-09-12T18:36:23.138026+0000","last_clean":"2024-09-12T18:36:23.138026+0000","last_became_active":"2024-09-12T17:10:38.413131+0000","last_became_peered":"2024-09-12T17:10:38.413131+0000","last_unstale":"2024-09-12T18:36:23.138026+0000","last_undegraded":"2024-09-12T18:36:23.138026+0000","last_fullsized":"2024-09-12T18:36:23.138026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:23.137806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:23.137806+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.137806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:14.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'132","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.413271+0000","last_change":"2024-09-12T17:10:40.429935+0000","last_active":"2024-09-12T18:33:11.413271+0000","last_peered":"2024-09-12T18:33:11.413271+0000","last_clean":"2024-09-12T18:33:11.413271+0000","last_became_active":"2024-09-12T17:10:40.429224+0000","last_became_peered":"2024-09-12T17:10:40.429224+0000","last_unstale":"2024-09-12T18:33:11.413271+0000","last_undegraded":"2024-09-12T18:33:11.413271+0000","last_fullsized":"2024-09-12T18:33:11.413271+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:11.523864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'951","reported_seq":2635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.818036+0000","last_change":"2024-09-12T18:36:17.818036+0000","last_active":"2024-09-12T18:36:17.818036+0000","last_peered":"2024-09-12T18:36:17.818036+0000","last_clean":"2024-09-12T18:36:17.818036+0000","last_became_active":"2024-09-12T17:10:32.369282+0000","last_became_peered":"2024-09-12T17:10:32.369282+0000","last_unstale":"2024-09-12T18:36:17.818036+0000","last_undegraded":"2024-09-12T18:36:17.818036+0000","last_fullsized":"2024-09-12T18:36:17.818036+0000","mapping_epoch":27,"log_start":"268'900","ondisk_log_start":"268'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'951","last_scrub_stamp":"2024-09-12T18:36:17.817821+0000","last_deep_scrub":"268'951","last_deep_scrub_stamp":"2024-09-12T18:36:17.817821+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.817821+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:50.499239+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4532,"num_read_kb":4046,"num_write":1302,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'374","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.619579+0000","last_change":"2024-09-12T18:36:07.619579+0000","last_active":"2024-09-12T18:36:07.619579+0000","last_peered":"2024-09-12T18:36:07.619579+0000","last_clean":"2024-09-12T18:36:07.619579+0000","last_became_active":"2024-09-12T17:10:30.356383+0000","last_became_peered":"2024-09-12T17:10:30.356383+0000","last_unstale":"2024-09-12T18:36:07.619579+0000","last_undegraded":"2024-09-12T18:36:07.619579+0000","last_fullsized":"2024-09-12T18:36:07.619579+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'374","last_scrub_stamp":"2024-09-12T18:36:07.619444+0000","last_deep_scrub":"268'374","last_deep_scrub_stamp":"2024-09-12T18:36:07.619444+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.619444+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:13.321492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":17278,"num_write":1157,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.136810+0000","last_change":"2024-09-12T18:36:22.136810+0000","last_active":"2024-09-12T18:36:22.136810+0000","last_peered":"2024-09-12T18:36:22.136810+0000","last_clean":"2024-09-12T18:36:22.136810+0000","last_became_active":"2024-09-12T17:10:34.363279+0000","last_became_peered":"2024-09-12T17:10:34.363279+0000","last_unstale":"2024-09-12T18:36:22.136810+0000","last_undegraded":"2024-09-12T18:36:22.136810+0000","last_fullsized":"2024-09-12T18:36:22.136810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:22.136599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:22.136599+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.136599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:38.570087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'320","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.079295+0000","last_change":"2024-09-12T17:10:36.397496+0000","last_active":"2024-09-12T18:36:01.079295+0000","last_peered":"2024-09-12T18:36:01.079295+0000","last_clean":"2024-09-12T18:36:01.079295+0000","last_became_active":"2024-09-12T17:10:36.396758+0000","last_became_peered":"2024-09-12T17:10:36.396758+0000","last_unstale":"2024-09-12T18:36:01.079295+0000","last_undegraded":"2024-09-12T18:36:01.079295+0000","last_fullsized":"2024-09-12T18:36:01.079295+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:17.261131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59757,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1297,"num_write":442,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:21.405399+0000","last_change":"2024-09-12T17:10:38.414645+0000","last_active":"2024-09-12T18:32:21.405399+0000","last_peered":"2024-09-12T18:32:21.405399+0000","last_clean":"2024-09-12T18:32:21.405399+0000","last_became_active":"2024-09-12T17:10:38.413004+0000","last_became_peered":"2024-09-12T17:10:38.413004+0000","last_unstale":"2024-09-12T18:32:21.405399+0000","last_undegraded":"2024-09-12T18:32:21.405399+0000","last_fullsized":"2024-09-12T18:32:21.405399+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:16.768442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'441","reported_seq":1953,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.092673+0000","last_change":"2024-09-12T18:36:17.092673+0000","last_active":"2024-09-12T18:36:17.092673+0000","last_peered":"2024-09-12T18:36:17.092673+0000","last_clean":"2024-09-12T18:36:17.092673+0000","last_became_active":"2024-09-12T17:10:32.350751+0000","last_became_peered":"2024-09-12T17:10:32.350751+0000","last_unstale":"2024-09-12T18:36:17.092673+0000","last_undegraded":"2024-09-12T18:36:17.092673+0000","last_fullsized":"2024-09-12T18:36:17.092673+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'441","last_scrub_stamp":"2024-09-12T18:36:17.092489+0000","last_deep_scrub":"268'441","last_deep_scrub_stamp":"2024-09-12T18:36:17.092489+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.092489+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:22.621992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2256,"num_read_kb":2119,"num_write":496,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'284","reported_seq":939,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.937121+0000","last_change":"2024-09-12T18:36:10.937121+0000","last_active":"2024-09-12T18:36:10.937121+0000","last_peered":"2024-09-12T18:36:10.937121+0000","last_clean":"2024-09-12T18:36:10.937121+0000","last_became_active":"2024-09-12T17:10:30.353308+0000","last_became_peered":"2024-09-12T17:10:30.353308+0000","last_unstale":"2024-09-12T18:36:10.937121+0000","last_undegraded":"2024-09-12T18:36:10.937121+0000","last_fullsized":"2024-09-12T18:36:10.937121+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'284","last_scrub_stamp":"2024-09-12T18:36:10.936793+0000","last_deep_scrub":"268'284","last_deep_scrub_stamp":"2024-09-12T18:36:10.936793+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.936793+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:08.902755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262194,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":407,"num_read_kb":20512,"num_write":856,"num_write_kb":25251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.593258+0000","last_change":"2024-09-12T18:36:25.593258+0000","last_active":"2024-09-12T18:36:25.593258+0000","last_peered":"2024-09-12T18:36:25.593258+0000","last_clean":"2024-09-12T18:36:25.593258+0000","last_became_active":"2024-09-12T17:10:34.357883+0000","last_became_peered":"2024-09-12T17:10:34.357883+0000","last_unstale":"2024-09-12T18:36:25.593258+0000","last_undegraded":"2024-09-12T18:36:25.593258+0000","last_fullsized":"2024-09-12T18:36:25.593258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:25.593056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:25.593056+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.593056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:49.907882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'519","reported_seq":1177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.001199+0000","last_change":"2024-09-12T17:10:36.402382+0000","last_active":"2024-09-12T18:36:01.001199+0000","last_peered":"2024-09-12T18:36:01.001199+0000","last_clean":"2024-09-12T18:36:01.001199+0000","last_became_active":"2024-09-12T17:10:36.401608+0000","last_became_peered":"2024-09-12T17:10:36.401608+0000","last_unstale":"2024-09-12T18:36:01.001199+0000","last_undegraded":"2024-09-12T18:36:01.001199+0000","last_fullsized":"2024-09-12T18:36:01.001199+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:02.237080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95576,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":903,"num_read_kb":2101,"num_write":776,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.413301+0000","last_change":"2024-09-12T17:10:38.399567+0000","last_active":"2024-09-12T18:33:11.413301+0000","last_peered":"2024-09-12T18:33:11.413301+0000","last_clean":"2024-09-12T18:33:11.413301+0000","last_became_active":"2024-09-12T17:10:38.398862+0000","last_became_peered":"2024-09-12T17:10:38.398862+0000","last_unstale":"2024-09-12T18:33:11.413301+0000","last_undegraded":"2024-09-12T18:33:11.413301+0000","last_fullsized":"2024-09-12T18:33:11.413301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:54.103985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'157","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.787915+0000","last_change":"2024-09-12T17:10:40.771008+0000","last_active":"2024-09-12T18:34:01.787915+0000","last_peered":"2024-09-12T18:34:01.787915+0000","last_clean":"2024-09-12T18:34:01.787915+0000","last_became_active":"2024-09-12T17:10:40.770075+0000","last_became_peered":"2024-09-12T17:10:40.770075+0000","last_unstale":"2024-09-12T18:34:01.787915+0000","last_undegraded":"2024-09-12T18:34:01.787915+0000","last_fullsized":"2024-09-12T18:34:01.787915+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:20.570103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":234,"num_write":361,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'1462","reported_seq":3056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.508311+0000","last_change":"2024-09-12T18:36:17.508311+0000","last_active":"2024-09-12T18:36:17.508311+0000","last_peered":"2024-09-12T18:36:17.508311+0000","last_clean":"2024-09-12T18:36:17.508311+0000","last_became_active":"2024-09-12T17:10:32.376892+0000","last_became_peered":"2024-09-12T17:10:32.376892+0000","last_unstale":"2024-09-12T18:36:17.508311+0000","last_undegraded":"2024-09-12T18:36:17.508311+0000","last_fullsized":"2024-09-12T18:36:17.508311+0000","mapping_epoch":27,"log_start":"268'1400","ondisk_log_start":"268'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1462","last_scrub_stamp":"2024-09-12T18:36:17.508128+0000","last_deep_scrub":"268'1462","last_deep_scrub_stamp":"2024-09-12T18:36:17.508128+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.508128+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":1400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.380441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6636,"num_read_kb":5839,"num_write":2046,"num_write_kb":883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'297","reported_seq":942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.834263+0000","last_change":"2024-09-12T18:36:08.834263+0000","last_active":"2024-09-12T18:36:08.834263+0000","last_peered":"2024-09-12T18:36:08.834263+0000","last_clean":"2024-09-12T18:36:08.834263+0000","last_became_active":"2024-09-12T17:10:30.378075+0000","last_became_peered":"2024-09-12T17:10:30.378075+0000","last_unstale":"2024-09-12T18:36:08.834263+0000","last_undegraded":"2024-09-12T18:36:08.834263+0000","last_fullsized":"2024-09-12T18:36:08.834263+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'297","last_scrub_stamp":"2024-09-12T18:36:08.833929+0000","last_deep_scrub":"268'297","last_deep_scrub_stamp":"2024-09-12T18:36:08.833929+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.833929+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:52.476849+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4500309,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":47843,"num_write":921,"num_write_kb":30557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.097940+0000","last_change":"2024-09-12T18:36:20.097940+0000","last_active":"2024-09-12T18:36:20.097940+0000","last_peered":"2024-09-12T18:36:20.097940+0000","last_clean":"2024-09-12T18:36:20.097940+0000","last_became_active":"2024-09-12T17:10:34.361495+0000","last_became_peered":"2024-09-12T17:10:34.361495+0000","last_unstale":"2024-09-12T18:36:20.097940+0000","last_undegraded":"2024-09-12T18:36:20.097940+0000","last_fullsized":"2024-09-12T18:36:20.097940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:20.097716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:20.097716+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.097716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:48.768128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'338","reported_seq":960,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.142261+0000","last_change":"2024-09-12T17:10:36.399101+0000","last_active":"2024-09-12T18:36:01.142261+0000","last_peered":"2024-09-12T18:36:01.142261+0000","last_clean":"2024-09-12T18:36:01.142261+0000","last_became_active":"2024-09-12T17:10:36.398415+0000","last_became_peered":"2024-09-12T17:10:36.398415+0000","last_unstale":"2024-09-12T18:36:01.142261+0000","last_undegraded":"2024-09-12T18:36:01.142261+0000","last_fullsized":"2024-09-12T18:36:01.142261+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:16.776403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45877,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":580,"num_read_kb":1203,"num_write":474,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.644654+0000","last_change":"2024-09-12T17:10:38.404690+0000","last_active":"2024-09-12T18:33:11.644654+0000","last_peered":"2024-09-12T18:33:11.644654+0000","last_clean":"2024-09-12T18:33:11.644654+0000","last_became_active":"2024-09-12T17:10:38.401047+0000","last_became_peered":"2024-09-12T17:10:38.401047+0000","last_unstale":"2024-09-12T18:33:11.644654+0000","last_undegraded":"2024-09-12T18:33:11.644654+0000","last_fullsized":"2024-09-12T18:33:11.644654+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:40.635802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'196","reported_seq":744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:58.343759+0000","last_change":"2024-09-12T17:10:40.429587+0000","last_active":"2024-09-12T18:33:58.343759+0000","last_peered":"2024-09-12T18:33:58.343759+0000","last_clean":"2024-09-12T18:33:58.343759+0000","last_became_active":"2024-09-12T17:10:40.428841+0000","last_became_peered":"2024-09-12T17:10:40.428841+0000","last_unstale":"2024-09-12T18:33:58.343759+0000","last_undegraded":"2024-09-12T18:33:58.343759+0000","last_fullsized":"2024-09-12T18:33:58.343759+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:22.728668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1669,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":376,"num_read_kb":345,"num_write":581,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'1124","reported_seq":2870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.926010+0000","last_change":"2024-09-12T17:10:32.369642+0000","last_active":"2024-09-12T18:33:59.926010+0000","last_peered":"2024-09-12T18:33:59.926010+0000","last_clean":"2024-09-12T18:33:59.926010+0000","last_became_active":"2024-09-12T17:10:32.369344+0000","last_became_peered":"2024-09-12T17:10:32.369344+0000","last_unstale":"2024-09-12T18:33:59.926010+0000","last_undegraded":"2024-09-12T18:33:59.926010+0000","last_fullsized":"2024-09-12T18:33:59.926010+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:38.641315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5513,"num_read_kb":4854,"num_write":1595,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'341","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.312390+0000","last_change":"2024-09-12T18:36:10.312390+0000","last_active":"2024-09-12T18:36:10.312390+0000","last_peered":"2024-09-12T18:36:10.312390+0000","last_clean":"2024-09-12T18:36:10.312390+0000","last_became_active":"2024-09-12T17:11:05.123283+0000","last_became_peered":"2024-09-12T17:11:05.123283+0000","last_unstale":"2024-09-12T18:36:10.312390+0000","last_undegraded":"2024-09-12T18:36:10.312390+0000","last_fullsized":"2024-09-12T18:36:10.312390+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'341","last_scrub_stamp":"2024-09-12T18:36:10.312023+0000","last_deep_scrub":"268'341","last_deep_scrub_stamp":"2024-09-12T18:36:10.312023+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.312023+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:26:25.953575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048663,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":48133,"num_write":1103,"num_write_kb":35281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"37'5","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:58.750296+0000","last_change":"2024-09-12T17:10:34.352955+0000","last_active":"2024-09-12T18:35:58.750296+0000","last_peered":"2024-09-12T18:35:58.750296+0000","last_clean":"2024-09-12T18:35:58.750296+0000","last_became_active":"2024-09-12T17:10:34.352213+0000","last_became_peered":"2024-09-12T17:10:34.352213+0000","last_unstale":"2024-09-12T18:35:58.750296+0000","last_undegraded":"2024-09-12T18:35:58.750296+0000","last_fullsized":"2024-09-12T18:35:58.750296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:10.177818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'298","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.748127+0000","last_change":"2024-09-12T17:10:36.922284+0000","last_active":"2024-09-12T18:35:59.748127+0000","last_peered":"2024-09-12T18:35:59.748127+0000","last_clean":"2024-09-12T18:35:59.748127+0000","last_became_active":"2024-09-12T17:10:36.921450+0000","last_became_peered":"2024-09-12T17:10:36.921450+0000","last_unstale":"2024-09-12T18:35:59.748127+0000","last_undegraded":"2024-09-12T18:35:59.748127+0000","last_fullsized":"2024-09-12T18:35:59.748127+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:10.318840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44011,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":1000,"num_write":366,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642311+0000","last_change":"2024-09-12T17:10:38.396118+0000","last_active":"2024-09-12T18:33:01.642311+0000","last_peered":"2024-09-12T18:33:01.642311+0000","last_clean":"2024-09-12T18:33:01.642311+0000","last_became_active":"2024-09-12T17:10:38.395457+0000","last_became_peered":"2024-09-12T17:10:38.395457+0000","last_unstale":"2024-09-12T18:33:01.642311+0000","last_undegraded":"2024-09-12T18:33:01.642311+0000","last_fullsized":"2024-09-12T18:33:01.642311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:35.393797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'130","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.742743+0000","last_change":"2024-09-12T17:10:40.430012+0000","last_active":"2024-09-12T18:35:21.742743+0000","last_peered":"2024-09-12T18:35:21.742743+0000","last_clean":"2024-09-12T18:35:21.742743+0000","last_became_active":"2024-09-12T17:10:40.429303+0000","last_became_peered":"2024-09-12T17:10:40.429303+0000","last_unstale":"2024-09-12T18:35:21.742743+0000","last_undegraded":"2024-09-12T18:35:21.742743+0000","last_fullsized":"2024-09-12T18:35:21.742743+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:37.352428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":233,"num_read_kb":212,"num_write":334,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'905","reported_seq":2428,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.380060+0000","last_change":"2024-09-12T18:36:15.380060+0000","last_active":"2024-09-12T18:36:15.380060+0000","last_peered":"2024-09-12T18:36:15.380060+0000","last_clean":"2024-09-12T18:36:15.380060+0000","last_became_active":"2024-09-12T17:10:32.362957+0000","last_became_peered":"2024-09-12T17:10:32.362957+0000","last_unstale":"2024-09-12T18:36:15.380060+0000","last_undegraded":"2024-09-12T18:36:15.380060+0000","last_fullsized":"2024-09-12T18:36:15.380060+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'905","last_scrub_stamp":"2024-09-12T18:36:15.379868+0000","last_deep_scrub":"268'905","last_deep_scrub_stamp":"2024-09-12T18:36:15.379868+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.379868+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":800,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:49.635855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4274,"num_read_kb":3831,"num_write":1263,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'361","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.565443+0000","last_change":"2024-09-12T18:36:10.565443+0000","last_active":"2024-09-12T18:36:10.565443+0000","last_peered":"2024-09-12T18:36:10.565443+0000","last_clean":"2024-09-12T18:36:10.565443+0000","last_became_active":"2024-09-12T17:10:30.374618+0000","last_became_peered":"2024-09-12T17:10:30.374618+0000","last_unstale":"2024-09-12T18:36:10.565443+0000","last_undegraded":"2024-09-12T18:36:10.565443+0000","last_fullsized":"2024-09-12T18:36:10.565443+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-12T18:36:10.565103+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-12T18:36:10.565103+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.565103+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:57.740717+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048724,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":441,"num_read_kb":21889,"num_write":990,"num_write_kb":37331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.924046+0000","last_change":"2024-09-12T18:36:24.924046+0000","last_active":"2024-09-12T18:36:24.924046+0000","last_peered":"2024-09-12T18:36:24.924046+0000","last_clean":"2024-09-12T18:36:24.924046+0000","last_became_active":"2024-09-12T17:10:34.361536+0000","last_became_peered":"2024-09-12T17:10:34.361536+0000","last_unstale":"2024-09-12T18:36:24.924046+0000","last_undegraded":"2024-09-12T18:36:24.924046+0000","last_fullsized":"2024-09-12T18:36:24.924046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:24.923870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:24.923870+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.923870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:02.233333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'114","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:00.592520+0000","last_change":"2024-09-12T17:10:36.923878+0000","last_active":"2024-09-12T18:33:00.592520+0000","last_peered":"2024-09-12T18:33:00.592520+0000","last_clean":"2024-09-12T18:33:00.592520+0000","last_became_active":"2024-09-12T17:10:36.923087+0000","last_became_peered":"2024-09-12T17:10:36.923087+0000","last_unstale":"2024-09-12T18:33:00.592520+0000","last_undegraded":"2024-09-12T18:33:00.592520+0000","last_fullsized":"2024-09-12T18:33:00.592520+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:34.787955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":134,"num_write":98,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'781","reported_seq":2886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.917188+0000","last_change":"2024-09-12T17:10:38.410583+0000","last_active":"2024-09-12T18:36:01.917188+0000","last_peered":"2024-09-12T18:36:01.917188+0000","last_clean":"2024-09-12T18:36:01.917188+0000","last_became_active":"2024-09-12T17:10:38.407830+0000","last_became_peered":"2024-09-12T17:10:38.407830+0000","last_unstale":"2024-09-12T18:36:01.917188+0000","last_undegraded":"2024-09-12T18:36:01.917188+0000","last_fullsized":"2024-09-12T18:36:01.917188+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:25.369785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'146","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.883725+0000","last_change":"2024-09-12T17:10:40.432466+0000","last_active":"2024-09-12T18:33:59.883725+0000","last_peered":"2024-09-12T18:33:59.883725+0000","last_clean":"2024-09-12T18:33:59.883725+0000","last_became_active":"2024-09-12T17:10:40.431693+0000","last_became_peered":"2024-09-12T17:10:40.431693+0000","last_unstale":"2024-09-12T18:33:59.883725+0000","last_undegraded":"2024-09-12T18:33:59.883725+0000","last_fullsized":"2024-09-12T18:33:59.883725+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:18.379860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":232,"num_write":366,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'809","reported_seq":2336,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.062762+0000","last_change":"2024-09-12T18:36:18.062762+0000","last_active":"2024-09-12T18:36:18.062762+0000","last_peered":"2024-09-12T18:36:18.062762+0000","last_clean":"2024-09-12T18:36:18.062762+0000","last_became_active":"2024-09-12T17:10:32.369824+0000","last_became_peered":"2024-09-12T17:10:32.369824+0000","last_unstale":"2024-09-12T18:36:18.062762+0000","last_undegraded":"2024-09-12T18:36:18.062762+0000","last_fullsized":"2024-09-12T18:36:18.062762+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'809","last_scrub_stamp":"2024-09-12T18:36:18.062570+0000","last_deep_scrub":"268'809","last_deep_scrub_stamp":"2024-09-12T18:36:18.062570+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.062570+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:06.008030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3803,"num_read_kb":3411,"num_write":1089,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'371","reported_seq":1184,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.929229+0000","last_change":"2024-09-12T18:36:12.929229+0000","last_active":"2024-09-12T18:36:12.929229+0000","last_peered":"2024-09-12T18:36:12.929229+0000","last_clean":"2024-09-12T18:36:12.929229+0000","last_became_active":"2024-09-12T17:10:30.357942+0000","last_became_peered":"2024-09-12T17:10:30.357942+0000","last_unstale":"2024-09-12T18:36:12.929229+0000","last_undegraded":"2024-09-12T18:36:12.929229+0000","last_fullsized":"2024-09-12T18:36:12.929229+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'371","last_scrub_stamp":"2024-09-12T18:36:12.928977+0000","last_deep_scrub":"268'371","last_deep_scrub_stamp":"2024-09-12T18:36:12.928977+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.928977+0000","objects_scrubbed":8,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:50.171794+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310810,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":949,"num_read_kb":26001,"num_write":1281,"num_write_kb":43743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.404767+0000","last_change":"2024-09-12T17:10:34.362432+0000","last_active":"2024-09-12T18:33:06.404767+0000","last_peered":"2024-09-12T18:33:06.404767+0000","last_clean":"2024-09-12T18:33:06.404767+0000","last_became_active":"2024-09-12T17:10:34.361686+0000","last_became_peered":"2024-09-12T17:10:34.361686+0000","last_unstale":"2024-09-12T18:33:06.404767+0000","last_undegraded":"2024-09-12T18:33:06.404767+0000","last_fullsized":"2024-09-12T18:33:06.404767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:20.692641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'367","reported_seq":989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.360473+0000","last_change":"2024-09-12T17:10:36.392913+0000","last_active":"2024-09-12T18:36:00.360473+0000","last_peered":"2024-09-12T18:36:00.360473+0000","last_clean":"2024-09-12T18:36:00.360473+0000","last_became_active":"2024-09-12T17:10:36.392089+0000","last_became_peered":"2024-09-12T17:10:36.392089+0000","last_unstale":"2024-09-12T18:36:00.360473+0000","last_undegraded":"2024-09-12T18:36:00.360473+0000","last_fullsized":"2024-09-12T18:36:00.360473+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:00.724692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47317,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":601,"num_read_kb":1312,"num_write":482,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411609+0000","last_change":"2024-09-12T17:10:38.411770+0000","last_active":"2024-09-12T18:32:51.411609+0000","last_peered":"2024-09-12T18:32:51.411609+0000","last_clean":"2024-09-12T18:32:51.411609+0000","last_became_active":"2024-09-12T17:10:38.411191+0000","last_became_peered":"2024-09-12T17:10:38.411191+0000","last_unstale":"2024-09-12T18:32:51.411609+0000","last_undegraded":"2024-09-12T18:32:51.411609+0000","last_fullsized":"2024-09-12T18:32:51.411609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:29.140092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'100","reported_seq":612,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.845108+0000","last_change":"2024-09-12T17:10:40.437458+0000","last_active":"2024-09-12T18:33:55.845108+0000","last_peered":"2024-09-12T18:33:55.845108+0000","last_clean":"2024-09-12T18:33:55.845108+0000","last_became_active":"2024-09-12T17:10:40.436748+0000","last_became_peered":"2024-09-12T17:10:40.436748+0000","last_unstale":"2024-09-12T18:33:55.845108+0000","last_undegraded":"2024-09-12T18:33:55.845108+0000","last_fullsized":"2024-09-12T18:33:55.845108+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:53.015779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":136,"num_write":243,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'580","reported_seq":2238,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.023785+0000","last_change":"2024-09-12T18:36:19.023785+0000","last_active":"2024-09-12T18:36:19.023785+0000","last_peered":"2024-09-12T18:36:19.023785+0000","last_clean":"2024-09-12T18:36:19.023785+0000","last_became_active":"2024-09-12T17:10:32.370173+0000","last_became_peered":"2024-09-12T17:10:32.370173+0000","last_unstale":"2024-09-12T18:36:19.023785+0000","last_undegraded":"2024-09-12T18:36:19.023785+0000","last_fullsized":"2024-09-12T18:36:19.023785+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'580","last_scrub_stamp":"2024-09-12T18:36:19.023540+0000","last_deep_scrub":"268'580","last_deep_scrub_stamp":"2024-09-12T18:36:19.023540+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.023540+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:18.181483+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2773,"num_read_kb":2563,"num_write":696,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'364","reported_seq":1006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.882426+0000","last_change":"2024-09-12T18:36:13.882426+0000","last_active":"2024-09-12T18:36:13.882426+0000","last_peered":"2024-09-12T18:36:13.882426+0000","last_clean":"2024-09-12T18:36:13.882426+0000","last_became_active":"2024-09-12T17:10:30.355723+0000","last_became_peered":"2024-09-12T17:10:30.355723+0000","last_unstale":"2024-09-12T18:36:13.882426+0000","last_undegraded":"2024-09-12T18:36:13.882426+0000","last_fullsized":"2024-09-12T18:36:13.882426+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T18:36:13.882169+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T18:36:13.882169+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.882169+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:47.864528+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":22337,"num_write":1141,"num_write_kb":39083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.412100+0000","last_change":"2024-09-12T17:10:34.364113+0000","last_active":"2024-09-12T18:33:06.412100+0000","last_peered":"2024-09-12T18:33:06.412100+0000","last_clean":"2024-09-12T18:33:06.412100+0000","last_became_active":"2024-09-12T17:10:34.363439+0000","last_became_peered":"2024-09-12T17:10:34.363439+0000","last_unstale":"2024-09-12T18:33:06.412100+0000","last_undegraded":"2024-09-12T18:33:06.412100+0000","last_fullsized":"2024-09-12T18:33:06.412100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:02.164079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'289","reported_seq":889,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.452354+0000","last_change":"2024-09-12T17:10:36.397893+0000","last_active":"2024-09-12T18:36:00.452354+0000","last_peered":"2024-09-12T18:36:00.452354+0000","last_clean":"2024-09-12T18:36:00.452354+0000","last_became_active":"2024-09-12T17:10:36.397148+0000","last_became_peered":"2024-09-12T17:10:36.397148+0000","last_unstale":"2024-09-12T18:36:00.452354+0000","last_undegraded":"2024-09-12T18:36:00.452354+0000","last_fullsized":"2024-09-12T18:36:00.452354+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:04.236115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":1130,"num_write":384,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.173962+0000","last_change":"2024-09-12T18:36:26.173962+0000","last_active":"2024-09-12T18:36:26.173962+0000","last_peered":"2024-09-12T18:36:26.173962+0000","last_clean":"2024-09-12T18:36:26.173962+0000","last_became_active":"2024-09-12T17:10:38.406892+0000","last_became_peered":"2024-09-12T17:10:38.406892+0000","last_unstale":"2024-09-12T18:36:26.173962+0000","last_undegraded":"2024-09-12T18:36:26.173962+0000","last_fullsized":"2024-09-12T18:36:26.173962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.173758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.173758+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.173758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:04.936184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'157","reported_seq":692,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:19.439905+0000","last_change":"2024-09-12T17:10:40.770908+0000","last_active":"2024-09-12T18:35:19.439905+0000","last_peered":"2024-09-12T18:35:19.439905+0000","last_clean":"2024-09-12T18:35:19.439905+0000","last_became_active":"2024-09-12T17:10:40.770159+0000","last_became_peered":"2024-09-12T17:10:40.770159+0000","last_unstale":"2024-09-12T18:35:19.439905+0000","last_undegraded":"2024-09-12T18:35:19.439905+0000","last_fullsized":"2024-09-12T18:35:19.439905+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:17.022501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":169,"num_write":336,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'1196","reported_seq":2731,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.766995+0000","last_change":"2024-09-12T18:36:21.766995+0000","last_active":"2024-09-12T18:36:21.766995+0000","last_peered":"2024-09-12T18:36:21.766995+0000","last_clean":"2024-09-12T18:36:21.766995+0000","last_became_active":"2024-09-12T17:10:32.357738+0000","last_became_peered":"2024-09-12T17:10:32.357738+0000","last_unstale":"2024-09-12T18:36:21.766995+0000","last_undegraded":"2024-09-12T18:36:21.766995+0000","last_fullsized":"2024-09-12T18:36:21.766995+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1196","last_scrub_stamp":"2024-09-12T18:36:21.766764+0000","last_deep_scrub":"268'1196","last_deep_scrub_stamp":"2024-09-12T18:36:21.766764+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.766764+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":1100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:30.939395+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5279,"num_read_kb":4649,"num_write":1626,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'344","reported_seq":1006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.923708+0000","last_change":"2024-09-12T18:36:11.923708+0000","last_active":"2024-09-12T18:36:11.923708+0000","last_peered":"2024-09-12T18:36:11.923708+0000","last_clean":"2024-09-12T18:36:11.923708+0000","last_became_active":"2024-09-12T17:10:30.401941+0000","last_became_peered":"2024-09-12T17:10:30.401941+0000","last_unstale":"2024-09-12T18:36:11.923708+0000","last_undegraded":"2024-09-12T18:36:11.923708+0000","last_fullsized":"2024-09-12T18:36:11.923708+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-12T18:36:11.923480+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-12T18:36:11.923480+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.923480+0000","objects_scrubbed":9,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:14.387628+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310809,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":28042,"num_write":994,"num_write_kb":46600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:45.588684+0000","last_change":"2024-09-12T17:10:34.358478+0000","last_active":"2024-09-12T18:32:45.588684+0000","last_peered":"2024-09-12T18:32:45.588684+0000","last_clean":"2024-09-12T18:32:45.588684+0000","last_became_active":"2024-09-12T17:10:34.357688+0000","last_became_peered":"2024-09-12T17:10:34.357688+0000","last_unstale":"2024-09-12T18:32:45.588684+0000","last_undegraded":"2024-09-12T18:32:45.588684+0000","last_fullsized":"2024-09-12T18:32:45.588684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:33.324157+0000","last_clean_scrub_stamp":"2024-09-12T17:10:33.324157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:01.686198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'249","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.561418+0000","last_change":"2024-09-12T17:10:36.400271+0000","last_active":"2024-09-12T18:35:59.561418+0000","last_peered":"2024-09-12T18:35:59.561418+0000","last_clean":"2024-09-12T18:35:59.561418+0000","last_became_active":"2024-09-12T17:10:36.398639+0000","last_became_peered":"2024-09-12T17:10:36.398639+0000","last_unstale":"2024-09-12T18:35:59.561418+0000","last_undegraded":"2024-09-12T18:35:59.561418+0000","last_fullsized":"2024-09-12T18:35:59.561418+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:36.210475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52346,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":1002,"num_write":330,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.595054+0000","last_change":"2024-09-12T17:10:38.401463+0000","last_active":"2024-09-12T18:33:10.595054+0000","last_peered":"2024-09-12T18:33:10.595054+0000","last_clean":"2024-09-12T18:33:10.595054+0000","last_became_active":"2024-09-12T17:10:38.400703+0000","last_became_peered":"2024-09-12T17:10:38.400703+0000","last_unstale":"2024-09-12T18:33:10.595054+0000","last_undegraded":"2024-09-12T18:33:10.595054+0000","last_fullsized":"2024-09-12T18:33:10.595054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:10.103057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'171","reported_seq":1654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:55.714827+0000","last_change":"2024-09-12T17:10:40.435581+0000","last_active":"2024-09-12T18:33:55.714827+0000","last_peered":"2024-09-12T18:33:55.714827+0000","last_clean":"2024-09-12T18:33:55.714827+0000","last_became_active":"2024-09-12T17:10:40.434195+0000","last_became_peered":"2024-09-12T17:10:40.434195+0000","last_unstale":"2024-09-12T18:33:55.714827+0000","last_undegraded":"2024-09-12T18:33:55.714827+0000","last_fullsized":"2024-09-12T18:33:55.714827+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:34.304171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1233,"num_read_kb":1222,"num_write":385,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'396","reported_seq":1921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.020701+0000","last_change":"2024-09-12T18:36:17.020701+0000","last_active":"2024-09-12T18:36:17.020701+0000","last_peered":"2024-09-12T18:36:17.020701+0000","last_clean":"2024-09-12T18:36:17.020701+0000","last_became_active":"2024-09-12T17:10:32.361716+0000","last_became_peered":"2024-09-12T17:10:32.361716+0000","last_unstale":"2024-09-12T18:36:17.020701+0000","last_undegraded":"2024-09-12T18:36:17.020701+0000","last_fullsized":"2024-09-12T18:36:17.020701+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'396","last_scrub_stamp":"2024-09-12T18:36:17.020480+0000","last_deep_scrub":"268'396","last_deep_scrub_stamp":"2024-09-12T18:36:17.020480+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.020480+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:51.155889+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2161,"num_read_kb":2069,"num_write":462,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'306","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.614975+0000","last_change":"2024-09-12T18:36:09.614975+0000","last_active":"2024-09-12T18:36:09.614975+0000","last_peered":"2024-09-12T18:36:09.614975+0000","last_clean":"2024-09-12T18:36:09.614975+0000","last_became_active":"2024-09-12T17:10:30.387788+0000","last_became_peered":"2024-09-12T17:10:30.387788+0000","last_unstale":"2024-09-12T18:36:09.614975+0000","last_undegraded":"2024-09-12T18:36:09.614975+0000","last_fullsized":"2024-09-12T18:36:09.614975+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'306","last_scrub_stamp":"2024-09-12T18:36:09.614762+0000","last_deep_scrub":"268'306","last_deep_scrub_stamp":"2024-09-12T18:36:09.614762+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.614762+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:45.452561+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1332788,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":40433,"num_write":1021,"num_write_kb":46438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.968939+0000","last_change":"2024-09-12T18:36:20.968939+0000","last_active":"2024-09-12T18:36:20.968939+0000","last_peered":"2024-09-12T18:36:20.968939+0000","last_clean":"2024-09-12T18:36:20.968939+0000","last_became_active":"2024-09-12T17:10:34.356290+0000","last_became_peered":"2024-09-12T17:10:34.356290+0000","last_unstale":"2024-09-12T18:36:20.968939+0000","last_undegraded":"2024-09-12T18:36:20.968939+0000","last_fullsized":"2024-09-12T18:36:20.968939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:20.968760+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:20.968760+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.968760+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:48.876143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'309","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.841400+0000","last_change":"2024-09-12T17:10:36.392771+0000","last_active":"2024-09-12T18:35:59.841400+0000","last_peered":"2024-09-12T18:35:59.841400+0000","last_clean":"2024-09-12T18:35:59.841400+0000","last_became_active":"2024-09-12T17:10:36.391455+0000","last_became_peered":"2024-09-12T17:10:36.391455+0000","last_unstale":"2024-09-12T18:35:59.841400+0000","last_undegraded":"2024-09-12T18:35:59.841400+0000","last_fullsized":"2024-09-12T18:35:59.841400+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:35.353197+0000","last_clean_scrub_stamp":"2024-09-12T17:10:35.353197+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:23.461018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44113,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":1099,"num_write":400,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:11.415277+0000","last_change":"2024-09-12T17:10:38.414101+0000","last_active":"2024-09-12T18:33:11.415277+0000","last_peered":"2024-09-12T18:33:11.415277+0000","last_clean":"2024-09-12T18:33:11.415277+0000","last_became_active":"2024-09-12T17:10:38.413592+0000","last_became_peered":"2024-09-12T17:10:38.413592+0000","last_unstale":"2024-09-12T18:33:11.415277+0000","last_undegraded":"2024-09-12T18:33:11.415277+0000","last_fullsized":"2024-09-12T18:33:11.415277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:37.365462+0000","last_clean_scrub_stamp":"2024-09-12T17:10:37.365462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:44.432349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'148","reported_seq":661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.433937+0000","last_change":"2024-09-12T17:10:40.432069+0000","last_active":"2024-09-12T18:35:20.433937+0000","last_peered":"2024-09-12T18:35:20.433937+0000","last_clean":"2024-09-12T18:35:20.433937+0000","last_became_active":"2024-09-12T17:10:40.425063+0000","last_became_peered":"2024-09-12T17:10:40.425063+0000","last_unstale":"2024-09-12T18:35:20.433937+0000","last_undegraded":"2024-09-12T18:35:20.433937+0000","last_fullsized":"2024-09-12T18:35:20.433937+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:02.872786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":181,"num_read_kb":173,"num_write":358,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'373","reported_seq":1793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.509133+0000","last_change":"2024-09-12T17:10:32.365153+0000","last_active":"2024-09-12T18:33:01.509133+0000","last_peered":"2024-09-12T18:33:01.509133+0000","last_clean":"2024-09-12T18:33:01.509133+0000","last_became_active":"2024-09-12T17:10:32.361445+0000","last_became_peered":"2024-09-12T17:10:32.361445+0000","last_unstale":"2024-09-12T18:33:01.509133+0000","last_undegraded":"2024-09-12T18:33:01.509133+0000","last_fullsized":"2024-09-12T18:33:01.509133+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:31.834987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1921,"num_read_kb":1829,"num_write":410,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'364","reported_seq":1015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.393839+0000","last_change":"2024-09-12T18:36:06.393839+0000","last_active":"2024-09-12T18:36:06.393839+0000","last_peered":"2024-09-12T18:36:06.393839+0000","last_clean":"2024-09-12T18:36:06.393839+0000","last_became_active":"2024-09-12T17:11:04.372622+0000","last_became_peered":"2024-09-12T17:11:04.372622+0000","last_unstale":"2024-09-12T18:36:06.393839+0000","last_undegraded":"2024-09-12T18:36:06.393839+0000","last_fullsized":"2024-09-12T18:36:06.393839+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T18:36:06.393728+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T18:36:06.393728+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.393728+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:56.730903+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456544,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":530,"num_read_kb":34257,"num_write":1086,"num_write_kb":35279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'383","reported_seq":1908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.927405+0000","last_change":"2024-09-12T18:36:19.927405+0000","last_active":"2024-09-12T18:36:19.927405+0000","last_peered":"2024-09-12T18:36:19.927405+0000","last_clean":"2024-09-12T18:36:19.927405+0000","last_became_active":"2024-09-12T17:10:32.364080+0000","last_became_peered":"2024-09-12T17:10:32.364080+0000","last_unstale":"2024-09-12T18:36:19.927405+0000","last_undegraded":"2024-09-12T18:36:19.927405+0000","last_fullsized":"2024-09-12T18:36:19.927405+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-12T18:36:19.927195+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-12T18:36:19.927195+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.927195+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:05.629401+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2111,"num_read_kb":2018,"num_write":410,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'353","reported_seq":1136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.389225+0000","last_change":"2024-09-12T18:36:13.389225+0000","last_active":"2024-09-12T18:36:13.389225+0000","last_peered":"2024-09-12T18:36:13.389225+0000","last_clean":"2024-09-12T18:36:13.389225+0000","last_became_active":"2024-09-12T17:10:30.393924+0000","last_became_peered":"2024-09-12T17:10:30.393924+0000","last_unstale":"2024-09-12T18:36:13.389225+0000","last_undegraded":"2024-09-12T18:36:13.389225+0000","last_fullsized":"2024-09-12T18:36:13.389225+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'353","last_scrub_stamp":"2024-09-12T18:36:13.388912+0000","last_deep_scrub":"268'353","last_deep_scrub_stamp":"2024-09-12T18:36:13.388912+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.388912+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:11.683116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550017,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":731,"num_read_kb":31225,"num_write":1143,"num_write_kb":33307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'812","reported_seq":2200,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:10.879138+0000","last_change":"2024-09-12T17:10:32.382803+0000","last_active":"2024-09-12T18:33:10.879138+0000","last_peered":"2024-09-12T18:33:10.879138+0000","last_clean":"2024-09-12T18:33:10.879138+0000","last_became_active":"2024-09-12T17:10:32.382110+0000","last_became_peered":"2024-09-12T17:10:32.382110+0000","last_unstale":"2024-09-12T18:33:10.879138+0000","last_undegraded":"2024-09-12T18:33:10.879138+0000","last_fullsized":"2024-09-12T18:33:10.879138+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:57.022415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3583,"num_read_kb":3191,"num_write":1046,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'356","reported_seq":1040,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.868686+0000","last_change":"2024-09-12T18:36:14.868686+0000","last_active":"2024-09-12T18:36:14.868686+0000","last_peered":"2024-09-12T18:36:14.868686+0000","last_clean":"2024-09-12T18:36:14.868686+0000","last_became_active":"2024-09-12T17:10:30.352353+0000","last_became_peered":"2024-09-12T17:10:30.352353+0000","last_unstale":"2024-09-12T18:36:14.868686+0000","last_undegraded":"2024-09-12T18:36:14.868686+0000","last_fullsized":"2024-09-12T18:36:14.868686+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'356","last_scrub_stamp":"2024-09-12T18:36:14.868477+0000","last_deep_scrub":"268'356","last_deep_scrub_stamp":"2024-09-12T18:36:14.868477+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.868477+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:59.665480+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267294,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":541,"num_read_kb":44546,"num_write":1186,"num_write_kb":40457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'444","reported_seq":1997,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.878506+0000","last_change":"2024-09-12T18:36:16.878506+0000","last_active":"2024-09-12T18:36:16.878506+0000","last_peered":"2024-09-12T18:36:16.878506+0000","last_clean":"2024-09-12T18:36:16.878506+0000","last_became_active":"2024-09-12T17:10:32.378659+0000","last_became_peered":"2024-09-12T17:10:32.378659+0000","last_unstale":"2024-09-12T18:36:16.878506+0000","last_undegraded":"2024-09-12T18:36:16.878506+0000","last_fullsized":"2024-09-12T18:36:16.878506+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'444","last_scrub_stamp":"2024-09-12T18:36:16.878330+0000","last_deep_scrub":"268'444","last_deep_scrub_stamp":"2024-09-12T18:36:16.878330+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.878330+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:57.042518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2290,"num_read_kb":2161,"num_write":510,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1009,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'375","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.615620+0000","last_change":"2024-09-12T18:36:11.615620+0000","last_active":"2024-09-12T18:36:11.615620+0000","last_peered":"2024-09-12T18:36:11.615620+0000","last_clean":"2024-09-12T18:36:11.615620+0000","last_became_active":"2024-09-12T17:11:04.868302+0000","last_became_peered":"2024-09-12T17:11:04.868302+0000","last_unstale":"2024-09-12T18:36:11.615620+0000","last_undegraded":"2024-09-12T18:36:11.615620+0000","last_fullsized":"2024-09-12T18:36:11.615620+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'375","last_scrub_stamp":"2024-09-12T18:36:11.615367+0000","last_deep_scrub":"268'375","last_deep_scrub_stamp":"2024-09-12T18:36:11.615367+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.615367+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:50.353013+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194362,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":35312,"num_write":1211,"num_write_kb":68294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'522","reported_seq":2253,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.780273+0000","last_change":"2024-09-12T18:36:23.780273+0000","last_active":"2024-09-12T18:36:23.780273+0000","last_peered":"2024-09-12T18:36:23.780273+0000","last_clean":"2024-09-12T18:36:23.780273+0000","last_became_active":"2024-09-12T17:10:32.382841+0000","last_became_peered":"2024-09-12T17:10:32.382841+0000","last_unstale":"2024-09-12T18:36:23.780273+0000","last_undegraded":"2024-09-12T18:36:23.780273+0000","last_fullsized":"2024-09-12T18:36:23.780273+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'522","last_scrub_stamp":"2024-09-12T18:36:23.780095+0000","last_deep_scrub":"268'522","last_deep_scrub_stamp":"2024-09-12T18:36:23.780095+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.780095+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:34.659271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2888,"num_read_kb":2690,"num_write":642,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'320","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.931640+0000","last_change":"2024-09-12T18:36:09.931640+0000","last_active":"2024-09-12T18:36:09.931640+0000","last_peered":"2024-09-12T18:36:09.931640+0000","last_clean":"2024-09-12T18:36:09.931640+0000","last_became_active":"2024-09-12T17:11:04.373103+0000","last_became_peered":"2024-09-12T17:11:04.373103+0000","last_unstale":"2024-09-12T18:36:09.931640+0000","last_undegraded":"2024-09-12T18:36:09.931640+0000","last_fullsized":"2024-09-12T18:36:09.931640+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-09-12T18:36:09.931398+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-09-12T18:36:09.931398+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.931398+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:02.232474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":30230,"num_write":1056,"num_write_kb":31529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'447","reported_seq":2081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.977845+0000","last_change":"2024-09-12T18:36:23.977845+0000","last_active":"2024-09-12T18:36:23.977845+0000","last_peered":"2024-09-12T18:36:23.977845+0000","last_clean":"2024-09-12T18:36:23.977845+0000","last_became_active":"2024-09-12T17:10:32.370112+0000","last_became_peered":"2024-09-12T17:10:32.370112+0000","last_unstale":"2024-09-12T18:36:23.977845+0000","last_undegraded":"2024-09-12T18:36:23.977845+0000","last_fullsized":"2024-09-12T18:36:23.977845+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'447","last_scrub_stamp":"2024-09-12T18:36:23.977770+0000","last_deep_scrub":"268'447","last_deep_scrub_stamp":"2024-09-12T18:36:23.977770+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.977770+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:57.025220+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2345,"num_read_kb":2230,"num_write":501,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'371","reported_seq":1070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.914493+0000","last_change":"2024-09-12T18:36:10.914493+0000","last_active":"2024-09-12T18:36:10.914493+0000","last_peered":"2024-09-12T18:36:10.914493+0000","last_clean":"2024-09-12T18:36:10.914493+0000","last_became_active":"2024-09-12T17:10:30.348702+0000","last_became_peered":"2024-09-12T17:10:30.348702+0000","last_unstale":"2024-09-12T18:36:10.914493+0000","last_undegraded":"2024-09-12T18:36:10.914493+0000","last_fullsized":"2024-09-12T18:36:10.914493+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'371","last_scrub_stamp":"2024-09-12T18:36:10.914266+0000","last_deep_scrub":"268'371","last_deep_scrub_stamp":"2024-09-12T18:36:10.914266+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.914266+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:47.453636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310621,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":552,"num_read_kb":10243,"num_write":1254,"num_write_kb":63527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'740","reported_seq":2634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.739616+0000","last_change":"2024-09-12T18:36:22.739616+0000","last_active":"2024-09-12T18:36:22.739616+0000","last_peered":"2024-09-12T18:36:22.739616+0000","last_clean":"2024-09-12T18:36:22.739616+0000","last_became_active":"2024-09-12T17:10:32.371017+0000","last_became_peered":"2024-09-12T17:10:32.371017+0000","last_unstale":"2024-09-12T18:36:22.739616+0000","last_undegraded":"2024-09-12T18:36:22.739616+0000","last_fullsized":"2024-09-12T18:36:22.739616+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'740","last_scrub_stamp":"2024-09-12T18:36:22.739504+0000","last_deep_scrub":"268'740","last_deep_scrub_stamp":"2024-09-12T18:36:22.739504+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.739504+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:07.137813+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4018,"num_read_kb":3683,"num_write":976,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'331","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.196685+0000","last_change":"2024-09-12T18:36:10.196685+0000","last_active":"2024-09-12T18:36:10.196685+0000","last_peered":"2024-09-12T18:36:10.196685+0000","last_clean":"2024-09-12T18:36:10.196685+0000","last_became_active":"2024-09-12T17:10:30.396958+0000","last_became_peered":"2024-09-12T17:10:30.396958+0000","last_unstale":"2024-09-12T18:36:10.196685+0000","last_undegraded":"2024-09-12T18:36:10.196685+0000","last_fullsized":"2024-09-12T18:36:10.196685+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'331","last_scrub_stamp":"2024-09-12T18:36:10.196408+0000","last_deep_scrub":"268'331","last_deep_scrub_stamp":"2024-09-12T18:36:10.196408+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.196408+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:20.172679+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9953582,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":23680,"num_write":1025,"num_write_kb":41122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'721","reported_seq":2427,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.096925+0000","last_change":"2024-09-12T18:36:15.096925+0000","last_active":"2024-09-12T18:36:15.096925+0000","last_peered":"2024-09-12T18:36:15.096925+0000","last_clean":"2024-09-12T18:36:15.096925+0000","last_became_active":"2024-09-12T17:10:32.348200+0000","last_became_peered":"2024-09-12T17:10:32.348200+0000","last_unstale":"2024-09-12T18:36:15.096925+0000","last_undegraded":"2024-09-12T18:36:15.096925+0000","last_fullsized":"2024-09-12T18:36:15.096925+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'721","last_scrub_stamp":"2024-09-12T18:36:15.096745+0000","last_deep_scrub":"268'721","last_deep_scrub_stamp":"2024-09-12T18:36:15.096745+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.096745+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:45.902234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3587,"num_read_kb":3235,"num_write":983,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'407","reported_seq":1111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.863524+0000","last_change":"2024-09-12T18:36:13.863524+0000","last_active":"2024-09-12T18:36:13.863524+0000","last_peered":"2024-09-12T18:36:13.863524+0000","last_clean":"2024-09-12T18:36:13.863524+0000","last_became_active":"2024-09-12T17:10:30.370015+0000","last_became_peered":"2024-09-12T17:10:30.370015+0000","last_unstale":"2024-09-12T18:36:13.863524+0000","last_undegraded":"2024-09-12T18:36:13.863524+0000","last_fullsized":"2024-09-12T18:36:13.863524+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'407","last_scrub_stamp":"2024-09-12T18:36:13.863264+0000","last_deep_scrub":"268'407","last_deep_scrub_stamp":"2024-09-12T18:36:13.863264+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.863264+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:26.107432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399128,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":575,"num_read_kb":40389,"num_write":1181,"num_write_kb":51606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'836","reported_seq":2478,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.547033+0000","last_change":"2024-09-12T18:36:19.547033+0000","last_active":"2024-09-12T18:36:19.547033+0000","last_peered":"2024-09-12T18:36:19.547033+0000","last_clean":"2024-09-12T18:36:19.547033+0000","last_became_active":"2024-09-12T17:10:32.348842+0000","last_became_peered":"2024-09-12T17:10:32.348842+0000","last_unstale":"2024-09-12T18:36:19.547033+0000","last_undegraded":"2024-09-12T18:36:19.547033+0000","last_fullsized":"2024-09-12T18:36:19.547033+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'836","last_scrub_stamp":"2024-09-12T18:36:19.546818+0000","last_deep_scrub":"268'836","last_deep_scrub_stamp":"2024-09-12T18:36:19.546818+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.546818+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:47.788325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4030,"num_read_kb":3642,"num_write":1104,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'317","reported_seq":977,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.921361+0000","last_change":"2024-09-12T18:36:15.921361+0000","last_active":"2024-09-12T18:36:15.921361+0000","last_peered":"2024-09-12T18:36:15.921361+0000","last_clean":"2024-09-12T18:36:15.921361+0000","last_became_active":"2024-09-12T17:10:30.349523+0000","last_became_peered":"2024-09-12T17:10:30.349523+0000","last_unstale":"2024-09-12T18:36:15.921361+0000","last_undegraded":"2024-09-12T18:36:15.921361+0000","last_fullsized":"2024-09-12T18:36:15.921361+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'317","last_scrub_stamp":"2024-09-12T18:36:15.921079+0000","last_deep_scrub":"268'317","last_deep_scrub_stamp":"2024-09-12T18:36:15.921079+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.921079+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:36.009620+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456505,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":103976,"num_write":995,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'522","reported_seq":2361,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.976891+0000","last_change":"2024-09-12T18:36:19.976891+0000","last_active":"2024-09-12T18:36:19.976891+0000","last_peered":"2024-09-12T18:36:19.976891+0000","last_clean":"2024-09-12T18:36:19.976891+0000","last_became_active":"2024-09-12T17:10:32.362881+0000","last_became_peered":"2024-09-12T17:10:32.362881+0000","last_unstale":"2024-09-12T18:36:19.976891+0000","last_undegraded":"2024-09-12T18:36:19.976891+0000","last_fullsized":"2024-09-12T18:36:19.976891+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'522","last_scrub_stamp":"2024-09-12T18:36:19.976700+0000","last_deep_scrub":"268'522","last_deep_scrub_stamp":"2024-09-12T18:36:19.976700+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.976700+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:14.830945+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2930,"num_read_kb":2778,"num_write":610,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'363","reported_seq":1059,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.900511+0000","last_change":"2024-09-12T18:36:12.900511+0000","last_active":"2024-09-12T18:36:12.900511+0000","last_peered":"2024-09-12T18:36:12.900511+0000","last_clean":"2024-09-12T18:36:12.900511+0000","last_became_active":"2024-09-12T17:10:30.378766+0000","last_became_peered":"2024-09-12T17:10:30.378766+0000","last_unstale":"2024-09-12T18:36:12.900511+0000","last_undegraded":"2024-09-12T18:36:12.900511+0000","last_fullsized":"2024-09-12T18:36:12.900511+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-12T18:36:12.900085+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-12T18:36:12.900085+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.900085+0000","objects_scrubbed":6,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:24.060613+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102155,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":26410,"num_write":1209,"num_write_kb":29487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'526","reported_seq":2184,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.396356+0000","last_change":"2024-09-12T18:36:14.396208+0000","last_active":"2024-09-12T18:36:14.396356+0000","last_peered":"2024-09-12T18:36:14.396356+0000","last_clean":"2024-09-12T18:36:14.396356+0000","last_became_active":"2024-09-12T17:10:32.341480+0000","last_became_peered":"2024-09-12T17:10:32.341480+0000","last_unstale":"2024-09-12T18:36:14.396356+0000","last_undegraded":"2024-09-12T18:36:14.396356+0000","last_fullsized":"2024-09-12T18:36:14.396356+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'526","last_scrub_stamp":"2024-09-12T18:36:14.396018+0000","last_deep_scrub":"268'526","last_deep_scrub_stamp":"2024-09-12T18:36:14.396018+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.396018+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:55.035930+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2856,"num_read_kb":2663,"num_write":671,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'349","reported_seq":1107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.956802+0000","last_change":"2024-09-12T18:36:16.956802+0000","last_active":"2024-09-12T18:36:16.956802+0000","last_peered":"2024-09-12T18:36:16.956802+0000","last_clean":"2024-09-12T18:36:16.956802+0000","last_became_active":"2024-09-12T17:10:30.404567+0000","last_became_peered":"2024-09-12T17:10:30.404567+0000","last_unstale":"2024-09-12T18:36:16.956802+0000","last_undegraded":"2024-09-12T18:36:16.956802+0000","last_fullsized":"2024-09-12T18:36:16.956802+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-12T18:36:16.956584+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-12T18:36:16.956584+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.956584+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:29.404555+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":789,"num_read_kb":46887,"num_write":1083,"num_write_kb":42596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'381","reported_seq":1788,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.997849+0000","last_change":"2024-09-12T18:36:20.997849+0000","last_active":"2024-09-12T18:36:20.997849+0000","last_peered":"2024-09-12T18:36:20.997849+0000","last_clean":"2024-09-12T18:36:20.997849+0000","last_became_active":"2024-09-12T17:10:32.370799+0000","last_became_peered":"2024-09-12T17:10:32.370799+0000","last_unstale":"2024-09-12T18:36:20.997849+0000","last_undegraded":"2024-09-12T18:36:20.997849+0000","last_fullsized":"2024-09-12T18:36:20.997849+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'381","last_scrub_stamp":"2024-09-12T18:36:20.997632+0000","last_deep_scrub":"268'381","last_deep_scrub_stamp":"2024-09-12T18:36:20.997632+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.997632+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:50.639762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2049,"num_read_kb":1938,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'327","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.593784+0000","last_change":"2024-09-12T18:36:14.593784+0000","last_active":"2024-09-12T18:36:14.593784+0000","last_peered":"2024-09-12T18:36:14.593784+0000","last_clean":"2024-09-12T18:36:14.593784+0000","last_became_active":"2024-09-12T17:10:30.374689+0000","last_became_peered":"2024-09-12T17:10:30.374689+0000","last_unstale":"2024-09-12T18:36:14.593784+0000","last_undegraded":"2024-09-12T18:36:14.593784+0000","last_fullsized":"2024-09-12T18:36:14.593784+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'327","last_scrub_stamp":"2024-09-12T18:36:14.593513+0000","last_deep_scrub":"268'327","last_deep_scrub_stamp":"2024-09-12T18:36:14.593513+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.593513+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:28.532832+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7813717,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":410,"num_read_kb":28127,"num_write":1070,"num_write_kb":52007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1587","reported_seq":3075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.983176+0000","last_change":"2024-09-12T18:36:21.983176+0000","last_active":"2024-09-12T18:36:21.983176+0000","last_peered":"2024-09-12T18:36:21.983176+0000","last_clean":"2024-09-12T18:36:21.983176+0000","last_became_active":"2024-09-12T17:10:32.384842+0000","last_became_peered":"2024-09-12T17:10:32.384842+0000","last_unstale":"2024-09-12T18:36:21.983176+0000","last_undegraded":"2024-09-12T18:36:21.983176+0000","last_fullsized":"2024-09-12T18:36:21.983176+0000","mapping_epoch":27,"log_start":"268'1500","ondisk_log_start":"268'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1587","last_scrub_stamp":"2024-09-12T18:36:21.982944+0000","last_deep_scrub":"268'1587","last_deep_scrub_stamp":"2024-09-12T18:36:21.982944+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.982944+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":1500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:29.105970+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6992,"num_read_kb":6083,"num_write":2272,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1264,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'489","reported_seq":1308,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.175743+0000","last_change":"2024-09-12T18:36:11.175743+0000","last_active":"2024-09-12T18:36:11.175743+0000","last_peered":"2024-09-12T18:36:11.175743+0000","last_clean":"2024-09-12T18:36:11.175743+0000","last_became_active":"2024-09-12T17:12:05.372879+0000","last_became_peered":"2024-09-12T17:12:05.372879+0000","last_unstale":"2024-09-12T18:36:11.175743+0000","last_undegraded":"2024-09-12T18:36:11.175743+0000","last_fullsized":"2024-09-12T18:36:11.175743+0000","mapping_epoch":40,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'489","last_scrub_stamp":"2024-09-12T18:36:11.175471+0000","last_deep_scrub":"268'489","last_deep_scrub_stamp":"2024-09-12T18:36:11.175471+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.175471+0000","objects_scrubbed":6,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:34.394103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":953,"num_read_kb":72647,"num_write":1674,"num_write_kb":47468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,0],"acting":[6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'1144","reported_seq":2659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.593697+0000","last_change":"2024-09-12T18:36:22.593697+0000","last_active":"2024-09-12T18:36:22.593697+0000","last_peered":"2024-09-12T18:36:22.593697+0000","last_clean":"2024-09-12T18:36:22.593697+0000","last_became_active":"2024-09-12T17:10:32.361416+0000","last_became_peered":"2024-09-12T17:10:32.361416+0000","last_unstale":"2024-09-12T18:36:22.593697+0000","last_undegraded":"2024-09-12T18:36:22.593697+0000","last_fullsized":"2024-09-12T18:36:22.593697+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1144","last_scrub_stamp":"2024-09-12T18:36:22.593502+0000","last_deep_scrub":"268'1144","last_deep_scrub_stamp":"2024-09-12T18:36:22.593502+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.593502+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":1100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:36.821997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5102,"num_read_kb":4502,"num_write":1588,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'428","reported_seq":1230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.909977+0000","last_change":"2024-09-12T18:36:19.909819+0000","last_active":"2024-09-12T18:36:19.909977+0000","last_peered":"2024-09-12T18:36:19.909977+0000","last_clean":"2024-09-12T18:36:19.909977+0000","last_became_active":"2024-09-12T17:10:30.404403+0000","last_became_peered":"2024-09-12T17:10:30.404403+0000","last_unstale":"2024-09-12T18:36:19.909977+0000","last_undegraded":"2024-09-12T18:36:19.909977+0000","last_fullsized":"2024-09-12T18:36:19.909977+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'428","last_scrub_stamp":"2024-09-12T18:36:19.909576+0000","last_deep_scrub":"268'428","last_deep_scrub_stamp":"2024-09-12T18:36:19.909576+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.909576+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:04.500862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":773,"num_read_kb":38616,"num_write":1272,"num_write_kb":36952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'389","reported_seq":1946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:20.526147+0000","last_change":"2024-09-12T17:10:32.353298+0000","last_active":"2024-09-12T18:35:20.526147+0000","last_peered":"2024-09-12T18:35:20.526147+0000","last_clean":"2024-09-12T18:35:20.526147+0000","last_became_active":"2024-09-12T17:10:32.352916+0000","last_became_peered":"2024-09-12T17:10:32.352916+0000","last_unstale":"2024-09-12T18:35:20.526147+0000","last_undegraded":"2024-09-12T18:35:20.526147+0000","last_fullsized":"2024-09-12T18:35:20.526147+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:31.317597+0000","last_clean_scrub_stamp":"2024-09-12T17:10:31.317597+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:14.122659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2283,"num_read_kb":2176,"num_write":460,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'343","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.345942+0000","last_change":"2024-09-12T18:36:09.345942+0000","last_active":"2024-09-12T18:36:09.345942+0000","last_peered":"2024-09-12T18:36:09.345942+0000","last_clean":"2024-09-12T18:36:09.345942+0000","last_became_active":"2024-09-12T17:10:30.402024+0000","last_became_peered":"2024-09-12T17:10:30.402024+0000","last_unstale":"2024-09-12T18:36:09.345942+0000","last_undegraded":"2024-09-12T18:36:09.345942+0000","last_fullsized":"2024-09-12T18:36:09.345942+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'343","last_scrub_stamp":"2024-09-12T18:36:09.345594+0000","last_deep_scrub":"268'343","last_deep_scrub_stamp":"2024-09-12T18:36:09.345594+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.345594+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:30.257704+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048602,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":454,"num_read_kb":33472,"num_write":1006,"num_write_kb":44244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'833","reported_seq":2409,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.932561+0000","last_change":"2024-09-12T18:36:25.932561+0000","last_active":"2024-09-12T18:36:25.932561+0000","last_peered":"2024-09-12T18:36:25.932561+0000","last_clean":"2024-09-12T18:36:25.932561+0000","last_became_active":"2024-09-12T17:10:32.375891+0000","last_became_peered":"2024-09-12T17:10:32.375891+0000","last_unstale":"2024-09-12T18:36:25.932561+0000","last_undegraded":"2024-09-12T18:36:25.932561+0000","last_fullsized":"2024-09-12T18:36:25.932561+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'833","last_scrub_stamp":"2024-09-12T18:36:25.932381+0000","last_deep_scrub":"268'833","last_deep_scrub_stamp":"2024-09-12T18:36:25.932381+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.932381+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:14.640927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3808,"num_read_kb":3437,"num_write":1089,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'407","reported_seq":1137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.991189+0000","last_change":"2024-09-12T18:36:17.991189+0000","last_active":"2024-09-12T18:36:17.991189+0000","last_peered":"2024-09-12T18:36:17.991189+0000","last_clean":"2024-09-12T18:36:17.991189+0000","last_became_active":"2024-09-12T17:10:30.378109+0000","last_became_peered":"2024-09-12T17:10:30.378109+0000","last_unstale":"2024-09-12T18:36:17.991189+0000","last_undegraded":"2024-09-12T18:36:17.991189+0000","last_fullsized":"2024-09-12T18:36:17.991189+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'407","last_scrub_stamp":"2024-09-12T18:36:17.990804+0000","last_deep_scrub":"268'407","last_deep_scrub_stamp":"2024-09-12T18:36:17.990804+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.990804+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:07.244535+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505043,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":645,"num_read_kb":82540,"num_write":1282,"num_write_kb":46419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'405","reported_seq":1092,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.986000+0000","last_change":"2024-09-12T18:36:19.986000+0000","last_active":"2024-09-12T18:36:19.986000+0000","last_peered":"2024-09-12T18:36:19.986000+0000","last_clean":"2024-09-12T18:36:19.986000+0000","last_became_active":"2024-09-12T17:10:30.356199+0000","last_became_peered":"2024-09-12T17:10:30.356199+0000","last_unstale":"2024-09-12T18:36:19.986000+0000","last_undegraded":"2024-09-12T18:36:19.986000+0000","last_fullsized":"2024-09-12T18:36:19.986000+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'405","last_scrub_stamp":"2024-09-12T18:36:19.985773+0000","last_deep_scrub":"268'405","last_deep_scrub_stamp":"2024-09-12T18:36:19.985773+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.985773+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:53.434690+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4401467,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":595,"num_read_kb":25748,"num_write":1241,"num_write_kb":44098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'463","reported_seq":2259,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.568220+0000","last_change":"2024-09-12T18:36:20.568220+0000","last_active":"2024-09-12T18:36:20.568220+0000","last_peered":"2024-09-12T18:36:20.568220+0000","last_clean":"2024-09-12T18:36:20.568220+0000","last_became_active":"2024-09-12T17:10:32.349687+0000","last_became_peered":"2024-09-12T17:10:32.349687+0000","last_unstale":"2024-09-12T18:36:20.568220+0000","last_undegraded":"2024-09-12T18:36:20.568220+0000","last_fullsized":"2024-09-12T18:36:20.568220+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'463","last_scrub_stamp":"2024-09-12T18:36:20.568016+0000","last_deep_scrub":"268'463","last_deep_scrub_stamp":"2024-09-12T18:36:20.568016+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.568016+0000","objects_scrubbed":6,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:18.504326+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2918,"num_read_kb":2789,"num_write":551,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'377","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.921872+0000","last_change":"2024-09-12T18:36:11.921872+0000","last_active":"2024-09-12T18:36:11.921872+0000","last_peered":"2024-09-12T18:36:11.921872+0000","last_clean":"2024-09-12T18:36:11.921872+0000","last_became_active":"2024-09-12T17:11:05.121473+0000","last_became_peered":"2024-09-12T17:11:05.121473+0000","last_unstale":"2024-09-12T18:36:11.921872+0000","last_undegraded":"2024-09-12T18:36:11.921872+0000","last_fullsized":"2024-09-12T18:36:11.921872+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'377","last_scrub_stamp":"2024-09-12T18:36:11.921663+0000","last_deep_scrub":"268'377","last_deep_scrub_stamp":"2024-09-12T18:36:11.921663+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.921663+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:06.622722+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574022,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":29048,"num_write":1222,"num_write_kb":43104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'469","reported_seq":1973,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.000255+0000","last_change":"2024-09-12T18:36:26.000255+0000","last_active":"2024-09-12T18:36:26.000255+0000","last_peered":"2024-09-12T18:36:26.000255+0000","last_clean":"2024-09-12T18:36:26.000255+0000","last_became_active":"2024-09-12T17:10:32.352369+0000","last_became_peered":"2024-09-12T17:10:32.352369+0000","last_unstale":"2024-09-12T18:36:26.000255+0000","last_undegraded":"2024-09-12T18:36:26.000255+0000","last_fullsized":"2024-09-12T18:36:26.000255+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'469","last_scrub_stamp":"2024-09-12T18:36:25.999980+0000","last_deep_scrub":"268'469","last_deep_scrub_stamp":"2024-09-12T18:36:25.999980+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.999980+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:32.160700+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2354,"num_read_kb":2191,"num_write":554,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6108,"num_read_kb":4244,"num_write":1960,"num_write_kb":858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1131,"ondisk_log_size":1131,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":16274,"num_read_kb":15945,"num_write":16744,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1671,"ondisk_log_size":1671,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":731,"ondisk_log_size":731,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1625724,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":19494,"num_read_kb":40096,"num_write":16267,"num_write_kb":12112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1963,"ondisk_log_size":1963,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":213001,"num_read_kb":194600,"num_write":55405,"num_write_kb":18906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34456,"num_omap_keys":140,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3821,"ondisk_log_size":3821,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":165322276,"num_objects":398,"num_object_clones":0,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":0,"num_read":36558,"num_read_kb":2308341,"num_write":72533,"num_write_kb":2504748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":249851904,"data_stored":249851904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3895,"ondisk_log_size":3895,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":159116,"num_write":182,"num_write_kb":116497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":158495,"num_write":182,"num_write_kb":116497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510478,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":340376,"kb_used_data":52360,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94031464,"statfs":{"total":96636764160,"available":96288219136,"internally_reserved":0,"allocated":53616640,"data_stored":51463722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":294910410},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510482,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299236,"kb_used_data":33428,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94072604,"statfs":{"total":96636764160,"available":96330346496,"internally_reserved":0,"allocated":34230272,"data_stored":32143073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":272169414},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510479,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":178948,"kb_used_data":31220,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94192892,"statfs":{"total":96636764160,"available":96453521408,"internally_reserved":0,"allocated":31969280,"data_stored":29799186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510481,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130944,"kb_used_data":23408,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94240896,"statfs":{"total":96636764160,"available":96502677504,"internally_reserved":0,"allocated":23969792,"data_stored":21888023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510482,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209668,"kb_used_data":25844,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94162172,"statfs":{"total":96636764160,"available":96422064128,"internally_reserved":0,"allocated":26464256,"data_stored":24357991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510479,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302280,"kb_used_data":36472,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94069560,"statfs":{"total":96636764160,"available":96327229440,"internally_reserved":0,"allocated":37347328,"data_stored":35205199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":272169414},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543185,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":156180,"kb_used_data":40324,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94215660,"statfs":{"total":96636764160,"available":96476835840,"internally_reserved":0,"allocated":41291776,"data_stored":39213361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118618565},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575886,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320580,"kb_used_data":36724,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94051260,"statfs":{"total":96636764160,"available":96308490240,"internally_reserved":0,"allocated":37605376,"data_stored":35472167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32301056,"data_stored":32301056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22044672,"data_stored":22044672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19574784,"data_stored":19574784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33157120,"data_stored":33157120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36900864,"data_stored":36900864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":27484160,"data_stored":27484160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29831168,"data_stored":29831168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":48558080,"data_stored":48558080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:36:29.186 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.187 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.187 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.187 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.187 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.187 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.187 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.187 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.187 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.188 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.188 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.188 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.188 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.188 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.188 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.188 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.188 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.188 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.189 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.189 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.189 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.189 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.189 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.189 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.189 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.189 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.189 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.190 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.190 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.190 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.190 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.190 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.190 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.190 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.190 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.191 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.191 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.191 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.191 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.191 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.191 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.191 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.191 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.192 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.192 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.192 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.192 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.192 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.192 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.192 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.192 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.193 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.193 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.193 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.193 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.193 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.193 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.193 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.193 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.193 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.194 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.194 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.194 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.194 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.194 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.194 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.194 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.194 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.194 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.195 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.195 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.195 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.195 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.195 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.195 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.195 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.195 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.195 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.196 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.196 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.196 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.196 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.196 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.196 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.196 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.196 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.196 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.196 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.197 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.197 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.197 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.197 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.197 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.197 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.197 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.197 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.197 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.198 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.198 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.198 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.198 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.198 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.198 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.198 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.198 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.198 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.199 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.199 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.199 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.199 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.199 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.199 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.199 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.199 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.199 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.200 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.200 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.200 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.200 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.200 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.200 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.200 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.200 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.200 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.201 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.201 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.201 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.201 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.201 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.201 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.201 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.202 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.202 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.202 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.202 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.202 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.203 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.203 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.203 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.203 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.203 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.203 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.203 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.203 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.204 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.204 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.204 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.204 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.204 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.204 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.204 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.204 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.205 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.205 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.205 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.205 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.205 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.205 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.206 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.206 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.206 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.206 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.206 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.206 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.206 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.206 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.207 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.207 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.207 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.207 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.207 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.207 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.208 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.208 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.208 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.208 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.208 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.208 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.208 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.208 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.209 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.209 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.209 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.209 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.209 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.209 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.209 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.210 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.210 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.210 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.210 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.210 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.210 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.210 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.210 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.210 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.211 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.211 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.211 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.211 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.211 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.211 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.211 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.212 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.212 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.212 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.212 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.212 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.213 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.213 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.213 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.213 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.213 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.213 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.213 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.214 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.214 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.214 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.214 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.214 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.214 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.214 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.214 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.215 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.215 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.215 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.215 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.215 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:10:33.324157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.215 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.215 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.216 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.216 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:10:35.353197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.216 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:10:37.365462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.216 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.216 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.217 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.217 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:10:31.317597+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:29.217 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:36:49.218 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:36:49.594 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:36:49.607 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T18:36:49.617 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":2859,"stamp":"2024-09-12T18:36:48.876978+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":167556499,"num_objects":881,"num_object_clones":0,"num_object_copies":2160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":881,"num_whiteouts":0,"num_read":294260,"num_read_kb":2883804,"num_write":163416,"num_write_kb":2776168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":213,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":736417,"num_omap_keys":1774,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13641,"ondisk_log_size":13641,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1925732,"kb_used_data":279780,"kb_used_omap":12,"kb_used_meta":1645811,"kb_avail":753048988,"statfs":{"total":773094113280,"available":771122163712,"internally_reserved":0,"allocated":286494720,"data_stored":269542722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1685311025},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6718,"num_omap_keys":23,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009604"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.416560+0000","last_change":"2024-09-12T17:53:27.147438+0000","last_active":"2024-09-12T18:33:26.416560+0000","last_peered":"2024-09-12T18:33:26.416560+0000","last_clean":"2024-09-12T18:33:26.416560+0000","last_became_active":"2024-09-12T17:53:27.146780+0000","last_became_peered":"2024-09-12T17:53:27.146780+0000","last_unstale":"2024-09-12T18:33:26.416560+0000","last_undegraded":"2024-09-12T18:33:26.416560+0000","last_fullsized":"2024-09-12T18:33:26.416560+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:27.271555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"268'11","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.268205+0000","last_change":"2024-09-12T17:31:16.246161+0000","last_active":"2024-09-12T18:35:59.268205+0000","last_peered":"2024-09-12T18:35:59.268205+0000","last_clean":"2024-09-12T18:35:59.268205+0000","last_became_active":"2024-09-12T17:31:16.245482+0000","last_became_peered":"2024-09-12T17:31:16.245482+0000","last_unstale":"2024-09-12T18:35:59.268205+0000","last_undegraded":"2024-09-12T18:35:59.268205+0000","last_fullsized":"2024-09-12T18:35:59.268205+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5245,"num_write":16,"num_write_kb":2121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:44.419803+0000","last_change":"2024-09-12T17:31:12.096770+0000","last_active":"2024-09-12T18:33:44.419803+0000","last_peered":"2024-09-12T18:33:44.419803+0000","last_clean":"2024-09-12T18:33:44.419803+0000","last_became_active":"2024-09-12T17:31:12.094935+0000","last_became_peered":"2024-09-12T17:31:12.094935+0000","last_unstale":"2024-09-12T18:33:44.419803+0000","last_undegraded":"2024-09-12T18:33:44.419803+0000","last_fullsized":"2024-09-12T18:33:44.419803+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'30","reported_seq":144,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:16.429684+0000","last_change":"2024-09-12T17:27:32.584697+0000","last_active":"2024-09-12T18:34:16.429684+0000","last_peered":"2024-09-12T18:34:16.429684+0000","last_clean":"2024-09-12T18:34:16.429684+0000","last_became_active":"2024-09-12T17:27:32.583903+0000","last_became_peered":"2024-09-12T17:27:32.583903+0000","last_unstale":"2024-09-12T18:34:16.429684+0000","last_undegraded":"2024-09-12T18:34:16.429684+0000","last_fullsized":"2024-09-12T18:34:16.429684+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":98,"num_write":57,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.331440+0000","last_change":"2024-09-12T18:36:38.331440+0000","last_active":"2024-09-12T18:36:38.331440+0000","last_peered":"2024-09-12T18:36:38.331440+0000","last_clean":"2024-09-12T18:36:38.331440+0000","last_became_active":"2024-09-12T17:53:27.167810+0000","last_became_peered":"2024-09-12T17:53:27.167810+0000","last_unstale":"2024-09-12T18:36:38.331440+0000","last_undegraded":"2024-09-12T18:36:38.331440+0000","last_fullsized":"2024-09-12T18:36:38.331440+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:38.331269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:38.331269+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.331269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:08.481081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'7","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.264378+0000","last_change":"2024-09-12T17:31:16.238350+0000","last_active":"2024-09-12T18:36:00.264378+0000","last_peered":"2024-09-12T18:36:00.264378+0000","last_clean":"2024-09-12T18:36:00.264378+0000","last_became_active":"2024-09-12T17:31:16.237721+0000","last_became_peered":"2024-09-12T17:31:16.237721+0000","last_unstale":"2024-09-12T18:36:00.264378+0000","last_undegraded":"2024-09-12T18:36:00.264378+0000","last_fullsized":"2024-09-12T18:36:00.264378+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'2","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.813987+0000","last_change":"2024-09-12T18:36:32.813987+0000","last_active":"2024-09-12T18:36:32.813987+0000","last_peered":"2024-09-12T18:36:32.813987+0000","last_clean":"2024-09-12T18:36:32.813987+0000","last_became_active":"2024-09-12T17:31:12.105548+0000","last_became_peered":"2024-09-12T17:31:12.105548+0000","last_unstale":"2024-09-12T18:36:32.813987+0000","last_undegraded":"2024-09-12T18:36:32.813987+0000","last_fullsized":"2024-09-12T18:36:32.813987+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:36:32.813796+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:36:32.813796+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.813796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:48.755340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'16","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.518979+0000","last_change":"2024-09-12T18:36:30.518979+0000","last_active":"2024-09-12T18:36:30.518979+0000","last_peered":"2024-09-12T18:36:30.518979+0000","last_clean":"2024-09-12T18:36:30.518979+0000","last_became_active":"2024-09-12T17:27:32.563281+0000","last_became_peered":"2024-09-12T17:27:32.563281+0000","last_unstale":"2024-09-12T18:36:30.518979+0000","last_undegraded":"2024-09-12T18:36:30.518979+0000","last_fullsized":"2024-09-12T18:36:30.518979+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-09-12T18:36:30.518795+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-09-12T18:36:30.518795+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.518795+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:53.495286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.190836+0000","last_change":"2024-09-12T18:36:43.190836+0000","last_active":"2024-09-12T18:36:43.190836+0000","last_peered":"2024-09-12T18:36:43.190836+0000","last_clean":"2024-09-12T18:36:43.190836+0000","last_became_active":"2024-09-12T17:53:27.143812+0000","last_became_peered":"2024-09-12T17:53:27.143812+0000","last_unstale":"2024-09-12T18:36:43.190836+0000","last_undegraded":"2024-09-12T18:36:43.190836+0000","last_fullsized":"2024-09-12T18:36:43.190836+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:43.190659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:43.190659+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.190659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:00.740038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:46.422572+0000","last_change":"2024-09-12T17:31:16.209712+0000","last_active":"2024-09-12T18:33:46.422572+0000","last_peered":"2024-09-12T18:33:46.422572+0000","last_clean":"2024-09-12T18:33:46.422572+0000","last_became_active":"2024-09-12T17:31:16.208994+0000","last_became_peered":"2024-09-12T17:31:16.208994+0000","last_unstale":"2024-09-12T18:33:46.422572+0000","last_undegraded":"2024-09-12T18:33:46.422572+0000","last_fullsized":"2024-09-12T18:33:46.422572+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:21.511571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'15","reported_seq":94,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.418411+0000","last_change":"2024-09-12T18:36:35.418411+0000","last_active":"2024-09-12T18:36:35.418411+0000","last_peered":"2024-09-12T18:36:35.418411+0000","last_clean":"2024-09-12T18:36:35.418411+0000","last_became_active":"2024-09-12T17:31:12.090602+0000","last_became_peered":"2024-09-12T17:31:12.090602+0000","last_unstale":"2024-09-12T18:36:35.418411+0000","last_undegraded":"2024-09-12T18:36:35.418411+0000","last_fullsized":"2024-09-12T18:36:35.418411+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'15","last_scrub_stamp":"2024-09-12T18:36:35.418214+0000","last_deep_scrub":"268'15","last_deep_scrub_stamp":"2024-09-12T18:36:35.418214+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.418214+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:59.377552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10290,"num_write":20,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'40","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.408679+0000","last_change":"2024-09-12T17:27:32.554962+0000","last_active":"2024-09-12T18:32:36.408679+0000","last_peered":"2024-09-12T18:32:36.408679+0000","last_clean":"2024-09-12T18:32:36.408679+0000","last_became_active":"2024-09-12T17:27:32.554228+0000","last_became_peered":"2024-09-12T17:27:32.554228+0000","last_unstale":"2024-09-12T18:32:36.408679+0000","last_undegraded":"2024-09-12T18:32:36.408679+0000","last_fullsized":"2024-09-12T18:32:36.408679+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:30.083918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":136,"num_write":75,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:19.399599+0000","last_change":"2024-09-12T17:53:27.171122+0000","last_active":"2024-09-12T18:32:19.399599+0000","last_peered":"2024-09-12T18:32:19.399599+0000","last_clean":"2024-09-12T18:32:19.399599+0000","last_became_active":"2024-09-12T17:53:27.165849+0000","last_became_peered":"2024-09-12T17:53:27.165849+0000","last_unstale":"2024-09-12T18:32:19.399599+0000","last_undegraded":"2024-09-12T18:32:19.399599+0000","last_fullsized":"2024-09-12T18:32:19.399599+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:27.566630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"268'7","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:34.443405+0000","last_change":"2024-09-12T17:31:16.234725+0000","last_active":"2024-09-12T18:35:34.443405+0000","last_peered":"2024-09-12T18:35:34.443405+0000","last_clean":"2024-09-12T18:35:34.443405+0000","last_became_active":"2024-09-12T17:31:16.233989+0000","last_became_peered":"2024-09-12T17:31:16.233989+0000","last_unstale":"2024-09-12T18:35:34.443405+0000","last_undegraded":"2024-09-12T18:35:34.443405+0000","last_fullsized":"2024-09-12T18:35:34.443405+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:22.667547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'10","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.388434+0000","last_change":"2024-09-12T17:31:12.078149+0000","last_active":"2024-09-12T18:35:59.388434+0000","last_peered":"2024-09-12T18:35:59.388434+0000","last_clean":"2024-09-12T18:35:59.388434+0000","last_became_active":"2024-09-12T17:31:12.076980+0000","last_became_peered":"2024-09-12T17:31:12.076980+0000","last_unstale":"2024-09-12T18:35:59.388434+0000","last_undegraded":"2024-09-12T18:35:59.388434+0000","last_fullsized":"2024-09-12T18:35:59.388434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:20.927562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11264,"num_write":20,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'22","reported_seq":123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403144+0000","last_change":"2024-09-12T17:27:32.597852+0000","last_active":"2024-09-12T18:32:34.403144+0000","last_peered":"2024-09-12T18:32:34.403144+0000","last_clean":"2024-09-12T18:32:34.403144+0000","last_became_active":"2024-09-12T17:27:32.597092+0000","last_became_peered":"2024-09-12T17:27:32.597092+0000","last_unstale":"2024-09-12T18:32:34.403144+0000","last_undegraded":"2024-09-12T18:32:34.403144+0000","last_fullsized":"2024-09-12T18:32:34.403144+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:46.150508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":80,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.418737+0000","last_change":"2024-09-12T17:53:27.172827+0000","last_active":"2024-09-12T18:33:39.418737+0000","last_peered":"2024-09-12T18:33:39.418737+0000","last_clean":"2024-09-12T18:33:39.418737+0000","last_became_active":"2024-09-12T17:53:27.166248+0000","last_became_peered":"2024-09-12T17:53:27.166248+0000","last_unstale":"2024-09-12T18:33:39.418737+0000","last_undegraded":"2024-09-12T18:33:39.418737+0000","last_fullsized":"2024-09-12T18:33:39.418737+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:16.950414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:01.396099+0000","last_change":"2024-09-12T17:32:06.560970+0000","last_active":"2024-09-12T18:32:01.396099+0000","last_peered":"2024-09-12T18:32:01.396099+0000","last_clean":"2024-09-12T18:32:01.396099+0000","last_became_active":"2024-09-12T17:32:06.560465+0000","last_became_peered":"2024-09-12T17:32:06.560465+0000","last_unstale":"2024-09-12T18:32:01.396099+0000","last_undegraded":"2024-09-12T18:32:01.396099+0000","last_fullsized":"2024-09-12T18:32:01.396099+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:44.091888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'8","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.853947+0000","last_change":"2024-09-12T17:31:12.068624+0000","last_active":"2024-09-12T18:36:00.853947+0000","last_peered":"2024-09-12T18:36:00.853947+0000","last_clean":"2024-09-12T18:36:00.853947+0000","last_became_active":"2024-09-12T17:31:12.067819+0000","last_became_peered":"2024-09-12T17:31:12.067819+0000","last_unstale":"2024-09-12T18:36:00.853947+0000","last_undegraded":"2024-09-12T18:36:00.853947+0000","last_fullsized":"2024-09-12T18:36:00.853947+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":19458,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'26","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.403079+0000","last_change":"2024-09-12T17:27:32.591166+0000","last_active":"2024-09-12T18:32:34.403079+0000","last_peered":"2024-09-12T18:32:34.403079+0000","last_clean":"2024-09-12T18:32:34.403079+0000","last_became_active":"2024-09-12T17:27:32.578575+0000","last_became_peered":"2024-09-12T17:27:32.578575+0000","last_unstale":"2024-09-12T18:32:34.403079+0000","last_undegraded":"2024-09-12T18:32:34.403079+0000","last_fullsized":"2024-09-12T18:32:34.403079+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:56.541481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":95,"num_write":44,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.642338+0000","last_change":"2024-09-12T17:53:27.156978+0000","last_active":"2024-09-12T18:33:01.642338+0000","last_peered":"2024-09-12T18:33:01.642338+0000","last_clean":"2024-09-12T18:33:01.642338+0000","last_became_active":"2024-09-12T17:53:27.156155+0000","last_became_peered":"2024-09-12T17:53:27.156155+0000","last_unstale":"2024-09-12T18:33:01.642338+0000","last_undegraded":"2024-09-12T18:33:01.642338+0000","last_fullsized":"2024-09-12T18:33:01.642338+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:51.477046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"268'2","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.162170+0000","last_change":"2024-09-12T18:36:38.162170+0000","last_active":"2024-09-12T18:36:38.162170+0000","last_peered":"2024-09-12T18:36:38.162170+0000","last_clean":"2024-09-12T18:36:38.162170+0000","last_became_active":"2024-09-12T17:31:16.226398+0000","last_became_peered":"2024-09-12T17:31:16.226398+0000","last_unstale":"2024-09-12T18:36:38.162170+0000","last_undegraded":"2024-09-12T18:36:38.162170+0000","last_fullsized":"2024-09-12T18:36:38.162170+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:38.161992+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:38.161992+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.161992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:58.585276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:00.578262+0000","last_change":"2024-09-12T17:31:12.077317+0000","last_active":"2024-09-12T18:32:00.578262+0000","last_peered":"2024-09-12T18:32:00.578262+0000","last_clean":"2024-09-12T18:32:00.578262+0000","last_became_active":"2024-09-12T17:31:12.076502+0000","last_became_peered":"2024-09-12T17:31:12.076502+0000","last_unstale":"2024-09-12T18:32:00.578262+0000","last_undegraded":"2024-09-12T18:32:00.578262+0000","last_fullsized":"2024-09-12T18:32:00.578262+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:49.794829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'36","reported_seq":165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.143323+0000","last_change":"2024-09-12T18:36:35.143323+0000","last_active":"2024-09-12T18:36:35.143323+0000","last_peered":"2024-09-12T18:36:35.143323+0000","last_clean":"2024-09-12T18:36:35.143323+0000","last_became_active":"2024-09-12T17:27:32.568740+0000","last_became_peered":"2024-09-12T17:27:32.568740+0000","last_unstale":"2024-09-12T18:36:35.143323+0000","last_undegraded":"2024-09-12T18:36:35.143323+0000","last_fullsized":"2024-09-12T18:36:35.143323+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-09-12T18:36:35.143142+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-09-12T18:36:35.143142+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.143142+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:17.123627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":126,"num_write":62,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.409921+0000","last_change":"2024-09-12T17:53:27.170601+0000","last_active":"2024-09-12T18:33:26.409921+0000","last_peered":"2024-09-12T18:33:26.409921+0000","last_clean":"2024-09-12T18:33:26.409921+0000","last_became_active":"2024-09-12T17:53:27.169805+0000","last_became_peered":"2024-09-12T17:53:27.169805+0000","last_unstale":"2024-09-12T18:33:26.409921+0000","last_undegraded":"2024-09-12T18:33:26.409921+0000","last_fullsized":"2024-09-12T18:33:26.409921+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:47.368175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"268'2","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.240019+0000","last_change":"2024-09-12T18:36:42.240019+0000","last_active":"2024-09-12T18:36:42.240019+0000","last_peered":"2024-09-12T18:36:42.240019+0000","last_clean":"2024-09-12T18:36:42.240019+0000","last_became_active":"2024-09-12T17:31:16.220449+0000","last_became_peered":"2024-09-12T17:31:16.220449+0000","last_unstale":"2024-09-12T18:36:42.240019+0000","last_undegraded":"2024-09-12T18:36:42.240019+0000","last_fullsized":"2024-09-12T18:36:42.240019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:42.239845+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:42.239845+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.239845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:07.000654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.602895+0000","last_change":"2024-09-12T17:31:12.086822+0000","last_active":"2024-09-12T18:33:45.602895+0000","last_peered":"2024-09-12T18:33:45.602895+0000","last_clean":"2024-09-12T18:33:45.602895+0000","last_became_active":"2024-09-12T17:31:12.086091+0000","last_became_peered":"2024-09-12T17:31:12.086091+0000","last_unstale":"2024-09-12T18:33:45.602895+0000","last_undegraded":"2024-09-12T18:33:45.602895+0000","last_fullsized":"2024-09-12T18:33:45.602895+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'57","reported_seq":217,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.414339+0000","last_change":"2024-09-12T17:27:32.569293+0000","last_active":"2024-09-12T18:33:06.414339+0000","last_peered":"2024-09-12T18:33:06.414339+0000","last_clean":"2024-09-12T18:33:06.414339+0000","last_became_active":"2024-09-12T17:27:32.568506+0000","last_became_peered":"2024-09-12T17:27:32.568506+0000","last_unstale":"2024-09-12T18:33:06.414339+0000","last_undegraded":"2024-09-12T18:33:06.414339+0000","last_fullsized":"2024-09-12T18:33:06.414339+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:54.976967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":207,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:26.410077+0000","last_change":"2024-09-12T17:53:27.171469+0000","last_active":"2024-09-12T18:33:26.410077+0000","last_peered":"2024-09-12T18:33:26.410077+0000","last_clean":"2024-09-12T18:33:26.410077+0000","last_became_active":"2024-09-12T17:53:27.170636+0000","last_became_peered":"2024-09-12T17:53:27.170636+0000","last_unstale":"2024-09-12T18:33:26.410077+0000","last_undegraded":"2024-09-12T18:33:26.410077+0000","last_fullsized":"2024-09-12T18:33:26.410077+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:42.171510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"268'3","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.132840+0000","last_change":"2024-09-12T17:31:16.239144+0000","last_active":"2024-09-12T18:35:59.132840+0000","last_peered":"2024-09-12T18:35:59.132840+0000","last_clean":"2024-09-12T18:35:59.132840+0000","last_became_active":"2024-09-12T17:31:16.238450+0000","last_became_peered":"2024-09-12T17:31:16.238450+0000","last_unstale":"2024-09-12T18:35:59.132840+0000","last_undegraded":"2024-09-12T18:35:59.132840+0000","last_fullsized":"2024-09-12T18:35:59.132840+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.421610+0000","last_change":"2024-09-12T17:31:12.091121+0000","last_active":"2024-09-12T18:33:41.421610+0000","last_peered":"2024-09-12T18:33:41.421610+0000","last_clean":"2024-09-12T18:33:41.421610+0000","last_became_active":"2024-09-12T17:31:12.090201+0000","last_became_peered":"2024-09-12T17:31:12.090201+0000","last_unstale":"2024-09-12T18:33:41.421610+0000","last_undegraded":"2024-09-12T18:33:41.421610+0000","last_fullsized":"2024-09-12T18:33:41.421610+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.770769+0000","last_change":"2024-09-12T18:36:39.770769+0000","last_active":"2024-09-12T18:36:39.770769+0000","last_peered":"2024-09-12T18:36:39.770769+0000","last_clean":"2024-09-12T18:36:39.770769+0000","last_became_active":"2024-09-12T17:27:32.567672+0000","last_became_peered":"2024-09-12T17:27:32.567672+0000","last_unstale":"2024-09-12T18:36:39.770769+0000","last_undegraded":"2024-09-12T18:36:39.770769+0000","last_fullsized":"2024-09-12T18:36:39.770769+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:39.770579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:39.770579+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.770579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:03.618879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.813013+0000","last_change":"2024-09-12T18:36:40.813013+0000","last_active":"2024-09-12T18:36:40.813013+0000","last_peered":"2024-09-12T18:36:40.813013+0000","last_clean":"2024-09-12T18:36:40.813013+0000","last_became_active":"2024-09-12T17:53:27.142060+0000","last_became_peered":"2024-09-12T17:53:27.142060+0000","last_unstale":"2024-09-12T18:36:40.813013+0000","last_undegraded":"2024-09-12T18:36:40.813013+0000","last_fullsized":"2024-09-12T18:36:40.813013+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:40.812833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:40.812833+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.812833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:17.096207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"268'5","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.847623+0000","last_change":"2024-09-12T17:31:16.235658+0000","last_active":"2024-09-12T18:35:59.847623+0000","last_peered":"2024-09-12T18:35:59.847623+0000","last_clean":"2024-09-12T18:35:59.847623+0000","last_became_active":"2024-09-12T17:31:16.228226+0000","last_became_peered":"2024-09-12T17:31:16.228226+0000","last_unstale":"2024-09-12T18:35:59.847623+0000","last_undegraded":"2024-09-12T18:35:59.847623+0000","last_fullsized":"2024-09-12T18:35:59.847623+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1072,"num_write":10,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'5","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:31.431352+0000","last_change":"2024-09-12T17:31:12.091577+0000","last_active":"2024-09-12T18:34:31.431352+0000","last_peered":"2024-09-12T18:34:31.431352+0000","last_clean":"2024-09-12T18:34:31.431352+0000","last_became_active":"2024-09-12T17:31:12.090779+0000","last_became_peered":"2024-09-12T17:31:12.090779+0000","last_unstale":"2024-09-12T18:34:31.431352+0000","last_undegraded":"2024-09-12T18:34:31.431352+0000","last_fullsized":"2024-09-12T18:34:31.431352+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:37.345815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'62","reported_seq":234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.411872+0000","last_change":"2024-09-12T17:27:32.571784+0000","last_active":"2024-09-12T18:32:51.411872+0000","last_peered":"2024-09-12T18:32:51.411872+0000","last_clean":"2024-09-12T18:32:51.411872+0000","last_became_active":"2024-09-12T17:27:32.567884+0000","last_became_peered":"2024-09-12T17:27:32.567884+0000","last_unstale":"2024-09-12T18:32:51.411872+0000","last_undegraded":"2024-09-12T18:32:51.411872+0000","last_fullsized":"2024-09-12T18:32:51.411872+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:13.840706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":230,"num_write":101,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.369481+0000","last_change":"2024-09-12T18:36:37.369481+0000","last_active":"2024-09-12T18:36:37.369481+0000","last_peered":"2024-09-12T18:36:37.369481+0000","last_clean":"2024-09-12T18:36:37.369481+0000","last_became_active":"2024-09-12T17:53:27.139551+0000","last_became_peered":"2024-09-12T17:53:27.139551+0000","last_unstale":"2024-09-12T18:36:37.369481+0000","last_undegraded":"2024-09-12T18:36:37.369481+0000","last_fullsized":"2024-09-12T18:36:37.369481+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:37.369267+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:37.369267+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.369267+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:04.544870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'3","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:14.398487+0000","last_change":"2024-09-12T17:31:16.237383+0000","last_active":"2024-09-12T18:32:14.398487+0000","last_peered":"2024-09-12T18:32:14.398487+0000","last_clean":"2024-09-12T18:32:14.398487+0000","last_became_active":"2024-09-12T17:31:16.236796+0000","last_became_peered":"2024-09-12T17:31:16.236796+0000","last_unstale":"2024-09-12T18:32:14.398487+0000","last_undegraded":"2024-09-12T18:32:14.398487+0000","last_fullsized":"2024-09-12T18:32:14.398487+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:49.523071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'4","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.938902+0000","last_change":"2024-09-12T17:31:12.093519+0000","last_active":"2024-09-12T18:35:59.938902+0000","last_peered":"2024-09-12T18:35:59.938902+0000","last_clean":"2024-09-12T18:35:59.938902+0000","last_became_active":"2024-09-12T17:31:12.092655+0000","last_became_peered":"2024-09-12T17:31:12.092655+0000","last_unstale":"2024-09-12T18:35:59.938902+0000","last_undegraded":"2024-09-12T18:35:59.938902+0000","last_fullsized":"2024-09-12T18:35:59.938902+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'23","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:49.407673+0000","last_change":"2024-09-12T17:27:32.579819+0000","last_active":"2024-09-12T18:32:49.407673+0000","last_peered":"2024-09-12T18:32:49.407673+0000","last_clean":"2024-09-12T18:32:49.407673+0000","last_became_active":"2024-09-12T17:27:32.578393+0000","last_became_peered":"2024-09-12T17:27:32.578393+0000","last_unstale":"2024-09-12T18:32:49.407673+0000","last_undegraded":"2024-09-12T18:32:49.407673+0000","last_fullsized":"2024-09-12T18:32:49.407673+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:12.325555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":84,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.404631+0000","last_change":"2024-09-12T17:53:27.151852+0000","last_active":"2024-09-12T18:33:06.404631+0000","last_peered":"2024-09-12T18:33:06.404631+0000","last_clean":"2024-09-12T18:33:06.404631+0000","last_became_active":"2024-09-12T17:53:27.142159+0000","last_became_peered":"2024-09-12T17:53:27.142159+0000","last_unstale":"2024-09-12T18:33:06.404631+0000","last_undegraded":"2024-09-12T18:33:06.404631+0000","last_fullsized":"2024-09-12T18:33:06.404631+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:32.788357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.132746+0000","last_change":"2024-09-12T17:31:16.237254+0000","last_active":"2024-09-12T18:35:59.132746+0000","last_peered":"2024-09-12T18:35:59.132746+0000","last_clean":"2024-09-12T18:35:59.132746+0000","last_became_active":"2024-09-12T17:31:16.236478+0000","last_became_peered":"2024-09-12T17:31:16.236478+0000","last_unstale":"2024-09-12T18:35:59.132746+0000","last_undegraded":"2024-09-12T18:35:59.132746+0000","last_fullsized":"2024-09-12T18:35:59.132746+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.413764+0000","last_change":"2024-09-12T18:36:33.413764+0000","last_active":"2024-09-12T18:36:33.413764+0000","last_peered":"2024-09-12T18:36:33.413764+0000","last_clean":"2024-09-12T18:36:33.413764+0000","last_became_active":"2024-09-12T17:31:12.091488+0000","last_became_peered":"2024-09-12T17:31:12.091488+0000","last_unstale":"2024-09-12T18:36:33.413764+0000","last_undegraded":"2024-09-12T18:36:33.413764+0000","last_fullsized":"2024-09-12T18:36:33.413764+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:33.413578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:33.413578+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.413578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:54.083021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'49","reported_seq":208,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.524946+0000","last_change":"2024-09-12T18:36:28.524946+0000","last_active":"2024-09-12T18:36:28.524946+0000","last_peered":"2024-09-12T18:36:28.524946+0000","last_clean":"2024-09-12T18:36:28.524946+0000","last_became_active":"2024-09-12T17:27:32.572859+0000","last_became_peered":"2024-09-12T17:27:32.572859+0000","last_unstale":"2024-09-12T18:36:28.524946+0000","last_undegraded":"2024-09-12T18:36:28.524946+0000","last_fullsized":"2024-09-12T18:36:28.524946+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'49","last_scrub_stamp":"2024-09-12T18:36:28.524755+0000","last_deep_scrub":"268'49","last_deep_scrub_stamp":"2024-09-12T18:36:28.524755+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.524755+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:40.471596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":198,"num_write":77,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:06.412028+0000","last_change":"2024-09-12T17:53:27.156462+0000","last_active":"2024-09-12T18:33:06.412028+0000","last_peered":"2024-09-12T18:33:06.412028+0000","last_clean":"2024-09-12T18:33:06.412028+0000","last_became_active":"2024-09-12T17:53:27.155646+0000","last_became_peered":"2024-09-12T17:53:27.155646+0000","last_unstale":"2024-09-12T18:33:06.412028+0000","last_undegraded":"2024-09-12T18:33:06.412028+0000","last_fullsized":"2024-09-12T18:33:06.412028+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:44.968007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:05.607600+0000","last_change":"2024-09-12T17:31:16.221542+0000","last_active":"2024-09-12T18:34:05.607600+0000","last_peered":"2024-09-12T18:34:05.607600+0000","last_clean":"2024-09-12T18:34:05.607600+0000","last_became_active":"2024-09-12T17:31:16.220797+0000","last_became_peered":"2024-09-12T17:31:16.220797+0000","last_unstale":"2024-09-12T18:34:05.607600+0000","last_undegraded":"2024-09-12T18:34:05.607600+0000","last_fullsized":"2024-09-12T18:34:05.607600+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.426103+0000","last_change":"2024-09-12T17:31:12.098496+0000","last_active":"2024-09-12T18:34:01.426103+0000","last_peered":"2024-09-12T18:34:01.426103+0000","last_clean":"2024-09-12T18:34:01.426103+0000","last_became_active":"2024-09-12T17:31:12.090174+0000","last_became_peered":"2024-09-12T17:31:12.090174+0000","last_unstale":"2024-09-12T18:34:01.426103+0000","last_undegraded":"2024-09-12T18:34:01.426103+0000","last_fullsized":"2024-09-12T18:34:01.426103+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'100","reported_seq":394,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.407333+0000","last_change":"2024-09-12T17:27:32.574809+0000","last_active":"2024-09-12T18:33:16.407333+0000","last_peered":"2024-09-12T18:33:16.407333+0000","last_clean":"2024-09-12T18:33:16.407333+0000","last_became_active":"2024-09-12T17:27:32.574023+0000","last_became_peered":"2024-09-12T17:27:32.574023+0000","last_unstale":"2024-09-12T18:33:16.407333+0000","last_undegraded":"2024-09-12T18:33:16.407333+0000","last_fullsized":"2024-09-12T18:33:16.407333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:43.524925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":651,"num_read_kb":453,"num_write":126,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:09.397336+0000","last_change":"2024-09-12T17:53:27.165446+0000","last_active":"2024-09-12T18:32:09.397336+0000","last_peered":"2024-09-12T18:32:09.397336+0000","last_clean":"2024-09-12T18:32:09.397336+0000","last_became_active":"2024-09-12T17:53:27.164643+0000","last_became_peered":"2024-09-12T17:53:27.164643+0000","last_unstale":"2024-09-12T18:32:09.397336+0000","last_undegraded":"2024-09-12T18:32:09.397336+0000","last_fullsized":"2024-09-12T18:32:09.397336+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:32.358718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"265'4","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.778689+0000","last_change":"2024-09-12T18:36:42.778689+0000","last_active":"2024-09-12T18:36:42.778689+0000","last_peered":"2024-09-12T18:36:42.778689+0000","last_clean":"2024-09-12T18:36:42.778689+0000","last_became_active":"2024-09-12T17:31:16.240666+0000","last_became_peered":"2024-09-12T17:31:16.240666+0000","last_unstale":"2024-09-12T18:36:42.778689+0000","last_undegraded":"2024-09-12T18:36:42.778689+0000","last_fullsized":"2024-09-12T18:36:42.778689+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:36:42.778498+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:36:42.778498+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.778498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:25.885647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'2","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.388693+0000","last_change":"2024-09-12T17:31:12.079972+0000","last_active":"2024-09-12T18:35:59.388693+0000","last_peered":"2024-09-12T18:35:59.388693+0000","last_clean":"2024-09-12T18:35:59.388693+0000","last_became_active":"2024-09-12T17:31:12.077055+0000","last_became_peered":"2024-09-12T17:31:12.077055+0000","last_unstale":"2024-09-12T18:35:59.388693+0000","last_undegraded":"2024-09-12T18:35:59.388693+0000","last_fullsized":"2024-09-12T18:35:59.388693+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'36","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:46.104074+0000","last_change":"2024-09-12T18:36:46.104074+0000","last_active":"2024-09-12T18:36:46.104074+0000","last_peered":"2024-09-12T18:36:46.104074+0000","last_clean":"2024-09-12T18:36:46.104074+0000","last_became_active":"2024-09-12T17:27:32.574128+0000","last_became_peered":"2024-09-12T17:27:32.574128+0000","last_unstale":"2024-09-12T18:36:46.104074+0000","last_undegraded":"2024-09-12T18:36:46.104074+0000","last_fullsized":"2024-09-12T18:36:46.104074+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-09-12T18:36:46.103894+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-09-12T18:36:46.103894+0000","last_clean_scrub_stamp":"2024-09-12T18:36:46.103894+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:56.981018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":129,"num_write":75,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:06.402547+0000","last_change":"2024-09-12T17:53:27.170202+0000","last_active":"2024-09-12T18:32:06.402547+0000","last_peered":"2024-09-12T18:32:06.402547+0000","last_clean":"2024-09-12T18:32:06.402547+0000","last_became_active":"2024-09-12T17:53:27.169499+0000","last_became_peered":"2024-09-12T17:53:27.169499+0000","last_unstale":"2024-09-12T18:32:06.402547+0000","last_undegraded":"2024-09-12T18:32:06.402547+0000","last_fullsized":"2024-09-12T18:32:06.402547+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:09.313257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"268'4","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.750543+0000","last_change":"2024-09-12T18:36:43.750543+0000","last_active":"2024-09-12T18:36:43.750543+0000","last_peered":"2024-09-12T18:36:43.750543+0000","last_clean":"2024-09-12T18:36:43.750543+0000","last_became_active":"2024-09-12T17:31:16.232949+0000","last_became_peered":"2024-09-12T17:31:16.232949+0000","last_unstale":"2024-09-12T18:36:43.750543+0000","last_undegraded":"2024-09-12T18:36:43.750543+0000","last_fullsized":"2024-09-12T18:36:43.750543+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:43.750294+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:43.750294+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.750294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:47.834399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'4","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.047771+0000","last_change":"2024-09-12T17:31:12.087042+0000","last_active":"2024-09-12T18:36:00.047771+0000","last_peered":"2024-09-12T18:36:00.047771+0000","last_clean":"2024-09-12T18:36:00.047771+0000","last_became_active":"2024-09-12T17:31:12.086300+0000","last_became_peered":"2024-09-12T17:31:12.086300+0000","last_unstale":"2024-09-12T18:36:00.047771+0000","last_undegraded":"2024-09-12T18:36:00.047771+0000","last_fullsized":"2024-09-12T18:36:00.047771+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'15","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:56.412585+0000","last_change":"2024-09-12T17:27:32.592754+0000","last_active":"2024-09-12T18:32:56.412585+0000","last_peered":"2024-09-12T18:32:56.412585+0000","last_clean":"2024-09-12T18:32:56.412585+0000","last_became_active":"2024-09-12T17:27:32.591878+0000","last_became_peered":"2024-09-12T17:27:32.591878+0000","last_unstale":"2024-09-12T18:32:56.412585+0000","last_undegraded":"2024-09-12T18:32:56.412585+0000","last_fullsized":"2024-09-12T18:32:56.412585+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:19.824090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.416384+0000","last_change":"2024-09-12T17:53:27.158764+0000","last_active":"2024-09-12T18:33:16.416384+0000","last_peered":"2024-09-12T18:33:16.416384+0000","last_clean":"2024-09-12T18:33:16.416384+0000","last_became_active":"2024-09-12T17:53:27.157992+0000","last_became_peered":"2024-09-12T17:53:27.157992+0000","last_unstale":"2024-09-12T18:33:16.416384+0000","last_undegraded":"2024-09-12T18:33:16.416384+0000","last_fullsized":"2024-09-12T18:33:16.416384+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:50.572142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'2","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.132526+0000","last_change":"2024-09-12T17:31:16.228882+0000","last_active":"2024-09-12T18:35:59.132526+0000","last_peered":"2024-09-12T18:35:59.132526+0000","last_clean":"2024-09-12T18:35:59.132526+0000","last_became_active":"2024-09-12T17:31:16.227946+0000","last_became_peered":"2024-09-12T17:31:16.227946+0000","last_unstale":"2024-09-12T18:35:59.132526+0000","last_undegraded":"2024-09-12T18:35:59.132526+0000","last_fullsized":"2024-09-12T18:35:59.132526+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'5","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.184041+0000","last_change":"2024-09-12T18:36:36.184041+0000","last_active":"2024-09-12T18:36:36.184041+0000","last_peered":"2024-09-12T18:36:36.184041+0000","last_clean":"2024-09-12T18:36:36.184041+0000","last_became_active":"2024-09-12T17:31:12.105448+0000","last_became_peered":"2024-09-12T17:31:12.105448+0000","last_unstale":"2024-09-12T18:36:36.184041+0000","last_undegraded":"2024-09-12T18:36:36.184041+0000","last_fullsized":"2024-09-12T18:36:36.184041+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T18:36:36.183859+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T18:36:36.183859+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.183859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.721194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'22","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.756826+0000","last_change":"2024-09-12T18:36:42.756826+0000","last_active":"2024-09-12T18:36:42.756826+0000","last_peered":"2024-09-12T18:36:42.756826+0000","last_clean":"2024-09-12T18:36:42.756826+0000","last_became_active":"2024-09-12T17:27:32.567500+0000","last_became_peered":"2024-09-12T17:27:32.567500+0000","last_unstale":"2024-09-12T18:36:42.756826+0000","last_undegraded":"2024-09-12T18:36:42.756826+0000","last_fullsized":"2024-09-12T18:36:42.756826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'22","last_scrub_stamp":"2024-09-12T18:36:42.756642+0000","last_deep_scrub":"268'22","last_deep_scrub_stamp":"2024-09-12T18:36:42.756642+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.756642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:22.566917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:09.397287+0000","last_change":"2024-09-12T17:53:27.167094+0000","last_active":"2024-09-12T18:32:09.397287+0000","last_peered":"2024-09-12T18:32:09.397287+0000","last_clean":"2024-09-12T18:32:09.397287+0000","last_became_active":"2024-09-12T17:53:27.164083+0000","last_became_peered":"2024-09-12T17:53:27.164083+0000","last_unstale":"2024-09-12T18:32:09.397287+0000","last_undegraded":"2024-09-12T18:32:09.397287+0000","last_fullsized":"2024-09-12T18:32:09.397287+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:57.760600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"268'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.157495+0000","last_change":"2024-09-12T18:36:40.157495+0000","last_active":"2024-09-12T18:36:40.157495+0000","last_peered":"2024-09-12T18:36:40.157495+0000","last_clean":"2024-09-12T18:36:40.157495+0000","last_became_active":"2024-09-12T17:31:16.238356+0000","last_became_peered":"2024-09-12T17:31:16.238356+0000","last_unstale":"2024-09-12T18:36:40.157495+0000","last_undegraded":"2024-09-12T18:36:40.157495+0000","last_fullsized":"2024-09-12T18:36:40.157495+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:40.157306+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:40.157306+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.157306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:06.571107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'5","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.391171+0000","last_change":"2024-09-12T17:31:12.106100+0000","last_active":"2024-09-12T18:35:59.391171+0000","last_peered":"2024-09-12T18:35:59.391171+0000","last_clean":"2024-09-12T18:35:59.391171+0000","last_became_active":"2024-09-12T17:31:12.105300+0000","last_became_peered":"2024-09-12T17:31:12.105300+0000","last_unstale":"2024-09-12T18:35:59.391171+0000","last_undegraded":"2024-09-12T18:35:59.391171+0000","last_fullsized":"2024-09-12T18:35:59.391171+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'42","reported_seq":176,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:54.408584+0000","last_change":"2024-09-12T17:27:32.598060+0000","last_active":"2024-09-12T18:32:54.408584+0000","last_peered":"2024-09-12T18:32:54.408584+0000","last_clean":"2024-09-12T18:32:54.408584+0000","last_became_active":"2024-09-12T17:27:32.597518+0000","last_became_peered":"2024-09-12T17:27:32.597518+0000","last_unstale":"2024-09-12T18:32:54.408584+0000","last_undegraded":"2024-09-12T18:32:54.408584+0000","last_fullsized":"2024-09-12T18:32:54.408584+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:46.388068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":146,"num_write":82,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.463783+0000","last_change":"2024-09-12T18:36:34.463783+0000","last_active":"2024-09-12T18:36:34.463783+0000","last_peered":"2024-09-12T18:36:34.463783+0000","last_clean":"2024-09-12T18:36:34.463783+0000","last_became_active":"2024-09-12T17:53:27.139633+0000","last_became_peered":"2024-09-12T17:53:27.139633+0000","last_unstale":"2024-09-12T18:36:34.463783+0000","last_undegraded":"2024-09-12T18:36:34.463783+0000","last_fullsized":"2024-09-12T18:36:34.463783+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:34.463510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:34.463510+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.463510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:11.843726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"265'4","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428161+0000","last_change":"2024-09-12T17:31:16.233015+0000","last_active":"2024-09-12T18:34:19.428161+0000","last_peered":"2024-09-12T18:34:19.428161+0000","last_clean":"2024-09-12T18:34:19.428161+0000","last_became_active":"2024-09-12T17:31:16.229063+0000","last_became_peered":"2024-09-12T17:31:16.229063+0000","last_unstale":"2024-09-12T18:34:19.428161+0000","last_undegraded":"2024-09-12T18:34:19.428161+0000","last_fullsized":"2024-09-12T18:34:19.428161+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:11.421536+0000","last_change":"2024-09-12T17:31:12.094349+0000","last_active":"2024-09-12T18:34:11.421536+0000","last_peered":"2024-09-12T18:34:11.421536+0000","last_clean":"2024-09-12T18:34:11.421536+0000","last_became_active":"2024-09-12T17:31:12.093496+0000","last_became_peered":"2024-09-12T17:31:12.093496+0000","last_unstale":"2024-09-12T18:34:11.421536+0000","last_undegraded":"2024-09-12T18:34:11.421536+0000","last_fullsized":"2024-09-12T18:34:11.421536+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":4,"num_write_kb":1047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'15","reported_seq":104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.411590+0000","last_change":"2024-09-12T17:27:32.598394+0000","last_active":"2024-09-12T18:33:04.411590+0000","last_peered":"2024-09-12T18:33:04.411590+0000","last_clean":"2024-09-12T18:33:04.411590+0000","last_became_active":"2024-09-12T17:27:32.597694+0000","last_became_peered":"2024-09-12T17:27:32.597694+0000","last_unstale":"2024-09-12T18:33:04.411590+0000","last_undegraded":"2024-09-12T18:33:04.411590+0000","last_fullsized":"2024-09-12T18:33:04.411590+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:30.364314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.417603+0000","last_change":"2024-09-12T17:53:27.162772+0000","last_active":"2024-09-12T18:33:56.417603+0000","last_peered":"2024-09-12T18:33:56.417603+0000","last_clean":"2024-09-12T18:33:56.417603+0000","last_became_active":"2024-09-12T17:53:27.161396+0000","last_became_peered":"2024-09-12T17:53:27.161396+0000","last_unstale":"2024-09-12T18:33:56.417603+0000","last_undegraded":"2024-09-12T18:33:56.417603+0000","last_fullsized":"2024-09-12T18:33:56.417603+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'3","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.135213+0000","last_change":"2024-09-12T17:31:16.239207+0000","last_active":"2024-09-12T18:35:59.135213+0000","last_peered":"2024-09-12T18:35:59.135213+0000","last_clean":"2024-09-12T18:35:59.135213+0000","last_became_active":"2024-09-12T17:31:16.238011+0000","last_became_peered":"2024-09-12T17:31:16.238011+0000","last_unstale":"2024-09-12T18:35:59.135213+0000","last_undegraded":"2024-09-12T18:35:59.135213+0000","last_fullsized":"2024-09-12T18:35:59.135213+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"268'7","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.458059+0000","last_change":"2024-09-12T18:36:32.458059+0000","last_active":"2024-09-12T18:36:32.458059+0000","last_peered":"2024-09-12T18:36:32.458059+0000","last_clean":"2024-09-12T18:36:32.458059+0000","last_became_active":"2024-09-12T17:31:12.093705+0000","last_became_peered":"2024-09-12T17:31:12.093705+0000","last_unstale":"2024-09-12T18:36:32.458059+0000","last_undegraded":"2024-09-12T18:36:32.458059+0000","last_fullsized":"2024-09-12T18:36:32.458059+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T18:36:32.457867+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T18:36:32.457867+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.457867+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:50.495148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'6","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:51.408420+0000","last_change":"2024-09-12T17:27:32.580514+0000","last_active":"2024-09-12T18:32:51.408420+0000","last_peered":"2024-09-12T18:32:51.408420+0000","last_clean":"2024-09-12T18:32:51.408420+0000","last_became_active":"2024-09-12T17:27:32.579749+0000","last_became_peered":"2024-09-12T17:27:32.579749+0000","last_unstale":"2024-09-12T18:32:51.408420+0000","last_undegraded":"2024-09-12T18:32:51.408420+0000","last_fullsized":"2024-09-12T18:32:51.408420+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:28.676196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.191586+0000","last_change":"2024-09-12T18:36:41.191421+0000","last_active":"2024-09-12T18:36:41.191586+0000","last_peered":"2024-09-12T18:36:41.191586+0000","last_clean":"2024-09-12T18:36:41.191586+0000","last_became_active":"2024-09-12T17:53:27.142745+0000","last_became_peered":"2024-09-12T17:53:27.142745+0000","last_unstale":"2024-09-12T18:36:41.191586+0000","last_undegraded":"2024-09-12T18:36:41.191586+0000","last_fullsized":"2024-09-12T18:36:41.191586+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:41.191230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:41.191230+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.191230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:57.178772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:31.662916+0000","last_change":"2024-09-12T17:31:16.242998+0000","last_active":"2024-09-12T18:34:31.662916+0000","last_peered":"2024-09-12T18:34:31.662916+0000","last_clean":"2024-09-12T18:34:31.662916+0000","last_became_active":"2024-09-12T17:31:16.242306+0000","last_became_peered":"2024-09-12T17:31:16.242306+0000","last_unstale":"2024-09-12T18:34:31.662916+0000","last_undegraded":"2024-09-12T18:34:31.662916+0000","last_fullsized":"2024-09-12T18:34:31.662916+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'6","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.049560+0000","last_change":"2024-09-12T17:31:12.078680+0000","last_active":"2024-09-12T18:36:00.049560+0000","last_peered":"2024-09-12T18:36:00.049560+0000","last_clean":"2024-09-12T18:36:00.049560+0000","last_became_active":"2024-09-12T17:31:12.077726+0000","last_became_peered":"2024-09-12T17:31:12.077726+0000","last_unstale":"2024-09-12T18:36:00.049560+0000","last_undegraded":"2024-09-12T18:36:00.049560+0000","last_fullsized":"2024-09-12T18:36:00.049560+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'8","reported_seq":94,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.178365+0000","last_change":"2024-09-12T18:36:34.178365+0000","last_active":"2024-09-12T18:36:34.178365+0000","last_peered":"2024-09-12T18:36:34.178365+0000","last_clean":"2024-09-12T18:36:34.178365+0000","last_became_active":"2024-09-12T17:27:32.583062+0000","last_became_peered":"2024-09-12T17:27:32.583062+0000","last_unstale":"2024-09-12T18:36:34.178365+0000","last_undegraded":"2024-09-12T18:36:34.178365+0000","last_fullsized":"2024-09-12T18:36:34.178365+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T18:36:34.178159+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T18:36:34.178159+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.178159+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:13.223172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:36.427648+0000","last_change":"2024-09-12T17:53:27.165755+0000","last_active":"2024-09-12T18:34:36.427648+0000","last_peered":"2024-09-12T18:34:36.427648+0000","last_clean":"2024-09-12T18:34:36.427648+0000","last_became_active":"2024-09-12T17:53:27.163419+0000","last_became_peered":"2024-09-12T17:53:27.163419+0000","last_unstale":"2024-09-12T18:34:36.427648+0000","last_undegraded":"2024-09-12T18:34:36.427648+0000","last_fullsized":"2024-09-12T18:34:36.427648+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:19.428227+0000","last_change":"2024-09-12T17:31:16.237342+0000","last_active":"2024-09-12T18:34:19.428227+0000","last_peered":"2024-09-12T18:34:19.428227+0000","last_clean":"2024-09-12T18:34:19.428227+0000","last_became_active":"2024-09-12T17:31:16.236619+0000","last_became_peered":"2024-09-12T17:31:16.236619+0000","last_unstale":"2024-09-12T18:34:19.428227+0000","last_undegraded":"2024-09-12T18:34:19.428227+0000","last_fullsized":"2024-09-12T18:34:19.428227+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"268'7","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:45.711196+0000","last_change":"2024-09-12T18:36:45.711196+0000","last_active":"2024-09-12T18:36:45.711196+0000","last_peered":"2024-09-12T18:36:45.711196+0000","last_clean":"2024-09-12T18:36:45.711196+0000","last_became_active":"2024-09-12T17:31:12.105793+0000","last_became_peered":"2024-09-12T17:31:12.105793+0000","last_unstale":"2024-09-12T18:36:45.711196+0000","last_undegraded":"2024-09-12T18:36:45.711196+0000","last_fullsized":"2024-09-12T18:36:45.711196+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T18:36:45.710950+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T18:36:45.710950+0000","last_clean_scrub_stamp":"2024-09-12T18:36:45.710950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:57.494629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'53","reported_seq":214,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.482580+0000","last_change":"2024-09-12T18:36:29.482580+0000","last_active":"2024-09-12T18:36:29.482580+0000","last_peered":"2024-09-12T18:36:29.482580+0000","last_clean":"2024-09-12T18:36:29.482580+0000","last_became_active":"2024-09-12T17:27:32.569594+0000","last_became_peered":"2024-09-12T17:27:32.569594+0000","last_unstale":"2024-09-12T18:36:29.482580+0000","last_undegraded":"2024-09-12T18:36:29.482580+0000","last_fullsized":"2024-09-12T18:36:29.482580+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'53","last_scrub_stamp":"2024-09-12T18:36:29.482390+0000","last_deep_scrub":"268'53","last_deep_scrub_stamp":"2024-09-12T18:36:29.482390+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.482390+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:05.105632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":187,"num_write":95,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.423114+0000","last_change":"2024-09-12T17:53:27.166701+0000","last_active":"2024-09-12T18:33:59.423114+0000","last_peered":"2024-09-12T18:33:59.423114+0000","last_clean":"2024-09-12T18:33:59.423114+0000","last_became_active":"2024-09-12T17:53:27.165129+0000","last_became_peered":"2024-09-12T17:53:27.165129+0000","last_unstale":"2024-09-12T18:33:59.423114+0000","last_undegraded":"2024-09-12T18:33:59.423114+0000","last_fullsized":"2024-09-12T18:33:59.423114+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"268'2","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.486570+0000","last_change":"2024-09-12T17:31:16.240818+0000","last_active":"2024-09-12T18:35:59.486570+0000","last_peered":"2024-09-12T18:35:59.486570+0000","last_clean":"2024-09-12T18:35:59.486570+0000","last_became_active":"2024-09-12T17:31:16.240152+0000","last_became_peered":"2024-09-12T17:31:16.240152+0000","last_unstale":"2024-09-12T18:35:59.486570+0000","last_undegraded":"2024-09-12T18:35:59.486570+0000","last_fullsized":"2024-09-12T18:35:59.486570+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'5","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.660857+0000","last_change":"2024-09-12T17:31:12.098113+0000","last_active":"2024-09-12T18:36:00.660857+0000","last_peered":"2024-09-12T18:36:00.660857+0000","last_clean":"2024-09-12T18:36:00.660857+0000","last_became_active":"2024-09-12T17:31:12.089200+0000","last_became_peered":"2024-09-12T17:31:12.089200+0000","last_unstale":"2024-09-12T18:36:00.660857+0000","last_undegraded":"2024-09-12T18:36:00.660857+0000","last_fullsized":"2024-09-12T18:36:00.660857+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8242,"num_write":10,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'48","reported_seq":201,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:45.745885+0000","last_change":"2024-09-12T18:36:45.745885+0000","last_active":"2024-09-12T18:36:45.745885+0000","last_peered":"2024-09-12T18:36:45.745885+0000","last_clean":"2024-09-12T18:36:45.745885+0000","last_became_active":"2024-09-12T17:27:32.568661+0000","last_became_peered":"2024-09-12T17:27:32.568661+0000","last_unstale":"2024-09-12T18:36:45.745885+0000","last_undegraded":"2024-09-12T18:36:45.745885+0000","last_fullsized":"2024-09-12T18:36:45.745885+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'48","last_scrub_stamp":"2024-09-12T18:36:45.745710+0000","last_deep_scrub":"268'48","last_deep_scrub_stamp":"2024-09-12T18:36:45.745710+0000","last_clean_scrub_stamp":"2024-09-12T18:36:45.745710+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:00.242423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":169,"num_write":85,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:11.421688+0000","last_change":"2024-09-12T17:53:27.171856+0000","last_active":"2024-09-12T18:34:11.421688+0000","last_peered":"2024-09-12T18:34:11.421688+0000","last_clean":"2024-09-12T18:34:11.421688+0000","last_became_active":"2024-09-12T17:53:27.170493+0000","last_became_peered":"2024-09-12T17:53:27.170493+0000","last_unstale":"2024-09-12T18:34:11.421688+0000","last_undegraded":"2024-09-12T18:34:11.421688+0000","last_fullsized":"2024-09-12T18:34:11.421688+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'7","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:01.644453+0000","last_change":"2024-09-12T17:31:16.229295+0000","last_active":"2024-09-12T18:36:01.644453+0000","last_peered":"2024-09-12T18:36:01.644453+0000","last_clean":"2024-09-12T18:36:01.644453+0000","last_became_active":"2024-09-12T17:31:16.228566+0000","last_became_peered":"2024-09-12T17:31:16.228566+0000","last_unstale":"2024-09-12T18:36:01.644453+0000","last_undegraded":"2024-09-12T18:36:01.644453+0000","last_fullsized":"2024-09-12T18:36:01.644453+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5238,"num_write":12,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'4","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.704030+0000","last_change":"2024-09-12T18:36:44.704030+0000","last_active":"2024-09-12T18:36:44.704030+0000","last_peered":"2024-09-12T18:36:44.704030+0000","last_clean":"2024-09-12T18:36:44.704030+0000","last_became_active":"2024-09-12T17:31:12.105384+0000","last_became_peered":"2024-09-12T17:31:12.105384+0000","last_unstale":"2024-09-12T18:36:44.704030+0000","last_undegraded":"2024-09-12T18:36:44.704030+0000","last_fullsized":"2024-09-12T18:36:44.704030+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:44.703841+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:44.703841+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.703841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:23.099047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'111","reported_seq":488,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:45.057682+0000","last_change":"2024-09-12T18:36:45.057682+0000","last_active":"2024-09-12T18:36:45.057682+0000","last_peered":"2024-09-12T18:36:45.057682+0000","last_clean":"2024-09-12T18:36:45.057682+0000","last_became_active":"2024-09-12T17:27:32.586640+0000","last_became_peered":"2024-09-12T17:27:32.586640+0000","last_unstale":"2024-09-12T18:36:45.057682+0000","last_undegraded":"2024-09-12T18:36:45.057682+0000","last_fullsized":"2024-09-12T18:36:45.057682+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'111","last_scrub_stamp":"2024-09-12T18:36:45.057448+0000","last_deep_scrub":"268'111","last_deep_scrub_stamp":"2024-09-12T18:36:45.057448+0000","last_clean_scrub_stamp":"2024-09-12T18:36:45.057448+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:10.836559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":815,"num_read_kb":525,"num_write":139,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3486,"num_omap_keys":7,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.417721+0000","last_change":"2024-09-12T17:53:27.171182+0000","last_active":"2024-09-12T18:33:56.417721+0000","last_peered":"2024-09-12T18:33:56.417721+0000","last_clean":"2024-09-12T18:33:56.417721+0000","last_became_active":"2024-09-12T17:53:27.170381+0000","last_became_peered":"2024-09-12T17:53:27.170381+0000","last_unstale":"2024-09-12T18:33:56.417721+0000","last_undegraded":"2024-09-12T18:33:56.417721+0000","last_fullsized":"2024-09-12T18:33:56.417721+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'7","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.793387+0000","last_change":"2024-09-12T18:36:36.793387+0000","last_active":"2024-09-12T18:36:36.793387+0000","last_peered":"2024-09-12T18:36:36.793387+0000","last_clean":"2024-09-12T18:36:36.793387+0000","last_became_active":"2024-09-12T17:31:16.245228+0000","last_became_peered":"2024-09-12T17:31:16.245228+0000","last_unstale":"2024-09-12T18:36:36.793387+0000","last_undegraded":"2024-09-12T18:36:36.793387+0000","last_fullsized":"2024-09-12T18:36:36.793387+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T18:36:36.793179+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T18:36:36.793179+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.793179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:54.579651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":48,"num_write":12,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:59.270818+0000","last_change":"2024-09-12T17:31:12.091353+0000","last_active":"2024-09-12T18:35:59.270818+0000","last_peered":"2024-09-12T18:35:59.270818+0000","last_clean":"2024-09-12T18:35:59.270818+0000","last_became_active":"2024-09-12T17:31:12.089735+0000","last_became_peered":"2024-09-12T17:31:12.089735+0000","last_unstale":"2024-09-12T18:35:59.270818+0000","last_undegraded":"2024-09-12T18:35:59.270818+0000","last_fullsized":"2024-09-12T18:35:59.270818+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'45","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:34.402987+0000","last_change":"2024-09-12T17:27:32.576354+0000","last_active":"2024-09-12T18:32:34.402987+0000","last_peered":"2024-09-12T18:32:34.402987+0000","last_clean":"2024-09-12T18:32:34.402987+0000","last_became_active":"2024-09-12T17:27:32.575300+0000","last_became_peered":"2024-09-12T17:27:32.575300+0000","last_unstale":"2024-09-12T18:32:34.402987+0000","last_undegraded":"2024-09-12T18:32:34.402987+0000","last_fullsized":"2024-09-12T18:32:34.402987+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:55.469608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":157,"num_write":84,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:56.424806+0000","last_change":"2024-09-12T17:53:27.174556+0000","last_active":"2024-09-12T18:33:56.424806+0000","last_peered":"2024-09-12T18:33:56.424806+0000","last_clean":"2024-09-12T18:33:56.424806+0000","last_became_active":"2024-09-12T17:53:27.173955+0000","last_became_peered":"2024-09-12T17:53:27.173955+0000","last_unstale":"2024-09-12T18:33:56.424806+0000","last_undegraded":"2024-09-12T18:33:56.424806+0000","last_fullsized":"2024-09-12T18:33:56.424806+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:26.425102+0000","last_change":"2024-09-12T17:31:16.232804+0000","last_active":"2024-09-12T18:34:26.425102+0000","last_peered":"2024-09-12T18:34:26.425102+0000","last_clean":"2024-09-12T18:34:26.425102+0000","last_became_active":"2024-09-12T17:31:16.231516+0000","last_became_peered":"2024-09-12T17:31:16.231516+0000","last_unstale":"2024-09-12T18:34:26.425102+0000","last_undegraded":"2024-09-12T18:34:26.425102+0000","last_fullsized":"2024-09-12T18:34:26.425102+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.786963+0000","last_change":"2024-09-12T18:36:43.786963+0000","last_active":"2024-09-12T18:36:43.786963+0000","last_peered":"2024-09-12T18:36:43.786963+0000","last_clean":"2024-09-12T18:36:43.786963+0000","last_became_active":"2024-09-12T17:31:12.084158+0000","last_became_peered":"2024-09-12T17:31:12.084158+0000","last_unstale":"2024-09-12T18:36:43.786963+0000","last_undegraded":"2024-09-12T18:36:43.786963+0000","last_fullsized":"2024-09-12T18:36:43.786963+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:43.786777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:43.786777+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.786777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:32.037462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'55","reported_seq":219,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.142834+0000","last_change":"2024-09-12T18:36:33.142834+0000","last_active":"2024-09-12T18:36:33.142834+0000","last_peered":"2024-09-12T18:36:33.142834+0000","last_clean":"2024-09-12T18:36:33.142834+0000","last_became_active":"2024-09-12T17:27:32.569924+0000","last_became_peered":"2024-09-12T17:27:32.569924+0000","last_unstale":"2024-09-12T18:36:33.142834+0000","last_undegraded":"2024-09-12T18:36:33.142834+0000","last_fullsized":"2024-09-12T18:36:33.142834+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'55","last_scrub_stamp":"2024-09-12T18:36:33.142657+0000","last_deep_scrub":"268'55","last_deep_scrub_stamp":"2024-09-12T18:36:33.142657+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.142657+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:06.255940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":184,"num_write":101,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.403508+0000","last_change":"2024-09-12T17:53:27.163286+0000","last_active":"2024-09-12T18:33:01.403508+0000","last_peered":"2024-09-12T18:33:01.403508+0000","last_clean":"2024-09-12T18:33:01.403508+0000","last_became_active":"2024-09-12T17:53:27.162527+0000","last_became_peered":"2024-09-12T17:53:27.162527+0000","last_unstale":"2024-09-12T18:33:01.403508+0000","last_undegraded":"2024-09-12T18:33:01.403508+0000","last_fullsized":"2024-09-12T18:33:01.403508+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:27.017224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.426025+0000","last_change":"2024-09-12T17:31:16.245393+0000","last_active":"2024-09-12T18:34:01.426025+0000","last_peered":"2024-09-12T18:34:01.426025+0000","last_clean":"2024-09-12T18:34:01.426025+0000","last_became_active":"2024-09-12T17:31:16.244556+0000","last_became_peered":"2024-09-12T17:31:16.244556+0000","last_unstale":"2024-09-12T18:34:01.426025+0000","last_undegraded":"2024-09-12T18:34:01.426025+0000","last_fullsized":"2024-09-12T18:34:01.426025+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'7","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:41.413674+0000","last_change":"2024-09-12T17:31:12.081797+0000","last_active":"2024-09-12T18:33:41.413674+0000","last_peered":"2024-09-12T18:33:41.413674+0000","last_clean":"2024-09-12T18:33:41.413674+0000","last_became_active":"2024-09-12T17:31:12.081025+0000","last_became_peered":"2024-09-12T17:31:12.081025+0000","last_unstale":"2024-09-12T18:33:41.413674+0000","last_undegraded":"2024-09-12T18:33:41.413674+0000","last_fullsized":"2024-09-12T18:33:41.413674+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:23.240064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:36.408791+0000","last_change":"2024-09-12T17:27:32.562776+0000","last_active":"2024-09-12T18:32:36.408791+0000","last_peered":"2024-09-12T18:32:36.408791+0000","last_clean":"2024-09-12T18:32:36.408791+0000","last_became_active":"2024-09-12T17:27:32.561993+0000","last_became_peered":"2024-09-12T17:27:32.561993+0000","last_unstale":"2024-09-12T18:32:36.408791+0000","last_undegraded":"2024-09-12T18:32:36.408791+0000","last_fullsized":"2024-09-12T18:32:36.408791+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.521239+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.521239+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:55.063772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":121,"num_write":59,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.410789+0000","last_change":"2024-09-12T17:53:27.153890+0000","last_active":"2024-09-12T18:33:01.410789+0000","last_peered":"2024-09-12T18:33:01.410789+0000","last_clean":"2024-09-12T18:33:01.410789+0000","last_became_active":"2024-09-12T17:53:27.153125+0000","last_became_peered":"2024-09-12T17:53:27.153125+0000","last_unstale":"2024-09-12T18:33:01.410789+0000","last_undegraded":"2024-09-12T18:33:01.410789+0000","last_fullsized":"2024-09-12T18:33:01.410789+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:29.571163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'6","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:51.449584+0000","last_change":"2024-09-12T17:31:16.223351+0000","last_active":"2024-09-12T18:35:51.449584+0000","last_peered":"2024-09-12T18:35:51.449584+0000","last_clean":"2024-09-12T18:35:51.449584+0000","last_became_active":"2024-09-12T17:31:16.212330+0000","last_became_peered":"2024-09-12T17:31:16.212330+0000","last_unstale":"2024-09-12T18:35:51.449584+0000","last_undegraded":"2024-09-12T18:35:51.449584+0000","last_fullsized":"2024-09-12T18:35:51.449584+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:36.131170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'2","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.476350+0000","last_change":"2024-09-12T18:36:31.476350+0000","last_active":"2024-09-12T18:36:31.476350+0000","last_peered":"2024-09-12T18:36:31.476350+0000","last_clean":"2024-09-12T18:36:31.476350+0000","last_became_active":"2024-09-12T17:31:12.093752+0000","last_became_peered":"2024-09-12T17:31:12.093752+0000","last_unstale":"2024-09-12T18:36:31.476350+0000","last_undegraded":"2024-09-12T18:36:31.476350+0000","last_fullsized":"2024-09-12T18:36:31.476350+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:36:31.476157+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:36:31.476157+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.476157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:03.620536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"0'0","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.120582+0000","last_change":"2024-09-12T18:36:32.120582+0000","last_active":"2024-09-12T18:36:32.120582+0000","last_peered":"2024-09-12T18:36:32.120582+0000","last_clean":"2024-09-12T18:36:32.120582+0000","last_became_active":"2024-09-12T17:27:32.583070+0000","last_became_peered":"2024-09-12T17:27:32.583070+0000","last_unstale":"2024-09-12T18:36:32.120582+0000","last_undegraded":"2024-09-12T18:36:32.120582+0000","last_fullsized":"2024-09-12T18:36:32.120582+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:32.120403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:32.120403+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.120403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:14.385650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.649994+0000","last_change":"2024-09-12T17:53:27.155092+0000","last_active":"2024-09-12T18:33:36.649994+0000","last_peered":"2024-09-12T18:33:36.649994+0000","last_clean":"2024-09-12T18:33:36.649994+0000","last_became_active":"2024-09-12T17:53:27.154309+0000","last_became_peered":"2024-09-12T17:53:27.154309+0000","last_unstale":"2024-09-12T18:33:36.649994+0000","last_undegraded":"2024-09-12T18:33:36.649994+0000","last_fullsized":"2024-09-12T18:33:36.649994+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:16.746183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'8","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.264328+0000","last_change":"2024-09-12T17:31:16.231548+0000","last_active":"2024-09-12T18:36:00.264328+0000","last_peered":"2024-09-12T18:36:00.264328+0000","last_clean":"2024-09-12T18:36:00.264328+0000","last_became_active":"2024-09-12T17:31:16.230809+0000","last_became_peered":"2024-09-12T17:31:16.230809+0000","last_unstale":"2024-09-12T18:36:00.264328+0000","last_undegraded":"2024-09-12T18:36:00.264328+0000","last_fullsized":"2024-09-12T18:36:00.264328+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":16386,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"265'2","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.424559+0000","last_change":"2024-09-12T17:31:12.084859+0000","last_active":"2024-09-12T18:34:01.424559+0000","last_peered":"2024-09-12T18:34:01.424559+0000","last_clean":"2024-09-12T18:34:01.424559+0000","last_became_active":"2024-09-12T17:31:12.084101+0000","last_became_peered":"2024-09-12T17:31:12.084101+0000","last_unstale":"2024-09-12T18:34:01.424559+0000","last_undegraded":"2024-09-12T18:34:01.424559+0000","last_fullsized":"2024-09-12T18:34:01.424559+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'37","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.035502+0000","last_change":"2024-09-12T18:36:44.035502+0000","last_active":"2024-09-12T18:36:44.035502+0000","last_peered":"2024-09-12T18:36:44.035502+0000","last_clean":"2024-09-12T18:36:44.035502+0000","last_became_active":"2024-09-12T17:27:32.582183+0000","last_became_peered":"2024-09-12T17:27:32.582183+0000","last_unstale":"2024-09-12T18:36:44.035502+0000","last_undegraded":"2024-09-12T18:36:44.035502+0000","last_fullsized":"2024-09-12T18:36:44.035502+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'37","last_scrub_stamp":"2024-09-12T18:36:44.035316+0000","last_deep_scrub":"268'37","last_deep_scrub_stamp":"2024-09-12T18:36:44.035316+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.035316+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:17.715772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":125,"num_write":74,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:05.593556+0000","last_change":"2024-09-12T17:53:27.160005+0000","last_active":"2024-09-12T18:33:05.593556+0000","last_peered":"2024-09-12T18:33:05.593556+0000","last_clean":"2024-09-12T18:33:05.593556+0000","last_became_active":"2024-09-12T17:53:27.159240+0000","last_became_peered":"2024-09-12T17:53:27.159240+0000","last_unstale":"2024-09-12T18:33:05.593556+0000","last_undegraded":"2024-09-12T18:33:05.593556+0000","last_fullsized":"2024-09-12T18:33:05.593556+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:37.529736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'5","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:00.758759+0000","last_change":"2024-09-12T17:31:16.226574+0000","last_active":"2024-09-12T18:36:00.758759+0000","last_peered":"2024-09-12T18:36:00.758759+0000","last_clean":"2024-09-12T18:36:00.758759+0000","last_became_active":"2024-09-12T17:31:16.225754+0000","last_became_peered":"2024-09-12T17:31:16.225754+0000","last_unstale":"2024-09-12T18:36:00.758759+0000","last_undegraded":"2024-09-12T18:36:00.758759+0000","last_fullsized":"2024-09-12T18:36:00.758759+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:01.419116+0000","last_change":"2024-09-12T17:31:12.088188+0000","last_active":"2024-09-12T18:34:01.419116+0000","last_peered":"2024-09-12T18:34:01.419116+0000","last_clean":"2024-09-12T18:34:01.419116+0000","last_became_active":"2024-09-12T17:31:12.087356+0000","last_became_peered":"2024-09-12T17:31:12.087356+0000","last_unstale":"2024-09-12T18:34:01.419116+0000","last_undegraded":"2024-09-12T18:34:01.419116+0000","last_fullsized":"2024-09-12T18:34:01.419116+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'23","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.806178+0000","last_change":"2024-09-12T18:36:37.806178+0000","last_active":"2024-09-12T18:36:37.806178+0000","last_peered":"2024-09-12T18:36:37.806178+0000","last_clean":"2024-09-12T18:36:37.806178+0000","last_became_active":"2024-09-12T17:27:32.583631+0000","last_became_peered":"2024-09-12T17:27:32.583631+0000","last_unstale":"2024-09-12T18:36:37.806178+0000","last_undegraded":"2024-09-12T18:36:37.806178+0000","last_fullsized":"2024-09-12T18:36:37.806178+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'23","last_scrub_stamp":"2024-09-12T18:36:37.805995+0000","last_deep_scrub":"268'23","last_deep_scrub_stamp":"2024-09-12T18:36:37.805995+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.805995+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:50.592369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":83,"num_write":39,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'2","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.392020+0000","last_change":"2024-09-12T18:36:36.391863+0000","last_active":"2024-09-12T18:36:36.392020+0000","last_peered":"2024-09-12T18:36:36.392020+0000","last_clean":"2024-09-12T18:36:36.392020+0000","last_became_active":"2024-09-12T17:53:27.152651+0000","last_became_peered":"2024-09-12T17:53:27.152651+0000","last_unstale":"2024-09-12T18:36:36.392020+0000","last_undegraded":"2024-09-12T18:36:36.392020+0000","last_fullsized":"2024-09-12T18:36:36.392020+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:36.391681+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:36.391681+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.391681+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:30.517267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'9","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.761952+0000","last_change":"2024-09-12T18:36:38.761952+0000","last_active":"2024-09-12T18:36:38.761952+0000","last_peered":"2024-09-12T18:36:38.761952+0000","last_clean":"2024-09-12T18:36:38.761952+0000","last_became_active":"2024-09-12T17:31:16.242981+0000","last_became_peered":"2024-09-12T17:31:16.242981+0000","last_unstale":"2024-09-12T18:36:38.761952+0000","last_undegraded":"2024-09-12T18:36:38.761952+0000","last_fullsized":"2024-09-12T18:36:38.761952+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-09-12T18:36:38.761770+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-09-12T18:36:38.761770+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.761770+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:52.221501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15362,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:31.411117+0000","last_change":"2024-09-12T17:31:12.097913+0000","last_active":"2024-09-12T18:33:31.411117+0000","last_peered":"2024-09-12T18:33:31.411117+0000","last_clean":"2024-09-12T18:33:31.411117+0000","last_became_active":"2024-09-12T17:31:12.097216+0000","last_became_peered":"2024-09-12T17:31:12.097216+0000","last_unstale":"2024-09-12T18:33:31.411117+0000","last_undegraded":"2024-09-12T18:33:31.411117+0000","last_fullsized":"2024-09-12T18:33:31.411117+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:29.988488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'30","reported_seq":152,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:45.811523+0000","last_change":"2024-09-12T18:36:45.811523+0000","last_active":"2024-09-12T18:36:45.811523+0000","last_peered":"2024-09-12T18:36:45.811523+0000","last_clean":"2024-09-12T18:36:45.811523+0000","last_became_active":"2024-09-12T17:27:32.571830+0000","last_became_peered":"2024-09-12T17:27:32.571830+0000","last_unstale":"2024-09-12T18:36:45.811523+0000","last_undegraded":"2024-09-12T18:36:45.811523+0000","last_fullsized":"2024-09-12T18:36:45.811523+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-12T18:36:45.811332+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-12T18:36:45.811332+0000","last_clean_scrub_stamp":"2024-09-12T18:36:45.811332+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:44.077797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":95,"num_write":63,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:36.433540+0000","last_change":"2024-09-12T17:53:27.163946+0000","last_active":"2024-09-12T18:34:36.433540+0000","last_peered":"2024-09-12T18:34:36.433540+0000","last_clean":"2024-09-12T18:34:36.433540+0000","last_became_active":"2024-09-12T17:53:27.163113+0000","last_became_peered":"2024-09-12T17:53:27.163113+0000","last_unstale":"2024-09-12T18:34:36.433540+0000","last_undegraded":"2024-09-12T18:34:36.433540+0000","last_fullsized":"2024-09-12T18:34:36.433540+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:36.418774+0000","last_change":"2024-09-12T17:31:16.234271+0000","last_active":"2024-09-12T18:33:36.418774+0000","last_peered":"2024-09-12T18:33:36.418774+0000","last_clean":"2024-09-12T18:33:36.418774+0000","last_became_active":"2024-09-12T17:31:16.233558+0000","last_became_peered":"2024-09-12T17:31:16.233558+0000","last_unstale":"2024-09-12T18:33:36.418774+0000","last_undegraded":"2024-09-12T18:33:36.418774+0000","last_fullsized":"2024-09-12T18:33:36.418774+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:03.391887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'7","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:46.444961+0000","last_change":"2024-09-12T17:31:12.094815+0000","last_active":"2024-09-12T18:35:46.444961+0000","last_peered":"2024-09-12T18:35:46.444961+0000","last_clean":"2024-09-12T18:35:46.444961+0000","last_became_active":"2024-09-12T17:31:12.094159+0000","last_became_peered":"2024-09-12T17:31:12.094159+0000","last_unstale":"2024-09-12T18:35:46.444961+0000","last_undegraded":"2024-09-12T18:35:46.444961+0000","last_fullsized":"2024-09-12T18:35:46.444961+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.046245+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.046245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:09.522281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3074,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'20","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.750473+0000","last_change":"2024-09-12T18:36:44.750473+0000","last_active":"2024-09-12T18:36:44.750473+0000","last_peered":"2024-09-12T18:36:44.750473+0000","last_clean":"2024-09-12T18:36:44.750473+0000","last_became_active":"2024-09-12T17:27:32.595524+0000","last_became_peered":"2024-09-12T17:27:32.595524+0000","last_unstale":"2024-09-12T18:36:44.750473+0000","last_undegraded":"2024-09-12T18:36:44.750473+0000","last_fullsized":"2024-09-12T18:36:44.750473+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-12T18:36:44.750178+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-12T18:36:44.750178+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.750178+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:45.297099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":74,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:01.413732+0000","last_change":"2024-09-12T17:53:27.175841+0000","last_active":"2024-09-12T18:33:01.413732+0000","last_peered":"2024-09-12T18:33:01.413732+0000","last_clean":"2024-09-12T18:33:01.413732+0000","last_became_active":"2024-09-12T17:53:27.175125+0000","last_became_peered":"2024-09-12T17:53:27.175125+0000","last_unstale":"2024-09-12T18:33:01.413732+0000","last_undegraded":"2024-09-12T18:33:01.413732+0000","last_fullsized":"2024-09-12T18:33:01.413732+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:18.938638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'4","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.124702+0000","last_change":"2024-09-12T18:36:39.124702+0000","last_active":"2024-09-12T18:36:39.124702+0000","last_peered":"2024-09-12T18:36:39.124702+0000","last_clean":"2024-09-12T18:36:39.124702+0000","last_became_active":"2024-09-12T17:31:16.211664+0000","last_became_peered":"2024-09-12T17:31:16.211664+0000","last_unstale":"2024-09-12T18:36:39.124702+0000","last_undegraded":"2024-09-12T18:36:39.124702+0000","last_fullsized":"2024-09-12T18:36:39.124702+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:36:39.124513+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:36:39.124513+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.124513+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:43.413810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1069,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'4","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.842623+0000","last_change":"2024-09-12T18:36:35.842623+0000","last_active":"2024-09-12T18:36:35.842623+0000","last_peered":"2024-09-12T18:36:35.842623+0000","last_clean":"2024-09-12T18:36:35.842623+0000","last_became_active":"2024-09-12T17:31:12.099608+0000","last_became_peered":"2024-09-12T17:31:12.099608+0000","last_unstale":"2024-09-12T18:36:35.842623+0000","last_undegraded":"2024-09-12T18:36:35.842623+0000","last_fullsized":"2024-09-12T18:36:35.842623+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:35.842447+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:35.842447+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.842447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:21.122228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'56","reported_seq":227,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.126507+0000","last_change":"2024-09-12T18:36:31.126507+0000","last_active":"2024-09-12T18:36:31.126507+0000","last_peered":"2024-09-12T18:36:31.126507+0000","last_clean":"2024-09-12T18:36:31.126507+0000","last_became_active":"2024-09-12T17:27:32.568785+0000","last_became_peered":"2024-09-12T17:27:32.568785+0000","last_unstale":"2024-09-12T18:36:31.126507+0000","last_undegraded":"2024-09-12T18:36:31.126507+0000","last_fullsized":"2024-09-12T18:36:31.126507+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'56","last_scrub_stamp":"2024-09-12T18:36:31.126325+0000","last_deep_scrub":"268'56","last_deep_scrub_stamp":"2024-09-12T18:36:31.126325+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.126325+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:42.729615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":196,"num_write":113,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:16.407392+0000","last_change":"2024-09-12T17:53:27.175493+0000","last_active":"2024-09-12T18:33:16.407392+0000","last_peered":"2024-09-12T18:33:16.407392+0000","last_clean":"2024-09-12T18:33:16.407392+0000","last_became_active":"2024-09-12T17:53:27.175073+0000","last_became_peered":"2024-09-12T17:53:27.175073+0000","last_unstale":"2024-09-12T18:33:16.407392+0000","last_undegraded":"2024-09-12T18:33:16.407392+0000","last_fullsized":"2024-09-12T18:33:16.407392+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:43.723718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:45.602853+0000","last_change":"2024-09-12T17:31:16.229188+0000","last_active":"2024-09-12T18:33:45.602853+0000","last_peered":"2024-09-12T18:33:45.602853+0000","last_clean":"2024-09-12T18:33:45.602853+0000","last_became_active":"2024-09-12T17:31:16.228416+0000","last_became_peered":"2024-09-12T17:31:16.228416+0000","last_unstale":"2024-09-12T18:33:45.602853+0000","last_undegraded":"2024-09-12T18:33:45.602853+0000","last_fullsized":"2024-09-12T18:33:45.602853+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:54.390718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.155671+0000","last_change":"2024-09-12T18:36:37.155671+0000","last_active":"2024-09-12T18:36:37.155671+0000","last_peered":"2024-09-12T18:36:37.155671+0000","last_clean":"2024-09-12T18:36:37.155671+0000","last_became_active":"2024-09-12T17:31:12.088297+0000","last_became_peered":"2024-09-12T17:31:12.088297+0000","last_unstale":"2024-09-12T18:36:37.155671+0000","last_undegraded":"2024-09-12T18:36:37.155671+0000","last_fullsized":"2024-09-12T18:36:37.155671+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:37.155486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:37.155486+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.155486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:32.709238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'16","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.009727+0000","last_change":"2024-09-12T18:36:42.009727+0000","last_active":"2024-09-12T18:36:42.009727+0000","last_peered":"2024-09-12T18:36:42.009727+0000","last_clean":"2024-09-12T18:36:42.009727+0000","last_became_active":"2024-09-12T17:27:32.584404+0000","last_became_peered":"2024-09-12T17:27:32.584404+0000","last_unstale":"2024-09-12T18:36:42.009727+0000","last_undegraded":"2024-09-12T18:36:42.009727+0000","last_fullsized":"2024-09-12T18:36:42.009727+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-09-12T18:36:42.009525+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-09-12T18:36:42.009525+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.009525+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:08.730069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":55,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'315","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.951082+0000","last_change":"2024-09-12T18:36:20.951082+0000","last_active":"2024-09-12T18:36:20.951082+0000","last_peered":"2024-09-12T18:36:20.951082+0000","last_clean":"2024-09-12T18:36:20.951082+0000","last_became_active":"2024-09-12T17:10:30.407181+0000","last_became_peered":"2024-09-12T17:10:30.407181+0000","last_unstale":"2024-09-12T18:36:20.951082+0000","last_undegraded":"2024-09-12T18:36:20.951082+0000","last_fullsized":"2024-09-12T18:36:20.951082+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'315","last_scrub_stamp":"2024-09-12T18:36:20.950828+0000","last_deep_scrub":"268'315","last_deep_scrub_stamp":"2024-09-12T18:36:20.950828+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.950828+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:01.236915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262204,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":478,"num_read_kb":10655,"num_write":917,"num_write_kb":47496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'781","reported_seq":2322,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.976956+0000","last_change":"2024-09-12T18:36:23.976956+0000","last_active":"2024-09-12T18:36:23.976956+0000","last_peered":"2024-09-12T18:36:23.976956+0000","last_clean":"2024-09-12T18:36:23.976956+0000","last_became_active":"2024-09-12T17:10:32.346911+0000","last_became_peered":"2024-09-12T17:10:32.346911+0000","last_unstale":"2024-09-12T18:36:23.976956+0000","last_undegraded":"2024-09-12T18:36:23.976956+0000","last_fullsized":"2024-09-12T18:36:23.976956+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'781","last_scrub_stamp":"2024-09-12T18:36:23.976864+0000","last_deep_scrub":"268'781","last_deep_scrub_stamp":"2024-09-12T18:36:23.976864+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.976864+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:06.388928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3659,"num_read_kb":3307,"num_write":1011,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'379","reported_seq":1102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.899907+0000","last_change":"2024-09-12T18:36:14.899907+0000","last_active":"2024-09-12T18:36:14.899907+0000","last_peered":"2024-09-12T18:36:14.899907+0000","last_clean":"2024-09-12T18:36:14.899907+0000","last_became_active":"2024-09-12T17:10:30.405515+0000","last_became_peered":"2024-09-12T17:10:30.405515+0000","last_unstale":"2024-09-12T18:36:14.899907+0000","last_undegraded":"2024-09-12T18:36:14.899907+0000","last_fullsized":"2024-09-12T18:36:14.899907+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'379","last_scrub_stamp":"2024-09-12T18:36:14.899603+0000","last_deep_scrub":"268'379","last_deep_scrub_stamp":"2024-09-12T18:36:14.899603+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.899603+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:27.598354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262215,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":661,"num_read_kb":13611,"num_write":1216,"num_write_kb":42248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'456","reported_seq":1944,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.985655+0000","last_change":"2024-09-12T18:36:23.985655+0000","last_active":"2024-09-12T18:36:23.985655+0000","last_peered":"2024-09-12T18:36:23.985655+0000","last_clean":"2024-09-12T18:36:23.985655+0000","last_became_active":"2024-09-12T17:10:32.375908+0000","last_became_peered":"2024-09-12T17:10:32.375908+0000","last_unstale":"2024-09-12T18:36:23.985655+0000","last_undegraded":"2024-09-12T18:36:23.985655+0000","last_fullsized":"2024-09-12T18:36:23.985655+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'456","last_scrub_stamp":"2024-09-12T18:36:23.985573+0000","last_deep_scrub":"268'456","last_deep_scrub_stamp":"2024-09-12T18:36:23.985573+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.985573+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:23.461123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2460,"num_read_kb":2294,"num_write":575,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'368","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.537548+0000","last_change":"2024-09-12T18:36:15.537548+0000","last_active":"2024-09-12T18:36:15.537548+0000","last_peered":"2024-09-12T18:36:15.537548+0000","last_clean":"2024-09-12T18:36:15.537548+0000","last_became_active":"2024-09-12T17:10:30.351202+0000","last_became_peered":"2024-09-12T17:10:30.351202+0000","last_unstale":"2024-09-12T18:36:15.537548+0000","last_undegraded":"2024-09-12T18:36:15.537548+0000","last_fullsized":"2024-09-12T18:36:15.537548+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'368","last_scrub_stamp":"2024-09-12T18:36:15.537307+0000","last_deep_scrub":"268'368","last_deep_scrub_stamp":"2024-09-12T18:36:15.537307+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.537307+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:11.681842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":96764,"num_write":1045,"num_write_kb":52334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'562","reported_seq":2206,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.865091+0000","last_change":"2024-09-12T18:36:28.865091+0000","last_active":"2024-09-12T18:36:28.865091+0000","last_peered":"2024-09-12T18:36:28.865091+0000","last_clean":"2024-09-12T18:36:28.865091+0000","last_became_active":"2024-09-12T17:10:32.370962+0000","last_became_peered":"2024-09-12T17:10:32.370962+0000","last_unstale":"2024-09-12T18:36:28.865091+0000","last_undegraded":"2024-09-12T18:36:28.865091+0000","last_fullsized":"2024-09-12T18:36:28.865091+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'562","last_scrub_stamp":"2024-09-12T18:36:28.864895+0000","last_deep_scrub":"268'562","last_deep_scrub_stamp":"2024-09-12T18:36:28.864895+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.864895+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:41.919276+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2855,"num_read_kb":2656,"num_write":715,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1728,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'407","reported_seq":1141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.964533+0000","last_change":"2024-09-12T18:36:20.964533+0000","last_active":"2024-09-12T18:36:20.964533+0000","last_peered":"2024-09-12T18:36:20.964533+0000","last_clean":"2024-09-12T18:36:20.964533+0000","last_became_active":"2024-09-12T17:10:30.374789+0000","last_became_peered":"2024-09-12T17:10:30.374789+0000","last_unstale":"2024-09-12T18:36:20.964533+0000","last_undegraded":"2024-09-12T18:36:20.964533+0000","last_fullsized":"2024-09-12T18:36:20.964533+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'407","last_scrub_stamp":"2024-09-12T18:36:20.964301+0000","last_deep_scrub":"268'407","last_deep_scrub_stamp":"2024-09-12T18:36:20.964301+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.964301+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:34.996196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267453,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":786,"num_read_kb":12016,"num_write":1261,"num_write_kb":48882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'289","reported_seq":1686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.595129+0000","last_change":"2024-09-12T18:36:23.595129+0000","last_active":"2024-09-12T18:36:23.595129+0000","last_peered":"2024-09-12T18:36:23.595129+0000","last_clean":"2024-09-12T18:36:23.595129+0000","last_became_active":"2024-09-12T17:10:32.357199+0000","last_became_peered":"2024-09-12T17:10:32.357199+0000","last_unstale":"2024-09-12T18:36:23.595129+0000","last_undegraded":"2024-09-12T18:36:23.595129+0000","last_fullsized":"2024-09-12T18:36:23.595129+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'289","last_scrub_stamp":"2024-09-12T18:36:23.594944+0000","last_deep_scrub":"268'289","last_deep_scrub_stamp":"2024-09-12T18:36:23.594944+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.594944+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:43.920636+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1623,"num_read_kb":1593,"num_write":300,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'311","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.900501+0000","last_change":"2024-09-12T18:36:18.900501+0000","last_active":"2024-09-12T18:36:18.900501+0000","last_peered":"2024-09-12T18:36:18.900501+0000","last_clean":"2024-09-12T18:36:18.900501+0000","last_became_active":"2024-09-12T17:10:30.385216+0000","last_became_peered":"2024-09-12T17:10:30.385216+0000","last_unstale":"2024-09-12T18:36:18.900501+0000","last_undegraded":"2024-09-12T18:36:18.900501+0000","last_fullsized":"2024-09-12T18:36:18.900501+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'311","last_scrub_stamp":"2024-09-12T18:36:18.900301+0000","last_deep_scrub":"268'311","last_deep_scrub_stamp":"2024-09-12T18:36:18.900301+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.900301+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:13.169294+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1826375,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":401,"num_read_kb":5414,"num_write":926,"num_write_kb":15383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'551","reported_seq":2132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.076590+0000","last_change":"2024-09-12T18:36:18.076590+0000","last_active":"2024-09-12T18:36:18.076590+0000","last_peered":"2024-09-12T18:36:18.076590+0000","last_clean":"2024-09-12T18:36:18.076590+0000","last_became_active":"2024-09-12T17:10:32.351972+0000","last_became_peered":"2024-09-12T17:10:32.351972+0000","last_unstale":"2024-09-12T18:36:18.076590+0000","last_undegraded":"2024-09-12T18:36:18.076590+0000","last_fullsized":"2024-09-12T18:36:18.076590+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'551","last_scrub_stamp":"2024-09-12T18:36:18.076367+0000","last_deep_scrub":"268'551","last_deep_scrub_stamp":"2024-09-12T18:36:18.076367+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.076367+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:24.496910+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2788,"num_read_kb":2550,"num_write":700,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'360","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.946134+0000","last_change":"2024-09-12T18:36:18.946134+0000","last_active":"2024-09-12T18:36:18.946134+0000","last_peered":"2024-09-12T18:36:18.946134+0000","last_clean":"2024-09-12T18:36:18.946134+0000","last_became_active":"2024-09-12T17:10:30.350813+0000","last_became_peered":"2024-09-12T17:10:30.350813+0000","last_unstale":"2024-09-12T18:36:18.946134+0000","last_undegraded":"2024-09-12T18:36:18.946134+0000","last_fullsized":"2024-09-12T18:36:18.946134+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'360","last_scrub_stamp":"2024-09-12T18:36:18.945828+0000","last_deep_scrub":"268'360","last_deep_scrub_stamp":"2024-09-12T18:36:18.945828+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.945828+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:55.758222+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":527,"num_read_kb":3741,"num_write":1103,"num_write_kb":26406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'435","reported_seq":2157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.903357+0000","last_change":"2024-09-12T18:36:25.903357+0000","last_active":"2024-09-12T18:36:25.903357+0000","last_peered":"2024-09-12T18:36:25.903357+0000","last_clean":"2024-09-12T18:36:25.903357+0000","last_became_active":"2024-09-12T17:10:32.362980+0000","last_became_peered":"2024-09-12T17:10:32.362980+0000","last_unstale":"2024-09-12T18:36:25.903357+0000","last_undegraded":"2024-09-12T18:36:25.903357+0000","last_fullsized":"2024-09-12T18:36:25.903357+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'435","last_scrub_stamp":"2024-09-12T18:36:25.903163+0000","last_deep_scrub":"268'435","last_deep_scrub_stamp":"2024-09-12T18:36:25.903163+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.903163+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:46.137958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2502,"num_read_kb":2403,"num_write":488,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2554,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'356","reported_seq":1261,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.924979+0000","last_change":"2024-09-12T18:36:17.924979+0000","last_active":"2024-09-12T18:36:17.924979+0000","last_peered":"2024-09-12T18:36:17.924979+0000","last_clean":"2024-09-12T18:36:17.924979+0000","last_became_active":"2024-09-12T17:11:04.870569+0000","last_became_peered":"2024-09-12T17:11:04.870569+0000","last_unstale":"2024-09-12T18:36:17.924979+0000","last_undegraded":"2024-09-12T18:36:17.924979+0000","last_fullsized":"2024-09-12T18:36:17.924979+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'356","last_scrub_stamp":"2024-09-12T18:36:17.924678+0000","last_deep_scrub":"268'356","last_deep_scrub_stamp":"2024-09-12T18:36:17.924678+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.924678+0000","objects_scrubbed":10,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.128171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170424,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":989,"num_read_kb":89437,"num_write":1208,"num_write_kb":38550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'429","reported_seq":1952,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.943654+0000","last_change":"2024-09-12T18:36:27.943654+0000","last_active":"2024-09-12T18:36:27.943654+0000","last_peered":"2024-09-12T18:36:27.943654+0000","last_clean":"2024-09-12T18:36:27.943654+0000","last_became_active":"2024-09-12T17:10:32.368909+0000","last_became_peered":"2024-09-12T17:10:32.368909+0000","last_unstale":"2024-09-12T18:36:27.943654+0000","last_undegraded":"2024-09-12T18:36:27.943654+0000","last_fullsized":"2024-09-12T18:36:27.943654+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'429","last_scrub_stamp":"2024-09-12T18:36:27.943422+0000","last_deep_scrub":"268'429","last_deep_scrub_stamp":"2024-09-12T18:36:27.943422+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.943422+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:14.861878+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2227,"num_read_kb":2101,"num_write":505,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'392","reported_seq":1066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.853233+0000","last_change":"2024-09-12T18:36:15.853233+0000","last_active":"2024-09-12T18:36:15.853233+0000","last_peered":"2024-09-12T18:36:15.853233+0000","last_clean":"2024-09-12T18:36:15.853233+0000","last_became_active":"2024-09-12T17:10:30.395061+0000","last_became_peered":"2024-09-12T17:10:30.395061+0000","last_unstale":"2024-09-12T18:36:15.853233+0000","last_undegraded":"2024-09-12T18:36:15.853233+0000","last_fullsized":"2024-09-12T18:36:15.853233+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'392","last_scrub_stamp":"2024-09-12T18:36:15.853009+0000","last_deep_scrub":"268'392","last_deep_scrub_stamp":"2024-09-12T18:36:15.853009+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.853009+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:30.721888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194335,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":651,"num_read_kb":20153,"num_write":1153,"num_write_kb":23715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'422","reported_seq":1792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.446660+0000","last_change":"2024-09-12T18:36:19.446660+0000","last_active":"2024-09-12T18:36:19.446660+0000","last_peered":"2024-09-12T18:36:19.446660+0000","last_clean":"2024-09-12T18:36:19.446660+0000","last_became_active":"2024-09-12T17:11:05.124718+0000","last_became_peered":"2024-09-12T17:11:05.124718+0000","last_unstale":"2024-09-12T18:36:19.446660+0000","last_undegraded":"2024-09-12T18:36:19.446660+0000","last_fullsized":"2024-09-12T18:36:19.446660+0000","mapping_epoch":38,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'422","last_scrub_stamp":"2024-09-12T18:36:19.446482+0000","last_deep_scrub":"268'422","last_deep_scrub_stamp":"2024-09-12T18:36:19.446482+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.446482+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:14.866943+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2066,"num_read_kb":1911,"num_write":507,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'655","reported_seq":2401,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.950342+0000","last_change":"2024-09-12T18:36:22.950342+0000","last_active":"2024-09-12T18:36:22.950342+0000","last_peered":"2024-09-12T18:36:22.950342+0000","last_clean":"2024-09-12T18:36:22.950342+0000","last_became_active":"2024-09-12T17:10:32.363179+0000","last_became_peered":"2024-09-12T17:10:32.363179+0000","last_unstale":"2024-09-12T18:36:22.950342+0000","last_undegraded":"2024-09-12T18:36:22.950342+0000","last_fullsized":"2024-09-12T18:36:22.950342+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'655","last_scrub_stamp":"2024-09-12T18:36:22.950172+0000","last_deep_scrub":"268'655","last_deep_scrub_stamp":"2024-09-12T18:36:22.950172+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.950172+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":600,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:34.387389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3427,"num_read_kb":3148,"num_write":833,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'327","reported_seq":1021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.939536+0000","last_change":"2024-09-12T18:36:16.939536+0000","last_active":"2024-09-12T18:36:16.939536+0000","last_peered":"2024-09-12T18:36:16.939536+0000","last_clean":"2024-09-12T18:36:16.939536+0000","last_became_active":"2024-09-12T17:10:30.385785+0000","last_became_peered":"2024-09-12T17:10:30.385785+0000","last_unstale":"2024-09-12T18:36:16.939536+0000","last_undegraded":"2024-09-12T18:36:16.939536+0000","last_fullsized":"2024-09-12T18:36:16.939536+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'327","last_scrub_stamp":"2024-09-12T18:36:16.939330+0000","last_deep_scrub":"268'327","last_deep_scrub_stamp":"2024-09-12T18:36:16.939330+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.939330+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:37.817445+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":51060,"num_write":1041,"num_write_kb":34693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'512","reported_seq":2198,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.981814+0000","last_change":"2024-09-12T18:36:22.981814+0000","last_active":"2024-09-12T18:36:22.981814+0000","last_peered":"2024-09-12T18:36:22.981814+0000","last_clean":"2024-09-12T18:36:22.981814+0000","last_became_active":"2024-09-12T17:10:32.379669+0000","last_became_peered":"2024-09-12T17:10:32.379669+0000","last_unstale":"2024-09-12T18:36:22.981814+0000","last_undegraded":"2024-09-12T18:36:22.981814+0000","last_fullsized":"2024-09-12T18:36:22.981814+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'512","last_scrub_stamp":"2024-09-12T18:36:22.981614+0000","last_deep_scrub":"268'512","last_deep_scrub_stamp":"2024-09-12T18:36:22.981614+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.981614+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:06.503319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2752,"num_read_kb":2572,"num_write":584,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3555,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'342","reported_seq":1004,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.344415+0000","last_change":"2024-09-12T18:36:12.344257+0000","last_active":"2024-09-12T18:36:12.344415+0000","last_peered":"2024-09-12T18:36:12.344415+0000","last_clean":"2024-09-12T18:36:12.344415+0000","last_became_active":"2024-09-12T17:12:05.834873+0000","last_became_peered":"2024-09-12T17:12:05.834873+0000","last_unstale":"2024-09-12T18:36:12.344415+0000","last_undegraded":"2024-09-12T18:36:12.344415+0000","last_fullsized":"2024-09-12T18:36:12.344415+0000","mapping_epoch":40,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-12T18:36:12.344008+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-12T18:36:12.344008+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.344008+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:12.727528+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505043,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":40642,"num_write":1117,"num_write_kb":40250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"268'1947","reported_seq":3546,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.019641+0000","last_change":"2024-09-12T18:36:25.019641+0000","last_active":"2024-09-12T18:36:25.019641+0000","last_peered":"2024-09-12T18:36:25.019641+0000","last_clean":"2024-09-12T18:36:25.019641+0000","last_became_active":"2024-09-12T17:10:32.358342+0000","last_became_peered":"2024-09-12T17:10:32.358342+0000","last_unstale":"2024-09-12T18:36:25.019641+0000","last_undegraded":"2024-09-12T18:36:25.019641+0000","last_fullsized":"2024-09-12T18:36:25.019641+0000","mapping_epoch":27,"log_start":"268'1900","ondisk_log_start":"268'1900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1947","last_scrub_stamp":"2024-09-12T18:36:25.019441+0000","last_deep_scrub":"268'1947","last_deep_scrub_stamp":"2024-09-12T18:36:25.019441+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.019441+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":1900,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:26.178456+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8411,"num_read_kb":7313,"num_write":2747,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1244,"num_omap_keys":5,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'385","reported_seq":1049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.171293+0000","last_change":"2024-09-12T18:36:12.171293+0000","last_active":"2024-09-12T18:36:12.171293+0000","last_peered":"2024-09-12T18:36:12.171293+0000","last_clean":"2024-09-12T18:36:12.171293+0000","last_became_active":"2024-09-12T17:10:30.395938+0000","last_became_peered":"2024-09-12T17:10:30.395938+0000","last_unstale":"2024-09-12T18:36:12.171293+0000","last_undegraded":"2024-09-12T18:36:12.171293+0000","last_fullsized":"2024-09-12T18:36:12.171293+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-12T18:36:12.171022+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-12T18:36:12.171022+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.171022+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:57.800473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":529,"num_read_kb":40778,"num_write":1213,"num_write_kb":34948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'784","reported_seq":2238,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.458241+0000","last_change":"2024-09-12T18:36:17.458241+0000","last_active":"2024-09-12T18:36:17.458241+0000","last_peered":"2024-09-12T18:36:17.458241+0000","last_clean":"2024-09-12T18:36:17.458241+0000","last_became_active":"2024-09-12T17:10:32.354271+0000","last_became_peered":"2024-09-12T17:10:32.354271+0000","last_unstale":"2024-09-12T18:36:17.458241+0000","last_undegraded":"2024-09-12T18:36:17.458241+0000","last_fullsized":"2024-09-12T18:36:17.458241+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'784","last_scrub_stamp":"2024-09-12T18:36:17.458035+0000","last_deep_scrub":"268'784","last_deep_scrub_stamp":"2024-09-12T18:36:17.458035+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.458035+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:22.834719+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3730,"num_read_kb":3333,"num_write":1060,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1463,"num_omap_keys":7,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'534","reported_seq":1291,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.982254+0000","last_change":"2024-09-12T18:36:07.982254+0000","last_active":"2024-09-12T18:36:07.982254+0000","last_peered":"2024-09-12T18:36:07.982254+0000","last_clean":"2024-09-12T18:36:07.982254+0000","last_became_active":"2024-09-12T17:10:30.394905+0000","last_became_peered":"2024-09-12T17:10:30.394905+0000","last_unstale":"2024-09-12T18:36:07.982254+0000","last_undegraded":"2024-09-12T18:36:07.982254+0000","last_fullsized":"2024-09-12T18:36:07.982254+0000","mapping_epoch":25,"log_start":"268'500","ondisk_log_start":"268'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'534","last_scrub_stamp":"2024-09-12T18:36:07.981975+0000","last_deep_scrub":"268'534","last_deep_scrub_stamp":"2024-09-12T18:36:07.981975+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.981975+0000","objects_scrubbed":11,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:02.322234+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4500387,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":948,"num_read_kb":40764,"num_write":1577,"num_write_kb":41950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'789","reported_seq":2390,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.424934+0000","last_change":"2024-09-12T18:36:16.424934+0000","last_active":"2024-09-12T18:36:16.424934+0000","last_peered":"2024-09-12T18:36:16.424934+0000","last_clean":"2024-09-12T18:36:16.424934+0000","last_became_active":"2024-09-12T17:10:32.372137+0000","last_became_peered":"2024-09-12T17:10:32.372137+0000","last_unstale":"2024-09-12T18:36:16.424934+0000","last_undegraded":"2024-09-12T18:36:16.424934+0000","last_fullsized":"2024-09-12T18:36:16.424934+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'789","last_scrub_stamp":"2024-09-12T18:36:16.424682+0000","last_deep_scrub":"268'789","last_deep_scrub_stamp":"2024-09-12T18:36:16.424682+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.424682+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:31.677702+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3748,"num_read_kb":3393,"num_write":1031,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'350","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.873906+0000","last_change":"2024-09-12T18:36:14.873906+0000","last_active":"2024-09-12T18:36:14.873906+0000","last_peered":"2024-09-12T18:36:14.873906+0000","last_clean":"2024-09-12T18:36:14.873906+0000","last_became_active":"2024-09-12T17:10:30.394096+0000","last_became_peered":"2024-09-12T17:10:30.394096+0000","last_unstale":"2024-09-12T18:36:14.873906+0000","last_undegraded":"2024-09-12T18:36:14.873906+0000","last_fullsized":"2024-09-12T18:36:14.873906+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T18:36:14.873700+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T18:36:14.873700+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.873700+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:24.375076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399199,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":10350,"num_write":1046,"num_write_kb":23725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'866","reported_seq":2543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.989539+0000","last_change":"2024-09-12T18:36:21.989539+0000","last_active":"2024-09-12T18:36:21.989539+0000","last_peered":"2024-09-12T18:36:21.989539+0000","last_clean":"2024-09-12T18:36:21.989539+0000","last_became_active":"2024-09-12T17:10:32.361126+0000","last_became_peered":"2024-09-12T17:10:32.361126+0000","last_unstale":"2024-09-12T18:36:21.989539+0000","last_undegraded":"2024-09-12T18:36:21.989539+0000","last_fullsized":"2024-09-12T18:36:21.989539+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'866","last_scrub_stamp":"2024-09-12T18:36:21.989341+0000","last_deep_scrub":"268'866","last_deep_scrub_stamp":"2024-09-12T18:36:21.989341+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.989341+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":800,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:40.716672+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4216,"num_read_kb":3793,"num_write":1162,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'338","reported_seq":964,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.621286+0000","last_change":"2024-09-12T18:36:12.621286+0000","last_active":"2024-09-12T18:36:12.621286+0000","last_peered":"2024-09-12T18:36:12.621286+0000","last_clean":"2024-09-12T18:36:12.621286+0000","last_became_active":"2024-09-12T17:10:30.353147+0000","last_became_peered":"2024-09-12T17:10:30.353147+0000","last_unstale":"2024-09-12T18:36:12.621286+0000","last_undegraded":"2024-09-12T18:36:12.621286+0000","last_fullsized":"2024-09-12T18:36:12.621286+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'338","last_scrub_stamp":"2024-09-12T18:36:12.621045+0000","last_deep_scrub":"268'338","last_deep_scrub_stamp":"2024-09-12T18:36:12.621045+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.621045+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:05.954192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":416,"num_read_kb":13692,"num_write":1012,"num_write_kb":32545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'138","reported_seq":688,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.757372+0000","last_change":"2024-09-12T18:36:40.757372+0000","last_active":"2024-09-12T18:36:40.757372+0000","last_peered":"2024-09-12T18:36:40.757372+0000","last_clean":"2024-09-12T18:36:40.757372+0000","last_became_active":"2024-09-12T17:10:40.421380+0000","last_became_peered":"2024-09-12T17:10:40.421380+0000","last_unstale":"2024-09-12T18:36:40.757372+0000","last_undegraded":"2024-09-12T18:36:40.757372+0000","last_fullsized":"2024-09-12T18:36:40.757372+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'138","last_scrub_stamp":"2024-09-12T18:36:40.757083+0000","last_deep_scrub":"268'138","last_deep_scrub_stamp":"2024-09-12T18:36:40.757083+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.757083+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:12.153166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":207,"num_write":318,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'457","reported_seq":2079,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.781267+0000","last_change":"2024-09-12T18:36:20.781267+0000","last_active":"2024-09-12T18:36:20.781267+0000","last_peered":"2024-09-12T18:36:20.781267+0000","last_clean":"2024-09-12T18:36:20.781267+0000","last_became_active":"2024-09-12T17:10:32.370058+0000","last_became_peered":"2024-09-12T17:10:32.370058+0000","last_unstale":"2024-09-12T18:36:20.781267+0000","last_undegraded":"2024-09-12T18:36:20.781267+0000","last_fullsized":"2024-09-12T18:36:20.781267+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'457","last_scrub_stamp":"2024-09-12T18:36:20.781035+0000","last_deep_scrub":"268'457","last_deep_scrub_stamp":"2024-09-12T18:36:20.781035+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.781035+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:40.316776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2398,"num_read_kb":2269,"num_write":525,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'310","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.309364+0000","last_change":"2024-09-12T18:36:11.309364+0000","last_active":"2024-09-12T18:36:11.309364+0000","last_peered":"2024-09-12T18:36:11.309364+0000","last_clean":"2024-09-12T18:36:11.309364+0000","last_became_active":"2024-09-12T17:11:04.871007+0000","last_became_peered":"2024-09-12T17:11:04.871007+0000","last_unstale":"2024-09-12T18:36:11.309364+0000","last_undegraded":"2024-09-12T18:36:11.309364+0000","last_fullsized":"2024-09-12T18:36:11.309364+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-12T18:36:11.309154+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-12T18:36:11.309154+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.309154+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:27.380152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":422,"num_read_kb":10233,"num_write":1020,"num_write_kb":32687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.887052+0000","last_change":"2024-09-12T18:36:30.887052+0000","last_active":"2024-09-12T18:36:30.887052+0000","last_peered":"2024-09-12T18:36:30.887052+0000","last_clean":"2024-09-12T18:36:30.887052+0000","last_became_active":"2024-09-12T17:10:34.371022+0000","last_became_peered":"2024-09-12T17:10:34.371022+0000","last_unstale":"2024-09-12T18:36:30.887052+0000","last_undegraded":"2024-09-12T18:36:30.887052+0000","last_fullsized":"2024-09-12T18:36:30.887052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:30.886855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:30.886855+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.886855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:49.121602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'371","reported_seq":1013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.691239+0000","last_change":"2024-09-12T18:36:29.691239+0000","last_active":"2024-09-12T18:36:29.691239+0000","last_peered":"2024-09-12T18:36:29.691239+0000","last_clean":"2024-09-12T18:36:29.691239+0000","last_became_active":"2024-09-12T17:10:36.399464+0000","last_became_peered":"2024-09-12T17:10:36.399464+0000","last_unstale":"2024-09-12T18:36:29.691239+0000","last_undegraded":"2024-09-12T18:36:29.691239+0000","last_fullsized":"2024-09-12T18:36:29.691239+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'371","last_scrub_stamp":"2024-09-12T18:36:29.691048+0000","last_deep_scrub":"268'371","last_deep_scrub_stamp":"2024-09-12T18:36:29.691048+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.691048+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:40.446128+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49246,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":602,"num_read_kb":1286,"num_write":476,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.002847+0000","last_change":"2024-09-12T18:36:40.002847+0000","last_active":"2024-09-12T18:36:40.002847+0000","last_peered":"2024-09-12T18:36:40.002847+0000","last_clean":"2024-09-12T18:36:40.002847+0000","last_became_active":"2024-09-12T17:10:38.404423+0000","last_became_peered":"2024-09-12T17:10:38.404423+0000","last_unstale":"2024-09-12T18:36:40.002847+0000","last_undegraded":"2024-09-12T18:36:40.002847+0000","last_fullsized":"2024-09-12T18:36:40.002847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:40.002666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:40.002666+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.002666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:16.488702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'174","reported_seq":752,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.812941+0000","last_change":"2024-09-12T18:36:44.812941+0000","last_active":"2024-09-12T18:36:44.812941+0000","last_peered":"2024-09-12T18:36:44.812941+0000","last_clean":"2024-09-12T18:36:44.812941+0000","last_became_active":"2024-09-12T17:10:40.425532+0000","last_became_peered":"2024-09-12T17:10:40.425532+0000","last_unstale":"2024-09-12T18:36:44.812941+0000","last_undegraded":"2024-09-12T18:36:44.812941+0000","last_fullsized":"2024-09-12T18:36:44.812941+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'174","last_scrub_stamp":"2024-09-12T18:36:44.812743+0000","last_deep_scrub":"268'174","last_deep_scrub_stamp":"2024-09-12T18:36:44.812743+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.812743+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:34.484903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":265,"num_read_kb":256,"num_write":326,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'734","reported_seq":2472,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.977608+0000","last_change":"2024-09-12T18:36:22.977608+0000","last_active":"2024-09-12T18:36:22.977608+0000","last_peered":"2024-09-12T18:36:22.977608+0000","last_clean":"2024-09-12T18:36:22.977608+0000","last_became_active":"2024-09-12T17:10:32.381838+0000","last_became_peered":"2024-09-12T17:10:32.381838+0000","last_unstale":"2024-09-12T18:36:22.977608+0000","last_undegraded":"2024-09-12T18:36:22.977608+0000","last_fullsized":"2024-09-12T18:36:22.977608+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'734","last_scrub_stamp":"2024-09-12T18:36:22.977435+0000","last_deep_scrub":"268'734","last_deep_scrub_stamp":"2024-09-12T18:36:22.977435+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.977435+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:38.867097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3756,"num_read_kb":3395,"num_write":1068,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'387","reported_seq":1116,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.651608+0000","last_change":"2024-09-12T18:36:08.651608+0000","last_active":"2024-09-12T18:36:08.651608+0000","last_peered":"2024-09-12T18:36:08.651608+0000","last_clean":"2024-09-12T18:36:08.651608+0000","last_became_active":"2024-09-12T17:10:30.362010+0000","last_became_peered":"2024-09-12T17:10:30.362010+0000","last_unstale":"2024-09-12T18:36:08.651608+0000","last_undegraded":"2024-09-12T18:36:08.651608+0000","last_fullsized":"2024-09-12T18:36:08.651608+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'387","last_scrub_stamp":"2024-09-12T18:36:08.651489+0000","last_deep_scrub":"268'387","last_deep_scrub_stamp":"2024-09-12T18:36:08.651489+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.651489+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:16.615443+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9667749,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":698,"num_read_kb":52712,"num_write":1418,"num_write_kb":39491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.802895+0000","last_change":"2024-09-12T18:36:27.802895+0000","last_active":"2024-09-12T18:36:27.802895+0000","last_peered":"2024-09-12T18:36:27.802895+0000","last_clean":"2024-09-12T18:36:27.802895+0000","last_became_active":"2024-09-12T17:10:34.361102+0000","last_became_peered":"2024-09-12T17:10:34.361102+0000","last_unstale":"2024-09-12T18:36:27.802895+0000","last_undegraded":"2024-09-12T18:36:27.802895+0000","last_fullsized":"2024-09-12T18:36:27.802895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:27.802698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:27.802698+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.802698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:44.974084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'113","reported_seq":677,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.759671+0000","last_change":"2024-09-12T18:36:32.759671+0000","last_active":"2024-09-12T18:36:32.759671+0000","last_peered":"2024-09-12T18:36:32.759671+0000","last_clean":"2024-09-12T18:36:32.759671+0000","last_became_active":"2024-09-12T17:10:36.390398+0000","last_became_peered":"2024-09-12T17:10:36.390398+0000","last_unstale":"2024-09-12T18:36:32.759671+0000","last_undegraded":"2024-09-12T18:36:32.759671+0000","last_fullsized":"2024-09-12T18:36:32.759671+0000","mapping_epoch":31,"log_start":"268'101","ondisk_log_start":"268'101","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'113","last_scrub_stamp":"2024-09-12T18:36:32.759435+0000","last_deep_scrub":"268'113","last_deep_scrub_stamp":"2024-09-12T18:36:32.759435+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.759435+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":101,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:52.362289+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.750447+0000","last_change":"2024-09-12T18:36:37.750447+0000","last_active":"2024-09-12T18:36:37.750447+0000","last_peered":"2024-09-12T18:36:37.750447+0000","last_clean":"2024-09-12T18:36:37.750447+0000","last_became_active":"2024-09-12T17:10:38.414063+0000","last_became_peered":"2024-09-12T17:10:38.414063+0000","last_unstale":"2024-09-12T18:36:37.750447+0000","last_undegraded":"2024-09-12T18:36:37.750447+0000","last_fullsized":"2024-09-12T18:36:37.750447+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:37.750266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:37.750266+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.750266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:40.593091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'143","reported_seq":669,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.718607+0000","last_change":"2024-09-12T18:36:42.718607+0000","last_active":"2024-09-12T18:36:42.718607+0000","last_peered":"2024-09-12T18:36:42.718607+0000","last_clean":"2024-09-12T18:36:42.718607+0000","last_became_active":"2024-09-12T17:10:40.422118+0000","last_became_peered":"2024-09-12T17:10:40.422118+0000","last_unstale":"2024-09-12T18:36:42.718607+0000","last_undegraded":"2024-09-12T18:36:42.718607+0000","last_fullsized":"2024-09-12T18:36:42.718607+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'143","last_scrub_stamp":"2024-09-12T18:36:42.718415+0000","last_deep_scrub":"268'143","last_deep_scrub_stamp":"2024-09-12T18:36:42.718415+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.718415+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:22.743040+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":180,"num_write":349,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'874","reported_seq":2504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.499729+0000","last_change":"2024-09-12T18:36:16.499729+0000","last_active":"2024-09-12T18:36:16.499729+0000","last_peered":"2024-09-12T18:36:16.499729+0000","last_clean":"2024-09-12T18:36:16.499729+0000","last_became_active":"2024-09-12T17:10:32.351650+0000","last_became_peered":"2024-09-12T17:10:32.351650+0000","last_unstale":"2024-09-12T18:36:16.499729+0000","last_undegraded":"2024-09-12T18:36:16.499729+0000","last_fullsized":"2024-09-12T18:36:16.499729+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'874","last_scrub_stamp":"2024-09-12T18:36:16.499553+0000","last_deep_scrub":"268'874","last_deep_scrub_stamp":"2024-09-12T18:36:16.499553+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.499553+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:08.094193+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4313,"num_read_kb":3885,"num_write":1184,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'394","reported_seq":1137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.970009+0000","last_change":"2024-09-12T18:36:13.970009+0000","last_active":"2024-09-12T18:36:13.970009+0000","last_peered":"2024-09-12T18:36:13.970009+0000","last_clean":"2024-09-12T18:36:13.970009+0000","last_became_active":"2024-09-12T17:10:30.393670+0000","last_became_peered":"2024-09-12T17:10:30.393670+0000","last_unstale":"2024-09-12T18:36:13.970009+0000","last_undegraded":"2024-09-12T18:36:13.970009+0000","last_fullsized":"2024-09-12T18:36:13.970009+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T18:36:13.969732+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T18:36:13.969732+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.969732+0000","objects_scrubbed":10,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:08.366310+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3976825,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":785,"num_read_kb":43186,"num_write":1227,"num_write_kb":22438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.856938+0000","last_change":"2024-09-12T18:36:29.856938+0000","last_active":"2024-09-12T18:36:29.856938+0000","last_peered":"2024-09-12T18:36:29.856938+0000","last_clean":"2024-09-12T18:36:29.856938+0000","last_became_active":"2024-09-12T17:10:34.358119+0000","last_became_peered":"2024-09-12T17:10:34.358119+0000","last_unstale":"2024-09-12T18:36:29.856938+0000","last_undegraded":"2024-09-12T18:36:29.856938+0000","last_fullsized":"2024-09-12T18:36:29.856938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:29.856757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:29.856757+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.856757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:50.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'157","reported_seq":739,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.490785+0000","last_change":"2024-09-12T18:36:24.490785+0000","last_active":"2024-09-12T18:36:24.490785+0000","last_peered":"2024-09-12T18:36:24.490785+0000","last_clean":"2024-09-12T18:36:24.490785+0000","last_became_active":"2024-09-12T17:10:36.384465+0000","last_became_peered":"2024-09-12T17:10:36.384465+0000","last_unstale":"2024-09-12T18:36:24.490785+0000","last_undegraded":"2024-09-12T18:36:24.490785+0000","last_fullsized":"2024-09-12T18:36:24.490785+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'157","last_scrub_stamp":"2024-09-12T18:36:24.490568+0000","last_deep_scrub":"268'157","last_deep_scrub_stamp":"2024-09-12T18:36:24.490568+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.490568+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:59.451113+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":178,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'795","reported_seq":2929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.010486+0000","last_change":"2024-09-12T18:36:38.010486+0000","last_active":"2024-09-12T18:36:38.010486+0000","last_peered":"2024-09-12T18:36:38.010486+0000","last_clean":"2024-09-12T18:36:38.010486+0000","last_became_active":"2024-09-12T17:10:38.406964+0000","last_became_peered":"2024-09-12T17:10:38.406964+0000","last_unstale":"2024-09-12T18:36:38.010486+0000","last_undegraded":"2024-09-12T18:36:38.010486+0000","last_fullsized":"2024-09-12T18:36:38.010486+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'795","last_scrub_stamp":"2024-09-12T18:36:38.010307+0000","last_deep_scrub":"268'795","last_deep_scrub_stamp":"2024-09-12T18:36:38.010307+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.010307+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:19.069357+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'257","reported_seq":1122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.773012+0000","last_change":"2024-09-12T18:36:41.773012+0000","last_active":"2024-09-12T18:36:41.773012+0000","last_peered":"2024-09-12T18:36:41.773012+0000","last_clean":"2024-09-12T18:36:41.773012+0000","last_became_active":"2024-09-12T17:10:40.768896+0000","last_became_peered":"2024-09-12T17:10:40.768896+0000","last_unstale":"2024-09-12T18:36:41.773012+0000","last_undegraded":"2024-09-12T18:36:41.773012+0000","last_fullsized":"2024-09-12T18:36:41.773012+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'257","last_scrub_stamp":"2024-09-12T18:36:41.772831+0000","last_deep_scrub":"268'257","last_deep_scrub_stamp":"2024-09-12T18:36:41.772831+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.772831+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:20.614751+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":705,"num_read_kb":685,"num_write":456,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'534","reported_seq":2346,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.817370+0000","last_change":"2024-09-12T18:36:19.817370+0000","last_active":"2024-09-12T18:36:19.817370+0000","last_peered":"2024-09-12T18:36:19.817370+0000","last_clean":"2024-09-12T18:36:19.817370+0000","last_became_active":"2024-09-12T17:10:32.382671+0000","last_became_peered":"2024-09-12T17:10:32.382671+0000","last_unstale":"2024-09-12T18:36:19.817370+0000","last_undegraded":"2024-09-12T18:36:19.817370+0000","last_fullsized":"2024-09-12T18:36:19.817370+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'534","last_scrub_stamp":"2024-09-12T18:36:19.817166+0000","last_deep_scrub":"268'534","last_deep_scrub_stamp":"2024-09-12T18:36:19.817166+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.817166+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:25.307712+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3129,"num_read_kb":2937,"num_write":633,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3101,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'384","reported_seq":1068,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.175322+0000","last_change":"2024-09-12T18:36:09.175322+0000","last_active":"2024-09-12T18:36:09.175322+0000","last_peered":"2024-09-12T18:36:09.175322+0000","last_clean":"2024-09-12T18:36:09.175322+0000","last_became_active":"2024-09-12T17:10:30.390677+0000","last_became_peered":"2024-09-12T17:10:30.390677+0000","last_unstale":"2024-09-12T18:36:09.175322+0000","last_undegraded":"2024-09-12T18:36:09.175322+0000","last_fullsized":"2024-09-12T18:36:09.175322+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'384","last_scrub_stamp":"2024-09-12T18:36:09.175054+0000","last_deep_scrub":"268'384","last_deep_scrub_stamp":"2024-09-12T18:36:09.175054+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.175054+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:54.543850+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262215,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":587,"num_read_kb":63186,"num_write":1131,"num_write_kb":46639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.849515+0000","last_change":"2024-09-12T18:36:31.849515+0000","last_active":"2024-09-12T18:36:31.849515+0000","last_peered":"2024-09-12T18:36:31.849515+0000","last_clean":"2024-09-12T18:36:31.849515+0000","last_became_active":"2024-09-12T17:10:34.371937+0000","last_became_peered":"2024-09-12T17:10:34.371937+0000","last_unstale":"2024-09-12T18:36:31.849515+0000","last_undegraded":"2024-09-12T18:36:31.849515+0000","last_fullsized":"2024-09-12T18:36:31.849515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:31.849247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:31.849247+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.849247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:45.208680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'323","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.949245+0000","last_change":"2024-09-12T18:36:33.949245+0000","last_active":"2024-09-12T18:36:33.949245+0000","last_peered":"2024-09-12T18:36:33.949245+0000","last_clean":"2024-09-12T18:36:33.949245+0000","last_became_active":"2024-09-12T17:10:36.920487+0000","last_became_peered":"2024-09-12T17:10:36.920487+0000","last_unstale":"2024-09-12T18:36:33.949245+0000","last_undegraded":"2024-09-12T18:36:33.949245+0000","last_fullsized":"2024-09-12T18:36:33.949245+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'323","last_scrub_stamp":"2024-09-12T18:36:33.949047+0000","last_deep_scrub":"268'323","last_deep_scrub_stamp":"2024-09-12T18:36:33.949047+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.949047+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:14.235888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46675,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":545,"num_read_kb":1308,"num_write":450,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'809","reported_seq":2825,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.969480+0000","last_change":"2024-09-12T18:36:40.969480+0000","last_active":"2024-09-12T18:36:40.969480+0000","last_peered":"2024-09-12T18:36:40.969480+0000","last_clean":"2024-09-12T18:36:40.969480+0000","last_became_active":"2024-09-12T17:10:38.393524+0000","last_became_peered":"2024-09-12T17:10:38.393524+0000","last_unstale":"2024-09-12T18:36:40.969480+0000","last_undegraded":"2024-09-12T18:36:40.969480+0000","last_fullsized":"2024-09-12T18:36:40.969480+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'809","last_scrub_stamp":"2024-09-12T18:36:40.969247+0000","last_deep_scrub":"268'809","last_deep_scrub_stamp":"2024-09-12T18:36:40.969247+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.969247+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:00.549255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'402","reported_seq":1979,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.984204+0000","last_change":"2024-09-12T18:36:21.984204+0000","last_active":"2024-09-12T18:36:21.984204+0000","last_peered":"2024-09-12T18:36:21.984204+0000","last_clean":"2024-09-12T18:36:21.984204+0000","last_became_active":"2024-09-12T17:10:32.378027+0000","last_became_peered":"2024-09-12T17:10:32.378027+0000","last_unstale":"2024-09-12T18:36:21.984204+0000","last_undegraded":"2024-09-12T18:36:21.984204+0000","last_fullsized":"2024-09-12T18:36:21.984204+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'402","last_scrub_stamp":"2024-09-12T18:36:21.983901+0000","last_deep_scrub":"268'402","last_deep_scrub_stamp":"2024-09-12T18:36:21.983901+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.983901+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:14.125927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2313,"num_read_kb":2218,"num_write":459,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'347","reported_seq":1027,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.000957+0000","last_change":"2024-09-12T18:36:12.000812+0000","last_active":"2024-09-12T18:36:12.000957+0000","last_peered":"2024-09-12T18:36:12.000957+0000","last_clean":"2024-09-12T18:36:12.000957+0000","last_became_active":"2024-09-12T17:10:30.386707+0000","last_became_peered":"2024-09-12T17:10:30.386707+0000","last_unstale":"2024-09-12T18:36:12.000957+0000","last_undegraded":"2024-09-12T18:36:12.000957+0000","last_fullsized":"2024-09-12T18:36:12.000957+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-12T18:36:12.000536+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-12T18:36:12.000536+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.000536+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:38.013571+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399029,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":531,"num_read_kb":31049,"num_write":1121,"num_write_kb":31528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.971329+0000","last_change":"2024-09-12T18:36:26.971329+0000","last_active":"2024-09-12T18:36:26.971329+0000","last_peered":"2024-09-12T18:36:26.971329+0000","last_clean":"2024-09-12T18:36:26.971329+0000","last_became_active":"2024-09-12T17:10:34.369066+0000","last_became_peered":"2024-09-12T17:10:34.369066+0000","last_unstale":"2024-09-12T18:36:26.971329+0000","last_undegraded":"2024-09-12T18:36:26.971329+0000","last_fullsized":"2024-09-12T18:36:26.971329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.971149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.971149+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.971149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:39.933136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'394","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.886618+0000","last_change":"2024-09-12T18:36:35.886618+0000","last_active":"2024-09-12T18:36:35.886618+0000","last_peered":"2024-09-12T18:36:35.886618+0000","last_clean":"2024-09-12T18:36:35.886618+0000","last_became_active":"2024-09-12T17:10:36.920136+0000","last_became_peered":"2024-09-12T17:10:36.920136+0000","last_unstale":"2024-09-12T18:36:35.886618+0000","last_undegraded":"2024-09-12T18:36:35.886618+0000","last_fullsized":"2024-09-12T18:36:35.886618+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T18:36:35.886408+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T18:36:35.886408+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.886408+0000","objects_scrubbed":9,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:53.596754+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54168,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":623,"num_read_kb":1195,"num_write":466,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.879465+0000","last_change":"2024-09-12T18:36:25.879465+0000","last_active":"2024-09-12T18:36:25.879465+0000","last_peered":"2024-09-12T18:36:25.879465+0000","last_clean":"2024-09-12T18:36:25.879465+0000","last_became_active":"2024-09-12T17:10:38.394381+0000","last_became_peered":"2024-09-12T17:10:38.394381+0000","last_unstale":"2024-09-12T18:36:25.879465+0000","last_undegraded":"2024-09-12T18:36:25.879465+0000","last_fullsized":"2024-09-12T18:36:25.879465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:25.879288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:25.879288+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.879288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:15.785711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'534","reported_seq":1368,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.840000+0000","last_change":"2024-09-12T18:36:39.840000+0000","last_active":"2024-09-12T18:36:39.840000+0000","last_peered":"2024-09-12T18:36:39.840000+0000","last_clean":"2024-09-12T18:36:39.840000+0000","last_became_active":"2024-09-12T17:10:40.422353+0000","last_became_peered":"2024-09-12T17:10:40.422353+0000","last_unstale":"2024-09-12T18:36:39.840000+0000","last_undegraded":"2024-09-12T18:36:39.840000+0000","last_fullsized":"2024-09-12T18:36:39.840000+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'534","last_scrub_stamp":"2024-09-12T18:36:39.839738+0000","last_deep_scrub":"268'534","last_deep_scrub_stamp":"2024-09-12T18:36:39.839738+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.839738+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:19.782940+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1294,"num_read_kb":1291,"num_write":1098,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'425","reported_seq":2041,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.993454+0000","last_change":"2024-09-12T18:36:11.993454+0000","last_active":"2024-09-12T18:36:11.993454+0000","last_peered":"2024-09-12T18:36:11.993454+0000","last_clean":"2024-09-12T18:36:11.993454+0000","last_became_active":"2024-09-12T17:10:32.369188+0000","last_became_peered":"2024-09-12T17:10:32.369188+0000","last_unstale":"2024-09-12T18:36:11.993454+0000","last_undegraded":"2024-09-12T18:36:11.993454+0000","last_fullsized":"2024-09-12T18:36:11.993454+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'425","last_scrub_stamp":"2024-09-12T18:36:11.993172+0000","last_deep_scrub":"268'425","last_deep_scrub_stamp":"2024-09-12T18:36:11.993172+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.993172+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:31.536535+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2274,"num_read_kb":2176,"num_write":482,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'333","reported_seq":1118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.915481+0000","last_change":"2024-09-12T18:36:14.915481+0000","last_active":"2024-09-12T18:36:14.915481+0000","last_peered":"2024-09-12T18:36:14.915481+0000","last_clean":"2024-09-12T18:36:14.915481+0000","last_became_active":"2024-09-12T17:10:30.381728+0000","last_became_peered":"2024-09-12T17:10:30.381728+0000","last_unstale":"2024-09-12T18:36:14.915481+0000","last_undegraded":"2024-09-12T18:36:14.915481+0000","last_fullsized":"2024-09-12T18:36:14.915481+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-12T18:36:14.915264+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-12T18:36:14.915264+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.915264+0000","objects_scrubbed":9,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:17.086755+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399298,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":581,"num_read_kb":127583,"num_write":1019,"num_write_kb":57035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.416236+0000","last_change":"2024-09-12T18:36:21.416236+0000","last_active":"2024-09-12T18:36:21.416236+0000","last_peered":"2024-09-12T18:36:21.416236+0000","last_clean":"2024-09-12T18:36:21.416236+0000","last_became_active":"2024-09-12T17:10:34.346229+0000","last_became_peered":"2024-09-12T17:10:34.346229+0000","last_unstale":"2024-09-12T18:36:21.416236+0000","last_undegraded":"2024-09-12T18:36:21.416236+0000","last_fullsized":"2024-09-12T18:36:21.416236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:21.416056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:21.416056+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.416056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:15.060850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'302","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.887064+0000","last_change":"2024-09-12T18:36:30.887064+0000","last_active":"2024-09-12T18:36:30.887064+0000","last_peered":"2024-09-12T18:36:30.887064+0000","last_clean":"2024-09-12T18:36:30.887064+0000","last_became_active":"2024-09-12T17:10:36.398641+0000","last_became_peered":"2024-09-12T17:10:36.398641+0000","last_unstale":"2024-09-12T18:36:30.887064+0000","last_undegraded":"2024-09-12T18:36:30.887064+0000","last_fullsized":"2024-09-12T18:36:30.887064+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'302","last_scrub_stamp":"2024-09-12T18:36:30.886775+0000","last_deep_scrub":"268'302","last_deep_scrub_stamp":"2024-09-12T18:36:30.886775+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.886775+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:50.024569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":1192,"num_write":410,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.977363+0000","last_change":"2024-09-12T18:36:41.977363+0000","last_active":"2024-09-12T18:36:41.977363+0000","last_peered":"2024-09-12T18:36:41.977363+0000","last_clean":"2024-09-12T18:36:41.977363+0000","last_became_active":"2024-09-12T17:10:38.393114+0000","last_became_peered":"2024-09-12T17:10:38.393114+0000","last_unstale":"2024-09-12T18:36:41.977363+0000","last_undegraded":"2024-09-12T18:36:41.977363+0000","last_fullsized":"2024-09-12T18:36:41.977363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:41.977180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:41.977180+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.977180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:29.512987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'2404","reported_seq":4254,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.208843+0000","last_change":"2024-09-12T18:36:27.208843+0000","last_active":"2024-09-12T18:36:27.208843+0000","last_peered":"2024-09-12T18:36:27.208843+0000","last_clean":"2024-09-12T18:36:27.208843+0000","last_became_active":"2024-09-12T17:10:40.425351+0000","last_became_peered":"2024-09-12T17:10:40.425351+0000","last_unstale":"2024-09-12T18:36:27.208843+0000","last_undegraded":"2024-09-12T18:36:27.208843+0000","last_fullsized":"2024-09-12T18:36:27.208843+0000","mapping_epoch":35,"log_start":"268'2300","ondisk_log_start":"268'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2404","last_scrub_stamp":"2024-09-12T18:36:27.208656+0000","last_deep_scrub":"268'2404","last_deep_scrub_stamp":"2024-09-12T18:36:27.208656+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.208656+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":2300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:30.619720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6030,"num_read_kb":6033,"num_write":4839,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'771","reported_seq":2283,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.076189+0000","last_change":"2024-09-12T18:36:16.076189+0000","last_active":"2024-09-12T18:36:16.076189+0000","last_peered":"2024-09-12T18:36:16.076189+0000","last_clean":"2024-09-12T18:36:16.076189+0000","last_became_active":"2024-09-12T17:11:04.373050+0000","last_became_peered":"2024-09-12T17:11:04.373050+0000","last_unstale":"2024-09-12T18:36:16.076189+0000","last_undegraded":"2024-09-12T18:36:16.076189+0000","last_fullsized":"2024-09-12T18:36:16.076189+0000","mapping_epoch":38,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'771","last_scrub_stamp":"2024-09-12T18:36:16.075977+0000","last_deep_scrub":"268'771","last_deep_scrub_stamp":"2024-09-12T18:36:16.075977+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.075977+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:34.465225+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3705,"num_read_kb":3333,"num_write":1034,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":470,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'339","reported_seq":1022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.991290+0000","last_change":"2024-09-12T18:36:12.991290+0000","last_active":"2024-09-12T18:36:12.991290+0000","last_peered":"2024-09-12T18:36:12.991290+0000","last_clean":"2024-09-12T18:36:12.991290+0000","last_became_active":"2024-09-12T17:10:30.381997+0000","last_became_peered":"2024-09-12T17:10:30.381997+0000","last_unstale":"2024-09-12T18:36:12.991290+0000","last_undegraded":"2024-09-12T18:36:12.991290+0000","last_fullsized":"2024-09-12T18:36:12.991290+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T18:36:12.991024+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T18:36:12.991024+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.991024+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:06.763609+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":534,"num_read_kb":9738,"num_write":1109,"num_write_kb":58445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.424294+0000","last_change":"2024-09-12T18:36:20.424294+0000","last_active":"2024-09-12T18:36:20.424294+0000","last_peered":"2024-09-12T18:36:20.424294+0000","last_clean":"2024-09-12T18:36:20.424294+0000","last_became_active":"2024-09-12T17:10:34.358798+0000","last_became_peered":"2024-09-12T17:10:34.358798+0000","last_unstale":"2024-09-12T18:36:20.424294+0000","last_undegraded":"2024-09-12T18:36:20.424294+0000","last_fullsized":"2024-09-12T18:36:20.424294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:20.424121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:20.424121+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.424121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:13.717135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'358","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.969112+0000","last_change":"2024-09-12T18:36:31.969112+0000","last_active":"2024-09-12T18:36:31.969112+0000","last_peered":"2024-09-12T18:36:31.969112+0000","last_clean":"2024-09-12T18:36:31.969112+0000","last_became_active":"2024-09-12T17:10:36.396261+0000","last_became_peered":"2024-09-12T17:10:36.396261+0000","last_unstale":"2024-09-12T18:36:31.969112+0000","last_undegraded":"2024-09-12T18:36:31.969112+0000","last_fullsized":"2024-09-12T18:36:31.969112+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-12T18:36:31.968917+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-12T18:36:31.968917+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.968917+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:43.059228+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49048,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1254,"num_write":464,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'802","reported_seq":2791,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.821601+0000","last_change":"2024-09-12T18:36:35.821601+0000","last_active":"2024-09-12T18:36:35.821601+0000","last_peered":"2024-09-12T18:36:35.821601+0000","last_clean":"2024-09-12T18:36:35.821601+0000","last_became_active":"2024-09-12T17:10:38.408710+0000","last_became_peered":"2024-09-12T17:10:38.408710+0000","last_unstale":"2024-09-12T18:36:35.821601+0000","last_undegraded":"2024-09-12T18:36:35.821601+0000","last_fullsized":"2024-09-12T18:36:35.821601+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'802","last_scrub_stamp":"2024-09-12T18:36:35.821417+0000","last_deep_scrub":"268'802","last_deep_scrub_stamp":"2024-09-12T18:36:35.821417+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.821417+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:26.246515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'126","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.818917+0000","last_change":"2024-09-12T18:36:39.818917+0000","last_active":"2024-09-12T18:36:39.818917+0000","last_peered":"2024-09-12T18:36:39.818917+0000","last_clean":"2024-09-12T18:36:39.818917+0000","last_became_active":"2024-09-12T17:10:40.417664+0000","last_became_peered":"2024-09-12T17:10:40.417664+0000","last_unstale":"2024-09-12T18:36:39.818917+0000","last_undegraded":"2024-09-12T18:36:39.818917+0000","last_fullsized":"2024-09-12T18:36:39.818917+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'126","last_scrub_stamp":"2024-09-12T18:36:39.818689+0000","last_deep_scrub":"268'126","last_deep_scrub_stamp":"2024-09-12T18:36:39.818689+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.818689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:15.525509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":285,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'887","reported_seq":2356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.581186+0000","last_change":"2024-09-12T18:36:21.581186+0000","last_active":"2024-09-12T18:36:21.581186+0000","last_peered":"2024-09-12T18:36:21.581186+0000","last_clean":"2024-09-12T18:36:21.581186+0000","last_became_active":"2024-09-12T17:10:32.364995+0000","last_became_peered":"2024-09-12T17:10:32.364995+0000","last_unstale":"2024-09-12T18:36:21.581186+0000","last_undegraded":"2024-09-12T18:36:21.581186+0000","last_fullsized":"2024-09-12T18:36:21.581186+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'887","last_scrub_stamp":"2024-09-12T18:36:21.580992+0000","last_deep_scrub":"268'887","last_deep_scrub_stamp":"2024-09-12T18:36:21.580992+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.580992+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:04.860009+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4158,"num_read_kb":3733,"num_write":1245,"num_write_kb":492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'333","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.931436+0000","last_change":"2024-09-12T18:36:10.931436+0000","last_active":"2024-09-12T18:36:10.931436+0000","last_peered":"2024-09-12T18:36:10.931436+0000","last_clean":"2024-09-12T18:36:10.931436+0000","last_became_active":"2024-09-12T17:10:30.393495+0000","last_became_peered":"2024-09-12T17:10:30.393495+0000","last_unstale":"2024-09-12T18:36:10.931436+0000","last_undegraded":"2024-09-12T18:36:10.931436+0000","last_fullsized":"2024-09-12T18:36:10.931436+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-12T18:36:10.931229+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-12T18:36:10.931229+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.931229+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:44.015657+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170230,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":492,"num_read_kb":51876,"num_write":985,"num_write_kb":56464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.456159+0000","last_change":"2024-09-12T18:36:23.456159+0000","last_active":"2024-09-12T18:36:23.456159+0000","last_peered":"2024-09-12T18:36:23.456159+0000","last_clean":"2024-09-12T18:36:23.456159+0000","last_became_active":"2024-09-12T17:10:34.360732+0000","last_became_peered":"2024-09-12T17:10:34.360732+0000","last_unstale":"2024-09-12T18:36:23.456159+0000","last_undegraded":"2024-09-12T18:36:23.456159+0000","last_fullsized":"2024-09-12T18:36:23.456159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:23.455974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:23.455974+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.455974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:57.486813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'515","reported_seq":1189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.626221+0000","last_change":"2024-09-12T18:36:27.626221+0000","last_active":"2024-09-12T18:36:27.626221+0000","last_peered":"2024-09-12T18:36:27.626221+0000","last_clean":"2024-09-12T18:36:27.626221+0000","last_became_active":"2024-09-12T17:10:36.399536+0000","last_became_peered":"2024-09-12T17:10:36.399536+0000","last_unstale":"2024-09-12T18:36:27.626221+0000","last_undegraded":"2024-09-12T18:36:27.626221+0000","last_fullsized":"2024-09-12T18:36:27.626221+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'515","last_scrub_stamp":"2024-09-12T18:36:27.626038+0000","last_deep_scrub":"268'515","last_deep_scrub_stamp":"2024-09-12T18:36:27.626038+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.626038+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:01.780600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89531,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":886,"num_read_kb":2156,"num_write":724,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.504638+0000","last_change":"2024-09-12T18:36:26.504638+0000","last_active":"2024-09-12T18:36:26.504638+0000","last_peered":"2024-09-12T18:36:26.504638+0000","last_clean":"2024-09-12T18:36:26.504638+0000","last_became_active":"2024-09-12T17:10:38.405169+0000","last_became_peered":"2024-09-12T17:10:38.405169+0000","last_unstale":"2024-09-12T18:36:26.504638+0000","last_undegraded":"2024-09-12T18:36:26.504638+0000","last_fullsized":"2024-09-12T18:36:26.504638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.504135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.504135+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.504135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:48.917759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'150","reported_seq":758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.808477+0000","last_change":"2024-09-12T18:36:33.808477+0000","last_active":"2024-09-12T18:36:33.808477+0000","last_peered":"2024-09-12T18:36:33.808477+0000","last_clean":"2024-09-12T18:36:33.808477+0000","last_became_active":"2024-09-12T17:10:40.409722+0000","last_became_peered":"2024-09-12T17:10:40.409722+0000","last_unstale":"2024-09-12T18:36:33.808477+0000","last_undegraded":"2024-09-12T18:36:33.808477+0000","last_fullsized":"2024-09-12T18:36:33.808477+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'150","last_scrub_stamp":"2024-09-12T18:36:33.808262+0000","last_deep_scrub":"268'150","last_deep_scrub_stamp":"2024-09-12T18:36:33.808262+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.808262+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:12.376177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":508,"num_read_kb":430,"num_write":364,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'825","reported_seq":2351,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.972052+0000","last_change":"2024-09-12T18:36:12.972052+0000","last_active":"2024-09-12T18:36:12.972052+0000","last_peered":"2024-09-12T18:36:12.972052+0000","last_clean":"2024-09-12T18:36:12.972052+0000","last_became_active":"2024-09-12T17:10:32.370915+0000","last_became_peered":"2024-09-12T17:10:32.370915+0000","last_unstale":"2024-09-12T18:36:12.972052+0000","last_undegraded":"2024-09-12T18:36:12.972052+0000","last_fullsized":"2024-09-12T18:36:12.972052+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'825","last_scrub_stamp":"2024-09-12T18:36:12.971870+0000","last_deep_scrub":"268'825","last_deep_scrub_stamp":"2024-09-12T18:36:12.971870+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.971870+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:25.914060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3877,"num_read_kb":3457,"num_write":1088,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'360","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.366818+0000","last_change":"2024-09-12T18:36:07.366750+0000","last_active":"2024-09-12T18:36:07.366818+0000","last_peered":"2024-09-12T18:36:07.366818+0000","last_clean":"2024-09-12T18:36:07.366818+0000","last_became_active":"2024-09-12T17:11:04.868662+0000","last_became_peered":"2024-09-12T17:11:04.868662+0000","last_unstale":"2024-09-12T18:36:07.366818+0000","last_undegraded":"2024-09-12T18:36:07.366818+0000","last_fullsized":"2024-09-12T18:36:07.366818+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'360","last_scrub_stamp":"2024-09-12T18:36:07.366618+0000","last_deep_scrub":"268'360","last_deep_scrub_stamp":"2024-09-12T18:36:07.366618+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.366618+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:46.462039+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456511,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":553,"num_read_kb":17196,"num_write":1231,"num_write_kb":37960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.462220+0000","last_change":"2024-09-12T18:36:22.462220+0000","last_active":"2024-09-12T18:36:22.462220+0000","last_peered":"2024-09-12T18:36:22.462220+0000","last_clean":"2024-09-12T18:36:22.462220+0000","last_became_active":"2024-09-12T17:10:34.363822+0000","last_became_peered":"2024-09-12T17:10:34.363822+0000","last_unstale":"2024-09-12T18:36:22.462220+0000","last_undegraded":"2024-09-12T18:36:22.462220+0000","last_fullsized":"2024-09-12T18:36:22.462220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:22.462029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:22.462029+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.462029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:34.960157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'310","reported_seq":932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.805947+0000","last_change":"2024-09-12T18:36:31.805947+0000","last_active":"2024-09-12T18:36:31.805947+0000","last_peered":"2024-09-12T18:36:31.805947+0000","last_clean":"2024-09-12T18:36:31.805947+0000","last_became_active":"2024-09-12T17:10:36.377677+0000","last_became_peered":"2024-09-12T17:10:36.377677+0000","last_unstale":"2024-09-12T18:36:31.805947+0000","last_undegraded":"2024-09-12T18:36:31.805947+0000","last_fullsized":"2024-09-12T18:36:31.805947+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-12T18:36:31.805723+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-12T18:36:31.805723+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.805723+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:34.615781+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50917,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":528,"num_read_kb":1122,"num_write":460,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.770704+0000","last_change":"2024-09-12T18:36:34.770704+0000","last_active":"2024-09-12T18:36:34.770704+0000","last_peered":"2024-09-12T18:36:34.770704+0000","last_clean":"2024-09-12T18:36:34.770704+0000","last_became_active":"2024-09-12T17:10:38.413429+0000","last_became_peered":"2024-09-12T17:10:38.413429+0000","last_unstale":"2024-09-12T18:36:34.770704+0000","last_undegraded":"2024-09-12T18:36:34.770704+0000","last_fullsized":"2024-09-12T18:36:34.770704+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:34.770523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:34.770523+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.770523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:05.999887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'116","reported_seq":633,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.941374+0000","last_change":"2024-09-12T18:36:42.941374+0000","last_active":"2024-09-12T18:36:42.941374+0000","last_peered":"2024-09-12T18:36:42.941374+0000","last_clean":"2024-09-12T18:36:42.941374+0000","last_became_active":"2024-09-12T17:10:40.415270+0000","last_became_peered":"2024-09-12T17:10:40.415270+0000","last_unstale":"2024-09-12T18:36:42.941374+0000","last_undegraded":"2024-09-12T18:36:42.941374+0000","last_fullsized":"2024-09-12T18:36:42.941374+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'116","last_scrub_stamp":"2024-09-12T18:36:42.941131+0000","last_deep_scrub":"268'116","last_deep_scrub_stamp":"2024-09-12T18:36:42.941131+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.941131+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:22.686550+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":272,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'513","reported_seq":2185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.975512+0000","last_change":"2024-09-12T18:36:13.975512+0000","last_active":"2024-09-12T18:36:13.975512+0000","last_peered":"2024-09-12T18:36:13.975512+0000","last_clean":"2024-09-12T18:36:13.975512+0000","last_became_active":"2024-09-12T17:10:32.357121+0000","last_became_peered":"2024-09-12T17:10:32.357121+0000","last_unstale":"2024-09-12T18:36:13.975512+0000","last_undegraded":"2024-09-12T18:36:13.975512+0000","last_fullsized":"2024-09-12T18:36:13.975512+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'513","last_scrub_stamp":"2024-09-12T18:36:13.975293+0000","last_deep_scrub":"268'513","last_deep_scrub_stamp":"2024-09-12T18:36:13.975293+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.975293+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":500,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:27.406648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2802,"num_read_kb":2611,"num_write":616,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'390","reported_seq":1081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.140455+0000","last_change":"2024-09-12T18:36:14.140455+0000","last_active":"2024-09-12T18:36:14.140455+0000","last_peered":"2024-09-12T18:36:14.140455+0000","last_clean":"2024-09-12T18:36:14.140455+0000","last_became_active":"2024-09-12T17:10:30.391780+0000","last_became_peered":"2024-09-12T17:10:30.391780+0000","last_unstale":"2024-09-12T18:36:14.140455+0000","last_undegraded":"2024-09-12T18:36:14.140455+0000","last_fullsized":"2024-09-12T18:36:14.140455+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'390","last_scrub_stamp":"2024-09-12T18:36:14.140207+0000","last_deep_scrub":"268'390","last_deep_scrub_stamp":"2024-09-12T18:36:14.140207+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.140207+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:53.168988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170426,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":660,"num_read_kb":4836,"num_write":1182,"num_write_kb":23965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.876077+0000","last_change":"2024-09-12T18:36:18.876077+0000","last_active":"2024-09-12T18:36:18.876077+0000","last_peered":"2024-09-12T18:36:18.876077+0000","last_clean":"2024-09-12T18:36:18.876077+0000","last_became_active":"2024-09-12T17:10:34.362337+0000","last_became_peered":"2024-09-12T17:10:34.362337+0000","last_unstale":"2024-09-12T18:36:18.876077+0000","last_undegraded":"2024-09-12T18:36:18.876077+0000","last_fullsized":"2024-09-12T18:36:18.876077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:18.875873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:18.875873+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.875873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:35.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'347","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.533049+0000","last_change":"2024-09-12T18:36:27.533049+0000","last_active":"2024-09-12T18:36:27.533049+0000","last_peered":"2024-09-12T18:36:27.533049+0000","last_clean":"2024-09-12T18:36:27.533049+0000","last_became_active":"2024-09-12T17:10:36.389965+0000","last_became_peered":"2024-09-12T17:10:36.389965+0000","last_unstale":"2024-09-12T18:36:27.533049+0000","last_undegraded":"2024-09-12T18:36:27.533049+0000","last_fullsized":"2024-09-12T18:36:27.533049+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-12T18:36:27.532837+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-12T18:36:27.532837+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.532837+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:54.733598+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60342,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":574,"num_read_kb":1242,"num_write":452,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'766","reported_seq":6969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.495465+0000","last_change":"2024-09-12T18:36:25.495465+0000","last_active":"2024-09-12T18:36:25.495465+0000","last_peered":"2024-09-12T18:36:25.495465+0000","last_clean":"2024-09-12T18:36:25.495465+0000","last_became_active":"2024-09-12T17:10:38.397332+0000","last_became_peered":"2024-09-12T17:10:38.397332+0000","last_unstale":"2024-09-12T18:36:25.495465+0000","last_undegraded":"2024-09-12T18:36:25.495465+0000","last_fullsized":"2024-09-12T18:36:25.495465+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'766","last_scrub_stamp":"2024-09-12T18:36:25.495275+0000","last_deep_scrub":"268'766","last_deep_scrub_stamp":"2024-09-12T18:36:25.495275+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.495275+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:58.308585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'153","reported_seq":686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.850700+0000","last_change":"2024-09-12T18:36:29.850700+0000","last_active":"2024-09-12T18:36:29.850700+0000","last_peered":"2024-09-12T18:36:29.850700+0000","last_clean":"2024-09-12T18:36:29.850700+0000","last_became_active":"2024-09-12T17:10:40.423894+0000","last_became_peered":"2024-09-12T17:10:40.423894+0000","last_unstale":"2024-09-12T18:36:29.850700+0000","last_undegraded":"2024-09-12T18:36:29.850700+0000","last_fullsized":"2024-09-12T18:36:29.850700+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'153","last_scrub_stamp":"2024-09-12T18:36:29.850481+0000","last_deep_scrub":"268'153","last_deep_scrub_stamp":"2024-09-12T18:36:29.850481+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.850481+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:41.819877+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1683,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":214,"num_read_kb":204,"num_write":362,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'508","reported_seq":2230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.061396+0000","last_change":"2024-09-12T18:36:16.061396+0000","last_active":"2024-09-12T18:36:16.061396+0000","last_peered":"2024-09-12T18:36:16.061396+0000","last_clean":"2024-09-12T18:36:16.061396+0000","last_became_active":"2024-09-12T17:10:32.361164+0000","last_became_peered":"2024-09-12T17:10:32.361164+0000","last_unstale":"2024-09-12T18:36:16.061396+0000","last_undegraded":"2024-09-12T18:36:16.061396+0000","last_fullsized":"2024-09-12T18:36:16.061396+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'508","last_scrub_stamp":"2024-09-12T18:36:16.061192+0000","last_deep_scrub":"268'508","last_deep_scrub_stamp":"2024-09-12T18:36:16.061192+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.061192+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:04.877347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2673,"num_read_kb":2535,"num_write":607,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'391","reported_seq":1130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.012522+0000","last_change":"2024-09-12T18:36:07.012522+0000","last_active":"2024-09-12T18:36:07.012522+0000","last_peered":"2024-09-12T18:36:07.012522+0000","last_clean":"2024-09-12T18:36:07.012522+0000","last_became_active":"2024-09-12T17:10:30.361126+0000","last_became_peered":"2024-09-12T17:10:30.361126+0000","last_unstale":"2024-09-12T18:36:07.012522+0000","last_undegraded":"2024-09-12T18:36:07.012522+0000","last_fullsized":"2024-09-12T18:36:07.012522+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'391","last_scrub_stamp":"2024-09-12T18:36:07.012238+0000","last_deep_scrub":"268'391","last_deep_scrub_stamp":"2024-09-12T18:36:07.012238+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.012238+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:22.284310+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8882037,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":691,"num_read_kb":57357,"num_write":1297,"num_write_kb":69062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1488,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.919834+0000","last_change":"2024-09-12T18:36:29.919699+0000","last_active":"2024-09-12T18:36:29.919834+0000","last_peered":"2024-09-12T18:36:29.919834+0000","last_clean":"2024-09-12T18:36:29.919834+0000","last_became_active":"2024-09-12T17:10:34.367608+0000","last_became_peered":"2024-09-12T17:10:34.367608+0000","last_unstale":"2024-09-12T18:36:29.919834+0000","last_undegraded":"2024-09-12T18:36:29.919834+0000","last_fullsized":"2024-09-12T18:36:29.919834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:29.919514+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:29.919514+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.919514+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:59.551307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'127","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.973454+0000","last_change":"2024-09-12T18:36:33.973454+0000","last_active":"2024-09-12T18:36:33.973454+0000","last_peered":"2024-09-12T18:36:33.973454+0000","last_clean":"2024-09-12T18:36:33.973454+0000","last_became_active":"2024-09-12T17:10:36.921242+0000","last_became_peered":"2024-09-12T17:10:36.921242+0000","last_unstale":"2024-09-12T18:36:33.973454+0000","last_undegraded":"2024-09-12T18:36:33.973454+0000","last_fullsized":"2024-09-12T18:36:33.973454+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-09-12T18:36:33.973249+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-09-12T18:36:33.973249+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.973249+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:56.412447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'781","reported_seq":2895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.125502+0000","last_change":"2024-09-12T18:36:25.125502+0000","last_active":"2024-09-12T18:36:25.125502+0000","last_peered":"2024-09-12T18:36:25.125502+0000","last_clean":"2024-09-12T18:36:25.125502+0000","last_became_active":"2024-09-12T17:10:38.397242+0000","last_became_peered":"2024-09-12T17:10:38.397242+0000","last_unstale":"2024-09-12T18:36:25.125502+0000","last_undegraded":"2024-09-12T18:36:25.125502+0000","last_fullsized":"2024-09-12T18:36:25.125502+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'781","last_scrub_stamp":"2024-09-12T18:36:25.125289+0000","last_deep_scrub":"268'781","last_deep_scrub_stamp":"2024-09-12T18:36:25.125289+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.125289+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:01.514681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'139","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.760416+0000","last_change":"2024-09-12T18:36:38.760416+0000","last_active":"2024-09-12T18:36:38.760416+0000","last_peered":"2024-09-12T18:36:38.760416+0000","last_clean":"2024-09-12T18:36:38.760416+0000","last_became_active":"2024-09-12T17:10:40.415831+0000","last_became_peered":"2024-09-12T17:10:40.415831+0000","last_unstale":"2024-09-12T18:36:38.760416+0000","last_undegraded":"2024-09-12T18:36:38.760416+0000","last_fullsized":"2024-09-12T18:36:38.760416+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'139","last_scrub_stamp":"2024-09-12T18:36:38.760146+0000","last_deep_scrub":"268'139","last_deep_scrub_stamp":"2024-09-12T18:36:38.760146+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.760146+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:42.944767+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":150,"num_write":326,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'563","reported_seq":2088,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.989105+0000","last_change":"2024-09-12T18:36:21.988883+0000","last_active":"2024-09-12T18:36:21.989105+0000","last_peered":"2024-09-12T18:36:21.989105+0000","last_clean":"2024-09-12T18:36:21.989105+0000","last_became_active":"2024-09-12T17:10:32.366967+0000","last_became_peered":"2024-09-12T17:10:32.366967+0000","last_unstale":"2024-09-12T18:36:21.989105+0000","last_undegraded":"2024-09-12T18:36:21.989105+0000","last_fullsized":"2024-09-12T18:36:21.989105+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'563","last_scrub_stamp":"2024-09-12T18:36:21.988625+0000","last_deep_scrub":"268'563","last_deep_scrub_stamp":"2024-09-12T18:36:21.988625+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.988625+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:25.834312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2878,"num_read_kb":2622,"num_write":716,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'383","reported_seq":1075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.936973+0000","last_change":"2024-09-12T18:36:06.936973+0000","last_active":"2024-09-12T18:36:06.936973+0000","last_peered":"2024-09-12T18:36:06.936973+0000","last_clean":"2024-09-12T18:36:06.936973+0000","last_became_active":"2024-09-12T17:10:30.360368+0000","last_became_peered":"2024-09-12T17:10:30.360368+0000","last_unstale":"2024-09-12T18:36:06.936973+0000","last_undegraded":"2024-09-12T18:36:06.936973+0000","last_fullsized":"2024-09-12T18:36:06.936973+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-12T18:36:06.936843+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-12T18:36:06.936843+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.936843+0000","objects_scrubbed":8,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:18.264741+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4303946,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":608,"num_read_kb":11061,"num_write":1240,"num_write_kb":24095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.864724+0000","last_change":"2024-09-12T18:36:26.864724+0000","last_active":"2024-09-12T18:36:26.864724+0000","last_peered":"2024-09-12T18:36:26.864724+0000","last_clean":"2024-09-12T18:36:26.864724+0000","last_became_active":"2024-09-12T17:10:34.354009+0000","last_became_peered":"2024-09-12T17:10:34.354009+0000","last_unstale":"2024-09-12T18:36:26.864724+0000","last_undegraded":"2024-09-12T18:36:26.864724+0000","last_fullsized":"2024-09-12T18:36:26.864724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.864521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.864521+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.864521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:13.936489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'386","reported_seq":1043,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.929178+0000","last_change":"2024-09-12T18:36:34.929178+0000","last_active":"2024-09-12T18:36:34.929178+0000","last_peered":"2024-09-12T18:36:34.929178+0000","last_clean":"2024-09-12T18:36:34.929178+0000","last_became_active":"2024-09-12T17:10:36.392271+0000","last_became_peered":"2024-09-12T17:10:36.392271+0000","last_unstale":"2024-09-12T18:36:34.929178+0000","last_undegraded":"2024-09-12T18:36:34.929178+0000","last_fullsized":"2024-09-12T18:36:34.929178+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'386","last_scrub_stamp":"2024-09-12T18:36:34.928990+0000","last_deep_scrub":"268'386","last_deep_scrub_stamp":"2024-09-12T18:36:34.928990+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.928990+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:30.954181+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45147,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":615,"num_read_kb":1214,"num_write":468,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.096343+0000","last_change":"2024-09-12T18:36:24.096343+0000","last_active":"2024-09-12T18:36:24.096343+0000","last_peered":"2024-09-12T18:36:24.096343+0000","last_clean":"2024-09-12T18:36:24.096343+0000","last_became_active":"2024-09-12T17:10:38.398743+0000","last_became_peered":"2024-09-12T17:10:38.398743+0000","last_unstale":"2024-09-12T18:36:24.096343+0000","last_undegraded":"2024-09-12T18:36:24.096343+0000","last_fullsized":"2024-09-12T18:36:24.096343+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:24.096160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:24.096160+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.096160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:15:10.883351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'108","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.907368+0000","last_change":"2024-09-12T18:36:26.907368+0000","last_active":"2024-09-12T18:36:26.907368+0000","last_peered":"2024-09-12T18:36:26.907368+0000","last_clean":"2024-09-12T18:36:26.907368+0000","last_became_active":"2024-09-12T17:10:40.410710+0000","last_became_peered":"2024-09-12T17:10:40.410710+0000","last_unstale":"2024-09-12T18:36:26.907368+0000","last_undegraded":"2024-09-12T18:36:26.907368+0000","last_fullsized":"2024-09-12T18:36:26.907368+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'108","last_scrub_stamp":"2024-09-12T18:36:26.907174+0000","last_deep_scrub":"268'108","last_deep_scrub_stamp":"2024-09-12T18:36:26.907174+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.907174+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:55.084708+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":239,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'450","reported_seq":2013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.163747+0000","last_change":"2024-09-12T18:36:13.163599+0000","last_active":"2024-09-12T18:36:13.163747+0000","last_peered":"2024-09-12T18:36:13.163747+0000","last_clean":"2024-09-12T18:36:13.163747+0000","last_became_active":"2024-09-12T17:10:32.366571+0000","last_became_peered":"2024-09-12T17:10:32.366571+0000","last_unstale":"2024-09-12T18:36:13.163747+0000","last_undegraded":"2024-09-12T18:36:13.163747+0000","last_fullsized":"2024-09-12T18:36:13.163747+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'450","last_scrub_stamp":"2024-09-12T18:36:13.163413+0000","last_deep_scrub":"268'450","last_deep_scrub_stamp":"2024-09-12T18:36:13.163413+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.163413+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:42.296285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2259,"num_read_kb":2146,"num_write":500,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":645,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.003510+0000","last_change":"2024-09-12T18:36:09.003372+0000","last_active":"2024-09-12T18:36:09.003510+0000","last_peered":"2024-09-12T18:36:09.003510+0000","last_clean":"2024-09-12T18:36:09.003510+0000","last_became_active":"2024-09-12T17:10:13.024652+0000","last_became_peered":"2024-09-12T17:10:13.024652+0000","last_unstale":"2024-09-12T18:36:09.003510+0000","last_undegraded":"2024-09-12T18:36:09.003510+0000","last_fullsized":"2024-09-12T18:36:09.003510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-12T18:36:09.003177+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-12T18:36:09.003177+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.003177+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:13.554583+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.977110+0000","last_change":"2024-09-12T18:36:08.977110+0000","last_active":"2024-09-12T18:36:08.977110+0000","last_peered":"2024-09-12T18:36:08.977110+0000","last_clean":"2024-09-12T18:36:08.977110+0000","last_became_active":"2024-09-12T17:10:18.073547+0000","last_became_peered":"2024-09-12T17:10:18.073547+0000","last_unstale":"2024-09-12T18:36:08.977110+0000","last_undegraded":"2024-09-12T18:36:08.977110+0000","last_fullsized":"2024-09-12T18:36:08.977110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:08.976931+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:08.976931+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.976931+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:40.637153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010552039999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'325","reported_seq":1042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.967233+0000","last_change":"2024-09-12T18:36:07.967233+0000","last_active":"2024-09-12T18:36:07.967233+0000","last_peered":"2024-09-12T18:36:07.967233+0000","last_clean":"2024-09-12T18:36:07.967233+0000","last_became_active":"2024-09-12T17:10:30.395026+0000","last_became_peered":"2024-09-12T17:10:30.395026+0000","last_unstale":"2024-09-12T18:36:07.967233+0000","last_undegraded":"2024-09-12T18:36:07.967233+0000","last_fullsized":"2024-09-12T18:36:07.967233+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'325","last_scrub_stamp":"2024-09-12T18:36:07.967135+0000","last_deep_scrub":"268'325","last_deep_scrub_stamp":"2024-09-12T18:36:07.967135+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.967135+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:46.811857+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048618,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":151053,"num_write":1004,"num_write_kb":34461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"268'4","reported_seq":1013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.935798+0000","last_change":"2024-09-12T18:36:24.935798+0000","last_active":"2024-09-12T18:36:24.935798+0000","last_peered":"2024-09-12T18:36:24.935798+0000","last_clean":"2024-09-12T18:36:24.935798+0000","last_became_active":"2024-09-12T17:10:34.363615+0000","last_became_peered":"2024-09-12T17:10:34.363615+0000","last_unstale":"2024-09-12T18:36:24.935798+0000","last_undegraded":"2024-09-12T18:36:24.935798+0000","last_fullsized":"2024-09-12T18:36:24.935798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:24.935619+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:24.935619+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.935619+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:43.313804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":734,"num_read_kb":732,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'760","reported_seq":1498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.930201+0000","last_change":"2024-09-12T18:36:33.930201+0000","last_active":"2024-09-12T18:36:33.930201+0000","last_peered":"2024-09-12T18:36:33.930201+0000","last_clean":"2024-09-12T18:36:33.930201+0000","last_became_active":"2024-09-12T17:10:36.395060+0000","last_became_peered":"2024-09-12T17:10:36.395060+0000","last_unstale":"2024-09-12T18:36:33.930201+0000","last_undegraded":"2024-09-12T18:36:33.930201+0000","last_fullsized":"2024-09-12T18:36:33.930201+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'760","last_scrub_stamp":"2024-09-12T18:36:33.930021+0000","last_deep_scrub":"268'760","last_deep_scrub_stamp":"2024-09-12T18:36:33.930021+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.930021+0000","objects_scrubbed":7,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:41.316757+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142312,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1468,"num_read_kb":3324,"num_write":1428,"num_write_kb":1256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106668,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.692277+0000","last_change":"2024-09-12T18:36:32.692277+0000","last_active":"2024-09-12T18:36:32.692277+0000","last_peered":"2024-09-12T18:36:32.692277+0000","last_clean":"2024-09-12T18:36:32.692277+0000","last_became_active":"2024-09-12T17:10:38.413042+0000","last_became_peered":"2024-09-12T17:10:38.413042+0000","last_unstale":"2024-09-12T18:36:32.692277+0000","last_undegraded":"2024-09-12T18:36:32.692277+0000","last_fullsized":"2024-09-12T18:36:32.692277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:32.692076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:32.692076+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.692076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:46.407882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'216","reported_seq":947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.183568+0000","last_change":"2024-09-12T18:36:29.183568+0000","last_active":"2024-09-12T18:36:29.183568+0000","last_peered":"2024-09-12T18:36:29.183568+0000","last_clean":"2024-09-12T18:36:29.183568+0000","last_became_active":"2024-09-12T17:10:40.413341+0000","last_became_peered":"2024-09-12T17:10:40.413341+0000","last_unstale":"2024-09-12T18:36:29.183568+0000","last_undegraded":"2024-09-12T18:36:29.183568+0000","last_fullsized":"2024-09-12T18:36:29.183568+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'216","last_scrub_stamp":"2024-09-12T18:36:29.183338+0000","last_deep_scrub":"268'216","last_deep_scrub_stamp":"2024-09-12T18:36:29.183338+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.183338+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:56.524847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":511,"num_write":461,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'396","reported_seq":1842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.589512+0000","last_change":"2024-09-12T18:36:13.589512+0000","last_active":"2024-09-12T18:36:13.589512+0000","last_peered":"2024-09-12T18:36:13.589512+0000","last_clean":"2024-09-12T18:36:13.589512+0000","last_became_active":"2024-09-12T17:10:32.364798+0000","last_became_peered":"2024-09-12T17:10:32.364798+0000","last_unstale":"2024-09-12T18:36:13.589512+0000","last_undegraded":"2024-09-12T18:36:13.589512+0000","last_fullsized":"2024-09-12T18:36:13.589512+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'396","last_scrub_stamp":"2024-09-12T18:36:13.589303+0000","last_deep_scrub":"268'396","last_deep_scrub_stamp":"2024-09-12T18:36:13.589303+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.589303+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:17.430737+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2015,"num_read_kb":1907,"num_write":451,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":552,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.017279+0000","last_change":"2024-09-12T18:36:11.017052+0000","last_active":"2024-09-12T18:36:11.017279+0000","last_peered":"2024-09-12T18:36:11.017279+0000","last_clean":"2024-09-12T18:36:11.017279+0000","last_became_active":"2024-09-12T17:10:18.073016+0000","last_became_peered":"2024-09-12T17:10:18.073016+0000","last_unstale":"2024-09-12T18:36:11.017279+0000","last_undegraded":"2024-09-12T18:36:11.017279+0000","last_fullsized":"2024-09-12T18:36:11.017279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:11.016844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:11.016844+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.016844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:43.713164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098613699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'345","reported_seq":1030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:05.576045+0000","last_change":"2024-09-12T18:36:05.576045+0000","last_active":"2024-09-12T18:36:05.576045+0000","last_peered":"2024-09-12T18:36:05.576045+0000","last_clean":"2024-09-12T18:36:05.576045+0000","last_became_active":"2024-09-12T17:10:30.355237+0000","last_became_peered":"2024-09-12T17:10:30.355237+0000","last_unstale":"2024-09-12T18:36:05.576045+0000","last_undegraded":"2024-09-12T18:36:05.576045+0000","last_fullsized":"2024-09-12T18:36:05.576045+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'345","last_scrub_stamp":"2024-09-12T18:36:05.575700+0000","last_deep_scrub":"268'345","last_deep_scrub_stamp":"2024-09-12T18:36:05.575700+0000","last_clean_scrub_stamp":"2024-09-12T18:36:05.575700+0000","objects_scrubbed":8,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:37.874770+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262274,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":552,"num_read_kb":28524,"num_write":1156,"num_write_kb":35154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.961219+0000","last_change":"2024-09-12T18:36:28.961219+0000","last_active":"2024-09-12T18:36:28.961219+0000","last_peered":"2024-09-12T18:36:28.961219+0000","last_clean":"2024-09-12T18:36:28.961219+0000","last_became_active":"2024-09-12T17:10:34.366826+0000","last_became_peered":"2024-09-12T17:10:34.366826+0000","last_unstale":"2024-09-12T18:36:28.961219+0000","last_undegraded":"2024-09-12T18:36:28.961219+0000","last_fullsized":"2024-09-12T18:36:28.961219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:28.961015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:28.961015+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.961015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:28.657697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1394","reported_seq":3392,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.860034+0000","last_change":"2024-09-12T18:36:30.860034+0000","last_active":"2024-09-12T18:36:30.860034+0000","last_peered":"2024-09-12T18:36:30.860034+0000","last_clean":"2024-09-12T18:36:30.860034+0000","last_became_active":"2024-09-12T17:10:36.398283+0000","last_became_peered":"2024-09-12T17:10:36.398283+0000","last_unstale":"2024-09-12T18:36:30.860034+0000","last_undegraded":"2024-09-12T18:36:30.860034+0000","last_fullsized":"2024-09-12T18:36:30.860034+0000","mapping_epoch":31,"log_start":"268'1300","ondisk_log_start":"268'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1394","last_scrub_stamp":"2024-09-12T18:36:30.859791+0000","last_deep_scrub":"268'1394","last_deep_scrub_stamp":"2024-09-12T18:36:30.859791+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.859791+0000","objects_scrubbed":11,"log_size":94,"log_dups_size":1300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:58.008271+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157765,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2194,"num_read_kb":4204,"num_write":1286,"num_write_kb":1080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.002470+0000","last_change":"2024-09-12T18:36:36.002470+0000","last_active":"2024-09-12T18:36:36.002470+0000","last_peered":"2024-09-12T18:36:36.002470+0000","last_clean":"2024-09-12T18:36:36.002470+0000","last_became_active":"2024-09-12T17:10:38.407002+0000","last_became_peered":"2024-09-12T17:10:38.407002+0000","last_unstale":"2024-09-12T18:36:36.002470+0000","last_undegraded":"2024-09-12T18:36:36.002470+0000","last_fullsized":"2024-09-12T18:36:36.002470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:36.002257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:36.002257+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.002257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:16.711812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'127","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.822482+0000","last_change":"2024-09-12T18:36:34.822482+0000","last_active":"2024-09-12T18:36:34.822482+0000","last_peered":"2024-09-12T18:36:34.822482+0000","last_clean":"2024-09-12T18:36:34.822482+0000","last_became_active":"2024-09-12T17:10:40.770362+0000","last_became_peered":"2024-09-12T17:10:40.770362+0000","last_unstale":"2024-09-12T18:36:34.822482+0000","last_undegraded":"2024-09-12T18:36:34.822482+0000","last_fullsized":"2024-09-12T18:36:34.822482+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-09-12T18:36:34.822272+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-09-12T18:36:34.822272+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.822272+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:28.926701+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":150,"num_write":307,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'427","reported_seq":2046,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.925833+0000","last_change":"2024-09-12T18:36:17.925833+0000","last_active":"2024-09-12T18:36:17.925833+0000","last_peered":"2024-09-12T18:36:17.925833+0000","last_clean":"2024-09-12T18:36:17.925833+0000","last_became_active":"2024-09-12T17:10:32.361184+0000","last_became_peered":"2024-09-12T17:10:32.361184+0000","last_unstale":"2024-09-12T18:36:17.925833+0000","last_undegraded":"2024-09-12T18:36:17.925833+0000","last_fullsized":"2024-09-12T18:36:17.925833+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'427","last_scrub_stamp":"2024-09-12T18:36:17.925631+0000","last_deep_scrub":"268'427","last_deep_scrub_stamp":"2024-09-12T18:36:17.925631+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.925631+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:12.940790+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2375,"num_read_kb":2259,"num_write":493,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":555,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.366031+0000","last_change":"2024-09-12T18:36:08.366031+0000","last_active":"2024-09-12T18:36:08.366031+0000","last_peered":"2024-09-12T18:36:08.366031+0000","last_clean":"2024-09-12T18:36:08.366031+0000","last_became_active":"2024-09-12T17:10:18.210168+0000","last_became_peered":"2024-09-12T17:10:18.210168+0000","last_unstale":"2024-09-12T18:36:08.366031+0000","last_undegraded":"2024-09-12T18:36:08.366031+0000","last_fullsized":"2024-09-12T18:36:08.366031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:08.365841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:08.365841+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.365841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:46.140147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001219171,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'335","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:05.823972+0000","last_change":"2024-09-12T18:36:05.823972+0000","last_active":"2024-09-12T18:36:05.823972+0000","last_peered":"2024-09-12T18:36:05.823972+0000","last_clean":"2024-09-12T18:36:05.823972+0000","last_became_active":"2024-09-12T17:10:30.405641+0000","last_became_peered":"2024-09-12T17:10:30.405641+0000","last_unstale":"2024-09-12T18:36:05.823972+0000","last_undegraded":"2024-09-12T18:36:05.823972+0000","last_fullsized":"2024-09-12T18:36:05.823972+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'335","last_scrub_stamp":"2024-09-12T18:36:05.823746+0000","last_deep_scrub":"268'335","last_deep_scrub_stamp":"2024-09-12T18:36:05.823746+0000","last_clean_scrub_stamp":"2024-09-12T18:36:05.823746+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:01.852500+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":435,"num_read_kb":15806,"num_write":1012,"num_write_kb":36297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.440485+0000","last_change":"2024-09-12T18:36:18.440485+0000","last_active":"2024-09-12T18:36:18.440485+0000","last_peered":"2024-09-12T18:36:18.440485+0000","last_clean":"2024-09-12T18:36:18.440485+0000","last_became_active":"2024-09-12T17:10:34.367870+0000","last_became_peered":"2024-09-12T17:10:34.367870+0000","last_unstale":"2024-09-12T18:36:18.440485+0000","last_undegraded":"2024-09-12T18:36:18.440485+0000","last_fullsized":"2024-09-12T18:36:18.440485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:18.440311+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:18.440311+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.440311+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:10.134048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'354","reported_seq":1955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.993747+0000","last_change":"2024-09-12T18:36:30.993747+0000","last_active":"2024-09-12T18:36:30.993747+0000","last_peered":"2024-09-12T18:36:30.993747+0000","last_clean":"2024-09-12T18:36:30.993747+0000","last_became_active":"2024-09-12T17:10:36.922321+0000","last_became_peered":"2024-09-12T17:10:36.922321+0000","last_unstale":"2024-09-12T18:36:30.993747+0000","last_undegraded":"2024-09-12T18:36:30.993747+0000","last_fullsized":"2024-09-12T18:36:30.993747+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'354","last_scrub_stamp":"2024-09-12T18:36:30.993518+0000","last_deep_scrub":"268'354","last_deep_scrub_stamp":"2024-09-12T18:36:30.993518+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.993518+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:54.363804+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":291,"num_read_kb":281,"num_write":273,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.729064+0000","last_change":"2024-09-12T18:36:31.729064+0000","last_active":"2024-09-12T18:36:31.729064+0000","last_peered":"2024-09-12T18:36:31.729064+0000","last_clean":"2024-09-12T18:36:31.729064+0000","last_became_active":"2024-09-12T17:10:38.413459+0000","last_became_peered":"2024-09-12T17:10:38.413459+0000","last_unstale":"2024-09-12T18:36:31.729064+0000","last_undegraded":"2024-09-12T18:36:31.729064+0000","last_fullsized":"2024-09-12T18:36:31.729064+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:31.728883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:31.728883+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.728883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:06.064463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'231","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:02.367458+0000","last_change":"2024-09-12T17:10:40.415650+0000","last_active":"2024-09-12T18:34:02.367458+0000","last_peered":"2024-09-12T18:34:02.367458+0000","last_clean":"2024-09-12T18:34:02.367458+0000","last_became_active":"2024-09-12T17:10:40.414712+0000","last_became_peered":"2024-09-12T17:10:40.414712+0000","last_unstale":"2024-09-12T18:34:02.367458+0000","last_undegraded":"2024-09-12T18:34:02.367458+0000","last_fullsized":"2024-09-12T18:34:02.367458+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":496,"num_read_kb":517,"num_write":496,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'463","reported_seq":1990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.909274+0000","last_change":"2024-09-12T18:36:12.909274+0000","last_active":"2024-09-12T18:36:12.909274+0000","last_peered":"2024-09-12T18:36:12.909274+0000","last_clean":"2024-09-12T18:36:12.909274+0000","last_became_active":"2024-09-12T17:10:32.360853+0000","last_became_peered":"2024-09-12T17:10:32.360853+0000","last_unstale":"2024-09-12T18:36:12.909274+0000","last_undegraded":"2024-09-12T18:36:12.909274+0000","last_fullsized":"2024-09-12T18:36:12.909274+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'463","last_scrub_stamp":"2024-09-12T18:36:12.909073+0000","last_deep_scrub":"268'463","last_deep_scrub_stamp":"2024-09-12T18:36:12.909073+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.909073+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:48.700492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2461,"num_read_kb":2304,"num_write":540,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":551,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.993172+0000","last_change":"2024-09-12T18:36:07.993172+0000","last_active":"2024-09-12T18:36:07.993172+0000","last_peered":"2024-09-12T18:36:07.993172+0000","last_clean":"2024-09-12T18:36:07.993172+0000","last_became_active":"2024-09-12T17:10:18.072719+0000","last_became_peered":"2024-09-12T17:10:18.072719+0000","last_unstale":"2024-09-12T18:36:07.993172+0000","last_undegraded":"2024-09-12T18:36:07.993172+0000","last_fullsized":"2024-09-12T18:36:07.993172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T18:36:07.992994+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T18:36:07.992994+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.992994+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:43.943090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022239349999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'390","reported_seq":1108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.978577+0000","last_change":"2024-09-12T18:36:09.978577+0000","last_active":"2024-09-12T18:36:09.978577+0000","last_peered":"2024-09-12T18:36:09.978577+0000","last_clean":"2024-09-12T18:36:09.978577+0000","last_became_active":"2024-09-12T17:10:30.354850+0000","last_became_peered":"2024-09-12T17:10:30.354850+0000","last_unstale":"2024-09-12T18:36:09.978577+0000","last_undegraded":"2024-09-12T18:36:09.978577+0000","last_fullsized":"2024-09-12T18:36:09.978577+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'390","last_scrub_stamp":"2024-09-12T18:36:09.978364+0000","last_deep_scrub":"268'390","last_deep_scrub_stamp":"2024-09-12T18:36:09.978364+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.978364+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:24.725033+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194319,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":615,"num_read_kb":44146,"num_write":1329,"num_write_kb":42918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.628005+0000","last_change":"2024-09-12T18:36:24.628005+0000","last_active":"2024-09-12T18:36:24.628005+0000","last_peered":"2024-09-12T18:36:24.628005+0000","last_clean":"2024-09-12T18:36:24.628005+0000","last_became_active":"2024-09-12T17:10:34.358926+0000","last_became_peered":"2024-09-12T17:10:34.358926+0000","last_unstale":"2024-09-12T18:36:24.628005+0000","last_undegraded":"2024-09-12T18:36:24.628005+0000","last_fullsized":"2024-09-12T18:36:24.628005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:24.627810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:24.627810+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.627810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:40.687387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'178","reported_seq":770,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.909641+0000","last_change":"2024-09-12T18:36:31.909641+0000","last_active":"2024-09-12T18:36:31.909641+0000","last_peered":"2024-09-12T18:36:31.909641+0000","last_clean":"2024-09-12T18:36:31.909641+0000","last_became_active":"2024-09-12T17:10:36.395658+0000","last_became_peered":"2024-09-12T17:10:36.395658+0000","last_unstale":"2024-09-12T18:36:31.909641+0000","last_undegraded":"2024-09-12T18:36:31.909641+0000","last_fullsized":"2024-09-12T18:36:31.909641+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'178","last_scrub_stamp":"2024-09-12T18:36:31.909396+0000","last_deep_scrub":"268'178","last_deep_scrub_stamp":"2024-09-12T18:36:31.909396+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.909396+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:46.201653+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":215,"num_read_kb":209,"num_write":154,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.111044+0000","last_change":"2024-09-12T18:36:21.111044+0000","last_active":"2024-09-12T18:36:21.111044+0000","last_peered":"2024-09-12T18:36:21.111044+0000","last_clean":"2024-09-12T18:36:21.111044+0000","last_became_active":"2024-09-12T17:10:38.414045+0000","last_became_peered":"2024-09-12T17:10:38.414045+0000","last_unstale":"2024-09-12T18:36:21.111044+0000","last_undegraded":"2024-09-12T18:36:21.111044+0000","last_fullsized":"2024-09-12T18:36:21.111044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:21.110869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:21.110869+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.110869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:19.693627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'152","reported_seq":748,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.836069+0000","last_change":"2024-09-12T18:36:40.836069+0000","last_active":"2024-09-12T18:36:40.836069+0000","last_peered":"2024-09-12T18:36:40.836069+0000","last_clean":"2024-09-12T18:36:40.836069+0000","last_became_active":"2024-09-12T17:10:40.420995+0000","last_became_peered":"2024-09-12T17:10:40.420995+0000","last_unstale":"2024-09-12T18:36:40.836069+0000","last_undegraded":"2024-09-12T18:36:40.836069+0000","last_fullsized":"2024-09-12T18:36:40.836069+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'152","last_scrub_stamp":"2024-09-12T18:36:40.835889+0000","last_deep_scrub":"268'152","last_deep_scrub_stamp":"2024-09-12T18:36:40.835889+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.835889+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:02.982789+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":383,"num_read_kb":354,"num_write":368,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'864","reported_seq":2550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.911046+0000","last_change":"2024-09-12T18:36:13.911046+0000","last_active":"2024-09-12T18:36:13.911046+0000","last_peered":"2024-09-12T18:36:13.911046+0000","last_clean":"2024-09-12T18:36:13.911046+0000","last_became_active":"2024-09-12T17:10:32.361696+0000","last_became_peered":"2024-09-12T17:10:32.361696+0000","last_unstale":"2024-09-12T18:36:13.911046+0000","last_undegraded":"2024-09-12T18:36:13.911046+0000","last_fullsized":"2024-09-12T18:36:13.911046+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'864","last_scrub_stamp":"2024-09-12T18:36:13.910873+0000","last_deep_scrub":"268'864","last_deep_scrub_stamp":"2024-09-12T18:36:13.910873+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.910873+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:05.088162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4191,"num_read_kb":3806,"num_write":1162,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'312","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.944399+0000","last_change":"2024-09-12T18:36:09.944245+0000","last_active":"2024-09-12T18:36:09.944399+0000","last_peered":"2024-09-12T18:36:09.944399+0000","last_clean":"2024-09-12T18:36:09.944399+0000","last_became_active":"2024-09-12T17:10:30.354730+0000","last_became_peered":"2024-09-12T17:10:30.354730+0000","last_unstale":"2024-09-12T18:36:09.944399+0000","last_undegraded":"2024-09-12T18:36:09.944399+0000","last_fullsized":"2024-09-12T18:36:09.944399+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'312","last_scrub_stamp":"2024-09-12T18:36:09.944018+0000","last_deep_scrub":"268'312","last_deep_scrub_stamp":"2024-09-12T18:36:09.944018+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.944018+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:20.773386+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":12992,"num_write":926,"num_write_kb":30670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":551,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.814786+0000","last_change":"2024-09-12T18:36:06.814786+0000","last_active":"2024-09-12T18:36:06.814786+0000","last_peered":"2024-09-12T18:36:06.814786+0000","last_clean":"2024-09-12T18:36:06.814786+0000","last_became_active":"2024-09-12T17:10:18.209658+0000","last_became_peered":"2024-09-12T17:10:18.209658+0000","last_unstale":"2024-09-12T18:36:06.814786+0000","last_undegraded":"2024-09-12T18:36:06.814786+0000","last_fullsized":"2024-09-12T18:36:06.814786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:06.814685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:06.814685+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.814685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:44.195873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010531659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.607924+0000","last_change":"2024-09-12T18:36:26.607924+0000","last_active":"2024-09-12T18:36:26.607924+0000","last_peered":"2024-09-12T18:36:26.607924+0000","last_clean":"2024-09-12T18:36:26.607924+0000","last_became_active":"2024-09-12T17:10:34.361845+0000","last_became_peered":"2024-09-12T17:10:34.361845+0000","last_unstale":"2024-09-12T18:36:26.607924+0000","last_undegraded":"2024-09-12T18:36:26.607924+0000","last_fullsized":"2024-09-12T18:36:26.607924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.607740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.607740+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.607740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:28.628006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'685","reported_seq":1405,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.663314+0000","last_change":"2024-09-12T18:36:28.663314+0000","last_active":"2024-09-12T18:36:28.663314+0000","last_peered":"2024-09-12T18:36:28.663314+0000","last_clean":"2024-09-12T18:36:28.663314+0000","last_became_active":"2024-09-12T17:10:36.398917+0000","last_became_peered":"2024-09-12T17:10:36.398917+0000","last_unstale":"2024-09-12T18:36:28.663314+0000","last_undegraded":"2024-09-12T18:36:28.663314+0000","last_fullsized":"2024-09-12T18:36:28.663314+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'685","last_scrub_stamp":"2024-09-12T18:36:28.663087+0000","last_deep_scrub":"268'685","last_deep_scrub_stamp":"2024-09-12T18:36:28.663087+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.663087+0000","objects_scrubbed":9,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:26.716240+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100883,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1833,"num_read_kb":3243,"num_write":2400,"num_write_kb":2201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":509380,"num_omap_keys":1154,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.708005+0000","last_change":"2024-09-12T18:36:34.708005+0000","last_active":"2024-09-12T18:36:34.708005+0000","last_peered":"2024-09-12T18:36:34.708005+0000","last_clean":"2024-09-12T18:36:34.708005+0000","last_became_active":"2024-09-12T17:10:38.400868+0000","last_became_peered":"2024-09-12T17:10:38.400868+0000","last_unstale":"2024-09-12T18:36:34.708005+0000","last_undegraded":"2024-09-12T18:36:34.708005+0000","last_fullsized":"2024-09-12T18:36:34.708005+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:34.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:34.707795+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.707795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:35.737755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'140","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.780796+0000","last_change":"2024-09-12T18:36:40.780796+0000","last_active":"2024-09-12T18:36:40.780796+0000","last_peered":"2024-09-12T18:36:40.780796+0000","last_clean":"2024-09-12T18:36:40.780796+0000","last_became_active":"2024-09-12T17:10:40.771185+0000","last_became_peered":"2024-09-12T17:10:40.771185+0000","last_unstale":"2024-09-12T18:36:40.780796+0000","last_undegraded":"2024-09-12T18:36:40.780796+0000","last_fullsized":"2024-09-12T18:36:40.780796+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'140","last_scrub_stamp":"2024-09-12T18:36:40.780568+0000","last_deep_scrub":"268'140","last_deep_scrub_stamp":"2024-09-12T18:36:40.780568+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.780568+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:20.238458+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":180,"num_write":328,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'473","reported_seq":2171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.533222+0000","last_change":"2024-09-12T18:36:18.533222+0000","last_active":"2024-09-12T18:36:18.533222+0000","last_peered":"2024-09-12T18:36:18.533222+0000","last_clean":"2024-09-12T18:36:18.533222+0000","last_became_active":"2024-09-12T17:10:32.354795+0000","last_became_peered":"2024-09-12T17:10:32.354795+0000","last_unstale":"2024-09-12T18:36:18.533222+0000","last_undegraded":"2024-09-12T18:36:18.533222+0000","last_fullsized":"2024-09-12T18:36:18.533222+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'473","last_scrub_stamp":"2024-09-12T18:36:18.532993+0000","last_deep_scrub":"268'473","last_deep_scrub_stamp":"2024-09-12T18:36:18.532993+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.532993+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:56.579630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2620,"num_read_kb":2476,"num_write":562,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'325","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.884981+0000","last_change":"2024-09-12T18:36:09.884981+0000","last_active":"2024-09-12T18:36:09.884981+0000","last_peered":"2024-09-12T18:36:09.884981+0000","last_clean":"2024-09-12T18:36:09.884981+0000","last_became_active":"2024-09-12T17:10:30.405460+0000","last_became_peered":"2024-09-12T17:10:30.405460+0000","last_unstale":"2024-09-12T18:36:09.884981+0000","last_undegraded":"2024-09-12T18:36:09.884981+0000","last_fullsized":"2024-09-12T18:36:09.884981+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'325","last_scrub_stamp":"2024-09-12T18:36:09.884732+0000","last_deep_scrub":"268'325","last_deep_scrub_stamp":"2024-09-12T18:36:09.884732+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.884732+0000","objects_scrubbed":9,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:49.903883+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243060,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":16852,"num_write":1075,"num_write_kb":30938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.983491+0000","last_change":"2024-09-12T18:36:09.983362+0000","last_active":"2024-09-12T18:36:09.983491+0000","last_peered":"2024-09-12T18:36:09.983491+0000","last_clean":"2024-09-12T18:36:09.983491+0000","last_became_active":"2024-09-12T17:10:18.208762+0000","last_became_peered":"2024-09-12T17:10:18.208762+0000","last_unstale":"2024-09-12T18:36:09.983491+0000","last_undegraded":"2024-09-12T18:36:09.983491+0000","last_fullsized":"2024-09-12T18:36:09.983491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:09.983179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:09.983179+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.983179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:05.608460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001091554,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.061203+0000","last_change":"2024-09-12T18:36:19.061203+0000","last_active":"2024-09-12T18:36:19.061203+0000","last_peered":"2024-09-12T18:36:19.061203+0000","last_clean":"2024-09-12T18:36:19.061203+0000","last_became_active":"2024-09-12T17:10:34.355590+0000","last_became_peered":"2024-09-12T17:10:34.355590+0000","last_unstale":"2024-09-12T18:36:19.061203+0000","last_undegraded":"2024-09-12T18:36:19.061203+0000","last_fullsized":"2024-09-12T18:36:19.061203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:19.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:19.060998+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:14.047471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'231","reported_seq":848,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.963144+0000","last_change":"2024-09-12T18:36:23.963144+0000","last_active":"2024-09-12T18:36:23.963144+0000","last_peered":"2024-09-12T18:36:23.963144+0000","last_clean":"2024-09-12T18:36:23.963144+0000","last_became_active":"2024-09-12T17:10:36.921234+0000","last_became_peered":"2024-09-12T17:10:36.921234+0000","last_unstale":"2024-09-12T18:36:23.963144+0000","last_undegraded":"2024-09-12T18:36:23.963144+0000","last_fullsized":"2024-09-12T18:36:23.963144+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'231","last_scrub_stamp":"2024-09-12T18:36:23.962933+0000","last_deep_scrub":"268'231","last_deep_scrub_stamp":"2024-09-12T18:36:23.962933+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.962933+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:00.002043+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":277,"num_write":196,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'793","reported_seq":2956,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.906202+0000","last_change":"2024-09-12T18:36:36.906202+0000","last_active":"2024-09-12T18:36:36.906202+0000","last_peered":"2024-09-12T18:36:36.906202+0000","last_clean":"2024-09-12T18:36:36.906202+0000","last_became_active":"2024-09-12T17:10:38.395439+0000","last_became_peered":"2024-09-12T17:10:38.395439+0000","last_unstale":"2024-09-12T18:36:36.906202+0000","last_undegraded":"2024-09-12T18:36:36.906202+0000","last_fullsized":"2024-09-12T18:36:36.906202+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'793","last_scrub_stamp":"2024-09-12T18:36:36.906025+0000","last_deep_scrub":"268'793","last_deep_scrub_stamp":"2024-09-12T18:36:36.906025+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.906025+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:45.280968+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'180","reported_seq":719,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:21.756761+0000","last_change":"2024-09-12T17:10:40.770840+0000","last_active":"2024-09-12T18:35:21.756761+0000","last_peered":"2024-09-12T18:35:21.756761+0000","last_clean":"2024-09-12T18:35:21.756761+0000","last_became_active":"2024-09-12T17:10:40.770042+0000","last_became_peered":"2024-09-12T17:10:40.770042+0000","last_unstale":"2024-09-12T18:35:21.756761+0000","last_undegraded":"2024-09-12T18:35:21.756761+0000","last_fullsized":"2024-09-12T18:35:21.756761+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":293,"num_read_kb":273,"num_write":449,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'902","reported_seq":2644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.834013+0000","last_change":"2024-09-12T18:36:16.834013+0000","last_active":"2024-09-12T18:36:16.834013+0000","last_peered":"2024-09-12T18:36:16.834013+0000","last_clean":"2024-09-12T18:36:16.834013+0000","last_became_active":"2024-09-12T17:10:32.382755+0000","last_became_peered":"2024-09-12T17:10:32.382755+0000","last_unstale":"2024-09-12T18:36:16.834013+0000","last_undegraded":"2024-09-12T18:36:16.834013+0000","last_fullsized":"2024-09-12T18:36:16.834013+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'902","last_scrub_stamp":"2024-09-12T18:36:16.833790+0000","last_deep_scrub":"268'902","last_deep_scrub_stamp":"2024-09-12T18:36:16.833790+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.833790+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:47.335837+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4651,"num_read_kb":4208,"num_write":1244,"num_write_kb":526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4562,"num_omap_keys":18,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'316","reported_seq":955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.947740+0000","last_change":"2024-09-12T18:36:08.947740+0000","last_active":"2024-09-12T18:36:08.947740+0000","last_peered":"2024-09-12T18:36:08.947740+0000","last_clean":"2024-09-12T18:36:08.947740+0000","last_became_active":"2024-09-12T17:10:30.364767+0000","last_became_peered":"2024-09-12T17:10:30.364767+0000","last_unstale":"2024-09-12T18:36:08.947740+0000","last_undegraded":"2024-09-12T18:36:08.947740+0000","last_fullsized":"2024-09-12T18:36:08.947740+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'316","last_scrub_stamp":"2024-09-12T18:36:08.947480+0000","last_deep_scrub":"268'316","last_deep_scrub_stamp":"2024-09-12T18:36:08.947480+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.947480+0000","objects_scrubbed":9,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:50.062268+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":450,"num_read_kb":23959,"num_write":1040,"num_write_kb":32355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":549,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.822491+0000","last_change":"2024-09-12T18:36:07.822491+0000","last_active":"2024-09-12T18:36:07.822491+0000","last_peered":"2024-09-12T18:36:07.822491+0000","last_clean":"2024-09-12T18:36:07.822491+0000","last_became_active":"2024-09-12T17:10:18.073132+0000","last_became_peered":"2024-09-12T17:10:18.073132+0000","last_unstale":"2024-09-12T18:36:07.822491+0000","last_undegraded":"2024-09-12T18:36:07.822491+0000","last_fullsized":"2024-09-12T18:36:07.822491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:07.822365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:07.822365+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.822365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:38.482041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001154721,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.926922+0000","last_change":"2024-09-12T18:36:24.926922+0000","last_active":"2024-09-12T18:36:24.926922+0000","last_peered":"2024-09-12T18:36:24.926922+0000","last_clean":"2024-09-12T18:36:24.926922+0000","last_became_active":"2024-09-12T17:10:34.349093+0000","last_became_peered":"2024-09-12T17:10:34.349093+0000","last_unstale":"2024-09-12T18:36:24.926922+0000","last_undegraded":"2024-09-12T18:36:24.926922+0000","last_fullsized":"2024-09-12T18:36:24.926922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:24.926737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:24.926737+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.926737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:07.858866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'174","reported_seq":762,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.847044+0000","last_change":"2024-09-12T18:36:30.847044+0000","last_active":"2024-09-12T18:36:30.847044+0000","last_peered":"2024-09-12T18:36:30.847044+0000","last_clean":"2024-09-12T18:36:30.847044+0000","last_became_active":"2024-09-12T17:10:36.390439+0000","last_became_peered":"2024-09-12T17:10:36.390439+0000","last_unstale":"2024-09-12T18:36:30.847044+0000","last_undegraded":"2024-09-12T18:36:30.847044+0000","last_fullsized":"2024-09-12T18:36:30.847044+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'174","last_scrub_stamp":"2024-09-12T18:36:30.846848+0000","last_deep_scrub":"268'174","last_deep_scrub_stamp":"2024-09-12T18:36:30.846848+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.846848+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:23.164661+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":183,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'809","reported_seq":2869,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.919613+0000","last_change":"2024-09-12T18:36:37.919613+0000","last_active":"2024-09-12T18:36:37.919613+0000","last_peered":"2024-09-12T18:36:37.919613+0000","last_clean":"2024-09-12T18:36:37.919613+0000","last_became_active":"2024-09-12T17:10:38.393426+0000","last_became_peered":"2024-09-12T17:10:38.393426+0000","last_unstale":"2024-09-12T18:36:37.919613+0000","last_undegraded":"2024-09-12T18:36:37.919613+0000","last_fullsized":"2024-09-12T18:36:37.919613+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'809","last_scrub_stamp":"2024-09-12T18:36:37.919417+0000","last_deep_scrub":"268'809","last_deep_scrub_stamp":"2024-09-12T18:36:37.919417+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.919417+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:41.111792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'259","reported_seq":811,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.760094+0000","last_change":"2024-09-12T18:36:41.760094+0000","last_active":"2024-09-12T18:36:41.760094+0000","last_peered":"2024-09-12T18:36:41.760094+0000","last_clean":"2024-09-12T18:36:41.760094+0000","last_became_active":"2024-09-12T17:10:40.423742+0000","last_became_peered":"2024-09-12T17:10:40.423742+0000","last_unstale":"2024-09-12T18:36:41.760094+0000","last_undegraded":"2024-09-12T18:36:41.760094+0000","last_fullsized":"2024-09-12T18:36:41.760094+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'259","last_scrub_stamp":"2024-09-12T18:36:41.759888+0000","last_deep_scrub":"268'259","last_deep_scrub_stamp":"2024-09-12T18:36:41.759888+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.759888+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:57.353061+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":353,"num_read_kb":347,"num_write":533,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'875","reported_seq":2677,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.961775+0000","last_change":"2024-09-12T18:36:10.961775+0000","last_active":"2024-09-12T18:36:10.961775+0000","last_peered":"2024-09-12T18:36:10.961775+0000","last_clean":"2024-09-12T18:36:10.961775+0000","last_became_active":"2024-09-12T17:10:32.368217+0000","last_became_peered":"2024-09-12T17:10:32.368217+0000","last_unstale":"2024-09-12T18:36:10.961775+0000","last_undegraded":"2024-09-12T18:36:10.961775+0000","last_fullsized":"2024-09-12T18:36:10.961775+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'875","last_scrub_stamp":"2024-09-12T18:36:10.961561+0000","last_deep_scrub":"268'875","last_deep_scrub_stamp":"2024-09-12T18:36:10.961561+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.961561+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:02.933031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4306,"num_read_kb":3903,"num_write":1124,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1533,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'367","reported_seq":1080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.599903+0000","last_change":"2024-09-12T18:36:06.599903+0000","last_active":"2024-09-12T18:36:06.599903+0000","last_peered":"2024-09-12T18:36:06.599903+0000","last_clean":"2024-09-12T18:36:06.599903+0000","last_became_active":"2024-09-12T17:10:30.361736+0000","last_became_peered":"2024-09-12T17:10:30.361736+0000","last_unstale":"2024-09-12T18:36:06.599903+0000","last_undegraded":"2024-09-12T18:36:06.599903+0000","last_fullsized":"2024-09-12T18:36:06.599903+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'367","last_scrub_stamp":"2024-09-12T18:36:06.599810+0000","last_deep_scrub":"268'367","last_deep_scrub_stamp":"2024-09-12T18:36:06.599810+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.599810+0000","objects_scrubbed":7,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:40.095034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5736431,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":617,"num_read_kb":21637,"num_write":1193,"num_write_kb":30222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":548,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.128765+0000","last_change":"2024-09-12T18:36:08.128765+0000","last_active":"2024-09-12T18:36:08.128765+0000","last_peered":"2024-09-12T18:36:08.128765+0000","last_clean":"2024-09-12T18:36:08.128765+0000","last_became_active":"2024-09-12T17:10:18.074669+0000","last_became_peered":"2024-09-12T17:10:18.074669+0000","last_unstale":"2024-09-12T18:36:08.128765+0000","last_undegraded":"2024-09-12T18:36:08.128765+0000","last_fullsized":"2024-09-12T18:36:08.128765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:08.128568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:08.128568+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.128568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:13.278072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.813505+0000","last_change":"2024-09-12T18:36:28.813505+0000","last_active":"2024-09-12T18:36:28.813505+0000","last_peered":"2024-09-12T18:36:28.813505+0000","last_clean":"2024-09-12T18:36:28.813505+0000","last_became_active":"2024-09-12T17:10:34.358250+0000","last_became_peered":"2024-09-12T17:10:34.358250+0000","last_unstale":"2024-09-12T18:36:28.813505+0000","last_undegraded":"2024-09-12T18:36:28.813505+0000","last_fullsized":"2024-09-12T18:36:28.813505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:28.813308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:28.813308+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.813308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:48.280221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'750","reported_seq":1518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.024128+0000","last_change":"2024-09-12T18:36:30.024128+0000","last_active":"2024-09-12T18:36:30.024128+0000","last_peered":"2024-09-12T18:36:30.024128+0000","last_clean":"2024-09-12T18:36:30.024128+0000","last_became_active":"2024-09-12T17:10:36.920239+0000","last_became_peered":"2024-09-12T17:10:36.920239+0000","last_unstale":"2024-09-12T18:36:30.024128+0000","last_undegraded":"2024-09-12T18:36:30.024128+0000","last_fullsized":"2024-09-12T18:36:30.024128+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'750","last_scrub_stamp":"2024-09-12T18:36:30.023945+0000","last_deep_scrub":"268'750","last_deep_scrub_stamp":"2024-09-12T18:36:30.023945+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.023945+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:49.559022+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144312,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1298,"num_read_kb":3045,"num_write":1034,"num_write_kb":815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.926272+0000","last_change":"2024-09-12T18:36:39.926272+0000","last_active":"2024-09-12T18:36:39.926272+0000","last_peered":"2024-09-12T18:36:39.926272+0000","last_clean":"2024-09-12T18:36:39.926272+0000","last_became_active":"2024-09-12T17:10:38.391661+0000","last_became_peered":"2024-09-12T17:10:38.391661+0000","last_unstale":"2024-09-12T18:36:39.926272+0000","last_undegraded":"2024-09-12T18:36:39.926272+0000","last_fullsized":"2024-09-12T18:36:39.926272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:39.926092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:39.926092+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.926092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:59.398217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'102","reported_seq":620,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.815816+0000","last_change":"2024-09-12T18:36:41.815816+0000","last_active":"2024-09-12T18:36:41.815816+0000","last_peered":"2024-09-12T18:36:41.815816+0000","last_clean":"2024-09-12T18:36:41.815816+0000","last_became_active":"2024-09-12T17:10:40.435114+0000","last_became_peered":"2024-09-12T17:10:40.435114+0000","last_unstale":"2024-09-12T18:36:41.815816+0000","last_undegraded":"2024-09-12T18:36:41.815816+0000","last_fullsized":"2024-09-12T18:36:41.815816+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'102","last_scrub_stamp":"2024-09-12T18:36:41.815605+0000","last_deep_scrub":"268'102","last_deep_scrub_stamp":"2024-09-12T18:36:41.815605+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.815605+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:09.427117+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":238,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'130","reported_seq":735,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.745640+0000","last_change":"2024-09-12T18:36:43.745640+0000","last_active":"2024-09-12T18:36:43.745640+0000","last_peered":"2024-09-12T18:36:43.745640+0000","last_clean":"2024-09-12T18:36:43.745640+0000","last_became_active":"2024-09-12T17:10:40.417972+0000","last_became_peered":"2024-09-12T17:10:40.417972+0000","last_unstale":"2024-09-12T18:36:43.745640+0000","last_undegraded":"2024-09-12T18:36:43.745640+0000","last_fullsized":"2024-09-12T18:36:43.745640+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'130","last_scrub_stamp":"2024-09-12T18:36:43.745449+0000","last_deep_scrub":"268'130","last_deep_scrub_stamp":"2024-09-12T18:36:43.745449+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.745449+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:46.799454+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":319,"num_read_kb":297,"num_write":314,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'794","reported_seq":2323,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.019127+0000","last_change":"2024-09-12T18:36:15.019127+0000","last_active":"2024-09-12T18:36:15.019127+0000","last_peered":"2024-09-12T18:36:15.019127+0000","last_clean":"2024-09-12T18:36:15.019127+0000","last_became_active":"2024-09-12T17:10:32.368063+0000","last_became_peered":"2024-09-12T17:10:32.368063+0000","last_unstale":"2024-09-12T18:36:15.019127+0000","last_undegraded":"2024-09-12T18:36:15.019127+0000","last_fullsized":"2024-09-12T18:36:15.019127+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'794","last_scrub_stamp":"2024-09-12T18:36:15.018950+0000","last_deep_scrub":"268'794","last_deep_scrub_stamp":"2024-09-12T18:36:15.018950+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.018950+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:15.614937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3740,"num_read_kb":3358,"num_write":1050,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'385","reported_seq":1051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.014293+0000","last_change":"2024-09-12T18:36:09.014293+0000","last_active":"2024-09-12T18:36:09.014293+0000","last_peered":"2024-09-12T18:36:09.014293+0000","last_clean":"2024-09-12T18:36:09.014293+0000","last_became_active":"2024-09-12T17:10:30.394117+0000","last_became_peered":"2024-09-12T17:10:30.394117+0000","last_unstale":"2024-09-12T18:36:09.014293+0000","last_undegraded":"2024-09-12T18:36:09.014293+0000","last_fullsized":"2024-09-12T18:36:09.014293+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-12T18:36:09.014036+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-12T18:36:09.014036+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.014036+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:20.531488+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330018,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":538,"num_read_kb":2122,"num_write":1160,"num_write_kb":20675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.975839+0000","last_change":"2024-09-12T18:36:22.975839+0000","last_active":"2024-09-12T18:36:22.975839+0000","last_peered":"2024-09-12T18:36:22.975839+0000","last_clean":"2024-09-12T18:36:22.975839+0000","last_became_active":"2024-09-12T17:10:34.359923+0000","last_became_peered":"2024-09-12T17:10:34.359923+0000","last_unstale":"2024-09-12T18:36:22.975839+0000","last_undegraded":"2024-09-12T18:36:22.975839+0000","last_fullsized":"2024-09-12T18:36:22.975839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:22.975695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:22.975695+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.975695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:10.101003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'308","reported_seq":925,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.932101+0000","last_change":"2024-09-12T18:36:32.932101+0000","last_active":"2024-09-12T18:36:32.932101+0000","last_peered":"2024-09-12T18:36:32.932101+0000","last_clean":"2024-09-12T18:36:32.932101+0000","last_became_active":"2024-09-12T17:10:36.394731+0000","last_became_peered":"2024-09-12T17:10:36.394731+0000","last_unstale":"2024-09-12T18:36:32.932101+0000","last_undegraded":"2024-09-12T18:36:32.932101+0000","last_fullsized":"2024-09-12T18:36:32.932101+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'308","last_scrub_stamp":"2024-09-12T18:36:32.931887+0000","last_deep_scrub":"268'308","last_deep_scrub_stamp":"2024-09-12T18:36:32.931887+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.931887+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:30.103482+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56497,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":1193,"num_write":404,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.933547+0000","last_change":"2024-09-12T18:36:38.933547+0000","last_active":"2024-09-12T18:36:38.933547+0000","last_peered":"2024-09-12T18:36:38.933547+0000","last_clean":"2024-09-12T18:36:38.933547+0000","last_became_active":"2024-09-12T17:10:38.393112+0000","last_became_peered":"2024-09-12T17:10:38.393112+0000","last_unstale":"2024-09-12T18:36:38.933547+0000","last_undegraded":"2024-09-12T18:36:38.933547+0000","last_fullsized":"2024-09-12T18:36:38.933547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:38.933365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:38.933365+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.933365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:17.416261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'117","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:04.411553+0000","last_change":"2024-09-12T17:10:40.430432+0000","last_active":"2024-09-12T18:33:04.411553+0000","last_peered":"2024-09-12T18:33:04.411553+0000","last_clean":"2024-09-12T18:33:04.411553+0000","last_became_active":"2024-09-12T17:10:40.429366+0000","last_became_peered":"2024-09-12T17:10:40.429366+0000","last_unstale":"2024-09-12T18:33:04.411553+0000","last_undegraded":"2024-09-12T18:33:04.411553+0000","last_fullsized":"2024-09-12T18:33:04.411553+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:03.623489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":137,"num_write":282,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'500","reported_seq":2108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.917070+0000","last_change":"2024-09-12T18:36:15.917070+0000","last_active":"2024-09-12T18:36:15.917070+0000","last_peered":"2024-09-12T18:36:15.917070+0000","last_clean":"2024-09-12T18:36:15.917070+0000","last_became_active":"2024-09-12T17:10:32.364033+0000","last_became_peered":"2024-09-12T17:10:32.364033+0000","last_unstale":"2024-09-12T18:36:15.917070+0000","last_undegraded":"2024-09-12T18:36:15.917070+0000","last_fullsized":"2024-09-12T18:36:15.917070+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'500","last_scrub_stamp":"2024-09-12T18:36:15.916790+0000","last_deep_scrub":"268'500","last_deep_scrub_stamp":"2024-09-12T18:36:15.916790+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.916790+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:19.758173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2497,"num_read_kb":2341,"num_write":588,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'287","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.956199+0000","last_change":"2024-09-12T18:36:15.956199+0000","last_active":"2024-09-12T18:36:15.956199+0000","last_peered":"2024-09-12T18:36:15.956199+0000","last_clean":"2024-09-12T18:36:15.956199+0000","last_became_active":"2024-09-12T17:10:30.405137+0000","last_became_peered":"2024-09-12T17:10:30.405137+0000","last_unstale":"2024-09-12T18:36:15.956199+0000","last_undegraded":"2024-09-12T18:36:15.956199+0000","last_fullsized":"2024-09-12T18:36:15.956199+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'287","last_scrub_stamp":"2024-09-12T18:36:15.955868+0000","last_deep_scrub":"268'287","last_deep_scrub_stamp":"2024-09-12T18:36:15.955868+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.955868+0000","objects_scrubbed":9,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:38.210429+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728666,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":586,"num_read_kb":36707,"num_write":949,"num_write_kb":52863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.757025+0000","last_change":"2024-09-12T18:36:26.757025+0000","last_active":"2024-09-12T18:36:26.757025+0000","last_peered":"2024-09-12T18:36:26.757025+0000","last_clean":"2024-09-12T18:36:26.757025+0000","last_became_active":"2024-09-12T17:10:34.355684+0000","last_became_peered":"2024-09-12T17:10:34.355684+0000","last_unstale":"2024-09-12T18:36:26.757025+0000","last_undegraded":"2024-09-12T18:36:26.757025+0000","last_fullsized":"2024-09-12T18:36:26.757025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.756852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.756852+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.756852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:01.952314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'61","reported_seq":599,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.684320+0000","last_change":"2024-09-12T18:36:30.684320+0000","last_active":"2024-09-12T18:36:30.684320+0000","last_peered":"2024-09-12T18:36:30.684320+0000","last_clean":"2024-09-12T18:36:30.684320+0000","last_became_active":"2024-09-12T17:10:36.400358+0000","last_became_peered":"2024-09-12T17:10:36.400358+0000","last_unstale":"2024-09-12T18:36:30.684320+0000","last_undegraded":"2024-09-12T18:36:30.684320+0000","last_fullsized":"2024-09-12T18:36:30.684320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'61","last_scrub_stamp":"2024-09-12T18:36:30.684044+0000","last_deep_scrub":"268'61","last_deep_scrub_stamp":"2024-09-12T18:36:30.684044+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.684044+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:14:14.583204+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":54,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.995988+0000","last_change":"2024-09-12T18:36:36.995988+0000","last_active":"2024-09-12T18:36:36.995988+0000","last_peered":"2024-09-12T18:36:36.995988+0000","last_clean":"2024-09-12T18:36:36.995988+0000","last_became_active":"2024-09-12T17:10:38.404309+0000","last_became_peered":"2024-09-12T17:10:38.404309+0000","last_unstale":"2024-09-12T18:36:36.995988+0000","last_undegraded":"2024-09-12T18:36:36.995988+0000","last_fullsized":"2024-09-12T18:36:36.995988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:36.995770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:36.995770+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.995770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:40.259880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'195","reported_seq":746,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.716148+0000","last_change":"2024-09-12T18:36:44.716148+0000","last_active":"2024-09-12T18:36:44.716148+0000","last_peered":"2024-09-12T18:36:44.716148+0000","last_clean":"2024-09-12T18:36:44.716148+0000","last_became_active":"2024-09-12T17:10:40.418473+0000","last_became_peered":"2024-09-12T17:10:40.418473+0000","last_unstale":"2024-09-12T18:36:44.716148+0000","last_undegraded":"2024-09-12T18:36:44.716148+0000","last_fullsized":"2024-09-12T18:36:44.716148+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'195","last_scrub_stamp":"2024-09-12T18:36:44.715966+0000","last_deep_scrub":"268'195","last_deep_scrub_stamp":"2024-09-12T18:36:44.715966+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.715966+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:32.160773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":350,"num_read_kb":341,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'359","reported_seq":1690,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.844725+0000","last_change":"2024-09-12T18:36:18.844725+0000","last_active":"2024-09-12T18:36:18.844725+0000","last_peered":"2024-09-12T18:36:18.844725+0000","last_clean":"2024-09-12T18:36:18.844725+0000","last_became_active":"2024-09-12T17:10:32.382581+0000","last_became_peered":"2024-09-12T17:10:32.382581+0000","last_unstale":"2024-09-12T18:36:18.844725+0000","last_undegraded":"2024-09-12T18:36:18.844725+0000","last_fullsized":"2024-09-12T18:36:18.844725+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T18:36:18.844512+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T18:36:18.844512+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.844512+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:14.341522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1854,"num_read_kb":1737,"num_write":414,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'369","reported_seq":1050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.893176+0000","last_change":"2024-09-12T18:36:11.893176+0000","last_active":"2024-09-12T18:36:11.893176+0000","last_peered":"2024-09-12T18:36:11.893176+0000","last_clean":"2024-09-12T18:36:11.893176+0000","last_became_active":"2024-09-12T17:10:30.374846+0000","last_became_peered":"2024-09-12T17:10:30.374846+0000","last_unstale":"2024-09-12T18:36:11.893176+0000","last_undegraded":"2024-09-12T18:36:11.893176+0000","last_fullsized":"2024-09-12T18:36:11.893176+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'369","last_scrub_stamp":"2024-09-12T18:36:11.892901+0000","last_deep_scrub":"268'369","last_deep_scrub_stamp":"2024-09-12T18:36:11.892901+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.892901+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:09.620432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572943,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":611,"num_read_kb":15632,"num_write":1214,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.019636+0000","last_change":"2024-09-12T18:36:28.019636+0000","last_active":"2024-09-12T18:36:28.019636+0000","last_peered":"2024-09-12T18:36:28.019636+0000","last_clean":"2024-09-12T18:36:28.019636+0000","last_became_active":"2024-09-12T17:10:34.362168+0000","last_became_peered":"2024-09-12T17:10:34.362168+0000","last_unstale":"2024-09-12T18:36:28.019636+0000","last_undegraded":"2024-09-12T18:36:28.019636+0000","last_fullsized":"2024-09-12T18:36:28.019636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:28.019461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:28.019461+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.019461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:31.096402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'385","reported_seq":1018,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.989672+0000","last_change":"2024-09-12T18:36:34.989672+0000","last_active":"2024-09-12T18:36:34.989672+0000","last_peered":"2024-09-12T18:36:34.989672+0000","last_clean":"2024-09-12T18:36:34.989672+0000","last_became_active":"2024-09-12T17:10:36.394639+0000","last_became_peered":"2024-09-12T17:10:36.394639+0000","last_unstale":"2024-09-12T18:36:34.989672+0000","last_undegraded":"2024-09-12T18:36:34.989672+0000","last_fullsized":"2024-09-12T18:36:34.989672+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-12T18:36:34.989490+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-12T18:36:34.989490+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.989490+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:30.943215+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67938,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":612,"num_read_kb":1404,"num_write":492,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.138026+0000","last_change":"2024-09-12T18:36:23.138026+0000","last_active":"2024-09-12T18:36:23.138026+0000","last_peered":"2024-09-12T18:36:23.138026+0000","last_clean":"2024-09-12T18:36:23.138026+0000","last_became_active":"2024-09-12T17:10:38.413131+0000","last_became_peered":"2024-09-12T17:10:38.413131+0000","last_unstale":"2024-09-12T18:36:23.138026+0000","last_undegraded":"2024-09-12T18:36:23.138026+0000","last_fullsized":"2024-09-12T18:36:23.138026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:23.137806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:23.137806+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.137806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:14.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'133","reported_seq":661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.796714+0000","last_change":"2024-09-12T18:36:43.796714+0000","last_active":"2024-09-12T18:36:43.796714+0000","last_peered":"2024-09-12T18:36:43.796714+0000","last_clean":"2024-09-12T18:36:43.796714+0000","last_became_active":"2024-09-12T17:10:40.429224+0000","last_became_peered":"2024-09-12T17:10:40.429224+0000","last_unstale":"2024-09-12T18:36:43.796714+0000","last_undegraded":"2024-09-12T18:36:43.796714+0000","last_fullsized":"2024-09-12T18:36:43.796714+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'133","last_scrub_stamp":"2024-09-12T18:36:43.796489+0000","last_deep_scrub":"268'133","last_deep_scrub_stamp":"2024-09-12T18:36:43.796489+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.796489+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:03.966623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'951","reported_seq":2635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.818036+0000","last_change":"2024-09-12T18:36:17.818036+0000","last_active":"2024-09-12T18:36:17.818036+0000","last_peered":"2024-09-12T18:36:17.818036+0000","last_clean":"2024-09-12T18:36:17.818036+0000","last_became_active":"2024-09-12T17:10:32.369282+0000","last_became_peered":"2024-09-12T17:10:32.369282+0000","last_unstale":"2024-09-12T18:36:17.818036+0000","last_undegraded":"2024-09-12T18:36:17.818036+0000","last_fullsized":"2024-09-12T18:36:17.818036+0000","mapping_epoch":27,"log_start":"268'900","ondisk_log_start":"268'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'951","last_scrub_stamp":"2024-09-12T18:36:17.817821+0000","last_deep_scrub":"268'951","last_deep_scrub_stamp":"2024-09-12T18:36:17.817821+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.817821+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:50.499239+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4532,"num_read_kb":4046,"num_write":1302,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'374","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.619579+0000","last_change":"2024-09-12T18:36:07.619579+0000","last_active":"2024-09-12T18:36:07.619579+0000","last_peered":"2024-09-12T18:36:07.619579+0000","last_clean":"2024-09-12T18:36:07.619579+0000","last_became_active":"2024-09-12T17:10:30.356383+0000","last_became_peered":"2024-09-12T17:10:30.356383+0000","last_unstale":"2024-09-12T18:36:07.619579+0000","last_undegraded":"2024-09-12T18:36:07.619579+0000","last_fullsized":"2024-09-12T18:36:07.619579+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'374","last_scrub_stamp":"2024-09-12T18:36:07.619444+0000","last_deep_scrub":"268'374","last_deep_scrub_stamp":"2024-09-12T18:36:07.619444+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.619444+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:13.321492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":17278,"num_write":1157,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.136810+0000","last_change":"2024-09-12T18:36:22.136810+0000","last_active":"2024-09-12T18:36:22.136810+0000","last_peered":"2024-09-12T18:36:22.136810+0000","last_clean":"2024-09-12T18:36:22.136810+0000","last_became_active":"2024-09-12T17:10:34.363279+0000","last_became_peered":"2024-09-12T17:10:34.363279+0000","last_unstale":"2024-09-12T18:36:22.136810+0000","last_undegraded":"2024-09-12T18:36:22.136810+0000","last_fullsized":"2024-09-12T18:36:22.136810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:22.136599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:22.136599+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.136599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:38.570087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'324","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.917877+0000","last_change":"2024-09-12T18:36:32.917877+0000","last_active":"2024-09-12T18:36:32.917877+0000","last_peered":"2024-09-12T18:36:32.917877+0000","last_clean":"2024-09-12T18:36:32.917877+0000","last_became_active":"2024-09-12T17:10:36.396758+0000","last_became_peered":"2024-09-12T17:10:36.396758+0000","last_unstale":"2024-09-12T18:36:32.917877+0000","last_undegraded":"2024-09-12T18:36:32.917877+0000","last_fullsized":"2024-09-12T18:36:32.917877+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'324","last_scrub_stamp":"2024-09-12T18:36:32.917681+0000","last_deep_scrub":"268'324","last_deep_scrub_stamp":"2024-09-12T18:36:32.917681+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.917681+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:42.212707+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59757,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1297,"num_write":442,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.814492+0000","last_change":"2024-09-12T18:36:36.814492+0000","last_active":"2024-09-12T18:36:36.814492+0000","last_peered":"2024-09-12T18:36:36.814492+0000","last_clean":"2024-09-12T18:36:36.814492+0000","last_became_active":"2024-09-12T17:10:38.413004+0000","last_became_peered":"2024-09-12T17:10:38.413004+0000","last_unstale":"2024-09-12T18:36:36.814492+0000","last_undegraded":"2024-09-12T18:36:36.814492+0000","last_fullsized":"2024-09-12T18:36:36.814492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:36.814278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:36.814278+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.814278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:20.375476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'441","reported_seq":1953,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.092673+0000","last_change":"2024-09-12T18:36:17.092673+0000","last_active":"2024-09-12T18:36:17.092673+0000","last_peered":"2024-09-12T18:36:17.092673+0000","last_clean":"2024-09-12T18:36:17.092673+0000","last_became_active":"2024-09-12T17:10:32.350751+0000","last_became_peered":"2024-09-12T17:10:32.350751+0000","last_unstale":"2024-09-12T18:36:17.092673+0000","last_undegraded":"2024-09-12T18:36:17.092673+0000","last_fullsized":"2024-09-12T18:36:17.092673+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'441","last_scrub_stamp":"2024-09-12T18:36:17.092489+0000","last_deep_scrub":"268'441","last_deep_scrub_stamp":"2024-09-12T18:36:17.092489+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.092489+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:22.621992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2256,"num_read_kb":2119,"num_write":496,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'284","reported_seq":939,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.937121+0000","last_change":"2024-09-12T18:36:10.937121+0000","last_active":"2024-09-12T18:36:10.937121+0000","last_peered":"2024-09-12T18:36:10.937121+0000","last_clean":"2024-09-12T18:36:10.937121+0000","last_became_active":"2024-09-12T17:10:30.353308+0000","last_became_peered":"2024-09-12T17:10:30.353308+0000","last_unstale":"2024-09-12T18:36:10.937121+0000","last_undegraded":"2024-09-12T18:36:10.937121+0000","last_fullsized":"2024-09-12T18:36:10.937121+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'284","last_scrub_stamp":"2024-09-12T18:36:10.936793+0000","last_deep_scrub":"268'284","last_deep_scrub_stamp":"2024-09-12T18:36:10.936793+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.936793+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:08.902755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262194,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":407,"num_read_kb":20512,"num_write":856,"num_write_kb":25251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.593258+0000","last_change":"2024-09-12T18:36:25.593258+0000","last_active":"2024-09-12T18:36:25.593258+0000","last_peered":"2024-09-12T18:36:25.593258+0000","last_clean":"2024-09-12T18:36:25.593258+0000","last_became_active":"2024-09-12T17:10:34.357883+0000","last_became_peered":"2024-09-12T17:10:34.357883+0000","last_unstale":"2024-09-12T18:36:25.593258+0000","last_undegraded":"2024-09-12T18:36:25.593258+0000","last_fullsized":"2024-09-12T18:36:25.593258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:25.593056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:25.593056+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.593056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:49.907882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'523","reported_seq":1189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.886533+0000","last_change":"2024-09-12T18:36:28.886533+0000","last_active":"2024-09-12T18:36:28.886533+0000","last_peered":"2024-09-12T18:36:28.886533+0000","last_clean":"2024-09-12T18:36:28.886533+0000","last_became_active":"2024-09-12T17:10:36.401608+0000","last_became_peered":"2024-09-12T17:10:36.401608+0000","last_unstale":"2024-09-12T18:36:28.886533+0000","last_undegraded":"2024-09-12T18:36:28.886533+0000","last_fullsized":"2024-09-12T18:36:28.886533+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'523","last_scrub_stamp":"2024-09-12T18:36:28.886458+0000","last_deep_scrub":"268'523","last_deep_scrub_stamp":"2024-09-12T18:36:28.886458+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.886458+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:36.974846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95576,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":903,"num_read_kb":2101,"num_write":776,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.860439+0000","last_change":"2024-09-12T18:36:38.860439+0000","last_active":"2024-09-12T18:36:38.860439+0000","last_peered":"2024-09-12T18:36:38.860439+0000","last_clean":"2024-09-12T18:36:38.860439+0000","last_became_active":"2024-09-12T17:10:38.398862+0000","last_became_peered":"2024-09-12T17:10:38.398862+0000","last_unstale":"2024-09-12T18:36:38.860439+0000","last_undegraded":"2024-09-12T18:36:38.860439+0000","last_fullsized":"2024-09-12T18:36:38.860439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:38.860257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:38.860257+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.860257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:31.601508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'159","reported_seq":688,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.912889+0000","last_change":"2024-09-12T18:36:43.912889+0000","last_active":"2024-09-12T18:36:43.912889+0000","last_peered":"2024-09-12T18:36:43.912889+0000","last_clean":"2024-09-12T18:36:43.912889+0000","last_became_active":"2024-09-12T17:10:40.770075+0000","last_became_peered":"2024-09-12T17:10:40.770075+0000","last_unstale":"2024-09-12T18:36:43.912889+0000","last_undegraded":"2024-09-12T18:36:43.912889+0000","last_fullsized":"2024-09-12T18:36:43.912889+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'159","last_scrub_stamp":"2024-09-12T18:36:43.912709+0000","last_deep_scrub":"268'159","last_deep_scrub_stamp":"2024-09-12T18:36:43.912709+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.912709+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:54.272079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":234,"num_write":361,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'1462","reported_seq":3056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.508311+0000","last_change":"2024-09-12T18:36:17.508311+0000","last_active":"2024-09-12T18:36:17.508311+0000","last_peered":"2024-09-12T18:36:17.508311+0000","last_clean":"2024-09-12T18:36:17.508311+0000","last_became_active":"2024-09-12T17:10:32.376892+0000","last_became_peered":"2024-09-12T17:10:32.376892+0000","last_unstale":"2024-09-12T18:36:17.508311+0000","last_undegraded":"2024-09-12T18:36:17.508311+0000","last_fullsized":"2024-09-12T18:36:17.508311+0000","mapping_epoch":27,"log_start":"268'1400","ondisk_log_start":"268'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1462","last_scrub_stamp":"2024-09-12T18:36:17.508128+0000","last_deep_scrub":"268'1462","last_deep_scrub_stamp":"2024-09-12T18:36:17.508128+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.508128+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":1400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.380441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6636,"num_read_kb":5839,"num_write":2046,"num_write_kb":883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'297","reported_seq":942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.834263+0000","last_change":"2024-09-12T18:36:08.834263+0000","last_active":"2024-09-12T18:36:08.834263+0000","last_peered":"2024-09-12T18:36:08.834263+0000","last_clean":"2024-09-12T18:36:08.834263+0000","last_became_active":"2024-09-12T17:10:30.378075+0000","last_became_peered":"2024-09-12T17:10:30.378075+0000","last_unstale":"2024-09-12T18:36:08.834263+0000","last_undegraded":"2024-09-12T18:36:08.834263+0000","last_fullsized":"2024-09-12T18:36:08.834263+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'297","last_scrub_stamp":"2024-09-12T18:36:08.833929+0000","last_deep_scrub":"268'297","last_deep_scrub_stamp":"2024-09-12T18:36:08.833929+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.833929+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:52.476849+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4500309,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":47843,"num_write":921,"num_write_kb":30557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.097940+0000","last_change":"2024-09-12T18:36:20.097940+0000","last_active":"2024-09-12T18:36:20.097940+0000","last_peered":"2024-09-12T18:36:20.097940+0000","last_clean":"2024-09-12T18:36:20.097940+0000","last_became_active":"2024-09-12T17:10:34.361495+0000","last_became_peered":"2024-09-12T17:10:34.361495+0000","last_unstale":"2024-09-12T18:36:20.097940+0000","last_undegraded":"2024-09-12T18:36:20.097940+0000","last_fullsized":"2024-09-12T18:36:20.097940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:20.097716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:20.097716+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.097716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:48.768128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'346","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.002122+0000","last_change":"2024-09-12T18:36:35.002122+0000","last_active":"2024-09-12T18:36:35.002122+0000","last_peered":"2024-09-12T18:36:35.002122+0000","last_clean":"2024-09-12T18:36:35.002122+0000","last_became_active":"2024-09-12T17:10:36.398415+0000","last_became_peered":"2024-09-12T17:10:36.398415+0000","last_unstale":"2024-09-12T18:36:35.002122+0000","last_undegraded":"2024-09-12T18:36:35.002122+0000","last_fullsized":"2024-09-12T18:36:35.002122+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T18:36:35.001911+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T18:36:35.001911+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.001911+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:12.324376+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45877,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":580,"num_read_kb":1203,"num_write":474,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.826608+0000","last_change":"2024-09-12T18:36:31.826608+0000","last_active":"2024-09-12T18:36:31.826608+0000","last_peered":"2024-09-12T18:36:31.826608+0000","last_clean":"2024-09-12T18:36:31.826608+0000","last_became_active":"2024-09-12T17:10:38.401047+0000","last_became_peered":"2024-09-12T17:10:38.401047+0000","last_unstale":"2024-09-12T18:36:31.826608+0000","last_undegraded":"2024-09-12T18:36:31.826608+0000","last_fullsized":"2024-09-12T18:36:31.826608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:31.826409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:31.826409+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.826409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:36.329076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'203","reported_seq":759,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.166049+0000","last_change":"2024-09-12T18:36:30.166049+0000","last_active":"2024-09-12T18:36:30.166049+0000","last_peered":"2024-09-12T18:36:30.166049+0000","last_clean":"2024-09-12T18:36:30.166049+0000","last_became_active":"2024-09-12T17:10:40.428841+0000","last_became_peered":"2024-09-12T17:10:40.428841+0000","last_unstale":"2024-09-12T18:36:30.166049+0000","last_undegraded":"2024-09-12T18:36:30.166049+0000","last_fullsized":"2024-09-12T18:36:30.166049+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-12T18:36:30.165768+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-12T18:36:30.165768+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.165768+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:12.319509+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1669,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":376,"num_read_kb":345,"num_write":581,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'1128","reported_seq":2882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.773405+0000","last_change":"2024-09-12T18:36:24.773405+0000","last_active":"2024-09-12T18:36:24.773405+0000","last_peered":"2024-09-12T18:36:24.773405+0000","last_clean":"2024-09-12T18:36:24.773405+0000","last_became_active":"2024-09-12T17:10:32.369344+0000","last_became_peered":"2024-09-12T17:10:32.369344+0000","last_unstale":"2024-09-12T18:36:24.773405+0000","last_undegraded":"2024-09-12T18:36:24.773405+0000","last_fullsized":"2024-09-12T18:36:24.773405+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1128","last_scrub_stamp":"2024-09-12T18:36:24.773164+0000","last_deep_scrub":"268'1128","last_deep_scrub_stamp":"2024-09-12T18:36:24.773164+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.773164+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":1100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:21.417963+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5513,"num_read_kb":4854,"num_write":1595,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'341","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.312390+0000","last_change":"2024-09-12T18:36:10.312390+0000","last_active":"2024-09-12T18:36:10.312390+0000","last_peered":"2024-09-12T18:36:10.312390+0000","last_clean":"2024-09-12T18:36:10.312390+0000","last_became_active":"2024-09-12T17:11:05.123283+0000","last_became_peered":"2024-09-12T17:11:05.123283+0000","last_unstale":"2024-09-12T18:36:10.312390+0000","last_undegraded":"2024-09-12T18:36:10.312390+0000","last_fullsized":"2024-09-12T18:36:10.312390+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'341","last_scrub_stamp":"2024-09-12T18:36:10.312023+0000","last_deep_scrub":"268'341","last_deep_scrub_stamp":"2024-09-12T18:36:10.312023+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.312023+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:26:25.953575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048663,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":48133,"num_write":1103,"num_write_kb":35281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"268'6","reported_seq":1011,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.875220+0000","last_change":"2024-09-12T18:36:29.875220+0000","last_active":"2024-09-12T18:36:29.875220+0000","last_peered":"2024-09-12T18:36:29.875220+0000","last_clean":"2024-09-12T18:36:29.875220+0000","last_became_active":"2024-09-12T17:10:34.352213+0000","last_became_peered":"2024-09-12T17:10:34.352213+0000","last_unstale":"2024-09-12T18:36:29.875220+0000","last_undegraded":"2024-09-12T18:36:29.875220+0000","last_fullsized":"2024-09-12T18:36:29.875220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T18:36:29.875035+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T18:36:29.875035+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.875035+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:02.237403+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'303","reported_seq":925,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.967050+0000","last_change":"2024-09-12T18:36:36.967050+0000","last_active":"2024-09-12T18:36:36.967050+0000","last_peered":"2024-09-12T18:36:36.967050+0000","last_clean":"2024-09-12T18:36:36.967050+0000","last_became_active":"2024-09-12T17:10:36.921450+0000","last_became_peered":"2024-09-12T17:10:36.921450+0000","last_unstale":"2024-09-12T18:36:36.967050+0000","last_undegraded":"2024-09-12T18:36:36.967050+0000","last_fullsized":"2024-09-12T18:36:36.967050+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'303","last_scrub_stamp":"2024-09-12T18:36:36.966861+0000","last_deep_scrub":"268'303","last_deep_scrub_stamp":"2024-09-12T18:36:36.966861+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.966861+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:50.821225+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44011,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":1000,"num_write":366,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.824554+0000","last_change":"2024-09-12T18:36:41.824554+0000","last_active":"2024-09-12T18:36:41.824554+0000","last_peered":"2024-09-12T18:36:41.824554+0000","last_clean":"2024-09-12T18:36:41.824554+0000","last_became_active":"2024-09-12T17:10:38.395457+0000","last_became_peered":"2024-09-12T17:10:38.395457+0000","last_unstale":"2024-09-12T18:36:41.824554+0000","last_undegraded":"2024-09-12T18:36:41.824554+0000","last_fullsized":"2024-09-12T18:36:41.824554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:41.824274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:41.824274+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.824274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:29.679358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'134","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.811656+0000","last_change":"2024-09-12T18:36:42.811656+0000","last_active":"2024-09-12T18:36:42.811656+0000","last_peered":"2024-09-12T18:36:42.811656+0000","last_clean":"2024-09-12T18:36:42.811656+0000","last_became_active":"2024-09-12T17:10:40.429303+0000","last_became_peered":"2024-09-12T17:10:40.429303+0000","last_unstale":"2024-09-12T18:36:42.811656+0000","last_undegraded":"2024-09-12T18:36:42.811656+0000","last_fullsized":"2024-09-12T18:36:42.811656+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'134","last_scrub_stamp":"2024-09-12T18:36:42.811437+0000","last_deep_scrub":"268'134","last_deep_scrub_stamp":"2024-09-12T18:36:42.811437+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.811437+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:56.115877+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":233,"num_read_kb":212,"num_write":334,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'905","reported_seq":2428,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.380060+0000","last_change":"2024-09-12T18:36:15.380060+0000","last_active":"2024-09-12T18:36:15.380060+0000","last_peered":"2024-09-12T18:36:15.380060+0000","last_clean":"2024-09-12T18:36:15.380060+0000","last_became_active":"2024-09-12T17:10:32.362957+0000","last_became_peered":"2024-09-12T17:10:32.362957+0000","last_unstale":"2024-09-12T18:36:15.380060+0000","last_undegraded":"2024-09-12T18:36:15.380060+0000","last_fullsized":"2024-09-12T18:36:15.380060+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'905","last_scrub_stamp":"2024-09-12T18:36:15.379868+0000","last_deep_scrub":"268'905","last_deep_scrub_stamp":"2024-09-12T18:36:15.379868+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.379868+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":800,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:49.635855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4274,"num_read_kb":3831,"num_write":1263,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'361","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.565443+0000","last_change":"2024-09-12T18:36:10.565443+0000","last_active":"2024-09-12T18:36:10.565443+0000","last_peered":"2024-09-12T18:36:10.565443+0000","last_clean":"2024-09-12T18:36:10.565443+0000","last_became_active":"2024-09-12T17:10:30.374618+0000","last_became_peered":"2024-09-12T17:10:30.374618+0000","last_unstale":"2024-09-12T18:36:10.565443+0000","last_undegraded":"2024-09-12T18:36:10.565443+0000","last_fullsized":"2024-09-12T18:36:10.565443+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-12T18:36:10.565103+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-12T18:36:10.565103+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.565103+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:57.740717+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048724,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":441,"num_read_kb":21889,"num_write":990,"num_write_kb":37331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.924046+0000","last_change":"2024-09-12T18:36:24.924046+0000","last_active":"2024-09-12T18:36:24.924046+0000","last_peered":"2024-09-12T18:36:24.924046+0000","last_clean":"2024-09-12T18:36:24.924046+0000","last_became_active":"2024-09-12T17:10:34.361536+0000","last_became_peered":"2024-09-12T17:10:34.361536+0000","last_unstale":"2024-09-12T18:36:24.924046+0000","last_undegraded":"2024-09-12T18:36:24.924046+0000","last_fullsized":"2024-09-12T18:36:24.924046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:24.923870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:24.923870+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.923870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:02.233333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'120","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.754806+0000","last_change":"2024-09-12T18:36:35.754806+0000","last_active":"2024-09-12T18:36:35.754806+0000","last_peered":"2024-09-12T18:36:35.754806+0000","last_clean":"2024-09-12T18:36:35.754806+0000","last_became_active":"2024-09-12T17:10:36.923087+0000","last_became_peered":"2024-09-12T17:10:36.923087+0000","last_unstale":"2024-09-12T18:36:35.754806+0000","last_undegraded":"2024-09-12T18:36:35.754806+0000","last_fullsized":"2024-09-12T18:36:35.754806+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'120","last_scrub_stamp":"2024-09-12T18:36:35.754611+0000","last_deep_scrub":"268'120","last_deep_scrub_stamp":"2024-09-12T18:36:35.754611+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.754611+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:10.265855+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":134,"num_write":98,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'781","reported_seq":2894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.226235+0000","last_change":"2024-09-12T18:36:28.226235+0000","last_active":"2024-09-12T18:36:28.226235+0000","last_peered":"2024-09-12T18:36:28.226235+0000","last_clean":"2024-09-12T18:36:28.226235+0000","last_became_active":"2024-09-12T17:10:38.407830+0000","last_became_peered":"2024-09-12T17:10:38.407830+0000","last_unstale":"2024-09-12T18:36:28.226235+0000","last_undegraded":"2024-09-12T18:36:28.226235+0000","last_fullsized":"2024-09-12T18:36:28.226235+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'781","last_scrub_stamp":"2024-09-12T18:36:28.226043+0000","last_deep_scrub":"268'781","last_deep_scrub_stamp":"2024-09-12T18:36:28.226043+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.226043+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:01.367734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'147","reported_seq":682,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.979196+0000","last_change":"2024-09-12T18:36:38.979196+0000","last_active":"2024-09-12T18:36:38.979196+0000","last_peered":"2024-09-12T18:36:38.979196+0000","last_clean":"2024-09-12T18:36:38.979196+0000","last_became_active":"2024-09-12T17:10:40.431693+0000","last_became_peered":"2024-09-12T17:10:40.431693+0000","last_unstale":"2024-09-12T18:36:38.979196+0000","last_undegraded":"2024-09-12T18:36:38.979196+0000","last_fullsized":"2024-09-12T18:36:38.979196+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'147","last_scrub_stamp":"2024-09-12T18:36:38.979004+0000","last_deep_scrub":"268'147","last_deep_scrub_stamp":"2024-09-12T18:36:38.979004+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.979004+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:30.012772+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":232,"num_write":366,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'809","reported_seq":2336,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.062762+0000","last_change":"2024-09-12T18:36:18.062762+0000","last_active":"2024-09-12T18:36:18.062762+0000","last_peered":"2024-09-12T18:36:18.062762+0000","last_clean":"2024-09-12T18:36:18.062762+0000","last_became_active":"2024-09-12T17:10:32.369824+0000","last_became_peered":"2024-09-12T17:10:32.369824+0000","last_unstale":"2024-09-12T18:36:18.062762+0000","last_undegraded":"2024-09-12T18:36:18.062762+0000","last_fullsized":"2024-09-12T18:36:18.062762+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'809","last_scrub_stamp":"2024-09-12T18:36:18.062570+0000","last_deep_scrub":"268'809","last_deep_scrub_stamp":"2024-09-12T18:36:18.062570+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.062570+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:06.008030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3803,"num_read_kb":3411,"num_write":1089,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'371","reported_seq":1184,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.929229+0000","last_change":"2024-09-12T18:36:12.929229+0000","last_active":"2024-09-12T18:36:12.929229+0000","last_peered":"2024-09-12T18:36:12.929229+0000","last_clean":"2024-09-12T18:36:12.929229+0000","last_became_active":"2024-09-12T17:10:30.357942+0000","last_became_peered":"2024-09-12T17:10:30.357942+0000","last_unstale":"2024-09-12T18:36:12.929229+0000","last_undegraded":"2024-09-12T18:36:12.929229+0000","last_fullsized":"2024-09-12T18:36:12.929229+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'371","last_scrub_stamp":"2024-09-12T18:36:12.928977+0000","last_deep_scrub":"268'371","last_deep_scrub_stamp":"2024-09-12T18:36:12.928977+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.928977+0000","objects_scrubbed":8,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:50.171794+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310810,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":949,"num_read_kb":26001,"num_write":1281,"num_write_kb":43743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.001612+0000","last_change":"2024-09-12T18:36:29.001612+0000","last_active":"2024-09-12T18:36:29.001612+0000","last_peered":"2024-09-12T18:36:29.001612+0000","last_clean":"2024-09-12T18:36:29.001612+0000","last_became_active":"2024-09-12T17:10:34.361686+0000","last_became_peered":"2024-09-12T17:10:34.361686+0000","last_unstale":"2024-09-12T18:36:29.001612+0000","last_undegraded":"2024-09-12T18:36:29.001612+0000","last_fullsized":"2024-09-12T18:36:29.001612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:29.001403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:29.001403+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.001403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:52.326890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'376","reported_seq":1006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.905863+0000","last_change":"2024-09-12T18:36:37.905863+0000","last_active":"2024-09-12T18:36:37.905863+0000","last_peered":"2024-09-12T18:36:37.905863+0000","last_clean":"2024-09-12T18:36:37.905863+0000","last_became_active":"2024-09-12T17:10:36.392089+0000","last_became_peered":"2024-09-12T17:10:36.392089+0000","last_unstale":"2024-09-12T18:36:37.905863+0000","last_undegraded":"2024-09-12T18:36:37.905863+0000","last_fullsized":"2024-09-12T18:36:37.905863+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-12T18:36:37.905604+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-12T18:36:37.905604+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.905604+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:26.212396+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47317,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":601,"num_read_kb":1312,"num_write":482,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.790130+0000","last_change":"2024-09-12T18:36:37.790130+0000","last_active":"2024-09-12T18:36:37.790130+0000","last_peered":"2024-09-12T18:36:37.790130+0000","last_clean":"2024-09-12T18:36:37.790130+0000","last_became_active":"2024-09-12T17:10:38.411191+0000","last_became_peered":"2024-09-12T17:10:38.411191+0000","last_unstale":"2024-09-12T18:36:37.790130+0000","last_undegraded":"2024-09-12T18:36:37.790130+0000","last_fullsized":"2024-09-12T18:36:37.790130+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:37.789950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:37.789950+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.789950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:40.481018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'103","reported_seq":623,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.010315+0000","last_change":"2024-09-12T18:36:43.010315+0000","last_active":"2024-09-12T18:36:43.010315+0000","last_peered":"2024-09-12T18:36:43.010315+0000","last_clean":"2024-09-12T18:36:43.010315+0000","last_became_active":"2024-09-12T17:10:40.436748+0000","last_became_peered":"2024-09-12T17:10:40.436748+0000","last_unstale":"2024-09-12T18:36:43.010315+0000","last_undegraded":"2024-09-12T18:36:43.010315+0000","last_fullsized":"2024-09-12T18:36:43.010315+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'103","last_scrub_stamp":"2024-09-12T18:36:43.010111+0000","last_deep_scrub":"268'103","last_deep_scrub_stamp":"2024-09-12T18:36:43.010111+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.010111+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:09.227136+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":136,"num_write":243,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'580","reported_seq":2238,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.023785+0000","last_change":"2024-09-12T18:36:19.023785+0000","last_active":"2024-09-12T18:36:19.023785+0000","last_peered":"2024-09-12T18:36:19.023785+0000","last_clean":"2024-09-12T18:36:19.023785+0000","last_became_active":"2024-09-12T17:10:32.370173+0000","last_became_peered":"2024-09-12T17:10:32.370173+0000","last_unstale":"2024-09-12T18:36:19.023785+0000","last_undegraded":"2024-09-12T18:36:19.023785+0000","last_fullsized":"2024-09-12T18:36:19.023785+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'580","last_scrub_stamp":"2024-09-12T18:36:19.023540+0000","last_deep_scrub":"268'580","last_deep_scrub_stamp":"2024-09-12T18:36:19.023540+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.023540+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:18.181483+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2773,"num_read_kb":2563,"num_write":696,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'364","reported_seq":1006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.882426+0000","last_change":"2024-09-12T18:36:13.882426+0000","last_active":"2024-09-12T18:36:13.882426+0000","last_peered":"2024-09-12T18:36:13.882426+0000","last_clean":"2024-09-12T18:36:13.882426+0000","last_became_active":"2024-09-12T17:10:30.355723+0000","last_became_peered":"2024-09-12T17:10:30.355723+0000","last_unstale":"2024-09-12T18:36:13.882426+0000","last_undegraded":"2024-09-12T18:36:13.882426+0000","last_fullsized":"2024-09-12T18:36:13.882426+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T18:36:13.882169+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T18:36:13.882169+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.882169+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:47.864528+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":22337,"num_write":1141,"num_write_kb":39083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.870528+0000","last_change":"2024-09-12T18:36:32.870528+0000","last_active":"2024-09-12T18:36:32.870528+0000","last_peered":"2024-09-12T18:36:32.870528+0000","last_clean":"2024-09-12T18:36:32.870528+0000","last_became_active":"2024-09-12T17:10:34.363439+0000","last_became_peered":"2024-09-12T17:10:34.363439+0000","last_unstale":"2024-09-12T18:36:32.870528+0000","last_undegraded":"2024-09-12T18:36:32.870528+0000","last_fullsized":"2024-09-12T18:36:32.870528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:32.870356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:32.870356+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.870356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:28.941269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'294","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.730732+0000","last_change":"2024-09-12T18:36:33.730732+0000","last_active":"2024-09-12T18:36:33.730732+0000","last_peered":"2024-09-12T18:36:33.730732+0000","last_clean":"2024-09-12T18:36:33.730732+0000","last_became_active":"2024-09-12T17:10:36.397148+0000","last_became_peered":"2024-09-12T17:10:36.397148+0000","last_unstale":"2024-09-12T18:36:33.730732+0000","last_undegraded":"2024-09-12T18:36:33.730732+0000","last_fullsized":"2024-09-12T18:36:33.730732+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'294","last_scrub_stamp":"2024-09-12T18:36:33.730540+0000","last_deep_scrub":"268'294","last_deep_scrub_stamp":"2024-09-12T18:36:33.730540+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.730540+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:53.128733+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":1130,"num_write":384,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.173962+0000","last_change":"2024-09-12T18:36:26.173962+0000","last_active":"2024-09-12T18:36:26.173962+0000","last_peered":"2024-09-12T18:36:26.173962+0000","last_clean":"2024-09-12T18:36:26.173962+0000","last_became_active":"2024-09-12T17:10:38.406892+0000","last_became_peered":"2024-09-12T17:10:38.406892+0000","last_unstale":"2024-09-12T18:36:26.173962+0000","last_undegraded":"2024-09-12T18:36:26.173962+0000","last_fullsized":"2024-09-12T18:36:26.173962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.173758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.173758+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.173758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:04.936184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'157","reported_seq":692,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:19.439905+0000","last_change":"2024-09-12T17:10:40.770908+0000","last_active":"2024-09-12T18:35:19.439905+0000","last_peered":"2024-09-12T18:35:19.439905+0000","last_clean":"2024-09-12T18:35:19.439905+0000","last_became_active":"2024-09-12T17:10:40.770159+0000","last_became_peered":"2024-09-12T17:10:40.770159+0000","last_unstale":"2024-09-12T18:35:19.439905+0000","last_undegraded":"2024-09-12T18:35:19.439905+0000","last_fullsized":"2024-09-12T18:35:19.439905+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:39.371713+0000","last_clean_scrub_stamp":"2024-09-12T17:10:39.371713+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:17.022501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":169,"num_write":336,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'1196","reported_seq":2731,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.766995+0000","last_change":"2024-09-12T18:36:21.766995+0000","last_active":"2024-09-12T18:36:21.766995+0000","last_peered":"2024-09-12T18:36:21.766995+0000","last_clean":"2024-09-12T18:36:21.766995+0000","last_became_active":"2024-09-12T17:10:32.357738+0000","last_became_peered":"2024-09-12T17:10:32.357738+0000","last_unstale":"2024-09-12T18:36:21.766995+0000","last_undegraded":"2024-09-12T18:36:21.766995+0000","last_fullsized":"2024-09-12T18:36:21.766995+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1196","last_scrub_stamp":"2024-09-12T18:36:21.766764+0000","last_deep_scrub":"268'1196","last_deep_scrub_stamp":"2024-09-12T18:36:21.766764+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.766764+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":1100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:30.939395+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5279,"num_read_kb":4649,"num_write":1626,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'344","reported_seq":1006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.923708+0000","last_change":"2024-09-12T18:36:11.923708+0000","last_active":"2024-09-12T18:36:11.923708+0000","last_peered":"2024-09-12T18:36:11.923708+0000","last_clean":"2024-09-12T18:36:11.923708+0000","last_became_active":"2024-09-12T17:10:30.401941+0000","last_became_peered":"2024-09-12T17:10:30.401941+0000","last_unstale":"2024-09-12T18:36:11.923708+0000","last_undegraded":"2024-09-12T18:36:11.923708+0000","last_fullsized":"2024-09-12T18:36:11.923708+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-12T18:36:11.923480+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-12T18:36:11.923480+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.923480+0000","objects_scrubbed":9,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:14.387628+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310809,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":28042,"num_write":994,"num_write_kb":46600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.859023+0000","last_change":"2024-09-12T18:36:27.859023+0000","last_active":"2024-09-12T18:36:27.859023+0000","last_peered":"2024-09-12T18:36:27.859023+0000","last_clean":"2024-09-12T18:36:27.859023+0000","last_became_active":"2024-09-12T17:10:34.357688+0000","last_became_peered":"2024-09-12T17:10:34.357688+0000","last_unstale":"2024-09-12T18:36:27.859023+0000","last_undegraded":"2024-09-12T18:36:27.859023+0000","last_fullsized":"2024-09-12T18:36:27.859023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:27.858842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:27.858842+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.858842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:58.748918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'251","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.952302+0000","last_change":"2024-09-12T18:36:35.952302+0000","last_active":"2024-09-12T18:36:35.952302+0000","last_peered":"2024-09-12T18:36:35.952302+0000","last_clean":"2024-09-12T18:36:35.952302+0000","last_became_active":"2024-09-12T17:10:36.398639+0000","last_became_peered":"2024-09-12T17:10:36.398639+0000","last_unstale":"2024-09-12T18:36:35.952302+0000","last_undegraded":"2024-09-12T18:36:35.952302+0000","last_fullsized":"2024-09-12T18:36:35.952302+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'251","last_scrub_stamp":"2024-09-12T18:36:35.952117+0000","last_deep_scrub":"268'251","last_deep_scrub_stamp":"2024-09-12T18:36:35.952117+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.952117+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:16.335588+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52346,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":1002,"num_write":330,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.782135+0000","last_change":"2024-09-12T18:36:36.782135+0000","last_active":"2024-09-12T18:36:36.782135+0000","last_peered":"2024-09-12T18:36:36.782135+0000","last_clean":"2024-09-12T18:36:36.782135+0000","last_became_active":"2024-09-12T17:10:38.400703+0000","last_became_peered":"2024-09-12T17:10:38.400703+0000","last_unstale":"2024-09-12T18:36:36.782135+0000","last_undegraded":"2024-09-12T18:36:36.782135+0000","last_fullsized":"2024-09-12T18:36:36.782135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:36.781956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:36.781956+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.781956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:52.593251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'177","reported_seq":1668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.056285+0000","last_change":"2024-09-12T18:36:41.056285+0000","last_active":"2024-09-12T18:36:41.056285+0000","last_peered":"2024-09-12T18:36:41.056285+0000","last_clean":"2024-09-12T18:36:41.056285+0000","last_became_active":"2024-09-12T17:10:40.434195+0000","last_became_peered":"2024-09-12T17:10:40.434195+0000","last_unstale":"2024-09-12T18:36:41.056285+0000","last_undegraded":"2024-09-12T18:36:41.056285+0000","last_fullsized":"2024-09-12T18:36:41.056285+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'177","last_scrub_stamp":"2024-09-12T18:36:41.056096+0000","last_deep_scrub":"268'177","last_deep_scrub_stamp":"2024-09-12T18:36:41.056096+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.056096+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:28.684929+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1233,"num_read_kb":1222,"num_write":385,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'396","reported_seq":1921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.020701+0000","last_change":"2024-09-12T18:36:17.020701+0000","last_active":"2024-09-12T18:36:17.020701+0000","last_peered":"2024-09-12T18:36:17.020701+0000","last_clean":"2024-09-12T18:36:17.020701+0000","last_became_active":"2024-09-12T17:10:32.361716+0000","last_became_peered":"2024-09-12T17:10:32.361716+0000","last_unstale":"2024-09-12T18:36:17.020701+0000","last_undegraded":"2024-09-12T18:36:17.020701+0000","last_fullsized":"2024-09-12T18:36:17.020701+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'396","last_scrub_stamp":"2024-09-12T18:36:17.020480+0000","last_deep_scrub":"268'396","last_deep_scrub_stamp":"2024-09-12T18:36:17.020480+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.020480+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:51.155889+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2161,"num_read_kb":2069,"num_write":462,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'306","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.614975+0000","last_change":"2024-09-12T18:36:09.614975+0000","last_active":"2024-09-12T18:36:09.614975+0000","last_peered":"2024-09-12T18:36:09.614975+0000","last_clean":"2024-09-12T18:36:09.614975+0000","last_became_active":"2024-09-12T17:10:30.387788+0000","last_became_peered":"2024-09-12T17:10:30.387788+0000","last_unstale":"2024-09-12T18:36:09.614975+0000","last_undegraded":"2024-09-12T18:36:09.614975+0000","last_fullsized":"2024-09-12T18:36:09.614975+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'306","last_scrub_stamp":"2024-09-12T18:36:09.614762+0000","last_deep_scrub":"268'306","last_deep_scrub_stamp":"2024-09-12T18:36:09.614762+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.614762+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:45.452561+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1332788,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":40433,"num_write":1021,"num_write_kb":46438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.968939+0000","last_change":"2024-09-12T18:36:20.968939+0000","last_active":"2024-09-12T18:36:20.968939+0000","last_peered":"2024-09-12T18:36:20.968939+0000","last_clean":"2024-09-12T18:36:20.968939+0000","last_became_active":"2024-09-12T17:10:34.356290+0000","last_became_peered":"2024-09-12T17:10:34.356290+0000","last_unstale":"2024-09-12T18:36:20.968939+0000","last_undegraded":"2024-09-12T18:36:20.968939+0000","last_fullsized":"2024-09-12T18:36:20.968939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:20.968760+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:20.968760+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.968760+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:48.876143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'313","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.711502+0000","last_change":"2024-09-12T18:36:33.711502+0000","last_active":"2024-09-12T18:36:33.711502+0000","last_peered":"2024-09-12T18:36:33.711502+0000","last_clean":"2024-09-12T18:36:33.711502+0000","last_became_active":"2024-09-12T17:10:36.391455+0000","last_became_peered":"2024-09-12T17:10:36.391455+0000","last_unstale":"2024-09-12T18:36:33.711502+0000","last_undegraded":"2024-09-12T18:36:33.711502+0000","last_fullsized":"2024-09-12T18:36:33.711502+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T18:36:33.711301+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T18:36:33.711301+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.711301+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:17.424966+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44113,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":1099,"num_write":400,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.789767+0000","last_change":"2024-09-12T18:36:38.789767+0000","last_active":"2024-09-12T18:36:38.789767+0000","last_peered":"2024-09-12T18:36:38.789767+0000","last_clean":"2024-09-12T18:36:38.789767+0000","last_became_active":"2024-09-12T17:10:38.413592+0000","last_became_peered":"2024-09-12T17:10:38.413592+0000","last_unstale":"2024-09-12T18:36:38.789767+0000","last_undegraded":"2024-09-12T18:36:38.789767+0000","last_fullsized":"2024-09-12T18:36:38.789767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:38.789532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:38.789532+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.789532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:49.383173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'152","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.777069+0000","last_change":"2024-09-12T18:36:39.777069+0000","last_active":"2024-09-12T18:36:39.777069+0000","last_peered":"2024-09-12T18:36:39.777069+0000","last_clean":"2024-09-12T18:36:39.777069+0000","last_became_active":"2024-09-12T17:10:40.425063+0000","last_became_peered":"2024-09-12T17:10:40.425063+0000","last_unstale":"2024-09-12T18:36:39.777069+0000","last_undegraded":"2024-09-12T18:36:39.777069+0000","last_fullsized":"2024-09-12T18:36:39.777069+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'152","last_scrub_stamp":"2024-09-12T18:36:39.776872+0000","last_deep_scrub":"268'152","last_deep_scrub_stamp":"2024-09-12T18:36:39.776872+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.776872+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:55.611705+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":181,"num_read_kb":173,"num_write":358,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'373","reported_seq":1801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.871094+0000","last_change":"2024-09-12T18:36:27.871094+0000","last_active":"2024-09-12T18:36:27.871094+0000","last_peered":"2024-09-12T18:36:27.871094+0000","last_clean":"2024-09-12T18:36:27.871094+0000","last_became_active":"2024-09-12T17:10:32.361445+0000","last_became_peered":"2024-09-12T17:10:32.361445+0000","last_unstale":"2024-09-12T18:36:27.871094+0000","last_undegraded":"2024-09-12T18:36:27.871094+0000","last_fullsized":"2024-09-12T18:36:27.871094+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'373","last_scrub_stamp":"2024-09-12T18:36:27.870922+0000","last_deep_scrub":"268'373","last_deep_scrub_stamp":"2024-09-12T18:36:27.870922+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.870922+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.512963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1921,"num_read_kb":1829,"num_write":410,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'364","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.393893+0000","last_change":"2024-09-12T18:36:06.393839+0000","last_active":"2024-09-12T18:36:06.393893+0000","last_peered":"2024-09-12T18:36:06.393893+0000","last_clean":"2024-09-12T18:36:06.393893+0000","last_became_active":"2024-09-12T17:11:04.372622+0000","last_became_peered":"2024-09-12T17:11:04.372622+0000","last_unstale":"2024-09-12T18:36:06.393893+0000","last_undegraded":"2024-09-12T18:36:06.393893+0000","last_fullsized":"2024-09-12T18:36:06.393893+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T18:36:06.393728+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T18:36:06.393728+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.393728+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:56.730903+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456544,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":530,"num_read_kb":34257,"num_write":1086,"num_write_kb":35279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'383","reported_seq":1908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.927405+0000","last_change":"2024-09-12T18:36:19.927405+0000","last_active":"2024-09-12T18:36:19.927405+0000","last_peered":"2024-09-12T18:36:19.927405+0000","last_clean":"2024-09-12T18:36:19.927405+0000","last_became_active":"2024-09-12T17:10:32.364080+0000","last_became_peered":"2024-09-12T17:10:32.364080+0000","last_unstale":"2024-09-12T18:36:19.927405+0000","last_undegraded":"2024-09-12T18:36:19.927405+0000","last_fullsized":"2024-09-12T18:36:19.927405+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-12T18:36:19.927195+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-12T18:36:19.927195+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.927195+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:05.629401+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2111,"num_read_kb":2018,"num_write":410,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'353","reported_seq":1136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.389225+0000","last_change":"2024-09-12T18:36:13.389225+0000","last_active":"2024-09-12T18:36:13.389225+0000","last_peered":"2024-09-12T18:36:13.389225+0000","last_clean":"2024-09-12T18:36:13.389225+0000","last_became_active":"2024-09-12T17:10:30.393924+0000","last_became_peered":"2024-09-12T17:10:30.393924+0000","last_unstale":"2024-09-12T18:36:13.389225+0000","last_undegraded":"2024-09-12T18:36:13.389225+0000","last_fullsized":"2024-09-12T18:36:13.389225+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'353","last_scrub_stamp":"2024-09-12T18:36:13.388912+0000","last_deep_scrub":"268'353","last_deep_scrub_stamp":"2024-09-12T18:36:13.388912+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.388912+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:11.683116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550017,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":731,"num_read_kb":31225,"num_write":1143,"num_write_kb":33307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'814","reported_seq":2210,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.957323+0000","last_change":"2024-09-12T18:36:26.957323+0000","last_active":"2024-09-12T18:36:26.957323+0000","last_peered":"2024-09-12T18:36:26.957323+0000","last_clean":"2024-09-12T18:36:26.957323+0000","last_became_active":"2024-09-12T17:10:32.382110+0000","last_became_peered":"2024-09-12T17:10:32.382110+0000","last_unstale":"2024-09-12T18:36:26.957323+0000","last_undegraded":"2024-09-12T18:36:26.957323+0000","last_fullsized":"2024-09-12T18:36:26.957323+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'814","last_scrub_stamp":"2024-09-12T18:36:26.957133+0000","last_deep_scrub":"268'814","last_deep_scrub_stamp":"2024-09-12T18:36:26.957133+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.957133+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:11.699858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3583,"num_read_kb":3191,"num_write":1046,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'356","reported_seq":1040,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.868686+0000","last_change":"2024-09-12T18:36:14.868686+0000","last_active":"2024-09-12T18:36:14.868686+0000","last_peered":"2024-09-12T18:36:14.868686+0000","last_clean":"2024-09-12T18:36:14.868686+0000","last_became_active":"2024-09-12T17:10:30.352353+0000","last_became_peered":"2024-09-12T17:10:30.352353+0000","last_unstale":"2024-09-12T18:36:14.868686+0000","last_undegraded":"2024-09-12T18:36:14.868686+0000","last_fullsized":"2024-09-12T18:36:14.868686+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'356","last_scrub_stamp":"2024-09-12T18:36:14.868477+0000","last_deep_scrub":"268'356","last_deep_scrub_stamp":"2024-09-12T18:36:14.868477+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.868477+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:59.665480+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267294,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":541,"num_read_kb":44546,"num_write":1186,"num_write_kb":40457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'444","reported_seq":1997,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.878506+0000","last_change":"2024-09-12T18:36:16.878506+0000","last_active":"2024-09-12T18:36:16.878506+0000","last_peered":"2024-09-12T18:36:16.878506+0000","last_clean":"2024-09-12T18:36:16.878506+0000","last_became_active":"2024-09-12T17:10:32.378659+0000","last_became_peered":"2024-09-12T17:10:32.378659+0000","last_unstale":"2024-09-12T18:36:16.878506+0000","last_undegraded":"2024-09-12T18:36:16.878506+0000","last_fullsized":"2024-09-12T18:36:16.878506+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'444","last_scrub_stamp":"2024-09-12T18:36:16.878330+0000","last_deep_scrub":"268'444","last_deep_scrub_stamp":"2024-09-12T18:36:16.878330+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.878330+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:57.042518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2290,"num_read_kb":2161,"num_write":510,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1009,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'375","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.615620+0000","last_change":"2024-09-12T18:36:11.615620+0000","last_active":"2024-09-12T18:36:11.615620+0000","last_peered":"2024-09-12T18:36:11.615620+0000","last_clean":"2024-09-12T18:36:11.615620+0000","last_became_active":"2024-09-12T17:11:04.868302+0000","last_became_peered":"2024-09-12T17:11:04.868302+0000","last_unstale":"2024-09-12T18:36:11.615620+0000","last_undegraded":"2024-09-12T18:36:11.615620+0000","last_fullsized":"2024-09-12T18:36:11.615620+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'375","last_scrub_stamp":"2024-09-12T18:36:11.615367+0000","last_deep_scrub":"268'375","last_deep_scrub_stamp":"2024-09-12T18:36:11.615367+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.615367+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:50.353013+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194362,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":35312,"num_write":1211,"num_write_kb":68294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'522","reported_seq":2253,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.780273+0000","last_change":"2024-09-12T18:36:23.780273+0000","last_active":"2024-09-12T18:36:23.780273+0000","last_peered":"2024-09-12T18:36:23.780273+0000","last_clean":"2024-09-12T18:36:23.780273+0000","last_became_active":"2024-09-12T17:10:32.382841+0000","last_became_peered":"2024-09-12T17:10:32.382841+0000","last_unstale":"2024-09-12T18:36:23.780273+0000","last_undegraded":"2024-09-12T18:36:23.780273+0000","last_fullsized":"2024-09-12T18:36:23.780273+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'522","last_scrub_stamp":"2024-09-12T18:36:23.780095+0000","last_deep_scrub":"268'522","last_deep_scrub_stamp":"2024-09-12T18:36:23.780095+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.780095+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:34.659271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2888,"num_read_kb":2690,"num_write":642,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'320","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.931640+0000","last_change":"2024-09-12T18:36:09.931640+0000","last_active":"2024-09-12T18:36:09.931640+0000","last_peered":"2024-09-12T18:36:09.931640+0000","last_clean":"2024-09-12T18:36:09.931640+0000","last_became_active":"2024-09-12T17:11:04.373103+0000","last_became_peered":"2024-09-12T17:11:04.373103+0000","last_unstale":"2024-09-12T18:36:09.931640+0000","last_undegraded":"2024-09-12T18:36:09.931640+0000","last_fullsized":"2024-09-12T18:36:09.931640+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-09-12T18:36:09.931398+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-09-12T18:36:09.931398+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.931398+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:02.232474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":30230,"num_write":1056,"num_write_kb":31529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'447","reported_seq":2081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.977845+0000","last_change":"2024-09-12T18:36:23.977845+0000","last_active":"2024-09-12T18:36:23.977845+0000","last_peered":"2024-09-12T18:36:23.977845+0000","last_clean":"2024-09-12T18:36:23.977845+0000","last_became_active":"2024-09-12T17:10:32.370112+0000","last_became_peered":"2024-09-12T17:10:32.370112+0000","last_unstale":"2024-09-12T18:36:23.977845+0000","last_undegraded":"2024-09-12T18:36:23.977845+0000","last_fullsized":"2024-09-12T18:36:23.977845+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'447","last_scrub_stamp":"2024-09-12T18:36:23.977770+0000","last_deep_scrub":"268'447","last_deep_scrub_stamp":"2024-09-12T18:36:23.977770+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.977770+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:57.025220+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2345,"num_read_kb":2230,"num_write":501,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'371","reported_seq":1070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.914493+0000","last_change":"2024-09-12T18:36:10.914493+0000","last_active":"2024-09-12T18:36:10.914493+0000","last_peered":"2024-09-12T18:36:10.914493+0000","last_clean":"2024-09-12T18:36:10.914493+0000","last_became_active":"2024-09-12T17:10:30.348702+0000","last_became_peered":"2024-09-12T17:10:30.348702+0000","last_unstale":"2024-09-12T18:36:10.914493+0000","last_undegraded":"2024-09-12T18:36:10.914493+0000","last_fullsized":"2024-09-12T18:36:10.914493+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'371","last_scrub_stamp":"2024-09-12T18:36:10.914266+0000","last_deep_scrub":"268'371","last_deep_scrub_stamp":"2024-09-12T18:36:10.914266+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.914266+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:47.453636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310621,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":552,"num_read_kb":10243,"num_write":1254,"num_write_kb":63527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'740","reported_seq":2634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.739616+0000","last_change":"2024-09-12T18:36:22.739616+0000","last_active":"2024-09-12T18:36:22.739616+0000","last_peered":"2024-09-12T18:36:22.739616+0000","last_clean":"2024-09-12T18:36:22.739616+0000","last_became_active":"2024-09-12T17:10:32.371017+0000","last_became_peered":"2024-09-12T17:10:32.371017+0000","last_unstale":"2024-09-12T18:36:22.739616+0000","last_undegraded":"2024-09-12T18:36:22.739616+0000","last_fullsized":"2024-09-12T18:36:22.739616+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'740","last_scrub_stamp":"2024-09-12T18:36:22.739504+0000","last_deep_scrub":"268'740","last_deep_scrub_stamp":"2024-09-12T18:36:22.739504+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.739504+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:07.137813+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4018,"num_read_kb":3683,"num_write":976,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'331","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.196685+0000","last_change":"2024-09-12T18:36:10.196685+0000","last_active":"2024-09-12T18:36:10.196685+0000","last_peered":"2024-09-12T18:36:10.196685+0000","last_clean":"2024-09-12T18:36:10.196685+0000","last_became_active":"2024-09-12T17:10:30.396958+0000","last_became_peered":"2024-09-12T17:10:30.396958+0000","last_unstale":"2024-09-12T18:36:10.196685+0000","last_undegraded":"2024-09-12T18:36:10.196685+0000","last_fullsized":"2024-09-12T18:36:10.196685+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'331","last_scrub_stamp":"2024-09-12T18:36:10.196408+0000","last_deep_scrub":"268'331","last_deep_scrub_stamp":"2024-09-12T18:36:10.196408+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.196408+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:20.172679+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9953582,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":23680,"num_write":1025,"num_write_kb":41122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'721","reported_seq":2427,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.096925+0000","last_change":"2024-09-12T18:36:15.096925+0000","last_active":"2024-09-12T18:36:15.096925+0000","last_peered":"2024-09-12T18:36:15.096925+0000","last_clean":"2024-09-12T18:36:15.096925+0000","last_became_active":"2024-09-12T17:10:32.348200+0000","last_became_peered":"2024-09-12T17:10:32.348200+0000","last_unstale":"2024-09-12T18:36:15.096925+0000","last_undegraded":"2024-09-12T18:36:15.096925+0000","last_fullsized":"2024-09-12T18:36:15.096925+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'721","last_scrub_stamp":"2024-09-12T18:36:15.096745+0000","last_deep_scrub":"268'721","last_deep_scrub_stamp":"2024-09-12T18:36:15.096745+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.096745+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:45.902234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3587,"num_read_kb":3235,"num_write":983,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'407","reported_seq":1111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.863524+0000","last_change":"2024-09-12T18:36:13.863524+0000","last_active":"2024-09-12T18:36:13.863524+0000","last_peered":"2024-09-12T18:36:13.863524+0000","last_clean":"2024-09-12T18:36:13.863524+0000","last_became_active":"2024-09-12T17:10:30.370015+0000","last_became_peered":"2024-09-12T17:10:30.370015+0000","last_unstale":"2024-09-12T18:36:13.863524+0000","last_undegraded":"2024-09-12T18:36:13.863524+0000","last_fullsized":"2024-09-12T18:36:13.863524+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'407","last_scrub_stamp":"2024-09-12T18:36:13.863264+0000","last_deep_scrub":"268'407","last_deep_scrub_stamp":"2024-09-12T18:36:13.863264+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.863264+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:26.107432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399128,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":575,"num_read_kb":40389,"num_write":1181,"num_write_kb":51606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'836","reported_seq":2478,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.547033+0000","last_change":"2024-09-12T18:36:19.547033+0000","last_active":"2024-09-12T18:36:19.547033+0000","last_peered":"2024-09-12T18:36:19.547033+0000","last_clean":"2024-09-12T18:36:19.547033+0000","last_became_active":"2024-09-12T17:10:32.348842+0000","last_became_peered":"2024-09-12T17:10:32.348842+0000","last_unstale":"2024-09-12T18:36:19.547033+0000","last_undegraded":"2024-09-12T18:36:19.547033+0000","last_fullsized":"2024-09-12T18:36:19.547033+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'836","last_scrub_stamp":"2024-09-12T18:36:19.546818+0000","last_deep_scrub":"268'836","last_deep_scrub_stamp":"2024-09-12T18:36:19.546818+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.546818+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:47.788325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4030,"num_read_kb":3642,"num_write":1104,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'317","reported_seq":977,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.921361+0000","last_change":"2024-09-12T18:36:15.921361+0000","last_active":"2024-09-12T18:36:15.921361+0000","last_peered":"2024-09-12T18:36:15.921361+0000","last_clean":"2024-09-12T18:36:15.921361+0000","last_became_active":"2024-09-12T17:10:30.349523+0000","last_became_peered":"2024-09-12T17:10:30.349523+0000","last_unstale":"2024-09-12T18:36:15.921361+0000","last_undegraded":"2024-09-12T18:36:15.921361+0000","last_fullsized":"2024-09-12T18:36:15.921361+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'317","last_scrub_stamp":"2024-09-12T18:36:15.921079+0000","last_deep_scrub":"268'317","last_deep_scrub_stamp":"2024-09-12T18:36:15.921079+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.921079+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:36.009620+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456505,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":103976,"num_write":995,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'522","reported_seq":2361,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.976891+0000","last_change":"2024-09-12T18:36:19.976891+0000","last_active":"2024-09-12T18:36:19.976891+0000","last_peered":"2024-09-12T18:36:19.976891+0000","last_clean":"2024-09-12T18:36:19.976891+0000","last_became_active":"2024-09-12T17:10:32.362881+0000","last_became_peered":"2024-09-12T17:10:32.362881+0000","last_unstale":"2024-09-12T18:36:19.976891+0000","last_undegraded":"2024-09-12T18:36:19.976891+0000","last_fullsized":"2024-09-12T18:36:19.976891+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'522","last_scrub_stamp":"2024-09-12T18:36:19.976700+0000","last_deep_scrub":"268'522","last_deep_scrub_stamp":"2024-09-12T18:36:19.976700+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.976700+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:14.830945+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2930,"num_read_kb":2778,"num_write":610,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'363","reported_seq":1059,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.900511+0000","last_change":"2024-09-12T18:36:12.900511+0000","last_active":"2024-09-12T18:36:12.900511+0000","last_peered":"2024-09-12T18:36:12.900511+0000","last_clean":"2024-09-12T18:36:12.900511+0000","last_became_active":"2024-09-12T17:10:30.378766+0000","last_became_peered":"2024-09-12T17:10:30.378766+0000","last_unstale":"2024-09-12T18:36:12.900511+0000","last_undegraded":"2024-09-12T18:36:12.900511+0000","last_fullsized":"2024-09-12T18:36:12.900511+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-12T18:36:12.900085+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-12T18:36:12.900085+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.900085+0000","objects_scrubbed":6,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:24.060613+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102155,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":26410,"num_write":1209,"num_write_kb":29487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'526","reported_seq":2184,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.396356+0000","last_change":"2024-09-12T18:36:14.396208+0000","last_active":"2024-09-12T18:36:14.396356+0000","last_peered":"2024-09-12T18:36:14.396356+0000","last_clean":"2024-09-12T18:36:14.396356+0000","last_became_active":"2024-09-12T17:10:32.341480+0000","last_became_peered":"2024-09-12T17:10:32.341480+0000","last_unstale":"2024-09-12T18:36:14.396356+0000","last_undegraded":"2024-09-12T18:36:14.396356+0000","last_fullsized":"2024-09-12T18:36:14.396356+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'526","last_scrub_stamp":"2024-09-12T18:36:14.396018+0000","last_deep_scrub":"268'526","last_deep_scrub_stamp":"2024-09-12T18:36:14.396018+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.396018+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:55.035930+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2856,"num_read_kb":2663,"num_write":671,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'349","reported_seq":1107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.956802+0000","last_change":"2024-09-12T18:36:16.956802+0000","last_active":"2024-09-12T18:36:16.956802+0000","last_peered":"2024-09-12T18:36:16.956802+0000","last_clean":"2024-09-12T18:36:16.956802+0000","last_became_active":"2024-09-12T17:10:30.404567+0000","last_became_peered":"2024-09-12T17:10:30.404567+0000","last_unstale":"2024-09-12T18:36:16.956802+0000","last_undegraded":"2024-09-12T18:36:16.956802+0000","last_fullsized":"2024-09-12T18:36:16.956802+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-12T18:36:16.956584+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-12T18:36:16.956584+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.956584+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:29.404555+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":789,"num_read_kb":46887,"num_write":1083,"num_write_kb":42596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'381","reported_seq":1788,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.997849+0000","last_change":"2024-09-12T18:36:20.997849+0000","last_active":"2024-09-12T18:36:20.997849+0000","last_peered":"2024-09-12T18:36:20.997849+0000","last_clean":"2024-09-12T18:36:20.997849+0000","last_became_active":"2024-09-12T17:10:32.370799+0000","last_became_peered":"2024-09-12T17:10:32.370799+0000","last_unstale":"2024-09-12T18:36:20.997849+0000","last_undegraded":"2024-09-12T18:36:20.997849+0000","last_fullsized":"2024-09-12T18:36:20.997849+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'381","last_scrub_stamp":"2024-09-12T18:36:20.997632+0000","last_deep_scrub":"268'381","last_deep_scrub_stamp":"2024-09-12T18:36:20.997632+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.997632+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:50.639762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2049,"num_read_kb":1938,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'327","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.593784+0000","last_change":"2024-09-12T18:36:14.593784+0000","last_active":"2024-09-12T18:36:14.593784+0000","last_peered":"2024-09-12T18:36:14.593784+0000","last_clean":"2024-09-12T18:36:14.593784+0000","last_became_active":"2024-09-12T17:10:30.374689+0000","last_became_peered":"2024-09-12T17:10:30.374689+0000","last_unstale":"2024-09-12T18:36:14.593784+0000","last_undegraded":"2024-09-12T18:36:14.593784+0000","last_fullsized":"2024-09-12T18:36:14.593784+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'327","last_scrub_stamp":"2024-09-12T18:36:14.593513+0000","last_deep_scrub":"268'327","last_deep_scrub_stamp":"2024-09-12T18:36:14.593513+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.593513+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:28.532832+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7813717,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":410,"num_read_kb":28127,"num_write":1070,"num_write_kb":52007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1587","reported_seq":3075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.983176+0000","last_change":"2024-09-12T18:36:21.983176+0000","last_active":"2024-09-12T18:36:21.983176+0000","last_peered":"2024-09-12T18:36:21.983176+0000","last_clean":"2024-09-12T18:36:21.983176+0000","last_became_active":"2024-09-12T17:10:32.384842+0000","last_became_peered":"2024-09-12T17:10:32.384842+0000","last_unstale":"2024-09-12T18:36:21.983176+0000","last_undegraded":"2024-09-12T18:36:21.983176+0000","last_fullsized":"2024-09-12T18:36:21.983176+0000","mapping_epoch":27,"log_start":"268'1500","ondisk_log_start":"268'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1587","last_scrub_stamp":"2024-09-12T18:36:21.982944+0000","last_deep_scrub":"268'1587","last_deep_scrub_stamp":"2024-09-12T18:36:21.982944+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.982944+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":1500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:29.105970+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6992,"num_read_kb":6083,"num_write":2272,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1264,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'489","reported_seq":1308,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.175743+0000","last_change":"2024-09-12T18:36:11.175743+0000","last_active":"2024-09-12T18:36:11.175743+0000","last_peered":"2024-09-12T18:36:11.175743+0000","last_clean":"2024-09-12T18:36:11.175743+0000","last_became_active":"2024-09-12T17:12:05.372879+0000","last_became_peered":"2024-09-12T17:12:05.372879+0000","last_unstale":"2024-09-12T18:36:11.175743+0000","last_undegraded":"2024-09-12T18:36:11.175743+0000","last_fullsized":"2024-09-12T18:36:11.175743+0000","mapping_epoch":40,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'489","last_scrub_stamp":"2024-09-12T18:36:11.175471+0000","last_deep_scrub":"268'489","last_deep_scrub_stamp":"2024-09-12T18:36:11.175471+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.175471+0000","objects_scrubbed":6,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:34.394103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":953,"num_read_kb":72647,"num_write":1674,"num_write_kb":47468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,0],"acting":[6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'1144","reported_seq":2659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.593697+0000","last_change":"2024-09-12T18:36:22.593697+0000","last_active":"2024-09-12T18:36:22.593697+0000","last_peered":"2024-09-12T18:36:22.593697+0000","last_clean":"2024-09-12T18:36:22.593697+0000","last_became_active":"2024-09-12T17:10:32.361416+0000","last_became_peered":"2024-09-12T17:10:32.361416+0000","last_unstale":"2024-09-12T18:36:22.593697+0000","last_undegraded":"2024-09-12T18:36:22.593697+0000","last_fullsized":"2024-09-12T18:36:22.593697+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1144","last_scrub_stamp":"2024-09-12T18:36:22.593502+0000","last_deep_scrub":"268'1144","last_deep_scrub_stamp":"2024-09-12T18:36:22.593502+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.593502+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":1100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:36.821997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5102,"num_read_kb":4502,"num_write":1588,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'428","reported_seq":1230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.909977+0000","last_change":"2024-09-12T18:36:19.909819+0000","last_active":"2024-09-12T18:36:19.909977+0000","last_peered":"2024-09-12T18:36:19.909977+0000","last_clean":"2024-09-12T18:36:19.909977+0000","last_became_active":"2024-09-12T17:10:30.404403+0000","last_became_peered":"2024-09-12T17:10:30.404403+0000","last_unstale":"2024-09-12T18:36:19.909977+0000","last_undegraded":"2024-09-12T18:36:19.909977+0000","last_fullsized":"2024-09-12T18:36:19.909977+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'428","last_scrub_stamp":"2024-09-12T18:36:19.909576+0000","last_deep_scrub":"268'428","last_deep_scrub_stamp":"2024-09-12T18:36:19.909576+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.909576+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:04.500862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":773,"num_read_kb":38616,"num_write":1272,"num_write_kb":36952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'394","reported_seq":1959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.746611+0000","last_change":"2024-09-12T18:36:25.746611+0000","last_active":"2024-09-12T18:36:25.746611+0000","last_peered":"2024-09-12T18:36:25.746611+0000","last_clean":"2024-09-12T18:36:25.746611+0000","last_became_active":"2024-09-12T17:10:32.352916+0000","last_became_peered":"2024-09-12T17:10:32.352916+0000","last_unstale":"2024-09-12T18:36:25.746611+0000","last_undegraded":"2024-09-12T18:36:25.746611+0000","last_fullsized":"2024-09-12T18:36:25.746611+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T18:36:25.746401+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T18:36:25.746401+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.746401+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:50.410716+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2283,"num_read_kb":2176,"num_write":460,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3055,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'343","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.345942+0000","last_change":"2024-09-12T18:36:09.345942+0000","last_active":"2024-09-12T18:36:09.345942+0000","last_peered":"2024-09-12T18:36:09.345942+0000","last_clean":"2024-09-12T18:36:09.345942+0000","last_became_active":"2024-09-12T17:10:30.402024+0000","last_became_peered":"2024-09-12T17:10:30.402024+0000","last_unstale":"2024-09-12T18:36:09.345942+0000","last_undegraded":"2024-09-12T18:36:09.345942+0000","last_fullsized":"2024-09-12T18:36:09.345942+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'343","last_scrub_stamp":"2024-09-12T18:36:09.345594+0000","last_deep_scrub":"268'343","last_deep_scrub_stamp":"2024-09-12T18:36:09.345594+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.345594+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:30.257704+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048602,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":454,"num_read_kb":33472,"num_write":1006,"num_write_kb":44244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'833","reported_seq":2409,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.932561+0000","last_change":"2024-09-12T18:36:25.932561+0000","last_active":"2024-09-12T18:36:25.932561+0000","last_peered":"2024-09-12T18:36:25.932561+0000","last_clean":"2024-09-12T18:36:25.932561+0000","last_became_active":"2024-09-12T17:10:32.375891+0000","last_became_peered":"2024-09-12T17:10:32.375891+0000","last_unstale":"2024-09-12T18:36:25.932561+0000","last_undegraded":"2024-09-12T18:36:25.932561+0000","last_fullsized":"2024-09-12T18:36:25.932561+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'833","last_scrub_stamp":"2024-09-12T18:36:25.932381+0000","last_deep_scrub":"268'833","last_deep_scrub_stamp":"2024-09-12T18:36:25.932381+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.932381+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:14.640927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3808,"num_read_kb":3437,"num_write":1089,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'407","reported_seq":1137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.991189+0000","last_change":"2024-09-12T18:36:17.991189+0000","last_active":"2024-09-12T18:36:17.991189+0000","last_peered":"2024-09-12T18:36:17.991189+0000","last_clean":"2024-09-12T18:36:17.991189+0000","last_became_active":"2024-09-12T17:10:30.378109+0000","last_became_peered":"2024-09-12T17:10:30.378109+0000","last_unstale":"2024-09-12T18:36:17.991189+0000","last_undegraded":"2024-09-12T18:36:17.991189+0000","last_fullsized":"2024-09-12T18:36:17.991189+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'407","last_scrub_stamp":"2024-09-12T18:36:17.990804+0000","last_deep_scrub":"268'407","last_deep_scrub_stamp":"2024-09-12T18:36:17.990804+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.990804+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:07.244535+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505043,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":645,"num_read_kb":82540,"num_write":1282,"num_write_kb":46419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'405","reported_seq":1092,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.986000+0000","last_change":"2024-09-12T18:36:19.986000+0000","last_active":"2024-09-12T18:36:19.986000+0000","last_peered":"2024-09-12T18:36:19.986000+0000","last_clean":"2024-09-12T18:36:19.986000+0000","last_became_active":"2024-09-12T17:10:30.356199+0000","last_became_peered":"2024-09-12T17:10:30.356199+0000","last_unstale":"2024-09-12T18:36:19.986000+0000","last_undegraded":"2024-09-12T18:36:19.986000+0000","last_fullsized":"2024-09-12T18:36:19.986000+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'405","last_scrub_stamp":"2024-09-12T18:36:19.985773+0000","last_deep_scrub":"268'405","last_deep_scrub_stamp":"2024-09-12T18:36:19.985773+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.985773+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:53.434690+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4401467,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":595,"num_read_kb":25748,"num_write":1241,"num_write_kb":44098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'463","reported_seq":2259,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.568220+0000","last_change":"2024-09-12T18:36:20.568220+0000","last_active":"2024-09-12T18:36:20.568220+0000","last_peered":"2024-09-12T18:36:20.568220+0000","last_clean":"2024-09-12T18:36:20.568220+0000","last_became_active":"2024-09-12T17:10:32.349687+0000","last_became_peered":"2024-09-12T17:10:32.349687+0000","last_unstale":"2024-09-12T18:36:20.568220+0000","last_undegraded":"2024-09-12T18:36:20.568220+0000","last_fullsized":"2024-09-12T18:36:20.568220+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'463","last_scrub_stamp":"2024-09-12T18:36:20.568016+0000","last_deep_scrub":"268'463","last_deep_scrub_stamp":"2024-09-12T18:36:20.568016+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.568016+0000","objects_scrubbed":6,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:18.504326+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2918,"num_read_kb":2789,"num_write":551,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'377","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.921872+0000","last_change":"2024-09-12T18:36:11.921872+0000","last_active":"2024-09-12T18:36:11.921872+0000","last_peered":"2024-09-12T18:36:11.921872+0000","last_clean":"2024-09-12T18:36:11.921872+0000","last_became_active":"2024-09-12T17:11:05.121473+0000","last_became_peered":"2024-09-12T17:11:05.121473+0000","last_unstale":"2024-09-12T18:36:11.921872+0000","last_undegraded":"2024-09-12T18:36:11.921872+0000","last_fullsized":"2024-09-12T18:36:11.921872+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'377","last_scrub_stamp":"2024-09-12T18:36:11.921663+0000","last_deep_scrub":"268'377","last_deep_scrub_stamp":"2024-09-12T18:36:11.921663+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.921663+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:06.622722+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574022,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":29048,"num_write":1222,"num_write_kb":43104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'469","reported_seq":1973,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.000255+0000","last_change":"2024-09-12T18:36:26.000255+0000","last_active":"2024-09-12T18:36:26.000255+0000","last_peered":"2024-09-12T18:36:26.000255+0000","last_clean":"2024-09-12T18:36:26.000255+0000","last_became_active":"2024-09-12T17:10:32.352369+0000","last_became_peered":"2024-09-12T17:10:32.352369+0000","last_unstale":"2024-09-12T18:36:26.000255+0000","last_undegraded":"2024-09-12T18:36:26.000255+0000","last_fullsized":"2024-09-12T18:36:26.000255+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'469","last_scrub_stamp":"2024-09-12T18:36:25.999980+0000","last_deep_scrub":"268'469","last_deep_scrub_stamp":"2024-09-12T18:36:25.999980+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.999980+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:32.160700+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2354,"num_read_kb":2191,"num_write":554,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6108,"num_read_kb":4244,"num_write":1960,"num_write_kb":858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3486,"num_omap_keys":7,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1132,"ondisk_log_size":1132,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":16274,"num_read_kb":15945,"num_write":16744,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1677,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1756,"ondisk_log_size":1756,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":736,"ondisk_log_size":736,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1625724,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":19494,"num_read_kb":40096,"num_write":16267,"num_write_kb":12112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":686274,"num_omap_keys":1572,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1932,"ondisk_log_size":1932,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":213001,"num_read_kb":194600,"num_write":55405,"num_write_kb":18906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44604,"num_omap_keys":180,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3841,"ondisk_log_size":3841,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":165322276,"num_objects":398,"num_object_clones":0,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":0,"num_read":36558,"num_read_kb":2308341,"num_write":72533,"num_write_kb":2504748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":249851904,"data_stored":249851904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3895,"ondisk_log_size":3895,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":159116,"num_write":182,"num_write_kb":116497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":158495,"num_write":182,"num_write_kb":116497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510482,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":340376,"kb_used_data":52360,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94031464,"statfs":{"total":96636764160,"available":96288219136,"internally_reserved":0,"allocated":53616640,"data_stored":51463722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":294910410},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510486,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299236,"kb_used_data":33428,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94072604,"statfs":{"total":96636764160,"available":96330346496,"internally_reserved":0,"allocated":34230272,"data_stored":32143073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":272169414},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510483,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":178948,"kb_used_data":31220,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94192892,"statfs":{"total":96636764160,"available":96453521408,"internally_reserved":0,"allocated":31969280,"data_stored":29799186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510485,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":135104,"kb_used_data":23408,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94236736,"statfs":{"total":96636764160,"available":96498417664,"internally_reserved":0,"allocated":23969792,"data_stored":21888023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510486,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209668,"kb_used_data":25844,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94162172,"statfs":{"total":96636764160,"available":96422064128,"internally_reserved":0,"allocated":26464256,"data_stored":24357991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510483,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302280,"kb_used_data":36472,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94069560,"statfs":{"total":96636764160,"available":96327229440,"internally_reserved":0,"allocated":37347328,"data_stored":35205199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":272169414},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543189,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139540,"kb_used_data":40324,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94232300,"statfs":{"total":96636764160,"available":96493875200,"internally_reserved":0,"allocated":41291776,"data_stored":39213361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575890,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320580,"kb_used_data":36724,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94051260,"statfs":{"total":96636764160,"available":96308490240,"internally_reserved":0,"allocated":37605376,"data_stored":35472167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32301056,"data_stored":32301056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22044672,"data_stored":22044672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19574784,"data_stored":19574784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33157120,"data_stored":33157120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36900864,"data_stored":36900864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":27484160,"data_stored":27484160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29831168,"data_stored":29831168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":48558080,"data_stored":48558080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:36:49.633 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.633 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.633 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.633 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.633 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.634 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.634 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.634 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.634 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.634 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.634 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.634 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.634 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.635 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.635 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.635 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.635 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.635 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.635 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.635 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.635 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.636 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.636 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.636 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.636 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.636 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.636 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.636 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.636 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.637 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.637 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.637 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.637 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.637 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.637 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.637 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.637 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.638 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.638 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.638 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.638 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.638 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.639 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.639 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.639 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.639 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.640 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.640 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.640 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.640 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.640 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.640 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.640 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.640 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.640 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.641 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.641 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.641 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.641 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.641 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.642 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.642 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.642 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.642 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.642 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.642 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.642 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.642 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.643 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:27:31.521239+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.643 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.643 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.643 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.643 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.643 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.643 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.643 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.643 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.644 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.644 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.644 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.644 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:31:11.046245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.644 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.644 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.645 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.646 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.646 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.647 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.647 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:10:39.371713+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:36:49.648 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:37:09.649 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:37:10.012 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:37:10.023 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T18:37:10.030 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":2869,"stamp":"2024-09-12T18:37:08.891511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":167556499,"num_objects":881,"num_object_clones":0,"num_object_copies":2160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":881,"num_whiteouts":0,"num_read":294260,"num_read_kb":2883804,"num_write":163416,"num_write_kb":2776168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":213,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":741710,"num_omap_keys":1795,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13655,"ondisk_log_size":13655,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1925732,"kb_used_data":279780,"kb_used_omap":12,"kb_used_meta":1645811,"kb_avail":753048988,"statfs":{"total":773094113280,"available":771122163712,"internally_reserved":0,"allocated":286494720,"data_stored":269542722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1685311025},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009327"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:55.761427+0000","last_change":"2024-09-12T18:36:55.761427+0000","last_active":"2024-09-12T18:36:55.761427+0000","last_peered":"2024-09-12T18:36:55.761427+0000","last_clean":"2024-09-12T18:36:55.761427+0000","last_became_active":"2024-09-12T17:53:27.146780+0000","last_became_peered":"2024-09-12T17:53:27.146780+0000","last_unstale":"2024-09-12T18:36:55.761427+0000","last_undegraded":"2024-09-12T18:36:55.761427+0000","last_fullsized":"2024-09-12T18:36:55.761427+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:55.761246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:55.761246+0000","last_clean_scrub_stamp":"2024-09-12T18:36:55.761246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:06.414728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"268'11","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:52.717374+0000","last_change":"2024-09-12T18:36:52.717374+0000","last_active":"2024-09-12T18:36:52.717374+0000","last_peered":"2024-09-12T18:36:52.717374+0000","last_clean":"2024-09-12T18:36:52.717374+0000","last_became_active":"2024-09-12T17:31:16.245482+0000","last_became_peered":"2024-09-12T17:31:16.245482+0000","last_unstale":"2024-09-12T18:36:52.717374+0000","last_undegraded":"2024-09-12T18:36:52.717374+0000","last_fullsized":"2024-09-12T18:36:52.717374+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'11","last_scrub_stamp":"2024-09-12T18:36:52.717187+0000","last_deep_scrub":"268'11","last_deep_scrub_stamp":"2024-09-12T18:36:52.717187+0000","last_clean_scrub_stamp":"2024-09-12T18:36:52.717187+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:46.599351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5245,"num_write":16,"num_write_kb":2121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:55.856834+0000","last_change":"2024-09-12T18:36:55.856834+0000","last_active":"2024-09-12T18:36:55.856834+0000","last_peered":"2024-09-12T18:36:55.856834+0000","last_clean":"2024-09-12T18:36:55.856834+0000","last_became_active":"2024-09-12T17:31:12.094935+0000","last_became_peered":"2024-09-12T17:31:12.094935+0000","last_unstale":"2024-09-12T18:36:55.856834+0000","last_undegraded":"2024-09-12T18:36:55.856834+0000","last_fullsized":"2024-09-12T18:36:55.856834+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:36:55.856642+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:36:55.856642+0000","last_clean_scrub_stamp":"2024-09-12T18:36:55.856642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:22.785398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'30","reported_seq":152,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:53.973957+0000","last_change":"2024-09-12T18:36:53.973957+0000","last_active":"2024-09-12T18:36:53.973957+0000","last_peered":"2024-09-12T18:36:53.973957+0000","last_clean":"2024-09-12T18:36:53.973957+0000","last_became_active":"2024-09-12T17:27:32.583903+0000","last_became_peered":"2024-09-12T17:27:32.583903+0000","last_unstale":"2024-09-12T18:36:53.973957+0000","last_undegraded":"2024-09-12T18:36:53.973957+0000","last_fullsized":"2024-09-12T18:36:53.973957+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-12T18:36:53.973711+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-12T18:36:53.973711+0000","last_clean_scrub_stamp":"2024-09-12T18:36:53.973711+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:05.725948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":98,"num_write":57,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.331440+0000","last_change":"2024-09-12T18:36:38.331440+0000","last_active":"2024-09-12T18:36:38.331440+0000","last_peered":"2024-09-12T18:36:38.331440+0000","last_clean":"2024-09-12T18:36:38.331440+0000","last_became_active":"2024-09-12T17:53:27.167810+0000","last_became_peered":"2024-09-12T17:53:27.167810+0000","last_unstale":"2024-09-12T18:36:38.331440+0000","last_undegraded":"2024-09-12T18:36:38.331440+0000","last_fullsized":"2024-09-12T18:36:38.331440+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:38.331269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:38.331269+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.331269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:08.481081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'7","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:54.686861+0000","last_change":"2024-09-12T18:36:54.686861+0000","last_active":"2024-09-12T18:36:54.686861+0000","last_peered":"2024-09-12T18:36:54.686861+0000","last_clean":"2024-09-12T18:36:54.686861+0000","last_became_active":"2024-09-12T17:31:16.237721+0000","last_became_peered":"2024-09-12T17:31:16.237721+0000","last_unstale":"2024-09-12T18:36:54.686861+0000","last_undegraded":"2024-09-12T18:36:54.686861+0000","last_fullsized":"2024-09-12T18:36:54.686861+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T18:36:54.686681+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T18:36:54.686681+0000","last_clean_scrub_stamp":"2024-09-12T18:36:54.686681+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:00.615927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'2","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.813987+0000","last_change":"2024-09-12T18:36:32.813987+0000","last_active":"2024-09-12T18:36:32.813987+0000","last_peered":"2024-09-12T18:36:32.813987+0000","last_clean":"2024-09-12T18:36:32.813987+0000","last_became_active":"2024-09-12T17:31:12.105548+0000","last_became_peered":"2024-09-12T17:31:12.105548+0000","last_unstale":"2024-09-12T18:36:32.813987+0000","last_undegraded":"2024-09-12T18:36:32.813987+0000","last_fullsized":"2024-09-12T18:36:32.813987+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:36:32.813796+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:36:32.813796+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.813796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:48.755340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'16","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.518979+0000","last_change":"2024-09-12T18:36:30.518979+0000","last_active":"2024-09-12T18:36:30.518979+0000","last_peered":"2024-09-12T18:36:30.518979+0000","last_clean":"2024-09-12T18:36:30.518979+0000","last_became_active":"2024-09-12T17:27:32.563281+0000","last_became_peered":"2024-09-12T17:27:32.563281+0000","last_unstale":"2024-09-12T18:36:30.518979+0000","last_undegraded":"2024-09-12T18:36:30.518979+0000","last_fullsized":"2024-09-12T18:36:30.518979+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-09-12T18:36:30.518795+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-09-12T18:36:30.518795+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.518795+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:53.495286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.190979+0000","last_change":"2024-09-12T18:36:43.190836+0000","last_active":"2024-09-12T18:36:43.190979+0000","last_peered":"2024-09-12T18:36:43.190979+0000","last_clean":"2024-09-12T18:36:43.190979+0000","last_became_active":"2024-09-12T17:53:27.143812+0000","last_became_peered":"2024-09-12T17:53:27.143812+0000","last_unstale":"2024-09-12T18:36:43.190979+0000","last_undegraded":"2024-09-12T18:36:43.190979+0000","last_fullsized":"2024-09-12T18:36:43.190979+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:43.190659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:43.190659+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.190659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:00.740038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:01.988492+0000","last_change":"2024-09-12T18:37:01.988492+0000","last_active":"2024-09-12T18:37:01.988492+0000","last_peered":"2024-09-12T18:37:01.988492+0000","last_clean":"2024-09-12T18:37:01.988492+0000","last_became_active":"2024-09-12T17:31:16.208994+0000","last_became_peered":"2024-09-12T17:31:16.208994+0000","last_unstale":"2024-09-12T18:37:01.988492+0000","last_undegraded":"2024-09-12T18:37:01.988492+0000","last_fullsized":"2024-09-12T18:37:01.988492+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:01.988306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:01.988306+0000","last_clean_scrub_stamp":"2024-09-12T18:37:01.988306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:32.291672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'15","reported_seq":94,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.418411+0000","last_change":"2024-09-12T18:36:35.418411+0000","last_active":"2024-09-12T18:36:35.418411+0000","last_peered":"2024-09-12T18:36:35.418411+0000","last_clean":"2024-09-12T18:36:35.418411+0000","last_became_active":"2024-09-12T17:31:12.090602+0000","last_became_peered":"2024-09-12T17:31:12.090602+0000","last_unstale":"2024-09-12T18:36:35.418411+0000","last_undegraded":"2024-09-12T18:36:35.418411+0000","last_fullsized":"2024-09-12T18:36:35.418411+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'15","last_scrub_stamp":"2024-09-12T18:36:35.418214+0000","last_deep_scrub":"268'15","last_deep_scrub_stamp":"2024-09-12T18:36:35.418214+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.418214+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:59.377552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10290,"num_write":20,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'40","reported_seq":175,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:49.845542+0000","last_change":"2024-09-12T18:36:49.845542+0000","last_active":"2024-09-12T18:36:49.845542+0000","last_peered":"2024-09-12T18:36:49.845542+0000","last_clean":"2024-09-12T18:36:49.845542+0000","last_became_active":"2024-09-12T17:27:32.554228+0000","last_became_peered":"2024-09-12T17:27:32.554228+0000","last_unstale":"2024-09-12T18:36:49.845542+0000","last_undegraded":"2024-09-12T18:36:49.845542+0000","last_fullsized":"2024-09-12T18:36:49.845542+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'40","last_scrub_stamp":"2024-09-12T18:36:49.845350+0000","last_deep_scrub":"268'40","last_deep_scrub_stamp":"2024-09-12T18:36:49.845350+0000","last_clean_scrub_stamp":"2024-09-12T18:36:49.845350+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:09.422732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":136,"num_write":75,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:32:19.399599+0000","last_change":"2024-09-12T17:53:27.171122+0000","last_active":"2024-09-12T18:32:19.399599+0000","last_peered":"2024-09-12T18:32:19.399599+0000","last_clean":"2024-09-12T18:32:19.399599+0000","last_became_active":"2024-09-12T17:53:27.165849+0000","last_became_peered":"2024-09-12T17:53:27.165849+0000","last_unstale":"2024-09-12T18:32:19.399599+0000","last_undegraded":"2024-09-12T18:32:19.399599+0000","last_fullsized":"2024-09-12T18:32:19.399599+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:27.566630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"268'7","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:35:34.443405+0000","last_change":"2024-09-12T17:31:16.234725+0000","last_active":"2024-09-12T18:35:34.443405+0000","last_peered":"2024-09-12T18:35:34.443405+0000","last_clean":"2024-09-12T18:35:34.443405+0000","last_became_active":"2024-09-12T17:31:16.233989+0000","last_became_peered":"2024-09-12T17:31:16.233989+0000","last_unstale":"2024-09-12T18:35:34.443405+0000","last_undegraded":"2024-09-12T18:35:34.443405+0000","last_fullsized":"2024-09-12T18:35:34.443405+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.166978+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.166978+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:22.667547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'10","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:49.717176+0000","last_change":"2024-09-12T18:36:49.717176+0000","last_active":"2024-09-12T18:36:49.717176+0000","last_peered":"2024-09-12T18:36:49.717176+0000","last_clean":"2024-09-12T18:36:49.717176+0000","last_became_active":"2024-09-12T17:31:12.076980+0000","last_became_peered":"2024-09-12T17:31:12.076980+0000","last_unstale":"2024-09-12T18:36:49.717176+0000","last_undegraded":"2024-09-12T18:36:49.717176+0000","last_fullsized":"2024-09-12T18:36:49.717176+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'10","last_scrub_stamp":"2024-09-12T18:36:49.716946+0000","last_deep_scrub":"268'10","last_deep_scrub_stamp":"2024-09-12T18:36:49.716946+0000","last_clean_scrub_stamp":"2024-09-12T18:36:49.716946+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:50.318674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11264,"num_write":20,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'22","reported_seq":131,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:54.903402+0000","last_change":"2024-09-12T18:36:54.903402+0000","last_active":"2024-09-12T18:36:54.903402+0000","last_peered":"2024-09-12T18:36:54.903402+0000","last_clean":"2024-09-12T18:36:54.903402+0000","last_became_active":"2024-09-12T17:27:32.597092+0000","last_became_peered":"2024-09-12T17:27:32.597092+0000","last_unstale":"2024-09-12T18:36:54.903402+0000","last_undegraded":"2024-09-12T18:36:54.903402+0000","last_fullsized":"2024-09-12T18:36:54.903402+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'22","last_scrub_stamp":"2024-09-12T18:36:54.903217+0000","last_deep_scrub":"268'22","last_deep_scrub_stamp":"2024-09-12T18:36:54.903217+0000","last_clean_scrub_stamp":"2024-09-12T18:36:54.903217+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:27.462006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":80,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:39.418737+0000","last_change":"2024-09-12T17:53:27.172827+0000","last_active":"2024-09-12T18:33:39.418737+0000","last_peered":"2024-09-12T18:33:39.418737+0000","last_clean":"2024-09-12T18:33:39.418737+0000","last_became_active":"2024-09-12T17:53:27.166248+0000","last_became_peered":"2024-09-12T17:53:27.166248+0000","last_unstale":"2024-09-12T18:33:39.418737+0000","last_undegraded":"2024-09-12T18:33:39.418737+0000","last_fullsized":"2024-09-12T18:33:39.418737+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:16.950414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:51.682423+0000","last_change":"2024-09-12T18:36:51.682423+0000","last_active":"2024-09-12T18:36:51.682423+0000","last_peered":"2024-09-12T18:36:51.682423+0000","last_clean":"2024-09-12T18:36:51.682423+0000","last_became_active":"2024-09-12T17:32:06.560465+0000","last_became_peered":"2024-09-12T17:32:06.560465+0000","last_unstale":"2024-09-12T18:36:51.682423+0000","last_undegraded":"2024-09-12T18:36:51.682423+0000","last_fullsized":"2024-09-12T18:36:51.682423+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:51.682229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:51.682229+0000","last_clean_scrub_stamp":"2024-09-12T18:36:51.682229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:16.365716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'8","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:54.925227+0000","last_change":"2024-09-12T18:36:54.925227+0000","last_active":"2024-09-12T18:36:54.925227+0000","last_peered":"2024-09-12T18:36:54.925227+0000","last_clean":"2024-09-12T18:36:54.925227+0000","last_became_active":"2024-09-12T17:31:12.067819+0000","last_became_peered":"2024-09-12T17:31:12.067819+0000","last_unstale":"2024-09-12T18:36:54.925227+0000","last_undegraded":"2024-09-12T18:36:54.925227+0000","last_fullsized":"2024-09-12T18:36:54.925227+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T18:36:54.925007+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T18:36:54.925007+0000","last_clean_scrub_stamp":"2024-09-12T18:36:54.925007+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:00.584474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":19458,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'26","reported_seq":142,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:51.835018+0000","last_change":"2024-09-12T18:36:51.835018+0000","last_active":"2024-09-12T18:36:51.835018+0000","last_peered":"2024-09-12T18:36:51.835018+0000","last_clean":"2024-09-12T18:36:51.835018+0000","last_became_active":"2024-09-12T17:27:32.578575+0000","last_became_peered":"2024-09-12T17:27:32.578575+0000","last_unstale":"2024-09-12T18:36:51.835018+0000","last_undegraded":"2024-09-12T18:36:51.835018+0000","last_fullsized":"2024-09-12T18:36:51.835018+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-09-12T18:36:51.834828+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-09-12T18:36:51.834828+0000","last_clean_scrub_stamp":"2024-09-12T18:36:51.834828+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:24.652055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":95,"num_write":44,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:47.779208+0000","last_change":"2024-09-12T18:36:47.779208+0000","last_active":"2024-09-12T18:36:47.779208+0000","last_peered":"2024-09-12T18:36:47.779208+0000","last_clean":"2024-09-12T18:36:47.779208+0000","last_became_active":"2024-09-12T17:53:27.156155+0000","last_became_peered":"2024-09-12T17:53:27.156155+0000","last_unstale":"2024-09-12T18:36:47.779208+0000","last_undegraded":"2024-09-12T18:36:47.779208+0000","last_fullsized":"2024-09-12T18:36:47.779208+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:47.778990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:47.778990+0000","last_clean_scrub_stamp":"2024-09-12T18:36:47.778990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:30.215730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"268'2","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.162170+0000","last_change":"2024-09-12T18:36:38.162170+0000","last_active":"2024-09-12T18:36:38.162170+0000","last_peered":"2024-09-12T18:36:38.162170+0000","last_clean":"2024-09-12T18:36:38.162170+0000","last_became_active":"2024-09-12T17:31:16.226398+0000","last_became_peered":"2024-09-12T17:31:16.226398+0000","last_unstale":"2024-09-12T18:36:38.162170+0000","last_undegraded":"2024-09-12T18:36:38.162170+0000","last_fullsized":"2024-09-12T18:36:38.162170+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:38.161992+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:38.161992+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.161992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:58.585276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:46.744036+0000","last_change":"2024-09-12T18:36:46.743867+0000","last_active":"2024-09-12T18:36:46.744036+0000","last_peered":"2024-09-12T18:36:46.744036+0000","last_clean":"2024-09-12T18:36:46.744036+0000","last_became_active":"2024-09-12T17:31:12.076502+0000","last_became_peered":"2024-09-12T17:31:12.076502+0000","last_unstale":"2024-09-12T18:36:46.744036+0000","last_undegraded":"2024-09-12T18:36:46.744036+0000","last_fullsized":"2024-09-12T18:36:46.744036+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:46.743670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:46.743670+0000","last_clean_scrub_stamp":"2024-09-12T18:36:46.743670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:41.248759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'36","reported_seq":165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.143323+0000","last_change":"2024-09-12T18:36:35.143323+0000","last_active":"2024-09-12T18:36:35.143323+0000","last_peered":"2024-09-12T18:36:35.143323+0000","last_clean":"2024-09-12T18:36:35.143323+0000","last_became_active":"2024-09-12T17:27:32.568740+0000","last_became_peered":"2024-09-12T17:27:32.568740+0000","last_unstale":"2024-09-12T18:36:35.143323+0000","last_undegraded":"2024-09-12T18:36:35.143323+0000","last_fullsized":"2024-09-12T18:36:35.143323+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-09-12T18:36:35.143142+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-09-12T18:36:35.143142+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.143142+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:17.123627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":126,"num_write":62,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:05.143627+0000","last_change":"2024-09-12T18:37:05.143627+0000","last_active":"2024-09-12T18:37:05.143627+0000","last_peered":"2024-09-12T18:37:05.143627+0000","last_clean":"2024-09-12T18:37:05.143627+0000","last_became_active":"2024-09-12T17:53:27.169805+0000","last_became_peered":"2024-09-12T17:53:27.169805+0000","last_unstale":"2024-09-12T18:37:05.143627+0000","last_undegraded":"2024-09-12T18:37:05.143627+0000","last_fullsized":"2024-09-12T18:37:05.143627+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:37:05.143437+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:37:05.143437+0000","last_clean_scrub_stamp":"2024-09-12T18:37:05.143437+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:28.635876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"268'2","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.240019+0000","last_change":"2024-09-12T18:36:42.240019+0000","last_active":"2024-09-12T18:36:42.240019+0000","last_peered":"2024-09-12T18:36:42.240019+0000","last_clean":"2024-09-12T18:36:42.240019+0000","last_became_active":"2024-09-12T17:31:16.220449+0000","last_became_peered":"2024-09-12T17:31:16.220449+0000","last_unstale":"2024-09-12T18:36:42.240019+0000","last_undegraded":"2024-09-12T18:36:42.240019+0000","last_fullsized":"2024-09-12T18:36:42.240019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:42.239845+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:42.239845+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.239845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:07.000654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:47.696858+0000","last_change":"2024-09-12T18:36:47.696858+0000","last_active":"2024-09-12T18:36:47.696858+0000","last_peered":"2024-09-12T18:36:47.696858+0000","last_clean":"2024-09-12T18:36:47.696858+0000","last_became_active":"2024-09-12T17:31:12.086091+0000","last_became_peered":"2024-09-12T17:31:12.086091+0000","last_unstale":"2024-09-12T18:36:47.696858+0000","last_undegraded":"2024-09-12T18:36:47.696858+0000","last_fullsized":"2024-09-12T18:36:47.696858+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:47.696568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:47.696568+0000","last_clean_scrub_stamp":"2024-09-12T18:36:47.696568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:32.501521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'57","reported_seq":225,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:50.857457+0000","last_change":"2024-09-12T18:36:50.857457+0000","last_active":"2024-09-12T18:36:50.857457+0000","last_peered":"2024-09-12T18:36:50.857457+0000","last_clean":"2024-09-12T18:36:50.857457+0000","last_became_active":"2024-09-12T17:27:32.568506+0000","last_became_peered":"2024-09-12T17:27:32.568506+0000","last_unstale":"2024-09-12T18:36:50.857457+0000","last_undegraded":"2024-09-12T18:36:50.857457+0000","last_fullsized":"2024-09-12T18:36:50.857457+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'57","last_scrub_stamp":"2024-09-12T18:36:50.857195+0000","last_deep_scrub":"268'57","last_deep_scrub_stamp":"2024-09-12T18:36:50.857195+0000","last_clean_scrub_stamp":"2024-09-12T18:36:50.857195+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:09.064961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":207,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:04.113609+0000","last_change":"2024-09-12T18:37:04.113609+0000","last_active":"2024-09-12T18:37:04.113609+0000","last_peered":"2024-09-12T18:37:04.113609+0000","last_clean":"2024-09-12T18:37:04.113609+0000","last_became_active":"2024-09-12T17:53:27.170636+0000","last_became_peered":"2024-09-12T17:53:27.170636+0000","last_unstale":"2024-09-12T18:37:04.113609+0000","last_undegraded":"2024-09-12T18:37:04.113609+0000","last_fullsized":"2024-09-12T18:37:04.113609+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:04.113422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:04.113422+0000","last_clean_scrub_stamp":"2024-09-12T18:37:04.113422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:05.955316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"268'3","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:03.879814+0000","last_change":"2024-09-12T18:37:03.879814+0000","last_active":"2024-09-12T18:37:03.879814+0000","last_peered":"2024-09-12T18:37:03.879814+0000","last_clean":"2024-09-12T18:37:03.879814+0000","last_became_active":"2024-09-12T17:31:16.238450+0000","last_became_peered":"2024-09-12T17:31:16.238450+0000","last_unstale":"2024-09-12T18:37:03.879814+0000","last_undegraded":"2024-09-12T18:37:03.879814+0000","last_fullsized":"2024-09-12T18:37:03.879814+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T18:37:03.879625+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T18:37:03.879625+0000","last_clean_scrub_stamp":"2024-09-12T18:37:03.879625+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:24.772909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:59.993911+0000","last_change":"2024-09-12T18:36:59.993911+0000","last_active":"2024-09-12T18:36:59.993911+0000","last_peered":"2024-09-12T18:36:59.993911+0000","last_clean":"2024-09-12T18:36:59.993911+0000","last_became_active":"2024-09-12T17:31:12.090201+0000","last_became_peered":"2024-09-12T17:31:12.090201+0000","last_unstale":"2024-09-12T18:36:59.993911+0000","last_undegraded":"2024-09-12T18:36:59.993911+0000","last_fullsized":"2024-09-12T18:36:59.993911+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:36:59.993724+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:36:59.993724+0000","last_clean_scrub_stamp":"2024-09-12T18:36:59.993724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:37.183073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.770769+0000","last_change":"2024-09-12T18:36:39.770769+0000","last_active":"2024-09-12T18:36:39.770769+0000","last_peered":"2024-09-12T18:36:39.770769+0000","last_clean":"2024-09-12T18:36:39.770769+0000","last_became_active":"2024-09-12T17:27:32.567672+0000","last_became_peered":"2024-09-12T17:27:32.567672+0000","last_unstale":"2024-09-12T18:36:39.770769+0000","last_undegraded":"2024-09-12T18:36:39.770769+0000","last_fullsized":"2024-09-12T18:36:39.770769+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:39.770579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:39.770579+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.770579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:03.618879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.813013+0000","last_change":"2024-09-12T18:36:40.813013+0000","last_active":"2024-09-12T18:36:40.813013+0000","last_peered":"2024-09-12T18:36:40.813013+0000","last_clean":"2024-09-12T18:36:40.813013+0000","last_became_active":"2024-09-12T17:53:27.142060+0000","last_became_peered":"2024-09-12T17:53:27.142060+0000","last_unstale":"2024-09-12T18:36:40.813013+0000","last_undegraded":"2024-09-12T18:36:40.813013+0000","last_fullsized":"2024-09-12T18:36:40.813013+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:40.812833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:40.812833+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.812833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:17.096207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"268'5","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:02.879499+0000","last_change":"2024-09-12T18:37:02.879499+0000","last_active":"2024-09-12T18:37:02.879499+0000","last_peered":"2024-09-12T18:37:02.879499+0000","last_clean":"2024-09-12T18:37:02.879499+0000","last_became_active":"2024-09-12T17:31:16.228226+0000","last_became_peered":"2024-09-12T17:31:16.228226+0000","last_unstale":"2024-09-12T18:37:02.879499+0000","last_undegraded":"2024-09-12T18:37:02.879499+0000","last_fullsized":"2024-09-12T18:37:02.879499+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T18:37:02.879280+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T18:37:02.879280+0000","last_clean_scrub_stamp":"2024-09-12T18:37:02.879280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:33.746237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1072,"num_write":10,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'5","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:48.778044+0000","last_change":"2024-09-12T18:36:48.777897+0000","last_active":"2024-09-12T18:36:48.778044+0000","last_peered":"2024-09-12T18:36:48.778044+0000","last_clean":"2024-09-12T18:36:48.778044+0000","last_became_active":"2024-09-12T17:31:12.090779+0000","last_became_peered":"2024-09-12T17:31:12.090779+0000","last_unstale":"2024-09-12T18:36:48.778044+0000","last_undegraded":"2024-09-12T18:36:48.778044+0000","last_fullsized":"2024-09-12T18:36:48.778044+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T18:36:48.777712+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T18:36:48.777712+0000","last_clean_scrub_stamp":"2024-09-12T18:36:48.777712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:14.632377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'62","reported_seq":242,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:48.822239+0000","last_change":"2024-09-12T18:36:48.822239+0000","last_active":"2024-09-12T18:36:48.822239+0000","last_peered":"2024-09-12T18:36:48.822239+0000","last_clean":"2024-09-12T18:36:48.822239+0000","last_became_active":"2024-09-12T17:27:32.567884+0000","last_became_peered":"2024-09-12T17:27:32.567884+0000","last_unstale":"2024-09-12T18:36:48.822239+0000","last_undegraded":"2024-09-12T18:36:48.822239+0000","last_fullsized":"2024-09-12T18:36:48.822239+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'62","last_scrub_stamp":"2024-09-12T18:36:48.822018+0000","last_deep_scrub":"268'62","last_deep_scrub_stamp":"2024-09-12T18:36:48.822018+0000","last_clean_scrub_stamp":"2024-09-12T18:36:48.822018+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:55.939955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":230,"num_write":101,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.369481+0000","last_change":"2024-09-12T18:36:37.369481+0000","last_active":"2024-09-12T18:36:37.369481+0000","last_peered":"2024-09-12T18:36:37.369481+0000","last_clean":"2024-09-12T18:36:37.369481+0000","last_became_active":"2024-09-12T17:53:27.139551+0000","last_became_peered":"2024-09-12T17:53:27.139551+0000","last_unstale":"2024-09-12T18:36:37.369481+0000","last_undegraded":"2024-09-12T18:36:37.369481+0000","last_fullsized":"2024-09-12T18:36:37.369481+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:37.369267+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:37.369267+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.369267+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:04.544870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'3","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:59.858494+0000","last_change":"2024-09-12T18:36:59.858494+0000","last_active":"2024-09-12T18:36:59.858494+0000","last_peered":"2024-09-12T18:36:59.858494+0000","last_clean":"2024-09-12T18:36:59.858494+0000","last_became_active":"2024-09-12T17:31:16.236796+0000","last_became_peered":"2024-09-12T17:31:16.236796+0000","last_unstale":"2024-09-12T18:36:59.858494+0000","last_undegraded":"2024-09-12T18:36:59.858494+0000","last_fullsized":"2024-09-12T18:36:59.858494+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:36:59.858278+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:36:59.858278+0000","last_clean_scrub_stamp":"2024-09-12T18:36:59.858278+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:16.454139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'4","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:53.134702+0000","last_change":"2024-09-12T18:36:53.134702+0000","last_active":"2024-09-12T18:36:53.134702+0000","last_peered":"2024-09-12T18:36:53.134702+0000","last_clean":"2024-09-12T18:36:53.134702+0000","last_became_active":"2024-09-12T17:31:12.092655+0000","last_became_peered":"2024-09-12T17:31:12.092655+0000","last_unstale":"2024-09-12T18:36:53.134702+0000","last_undegraded":"2024-09-12T18:36:53.134702+0000","last_fullsized":"2024-09-12T18:36:53.134702+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:53.134526+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:53.134526+0000","last_clean_scrub_stamp":"2024-09-12T18:36:53.134526+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:28.155409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'23","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:50.859026+0000","last_change":"2024-09-12T18:36:50.859026+0000","last_active":"2024-09-12T18:36:50.859026+0000","last_peered":"2024-09-12T18:36:50.859026+0000","last_clean":"2024-09-12T18:36:50.859026+0000","last_became_active":"2024-09-12T17:27:32.578393+0000","last_became_peered":"2024-09-12T17:27:32.578393+0000","last_unstale":"2024-09-12T18:36:50.859026+0000","last_undegraded":"2024-09-12T18:36:50.859026+0000","last_fullsized":"2024-09-12T18:36:50.859026+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'23","last_scrub_stamp":"2024-09-12T18:36:50.858847+0000","last_deep_scrub":"268'23","last_deep_scrub_stamp":"2024-09-12T18:36:50.858847+0000","last_clean_scrub_stamp":"2024-09-12T18:36:50.858847+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:34.798974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":84,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:03.150616+0000","last_change":"2024-09-12T18:37:03.150616+0000","last_active":"2024-09-12T18:37:03.150616+0000","last_peered":"2024-09-12T18:37:03.150616+0000","last_clean":"2024-09-12T18:37:03.150616+0000","last_became_active":"2024-09-12T17:53:27.142159+0000","last_became_peered":"2024-09-12T17:53:27.142159+0000","last_unstale":"2024-09-12T18:37:03.150616+0000","last_undegraded":"2024-09-12T18:37:03.150616+0000","last_fullsized":"2024-09-12T18:37:03.150616+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:03.150426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:03.150426+0000","last_clean_scrub_stamp":"2024-09-12T18:37:03.150426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:56.693488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'4","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:01.861518+0000","last_change":"2024-09-12T18:37:01.861518+0000","last_active":"2024-09-12T18:37:01.861518+0000","last_peered":"2024-09-12T18:37:01.861518+0000","last_clean":"2024-09-12T18:37:01.861518+0000","last_became_active":"2024-09-12T17:31:16.236478+0000","last_became_peered":"2024-09-12T17:31:16.236478+0000","last_unstale":"2024-09-12T18:37:01.861518+0000","last_undegraded":"2024-09-12T18:37:01.861518+0000","last_fullsized":"2024-09-12T18:37:01.861518+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:37:01.861183+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:37:01.861183+0000","last_clean_scrub_stamp":"2024-09-12T18:37:01.861183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:35.015341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.413764+0000","last_change":"2024-09-12T18:36:33.413764+0000","last_active":"2024-09-12T18:36:33.413764+0000","last_peered":"2024-09-12T18:36:33.413764+0000","last_clean":"2024-09-12T18:36:33.413764+0000","last_became_active":"2024-09-12T17:31:12.091488+0000","last_became_peered":"2024-09-12T17:31:12.091488+0000","last_unstale":"2024-09-12T18:36:33.413764+0000","last_undegraded":"2024-09-12T18:36:33.413764+0000","last_fullsized":"2024-09-12T18:36:33.413764+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:33.413578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:33.413578+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.413578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:54.083021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'49","reported_seq":208,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.524946+0000","last_change":"2024-09-12T18:36:28.524946+0000","last_active":"2024-09-12T18:36:28.524946+0000","last_peered":"2024-09-12T18:36:28.524946+0000","last_clean":"2024-09-12T18:36:28.524946+0000","last_became_active":"2024-09-12T17:27:32.572859+0000","last_became_peered":"2024-09-12T17:27:32.572859+0000","last_unstale":"2024-09-12T18:36:28.524946+0000","last_undegraded":"2024-09-12T18:36:28.524946+0000","last_fullsized":"2024-09-12T18:36:28.524946+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'49","last_scrub_stamp":"2024-09-12T18:36:28.524755+0000","last_deep_scrub":"268'49","last_deep_scrub_stamp":"2024-09-12T18:36:28.524755+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.524755+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:40.471596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":198,"num_write":77,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:54.715251+0000","last_change":"2024-09-12T18:36:54.715251+0000","last_active":"2024-09-12T18:36:54.715251+0000","last_peered":"2024-09-12T18:36:54.715251+0000","last_clean":"2024-09-12T18:36:54.715251+0000","last_became_active":"2024-09-12T17:53:27.155646+0000","last_became_peered":"2024-09-12T17:53:27.155646+0000","last_unstale":"2024-09-12T18:36:54.715251+0000","last_undegraded":"2024-09-12T18:36:54.715251+0000","last_fullsized":"2024-09-12T18:36:54.715251+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:54.715064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:54.715064+0000","last_clean_scrub_stamp":"2024-09-12T18:36:54.715064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:25.403137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'4","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:52.667068+0000","last_change":"2024-09-12T18:36:52.667068+0000","last_active":"2024-09-12T18:36:52.667068+0000","last_peered":"2024-09-12T18:36:52.667068+0000","last_clean":"2024-09-12T18:36:52.667068+0000","last_became_active":"2024-09-12T17:31:16.220797+0000","last_became_peered":"2024-09-12T17:31:16.220797+0000","last_unstale":"2024-09-12T18:36:52.667068+0000","last_undegraded":"2024-09-12T18:36:52.667068+0000","last_fullsized":"2024-09-12T18:36:52.667068+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:36:52.666845+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:36:52.666845+0000","last_clean_scrub_stamp":"2024-09-12T18:36:52.666845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:47.529646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:55.917357+0000","last_change":"2024-09-12T18:36:55.917357+0000","last_active":"2024-09-12T18:36:55.917357+0000","last_peered":"2024-09-12T18:36:55.917357+0000","last_clean":"2024-09-12T18:36:55.917357+0000","last_became_active":"2024-09-12T17:31:12.090174+0000","last_became_peered":"2024-09-12T17:31:12.090174+0000","last_unstale":"2024-09-12T18:36:55.917357+0000","last_undegraded":"2024-09-12T18:36:55.917357+0000","last_fullsized":"2024-09-12T18:36:55.917357+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:55.917144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:55.917144+0000","last_clean_scrub_stamp":"2024-09-12T18:36:55.917144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:02.788344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'101","reported_seq":403,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:47.131098+0000","last_change":"2024-09-12T18:36:47.131098+0000","last_active":"2024-09-12T18:36:47.131098+0000","last_peered":"2024-09-12T18:36:47.131098+0000","last_clean":"2024-09-12T18:36:47.131098+0000","last_became_active":"2024-09-12T17:27:32.574023+0000","last_became_peered":"2024-09-12T17:27:32.574023+0000","last_unstale":"2024-09-12T18:36:47.131098+0000","last_undegraded":"2024-09-12T18:36:47.131098+0000","last_fullsized":"2024-09-12T18:36:47.131098+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'101","last_scrub_stamp":"2024-09-12T18:36:47.130903+0000","last_deep_scrub":"268'101","last_deep_scrub_stamp":"2024-09-12T18:36:47.130903+0000","last_clean_scrub_stamp":"2024-09-12T18:36:47.130903+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:44.151223+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":651,"num_read_kb":453,"num_write":126,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3472,"num_omap_keys":7,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:34.431282+0000","last_change":"2024-09-12T17:53:27.165446+0000","last_active":"2024-09-12T18:34:34.431282+0000","last_peered":"2024-09-12T18:34:34.431282+0000","last_clean":"2024-09-12T18:34:34.431282+0000","last_became_active":"2024-09-12T17:53:27.164643+0000","last_became_peered":"2024-09-12T17:53:27.164643+0000","last_unstale":"2024-09-12T18:34:34.431282+0000","last_undegraded":"2024-09-12T18:34:34.431282+0000","last_fullsized":"2024-09-12T18:34:34.431282+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"265'4","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.778689+0000","last_change":"2024-09-12T18:36:42.778689+0000","last_active":"2024-09-12T18:36:42.778689+0000","last_peered":"2024-09-12T18:36:42.778689+0000","last_clean":"2024-09-12T18:36:42.778689+0000","last_became_active":"2024-09-12T17:31:16.240666+0000","last_became_peered":"2024-09-12T17:31:16.240666+0000","last_unstale":"2024-09-12T18:36:42.778689+0000","last_undegraded":"2024-09-12T18:36:42.778689+0000","last_fullsized":"2024-09-12T18:36:42.778689+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:36:42.778498+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:36:42.778498+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.778498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:25.885647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:45.736128+0000","last_change":"2024-09-12T18:36:45.736128+0000","last_active":"2024-09-12T18:36:45.736128+0000","last_peered":"2024-09-12T18:36:45.736128+0000","last_clean":"2024-09-12T18:36:45.736128+0000","last_became_active":"2024-09-12T17:31:12.077055+0000","last_became_peered":"2024-09-12T17:31:12.077055+0000","last_unstale":"2024-09-12T18:36:45.736128+0000","last_undegraded":"2024-09-12T18:36:45.736128+0000","last_fullsized":"2024-09-12T18:36:45.736128+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:45.735944+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:45.735944+0000","last_clean_scrub_stamp":"2024-09-12T18:36:45.735944+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:36.120792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'36","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:46.104074+0000","last_change":"2024-09-12T18:36:46.104074+0000","last_active":"2024-09-12T18:36:46.104074+0000","last_peered":"2024-09-12T18:36:46.104074+0000","last_clean":"2024-09-12T18:36:46.104074+0000","last_became_active":"2024-09-12T17:27:32.574128+0000","last_became_peered":"2024-09-12T17:27:32.574128+0000","last_unstale":"2024-09-12T18:36:46.104074+0000","last_undegraded":"2024-09-12T18:36:46.104074+0000","last_fullsized":"2024-09-12T18:36:46.104074+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-09-12T18:36:46.103894+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-09-12T18:36:46.103894+0000","last_clean_scrub_stamp":"2024-09-12T18:36:46.103894+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:56.981018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":129,"num_write":75,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:05.974902+0000","last_change":"2024-09-12T18:37:05.974902+0000","last_active":"2024-09-12T18:37:05.974902+0000","last_peered":"2024-09-12T18:37:05.974902+0000","last_clean":"2024-09-12T18:37:05.974902+0000","last_became_active":"2024-09-12T17:53:27.169499+0000","last_became_peered":"2024-09-12T17:53:27.169499+0000","last_unstale":"2024-09-12T18:37:05.974902+0000","last_undegraded":"2024-09-12T18:37:05.974902+0000","last_fullsized":"2024-09-12T18:37:05.974902+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:05.974669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:05.974669+0000","last_clean_scrub_stamp":"2024-09-12T18:37:05.974669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:45.795396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"268'4","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.750543+0000","last_change":"2024-09-12T18:36:43.750543+0000","last_active":"2024-09-12T18:36:43.750543+0000","last_peered":"2024-09-12T18:36:43.750543+0000","last_clean":"2024-09-12T18:36:43.750543+0000","last_became_active":"2024-09-12T17:31:16.232949+0000","last_became_peered":"2024-09-12T17:31:16.232949+0000","last_unstale":"2024-09-12T18:36:43.750543+0000","last_undegraded":"2024-09-12T18:36:43.750543+0000","last_fullsized":"2024-09-12T18:36:43.750543+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:43.750294+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:43.750294+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.750294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:47.834399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'4","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:53.857461+0000","last_change":"2024-09-12T18:36:53.857461+0000","last_active":"2024-09-12T18:36:53.857461+0000","last_peered":"2024-09-12T18:36:53.857461+0000","last_clean":"2024-09-12T18:36:53.857461+0000","last_became_active":"2024-09-12T17:31:12.086300+0000","last_became_peered":"2024-09-12T17:31:12.086300+0000","last_unstale":"2024-09-12T18:36:53.857461+0000","last_undegraded":"2024-09-12T18:36:53.857461+0000","last_fullsized":"2024-09-12T18:36:53.857461+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:53.857259+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:53.857259+0000","last_clean_scrub_stamp":"2024-09-12T18:36:53.857259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:03.233529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'15","reported_seq":117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:46.770365+0000","last_change":"2024-09-12T18:36:46.770365+0000","last_active":"2024-09-12T18:36:46.770365+0000","last_peered":"2024-09-12T18:36:46.770365+0000","last_clean":"2024-09-12T18:36:46.770365+0000","last_became_active":"2024-09-12T17:27:32.591878+0000","last_became_peered":"2024-09-12T17:27:32.591878+0000","last_unstale":"2024-09-12T18:36:46.770365+0000","last_undegraded":"2024-09-12T18:36:46.770365+0000","last_fullsized":"2024-09-12T18:36:46.770365+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'15","last_scrub_stamp":"2024-09-12T18:36:46.770097+0000","last_deep_scrub":"265'15","last_deep_scrub_stamp":"2024-09-12T18:36:46.770097+0000","last_clean_scrub_stamp":"2024-09-12T18:36:46.770097+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:18.413498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"268'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:03.924376+0000","last_change":"2024-09-12T18:37:03.924376+0000","last_active":"2024-09-12T18:37:03.924376+0000","last_peered":"2024-09-12T18:37:03.924376+0000","last_clean":"2024-09-12T18:37:03.924376+0000","last_became_active":"2024-09-12T17:53:27.157992+0000","last_became_peered":"2024-09-12T17:53:27.157992+0000","last_unstale":"2024-09-12T18:37:03.924376+0000","last_undegraded":"2024-09-12T18:37:03.924376+0000","last_fullsized":"2024-09-12T18:37:03.924376+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:37:03.924149+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:37:03.924149+0000","last_clean_scrub_stamp":"2024-09-12T18:37:03.924149+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:36.785761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'2","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:58.906550+0000","last_change":"2024-09-12T18:36:58.906550+0000","last_active":"2024-09-12T18:36:58.906550+0000","last_peered":"2024-09-12T18:36:58.906550+0000","last_clean":"2024-09-12T18:36:58.906550+0000","last_became_active":"2024-09-12T17:31:16.227946+0000","last_became_peered":"2024-09-12T17:31:16.227946+0000","last_unstale":"2024-09-12T18:36:58.906550+0000","last_undegraded":"2024-09-12T18:36:58.906550+0000","last_fullsized":"2024-09-12T18:36:58.906550+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:58.906357+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:58.906357+0000","last_clean_scrub_stamp":"2024-09-12T18:36:58.906357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:03.672657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'5","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.184041+0000","last_change":"2024-09-12T18:36:36.184041+0000","last_active":"2024-09-12T18:36:36.184041+0000","last_peered":"2024-09-12T18:36:36.184041+0000","last_clean":"2024-09-12T18:36:36.184041+0000","last_became_active":"2024-09-12T17:31:12.105448+0000","last_became_peered":"2024-09-12T17:31:12.105448+0000","last_unstale":"2024-09-12T18:36:36.184041+0000","last_undegraded":"2024-09-12T18:36:36.184041+0000","last_fullsized":"2024-09-12T18:36:36.184041+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T18:36:36.183859+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T18:36:36.183859+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.183859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.721194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'22","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.756826+0000","last_change":"2024-09-12T18:36:42.756826+0000","last_active":"2024-09-12T18:36:42.756826+0000","last_peered":"2024-09-12T18:36:42.756826+0000","last_clean":"2024-09-12T18:36:42.756826+0000","last_became_active":"2024-09-12T17:27:32.567500+0000","last_became_peered":"2024-09-12T17:27:32.567500+0000","last_unstale":"2024-09-12T18:36:42.756826+0000","last_undegraded":"2024-09-12T18:36:42.756826+0000","last_fullsized":"2024-09-12T18:36:42.756826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'22","last_scrub_stamp":"2024-09-12T18:36:42.756642+0000","last_deep_scrub":"268'22","last_deep_scrub_stamp":"2024-09-12T18:36:42.756642+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.756642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:22.566917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:34:34.431249+0000","last_change":"2024-09-12T17:53:27.167094+0000","last_active":"2024-09-12T18:34:34.431249+0000","last_peered":"2024-09-12T18:34:34.431249+0000","last_clean":"2024-09-12T18:34:34.431249+0000","last_became_active":"2024-09-12T17:53:27.164083+0000","last_became_peered":"2024-09-12T17:53:27.164083+0000","last_unstale":"2024-09-12T18:34:34.431249+0000","last_undegraded":"2024-09-12T18:34:34.431249+0000","last_fullsized":"2024-09-12T18:34:34.431249+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"268'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.157495+0000","last_change":"2024-09-12T18:36:40.157495+0000","last_active":"2024-09-12T18:36:40.157495+0000","last_peered":"2024-09-12T18:36:40.157495+0000","last_clean":"2024-09-12T18:36:40.157495+0000","last_became_active":"2024-09-12T17:31:16.238356+0000","last_became_peered":"2024-09-12T17:31:16.238356+0000","last_unstale":"2024-09-12T18:36:40.157495+0000","last_undegraded":"2024-09-12T18:36:40.157495+0000","last_fullsized":"2024-09-12T18:36:40.157495+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:40.157306+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:40.157306+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.157306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:06.571107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'5","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:47.812978+0000","last_change":"2024-09-12T18:36:47.812978+0000","last_active":"2024-09-12T18:36:47.812978+0000","last_peered":"2024-09-12T18:36:47.812978+0000","last_clean":"2024-09-12T18:36:47.812978+0000","last_became_active":"2024-09-12T17:31:12.105300+0000","last_became_peered":"2024-09-12T17:31:12.105300+0000","last_unstale":"2024-09-12T18:36:47.812978+0000","last_undegraded":"2024-09-12T18:36:47.812978+0000","last_fullsized":"2024-09-12T18:36:47.812978+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T18:36:47.812785+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T18:36:47.812785+0000","last_clean_scrub_stamp":"2024-09-12T18:36:47.812785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:22.868595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'42","reported_seq":184,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:52.857547+0000","last_change":"2024-09-12T18:36:52.857547+0000","last_active":"2024-09-12T18:36:52.857547+0000","last_peered":"2024-09-12T18:36:52.857547+0000","last_clean":"2024-09-12T18:36:52.857547+0000","last_became_active":"2024-09-12T17:27:32.597518+0000","last_became_peered":"2024-09-12T17:27:32.597518+0000","last_unstale":"2024-09-12T18:36:52.857547+0000","last_undegraded":"2024-09-12T18:36:52.857547+0000","last_fullsized":"2024-09-12T18:36:52.857547+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'42","last_scrub_stamp":"2024-09-12T18:36:52.857310+0000","last_deep_scrub":"268'42","last_deep_scrub_stamp":"2024-09-12T18:36:52.857310+0000","last_clean_scrub_stamp":"2024-09-12T18:36:52.857310+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:28.971317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":146,"num_write":82,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.464065+0000","last_change":"2024-09-12T18:36:34.463783+0000","last_active":"2024-09-12T18:36:34.464065+0000","last_peered":"2024-09-12T18:36:34.464065+0000","last_clean":"2024-09-12T18:36:34.464065+0000","last_became_active":"2024-09-12T17:53:27.139633+0000","last_became_peered":"2024-09-12T17:53:27.139633+0000","last_unstale":"2024-09-12T18:36:34.464065+0000","last_undegraded":"2024-09-12T18:36:34.464065+0000","last_fullsized":"2024-09-12T18:36:34.464065+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:34.463510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:34.463510+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.463510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:11.843726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"265'4","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:56.879434+0000","last_change":"2024-09-12T18:36:56.879434+0000","last_active":"2024-09-12T18:36:56.879434+0000","last_peered":"2024-09-12T18:36:56.879434+0000","last_clean":"2024-09-12T18:36:56.879434+0000","last_became_active":"2024-09-12T17:31:16.229063+0000","last_became_peered":"2024-09-12T17:31:16.229063+0000","last_unstale":"2024-09-12T18:36:56.879434+0000","last_undegraded":"2024-09-12T18:36:56.879434+0000","last_fullsized":"2024-09-12T18:36:56.879434+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:36:56.879244+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:36:56.879244+0000","last_clean_scrub_stamp":"2024-09-12T18:36:56.879244+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:16.783337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:52.109432+0000","last_change":"2024-09-12T18:36:52.109432+0000","last_active":"2024-09-12T18:36:52.109432+0000","last_peered":"2024-09-12T18:36:52.109432+0000","last_clean":"2024-09-12T18:36:52.109432+0000","last_became_active":"2024-09-12T17:31:12.093496+0000","last_became_peered":"2024-09-12T17:31:12.093496+0000","last_unstale":"2024-09-12T18:36:52.109432+0000","last_undegraded":"2024-09-12T18:36:52.109432+0000","last_fullsized":"2024-09-12T18:36:52.109432+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:36:52.109239+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:36:52.109239+0000","last_clean_scrub_stamp":"2024-09-12T18:36:52.109239+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:01.666822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":4,"num_write_kb":1047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'15","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:48.898305+0000","last_change":"2024-09-12T18:36:48.898305+0000","last_active":"2024-09-12T18:36:48.898305+0000","last_peered":"2024-09-12T18:36:48.898305+0000","last_clean":"2024-09-12T18:36:48.898305+0000","last_became_active":"2024-09-12T17:27:32.597694+0000","last_became_peered":"2024-09-12T17:27:32.597694+0000","last_unstale":"2024-09-12T18:36:48.898305+0000","last_undegraded":"2024-09-12T18:36:48.898305+0000","last_fullsized":"2024-09-12T18:36:48.898305+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'15","last_scrub_stamp":"2024-09-12T18:36:48.898124+0000","last_deep_scrub":"268'15","last_deep_scrub_stamp":"2024-09-12T18:36:48.898124+0000","last_clean_scrub_stamp":"2024-09-12T18:36:48.898124+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:32.304263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:00.103967+0000","last_change":"2024-09-12T18:37:00.103967+0000","last_active":"2024-09-12T18:37:00.103967+0000","last_peered":"2024-09-12T18:37:00.103967+0000","last_clean":"2024-09-12T18:37:00.103967+0000","last_became_active":"2024-09-12T17:53:27.161396+0000","last_became_peered":"2024-09-12T17:53:27.161396+0000","last_unstale":"2024-09-12T18:37:00.103967+0000","last_undegraded":"2024-09-12T18:37:00.103967+0000","last_fullsized":"2024-09-12T18:37:00.103967+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:00.103760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:00.103760+0000","last_clean_scrub_stamp":"2024-09-12T18:37:00.103760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:42.215769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'3","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:57.881358+0000","last_change":"2024-09-12T18:36:57.881358+0000","last_active":"2024-09-12T18:36:57.881358+0000","last_peered":"2024-09-12T18:36:57.881358+0000","last_clean":"2024-09-12T18:36:57.881358+0000","last_became_active":"2024-09-12T17:31:16.238011+0000","last_became_peered":"2024-09-12T17:31:16.238011+0000","last_unstale":"2024-09-12T18:36:57.881358+0000","last_undegraded":"2024-09-12T18:36:57.881358+0000","last_fullsized":"2024-09-12T18:36:57.881358+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T18:36:57.881134+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T18:36:57.881134+0000","last_clean_scrub_stamp":"2024-09-12T18:36:57.881134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:31.802657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"268'7","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.458059+0000","last_change":"2024-09-12T18:36:32.458059+0000","last_active":"2024-09-12T18:36:32.458059+0000","last_peered":"2024-09-12T18:36:32.458059+0000","last_clean":"2024-09-12T18:36:32.458059+0000","last_became_active":"2024-09-12T17:31:12.093705+0000","last_became_peered":"2024-09-12T17:31:12.093705+0000","last_unstale":"2024-09-12T18:36:32.458059+0000","last_undegraded":"2024-09-12T18:36:32.458059+0000","last_fullsized":"2024-09-12T18:36:32.458059+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T18:36:32.457867+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T18:36:32.457867+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.457867+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:50.495148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'6","reported_seq":88,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:46.773356+0000","last_change":"2024-09-12T18:36:46.773356+0000","last_active":"2024-09-12T18:36:46.773356+0000","last_peered":"2024-09-12T18:36:46.773356+0000","last_clean":"2024-09-12T18:36:46.773356+0000","last_became_active":"2024-09-12T17:27:32.579749+0000","last_became_peered":"2024-09-12T17:27:32.579749+0000","last_unstale":"2024-09-12T18:36:46.773356+0000","last_undegraded":"2024-09-12T18:36:46.773356+0000","last_fullsized":"2024-09-12T18:36:46.773356+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:36:46.773161+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:36:46.773161+0000","last_clean_scrub_stamp":"2024-09-12T18:36:46.773161+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:13.565871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.191586+0000","last_change":"2024-09-12T18:36:41.191421+0000","last_active":"2024-09-12T18:36:41.191586+0000","last_peered":"2024-09-12T18:36:41.191586+0000","last_clean":"2024-09-12T18:36:41.191586+0000","last_became_active":"2024-09-12T17:53:27.142745+0000","last_became_peered":"2024-09-12T17:53:27.142745+0000","last_unstale":"2024-09-12T18:36:41.191586+0000","last_undegraded":"2024-09-12T18:36:41.191586+0000","last_fullsized":"2024-09-12T18:36:41.191586+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:41.191230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:41.191230+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.191230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:57.178772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:48.769753+0000","last_change":"2024-09-12T18:36:48.769753+0000","last_active":"2024-09-12T18:36:48.769753+0000","last_peered":"2024-09-12T18:36:48.769753+0000","last_clean":"2024-09-12T18:36:48.769753+0000","last_became_active":"2024-09-12T17:31:16.242306+0000","last_became_peered":"2024-09-12T17:31:16.242306+0000","last_unstale":"2024-09-12T18:36:48.769753+0000","last_undegraded":"2024-09-12T18:36:48.769753+0000","last_fullsized":"2024-09-12T18:36:48.769753+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:48.769558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:48.769558+0000","last_clean_scrub_stamp":"2024-09-12T18:36:48.769558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:25.552952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'6","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:56.875048+0000","last_change":"2024-09-12T18:36:56.875048+0000","last_active":"2024-09-12T18:36:56.875048+0000","last_peered":"2024-09-12T18:36:56.875048+0000","last_clean":"2024-09-12T18:36:56.875048+0000","last_became_active":"2024-09-12T17:31:12.077726+0000","last_became_peered":"2024-09-12T17:31:12.077726+0000","last_unstale":"2024-09-12T18:36:56.875048+0000","last_undegraded":"2024-09-12T18:36:56.875048+0000","last_fullsized":"2024-09-12T18:36:56.875048+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T18:36:56.874860+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T18:36:56.874860+0000","last_clean_scrub_stamp":"2024-09-12T18:36:56.874860+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:52.201139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'8","reported_seq":94,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.178365+0000","last_change":"2024-09-12T18:36:34.178365+0000","last_active":"2024-09-12T18:36:34.178365+0000","last_peered":"2024-09-12T18:36:34.178365+0000","last_clean":"2024-09-12T18:36:34.178365+0000","last_became_active":"2024-09-12T17:27:32.583062+0000","last_became_peered":"2024-09-12T17:27:32.583062+0000","last_unstale":"2024-09-12T18:36:34.178365+0000","last_undegraded":"2024-09-12T18:36:34.178365+0000","last_fullsized":"2024-09-12T18:36:34.178365+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T18:36:34.178159+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T18:36:34.178159+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.178159+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:13.223172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:59.091068+0000","last_change":"2024-09-12T18:36:59.091068+0000","last_active":"2024-09-12T18:36:59.091068+0000","last_peered":"2024-09-12T18:36:59.091068+0000","last_clean":"2024-09-12T18:36:59.091068+0000","last_became_active":"2024-09-12T17:53:27.163419+0000","last_became_peered":"2024-09-12T17:53:27.163419+0000","last_unstale":"2024-09-12T18:36:59.091068+0000","last_undegraded":"2024-09-12T18:36:59.091068+0000","last_fullsized":"2024-09-12T18:36:59.091068+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:59.090886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:59.090886+0000","last_clean_scrub_stamp":"2024-09-12T18:36:59.090886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:39.221191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:00.845324+0000","last_change":"2024-09-12T18:37:00.845324+0000","last_active":"2024-09-12T18:37:00.845324+0000","last_peered":"2024-09-12T18:37:00.845324+0000","last_clean":"2024-09-12T18:37:00.845324+0000","last_became_active":"2024-09-12T17:31:16.236619+0000","last_became_peered":"2024-09-12T17:31:16.236619+0000","last_unstale":"2024-09-12T18:37:00.845324+0000","last_undegraded":"2024-09-12T18:37:00.845324+0000","last_fullsized":"2024-09-12T18:37:00.845324+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:00.845111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:00.845111+0000","last_clean_scrub_stamp":"2024-09-12T18:37:00.845111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:55.826678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"268'7","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:45.711196+0000","last_change":"2024-09-12T18:36:45.711196+0000","last_active":"2024-09-12T18:36:45.711196+0000","last_peered":"2024-09-12T18:36:45.711196+0000","last_clean":"2024-09-12T18:36:45.711196+0000","last_became_active":"2024-09-12T17:31:12.105793+0000","last_became_peered":"2024-09-12T17:31:12.105793+0000","last_unstale":"2024-09-12T18:36:45.711196+0000","last_undegraded":"2024-09-12T18:36:45.711196+0000","last_fullsized":"2024-09-12T18:36:45.711196+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T18:36:45.710950+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T18:36:45.710950+0000","last_clean_scrub_stamp":"2024-09-12T18:36:45.710950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:57.494629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'53","reported_seq":214,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.482580+0000","last_change":"2024-09-12T18:36:29.482580+0000","last_active":"2024-09-12T18:36:29.482580+0000","last_peered":"2024-09-12T18:36:29.482580+0000","last_clean":"2024-09-12T18:36:29.482580+0000","last_became_active":"2024-09-12T17:27:32.569594+0000","last_became_peered":"2024-09-12T17:27:32.569594+0000","last_unstale":"2024-09-12T18:36:29.482580+0000","last_undegraded":"2024-09-12T18:36:29.482580+0000","last_fullsized":"2024-09-12T18:36:29.482580+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'53","last_scrub_stamp":"2024-09-12T18:36:29.482390+0000","last_deep_scrub":"268'53","last_deep_scrub_stamp":"2024-09-12T18:36:29.482390+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.482390+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:05.105632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":187,"num_write":95,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:33:59.423114+0000","last_change":"2024-09-12T17:53:27.166701+0000","last_active":"2024-09-12T18:33:59.423114+0000","last_peered":"2024-09-12T18:33:59.423114+0000","last_clean":"2024-09-12T18:33:59.423114+0000","last_became_active":"2024-09-12T17:53:27.165129+0000","last_became_peered":"2024-09-12T17:53:27.165129+0000","last_unstale":"2024-09-12T18:33:59.423114+0000","last_undegraded":"2024-09-12T18:33:59.423114+0000","last_fullsized":"2024-09-12T18:33:59.423114+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:53:26.111473+0000","last_clean_scrub_stamp":"2024-09-12T17:53:26.111473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"268'2","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:50.676310+0000","last_change":"2024-09-12T18:36:50.676310+0000","last_active":"2024-09-12T18:36:50.676310+0000","last_peered":"2024-09-12T18:36:50.676310+0000","last_clean":"2024-09-12T18:36:50.676310+0000","last_became_active":"2024-09-12T17:31:16.240152+0000","last_became_peered":"2024-09-12T17:31:16.240152+0000","last_unstale":"2024-09-12T18:36:50.676310+0000","last_undegraded":"2024-09-12T18:36:50.676310+0000","last_fullsized":"2024-09-12T18:36:50.676310+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:50.676083+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:50.676083+0000","last_clean_scrub_stamp":"2024-09-12T18:36:50.676083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:45.187304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'5","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:51.902235+0000","last_change":"2024-09-12T18:36:51.902235+0000","last_active":"2024-09-12T18:36:51.902235+0000","last_peered":"2024-09-12T18:36:51.902235+0000","last_clean":"2024-09-12T18:36:51.902235+0000","last_became_active":"2024-09-12T17:31:12.089200+0000","last_became_peered":"2024-09-12T17:31:12.089200+0000","last_unstale":"2024-09-12T18:36:51.902235+0000","last_undegraded":"2024-09-12T18:36:51.902235+0000","last_fullsized":"2024-09-12T18:36:51.902235+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T18:36:51.902050+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T18:36:51.902050+0000","last_clean_scrub_stamp":"2024-09-12T18:36:51.902050+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:08.418200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8242,"num_write":10,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'48","reported_seq":201,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:45.745885+0000","last_change":"2024-09-12T18:36:45.745885+0000","last_active":"2024-09-12T18:36:45.745885+0000","last_peered":"2024-09-12T18:36:45.745885+0000","last_clean":"2024-09-12T18:36:45.745885+0000","last_became_active":"2024-09-12T17:27:32.568661+0000","last_became_peered":"2024-09-12T17:27:32.568661+0000","last_unstale":"2024-09-12T18:36:45.745885+0000","last_undegraded":"2024-09-12T18:36:45.745885+0000","last_fullsized":"2024-09-12T18:36:45.745885+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'48","last_scrub_stamp":"2024-09-12T18:36:45.745710+0000","last_deep_scrub":"268'48","last_deep_scrub_stamp":"2024-09-12T18:36:45.745710+0000","last_clean_scrub_stamp":"2024-09-12T18:36:45.745710+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:00.242423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":169,"num_write":85,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:02.170629+0000","last_change":"2024-09-12T18:37:02.170629+0000","last_active":"2024-09-12T18:37:02.170629+0000","last_peered":"2024-09-12T18:37:02.170629+0000","last_clean":"2024-09-12T18:37:02.170629+0000","last_became_active":"2024-09-12T17:53:27.170493+0000","last_became_peered":"2024-09-12T17:53:27.170493+0000","last_unstale":"2024-09-12T18:37:02.170629+0000","last_undegraded":"2024-09-12T18:37:02.170629+0000","last_fullsized":"2024-09-12T18:37:02.170629+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:02.170442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:02.170442+0000","last_clean_scrub_stamp":"2024-09-12T18:37:02.170442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:57.047302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'7","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:55.140302+0000","last_change":"2024-09-12T18:36:55.140302+0000","last_active":"2024-09-12T18:36:55.140302+0000","last_peered":"2024-09-12T18:36:55.140302+0000","last_clean":"2024-09-12T18:36:55.140302+0000","last_became_active":"2024-09-12T17:31:16.228566+0000","last_became_peered":"2024-09-12T17:31:16.228566+0000","last_unstale":"2024-09-12T18:36:55.140302+0000","last_undegraded":"2024-09-12T18:36:55.140302+0000","last_fullsized":"2024-09-12T18:36:55.140302+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T18:36:55.140130+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T18:36:55.140130+0000","last_clean_scrub_stamp":"2024-09-12T18:36:55.140130+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:56.174852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5238,"num_write":12,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'4","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.704030+0000","last_change":"2024-09-12T18:36:44.704030+0000","last_active":"2024-09-12T18:36:44.704030+0000","last_peered":"2024-09-12T18:36:44.704030+0000","last_clean":"2024-09-12T18:36:44.704030+0000","last_became_active":"2024-09-12T17:31:12.105384+0000","last_became_peered":"2024-09-12T17:31:12.105384+0000","last_unstale":"2024-09-12T18:36:44.704030+0000","last_undegraded":"2024-09-12T18:36:44.704030+0000","last_fullsized":"2024-09-12T18:36:44.704030+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:44.703841+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:44.703841+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.703841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:23.099047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'111","reported_seq":488,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:45.057682+0000","last_change":"2024-09-12T18:36:45.057682+0000","last_active":"2024-09-12T18:36:45.057682+0000","last_peered":"2024-09-12T18:36:45.057682+0000","last_clean":"2024-09-12T18:36:45.057682+0000","last_became_active":"2024-09-12T17:27:32.586640+0000","last_became_peered":"2024-09-12T17:27:32.586640+0000","last_unstale":"2024-09-12T18:36:45.057682+0000","last_undegraded":"2024-09-12T18:36:45.057682+0000","last_fullsized":"2024-09-12T18:36:45.057682+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'111","last_scrub_stamp":"2024-09-12T18:36:45.057448+0000","last_deep_scrub":"268'111","last_deep_scrub_stamp":"2024-09-12T18:36:45.057448+0000","last_clean_scrub_stamp":"2024-09-12T18:36:45.057448+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:10.836559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":815,"num_read_kb":525,"num_write":139,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3486,"num_omap_keys":7,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'2","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:01.152651+0000","last_change":"2024-09-12T18:37:01.152651+0000","last_active":"2024-09-12T18:37:01.152651+0000","last_peered":"2024-09-12T18:37:01.152651+0000","last_clean":"2024-09-12T18:37:01.152651+0000","last_became_active":"2024-09-12T17:53:27.170381+0000","last_became_peered":"2024-09-12T17:53:27.170381+0000","last_unstale":"2024-09-12T18:37:01.152651+0000","last_undegraded":"2024-09-12T18:37:01.152651+0000","last_fullsized":"2024-09-12T18:37:01.152651+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:37:01.152463+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:37:01.152463+0000","last_clean_scrub_stamp":"2024-09-12T18:37:01.152463+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:46.938665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'7","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.793387+0000","last_change":"2024-09-12T18:36:36.793387+0000","last_active":"2024-09-12T18:36:36.793387+0000","last_peered":"2024-09-12T18:36:36.793387+0000","last_clean":"2024-09-12T18:36:36.793387+0000","last_became_active":"2024-09-12T17:31:16.245228+0000","last_became_peered":"2024-09-12T17:31:16.245228+0000","last_unstale":"2024-09-12T18:36:36.793387+0000","last_undegraded":"2024-09-12T18:36:36.793387+0000","last_fullsized":"2024-09-12T18:36:36.793387+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T18:36:36.793179+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T18:36:36.793179+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.793179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:54.579651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":48,"num_write":12,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'2","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:52.951184+0000","last_change":"2024-09-12T18:36:52.951184+0000","last_active":"2024-09-12T18:36:52.951184+0000","last_peered":"2024-09-12T18:36:52.951184+0000","last_clean":"2024-09-12T18:36:52.951184+0000","last_became_active":"2024-09-12T17:31:12.089735+0000","last_became_peered":"2024-09-12T17:31:12.089735+0000","last_unstale":"2024-09-12T18:36:52.951184+0000","last_undegraded":"2024-09-12T18:36:52.951184+0000","last_fullsized":"2024-09-12T18:36:52.951184+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:52.950978+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:52.950978+0000","last_clean_scrub_stamp":"2024-09-12T18:36:52.950978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:30.996137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'45","reported_seq":197,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:49.858448+0000","last_change":"2024-09-12T18:36:49.858269+0000","last_active":"2024-09-12T18:36:49.858448+0000","last_peered":"2024-09-12T18:36:49.858448+0000","last_clean":"2024-09-12T18:36:49.858448+0000","last_became_active":"2024-09-12T17:27:32.575300+0000","last_became_peered":"2024-09-12T17:27:32.575300+0000","last_unstale":"2024-09-12T18:36:49.858448+0000","last_undegraded":"2024-09-12T18:36:49.858448+0000","last_fullsized":"2024-09-12T18:36:49.858448+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'45","last_scrub_stamp":"2024-09-12T18:36:49.858092+0000","last_deep_scrub":"268'45","last_deep_scrub_stamp":"2024-09-12T18:36:49.858092+0000","last_clean_scrub_stamp":"2024-09-12T18:36:49.858092+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:48.927678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":157,"num_write":84,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:02.944628+0000","last_change":"2024-09-12T18:37:02.944628+0000","last_active":"2024-09-12T18:37:02.944628+0000","last_peered":"2024-09-12T18:37:02.944628+0000","last_clean":"2024-09-12T18:37:02.944628+0000","last_became_active":"2024-09-12T17:53:27.173955+0000","last_became_peered":"2024-09-12T17:53:27.173955+0000","last_unstale":"2024-09-12T18:37:02.944628+0000","last_undegraded":"2024-09-12T18:37:02.944628+0000","last_fullsized":"2024-09-12T18:37:02.944628+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:02.944441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:02.944441+0000","last_clean_scrub_stamp":"2024-09-12T18:37:02.944441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:29.016664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:56.140478+0000","last_change":"2024-09-12T18:36:56.140478+0000","last_active":"2024-09-12T18:36:56.140478+0000","last_peered":"2024-09-12T18:36:56.140478+0000","last_clean":"2024-09-12T18:36:56.140478+0000","last_became_active":"2024-09-12T17:31:16.231516+0000","last_became_peered":"2024-09-12T17:31:16.231516+0000","last_unstale":"2024-09-12T18:36:56.140478+0000","last_undegraded":"2024-09-12T18:36:56.140478+0000","last_fullsized":"2024-09-12T18:36:56.140478+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:36:56.140291+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:36:56.140291+0000","last_clean_scrub_stamp":"2024-09-12T18:36:56.140291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:57.236044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.786963+0000","last_change":"2024-09-12T18:36:43.786963+0000","last_active":"2024-09-12T18:36:43.786963+0000","last_peered":"2024-09-12T18:36:43.786963+0000","last_clean":"2024-09-12T18:36:43.786963+0000","last_became_active":"2024-09-12T17:31:12.084158+0000","last_became_peered":"2024-09-12T17:31:12.084158+0000","last_unstale":"2024-09-12T18:36:43.786963+0000","last_undegraded":"2024-09-12T18:36:43.786963+0000","last_fullsized":"2024-09-12T18:36:43.786963+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:43.786777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:43.786777+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.786777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:32.037462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'55","reported_seq":220,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.142986+0000","last_change":"2024-09-12T18:36:33.142834+0000","last_active":"2024-09-12T18:36:33.142986+0000","last_peered":"2024-09-12T18:36:33.142986+0000","last_clean":"2024-09-12T18:36:33.142986+0000","last_became_active":"2024-09-12T17:27:32.569924+0000","last_became_peered":"2024-09-12T17:27:32.569924+0000","last_unstale":"2024-09-12T18:36:33.142986+0000","last_undegraded":"2024-09-12T18:36:33.142986+0000","last_fullsized":"2024-09-12T18:36:33.142986+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'55","last_scrub_stamp":"2024-09-12T18:36:33.142657+0000","last_deep_scrub":"268'55","last_deep_scrub_stamp":"2024-09-12T18:36:33.142657+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.142657+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:06.255940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":184,"num_write":101,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:57.141981+0000","last_change":"2024-09-12T18:36:57.141981+0000","last_active":"2024-09-12T18:36:57.141981+0000","last_peered":"2024-09-12T18:36:57.141981+0000","last_clean":"2024-09-12T18:36:57.141981+0000","last_became_active":"2024-09-12T17:53:27.162527+0000","last_became_peered":"2024-09-12T17:53:27.162527+0000","last_unstale":"2024-09-12T18:36:57.141981+0000","last_undegraded":"2024-09-12T18:36:57.141981+0000","last_fullsized":"2024-09-12T18:36:57.141981+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:57.141797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:57.141797+0000","last_clean_scrub_stamp":"2024-09-12T18:36:57.141797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:58.781741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:58.960949+0000","last_change":"2024-09-12T18:36:58.960949+0000","last_active":"2024-09-12T18:36:58.960949+0000","last_peered":"2024-09-12T18:36:58.960949+0000","last_clean":"2024-09-12T18:36:58.960949+0000","last_became_active":"2024-09-12T17:31:16.244556+0000","last_became_peered":"2024-09-12T17:31:16.244556+0000","last_unstale":"2024-09-12T18:36:58.960949+0000","last_undegraded":"2024-09-12T18:36:58.960949+0000","last_fullsized":"2024-09-12T18:36:58.960949+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:36:58.960757+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:36:58.960757+0000","last_clean_scrub_stamp":"2024-09-12T18:36:58.960757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:34.152942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'7","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:51.137506+0000","last_change":"2024-09-12T18:36:51.137506+0000","last_active":"2024-09-12T18:36:51.137506+0000","last_peered":"2024-09-12T18:36:51.137506+0000","last_clean":"2024-09-12T18:36:51.137506+0000","last_became_active":"2024-09-12T17:31:12.081025+0000","last_became_peered":"2024-09-12T17:31:12.081025+0000","last_unstale":"2024-09-12T18:36:51.137506+0000","last_undegraded":"2024-09-12T18:36:51.137506+0000","last_fullsized":"2024-09-12T18:36:51.137506+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T18:36:51.137316+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T18:36:51.137316+0000","last_clean_scrub_stamp":"2024-09-12T18:36:51.137316+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:23.645838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":166,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:47.787700+0000","last_change":"2024-09-12T18:36:47.787543+0000","last_active":"2024-09-12T18:36:47.787700+0000","last_peered":"2024-09-12T18:36:47.787700+0000","last_clean":"2024-09-12T18:36:47.787700+0000","last_became_active":"2024-09-12T17:27:32.561993+0000","last_became_peered":"2024-09-12T17:27:32.561993+0000","last_unstale":"2024-09-12T18:36:47.787700+0000","last_undegraded":"2024-09-12T18:36:47.787700+0000","last_fullsized":"2024-09-12T18:36:47.787700+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'33","last_scrub_stamp":"2024-09-12T18:36:47.787356+0000","last_deep_scrub":"268'33","last_deep_scrub_stamp":"2024-09-12T18:36:47.787356+0000","last_clean_scrub_stamp":"2024-09-12T18:36:47.787356+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:28.183868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":121,"num_write":59,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:53.696842+0000","last_change":"2024-09-12T18:36:53.696842+0000","last_active":"2024-09-12T18:36:53.696842+0000","last_peered":"2024-09-12T18:36:53.696842+0000","last_clean":"2024-09-12T18:36:53.696842+0000","last_became_active":"2024-09-12T17:53:27.153125+0000","last_became_peered":"2024-09-12T17:53:27.153125+0000","last_unstale":"2024-09-12T18:36:53.696842+0000","last_undegraded":"2024-09-12T18:36:53.696842+0000","last_fullsized":"2024-09-12T18:36:53.696842+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:53.696544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:53.696544+0000","last_clean_scrub_stamp":"2024-09-12T18:36:53.696544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:43.920353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'6","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:57.920509+0000","last_change":"2024-09-12T18:36:57.920509+0000","last_active":"2024-09-12T18:36:57.920509+0000","last_peered":"2024-09-12T18:36:57.920509+0000","last_clean":"2024-09-12T18:36:57.920509+0000","last_became_active":"2024-09-12T17:31:16.212330+0000","last_became_peered":"2024-09-12T17:31:16.212330+0000","last_unstale":"2024-09-12T18:36:57.920509+0000","last_undegraded":"2024-09-12T18:36:57.920509+0000","last_fullsized":"2024-09-12T18:36:57.920509+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T18:36:57.920332+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T18:36:57.920332+0000","last_clean_scrub_stamp":"2024-09-12T18:36:57.920332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:12.372696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'2","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.476350+0000","last_change":"2024-09-12T18:36:31.476350+0000","last_active":"2024-09-12T18:36:31.476350+0000","last_peered":"2024-09-12T18:36:31.476350+0000","last_clean":"2024-09-12T18:36:31.476350+0000","last_became_active":"2024-09-12T17:31:12.093752+0000","last_became_peered":"2024-09-12T17:31:12.093752+0000","last_unstale":"2024-09-12T18:36:31.476350+0000","last_undegraded":"2024-09-12T18:36:31.476350+0000","last_fullsized":"2024-09-12T18:36:31.476350+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:36:31.476157+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:36:31.476157+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.476157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:03.620536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"0'0","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.120720+0000","last_change":"2024-09-12T18:36:32.120582+0000","last_active":"2024-09-12T18:36:32.120720+0000","last_peered":"2024-09-12T18:36:32.120720+0000","last_clean":"2024-09-12T18:36:32.120720+0000","last_became_active":"2024-09-12T17:27:32.583070+0000","last_became_peered":"2024-09-12T17:27:32.583070+0000","last_unstale":"2024-09-12T18:36:32.120720+0000","last_undegraded":"2024-09-12T18:36:32.120720+0000","last_fullsized":"2024-09-12T18:36:32.120720+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:32.120403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:32.120403+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.120403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:14.385650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:46.747351+0000","last_change":"2024-09-12T18:36:46.747351+0000","last_active":"2024-09-12T18:36:46.747351+0000","last_peered":"2024-09-12T18:36:46.747351+0000","last_clean":"2024-09-12T18:36:46.747351+0000","last_became_active":"2024-09-12T17:53:27.154309+0000","last_became_peered":"2024-09-12T17:53:27.154309+0000","last_unstale":"2024-09-12T18:36:46.747351+0000","last_undegraded":"2024-09-12T18:36:46.747351+0000","last_fullsized":"2024-09-12T18:36:46.747351+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:46.747166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:46.747166+0000","last_clean_scrub_stamp":"2024-09-12T18:36:46.747166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:56.656299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'8","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:54.125493+0000","last_change":"2024-09-12T18:36:54.125493+0000","last_active":"2024-09-12T18:36:54.125493+0000","last_peered":"2024-09-12T18:36:54.125493+0000","last_clean":"2024-09-12T18:36:54.125493+0000","last_became_active":"2024-09-12T17:31:16.230809+0000","last_became_peered":"2024-09-12T17:31:16.230809+0000","last_unstale":"2024-09-12T18:36:54.125493+0000","last_undegraded":"2024-09-12T18:36:54.125493+0000","last_fullsized":"2024-09-12T18:36:54.125493+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T18:36:54.125315+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T18:36:54.125315+0000","last_clean_scrub_stamp":"2024-09-12T18:36:54.125315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:59.718546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":16386,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"265'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:50.708310+0000","last_change":"2024-09-12T18:36:50.708310+0000","last_active":"2024-09-12T18:36:50.708310+0000","last_peered":"2024-09-12T18:36:50.708310+0000","last_clean":"2024-09-12T18:36:50.708310+0000","last_became_active":"2024-09-12T17:31:12.084101+0000","last_became_peered":"2024-09-12T17:31:12.084101+0000","last_unstale":"2024-09-12T18:36:50.708310+0000","last_undegraded":"2024-09-12T18:36:50.708310+0000","last_fullsized":"2024-09-12T18:36:50.708310+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:36:50.708093+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:36:50.708093+0000","last_clean_scrub_stamp":"2024-09-12T18:36:50.708093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:42.776584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'37","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.035502+0000","last_change":"2024-09-12T18:36:44.035502+0000","last_active":"2024-09-12T18:36:44.035502+0000","last_peered":"2024-09-12T18:36:44.035502+0000","last_clean":"2024-09-12T18:36:44.035502+0000","last_became_active":"2024-09-12T17:27:32.582183+0000","last_became_peered":"2024-09-12T17:27:32.582183+0000","last_unstale":"2024-09-12T18:36:44.035502+0000","last_undegraded":"2024-09-12T18:36:44.035502+0000","last_fullsized":"2024-09-12T18:36:44.035502+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'37","last_scrub_stamp":"2024-09-12T18:36:44.035316+0000","last_deep_scrub":"268'37","last_deep_scrub_stamp":"2024-09-12T18:36:44.035316+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.035316+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:17.715772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":125,"num_write":74,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:53.696529+0000","last_change":"2024-09-12T18:36:53.696529+0000","last_active":"2024-09-12T18:36:53.696529+0000","last_peered":"2024-09-12T18:36:53.696529+0000","last_clean":"2024-09-12T18:36:53.696529+0000","last_became_active":"2024-09-12T17:53:27.159240+0000","last_became_peered":"2024-09-12T17:53:27.159240+0000","last_unstale":"2024-09-12T18:36:53.696529+0000","last_undegraded":"2024-09-12T18:36:53.696529+0000","last_fullsized":"2024-09-12T18:36:53.696529+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:53.696335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:53.696335+0000","last_clean_scrub_stamp":"2024-09-12T18:36:53.696335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:58.794343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'5","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:51.686069+0000","last_change":"2024-09-12T18:36:51.686069+0000","last_active":"2024-09-12T18:36:51.686069+0000","last_peered":"2024-09-12T18:36:51.686069+0000","last_clean":"2024-09-12T18:36:51.686069+0000","last_became_active":"2024-09-12T17:31:16.225754+0000","last_became_peered":"2024-09-12T17:31:16.225754+0000","last_unstale":"2024-09-12T18:36:51.686069+0000","last_undegraded":"2024-09-12T18:36:51.686069+0000","last_fullsized":"2024-09-12T18:36:51.686069+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T18:36:51.685871+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T18:36:51.685871+0000","last_clean_scrub_stamp":"2024-09-12T18:36:51.685871+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:30.555209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:50.117565+0000","last_change":"2024-09-12T18:36:50.117565+0000","last_active":"2024-09-12T18:36:50.117565+0000","last_peered":"2024-09-12T18:36:50.117565+0000","last_clean":"2024-09-12T18:36:50.117565+0000","last_became_active":"2024-09-12T17:31:12.087356+0000","last_became_peered":"2024-09-12T17:31:12.087356+0000","last_unstale":"2024-09-12T18:36:50.117565+0000","last_undegraded":"2024-09-12T18:36:50.117565+0000","last_fullsized":"2024-09-12T18:36:50.117565+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:50.117437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:50.117437+0000","last_clean_scrub_stamp":"2024-09-12T18:36:50.117437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:43.432279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'23","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.806178+0000","last_change":"2024-09-12T18:36:37.806178+0000","last_active":"2024-09-12T18:36:37.806178+0000","last_peered":"2024-09-12T18:36:37.806178+0000","last_clean":"2024-09-12T18:36:37.806178+0000","last_became_active":"2024-09-12T17:27:32.583631+0000","last_became_peered":"2024-09-12T17:27:32.583631+0000","last_unstale":"2024-09-12T18:36:37.806178+0000","last_undegraded":"2024-09-12T18:36:37.806178+0000","last_fullsized":"2024-09-12T18:36:37.806178+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'23","last_scrub_stamp":"2024-09-12T18:36:37.805995+0000","last_deep_scrub":"268'23","last_deep_scrub_stamp":"2024-09-12T18:36:37.805995+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.805995+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:50.592369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":83,"num_write":39,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'2","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.392020+0000","last_change":"2024-09-12T18:36:36.391863+0000","last_active":"2024-09-12T18:36:36.392020+0000","last_peered":"2024-09-12T18:36:36.392020+0000","last_clean":"2024-09-12T18:36:36.392020+0000","last_became_active":"2024-09-12T17:53:27.152651+0000","last_became_peered":"2024-09-12T17:53:27.152651+0000","last_unstale":"2024-09-12T18:36:36.392020+0000","last_undegraded":"2024-09-12T18:36:36.392020+0000","last_fullsized":"2024-09-12T18:36:36.392020+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:36.391681+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:36.391681+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.391681+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:30.517267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'9","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.761952+0000","last_change":"2024-09-12T18:36:38.761952+0000","last_active":"2024-09-12T18:36:38.761952+0000","last_peered":"2024-09-12T18:36:38.761952+0000","last_clean":"2024-09-12T18:36:38.761952+0000","last_became_active":"2024-09-12T17:31:16.242981+0000","last_became_peered":"2024-09-12T17:31:16.242981+0000","last_unstale":"2024-09-12T18:36:38.761952+0000","last_undegraded":"2024-09-12T18:36:38.761952+0000","last_fullsized":"2024-09-12T18:36:38.761952+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-09-12T18:36:38.761770+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-09-12T18:36:38.761770+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.761770+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:52.221501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15362,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:48.155757+0000","last_change":"2024-09-12T18:36:48.155757+0000","last_active":"2024-09-12T18:36:48.155757+0000","last_peered":"2024-09-12T18:36:48.155757+0000","last_clean":"2024-09-12T18:36:48.155757+0000","last_became_active":"2024-09-12T17:31:12.097216+0000","last_became_peered":"2024-09-12T17:31:12.097216+0000","last_unstale":"2024-09-12T18:36:48.155757+0000","last_undegraded":"2024-09-12T18:36:48.155757+0000","last_fullsized":"2024-09-12T18:36:48.155757+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:48.155546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:48.155546+0000","last_clean_scrub_stamp":"2024-09-12T18:36:48.155546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:20.194886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'30","reported_seq":152,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:45.811523+0000","last_change":"2024-09-12T18:36:45.811523+0000","last_active":"2024-09-12T18:36:45.811523+0000","last_peered":"2024-09-12T18:36:45.811523+0000","last_clean":"2024-09-12T18:36:45.811523+0000","last_became_active":"2024-09-12T17:27:32.571830+0000","last_became_peered":"2024-09-12T17:27:32.571830+0000","last_unstale":"2024-09-12T18:36:45.811523+0000","last_undegraded":"2024-09-12T18:36:45.811523+0000","last_fullsized":"2024-09-12T18:36:45.811523+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-12T18:36:45.811332+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-12T18:36:45.811332+0000","last_clean_scrub_stamp":"2024-09-12T18:36:45.811332+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:44.077797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":95,"num_write":63,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:04.967955+0000","last_change":"2024-09-12T18:37:04.967955+0000","last_active":"2024-09-12T18:37:04.967955+0000","last_peered":"2024-09-12T18:37:04.967955+0000","last_clean":"2024-09-12T18:37:04.967955+0000","last_became_active":"2024-09-12T17:53:27.163113+0000","last_became_peered":"2024-09-12T17:53:27.163113+0000","last_unstale":"2024-09-12T18:37:04.967955+0000","last_undegraded":"2024-09-12T18:37:04.967955+0000","last_fullsized":"2024-09-12T18:37:04.967955+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:04.967768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:04.967768+0000","last_clean_scrub_stamp":"2024-09-12T18:37:04.967768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:17.462590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:49.738930+0000","last_change":"2024-09-12T18:36:49.738930+0000","last_active":"2024-09-12T18:36:49.738930+0000","last_peered":"2024-09-12T18:36:49.738930+0000","last_clean":"2024-09-12T18:36:49.738930+0000","last_became_active":"2024-09-12T17:31:16.233558+0000","last_became_peered":"2024-09-12T17:31:16.233558+0000","last_unstale":"2024-09-12T18:36:49.738930+0000","last_undegraded":"2024-09-12T18:36:49.738930+0000","last_fullsized":"2024-09-12T18:36:49.738930+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:36:49.738738+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:36:49.738738+0000","last_clean_scrub_stamp":"2024-09-12T18:36:49.738738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:35.975423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'7","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:49.146946+0000","last_change":"2024-09-12T18:36:49.146946+0000","last_active":"2024-09-12T18:36:49.146946+0000","last_peered":"2024-09-12T18:36:49.146946+0000","last_clean":"2024-09-12T18:36:49.146946+0000","last_became_active":"2024-09-12T17:31:12.094159+0000","last_became_peered":"2024-09-12T17:31:12.094159+0000","last_unstale":"2024-09-12T18:36:49.146946+0000","last_undegraded":"2024-09-12T18:36:49.146946+0000","last_fullsized":"2024-09-12T18:36:49.146946+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T18:36:49.146757+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T18:36:49.146757+0000","last_clean_scrub_stamp":"2024-09-12T18:36:49.146757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:17.866885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3074,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'20","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.750473+0000","last_change":"2024-09-12T18:36:44.750473+0000","last_active":"2024-09-12T18:36:44.750473+0000","last_peered":"2024-09-12T18:36:44.750473+0000","last_clean":"2024-09-12T18:36:44.750473+0000","last_became_active":"2024-09-12T17:27:32.595524+0000","last_became_peered":"2024-09-12T17:27:32.595524+0000","last_unstale":"2024-09-12T18:36:44.750473+0000","last_undegraded":"2024-09-12T18:36:44.750473+0000","last_fullsized":"2024-09-12T18:36:44.750473+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-12T18:36:44.750178+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-12T18:36:44.750178+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.750178+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:45.297099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":74,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:00.980139+0000","last_change":"2024-09-12T18:37:00.980139+0000","last_active":"2024-09-12T18:37:00.980139+0000","last_peered":"2024-09-12T18:37:00.980139+0000","last_clean":"2024-09-12T18:37:00.980139+0000","last_became_active":"2024-09-12T17:53:27.175125+0000","last_became_peered":"2024-09-12T17:53:27.175125+0000","last_unstale":"2024-09-12T18:37:00.980139+0000","last_undegraded":"2024-09-12T18:37:00.980139+0000","last_fullsized":"2024-09-12T18:37:00.980139+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:00.979945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:00.979945+0000","last_clean_scrub_stamp":"2024-09-12T18:37:00.979945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:40.813742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'4","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.124702+0000","last_change":"2024-09-12T18:36:39.124702+0000","last_active":"2024-09-12T18:36:39.124702+0000","last_peered":"2024-09-12T18:36:39.124702+0000","last_clean":"2024-09-12T18:36:39.124702+0000","last_became_active":"2024-09-12T17:31:16.211664+0000","last_became_peered":"2024-09-12T17:31:16.211664+0000","last_unstale":"2024-09-12T18:36:39.124702+0000","last_undegraded":"2024-09-12T18:36:39.124702+0000","last_fullsized":"2024-09-12T18:36:39.124702+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:36:39.124513+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:36:39.124513+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.124513+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:43.413810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1069,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'4","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.842623+0000","last_change":"2024-09-12T18:36:35.842623+0000","last_active":"2024-09-12T18:36:35.842623+0000","last_peered":"2024-09-12T18:36:35.842623+0000","last_clean":"2024-09-12T18:36:35.842623+0000","last_became_active":"2024-09-12T17:31:12.099608+0000","last_became_peered":"2024-09-12T17:31:12.099608+0000","last_unstale":"2024-09-12T18:36:35.842623+0000","last_undegraded":"2024-09-12T18:36:35.842623+0000","last_fullsized":"2024-09-12T18:36:35.842623+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:35.842447+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:35.842447+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.842447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:21.122228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'56","reported_seq":227,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.126507+0000","last_change":"2024-09-12T18:36:31.126507+0000","last_active":"2024-09-12T18:36:31.126507+0000","last_peered":"2024-09-12T18:36:31.126507+0000","last_clean":"2024-09-12T18:36:31.126507+0000","last_became_active":"2024-09-12T17:27:32.568785+0000","last_became_peered":"2024-09-12T17:27:32.568785+0000","last_unstale":"2024-09-12T18:36:31.126507+0000","last_undegraded":"2024-09-12T18:36:31.126507+0000","last_fullsized":"2024-09-12T18:36:31.126507+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'56","last_scrub_stamp":"2024-09-12T18:36:31.126325+0000","last_deep_scrub":"268'56","last_deep_scrub_stamp":"2024-09-12T18:36:31.126325+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.126325+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:42.729615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":196,"num_write":113,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:58.112943+0000","last_change":"2024-09-12T18:36:58.112943+0000","last_active":"2024-09-12T18:36:58.112943+0000","last_peered":"2024-09-12T18:36:58.112943+0000","last_clean":"2024-09-12T18:36:58.112943+0000","last_became_active":"2024-09-12T17:53:27.175073+0000","last_became_peered":"2024-09-12T17:53:27.175073+0000","last_unstale":"2024-09-12T18:36:58.112943+0000","last_undegraded":"2024-09-12T18:36:58.112943+0000","last_fullsized":"2024-09-12T18:36:58.112943+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:58.112768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:58.112768+0000","last_clean_scrub_stamp":"2024-09-12T18:36:58.112768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:45.986059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:48.730577+0000","last_change":"2024-09-12T18:36:48.730577+0000","last_active":"2024-09-12T18:36:48.730577+0000","last_peered":"2024-09-12T18:36:48.730577+0000","last_clean":"2024-09-12T18:36:48.730577+0000","last_became_active":"2024-09-12T17:31:16.228416+0000","last_became_peered":"2024-09-12T17:31:16.228416+0000","last_unstale":"2024-09-12T18:36:48.730577+0000","last_undegraded":"2024-09-12T18:36:48.730577+0000","last_fullsized":"2024-09-12T18:36:48.730577+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:48.730397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:48.730397+0000","last_clean_scrub_stamp":"2024-09-12T18:36:48.730397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:48.038132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.155671+0000","last_change":"2024-09-12T18:36:37.155671+0000","last_active":"2024-09-12T18:36:37.155671+0000","last_peered":"2024-09-12T18:36:37.155671+0000","last_clean":"2024-09-12T18:36:37.155671+0000","last_became_active":"2024-09-12T17:31:12.088297+0000","last_became_peered":"2024-09-12T17:31:12.088297+0000","last_unstale":"2024-09-12T18:36:37.155671+0000","last_undegraded":"2024-09-12T18:36:37.155671+0000","last_fullsized":"2024-09-12T18:36:37.155671+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:37.155486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:37.155486+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.155486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:32.709238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'16","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.009727+0000","last_change":"2024-09-12T18:36:42.009727+0000","last_active":"2024-09-12T18:36:42.009727+0000","last_peered":"2024-09-12T18:36:42.009727+0000","last_clean":"2024-09-12T18:36:42.009727+0000","last_became_active":"2024-09-12T17:27:32.584404+0000","last_became_peered":"2024-09-12T17:27:32.584404+0000","last_unstale":"2024-09-12T18:36:42.009727+0000","last_undegraded":"2024-09-12T18:36:42.009727+0000","last_fullsized":"2024-09-12T18:36:42.009727+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-09-12T18:36:42.009525+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-09-12T18:36:42.009525+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.009525+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:08.730069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":55,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'315","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.951082+0000","last_change":"2024-09-12T18:36:20.951082+0000","last_active":"2024-09-12T18:36:20.951082+0000","last_peered":"2024-09-12T18:36:20.951082+0000","last_clean":"2024-09-12T18:36:20.951082+0000","last_became_active":"2024-09-12T17:10:30.407181+0000","last_became_peered":"2024-09-12T17:10:30.407181+0000","last_unstale":"2024-09-12T18:36:20.951082+0000","last_undegraded":"2024-09-12T18:36:20.951082+0000","last_fullsized":"2024-09-12T18:36:20.951082+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'315","last_scrub_stamp":"2024-09-12T18:36:20.950828+0000","last_deep_scrub":"268'315","last_deep_scrub_stamp":"2024-09-12T18:36:20.950828+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.950828+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:01.236915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262204,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":478,"num_read_kb":10655,"num_write":917,"num_write_kb":47496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'781","reported_seq":2322,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.976956+0000","last_change":"2024-09-12T18:36:23.976956+0000","last_active":"2024-09-12T18:36:23.976956+0000","last_peered":"2024-09-12T18:36:23.976956+0000","last_clean":"2024-09-12T18:36:23.976956+0000","last_became_active":"2024-09-12T17:10:32.346911+0000","last_became_peered":"2024-09-12T17:10:32.346911+0000","last_unstale":"2024-09-12T18:36:23.976956+0000","last_undegraded":"2024-09-12T18:36:23.976956+0000","last_fullsized":"2024-09-12T18:36:23.976956+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'781","last_scrub_stamp":"2024-09-12T18:36:23.976864+0000","last_deep_scrub":"268'781","last_deep_scrub_stamp":"2024-09-12T18:36:23.976864+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.976864+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:06.388928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3659,"num_read_kb":3307,"num_write":1011,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'379","reported_seq":1102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.899907+0000","last_change":"2024-09-12T18:36:14.899907+0000","last_active":"2024-09-12T18:36:14.899907+0000","last_peered":"2024-09-12T18:36:14.899907+0000","last_clean":"2024-09-12T18:36:14.899907+0000","last_became_active":"2024-09-12T17:10:30.405515+0000","last_became_peered":"2024-09-12T17:10:30.405515+0000","last_unstale":"2024-09-12T18:36:14.899907+0000","last_undegraded":"2024-09-12T18:36:14.899907+0000","last_fullsized":"2024-09-12T18:36:14.899907+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'379","last_scrub_stamp":"2024-09-12T18:36:14.899603+0000","last_deep_scrub":"268'379","last_deep_scrub_stamp":"2024-09-12T18:36:14.899603+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.899603+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:27.598354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262215,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":661,"num_read_kb":13611,"num_write":1216,"num_write_kb":42248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'456","reported_seq":1944,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.985655+0000","last_change":"2024-09-12T18:36:23.985655+0000","last_active":"2024-09-12T18:36:23.985655+0000","last_peered":"2024-09-12T18:36:23.985655+0000","last_clean":"2024-09-12T18:36:23.985655+0000","last_became_active":"2024-09-12T17:10:32.375908+0000","last_became_peered":"2024-09-12T17:10:32.375908+0000","last_unstale":"2024-09-12T18:36:23.985655+0000","last_undegraded":"2024-09-12T18:36:23.985655+0000","last_fullsized":"2024-09-12T18:36:23.985655+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'456","last_scrub_stamp":"2024-09-12T18:36:23.985573+0000","last_deep_scrub":"268'456","last_deep_scrub_stamp":"2024-09-12T18:36:23.985573+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.985573+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:23.461123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2460,"num_read_kb":2294,"num_write":575,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'368","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.537548+0000","last_change":"2024-09-12T18:36:15.537548+0000","last_active":"2024-09-12T18:36:15.537548+0000","last_peered":"2024-09-12T18:36:15.537548+0000","last_clean":"2024-09-12T18:36:15.537548+0000","last_became_active":"2024-09-12T17:10:30.351202+0000","last_became_peered":"2024-09-12T17:10:30.351202+0000","last_unstale":"2024-09-12T18:36:15.537548+0000","last_undegraded":"2024-09-12T18:36:15.537548+0000","last_fullsized":"2024-09-12T18:36:15.537548+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'368","last_scrub_stamp":"2024-09-12T18:36:15.537307+0000","last_deep_scrub":"268'368","last_deep_scrub_stamp":"2024-09-12T18:36:15.537307+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.537307+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:11.681842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":96764,"num_write":1045,"num_write_kb":52334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'562","reported_seq":2206,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.865091+0000","last_change":"2024-09-12T18:36:28.865091+0000","last_active":"2024-09-12T18:36:28.865091+0000","last_peered":"2024-09-12T18:36:28.865091+0000","last_clean":"2024-09-12T18:36:28.865091+0000","last_became_active":"2024-09-12T17:10:32.370962+0000","last_became_peered":"2024-09-12T17:10:32.370962+0000","last_unstale":"2024-09-12T18:36:28.865091+0000","last_undegraded":"2024-09-12T18:36:28.865091+0000","last_fullsized":"2024-09-12T18:36:28.865091+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'562","last_scrub_stamp":"2024-09-12T18:36:28.864895+0000","last_deep_scrub":"268'562","last_deep_scrub_stamp":"2024-09-12T18:36:28.864895+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.864895+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:41.919276+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2855,"num_read_kb":2656,"num_write":715,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1728,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'407","reported_seq":1142,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.964675+0000","last_change":"2024-09-12T18:36:20.964533+0000","last_active":"2024-09-12T18:36:20.964675+0000","last_peered":"2024-09-12T18:36:20.964675+0000","last_clean":"2024-09-12T18:36:20.964675+0000","last_became_active":"2024-09-12T17:10:30.374789+0000","last_became_peered":"2024-09-12T17:10:30.374789+0000","last_unstale":"2024-09-12T18:36:20.964675+0000","last_undegraded":"2024-09-12T18:36:20.964675+0000","last_fullsized":"2024-09-12T18:36:20.964675+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'407","last_scrub_stamp":"2024-09-12T18:36:20.964301+0000","last_deep_scrub":"268'407","last_deep_scrub_stamp":"2024-09-12T18:36:20.964301+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.964301+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:34.996196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267453,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":786,"num_read_kb":12016,"num_write":1261,"num_write_kb":48882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'289","reported_seq":1686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.595129+0000","last_change":"2024-09-12T18:36:23.595129+0000","last_active":"2024-09-12T18:36:23.595129+0000","last_peered":"2024-09-12T18:36:23.595129+0000","last_clean":"2024-09-12T18:36:23.595129+0000","last_became_active":"2024-09-12T17:10:32.357199+0000","last_became_peered":"2024-09-12T17:10:32.357199+0000","last_unstale":"2024-09-12T18:36:23.595129+0000","last_undegraded":"2024-09-12T18:36:23.595129+0000","last_fullsized":"2024-09-12T18:36:23.595129+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'289","last_scrub_stamp":"2024-09-12T18:36:23.594944+0000","last_deep_scrub":"268'289","last_deep_scrub_stamp":"2024-09-12T18:36:23.594944+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.594944+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:43.920636+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1623,"num_read_kb":1593,"num_write":300,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'311","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.900501+0000","last_change":"2024-09-12T18:36:18.900501+0000","last_active":"2024-09-12T18:36:18.900501+0000","last_peered":"2024-09-12T18:36:18.900501+0000","last_clean":"2024-09-12T18:36:18.900501+0000","last_became_active":"2024-09-12T17:10:30.385216+0000","last_became_peered":"2024-09-12T17:10:30.385216+0000","last_unstale":"2024-09-12T18:36:18.900501+0000","last_undegraded":"2024-09-12T18:36:18.900501+0000","last_fullsized":"2024-09-12T18:36:18.900501+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'311","last_scrub_stamp":"2024-09-12T18:36:18.900301+0000","last_deep_scrub":"268'311","last_deep_scrub_stamp":"2024-09-12T18:36:18.900301+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.900301+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:13.169294+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1826375,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":401,"num_read_kb":5414,"num_write":926,"num_write_kb":15383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'551","reported_seq":2133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.076802+0000","last_change":"2024-09-12T18:36:18.076590+0000","last_active":"2024-09-12T18:36:18.076802+0000","last_peered":"2024-09-12T18:36:18.076802+0000","last_clean":"2024-09-12T18:36:18.076802+0000","last_became_active":"2024-09-12T17:10:32.351972+0000","last_became_peered":"2024-09-12T17:10:32.351972+0000","last_unstale":"2024-09-12T18:36:18.076802+0000","last_undegraded":"2024-09-12T18:36:18.076802+0000","last_fullsized":"2024-09-12T18:36:18.076802+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'551","last_scrub_stamp":"2024-09-12T18:36:18.076367+0000","last_deep_scrub":"268'551","last_deep_scrub_stamp":"2024-09-12T18:36:18.076367+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.076367+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:24.496910+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2788,"num_read_kb":2550,"num_write":700,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'360","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.946134+0000","last_change":"2024-09-12T18:36:18.946134+0000","last_active":"2024-09-12T18:36:18.946134+0000","last_peered":"2024-09-12T18:36:18.946134+0000","last_clean":"2024-09-12T18:36:18.946134+0000","last_became_active":"2024-09-12T17:10:30.350813+0000","last_became_peered":"2024-09-12T17:10:30.350813+0000","last_unstale":"2024-09-12T18:36:18.946134+0000","last_undegraded":"2024-09-12T18:36:18.946134+0000","last_fullsized":"2024-09-12T18:36:18.946134+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'360","last_scrub_stamp":"2024-09-12T18:36:18.945828+0000","last_deep_scrub":"268'360","last_deep_scrub_stamp":"2024-09-12T18:36:18.945828+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.945828+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:55.758222+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":527,"num_read_kb":3741,"num_write":1103,"num_write_kb":26406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'435","reported_seq":2157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.903357+0000","last_change":"2024-09-12T18:36:25.903357+0000","last_active":"2024-09-12T18:36:25.903357+0000","last_peered":"2024-09-12T18:36:25.903357+0000","last_clean":"2024-09-12T18:36:25.903357+0000","last_became_active":"2024-09-12T17:10:32.362980+0000","last_became_peered":"2024-09-12T17:10:32.362980+0000","last_unstale":"2024-09-12T18:36:25.903357+0000","last_undegraded":"2024-09-12T18:36:25.903357+0000","last_fullsized":"2024-09-12T18:36:25.903357+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'435","last_scrub_stamp":"2024-09-12T18:36:25.903163+0000","last_deep_scrub":"268'435","last_deep_scrub_stamp":"2024-09-12T18:36:25.903163+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.903163+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:46.137958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2502,"num_read_kb":2403,"num_write":488,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2554,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'356","reported_seq":1261,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.924979+0000","last_change":"2024-09-12T18:36:17.924979+0000","last_active":"2024-09-12T18:36:17.924979+0000","last_peered":"2024-09-12T18:36:17.924979+0000","last_clean":"2024-09-12T18:36:17.924979+0000","last_became_active":"2024-09-12T17:11:04.870569+0000","last_became_peered":"2024-09-12T17:11:04.870569+0000","last_unstale":"2024-09-12T18:36:17.924979+0000","last_undegraded":"2024-09-12T18:36:17.924979+0000","last_fullsized":"2024-09-12T18:36:17.924979+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'356","last_scrub_stamp":"2024-09-12T18:36:17.924678+0000","last_deep_scrub":"268'356","last_deep_scrub_stamp":"2024-09-12T18:36:17.924678+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.924678+0000","objects_scrubbed":10,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.128171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170424,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":989,"num_read_kb":89437,"num_write":1208,"num_write_kb":38550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'429","reported_seq":1952,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.943654+0000","last_change":"2024-09-12T18:36:27.943654+0000","last_active":"2024-09-12T18:36:27.943654+0000","last_peered":"2024-09-12T18:36:27.943654+0000","last_clean":"2024-09-12T18:36:27.943654+0000","last_became_active":"2024-09-12T17:10:32.368909+0000","last_became_peered":"2024-09-12T17:10:32.368909+0000","last_unstale":"2024-09-12T18:36:27.943654+0000","last_undegraded":"2024-09-12T18:36:27.943654+0000","last_fullsized":"2024-09-12T18:36:27.943654+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'429","last_scrub_stamp":"2024-09-12T18:36:27.943422+0000","last_deep_scrub":"268'429","last_deep_scrub_stamp":"2024-09-12T18:36:27.943422+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.943422+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:14.861878+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2227,"num_read_kb":2101,"num_write":505,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'392","reported_seq":1066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.853233+0000","last_change":"2024-09-12T18:36:15.853233+0000","last_active":"2024-09-12T18:36:15.853233+0000","last_peered":"2024-09-12T18:36:15.853233+0000","last_clean":"2024-09-12T18:36:15.853233+0000","last_became_active":"2024-09-12T17:10:30.395061+0000","last_became_peered":"2024-09-12T17:10:30.395061+0000","last_unstale":"2024-09-12T18:36:15.853233+0000","last_undegraded":"2024-09-12T18:36:15.853233+0000","last_fullsized":"2024-09-12T18:36:15.853233+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'392","last_scrub_stamp":"2024-09-12T18:36:15.853009+0000","last_deep_scrub":"268'392","last_deep_scrub_stamp":"2024-09-12T18:36:15.853009+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.853009+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:30.721888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194335,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":651,"num_read_kb":20153,"num_write":1153,"num_write_kb":23715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'422","reported_seq":1792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.446660+0000","last_change":"2024-09-12T18:36:19.446660+0000","last_active":"2024-09-12T18:36:19.446660+0000","last_peered":"2024-09-12T18:36:19.446660+0000","last_clean":"2024-09-12T18:36:19.446660+0000","last_became_active":"2024-09-12T17:11:05.124718+0000","last_became_peered":"2024-09-12T17:11:05.124718+0000","last_unstale":"2024-09-12T18:36:19.446660+0000","last_undegraded":"2024-09-12T18:36:19.446660+0000","last_fullsized":"2024-09-12T18:36:19.446660+0000","mapping_epoch":38,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'422","last_scrub_stamp":"2024-09-12T18:36:19.446482+0000","last_deep_scrub":"268'422","last_deep_scrub_stamp":"2024-09-12T18:36:19.446482+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.446482+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:14.866943+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2066,"num_read_kb":1911,"num_write":507,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'655","reported_seq":2402,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.950498+0000","last_change":"2024-09-12T18:36:22.950342+0000","last_active":"2024-09-12T18:36:22.950498+0000","last_peered":"2024-09-12T18:36:22.950498+0000","last_clean":"2024-09-12T18:36:22.950498+0000","last_became_active":"2024-09-12T17:10:32.363179+0000","last_became_peered":"2024-09-12T17:10:32.363179+0000","last_unstale":"2024-09-12T18:36:22.950498+0000","last_undegraded":"2024-09-12T18:36:22.950498+0000","last_fullsized":"2024-09-12T18:36:22.950498+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'655","last_scrub_stamp":"2024-09-12T18:36:22.950172+0000","last_deep_scrub":"268'655","last_deep_scrub_stamp":"2024-09-12T18:36:22.950172+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.950172+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":600,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:34.387389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3427,"num_read_kb":3148,"num_write":833,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'327","reported_seq":1021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.939536+0000","last_change":"2024-09-12T18:36:16.939536+0000","last_active":"2024-09-12T18:36:16.939536+0000","last_peered":"2024-09-12T18:36:16.939536+0000","last_clean":"2024-09-12T18:36:16.939536+0000","last_became_active":"2024-09-12T17:10:30.385785+0000","last_became_peered":"2024-09-12T17:10:30.385785+0000","last_unstale":"2024-09-12T18:36:16.939536+0000","last_undegraded":"2024-09-12T18:36:16.939536+0000","last_fullsized":"2024-09-12T18:36:16.939536+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'327","last_scrub_stamp":"2024-09-12T18:36:16.939330+0000","last_deep_scrub":"268'327","last_deep_scrub_stamp":"2024-09-12T18:36:16.939330+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.939330+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:37.817445+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":51060,"num_write":1041,"num_write_kb":34693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'512","reported_seq":2199,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.981953+0000","last_change":"2024-09-12T18:36:22.981814+0000","last_active":"2024-09-12T18:36:22.981953+0000","last_peered":"2024-09-12T18:36:22.981953+0000","last_clean":"2024-09-12T18:36:22.981953+0000","last_became_active":"2024-09-12T17:10:32.379669+0000","last_became_peered":"2024-09-12T17:10:32.379669+0000","last_unstale":"2024-09-12T18:36:22.981953+0000","last_undegraded":"2024-09-12T18:36:22.981953+0000","last_fullsized":"2024-09-12T18:36:22.981953+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'512","last_scrub_stamp":"2024-09-12T18:36:22.981614+0000","last_deep_scrub":"268'512","last_deep_scrub_stamp":"2024-09-12T18:36:22.981614+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.981614+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:06.503319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2752,"num_read_kb":2572,"num_write":584,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3555,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'342","reported_seq":1004,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.344415+0000","last_change":"2024-09-12T18:36:12.344257+0000","last_active":"2024-09-12T18:36:12.344415+0000","last_peered":"2024-09-12T18:36:12.344415+0000","last_clean":"2024-09-12T18:36:12.344415+0000","last_became_active":"2024-09-12T17:12:05.834873+0000","last_became_peered":"2024-09-12T17:12:05.834873+0000","last_unstale":"2024-09-12T18:36:12.344415+0000","last_undegraded":"2024-09-12T18:36:12.344415+0000","last_fullsized":"2024-09-12T18:36:12.344415+0000","mapping_epoch":40,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-12T18:36:12.344008+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-12T18:36:12.344008+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.344008+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:12.727528+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505043,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":40642,"num_write":1117,"num_write_kb":40250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"268'1947","reported_seq":3546,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.019641+0000","last_change":"2024-09-12T18:36:25.019641+0000","last_active":"2024-09-12T18:36:25.019641+0000","last_peered":"2024-09-12T18:36:25.019641+0000","last_clean":"2024-09-12T18:36:25.019641+0000","last_became_active":"2024-09-12T17:10:32.358342+0000","last_became_peered":"2024-09-12T17:10:32.358342+0000","last_unstale":"2024-09-12T18:36:25.019641+0000","last_undegraded":"2024-09-12T18:36:25.019641+0000","last_fullsized":"2024-09-12T18:36:25.019641+0000","mapping_epoch":27,"log_start":"268'1900","ondisk_log_start":"268'1900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1947","last_scrub_stamp":"2024-09-12T18:36:25.019441+0000","last_deep_scrub":"268'1947","last_deep_scrub_stamp":"2024-09-12T18:36:25.019441+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.019441+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":1900,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:26.178456+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8411,"num_read_kb":7313,"num_write":2747,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1244,"num_omap_keys":5,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'385","reported_seq":1049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.171293+0000","last_change":"2024-09-12T18:36:12.171293+0000","last_active":"2024-09-12T18:36:12.171293+0000","last_peered":"2024-09-12T18:36:12.171293+0000","last_clean":"2024-09-12T18:36:12.171293+0000","last_became_active":"2024-09-12T17:10:30.395938+0000","last_became_peered":"2024-09-12T17:10:30.395938+0000","last_unstale":"2024-09-12T18:36:12.171293+0000","last_undegraded":"2024-09-12T18:36:12.171293+0000","last_fullsized":"2024-09-12T18:36:12.171293+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-12T18:36:12.171022+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-12T18:36:12.171022+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.171022+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:57.800473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":529,"num_read_kb":40778,"num_write":1213,"num_write_kb":34948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'784","reported_seq":2238,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.458241+0000","last_change":"2024-09-12T18:36:17.458241+0000","last_active":"2024-09-12T18:36:17.458241+0000","last_peered":"2024-09-12T18:36:17.458241+0000","last_clean":"2024-09-12T18:36:17.458241+0000","last_became_active":"2024-09-12T17:10:32.354271+0000","last_became_peered":"2024-09-12T17:10:32.354271+0000","last_unstale":"2024-09-12T18:36:17.458241+0000","last_undegraded":"2024-09-12T18:36:17.458241+0000","last_fullsized":"2024-09-12T18:36:17.458241+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'784","last_scrub_stamp":"2024-09-12T18:36:17.458035+0000","last_deep_scrub":"268'784","last_deep_scrub_stamp":"2024-09-12T18:36:17.458035+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.458035+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:22.834719+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3730,"num_read_kb":3333,"num_write":1060,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1463,"num_omap_keys":7,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'534","reported_seq":1291,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.982254+0000","last_change":"2024-09-12T18:36:07.982254+0000","last_active":"2024-09-12T18:36:07.982254+0000","last_peered":"2024-09-12T18:36:07.982254+0000","last_clean":"2024-09-12T18:36:07.982254+0000","last_became_active":"2024-09-12T17:10:30.394905+0000","last_became_peered":"2024-09-12T17:10:30.394905+0000","last_unstale":"2024-09-12T18:36:07.982254+0000","last_undegraded":"2024-09-12T18:36:07.982254+0000","last_fullsized":"2024-09-12T18:36:07.982254+0000","mapping_epoch":25,"log_start":"268'500","ondisk_log_start":"268'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'534","last_scrub_stamp":"2024-09-12T18:36:07.981975+0000","last_deep_scrub":"268'534","last_deep_scrub_stamp":"2024-09-12T18:36:07.981975+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.981975+0000","objects_scrubbed":11,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:02.322234+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4500387,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":948,"num_read_kb":40764,"num_write":1577,"num_write_kb":41950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'789","reported_seq":2390,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.424934+0000","last_change":"2024-09-12T18:36:16.424934+0000","last_active":"2024-09-12T18:36:16.424934+0000","last_peered":"2024-09-12T18:36:16.424934+0000","last_clean":"2024-09-12T18:36:16.424934+0000","last_became_active":"2024-09-12T17:10:32.372137+0000","last_became_peered":"2024-09-12T17:10:32.372137+0000","last_unstale":"2024-09-12T18:36:16.424934+0000","last_undegraded":"2024-09-12T18:36:16.424934+0000","last_fullsized":"2024-09-12T18:36:16.424934+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'789","last_scrub_stamp":"2024-09-12T18:36:16.424682+0000","last_deep_scrub":"268'789","last_deep_scrub_stamp":"2024-09-12T18:36:16.424682+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.424682+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:31.677702+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3748,"num_read_kb":3393,"num_write":1031,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'350","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.873906+0000","last_change":"2024-09-12T18:36:14.873906+0000","last_active":"2024-09-12T18:36:14.873906+0000","last_peered":"2024-09-12T18:36:14.873906+0000","last_clean":"2024-09-12T18:36:14.873906+0000","last_became_active":"2024-09-12T17:10:30.394096+0000","last_became_peered":"2024-09-12T17:10:30.394096+0000","last_unstale":"2024-09-12T18:36:14.873906+0000","last_undegraded":"2024-09-12T18:36:14.873906+0000","last_fullsized":"2024-09-12T18:36:14.873906+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T18:36:14.873700+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T18:36:14.873700+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.873700+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:24.375076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399199,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":10350,"num_write":1046,"num_write_kb":23725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'866","reported_seq":2543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.989539+0000","last_change":"2024-09-12T18:36:21.989539+0000","last_active":"2024-09-12T18:36:21.989539+0000","last_peered":"2024-09-12T18:36:21.989539+0000","last_clean":"2024-09-12T18:36:21.989539+0000","last_became_active":"2024-09-12T17:10:32.361126+0000","last_became_peered":"2024-09-12T17:10:32.361126+0000","last_unstale":"2024-09-12T18:36:21.989539+0000","last_undegraded":"2024-09-12T18:36:21.989539+0000","last_fullsized":"2024-09-12T18:36:21.989539+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'866","last_scrub_stamp":"2024-09-12T18:36:21.989341+0000","last_deep_scrub":"268'866","last_deep_scrub_stamp":"2024-09-12T18:36:21.989341+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.989341+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":800,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:40.716672+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4216,"num_read_kb":3793,"num_write":1162,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'338","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.621464+0000","last_change":"2024-09-12T18:36:12.621286+0000","last_active":"2024-09-12T18:36:12.621464+0000","last_peered":"2024-09-12T18:36:12.621464+0000","last_clean":"2024-09-12T18:36:12.621464+0000","last_became_active":"2024-09-12T17:10:30.353147+0000","last_became_peered":"2024-09-12T17:10:30.353147+0000","last_unstale":"2024-09-12T18:36:12.621464+0000","last_undegraded":"2024-09-12T18:36:12.621464+0000","last_fullsized":"2024-09-12T18:36:12.621464+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'338","last_scrub_stamp":"2024-09-12T18:36:12.621045+0000","last_deep_scrub":"268'338","last_deep_scrub_stamp":"2024-09-12T18:36:12.621045+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.621045+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:05.954192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":416,"num_read_kb":13692,"num_write":1012,"num_write_kb":32545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'138","reported_seq":688,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.757372+0000","last_change":"2024-09-12T18:36:40.757372+0000","last_active":"2024-09-12T18:36:40.757372+0000","last_peered":"2024-09-12T18:36:40.757372+0000","last_clean":"2024-09-12T18:36:40.757372+0000","last_became_active":"2024-09-12T17:10:40.421380+0000","last_became_peered":"2024-09-12T17:10:40.421380+0000","last_unstale":"2024-09-12T18:36:40.757372+0000","last_undegraded":"2024-09-12T18:36:40.757372+0000","last_fullsized":"2024-09-12T18:36:40.757372+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'138","last_scrub_stamp":"2024-09-12T18:36:40.757083+0000","last_deep_scrub":"268'138","last_deep_scrub_stamp":"2024-09-12T18:36:40.757083+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.757083+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:12.153166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":207,"num_write":318,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'457","reported_seq":2079,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.781267+0000","last_change":"2024-09-12T18:36:20.781267+0000","last_active":"2024-09-12T18:36:20.781267+0000","last_peered":"2024-09-12T18:36:20.781267+0000","last_clean":"2024-09-12T18:36:20.781267+0000","last_became_active":"2024-09-12T17:10:32.370058+0000","last_became_peered":"2024-09-12T17:10:32.370058+0000","last_unstale":"2024-09-12T18:36:20.781267+0000","last_undegraded":"2024-09-12T18:36:20.781267+0000","last_fullsized":"2024-09-12T18:36:20.781267+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'457","last_scrub_stamp":"2024-09-12T18:36:20.781035+0000","last_deep_scrub":"268'457","last_deep_scrub_stamp":"2024-09-12T18:36:20.781035+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.781035+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:40.316776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2398,"num_read_kb":2269,"num_write":525,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'310","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.309364+0000","last_change":"2024-09-12T18:36:11.309364+0000","last_active":"2024-09-12T18:36:11.309364+0000","last_peered":"2024-09-12T18:36:11.309364+0000","last_clean":"2024-09-12T18:36:11.309364+0000","last_became_active":"2024-09-12T17:11:04.871007+0000","last_became_peered":"2024-09-12T17:11:04.871007+0000","last_unstale":"2024-09-12T18:36:11.309364+0000","last_undegraded":"2024-09-12T18:36:11.309364+0000","last_fullsized":"2024-09-12T18:36:11.309364+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-12T18:36:11.309154+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-12T18:36:11.309154+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.309154+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:27.380152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":422,"num_read_kb":10233,"num_write":1020,"num_write_kb":32687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.887052+0000","last_change":"2024-09-12T18:36:30.887052+0000","last_active":"2024-09-12T18:36:30.887052+0000","last_peered":"2024-09-12T18:36:30.887052+0000","last_clean":"2024-09-12T18:36:30.887052+0000","last_became_active":"2024-09-12T17:10:34.371022+0000","last_became_peered":"2024-09-12T17:10:34.371022+0000","last_unstale":"2024-09-12T18:36:30.887052+0000","last_undegraded":"2024-09-12T18:36:30.887052+0000","last_fullsized":"2024-09-12T18:36:30.887052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:30.886855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:30.886855+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.886855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:49.121602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'371","reported_seq":1013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.691239+0000","last_change":"2024-09-12T18:36:29.691239+0000","last_active":"2024-09-12T18:36:29.691239+0000","last_peered":"2024-09-12T18:36:29.691239+0000","last_clean":"2024-09-12T18:36:29.691239+0000","last_became_active":"2024-09-12T17:10:36.399464+0000","last_became_peered":"2024-09-12T17:10:36.399464+0000","last_unstale":"2024-09-12T18:36:29.691239+0000","last_undegraded":"2024-09-12T18:36:29.691239+0000","last_fullsized":"2024-09-12T18:36:29.691239+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'371","last_scrub_stamp":"2024-09-12T18:36:29.691048+0000","last_deep_scrub":"268'371","last_deep_scrub_stamp":"2024-09-12T18:36:29.691048+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.691048+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:40.446128+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49246,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":602,"num_read_kb":1286,"num_write":476,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.002847+0000","last_change":"2024-09-12T18:36:40.002847+0000","last_active":"2024-09-12T18:36:40.002847+0000","last_peered":"2024-09-12T18:36:40.002847+0000","last_clean":"2024-09-12T18:36:40.002847+0000","last_became_active":"2024-09-12T17:10:38.404423+0000","last_became_peered":"2024-09-12T17:10:38.404423+0000","last_unstale":"2024-09-12T18:36:40.002847+0000","last_undegraded":"2024-09-12T18:36:40.002847+0000","last_fullsized":"2024-09-12T18:36:40.002847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:40.002666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:40.002666+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.002666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:16.488702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'174","reported_seq":752,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.812941+0000","last_change":"2024-09-12T18:36:44.812941+0000","last_active":"2024-09-12T18:36:44.812941+0000","last_peered":"2024-09-12T18:36:44.812941+0000","last_clean":"2024-09-12T18:36:44.812941+0000","last_became_active":"2024-09-12T17:10:40.425532+0000","last_became_peered":"2024-09-12T17:10:40.425532+0000","last_unstale":"2024-09-12T18:36:44.812941+0000","last_undegraded":"2024-09-12T18:36:44.812941+0000","last_fullsized":"2024-09-12T18:36:44.812941+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'174","last_scrub_stamp":"2024-09-12T18:36:44.812743+0000","last_deep_scrub":"268'174","last_deep_scrub_stamp":"2024-09-12T18:36:44.812743+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.812743+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:34.484903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":265,"num_read_kb":256,"num_write":326,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'734","reported_seq":2472,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.977608+0000","last_change":"2024-09-12T18:36:22.977608+0000","last_active":"2024-09-12T18:36:22.977608+0000","last_peered":"2024-09-12T18:36:22.977608+0000","last_clean":"2024-09-12T18:36:22.977608+0000","last_became_active":"2024-09-12T17:10:32.381838+0000","last_became_peered":"2024-09-12T17:10:32.381838+0000","last_unstale":"2024-09-12T18:36:22.977608+0000","last_undegraded":"2024-09-12T18:36:22.977608+0000","last_fullsized":"2024-09-12T18:36:22.977608+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'734","last_scrub_stamp":"2024-09-12T18:36:22.977435+0000","last_deep_scrub":"268'734","last_deep_scrub_stamp":"2024-09-12T18:36:22.977435+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.977435+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:38.867097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3756,"num_read_kb":3395,"num_write":1068,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'387","reported_seq":1117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.651661+0000","last_change":"2024-09-12T18:36:08.651608+0000","last_active":"2024-09-12T18:36:08.651661+0000","last_peered":"2024-09-12T18:36:08.651661+0000","last_clean":"2024-09-12T18:36:08.651661+0000","last_became_active":"2024-09-12T17:10:30.362010+0000","last_became_peered":"2024-09-12T17:10:30.362010+0000","last_unstale":"2024-09-12T18:36:08.651661+0000","last_undegraded":"2024-09-12T18:36:08.651661+0000","last_fullsized":"2024-09-12T18:36:08.651661+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'387","last_scrub_stamp":"2024-09-12T18:36:08.651489+0000","last_deep_scrub":"268'387","last_deep_scrub_stamp":"2024-09-12T18:36:08.651489+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.651489+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:16.615443+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9667749,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":698,"num_read_kb":52712,"num_write":1418,"num_write_kb":39491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.802895+0000","last_change":"2024-09-12T18:36:27.802895+0000","last_active":"2024-09-12T18:36:27.802895+0000","last_peered":"2024-09-12T18:36:27.802895+0000","last_clean":"2024-09-12T18:36:27.802895+0000","last_became_active":"2024-09-12T17:10:34.361102+0000","last_became_peered":"2024-09-12T17:10:34.361102+0000","last_unstale":"2024-09-12T18:36:27.802895+0000","last_undegraded":"2024-09-12T18:36:27.802895+0000","last_fullsized":"2024-09-12T18:36:27.802895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:27.802698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:27.802698+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.802698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:44.974084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'113","reported_seq":677,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.759671+0000","last_change":"2024-09-12T18:36:32.759671+0000","last_active":"2024-09-12T18:36:32.759671+0000","last_peered":"2024-09-12T18:36:32.759671+0000","last_clean":"2024-09-12T18:36:32.759671+0000","last_became_active":"2024-09-12T17:10:36.390398+0000","last_became_peered":"2024-09-12T17:10:36.390398+0000","last_unstale":"2024-09-12T18:36:32.759671+0000","last_undegraded":"2024-09-12T18:36:32.759671+0000","last_fullsized":"2024-09-12T18:36:32.759671+0000","mapping_epoch":31,"log_start":"268'101","ondisk_log_start":"268'101","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'113","last_scrub_stamp":"2024-09-12T18:36:32.759435+0000","last_deep_scrub":"268'113","last_deep_scrub_stamp":"2024-09-12T18:36:32.759435+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.759435+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":101,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:52.362289+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.750447+0000","last_change":"2024-09-12T18:36:37.750447+0000","last_active":"2024-09-12T18:36:37.750447+0000","last_peered":"2024-09-12T18:36:37.750447+0000","last_clean":"2024-09-12T18:36:37.750447+0000","last_became_active":"2024-09-12T17:10:38.414063+0000","last_became_peered":"2024-09-12T17:10:38.414063+0000","last_unstale":"2024-09-12T18:36:37.750447+0000","last_undegraded":"2024-09-12T18:36:37.750447+0000","last_fullsized":"2024-09-12T18:36:37.750447+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:37.750266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:37.750266+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.750266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:40.593091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'143","reported_seq":669,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.718607+0000","last_change":"2024-09-12T18:36:42.718607+0000","last_active":"2024-09-12T18:36:42.718607+0000","last_peered":"2024-09-12T18:36:42.718607+0000","last_clean":"2024-09-12T18:36:42.718607+0000","last_became_active":"2024-09-12T17:10:40.422118+0000","last_became_peered":"2024-09-12T17:10:40.422118+0000","last_unstale":"2024-09-12T18:36:42.718607+0000","last_undegraded":"2024-09-12T18:36:42.718607+0000","last_fullsized":"2024-09-12T18:36:42.718607+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'143","last_scrub_stamp":"2024-09-12T18:36:42.718415+0000","last_deep_scrub":"268'143","last_deep_scrub_stamp":"2024-09-12T18:36:42.718415+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.718415+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:22.743040+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":180,"num_write":349,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'874","reported_seq":2504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.499729+0000","last_change":"2024-09-12T18:36:16.499729+0000","last_active":"2024-09-12T18:36:16.499729+0000","last_peered":"2024-09-12T18:36:16.499729+0000","last_clean":"2024-09-12T18:36:16.499729+0000","last_became_active":"2024-09-12T17:10:32.351650+0000","last_became_peered":"2024-09-12T17:10:32.351650+0000","last_unstale":"2024-09-12T18:36:16.499729+0000","last_undegraded":"2024-09-12T18:36:16.499729+0000","last_fullsized":"2024-09-12T18:36:16.499729+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'874","last_scrub_stamp":"2024-09-12T18:36:16.499553+0000","last_deep_scrub":"268'874","last_deep_scrub_stamp":"2024-09-12T18:36:16.499553+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.499553+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:08.094193+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4313,"num_read_kb":3885,"num_write":1184,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'394","reported_seq":1138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.970241+0000","last_change":"2024-09-12T18:36:13.970009+0000","last_active":"2024-09-12T18:36:13.970241+0000","last_peered":"2024-09-12T18:36:13.970241+0000","last_clean":"2024-09-12T18:36:13.970241+0000","last_became_active":"2024-09-12T17:10:30.393670+0000","last_became_peered":"2024-09-12T17:10:30.393670+0000","last_unstale":"2024-09-12T18:36:13.970241+0000","last_undegraded":"2024-09-12T18:36:13.970241+0000","last_fullsized":"2024-09-12T18:36:13.970241+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T18:36:13.969732+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T18:36:13.969732+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.969732+0000","objects_scrubbed":10,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:08.366310+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3976825,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":785,"num_read_kb":43186,"num_write":1227,"num_write_kb":22438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.856938+0000","last_change":"2024-09-12T18:36:29.856938+0000","last_active":"2024-09-12T18:36:29.856938+0000","last_peered":"2024-09-12T18:36:29.856938+0000","last_clean":"2024-09-12T18:36:29.856938+0000","last_became_active":"2024-09-12T17:10:34.358119+0000","last_became_peered":"2024-09-12T17:10:34.358119+0000","last_unstale":"2024-09-12T18:36:29.856938+0000","last_undegraded":"2024-09-12T18:36:29.856938+0000","last_fullsized":"2024-09-12T18:36:29.856938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:29.856757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:29.856757+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.856757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:50.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'157","reported_seq":740,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.490927+0000","last_change":"2024-09-12T18:36:24.490785+0000","last_active":"2024-09-12T18:36:24.490927+0000","last_peered":"2024-09-12T18:36:24.490927+0000","last_clean":"2024-09-12T18:36:24.490927+0000","last_became_active":"2024-09-12T17:10:36.384465+0000","last_became_peered":"2024-09-12T17:10:36.384465+0000","last_unstale":"2024-09-12T18:36:24.490927+0000","last_undegraded":"2024-09-12T18:36:24.490927+0000","last_fullsized":"2024-09-12T18:36:24.490927+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'157","last_scrub_stamp":"2024-09-12T18:36:24.490568+0000","last_deep_scrub":"268'157","last_deep_scrub_stamp":"2024-09-12T18:36:24.490568+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.490568+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:59.451113+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":178,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'795","reported_seq":2929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.010486+0000","last_change":"2024-09-12T18:36:38.010486+0000","last_active":"2024-09-12T18:36:38.010486+0000","last_peered":"2024-09-12T18:36:38.010486+0000","last_clean":"2024-09-12T18:36:38.010486+0000","last_became_active":"2024-09-12T17:10:38.406964+0000","last_became_peered":"2024-09-12T17:10:38.406964+0000","last_unstale":"2024-09-12T18:36:38.010486+0000","last_undegraded":"2024-09-12T18:36:38.010486+0000","last_fullsized":"2024-09-12T18:36:38.010486+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'795","last_scrub_stamp":"2024-09-12T18:36:38.010307+0000","last_deep_scrub":"268'795","last_deep_scrub_stamp":"2024-09-12T18:36:38.010307+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.010307+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:19.069357+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'257","reported_seq":1122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.773012+0000","last_change":"2024-09-12T18:36:41.773012+0000","last_active":"2024-09-12T18:36:41.773012+0000","last_peered":"2024-09-12T18:36:41.773012+0000","last_clean":"2024-09-12T18:36:41.773012+0000","last_became_active":"2024-09-12T17:10:40.768896+0000","last_became_peered":"2024-09-12T17:10:40.768896+0000","last_unstale":"2024-09-12T18:36:41.773012+0000","last_undegraded":"2024-09-12T18:36:41.773012+0000","last_fullsized":"2024-09-12T18:36:41.773012+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'257","last_scrub_stamp":"2024-09-12T18:36:41.772831+0000","last_deep_scrub":"268'257","last_deep_scrub_stamp":"2024-09-12T18:36:41.772831+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.772831+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:20.614751+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":705,"num_read_kb":685,"num_write":456,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'534","reported_seq":2346,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.817370+0000","last_change":"2024-09-12T18:36:19.817370+0000","last_active":"2024-09-12T18:36:19.817370+0000","last_peered":"2024-09-12T18:36:19.817370+0000","last_clean":"2024-09-12T18:36:19.817370+0000","last_became_active":"2024-09-12T17:10:32.382671+0000","last_became_peered":"2024-09-12T17:10:32.382671+0000","last_unstale":"2024-09-12T18:36:19.817370+0000","last_undegraded":"2024-09-12T18:36:19.817370+0000","last_fullsized":"2024-09-12T18:36:19.817370+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'534","last_scrub_stamp":"2024-09-12T18:36:19.817166+0000","last_deep_scrub":"268'534","last_deep_scrub_stamp":"2024-09-12T18:36:19.817166+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.817166+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:25.307712+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3129,"num_read_kb":2937,"num_write":633,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3101,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'384","reported_seq":1069,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.175550+0000","last_change":"2024-09-12T18:36:09.175322+0000","last_active":"2024-09-12T18:36:09.175550+0000","last_peered":"2024-09-12T18:36:09.175550+0000","last_clean":"2024-09-12T18:36:09.175550+0000","last_became_active":"2024-09-12T17:10:30.390677+0000","last_became_peered":"2024-09-12T17:10:30.390677+0000","last_unstale":"2024-09-12T18:36:09.175550+0000","last_undegraded":"2024-09-12T18:36:09.175550+0000","last_fullsized":"2024-09-12T18:36:09.175550+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'384","last_scrub_stamp":"2024-09-12T18:36:09.175054+0000","last_deep_scrub":"268'384","last_deep_scrub_stamp":"2024-09-12T18:36:09.175054+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.175054+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:54.543850+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262215,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":587,"num_read_kb":63186,"num_write":1131,"num_write_kb":46639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.849515+0000","last_change":"2024-09-12T18:36:31.849515+0000","last_active":"2024-09-12T18:36:31.849515+0000","last_peered":"2024-09-12T18:36:31.849515+0000","last_clean":"2024-09-12T18:36:31.849515+0000","last_became_active":"2024-09-12T17:10:34.371937+0000","last_became_peered":"2024-09-12T17:10:34.371937+0000","last_unstale":"2024-09-12T18:36:31.849515+0000","last_undegraded":"2024-09-12T18:36:31.849515+0000","last_fullsized":"2024-09-12T18:36:31.849515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:31.849247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:31.849247+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.849247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:45.208680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'323","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.949245+0000","last_change":"2024-09-12T18:36:33.949245+0000","last_active":"2024-09-12T18:36:33.949245+0000","last_peered":"2024-09-12T18:36:33.949245+0000","last_clean":"2024-09-12T18:36:33.949245+0000","last_became_active":"2024-09-12T17:10:36.920487+0000","last_became_peered":"2024-09-12T17:10:36.920487+0000","last_unstale":"2024-09-12T18:36:33.949245+0000","last_undegraded":"2024-09-12T18:36:33.949245+0000","last_fullsized":"2024-09-12T18:36:33.949245+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'323","last_scrub_stamp":"2024-09-12T18:36:33.949047+0000","last_deep_scrub":"268'323","last_deep_scrub_stamp":"2024-09-12T18:36:33.949047+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.949047+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:14.235888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46675,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":545,"num_read_kb":1308,"num_write":450,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'809","reported_seq":2825,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.969480+0000","last_change":"2024-09-12T18:36:40.969480+0000","last_active":"2024-09-12T18:36:40.969480+0000","last_peered":"2024-09-12T18:36:40.969480+0000","last_clean":"2024-09-12T18:36:40.969480+0000","last_became_active":"2024-09-12T17:10:38.393524+0000","last_became_peered":"2024-09-12T17:10:38.393524+0000","last_unstale":"2024-09-12T18:36:40.969480+0000","last_undegraded":"2024-09-12T18:36:40.969480+0000","last_fullsized":"2024-09-12T18:36:40.969480+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'809","last_scrub_stamp":"2024-09-12T18:36:40.969247+0000","last_deep_scrub":"268'809","last_deep_scrub_stamp":"2024-09-12T18:36:40.969247+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.969247+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:00.549255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'402","reported_seq":1979,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.984204+0000","last_change":"2024-09-12T18:36:21.984204+0000","last_active":"2024-09-12T18:36:21.984204+0000","last_peered":"2024-09-12T18:36:21.984204+0000","last_clean":"2024-09-12T18:36:21.984204+0000","last_became_active":"2024-09-12T17:10:32.378027+0000","last_became_peered":"2024-09-12T17:10:32.378027+0000","last_unstale":"2024-09-12T18:36:21.984204+0000","last_undegraded":"2024-09-12T18:36:21.984204+0000","last_fullsized":"2024-09-12T18:36:21.984204+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'402","last_scrub_stamp":"2024-09-12T18:36:21.983901+0000","last_deep_scrub":"268'402","last_deep_scrub_stamp":"2024-09-12T18:36:21.983901+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.983901+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:14.125927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2313,"num_read_kb":2218,"num_write":459,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'347","reported_seq":1027,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.000957+0000","last_change":"2024-09-12T18:36:12.000812+0000","last_active":"2024-09-12T18:36:12.000957+0000","last_peered":"2024-09-12T18:36:12.000957+0000","last_clean":"2024-09-12T18:36:12.000957+0000","last_became_active":"2024-09-12T17:10:30.386707+0000","last_became_peered":"2024-09-12T17:10:30.386707+0000","last_unstale":"2024-09-12T18:36:12.000957+0000","last_undegraded":"2024-09-12T18:36:12.000957+0000","last_fullsized":"2024-09-12T18:36:12.000957+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-12T18:36:12.000536+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-12T18:36:12.000536+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.000536+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:38.013571+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399029,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":531,"num_read_kb":31049,"num_write":1121,"num_write_kb":31528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.971329+0000","last_change":"2024-09-12T18:36:26.971329+0000","last_active":"2024-09-12T18:36:26.971329+0000","last_peered":"2024-09-12T18:36:26.971329+0000","last_clean":"2024-09-12T18:36:26.971329+0000","last_became_active":"2024-09-12T17:10:34.369066+0000","last_became_peered":"2024-09-12T17:10:34.369066+0000","last_unstale":"2024-09-12T18:36:26.971329+0000","last_undegraded":"2024-09-12T18:36:26.971329+0000","last_fullsized":"2024-09-12T18:36:26.971329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.971149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.971149+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.971149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:39.933136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'394","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.886618+0000","last_change":"2024-09-12T18:36:35.886618+0000","last_active":"2024-09-12T18:36:35.886618+0000","last_peered":"2024-09-12T18:36:35.886618+0000","last_clean":"2024-09-12T18:36:35.886618+0000","last_became_active":"2024-09-12T17:10:36.920136+0000","last_became_peered":"2024-09-12T17:10:36.920136+0000","last_unstale":"2024-09-12T18:36:35.886618+0000","last_undegraded":"2024-09-12T18:36:35.886618+0000","last_fullsized":"2024-09-12T18:36:35.886618+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T18:36:35.886408+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T18:36:35.886408+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.886408+0000","objects_scrubbed":9,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:53.596754+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54168,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":623,"num_read_kb":1195,"num_write":466,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.879465+0000","last_change":"2024-09-12T18:36:25.879465+0000","last_active":"2024-09-12T18:36:25.879465+0000","last_peered":"2024-09-12T18:36:25.879465+0000","last_clean":"2024-09-12T18:36:25.879465+0000","last_became_active":"2024-09-12T17:10:38.394381+0000","last_became_peered":"2024-09-12T17:10:38.394381+0000","last_unstale":"2024-09-12T18:36:25.879465+0000","last_undegraded":"2024-09-12T18:36:25.879465+0000","last_fullsized":"2024-09-12T18:36:25.879465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:25.879288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:25.879288+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.879288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:15.785711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'534","reported_seq":1368,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.840000+0000","last_change":"2024-09-12T18:36:39.840000+0000","last_active":"2024-09-12T18:36:39.840000+0000","last_peered":"2024-09-12T18:36:39.840000+0000","last_clean":"2024-09-12T18:36:39.840000+0000","last_became_active":"2024-09-12T17:10:40.422353+0000","last_became_peered":"2024-09-12T17:10:40.422353+0000","last_unstale":"2024-09-12T18:36:39.840000+0000","last_undegraded":"2024-09-12T18:36:39.840000+0000","last_fullsized":"2024-09-12T18:36:39.840000+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'534","last_scrub_stamp":"2024-09-12T18:36:39.839738+0000","last_deep_scrub":"268'534","last_deep_scrub_stamp":"2024-09-12T18:36:39.839738+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.839738+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:19.782940+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1294,"num_read_kb":1291,"num_write":1098,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'425","reported_seq":2041,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.993454+0000","last_change":"2024-09-12T18:36:11.993454+0000","last_active":"2024-09-12T18:36:11.993454+0000","last_peered":"2024-09-12T18:36:11.993454+0000","last_clean":"2024-09-12T18:36:11.993454+0000","last_became_active":"2024-09-12T17:10:32.369188+0000","last_became_peered":"2024-09-12T17:10:32.369188+0000","last_unstale":"2024-09-12T18:36:11.993454+0000","last_undegraded":"2024-09-12T18:36:11.993454+0000","last_fullsized":"2024-09-12T18:36:11.993454+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'425","last_scrub_stamp":"2024-09-12T18:36:11.993172+0000","last_deep_scrub":"268'425","last_deep_scrub_stamp":"2024-09-12T18:36:11.993172+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.993172+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:31.536535+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2274,"num_read_kb":2176,"num_write":482,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'333","reported_seq":1118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.915481+0000","last_change":"2024-09-12T18:36:14.915481+0000","last_active":"2024-09-12T18:36:14.915481+0000","last_peered":"2024-09-12T18:36:14.915481+0000","last_clean":"2024-09-12T18:36:14.915481+0000","last_became_active":"2024-09-12T17:10:30.381728+0000","last_became_peered":"2024-09-12T17:10:30.381728+0000","last_unstale":"2024-09-12T18:36:14.915481+0000","last_undegraded":"2024-09-12T18:36:14.915481+0000","last_fullsized":"2024-09-12T18:36:14.915481+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-12T18:36:14.915264+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-12T18:36:14.915264+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.915264+0000","objects_scrubbed":9,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:17.086755+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399298,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":581,"num_read_kb":127583,"num_write":1019,"num_write_kb":57035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.416236+0000","last_change":"2024-09-12T18:36:21.416236+0000","last_active":"2024-09-12T18:36:21.416236+0000","last_peered":"2024-09-12T18:36:21.416236+0000","last_clean":"2024-09-12T18:36:21.416236+0000","last_became_active":"2024-09-12T17:10:34.346229+0000","last_became_peered":"2024-09-12T17:10:34.346229+0000","last_unstale":"2024-09-12T18:36:21.416236+0000","last_undegraded":"2024-09-12T18:36:21.416236+0000","last_fullsized":"2024-09-12T18:36:21.416236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:21.416056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:21.416056+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.416056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:15.060850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'302","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.887064+0000","last_change":"2024-09-12T18:36:30.887064+0000","last_active":"2024-09-12T18:36:30.887064+0000","last_peered":"2024-09-12T18:36:30.887064+0000","last_clean":"2024-09-12T18:36:30.887064+0000","last_became_active":"2024-09-12T17:10:36.398641+0000","last_became_peered":"2024-09-12T17:10:36.398641+0000","last_unstale":"2024-09-12T18:36:30.887064+0000","last_undegraded":"2024-09-12T18:36:30.887064+0000","last_fullsized":"2024-09-12T18:36:30.887064+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'302","last_scrub_stamp":"2024-09-12T18:36:30.886775+0000","last_deep_scrub":"268'302","last_deep_scrub_stamp":"2024-09-12T18:36:30.886775+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.886775+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:50.024569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":1192,"num_write":410,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.977363+0000","last_change":"2024-09-12T18:36:41.977363+0000","last_active":"2024-09-12T18:36:41.977363+0000","last_peered":"2024-09-12T18:36:41.977363+0000","last_clean":"2024-09-12T18:36:41.977363+0000","last_became_active":"2024-09-12T17:10:38.393114+0000","last_became_peered":"2024-09-12T17:10:38.393114+0000","last_unstale":"2024-09-12T18:36:41.977363+0000","last_undegraded":"2024-09-12T18:36:41.977363+0000","last_fullsized":"2024-09-12T18:36:41.977363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:41.977180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:41.977180+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.977180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:29.512987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'2404","reported_seq":4254,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.208843+0000","last_change":"2024-09-12T18:36:27.208843+0000","last_active":"2024-09-12T18:36:27.208843+0000","last_peered":"2024-09-12T18:36:27.208843+0000","last_clean":"2024-09-12T18:36:27.208843+0000","last_became_active":"2024-09-12T17:10:40.425351+0000","last_became_peered":"2024-09-12T17:10:40.425351+0000","last_unstale":"2024-09-12T18:36:27.208843+0000","last_undegraded":"2024-09-12T18:36:27.208843+0000","last_fullsized":"2024-09-12T18:36:27.208843+0000","mapping_epoch":35,"log_start":"268'2300","ondisk_log_start":"268'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2404","last_scrub_stamp":"2024-09-12T18:36:27.208656+0000","last_deep_scrub":"268'2404","last_deep_scrub_stamp":"2024-09-12T18:36:27.208656+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.208656+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":2300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:30.619720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6030,"num_read_kb":6033,"num_write":4839,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'771","reported_seq":2283,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.076189+0000","last_change":"2024-09-12T18:36:16.076189+0000","last_active":"2024-09-12T18:36:16.076189+0000","last_peered":"2024-09-12T18:36:16.076189+0000","last_clean":"2024-09-12T18:36:16.076189+0000","last_became_active":"2024-09-12T17:11:04.373050+0000","last_became_peered":"2024-09-12T17:11:04.373050+0000","last_unstale":"2024-09-12T18:36:16.076189+0000","last_undegraded":"2024-09-12T18:36:16.076189+0000","last_fullsized":"2024-09-12T18:36:16.076189+0000","mapping_epoch":38,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'771","last_scrub_stamp":"2024-09-12T18:36:16.075977+0000","last_deep_scrub":"268'771","last_deep_scrub_stamp":"2024-09-12T18:36:16.075977+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.075977+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:34.465225+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3705,"num_read_kb":3333,"num_write":1034,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":470,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'339","reported_seq":1022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.991290+0000","last_change":"2024-09-12T18:36:12.991290+0000","last_active":"2024-09-12T18:36:12.991290+0000","last_peered":"2024-09-12T18:36:12.991290+0000","last_clean":"2024-09-12T18:36:12.991290+0000","last_became_active":"2024-09-12T17:10:30.381997+0000","last_became_peered":"2024-09-12T17:10:30.381997+0000","last_unstale":"2024-09-12T18:36:12.991290+0000","last_undegraded":"2024-09-12T18:36:12.991290+0000","last_fullsized":"2024-09-12T18:36:12.991290+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T18:36:12.991024+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T18:36:12.991024+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.991024+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:06.763609+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":534,"num_read_kb":9738,"num_write":1109,"num_write_kb":58445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.424294+0000","last_change":"2024-09-12T18:36:20.424294+0000","last_active":"2024-09-12T18:36:20.424294+0000","last_peered":"2024-09-12T18:36:20.424294+0000","last_clean":"2024-09-12T18:36:20.424294+0000","last_became_active":"2024-09-12T17:10:34.358798+0000","last_became_peered":"2024-09-12T17:10:34.358798+0000","last_unstale":"2024-09-12T18:36:20.424294+0000","last_undegraded":"2024-09-12T18:36:20.424294+0000","last_fullsized":"2024-09-12T18:36:20.424294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:20.424121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:20.424121+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.424121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:13.717135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'358","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.969112+0000","last_change":"2024-09-12T18:36:31.969112+0000","last_active":"2024-09-12T18:36:31.969112+0000","last_peered":"2024-09-12T18:36:31.969112+0000","last_clean":"2024-09-12T18:36:31.969112+0000","last_became_active":"2024-09-12T17:10:36.396261+0000","last_became_peered":"2024-09-12T17:10:36.396261+0000","last_unstale":"2024-09-12T18:36:31.969112+0000","last_undegraded":"2024-09-12T18:36:31.969112+0000","last_fullsized":"2024-09-12T18:36:31.969112+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-12T18:36:31.968917+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-12T18:36:31.968917+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.968917+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:43.059228+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49048,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1254,"num_write":464,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'802","reported_seq":2791,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.821601+0000","last_change":"2024-09-12T18:36:35.821601+0000","last_active":"2024-09-12T18:36:35.821601+0000","last_peered":"2024-09-12T18:36:35.821601+0000","last_clean":"2024-09-12T18:36:35.821601+0000","last_became_active":"2024-09-12T17:10:38.408710+0000","last_became_peered":"2024-09-12T17:10:38.408710+0000","last_unstale":"2024-09-12T18:36:35.821601+0000","last_undegraded":"2024-09-12T18:36:35.821601+0000","last_fullsized":"2024-09-12T18:36:35.821601+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'802","last_scrub_stamp":"2024-09-12T18:36:35.821417+0000","last_deep_scrub":"268'802","last_deep_scrub_stamp":"2024-09-12T18:36:35.821417+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.821417+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:26.246515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'126","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.818917+0000","last_change":"2024-09-12T18:36:39.818917+0000","last_active":"2024-09-12T18:36:39.818917+0000","last_peered":"2024-09-12T18:36:39.818917+0000","last_clean":"2024-09-12T18:36:39.818917+0000","last_became_active":"2024-09-12T17:10:40.417664+0000","last_became_peered":"2024-09-12T17:10:40.417664+0000","last_unstale":"2024-09-12T18:36:39.818917+0000","last_undegraded":"2024-09-12T18:36:39.818917+0000","last_fullsized":"2024-09-12T18:36:39.818917+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'126","last_scrub_stamp":"2024-09-12T18:36:39.818689+0000","last_deep_scrub":"268'126","last_deep_scrub_stamp":"2024-09-12T18:36:39.818689+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.818689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:15.525509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":285,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'887","reported_seq":2356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.581186+0000","last_change":"2024-09-12T18:36:21.581186+0000","last_active":"2024-09-12T18:36:21.581186+0000","last_peered":"2024-09-12T18:36:21.581186+0000","last_clean":"2024-09-12T18:36:21.581186+0000","last_became_active":"2024-09-12T17:10:32.364995+0000","last_became_peered":"2024-09-12T17:10:32.364995+0000","last_unstale":"2024-09-12T18:36:21.581186+0000","last_undegraded":"2024-09-12T18:36:21.581186+0000","last_fullsized":"2024-09-12T18:36:21.581186+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'887","last_scrub_stamp":"2024-09-12T18:36:21.580992+0000","last_deep_scrub":"268'887","last_deep_scrub_stamp":"2024-09-12T18:36:21.580992+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.580992+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:04.860009+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4158,"num_read_kb":3733,"num_write":1245,"num_write_kb":492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'333","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.931436+0000","last_change":"2024-09-12T18:36:10.931436+0000","last_active":"2024-09-12T18:36:10.931436+0000","last_peered":"2024-09-12T18:36:10.931436+0000","last_clean":"2024-09-12T18:36:10.931436+0000","last_became_active":"2024-09-12T17:10:30.393495+0000","last_became_peered":"2024-09-12T17:10:30.393495+0000","last_unstale":"2024-09-12T18:36:10.931436+0000","last_undegraded":"2024-09-12T18:36:10.931436+0000","last_fullsized":"2024-09-12T18:36:10.931436+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-12T18:36:10.931229+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-12T18:36:10.931229+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.931229+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:44.015657+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170230,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":492,"num_read_kb":51876,"num_write":985,"num_write_kb":56464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.456159+0000","last_change":"2024-09-12T18:36:23.456159+0000","last_active":"2024-09-12T18:36:23.456159+0000","last_peered":"2024-09-12T18:36:23.456159+0000","last_clean":"2024-09-12T18:36:23.456159+0000","last_became_active":"2024-09-12T17:10:34.360732+0000","last_became_peered":"2024-09-12T17:10:34.360732+0000","last_unstale":"2024-09-12T18:36:23.456159+0000","last_undegraded":"2024-09-12T18:36:23.456159+0000","last_fullsized":"2024-09-12T18:36:23.456159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:23.455974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:23.455974+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.455974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:57.486813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'515","reported_seq":1189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.626221+0000","last_change":"2024-09-12T18:36:27.626221+0000","last_active":"2024-09-12T18:36:27.626221+0000","last_peered":"2024-09-12T18:36:27.626221+0000","last_clean":"2024-09-12T18:36:27.626221+0000","last_became_active":"2024-09-12T17:10:36.399536+0000","last_became_peered":"2024-09-12T17:10:36.399536+0000","last_unstale":"2024-09-12T18:36:27.626221+0000","last_undegraded":"2024-09-12T18:36:27.626221+0000","last_fullsized":"2024-09-12T18:36:27.626221+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'515","last_scrub_stamp":"2024-09-12T18:36:27.626038+0000","last_deep_scrub":"268'515","last_deep_scrub_stamp":"2024-09-12T18:36:27.626038+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.626038+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:01.780600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89531,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":886,"num_read_kb":2156,"num_write":724,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.504638+0000","last_change":"2024-09-12T18:36:26.504638+0000","last_active":"2024-09-12T18:36:26.504638+0000","last_peered":"2024-09-12T18:36:26.504638+0000","last_clean":"2024-09-12T18:36:26.504638+0000","last_became_active":"2024-09-12T17:10:38.405169+0000","last_became_peered":"2024-09-12T17:10:38.405169+0000","last_unstale":"2024-09-12T18:36:26.504638+0000","last_undegraded":"2024-09-12T18:36:26.504638+0000","last_fullsized":"2024-09-12T18:36:26.504638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.504135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.504135+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.504135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:48.917759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'150","reported_seq":758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.808477+0000","last_change":"2024-09-12T18:36:33.808477+0000","last_active":"2024-09-12T18:36:33.808477+0000","last_peered":"2024-09-12T18:36:33.808477+0000","last_clean":"2024-09-12T18:36:33.808477+0000","last_became_active":"2024-09-12T17:10:40.409722+0000","last_became_peered":"2024-09-12T17:10:40.409722+0000","last_unstale":"2024-09-12T18:36:33.808477+0000","last_undegraded":"2024-09-12T18:36:33.808477+0000","last_fullsized":"2024-09-12T18:36:33.808477+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'150","last_scrub_stamp":"2024-09-12T18:36:33.808262+0000","last_deep_scrub":"268'150","last_deep_scrub_stamp":"2024-09-12T18:36:33.808262+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.808262+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:12.376177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":508,"num_read_kb":430,"num_write":364,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'825","reported_seq":2351,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.972052+0000","last_change":"2024-09-12T18:36:12.972052+0000","last_active":"2024-09-12T18:36:12.972052+0000","last_peered":"2024-09-12T18:36:12.972052+0000","last_clean":"2024-09-12T18:36:12.972052+0000","last_became_active":"2024-09-12T17:10:32.370915+0000","last_became_peered":"2024-09-12T17:10:32.370915+0000","last_unstale":"2024-09-12T18:36:12.972052+0000","last_undegraded":"2024-09-12T18:36:12.972052+0000","last_fullsized":"2024-09-12T18:36:12.972052+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'825","last_scrub_stamp":"2024-09-12T18:36:12.971870+0000","last_deep_scrub":"268'825","last_deep_scrub_stamp":"2024-09-12T18:36:12.971870+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.971870+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:25.914060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3877,"num_read_kb":3457,"num_write":1088,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'360","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.366818+0000","last_change":"2024-09-12T18:36:07.366750+0000","last_active":"2024-09-12T18:36:07.366818+0000","last_peered":"2024-09-12T18:36:07.366818+0000","last_clean":"2024-09-12T18:36:07.366818+0000","last_became_active":"2024-09-12T17:11:04.868662+0000","last_became_peered":"2024-09-12T17:11:04.868662+0000","last_unstale":"2024-09-12T18:36:07.366818+0000","last_undegraded":"2024-09-12T18:36:07.366818+0000","last_fullsized":"2024-09-12T18:36:07.366818+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'360","last_scrub_stamp":"2024-09-12T18:36:07.366618+0000","last_deep_scrub":"268'360","last_deep_scrub_stamp":"2024-09-12T18:36:07.366618+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.366618+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:46.462039+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456511,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":553,"num_read_kb":17196,"num_write":1231,"num_write_kb":37960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.462220+0000","last_change":"2024-09-12T18:36:22.462220+0000","last_active":"2024-09-12T18:36:22.462220+0000","last_peered":"2024-09-12T18:36:22.462220+0000","last_clean":"2024-09-12T18:36:22.462220+0000","last_became_active":"2024-09-12T17:10:34.363822+0000","last_became_peered":"2024-09-12T17:10:34.363822+0000","last_unstale":"2024-09-12T18:36:22.462220+0000","last_undegraded":"2024-09-12T18:36:22.462220+0000","last_fullsized":"2024-09-12T18:36:22.462220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:22.462029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:22.462029+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.462029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:34.960157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'310","reported_seq":932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.805947+0000","last_change":"2024-09-12T18:36:31.805947+0000","last_active":"2024-09-12T18:36:31.805947+0000","last_peered":"2024-09-12T18:36:31.805947+0000","last_clean":"2024-09-12T18:36:31.805947+0000","last_became_active":"2024-09-12T17:10:36.377677+0000","last_became_peered":"2024-09-12T17:10:36.377677+0000","last_unstale":"2024-09-12T18:36:31.805947+0000","last_undegraded":"2024-09-12T18:36:31.805947+0000","last_fullsized":"2024-09-12T18:36:31.805947+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-12T18:36:31.805723+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-12T18:36:31.805723+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.805723+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:34.615781+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50917,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":528,"num_read_kb":1122,"num_write":460,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.770704+0000","last_change":"2024-09-12T18:36:34.770704+0000","last_active":"2024-09-12T18:36:34.770704+0000","last_peered":"2024-09-12T18:36:34.770704+0000","last_clean":"2024-09-12T18:36:34.770704+0000","last_became_active":"2024-09-12T17:10:38.413429+0000","last_became_peered":"2024-09-12T17:10:38.413429+0000","last_unstale":"2024-09-12T18:36:34.770704+0000","last_undegraded":"2024-09-12T18:36:34.770704+0000","last_fullsized":"2024-09-12T18:36:34.770704+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:34.770523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:34.770523+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.770523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:05.999887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'116","reported_seq":634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.941512+0000","last_change":"2024-09-12T18:36:42.941374+0000","last_active":"2024-09-12T18:36:42.941512+0000","last_peered":"2024-09-12T18:36:42.941512+0000","last_clean":"2024-09-12T18:36:42.941512+0000","last_became_active":"2024-09-12T17:10:40.415270+0000","last_became_peered":"2024-09-12T17:10:40.415270+0000","last_unstale":"2024-09-12T18:36:42.941512+0000","last_undegraded":"2024-09-12T18:36:42.941512+0000","last_fullsized":"2024-09-12T18:36:42.941512+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'116","last_scrub_stamp":"2024-09-12T18:36:42.941131+0000","last_deep_scrub":"268'116","last_deep_scrub_stamp":"2024-09-12T18:36:42.941131+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.941131+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:22.686550+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":272,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'513","reported_seq":2185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.975512+0000","last_change":"2024-09-12T18:36:13.975512+0000","last_active":"2024-09-12T18:36:13.975512+0000","last_peered":"2024-09-12T18:36:13.975512+0000","last_clean":"2024-09-12T18:36:13.975512+0000","last_became_active":"2024-09-12T17:10:32.357121+0000","last_became_peered":"2024-09-12T17:10:32.357121+0000","last_unstale":"2024-09-12T18:36:13.975512+0000","last_undegraded":"2024-09-12T18:36:13.975512+0000","last_fullsized":"2024-09-12T18:36:13.975512+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'513","last_scrub_stamp":"2024-09-12T18:36:13.975293+0000","last_deep_scrub":"268'513","last_deep_scrub_stamp":"2024-09-12T18:36:13.975293+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.975293+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":500,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:27.406648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2802,"num_read_kb":2611,"num_write":616,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'390","reported_seq":1081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.140455+0000","last_change":"2024-09-12T18:36:14.140455+0000","last_active":"2024-09-12T18:36:14.140455+0000","last_peered":"2024-09-12T18:36:14.140455+0000","last_clean":"2024-09-12T18:36:14.140455+0000","last_became_active":"2024-09-12T17:10:30.391780+0000","last_became_peered":"2024-09-12T17:10:30.391780+0000","last_unstale":"2024-09-12T18:36:14.140455+0000","last_undegraded":"2024-09-12T18:36:14.140455+0000","last_fullsized":"2024-09-12T18:36:14.140455+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'390","last_scrub_stamp":"2024-09-12T18:36:14.140207+0000","last_deep_scrub":"268'390","last_deep_scrub_stamp":"2024-09-12T18:36:14.140207+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.140207+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:53.168988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170426,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":660,"num_read_kb":4836,"num_write":1182,"num_write_kb":23965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.876077+0000","last_change":"2024-09-12T18:36:18.876077+0000","last_active":"2024-09-12T18:36:18.876077+0000","last_peered":"2024-09-12T18:36:18.876077+0000","last_clean":"2024-09-12T18:36:18.876077+0000","last_became_active":"2024-09-12T17:10:34.362337+0000","last_became_peered":"2024-09-12T17:10:34.362337+0000","last_unstale":"2024-09-12T18:36:18.876077+0000","last_undegraded":"2024-09-12T18:36:18.876077+0000","last_fullsized":"2024-09-12T18:36:18.876077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:18.875873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:18.875873+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.875873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:35.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'347","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.533049+0000","last_change":"2024-09-12T18:36:27.533049+0000","last_active":"2024-09-12T18:36:27.533049+0000","last_peered":"2024-09-12T18:36:27.533049+0000","last_clean":"2024-09-12T18:36:27.533049+0000","last_became_active":"2024-09-12T17:10:36.389965+0000","last_became_peered":"2024-09-12T17:10:36.389965+0000","last_unstale":"2024-09-12T18:36:27.533049+0000","last_undegraded":"2024-09-12T18:36:27.533049+0000","last_fullsized":"2024-09-12T18:36:27.533049+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-12T18:36:27.532837+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-12T18:36:27.532837+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.532837+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:54.733598+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60342,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":574,"num_read_kb":1242,"num_write":452,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'766","reported_seq":6969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.495465+0000","last_change":"2024-09-12T18:36:25.495465+0000","last_active":"2024-09-12T18:36:25.495465+0000","last_peered":"2024-09-12T18:36:25.495465+0000","last_clean":"2024-09-12T18:36:25.495465+0000","last_became_active":"2024-09-12T17:10:38.397332+0000","last_became_peered":"2024-09-12T17:10:38.397332+0000","last_unstale":"2024-09-12T18:36:25.495465+0000","last_undegraded":"2024-09-12T18:36:25.495465+0000","last_fullsized":"2024-09-12T18:36:25.495465+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'766","last_scrub_stamp":"2024-09-12T18:36:25.495275+0000","last_deep_scrub":"268'766","last_deep_scrub_stamp":"2024-09-12T18:36:25.495275+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.495275+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:58.308585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'153","reported_seq":686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.850700+0000","last_change":"2024-09-12T18:36:29.850700+0000","last_active":"2024-09-12T18:36:29.850700+0000","last_peered":"2024-09-12T18:36:29.850700+0000","last_clean":"2024-09-12T18:36:29.850700+0000","last_became_active":"2024-09-12T17:10:40.423894+0000","last_became_peered":"2024-09-12T17:10:40.423894+0000","last_unstale":"2024-09-12T18:36:29.850700+0000","last_undegraded":"2024-09-12T18:36:29.850700+0000","last_fullsized":"2024-09-12T18:36:29.850700+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'153","last_scrub_stamp":"2024-09-12T18:36:29.850481+0000","last_deep_scrub":"268'153","last_deep_scrub_stamp":"2024-09-12T18:36:29.850481+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.850481+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:41.819877+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1683,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":214,"num_read_kb":204,"num_write":362,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'508","reported_seq":2230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.061396+0000","last_change":"2024-09-12T18:36:16.061396+0000","last_active":"2024-09-12T18:36:16.061396+0000","last_peered":"2024-09-12T18:36:16.061396+0000","last_clean":"2024-09-12T18:36:16.061396+0000","last_became_active":"2024-09-12T17:10:32.361164+0000","last_became_peered":"2024-09-12T17:10:32.361164+0000","last_unstale":"2024-09-12T18:36:16.061396+0000","last_undegraded":"2024-09-12T18:36:16.061396+0000","last_fullsized":"2024-09-12T18:36:16.061396+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'508","last_scrub_stamp":"2024-09-12T18:36:16.061192+0000","last_deep_scrub":"268'508","last_deep_scrub_stamp":"2024-09-12T18:36:16.061192+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.061192+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:04.877347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2673,"num_read_kb":2535,"num_write":607,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'391","reported_seq":1130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.012522+0000","last_change":"2024-09-12T18:36:07.012522+0000","last_active":"2024-09-12T18:36:07.012522+0000","last_peered":"2024-09-12T18:36:07.012522+0000","last_clean":"2024-09-12T18:36:07.012522+0000","last_became_active":"2024-09-12T17:10:30.361126+0000","last_became_peered":"2024-09-12T17:10:30.361126+0000","last_unstale":"2024-09-12T18:36:07.012522+0000","last_undegraded":"2024-09-12T18:36:07.012522+0000","last_fullsized":"2024-09-12T18:36:07.012522+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'391","last_scrub_stamp":"2024-09-12T18:36:07.012238+0000","last_deep_scrub":"268'391","last_deep_scrub_stamp":"2024-09-12T18:36:07.012238+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.012238+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:22.284310+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8882037,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":691,"num_read_kb":57357,"num_write":1297,"num_write_kb":69062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1488,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.919834+0000","last_change":"2024-09-12T18:36:29.919699+0000","last_active":"2024-09-12T18:36:29.919834+0000","last_peered":"2024-09-12T18:36:29.919834+0000","last_clean":"2024-09-12T18:36:29.919834+0000","last_became_active":"2024-09-12T17:10:34.367608+0000","last_became_peered":"2024-09-12T17:10:34.367608+0000","last_unstale":"2024-09-12T18:36:29.919834+0000","last_undegraded":"2024-09-12T18:36:29.919834+0000","last_fullsized":"2024-09-12T18:36:29.919834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:29.919514+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:29.919514+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.919514+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:59.551307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'127","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.973454+0000","last_change":"2024-09-12T18:36:33.973454+0000","last_active":"2024-09-12T18:36:33.973454+0000","last_peered":"2024-09-12T18:36:33.973454+0000","last_clean":"2024-09-12T18:36:33.973454+0000","last_became_active":"2024-09-12T17:10:36.921242+0000","last_became_peered":"2024-09-12T17:10:36.921242+0000","last_unstale":"2024-09-12T18:36:33.973454+0000","last_undegraded":"2024-09-12T18:36:33.973454+0000","last_fullsized":"2024-09-12T18:36:33.973454+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-09-12T18:36:33.973249+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-09-12T18:36:33.973249+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.973249+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:56.412447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'781","reported_seq":2895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.125502+0000","last_change":"2024-09-12T18:36:25.125502+0000","last_active":"2024-09-12T18:36:25.125502+0000","last_peered":"2024-09-12T18:36:25.125502+0000","last_clean":"2024-09-12T18:36:25.125502+0000","last_became_active":"2024-09-12T17:10:38.397242+0000","last_became_peered":"2024-09-12T17:10:38.397242+0000","last_unstale":"2024-09-12T18:36:25.125502+0000","last_undegraded":"2024-09-12T18:36:25.125502+0000","last_fullsized":"2024-09-12T18:36:25.125502+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'781","last_scrub_stamp":"2024-09-12T18:36:25.125289+0000","last_deep_scrub":"268'781","last_deep_scrub_stamp":"2024-09-12T18:36:25.125289+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.125289+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:01.514681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'139","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.760416+0000","last_change":"2024-09-12T18:36:38.760416+0000","last_active":"2024-09-12T18:36:38.760416+0000","last_peered":"2024-09-12T18:36:38.760416+0000","last_clean":"2024-09-12T18:36:38.760416+0000","last_became_active":"2024-09-12T17:10:40.415831+0000","last_became_peered":"2024-09-12T17:10:40.415831+0000","last_unstale":"2024-09-12T18:36:38.760416+0000","last_undegraded":"2024-09-12T18:36:38.760416+0000","last_fullsized":"2024-09-12T18:36:38.760416+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'139","last_scrub_stamp":"2024-09-12T18:36:38.760146+0000","last_deep_scrub":"268'139","last_deep_scrub_stamp":"2024-09-12T18:36:38.760146+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.760146+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:42.944767+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":150,"num_write":326,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'563","reported_seq":2088,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.989105+0000","last_change":"2024-09-12T18:36:21.988883+0000","last_active":"2024-09-12T18:36:21.989105+0000","last_peered":"2024-09-12T18:36:21.989105+0000","last_clean":"2024-09-12T18:36:21.989105+0000","last_became_active":"2024-09-12T17:10:32.366967+0000","last_became_peered":"2024-09-12T17:10:32.366967+0000","last_unstale":"2024-09-12T18:36:21.989105+0000","last_undegraded":"2024-09-12T18:36:21.989105+0000","last_fullsized":"2024-09-12T18:36:21.989105+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'563","last_scrub_stamp":"2024-09-12T18:36:21.988625+0000","last_deep_scrub":"268'563","last_deep_scrub_stamp":"2024-09-12T18:36:21.988625+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.988625+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:25.834312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2878,"num_read_kb":2622,"num_write":716,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'383","reported_seq":1075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.936973+0000","last_change":"2024-09-12T18:36:06.936973+0000","last_active":"2024-09-12T18:36:06.936973+0000","last_peered":"2024-09-12T18:36:06.936973+0000","last_clean":"2024-09-12T18:36:06.936973+0000","last_became_active":"2024-09-12T17:10:30.360368+0000","last_became_peered":"2024-09-12T17:10:30.360368+0000","last_unstale":"2024-09-12T18:36:06.936973+0000","last_undegraded":"2024-09-12T18:36:06.936973+0000","last_fullsized":"2024-09-12T18:36:06.936973+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-12T18:36:06.936843+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-12T18:36:06.936843+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.936843+0000","objects_scrubbed":8,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:18.264741+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4303946,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":608,"num_read_kb":11061,"num_write":1240,"num_write_kb":24095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.864724+0000","last_change":"2024-09-12T18:36:26.864724+0000","last_active":"2024-09-12T18:36:26.864724+0000","last_peered":"2024-09-12T18:36:26.864724+0000","last_clean":"2024-09-12T18:36:26.864724+0000","last_became_active":"2024-09-12T17:10:34.354009+0000","last_became_peered":"2024-09-12T17:10:34.354009+0000","last_unstale":"2024-09-12T18:36:26.864724+0000","last_undegraded":"2024-09-12T18:36:26.864724+0000","last_fullsized":"2024-09-12T18:36:26.864724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.864521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.864521+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.864521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:13.936489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'386","reported_seq":1043,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.929178+0000","last_change":"2024-09-12T18:36:34.929178+0000","last_active":"2024-09-12T18:36:34.929178+0000","last_peered":"2024-09-12T18:36:34.929178+0000","last_clean":"2024-09-12T18:36:34.929178+0000","last_became_active":"2024-09-12T17:10:36.392271+0000","last_became_peered":"2024-09-12T17:10:36.392271+0000","last_unstale":"2024-09-12T18:36:34.929178+0000","last_undegraded":"2024-09-12T18:36:34.929178+0000","last_fullsized":"2024-09-12T18:36:34.929178+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'386","last_scrub_stamp":"2024-09-12T18:36:34.928990+0000","last_deep_scrub":"268'386","last_deep_scrub_stamp":"2024-09-12T18:36:34.928990+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.928990+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:30.954181+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45147,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":615,"num_read_kb":1214,"num_write":468,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.096343+0000","last_change":"2024-09-12T18:36:24.096343+0000","last_active":"2024-09-12T18:36:24.096343+0000","last_peered":"2024-09-12T18:36:24.096343+0000","last_clean":"2024-09-12T18:36:24.096343+0000","last_became_active":"2024-09-12T17:10:38.398743+0000","last_became_peered":"2024-09-12T17:10:38.398743+0000","last_unstale":"2024-09-12T18:36:24.096343+0000","last_undegraded":"2024-09-12T18:36:24.096343+0000","last_fullsized":"2024-09-12T18:36:24.096343+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:24.096160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:24.096160+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.096160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:15:10.883351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'108","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.907368+0000","last_change":"2024-09-12T18:36:26.907368+0000","last_active":"2024-09-12T18:36:26.907368+0000","last_peered":"2024-09-12T18:36:26.907368+0000","last_clean":"2024-09-12T18:36:26.907368+0000","last_became_active":"2024-09-12T17:10:40.410710+0000","last_became_peered":"2024-09-12T17:10:40.410710+0000","last_unstale":"2024-09-12T18:36:26.907368+0000","last_undegraded":"2024-09-12T18:36:26.907368+0000","last_fullsized":"2024-09-12T18:36:26.907368+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'108","last_scrub_stamp":"2024-09-12T18:36:26.907174+0000","last_deep_scrub":"268'108","last_deep_scrub_stamp":"2024-09-12T18:36:26.907174+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.907174+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:55.084708+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":239,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'450","reported_seq":2013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.163747+0000","last_change":"2024-09-12T18:36:13.163599+0000","last_active":"2024-09-12T18:36:13.163747+0000","last_peered":"2024-09-12T18:36:13.163747+0000","last_clean":"2024-09-12T18:36:13.163747+0000","last_became_active":"2024-09-12T17:10:32.366571+0000","last_became_peered":"2024-09-12T17:10:32.366571+0000","last_unstale":"2024-09-12T18:36:13.163747+0000","last_undegraded":"2024-09-12T18:36:13.163747+0000","last_fullsized":"2024-09-12T18:36:13.163747+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'450","last_scrub_stamp":"2024-09-12T18:36:13.163413+0000","last_deep_scrub":"268'450","last_deep_scrub_stamp":"2024-09-12T18:36:13.163413+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.163413+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:42.296285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2259,"num_read_kb":2146,"num_write":500,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":645,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.003510+0000","last_change":"2024-09-12T18:36:09.003372+0000","last_active":"2024-09-12T18:36:09.003510+0000","last_peered":"2024-09-12T18:36:09.003510+0000","last_clean":"2024-09-12T18:36:09.003510+0000","last_became_active":"2024-09-12T17:10:13.024652+0000","last_became_peered":"2024-09-12T17:10:13.024652+0000","last_unstale":"2024-09-12T18:36:09.003510+0000","last_undegraded":"2024-09-12T18:36:09.003510+0000","last_fullsized":"2024-09-12T18:36:09.003510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-12T18:36:09.003177+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-12T18:36:09.003177+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.003177+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:13.554583+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.977110+0000","last_change":"2024-09-12T18:36:08.977110+0000","last_active":"2024-09-12T18:36:08.977110+0000","last_peered":"2024-09-12T18:36:08.977110+0000","last_clean":"2024-09-12T18:36:08.977110+0000","last_became_active":"2024-09-12T17:10:18.073547+0000","last_became_peered":"2024-09-12T17:10:18.073547+0000","last_unstale":"2024-09-12T18:36:08.977110+0000","last_undegraded":"2024-09-12T18:36:08.977110+0000","last_fullsized":"2024-09-12T18:36:08.977110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:08.976931+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:08.976931+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.976931+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:40.637153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010552039999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'325","reported_seq":1042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.967233+0000","last_change":"2024-09-12T18:36:07.967233+0000","last_active":"2024-09-12T18:36:07.967233+0000","last_peered":"2024-09-12T18:36:07.967233+0000","last_clean":"2024-09-12T18:36:07.967233+0000","last_became_active":"2024-09-12T17:10:30.395026+0000","last_became_peered":"2024-09-12T17:10:30.395026+0000","last_unstale":"2024-09-12T18:36:07.967233+0000","last_undegraded":"2024-09-12T18:36:07.967233+0000","last_fullsized":"2024-09-12T18:36:07.967233+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'325","last_scrub_stamp":"2024-09-12T18:36:07.967135+0000","last_deep_scrub":"268'325","last_deep_scrub_stamp":"2024-09-12T18:36:07.967135+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.967135+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:46.811857+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048618,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":151053,"num_write":1004,"num_write_kb":34461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"268'4","reported_seq":1013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.935798+0000","last_change":"2024-09-12T18:36:24.935798+0000","last_active":"2024-09-12T18:36:24.935798+0000","last_peered":"2024-09-12T18:36:24.935798+0000","last_clean":"2024-09-12T18:36:24.935798+0000","last_became_active":"2024-09-12T17:10:34.363615+0000","last_became_peered":"2024-09-12T17:10:34.363615+0000","last_unstale":"2024-09-12T18:36:24.935798+0000","last_undegraded":"2024-09-12T18:36:24.935798+0000","last_fullsized":"2024-09-12T18:36:24.935798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:24.935619+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:24.935619+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.935619+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:43.313804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":734,"num_read_kb":732,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'760","reported_seq":1498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.930201+0000","last_change":"2024-09-12T18:36:33.930201+0000","last_active":"2024-09-12T18:36:33.930201+0000","last_peered":"2024-09-12T18:36:33.930201+0000","last_clean":"2024-09-12T18:36:33.930201+0000","last_became_active":"2024-09-12T17:10:36.395060+0000","last_became_peered":"2024-09-12T17:10:36.395060+0000","last_unstale":"2024-09-12T18:36:33.930201+0000","last_undegraded":"2024-09-12T18:36:33.930201+0000","last_fullsized":"2024-09-12T18:36:33.930201+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'760","last_scrub_stamp":"2024-09-12T18:36:33.930021+0000","last_deep_scrub":"268'760","last_deep_scrub_stamp":"2024-09-12T18:36:33.930021+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.930021+0000","objects_scrubbed":7,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:41.316757+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142312,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1468,"num_read_kb":3324,"num_write":1428,"num_write_kb":1256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106668,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.692277+0000","last_change":"2024-09-12T18:36:32.692277+0000","last_active":"2024-09-12T18:36:32.692277+0000","last_peered":"2024-09-12T18:36:32.692277+0000","last_clean":"2024-09-12T18:36:32.692277+0000","last_became_active":"2024-09-12T17:10:38.413042+0000","last_became_peered":"2024-09-12T17:10:38.413042+0000","last_unstale":"2024-09-12T18:36:32.692277+0000","last_undegraded":"2024-09-12T18:36:32.692277+0000","last_fullsized":"2024-09-12T18:36:32.692277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:32.692076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:32.692076+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.692076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:46.407882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'216","reported_seq":947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.183568+0000","last_change":"2024-09-12T18:36:29.183568+0000","last_active":"2024-09-12T18:36:29.183568+0000","last_peered":"2024-09-12T18:36:29.183568+0000","last_clean":"2024-09-12T18:36:29.183568+0000","last_became_active":"2024-09-12T17:10:40.413341+0000","last_became_peered":"2024-09-12T17:10:40.413341+0000","last_unstale":"2024-09-12T18:36:29.183568+0000","last_undegraded":"2024-09-12T18:36:29.183568+0000","last_fullsized":"2024-09-12T18:36:29.183568+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'216","last_scrub_stamp":"2024-09-12T18:36:29.183338+0000","last_deep_scrub":"268'216","last_deep_scrub_stamp":"2024-09-12T18:36:29.183338+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.183338+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:56.524847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":511,"num_write":461,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'396","reported_seq":1842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.589512+0000","last_change":"2024-09-12T18:36:13.589512+0000","last_active":"2024-09-12T18:36:13.589512+0000","last_peered":"2024-09-12T18:36:13.589512+0000","last_clean":"2024-09-12T18:36:13.589512+0000","last_became_active":"2024-09-12T17:10:32.364798+0000","last_became_peered":"2024-09-12T17:10:32.364798+0000","last_unstale":"2024-09-12T18:36:13.589512+0000","last_undegraded":"2024-09-12T18:36:13.589512+0000","last_fullsized":"2024-09-12T18:36:13.589512+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'396","last_scrub_stamp":"2024-09-12T18:36:13.589303+0000","last_deep_scrub":"268'396","last_deep_scrub_stamp":"2024-09-12T18:36:13.589303+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.589303+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:17.430737+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2015,"num_read_kb":1907,"num_write":451,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":552,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.017279+0000","last_change":"2024-09-12T18:36:11.017052+0000","last_active":"2024-09-12T18:36:11.017279+0000","last_peered":"2024-09-12T18:36:11.017279+0000","last_clean":"2024-09-12T18:36:11.017279+0000","last_became_active":"2024-09-12T17:10:18.073016+0000","last_became_peered":"2024-09-12T17:10:18.073016+0000","last_unstale":"2024-09-12T18:36:11.017279+0000","last_undegraded":"2024-09-12T18:36:11.017279+0000","last_fullsized":"2024-09-12T18:36:11.017279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:11.016844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:11.016844+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.016844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:43.713164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098613699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'345","reported_seq":1030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:05.576045+0000","last_change":"2024-09-12T18:36:05.576045+0000","last_active":"2024-09-12T18:36:05.576045+0000","last_peered":"2024-09-12T18:36:05.576045+0000","last_clean":"2024-09-12T18:36:05.576045+0000","last_became_active":"2024-09-12T17:10:30.355237+0000","last_became_peered":"2024-09-12T17:10:30.355237+0000","last_unstale":"2024-09-12T18:36:05.576045+0000","last_undegraded":"2024-09-12T18:36:05.576045+0000","last_fullsized":"2024-09-12T18:36:05.576045+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'345","last_scrub_stamp":"2024-09-12T18:36:05.575700+0000","last_deep_scrub":"268'345","last_deep_scrub_stamp":"2024-09-12T18:36:05.575700+0000","last_clean_scrub_stamp":"2024-09-12T18:36:05.575700+0000","objects_scrubbed":8,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:37.874770+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262274,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":552,"num_read_kb":28524,"num_write":1156,"num_write_kb":35154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.961219+0000","last_change":"2024-09-12T18:36:28.961219+0000","last_active":"2024-09-12T18:36:28.961219+0000","last_peered":"2024-09-12T18:36:28.961219+0000","last_clean":"2024-09-12T18:36:28.961219+0000","last_became_active":"2024-09-12T17:10:34.366826+0000","last_became_peered":"2024-09-12T17:10:34.366826+0000","last_unstale":"2024-09-12T18:36:28.961219+0000","last_undegraded":"2024-09-12T18:36:28.961219+0000","last_fullsized":"2024-09-12T18:36:28.961219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:28.961015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:28.961015+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.961015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:28.657697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1394","reported_seq":3392,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.860034+0000","last_change":"2024-09-12T18:36:30.860034+0000","last_active":"2024-09-12T18:36:30.860034+0000","last_peered":"2024-09-12T18:36:30.860034+0000","last_clean":"2024-09-12T18:36:30.860034+0000","last_became_active":"2024-09-12T17:10:36.398283+0000","last_became_peered":"2024-09-12T17:10:36.398283+0000","last_unstale":"2024-09-12T18:36:30.860034+0000","last_undegraded":"2024-09-12T18:36:30.860034+0000","last_fullsized":"2024-09-12T18:36:30.860034+0000","mapping_epoch":31,"log_start":"268'1300","ondisk_log_start":"268'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1394","last_scrub_stamp":"2024-09-12T18:36:30.859791+0000","last_deep_scrub":"268'1394","last_deep_scrub_stamp":"2024-09-12T18:36:30.859791+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.859791+0000","objects_scrubbed":11,"log_size":94,"log_dups_size":1300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:58.008271+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157765,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2194,"num_read_kb":4204,"num_write":1286,"num_write_kb":1080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.002470+0000","last_change":"2024-09-12T18:36:36.002470+0000","last_active":"2024-09-12T18:36:36.002470+0000","last_peered":"2024-09-12T18:36:36.002470+0000","last_clean":"2024-09-12T18:36:36.002470+0000","last_became_active":"2024-09-12T17:10:38.407002+0000","last_became_peered":"2024-09-12T17:10:38.407002+0000","last_unstale":"2024-09-12T18:36:36.002470+0000","last_undegraded":"2024-09-12T18:36:36.002470+0000","last_fullsized":"2024-09-12T18:36:36.002470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:36.002257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:36.002257+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.002257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:16.711812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'127","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.822482+0000","last_change":"2024-09-12T18:36:34.822482+0000","last_active":"2024-09-12T18:36:34.822482+0000","last_peered":"2024-09-12T18:36:34.822482+0000","last_clean":"2024-09-12T18:36:34.822482+0000","last_became_active":"2024-09-12T17:10:40.770362+0000","last_became_peered":"2024-09-12T17:10:40.770362+0000","last_unstale":"2024-09-12T18:36:34.822482+0000","last_undegraded":"2024-09-12T18:36:34.822482+0000","last_fullsized":"2024-09-12T18:36:34.822482+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-09-12T18:36:34.822272+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-09-12T18:36:34.822272+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.822272+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:28.926701+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":150,"num_write":307,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'427","reported_seq":2046,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.925833+0000","last_change":"2024-09-12T18:36:17.925833+0000","last_active":"2024-09-12T18:36:17.925833+0000","last_peered":"2024-09-12T18:36:17.925833+0000","last_clean":"2024-09-12T18:36:17.925833+0000","last_became_active":"2024-09-12T17:10:32.361184+0000","last_became_peered":"2024-09-12T17:10:32.361184+0000","last_unstale":"2024-09-12T18:36:17.925833+0000","last_undegraded":"2024-09-12T18:36:17.925833+0000","last_fullsized":"2024-09-12T18:36:17.925833+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'427","last_scrub_stamp":"2024-09-12T18:36:17.925631+0000","last_deep_scrub":"268'427","last_deep_scrub_stamp":"2024-09-12T18:36:17.925631+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.925631+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:12.940790+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2375,"num_read_kb":2259,"num_write":493,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":555,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.366031+0000","last_change":"2024-09-12T18:36:08.366031+0000","last_active":"2024-09-12T18:36:08.366031+0000","last_peered":"2024-09-12T18:36:08.366031+0000","last_clean":"2024-09-12T18:36:08.366031+0000","last_became_active":"2024-09-12T17:10:18.210168+0000","last_became_peered":"2024-09-12T17:10:18.210168+0000","last_unstale":"2024-09-12T18:36:08.366031+0000","last_undegraded":"2024-09-12T18:36:08.366031+0000","last_fullsized":"2024-09-12T18:36:08.366031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:08.365841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:08.365841+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.365841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:46.140147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001219171,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'335","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:05.824128+0000","last_change":"2024-09-12T18:36:05.823972+0000","last_active":"2024-09-12T18:36:05.824128+0000","last_peered":"2024-09-12T18:36:05.824128+0000","last_clean":"2024-09-12T18:36:05.824128+0000","last_became_active":"2024-09-12T17:10:30.405641+0000","last_became_peered":"2024-09-12T17:10:30.405641+0000","last_unstale":"2024-09-12T18:36:05.824128+0000","last_undegraded":"2024-09-12T18:36:05.824128+0000","last_fullsized":"2024-09-12T18:36:05.824128+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'335","last_scrub_stamp":"2024-09-12T18:36:05.823746+0000","last_deep_scrub":"268'335","last_deep_scrub_stamp":"2024-09-12T18:36:05.823746+0000","last_clean_scrub_stamp":"2024-09-12T18:36:05.823746+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:01.852500+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":435,"num_read_kb":15806,"num_write":1012,"num_write_kb":36297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.440485+0000","last_change":"2024-09-12T18:36:18.440485+0000","last_active":"2024-09-12T18:36:18.440485+0000","last_peered":"2024-09-12T18:36:18.440485+0000","last_clean":"2024-09-12T18:36:18.440485+0000","last_became_active":"2024-09-12T17:10:34.367870+0000","last_became_peered":"2024-09-12T17:10:34.367870+0000","last_unstale":"2024-09-12T18:36:18.440485+0000","last_undegraded":"2024-09-12T18:36:18.440485+0000","last_fullsized":"2024-09-12T18:36:18.440485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:18.440311+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:18.440311+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.440311+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:10.134048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'354","reported_seq":1955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.993747+0000","last_change":"2024-09-12T18:36:30.993747+0000","last_active":"2024-09-12T18:36:30.993747+0000","last_peered":"2024-09-12T18:36:30.993747+0000","last_clean":"2024-09-12T18:36:30.993747+0000","last_became_active":"2024-09-12T17:10:36.922321+0000","last_became_peered":"2024-09-12T17:10:36.922321+0000","last_unstale":"2024-09-12T18:36:30.993747+0000","last_undegraded":"2024-09-12T18:36:30.993747+0000","last_fullsized":"2024-09-12T18:36:30.993747+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'354","last_scrub_stamp":"2024-09-12T18:36:30.993518+0000","last_deep_scrub":"268'354","last_deep_scrub_stamp":"2024-09-12T18:36:30.993518+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.993518+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:54.363804+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":291,"num_read_kb":281,"num_write":273,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.729064+0000","last_change":"2024-09-12T18:36:31.729064+0000","last_active":"2024-09-12T18:36:31.729064+0000","last_peered":"2024-09-12T18:36:31.729064+0000","last_clean":"2024-09-12T18:36:31.729064+0000","last_became_active":"2024-09-12T17:10:38.413459+0000","last_became_peered":"2024-09-12T17:10:38.413459+0000","last_unstale":"2024-09-12T18:36:31.729064+0000","last_undegraded":"2024-09-12T18:36:31.729064+0000","last_fullsized":"2024-09-12T18:36:31.729064+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:31.728883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:31.728883+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.728883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:06.064463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'234","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.912795+0000","last_change":"2024-09-12T18:36:44.912795+0000","last_active":"2024-09-12T18:36:44.912795+0000","last_peered":"2024-09-12T18:36:44.912795+0000","last_clean":"2024-09-12T18:36:44.912795+0000","last_became_active":"2024-09-12T17:10:40.414712+0000","last_became_peered":"2024-09-12T17:10:40.414712+0000","last_unstale":"2024-09-12T18:36:44.912795+0000","last_undegraded":"2024-09-12T18:36:44.912795+0000","last_fullsized":"2024-09-12T18:36:44.912795+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'234","last_scrub_stamp":"2024-09-12T18:36:44.912612+0000","last_deep_scrub":"268'234","last_deep_scrub_stamp":"2024-09-12T18:36:44.912612+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.912612+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:42.219443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":496,"num_read_kb":517,"num_write":496,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'463","reported_seq":1990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.909274+0000","last_change":"2024-09-12T18:36:12.909274+0000","last_active":"2024-09-12T18:36:12.909274+0000","last_peered":"2024-09-12T18:36:12.909274+0000","last_clean":"2024-09-12T18:36:12.909274+0000","last_became_active":"2024-09-12T17:10:32.360853+0000","last_became_peered":"2024-09-12T17:10:32.360853+0000","last_unstale":"2024-09-12T18:36:12.909274+0000","last_undegraded":"2024-09-12T18:36:12.909274+0000","last_fullsized":"2024-09-12T18:36:12.909274+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'463","last_scrub_stamp":"2024-09-12T18:36:12.909073+0000","last_deep_scrub":"268'463","last_deep_scrub_stamp":"2024-09-12T18:36:12.909073+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.909073+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:48.700492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2461,"num_read_kb":2304,"num_write":540,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":551,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.993172+0000","last_change":"2024-09-12T18:36:07.993172+0000","last_active":"2024-09-12T18:36:07.993172+0000","last_peered":"2024-09-12T18:36:07.993172+0000","last_clean":"2024-09-12T18:36:07.993172+0000","last_became_active":"2024-09-12T17:10:18.072719+0000","last_became_peered":"2024-09-12T17:10:18.072719+0000","last_unstale":"2024-09-12T18:36:07.993172+0000","last_undegraded":"2024-09-12T18:36:07.993172+0000","last_fullsized":"2024-09-12T18:36:07.993172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T18:36:07.992994+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T18:36:07.992994+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.992994+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:43.943090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022239349999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'390","reported_seq":1108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.978577+0000","last_change":"2024-09-12T18:36:09.978577+0000","last_active":"2024-09-12T18:36:09.978577+0000","last_peered":"2024-09-12T18:36:09.978577+0000","last_clean":"2024-09-12T18:36:09.978577+0000","last_became_active":"2024-09-12T17:10:30.354850+0000","last_became_peered":"2024-09-12T17:10:30.354850+0000","last_unstale":"2024-09-12T18:36:09.978577+0000","last_undegraded":"2024-09-12T18:36:09.978577+0000","last_fullsized":"2024-09-12T18:36:09.978577+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'390","last_scrub_stamp":"2024-09-12T18:36:09.978364+0000","last_deep_scrub":"268'390","last_deep_scrub_stamp":"2024-09-12T18:36:09.978364+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.978364+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:24.725033+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194319,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":615,"num_read_kb":44146,"num_write":1329,"num_write_kb":42918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.628005+0000","last_change":"2024-09-12T18:36:24.628005+0000","last_active":"2024-09-12T18:36:24.628005+0000","last_peered":"2024-09-12T18:36:24.628005+0000","last_clean":"2024-09-12T18:36:24.628005+0000","last_became_active":"2024-09-12T17:10:34.358926+0000","last_became_peered":"2024-09-12T17:10:34.358926+0000","last_unstale":"2024-09-12T18:36:24.628005+0000","last_undegraded":"2024-09-12T18:36:24.628005+0000","last_fullsized":"2024-09-12T18:36:24.628005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:24.627810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:24.627810+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.627810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:40.687387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'178","reported_seq":770,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.909641+0000","last_change":"2024-09-12T18:36:31.909641+0000","last_active":"2024-09-12T18:36:31.909641+0000","last_peered":"2024-09-12T18:36:31.909641+0000","last_clean":"2024-09-12T18:36:31.909641+0000","last_became_active":"2024-09-12T17:10:36.395658+0000","last_became_peered":"2024-09-12T17:10:36.395658+0000","last_unstale":"2024-09-12T18:36:31.909641+0000","last_undegraded":"2024-09-12T18:36:31.909641+0000","last_fullsized":"2024-09-12T18:36:31.909641+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'178","last_scrub_stamp":"2024-09-12T18:36:31.909396+0000","last_deep_scrub":"268'178","last_deep_scrub_stamp":"2024-09-12T18:36:31.909396+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.909396+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:46.201653+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":215,"num_read_kb":209,"num_write":154,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.111044+0000","last_change":"2024-09-12T18:36:21.111044+0000","last_active":"2024-09-12T18:36:21.111044+0000","last_peered":"2024-09-12T18:36:21.111044+0000","last_clean":"2024-09-12T18:36:21.111044+0000","last_became_active":"2024-09-12T17:10:38.414045+0000","last_became_peered":"2024-09-12T17:10:38.414045+0000","last_unstale":"2024-09-12T18:36:21.111044+0000","last_undegraded":"2024-09-12T18:36:21.111044+0000","last_fullsized":"2024-09-12T18:36:21.111044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:21.110869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:21.110869+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.110869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:19.693627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'152","reported_seq":748,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.836069+0000","last_change":"2024-09-12T18:36:40.836069+0000","last_active":"2024-09-12T18:36:40.836069+0000","last_peered":"2024-09-12T18:36:40.836069+0000","last_clean":"2024-09-12T18:36:40.836069+0000","last_became_active":"2024-09-12T17:10:40.420995+0000","last_became_peered":"2024-09-12T17:10:40.420995+0000","last_unstale":"2024-09-12T18:36:40.836069+0000","last_undegraded":"2024-09-12T18:36:40.836069+0000","last_fullsized":"2024-09-12T18:36:40.836069+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'152","last_scrub_stamp":"2024-09-12T18:36:40.835889+0000","last_deep_scrub":"268'152","last_deep_scrub_stamp":"2024-09-12T18:36:40.835889+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.835889+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:02.982789+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":383,"num_read_kb":354,"num_write":368,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'864","reported_seq":2550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.911046+0000","last_change":"2024-09-12T18:36:13.911046+0000","last_active":"2024-09-12T18:36:13.911046+0000","last_peered":"2024-09-12T18:36:13.911046+0000","last_clean":"2024-09-12T18:36:13.911046+0000","last_became_active":"2024-09-12T17:10:32.361696+0000","last_became_peered":"2024-09-12T17:10:32.361696+0000","last_unstale":"2024-09-12T18:36:13.911046+0000","last_undegraded":"2024-09-12T18:36:13.911046+0000","last_fullsized":"2024-09-12T18:36:13.911046+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'864","last_scrub_stamp":"2024-09-12T18:36:13.910873+0000","last_deep_scrub":"268'864","last_deep_scrub_stamp":"2024-09-12T18:36:13.910873+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.910873+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:05.088162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4191,"num_read_kb":3806,"num_write":1162,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'312","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.944399+0000","last_change":"2024-09-12T18:36:09.944245+0000","last_active":"2024-09-12T18:36:09.944399+0000","last_peered":"2024-09-12T18:36:09.944399+0000","last_clean":"2024-09-12T18:36:09.944399+0000","last_became_active":"2024-09-12T17:10:30.354730+0000","last_became_peered":"2024-09-12T17:10:30.354730+0000","last_unstale":"2024-09-12T18:36:09.944399+0000","last_undegraded":"2024-09-12T18:36:09.944399+0000","last_fullsized":"2024-09-12T18:36:09.944399+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'312","last_scrub_stamp":"2024-09-12T18:36:09.944018+0000","last_deep_scrub":"268'312","last_deep_scrub_stamp":"2024-09-12T18:36:09.944018+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.944018+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:20.773386+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":12992,"num_write":926,"num_write_kb":30670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":551,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.814786+0000","last_change":"2024-09-12T18:36:06.814786+0000","last_active":"2024-09-12T18:36:06.814786+0000","last_peered":"2024-09-12T18:36:06.814786+0000","last_clean":"2024-09-12T18:36:06.814786+0000","last_became_active":"2024-09-12T17:10:18.209658+0000","last_became_peered":"2024-09-12T17:10:18.209658+0000","last_unstale":"2024-09-12T18:36:06.814786+0000","last_undegraded":"2024-09-12T18:36:06.814786+0000","last_fullsized":"2024-09-12T18:36:06.814786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:06.814685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:06.814685+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.814685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:44.195873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010531659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.607924+0000","last_change":"2024-09-12T18:36:26.607924+0000","last_active":"2024-09-12T18:36:26.607924+0000","last_peered":"2024-09-12T18:36:26.607924+0000","last_clean":"2024-09-12T18:36:26.607924+0000","last_became_active":"2024-09-12T17:10:34.361845+0000","last_became_peered":"2024-09-12T17:10:34.361845+0000","last_unstale":"2024-09-12T18:36:26.607924+0000","last_undegraded":"2024-09-12T18:36:26.607924+0000","last_fullsized":"2024-09-12T18:36:26.607924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.607740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.607740+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.607740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:28.628006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'685","reported_seq":1406,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.663454+0000","last_change":"2024-09-12T18:36:28.663314+0000","last_active":"2024-09-12T18:36:28.663454+0000","last_peered":"2024-09-12T18:36:28.663454+0000","last_clean":"2024-09-12T18:36:28.663454+0000","last_became_active":"2024-09-12T17:10:36.398917+0000","last_became_peered":"2024-09-12T17:10:36.398917+0000","last_unstale":"2024-09-12T18:36:28.663454+0000","last_undegraded":"2024-09-12T18:36:28.663454+0000","last_fullsized":"2024-09-12T18:36:28.663454+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'685","last_scrub_stamp":"2024-09-12T18:36:28.663087+0000","last_deep_scrub":"268'685","last_deep_scrub_stamp":"2024-09-12T18:36:28.663087+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.663087+0000","objects_scrubbed":9,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:26.716240+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100883,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1833,"num_read_kb":3243,"num_write":2400,"num_write_kb":2201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":509380,"num_omap_keys":1154,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.708005+0000","last_change":"2024-09-12T18:36:34.708005+0000","last_active":"2024-09-12T18:36:34.708005+0000","last_peered":"2024-09-12T18:36:34.708005+0000","last_clean":"2024-09-12T18:36:34.708005+0000","last_became_active":"2024-09-12T17:10:38.400868+0000","last_became_peered":"2024-09-12T17:10:38.400868+0000","last_unstale":"2024-09-12T18:36:34.708005+0000","last_undegraded":"2024-09-12T18:36:34.708005+0000","last_fullsized":"2024-09-12T18:36:34.708005+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:34.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:34.707795+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.707795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:35.737755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'140","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.780796+0000","last_change":"2024-09-12T18:36:40.780796+0000","last_active":"2024-09-12T18:36:40.780796+0000","last_peered":"2024-09-12T18:36:40.780796+0000","last_clean":"2024-09-12T18:36:40.780796+0000","last_became_active":"2024-09-12T17:10:40.771185+0000","last_became_peered":"2024-09-12T17:10:40.771185+0000","last_unstale":"2024-09-12T18:36:40.780796+0000","last_undegraded":"2024-09-12T18:36:40.780796+0000","last_fullsized":"2024-09-12T18:36:40.780796+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'140","last_scrub_stamp":"2024-09-12T18:36:40.780568+0000","last_deep_scrub":"268'140","last_deep_scrub_stamp":"2024-09-12T18:36:40.780568+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.780568+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:20.238458+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":180,"num_write":328,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'473","reported_seq":2171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.533222+0000","last_change":"2024-09-12T18:36:18.533222+0000","last_active":"2024-09-12T18:36:18.533222+0000","last_peered":"2024-09-12T18:36:18.533222+0000","last_clean":"2024-09-12T18:36:18.533222+0000","last_became_active":"2024-09-12T17:10:32.354795+0000","last_became_peered":"2024-09-12T17:10:32.354795+0000","last_unstale":"2024-09-12T18:36:18.533222+0000","last_undegraded":"2024-09-12T18:36:18.533222+0000","last_fullsized":"2024-09-12T18:36:18.533222+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'473","last_scrub_stamp":"2024-09-12T18:36:18.532993+0000","last_deep_scrub":"268'473","last_deep_scrub_stamp":"2024-09-12T18:36:18.532993+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.532993+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:56.579630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2620,"num_read_kb":2476,"num_write":562,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'325","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.884981+0000","last_change":"2024-09-12T18:36:09.884981+0000","last_active":"2024-09-12T18:36:09.884981+0000","last_peered":"2024-09-12T18:36:09.884981+0000","last_clean":"2024-09-12T18:36:09.884981+0000","last_became_active":"2024-09-12T17:10:30.405460+0000","last_became_peered":"2024-09-12T17:10:30.405460+0000","last_unstale":"2024-09-12T18:36:09.884981+0000","last_undegraded":"2024-09-12T18:36:09.884981+0000","last_fullsized":"2024-09-12T18:36:09.884981+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'325","last_scrub_stamp":"2024-09-12T18:36:09.884732+0000","last_deep_scrub":"268'325","last_deep_scrub_stamp":"2024-09-12T18:36:09.884732+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.884732+0000","objects_scrubbed":9,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:49.903883+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243060,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":16852,"num_write":1075,"num_write_kb":30938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.983491+0000","last_change":"2024-09-12T18:36:09.983362+0000","last_active":"2024-09-12T18:36:09.983491+0000","last_peered":"2024-09-12T18:36:09.983491+0000","last_clean":"2024-09-12T18:36:09.983491+0000","last_became_active":"2024-09-12T17:10:18.208762+0000","last_became_peered":"2024-09-12T17:10:18.208762+0000","last_unstale":"2024-09-12T18:36:09.983491+0000","last_undegraded":"2024-09-12T18:36:09.983491+0000","last_fullsized":"2024-09-12T18:36:09.983491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:09.983179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:09.983179+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.983179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:05.608460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001091554,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.061203+0000","last_change":"2024-09-12T18:36:19.061203+0000","last_active":"2024-09-12T18:36:19.061203+0000","last_peered":"2024-09-12T18:36:19.061203+0000","last_clean":"2024-09-12T18:36:19.061203+0000","last_became_active":"2024-09-12T17:10:34.355590+0000","last_became_peered":"2024-09-12T17:10:34.355590+0000","last_unstale":"2024-09-12T18:36:19.061203+0000","last_undegraded":"2024-09-12T18:36:19.061203+0000","last_fullsized":"2024-09-12T18:36:19.061203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:19.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:19.060998+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:14.047471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'231","reported_seq":848,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.963144+0000","last_change":"2024-09-12T18:36:23.963144+0000","last_active":"2024-09-12T18:36:23.963144+0000","last_peered":"2024-09-12T18:36:23.963144+0000","last_clean":"2024-09-12T18:36:23.963144+0000","last_became_active":"2024-09-12T17:10:36.921234+0000","last_became_peered":"2024-09-12T17:10:36.921234+0000","last_unstale":"2024-09-12T18:36:23.963144+0000","last_undegraded":"2024-09-12T18:36:23.963144+0000","last_fullsized":"2024-09-12T18:36:23.963144+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'231","last_scrub_stamp":"2024-09-12T18:36:23.962933+0000","last_deep_scrub":"268'231","last_deep_scrub_stamp":"2024-09-12T18:36:23.962933+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.962933+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:00.002043+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":277,"num_write":196,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'793","reported_seq":2957,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.906363+0000","last_change":"2024-09-12T18:36:36.906202+0000","last_active":"2024-09-12T18:36:36.906363+0000","last_peered":"2024-09-12T18:36:36.906363+0000","last_clean":"2024-09-12T18:36:36.906363+0000","last_became_active":"2024-09-12T17:10:38.395439+0000","last_became_peered":"2024-09-12T17:10:38.395439+0000","last_unstale":"2024-09-12T18:36:36.906363+0000","last_undegraded":"2024-09-12T18:36:36.906363+0000","last_fullsized":"2024-09-12T18:36:36.906363+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'793","last_scrub_stamp":"2024-09-12T18:36:36.906025+0000","last_deep_scrub":"268'793","last_deep_scrub_stamp":"2024-09-12T18:36:36.906025+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.906025+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:45.280968+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'185","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:47.881985+0000","last_change":"2024-09-12T18:36:47.881985+0000","last_active":"2024-09-12T18:36:47.881985+0000","last_peered":"2024-09-12T18:36:47.881985+0000","last_clean":"2024-09-12T18:36:47.881985+0000","last_became_active":"2024-09-12T17:10:40.770042+0000","last_became_peered":"2024-09-12T17:10:40.770042+0000","last_unstale":"2024-09-12T18:36:47.881985+0000","last_undegraded":"2024-09-12T18:36:47.881985+0000","last_fullsized":"2024-09-12T18:36:47.881985+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'185","last_scrub_stamp":"2024-09-12T18:36:47.881781+0000","last_deep_scrub":"268'185","last_deep_scrub_stamp":"2024-09-12T18:36:47.881781+0000","last_clean_scrub_stamp":"2024-09-12T18:36:47.881781+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:46.740088+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":293,"num_read_kb":273,"num_write":449,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'902","reported_seq":2645,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.834272+0000","last_change":"2024-09-12T18:36:16.834013+0000","last_active":"2024-09-12T18:36:16.834272+0000","last_peered":"2024-09-12T18:36:16.834272+0000","last_clean":"2024-09-12T18:36:16.834272+0000","last_became_active":"2024-09-12T17:10:32.382755+0000","last_became_peered":"2024-09-12T17:10:32.382755+0000","last_unstale":"2024-09-12T18:36:16.834272+0000","last_undegraded":"2024-09-12T18:36:16.834272+0000","last_fullsized":"2024-09-12T18:36:16.834272+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'902","last_scrub_stamp":"2024-09-12T18:36:16.833790+0000","last_deep_scrub":"268'902","last_deep_scrub_stamp":"2024-09-12T18:36:16.833790+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.833790+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:47.335837+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4651,"num_read_kb":4208,"num_write":1244,"num_write_kb":526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4562,"num_omap_keys":18,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'316","reported_seq":955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.947740+0000","last_change":"2024-09-12T18:36:08.947740+0000","last_active":"2024-09-12T18:36:08.947740+0000","last_peered":"2024-09-12T18:36:08.947740+0000","last_clean":"2024-09-12T18:36:08.947740+0000","last_became_active":"2024-09-12T17:10:30.364767+0000","last_became_peered":"2024-09-12T17:10:30.364767+0000","last_unstale":"2024-09-12T18:36:08.947740+0000","last_undegraded":"2024-09-12T18:36:08.947740+0000","last_fullsized":"2024-09-12T18:36:08.947740+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'316","last_scrub_stamp":"2024-09-12T18:36:08.947480+0000","last_deep_scrub":"268'316","last_deep_scrub_stamp":"2024-09-12T18:36:08.947480+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.947480+0000","objects_scrubbed":9,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:50.062268+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":450,"num_read_kb":23959,"num_write":1040,"num_write_kb":32355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.822598+0000","last_change":"2024-09-12T18:36:07.822491+0000","last_active":"2024-09-12T18:36:07.822598+0000","last_peered":"2024-09-12T18:36:07.822598+0000","last_clean":"2024-09-12T18:36:07.822598+0000","last_became_active":"2024-09-12T17:10:18.073132+0000","last_became_peered":"2024-09-12T17:10:18.073132+0000","last_unstale":"2024-09-12T18:36:07.822598+0000","last_undegraded":"2024-09-12T18:36:07.822598+0000","last_fullsized":"2024-09-12T18:36:07.822598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:07.822365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:07.822365+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.822365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:38.482041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001154721,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.926922+0000","last_change":"2024-09-12T18:36:24.926922+0000","last_active":"2024-09-12T18:36:24.926922+0000","last_peered":"2024-09-12T18:36:24.926922+0000","last_clean":"2024-09-12T18:36:24.926922+0000","last_became_active":"2024-09-12T17:10:34.349093+0000","last_became_peered":"2024-09-12T17:10:34.349093+0000","last_unstale":"2024-09-12T18:36:24.926922+0000","last_undegraded":"2024-09-12T18:36:24.926922+0000","last_fullsized":"2024-09-12T18:36:24.926922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:24.926737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:24.926737+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.926737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:07.858866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'174","reported_seq":762,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.847044+0000","last_change":"2024-09-12T18:36:30.847044+0000","last_active":"2024-09-12T18:36:30.847044+0000","last_peered":"2024-09-12T18:36:30.847044+0000","last_clean":"2024-09-12T18:36:30.847044+0000","last_became_active":"2024-09-12T17:10:36.390439+0000","last_became_peered":"2024-09-12T17:10:36.390439+0000","last_unstale":"2024-09-12T18:36:30.847044+0000","last_undegraded":"2024-09-12T18:36:30.847044+0000","last_fullsized":"2024-09-12T18:36:30.847044+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'174","last_scrub_stamp":"2024-09-12T18:36:30.846848+0000","last_deep_scrub":"268'174","last_deep_scrub_stamp":"2024-09-12T18:36:30.846848+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.846848+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:23.164661+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":183,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'809","reported_seq":2869,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.919613+0000","last_change":"2024-09-12T18:36:37.919613+0000","last_active":"2024-09-12T18:36:37.919613+0000","last_peered":"2024-09-12T18:36:37.919613+0000","last_clean":"2024-09-12T18:36:37.919613+0000","last_became_active":"2024-09-12T17:10:38.393426+0000","last_became_peered":"2024-09-12T17:10:38.393426+0000","last_unstale":"2024-09-12T18:36:37.919613+0000","last_undegraded":"2024-09-12T18:36:37.919613+0000","last_fullsized":"2024-09-12T18:36:37.919613+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'809","last_scrub_stamp":"2024-09-12T18:36:37.919417+0000","last_deep_scrub":"268'809","last_deep_scrub_stamp":"2024-09-12T18:36:37.919417+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.919417+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:41.111792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'259","reported_seq":811,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.760094+0000","last_change":"2024-09-12T18:36:41.760094+0000","last_active":"2024-09-12T18:36:41.760094+0000","last_peered":"2024-09-12T18:36:41.760094+0000","last_clean":"2024-09-12T18:36:41.760094+0000","last_became_active":"2024-09-12T17:10:40.423742+0000","last_became_peered":"2024-09-12T17:10:40.423742+0000","last_unstale":"2024-09-12T18:36:41.760094+0000","last_undegraded":"2024-09-12T18:36:41.760094+0000","last_fullsized":"2024-09-12T18:36:41.760094+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'259","last_scrub_stamp":"2024-09-12T18:36:41.759888+0000","last_deep_scrub":"268'259","last_deep_scrub_stamp":"2024-09-12T18:36:41.759888+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.759888+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:57.353061+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":353,"num_read_kb":347,"num_write":533,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'875","reported_seq":2677,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.961775+0000","last_change":"2024-09-12T18:36:10.961775+0000","last_active":"2024-09-12T18:36:10.961775+0000","last_peered":"2024-09-12T18:36:10.961775+0000","last_clean":"2024-09-12T18:36:10.961775+0000","last_became_active":"2024-09-12T17:10:32.368217+0000","last_became_peered":"2024-09-12T17:10:32.368217+0000","last_unstale":"2024-09-12T18:36:10.961775+0000","last_undegraded":"2024-09-12T18:36:10.961775+0000","last_fullsized":"2024-09-12T18:36:10.961775+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'875","last_scrub_stamp":"2024-09-12T18:36:10.961561+0000","last_deep_scrub":"268'875","last_deep_scrub_stamp":"2024-09-12T18:36:10.961561+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.961561+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:02.933031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4306,"num_read_kb":3903,"num_write":1124,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1533,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'367","reported_seq":1080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.599903+0000","last_change":"2024-09-12T18:36:06.599903+0000","last_active":"2024-09-12T18:36:06.599903+0000","last_peered":"2024-09-12T18:36:06.599903+0000","last_clean":"2024-09-12T18:36:06.599903+0000","last_became_active":"2024-09-12T17:10:30.361736+0000","last_became_peered":"2024-09-12T17:10:30.361736+0000","last_unstale":"2024-09-12T18:36:06.599903+0000","last_undegraded":"2024-09-12T18:36:06.599903+0000","last_fullsized":"2024-09-12T18:36:06.599903+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'367","last_scrub_stamp":"2024-09-12T18:36:06.599810+0000","last_deep_scrub":"268'367","last_deep_scrub_stamp":"2024-09-12T18:36:06.599810+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.599810+0000","objects_scrubbed":7,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:40.095034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5736431,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":617,"num_read_kb":21637,"num_write":1193,"num_write_kb":30222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":549,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.128909+0000","last_change":"2024-09-12T18:36:08.128765+0000","last_active":"2024-09-12T18:36:08.128909+0000","last_peered":"2024-09-12T18:36:08.128909+0000","last_clean":"2024-09-12T18:36:08.128909+0000","last_became_active":"2024-09-12T17:10:18.074669+0000","last_became_peered":"2024-09-12T17:10:18.074669+0000","last_unstale":"2024-09-12T18:36:08.128909+0000","last_undegraded":"2024-09-12T18:36:08.128909+0000","last_fullsized":"2024-09-12T18:36:08.128909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:08.128568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:08.128568+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.128568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:13.278072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.813670+0000","last_change":"2024-09-12T18:36:28.813505+0000","last_active":"2024-09-12T18:36:28.813670+0000","last_peered":"2024-09-12T18:36:28.813670+0000","last_clean":"2024-09-12T18:36:28.813670+0000","last_became_active":"2024-09-12T17:10:34.358250+0000","last_became_peered":"2024-09-12T17:10:34.358250+0000","last_unstale":"2024-09-12T18:36:28.813670+0000","last_undegraded":"2024-09-12T18:36:28.813670+0000","last_fullsized":"2024-09-12T18:36:28.813670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:28.813308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:28.813308+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.813308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:48.280221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'750","reported_seq":1518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.024128+0000","last_change":"2024-09-12T18:36:30.024128+0000","last_active":"2024-09-12T18:36:30.024128+0000","last_peered":"2024-09-12T18:36:30.024128+0000","last_clean":"2024-09-12T18:36:30.024128+0000","last_became_active":"2024-09-12T17:10:36.920239+0000","last_became_peered":"2024-09-12T17:10:36.920239+0000","last_unstale":"2024-09-12T18:36:30.024128+0000","last_undegraded":"2024-09-12T18:36:30.024128+0000","last_fullsized":"2024-09-12T18:36:30.024128+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'750","last_scrub_stamp":"2024-09-12T18:36:30.023945+0000","last_deep_scrub":"268'750","last_deep_scrub_stamp":"2024-09-12T18:36:30.023945+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.023945+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:49.559022+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144312,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1298,"num_read_kb":3045,"num_write":1034,"num_write_kb":815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.926272+0000","last_change":"2024-09-12T18:36:39.926272+0000","last_active":"2024-09-12T18:36:39.926272+0000","last_peered":"2024-09-12T18:36:39.926272+0000","last_clean":"2024-09-12T18:36:39.926272+0000","last_became_active":"2024-09-12T17:10:38.391661+0000","last_became_peered":"2024-09-12T17:10:38.391661+0000","last_unstale":"2024-09-12T18:36:39.926272+0000","last_undegraded":"2024-09-12T18:36:39.926272+0000","last_fullsized":"2024-09-12T18:36:39.926272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:39.926092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:39.926092+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.926092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:59.398217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'102","reported_seq":620,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.815816+0000","last_change":"2024-09-12T18:36:41.815816+0000","last_active":"2024-09-12T18:36:41.815816+0000","last_peered":"2024-09-12T18:36:41.815816+0000","last_clean":"2024-09-12T18:36:41.815816+0000","last_became_active":"2024-09-12T17:10:40.435114+0000","last_became_peered":"2024-09-12T17:10:40.435114+0000","last_unstale":"2024-09-12T18:36:41.815816+0000","last_undegraded":"2024-09-12T18:36:41.815816+0000","last_fullsized":"2024-09-12T18:36:41.815816+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'102","last_scrub_stamp":"2024-09-12T18:36:41.815605+0000","last_deep_scrub":"268'102","last_deep_scrub_stamp":"2024-09-12T18:36:41.815605+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.815605+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:09.427117+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":238,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'130","reported_seq":735,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.745640+0000","last_change":"2024-09-12T18:36:43.745640+0000","last_active":"2024-09-12T18:36:43.745640+0000","last_peered":"2024-09-12T18:36:43.745640+0000","last_clean":"2024-09-12T18:36:43.745640+0000","last_became_active":"2024-09-12T17:10:40.417972+0000","last_became_peered":"2024-09-12T17:10:40.417972+0000","last_unstale":"2024-09-12T18:36:43.745640+0000","last_undegraded":"2024-09-12T18:36:43.745640+0000","last_fullsized":"2024-09-12T18:36:43.745640+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'130","last_scrub_stamp":"2024-09-12T18:36:43.745449+0000","last_deep_scrub":"268'130","last_deep_scrub_stamp":"2024-09-12T18:36:43.745449+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.745449+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:46.799454+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":319,"num_read_kb":297,"num_write":314,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'794","reported_seq":2324,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.019305+0000","last_change":"2024-09-12T18:36:15.019127+0000","last_active":"2024-09-12T18:36:15.019305+0000","last_peered":"2024-09-12T18:36:15.019305+0000","last_clean":"2024-09-12T18:36:15.019305+0000","last_became_active":"2024-09-12T17:10:32.368063+0000","last_became_peered":"2024-09-12T17:10:32.368063+0000","last_unstale":"2024-09-12T18:36:15.019305+0000","last_undegraded":"2024-09-12T18:36:15.019305+0000","last_fullsized":"2024-09-12T18:36:15.019305+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'794","last_scrub_stamp":"2024-09-12T18:36:15.018950+0000","last_deep_scrub":"268'794","last_deep_scrub_stamp":"2024-09-12T18:36:15.018950+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.018950+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:15.614937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3740,"num_read_kb":3358,"num_write":1050,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'385","reported_seq":1051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.014293+0000","last_change":"2024-09-12T18:36:09.014293+0000","last_active":"2024-09-12T18:36:09.014293+0000","last_peered":"2024-09-12T18:36:09.014293+0000","last_clean":"2024-09-12T18:36:09.014293+0000","last_became_active":"2024-09-12T17:10:30.394117+0000","last_became_peered":"2024-09-12T17:10:30.394117+0000","last_unstale":"2024-09-12T18:36:09.014293+0000","last_undegraded":"2024-09-12T18:36:09.014293+0000","last_fullsized":"2024-09-12T18:36:09.014293+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-12T18:36:09.014036+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-12T18:36:09.014036+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.014036+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:20.531488+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330018,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":538,"num_read_kb":2122,"num_write":1160,"num_write_kb":20675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.975963+0000","last_change":"2024-09-12T18:36:22.975839+0000","last_active":"2024-09-12T18:36:22.975963+0000","last_peered":"2024-09-12T18:36:22.975963+0000","last_clean":"2024-09-12T18:36:22.975963+0000","last_became_active":"2024-09-12T17:10:34.359923+0000","last_became_peered":"2024-09-12T17:10:34.359923+0000","last_unstale":"2024-09-12T18:36:22.975963+0000","last_undegraded":"2024-09-12T18:36:22.975963+0000","last_fullsized":"2024-09-12T18:36:22.975963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:22.975695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:22.975695+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.975695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:10.101003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'308","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.932248+0000","last_change":"2024-09-12T18:36:32.932101+0000","last_active":"2024-09-12T18:36:32.932248+0000","last_peered":"2024-09-12T18:36:32.932248+0000","last_clean":"2024-09-12T18:36:32.932248+0000","last_became_active":"2024-09-12T17:10:36.394731+0000","last_became_peered":"2024-09-12T17:10:36.394731+0000","last_unstale":"2024-09-12T18:36:32.932248+0000","last_undegraded":"2024-09-12T18:36:32.932248+0000","last_fullsized":"2024-09-12T18:36:32.932248+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'308","last_scrub_stamp":"2024-09-12T18:36:32.931887+0000","last_deep_scrub":"268'308","last_deep_scrub_stamp":"2024-09-12T18:36:32.931887+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.931887+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:30.103482+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56497,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":1193,"num_write":404,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.933682+0000","last_change":"2024-09-12T18:36:38.933547+0000","last_active":"2024-09-12T18:36:38.933682+0000","last_peered":"2024-09-12T18:36:38.933682+0000","last_clean":"2024-09-12T18:36:38.933682+0000","last_became_active":"2024-09-12T17:10:38.393112+0000","last_became_peered":"2024-09-12T17:10:38.393112+0000","last_unstale":"2024-09-12T18:36:38.933682+0000","last_undegraded":"2024-09-12T18:36:38.933682+0000","last_fullsized":"2024-09-12T18:36:38.933682+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:38.933365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:38.933365+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.933365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:17.416261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'117","reported_seq":641,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:46.898821+0000","last_change":"2024-09-12T18:36:46.898683+0000","last_active":"2024-09-12T18:36:46.898821+0000","last_peered":"2024-09-12T18:36:46.898821+0000","last_clean":"2024-09-12T18:36:46.898821+0000","last_became_active":"2024-09-12T17:10:40.429366+0000","last_became_peered":"2024-09-12T17:10:40.429366+0000","last_unstale":"2024-09-12T18:36:46.898821+0000","last_undegraded":"2024-09-12T18:36:46.898821+0000","last_fullsized":"2024-09-12T18:36:46.898821+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'117","last_scrub_stamp":"2024-09-12T18:36:46.898503+0000","last_deep_scrub":"268'117","last_deep_scrub_stamp":"2024-09-12T18:36:46.898503+0000","last_clean_scrub_stamp":"2024-09-12T18:36:46.898503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:30.894480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":137,"num_write":282,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'500","reported_seq":2109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.917232+0000","last_change":"2024-09-12T18:36:15.917070+0000","last_active":"2024-09-12T18:36:15.917232+0000","last_peered":"2024-09-12T18:36:15.917232+0000","last_clean":"2024-09-12T18:36:15.917232+0000","last_became_active":"2024-09-12T17:10:32.364033+0000","last_became_peered":"2024-09-12T17:10:32.364033+0000","last_unstale":"2024-09-12T18:36:15.917232+0000","last_undegraded":"2024-09-12T18:36:15.917232+0000","last_fullsized":"2024-09-12T18:36:15.917232+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'500","last_scrub_stamp":"2024-09-12T18:36:15.916790+0000","last_deep_scrub":"268'500","last_deep_scrub_stamp":"2024-09-12T18:36:15.916790+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.916790+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:19.758173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2497,"num_read_kb":2341,"num_write":588,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'287","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.956199+0000","last_change":"2024-09-12T18:36:15.956199+0000","last_active":"2024-09-12T18:36:15.956199+0000","last_peered":"2024-09-12T18:36:15.956199+0000","last_clean":"2024-09-12T18:36:15.956199+0000","last_became_active":"2024-09-12T17:10:30.405137+0000","last_became_peered":"2024-09-12T17:10:30.405137+0000","last_unstale":"2024-09-12T18:36:15.956199+0000","last_undegraded":"2024-09-12T18:36:15.956199+0000","last_fullsized":"2024-09-12T18:36:15.956199+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'287","last_scrub_stamp":"2024-09-12T18:36:15.955868+0000","last_deep_scrub":"268'287","last_deep_scrub_stamp":"2024-09-12T18:36:15.955868+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.955868+0000","objects_scrubbed":9,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:38.210429+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728666,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":586,"num_read_kb":36707,"num_write":949,"num_write_kb":52863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.757177+0000","last_change":"2024-09-12T18:36:26.757025+0000","last_active":"2024-09-12T18:36:26.757177+0000","last_peered":"2024-09-12T18:36:26.757177+0000","last_clean":"2024-09-12T18:36:26.757177+0000","last_became_active":"2024-09-12T17:10:34.355684+0000","last_became_peered":"2024-09-12T17:10:34.355684+0000","last_unstale":"2024-09-12T18:36:26.757177+0000","last_undegraded":"2024-09-12T18:36:26.757177+0000","last_fullsized":"2024-09-12T18:36:26.757177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.756852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.756852+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.756852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:01.952314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'61","reported_seq":600,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.684553+0000","last_change":"2024-09-12T18:36:30.684320+0000","last_active":"2024-09-12T18:36:30.684553+0000","last_peered":"2024-09-12T18:36:30.684553+0000","last_clean":"2024-09-12T18:36:30.684553+0000","last_became_active":"2024-09-12T17:10:36.400358+0000","last_became_peered":"2024-09-12T17:10:36.400358+0000","last_unstale":"2024-09-12T18:36:30.684553+0000","last_undegraded":"2024-09-12T18:36:30.684553+0000","last_fullsized":"2024-09-12T18:36:30.684553+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'61","last_scrub_stamp":"2024-09-12T18:36:30.684044+0000","last_deep_scrub":"268'61","last_deep_scrub_stamp":"2024-09-12T18:36:30.684044+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.684044+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:14:14.583204+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":54,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.996235+0000","last_change":"2024-09-12T18:36:36.995988+0000","last_active":"2024-09-12T18:36:36.996235+0000","last_peered":"2024-09-12T18:36:36.996235+0000","last_clean":"2024-09-12T18:36:36.996235+0000","last_became_active":"2024-09-12T17:10:38.404309+0000","last_became_peered":"2024-09-12T17:10:38.404309+0000","last_unstale":"2024-09-12T18:36:36.996235+0000","last_undegraded":"2024-09-12T18:36:36.996235+0000","last_fullsized":"2024-09-12T18:36:36.996235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:36.995770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:36.995770+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.995770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:40.259880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'195","reported_seq":746,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.716148+0000","last_change":"2024-09-12T18:36:44.716148+0000","last_active":"2024-09-12T18:36:44.716148+0000","last_peered":"2024-09-12T18:36:44.716148+0000","last_clean":"2024-09-12T18:36:44.716148+0000","last_became_active":"2024-09-12T17:10:40.418473+0000","last_became_peered":"2024-09-12T17:10:40.418473+0000","last_unstale":"2024-09-12T18:36:44.716148+0000","last_undegraded":"2024-09-12T18:36:44.716148+0000","last_fullsized":"2024-09-12T18:36:44.716148+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'195","last_scrub_stamp":"2024-09-12T18:36:44.715966+0000","last_deep_scrub":"268'195","last_deep_scrub_stamp":"2024-09-12T18:36:44.715966+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.715966+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:32.160773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":350,"num_read_kb":341,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'359","reported_seq":1691,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.844861+0000","last_change":"2024-09-12T18:36:18.844725+0000","last_active":"2024-09-12T18:36:18.844861+0000","last_peered":"2024-09-12T18:36:18.844861+0000","last_clean":"2024-09-12T18:36:18.844861+0000","last_became_active":"2024-09-12T17:10:32.382581+0000","last_became_peered":"2024-09-12T17:10:32.382581+0000","last_unstale":"2024-09-12T18:36:18.844861+0000","last_undegraded":"2024-09-12T18:36:18.844861+0000","last_fullsized":"2024-09-12T18:36:18.844861+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T18:36:18.844512+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T18:36:18.844512+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.844512+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:14.341522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1854,"num_read_kb":1737,"num_write":414,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'369","reported_seq":1050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.893176+0000","last_change":"2024-09-12T18:36:11.893176+0000","last_active":"2024-09-12T18:36:11.893176+0000","last_peered":"2024-09-12T18:36:11.893176+0000","last_clean":"2024-09-12T18:36:11.893176+0000","last_became_active":"2024-09-12T17:10:30.374846+0000","last_became_peered":"2024-09-12T17:10:30.374846+0000","last_unstale":"2024-09-12T18:36:11.893176+0000","last_undegraded":"2024-09-12T18:36:11.893176+0000","last_fullsized":"2024-09-12T18:36:11.893176+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'369","last_scrub_stamp":"2024-09-12T18:36:11.892901+0000","last_deep_scrub":"268'369","last_deep_scrub_stamp":"2024-09-12T18:36:11.892901+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.892901+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:09.620432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572943,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":611,"num_read_kb":15632,"num_write":1214,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.019790+0000","last_change":"2024-09-12T18:36:28.019636+0000","last_active":"2024-09-12T18:36:28.019790+0000","last_peered":"2024-09-12T18:36:28.019790+0000","last_clean":"2024-09-12T18:36:28.019790+0000","last_became_active":"2024-09-12T17:10:34.362168+0000","last_became_peered":"2024-09-12T17:10:34.362168+0000","last_unstale":"2024-09-12T18:36:28.019790+0000","last_undegraded":"2024-09-12T18:36:28.019790+0000","last_fullsized":"2024-09-12T18:36:28.019790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:28.019461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:28.019461+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.019461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:31.096402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'385","reported_seq":1019,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.989833+0000","last_change":"2024-09-12T18:36:34.989672+0000","last_active":"2024-09-12T18:36:34.989833+0000","last_peered":"2024-09-12T18:36:34.989833+0000","last_clean":"2024-09-12T18:36:34.989833+0000","last_became_active":"2024-09-12T17:10:36.394639+0000","last_became_peered":"2024-09-12T17:10:36.394639+0000","last_unstale":"2024-09-12T18:36:34.989833+0000","last_undegraded":"2024-09-12T18:36:34.989833+0000","last_fullsized":"2024-09-12T18:36:34.989833+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-12T18:36:34.989490+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-12T18:36:34.989490+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.989490+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:30.943215+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67938,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":612,"num_read_kb":1404,"num_write":492,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.138181+0000","last_change":"2024-09-12T18:36:23.138026+0000","last_active":"2024-09-12T18:36:23.138181+0000","last_peered":"2024-09-12T18:36:23.138181+0000","last_clean":"2024-09-12T18:36:23.138181+0000","last_became_active":"2024-09-12T17:10:38.413131+0000","last_became_peered":"2024-09-12T17:10:38.413131+0000","last_unstale":"2024-09-12T18:36:23.138181+0000","last_undegraded":"2024-09-12T18:36:23.138181+0000","last_fullsized":"2024-09-12T18:36:23.138181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:23.137806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:23.137806+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.137806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:14.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'133","reported_seq":661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.796714+0000","last_change":"2024-09-12T18:36:43.796714+0000","last_active":"2024-09-12T18:36:43.796714+0000","last_peered":"2024-09-12T18:36:43.796714+0000","last_clean":"2024-09-12T18:36:43.796714+0000","last_became_active":"2024-09-12T17:10:40.429224+0000","last_became_peered":"2024-09-12T17:10:40.429224+0000","last_unstale":"2024-09-12T18:36:43.796714+0000","last_undegraded":"2024-09-12T18:36:43.796714+0000","last_fullsized":"2024-09-12T18:36:43.796714+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'133","last_scrub_stamp":"2024-09-12T18:36:43.796489+0000","last_deep_scrub":"268'133","last_deep_scrub_stamp":"2024-09-12T18:36:43.796489+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.796489+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:03.966623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'951","reported_seq":2636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.818285+0000","last_change":"2024-09-12T18:36:17.818036+0000","last_active":"2024-09-12T18:36:17.818285+0000","last_peered":"2024-09-12T18:36:17.818285+0000","last_clean":"2024-09-12T18:36:17.818285+0000","last_became_active":"2024-09-12T17:10:32.369282+0000","last_became_peered":"2024-09-12T17:10:32.369282+0000","last_unstale":"2024-09-12T18:36:17.818285+0000","last_undegraded":"2024-09-12T18:36:17.818285+0000","last_fullsized":"2024-09-12T18:36:17.818285+0000","mapping_epoch":27,"log_start":"268'900","ondisk_log_start":"268'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'951","last_scrub_stamp":"2024-09-12T18:36:17.817821+0000","last_deep_scrub":"268'951","last_deep_scrub_stamp":"2024-09-12T18:36:17.817821+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.817821+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:50.499239+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4532,"num_read_kb":4046,"num_write":1302,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'374","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.619579+0000","last_change":"2024-09-12T18:36:07.619579+0000","last_active":"2024-09-12T18:36:07.619579+0000","last_peered":"2024-09-12T18:36:07.619579+0000","last_clean":"2024-09-12T18:36:07.619579+0000","last_became_active":"2024-09-12T17:10:30.356383+0000","last_became_peered":"2024-09-12T17:10:30.356383+0000","last_unstale":"2024-09-12T18:36:07.619579+0000","last_undegraded":"2024-09-12T18:36:07.619579+0000","last_fullsized":"2024-09-12T18:36:07.619579+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'374","last_scrub_stamp":"2024-09-12T18:36:07.619444+0000","last_deep_scrub":"268'374","last_deep_scrub_stamp":"2024-09-12T18:36:07.619444+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.619444+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:13.321492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":17278,"num_write":1157,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.137041+0000","last_change":"2024-09-12T18:36:22.136810+0000","last_active":"2024-09-12T18:36:22.137041+0000","last_peered":"2024-09-12T18:36:22.137041+0000","last_clean":"2024-09-12T18:36:22.137041+0000","last_became_active":"2024-09-12T17:10:34.363279+0000","last_became_peered":"2024-09-12T17:10:34.363279+0000","last_unstale":"2024-09-12T18:36:22.137041+0000","last_undegraded":"2024-09-12T18:36:22.137041+0000","last_fullsized":"2024-09-12T18:36:22.137041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:22.136599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:22.136599+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.136599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:38.570087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'324","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.918023+0000","last_change":"2024-09-12T18:36:32.917877+0000","last_active":"2024-09-12T18:36:32.918023+0000","last_peered":"2024-09-12T18:36:32.918023+0000","last_clean":"2024-09-12T18:36:32.918023+0000","last_became_active":"2024-09-12T17:10:36.396758+0000","last_became_peered":"2024-09-12T17:10:36.396758+0000","last_unstale":"2024-09-12T18:36:32.918023+0000","last_undegraded":"2024-09-12T18:36:32.918023+0000","last_fullsized":"2024-09-12T18:36:32.918023+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'324","last_scrub_stamp":"2024-09-12T18:36:32.917681+0000","last_deep_scrub":"268'324","last_deep_scrub_stamp":"2024-09-12T18:36:32.917681+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.917681+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:42.212707+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59757,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1297,"num_write":442,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.814631+0000","last_change":"2024-09-12T18:36:36.814492+0000","last_active":"2024-09-12T18:36:36.814631+0000","last_peered":"2024-09-12T18:36:36.814631+0000","last_clean":"2024-09-12T18:36:36.814631+0000","last_became_active":"2024-09-12T17:10:38.413004+0000","last_became_peered":"2024-09-12T17:10:38.413004+0000","last_unstale":"2024-09-12T18:36:36.814631+0000","last_undegraded":"2024-09-12T18:36:36.814631+0000","last_fullsized":"2024-09-12T18:36:36.814631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:36.814278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:36.814278+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.814278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:20.375476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'441","reported_seq":1953,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.092673+0000","last_change":"2024-09-12T18:36:17.092673+0000","last_active":"2024-09-12T18:36:17.092673+0000","last_peered":"2024-09-12T18:36:17.092673+0000","last_clean":"2024-09-12T18:36:17.092673+0000","last_became_active":"2024-09-12T17:10:32.350751+0000","last_became_peered":"2024-09-12T17:10:32.350751+0000","last_unstale":"2024-09-12T18:36:17.092673+0000","last_undegraded":"2024-09-12T18:36:17.092673+0000","last_fullsized":"2024-09-12T18:36:17.092673+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'441","last_scrub_stamp":"2024-09-12T18:36:17.092489+0000","last_deep_scrub":"268'441","last_deep_scrub_stamp":"2024-09-12T18:36:17.092489+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.092489+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:22.621992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2256,"num_read_kb":2119,"num_write":496,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'284","reported_seq":939,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.937121+0000","last_change":"2024-09-12T18:36:10.937121+0000","last_active":"2024-09-12T18:36:10.937121+0000","last_peered":"2024-09-12T18:36:10.937121+0000","last_clean":"2024-09-12T18:36:10.937121+0000","last_became_active":"2024-09-12T17:10:30.353308+0000","last_became_peered":"2024-09-12T17:10:30.353308+0000","last_unstale":"2024-09-12T18:36:10.937121+0000","last_undegraded":"2024-09-12T18:36:10.937121+0000","last_fullsized":"2024-09-12T18:36:10.937121+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'284","last_scrub_stamp":"2024-09-12T18:36:10.936793+0000","last_deep_scrub":"268'284","last_deep_scrub_stamp":"2024-09-12T18:36:10.936793+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.936793+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:08.902755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262194,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":407,"num_read_kb":20512,"num_write":856,"num_write_kb":25251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.593410+0000","last_change":"2024-09-12T18:36:25.593258+0000","last_active":"2024-09-12T18:36:25.593410+0000","last_peered":"2024-09-12T18:36:25.593410+0000","last_clean":"2024-09-12T18:36:25.593410+0000","last_became_active":"2024-09-12T17:10:34.357883+0000","last_became_peered":"2024-09-12T17:10:34.357883+0000","last_unstale":"2024-09-12T18:36:25.593410+0000","last_undegraded":"2024-09-12T18:36:25.593410+0000","last_fullsized":"2024-09-12T18:36:25.593410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:25.593056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:25.593056+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.593056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:49.907882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'523","reported_seq":1189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.886533+0000","last_change":"2024-09-12T18:36:28.886533+0000","last_active":"2024-09-12T18:36:28.886533+0000","last_peered":"2024-09-12T18:36:28.886533+0000","last_clean":"2024-09-12T18:36:28.886533+0000","last_became_active":"2024-09-12T17:10:36.401608+0000","last_became_peered":"2024-09-12T17:10:36.401608+0000","last_unstale":"2024-09-12T18:36:28.886533+0000","last_undegraded":"2024-09-12T18:36:28.886533+0000","last_fullsized":"2024-09-12T18:36:28.886533+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'523","last_scrub_stamp":"2024-09-12T18:36:28.886458+0000","last_deep_scrub":"268'523","last_deep_scrub_stamp":"2024-09-12T18:36:28.886458+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.886458+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:36.974846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95576,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":903,"num_read_kb":2101,"num_write":776,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.860439+0000","last_change":"2024-09-12T18:36:38.860439+0000","last_active":"2024-09-12T18:36:38.860439+0000","last_peered":"2024-09-12T18:36:38.860439+0000","last_clean":"2024-09-12T18:36:38.860439+0000","last_became_active":"2024-09-12T17:10:38.398862+0000","last_became_peered":"2024-09-12T17:10:38.398862+0000","last_unstale":"2024-09-12T18:36:38.860439+0000","last_undegraded":"2024-09-12T18:36:38.860439+0000","last_fullsized":"2024-09-12T18:36:38.860439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:38.860257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:38.860257+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.860257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:31.601508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'159","reported_seq":689,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.913041+0000","last_change":"2024-09-12T18:36:43.912889+0000","last_active":"2024-09-12T18:36:43.913041+0000","last_peered":"2024-09-12T18:36:43.913041+0000","last_clean":"2024-09-12T18:36:43.913041+0000","last_became_active":"2024-09-12T17:10:40.770075+0000","last_became_peered":"2024-09-12T17:10:40.770075+0000","last_unstale":"2024-09-12T18:36:43.913041+0000","last_undegraded":"2024-09-12T18:36:43.913041+0000","last_fullsized":"2024-09-12T18:36:43.913041+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'159","last_scrub_stamp":"2024-09-12T18:36:43.912709+0000","last_deep_scrub":"268'159","last_deep_scrub_stamp":"2024-09-12T18:36:43.912709+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.912709+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:54.272079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":234,"num_write":361,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'1462","reported_seq":3057,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.508454+0000","last_change":"2024-09-12T18:36:17.508311+0000","last_active":"2024-09-12T18:36:17.508454+0000","last_peered":"2024-09-12T18:36:17.508454+0000","last_clean":"2024-09-12T18:36:17.508454+0000","last_became_active":"2024-09-12T17:10:32.376892+0000","last_became_peered":"2024-09-12T17:10:32.376892+0000","last_unstale":"2024-09-12T18:36:17.508454+0000","last_undegraded":"2024-09-12T18:36:17.508454+0000","last_fullsized":"2024-09-12T18:36:17.508454+0000","mapping_epoch":27,"log_start":"268'1400","ondisk_log_start":"268'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1462","last_scrub_stamp":"2024-09-12T18:36:17.508128+0000","last_deep_scrub":"268'1462","last_deep_scrub_stamp":"2024-09-12T18:36:17.508128+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.508128+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":1400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.380441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6636,"num_read_kb":5839,"num_write":2046,"num_write_kb":883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'297","reported_seq":942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.834263+0000","last_change":"2024-09-12T18:36:08.834263+0000","last_active":"2024-09-12T18:36:08.834263+0000","last_peered":"2024-09-12T18:36:08.834263+0000","last_clean":"2024-09-12T18:36:08.834263+0000","last_became_active":"2024-09-12T17:10:30.378075+0000","last_became_peered":"2024-09-12T17:10:30.378075+0000","last_unstale":"2024-09-12T18:36:08.834263+0000","last_undegraded":"2024-09-12T18:36:08.834263+0000","last_fullsized":"2024-09-12T18:36:08.834263+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'297","last_scrub_stamp":"2024-09-12T18:36:08.833929+0000","last_deep_scrub":"268'297","last_deep_scrub_stamp":"2024-09-12T18:36:08.833929+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.833929+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:52.476849+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4500309,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":47843,"num_write":921,"num_write_kb":30557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.097940+0000","last_change":"2024-09-12T18:36:20.097940+0000","last_active":"2024-09-12T18:36:20.097940+0000","last_peered":"2024-09-12T18:36:20.097940+0000","last_clean":"2024-09-12T18:36:20.097940+0000","last_became_active":"2024-09-12T17:10:34.361495+0000","last_became_peered":"2024-09-12T17:10:34.361495+0000","last_unstale":"2024-09-12T18:36:20.097940+0000","last_undegraded":"2024-09-12T18:36:20.097940+0000","last_fullsized":"2024-09-12T18:36:20.097940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:20.097716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:20.097716+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.097716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:48.768128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'346","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.002122+0000","last_change":"2024-09-12T18:36:35.002122+0000","last_active":"2024-09-12T18:36:35.002122+0000","last_peered":"2024-09-12T18:36:35.002122+0000","last_clean":"2024-09-12T18:36:35.002122+0000","last_became_active":"2024-09-12T17:10:36.398415+0000","last_became_peered":"2024-09-12T17:10:36.398415+0000","last_unstale":"2024-09-12T18:36:35.002122+0000","last_undegraded":"2024-09-12T18:36:35.002122+0000","last_fullsized":"2024-09-12T18:36:35.002122+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T18:36:35.001911+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T18:36:35.001911+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.001911+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:12.324376+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45877,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":580,"num_read_kb":1203,"num_write":474,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.826608+0000","last_change":"2024-09-12T18:36:31.826608+0000","last_active":"2024-09-12T18:36:31.826608+0000","last_peered":"2024-09-12T18:36:31.826608+0000","last_clean":"2024-09-12T18:36:31.826608+0000","last_became_active":"2024-09-12T17:10:38.401047+0000","last_became_peered":"2024-09-12T17:10:38.401047+0000","last_unstale":"2024-09-12T18:36:31.826608+0000","last_undegraded":"2024-09-12T18:36:31.826608+0000","last_fullsized":"2024-09-12T18:36:31.826608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:31.826409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:31.826409+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.826409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:36.329076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'203","reported_seq":760,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.166184+0000","last_change":"2024-09-12T18:36:30.166049+0000","last_active":"2024-09-12T18:36:30.166184+0000","last_peered":"2024-09-12T18:36:30.166184+0000","last_clean":"2024-09-12T18:36:30.166184+0000","last_became_active":"2024-09-12T17:10:40.428841+0000","last_became_peered":"2024-09-12T17:10:40.428841+0000","last_unstale":"2024-09-12T18:36:30.166184+0000","last_undegraded":"2024-09-12T18:36:30.166184+0000","last_fullsized":"2024-09-12T18:36:30.166184+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-12T18:36:30.165768+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-12T18:36:30.165768+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.165768+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:12.319509+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1669,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":376,"num_read_kb":345,"num_write":581,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'1128","reported_seq":2882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.773405+0000","last_change":"2024-09-12T18:36:24.773405+0000","last_active":"2024-09-12T18:36:24.773405+0000","last_peered":"2024-09-12T18:36:24.773405+0000","last_clean":"2024-09-12T18:36:24.773405+0000","last_became_active":"2024-09-12T17:10:32.369344+0000","last_became_peered":"2024-09-12T17:10:32.369344+0000","last_unstale":"2024-09-12T18:36:24.773405+0000","last_undegraded":"2024-09-12T18:36:24.773405+0000","last_fullsized":"2024-09-12T18:36:24.773405+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1128","last_scrub_stamp":"2024-09-12T18:36:24.773164+0000","last_deep_scrub":"268'1128","last_deep_scrub_stamp":"2024-09-12T18:36:24.773164+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.773164+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":1100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:21.417963+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5513,"num_read_kb":4854,"num_write":1595,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'341","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.312390+0000","last_change":"2024-09-12T18:36:10.312390+0000","last_active":"2024-09-12T18:36:10.312390+0000","last_peered":"2024-09-12T18:36:10.312390+0000","last_clean":"2024-09-12T18:36:10.312390+0000","last_became_active":"2024-09-12T17:11:05.123283+0000","last_became_peered":"2024-09-12T17:11:05.123283+0000","last_unstale":"2024-09-12T18:36:10.312390+0000","last_undegraded":"2024-09-12T18:36:10.312390+0000","last_fullsized":"2024-09-12T18:36:10.312390+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'341","last_scrub_stamp":"2024-09-12T18:36:10.312023+0000","last_deep_scrub":"268'341","last_deep_scrub_stamp":"2024-09-12T18:36:10.312023+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.312023+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:26:25.953575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048663,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":48133,"num_write":1103,"num_write_kb":35281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"268'6","reported_seq":1011,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.875220+0000","last_change":"2024-09-12T18:36:29.875220+0000","last_active":"2024-09-12T18:36:29.875220+0000","last_peered":"2024-09-12T18:36:29.875220+0000","last_clean":"2024-09-12T18:36:29.875220+0000","last_became_active":"2024-09-12T17:10:34.352213+0000","last_became_peered":"2024-09-12T17:10:34.352213+0000","last_unstale":"2024-09-12T18:36:29.875220+0000","last_undegraded":"2024-09-12T18:36:29.875220+0000","last_fullsized":"2024-09-12T18:36:29.875220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T18:36:29.875035+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T18:36:29.875035+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.875035+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:02.237403+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'303","reported_seq":925,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.967050+0000","last_change":"2024-09-12T18:36:36.967050+0000","last_active":"2024-09-12T18:36:36.967050+0000","last_peered":"2024-09-12T18:36:36.967050+0000","last_clean":"2024-09-12T18:36:36.967050+0000","last_became_active":"2024-09-12T17:10:36.921450+0000","last_became_peered":"2024-09-12T17:10:36.921450+0000","last_unstale":"2024-09-12T18:36:36.967050+0000","last_undegraded":"2024-09-12T18:36:36.967050+0000","last_fullsized":"2024-09-12T18:36:36.967050+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'303","last_scrub_stamp":"2024-09-12T18:36:36.966861+0000","last_deep_scrub":"268'303","last_deep_scrub_stamp":"2024-09-12T18:36:36.966861+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.966861+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:50.821225+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44011,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":1000,"num_write":366,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.824781+0000","last_change":"2024-09-12T18:36:41.824554+0000","last_active":"2024-09-12T18:36:41.824781+0000","last_peered":"2024-09-12T18:36:41.824781+0000","last_clean":"2024-09-12T18:36:41.824781+0000","last_became_active":"2024-09-12T17:10:38.395457+0000","last_became_peered":"2024-09-12T17:10:38.395457+0000","last_unstale":"2024-09-12T18:36:41.824781+0000","last_undegraded":"2024-09-12T18:36:41.824781+0000","last_fullsized":"2024-09-12T18:36:41.824781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:41.824274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:41.824274+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.824274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:29.679358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'134","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.811797+0000","last_change":"2024-09-12T18:36:42.811656+0000","last_active":"2024-09-12T18:36:42.811797+0000","last_peered":"2024-09-12T18:36:42.811797+0000","last_clean":"2024-09-12T18:36:42.811797+0000","last_became_active":"2024-09-12T17:10:40.429303+0000","last_became_peered":"2024-09-12T17:10:40.429303+0000","last_unstale":"2024-09-12T18:36:42.811797+0000","last_undegraded":"2024-09-12T18:36:42.811797+0000","last_fullsized":"2024-09-12T18:36:42.811797+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'134","last_scrub_stamp":"2024-09-12T18:36:42.811437+0000","last_deep_scrub":"268'134","last_deep_scrub_stamp":"2024-09-12T18:36:42.811437+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.811437+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:56.115877+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":233,"num_read_kb":212,"num_write":334,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'905","reported_seq":2428,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.380060+0000","last_change":"2024-09-12T18:36:15.380060+0000","last_active":"2024-09-12T18:36:15.380060+0000","last_peered":"2024-09-12T18:36:15.380060+0000","last_clean":"2024-09-12T18:36:15.380060+0000","last_became_active":"2024-09-12T17:10:32.362957+0000","last_became_peered":"2024-09-12T17:10:32.362957+0000","last_unstale":"2024-09-12T18:36:15.380060+0000","last_undegraded":"2024-09-12T18:36:15.380060+0000","last_fullsized":"2024-09-12T18:36:15.380060+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'905","last_scrub_stamp":"2024-09-12T18:36:15.379868+0000","last_deep_scrub":"268'905","last_deep_scrub_stamp":"2024-09-12T18:36:15.379868+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.379868+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":800,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:49.635855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4274,"num_read_kb":3831,"num_write":1263,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'361","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.565443+0000","last_change":"2024-09-12T18:36:10.565443+0000","last_active":"2024-09-12T18:36:10.565443+0000","last_peered":"2024-09-12T18:36:10.565443+0000","last_clean":"2024-09-12T18:36:10.565443+0000","last_became_active":"2024-09-12T17:10:30.374618+0000","last_became_peered":"2024-09-12T17:10:30.374618+0000","last_unstale":"2024-09-12T18:36:10.565443+0000","last_undegraded":"2024-09-12T18:36:10.565443+0000","last_fullsized":"2024-09-12T18:36:10.565443+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-12T18:36:10.565103+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-12T18:36:10.565103+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.565103+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:57.740717+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048724,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":441,"num_read_kb":21889,"num_write":990,"num_write_kb":37331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.924046+0000","last_change":"2024-09-12T18:36:24.924046+0000","last_active":"2024-09-12T18:36:24.924046+0000","last_peered":"2024-09-12T18:36:24.924046+0000","last_clean":"2024-09-12T18:36:24.924046+0000","last_became_active":"2024-09-12T17:10:34.361536+0000","last_became_peered":"2024-09-12T17:10:34.361536+0000","last_unstale":"2024-09-12T18:36:24.924046+0000","last_undegraded":"2024-09-12T18:36:24.924046+0000","last_fullsized":"2024-09-12T18:36:24.924046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:24.923870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:24.923870+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.923870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:02.233333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'120","reported_seq":694,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.754955+0000","last_change":"2024-09-12T18:36:35.754806+0000","last_active":"2024-09-12T18:36:35.754955+0000","last_peered":"2024-09-12T18:36:35.754955+0000","last_clean":"2024-09-12T18:36:35.754955+0000","last_became_active":"2024-09-12T17:10:36.923087+0000","last_became_peered":"2024-09-12T17:10:36.923087+0000","last_unstale":"2024-09-12T18:36:35.754955+0000","last_undegraded":"2024-09-12T18:36:35.754955+0000","last_fullsized":"2024-09-12T18:36:35.754955+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'120","last_scrub_stamp":"2024-09-12T18:36:35.754611+0000","last_deep_scrub":"268'120","last_deep_scrub_stamp":"2024-09-12T18:36:35.754611+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.754611+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:10.265855+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":134,"num_write":98,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'781","reported_seq":2894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.226235+0000","last_change":"2024-09-12T18:36:28.226235+0000","last_active":"2024-09-12T18:36:28.226235+0000","last_peered":"2024-09-12T18:36:28.226235+0000","last_clean":"2024-09-12T18:36:28.226235+0000","last_became_active":"2024-09-12T17:10:38.407830+0000","last_became_peered":"2024-09-12T17:10:38.407830+0000","last_unstale":"2024-09-12T18:36:28.226235+0000","last_undegraded":"2024-09-12T18:36:28.226235+0000","last_fullsized":"2024-09-12T18:36:28.226235+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'781","last_scrub_stamp":"2024-09-12T18:36:28.226043+0000","last_deep_scrub":"268'781","last_deep_scrub_stamp":"2024-09-12T18:36:28.226043+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.226043+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:01.367734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'147","reported_seq":683,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.979348+0000","last_change":"2024-09-12T18:36:38.979196+0000","last_active":"2024-09-12T18:36:38.979348+0000","last_peered":"2024-09-12T18:36:38.979348+0000","last_clean":"2024-09-12T18:36:38.979348+0000","last_became_active":"2024-09-12T17:10:40.431693+0000","last_became_peered":"2024-09-12T17:10:40.431693+0000","last_unstale":"2024-09-12T18:36:38.979348+0000","last_undegraded":"2024-09-12T18:36:38.979348+0000","last_fullsized":"2024-09-12T18:36:38.979348+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'147","last_scrub_stamp":"2024-09-12T18:36:38.979004+0000","last_deep_scrub":"268'147","last_deep_scrub_stamp":"2024-09-12T18:36:38.979004+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.979004+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:30.012772+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":232,"num_write":366,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'809","reported_seq":2336,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.062762+0000","last_change":"2024-09-12T18:36:18.062762+0000","last_active":"2024-09-12T18:36:18.062762+0000","last_peered":"2024-09-12T18:36:18.062762+0000","last_clean":"2024-09-12T18:36:18.062762+0000","last_became_active":"2024-09-12T17:10:32.369824+0000","last_became_peered":"2024-09-12T17:10:32.369824+0000","last_unstale":"2024-09-12T18:36:18.062762+0000","last_undegraded":"2024-09-12T18:36:18.062762+0000","last_fullsized":"2024-09-12T18:36:18.062762+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'809","last_scrub_stamp":"2024-09-12T18:36:18.062570+0000","last_deep_scrub":"268'809","last_deep_scrub_stamp":"2024-09-12T18:36:18.062570+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.062570+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:06.008030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3803,"num_read_kb":3411,"num_write":1089,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'371","reported_seq":1184,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.929229+0000","last_change":"2024-09-12T18:36:12.929229+0000","last_active":"2024-09-12T18:36:12.929229+0000","last_peered":"2024-09-12T18:36:12.929229+0000","last_clean":"2024-09-12T18:36:12.929229+0000","last_became_active":"2024-09-12T17:10:30.357942+0000","last_became_peered":"2024-09-12T17:10:30.357942+0000","last_unstale":"2024-09-12T18:36:12.929229+0000","last_undegraded":"2024-09-12T18:36:12.929229+0000","last_fullsized":"2024-09-12T18:36:12.929229+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'371","last_scrub_stamp":"2024-09-12T18:36:12.928977+0000","last_deep_scrub":"268'371","last_deep_scrub_stamp":"2024-09-12T18:36:12.928977+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.928977+0000","objects_scrubbed":8,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:50.171794+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310810,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":949,"num_read_kb":26001,"num_write":1281,"num_write_kb":43743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.001612+0000","last_change":"2024-09-12T18:36:29.001612+0000","last_active":"2024-09-12T18:36:29.001612+0000","last_peered":"2024-09-12T18:36:29.001612+0000","last_clean":"2024-09-12T18:36:29.001612+0000","last_became_active":"2024-09-12T17:10:34.361686+0000","last_became_peered":"2024-09-12T17:10:34.361686+0000","last_unstale":"2024-09-12T18:36:29.001612+0000","last_undegraded":"2024-09-12T18:36:29.001612+0000","last_fullsized":"2024-09-12T18:36:29.001612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:29.001403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:29.001403+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.001403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:52.326890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'376","reported_seq":1006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.905863+0000","last_change":"2024-09-12T18:36:37.905863+0000","last_active":"2024-09-12T18:36:37.905863+0000","last_peered":"2024-09-12T18:36:37.905863+0000","last_clean":"2024-09-12T18:36:37.905863+0000","last_became_active":"2024-09-12T17:10:36.392089+0000","last_became_peered":"2024-09-12T17:10:36.392089+0000","last_unstale":"2024-09-12T18:36:37.905863+0000","last_undegraded":"2024-09-12T18:36:37.905863+0000","last_fullsized":"2024-09-12T18:36:37.905863+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-12T18:36:37.905604+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-12T18:36:37.905604+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.905604+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:26.212396+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47317,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":601,"num_read_kb":1312,"num_write":482,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.790130+0000","last_change":"2024-09-12T18:36:37.790130+0000","last_active":"2024-09-12T18:36:37.790130+0000","last_peered":"2024-09-12T18:36:37.790130+0000","last_clean":"2024-09-12T18:36:37.790130+0000","last_became_active":"2024-09-12T17:10:38.411191+0000","last_became_peered":"2024-09-12T17:10:38.411191+0000","last_unstale":"2024-09-12T18:36:37.790130+0000","last_undegraded":"2024-09-12T18:36:37.790130+0000","last_fullsized":"2024-09-12T18:36:37.790130+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:37.789950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:37.789950+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.789950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:40.481018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'103","reported_seq":623,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.010315+0000","last_change":"2024-09-12T18:36:43.010315+0000","last_active":"2024-09-12T18:36:43.010315+0000","last_peered":"2024-09-12T18:36:43.010315+0000","last_clean":"2024-09-12T18:36:43.010315+0000","last_became_active":"2024-09-12T17:10:40.436748+0000","last_became_peered":"2024-09-12T17:10:40.436748+0000","last_unstale":"2024-09-12T18:36:43.010315+0000","last_undegraded":"2024-09-12T18:36:43.010315+0000","last_fullsized":"2024-09-12T18:36:43.010315+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'103","last_scrub_stamp":"2024-09-12T18:36:43.010111+0000","last_deep_scrub":"268'103","last_deep_scrub_stamp":"2024-09-12T18:36:43.010111+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.010111+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:09.227136+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":136,"num_write":243,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'580","reported_seq":2238,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.023785+0000","last_change":"2024-09-12T18:36:19.023785+0000","last_active":"2024-09-12T18:36:19.023785+0000","last_peered":"2024-09-12T18:36:19.023785+0000","last_clean":"2024-09-12T18:36:19.023785+0000","last_became_active":"2024-09-12T17:10:32.370173+0000","last_became_peered":"2024-09-12T17:10:32.370173+0000","last_unstale":"2024-09-12T18:36:19.023785+0000","last_undegraded":"2024-09-12T18:36:19.023785+0000","last_fullsized":"2024-09-12T18:36:19.023785+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'580","last_scrub_stamp":"2024-09-12T18:36:19.023540+0000","last_deep_scrub":"268'580","last_deep_scrub_stamp":"2024-09-12T18:36:19.023540+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.023540+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:18.181483+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2773,"num_read_kb":2563,"num_write":696,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'364","reported_seq":1006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.882426+0000","last_change":"2024-09-12T18:36:13.882426+0000","last_active":"2024-09-12T18:36:13.882426+0000","last_peered":"2024-09-12T18:36:13.882426+0000","last_clean":"2024-09-12T18:36:13.882426+0000","last_became_active":"2024-09-12T17:10:30.355723+0000","last_became_peered":"2024-09-12T17:10:30.355723+0000","last_unstale":"2024-09-12T18:36:13.882426+0000","last_undegraded":"2024-09-12T18:36:13.882426+0000","last_fullsized":"2024-09-12T18:36:13.882426+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T18:36:13.882169+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T18:36:13.882169+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.882169+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:47.864528+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":22337,"num_write":1141,"num_write_kb":39083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.870528+0000","last_change":"2024-09-12T18:36:32.870528+0000","last_active":"2024-09-12T18:36:32.870528+0000","last_peered":"2024-09-12T18:36:32.870528+0000","last_clean":"2024-09-12T18:36:32.870528+0000","last_became_active":"2024-09-12T17:10:34.363439+0000","last_became_peered":"2024-09-12T17:10:34.363439+0000","last_unstale":"2024-09-12T18:36:32.870528+0000","last_undegraded":"2024-09-12T18:36:32.870528+0000","last_fullsized":"2024-09-12T18:36:32.870528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:32.870356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:32.870356+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.870356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:28.941269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'294","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.730732+0000","last_change":"2024-09-12T18:36:33.730732+0000","last_active":"2024-09-12T18:36:33.730732+0000","last_peered":"2024-09-12T18:36:33.730732+0000","last_clean":"2024-09-12T18:36:33.730732+0000","last_became_active":"2024-09-12T17:10:36.397148+0000","last_became_peered":"2024-09-12T17:10:36.397148+0000","last_unstale":"2024-09-12T18:36:33.730732+0000","last_undegraded":"2024-09-12T18:36:33.730732+0000","last_fullsized":"2024-09-12T18:36:33.730732+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'294","last_scrub_stamp":"2024-09-12T18:36:33.730540+0000","last_deep_scrub":"268'294","last_deep_scrub_stamp":"2024-09-12T18:36:33.730540+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.730540+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:53.128733+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":1130,"num_write":384,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.173962+0000","last_change":"2024-09-12T18:36:26.173962+0000","last_active":"2024-09-12T18:36:26.173962+0000","last_peered":"2024-09-12T18:36:26.173962+0000","last_clean":"2024-09-12T18:36:26.173962+0000","last_became_active":"2024-09-12T17:10:38.406892+0000","last_became_peered":"2024-09-12T17:10:38.406892+0000","last_unstale":"2024-09-12T18:36:26.173962+0000","last_undegraded":"2024-09-12T18:36:26.173962+0000","last_fullsized":"2024-09-12T18:36:26.173962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.173758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.173758+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.173758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:04.936184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'159","reported_seq":702,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:45.912168+0000","last_change":"2024-09-12T18:36:45.912168+0000","last_active":"2024-09-12T18:36:45.912168+0000","last_peered":"2024-09-12T18:36:45.912168+0000","last_clean":"2024-09-12T18:36:45.912168+0000","last_became_active":"2024-09-12T17:10:40.770159+0000","last_became_peered":"2024-09-12T17:10:40.770159+0000","last_unstale":"2024-09-12T18:36:45.912168+0000","last_undegraded":"2024-09-12T18:36:45.912168+0000","last_fullsized":"2024-09-12T18:36:45.912168+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'159","last_scrub_stamp":"2024-09-12T18:36:45.911969+0000","last_deep_scrub":"268'159","last_deep_scrub_stamp":"2024-09-12T18:36:45.911969+0000","last_clean_scrub_stamp":"2024-09-12T18:36:45.911969+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:56.729248+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":169,"num_write":336,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'1196","reported_seq":2731,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.766995+0000","last_change":"2024-09-12T18:36:21.766995+0000","last_active":"2024-09-12T18:36:21.766995+0000","last_peered":"2024-09-12T18:36:21.766995+0000","last_clean":"2024-09-12T18:36:21.766995+0000","last_became_active":"2024-09-12T17:10:32.357738+0000","last_became_peered":"2024-09-12T17:10:32.357738+0000","last_unstale":"2024-09-12T18:36:21.766995+0000","last_undegraded":"2024-09-12T18:36:21.766995+0000","last_fullsized":"2024-09-12T18:36:21.766995+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1196","last_scrub_stamp":"2024-09-12T18:36:21.766764+0000","last_deep_scrub":"268'1196","last_deep_scrub_stamp":"2024-09-12T18:36:21.766764+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.766764+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":1100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:30.939395+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5279,"num_read_kb":4649,"num_write":1626,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'344","reported_seq":1007,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.923859+0000","last_change":"2024-09-12T18:36:11.923708+0000","last_active":"2024-09-12T18:36:11.923859+0000","last_peered":"2024-09-12T18:36:11.923859+0000","last_clean":"2024-09-12T18:36:11.923859+0000","last_became_active":"2024-09-12T17:10:30.401941+0000","last_became_peered":"2024-09-12T17:10:30.401941+0000","last_unstale":"2024-09-12T18:36:11.923859+0000","last_undegraded":"2024-09-12T18:36:11.923859+0000","last_fullsized":"2024-09-12T18:36:11.923859+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-12T18:36:11.923480+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-12T18:36:11.923480+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.923480+0000","objects_scrubbed":9,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:14.387628+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310809,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":28042,"num_write":994,"num_write_kb":46600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.859023+0000","last_change":"2024-09-12T18:36:27.859023+0000","last_active":"2024-09-12T18:36:27.859023+0000","last_peered":"2024-09-12T18:36:27.859023+0000","last_clean":"2024-09-12T18:36:27.859023+0000","last_became_active":"2024-09-12T17:10:34.357688+0000","last_became_peered":"2024-09-12T17:10:34.357688+0000","last_unstale":"2024-09-12T18:36:27.859023+0000","last_undegraded":"2024-09-12T18:36:27.859023+0000","last_fullsized":"2024-09-12T18:36:27.859023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:27.858842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:27.858842+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.858842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:58.748918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'251","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.952302+0000","last_change":"2024-09-12T18:36:35.952302+0000","last_active":"2024-09-12T18:36:35.952302+0000","last_peered":"2024-09-12T18:36:35.952302+0000","last_clean":"2024-09-12T18:36:35.952302+0000","last_became_active":"2024-09-12T17:10:36.398639+0000","last_became_peered":"2024-09-12T17:10:36.398639+0000","last_unstale":"2024-09-12T18:36:35.952302+0000","last_undegraded":"2024-09-12T18:36:35.952302+0000","last_fullsized":"2024-09-12T18:36:35.952302+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'251","last_scrub_stamp":"2024-09-12T18:36:35.952117+0000","last_deep_scrub":"268'251","last_deep_scrub_stamp":"2024-09-12T18:36:35.952117+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.952117+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:16.335588+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52346,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":1002,"num_write":330,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.782135+0000","last_change":"2024-09-12T18:36:36.782135+0000","last_active":"2024-09-12T18:36:36.782135+0000","last_peered":"2024-09-12T18:36:36.782135+0000","last_clean":"2024-09-12T18:36:36.782135+0000","last_became_active":"2024-09-12T17:10:38.400703+0000","last_became_peered":"2024-09-12T17:10:38.400703+0000","last_unstale":"2024-09-12T18:36:36.782135+0000","last_undegraded":"2024-09-12T18:36:36.782135+0000","last_fullsized":"2024-09-12T18:36:36.782135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:36.781956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:36.781956+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.781956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:52.593251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'177","reported_seq":1668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.056285+0000","last_change":"2024-09-12T18:36:41.056285+0000","last_active":"2024-09-12T18:36:41.056285+0000","last_peered":"2024-09-12T18:36:41.056285+0000","last_clean":"2024-09-12T18:36:41.056285+0000","last_became_active":"2024-09-12T17:10:40.434195+0000","last_became_peered":"2024-09-12T17:10:40.434195+0000","last_unstale":"2024-09-12T18:36:41.056285+0000","last_undegraded":"2024-09-12T18:36:41.056285+0000","last_fullsized":"2024-09-12T18:36:41.056285+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'177","last_scrub_stamp":"2024-09-12T18:36:41.056096+0000","last_deep_scrub":"268'177","last_deep_scrub_stamp":"2024-09-12T18:36:41.056096+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.056096+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:28.684929+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1233,"num_read_kb":1222,"num_write":385,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'396","reported_seq":1921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.020701+0000","last_change":"2024-09-12T18:36:17.020701+0000","last_active":"2024-09-12T18:36:17.020701+0000","last_peered":"2024-09-12T18:36:17.020701+0000","last_clean":"2024-09-12T18:36:17.020701+0000","last_became_active":"2024-09-12T17:10:32.361716+0000","last_became_peered":"2024-09-12T17:10:32.361716+0000","last_unstale":"2024-09-12T18:36:17.020701+0000","last_undegraded":"2024-09-12T18:36:17.020701+0000","last_fullsized":"2024-09-12T18:36:17.020701+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'396","last_scrub_stamp":"2024-09-12T18:36:17.020480+0000","last_deep_scrub":"268'396","last_deep_scrub_stamp":"2024-09-12T18:36:17.020480+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.020480+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:51.155889+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2161,"num_read_kb":2069,"num_write":462,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'306","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.614975+0000","last_change":"2024-09-12T18:36:09.614975+0000","last_active":"2024-09-12T18:36:09.614975+0000","last_peered":"2024-09-12T18:36:09.614975+0000","last_clean":"2024-09-12T18:36:09.614975+0000","last_became_active":"2024-09-12T17:10:30.387788+0000","last_became_peered":"2024-09-12T17:10:30.387788+0000","last_unstale":"2024-09-12T18:36:09.614975+0000","last_undegraded":"2024-09-12T18:36:09.614975+0000","last_fullsized":"2024-09-12T18:36:09.614975+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'306","last_scrub_stamp":"2024-09-12T18:36:09.614762+0000","last_deep_scrub":"268'306","last_deep_scrub_stamp":"2024-09-12T18:36:09.614762+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.614762+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:45.452561+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1332788,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":40433,"num_write":1021,"num_write_kb":46438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.968939+0000","last_change":"2024-09-12T18:36:20.968939+0000","last_active":"2024-09-12T18:36:20.968939+0000","last_peered":"2024-09-12T18:36:20.968939+0000","last_clean":"2024-09-12T18:36:20.968939+0000","last_became_active":"2024-09-12T17:10:34.356290+0000","last_became_peered":"2024-09-12T17:10:34.356290+0000","last_unstale":"2024-09-12T18:36:20.968939+0000","last_undegraded":"2024-09-12T18:36:20.968939+0000","last_fullsized":"2024-09-12T18:36:20.968939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:20.968760+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:20.968760+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.968760+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:48.876143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'313","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.711502+0000","last_change":"2024-09-12T18:36:33.711502+0000","last_active":"2024-09-12T18:36:33.711502+0000","last_peered":"2024-09-12T18:36:33.711502+0000","last_clean":"2024-09-12T18:36:33.711502+0000","last_became_active":"2024-09-12T17:10:36.391455+0000","last_became_peered":"2024-09-12T17:10:36.391455+0000","last_unstale":"2024-09-12T18:36:33.711502+0000","last_undegraded":"2024-09-12T18:36:33.711502+0000","last_fullsized":"2024-09-12T18:36:33.711502+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T18:36:33.711301+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T18:36:33.711301+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.711301+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:17.424966+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44113,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":1099,"num_write":400,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.789767+0000","last_change":"2024-09-12T18:36:38.789767+0000","last_active":"2024-09-12T18:36:38.789767+0000","last_peered":"2024-09-12T18:36:38.789767+0000","last_clean":"2024-09-12T18:36:38.789767+0000","last_became_active":"2024-09-12T17:10:38.413592+0000","last_became_peered":"2024-09-12T17:10:38.413592+0000","last_unstale":"2024-09-12T18:36:38.789767+0000","last_undegraded":"2024-09-12T18:36:38.789767+0000","last_fullsized":"2024-09-12T18:36:38.789767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:38.789532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:38.789532+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.789532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:49.383173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'152","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.777069+0000","last_change":"2024-09-12T18:36:39.777069+0000","last_active":"2024-09-12T18:36:39.777069+0000","last_peered":"2024-09-12T18:36:39.777069+0000","last_clean":"2024-09-12T18:36:39.777069+0000","last_became_active":"2024-09-12T17:10:40.425063+0000","last_became_peered":"2024-09-12T17:10:40.425063+0000","last_unstale":"2024-09-12T18:36:39.777069+0000","last_undegraded":"2024-09-12T18:36:39.777069+0000","last_fullsized":"2024-09-12T18:36:39.777069+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'152","last_scrub_stamp":"2024-09-12T18:36:39.776872+0000","last_deep_scrub":"268'152","last_deep_scrub_stamp":"2024-09-12T18:36:39.776872+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.776872+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:55.611705+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":181,"num_read_kb":173,"num_write":358,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'373","reported_seq":1801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.871094+0000","last_change":"2024-09-12T18:36:27.871094+0000","last_active":"2024-09-12T18:36:27.871094+0000","last_peered":"2024-09-12T18:36:27.871094+0000","last_clean":"2024-09-12T18:36:27.871094+0000","last_became_active":"2024-09-12T17:10:32.361445+0000","last_became_peered":"2024-09-12T17:10:32.361445+0000","last_unstale":"2024-09-12T18:36:27.871094+0000","last_undegraded":"2024-09-12T18:36:27.871094+0000","last_fullsized":"2024-09-12T18:36:27.871094+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'373","last_scrub_stamp":"2024-09-12T18:36:27.870922+0000","last_deep_scrub":"268'373","last_deep_scrub_stamp":"2024-09-12T18:36:27.870922+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.870922+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.512963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1921,"num_read_kb":1829,"num_write":410,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'364","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.393893+0000","last_change":"2024-09-12T18:36:06.393839+0000","last_active":"2024-09-12T18:36:06.393893+0000","last_peered":"2024-09-12T18:36:06.393893+0000","last_clean":"2024-09-12T18:36:06.393893+0000","last_became_active":"2024-09-12T17:11:04.372622+0000","last_became_peered":"2024-09-12T17:11:04.372622+0000","last_unstale":"2024-09-12T18:36:06.393893+0000","last_undegraded":"2024-09-12T18:36:06.393893+0000","last_fullsized":"2024-09-12T18:36:06.393893+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T18:36:06.393728+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T18:36:06.393728+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.393728+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:56.730903+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456544,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":530,"num_read_kb":34257,"num_write":1086,"num_write_kb":35279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'383","reported_seq":1908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.927405+0000","last_change":"2024-09-12T18:36:19.927405+0000","last_active":"2024-09-12T18:36:19.927405+0000","last_peered":"2024-09-12T18:36:19.927405+0000","last_clean":"2024-09-12T18:36:19.927405+0000","last_became_active":"2024-09-12T17:10:32.364080+0000","last_became_peered":"2024-09-12T17:10:32.364080+0000","last_unstale":"2024-09-12T18:36:19.927405+0000","last_undegraded":"2024-09-12T18:36:19.927405+0000","last_fullsized":"2024-09-12T18:36:19.927405+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-12T18:36:19.927195+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-12T18:36:19.927195+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.927195+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:05.629401+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2111,"num_read_kb":2018,"num_write":410,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'353","reported_seq":1136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.389225+0000","last_change":"2024-09-12T18:36:13.389225+0000","last_active":"2024-09-12T18:36:13.389225+0000","last_peered":"2024-09-12T18:36:13.389225+0000","last_clean":"2024-09-12T18:36:13.389225+0000","last_became_active":"2024-09-12T17:10:30.393924+0000","last_became_peered":"2024-09-12T17:10:30.393924+0000","last_unstale":"2024-09-12T18:36:13.389225+0000","last_undegraded":"2024-09-12T18:36:13.389225+0000","last_fullsized":"2024-09-12T18:36:13.389225+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'353","last_scrub_stamp":"2024-09-12T18:36:13.388912+0000","last_deep_scrub":"268'353","last_deep_scrub_stamp":"2024-09-12T18:36:13.388912+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.388912+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:11.683116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550017,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":731,"num_read_kb":31225,"num_write":1143,"num_write_kb":33307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'814","reported_seq":2210,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.957323+0000","last_change":"2024-09-12T18:36:26.957323+0000","last_active":"2024-09-12T18:36:26.957323+0000","last_peered":"2024-09-12T18:36:26.957323+0000","last_clean":"2024-09-12T18:36:26.957323+0000","last_became_active":"2024-09-12T17:10:32.382110+0000","last_became_peered":"2024-09-12T17:10:32.382110+0000","last_unstale":"2024-09-12T18:36:26.957323+0000","last_undegraded":"2024-09-12T18:36:26.957323+0000","last_fullsized":"2024-09-12T18:36:26.957323+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'814","last_scrub_stamp":"2024-09-12T18:36:26.957133+0000","last_deep_scrub":"268'814","last_deep_scrub_stamp":"2024-09-12T18:36:26.957133+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.957133+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:11.699858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3583,"num_read_kb":3191,"num_write":1046,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'356","reported_seq":1040,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.868686+0000","last_change":"2024-09-12T18:36:14.868686+0000","last_active":"2024-09-12T18:36:14.868686+0000","last_peered":"2024-09-12T18:36:14.868686+0000","last_clean":"2024-09-12T18:36:14.868686+0000","last_became_active":"2024-09-12T17:10:30.352353+0000","last_became_peered":"2024-09-12T17:10:30.352353+0000","last_unstale":"2024-09-12T18:36:14.868686+0000","last_undegraded":"2024-09-12T18:36:14.868686+0000","last_fullsized":"2024-09-12T18:36:14.868686+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'356","last_scrub_stamp":"2024-09-12T18:36:14.868477+0000","last_deep_scrub":"268'356","last_deep_scrub_stamp":"2024-09-12T18:36:14.868477+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.868477+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:59.665480+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267294,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":541,"num_read_kb":44546,"num_write":1186,"num_write_kb":40457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'444","reported_seq":1997,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.878506+0000","last_change":"2024-09-12T18:36:16.878506+0000","last_active":"2024-09-12T18:36:16.878506+0000","last_peered":"2024-09-12T18:36:16.878506+0000","last_clean":"2024-09-12T18:36:16.878506+0000","last_became_active":"2024-09-12T17:10:32.378659+0000","last_became_peered":"2024-09-12T17:10:32.378659+0000","last_unstale":"2024-09-12T18:36:16.878506+0000","last_undegraded":"2024-09-12T18:36:16.878506+0000","last_fullsized":"2024-09-12T18:36:16.878506+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'444","last_scrub_stamp":"2024-09-12T18:36:16.878330+0000","last_deep_scrub":"268'444","last_deep_scrub_stamp":"2024-09-12T18:36:16.878330+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.878330+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:57.042518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2290,"num_read_kb":2161,"num_write":510,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1009,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'375","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.615620+0000","last_change":"2024-09-12T18:36:11.615620+0000","last_active":"2024-09-12T18:36:11.615620+0000","last_peered":"2024-09-12T18:36:11.615620+0000","last_clean":"2024-09-12T18:36:11.615620+0000","last_became_active":"2024-09-12T17:11:04.868302+0000","last_became_peered":"2024-09-12T17:11:04.868302+0000","last_unstale":"2024-09-12T18:36:11.615620+0000","last_undegraded":"2024-09-12T18:36:11.615620+0000","last_fullsized":"2024-09-12T18:36:11.615620+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'375","last_scrub_stamp":"2024-09-12T18:36:11.615367+0000","last_deep_scrub":"268'375","last_deep_scrub_stamp":"2024-09-12T18:36:11.615367+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.615367+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:50.353013+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194362,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":35312,"num_write":1211,"num_write_kb":68294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'522","reported_seq":2253,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.780273+0000","last_change":"2024-09-12T18:36:23.780273+0000","last_active":"2024-09-12T18:36:23.780273+0000","last_peered":"2024-09-12T18:36:23.780273+0000","last_clean":"2024-09-12T18:36:23.780273+0000","last_became_active":"2024-09-12T17:10:32.382841+0000","last_became_peered":"2024-09-12T17:10:32.382841+0000","last_unstale":"2024-09-12T18:36:23.780273+0000","last_undegraded":"2024-09-12T18:36:23.780273+0000","last_fullsized":"2024-09-12T18:36:23.780273+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'522","last_scrub_stamp":"2024-09-12T18:36:23.780095+0000","last_deep_scrub":"268'522","last_deep_scrub_stamp":"2024-09-12T18:36:23.780095+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.780095+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:34.659271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2888,"num_read_kb":2690,"num_write":642,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'320","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.931640+0000","last_change":"2024-09-12T18:36:09.931640+0000","last_active":"2024-09-12T18:36:09.931640+0000","last_peered":"2024-09-12T18:36:09.931640+0000","last_clean":"2024-09-12T18:36:09.931640+0000","last_became_active":"2024-09-12T17:11:04.373103+0000","last_became_peered":"2024-09-12T17:11:04.373103+0000","last_unstale":"2024-09-12T18:36:09.931640+0000","last_undegraded":"2024-09-12T18:36:09.931640+0000","last_fullsized":"2024-09-12T18:36:09.931640+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-09-12T18:36:09.931398+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-09-12T18:36:09.931398+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.931398+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:02.232474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":30230,"num_write":1056,"num_write_kb":31529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'447","reported_seq":2081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.977845+0000","last_change":"2024-09-12T18:36:23.977845+0000","last_active":"2024-09-12T18:36:23.977845+0000","last_peered":"2024-09-12T18:36:23.977845+0000","last_clean":"2024-09-12T18:36:23.977845+0000","last_became_active":"2024-09-12T17:10:32.370112+0000","last_became_peered":"2024-09-12T17:10:32.370112+0000","last_unstale":"2024-09-12T18:36:23.977845+0000","last_undegraded":"2024-09-12T18:36:23.977845+0000","last_fullsized":"2024-09-12T18:36:23.977845+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'447","last_scrub_stamp":"2024-09-12T18:36:23.977770+0000","last_deep_scrub":"268'447","last_deep_scrub_stamp":"2024-09-12T18:36:23.977770+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.977770+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:57.025220+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2345,"num_read_kb":2230,"num_write":501,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'371","reported_seq":1070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.914493+0000","last_change":"2024-09-12T18:36:10.914493+0000","last_active":"2024-09-12T18:36:10.914493+0000","last_peered":"2024-09-12T18:36:10.914493+0000","last_clean":"2024-09-12T18:36:10.914493+0000","last_became_active":"2024-09-12T17:10:30.348702+0000","last_became_peered":"2024-09-12T17:10:30.348702+0000","last_unstale":"2024-09-12T18:36:10.914493+0000","last_undegraded":"2024-09-12T18:36:10.914493+0000","last_fullsized":"2024-09-12T18:36:10.914493+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'371","last_scrub_stamp":"2024-09-12T18:36:10.914266+0000","last_deep_scrub":"268'371","last_deep_scrub_stamp":"2024-09-12T18:36:10.914266+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.914266+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:47.453636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310621,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":552,"num_read_kb":10243,"num_write":1254,"num_write_kb":63527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'740","reported_seq":2634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.739616+0000","last_change":"2024-09-12T18:36:22.739616+0000","last_active":"2024-09-12T18:36:22.739616+0000","last_peered":"2024-09-12T18:36:22.739616+0000","last_clean":"2024-09-12T18:36:22.739616+0000","last_became_active":"2024-09-12T17:10:32.371017+0000","last_became_peered":"2024-09-12T17:10:32.371017+0000","last_unstale":"2024-09-12T18:36:22.739616+0000","last_undegraded":"2024-09-12T18:36:22.739616+0000","last_fullsized":"2024-09-12T18:36:22.739616+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'740","last_scrub_stamp":"2024-09-12T18:36:22.739504+0000","last_deep_scrub":"268'740","last_deep_scrub_stamp":"2024-09-12T18:36:22.739504+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.739504+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:07.137813+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4018,"num_read_kb":3683,"num_write":976,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'331","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.196685+0000","last_change":"2024-09-12T18:36:10.196685+0000","last_active":"2024-09-12T18:36:10.196685+0000","last_peered":"2024-09-12T18:36:10.196685+0000","last_clean":"2024-09-12T18:36:10.196685+0000","last_became_active":"2024-09-12T17:10:30.396958+0000","last_became_peered":"2024-09-12T17:10:30.396958+0000","last_unstale":"2024-09-12T18:36:10.196685+0000","last_undegraded":"2024-09-12T18:36:10.196685+0000","last_fullsized":"2024-09-12T18:36:10.196685+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'331","last_scrub_stamp":"2024-09-12T18:36:10.196408+0000","last_deep_scrub":"268'331","last_deep_scrub_stamp":"2024-09-12T18:36:10.196408+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.196408+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:20.172679+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9953582,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":23680,"num_write":1025,"num_write_kb":41122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'721","reported_seq":2427,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.096925+0000","last_change":"2024-09-12T18:36:15.096925+0000","last_active":"2024-09-12T18:36:15.096925+0000","last_peered":"2024-09-12T18:36:15.096925+0000","last_clean":"2024-09-12T18:36:15.096925+0000","last_became_active":"2024-09-12T17:10:32.348200+0000","last_became_peered":"2024-09-12T17:10:32.348200+0000","last_unstale":"2024-09-12T18:36:15.096925+0000","last_undegraded":"2024-09-12T18:36:15.096925+0000","last_fullsized":"2024-09-12T18:36:15.096925+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'721","last_scrub_stamp":"2024-09-12T18:36:15.096745+0000","last_deep_scrub":"268'721","last_deep_scrub_stamp":"2024-09-12T18:36:15.096745+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.096745+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:45.902234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3587,"num_read_kb":3235,"num_write":983,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'407","reported_seq":1111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.863524+0000","last_change":"2024-09-12T18:36:13.863524+0000","last_active":"2024-09-12T18:36:13.863524+0000","last_peered":"2024-09-12T18:36:13.863524+0000","last_clean":"2024-09-12T18:36:13.863524+0000","last_became_active":"2024-09-12T17:10:30.370015+0000","last_became_peered":"2024-09-12T17:10:30.370015+0000","last_unstale":"2024-09-12T18:36:13.863524+0000","last_undegraded":"2024-09-12T18:36:13.863524+0000","last_fullsized":"2024-09-12T18:36:13.863524+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'407","last_scrub_stamp":"2024-09-12T18:36:13.863264+0000","last_deep_scrub":"268'407","last_deep_scrub_stamp":"2024-09-12T18:36:13.863264+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.863264+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:26.107432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399128,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":575,"num_read_kb":40389,"num_write":1181,"num_write_kb":51606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'836","reported_seq":2479,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.547284+0000","last_change":"2024-09-12T18:36:19.547033+0000","last_active":"2024-09-12T18:36:19.547284+0000","last_peered":"2024-09-12T18:36:19.547284+0000","last_clean":"2024-09-12T18:36:19.547284+0000","last_became_active":"2024-09-12T17:10:32.348842+0000","last_became_peered":"2024-09-12T17:10:32.348842+0000","last_unstale":"2024-09-12T18:36:19.547284+0000","last_undegraded":"2024-09-12T18:36:19.547284+0000","last_fullsized":"2024-09-12T18:36:19.547284+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'836","last_scrub_stamp":"2024-09-12T18:36:19.546818+0000","last_deep_scrub":"268'836","last_deep_scrub_stamp":"2024-09-12T18:36:19.546818+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.546818+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:47.788325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4030,"num_read_kb":3642,"num_write":1104,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'317","reported_seq":977,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.921361+0000","last_change":"2024-09-12T18:36:15.921361+0000","last_active":"2024-09-12T18:36:15.921361+0000","last_peered":"2024-09-12T18:36:15.921361+0000","last_clean":"2024-09-12T18:36:15.921361+0000","last_became_active":"2024-09-12T17:10:30.349523+0000","last_became_peered":"2024-09-12T17:10:30.349523+0000","last_unstale":"2024-09-12T18:36:15.921361+0000","last_undegraded":"2024-09-12T18:36:15.921361+0000","last_fullsized":"2024-09-12T18:36:15.921361+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'317","last_scrub_stamp":"2024-09-12T18:36:15.921079+0000","last_deep_scrub":"268'317","last_deep_scrub_stamp":"2024-09-12T18:36:15.921079+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.921079+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:36.009620+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456505,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":103976,"num_write":995,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'522","reported_seq":2362,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.977037+0000","last_change":"2024-09-12T18:36:19.976891+0000","last_active":"2024-09-12T18:36:19.977037+0000","last_peered":"2024-09-12T18:36:19.977037+0000","last_clean":"2024-09-12T18:36:19.977037+0000","last_became_active":"2024-09-12T17:10:32.362881+0000","last_became_peered":"2024-09-12T17:10:32.362881+0000","last_unstale":"2024-09-12T18:36:19.977037+0000","last_undegraded":"2024-09-12T18:36:19.977037+0000","last_fullsized":"2024-09-12T18:36:19.977037+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'522","last_scrub_stamp":"2024-09-12T18:36:19.976700+0000","last_deep_scrub":"268'522","last_deep_scrub_stamp":"2024-09-12T18:36:19.976700+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.976700+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:14.830945+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2930,"num_read_kb":2778,"num_write":610,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'363","reported_seq":1059,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.900511+0000","last_change":"2024-09-12T18:36:12.900511+0000","last_active":"2024-09-12T18:36:12.900511+0000","last_peered":"2024-09-12T18:36:12.900511+0000","last_clean":"2024-09-12T18:36:12.900511+0000","last_became_active":"2024-09-12T17:10:30.378766+0000","last_became_peered":"2024-09-12T17:10:30.378766+0000","last_unstale":"2024-09-12T18:36:12.900511+0000","last_undegraded":"2024-09-12T18:36:12.900511+0000","last_fullsized":"2024-09-12T18:36:12.900511+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-12T18:36:12.900085+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-12T18:36:12.900085+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.900085+0000","objects_scrubbed":6,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:24.060613+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102155,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":26410,"num_write":1209,"num_write_kb":29487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'526","reported_seq":2184,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.396356+0000","last_change":"2024-09-12T18:36:14.396208+0000","last_active":"2024-09-12T18:36:14.396356+0000","last_peered":"2024-09-12T18:36:14.396356+0000","last_clean":"2024-09-12T18:36:14.396356+0000","last_became_active":"2024-09-12T17:10:32.341480+0000","last_became_peered":"2024-09-12T17:10:32.341480+0000","last_unstale":"2024-09-12T18:36:14.396356+0000","last_undegraded":"2024-09-12T18:36:14.396356+0000","last_fullsized":"2024-09-12T18:36:14.396356+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'526","last_scrub_stamp":"2024-09-12T18:36:14.396018+0000","last_deep_scrub":"268'526","last_deep_scrub_stamp":"2024-09-12T18:36:14.396018+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.396018+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:55.035930+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2856,"num_read_kb":2663,"num_write":671,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'349","reported_seq":1107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.956802+0000","last_change":"2024-09-12T18:36:16.956802+0000","last_active":"2024-09-12T18:36:16.956802+0000","last_peered":"2024-09-12T18:36:16.956802+0000","last_clean":"2024-09-12T18:36:16.956802+0000","last_became_active":"2024-09-12T17:10:30.404567+0000","last_became_peered":"2024-09-12T17:10:30.404567+0000","last_unstale":"2024-09-12T18:36:16.956802+0000","last_undegraded":"2024-09-12T18:36:16.956802+0000","last_fullsized":"2024-09-12T18:36:16.956802+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-12T18:36:16.956584+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-12T18:36:16.956584+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.956584+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:29.404555+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":789,"num_read_kb":46887,"num_write":1083,"num_write_kb":42596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'381","reported_seq":1788,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.997849+0000","last_change":"2024-09-12T18:36:20.997849+0000","last_active":"2024-09-12T18:36:20.997849+0000","last_peered":"2024-09-12T18:36:20.997849+0000","last_clean":"2024-09-12T18:36:20.997849+0000","last_became_active":"2024-09-12T17:10:32.370799+0000","last_became_peered":"2024-09-12T17:10:32.370799+0000","last_unstale":"2024-09-12T18:36:20.997849+0000","last_undegraded":"2024-09-12T18:36:20.997849+0000","last_fullsized":"2024-09-12T18:36:20.997849+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'381","last_scrub_stamp":"2024-09-12T18:36:20.997632+0000","last_deep_scrub":"268'381","last_deep_scrub_stamp":"2024-09-12T18:36:20.997632+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.997632+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:50.639762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2049,"num_read_kb":1938,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'327","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.593784+0000","last_change":"2024-09-12T18:36:14.593784+0000","last_active":"2024-09-12T18:36:14.593784+0000","last_peered":"2024-09-12T18:36:14.593784+0000","last_clean":"2024-09-12T18:36:14.593784+0000","last_became_active":"2024-09-12T17:10:30.374689+0000","last_became_peered":"2024-09-12T17:10:30.374689+0000","last_unstale":"2024-09-12T18:36:14.593784+0000","last_undegraded":"2024-09-12T18:36:14.593784+0000","last_fullsized":"2024-09-12T18:36:14.593784+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'327","last_scrub_stamp":"2024-09-12T18:36:14.593513+0000","last_deep_scrub":"268'327","last_deep_scrub_stamp":"2024-09-12T18:36:14.593513+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.593513+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:28.532832+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7813717,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":410,"num_read_kb":28127,"num_write":1070,"num_write_kb":52007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1587","reported_seq":3075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.983176+0000","last_change":"2024-09-12T18:36:21.983176+0000","last_active":"2024-09-12T18:36:21.983176+0000","last_peered":"2024-09-12T18:36:21.983176+0000","last_clean":"2024-09-12T18:36:21.983176+0000","last_became_active":"2024-09-12T17:10:32.384842+0000","last_became_peered":"2024-09-12T17:10:32.384842+0000","last_unstale":"2024-09-12T18:36:21.983176+0000","last_undegraded":"2024-09-12T18:36:21.983176+0000","last_fullsized":"2024-09-12T18:36:21.983176+0000","mapping_epoch":27,"log_start":"268'1500","ondisk_log_start":"268'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1587","last_scrub_stamp":"2024-09-12T18:36:21.982944+0000","last_deep_scrub":"268'1587","last_deep_scrub_stamp":"2024-09-12T18:36:21.982944+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.982944+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":1500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:29.105970+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6992,"num_read_kb":6083,"num_write":2272,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1264,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'489","reported_seq":1308,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.175743+0000","last_change":"2024-09-12T18:36:11.175743+0000","last_active":"2024-09-12T18:36:11.175743+0000","last_peered":"2024-09-12T18:36:11.175743+0000","last_clean":"2024-09-12T18:36:11.175743+0000","last_became_active":"2024-09-12T17:12:05.372879+0000","last_became_peered":"2024-09-12T17:12:05.372879+0000","last_unstale":"2024-09-12T18:36:11.175743+0000","last_undegraded":"2024-09-12T18:36:11.175743+0000","last_fullsized":"2024-09-12T18:36:11.175743+0000","mapping_epoch":40,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'489","last_scrub_stamp":"2024-09-12T18:36:11.175471+0000","last_deep_scrub":"268'489","last_deep_scrub_stamp":"2024-09-12T18:36:11.175471+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.175471+0000","objects_scrubbed":6,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:34.394103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":953,"num_read_kb":72647,"num_write":1674,"num_write_kb":47468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,0],"acting":[6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'1144","reported_seq":2659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.593697+0000","last_change":"2024-09-12T18:36:22.593697+0000","last_active":"2024-09-12T18:36:22.593697+0000","last_peered":"2024-09-12T18:36:22.593697+0000","last_clean":"2024-09-12T18:36:22.593697+0000","last_became_active":"2024-09-12T17:10:32.361416+0000","last_became_peered":"2024-09-12T17:10:32.361416+0000","last_unstale":"2024-09-12T18:36:22.593697+0000","last_undegraded":"2024-09-12T18:36:22.593697+0000","last_fullsized":"2024-09-12T18:36:22.593697+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1144","last_scrub_stamp":"2024-09-12T18:36:22.593502+0000","last_deep_scrub":"268'1144","last_deep_scrub_stamp":"2024-09-12T18:36:22.593502+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.593502+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":1100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:36.821997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5102,"num_read_kb":4502,"num_write":1588,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'428","reported_seq":1230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.909977+0000","last_change":"2024-09-12T18:36:19.909819+0000","last_active":"2024-09-12T18:36:19.909977+0000","last_peered":"2024-09-12T18:36:19.909977+0000","last_clean":"2024-09-12T18:36:19.909977+0000","last_became_active":"2024-09-12T17:10:30.404403+0000","last_became_peered":"2024-09-12T17:10:30.404403+0000","last_unstale":"2024-09-12T18:36:19.909977+0000","last_undegraded":"2024-09-12T18:36:19.909977+0000","last_fullsized":"2024-09-12T18:36:19.909977+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'428","last_scrub_stamp":"2024-09-12T18:36:19.909576+0000","last_deep_scrub":"268'428","last_deep_scrub_stamp":"2024-09-12T18:36:19.909576+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.909576+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:04.500862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":773,"num_read_kb":38616,"num_write":1272,"num_write_kb":36952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'394","reported_seq":1959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.746611+0000","last_change":"2024-09-12T18:36:25.746611+0000","last_active":"2024-09-12T18:36:25.746611+0000","last_peered":"2024-09-12T18:36:25.746611+0000","last_clean":"2024-09-12T18:36:25.746611+0000","last_became_active":"2024-09-12T17:10:32.352916+0000","last_became_peered":"2024-09-12T17:10:32.352916+0000","last_unstale":"2024-09-12T18:36:25.746611+0000","last_undegraded":"2024-09-12T18:36:25.746611+0000","last_fullsized":"2024-09-12T18:36:25.746611+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T18:36:25.746401+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T18:36:25.746401+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.746401+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:50.410716+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2283,"num_read_kb":2176,"num_write":460,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3055,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'343","reported_seq":995,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.346154+0000","last_change":"2024-09-12T18:36:09.345942+0000","last_active":"2024-09-12T18:36:09.346154+0000","last_peered":"2024-09-12T18:36:09.346154+0000","last_clean":"2024-09-12T18:36:09.346154+0000","last_became_active":"2024-09-12T17:10:30.402024+0000","last_became_peered":"2024-09-12T17:10:30.402024+0000","last_unstale":"2024-09-12T18:36:09.346154+0000","last_undegraded":"2024-09-12T18:36:09.346154+0000","last_fullsized":"2024-09-12T18:36:09.346154+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'343","last_scrub_stamp":"2024-09-12T18:36:09.345594+0000","last_deep_scrub":"268'343","last_deep_scrub_stamp":"2024-09-12T18:36:09.345594+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.345594+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:30.257704+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048602,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":454,"num_read_kb":33472,"num_write":1006,"num_write_kb":44244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'833","reported_seq":2409,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.932561+0000","last_change":"2024-09-12T18:36:25.932561+0000","last_active":"2024-09-12T18:36:25.932561+0000","last_peered":"2024-09-12T18:36:25.932561+0000","last_clean":"2024-09-12T18:36:25.932561+0000","last_became_active":"2024-09-12T17:10:32.375891+0000","last_became_peered":"2024-09-12T17:10:32.375891+0000","last_unstale":"2024-09-12T18:36:25.932561+0000","last_undegraded":"2024-09-12T18:36:25.932561+0000","last_fullsized":"2024-09-12T18:36:25.932561+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'833","last_scrub_stamp":"2024-09-12T18:36:25.932381+0000","last_deep_scrub":"268'833","last_deep_scrub_stamp":"2024-09-12T18:36:25.932381+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.932381+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:14.640927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3808,"num_read_kb":3437,"num_write":1089,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'407","reported_seq":1138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.991342+0000","last_change":"2024-09-12T18:36:17.991189+0000","last_active":"2024-09-12T18:36:17.991342+0000","last_peered":"2024-09-12T18:36:17.991342+0000","last_clean":"2024-09-12T18:36:17.991342+0000","last_became_active":"2024-09-12T17:10:30.378109+0000","last_became_peered":"2024-09-12T17:10:30.378109+0000","last_unstale":"2024-09-12T18:36:17.991342+0000","last_undegraded":"2024-09-12T18:36:17.991342+0000","last_fullsized":"2024-09-12T18:36:17.991342+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'407","last_scrub_stamp":"2024-09-12T18:36:17.990804+0000","last_deep_scrub":"268'407","last_deep_scrub_stamp":"2024-09-12T18:36:17.990804+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.990804+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:07.244535+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505043,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":645,"num_read_kb":82540,"num_write":1282,"num_write_kb":46419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'405","reported_seq":1093,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.986139+0000","last_change":"2024-09-12T18:36:19.986000+0000","last_active":"2024-09-12T18:36:19.986139+0000","last_peered":"2024-09-12T18:36:19.986139+0000","last_clean":"2024-09-12T18:36:19.986139+0000","last_became_active":"2024-09-12T17:10:30.356199+0000","last_became_peered":"2024-09-12T17:10:30.356199+0000","last_unstale":"2024-09-12T18:36:19.986139+0000","last_undegraded":"2024-09-12T18:36:19.986139+0000","last_fullsized":"2024-09-12T18:36:19.986139+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'405","last_scrub_stamp":"2024-09-12T18:36:19.985773+0000","last_deep_scrub":"268'405","last_deep_scrub_stamp":"2024-09-12T18:36:19.985773+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.985773+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:53.434690+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4401467,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":595,"num_read_kb":25748,"num_write":1241,"num_write_kb":44098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'463","reported_seq":2259,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.568220+0000","last_change":"2024-09-12T18:36:20.568220+0000","last_active":"2024-09-12T18:36:20.568220+0000","last_peered":"2024-09-12T18:36:20.568220+0000","last_clean":"2024-09-12T18:36:20.568220+0000","last_became_active":"2024-09-12T17:10:32.349687+0000","last_became_peered":"2024-09-12T17:10:32.349687+0000","last_unstale":"2024-09-12T18:36:20.568220+0000","last_undegraded":"2024-09-12T18:36:20.568220+0000","last_fullsized":"2024-09-12T18:36:20.568220+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'463","last_scrub_stamp":"2024-09-12T18:36:20.568016+0000","last_deep_scrub":"268'463","last_deep_scrub_stamp":"2024-09-12T18:36:20.568016+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.568016+0000","objects_scrubbed":6,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:18.504326+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2918,"num_read_kb":2789,"num_write":551,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'377","reported_seq":1048,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.922019+0000","last_change":"2024-09-12T18:36:11.921872+0000","last_active":"2024-09-12T18:36:11.922019+0000","last_peered":"2024-09-12T18:36:11.922019+0000","last_clean":"2024-09-12T18:36:11.922019+0000","last_became_active":"2024-09-12T17:11:05.121473+0000","last_became_peered":"2024-09-12T17:11:05.121473+0000","last_unstale":"2024-09-12T18:36:11.922019+0000","last_undegraded":"2024-09-12T18:36:11.922019+0000","last_fullsized":"2024-09-12T18:36:11.922019+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'377","last_scrub_stamp":"2024-09-12T18:36:11.921663+0000","last_deep_scrub":"268'377","last_deep_scrub_stamp":"2024-09-12T18:36:11.921663+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.921663+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:06.622722+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574022,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":29048,"num_write":1222,"num_write_kb":43104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'469","reported_seq":1973,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.000255+0000","last_change":"2024-09-12T18:36:26.000255+0000","last_active":"2024-09-12T18:36:26.000255+0000","last_peered":"2024-09-12T18:36:26.000255+0000","last_clean":"2024-09-12T18:36:26.000255+0000","last_became_active":"2024-09-12T17:10:32.352369+0000","last_became_peered":"2024-09-12T17:10:32.352369+0000","last_unstale":"2024-09-12T18:36:26.000255+0000","last_undegraded":"2024-09-12T18:36:26.000255+0000","last_fullsized":"2024-09-12T18:36:26.000255+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'469","last_scrub_stamp":"2024-09-12T18:36:25.999980+0000","last_deep_scrub":"268'469","last_deep_scrub_stamp":"2024-09-12T18:36:25.999980+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.999980+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:32.160700+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2354,"num_read_kb":2191,"num_write":554,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6108,"num_read_kb":4244,"num_write":1960,"num_write_kb":858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6958,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1133,"ondisk_log_size":1133,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":16274,"num_read_kb":15945,"num_write":16744,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1766,"ondisk_log_size":1766,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":736,"ondisk_log_size":736,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1625724,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":19494,"num_read_kb":40096,"num_write":16267,"num_write_kb":12112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":686274,"num_omap_keys":1572,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1932,"ondisk_log_size":1932,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":213001,"num_read_kb":194600,"num_write":55405,"num_write_kb":18906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44604,"num_omap_keys":180,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3841,"ondisk_log_size":3841,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":165322276,"num_objects":398,"num_object_clones":0,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":0,"num_read":36558,"num_read_kb":2308341,"num_write":72533,"num_write_kb":2504748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":249851904,"data_stored":249851904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3895,"ondisk_log_size":3895,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":159116,"num_write":182,"num_write_kb":116497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":158495,"num_write":182,"num_write_kb":116497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510486,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":340376,"kb_used_data":52360,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94031464,"statfs":{"total":96636764160,"available":96288219136,"internally_reserved":0,"allocated":53616640,"data_stored":51463722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":294910410},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510490,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299236,"kb_used_data":33428,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94072604,"statfs":{"total":96636764160,"available":96330346496,"internally_reserved":0,"allocated":34230272,"data_stored":32143073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":272169414},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510487,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":178948,"kb_used_data":31220,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94192892,"statfs":{"total":96636764160,"available":96453521408,"internally_reserved":0,"allocated":31969280,"data_stored":29799186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510489,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":135104,"kb_used_data":23408,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94236736,"statfs":{"total":96636764160,"available":96498417664,"internally_reserved":0,"allocated":23969792,"data_stored":21888023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510490,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209668,"kb_used_data":25844,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94162172,"statfs":{"total":96636764160,"available":96422064128,"internally_reserved":0,"allocated":26464256,"data_stored":24357991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510487,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302280,"kb_used_data":36472,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94069560,"statfs":{"total":96636764160,"available":96327229440,"internally_reserved":0,"allocated":37347328,"data_stored":35205199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":272169414},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543193,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139540,"kb_used_data":40324,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94232300,"statfs":{"total":96636764160,"available":96493875200,"internally_reserved":0,"allocated":41291776,"data_stored":39213361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575894,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320580,"kb_used_data":36724,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94051260,"statfs":{"total":96636764160,"available":96308490240,"internally_reserved":0,"allocated":37605376,"data_stored":35472167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32301056,"data_stored":32301056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22044672,"data_stored":22044672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19574784,"data_stored":19574784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33157120,"data_stored":33157120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36900864,"data_stored":36900864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":27484160,"data_stored":27484160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29831168,"data_stored":29831168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":48558080,"data_stored":48558080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:37:10.046 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:37:10.046 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:31:15.166978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=31, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:37:10.047 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:37:10.047 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:37:10.047 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:37:10.048 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:53:26.111473+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=53, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=36, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:37:10.051 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:37:30.052 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:37:30.408 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T18:37:30.425 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-09-12T18:37:30.439 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":2879,"stamp":"2024-09-12T18:37:28.906126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":167556499,"num_objects":881,"num_object_clones":0,"num_object_copies":2160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":881,"num_whiteouts":0,"num_read":294260,"num_read_kb":2883804,"num_write":163416,"num_write_kb":2776168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":213,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":741898,"num_omap_keys":1797,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13656,"ondisk_log_size":13656,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1925732,"kb_used_data":279780,"kb_used_omap":12,"kb_used_meta":1645811,"kb_avail":753048988,"statfs":{"total":773094113280,"available":771122163712,"internally_reserved":0,"allocated":286494720,"data_stored":269542722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1685311025},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009531"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:55.761427+0000","last_change":"2024-09-12T18:36:55.761427+0000","last_active":"2024-09-12T18:36:55.761427+0000","last_peered":"2024-09-12T18:36:55.761427+0000","last_clean":"2024-09-12T18:36:55.761427+0000","last_became_active":"2024-09-12T17:53:27.146780+0000","last_became_peered":"2024-09-12T17:53:27.146780+0000","last_unstale":"2024-09-12T18:36:55.761427+0000","last_undegraded":"2024-09-12T18:36:55.761427+0000","last_fullsized":"2024-09-12T18:36:55.761427+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:55.761246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:55.761246+0000","last_clean_scrub_stamp":"2024-09-12T18:36:55.761246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:06.414728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"268'11","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:52.717374+0000","last_change":"2024-09-12T18:36:52.717374+0000","last_active":"2024-09-12T18:36:52.717374+0000","last_peered":"2024-09-12T18:36:52.717374+0000","last_clean":"2024-09-12T18:36:52.717374+0000","last_became_active":"2024-09-12T17:31:16.245482+0000","last_became_peered":"2024-09-12T17:31:16.245482+0000","last_unstale":"2024-09-12T18:36:52.717374+0000","last_undegraded":"2024-09-12T18:36:52.717374+0000","last_fullsized":"2024-09-12T18:36:52.717374+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'11","last_scrub_stamp":"2024-09-12T18:36:52.717187+0000","last_deep_scrub":"268'11","last_deep_scrub_stamp":"2024-09-12T18:36:52.717187+0000","last_clean_scrub_stamp":"2024-09-12T18:36:52.717187+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:46.599351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5245,"num_write":16,"num_write_kb":2121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:55.856834+0000","last_change":"2024-09-12T18:36:55.856834+0000","last_active":"2024-09-12T18:36:55.856834+0000","last_peered":"2024-09-12T18:36:55.856834+0000","last_clean":"2024-09-12T18:36:55.856834+0000","last_became_active":"2024-09-12T17:31:12.094935+0000","last_became_peered":"2024-09-12T17:31:12.094935+0000","last_unstale":"2024-09-12T18:36:55.856834+0000","last_undegraded":"2024-09-12T18:36:55.856834+0000","last_fullsized":"2024-09-12T18:36:55.856834+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:36:55.856642+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:36:55.856642+0000","last_clean_scrub_stamp":"2024-09-12T18:36:55.856642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:22.785398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'30","reported_seq":152,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:53.973957+0000","last_change":"2024-09-12T18:36:53.973957+0000","last_active":"2024-09-12T18:36:53.973957+0000","last_peered":"2024-09-12T18:36:53.973957+0000","last_clean":"2024-09-12T18:36:53.973957+0000","last_became_active":"2024-09-12T17:27:32.583903+0000","last_became_peered":"2024-09-12T17:27:32.583903+0000","last_unstale":"2024-09-12T18:36:53.973957+0000","last_undegraded":"2024-09-12T18:36:53.973957+0000","last_fullsized":"2024-09-12T18:36:53.973957+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-12T18:36:53.973711+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-12T18:36:53.973711+0000","last_clean_scrub_stamp":"2024-09-12T18:36:53.973711+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:05.725948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":98,"num_write":57,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.331440+0000","last_change":"2024-09-12T18:36:38.331440+0000","last_active":"2024-09-12T18:36:38.331440+0000","last_peered":"2024-09-12T18:36:38.331440+0000","last_clean":"2024-09-12T18:36:38.331440+0000","last_became_active":"2024-09-12T17:53:27.167810+0000","last_became_peered":"2024-09-12T17:53:27.167810+0000","last_unstale":"2024-09-12T18:36:38.331440+0000","last_undegraded":"2024-09-12T18:36:38.331440+0000","last_fullsized":"2024-09-12T18:36:38.331440+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:38.331269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:38.331269+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.331269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:08.481081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'7","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:54.686861+0000","last_change":"2024-09-12T18:36:54.686861+0000","last_active":"2024-09-12T18:36:54.686861+0000","last_peered":"2024-09-12T18:36:54.686861+0000","last_clean":"2024-09-12T18:36:54.686861+0000","last_became_active":"2024-09-12T17:31:16.237721+0000","last_became_peered":"2024-09-12T17:31:16.237721+0000","last_unstale":"2024-09-12T18:36:54.686861+0000","last_undegraded":"2024-09-12T18:36:54.686861+0000","last_fullsized":"2024-09-12T18:36:54.686861+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T18:36:54.686681+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T18:36:54.686681+0000","last_clean_scrub_stamp":"2024-09-12T18:36:54.686681+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:00.615927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'2","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.813987+0000","last_change":"2024-09-12T18:36:32.813987+0000","last_active":"2024-09-12T18:36:32.813987+0000","last_peered":"2024-09-12T18:36:32.813987+0000","last_clean":"2024-09-12T18:36:32.813987+0000","last_became_active":"2024-09-12T17:31:12.105548+0000","last_became_peered":"2024-09-12T17:31:12.105548+0000","last_unstale":"2024-09-12T18:36:32.813987+0000","last_undegraded":"2024-09-12T18:36:32.813987+0000","last_fullsized":"2024-09-12T18:36:32.813987+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:36:32.813796+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:36:32.813796+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.813796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:48.755340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'16","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.518979+0000","last_change":"2024-09-12T18:36:30.518979+0000","last_active":"2024-09-12T18:36:30.518979+0000","last_peered":"2024-09-12T18:36:30.518979+0000","last_clean":"2024-09-12T18:36:30.518979+0000","last_became_active":"2024-09-12T17:27:32.563281+0000","last_became_peered":"2024-09-12T17:27:32.563281+0000","last_unstale":"2024-09-12T18:36:30.518979+0000","last_undegraded":"2024-09-12T18:36:30.518979+0000","last_fullsized":"2024-09-12T18:36:30.518979+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-09-12T18:36:30.518795+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-09-12T18:36:30.518795+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.518795+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:53.495286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.190979+0000","last_change":"2024-09-12T18:36:43.190836+0000","last_active":"2024-09-12T18:36:43.190979+0000","last_peered":"2024-09-12T18:36:43.190979+0000","last_clean":"2024-09-12T18:36:43.190979+0000","last_became_active":"2024-09-12T17:53:27.143812+0000","last_became_peered":"2024-09-12T17:53:27.143812+0000","last_unstale":"2024-09-12T18:36:43.190979+0000","last_undegraded":"2024-09-12T18:36:43.190979+0000","last_fullsized":"2024-09-12T18:36:43.190979+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:43.190659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:43.190659+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.190659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:00.740038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:01.988492+0000","last_change":"2024-09-12T18:37:01.988492+0000","last_active":"2024-09-12T18:37:01.988492+0000","last_peered":"2024-09-12T18:37:01.988492+0000","last_clean":"2024-09-12T18:37:01.988492+0000","last_became_active":"2024-09-12T17:31:16.208994+0000","last_became_peered":"2024-09-12T17:31:16.208994+0000","last_unstale":"2024-09-12T18:37:01.988492+0000","last_undegraded":"2024-09-12T18:37:01.988492+0000","last_fullsized":"2024-09-12T18:37:01.988492+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:01.988306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:01.988306+0000","last_clean_scrub_stamp":"2024-09-12T18:37:01.988306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:32.291672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'15","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.418570+0000","last_change":"2024-09-12T18:36:35.418411+0000","last_active":"2024-09-12T18:36:35.418570+0000","last_peered":"2024-09-12T18:36:35.418570+0000","last_clean":"2024-09-12T18:36:35.418570+0000","last_became_active":"2024-09-12T17:31:12.090602+0000","last_became_peered":"2024-09-12T17:31:12.090602+0000","last_unstale":"2024-09-12T18:36:35.418570+0000","last_undegraded":"2024-09-12T18:36:35.418570+0000","last_fullsized":"2024-09-12T18:36:35.418570+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'15","last_scrub_stamp":"2024-09-12T18:36:35.418214+0000","last_deep_scrub":"268'15","last_deep_scrub_stamp":"2024-09-12T18:36:35.418214+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.418214+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:59.377552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10290,"num_write":20,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'40","reported_seq":175,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:49.845542+0000","last_change":"2024-09-12T18:36:49.845542+0000","last_active":"2024-09-12T18:36:49.845542+0000","last_peered":"2024-09-12T18:36:49.845542+0000","last_clean":"2024-09-12T18:36:49.845542+0000","last_became_active":"2024-09-12T17:27:32.554228+0000","last_became_peered":"2024-09-12T17:27:32.554228+0000","last_unstale":"2024-09-12T18:36:49.845542+0000","last_undegraded":"2024-09-12T18:36:49.845542+0000","last_fullsized":"2024-09-12T18:36:49.845542+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'40","last_scrub_stamp":"2024-09-12T18:36:49.845350+0000","last_deep_scrub":"268'40","last_deep_scrub_stamp":"2024-09-12T18:36:49.845350+0000","last_clean_scrub_stamp":"2024-09-12T18:36:49.845350+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:09.422732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":136,"num_write":75,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:09.934779+0000","last_change":"2024-09-12T18:37:09.934779+0000","last_active":"2024-09-12T18:37:09.934779+0000","last_peered":"2024-09-12T18:37:09.934779+0000","last_clean":"2024-09-12T18:37:09.934779+0000","last_became_active":"2024-09-12T17:53:27.165849+0000","last_became_peered":"2024-09-12T17:53:27.165849+0000","last_unstale":"2024-09-12T18:37:09.934779+0000","last_undegraded":"2024-09-12T18:37:09.934779+0000","last_fullsized":"2024-09-12T18:37:09.934779+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:09.934609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:09.934609+0000","last_clean_scrub_stamp":"2024-09-12T18:37:09.934609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:00.332658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"268'7","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:04.886740+0000","last_change":"2024-09-12T18:37:04.886740+0000","last_active":"2024-09-12T18:37:04.886740+0000","last_peered":"2024-09-12T18:37:04.886740+0000","last_clean":"2024-09-12T18:37:04.886740+0000","last_became_active":"2024-09-12T17:31:16.233989+0000","last_became_peered":"2024-09-12T17:31:16.233989+0000","last_unstale":"2024-09-12T18:37:04.886740+0000","last_undegraded":"2024-09-12T18:37:04.886740+0000","last_fullsized":"2024-09-12T18:37:04.886740+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T18:37:04.886508+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T18:37:04.886508+0000","last_clean_scrub_stamp":"2024-09-12T18:37:04.886508+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:45.496868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'10","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:49.717176+0000","last_change":"2024-09-12T18:36:49.717176+0000","last_active":"2024-09-12T18:36:49.717176+0000","last_peered":"2024-09-12T18:36:49.717176+0000","last_clean":"2024-09-12T18:36:49.717176+0000","last_became_active":"2024-09-12T17:31:12.076980+0000","last_became_peered":"2024-09-12T17:31:12.076980+0000","last_unstale":"2024-09-12T18:36:49.717176+0000","last_undegraded":"2024-09-12T18:36:49.717176+0000","last_fullsized":"2024-09-12T18:36:49.717176+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'10","last_scrub_stamp":"2024-09-12T18:36:49.716946+0000","last_deep_scrub":"268'10","last_deep_scrub_stamp":"2024-09-12T18:36:49.716946+0000","last_clean_scrub_stamp":"2024-09-12T18:36:49.716946+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:50.318674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11264,"num_write":20,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'22","reported_seq":131,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:54.903402+0000","last_change":"2024-09-12T18:36:54.903402+0000","last_active":"2024-09-12T18:36:54.903402+0000","last_peered":"2024-09-12T18:36:54.903402+0000","last_clean":"2024-09-12T18:36:54.903402+0000","last_became_active":"2024-09-12T17:27:32.597092+0000","last_became_peered":"2024-09-12T17:27:32.597092+0000","last_unstale":"2024-09-12T18:36:54.903402+0000","last_undegraded":"2024-09-12T18:36:54.903402+0000","last_fullsized":"2024-09-12T18:36:54.903402+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'22","last_scrub_stamp":"2024-09-12T18:36:54.903217+0000","last_deep_scrub":"268'22","last_deep_scrub_stamp":"2024-09-12T18:36:54.903217+0000","last_clean_scrub_stamp":"2024-09-12T18:36:54.903217+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:27.462006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":80,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:07.905356+0000","last_change":"2024-09-12T18:37:07.905356+0000","last_active":"2024-09-12T18:37:07.905356+0000","last_peered":"2024-09-12T18:37:07.905356+0000","last_clean":"2024-09-12T18:37:07.905356+0000","last_became_active":"2024-09-12T17:53:27.166248+0000","last_became_peered":"2024-09-12T17:53:27.166248+0000","last_unstale":"2024-09-12T18:37:07.905356+0000","last_undegraded":"2024-09-12T18:37:07.905356+0000","last_fullsized":"2024-09-12T18:37:07.905356+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:07.905115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:07.905115+0000","last_clean_scrub_stamp":"2024-09-12T18:37:07.905115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:29.217539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:51.682423+0000","last_change":"2024-09-12T18:36:51.682423+0000","last_active":"2024-09-12T18:36:51.682423+0000","last_peered":"2024-09-12T18:36:51.682423+0000","last_clean":"2024-09-12T18:36:51.682423+0000","last_became_active":"2024-09-12T17:32:06.560465+0000","last_became_peered":"2024-09-12T17:32:06.560465+0000","last_unstale":"2024-09-12T18:36:51.682423+0000","last_undegraded":"2024-09-12T18:36:51.682423+0000","last_fullsized":"2024-09-12T18:36:51.682423+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:51.682229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:51.682229+0000","last_clean_scrub_stamp":"2024-09-12T18:36:51.682229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:16.365716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'8","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:54.925227+0000","last_change":"2024-09-12T18:36:54.925227+0000","last_active":"2024-09-12T18:36:54.925227+0000","last_peered":"2024-09-12T18:36:54.925227+0000","last_clean":"2024-09-12T18:36:54.925227+0000","last_became_active":"2024-09-12T17:31:12.067819+0000","last_became_peered":"2024-09-12T17:31:12.067819+0000","last_unstale":"2024-09-12T18:36:54.925227+0000","last_undegraded":"2024-09-12T18:36:54.925227+0000","last_fullsized":"2024-09-12T18:36:54.925227+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T18:36:54.925007+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T18:36:54.925007+0000","last_clean_scrub_stamp":"2024-09-12T18:36:54.925007+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:00.584474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":19458,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'26","reported_seq":142,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:51.835018+0000","last_change":"2024-09-12T18:36:51.835018+0000","last_active":"2024-09-12T18:36:51.835018+0000","last_peered":"2024-09-12T18:36:51.835018+0000","last_clean":"2024-09-12T18:36:51.835018+0000","last_became_active":"2024-09-12T17:27:32.578575+0000","last_became_peered":"2024-09-12T17:27:32.578575+0000","last_unstale":"2024-09-12T18:36:51.835018+0000","last_undegraded":"2024-09-12T18:36:51.835018+0000","last_fullsized":"2024-09-12T18:36:51.835018+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-09-12T18:36:51.834828+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-09-12T18:36:51.834828+0000","last_clean_scrub_stamp":"2024-09-12T18:36:51.834828+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:24.652055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":95,"num_write":44,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:47.779436+0000","last_change":"2024-09-12T18:36:47.779208+0000","last_active":"2024-09-12T18:36:47.779436+0000","last_peered":"2024-09-12T18:36:47.779436+0000","last_clean":"2024-09-12T18:36:47.779436+0000","last_became_active":"2024-09-12T17:53:27.156155+0000","last_became_peered":"2024-09-12T17:53:27.156155+0000","last_unstale":"2024-09-12T18:36:47.779436+0000","last_undegraded":"2024-09-12T18:36:47.779436+0000","last_fullsized":"2024-09-12T18:36:47.779436+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:47.778990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:47.778990+0000","last_clean_scrub_stamp":"2024-09-12T18:36:47.778990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:30.215730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"268'2","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.162170+0000","last_change":"2024-09-12T18:36:38.162170+0000","last_active":"2024-09-12T18:36:38.162170+0000","last_peered":"2024-09-12T18:36:38.162170+0000","last_clean":"2024-09-12T18:36:38.162170+0000","last_became_active":"2024-09-12T17:31:16.226398+0000","last_became_peered":"2024-09-12T17:31:16.226398+0000","last_unstale":"2024-09-12T18:36:38.162170+0000","last_undegraded":"2024-09-12T18:36:38.162170+0000","last_fullsized":"2024-09-12T18:36:38.162170+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:38.161992+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:38.161992+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.161992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:58.585276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:46.744036+0000","last_change":"2024-09-12T18:36:46.743867+0000","last_active":"2024-09-12T18:36:46.744036+0000","last_peered":"2024-09-12T18:36:46.744036+0000","last_clean":"2024-09-12T18:36:46.744036+0000","last_became_active":"2024-09-12T17:31:12.076502+0000","last_became_peered":"2024-09-12T17:31:12.076502+0000","last_unstale":"2024-09-12T18:36:46.744036+0000","last_undegraded":"2024-09-12T18:36:46.744036+0000","last_fullsized":"2024-09-12T18:36:46.744036+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:46.743670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:46.743670+0000","last_clean_scrub_stamp":"2024-09-12T18:36:46.743670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:41.248759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'36","reported_seq":165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.143323+0000","last_change":"2024-09-12T18:36:35.143323+0000","last_active":"2024-09-12T18:36:35.143323+0000","last_peered":"2024-09-12T18:36:35.143323+0000","last_clean":"2024-09-12T18:36:35.143323+0000","last_became_active":"2024-09-12T17:27:32.568740+0000","last_became_peered":"2024-09-12T17:27:32.568740+0000","last_unstale":"2024-09-12T18:36:35.143323+0000","last_undegraded":"2024-09-12T18:36:35.143323+0000","last_fullsized":"2024-09-12T18:36:35.143323+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-09-12T18:36:35.143142+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-09-12T18:36:35.143142+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.143142+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:17.123627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":126,"num_write":62,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:05.143627+0000","last_change":"2024-09-12T18:37:05.143627+0000","last_active":"2024-09-12T18:37:05.143627+0000","last_peered":"2024-09-12T18:37:05.143627+0000","last_clean":"2024-09-12T18:37:05.143627+0000","last_became_active":"2024-09-12T17:53:27.169805+0000","last_became_peered":"2024-09-12T17:53:27.169805+0000","last_unstale":"2024-09-12T18:37:05.143627+0000","last_undegraded":"2024-09-12T18:37:05.143627+0000","last_fullsized":"2024-09-12T18:37:05.143627+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:37:05.143437+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:37:05.143437+0000","last_clean_scrub_stamp":"2024-09-12T18:37:05.143437+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:28.635876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"268'2","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.240019+0000","last_change":"2024-09-12T18:36:42.240019+0000","last_active":"2024-09-12T18:36:42.240019+0000","last_peered":"2024-09-12T18:36:42.240019+0000","last_clean":"2024-09-12T18:36:42.240019+0000","last_became_active":"2024-09-12T17:31:16.220449+0000","last_became_peered":"2024-09-12T17:31:16.220449+0000","last_unstale":"2024-09-12T18:36:42.240019+0000","last_undegraded":"2024-09-12T18:36:42.240019+0000","last_fullsized":"2024-09-12T18:36:42.240019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:42.239845+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:42.239845+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.239845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:07.000654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:47.696858+0000","last_change":"2024-09-12T18:36:47.696858+0000","last_active":"2024-09-12T18:36:47.696858+0000","last_peered":"2024-09-12T18:36:47.696858+0000","last_clean":"2024-09-12T18:36:47.696858+0000","last_became_active":"2024-09-12T17:31:12.086091+0000","last_became_peered":"2024-09-12T17:31:12.086091+0000","last_unstale":"2024-09-12T18:36:47.696858+0000","last_undegraded":"2024-09-12T18:36:47.696858+0000","last_fullsized":"2024-09-12T18:36:47.696858+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:47.696568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:47.696568+0000","last_clean_scrub_stamp":"2024-09-12T18:36:47.696568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:32.501521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'57","reported_seq":225,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:50.857457+0000","last_change":"2024-09-12T18:36:50.857457+0000","last_active":"2024-09-12T18:36:50.857457+0000","last_peered":"2024-09-12T18:36:50.857457+0000","last_clean":"2024-09-12T18:36:50.857457+0000","last_became_active":"2024-09-12T17:27:32.568506+0000","last_became_peered":"2024-09-12T17:27:32.568506+0000","last_unstale":"2024-09-12T18:36:50.857457+0000","last_undegraded":"2024-09-12T18:36:50.857457+0000","last_fullsized":"2024-09-12T18:36:50.857457+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'57","last_scrub_stamp":"2024-09-12T18:36:50.857195+0000","last_deep_scrub":"268'57","last_deep_scrub_stamp":"2024-09-12T18:36:50.857195+0000","last_clean_scrub_stamp":"2024-09-12T18:36:50.857195+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:09.064961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":207,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:04.113609+0000","last_change":"2024-09-12T18:37:04.113609+0000","last_active":"2024-09-12T18:37:04.113609+0000","last_peered":"2024-09-12T18:37:04.113609+0000","last_clean":"2024-09-12T18:37:04.113609+0000","last_became_active":"2024-09-12T17:53:27.170636+0000","last_became_peered":"2024-09-12T17:53:27.170636+0000","last_unstale":"2024-09-12T18:37:04.113609+0000","last_undegraded":"2024-09-12T18:37:04.113609+0000","last_fullsized":"2024-09-12T18:37:04.113609+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:04.113422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:04.113422+0000","last_clean_scrub_stamp":"2024-09-12T18:37:04.113422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:05.955316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"268'3","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:03.879814+0000","last_change":"2024-09-12T18:37:03.879814+0000","last_active":"2024-09-12T18:37:03.879814+0000","last_peered":"2024-09-12T18:37:03.879814+0000","last_clean":"2024-09-12T18:37:03.879814+0000","last_became_active":"2024-09-12T17:31:16.238450+0000","last_became_peered":"2024-09-12T17:31:16.238450+0000","last_unstale":"2024-09-12T18:37:03.879814+0000","last_undegraded":"2024-09-12T18:37:03.879814+0000","last_fullsized":"2024-09-12T18:37:03.879814+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T18:37:03.879625+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T18:37:03.879625+0000","last_clean_scrub_stamp":"2024-09-12T18:37:03.879625+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:24.772909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:59.993911+0000","last_change":"2024-09-12T18:36:59.993911+0000","last_active":"2024-09-12T18:36:59.993911+0000","last_peered":"2024-09-12T18:36:59.993911+0000","last_clean":"2024-09-12T18:36:59.993911+0000","last_became_active":"2024-09-12T17:31:12.090201+0000","last_became_peered":"2024-09-12T17:31:12.090201+0000","last_unstale":"2024-09-12T18:36:59.993911+0000","last_undegraded":"2024-09-12T18:36:59.993911+0000","last_fullsized":"2024-09-12T18:36:59.993911+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:36:59.993724+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:36:59.993724+0000","last_clean_scrub_stamp":"2024-09-12T18:36:59.993724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:37.183073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.770769+0000","last_change":"2024-09-12T18:36:39.770769+0000","last_active":"2024-09-12T18:36:39.770769+0000","last_peered":"2024-09-12T18:36:39.770769+0000","last_clean":"2024-09-12T18:36:39.770769+0000","last_became_active":"2024-09-12T17:27:32.567672+0000","last_became_peered":"2024-09-12T17:27:32.567672+0000","last_unstale":"2024-09-12T18:36:39.770769+0000","last_undegraded":"2024-09-12T18:36:39.770769+0000","last_fullsized":"2024-09-12T18:36:39.770769+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:39.770579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:39.770579+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.770579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:03.618879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.813013+0000","last_change":"2024-09-12T18:36:40.813013+0000","last_active":"2024-09-12T18:36:40.813013+0000","last_peered":"2024-09-12T18:36:40.813013+0000","last_clean":"2024-09-12T18:36:40.813013+0000","last_became_active":"2024-09-12T17:53:27.142060+0000","last_became_peered":"2024-09-12T17:53:27.142060+0000","last_unstale":"2024-09-12T18:36:40.813013+0000","last_undegraded":"2024-09-12T18:36:40.813013+0000","last_fullsized":"2024-09-12T18:36:40.813013+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:40.812833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:40.812833+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.812833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:17.096207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"268'5","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:02.879499+0000","last_change":"2024-09-12T18:37:02.879499+0000","last_active":"2024-09-12T18:37:02.879499+0000","last_peered":"2024-09-12T18:37:02.879499+0000","last_clean":"2024-09-12T18:37:02.879499+0000","last_became_active":"2024-09-12T17:31:16.228226+0000","last_became_peered":"2024-09-12T17:31:16.228226+0000","last_unstale":"2024-09-12T18:37:02.879499+0000","last_undegraded":"2024-09-12T18:37:02.879499+0000","last_fullsized":"2024-09-12T18:37:02.879499+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T18:37:02.879280+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T18:37:02.879280+0000","last_clean_scrub_stamp":"2024-09-12T18:37:02.879280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:33.746237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1072,"num_write":10,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'5","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:48.778044+0000","last_change":"2024-09-12T18:36:48.777897+0000","last_active":"2024-09-12T18:36:48.778044+0000","last_peered":"2024-09-12T18:36:48.778044+0000","last_clean":"2024-09-12T18:36:48.778044+0000","last_became_active":"2024-09-12T17:31:12.090779+0000","last_became_peered":"2024-09-12T17:31:12.090779+0000","last_unstale":"2024-09-12T18:36:48.778044+0000","last_undegraded":"2024-09-12T18:36:48.778044+0000","last_fullsized":"2024-09-12T18:36:48.778044+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T18:36:48.777712+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T18:36:48.777712+0000","last_clean_scrub_stamp":"2024-09-12T18:36:48.777712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:14.632377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'62","reported_seq":242,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:48.822239+0000","last_change":"2024-09-12T18:36:48.822239+0000","last_active":"2024-09-12T18:36:48.822239+0000","last_peered":"2024-09-12T18:36:48.822239+0000","last_clean":"2024-09-12T18:36:48.822239+0000","last_became_active":"2024-09-12T17:27:32.567884+0000","last_became_peered":"2024-09-12T17:27:32.567884+0000","last_unstale":"2024-09-12T18:36:48.822239+0000","last_undegraded":"2024-09-12T18:36:48.822239+0000","last_fullsized":"2024-09-12T18:36:48.822239+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'62","last_scrub_stamp":"2024-09-12T18:36:48.822018+0000","last_deep_scrub":"268'62","last_deep_scrub_stamp":"2024-09-12T18:36:48.822018+0000","last_clean_scrub_stamp":"2024-09-12T18:36:48.822018+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:55.939955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":230,"num_write":101,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.369481+0000","last_change":"2024-09-12T18:36:37.369481+0000","last_active":"2024-09-12T18:36:37.369481+0000","last_peered":"2024-09-12T18:36:37.369481+0000","last_clean":"2024-09-12T18:36:37.369481+0000","last_became_active":"2024-09-12T17:53:27.139551+0000","last_became_peered":"2024-09-12T17:53:27.139551+0000","last_unstale":"2024-09-12T18:36:37.369481+0000","last_undegraded":"2024-09-12T18:36:37.369481+0000","last_fullsized":"2024-09-12T18:36:37.369481+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:37.369267+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:37.369267+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.369267+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:04.544870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'3","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:59.858494+0000","last_change":"2024-09-12T18:36:59.858494+0000","last_active":"2024-09-12T18:36:59.858494+0000","last_peered":"2024-09-12T18:36:59.858494+0000","last_clean":"2024-09-12T18:36:59.858494+0000","last_became_active":"2024-09-12T17:31:16.236796+0000","last_became_peered":"2024-09-12T17:31:16.236796+0000","last_unstale":"2024-09-12T18:36:59.858494+0000","last_undegraded":"2024-09-12T18:36:59.858494+0000","last_fullsized":"2024-09-12T18:36:59.858494+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:36:59.858278+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:36:59.858278+0000","last_clean_scrub_stamp":"2024-09-12T18:36:59.858278+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:16.454139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'4","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:53.134702+0000","last_change":"2024-09-12T18:36:53.134702+0000","last_active":"2024-09-12T18:36:53.134702+0000","last_peered":"2024-09-12T18:36:53.134702+0000","last_clean":"2024-09-12T18:36:53.134702+0000","last_became_active":"2024-09-12T17:31:12.092655+0000","last_became_peered":"2024-09-12T17:31:12.092655+0000","last_unstale":"2024-09-12T18:36:53.134702+0000","last_undegraded":"2024-09-12T18:36:53.134702+0000","last_fullsized":"2024-09-12T18:36:53.134702+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:53.134526+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:53.134526+0000","last_clean_scrub_stamp":"2024-09-12T18:36:53.134526+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:28.155409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'23","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:50.859026+0000","last_change":"2024-09-12T18:36:50.859026+0000","last_active":"2024-09-12T18:36:50.859026+0000","last_peered":"2024-09-12T18:36:50.859026+0000","last_clean":"2024-09-12T18:36:50.859026+0000","last_became_active":"2024-09-12T17:27:32.578393+0000","last_became_peered":"2024-09-12T17:27:32.578393+0000","last_unstale":"2024-09-12T18:36:50.859026+0000","last_undegraded":"2024-09-12T18:36:50.859026+0000","last_fullsized":"2024-09-12T18:36:50.859026+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'23","last_scrub_stamp":"2024-09-12T18:36:50.858847+0000","last_deep_scrub":"268'23","last_deep_scrub_stamp":"2024-09-12T18:36:50.858847+0000","last_clean_scrub_stamp":"2024-09-12T18:36:50.858847+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:34.798974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":84,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:03.150616+0000","last_change":"2024-09-12T18:37:03.150616+0000","last_active":"2024-09-12T18:37:03.150616+0000","last_peered":"2024-09-12T18:37:03.150616+0000","last_clean":"2024-09-12T18:37:03.150616+0000","last_became_active":"2024-09-12T17:53:27.142159+0000","last_became_peered":"2024-09-12T17:53:27.142159+0000","last_unstale":"2024-09-12T18:37:03.150616+0000","last_undegraded":"2024-09-12T18:37:03.150616+0000","last_fullsized":"2024-09-12T18:37:03.150616+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:03.150426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:03.150426+0000","last_clean_scrub_stamp":"2024-09-12T18:37:03.150426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:56.693488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'4","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:01.861518+0000","last_change":"2024-09-12T18:37:01.861518+0000","last_active":"2024-09-12T18:37:01.861518+0000","last_peered":"2024-09-12T18:37:01.861518+0000","last_clean":"2024-09-12T18:37:01.861518+0000","last_became_active":"2024-09-12T17:31:16.236478+0000","last_became_peered":"2024-09-12T17:31:16.236478+0000","last_unstale":"2024-09-12T18:37:01.861518+0000","last_undegraded":"2024-09-12T18:37:01.861518+0000","last_fullsized":"2024-09-12T18:37:01.861518+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:37:01.861183+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:37:01.861183+0000","last_clean_scrub_stamp":"2024-09-12T18:37:01.861183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:35.015341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.413764+0000","last_change":"2024-09-12T18:36:33.413764+0000","last_active":"2024-09-12T18:36:33.413764+0000","last_peered":"2024-09-12T18:36:33.413764+0000","last_clean":"2024-09-12T18:36:33.413764+0000","last_became_active":"2024-09-12T17:31:12.091488+0000","last_became_peered":"2024-09-12T17:31:12.091488+0000","last_unstale":"2024-09-12T18:36:33.413764+0000","last_undegraded":"2024-09-12T18:36:33.413764+0000","last_fullsized":"2024-09-12T18:36:33.413764+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:33.413578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:33.413578+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.413578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:54.083021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'49","reported_seq":208,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.524946+0000","last_change":"2024-09-12T18:36:28.524946+0000","last_active":"2024-09-12T18:36:28.524946+0000","last_peered":"2024-09-12T18:36:28.524946+0000","last_clean":"2024-09-12T18:36:28.524946+0000","last_became_active":"2024-09-12T17:27:32.572859+0000","last_became_peered":"2024-09-12T17:27:32.572859+0000","last_unstale":"2024-09-12T18:36:28.524946+0000","last_undegraded":"2024-09-12T18:36:28.524946+0000","last_fullsized":"2024-09-12T18:36:28.524946+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'49","last_scrub_stamp":"2024-09-12T18:36:28.524755+0000","last_deep_scrub":"268'49","last_deep_scrub_stamp":"2024-09-12T18:36:28.524755+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.524755+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:40.471596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":198,"num_write":77,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:54.715251+0000","last_change":"2024-09-12T18:36:54.715251+0000","last_active":"2024-09-12T18:36:54.715251+0000","last_peered":"2024-09-12T18:36:54.715251+0000","last_clean":"2024-09-12T18:36:54.715251+0000","last_became_active":"2024-09-12T17:53:27.155646+0000","last_became_peered":"2024-09-12T17:53:27.155646+0000","last_unstale":"2024-09-12T18:36:54.715251+0000","last_undegraded":"2024-09-12T18:36:54.715251+0000","last_fullsized":"2024-09-12T18:36:54.715251+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:54.715064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:54.715064+0000","last_clean_scrub_stamp":"2024-09-12T18:36:54.715064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:25.403137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'4","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:52.667068+0000","last_change":"2024-09-12T18:36:52.667068+0000","last_active":"2024-09-12T18:36:52.667068+0000","last_peered":"2024-09-12T18:36:52.667068+0000","last_clean":"2024-09-12T18:36:52.667068+0000","last_became_active":"2024-09-12T17:31:16.220797+0000","last_became_peered":"2024-09-12T17:31:16.220797+0000","last_unstale":"2024-09-12T18:36:52.667068+0000","last_undegraded":"2024-09-12T18:36:52.667068+0000","last_fullsized":"2024-09-12T18:36:52.667068+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:36:52.666845+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:36:52.666845+0000","last_clean_scrub_stamp":"2024-09-12T18:36:52.666845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:47.529646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:55.917357+0000","last_change":"2024-09-12T18:36:55.917357+0000","last_active":"2024-09-12T18:36:55.917357+0000","last_peered":"2024-09-12T18:36:55.917357+0000","last_clean":"2024-09-12T18:36:55.917357+0000","last_became_active":"2024-09-12T17:31:12.090174+0000","last_became_peered":"2024-09-12T17:31:12.090174+0000","last_unstale":"2024-09-12T18:36:55.917357+0000","last_undegraded":"2024-09-12T18:36:55.917357+0000","last_fullsized":"2024-09-12T18:36:55.917357+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:55.917144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:55.917144+0000","last_clean_scrub_stamp":"2024-09-12T18:36:55.917144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:02.788344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'101","reported_seq":403,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:47.131098+0000","last_change":"2024-09-12T18:36:47.131098+0000","last_active":"2024-09-12T18:36:47.131098+0000","last_peered":"2024-09-12T18:36:47.131098+0000","last_clean":"2024-09-12T18:36:47.131098+0000","last_became_active":"2024-09-12T17:27:32.574023+0000","last_became_peered":"2024-09-12T17:27:32.574023+0000","last_unstale":"2024-09-12T18:36:47.131098+0000","last_undegraded":"2024-09-12T18:36:47.131098+0000","last_fullsized":"2024-09-12T18:36:47.131098+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'101","last_scrub_stamp":"2024-09-12T18:36:47.130903+0000","last_deep_scrub":"268'101","last_deep_scrub_stamp":"2024-09-12T18:36:47.130903+0000","last_clean_scrub_stamp":"2024-09-12T18:36:47.130903+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:44.151223+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":651,"num_read_kb":453,"num_write":126,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3472,"num_omap_keys":7,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:06.895169+0000","last_change":"2024-09-12T18:37:06.895169+0000","last_active":"2024-09-12T18:37:06.895169+0000","last_peered":"2024-09-12T18:37:06.895169+0000","last_clean":"2024-09-12T18:37:06.895169+0000","last_became_active":"2024-09-12T17:53:27.164643+0000","last_became_peered":"2024-09-12T17:53:27.164643+0000","last_unstale":"2024-09-12T18:37:06.895169+0000","last_undegraded":"2024-09-12T18:37:06.895169+0000","last_fullsized":"2024-09-12T18:37:06.895169+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:06.894951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:06.894951+0000","last_clean_scrub_stamp":"2024-09-12T18:37:06.894951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:00.735139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"265'4","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.778689+0000","last_change":"2024-09-12T18:36:42.778689+0000","last_active":"2024-09-12T18:36:42.778689+0000","last_peered":"2024-09-12T18:36:42.778689+0000","last_clean":"2024-09-12T18:36:42.778689+0000","last_became_active":"2024-09-12T17:31:16.240666+0000","last_became_peered":"2024-09-12T17:31:16.240666+0000","last_unstale":"2024-09-12T18:36:42.778689+0000","last_undegraded":"2024-09-12T18:36:42.778689+0000","last_fullsized":"2024-09-12T18:36:42.778689+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:36:42.778498+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:36:42.778498+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.778498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:25.885647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:45.736128+0000","last_change":"2024-09-12T18:36:45.736128+0000","last_active":"2024-09-12T18:36:45.736128+0000","last_peered":"2024-09-12T18:36:45.736128+0000","last_clean":"2024-09-12T18:36:45.736128+0000","last_became_active":"2024-09-12T17:31:12.077055+0000","last_became_peered":"2024-09-12T17:31:12.077055+0000","last_unstale":"2024-09-12T18:36:45.736128+0000","last_undegraded":"2024-09-12T18:36:45.736128+0000","last_fullsized":"2024-09-12T18:36:45.736128+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:45.735944+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:45.735944+0000","last_clean_scrub_stamp":"2024-09-12T18:36:45.735944+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:36.120792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'36","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:46.104074+0000","last_change":"2024-09-12T18:36:46.104074+0000","last_active":"2024-09-12T18:36:46.104074+0000","last_peered":"2024-09-12T18:36:46.104074+0000","last_clean":"2024-09-12T18:36:46.104074+0000","last_became_active":"2024-09-12T17:27:32.574128+0000","last_became_peered":"2024-09-12T17:27:32.574128+0000","last_unstale":"2024-09-12T18:36:46.104074+0000","last_undegraded":"2024-09-12T18:36:46.104074+0000","last_fullsized":"2024-09-12T18:36:46.104074+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-09-12T18:36:46.103894+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-09-12T18:36:46.103894+0000","last_clean_scrub_stamp":"2024-09-12T18:36:46.103894+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:56.981018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":129,"num_write":75,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:05.974902+0000","last_change":"2024-09-12T18:37:05.974902+0000","last_active":"2024-09-12T18:37:05.974902+0000","last_peered":"2024-09-12T18:37:05.974902+0000","last_clean":"2024-09-12T18:37:05.974902+0000","last_became_active":"2024-09-12T17:53:27.169499+0000","last_became_peered":"2024-09-12T17:53:27.169499+0000","last_unstale":"2024-09-12T18:37:05.974902+0000","last_undegraded":"2024-09-12T18:37:05.974902+0000","last_fullsized":"2024-09-12T18:37:05.974902+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:05.974669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:05.974669+0000","last_clean_scrub_stamp":"2024-09-12T18:37:05.974669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:45.795396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"268'4","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.750543+0000","last_change":"2024-09-12T18:36:43.750543+0000","last_active":"2024-09-12T18:36:43.750543+0000","last_peered":"2024-09-12T18:36:43.750543+0000","last_clean":"2024-09-12T18:36:43.750543+0000","last_became_active":"2024-09-12T17:31:16.232949+0000","last_became_peered":"2024-09-12T17:31:16.232949+0000","last_unstale":"2024-09-12T18:36:43.750543+0000","last_undegraded":"2024-09-12T18:36:43.750543+0000","last_fullsized":"2024-09-12T18:36:43.750543+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:43.750294+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:43.750294+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.750294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:47.834399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'4","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:53.857461+0000","last_change":"2024-09-12T18:36:53.857461+0000","last_active":"2024-09-12T18:36:53.857461+0000","last_peered":"2024-09-12T18:36:53.857461+0000","last_clean":"2024-09-12T18:36:53.857461+0000","last_became_active":"2024-09-12T17:31:12.086300+0000","last_became_peered":"2024-09-12T17:31:12.086300+0000","last_unstale":"2024-09-12T18:36:53.857461+0000","last_undegraded":"2024-09-12T18:36:53.857461+0000","last_fullsized":"2024-09-12T18:36:53.857461+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:53.857259+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:53.857259+0000","last_clean_scrub_stamp":"2024-09-12T18:36:53.857259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:03.233529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'15","reported_seq":117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:46.770365+0000","last_change":"2024-09-12T18:36:46.770365+0000","last_active":"2024-09-12T18:36:46.770365+0000","last_peered":"2024-09-12T18:36:46.770365+0000","last_clean":"2024-09-12T18:36:46.770365+0000","last_became_active":"2024-09-12T17:27:32.591878+0000","last_became_peered":"2024-09-12T17:27:32.591878+0000","last_unstale":"2024-09-12T18:36:46.770365+0000","last_undegraded":"2024-09-12T18:36:46.770365+0000","last_fullsized":"2024-09-12T18:36:46.770365+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'15","last_scrub_stamp":"2024-09-12T18:36:46.770097+0000","last_deep_scrub":"265'15","last_deep_scrub_stamp":"2024-09-12T18:36:46.770097+0000","last_clean_scrub_stamp":"2024-09-12T18:36:46.770097+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:18.413498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":60,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"268'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:03.924376+0000","last_change":"2024-09-12T18:37:03.924376+0000","last_active":"2024-09-12T18:37:03.924376+0000","last_peered":"2024-09-12T18:37:03.924376+0000","last_clean":"2024-09-12T18:37:03.924376+0000","last_became_active":"2024-09-12T17:53:27.157992+0000","last_became_peered":"2024-09-12T17:53:27.157992+0000","last_unstale":"2024-09-12T18:37:03.924376+0000","last_undegraded":"2024-09-12T18:37:03.924376+0000","last_fullsized":"2024-09-12T18:37:03.924376+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:37:03.924149+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:37:03.924149+0000","last_clean_scrub_stamp":"2024-09-12T18:37:03.924149+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:36.785761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'2","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:58.906550+0000","last_change":"2024-09-12T18:36:58.906550+0000","last_active":"2024-09-12T18:36:58.906550+0000","last_peered":"2024-09-12T18:36:58.906550+0000","last_clean":"2024-09-12T18:36:58.906550+0000","last_became_active":"2024-09-12T17:31:16.227946+0000","last_became_peered":"2024-09-12T17:31:16.227946+0000","last_unstale":"2024-09-12T18:36:58.906550+0000","last_undegraded":"2024-09-12T18:36:58.906550+0000","last_fullsized":"2024-09-12T18:36:58.906550+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:58.906357+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:58.906357+0000","last_clean_scrub_stamp":"2024-09-12T18:36:58.906357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:03.672657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'5","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.184041+0000","last_change":"2024-09-12T18:36:36.184041+0000","last_active":"2024-09-12T18:36:36.184041+0000","last_peered":"2024-09-12T18:36:36.184041+0000","last_clean":"2024-09-12T18:36:36.184041+0000","last_became_active":"2024-09-12T17:31:12.105448+0000","last_became_peered":"2024-09-12T17:31:12.105448+0000","last_unstale":"2024-09-12T18:36:36.184041+0000","last_undegraded":"2024-09-12T18:36:36.184041+0000","last_fullsized":"2024-09-12T18:36:36.184041+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T18:36:36.183859+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T18:36:36.183859+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.183859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:40.721194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'22","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.756826+0000","last_change":"2024-09-12T18:36:42.756826+0000","last_active":"2024-09-12T18:36:42.756826+0000","last_peered":"2024-09-12T18:36:42.756826+0000","last_clean":"2024-09-12T18:36:42.756826+0000","last_became_active":"2024-09-12T17:27:32.567500+0000","last_became_peered":"2024-09-12T17:27:32.567500+0000","last_unstale":"2024-09-12T18:36:42.756826+0000","last_undegraded":"2024-09-12T18:36:42.756826+0000","last_fullsized":"2024-09-12T18:36:42.756826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'22","last_scrub_stamp":"2024-09-12T18:36:42.756642+0000","last_deep_scrub":"268'22","last_deep_scrub_stamp":"2024-09-12T18:36:42.756642+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.756642+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:22.566917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:08.920636+0000","last_change":"2024-09-12T18:37:08.920636+0000","last_active":"2024-09-12T18:37:08.920636+0000","last_peered":"2024-09-12T18:37:08.920636+0000","last_clean":"2024-09-12T18:37:08.920636+0000","last_became_active":"2024-09-12T17:53:27.164083+0000","last_became_peered":"2024-09-12T17:53:27.164083+0000","last_unstale":"2024-09-12T18:37:08.920636+0000","last_undegraded":"2024-09-12T18:37:08.920636+0000","last_fullsized":"2024-09-12T18:37:08.920636+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:37:08.920452+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:37:08.920452+0000","last_clean_scrub_stamp":"2024-09-12T18:37:08.920452+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:36.924398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"268'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.157495+0000","last_change":"2024-09-12T18:36:40.157495+0000","last_active":"2024-09-12T18:36:40.157495+0000","last_peered":"2024-09-12T18:36:40.157495+0000","last_clean":"2024-09-12T18:36:40.157495+0000","last_became_active":"2024-09-12T17:31:16.238356+0000","last_became_peered":"2024-09-12T17:31:16.238356+0000","last_unstale":"2024-09-12T18:36:40.157495+0000","last_undegraded":"2024-09-12T18:36:40.157495+0000","last_fullsized":"2024-09-12T18:36:40.157495+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:40.157306+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:40.157306+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.157306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:06.571107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'5","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:47.812978+0000","last_change":"2024-09-12T18:36:47.812978+0000","last_active":"2024-09-12T18:36:47.812978+0000","last_peered":"2024-09-12T18:36:47.812978+0000","last_clean":"2024-09-12T18:36:47.812978+0000","last_became_active":"2024-09-12T17:31:12.105300+0000","last_became_peered":"2024-09-12T17:31:12.105300+0000","last_unstale":"2024-09-12T18:36:47.812978+0000","last_undegraded":"2024-09-12T18:36:47.812978+0000","last_fullsized":"2024-09-12T18:36:47.812978+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T18:36:47.812785+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T18:36:47.812785+0000","last_clean_scrub_stamp":"2024-09-12T18:36:47.812785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:22.868595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'42","reported_seq":184,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:52.857547+0000","last_change":"2024-09-12T18:36:52.857547+0000","last_active":"2024-09-12T18:36:52.857547+0000","last_peered":"2024-09-12T18:36:52.857547+0000","last_clean":"2024-09-12T18:36:52.857547+0000","last_became_active":"2024-09-12T17:27:32.597518+0000","last_became_peered":"2024-09-12T17:27:32.597518+0000","last_unstale":"2024-09-12T18:36:52.857547+0000","last_undegraded":"2024-09-12T18:36:52.857547+0000","last_fullsized":"2024-09-12T18:36:52.857547+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'42","last_scrub_stamp":"2024-09-12T18:36:52.857310+0000","last_deep_scrub":"268'42","last_deep_scrub_stamp":"2024-09-12T18:36:52.857310+0000","last_clean_scrub_stamp":"2024-09-12T18:36:52.857310+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:28.971317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":146,"num_write":82,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.464065+0000","last_change":"2024-09-12T18:36:34.463783+0000","last_active":"2024-09-12T18:36:34.464065+0000","last_peered":"2024-09-12T18:36:34.464065+0000","last_clean":"2024-09-12T18:36:34.464065+0000","last_became_active":"2024-09-12T17:53:27.139633+0000","last_became_peered":"2024-09-12T17:53:27.139633+0000","last_unstale":"2024-09-12T18:36:34.464065+0000","last_undegraded":"2024-09-12T18:36:34.464065+0000","last_fullsized":"2024-09-12T18:36:34.464065+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:34.463510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:34.463510+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.463510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:11.843726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"265'4","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:56.879434+0000","last_change":"2024-09-12T18:36:56.879434+0000","last_active":"2024-09-12T18:36:56.879434+0000","last_peered":"2024-09-12T18:36:56.879434+0000","last_clean":"2024-09-12T18:36:56.879434+0000","last_became_active":"2024-09-12T17:31:16.229063+0000","last_became_peered":"2024-09-12T17:31:16.229063+0000","last_unstale":"2024-09-12T18:36:56.879434+0000","last_undegraded":"2024-09-12T18:36:56.879434+0000","last_fullsized":"2024-09-12T18:36:56.879434+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:36:56.879244+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:36:56.879244+0000","last_clean_scrub_stamp":"2024-09-12T18:36:56.879244+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:16.783337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:52.109432+0000","last_change":"2024-09-12T18:36:52.109432+0000","last_active":"2024-09-12T18:36:52.109432+0000","last_peered":"2024-09-12T18:36:52.109432+0000","last_clean":"2024-09-12T18:36:52.109432+0000","last_became_active":"2024-09-12T17:31:12.093496+0000","last_became_peered":"2024-09-12T17:31:12.093496+0000","last_unstale":"2024-09-12T18:36:52.109432+0000","last_undegraded":"2024-09-12T18:36:52.109432+0000","last_fullsized":"2024-09-12T18:36:52.109432+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:36:52.109239+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:36:52.109239+0000","last_clean_scrub_stamp":"2024-09-12T18:36:52.109239+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:01.666822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":4,"num_write_kb":1047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'15","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:48.898305+0000","last_change":"2024-09-12T18:36:48.898305+0000","last_active":"2024-09-12T18:36:48.898305+0000","last_peered":"2024-09-12T18:36:48.898305+0000","last_clean":"2024-09-12T18:36:48.898305+0000","last_became_active":"2024-09-12T17:27:32.597694+0000","last_became_peered":"2024-09-12T17:27:32.597694+0000","last_unstale":"2024-09-12T18:36:48.898305+0000","last_undegraded":"2024-09-12T18:36:48.898305+0000","last_fullsized":"2024-09-12T18:36:48.898305+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'15","last_scrub_stamp":"2024-09-12T18:36:48.898124+0000","last_deep_scrub":"268'15","last_deep_scrub_stamp":"2024-09-12T18:36:48.898124+0000","last_clean_scrub_stamp":"2024-09-12T18:36:48.898124+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:32.304263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":27,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:00.103967+0000","last_change":"2024-09-12T18:37:00.103967+0000","last_active":"2024-09-12T18:37:00.103967+0000","last_peered":"2024-09-12T18:37:00.103967+0000","last_clean":"2024-09-12T18:37:00.103967+0000","last_became_active":"2024-09-12T17:53:27.161396+0000","last_became_peered":"2024-09-12T17:53:27.161396+0000","last_unstale":"2024-09-12T18:37:00.103967+0000","last_undegraded":"2024-09-12T18:37:00.103967+0000","last_fullsized":"2024-09-12T18:37:00.103967+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:00.103760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:00.103760+0000","last_clean_scrub_stamp":"2024-09-12T18:37:00.103760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:42.215769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'3","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:57.881358+0000","last_change":"2024-09-12T18:36:57.881358+0000","last_active":"2024-09-12T18:36:57.881358+0000","last_peered":"2024-09-12T18:36:57.881358+0000","last_clean":"2024-09-12T18:36:57.881358+0000","last_became_active":"2024-09-12T17:31:16.238011+0000","last_became_peered":"2024-09-12T17:31:16.238011+0000","last_unstale":"2024-09-12T18:36:57.881358+0000","last_undegraded":"2024-09-12T18:36:57.881358+0000","last_fullsized":"2024-09-12T18:36:57.881358+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T18:36:57.881134+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T18:36:57.881134+0000","last_clean_scrub_stamp":"2024-09-12T18:36:57.881134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:31.802657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"268'7","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.458059+0000","last_change":"2024-09-12T18:36:32.458059+0000","last_active":"2024-09-12T18:36:32.458059+0000","last_peered":"2024-09-12T18:36:32.458059+0000","last_clean":"2024-09-12T18:36:32.458059+0000","last_became_active":"2024-09-12T17:31:12.093705+0000","last_became_peered":"2024-09-12T17:31:12.093705+0000","last_unstale":"2024-09-12T18:36:32.458059+0000","last_undegraded":"2024-09-12T18:36:32.458059+0000","last_fullsized":"2024-09-12T18:36:32.458059+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T18:36:32.457867+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T18:36:32.457867+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.457867+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:50.495148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'6","reported_seq":89,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:46.773521+0000","last_change":"2024-09-12T18:36:46.773356+0000","last_active":"2024-09-12T18:36:46.773521+0000","last_peered":"2024-09-12T18:36:46.773521+0000","last_clean":"2024-09-12T18:36:46.773521+0000","last_became_active":"2024-09-12T17:27:32.579749+0000","last_became_peered":"2024-09-12T17:27:32.579749+0000","last_unstale":"2024-09-12T18:36:46.773521+0000","last_undegraded":"2024-09-12T18:36:46.773521+0000","last_fullsized":"2024-09-12T18:36:46.773521+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T18:36:46.773161+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T18:36:46.773161+0000","last_clean_scrub_stamp":"2024-09-12T18:36:46.773161+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:13.565871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.191586+0000","last_change":"2024-09-12T18:36:41.191421+0000","last_active":"2024-09-12T18:36:41.191586+0000","last_peered":"2024-09-12T18:36:41.191586+0000","last_clean":"2024-09-12T18:36:41.191586+0000","last_became_active":"2024-09-12T17:53:27.142745+0000","last_became_peered":"2024-09-12T17:53:27.142745+0000","last_unstale":"2024-09-12T18:36:41.191586+0000","last_undegraded":"2024-09-12T18:36:41.191586+0000","last_fullsized":"2024-09-12T18:36:41.191586+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:41.191230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:41.191230+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.191230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:57.178772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:48.769753+0000","last_change":"2024-09-12T18:36:48.769753+0000","last_active":"2024-09-12T18:36:48.769753+0000","last_peered":"2024-09-12T18:36:48.769753+0000","last_clean":"2024-09-12T18:36:48.769753+0000","last_became_active":"2024-09-12T17:31:16.242306+0000","last_became_peered":"2024-09-12T17:31:16.242306+0000","last_unstale":"2024-09-12T18:36:48.769753+0000","last_undegraded":"2024-09-12T18:36:48.769753+0000","last_fullsized":"2024-09-12T18:36:48.769753+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:48.769558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:48.769558+0000","last_clean_scrub_stamp":"2024-09-12T18:36:48.769558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:25.552952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'6","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:56.875048+0000","last_change":"2024-09-12T18:36:56.875048+0000","last_active":"2024-09-12T18:36:56.875048+0000","last_peered":"2024-09-12T18:36:56.875048+0000","last_clean":"2024-09-12T18:36:56.875048+0000","last_became_active":"2024-09-12T17:31:12.077726+0000","last_became_peered":"2024-09-12T17:31:12.077726+0000","last_unstale":"2024-09-12T18:36:56.875048+0000","last_undegraded":"2024-09-12T18:36:56.875048+0000","last_fullsized":"2024-09-12T18:36:56.875048+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T18:36:56.874860+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T18:36:56.874860+0000","last_clean_scrub_stamp":"2024-09-12T18:36:56.874860+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:52.201139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'8","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.178503+0000","last_change":"2024-09-12T18:36:34.178365+0000","last_active":"2024-09-12T18:36:34.178503+0000","last_peered":"2024-09-12T18:36:34.178503+0000","last_clean":"2024-09-12T18:36:34.178503+0000","last_became_active":"2024-09-12T17:27:32.583062+0000","last_became_peered":"2024-09-12T17:27:32.583062+0000","last_unstale":"2024-09-12T18:36:34.178503+0000","last_undegraded":"2024-09-12T18:36:34.178503+0000","last_fullsized":"2024-09-12T18:36:34.178503+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T18:36:34.178159+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T18:36:34.178159+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.178159+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:13.223172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:59.091068+0000","last_change":"2024-09-12T18:36:59.091068+0000","last_active":"2024-09-12T18:36:59.091068+0000","last_peered":"2024-09-12T18:36:59.091068+0000","last_clean":"2024-09-12T18:36:59.091068+0000","last_became_active":"2024-09-12T17:53:27.163419+0000","last_became_peered":"2024-09-12T17:53:27.163419+0000","last_unstale":"2024-09-12T18:36:59.091068+0000","last_undegraded":"2024-09-12T18:36:59.091068+0000","last_fullsized":"2024-09-12T18:36:59.091068+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:59.090886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:59.090886+0000","last_clean_scrub_stamp":"2024-09-12T18:36:59.090886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:39.221191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:00.845324+0000","last_change":"2024-09-12T18:37:00.845324+0000","last_active":"2024-09-12T18:37:00.845324+0000","last_peered":"2024-09-12T18:37:00.845324+0000","last_clean":"2024-09-12T18:37:00.845324+0000","last_became_active":"2024-09-12T17:31:16.236619+0000","last_became_peered":"2024-09-12T17:31:16.236619+0000","last_unstale":"2024-09-12T18:37:00.845324+0000","last_undegraded":"2024-09-12T18:37:00.845324+0000","last_fullsized":"2024-09-12T18:37:00.845324+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:00.845111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:00.845111+0000","last_clean_scrub_stamp":"2024-09-12T18:37:00.845111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:55.826678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"268'7","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:45.711196+0000","last_change":"2024-09-12T18:36:45.711196+0000","last_active":"2024-09-12T18:36:45.711196+0000","last_peered":"2024-09-12T18:36:45.711196+0000","last_clean":"2024-09-12T18:36:45.711196+0000","last_became_active":"2024-09-12T17:31:12.105793+0000","last_became_peered":"2024-09-12T17:31:12.105793+0000","last_unstale":"2024-09-12T18:36:45.711196+0000","last_undegraded":"2024-09-12T18:36:45.711196+0000","last_fullsized":"2024-09-12T18:36:45.711196+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T18:36:45.710950+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T18:36:45.710950+0000","last_clean_scrub_stamp":"2024-09-12T18:36:45.710950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:57.494629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'53","reported_seq":215,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.482750+0000","last_change":"2024-09-12T18:36:29.482580+0000","last_active":"2024-09-12T18:36:29.482750+0000","last_peered":"2024-09-12T18:36:29.482750+0000","last_clean":"2024-09-12T18:36:29.482750+0000","last_became_active":"2024-09-12T17:27:32.569594+0000","last_became_peered":"2024-09-12T17:27:32.569594+0000","last_unstale":"2024-09-12T18:36:29.482750+0000","last_undegraded":"2024-09-12T18:36:29.482750+0000","last_fullsized":"2024-09-12T18:36:29.482750+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'53","last_scrub_stamp":"2024-09-12T18:36:29.482390+0000","last_deep_scrub":"268'53","last_deep_scrub_stamp":"2024-09-12T18:36:29.482390+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.482390+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:05.105632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":187,"num_write":95,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:05.872089+0000","last_change":"2024-09-12T18:37:05.872089+0000","last_active":"2024-09-12T18:37:05.872089+0000","last_peered":"2024-09-12T18:37:05.872089+0000","last_clean":"2024-09-12T18:37:05.872089+0000","last_became_active":"2024-09-12T17:53:27.165129+0000","last_became_peered":"2024-09-12T17:53:27.165129+0000","last_unstale":"2024-09-12T18:37:05.872089+0000","last_undegraded":"2024-09-12T18:37:05.872089+0000","last_fullsized":"2024-09-12T18:37:05.872089+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:05.871885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:05.871885+0000","last_clean_scrub_stamp":"2024-09-12T18:37:05.871885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:54.806629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"268'2","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:50.676310+0000","last_change":"2024-09-12T18:36:50.676310+0000","last_active":"2024-09-12T18:36:50.676310+0000","last_peered":"2024-09-12T18:36:50.676310+0000","last_clean":"2024-09-12T18:36:50.676310+0000","last_became_active":"2024-09-12T17:31:16.240152+0000","last_became_peered":"2024-09-12T17:31:16.240152+0000","last_unstale":"2024-09-12T18:36:50.676310+0000","last_undegraded":"2024-09-12T18:36:50.676310+0000","last_fullsized":"2024-09-12T18:36:50.676310+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:50.676083+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:50.676083+0000","last_clean_scrub_stamp":"2024-09-12T18:36:50.676083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:45.187304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'5","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:51.902235+0000","last_change":"2024-09-12T18:36:51.902235+0000","last_active":"2024-09-12T18:36:51.902235+0000","last_peered":"2024-09-12T18:36:51.902235+0000","last_clean":"2024-09-12T18:36:51.902235+0000","last_became_active":"2024-09-12T17:31:12.089200+0000","last_became_peered":"2024-09-12T17:31:12.089200+0000","last_unstale":"2024-09-12T18:36:51.902235+0000","last_undegraded":"2024-09-12T18:36:51.902235+0000","last_fullsized":"2024-09-12T18:36:51.902235+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T18:36:51.902050+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T18:36:51.902050+0000","last_clean_scrub_stamp":"2024-09-12T18:36:51.902050+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:08.418200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8242,"num_write":10,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'48","reported_seq":202,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:45.746048+0000","last_change":"2024-09-12T18:36:45.745885+0000","last_active":"2024-09-12T18:36:45.746048+0000","last_peered":"2024-09-12T18:36:45.746048+0000","last_clean":"2024-09-12T18:36:45.746048+0000","last_became_active":"2024-09-12T17:27:32.568661+0000","last_became_peered":"2024-09-12T17:27:32.568661+0000","last_unstale":"2024-09-12T18:36:45.746048+0000","last_undegraded":"2024-09-12T18:36:45.746048+0000","last_fullsized":"2024-09-12T18:36:45.746048+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'48","last_scrub_stamp":"2024-09-12T18:36:45.745710+0000","last_deep_scrub":"268'48","last_deep_scrub_stamp":"2024-09-12T18:36:45.745710+0000","last_clean_scrub_stamp":"2024-09-12T18:36:45.745710+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:00.242423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":169,"num_write":85,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:02.170629+0000","last_change":"2024-09-12T18:37:02.170629+0000","last_active":"2024-09-12T18:37:02.170629+0000","last_peered":"2024-09-12T18:37:02.170629+0000","last_clean":"2024-09-12T18:37:02.170629+0000","last_became_active":"2024-09-12T17:53:27.170493+0000","last_became_peered":"2024-09-12T17:53:27.170493+0000","last_unstale":"2024-09-12T18:37:02.170629+0000","last_undegraded":"2024-09-12T18:37:02.170629+0000","last_fullsized":"2024-09-12T18:37:02.170629+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:02.170442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:02.170442+0000","last_clean_scrub_stamp":"2024-09-12T18:37:02.170442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:57.047302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'7","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:55.140302+0000","last_change":"2024-09-12T18:36:55.140302+0000","last_active":"2024-09-12T18:36:55.140302+0000","last_peered":"2024-09-12T18:36:55.140302+0000","last_clean":"2024-09-12T18:36:55.140302+0000","last_became_active":"2024-09-12T17:31:16.228566+0000","last_became_peered":"2024-09-12T17:31:16.228566+0000","last_unstale":"2024-09-12T18:36:55.140302+0000","last_undegraded":"2024-09-12T18:36:55.140302+0000","last_fullsized":"2024-09-12T18:36:55.140302+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T18:36:55.140130+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T18:36:55.140130+0000","last_clean_scrub_stamp":"2024-09-12T18:36:55.140130+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:56.174852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5238,"num_write":12,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'4","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.704030+0000","last_change":"2024-09-12T18:36:44.704030+0000","last_active":"2024-09-12T18:36:44.704030+0000","last_peered":"2024-09-12T18:36:44.704030+0000","last_clean":"2024-09-12T18:36:44.704030+0000","last_became_active":"2024-09-12T17:31:12.105384+0000","last_became_peered":"2024-09-12T17:31:12.105384+0000","last_unstale":"2024-09-12T18:36:44.704030+0000","last_undegraded":"2024-09-12T18:36:44.704030+0000","last_fullsized":"2024-09-12T18:36:44.704030+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:44.703841+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:44.703841+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.703841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:23.099047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'111","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:45.057845+0000","last_change":"2024-09-12T18:36:45.057682+0000","last_active":"2024-09-12T18:36:45.057845+0000","last_peered":"2024-09-12T18:36:45.057845+0000","last_clean":"2024-09-12T18:36:45.057845+0000","last_became_active":"2024-09-12T17:27:32.586640+0000","last_became_peered":"2024-09-12T17:27:32.586640+0000","last_unstale":"2024-09-12T18:36:45.057845+0000","last_undegraded":"2024-09-12T18:36:45.057845+0000","last_fullsized":"2024-09-12T18:36:45.057845+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'111","last_scrub_stamp":"2024-09-12T18:36:45.057448+0000","last_deep_scrub":"268'111","last_deep_scrub_stamp":"2024-09-12T18:36:45.057448+0000","last_clean_scrub_stamp":"2024-09-12T18:36:45.057448+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:10.836559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":815,"num_read_kb":525,"num_write":139,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3486,"num_omap_keys":7,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'2","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:01.152651+0000","last_change":"2024-09-12T18:37:01.152651+0000","last_active":"2024-09-12T18:37:01.152651+0000","last_peered":"2024-09-12T18:37:01.152651+0000","last_clean":"2024-09-12T18:37:01.152651+0000","last_became_active":"2024-09-12T17:53:27.170381+0000","last_became_peered":"2024-09-12T17:53:27.170381+0000","last_unstale":"2024-09-12T18:37:01.152651+0000","last_undegraded":"2024-09-12T18:37:01.152651+0000","last_fullsized":"2024-09-12T18:37:01.152651+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:37:01.152463+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:37:01.152463+0000","last_clean_scrub_stamp":"2024-09-12T18:37:01.152463+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:46.938665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'7","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.793387+0000","last_change":"2024-09-12T18:36:36.793387+0000","last_active":"2024-09-12T18:36:36.793387+0000","last_peered":"2024-09-12T18:36:36.793387+0000","last_clean":"2024-09-12T18:36:36.793387+0000","last_became_active":"2024-09-12T17:31:16.245228+0000","last_became_peered":"2024-09-12T17:31:16.245228+0000","last_unstale":"2024-09-12T18:36:36.793387+0000","last_undegraded":"2024-09-12T18:36:36.793387+0000","last_fullsized":"2024-09-12T18:36:36.793387+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T18:36:36.793179+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T18:36:36.793179+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.793179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:54.579651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":48,"num_write":12,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'2","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:52.951184+0000","last_change":"2024-09-12T18:36:52.951184+0000","last_active":"2024-09-12T18:36:52.951184+0000","last_peered":"2024-09-12T18:36:52.951184+0000","last_clean":"2024-09-12T18:36:52.951184+0000","last_became_active":"2024-09-12T17:31:12.089735+0000","last_became_peered":"2024-09-12T17:31:12.089735+0000","last_unstale":"2024-09-12T18:36:52.951184+0000","last_undegraded":"2024-09-12T18:36:52.951184+0000","last_fullsized":"2024-09-12T18:36:52.951184+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:52.950978+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:52.950978+0000","last_clean_scrub_stamp":"2024-09-12T18:36:52.950978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:30.996137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'45","reported_seq":197,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:49.858448+0000","last_change":"2024-09-12T18:36:49.858269+0000","last_active":"2024-09-12T18:36:49.858448+0000","last_peered":"2024-09-12T18:36:49.858448+0000","last_clean":"2024-09-12T18:36:49.858448+0000","last_became_active":"2024-09-12T17:27:32.575300+0000","last_became_peered":"2024-09-12T17:27:32.575300+0000","last_unstale":"2024-09-12T18:36:49.858448+0000","last_undegraded":"2024-09-12T18:36:49.858448+0000","last_fullsized":"2024-09-12T18:36:49.858448+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'45","last_scrub_stamp":"2024-09-12T18:36:49.858092+0000","last_deep_scrub":"268'45","last_deep_scrub_stamp":"2024-09-12T18:36:49.858092+0000","last_clean_scrub_stamp":"2024-09-12T18:36:49.858092+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:48.927678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":157,"num_write":84,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:02.944628+0000","last_change":"2024-09-12T18:37:02.944628+0000","last_active":"2024-09-12T18:37:02.944628+0000","last_peered":"2024-09-12T18:37:02.944628+0000","last_clean":"2024-09-12T18:37:02.944628+0000","last_became_active":"2024-09-12T17:53:27.173955+0000","last_became_peered":"2024-09-12T17:53:27.173955+0000","last_unstale":"2024-09-12T18:37:02.944628+0000","last_undegraded":"2024-09-12T18:37:02.944628+0000","last_fullsized":"2024-09-12T18:37:02.944628+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:02.944441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:02.944441+0000","last_clean_scrub_stamp":"2024-09-12T18:37:02.944441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:29.016664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:56.140478+0000","last_change":"2024-09-12T18:36:56.140478+0000","last_active":"2024-09-12T18:36:56.140478+0000","last_peered":"2024-09-12T18:36:56.140478+0000","last_clean":"2024-09-12T18:36:56.140478+0000","last_became_active":"2024-09-12T17:31:16.231516+0000","last_became_peered":"2024-09-12T17:31:16.231516+0000","last_unstale":"2024-09-12T18:36:56.140478+0000","last_undegraded":"2024-09-12T18:36:56.140478+0000","last_fullsized":"2024-09-12T18:36:56.140478+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:36:56.140291+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:36:56.140291+0000","last_clean_scrub_stamp":"2024-09-12T18:36:56.140291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:57.236044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.786963+0000","last_change":"2024-09-12T18:36:43.786963+0000","last_active":"2024-09-12T18:36:43.786963+0000","last_peered":"2024-09-12T18:36:43.786963+0000","last_clean":"2024-09-12T18:36:43.786963+0000","last_became_active":"2024-09-12T17:31:12.084158+0000","last_became_peered":"2024-09-12T17:31:12.084158+0000","last_unstale":"2024-09-12T18:36:43.786963+0000","last_undegraded":"2024-09-12T18:36:43.786963+0000","last_fullsized":"2024-09-12T18:36:43.786963+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:43.786777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:43.786777+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.786777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:32.037462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'55","reported_seq":220,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.142986+0000","last_change":"2024-09-12T18:36:33.142834+0000","last_active":"2024-09-12T18:36:33.142986+0000","last_peered":"2024-09-12T18:36:33.142986+0000","last_clean":"2024-09-12T18:36:33.142986+0000","last_became_active":"2024-09-12T17:27:32.569924+0000","last_became_peered":"2024-09-12T17:27:32.569924+0000","last_unstale":"2024-09-12T18:36:33.142986+0000","last_undegraded":"2024-09-12T18:36:33.142986+0000","last_fullsized":"2024-09-12T18:36:33.142986+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'55","last_scrub_stamp":"2024-09-12T18:36:33.142657+0000","last_deep_scrub":"268'55","last_deep_scrub_stamp":"2024-09-12T18:36:33.142657+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.142657+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:06.255940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":184,"num_write":101,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:57.142113+0000","last_change":"2024-09-12T18:36:57.141981+0000","last_active":"2024-09-12T18:36:57.142113+0000","last_peered":"2024-09-12T18:36:57.142113+0000","last_clean":"2024-09-12T18:36:57.142113+0000","last_became_active":"2024-09-12T17:53:27.162527+0000","last_became_peered":"2024-09-12T17:53:27.162527+0000","last_unstale":"2024-09-12T18:36:57.142113+0000","last_undegraded":"2024-09-12T18:36:57.142113+0000","last_fullsized":"2024-09-12T18:36:57.142113+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:57.141797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:57.141797+0000","last_clean_scrub_stamp":"2024-09-12T18:36:57.141797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:58.781741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:58.960949+0000","last_change":"2024-09-12T18:36:58.960949+0000","last_active":"2024-09-12T18:36:58.960949+0000","last_peered":"2024-09-12T18:36:58.960949+0000","last_clean":"2024-09-12T18:36:58.960949+0000","last_became_active":"2024-09-12T17:31:16.244556+0000","last_became_peered":"2024-09-12T17:31:16.244556+0000","last_unstale":"2024-09-12T18:36:58.960949+0000","last_undegraded":"2024-09-12T18:36:58.960949+0000","last_fullsized":"2024-09-12T18:36:58.960949+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:36:58.960757+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:36:58.960757+0000","last_clean_scrub_stamp":"2024-09-12T18:36:58.960757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:34.152942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'7","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:51.137506+0000","last_change":"2024-09-12T18:36:51.137506+0000","last_active":"2024-09-12T18:36:51.137506+0000","last_peered":"2024-09-12T18:36:51.137506+0000","last_clean":"2024-09-12T18:36:51.137506+0000","last_became_active":"2024-09-12T17:31:12.081025+0000","last_became_peered":"2024-09-12T17:31:12.081025+0000","last_unstale":"2024-09-12T18:36:51.137506+0000","last_undegraded":"2024-09-12T18:36:51.137506+0000","last_fullsized":"2024-09-12T18:36:51.137506+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T18:36:51.137316+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T18:36:51.137316+0000","last_clean_scrub_stamp":"2024-09-12T18:36:51.137316+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:23.645838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":166,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:47.787700+0000","last_change":"2024-09-12T18:36:47.787543+0000","last_active":"2024-09-12T18:36:47.787700+0000","last_peered":"2024-09-12T18:36:47.787700+0000","last_clean":"2024-09-12T18:36:47.787700+0000","last_became_active":"2024-09-12T17:27:32.561993+0000","last_became_peered":"2024-09-12T17:27:32.561993+0000","last_unstale":"2024-09-12T18:36:47.787700+0000","last_undegraded":"2024-09-12T18:36:47.787700+0000","last_fullsized":"2024-09-12T18:36:47.787700+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'33","last_scrub_stamp":"2024-09-12T18:36:47.787356+0000","last_deep_scrub":"268'33","last_deep_scrub_stamp":"2024-09-12T18:36:47.787356+0000","last_clean_scrub_stamp":"2024-09-12T18:36:47.787356+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:28.183868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":121,"num_write":59,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:53.697056+0000","last_change":"2024-09-12T18:36:53.696842+0000","last_active":"2024-09-12T18:36:53.697056+0000","last_peered":"2024-09-12T18:36:53.697056+0000","last_clean":"2024-09-12T18:36:53.697056+0000","last_became_active":"2024-09-12T17:53:27.153125+0000","last_became_peered":"2024-09-12T17:53:27.153125+0000","last_unstale":"2024-09-12T18:36:53.697056+0000","last_undegraded":"2024-09-12T18:36:53.697056+0000","last_fullsized":"2024-09-12T18:36:53.697056+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:53.696544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:53.696544+0000","last_clean_scrub_stamp":"2024-09-12T18:36:53.696544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:43.920353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'6","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:57.920509+0000","last_change":"2024-09-12T18:36:57.920509+0000","last_active":"2024-09-12T18:36:57.920509+0000","last_peered":"2024-09-12T18:36:57.920509+0000","last_clean":"2024-09-12T18:36:57.920509+0000","last_became_active":"2024-09-12T17:31:16.212330+0000","last_became_peered":"2024-09-12T17:31:16.212330+0000","last_unstale":"2024-09-12T18:36:57.920509+0000","last_undegraded":"2024-09-12T18:36:57.920509+0000","last_fullsized":"2024-09-12T18:36:57.920509+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T18:36:57.920332+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T18:36:57.920332+0000","last_clean_scrub_stamp":"2024-09-12T18:36:57.920332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:12.372696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'2","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.476350+0000","last_change":"2024-09-12T18:36:31.476350+0000","last_active":"2024-09-12T18:36:31.476350+0000","last_peered":"2024-09-12T18:36:31.476350+0000","last_clean":"2024-09-12T18:36:31.476350+0000","last_became_active":"2024-09-12T17:31:12.093752+0000","last_became_peered":"2024-09-12T17:31:12.093752+0000","last_unstale":"2024-09-12T18:36:31.476350+0000","last_undegraded":"2024-09-12T18:36:31.476350+0000","last_fullsized":"2024-09-12T18:36:31.476350+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:36:31.476157+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:36:31.476157+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.476157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:03.620536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"0'0","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.120720+0000","last_change":"2024-09-12T18:36:32.120582+0000","last_active":"2024-09-12T18:36:32.120720+0000","last_peered":"2024-09-12T18:36:32.120720+0000","last_clean":"2024-09-12T18:36:32.120720+0000","last_became_active":"2024-09-12T17:27:32.583070+0000","last_became_peered":"2024-09-12T17:27:32.583070+0000","last_unstale":"2024-09-12T18:36:32.120720+0000","last_undegraded":"2024-09-12T18:36:32.120720+0000","last_fullsized":"2024-09-12T18:36:32.120720+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:32.120403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:32.120403+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.120403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:14.385650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:46.747351+0000","last_change":"2024-09-12T18:36:46.747351+0000","last_active":"2024-09-12T18:36:46.747351+0000","last_peered":"2024-09-12T18:36:46.747351+0000","last_clean":"2024-09-12T18:36:46.747351+0000","last_became_active":"2024-09-12T17:53:27.154309+0000","last_became_peered":"2024-09-12T17:53:27.154309+0000","last_unstale":"2024-09-12T18:36:46.747351+0000","last_undegraded":"2024-09-12T18:36:46.747351+0000","last_fullsized":"2024-09-12T18:36:46.747351+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:46.747166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:46.747166+0000","last_clean_scrub_stamp":"2024-09-12T18:36:46.747166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:56.656299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'8","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:54.125493+0000","last_change":"2024-09-12T18:36:54.125493+0000","last_active":"2024-09-12T18:36:54.125493+0000","last_peered":"2024-09-12T18:36:54.125493+0000","last_clean":"2024-09-12T18:36:54.125493+0000","last_became_active":"2024-09-12T17:31:16.230809+0000","last_became_peered":"2024-09-12T17:31:16.230809+0000","last_unstale":"2024-09-12T18:36:54.125493+0000","last_undegraded":"2024-09-12T18:36:54.125493+0000","last_fullsized":"2024-09-12T18:36:54.125493+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T18:36:54.125315+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T18:36:54.125315+0000","last_clean_scrub_stamp":"2024-09-12T18:36:54.125315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:59.718546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":16386,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"265'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:50.708310+0000","last_change":"2024-09-12T18:36:50.708310+0000","last_active":"2024-09-12T18:36:50.708310+0000","last_peered":"2024-09-12T18:36:50.708310+0000","last_clean":"2024-09-12T18:36:50.708310+0000","last_became_active":"2024-09-12T17:31:12.084101+0000","last_became_peered":"2024-09-12T17:31:12.084101+0000","last_unstale":"2024-09-12T18:36:50.708310+0000","last_undegraded":"2024-09-12T18:36:50.708310+0000","last_fullsized":"2024-09-12T18:36:50.708310+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T18:36:50.708093+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T18:36:50.708093+0000","last_clean_scrub_stamp":"2024-09-12T18:36:50.708093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:42.776584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'37","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.035502+0000","last_change":"2024-09-12T18:36:44.035502+0000","last_active":"2024-09-12T18:36:44.035502+0000","last_peered":"2024-09-12T18:36:44.035502+0000","last_clean":"2024-09-12T18:36:44.035502+0000","last_became_active":"2024-09-12T17:27:32.582183+0000","last_became_peered":"2024-09-12T17:27:32.582183+0000","last_unstale":"2024-09-12T18:36:44.035502+0000","last_undegraded":"2024-09-12T18:36:44.035502+0000","last_fullsized":"2024-09-12T18:36:44.035502+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'37","last_scrub_stamp":"2024-09-12T18:36:44.035316+0000","last_deep_scrub":"268'37","last_deep_scrub_stamp":"2024-09-12T18:36:44.035316+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.035316+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:17.715772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":125,"num_write":74,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:53.696683+0000","last_change":"2024-09-12T18:36:53.696529+0000","last_active":"2024-09-12T18:36:53.696683+0000","last_peered":"2024-09-12T18:36:53.696683+0000","last_clean":"2024-09-12T18:36:53.696683+0000","last_became_active":"2024-09-12T17:53:27.159240+0000","last_became_peered":"2024-09-12T17:53:27.159240+0000","last_unstale":"2024-09-12T18:36:53.696683+0000","last_undegraded":"2024-09-12T18:36:53.696683+0000","last_fullsized":"2024-09-12T18:36:53.696683+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:53.696335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:53.696335+0000","last_clean_scrub_stamp":"2024-09-12T18:36:53.696335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:58.794343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'5","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:51.686069+0000","last_change":"2024-09-12T18:36:51.686069+0000","last_active":"2024-09-12T18:36:51.686069+0000","last_peered":"2024-09-12T18:36:51.686069+0000","last_clean":"2024-09-12T18:36:51.686069+0000","last_became_active":"2024-09-12T17:31:16.225754+0000","last_became_peered":"2024-09-12T17:31:16.225754+0000","last_unstale":"2024-09-12T18:36:51.686069+0000","last_undegraded":"2024-09-12T18:36:51.686069+0000","last_fullsized":"2024-09-12T18:36:51.686069+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T18:36:51.685871+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T18:36:51.685871+0000","last_clean_scrub_stamp":"2024-09-12T18:36:51.685871+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:30.555209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:50.117565+0000","last_change":"2024-09-12T18:36:50.117565+0000","last_active":"2024-09-12T18:36:50.117565+0000","last_peered":"2024-09-12T18:36:50.117565+0000","last_clean":"2024-09-12T18:36:50.117565+0000","last_became_active":"2024-09-12T17:31:12.087356+0000","last_became_peered":"2024-09-12T17:31:12.087356+0000","last_unstale":"2024-09-12T18:36:50.117565+0000","last_undegraded":"2024-09-12T18:36:50.117565+0000","last_fullsized":"2024-09-12T18:36:50.117565+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:50.117437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:50.117437+0000","last_clean_scrub_stamp":"2024-09-12T18:36:50.117437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:43.432279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'23","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.806178+0000","last_change":"2024-09-12T18:36:37.806178+0000","last_active":"2024-09-12T18:36:37.806178+0000","last_peered":"2024-09-12T18:36:37.806178+0000","last_clean":"2024-09-12T18:36:37.806178+0000","last_became_active":"2024-09-12T17:27:32.583631+0000","last_became_peered":"2024-09-12T17:27:32.583631+0000","last_unstale":"2024-09-12T18:36:37.806178+0000","last_undegraded":"2024-09-12T18:36:37.806178+0000","last_fullsized":"2024-09-12T18:36:37.806178+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'23","last_scrub_stamp":"2024-09-12T18:36:37.805995+0000","last_deep_scrub":"268'23","last_deep_scrub_stamp":"2024-09-12T18:36:37.805995+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.805995+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:50.592369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":83,"num_write":39,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'2","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.392020+0000","last_change":"2024-09-12T18:36:36.391863+0000","last_active":"2024-09-12T18:36:36.392020+0000","last_peered":"2024-09-12T18:36:36.392020+0000","last_clean":"2024-09-12T18:36:36.392020+0000","last_became_active":"2024-09-12T17:53:27.152651+0000","last_became_peered":"2024-09-12T17:53:27.152651+0000","last_unstale":"2024-09-12T18:36:36.392020+0000","last_undegraded":"2024-09-12T18:36:36.392020+0000","last_fullsized":"2024-09-12T18:36:36.392020+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:36.391681+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:36.391681+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.391681+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:30.517267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'9","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.761952+0000","last_change":"2024-09-12T18:36:38.761952+0000","last_active":"2024-09-12T18:36:38.761952+0000","last_peered":"2024-09-12T18:36:38.761952+0000","last_clean":"2024-09-12T18:36:38.761952+0000","last_became_active":"2024-09-12T17:31:16.242981+0000","last_became_peered":"2024-09-12T17:31:16.242981+0000","last_unstale":"2024-09-12T18:36:38.761952+0000","last_undegraded":"2024-09-12T18:36:38.761952+0000","last_fullsized":"2024-09-12T18:36:38.761952+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-09-12T18:36:38.761770+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-09-12T18:36:38.761770+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.761770+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:52.221501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15362,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:48.155757+0000","last_change":"2024-09-12T18:36:48.155757+0000","last_active":"2024-09-12T18:36:48.155757+0000","last_peered":"2024-09-12T18:36:48.155757+0000","last_clean":"2024-09-12T18:36:48.155757+0000","last_became_active":"2024-09-12T17:31:12.097216+0000","last_became_peered":"2024-09-12T17:31:12.097216+0000","last_unstale":"2024-09-12T18:36:48.155757+0000","last_undegraded":"2024-09-12T18:36:48.155757+0000","last_fullsized":"2024-09-12T18:36:48.155757+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:48.155546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:48.155546+0000","last_clean_scrub_stamp":"2024-09-12T18:36:48.155546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:20.194886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'30","reported_seq":152,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:45.811523+0000","last_change":"2024-09-12T18:36:45.811523+0000","last_active":"2024-09-12T18:36:45.811523+0000","last_peered":"2024-09-12T18:36:45.811523+0000","last_clean":"2024-09-12T18:36:45.811523+0000","last_became_active":"2024-09-12T17:27:32.571830+0000","last_became_peered":"2024-09-12T17:27:32.571830+0000","last_unstale":"2024-09-12T18:36:45.811523+0000","last_undegraded":"2024-09-12T18:36:45.811523+0000","last_fullsized":"2024-09-12T18:36:45.811523+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-12T18:36:45.811332+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-12T18:36:45.811332+0000","last_clean_scrub_stamp":"2024-09-12T18:36:45.811332+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:44.077797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":95,"num_write":63,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:04.967955+0000","last_change":"2024-09-12T18:37:04.967955+0000","last_active":"2024-09-12T18:37:04.967955+0000","last_peered":"2024-09-12T18:37:04.967955+0000","last_clean":"2024-09-12T18:37:04.967955+0000","last_became_active":"2024-09-12T17:53:27.163113+0000","last_became_peered":"2024-09-12T17:53:27.163113+0000","last_unstale":"2024-09-12T18:37:04.967955+0000","last_undegraded":"2024-09-12T18:37:04.967955+0000","last_fullsized":"2024-09-12T18:37:04.967955+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:04.967768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:04.967768+0000","last_clean_scrub_stamp":"2024-09-12T18:37:04.967768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:17.462590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:49.738930+0000","last_change":"2024-09-12T18:36:49.738930+0000","last_active":"2024-09-12T18:36:49.738930+0000","last_peered":"2024-09-12T18:36:49.738930+0000","last_clean":"2024-09-12T18:36:49.738930+0000","last_became_active":"2024-09-12T17:31:16.233558+0000","last_became_peered":"2024-09-12T17:31:16.233558+0000","last_unstale":"2024-09-12T18:36:49.738930+0000","last_undegraded":"2024-09-12T18:36:49.738930+0000","last_fullsized":"2024-09-12T18:36:49.738930+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T18:36:49.738738+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T18:36:49.738738+0000","last_clean_scrub_stamp":"2024-09-12T18:36:49.738738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:35.975423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'7","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:49.146946+0000","last_change":"2024-09-12T18:36:49.146946+0000","last_active":"2024-09-12T18:36:49.146946+0000","last_peered":"2024-09-12T18:36:49.146946+0000","last_clean":"2024-09-12T18:36:49.146946+0000","last_became_active":"2024-09-12T17:31:12.094159+0000","last_became_peered":"2024-09-12T17:31:12.094159+0000","last_unstale":"2024-09-12T18:36:49.146946+0000","last_undegraded":"2024-09-12T18:36:49.146946+0000","last_fullsized":"2024-09-12T18:36:49.146946+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T18:36:49.146757+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T18:36:49.146757+0000","last_clean_scrub_stamp":"2024-09-12T18:36:49.146757+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:17.866885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3074,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'20","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.750473+0000","last_change":"2024-09-12T18:36:44.750473+0000","last_active":"2024-09-12T18:36:44.750473+0000","last_peered":"2024-09-12T18:36:44.750473+0000","last_clean":"2024-09-12T18:36:44.750473+0000","last_became_active":"2024-09-12T17:27:32.595524+0000","last_became_peered":"2024-09-12T17:27:32.595524+0000","last_unstale":"2024-09-12T18:36:44.750473+0000","last_undegraded":"2024-09-12T18:36:44.750473+0000","last_fullsized":"2024-09-12T18:36:44.750473+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-12T18:36:44.750178+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-12T18:36:44.750178+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.750178+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:45.297099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":74,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:37:00.980269+0000","last_change":"2024-09-12T18:37:00.980139+0000","last_active":"2024-09-12T18:37:00.980269+0000","last_peered":"2024-09-12T18:37:00.980269+0000","last_clean":"2024-09-12T18:37:00.980269+0000","last_became_active":"2024-09-12T17:53:27.175125+0000","last_became_peered":"2024-09-12T17:53:27.175125+0000","last_unstale":"2024-09-12T18:37:00.980269+0000","last_undegraded":"2024-09-12T18:37:00.980269+0000","last_fullsized":"2024-09-12T18:37:00.980269+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:37:00.979945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:37:00.979945+0000","last_clean_scrub_stamp":"2024-09-12T18:37:00.979945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:40.813742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'4","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.124702+0000","last_change":"2024-09-12T18:36:39.124702+0000","last_active":"2024-09-12T18:36:39.124702+0000","last_peered":"2024-09-12T18:36:39.124702+0000","last_clean":"2024-09-12T18:36:39.124702+0000","last_became_active":"2024-09-12T17:31:16.211664+0000","last_became_peered":"2024-09-12T17:31:16.211664+0000","last_unstale":"2024-09-12T18:36:39.124702+0000","last_undegraded":"2024-09-12T18:36:39.124702+0000","last_fullsized":"2024-09-12T18:36:39.124702+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T18:36:39.124513+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T18:36:39.124513+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.124513+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:43.413810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1069,"num_write":4,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'4","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.842623+0000","last_change":"2024-09-12T18:36:35.842623+0000","last_active":"2024-09-12T18:36:35.842623+0000","last_peered":"2024-09-12T18:36:35.842623+0000","last_clean":"2024-09-12T18:36:35.842623+0000","last_became_active":"2024-09-12T17:31:12.099608+0000","last_became_peered":"2024-09-12T17:31:12.099608+0000","last_unstale":"2024-09-12T18:36:35.842623+0000","last_undegraded":"2024-09-12T18:36:35.842623+0000","last_fullsized":"2024-09-12T18:36:35.842623+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:35.842447+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:35.842447+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.842447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:21.122228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'56","reported_seq":227,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.126507+0000","last_change":"2024-09-12T18:36:31.126507+0000","last_active":"2024-09-12T18:36:31.126507+0000","last_peered":"2024-09-12T18:36:31.126507+0000","last_clean":"2024-09-12T18:36:31.126507+0000","last_became_active":"2024-09-12T17:27:32.568785+0000","last_became_peered":"2024-09-12T17:27:32.568785+0000","last_unstale":"2024-09-12T18:36:31.126507+0000","last_undegraded":"2024-09-12T18:36:31.126507+0000","last_fullsized":"2024-09-12T18:36:31.126507+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'56","last_scrub_stamp":"2024-09-12T18:36:31.126325+0000","last_deep_scrub":"268'56","last_deep_scrub_stamp":"2024-09-12T18:36:31.126325+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.126325+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:42.729615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":196,"num_write":113,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:58.113087+0000","last_change":"2024-09-12T18:36:58.112943+0000","last_active":"2024-09-12T18:36:58.113087+0000","last_peered":"2024-09-12T18:36:58.113087+0000","last_clean":"2024-09-12T18:36:58.113087+0000","last_became_active":"2024-09-12T17:53:27.175073+0000","last_became_peered":"2024-09-12T17:53:27.175073+0000","last_unstale":"2024-09-12T18:36:58.113087+0000","last_undegraded":"2024-09-12T18:36:58.113087+0000","last_fullsized":"2024-09-12T18:36:58.113087+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:58.112768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:58.112768+0000","last_clean_scrub_stamp":"2024-09-12T18:36:58.112768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:45.986059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:48.730577+0000","last_change":"2024-09-12T18:36:48.730577+0000","last_active":"2024-09-12T18:36:48.730577+0000","last_peered":"2024-09-12T18:36:48.730577+0000","last_clean":"2024-09-12T18:36:48.730577+0000","last_became_active":"2024-09-12T17:31:16.228416+0000","last_became_peered":"2024-09-12T17:31:16.228416+0000","last_unstale":"2024-09-12T18:36:48.730577+0000","last_undegraded":"2024-09-12T18:36:48.730577+0000","last_fullsized":"2024-09-12T18:36:48.730577+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:48.730397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:48.730397+0000","last_clean_scrub_stamp":"2024-09-12T18:36:48.730397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:48.038132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.155671+0000","last_change":"2024-09-12T18:36:37.155671+0000","last_active":"2024-09-12T18:36:37.155671+0000","last_peered":"2024-09-12T18:36:37.155671+0000","last_clean":"2024-09-12T18:36:37.155671+0000","last_became_active":"2024-09-12T17:31:12.088297+0000","last_became_peered":"2024-09-12T17:31:12.088297+0000","last_unstale":"2024-09-12T18:36:37.155671+0000","last_undegraded":"2024-09-12T18:36:37.155671+0000","last_fullsized":"2024-09-12T18:36:37.155671+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:37.155486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:37.155486+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.155486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:32.709238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'16","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.009727+0000","last_change":"2024-09-12T18:36:42.009727+0000","last_active":"2024-09-12T18:36:42.009727+0000","last_peered":"2024-09-12T18:36:42.009727+0000","last_clean":"2024-09-12T18:36:42.009727+0000","last_became_active":"2024-09-12T17:27:32.584404+0000","last_became_peered":"2024-09-12T17:27:32.584404+0000","last_unstale":"2024-09-12T18:36:42.009727+0000","last_undegraded":"2024-09-12T18:36:42.009727+0000","last_fullsized":"2024-09-12T18:36:42.009727+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'16","last_scrub_stamp":"2024-09-12T18:36:42.009525+0000","last_deep_scrub":"268'16","last_deep_scrub_stamp":"2024-09-12T18:36:42.009525+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.009525+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:08.730069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":55,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'315","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.951082+0000","last_change":"2024-09-12T18:36:20.951082+0000","last_active":"2024-09-12T18:36:20.951082+0000","last_peered":"2024-09-12T18:36:20.951082+0000","last_clean":"2024-09-12T18:36:20.951082+0000","last_became_active":"2024-09-12T17:10:30.407181+0000","last_became_peered":"2024-09-12T17:10:30.407181+0000","last_unstale":"2024-09-12T18:36:20.951082+0000","last_undegraded":"2024-09-12T18:36:20.951082+0000","last_fullsized":"2024-09-12T18:36:20.951082+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'315","last_scrub_stamp":"2024-09-12T18:36:20.950828+0000","last_deep_scrub":"268'315","last_deep_scrub_stamp":"2024-09-12T18:36:20.950828+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.950828+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:01.236915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262204,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":478,"num_read_kb":10655,"num_write":917,"num_write_kb":47496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'781","reported_seq":2322,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.976956+0000","last_change":"2024-09-12T18:36:23.976956+0000","last_active":"2024-09-12T18:36:23.976956+0000","last_peered":"2024-09-12T18:36:23.976956+0000","last_clean":"2024-09-12T18:36:23.976956+0000","last_became_active":"2024-09-12T17:10:32.346911+0000","last_became_peered":"2024-09-12T17:10:32.346911+0000","last_unstale":"2024-09-12T18:36:23.976956+0000","last_undegraded":"2024-09-12T18:36:23.976956+0000","last_fullsized":"2024-09-12T18:36:23.976956+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'781","last_scrub_stamp":"2024-09-12T18:36:23.976864+0000","last_deep_scrub":"268'781","last_deep_scrub_stamp":"2024-09-12T18:36:23.976864+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.976864+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:06.388928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3659,"num_read_kb":3307,"num_write":1011,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'379","reported_seq":1102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.899907+0000","last_change":"2024-09-12T18:36:14.899907+0000","last_active":"2024-09-12T18:36:14.899907+0000","last_peered":"2024-09-12T18:36:14.899907+0000","last_clean":"2024-09-12T18:36:14.899907+0000","last_became_active":"2024-09-12T17:10:30.405515+0000","last_became_peered":"2024-09-12T17:10:30.405515+0000","last_unstale":"2024-09-12T18:36:14.899907+0000","last_undegraded":"2024-09-12T18:36:14.899907+0000","last_fullsized":"2024-09-12T18:36:14.899907+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'379","last_scrub_stamp":"2024-09-12T18:36:14.899603+0000","last_deep_scrub":"268'379","last_deep_scrub_stamp":"2024-09-12T18:36:14.899603+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.899603+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:27.598354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262215,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":661,"num_read_kb":13611,"num_write":1216,"num_write_kb":42248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'456","reported_seq":1944,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.985655+0000","last_change":"2024-09-12T18:36:23.985655+0000","last_active":"2024-09-12T18:36:23.985655+0000","last_peered":"2024-09-12T18:36:23.985655+0000","last_clean":"2024-09-12T18:36:23.985655+0000","last_became_active":"2024-09-12T17:10:32.375908+0000","last_became_peered":"2024-09-12T17:10:32.375908+0000","last_unstale":"2024-09-12T18:36:23.985655+0000","last_undegraded":"2024-09-12T18:36:23.985655+0000","last_fullsized":"2024-09-12T18:36:23.985655+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'456","last_scrub_stamp":"2024-09-12T18:36:23.985573+0000","last_deep_scrub":"268'456","last_deep_scrub_stamp":"2024-09-12T18:36:23.985573+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.985573+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:23.461123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2460,"num_read_kb":2294,"num_write":575,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'368","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.537548+0000","last_change":"2024-09-12T18:36:15.537548+0000","last_active":"2024-09-12T18:36:15.537548+0000","last_peered":"2024-09-12T18:36:15.537548+0000","last_clean":"2024-09-12T18:36:15.537548+0000","last_became_active":"2024-09-12T17:10:30.351202+0000","last_became_peered":"2024-09-12T17:10:30.351202+0000","last_unstale":"2024-09-12T18:36:15.537548+0000","last_undegraded":"2024-09-12T18:36:15.537548+0000","last_fullsized":"2024-09-12T18:36:15.537548+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'368","last_scrub_stamp":"2024-09-12T18:36:15.537307+0000","last_deep_scrub":"268'368","last_deep_scrub_stamp":"2024-09-12T18:36:15.537307+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.537307+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:03:11.681842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":96764,"num_write":1045,"num_write_kb":52334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'562","reported_seq":2206,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.865091+0000","last_change":"2024-09-12T18:36:28.865091+0000","last_active":"2024-09-12T18:36:28.865091+0000","last_peered":"2024-09-12T18:36:28.865091+0000","last_clean":"2024-09-12T18:36:28.865091+0000","last_became_active":"2024-09-12T17:10:32.370962+0000","last_became_peered":"2024-09-12T17:10:32.370962+0000","last_unstale":"2024-09-12T18:36:28.865091+0000","last_undegraded":"2024-09-12T18:36:28.865091+0000","last_fullsized":"2024-09-12T18:36:28.865091+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'562","last_scrub_stamp":"2024-09-12T18:36:28.864895+0000","last_deep_scrub":"268'562","last_deep_scrub_stamp":"2024-09-12T18:36:28.864895+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.864895+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:41.919276+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2855,"num_read_kb":2656,"num_write":715,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1728,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'407","reported_seq":1142,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.964675+0000","last_change":"2024-09-12T18:36:20.964533+0000","last_active":"2024-09-12T18:36:20.964675+0000","last_peered":"2024-09-12T18:36:20.964675+0000","last_clean":"2024-09-12T18:36:20.964675+0000","last_became_active":"2024-09-12T17:10:30.374789+0000","last_became_peered":"2024-09-12T17:10:30.374789+0000","last_unstale":"2024-09-12T18:36:20.964675+0000","last_undegraded":"2024-09-12T18:36:20.964675+0000","last_fullsized":"2024-09-12T18:36:20.964675+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'407","last_scrub_stamp":"2024-09-12T18:36:20.964301+0000","last_deep_scrub":"268'407","last_deep_scrub_stamp":"2024-09-12T18:36:20.964301+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.964301+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:34.996196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267453,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":786,"num_read_kb":12016,"num_write":1261,"num_write_kb":48882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'289","reported_seq":1686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.595129+0000","last_change":"2024-09-12T18:36:23.595129+0000","last_active":"2024-09-12T18:36:23.595129+0000","last_peered":"2024-09-12T18:36:23.595129+0000","last_clean":"2024-09-12T18:36:23.595129+0000","last_became_active":"2024-09-12T17:10:32.357199+0000","last_became_peered":"2024-09-12T17:10:32.357199+0000","last_unstale":"2024-09-12T18:36:23.595129+0000","last_undegraded":"2024-09-12T18:36:23.595129+0000","last_fullsized":"2024-09-12T18:36:23.595129+0000","mapping_epoch":27,"log_start":"268'200","ondisk_log_start":"268'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'289","last_scrub_stamp":"2024-09-12T18:36:23.594944+0000","last_deep_scrub":"268'289","last_deep_scrub_stamp":"2024-09-12T18:36:23.594944+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.594944+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:43.920636+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1623,"num_read_kb":1593,"num_write":300,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'311","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.900501+0000","last_change":"2024-09-12T18:36:18.900501+0000","last_active":"2024-09-12T18:36:18.900501+0000","last_peered":"2024-09-12T18:36:18.900501+0000","last_clean":"2024-09-12T18:36:18.900501+0000","last_became_active":"2024-09-12T17:10:30.385216+0000","last_became_peered":"2024-09-12T17:10:30.385216+0000","last_unstale":"2024-09-12T18:36:18.900501+0000","last_undegraded":"2024-09-12T18:36:18.900501+0000","last_fullsized":"2024-09-12T18:36:18.900501+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'311","last_scrub_stamp":"2024-09-12T18:36:18.900301+0000","last_deep_scrub":"268'311","last_deep_scrub_stamp":"2024-09-12T18:36:18.900301+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.900301+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:13.169294+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1826375,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":401,"num_read_kb":5414,"num_write":926,"num_write_kb":15383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'551","reported_seq":2133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.076802+0000","last_change":"2024-09-12T18:36:18.076590+0000","last_active":"2024-09-12T18:36:18.076802+0000","last_peered":"2024-09-12T18:36:18.076802+0000","last_clean":"2024-09-12T18:36:18.076802+0000","last_became_active":"2024-09-12T17:10:32.351972+0000","last_became_peered":"2024-09-12T17:10:32.351972+0000","last_unstale":"2024-09-12T18:36:18.076802+0000","last_undegraded":"2024-09-12T18:36:18.076802+0000","last_fullsized":"2024-09-12T18:36:18.076802+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'551","last_scrub_stamp":"2024-09-12T18:36:18.076367+0000","last_deep_scrub":"268'551","last_deep_scrub_stamp":"2024-09-12T18:36:18.076367+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.076367+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:24.496910+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2788,"num_read_kb":2550,"num_write":700,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'360","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.946134+0000","last_change":"2024-09-12T18:36:18.946134+0000","last_active":"2024-09-12T18:36:18.946134+0000","last_peered":"2024-09-12T18:36:18.946134+0000","last_clean":"2024-09-12T18:36:18.946134+0000","last_became_active":"2024-09-12T17:10:30.350813+0000","last_became_peered":"2024-09-12T17:10:30.350813+0000","last_unstale":"2024-09-12T18:36:18.946134+0000","last_undegraded":"2024-09-12T18:36:18.946134+0000","last_fullsized":"2024-09-12T18:36:18.946134+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'360","last_scrub_stamp":"2024-09-12T18:36:18.945828+0000","last_deep_scrub":"268'360","last_deep_scrub_stamp":"2024-09-12T18:36:18.945828+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.945828+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:55.758222+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":527,"num_read_kb":3741,"num_write":1103,"num_write_kb":26406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'435","reported_seq":2157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.903357+0000","last_change":"2024-09-12T18:36:25.903357+0000","last_active":"2024-09-12T18:36:25.903357+0000","last_peered":"2024-09-12T18:36:25.903357+0000","last_clean":"2024-09-12T18:36:25.903357+0000","last_became_active":"2024-09-12T17:10:32.362980+0000","last_became_peered":"2024-09-12T17:10:32.362980+0000","last_unstale":"2024-09-12T18:36:25.903357+0000","last_undegraded":"2024-09-12T18:36:25.903357+0000","last_fullsized":"2024-09-12T18:36:25.903357+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'435","last_scrub_stamp":"2024-09-12T18:36:25.903163+0000","last_deep_scrub":"268'435","last_deep_scrub_stamp":"2024-09-12T18:36:25.903163+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.903163+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:46.137958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2502,"num_read_kb":2403,"num_write":488,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2554,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'356","reported_seq":1261,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.924979+0000","last_change":"2024-09-12T18:36:17.924979+0000","last_active":"2024-09-12T18:36:17.924979+0000","last_peered":"2024-09-12T18:36:17.924979+0000","last_clean":"2024-09-12T18:36:17.924979+0000","last_became_active":"2024-09-12T17:11:04.870569+0000","last_became_peered":"2024-09-12T17:11:04.870569+0000","last_unstale":"2024-09-12T18:36:17.924979+0000","last_undegraded":"2024-09-12T18:36:17.924979+0000","last_fullsized":"2024-09-12T18:36:17.924979+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'356","last_scrub_stamp":"2024-09-12T18:36:17.924678+0000","last_deep_scrub":"268'356","last_deep_scrub_stamp":"2024-09-12T18:36:17.924678+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.924678+0000","objects_scrubbed":10,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:37.128171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170424,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":989,"num_read_kb":89437,"num_write":1208,"num_write_kb":38550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'429","reported_seq":1952,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.943654+0000","last_change":"2024-09-12T18:36:27.943654+0000","last_active":"2024-09-12T18:36:27.943654+0000","last_peered":"2024-09-12T18:36:27.943654+0000","last_clean":"2024-09-12T18:36:27.943654+0000","last_became_active":"2024-09-12T17:10:32.368909+0000","last_became_peered":"2024-09-12T17:10:32.368909+0000","last_unstale":"2024-09-12T18:36:27.943654+0000","last_undegraded":"2024-09-12T18:36:27.943654+0000","last_fullsized":"2024-09-12T18:36:27.943654+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'429","last_scrub_stamp":"2024-09-12T18:36:27.943422+0000","last_deep_scrub":"268'429","last_deep_scrub_stamp":"2024-09-12T18:36:27.943422+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.943422+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:14.861878+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2227,"num_read_kb":2101,"num_write":505,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'392","reported_seq":1066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.853233+0000","last_change":"2024-09-12T18:36:15.853233+0000","last_active":"2024-09-12T18:36:15.853233+0000","last_peered":"2024-09-12T18:36:15.853233+0000","last_clean":"2024-09-12T18:36:15.853233+0000","last_became_active":"2024-09-12T17:10:30.395061+0000","last_became_peered":"2024-09-12T17:10:30.395061+0000","last_unstale":"2024-09-12T18:36:15.853233+0000","last_undegraded":"2024-09-12T18:36:15.853233+0000","last_fullsized":"2024-09-12T18:36:15.853233+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'392","last_scrub_stamp":"2024-09-12T18:36:15.853009+0000","last_deep_scrub":"268'392","last_deep_scrub_stamp":"2024-09-12T18:36:15.853009+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.853009+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:30.721888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194335,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":651,"num_read_kb":20153,"num_write":1153,"num_write_kb":23715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'422","reported_seq":1792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.446660+0000","last_change":"2024-09-12T18:36:19.446660+0000","last_active":"2024-09-12T18:36:19.446660+0000","last_peered":"2024-09-12T18:36:19.446660+0000","last_clean":"2024-09-12T18:36:19.446660+0000","last_became_active":"2024-09-12T17:11:05.124718+0000","last_became_peered":"2024-09-12T17:11:05.124718+0000","last_unstale":"2024-09-12T18:36:19.446660+0000","last_undegraded":"2024-09-12T18:36:19.446660+0000","last_fullsized":"2024-09-12T18:36:19.446660+0000","mapping_epoch":38,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'422","last_scrub_stamp":"2024-09-12T18:36:19.446482+0000","last_deep_scrub":"268'422","last_deep_scrub_stamp":"2024-09-12T18:36:19.446482+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.446482+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:14.866943+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2066,"num_read_kb":1911,"num_write":507,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'655","reported_seq":2402,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.950498+0000","last_change":"2024-09-12T18:36:22.950342+0000","last_active":"2024-09-12T18:36:22.950498+0000","last_peered":"2024-09-12T18:36:22.950498+0000","last_clean":"2024-09-12T18:36:22.950498+0000","last_became_active":"2024-09-12T17:10:32.363179+0000","last_became_peered":"2024-09-12T17:10:32.363179+0000","last_unstale":"2024-09-12T18:36:22.950498+0000","last_undegraded":"2024-09-12T18:36:22.950498+0000","last_fullsized":"2024-09-12T18:36:22.950498+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'655","last_scrub_stamp":"2024-09-12T18:36:22.950172+0000","last_deep_scrub":"268'655","last_deep_scrub_stamp":"2024-09-12T18:36:22.950172+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.950172+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":600,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:34.387389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3427,"num_read_kb":3148,"num_write":833,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'327","reported_seq":1021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.939536+0000","last_change":"2024-09-12T18:36:16.939536+0000","last_active":"2024-09-12T18:36:16.939536+0000","last_peered":"2024-09-12T18:36:16.939536+0000","last_clean":"2024-09-12T18:36:16.939536+0000","last_became_active":"2024-09-12T17:10:30.385785+0000","last_became_peered":"2024-09-12T17:10:30.385785+0000","last_unstale":"2024-09-12T18:36:16.939536+0000","last_undegraded":"2024-09-12T18:36:16.939536+0000","last_fullsized":"2024-09-12T18:36:16.939536+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'327","last_scrub_stamp":"2024-09-12T18:36:16.939330+0000","last_deep_scrub":"268'327","last_deep_scrub_stamp":"2024-09-12T18:36:16.939330+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.939330+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:37.817445+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":51060,"num_write":1041,"num_write_kb":34693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'512","reported_seq":2199,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.981953+0000","last_change":"2024-09-12T18:36:22.981814+0000","last_active":"2024-09-12T18:36:22.981953+0000","last_peered":"2024-09-12T18:36:22.981953+0000","last_clean":"2024-09-12T18:36:22.981953+0000","last_became_active":"2024-09-12T17:10:32.379669+0000","last_became_peered":"2024-09-12T17:10:32.379669+0000","last_unstale":"2024-09-12T18:36:22.981953+0000","last_undegraded":"2024-09-12T18:36:22.981953+0000","last_fullsized":"2024-09-12T18:36:22.981953+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'512","last_scrub_stamp":"2024-09-12T18:36:22.981614+0000","last_deep_scrub":"268'512","last_deep_scrub_stamp":"2024-09-12T18:36:22.981614+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.981614+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:06.503319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2752,"num_read_kb":2572,"num_write":584,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3555,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'342","reported_seq":1004,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.344415+0000","last_change":"2024-09-12T18:36:12.344257+0000","last_active":"2024-09-12T18:36:12.344415+0000","last_peered":"2024-09-12T18:36:12.344415+0000","last_clean":"2024-09-12T18:36:12.344415+0000","last_became_active":"2024-09-12T17:12:05.834873+0000","last_became_peered":"2024-09-12T17:12:05.834873+0000","last_unstale":"2024-09-12T18:36:12.344415+0000","last_undegraded":"2024-09-12T18:36:12.344415+0000","last_fullsized":"2024-09-12T18:36:12.344415+0000","mapping_epoch":40,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-12T18:36:12.344008+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-12T18:36:12.344008+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.344008+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:12.727528+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505043,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":40642,"num_write":1117,"num_write_kb":40250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"268'1947","reported_seq":3547,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.019771+0000","last_change":"2024-09-12T18:36:25.019641+0000","last_active":"2024-09-12T18:36:25.019771+0000","last_peered":"2024-09-12T18:36:25.019771+0000","last_clean":"2024-09-12T18:36:25.019771+0000","last_became_active":"2024-09-12T17:10:32.358342+0000","last_became_peered":"2024-09-12T17:10:32.358342+0000","last_unstale":"2024-09-12T18:36:25.019771+0000","last_undegraded":"2024-09-12T18:36:25.019771+0000","last_fullsized":"2024-09-12T18:36:25.019771+0000","mapping_epoch":27,"log_start":"268'1900","ondisk_log_start":"268'1900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1947","last_scrub_stamp":"2024-09-12T18:36:25.019441+0000","last_deep_scrub":"268'1947","last_deep_scrub_stamp":"2024-09-12T18:36:25.019441+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.019441+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":1900,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:26.178456+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8411,"num_read_kb":7313,"num_write":2747,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1244,"num_omap_keys":5,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'385","reported_seq":1049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.171293+0000","last_change":"2024-09-12T18:36:12.171293+0000","last_active":"2024-09-12T18:36:12.171293+0000","last_peered":"2024-09-12T18:36:12.171293+0000","last_clean":"2024-09-12T18:36:12.171293+0000","last_became_active":"2024-09-12T17:10:30.395938+0000","last_became_peered":"2024-09-12T17:10:30.395938+0000","last_unstale":"2024-09-12T18:36:12.171293+0000","last_undegraded":"2024-09-12T18:36:12.171293+0000","last_fullsized":"2024-09-12T18:36:12.171293+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-12T18:36:12.171022+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-12T18:36:12.171022+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.171022+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:57.800473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194330,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":529,"num_read_kb":40778,"num_write":1213,"num_write_kb":34948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'784","reported_seq":2238,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.458241+0000","last_change":"2024-09-12T18:36:17.458241+0000","last_active":"2024-09-12T18:36:17.458241+0000","last_peered":"2024-09-12T18:36:17.458241+0000","last_clean":"2024-09-12T18:36:17.458241+0000","last_became_active":"2024-09-12T17:10:32.354271+0000","last_became_peered":"2024-09-12T17:10:32.354271+0000","last_unstale":"2024-09-12T18:36:17.458241+0000","last_undegraded":"2024-09-12T18:36:17.458241+0000","last_fullsized":"2024-09-12T18:36:17.458241+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'784","last_scrub_stamp":"2024-09-12T18:36:17.458035+0000","last_deep_scrub":"268'784","last_deep_scrub_stamp":"2024-09-12T18:36:17.458035+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.458035+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:22.834719+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3730,"num_read_kb":3333,"num_write":1060,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1463,"num_omap_keys":7,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'534","reported_seq":1291,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.982254+0000","last_change":"2024-09-12T18:36:07.982254+0000","last_active":"2024-09-12T18:36:07.982254+0000","last_peered":"2024-09-12T18:36:07.982254+0000","last_clean":"2024-09-12T18:36:07.982254+0000","last_became_active":"2024-09-12T17:10:30.394905+0000","last_became_peered":"2024-09-12T17:10:30.394905+0000","last_unstale":"2024-09-12T18:36:07.982254+0000","last_undegraded":"2024-09-12T18:36:07.982254+0000","last_fullsized":"2024-09-12T18:36:07.982254+0000","mapping_epoch":25,"log_start":"268'500","ondisk_log_start":"268'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'534","last_scrub_stamp":"2024-09-12T18:36:07.981975+0000","last_deep_scrub":"268'534","last_deep_scrub_stamp":"2024-09-12T18:36:07.981975+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.981975+0000","objects_scrubbed":11,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:02.322234+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4500387,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":948,"num_read_kb":40764,"num_write":1577,"num_write_kb":41950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'789","reported_seq":2390,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.424934+0000","last_change":"2024-09-12T18:36:16.424934+0000","last_active":"2024-09-12T18:36:16.424934+0000","last_peered":"2024-09-12T18:36:16.424934+0000","last_clean":"2024-09-12T18:36:16.424934+0000","last_became_active":"2024-09-12T17:10:32.372137+0000","last_became_peered":"2024-09-12T17:10:32.372137+0000","last_unstale":"2024-09-12T18:36:16.424934+0000","last_undegraded":"2024-09-12T18:36:16.424934+0000","last_fullsized":"2024-09-12T18:36:16.424934+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'789","last_scrub_stamp":"2024-09-12T18:36:16.424682+0000","last_deep_scrub":"268'789","last_deep_scrub_stamp":"2024-09-12T18:36:16.424682+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.424682+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:31.677702+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3748,"num_read_kb":3393,"num_write":1031,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'350","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.873906+0000","last_change":"2024-09-12T18:36:14.873906+0000","last_active":"2024-09-12T18:36:14.873906+0000","last_peered":"2024-09-12T18:36:14.873906+0000","last_clean":"2024-09-12T18:36:14.873906+0000","last_became_active":"2024-09-12T17:10:30.394096+0000","last_became_peered":"2024-09-12T17:10:30.394096+0000","last_unstale":"2024-09-12T18:36:14.873906+0000","last_undegraded":"2024-09-12T18:36:14.873906+0000","last_fullsized":"2024-09-12T18:36:14.873906+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T18:36:14.873700+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T18:36:14.873700+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.873700+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:24.375076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399199,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":10350,"num_write":1046,"num_write_kb":23725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'866","reported_seq":2543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.989539+0000","last_change":"2024-09-12T18:36:21.989539+0000","last_active":"2024-09-12T18:36:21.989539+0000","last_peered":"2024-09-12T18:36:21.989539+0000","last_clean":"2024-09-12T18:36:21.989539+0000","last_became_active":"2024-09-12T17:10:32.361126+0000","last_became_peered":"2024-09-12T17:10:32.361126+0000","last_unstale":"2024-09-12T18:36:21.989539+0000","last_undegraded":"2024-09-12T18:36:21.989539+0000","last_fullsized":"2024-09-12T18:36:21.989539+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'866","last_scrub_stamp":"2024-09-12T18:36:21.989341+0000","last_deep_scrub":"268'866","last_deep_scrub_stamp":"2024-09-12T18:36:21.989341+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.989341+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":800,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:40.716672+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4216,"num_read_kb":3793,"num_write":1162,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'338","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.621464+0000","last_change":"2024-09-12T18:36:12.621286+0000","last_active":"2024-09-12T18:36:12.621464+0000","last_peered":"2024-09-12T18:36:12.621464+0000","last_clean":"2024-09-12T18:36:12.621464+0000","last_became_active":"2024-09-12T17:10:30.353147+0000","last_became_peered":"2024-09-12T17:10:30.353147+0000","last_unstale":"2024-09-12T18:36:12.621464+0000","last_undegraded":"2024-09-12T18:36:12.621464+0000","last_fullsized":"2024-09-12T18:36:12.621464+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'338","last_scrub_stamp":"2024-09-12T18:36:12.621045+0000","last_deep_scrub":"268'338","last_deep_scrub_stamp":"2024-09-12T18:36:12.621045+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.621045+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:05.954192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":416,"num_read_kb":13692,"num_write":1012,"num_write_kb":32545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'138","reported_seq":688,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.757372+0000","last_change":"2024-09-12T18:36:40.757372+0000","last_active":"2024-09-12T18:36:40.757372+0000","last_peered":"2024-09-12T18:36:40.757372+0000","last_clean":"2024-09-12T18:36:40.757372+0000","last_became_active":"2024-09-12T17:10:40.421380+0000","last_became_peered":"2024-09-12T17:10:40.421380+0000","last_unstale":"2024-09-12T18:36:40.757372+0000","last_undegraded":"2024-09-12T18:36:40.757372+0000","last_fullsized":"2024-09-12T18:36:40.757372+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'138","last_scrub_stamp":"2024-09-12T18:36:40.757083+0000","last_deep_scrub":"268'138","last_deep_scrub_stamp":"2024-09-12T18:36:40.757083+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.757083+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:10:12.153166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":207,"num_write":318,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'457","reported_seq":2080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.781398+0000","last_change":"2024-09-12T18:36:20.781267+0000","last_active":"2024-09-12T18:36:20.781398+0000","last_peered":"2024-09-12T18:36:20.781398+0000","last_clean":"2024-09-12T18:36:20.781398+0000","last_became_active":"2024-09-12T17:10:32.370058+0000","last_became_peered":"2024-09-12T17:10:32.370058+0000","last_unstale":"2024-09-12T18:36:20.781398+0000","last_undegraded":"2024-09-12T18:36:20.781398+0000","last_fullsized":"2024-09-12T18:36:20.781398+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'457","last_scrub_stamp":"2024-09-12T18:36:20.781035+0000","last_deep_scrub":"268'457","last_deep_scrub_stamp":"2024-09-12T18:36:20.781035+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.781035+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:40.316776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2398,"num_read_kb":2269,"num_write":525,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'310","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.309525+0000","last_change":"2024-09-12T18:36:11.309364+0000","last_active":"2024-09-12T18:36:11.309525+0000","last_peered":"2024-09-12T18:36:11.309525+0000","last_clean":"2024-09-12T18:36:11.309525+0000","last_became_active":"2024-09-12T17:11:04.871007+0000","last_became_peered":"2024-09-12T17:11:04.871007+0000","last_unstale":"2024-09-12T18:36:11.309525+0000","last_undegraded":"2024-09-12T18:36:11.309525+0000","last_fullsized":"2024-09-12T18:36:11.309525+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-12T18:36:11.309154+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-12T18:36:11.309154+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.309154+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:27.380152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":422,"num_read_kb":10233,"num_write":1020,"num_write_kb":32687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.887052+0000","last_change":"2024-09-12T18:36:30.887052+0000","last_active":"2024-09-12T18:36:30.887052+0000","last_peered":"2024-09-12T18:36:30.887052+0000","last_clean":"2024-09-12T18:36:30.887052+0000","last_became_active":"2024-09-12T17:10:34.371022+0000","last_became_peered":"2024-09-12T17:10:34.371022+0000","last_unstale":"2024-09-12T18:36:30.887052+0000","last_undegraded":"2024-09-12T18:36:30.887052+0000","last_fullsized":"2024-09-12T18:36:30.887052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:30.886855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:30.886855+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.886855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:49.121602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'371","reported_seq":1013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.691239+0000","last_change":"2024-09-12T18:36:29.691239+0000","last_active":"2024-09-12T18:36:29.691239+0000","last_peered":"2024-09-12T18:36:29.691239+0000","last_clean":"2024-09-12T18:36:29.691239+0000","last_became_active":"2024-09-12T17:10:36.399464+0000","last_became_peered":"2024-09-12T17:10:36.399464+0000","last_unstale":"2024-09-12T18:36:29.691239+0000","last_undegraded":"2024-09-12T18:36:29.691239+0000","last_fullsized":"2024-09-12T18:36:29.691239+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'371","last_scrub_stamp":"2024-09-12T18:36:29.691048+0000","last_deep_scrub":"268'371","last_deep_scrub_stamp":"2024-09-12T18:36:29.691048+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.691048+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:40.446128+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49246,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":602,"num_read_kb":1286,"num_write":476,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.002847+0000","last_change":"2024-09-12T18:36:40.002847+0000","last_active":"2024-09-12T18:36:40.002847+0000","last_peered":"2024-09-12T18:36:40.002847+0000","last_clean":"2024-09-12T18:36:40.002847+0000","last_became_active":"2024-09-12T17:10:38.404423+0000","last_became_peered":"2024-09-12T17:10:38.404423+0000","last_unstale":"2024-09-12T18:36:40.002847+0000","last_undegraded":"2024-09-12T18:36:40.002847+0000","last_fullsized":"2024-09-12T18:36:40.002847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:40.002666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:40.002666+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.002666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:16.488702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'174","reported_seq":752,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.812941+0000","last_change":"2024-09-12T18:36:44.812941+0000","last_active":"2024-09-12T18:36:44.812941+0000","last_peered":"2024-09-12T18:36:44.812941+0000","last_clean":"2024-09-12T18:36:44.812941+0000","last_became_active":"2024-09-12T17:10:40.425532+0000","last_became_peered":"2024-09-12T17:10:40.425532+0000","last_unstale":"2024-09-12T18:36:44.812941+0000","last_undegraded":"2024-09-12T18:36:44.812941+0000","last_fullsized":"2024-09-12T18:36:44.812941+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'174","last_scrub_stamp":"2024-09-12T18:36:44.812743+0000","last_deep_scrub":"268'174","last_deep_scrub_stamp":"2024-09-12T18:36:44.812743+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.812743+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:34.484903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":265,"num_read_kb":256,"num_write":326,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'734","reported_seq":2472,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.977608+0000","last_change":"2024-09-12T18:36:22.977608+0000","last_active":"2024-09-12T18:36:22.977608+0000","last_peered":"2024-09-12T18:36:22.977608+0000","last_clean":"2024-09-12T18:36:22.977608+0000","last_became_active":"2024-09-12T17:10:32.381838+0000","last_became_peered":"2024-09-12T17:10:32.381838+0000","last_unstale":"2024-09-12T18:36:22.977608+0000","last_undegraded":"2024-09-12T18:36:22.977608+0000","last_fullsized":"2024-09-12T18:36:22.977608+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'734","last_scrub_stamp":"2024-09-12T18:36:22.977435+0000","last_deep_scrub":"268'734","last_deep_scrub_stamp":"2024-09-12T18:36:22.977435+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.977435+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:38.867097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3756,"num_read_kb":3395,"num_write":1068,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'387","reported_seq":1117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.651661+0000","last_change":"2024-09-12T18:36:08.651608+0000","last_active":"2024-09-12T18:36:08.651661+0000","last_peered":"2024-09-12T18:36:08.651661+0000","last_clean":"2024-09-12T18:36:08.651661+0000","last_became_active":"2024-09-12T17:10:30.362010+0000","last_became_peered":"2024-09-12T17:10:30.362010+0000","last_unstale":"2024-09-12T18:36:08.651661+0000","last_undegraded":"2024-09-12T18:36:08.651661+0000","last_fullsized":"2024-09-12T18:36:08.651661+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'387","last_scrub_stamp":"2024-09-12T18:36:08.651489+0000","last_deep_scrub":"268'387","last_deep_scrub_stamp":"2024-09-12T18:36:08.651489+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.651489+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:16.615443+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9667749,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":698,"num_read_kb":52712,"num_write":1418,"num_write_kb":39491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.803027+0000","last_change":"2024-09-12T18:36:27.802895+0000","last_active":"2024-09-12T18:36:27.803027+0000","last_peered":"2024-09-12T18:36:27.803027+0000","last_clean":"2024-09-12T18:36:27.803027+0000","last_became_active":"2024-09-12T17:10:34.361102+0000","last_became_peered":"2024-09-12T17:10:34.361102+0000","last_unstale":"2024-09-12T18:36:27.803027+0000","last_undegraded":"2024-09-12T18:36:27.803027+0000","last_fullsized":"2024-09-12T18:36:27.803027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:27.802698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:27.802698+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.802698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:44.974084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'113","reported_seq":677,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.759671+0000","last_change":"2024-09-12T18:36:32.759671+0000","last_active":"2024-09-12T18:36:32.759671+0000","last_peered":"2024-09-12T18:36:32.759671+0000","last_clean":"2024-09-12T18:36:32.759671+0000","last_became_active":"2024-09-12T17:10:36.390398+0000","last_became_peered":"2024-09-12T17:10:36.390398+0000","last_unstale":"2024-09-12T18:36:32.759671+0000","last_undegraded":"2024-09-12T18:36:32.759671+0000","last_fullsized":"2024-09-12T18:36:32.759671+0000","mapping_epoch":31,"log_start":"268'101","ondisk_log_start":"268'101","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'113","last_scrub_stamp":"2024-09-12T18:36:32.759435+0000","last_deep_scrub":"268'113","last_deep_scrub_stamp":"2024-09-12T18:36:32.759435+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.759435+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":101,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:52.362289+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.750447+0000","last_change":"2024-09-12T18:36:37.750447+0000","last_active":"2024-09-12T18:36:37.750447+0000","last_peered":"2024-09-12T18:36:37.750447+0000","last_clean":"2024-09-12T18:36:37.750447+0000","last_became_active":"2024-09-12T17:10:38.414063+0000","last_became_peered":"2024-09-12T17:10:38.414063+0000","last_unstale":"2024-09-12T18:36:37.750447+0000","last_undegraded":"2024-09-12T18:36:37.750447+0000","last_fullsized":"2024-09-12T18:36:37.750447+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:37.750266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:37.750266+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.750266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:40.593091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'143","reported_seq":669,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.718607+0000","last_change":"2024-09-12T18:36:42.718607+0000","last_active":"2024-09-12T18:36:42.718607+0000","last_peered":"2024-09-12T18:36:42.718607+0000","last_clean":"2024-09-12T18:36:42.718607+0000","last_became_active":"2024-09-12T17:10:40.422118+0000","last_became_peered":"2024-09-12T17:10:40.422118+0000","last_unstale":"2024-09-12T18:36:42.718607+0000","last_undegraded":"2024-09-12T18:36:42.718607+0000","last_fullsized":"2024-09-12T18:36:42.718607+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'143","last_scrub_stamp":"2024-09-12T18:36:42.718415+0000","last_deep_scrub":"268'143","last_deep_scrub_stamp":"2024-09-12T18:36:42.718415+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.718415+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:22.743040+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":180,"num_write":349,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'874","reported_seq":2504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.499729+0000","last_change":"2024-09-12T18:36:16.499729+0000","last_active":"2024-09-12T18:36:16.499729+0000","last_peered":"2024-09-12T18:36:16.499729+0000","last_clean":"2024-09-12T18:36:16.499729+0000","last_became_active":"2024-09-12T17:10:32.351650+0000","last_became_peered":"2024-09-12T17:10:32.351650+0000","last_unstale":"2024-09-12T18:36:16.499729+0000","last_undegraded":"2024-09-12T18:36:16.499729+0000","last_fullsized":"2024-09-12T18:36:16.499729+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'874","last_scrub_stamp":"2024-09-12T18:36:16.499553+0000","last_deep_scrub":"268'874","last_deep_scrub_stamp":"2024-09-12T18:36:16.499553+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.499553+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:08.094193+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4313,"num_read_kb":3885,"num_write":1184,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'394","reported_seq":1138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.970241+0000","last_change":"2024-09-12T18:36:13.970009+0000","last_active":"2024-09-12T18:36:13.970241+0000","last_peered":"2024-09-12T18:36:13.970241+0000","last_clean":"2024-09-12T18:36:13.970241+0000","last_became_active":"2024-09-12T17:10:30.393670+0000","last_became_peered":"2024-09-12T17:10:30.393670+0000","last_unstale":"2024-09-12T18:36:13.970241+0000","last_undegraded":"2024-09-12T18:36:13.970241+0000","last_fullsized":"2024-09-12T18:36:13.970241+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T18:36:13.969732+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T18:36:13.969732+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.969732+0000","objects_scrubbed":10,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:08.366310+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3976825,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":785,"num_read_kb":43186,"num_write":1227,"num_write_kb":22438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.856938+0000","last_change":"2024-09-12T18:36:29.856938+0000","last_active":"2024-09-12T18:36:29.856938+0000","last_peered":"2024-09-12T18:36:29.856938+0000","last_clean":"2024-09-12T18:36:29.856938+0000","last_became_active":"2024-09-12T17:10:34.358119+0000","last_became_peered":"2024-09-12T17:10:34.358119+0000","last_unstale":"2024-09-12T18:36:29.856938+0000","last_undegraded":"2024-09-12T18:36:29.856938+0000","last_fullsized":"2024-09-12T18:36:29.856938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:29.856757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:29.856757+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.856757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:50.064545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'157","reported_seq":740,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.490927+0000","last_change":"2024-09-12T18:36:24.490785+0000","last_active":"2024-09-12T18:36:24.490927+0000","last_peered":"2024-09-12T18:36:24.490927+0000","last_clean":"2024-09-12T18:36:24.490927+0000","last_became_active":"2024-09-12T17:10:36.384465+0000","last_became_peered":"2024-09-12T17:10:36.384465+0000","last_unstale":"2024-09-12T18:36:24.490927+0000","last_undegraded":"2024-09-12T18:36:24.490927+0000","last_fullsized":"2024-09-12T18:36:24.490927+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'157","last_scrub_stamp":"2024-09-12T18:36:24.490568+0000","last_deep_scrub":"268'157","last_deep_scrub_stamp":"2024-09-12T18:36:24.490568+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.490568+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:59.451113+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":178,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'795","reported_seq":2929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.010486+0000","last_change":"2024-09-12T18:36:38.010486+0000","last_active":"2024-09-12T18:36:38.010486+0000","last_peered":"2024-09-12T18:36:38.010486+0000","last_clean":"2024-09-12T18:36:38.010486+0000","last_became_active":"2024-09-12T17:10:38.406964+0000","last_became_peered":"2024-09-12T17:10:38.406964+0000","last_unstale":"2024-09-12T18:36:38.010486+0000","last_undegraded":"2024-09-12T18:36:38.010486+0000","last_fullsized":"2024-09-12T18:36:38.010486+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'795","last_scrub_stamp":"2024-09-12T18:36:38.010307+0000","last_deep_scrub":"268'795","last_deep_scrub_stamp":"2024-09-12T18:36:38.010307+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.010307+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:19.069357+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'257","reported_seq":1122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.773012+0000","last_change":"2024-09-12T18:36:41.773012+0000","last_active":"2024-09-12T18:36:41.773012+0000","last_peered":"2024-09-12T18:36:41.773012+0000","last_clean":"2024-09-12T18:36:41.773012+0000","last_became_active":"2024-09-12T17:10:40.768896+0000","last_became_peered":"2024-09-12T17:10:40.768896+0000","last_unstale":"2024-09-12T18:36:41.773012+0000","last_undegraded":"2024-09-12T18:36:41.773012+0000","last_fullsized":"2024-09-12T18:36:41.773012+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'257","last_scrub_stamp":"2024-09-12T18:36:41.772831+0000","last_deep_scrub":"268'257","last_deep_scrub_stamp":"2024-09-12T18:36:41.772831+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.772831+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:20.614751+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":705,"num_read_kb":685,"num_write":456,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'534","reported_seq":2346,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.817370+0000","last_change":"2024-09-12T18:36:19.817370+0000","last_active":"2024-09-12T18:36:19.817370+0000","last_peered":"2024-09-12T18:36:19.817370+0000","last_clean":"2024-09-12T18:36:19.817370+0000","last_became_active":"2024-09-12T17:10:32.382671+0000","last_became_peered":"2024-09-12T17:10:32.382671+0000","last_unstale":"2024-09-12T18:36:19.817370+0000","last_undegraded":"2024-09-12T18:36:19.817370+0000","last_fullsized":"2024-09-12T18:36:19.817370+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'534","last_scrub_stamp":"2024-09-12T18:36:19.817166+0000","last_deep_scrub":"268'534","last_deep_scrub_stamp":"2024-09-12T18:36:19.817166+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.817166+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:25.307712+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3129,"num_read_kb":2937,"num_write":633,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3101,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'384","reported_seq":1069,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.175550+0000","last_change":"2024-09-12T18:36:09.175322+0000","last_active":"2024-09-12T18:36:09.175550+0000","last_peered":"2024-09-12T18:36:09.175550+0000","last_clean":"2024-09-12T18:36:09.175550+0000","last_became_active":"2024-09-12T17:10:30.390677+0000","last_became_peered":"2024-09-12T17:10:30.390677+0000","last_unstale":"2024-09-12T18:36:09.175550+0000","last_undegraded":"2024-09-12T18:36:09.175550+0000","last_fullsized":"2024-09-12T18:36:09.175550+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'384","last_scrub_stamp":"2024-09-12T18:36:09.175054+0000","last_deep_scrub":"268'384","last_deep_scrub_stamp":"2024-09-12T18:36:09.175054+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.175054+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:54.543850+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262215,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":587,"num_read_kb":63186,"num_write":1131,"num_write_kb":46639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.849515+0000","last_change":"2024-09-12T18:36:31.849515+0000","last_active":"2024-09-12T18:36:31.849515+0000","last_peered":"2024-09-12T18:36:31.849515+0000","last_clean":"2024-09-12T18:36:31.849515+0000","last_became_active":"2024-09-12T17:10:34.371937+0000","last_became_peered":"2024-09-12T17:10:34.371937+0000","last_unstale":"2024-09-12T18:36:31.849515+0000","last_undegraded":"2024-09-12T18:36:31.849515+0000","last_fullsized":"2024-09-12T18:36:31.849515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:31.849247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:31.849247+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.849247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:45.208680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'323","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.949245+0000","last_change":"2024-09-12T18:36:33.949245+0000","last_active":"2024-09-12T18:36:33.949245+0000","last_peered":"2024-09-12T18:36:33.949245+0000","last_clean":"2024-09-12T18:36:33.949245+0000","last_became_active":"2024-09-12T17:10:36.920487+0000","last_became_peered":"2024-09-12T17:10:36.920487+0000","last_unstale":"2024-09-12T18:36:33.949245+0000","last_undegraded":"2024-09-12T18:36:33.949245+0000","last_fullsized":"2024-09-12T18:36:33.949245+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'323","last_scrub_stamp":"2024-09-12T18:36:33.949047+0000","last_deep_scrub":"268'323","last_deep_scrub_stamp":"2024-09-12T18:36:33.949047+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.949047+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:14.235888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46675,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":545,"num_read_kb":1308,"num_write":450,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'809","reported_seq":2826,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.969737+0000","last_change":"2024-09-12T18:36:40.969480+0000","last_active":"2024-09-12T18:36:40.969737+0000","last_peered":"2024-09-12T18:36:40.969737+0000","last_clean":"2024-09-12T18:36:40.969737+0000","last_became_active":"2024-09-12T17:10:38.393524+0000","last_became_peered":"2024-09-12T17:10:38.393524+0000","last_unstale":"2024-09-12T18:36:40.969737+0000","last_undegraded":"2024-09-12T18:36:40.969737+0000","last_fullsized":"2024-09-12T18:36:40.969737+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'809","last_scrub_stamp":"2024-09-12T18:36:40.969247+0000","last_deep_scrub":"268'809","last_deep_scrub_stamp":"2024-09-12T18:36:40.969247+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.969247+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:00.549255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'402","reported_seq":1980,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.984443+0000","last_change":"2024-09-12T18:36:21.984204+0000","last_active":"2024-09-12T18:36:21.984443+0000","last_peered":"2024-09-12T18:36:21.984443+0000","last_clean":"2024-09-12T18:36:21.984443+0000","last_became_active":"2024-09-12T17:10:32.378027+0000","last_became_peered":"2024-09-12T17:10:32.378027+0000","last_unstale":"2024-09-12T18:36:21.984443+0000","last_undegraded":"2024-09-12T18:36:21.984443+0000","last_fullsized":"2024-09-12T18:36:21.984443+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'402","last_scrub_stamp":"2024-09-12T18:36:21.983901+0000","last_deep_scrub":"268'402","last_deep_scrub_stamp":"2024-09-12T18:36:21.983901+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.983901+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:14.125927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2313,"num_read_kb":2218,"num_write":459,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'347","reported_seq":1027,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.000957+0000","last_change":"2024-09-12T18:36:12.000812+0000","last_active":"2024-09-12T18:36:12.000957+0000","last_peered":"2024-09-12T18:36:12.000957+0000","last_clean":"2024-09-12T18:36:12.000957+0000","last_became_active":"2024-09-12T17:10:30.386707+0000","last_became_peered":"2024-09-12T17:10:30.386707+0000","last_unstale":"2024-09-12T18:36:12.000957+0000","last_undegraded":"2024-09-12T18:36:12.000957+0000","last_fullsized":"2024-09-12T18:36:12.000957+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-12T18:36:12.000536+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-12T18:36:12.000536+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.000536+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:38.013571+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399029,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":531,"num_read_kb":31049,"num_write":1121,"num_write_kb":31528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.971475+0000","last_change":"2024-09-12T18:36:26.971329+0000","last_active":"2024-09-12T18:36:26.971475+0000","last_peered":"2024-09-12T18:36:26.971475+0000","last_clean":"2024-09-12T18:36:26.971475+0000","last_became_active":"2024-09-12T17:10:34.369066+0000","last_became_peered":"2024-09-12T17:10:34.369066+0000","last_unstale":"2024-09-12T18:36:26.971475+0000","last_undegraded":"2024-09-12T18:36:26.971475+0000","last_fullsized":"2024-09-12T18:36:26.971475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.971149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.971149+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.971149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:39.933136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'394","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.886618+0000","last_change":"2024-09-12T18:36:35.886618+0000","last_active":"2024-09-12T18:36:35.886618+0000","last_peered":"2024-09-12T18:36:35.886618+0000","last_clean":"2024-09-12T18:36:35.886618+0000","last_became_active":"2024-09-12T17:10:36.920136+0000","last_became_peered":"2024-09-12T17:10:36.920136+0000","last_unstale":"2024-09-12T18:36:35.886618+0000","last_undegraded":"2024-09-12T18:36:35.886618+0000","last_fullsized":"2024-09-12T18:36:35.886618+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T18:36:35.886408+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T18:36:35.886408+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.886408+0000","objects_scrubbed":9,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:53.596754+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54168,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":623,"num_read_kb":1195,"num_write":466,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.879465+0000","last_change":"2024-09-12T18:36:25.879465+0000","last_active":"2024-09-12T18:36:25.879465+0000","last_peered":"2024-09-12T18:36:25.879465+0000","last_clean":"2024-09-12T18:36:25.879465+0000","last_became_active":"2024-09-12T17:10:38.394381+0000","last_became_peered":"2024-09-12T17:10:38.394381+0000","last_unstale":"2024-09-12T18:36:25.879465+0000","last_undegraded":"2024-09-12T18:36:25.879465+0000","last_fullsized":"2024-09-12T18:36:25.879465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:25.879288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:25.879288+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.879288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:15.785711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'534","reported_seq":1368,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.840000+0000","last_change":"2024-09-12T18:36:39.840000+0000","last_active":"2024-09-12T18:36:39.840000+0000","last_peered":"2024-09-12T18:36:39.840000+0000","last_clean":"2024-09-12T18:36:39.840000+0000","last_became_active":"2024-09-12T17:10:40.422353+0000","last_became_peered":"2024-09-12T17:10:40.422353+0000","last_unstale":"2024-09-12T18:36:39.840000+0000","last_undegraded":"2024-09-12T18:36:39.840000+0000","last_fullsized":"2024-09-12T18:36:39.840000+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'534","last_scrub_stamp":"2024-09-12T18:36:39.839738+0000","last_deep_scrub":"268'534","last_deep_scrub_stamp":"2024-09-12T18:36:39.839738+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.839738+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:19.782940+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1294,"num_read_kb":1291,"num_write":1098,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'425","reported_seq":2042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.993709+0000","last_change":"2024-09-12T18:36:11.993454+0000","last_active":"2024-09-12T18:36:11.993709+0000","last_peered":"2024-09-12T18:36:11.993709+0000","last_clean":"2024-09-12T18:36:11.993709+0000","last_became_active":"2024-09-12T17:10:32.369188+0000","last_became_peered":"2024-09-12T17:10:32.369188+0000","last_unstale":"2024-09-12T18:36:11.993709+0000","last_undegraded":"2024-09-12T18:36:11.993709+0000","last_fullsized":"2024-09-12T18:36:11.993709+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'425","last_scrub_stamp":"2024-09-12T18:36:11.993172+0000","last_deep_scrub":"268'425","last_deep_scrub_stamp":"2024-09-12T18:36:11.993172+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.993172+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:31.536535+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2274,"num_read_kb":2176,"num_write":482,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'333","reported_seq":1118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.915481+0000","last_change":"2024-09-12T18:36:14.915481+0000","last_active":"2024-09-12T18:36:14.915481+0000","last_peered":"2024-09-12T18:36:14.915481+0000","last_clean":"2024-09-12T18:36:14.915481+0000","last_became_active":"2024-09-12T17:10:30.381728+0000","last_became_peered":"2024-09-12T17:10:30.381728+0000","last_unstale":"2024-09-12T18:36:14.915481+0000","last_undegraded":"2024-09-12T18:36:14.915481+0000","last_fullsized":"2024-09-12T18:36:14.915481+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-12T18:36:14.915264+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-12T18:36:14.915264+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.915264+0000","objects_scrubbed":9,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:17.086755+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399298,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":581,"num_read_kb":127583,"num_write":1019,"num_write_kb":57035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.416377+0000","last_change":"2024-09-12T18:36:21.416236+0000","last_active":"2024-09-12T18:36:21.416377+0000","last_peered":"2024-09-12T18:36:21.416377+0000","last_clean":"2024-09-12T18:36:21.416377+0000","last_became_active":"2024-09-12T17:10:34.346229+0000","last_became_peered":"2024-09-12T17:10:34.346229+0000","last_unstale":"2024-09-12T18:36:21.416377+0000","last_undegraded":"2024-09-12T18:36:21.416377+0000","last_fullsized":"2024-09-12T18:36:21.416377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:21.416056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:21.416056+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.416056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:15.060850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'302","reported_seq":912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.887064+0000","last_change":"2024-09-12T18:36:30.887064+0000","last_active":"2024-09-12T18:36:30.887064+0000","last_peered":"2024-09-12T18:36:30.887064+0000","last_clean":"2024-09-12T18:36:30.887064+0000","last_became_active":"2024-09-12T17:10:36.398641+0000","last_became_peered":"2024-09-12T17:10:36.398641+0000","last_unstale":"2024-09-12T18:36:30.887064+0000","last_undegraded":"2024-09-12T18:36:30.887064+0000","last_fullsized":"2024-09-12T18:36:30.887064+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'302","last_scrub_stamp":"2024-09-12T18:36:30.886775+0000","last_deep_scrub":"268'302","last_deep_scrub_stamp":"2024-09-12T18:36:30.886775+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.886775+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:50.024569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":1192,"num_write":410,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.977363+0000","last_change":"2024-09-12T18:36:41.977363+0000","last_active":"2024-09-12T18:36:41.977363+0000","last_peered":"2024-09-12T18:36:41.977363+0000","last_clean":"2024-09-12T18:36:41.977363+0000","last_became_active":"2024-09-12T17:10:38.393114+0000","last_became_peered":"2024-09-12T17:10:38.393114+0000","last_unstale":"2024-09-12T18:36:41.977363+0000","last_undegraded":"2024-09-12T18:36:41.977363+0000","last_fullsized":"2024-09-12T18:36:41.977363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:41.977180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:41.977180+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.977180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:29.512987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'2404","reported_seq":4254,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.208843+0000","last_change":"2024-09-12T18:36:27.208843+0000","last_active":"2024-09-12T18:36:27.208843+0000","last_peered":"2024-09-12T18:36:27.208843+0000","last_clean":"2024-09-12T18:36:27.208843+0000","last_became_active":"2024-09-12T17:10:40.425351+0000","last_became_peered":"2024-09-12T17:10:40.425351+0000","last_unstale":"2024-09-12T18:36:27.208843+0000","last_undegraded":"2024-09-12T18:36:27.208843+0000","last_fullsized":"2024-09-12T18:36:27.208843+0000","mapping_epoch":35,"log_start":"268'2300","ondisk_log_start":"268'2300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2404","last_scrub_stamp":"2024-09-12T18:36:27.208656+0000","last_deep_scrub":"268'2404","last_deep_scrub_stamp":"2024-09-12T18:36:27.208656+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.208656+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":2300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:30.619720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6030,"num_read_kb":6033,"num_write":4839,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'771","reported_seq":2283,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.076189+0000","last_change":"2024-09-12T18:36:16.076189+0000","last_active":"2024-09-12T18:36:16.076189+0000","last_peered":"2024-09-12T18:36:16.076189+0000","last_clean":"2024-09-12T18:36:16.076189+0000","last_became_active":"2024-09-12T17:11:04.373050+0000","last_became_peered":"2024-09-12T17:11:04.373050+0000","last_unstale":"2024-09-12T18:36:16.076189+0000","last_undegraded":"2024-09-12T18:36:16.076189+0000","last_fullsized":"2024-09-12T18:36:16.076189+0000","mapping_epoch":38,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'771","last_scrub_stamp":"2024-09-12T18:36:16.075977+0000","last_deep_scrub":"268'771","last_deep_scrub_stamp":"2024-09-12T18:36:16.075977+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.075977+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:34.465225+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3705,"num_read_kb":3333,"num_write":1034,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":470,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'339","reported_seq":1022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.991290+0000","last_change":"2024-09-12T18:36:12.991290+0000","last_active":"2024-09-12T18:36:12.991290+0000","last_peered":"2024-09-12T18:36:12.991290+0000","last_clean":"2024-09-12T18:36:12.991290+0000","last_became_active":"2024-09-12T17:10:30.381997+0000","last_became_peered":"2024-09-12T17:10:30.381997+0000","last_unstale":"2024-09-12T18:36:12.991290+0000","last_undegraded":"2024-09-12T18:36:12.991290+0000","last_fullsized":"2024-09-12T18:36:12.991290+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T18:36:12.991024+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T18:36:12.991024+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.991024+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:06.763609+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":534,"num_read_kb":9738,"num_write":1109,"num_write_kb":58445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.424294+0000","last_change":"2024-09-12T18:36:20.424294+0000","last_active":"2024-09-12T18:36:20.424294+0000","last_peered":"2024-09-12T18:36:20.424294+0000","last_clean":"2024-09-12T18:36:20.424294+0000","last_became_active":"2024-09-12T17:10:34.358798+0000","last_became_peered":"2024-09-12T17:10:34.358798+0000","last_unstale":"2024-09-12T18:36:20.424294+0000","last_undegraded":"2024-09-12T18:36:20.424294+0000","last_fullsized":"2024-09-12T18:36:20.424294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:20.424121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:20.424121+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.424121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:13.717135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'358","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.969248+0000","last_change":"2024-09-12T18:36:31.969112+0000","last_active":"2024-09-12T18:36:31.969248+0000","last_peered":"2024-09-12T18:36:31.969248+0000","last_clean":"2024-09-12T18:36:31.969248+0000","last_became_active":"2024-09-12T17:10:36.396261+0000","last_became_peered":"2024-09-12T17:10:36.396261+0000","last_unstale":"2024-09-12T18:36:31.969248+0000","last_undegraded":"2024-09-12T18:36:31.969248+0000","last_fullsized":"2024-09-12T18:36:31.969248+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-12T18:36:31.968917+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-12T18:36:31.968917+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.968917+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:43.059228+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49048,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1254,"num_write":464,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'802","reported_seq":2792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.821735+0000","last_change":"2024-09-12T18:36:35.821601+0000","last_active":"2024-09-12T18:36:35.821735+0000","last_peered":"2024-09-12T18:36:35.821735+0000","last_clean":"2024-09-12T18:36:35.821735+0000","last_became_active":"2024-09-12T17:10:38.408710+0000","last_became_peered":"2024-09-12T17:10:38.408710+0000","last_unstale":"2024-09-12T18:36:35.821735+0000","last_undegraded":"2024-09-12T18:36:35.821735+0000","last_fullsized":"2024-09-12T18:36:35.821735+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'802","last_scrub_stamp":"2024-09-12T18:36:35.821417+0000","last_deep_scrub":"268'802","last_deep_scrub_stamp":"2024-09-12T18:36:35.821417+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.821417+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:26.246515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'126","reported_seq":648,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.819158+0000","last_change":"2024-09-12T18:36:39.818917+0000","last_active":"2024-09-12T18:36:39.819158+0000","last_peered":"2024-09-12T18:36:39.819158+0000","last_clean":"2024-09-12T18:36:39.819158+0000","last_became_active":"2024-09-12T17:10:40.417664+0000","last_became_peered":"2024-09-12T17:10:40.417664+0000","last_unstale":"2024-09-12T18:36:39.819158+0000","last_undegraded":"2024-09-12T18:36:39.819158+0000","last_fullsized":"2024-09-12T18:36:39.819158+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'126","last_scrub_stamp":"2024-09-12T18:36:39.818689+0000","last_deep_scrub":"268'126","last_deep_scrub_stamp":"2024-09-12T18:36:39.818689+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.818689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:15.525509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":285,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'887","reported_seq":2356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.581186+0000","last_change":"2024-09-12T18:36:21.581186+0000","last_active":"2024-09-12T18:36:21.581186+0000","last_peered":"2024-09-12T18:36:21.581186+0000","last_clean":"2024-09-12T18:36:21.581186+0000","last_became_active":"2024-09-12T17:10:32.364995+0000","last_became_peered":"2024-09-12T17:10:32.364995+0000","last_unstale":"2024-09-12T18:36:21.581186+0000","last_undegraded":"2024-09-12T18:36:21.581186+0000","last_fullsized":"2024-09-12T18:36:21.581186+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'887","last_scrub_stamp":"2024-09-12T18:36:21.580992+0000","last_deep_scrub":"268'887","last_deep_scrub_stamp":"2024-09-12T18:36:21.580992+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.580992+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:04.860009+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4158,"num_read_kb":3733,"num_write":1245,"num_write_kb":492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'333","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.931436+0000","last_change":"2024-09-12T18:36:10.931436+0000","last_active":"2024-09-12T18:36:10.931436+0000","last_peered":"2024-09-12T18:36:10.931436+0000","last_clean":"2024-09-12T18:36:10.931436+0000","last_became_active":"2024-09-12T17:10:30.393495+0000","last_became_peered":"2024-09-12T17:10:30.393495+0000","last_unstale":"2024-09-12T18:36:10.931436+0000","last_undegraded":"2024-09-12T18:36:10.931436+0000","last_fullsized":"2024-09-12T18:36:10.931436+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-12T18:36:10.931229+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-12T18:36:10.931229+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.931229+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:44.015657+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170230,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":492,"num_read_kb":51876,"num_write":985,"num_write_kb":56464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.456327+0000","last_change":"2024-09-12T18:36:23.456159+0000","last_active":"2024-09-12T18:36:23.456327+0000","last_peered":"2024-09-12T18:36:23.456327+0000","last_clean":"2024-09-12T18:36:23.456327+0000","last_became_active":"2024-09-12T17:10:34.360732+0000","last_became_peered":"2024-09-12T17:10:34.360732+0000","last_unstale":"2024-09-12T18:36:23.456327+0000","last_undegraded":"2024-09-12T18:36:23.456327+0000","last_fullsized":"2024-09-12T18:36:23.456327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:23.455974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:23.455974+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.455974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:57.486813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'515","reported_seq":1190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.626396+0000","last_change":"2024-09-12T18:36:27.626221+0000","last_active":"2024-09-12T18:36:27.626396+0000","last_peered":"2024-09-12T18:36:27.626396+0000","last_clean":"2024-09-12T18:36:27.626396+0000","last_became_active":"2024-09-12T17:10:36.399536+0000","last_became_peered":"2024-09-12T17:10:36.399536+0000","last_unstale":"2024-09-12T18:36:27.626396+0000","last_undegraded":"2024-09-12T18:36:27.626396+0000","last_fullsized":"2024-09-12T18:36:27.626396+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'515","last_scrub_stamp":"2024-09-12T18:36:27.626038+0000","last_deep_scrub":"268'515","last_deep_scrub_stamp":"2024-09-12T18:36:27.626038+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.626038+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:01.780600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89531,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":886,"num_read_kb":2156,"num_write":724,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.504876+0000","last_change":"2024-09-12T18:36:26.504638+0000","last_active":"2024-09-12T18:36:26.504876+0000","last_peered":"2024-09-12T18:36:26.504876+0000","last_clean":"2024-09-12T18:36:26.504876+0000","last_became_active":"2024-09-12T17:10:38.405169+0000","last_became_peered":"2024-09-12T17:10:38.405169+0000","last_unstale":"2024-09-12T18:36:26.504876+0000","last_undegraded":"2024-09-12T18:36:26.504876+0000","last_fullsized":"2024-09-12T18:36:26.504876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.504135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.504135+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.504135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:48.917759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'150","reported_seq":759,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.808624+0000","last_change":"2024-09-12T18:36:33.808477+0000","last_active":"2024-09-12T18:36:33.808624+0000","last_peered":"2024-09-12T18:36:33.808624+0000","last_clean":"2024-09-12T18:36:33.808624+0000","last_became_active":"2024-09-12T17:10:40.409722+0000","last_became_peered":"2024-09-12T17:10:40.409722+0000","last_unstale":"2024-09-12T18:36:33.808624+0000","last_undegraded":"2024-09-12T18:36:33.808624+0000","last_fullsized":"2024-09-12T18:36:33.808624+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'150","last_scrub_stamp":"2024-09-12T18:36:33.808262+0000","last_deep_scrub":"268'150","last_deep_scrub_stamp":"2024-09-12T18:36:33.808262+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.808262+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:12.376177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":508,"num_read_kb":430,"num_write":364,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'825","reported_seq":2351,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.972052+0000","last_change":"2024-09-12T18:36:12.972052+0000","last_active":"2024-09-12T18:36:12.972052+0000","last_peered":"2024-09-12T18:36:12.972052+0000","last_clean":"2024-09-12T18:36:12.972052+0000","last_became_active":"2024-09-12T17:10:32.370915+0000","last_became_peered":"2024-09-12T17:10:32.370915+0000","last_unstale":"2024-09-12T18:36:12.972052+0000","last_undegraded":"2024-09-12T18:36:12.972052+0000","last_fullsized":"2024-09-12T18:36:12.972052+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'825","last_scrub_stamp":"2024-09-12T18:36:12.971870+0000","last_deep_scrub":"268'825","last_deep_scrub_stamp":"2024-09-12T18:36:12.971870+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.971870+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:25.914060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3877,"num_read_kb":3457,"num_write":1088,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'360","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.366818+0000","last_change":"2024-09-12T18:36:07.366750+0000","last_active":"2024-09-12T18:36:07.366818+0000","last_peered":"2024-09-12T18:36:07.366818+0000","last_clean":"2024-09-12T18:36:07.366818+0000","last_became_active":"2024-09-12T17:11:04.868662+0000","last_became_peered":"2024-09-12T17:11:04.868662+0000","last_unstale":"2024-09-12T18:36:07.366818+0000","last_undegraded":"2024-09-12T18:36:07.366818+0000","last_fullsized":"2024-09-12T18:36:07.366818+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'360","last_scrub_stamp":"2024-09-12T18:36:07.366618+0000","last_deep_scrub":"268'360","last_deep_scrub_stamp":"2024-09-12T18:36:07.366618+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.366618+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:46.462039+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456511,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":553,"num_read_kb":17196,"num_write":1231,"num_write_kb":37960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.462220+0000","last_change":"2024-09-12T18:36:22.462220+0000","last_active":"2024-09-12T18:36:22.462220+0000","last_peered":"2024-09-12T18:36:22.462220+0000","last_clean":"2024-09-12T18:36:22.462220+0000","last_became_active":"2024-09-12T17:10:34.363822+0000","last_became_peered":"2024-09-12T17:10:34.363822+0000","last_unstale":"2024-09-12T18:36:22.462220+0000","last_undegraded":"2024-09-12T18:36:22.462220+0000","last_fullsized":"2024-09-12T18:36:22.462220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:22.462029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:22.462029+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.462029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:34.960157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'310","reported_seq":932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.805947+0000","last_change":"2024-09-12T18:36:31.805947+0000","last_active":"2024-09-12T18:36:31.805947+0000","last_peered":"2024-09-12T18:36:31.805947+0000","last_clean":"2024-09-12T18:36:31.805947+0000","last_became_active":"2024-09-12T17:10:36.377677+0000","last_became_peered":"2024-09-12T17:10:36.377677+0000","last_unstale":"2024-09-12T18:36:31.805947+0000","last_undegraded":"2024-09-12T18:36:31.805947+0000","last_fullsized":"2024-09-12T18:36:31.805947+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-12T18:36:31.805723+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-12T18:36:31.805723+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.805723+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:34.615781+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50917,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":528,"num_read_kb":1122,"num_write":460,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.770704+0000","last_change":"2024-09-12T18:36:34.770704+0000","last_active":"2024-09-12T18:36:34.770704+0000","last_peered":"2024-09-12T18:36:34.770704+0000","last_clean":"2024-09-12T18:36:34.770704+0000","last_became_active":"2024-09-12T17:10:38.413429+0000","last_became_peered":"2024-09-12T17:10:38.413429+0000","last_unstale":"2024-09-12T18:36:34.770704+0000","last_undegraded":"2024-09-12T18:36:34.770704+0000","last_fullsized":"2024-09-12T18:36:34.770704+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:34.770523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:34.770523+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.770523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:05.999887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'116","reported_seq":634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.941512+0000","last_change":"2024-09-12T18:36:42.941374+0000","last_active":"2024-09-12T18:36:42.941512+0000","last_peered":"2024-09-12T18:36:42.941512+0000","last_clean":"2024-09-12T18:36:42.941512+0000","last_became_active":"2024-09-12T17:10:40.415270+0000","last_became_peered":"2024-09-12T17:10:40.415270+0000","last_unstale":"2024-09-12T18:36:42.941512+0000","last_undegraded":"2024-09-12T18:36:42.941512+0000","last_fullsized":"2024-09-12T18:36:42.941512+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'116","last_scrub_stamp":"2024-09-12T18:36:42.941131+0000","last_deep_scrub":"268'116","last_deep_scrub_stamp":"2024-09-12T18:36:42.941131+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.941131+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:22.686550+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":272,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'513","reported_seq":2185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.975512+0000","last_change":"2024-09-12T18:36:13.975512+0000","last_active":"2024-09-12T18:36:13.975512+0000","last_peered":"2024-09-12T18:36:13.975512+0000","last_clean":"2024-09-12T18:36:13.975512+0000","last_became_active":"2024-09-12T17:10:32.357121+0000","last_became_peered":"2024-09-12T17:10:32.357121+0000","last_unstale":"2024-09-12T18:36:13.975512+0000","last_undegraded":"2024-09-12T18:36:13.975512+0000","last_fullsized":"2024-09-12T18:36:13.975512+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'513","last_scrub_stamp":"2024-09-12T18:36:13.975293+0000","last_deep_scrub":"268'513","last_deep_scrub_stamp":"2024-09-12T18:36:13.975293+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.975293+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":500,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:27.406648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2802,"num_read_kb":2611,"num_write":616,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'390","reported_seq":1081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.140455+0000","last_change":"2024-09-12T18:36:14.140455+0000","last_active":"2024-09-12T18:36:14.140455+0000","last_peered":"2024-09-12T18:36:14.140455+0000","last_clean":"2024-09-12T18:36:14.140455+0000","last_became_active":"2024-09-12T17:10:30.391780+0000","last_became_peered":"2024-09-12T17:10:30.391780+0000","last_unstale":"2024-09-12T18:36:14.140455+0000","last_undegraded":"2024-09-12T18:36:14.140455+0000","last_fullsized":"2024-09-12T18:36:14.140455+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'390","last_scrub_stamp":"2024-09-12T18:36:14.140207+0000","last_deep_scrub":"268'390","last_deep_scrub_stamp":"2024-09-12T18:36:14.140207+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.140207+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:53.168988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170426,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":660,"num_read_kb":4836,"num_write":1182,"num_write_kb":23965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.876077+0000","last_change":"2024-09-12T18:36:18.876077+0000","last_active":"2024-09-12T18:36:18.876077+0000","last_peered":"2024-09-12T18:36:18.876077+0000","last_clean":"2024-09-12T18:36:18.876077+0000","last_became_active":"2024-09-12T17:10:34.362337+0000","last_became_peered":"2024-09-12T17:10:34.362337+0000","last_unstale":"2024-09-12T18:36:18.876077+0000","last_undegraded":"2024-09-12T18:36:18.876077+0000","last_fullsized":"2024-09-12T18:36:18.876077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:18.875873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:18.875873+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.875873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:35.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'347","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.533049+0000","last_change":"2024-09-12T18:36:27.533049+0000","last_active":"2024-09-12T18:36:27.533049+0000","last_peered":"2024-09-12T18:36:27.533049+0000","last_clean":"2024-09-12T18:36:27.533049+0000","last_became_active":"2024-09-12T17:10:36.389965+0000","last_became_peered":"2024-09-12T17:10:36.389965+0000","last_unstale":"2024-09-12T18:36:27.533049+0000","last_undegraded":"2024-09-12T18:36:27.533049+0000","last_fullsized":"2024-09-12T18:36:27.533049+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-12T18:36:27.532837+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-12T18:36:27.532837+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.532837+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:54.733598+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60342,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":574,"num_read_kb":1242,"num_write":452,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'766","reported_seq":6969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.495465+0000","last_change":"2024-09-12T18:36:25.495465+0000","last_active":"2024-09-12T18:36:25.495465+0000","last_peered":"2024-09-12T18:36:25.495465+0000","last_clean":"2024-09-12T18:36:25.495465+0000","last_became_active":"2024-09-12T17:10:38.397332+0000","last_became_peered":"2024-09-12T17:10:38.397332+0000","last_unstale":"2024-09-12T18:36:25.495465+0000","last_undegraded":"2024-09-12T18:36:25.495465+0000","last_fullsized":"2024-09-12T18:36:25.495465+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'766","last_scrub_stamp":"2024-09-12T18:36:25.495275+0000","last_deep_scrub":"268'766","last_deep_scrub_stamp":"2024-09-12T18:36:25.495275+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.495275+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:58.308585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'153","reported_seq":686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.850700+0000","last_change":"2024-09-12T18:36:29.850700+0000","last_active":"2024-09-12T18:36:29.850700+0000","last_peered":"2024-09-12T18:36:29.850700+0000","last_clean":"2024-09-12T18:36:29.850700+0000","last_became_active":"2024-09-12T17:10:40.423894+0000","last_became_peered":"2024-09-12T17:10:40.423894+0000","last_unstale":"2024-09-12T18:36:29.850700+0000","last_undegraded":"2024-09-12T18:36:29.850700+0000","last_fullsized":"2024-09-12T18:36:29.850700+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'153","last_scrub_stamp":"2024-09-12T18:36:29.850481+0000","last_deep_scrub":"268'153","last_deep_scrub_stamp":"2024-09-12T18:36:29.850481+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.850481+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:41.819877+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1683,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":214,"num_read_kb":204,"num_write":362,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'508","reported_seq":2230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.061396+0000","last_change":"2024-09-12T18:36:16.061396+0000","last_active":"2024-09-12T18:36:16.061396+0000","last_peered":"2024-09-12T18:36:16.061396+0000","last_clean":"2024-09-12T18:36:16.061396+0000","last_became_active":"2024-09-12T17:10:32.361164+0000","last_became_peered":"2024-09-12T17:10:32.361164+0000","last_unstale":"2024-09-12T18:36:16.061396+0000","last_undegraded":"2024-09-12T18:36:16.061396+0000","last_fullsized":"2024-09-12T18:36:16.061396+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'508","last_scrub_stamp":"2024-09-12T18:36:16.061192+0000","last_deep_scrub":"268'508","last_deep_scrub_stamp":"2024-09-12T18:36:16.061192+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.061192+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:04.877347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2673,"num_read_kb":2535,"num_write":607,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'391","reported_seq":1131,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.012782+0000","last_change":"2024-09-12T18:36:07.012522+0000","last_active":"2024-09-12T18:36:07.012782+0000","last_peered":"2024-09-12T18:36:07.012782+0000","last_clean":"2024-09-12T18:36:07.012782+0000","last_became_active":"2024-09-12T17:10:30.361126+0000","last_became_peered":"2024-09-12T17:10:30.361126+0000","last_unstale":"2024-09-12T18:36:07.012782+0000","last_undegraded":"2024-09-12T18:36:07.012782+0000","last_fullsized":"2024-09-12T18:36:07.012782+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'391","last_scrub_stamp":"2024-09-12T18:36:07.012238+0000","last_deep_scrub":"268'391","last_deep_scrub_stamp":"2024-09-12T18:36:07.012238+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.012238+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:22.284310+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8882037,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":691,"num_read_kb":57357,"num_write":1297,"num_write_kb":69062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1488,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.919834+0000","last_change":"2024-09-12T18:36:29.919699+0000","last_active":"2024-09-12T18:36:29.919834+0000","last_peered":"2024-09-12T18:36:29.919834+0000","last_clean":"2024-09-12T18:36:29.919834+0000","last_became_active":"2024-09-12T17:10:34.367608+0000","last_became_peered":"2024-09-12T17:10:34.367608+0000","last_unstale":"2024-09-12T18:36:29.919834+0000","last_undegraded":"2024-09-12T18:36:29.919834+0000","last_fullsized":"2024-09-12T18:36:29.919834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:29.919514+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:29.919514+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.919514+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:59.551307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'127","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.973454+0000","last_change":"2024-09-12T18:36:33.973454+0000","last_active":"2024-09-12T18:36:33.973454+0000","last_peered":"2024-09-12T18:36:33.973454+0000","last_clean":"2024-09-12T18:36:33.973454+0000","last_became_active":"2024-09-12T17:10:36.921242+0000","last_became_peered":"2024-09-12T17:10:36.921242+0000","last_unstale":"2024-09-12T18:36:33.973454+0000","last_undegraded":"2024-09-12T18:36:33.973454+0000","last_fullsized":"2024-09-12T18:36:33.973454+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-09-12T18:36:33.973249+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-09-12T18:36:33.973249+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.973249+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:56.412447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'781","reported_seq":2895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.125502+0000","last_change":"2024-09-12T18:36:25.125502+0000","last_active":"2024-09-12T18:36:25.125502+0000","last_peered":"2024-09-12T18:36:25.125502+0000","last_clean":"2024-09-12T18:36:25.125502+0000","last_became_active":"2024-09-12T17:10:38.397242+0000","last_became_peered":"2024-09-12T17:10:38.397242+0000","last_unstale":"2024-09-12T18:36:25.125502+0000","last_undegraded":"2024-09-12T18:36:25.125502+0000","last_fullsized":"2024-09-12T18:36:25.125502+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'781","last_scrub_stamp":"2024-09-12T18:36:25.125289+0000","last_deep_scrub":"268'781","last_deep_scrub_stamp":"2024-09-12T18:36:25.125289+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.125289+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:01.514681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'139","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.760416+0000","last_change":"2024-09-12T18:36:38.760416+0000","last_active":"2024-09-12T18:36:38.760416+0000","last_peered":"2024-09-12T18:36:38.760416+0000","last_clean":"2024-09-12T18:36:38.760416+0000","last_became_active":"2024-09-12T17:10:40.415831+0000","last_became_peered":"2024-09-12T17:10:40.415831+0000","last_unstale":"2024-09-12T18:36:38.760416+0000","last_undegraded":"2024-09-12T18:36:38.760416+0000","last_fullsized":"2024-09-12T18:36:38.760416+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'139","last_scrub_stamp":"2024-09-12T18:36:38.760146+0000","last_deep_scrub":"268'139","last_deep_scrub_stamp":"2024-09-12T18:36:38.760146+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.760146+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:42.944767+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":150,"num_write":326,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'563","reported_seq":2088,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.989105+0000","last_change":"2024-09-12T18:36:21.988883+0000","last_active":"2024-09-12T18:36:21.989105+0000","last_peered":"2024-09-12T18:36:21.989105+0000","last_clean":"2024-09-12T18:36:21.989105+0000","last_became_active":"2024-09-12T17:10:32.366967+0000","last_became_peered":"2024-09-12T17:10:32.366967+0000","last_unstale":"2024-09-12T18:36:21.989105+0000","last_undegraded":"2024-09-12T18:36:21.989105+0000","last_fullsized":"2024-09-12T18:36:21.989105+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'563","last_scrub_stamp":"2024-09-12T18:36:21.988625+0000","last_deep_scrub":"268'563","last_deep_scrub_stamp":"2024-09-12T18:36:21.988625+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.988625+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:25.834312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2878,"num_read_kb":2622,"num_write":716,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'383","reported_seq":1076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.937045+0000","last_change":"2024-09-12T18:36:06.936973+0000","last_active":"2024-09-12T18:36:06.937045+0000","last_peered":"2024-09-12T18:36:06.937045+0000","last_clean":"2024-09-12T18:36:06.937045+0000","last_became_active":"2024-09-12T17:10:30.360368+0000","last_became_peered":"2024-09-12T17:10:30.360368+0000","last_unstale":"2024-09-12T18:36:06.937045+0000","last_undegraded":"2024-09-12T18:36:06.937045+0000","last_fullsized":"2024-09-12T18:36:06.937045+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-12T18:36:06.936843+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-12T18:36:06.936843+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.936843+0000","objects_scrubbed":8,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:18.264741+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4303946,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":608,"num_read_kb":11061,"num_write":1240,"num_write_kb":24095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.864724+0000","last_change":"2024-09-12T18:36:26.864724+0000","last_active":"2024-09-12T18:36:26.864724+0000","last_peered":"2024-09-12T18:36:26.864724+0000","last_clean":"2024-09-12T18:36:26.864724+0000","last_became_active":"2024-09-12T17:10:34.354009+0000","last_became_peered":"2024-09-12T17:10:34.354009+0000","last_unstale":"2024-09-12T18:36:26.864724+0000","last_undegraded":"2024-09-12T18:36:26.864724+0000","last_fullsized":"2024-09-12T18:36:26.864724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.864521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.864521+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.864521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:13.936489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'386","reported_seq":1043,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.929178+0000","last_change":"2024-09-12T18:36:34.929178+0000","last_active":"2024-09-12T18:36:34.929178+0000","last_peered":"2024-09-12T18:36:34.929178+0000","last_clean":"2024-09-12T18:36:34.929178+0000","last_became_active":"2024-09-12T17:10:36.392271+0000","last_became_peered":"2024-09-12T17:10:36.392271+0000","last_unstale":"2024-09-12T18:36:34.929178+0000","last_undegraded":"2024-09-12T18:36:34.929178+0000","last_fullsized":"2024-09-12T18:36:34.929178+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'386","last_scrub_stamp":"2024-09-12T18:36:34.928990+0000","last_deep_scrub":"268'386","last_deep_scrub_stamp":"2024-09-12T18:36:34.928990+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.928990+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:30.954181+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45147,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":615,"num_read_kb":1214,"num_write":468,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.096343+0000","last_change":"2024-09-12T18:36:24.096343+0000","last_active":"2024-09-12T18:36:24.096343+0000","last_peered":"2024-09-12T18:36:24.096343+0000","last_clean":"2024-09-12T18:36:24.096343+0000","last_became_active":"2024-09-12T17:10:38.398743+0000","last_became_peered":"2024-09-12T17:10:38.398743+0000","last_unstale":"2024-09-12T18:36:24.096343+0000","last_undegraded":"2024-09-12T18:36:24.096343+0000","last_fullsized":"2024-09-12T18:36:24.096343+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:24.096160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:24.096160+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.096160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:15:10.883351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'108","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.907368+0000","last_change":"2024-09-12T18:36:26.907368+0000","last_active":"2024-09-12T18:36:26.907368+0000","last_peered":"2024-09-12T18:36:26.907368+0000","last_clean":"2024-09-12T18:36:26.907368+0000","last_became_active":"2024-09-12T17:10:40.410710+0000","last_became_peered":"2024-09-12T17:10:40.410710+0000","last_unstale":"2024-09-12T18:36:26.907368+0000","last_undegraded":"2024-09-12T18:36:26.907368+0000","last_fullsized":"2024-09-12T18:36:26.907368+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'108","last_scrub_stamp":"2024-09-12T18:36:26.907174+0000","last_deep_scrub":"268'108","last_deep_scrub_stamp":"2024-09-12T18:36:26.907174+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.907174+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:55.084708+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":239,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'450","reported_seq":2013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.163747+0000","last_change":"2024-09-12T18:36:13.163599+0000","last_active":"2024-09-12T18:36:13.163747+0000","last_peered":"2024-09-12T18:36:13.163747+0000","last_clean":"2024-09-12T18:36:13.163747+0000","last_became_active":"2024-09-12T17:10:32.366571+0000","last_became_peered":"2024-09-12T17:10:32.366571+0000","last_unstale":"2024-09-12T18:36:13.163747+0000","last_undegraded":"2024-09-12T18:36:13.163747+0000","last_fullsized":"2024-09-12T18:36:13.163747+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'450","last_scrub_stamp":"2024-09-12T18:36:13.163413+0000","last_deep_scrub":"268'450","last_deep_scrub_stamp":"2024-09-12T18:36:13.163413+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.163413+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:42.296285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2259,"num_read_kb":2146,"num_write":500,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":645,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.003510+0000","last_change":"2024-09-12T18:36:09.003372+0000","last_active":"2024-09-12T18:36:09.003510+0000","last_peered":"2024-09-12T18:36:09.003510+0000","last_clean":"2024-09-12T18:36:09.003510+0000","last_became_active":"2024-09-12T17:10:13.024652+0000","last_became_peered":"2024-09-12T17:10:13.024652+0000","last_unstale":"2024-09-12T18:36:09.003510+0000","last_undegraded":"2024-09-12T18:36:09.003510+0000","last_fullsized":"2024-09-12T18:36:09.003510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-12T18:36:09.003177+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-12T18:36:09.003177+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.003177+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:13.554583+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.977110+0000","last_change":"2024-09-12T18:36:08.977110+0000","last_active":"2024-09-12T18:36:08.977110+0000","last_peered":"2024-09-12T18:36:08.977110+0000","last_clean":"2024-09-12T18:36:08.977110+0000","last_became_active":"2024-09-12T17:10:18.073547+0000","last_became_peered":"2024-09-12T17:10:18.073547+0000","last_unstale":"2024-09-12T18:36:08.977110+0000","last_undegraded":"2024-09-12T18:36:08.977110+0000","last_fullsized":"2024-09-12T18:36:08.977110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:08.976931+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:08.976931+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.976931+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:40.637153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010552039999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'325","reported_seq":1042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.967233+0000","last_change":"2024-09-12T18:36:07.967233+0000","last_active":"2024-09-12T18:36:07.967233+0000","last_peered":"2024-09-12T18:36:07.967233+0000","last_clean":"2024-09-12T18:36:07.967233+0000","last_became_active":"2024-09-12T17:10:30.395026+0000","last_became_peered":"2024-09-12T17:10:30.395026+0000","last_unstale":"2024-09-12T18:36:07.967233+0000","last_undegraded":"2024-09-12T18:36:07.967233+0000","last_fullsized":"2024-09-12T18:36:07.967233+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'325","last_scrub_stamp":"2024-09-12T18:36:07.967135+0000","last_deep_scrub":"268'325","last_deep_scrub_stamp":"2024-09-12T18:36:07.967135+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.967135+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:46.811857+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048618,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":151053,"num_write":1004,"num_write_kb":34461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"268'4","reported_seq":1013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.935798+0000","last_change":"2024-09-12T18:36:24.935798+0000","last_active":"2024-09-12T18:36:24.935798+0000","last_peered":"2024-09-12T18:36:24.935798+0000","last_clean":"2024-09-12T18:36:24.935798+0000","last_became_active":"2024-09-12T17:10:34.363615+0000","last_became_peered":"2024-09-12T17:10:34.363615+0000","last_unstale":"2024-09-12T18:36:24.935798+0000","last_undegraded":"2024-09-12T18:36:24.935798+0000","last_fullsized":"2024-09-12T18:36:24.935798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T18:36:24.935619+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T18:36:24.935619+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.935619+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:43.313804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":734,"num_read_kb":732,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'760","reported_seq":1499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.930335+0000","last_change":"2024-09-12T18:36:33.930201+0000","last_active":"2024-09-12T18:36:33.930335+0000","last_peered":"2024-09-12T18:36:33.930335+0000","last_clean":"2024-09-12T18:36:33.930335+0000","last_became_active":"2024-09-12T17:10:36.395060+0000","last_became_peered":"2024-09-12T17:10:36.395060+0000","last_unstale":"2024-09-12T18:36:33.930335+0000","last_undegraded":"2024-09-12T18:36:33.930335+0000","last_fullsized":"2024-09-12T18:36:33.930335+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'760","last_scrub_stamp":"2024-09-12T18:36:33.930021+0000","last_deep_scrub":"268'760","last_deep_scrub_stamp":"2024-09-12T18:36:33.930021+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.930021+0000","objects_scrubbed":7,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:41.316757+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142312,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1468,"num_read_kb":3324,"num_write":1428,"num_write_kb":1256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106668,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.692540+0000","last_change":"2024-09-12T18:36:32.692277+0000","last_active":"2024-09-12T18:36:32.692540+0000","last_peered":"2024-09-12T18:36:32.692540+0000","last_clean":"2024-09-12T18:36:32.692540+0000","last_became_active":"2024-09-12T17:10:38.413042+0000","last_became_peered":"2024-09-12T17:10:38.413042+0000","last_unstale":"2024-09-12T18:36:32.692540+0000","last_undegraded":"2024-09-12T18:36:32.692540+0000","last_fullsized":"2024-09-12T18:36:32.692540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:32.692076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:32.692076+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.692076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:46.407882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'216","reported_seq":948,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.183714+0000","last_change":"2024-09-12T18:36:29.183568+0000","last_active":"2024-09-12T18:36:29.183714+0000","last_peered":"2024-09-12T18:36:29.183714+0000","last_clean":"2024-09-12T18:36:29.183714+0000","last_became_active":"2024-09-12T17:10:40.413341+0000","last_became_peered":"2024-09-12T17:10:40.413341+0000","last_unstale":"2024-09-12T18:36:29.183714+0000","last_undegraded":"2024-09-12T18:36:29.183714+0000","last_fullsized":"2024-09-12T18:36:29.183714+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'216","last_scrub_stamp":"2024-09-12T18:36:29.183338+0000","last_deep_scrub":"268'216","last_deep_scrub_stamp":"2024-09-12T18:36:29.183338+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.183338+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:56.524847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":511,"num_write":461,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'396","reported_seq":1843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.589658+0000","last_change":"2024-09-12T18:36:13.589512+0000","last_active":"2024-09-12T18:36:13.589658+0000","last_peered":"2024-09-12T18:36:13.589658+0000","last_clean":"2024-09-12T18:36:13.589658+0000","last_became_active":"2024-09-12T17:10:32.364798+0000","last_became_peered":"2024-09-12T17:10:32.364798+0000","last_unstale":"2024-09-12T18:36:13.589658+0000","last_undegraded":"2024-09-12T18:36:13.589658+0000","last_fullsized":"2024-09-12T18:36:13.589658+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'396","last_scrub_stamp":"2024-09-12T18:36:13.589303+0000","last_deep_scrub":"268'396","last_deep_scrub_stamp":"2024-09-12T18:36:13.589303+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.589303+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:17.430737+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2015,"num_read_kb":1907,"num_write":451,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":552,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.017279+0000","last_change":"2024-09-12T18:36:11.017052+0000","last_active":"2024-09-12T18:36:11.017279+0000","last_peered":"2024-09-12T18:36:11.017279+0000","last_clean":"2024-09-12T18:36:11.017279+0000","last_became_active":"2024-09-12T17:10:18.073016+0000","last_became_peered":"2024-09-12T17:10:18.073016+0000","last_unstale":"2024-09-12T18:36:11.017279+0000","last_undegraded":"2024-09-12T18:36:11.017279+0000","last_fullsized":"2024-09-12T18:36:11.017279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:11.016844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:11.016844+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.016844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:43.713164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098613699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'345","reported_seq":1030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:05.576045+0000","last_change":"2024-09-12T18:36:05.576045+0000","last_active":"2024-09-12T18:36:05.576045+0000","last_peered":"2024-09-12T18:36:05.576045+0000","last_clean":"2024-09-12T18:36:05.576045+0000","last_became_active":"2024-09-12T17:10:30.355237+0000","last_became_peered":"2024-09-12T17:10:30.355237+0000","last_unstale":"2024-09-12T18:36:05.576045+0000","last_undegraded":"2024-09-12T18:36:05.576045+0000","last_fullsized":"2024-09-12T18:36:05.576045+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'345","last_scrub_stamp":"2024-09-12T18:36:05.575700+0000","last_deep_scrub":"268'345","last_deep_scrub_stamp":"2024-09-12T18:36:05.575700+0000","last_clean_scrub_stamp":"2024-09-12T18:36:05.575700+0000","objects_scrubbed":8,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:37.874770+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262274,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":552,"num_read_kb":28524,"num_write":1156,"num_write_kb":35154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.961456+0000","last_change":"2024-09-12T18:36:28.961219+0000","last_active":"2024-09-12T18:36:28.961456+0000","last_peered":"2024-09-12T18:36:28.961456+0000","last_clean":"2024-09-12T18:36:28.961456+0000","last_became_active":"2024-09-12T17:10:34.366826+0000","last_became_peered":"2024-09-12T17:10:34.366826+0000","last_unstale":"2024-09-12T18:36:28.961456+0000","last_undegraded":"2024-09-12T18:36:28.961456+0000","last_fullsized":"2024-09-12T18:36:28.961456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:28.961015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:28.961015+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.961015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:28.657697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1394","reported_seq":3392,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.860034+0000","last_change":"2024-09-12T18:36:30.860034+0000","last_active":"2024-09-12T18:36:30.860034+0000","last_peered":"2024-09-12T18:36:30.860034+0000","last_clean":"2024-09-12T18:36:30.860034+0000","last_became_active":"2024-09-12T17:10:36.398283+0000","last_became_peered":"2024-09-12T17:10:36.398283+0000","last_unstale":"2024-09-12T18:36:30.860034+0000","last_undegraded":"2024-09-12T18:36:30.860034+0000","last_fullsized":"2024-09-12T18:36:30.860034+0000","mapping_epoch":31,"log_start":"268'1300","ondisk_log_start":"268'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1394","last_scrub_stamp":"2024-09-12T18:36:30.859791+0000","last_deep_scrub":"268'1394","last_deep_scrub_stamp":"2024-09-12T18:36:30.859791+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.859791+0000","objects_scrubbed":11,"log_size":94,"log_dups_size":1300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:58.008271+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157765,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2194,"num_read_kb":4204,"num_write":1286,"num_write_kb":1080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.002470+0000","last_change":"2024-09-12T18:36:36.002470+0000","last_active":"2024-09-12T18:36:36.002470+0000","last_peered":"2024-09-12T18:36:36.002470+0000","last_clean":"2024-09-12T18:36:36.002470+0000","last_became_active":"2024-09-12T17:10:38.407002+0000","last_became_peered":"2024-09-12T17:10:38.407002+0000","last_unstale":"2024-09-12T18:36:36.002470+0000","last_undegraded":"2024-09-12T18:36:36.002470+0000","last_fullsized":"2024-09-12T18:36:36.002470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:36.002257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:36.002257+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.002257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:16.711812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'127","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.822482+0000","last_change":"2024-09-12T18:36:34.822482+0000","last_active":"2024-09-12T18:36:34.822482+0000","last_peered":"2024-09-12T18:36:34.822482+0000","last_clean":"2024-09-12T18:36:34.822482+0000","last_became_active":"2024-09-12T17:10:40.770362+0000","last_became_peered":"2024-09-12T17:10:40.770362+0000","last_unstale":"2024-09-12T18:36:34.822482+0000","last_undegraded":"2024-09-12T18:36:34.822482+0000","last_fullsized":"2024-09-12T18:36:34.822482+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-09-12T18:36:34.822272+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-09-12T18:36:34.822272+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.822272+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:28.926701+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":150,"num_write":307,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'427","reported_seq":2047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.925962+0000","last_change":"2024-09-12T18:36:17.925833+0000","last_active":"2024-09-12T18:36:17.925962+0000","last_peered":"2024-09-12T18:36:17.925962+0000","last_clean":"2024-09-12T18:36:17.925962+0000","last_became_active":"2024-09-12T17:10:32.361184+0000","last_became_peered":"2024-09-12T17:10:32.361184+0000","last_unstale":"2024-09-12T18:36:17.925962+0000","last_undegraded":"2024-09-12T18:36:17.925962+0000","last_fullsized":"2024-09-12T18:36:17.925962+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'427","last_scrub_stamp":"2024-09-12T18:36:17.925631+0000","last_deep_scrub":"268'427","last_deep_scrub_stamp":"2024-09-12T18:36:17.925631+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.925631+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:12.940790+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2375,"num_read_kb":2259,"num_write":493,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":555,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.366031+0000","last_change":"2024-09-12T18:36:08.366031+0000","last_active":"2024-09-12T18:36:08.366031+0000","last_peered":"2024-09-12T18:36:08.366031+0000","last_clean":"2024-09-12T18:36:08.366031+0000","last_became_active":"2024-09-12T17:10:18.210168+0000","last_became_peered":"2024-09-12T17:10:18.210168+0000","last_unstale":"2024-09-12T18:36:08.366031+0000","last_undegraded":"2024-09-12T18:36:08.366031+0000","last_fullsized":"2024-09-12T18:36:08.366031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:08.365841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:08.365841+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.365841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:46.140147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001219171,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'335","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:05.824128+0000","last_change":"2024-09-12T18:36:05.823972+0000","last_active":"2024-09-12T18:36:05.824128+0000","last_peered":"2024-09-12T18:36:05.824128+0000","last_clean":"2024-09-12T18:36:05.824128+0000","last_became_active":"2024-09-12T17:10:30.405641+0000","last_became_peered":"2024-09-12T17:10:30.405641+0000","last_unstale":"2024-09-12T18:36:05.824128+0000","last_undegraded":"2024-09-12T18:36:05.824128+0000","last_fullsized":"2024-09-12T18:36:05.824128+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'335","last_scrub_stamp":"2024-09-12T18:36:05.823746+0000","last_deep_scrub":"268'335","last_deep_scrub_stamp":"2024-09-12T18:36:05.823746+0000","last_clean_scrub_stamp":"2024-09-12T18:36:05.823746+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:01.852500+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":435,"num_read_kb":15806,"num_write":1012,"num_write_kb":36297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.440642+0000","last_change":"2024-09-12T18:36:18.440485+0000","last_active":"2024-09-12T18:36:18.440642+0000","last_peered":"2024-09-12T18:36:18.440642+0000","last_clean":"2024-09-12T18:36:18.440642+0000","last_became_active":"2024-09-12T17:10:34.367870+0000","last_became_peered":"2024-09-12T17:10:34.367870+0000","last_unstale":"2024-09-12T18:36:18.440642+0000","last_undegraded":"2024-09-12T18:36:18.440642+0000","last_fullsized":"2024-09-12T18:36:18.440642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:18.440311+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:18.440311+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.440311+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:10.134048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'354","reported_seq":1955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.993747+0000","last_change":"2024-09-12T18:36:30.993747+0000","last_active":"2024-09-12T18:36:30.993747+0000","last_peered":"2024-09-12T18:36:30.993747+0000","last_clean":"2024-09-12T18:36:30.993747+0000","last_became_active":"2024-09-12T17:10:36.922321+0000","last_became_peered":"2024-09-12T17:10:36.922321+0000","last_unstale":"2024-09-12T18:36:30.993747+0000","last_undegraded":"2024-09-12T18:36:30.993747+0000","last_fullsized":"2024-09-12T18:36:30.993747+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'354","last_scrub_stamp":"2024-09-12T18:36:30.993518+0000","last_deep_scrub":"268'354","last_deep_scrub_stamp":"2024-09-12T18:36:30.993518+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.993518+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:54.363804+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":291,"num_read_kb":281,"num_write":273,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.729064+0000","last_change":"2024-09-12T18:36:31.729064+0000","last_active":"2024-09-12T18:36:31.729064+0000","last_peered":"2024-09-12T18:36:31.729064+0000","last_clean":"2024-09-12T18:36:31.729064+0000","last_became_active":"2024-09-12T17:10:38.413459+0000","last_became_peered":"2024-09-12T17:10:38.413459+0000","last_unstale":"2024-09-12T18:36:31.729064+0000","last_undegraded":"2024-09-12T18:36:31.729064+0000","last_fullsized":"2024-09-12T18:36:31.729064+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:31.728883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:31.728883+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.728883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:06.064463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'234","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.912795+0000","last_change":"2024-09-12T18:36:44.912795+0000","last_active":"2024-09-12T18:36:44.912795+0000","last_peered":"2024-09-12T18:36:44.912795+0000","last_clean":"2024-09-12T18:36:44.912795+0000","last_became_active":"2024-09-12T17:10:40.414712+0000","last_became_peered":"2024-09-12T17:10:40.414712+0000","last_unstale":"2024-09-12T18:36:44.912795+0000","last_undegraded":"2024-09-12T18:36:44.912795+0000","last_fullsized":"2024-09-12T18:36:44.912795+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'234","last_scrub_stamp":"2024-09-12T18:36:44.912612+0000","last_deep_scrub":"268'234","last_deep_scrub_stamp":"2024-09-12T18:36:44.912612+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.912612+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:42.219443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":496,"num_read_kb":517,"num_write":496,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'463","reported_seq":1990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.909274+0000","last_change":"2024-09-12T18:36:12.909274+0000","last_active":"2024-09-12T18:36:12.909274+0000","last_peered":"2024-09-12T18:36:12.909274+0000","last_clean":"2024-09-12T18:36:12.909274+0000","last_became_active":"2024-09-12T17:10:32.360853+0000","last_became_peered":"2024-09-12T17:10:32.360853+0000","last_unstale":"2024-09-12T18:36:12.909274+0000","last_undegraded":"2024-09-12T18:36:12.909274+0000","last_fullsized":"2024-09-12T18:36:12.909274+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'463","last_scrub_stamp":"2024-09-12T18:36:12.909073+0000","last_deep_scrub":"268'463","last_deep_scrub_stamp":"2024-09-12T18:36:12.909073+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.909073+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:48.700492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2461,"num_read_kb":2304,"num_write":540,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":551,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.993172+0000","last_change":"2024-09-12T18:36:07.993172+0000","last_active":"2024-09-12T18:36:07.993172+0000","last_peered":"2024-09-12T18:36:07.993172+0000","last_clean":"2024-09-12T18:36:07.993172+0000","last_became_active":"2024-09-12T17:10:18.072719+0000","last_became_peered":"2024-09-12T17:10:18.072719+0000","last_unstale":"2024-09-12T18:36:07.993172+0000","last_undegraded":"2024-09-12T18:36:07.993172+0000","last_fullsized":"2024-09-12T18:36:07.993172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T18:36:07.992994+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T18:36:07.992994+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.992994+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:43.943090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022239349999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'390","reported_seq":1108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.978577+0000","last_change":"2024-09-12T18:36:09.978577+0000","last_active":"2024-09-12T18:36:09.978577+0000","last_peered":"2024-09-12T18:36:09.978577+0000","last_clean":"2024-09-12T18:36:09.978577+0000","last_became_active":"2024-09-12T17:10:30.354850+0000","last_became_peered":"2024-09-12T17:10:30.354850+0000","last_unstale":"2024-09-12T18:36:09.978577+0000","last_undegraded":"2024-09-12T18:36:09.978577+0000","last_fullsized":"2024-09-12T18:36:09.978577+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'390","last_scrub_stamp":"2024-09-12T18:36:09.978364+0000","last_deep_scrub":"268'390","last_deep_scrub_stamp":"2024-09-12T18:36:09.978364+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.978364+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:24.725033+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194319,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":615,"num_read_kb":44146,"num_write":1329,"num_write_kb":42918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.628005+0000","last_change":"2024-09-12T18:36:24.628005+0000","last_active":"2024-09-12T18:36:24.628005+0000","last_peered":"2024-09-12T18:36:24.628005+0000","last_clean":"2024-09-12T18:36:24.628005+0000","last_became_active":"2024-09-12T17:10:34.358926+0000","last_became_peered":"2024-09-12T17:10:34.358926+0000","last_unstale":"2024-09-12T18:36:24.628005+0000","last_undegraded":"2024-09-12T18:36:24.628005+0000","last_fullsized":"2024-09-12T18:36:24.628005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:24.627810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:24.627810+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.627810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:40.687387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'178","reported_seq":771,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.909886+0000","last_change":"2024-09-12T18:36:31.909641+0000","last_active":"2024-09-12T18:36:31.909886+0000","last_peered":"2024-09-12T18:36:31.909886+0000","last_clean":"2024-09-12T18:36:31.909886+0000","last_became_active":"2024-09-12T17:10:36.395658+0000","last_became_peered":"2024-09-12T17:10:36.395658+0000","last_unstale":"2024-09-12T18:36:31.909886+0000","last_undegraded":"2024-09-12T18:36:31.909886+0000","last_fullsized":"2024-09-12T18:36:31.909886+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'178","last_scrub_stamp":"2024-09-12T18:36:31.909396+0000","last_deep_scrub":"268'178","last_deep_scrub_stamp":"2024-09-12T18:36:31.909396+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.909396+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:46.201653+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":215,"num_read_kb":209,"num_write":154,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.111218+0000","last_change":"2024-09-12T18:36:21.111044+0000","last_active":"2024-09-12T18:36:21.111218+0000","last_peered":"2024-09-12T18:36:21.111218+0000","last_clean":"2024-09-12T18:36:21.111218+0000","last_became_active":"2024-09-12T17:10:38.414045+0000","last_became_peered":"2024-09-12T17:10:38.414045+0000","last_unstale":"2024-09-12T18:36:21.111218+0000","last_undegraded":"2024-09-12T18:36:21.111218+0000","last_fullsized":"2024-09-12T18:36:21.111218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:21.110869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:21.110869+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.110869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:19.693627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'152","reported_seq":749,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.836211+0000","last_change":"2024-09-12T18:36:40.836069+0000","last_active":"2024-09-12T18:36:40.836211+0000","last_peered":"2024-09-12T18:36:40.836211+0000","last_clean":"2024-09-12T18:36:40.836211+0000","last_became_active":"2024-09-12T17:10:40.420995+0000","last_became_peered":"2024-09-12T17:10:40.420995+0000","last_unstale":"2024-09-12T18:36:40.836211+0000","last_undegraded":"2024-09-12T18:36:40.836211+0000","last_fullsized":"2024-09-12T18:36:40.836211+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'152","last_scrub_stamp":"2024-09-12T18:36:40.835889+0000","last_deep_scrub":"268'152","last_deep_scrub_stamp":"2024-09-12T18:36:40.835889+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.835889+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:02.982789+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":383,"num_read_kb":354,"num_write":368,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'864","reported_seq":2550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.911046+0000","last_change":"2024-09-12T18:36:13.911046+0000","last_active":"2024-09-12T18:36:13.911046+0000","last_peered":"2024-09-12T18:36:13.911046+0000","last_clean":"2024-09-12T18:36:13.911046+0000","last_became_active":"2024-09-12T17:10:32.361696+0000","last_became_peered":"2024-09-12T17:10:32.361696+0000","last_unstale":"2024-09-12T18:36:13.911046+0000","last_undegraded":"2024-09-12T18:36:13.911046+0000","last_fullsized":"2024-09-12T18:36:13.911046+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'864","last_scrub_stamp":"2024-09-12T18:36:13.910873+0000","last_deep_scrub":"268'864","last_deep_scrub_stamp":"2024-09-12T18:36:13.910873+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.910873+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:05.088162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4191,"num_read_kb":3806,"num_write":1162,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'312","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.944399+0000","last_change":"2024-09-12T18:36:09.944245+0000","last_active":"2024-09-12T18:36:09.944399+0000","last_peered":"2024-09-12T18:36:09.944399+0000","last_clean":"2024-09-12T18:36:09.944399+0000","last_became_active":"2024-09-12T17:10:30.354730+0000","last_became_peered":"2024-09-12T17:10:30.354730+0000","last_unstale":"2024-09-12T18:36:09.944399+0000","last_undegraded":"2024-09-12T18:36:09.944399+0000","last_fullsized":"2024-09-12T18:36:09.944399+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'312","last_scrub_stamp":"2024-09-12T18:36:09.944018+0000","last_deep_scrub":"268'312","last_deep_scrub_stamp":"2024-09-12T18:36:09.944018+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.944018+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:20.773386+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":12992,"num_write":926,"num_write_kb":30670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":551,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.814786+0000","last_change":"2024-09-12T18:36:06.814786+0000","last_active":"2024-09-12T18:36:06.814786+0000","last_peered":"2024-09-12T18:36:06.814786+0000","last_clean":"2024-09-12T18:36:06.814786+0000","last_became_active":"2024-09-12T17:10:18.209658+0000","last_became_peered":"2024-09-12T17:10:18.209658+0000","last_unstale":"2024-09-12T18:36:06.814786+0000","last_undegraded":"2024-09-12T18:36:06.814786+0000","last_fullsized":"2024-09-12T18:36:06.814786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:06.814685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:06.814685+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.814685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:44.195873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010531659999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.607924+0000","last_change":"2024-09-12T18:36:26.607924+0000","last_active":"2024-09-12T18:36:26.607924+0000","last_peered":"2024-09-12T18:36:26.607924+0000","last_clean":"2024-09-12T18:36:26.607924+0000","last_became_active":"2024-09-12T17:10:34.361845+0000","last_became_peered":"2024-09-12T17:10:34.361845+0000","last_unstale":"2024-09-12T18:36:26.607924+0000","last_undegraded":"2024-09-12T18:36:26.607924+0000","last_fullsized":"2024-09-12T18:36:26.607924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.607740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.607740+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.607740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:28.628006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'685","reported_seq":1406,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.663454+0000","last_change":"2024-09-12T18:36:28.663314+0000","last_active":"2024-09-12T18:36:28.663454+0000","last_peered":"2024-09-12T18:36:28.663454+0000","last_clean":"2024-09-12T18:36:28.663454+0000","last_became_active":"2024-09-12T17:10:36.398917+0000","last_became_peered":"2024-09-12T17:10:36.398917+0000","last_unstale":"2024-09-12T18:36:28.663454+0000","last_undegraded":"2024-09-12T18:36:28.663454+0000","last_fullsized":"2024-09-12T18:36:28.663454+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'685","last_scrub_stamp":"2024-09-12T18:36:28.663087+0000","last_deep_scrub":"268'685","last_deep_scrub_stamp":"2024-09-12T18:36:28.663087+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.663087+0000","objects_scrubbed":9,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:26.716240+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100883,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1833,"num_read_kb":3243,"num_write":2400,"num_write_kb":2201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":509380,"num_omap_keys":1154,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.708005+0000","last_change":"2024-09-12T18:36:34.708005+0000","last_active":"2024-09-12T18:36:34.708005+0000","last_peered":"2024-09-12T18:36:34.708005+0000","last_clean":"2024-09-12T18:36:34.708005+0000","last_became_active":"2024-09-12T17:10:38.400868+0000","last_became_peered":"2024-09-12T17:10:38.400868+0000","last_unstale":"2024-09-12T18:36:34.708005+0000","last_undegraded":"2024-09-12T18:36:34.708005+0000","last_fullsized":"2024-09-12T18:36:34.708005+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:34.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:34.707795+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.707795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:35.737755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'140","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:40.780796+0000","last_change":"2024-09-12T18:36:40.780796+0000","last_active":"2024-09-12T18:36:40.780796+0000","last_peered":"2024-09-12T18:36:40.780796+0000","last_clean":"2024-09-12T18:36:40.780796+0000","last_became_active":"2024-09-12T17:10:40.771185+0000","last_became_peered":"2024-09-12T17:10:40.771185+0000","last_unstale":"2024-09-12T18:36:40.780796+0000","last_undegraded":"2024-09-12T18:36:40.780796+0000","last_fullsized":"2024-09-12T18:36:40.780796+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'140","last_scrub_stamp":"2024-09-12T18:36:40.780568+0000","last_deep_scrub":"268'140","last_deep_scrub_stamp":"2024-09-12T18:36:40.780568+0000","last_clean_scrub_stamp":"2024-09-12T18:36:40.780568+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:20.238458+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":180,"num_write":328,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'473","reported_seq":2171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.533222+0000","last_change":"2024-09-12T18:36:18.533222+0000","last_active":"2024-09-12T18:36:18.533222+0000","last_peered":"2024-09-12T18:36:18.533222+0000","last_clean":"2024-09-12T18:36:18.533222+0000","last_became_active":"2024-09-12T17:10:32.354795+0000","last_became_peered":"2024-09-12T17:10:32.354795+0000","last_unstale":"2024-09-12T18:36:18.533222+0000","last_undegraded":"2024-09-12T18:36:18.533222+0000","last_fullsized":"2024-09-12T18:36:18.533222+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'473","last_scrub_stamp":"2024-09-12T18:36:18.532993+0000","last_deep_scrub":"268'473","last_deep_scrub_stamp":"2024-09-12T18:36:18.532993+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.532993+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:56.579630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2620,"num_read_kb":2476,"num_write":562,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'325","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.884981+0000","last_change":"2024-09-12T18:36:09.884981+0000","last_active":"2024-09-12T18:36:09.884981+0000","last_peered":"2024-09-12T18:36:09.884981+0000","last_clean":"2024-09-12T18:36:09.884981+0000","last_became_active":"2024-09-12T17:10:30.405460+0000","last_became_peered":"2024-09-12T17:10:30.405460+0000","last_unstale":"2024-09-12T18:36:09.884981+0000","last_undegraded":"2024-09-12T18:36:09.884981+0000","last_fullsized":"2024-09-12T18:36:09.884981+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'325","last_scrub_stamp":"2024-09-12T18:36:09.884732+0000","last_deep_scrub":"268'325","last_deep_scrub_stamp":"2024-09-12T18:36:09.884732+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.884732+0000","objects_scrubbed":9,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:49.903883+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243060,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":16852,"num_write":1075,"num_write_kb":30938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.983491+0000","last_change":"2024-09-12T18:36:09.983362+0000","last_active":"2024-09-12T18:36:09.983491+0000","last_peered":"2024-09-12T18:36:09.983491+0000","last_clean":"2024-09-12T18:36:09.983491+0000","last_became_active":"2024-09-12T17:10:18.208762+0000","last_became_peered":"2024-09-12T17:10:18.208762+0000","last_unstale":"2024-09-12T18:36:09.983491+0000","last_undegraded":"2024-09-12T18:36:09.983491+0000","last_fullsized":"2024-09-12T18:36:09.983491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:09.983179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:09.983179+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.983179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:05.608460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001091554,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.061203+0000","last_change":"2024-09-12T18:36:19.061203+0000","last_active":"2024-09-12T18:36:19.061203+0000","last_peered":"2024-09-12T18:36:19.061203+0000","last_clean":"2024-09-12T18:36:19.061203+0000","last_became_active":"2024-09-12T17:10:34.355590+0000","last_became_peered":"2024-09-12T17:10:34.355590+0000","last_unstale":"2024-09-12T18:36:19.061203+0000","last_undegraded":"2024-09-12T18:36:19.061203+0000","last_fullsized":"2024-09-12T18:36:19.061203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:19.060998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:19.060998+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.060998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:14.047471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'231","reported_seq":848,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.963144+0000","last_change":"2024-09-12T18:36:23.963144+0000","last_active":"2024-09-12T18:36:23.963144+0000","last_peered":"2024-09-12T18:36:23.963144+0000","last_clean":"2024-09-12T18:36:23.963144+0000","last_became_active":"2024-09-12T17:10:36.921234+0000","last_became_peered":"2024-09-12T17:10:36.921234+0000","last_unstale":"2024-09-12T18:36:23.963144+0000","last_undegraded":"2024-09-12T18:36:23.963144+0000","last_fullsized":"2024-09-12T18:36:23.963144+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'231","last_scrub_stamp":"2024-09-12T18:36:23.962933+0000","last_deep_scrub":"268'231","last_deep_scrub_stamp":"2024-09-12T18:36:23.962933+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.962933+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:00.002043+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":277,"num_write":196,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'793","reported_seq":2957,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.906363+0000","last_change":"2024-09-12T18:36:36.906202+0000","last_active":"2024-09-12T18:36:36.906363+0000","last_peered":"2024-09-12T18:36:36.906363+0000","last_clean":"2024-09-12T18:36:36.906363+0000","last_became_active":"2024-09-12T17:10:38.395439+0000","last_became_peered":"2024-09-12T17:10:38.395439+0000","last_unstale":"2024-09-12T18:36:36.906363+0000","last_undegraded":"2024-09-12T18:36:36.906363+0000","last_fullsized":"2024-09-12T18:36:36.906363+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'793","last_scrub_stamp":"2024-09-12T18:36:36.906025+0000","last_deep_scrub":"268'793","last_deep_scrub_stamp":"2024-09-12T18:36:36.906025+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.906025+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:45.280968+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'185","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:47.881985+0000","last_change":"2024-09-12T18:36:47.881985+0000","last_active":"2024-09-12T18:36:47.881985+0000","last_peered":"2024-09-12T18:36:47.881985+0000","last_clean":"2024-09-12T18:36:47.881985+0000","last_became_active":"2024-09-12T17:10:40.770042+0000","last_became_peered":"2024-09-12T17:10:40.770042+0000","last_unstale":"2024-09-12T18:36:47.881985+0000","last_undegraded":"2024-09-12T18:36:47.881985+0000","last_fullsized":"2024-09-12T18:36:47.881985+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'185","last_scrub_stamp":"2024-09-12T18:36:47.881781+0000","last_deep_scrub":"268'185","last_deep_scrub_stamp":"2024-09-12T18:36:47.881781+0000","last_clean_scrub_stamp":"2024-09-12T18:36:47.881781+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:46.740088+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":293,"num_read_kb":273,"num_write":449,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'902","reported_seq":2645,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.834272+0000","last_change":"2024-09-12T18:36:16.834013+0000","last_active":"2024-09-12T18:36:16.834272+0000","last_peered":"2024-09-12T18:36:16.834272+0000","last_clean":"2024-09-12T18:36:16.834272+0000","last_became_active":"2024-09-12T17:10:32.382755+0000","last_became_peered":"2024-09-12T17:10:32.382755+0000","last_unstale":"2024-09-12T18:36:16.834272+0000","last_undegraded":"2024-09-12T18:36:16.834272+0000","last_fullsized":"2024-09-12T18:36:16.834272+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'902","last_scrub_stamp":"2024-09-12T18:36:16.833790+0000","last_deep_scrub":"268'902","last_deep_scrub_stamp":"2024-09-12T18:36:16.833790+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.833790+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:47.335837+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4651,"num_read_kb":4208,"num_write":1244,"num_write_kb":526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4562,"num_omap_keys":18,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'316","reported_seq":956,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.947883+0000","last_change":"2024-09-12T18:36:08.947740+0000","last_active":"2024-09-12T18:36:08.947883+0000","last_peered":"2024-09-12T18:36:08.947883+0000","last_clean":"2024-09-12T18:36:08.947883+0000","last_became_active":"2024-09-12T17:10:30.364767+0000","last_became_peered":"2024-09-12T17:10:30.364767+0000","last_unstale":"2024-09-12T18:36:08.947883+0000","last_undegraded":"2024-09-12T18:36:08.947883+0000","last_fullsized":"2024-09-12T18:36:08.947883+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'316","last_scrub_stamp":"2024-09-12T18:36:08.947480+0000","last_deep_scrub":"268'316","last_deep_scrub_stamp":"2024-09-12T18:36:08.947480+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.947480+0000","objects_scrubbed":9,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:50.062268+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":450,"num_read_kb":23959,"num_write":1040,"num_write_kb":32355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":550,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.822598+0000","last_change":"2024-09-12T18:36:07.822491+0000","last_active":"2024-09-12T18:36:07.822598+0000","last_peered":"2024-09-12T18:36:07.822598+0000","last_clean":"2024-09-12T18:36:07.822598+0000","last_became_active":"2024-09-12T17:10:18.073132+0000","last_became_peered":"2024-09-12T17:10:18.073132+0000","last_unstale":"2024-09-12T18:36:07.822598+0000","last_undegraded":"2024-09-12T18:36:07.822598+0000","last_fullsized":"2024-09-12T18:36:07.822598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:07.822365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:07.822365+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.822365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:38.482041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001154721,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.926922+0000","last_change":"2024-09-12T18:36:24.926922+0000","last_active":"2024-09-12T18:36:24.926922+0000","last_peered":"2024-09-12T18:36:24.926922+0000","last_clean":"2024-09-12T18:36:24.926922+0000","last_became_active":"2024-09-12T17:10:34.349093+0000","last_became_peered":"2024-09-12T17:10:34.349093+0000","last_unstale":"2024-09-12T18:36:24.926922+0000","last_undegraded":"2024-09-12T18:36:24.926922+0000","last_fullsized":"2024-09-12T18:36:24.926922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:24.926737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:24.926737+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.926737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:07.858866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'174","reported_seq":762,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.847044+0000","last_change":"2024-09-12T18:36:30.847044+0000","last_active":"2024-09-12T18:36:30.847044+0000","last_peered":"2024-09-12T18:36:30.847044+0000","last_clean":"2024-09-12T18:36:30.847044+0000","last_became_active":"2024-09-12T17:10:36.390439+0000","last_became_peered":"2024-09-12T17:10:36.390439+0000","last_unstale":"2024-09-12T18:36:30.847044+0000","last_undegraded":"2024-09-12T18:36:30.847044+0000","last_fullsized":"2024-09-12T18:36:30.847044+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'174","last_scrub_stamp":"2024-09-12T18:36:30.846848+0000","last_deep_scrub":"268'174","last_deep_scrub_stamp":"2024-09-12T18:36:30.846848+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.846848+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:23.164661+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":183,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'809","reported_seq":2869,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.919613+0000","last_change":"2024-09-12T18:36:37.919613+0000","last_active":"2024-09-12T18:36:37.919613+0000","last_peered":"2024-09-12T18:36:37.919613+0000","last_clean":"2024-09-12T18:36:37.919613+0000","last_became_active":"2024-09-12T17:10:38.393426+0000","last_became_peered":"2024-09-12T17:10:38.393426+0000","last_unstale":"2024-09-12T18:36:37.919613+0000","last_undegraded":"2024-09-12T18:36:37.919613+0000","last_fullsized":"2024-09-12T18:36:37.919613+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'809","last_scrub_stamp":"2024-09-12T18:36:37.919417+0000","last_deep_scrub":"268'809","last_deep_scrub_stamp":"2024-09-12T18:36:37.919417+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.919417+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:41.111792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'259","reported_seq":811,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.760094+0000","last_change":"2024-09-12T18:36:41.760094+0000","last_active":"2024-09-12T18:36:41.760094+0000","last_peered":"2024-09-12T18:36:41.760094+0000","last_clean":"2024-09-12T18:36:41.760094+0000","last_became_active":"2024-09-12T17:10:40.423742+0000","last_became_peered":"2024-09-12T17:10:40.423742+0000","last_unstale":"2024-09-12T18:36:41.760094+0000","last_undegraded":"2024-09-12T18:36:41.760094+0000","last_fullsized":"2024-09-12T18:36:41.760094+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'259","last_scrub_stamp":"2024-09-12T18:36:41.759888+0000","last_deep_scrub":"268'259","last_deep_scrub_stamp":"2024-09-12T18:36:41.759888+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.759888+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:57.353061+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":353,"num_read_kb":347,"num_write":533,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'875","reported_seq":2677,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.961775+0000","last_change":"2024-09-12T18:36:10.961775+0000","last_active":"2024-09-12T18:36:10.961775+0000","last_peered":"2024-09-12T18:36:10.961775+0000","last_clean":"2024-09-12T18:36:10.961775+0000","last_became_active":"2024-09-12T17:10:32.368217+0000","last_became_peered":"2024-09-12T17:10:32.368217+0000","last_unstale":"2024-09-12T18:36:10.961775+0000","last_undegraded":"2024-09-12T18:36:10.961775+0000","last_fullsized":"2024-09-12T18:36:10.961775+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'875","last_scrub_stamp":"2024-09-12T18:36:10.961561+0000","last_deep_scrub":"268'875","last_deep_scrub_stamp":"2024-09-12T18:36:10.961561+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.961561+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:02.933031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4306,"num_read_kb":3903,"num_write":1124,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1533,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'367","reported_seq":1081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.599955+0000","last_change":"2024-09-12T18:36:06.599903+0000","last_active":"2024-09-12T18:36:06.599955+0000","last_peered":"2024-09-12T18:36:06.599955+0000","last_clean":"2024-09-12T18:36:06.599955+0000","last_became_active":"2024-09-12T17:10:30.361736+0000","last_became_peered":"2024-09-12T17:10:30.361736+0000","last_unstale":"2024-09-12T18:36:06.599955+0000","last_undegraded":"2024-09-12T18:36:06.599955+0000","last_fullsized":"2024-09-12T18:36:06.599955+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'367","last_scrub_stamp":"2024-09-12T18:36:06.599810+0000","last_deep_scrub":"268'367","last_deep_scrub_stamp":"2024-09-12T18:36:06.599810+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.599810+0000","objects_scrubbed":7,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:40.095034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5736431,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":617,"num_read_kb":21637,"num_write":1193,"num_write_kb":30222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":549,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.128909+0000","last_change":"2024-09-12T18:36:08.128765+0000","last_active":"2024-09-12T18:36:08.128909+0000","last_peered":"2024-09-12T18:36:08.128909+0000","last_clean":"2024-09-12T18:36:08.128909+0000","last_became_active":"2024-09-12T17:10:18.074669+0000","last_became_peered":"2024-09-12T17:10:18.074669+0000","last_unstale":"2024-09-12T18:36:08.128909+0000","last_undegraded":"2024-09-12T18:36:08.128909+0000","last_fullsized":"2024-09-12T18:36:08.128909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:08.128568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:08.128568+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.128568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:13.278072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.813670+0000","last_change":"2024-09-12T18:36:28.813505+0000","last_active":"2024-09-12T18:36:28.813670+0000","last_peered":"2024-09-12T18:36:28.813670+0000","last_clean":"2024-09-12T18:36:28.813670+0000","last_became_active":"2024-09-12T17:10:34.358250+0000","last_became_peered":"2024-09-12T17:10:34.358250+0000","last_unstale":"2024-09-12T18:36:28.813670+0000","last_undegraded":"2024-09-12T18:36:28.813670+0000","last_fullsized":"2024-09-12T18:36:28.813670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:28.813308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:28.813308+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.813308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:48.280221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'750","reported_seq":1518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.024128+0000","last_change":"2024-09-12T18:36:30.024128+0000","last_active":"2024-09-12T18:36:30.024128+0000","last_peered":"2024-09-12T18:36:30.024128+0000","last_clean":"2024-09-12T18:36:30.024128+0000","last_became_active":"2024-09-12T17:10:36.920239+0000","last_became_peered":"2024-09-12T17:10:36.920239+0000","last_unstale":"2024-09-12T18:36:30.024128+0000","last_undegraded":"2024-09-12T18:36:30.024128+0000","last_fullsized":"2024-09-12T18:36:30.024128+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'750","last_scrub_stamp":"2024-09-12T18:36:30.023945+0000","last_deep_scrub":"268'750","last_deep_scrub_stamp":"2024-09-12T18:36:30.023945+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.023945+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:49.559022+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144312,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1298,"num_read_kb":3045,"num_write":1034,"num_write_kb":815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.926272+0000","last_change":"2024-09-12T18:36:39.926272+0000","last_active":"2024-09-12T18:36:39.926272+0000","last_peered":"2024-09-12T18:36:39.926272+0000","last_clean":"2024-09-12T18:36:39.926272+0000","last_became_active":"2024-09-12T17:10:38.391661+0000","last_became_peered":"2024-09-12T17:10:38.391661+0000","last_unstale":"2024-09-12T18:36:39.926272+0000","last_undegraded":"2024-09-12T18:36:39.926272+0000","last_fullsized":"2024-09-12T18:36:39.926272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:39.926092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:39.926092+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.926092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:59.398217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'102","reported_seq":620,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.815816+0000","last_change":"2024-09-12T18:36:41.815816+0000","last_active":"2024-09-12T18:36:41.815816+0000","last_peered":"2024-09-12T18:36:41.815816+0000","last_clean":"2024-09-12T18:36:41.815816+0000","last_became_active":"2024-09-12T17:10:40.435114+0000","last_became_peered":"2024-09-12T17:10:40.435114+0000","last_unstale":"2024-09-12T18:36:41.815816+0000","last_undegraded":"2024-09-12T18:36:41.815816+0000","last_fullsized":"2024-09-12T18:36:41.815816+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'102","last_scrub_stamp":"2024-09-12T18:36:41.815605+0000","last_deep_scrub":"268'102","last_deep_scrub_stamp":"2024-09-12T18:36:41.815605+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.815605+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:09.427117+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":122,"num_write":238,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'130","reported_seq":735,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.745640+0000","last_change":"2024-09-12T18:36:43.745640+0000","last_active":"2024-09-12T18:36:43.745640+0000","last_peered":"2024-09-12T18:36:43.745640+0000","last_clean":"2024-09-12T18:36:43.745640+0000","last_became_active":"2024-09-12T17:10:40.417972+0000","last_became_peered":"2024-09-12T17:10:40.417972+0000","last_unstale":"2024-09-12T18:36:43.745640+0000","last_undegraded":"2024-09-12T18:36:43.745640+0000","last_fullsized":"2024-09-12T18:36:43.745640+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'130","last_scrub_stamp":"2024-09-12T18:36:43.745449+0000","last_deep_scrub":"268'130","last_deep_scrub_stamp":"2024-09-12T18:36:43.745449+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.745449+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:46.799454+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":319,"num_read_kb":297,"num_write":314,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'794","reported_seq":2324,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.019305+0000","last_change":"2024-09-12T18:36:15.019127+0000","last_active":"2024-09-12T18:36:15.019305+0000","last_peered":"2024-09-12T18:36:15.019305+0000","last_clean":"2024-09-12T18:36:15.019305+0000","last_became_active":"2024-09-12T17:10:32.368063+0000","last_became_peered":"2024-09-12T17:10:32.368063+0000","last_unstale":"2024-09-12T18:36:15.019305+0000","last_undegraded":"2024-09-12T18:36:15.019305+0000","last_fullsized":"2024-09-12T18:36:15.019305+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'794","last_scrub_stamp":"2024-09-12T18:36:15.018950+0000","last_deep_scrub":"268'794","last_deep_scrub_stamp":"2024-09-12T18:36:15.018950+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.018950+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:15.614937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3740,"num_read_kb":3358,"num_write":1050,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'385","reported_seq":1052,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.014436+0000","last_change":"2024-09-12T18:36:09.014293+0000","last_active":"2024-09-12T18:36:09.014436+0000","last_peered":"2024-09-12T18:36:09.014436+0000","last_clean":"2024-09-12T18:36:09.014436+0000","last_became_active":"2024-09-12T17:10:30.394117+0000","last_became_peered":"2024-09-12T17:10:30.394117+0000","last_unstale":"2024-09-12T18:36:09.014436+0000","last_undegraded":"2024-09-12T18:36:09.014436+0000","last_fullsized":"2024-09-12T18:36:09.014436+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-12T18:36:09.014036+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-12T18:36:09.014036+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.014036+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:20.531488+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330018,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":538,"num_read_kb":2122,"num_write":1160,"num_write_kb":20675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.975963+0000","last_change":"2024-09-12T18:36:22.975839+0000","last_active":"2024-09-12T18:36:22.975963+0000","last_peered":"2024-09-12T18:36:22.975963+0000","last_clean":"2024-09-12T18:36:22.975963+0000","last_became_active":"2024-09-12T17:10:34.359923+0000","last_became_peered":"2024-09-12T17:10:34.359923+0000","last_unstale":"2024-09-12T18:36:22.975963+0000","last_undegraded":"2024-09-12T18:36:22.975963+0000","last_fullsized":"2024-09-12T18:36:22.975963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:22.975695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:22.975695+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.975695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:10.101003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'308","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.932248+0000","last_change":"2024-09-12T18:36:32.932101+0000","last_active":"2024-09-12T18:36:32.932248+0000","last_peered":"2024-09-12T18:36:32.932248+0000","last_clean":"2024-09-12T18:36:32.932248+0000","last_became_active":"2024-09-12T17:10:36.394731+0000","last_became_peered":"2024-09-12T17:10:36.394731+0000","last_unstale":"2024-09-12T18:36:32.932248+0000","last_undegraded":"2024-09-12T18:36:32.932248+0000","last_fullsized":"2024-09-12T18:36:32.932248+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'308","last_scrub_stamp":"2024-09-12T18:36:32.931887+0000","last_deep_scrub":"268'308","last_deep_scrub_stamp":"2024-09-12T18:36:32.931887+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.931887+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:30.103482+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56497,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":1193,"num_write":404,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.933682+0000","last_change":"2024-09-12T18:36:38.933547+0000","last_active":"2024-09-12T18:36:38.933682+0000","last_peered":"2024-09-12T18:36:38.933682+0000","last_clean":"2024-09-12T18:36:38.933682+0000","last_became_active":"2024-09-12T17:10:38.393112+0000","last_became_peered":"2024-09-12T17:10:38.393112+0000","last_unstale":"2024-09-12T18:36:38.933682+0000","last_undegraded":"2024-09-12T18:36:38.933682+0000","last_fullsized":"2024-09-12T18:36:38.933682+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:38.933365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:38.933365+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.933365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:17.416261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'117","reported_seq":641,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:46.898821+0000","last_change":"2024-09-12T18:36:46.898683+0000","last_active":"2024-09-12T18:36:46.898821+0000","last_peered":"2024-09-12T18:36:46.898821+0000","last_clean":"2024-09-12T18:36:46.898821+0000","last_became_active":"2024-09-12T17:10:40.429366+0000","last_became_peered":"2024-09-12T17:10:40.429366+0000","last_unstale":"2024-09-12T18:36:46.898821+0000","last_undegraded":"2024-09-12T18:36:46.898821+0000","last_fullsized":"2024-09-12T18:36:46.898821+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'117","last_scrub_stamp":"2024-09-12T18:36:46.898503+0000","last_deep_scrub":"268'117","last_deep_scrub_stamp":"2024-09-12T18:36:46.898503+0000","last_clean_scrub_stamp":"2024-09-12T18:36:46.898503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:30.894480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":137,"num_write":282,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'500","reported_seq":2109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.917232+0000","last_change":"2024-09-12T18:36:15.917070+0000","last_active":"2024-09-12T18:36:15.917232+0000","last_peered":"2024-09-12T18:36:15.917232+0000","last_clean":"2024-09-12T18:36:15.917232+0000","last_became_active":"2024-09-12T17:10:32.364033+0000","last_became_peered":"2024-09-12T17:10:32.364033+0000","last_unstale":"2024-09-12T18:36:15.917232+0000","last_undegraded":"2024-09-12T18:36:15.917232+0000","last_fullsized":"2024-09-12T18:36:15.917232+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'500","last_scrub_stamp":"2024-09-12T18:36:15.916790+0000","last_deep_scrub":"268'500","last_deep_scrub_stamp":"2024-09-12T18:36:15.916790+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.916790+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:19.758173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2497,"num_read_kb":2341,"num_write":588,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'287","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.956199+0000","last_change":"2024-09-12T18:36:15.956199+0000","last_active":"2024-09-12T18:36:15.956199+0000","last_peered":"2024-09-12T18:36:15.956199+0000","last_clean":"2024-09-12T18:36:15.956199+0000","last_became_active":"2024-09-12T17:10:30.405137+0000","last_became_peered":"2024-09-12T17:10:30.405137+0000","last_unstale":"2024-09-12T18:36:15.956199+0000","last_undegraded":"2024-09-12T18:36:15.956199+0000","last_fullsized":"2024-09-12T18:36:15.956199+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'287","last_scrub_stamp":"2024-09-12T18:36:15.955868+0000","last_deep_scrub":"268'287","last_deep_scrub_stamp":"2024-09-12T18:36:15.955868+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.955868+0000","objects_scrubbed":9,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:38.210429+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728666,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":586,"num_read_kb":36707,"num_write":949,"num_write_kb":52863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.757177+0000","last_change":"2024-09-12T18:36:26.757025+0000","last_active":"2024-09-12T18:36:26.757177+0000","last_peered":"2024-09-12T18:36:26.757177+0000","last_clean":"2024-09-12T18:36:26.757177+0000","last_became_active":"2024-09-12T17:10:34.355684+0000","last_became_peered":"2024-09-12T17:10:34.355684+0000","last_unstale":"2024-09-12T18:36:26.757177+0000","last_undegraded":"2024-09-12T18:36:26.757177+0000","last_fullsized":"2024-09-12T18:36:26.757177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.756852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.756852+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.756852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:01.952314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'61","reported_seq":600,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.684553+0000","last_change":"2024-09-12T18:36:30.684320+0000","last_active":"2024-09-12T18:36:30.684553+0000","last_peered":"2024-09-12T18:36:30.684553+0000","last_clean":"2024-09-12T18:36:30.684553+0000","last_became_active":"2024-09-12T17:10:36.400358+0000","last_became_peered":"2024-09-12T17:10:36.400358+0000","last_unstale":"2024-09-12T18:36:30.684553+0000","last_undegraded":"2024-09-12T18:36:30.684553+0000","last_fullsized":"2024-09-12T18:36:30.684553+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'61","last_scrub_stamp":"2024-09-12T18:36:30.684044+0000","last_deep_scrub":"268'61","last_deep_scrub_stamp":"2024-09-12T18:36:30.684044+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.684044+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:14:14.583204+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":54,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.996235+0000","last_change":"2024-09-12T18:36:36.995988+0000","last_active":"2024-09-12T18:36:36.996235+0000","last_peered":"2024-09-12T18:36:36.996235+0000","last_clean":"2024-09-12T18:36:36.996235+0000","last_became_active":"2024-09-12T17:10:38.404309+0000","last_became_peered":"2024-09-12T17:10:38.404309+0000","last_unstale":"2024-09-12T18:36:36.996235+0000","last_undegraded":"2024-09-12T18:36:36.996235+0000","last_fullsized":"2024-09-12T18:36:36.996235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:36.995770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:36.995770+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.995770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:40.259880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'195","reported_seq":746,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:44.716148+0000","last_change":"2024-09-12T18:36:44.716148+0000","last_active":"2024-09-12T18:36:44.716148+0000","last_peered":"2024-09-12T18:36:44.716148+0000","last_clean":"2024-09-12T18:36:44.716148+0000","last_became_active":"2024-09-12T17:10:40.418473+0000","last_became_peered":"2024-09-12T17:10:40.418473+0000","last_unstale":"2024-09-12T18:36:44.716148+0000","last_undegraded":"2024-09-12T18:36:44.716148+0000","last_fullsized":"2024-09-12T18:36:44.716148+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'195","last_scrub_stamp":"2024-09-12T18:36:44.715966+0000","last_deep_scrub":"268'195","last_deep_scrub_stamp":"2024-09-12T18:36:44.715966+0000","last_clean_scrub_stamp":"2024-09-12T18:36:44.715966+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:32.160773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":350,"num_read_kb":341,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'359","reported_seq":1691,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.844861+0000","last_change":"2024-09-12T18:36:18.844725+0000","last_active":"2024-09-12T18:36:18.844861+0000","last_peered":"2024-09-12T18:36:18.844861+0000","last_clean":"2024-09-12T18:36:18.844861+0000","last_became_active":"2024-09-12T17:10:32.382581+0000","last_became_peered":"2024-09-12T17:10:32.382581+0000","last_unstale":"2024-09-12T18:36:18.844861+0000","last_undegraded":"2024-09-12T18:36:18.844861+0000","last_fullsized":"2024-09-12T18:36:18.844861+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T18:36:18.844512+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T18:36:18.844512+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.844512+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:14.341522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1854,"num_read_kb":1737,"num_write":414,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'369","reported_seq":1050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.893176+0000","last_change":"2024-09-12T18:36:11.893176+0000","last_active":"2024-09-12T18:36:11.893176+0000","last_peered":"2024-09-12T18:36:11.893176+0000","last_clean":"2024-09-12T18:36:11.893176+0000","last_became_active":"2024-09-12T17:10:30.374846+0000","last_became_peered":"2024-09-12T17:10:30.374846+0000","last_unstale":"2024-09-12T18:36:11.893176+0000","last_undegraded":"2024-09-12T18:36:11.893176+0000","last_fullsized":"2024-09-12T18:36:11.893176+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'369","last_scrub_stamp":"2024-09-12T18:36:11.892901+0000","last_deep_scrub":"268'369","last_deep_scrub_stamp":"2024-09-12T18:36:11.892901+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.892901+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:09.620432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572943,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":611,"num_read_kb":15632,"num_write":1214,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.019790+0000","last_change":"2024-09-12T18:36:28.019636+0000","last_active":"2024-09-12T18:36:28.019790+0000","last_peered":"2024-09-12T18:36:28.019790+0000","last_clean":"2024-09-12T18:36:28.019790+0000","last_became_active":"2024-09-12T17:10:34.362168+0000","last_became_peered":"2024-09-12T17:10:34.362168+0000","last_unstale":"2024-09-12T18:36:28.019790+0000","last_undegraded":"2024-09-12T18:36:28.019790+0000","last_fullsized":"2024-09-12T18:36:28.019790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:28.019461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:28.019461+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.019461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:31.096402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'385","reported_seq":1019,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:34.989833+0000","last_change":"2024-09-12T18:36:34.989672+0000","last_active":"2024-09-12T18:36:34.989833+0000","last_peered":"2024-09-12T18:36:34.989833+0000","last_clean":"2024-09-12T18:36:34.989833+0000","last_became_active":"2024-09-12T17:10:36.394639+0000","last_became_peered":"2024-09-12T17:10:36.394639+0000","last_unstale":"2024-09-12T18:36:34.989833+0000","last_undegraded":"2024-09-12T18:36:34.989833+0000","last_fullsized":"2024-09-12T18:36:34.989833+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-12T18:36:34.989490+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-12T18:36:34.989490+0000","last_clean_scrub_stamp":"2024-09-12T18:36:34.989490+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:30.943215+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67938,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":612,"num_read_kb":1404,"num_write":492,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.138181+0000","last_change":"2024-09-12T18:36:23.138026+0000","last_active":"2024-09-12T18:36:23.138181+0000","last_peered":"2024-09-12T18:36:23.138181+0000","last_clean":"2024-09-12T18:36:23.138181+0000","last_became_active":"2024-09-12T17:10:38.413131+0000","last_became_peered":"2024-09-12T17:10:38.413131+0000","last_unstale":"2024-09-12T18:36:23.138181+0000","last_undegraded":"2024-09-12T18:36:23.138181+0000","last_fullsized":"2024-09-12T18:36:23.138181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:23.137806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:23.137806+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.137806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:14.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'133","reported_seq":661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.796714+0000","last_change":"2024-09-12T18:36:43.796714+0000","last_active":"2024-09-12T18:36:43.796714+0000","last_peered":"2024-09-12T18:36:43.796714+0000","last_clean":"2024-09-12T18:36:43.796714+0000","last_became_active":"2024-09-12T17:10:40.429224+0000","last_became_peered":"2024-09-12T17:10:40.429224+0000","last_unstale":"2024-09-12T18:36:43.796714+0000","last_undegraded":"2024-09-12T18:36:43.796714+0000","last_fullsized":"2024-09-12T18:36:43.796714+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'133","last_scrub_stamp":"2024-09-12T18:36:43.796489+0000","last_deep_scrub":"268'133","last_deep_scrub_stamp":"2024-09-12T18:36:43.796489+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.796489+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:03.966623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'951","reported_seq":2636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.818285+0000","last_change":"2024-09-12T18:36:17.818036+0000","last_active":"2024-09-12T18:36:17.818285+0000","last_peered":"2024-09-12T18:36:17.818285+0000","last_clean":"2024-09-12T18:36:17.818285+0000","last_became_active":"2024-09-12T17:10:32.369282+0000","last_became_peered":"2024-09-12T17:10:32.369282+0000","last_unstale":"2024-09-12T18:36:17.818285+0000","last_undegraded":"2024-09-12T18:36:17.818285+0000","last_fullsized":"2024-09-12T18:36:17.818285+0000","mapping_epoch":27,"log_start":"268'900","ondisk_log_start":"268'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'951","last_scrub_stamp":"2024-09-12T18:36:17.817821+0000","last_deep_scrub":"268'951","last_deep_scrub_stamp":"2024-09-12T18:36:17.817821+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.817821+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:50.499239+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4532,"num_read_kb":4046,"num_write":1302,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'374","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:07.619579+0000","last_change":"2024-09-12T18:36:07.619579+0000","last_active":"2024-09-12T18:36:07.619579+0000","last_peered":"2024-09-12T18:36:07.619579+0000","last_clean":"2024-09-12T18:36:07.619579+0000","last_became_active":"2024-09-12T17:10:30.356383+0000","last_became_peered":"2024-09-12T17:10:30.356383+0000","last_unstale":"2024-09-12T18:36:07.619579+0000","last_undegraded":"2024-09-12T18:36:07.619579+0000","last_fullsized":"2024-09-12T18:36:07.619579+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'374","last_scrub_stamp":"2024-09-12T18:36:07.619444+0000","last_deep_scrub":"268'374","last_deep_scrub_stamp":"2024-09-12T18:36:07.619444+0000","last_clean_scrub_stamp":"2024-09-12T18:36:07.619444+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:13.321492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":17278,"num_write":1157,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.137041+0000","last_change":"2024-09-12T18:36:22.136810+0000","last_active":"2024-09-12T18:36:22.137041+0000","last_peered":"2024-09-12T18:36:22.137041+0000","last_clean":"2024-09-12T18:36:22.137041+0000","last_became_active":"2024-09-12T17:10:34.363279+0000","last_became_peered":"2024-09-12T17:10:34.363279+0000","last_unstale":"2024-09-12T18:36:22.137041+0000","last_undegraded":"2024-09-12T18:36:22.137041+0000","last_fullsized":"2024-09-12T18:36:22.137041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:22.136599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:22.136599+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.136599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:38.570087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'324","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.918023+0000","last_change":"2024-09-12T18:36:32.917877+0000","last_active":"2024-09-12T18:36:32.918023+0000","last_peered":"2024-09-12T18:36:32.918023+0000","last_clean":"2024-09-12T18:36:32.918023+0000","last_became_active":"2024-09-12T17:10:36.396758+0000","last_became_peered":"2024-09-12T17:10:36.396758+0000","last_unstale":"2024-09-12T18:36:32.918023+0000","last_undegraded":"2024-09-12T18:36:32.918023+0000","last_fullsized":"2024-09-12T18:36:32.918023+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'324","last_scrub_stamp":"2024-09-12T18:36:32.917681+0000","last_deep_scrub":"268'324","last_deep_scrub_stamp":"2024-09-12T18:36:32.917681+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.917681+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:42.212707+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59757,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1297,"num_write":442,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.814631+0000","last_change":"2024-09-12T18:36:36.814492+0000","last_active":"2024-09-12T18:36:36.814631+0000","last_peered":"2024-09-12T18:36:36.814631+0000","last_clean":"2024-09-12T18:36:36.814631+0000","last_became_active":"2024-09-12T17:10:38.413004+0000","last_became_peered":"2024-09-12T17:10:38.413004+0000","last_unstale":"2024-09-12T18:36:36.814631+0000","last_undegraded":"2024-09-12T18:36:36.814631+0000","last_fullsized":"2024-09-12T18:36:36.814631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:36.814278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:36.814278+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.814278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:20.375476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'441","reported_seq":1953,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.092673+0000","last_change":"2024-09-12T18:36:17.092673+0000","last_active":"2024-09-12T18:36:17.092673+0000","last_peered":"2024-09-12T18:36:17.092673+0000","last_clean":"2024-09-12T18:36:17.092673+0000","last_became_active":"2024-09-12T17:10:32.350751+0000","last_became_peered":"2024-09-12T17:10:32.350751+0000","last_unstale":"2024-09-12T18:36:17.092673+0000","last_undegraded":"2024-09-12T18:36:17.092673+0000","last_fullsized":"2024-09-12T18:36:17.092673+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'441","last_scrub_stamp":"2024-09-12T18:36:17.092489+0000","last_deep_scrub":"268'441","last_deep_scrub_stamp":"2024-09-12T18:36:17.092489+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.092489+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:22.621992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2256,"num_read_kb":2119,"num_write":496,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'284","reported_seq":939,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.937121+0000","last_change":"2024-09-12T18:36:10.937121+0000","last_active":"2024-09-12T18:36:10.937121+0000","last_peered":"2024-09-12T18:36:10.937121+0000","last_clean":"2024-09-12T18:36:10.937121+0000","last_became_active":"2024-09-12T17:10:30.353308+0000","last_became_peered":"2024-09-12T17:10:30.353308+0000","last_unstale":"2024-09-12T18:36:10.937121+0000","last_undegraded":"2024-09-12T18:36:10.937121+0000","last_fullsized":"2024-09-12T18:36:10.937121+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'284","last_scrub_stamp":"2024-09-12T18:36:10.936793+0000","last_deep_scrub":"268'284","last_deep_scrub_stamp":"2024-09-12T18:36:10.936793+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.936793+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:08.902755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262194,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":407,"num_read_kb":20512,"num_write":856,"num_write_kb":25251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.593410+0000","last_change":"2024-09-12T18:36:25.593258+0000","last_active":"2024-09-12T18:36:25.593410+0000","last_peered":"2024-09-12T18:36:25.593410+0000","last_clean":"2024-09-12T18:36:25.593410+0000","last_became_active":"2024-09-12T17:10:34.357883+0000","last_became_peered":"2024-09-12T17:10:34.357883+0000","last_unstale":"2024-09-12T18:36:25.593410+0000","last_undegraded":"2024-09-12T18:36:25.593410+0000","last_fullsized":"2024-09-12T18:36:25.593410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:25.593056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:25.593056+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.593056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:49.907882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'523","reported_seq":1189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.886533+0000","last_change":"2024-09-12T18:36:28.886533+0000","last_active":"2024-09-12T18:36:28.886533+0000","last_peered":"2024-09-12T18:36:28.886533+0000","last_clean":"2024-09-12T18:36:28.886533+0000","last_became_active":"2024-09-12T17:10:36.401608+0000","last_became_peered":"2024-09-12T17:10:36.401608+0000","last_unstale":"2024-09-12T18:36:28.886533+0000","last_undegraded":"2024-09-12T18:36:28.886533+0000","last_fullsized":"2024-09-12T18:36:28.886533+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'523","last_scrub_stamp":"2024-09-12T18:36:28.886458+0000","last_deep_scrub":"268'523","last_deep_scrub_stamp":"2024-09-12T18:36:28.886458+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.886458+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:36.974846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95576,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":903,"num_read_kb":2101,"num_write":776,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.860439+0000","last_change":"2024-09-12T18:36:38.860439+0000","last_active":"2024-09-12T18:36:38.860439+0000","last_peered":"2024-09-12T18:36:38.860439+0000","last_clean":"2024-09-12T18:36:38.860439+0000","last_became_active":"2024-09-12T17:10:38.398862+0000","last_became_peered":"2024-09-12T17:10:38.398862+0000","last_unstale":"2024-09-12T18:36:38.860439+0000","last_undegraded":"2024-09-12T18:36:38.860439+0000","last_fullsized":"2024-09-12T18:36:38.860439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:38.860257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:38.860257+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.860257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:31.601508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'159","reported_seq":689,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.913041+0000","last_change":"2024-09-12T18:36:43.912889+0000","last_active":"2024-09-12T18:36:43.913041+0000","last_peered":"2024-09-12T18:36:43.913041+0000","last_clean":"2024-09-12T18:36:43.913041+0000","last_became_active":"2024-09-12T17:10:40.770075+0000","last_became_peered":"2024-09-12T17:10:40.770075+0000","last_unstale":"2024-09-12T18:36:43.913041+0000","last_undegraded":"2024-09-12T18:36:43.913041+0000","last_fullsized":"2024-09-12T18:36:43.913041+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'159","last_scrub_stamp":"2024-09-12T18:36:43.912709+0000","last_deep_scrub":"268'159","last_deep_scrub_stamp":"2024-09-12T18:36:43.912709+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.912709+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:54.272079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":234,"num_write":361,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'1462","reported_seq":3057,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.508454+0000","last_change":"2024-09-12T18:36:17.508311+0000","last_active":"2024-09-12T18:36:17.508454+0000","last_peered":"2024-09-12T18:36:17.508454+0000","last_clean":"2024-09-12T18:36:17.508454+0000","last_became_active":"2024-09-12T17:10:32.376892+0000","last_became_peered":"2024-09-12T17:10:32.376892+0000","last_unstale":"2024-09-12T18:36:17.508454+0000","last_undegraded":"2024-09-12T18:36:17.508454+0000","last_fullsized":"2024-09-12T18:36:17.508454+0000","mapping_epoch":27,"log_start":"268'1400","ondisk_log_start":"268'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1462","last_scrub_stamp":"2024-09-12T18:36:17.508128+0000","last_deep_scrub":"268'1462","last_deep_scrub_stamp":"2024-09-12T18:36:17.508128+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.508128+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":1400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.380441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6636,"num_read_kb":5839,"num_write":2046,"num_write_kb":883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'297","reported_seq":942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:08.834263+0000","last_change":"2024-09-12T18:36:08.834263+0000","last_active":"2024-09-12T18:36:08.834263+0000","last_peered":"2024-09-12T18:36:08.834263+0000","last_clean":"2024-09-12T18:36:08.834263+0000","last_became_active":"2024-09-12T17:10:30.378075+0000","last_became_peered":"2024-09-12T17:10:30.378075+0000","last_unstale":"2024-09-12T18:36:08.834263+0000","last_undegraded":"2024-09-12T18:36:08.834263+0000","last_fullsized":"2024-09-12T18:36:08.834263+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'297","last_scrub_stamp":"2024-09-12T18:36:08.833929+0000","last_deep_scrub":"268'297","last_deep_scrub_stamp":"2024-09-12T18:36:08.833929+0000","last_clean_scrub_stamp":"2024-09-12T18:36:08.833929+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:52.476849+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4500309,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":47843,"num_write":921,"num_write_kb":30557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.097940+0000","last_change":"2024-09-12T18:36:20.097940+0000","last_active":"2024-09-12T18:36:20.097940+0000","last_peered":"2024-09-12T18:36:20.097940+0000","last_clean":"2024-09-12T18:36:20.097940+0000","last_became_active":"2024-09-12T17:10:34.361495+0000","last_became_peered":"2024-09-12T17:10:34.361495+0000","last_unstale":"2024-09-12T18:36:20.097940+0000","last_undegraded":"2024-09-12T18:36:20.097940+0000","last_fullsized":"2024-09-12T18:36:20.097940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:20.097716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:20.097716+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.097716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:48.768128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'346","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.002122+0000","last_change":"2024-09-12T18:36:35.002122+0000","last_active":"2024-09-12T18:36:35.002122+0000","last_peered":"2024-09-12T18:36:35.002122+0000","last_clean":"2024-09-12T18:36:35.002122+0000","last_became_active":"2024-09-12T17:10:36.398415+0000","last_became_peered":"2024-09-12T17:10:36.398415+0000","last_unstale":"2024-09-12T18:36:35.002122+0000","last_undegraded":"2024-09-12T18:36:35.002122+0000","last_fullsized":"2024-09-12T18:36:35.002122+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T18:36:35.001911+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T18:36:35.001911+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.001911+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:12.324376+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45877,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":580,"num_read_kb":1203,"num_write":474,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:31.826608+0000","last_change":"2024-09-12T18:36:31.826608+0000","last_active":"2024-09-12T18:36:31.826608+0000","last_peered":"2024-09-12T18:36:31.826608+0000","last_clean":"2024-09-12T18:36:31.826608+0000","last_became_active":"2024-09-12T17:10:38.401047+0000","last_became_peered":"2024-09-12T17:10:38.401047+0000","last_unstale":"2024-09-12T18:36:31.826608+0000","last_undegraded":"2024-09-12T18:36:31.826608+0000","last_fullsized":"2024-09-12T18:36:31.826608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:31.826409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:31.826409+0000","last_clean_scrub_stamp":"2024-09-12T18:36:31.826409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:36.329076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'203","reported_seq":760,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:30.166184+0000","last_change":"2024-09-12T18:36:30.166049+0000","last_active":"2024-09-12T18:36:30.166184+0000","last_peered":"2024-09-12T18:36:30.166184+0000","last_clean":"2024-09-12T18:36:30.166184+0000","last_became_active":"2024-09-12T17:10:40.428841+0000","last_became_peered":"2024-09-12T17:10:40.428841+0000","last_unstale":"2024-09-12T18:36:30.166184+0000","last_undegraded":"2024-09-12T18:36:30.166184+0000","last_fullsized":"2024-09-12T18:36:30.166184+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-12T18:36:30.165768+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-12T18:36:30.165768+0000","last_clean_scrub_stamp":"2024-09-12T18:36:30.165768+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:12.319509+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1669,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":376,"num_read_kb":345,"num_write":581,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'1128","reported_seq":2882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.773405+0000","last_change":"2024-09-12T18:36:24.773405+0000","last_active":"2024-09-12T18:36:24.773405+0000","last_peered":"2024-09-12T18:36:24.773405+0000","last_clean":"2024-09-12T18:36:24.773405+0000","last_became_active":"2024-09-12T17:10:32.369344+0000","last_became_peered":"2024-09-12T17:10:32.369344+0000","last_unstale":"2024-09-12T18:36:24.773405+0000","last_undegraded":"2024-09-12T18:36:24.773405+0000","last_fullsized":"2024-09-12T18:36:24.773405+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1128","last_scrub_stamp":"2024-09-12T18:36:24.773164+0000","last_deep_scrub":"268'1128","last_deep_scrub_stamp":"2024-09-12T18:36:24.773164+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.773164+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":1100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:21.417963+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5513,"num_read_kb":4854,"num_write":1595,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'341","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.312390+0000","last_change":"2024-09-12T18:36:10.312390+0000","last_active":"2024-09-12T18:36:10.312390+0000","last_peered":"2024-09-12T18:36:10.312390+0000","last_clean":"2024-09-12T18:36:10.312390+0000","last_became_active":"2024-09-12T17:11:05.123283+0000","last_became_peered":"2024-09-12T17:11:05.123283+0000","last_unstale":"2024-09-12T18:36:10.312390+0000","last_undegraded":"2024-09-12T18:36:10.312390+0000","last_fullsized":"2024-09-12T18:36:10.312390+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'341","last_scrub_stamp":"2024-09-12T18:36:10.312023+0000","last_deep_scrub":"268'341","last_deep_scrub_stamp":"2024-09-12T18:36:10.312023+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.312023+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:26:25.953575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048663,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":48133,"num_write":1103,"num_write_kb":35281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"268'6","reported_seq":1011,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.875220+0000","last_change":"2024-09-12T18:36:29.875220+0000","last_active":"2024-09-12T18:36:29.875220+0000","last_peered":"2024-09-12T18:36:29.875220+0000","last_clean":"2024-09-12T18:36:29.875220+0000","last_became_active":"2024-09-12T17:10:34.352213+0000","last_became_peered":"2024-09-12T17:10:34.352213+0000","last_unstale":"2024-09-12T18:36:29.875220+0000","last_undegraded":"2024-09-12T18:36:29.875220+0000","last_fullsized":"2024-09-12T18:36:29.875220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T18:36:29.875035+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T18:36:29.875035+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.875035+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:02.237403+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'303","reported_seq":925,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.967050+0000","last_change":"2024-09-12T18:36:36.967050+0000","last_active":"2024-09-12T18:36:36.967050+0000","last_peered":"2024-09-12T18:36:36.967050+0000","last_clean":"2024-09-12T18:36:36.967050+0000","last_became_active":"2024-09-12T17:10:36.921450+0000","last_became_peered":"2024-09-12T17:10:36.921450+0000","last_unstale":"2024-09-12T18:36:36.967050+0000","last_undegraded":"2024-09-12T18:36:36.967050+0000","last_fullsized":"2024-09-12T18:36:36.967050+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'303","last_scrub_stamp":"2024-09-12T18:36:36.966861+0000","last_deep_scrub":"268'303","last_deep_scrub_stamp":"2024-09-12T18:36:36.966861+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.966861+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:50.821225+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44011,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":1000,"num_write":366,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.824781+0000","last_change":"2024-09-12T18:36:41.824554+0000","last_active":"2024-09-12T18:36:41.824781+0000","last_peered":"2024-09-12T18:36:41.824781+0000","last_clean":"2024-09-12T18:36:41.824781+0000","last_became_active":"2024-09-12T17:10:38.395457+0000","last_became_peered":"2024-09-12T17:10:38.395457+0000","last_unstale":"2024-09-12T18:36:41.824781+0000","last_undegraded":"2024-09-12T18:36:41.824781+0000","last_fullsized":"2024-09-12T18:36:41.824781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:41.824274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:41.824274+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.824274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:29.679358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'134","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:42.811797+0000","last_change":"2024-09-12T18:36:42.811656+0000","last_active":"2024-09-12T18:36:42.811797+0000","last_peered":"2024-09-12T18:36:42.811797+0000","last_clean":"2024-09-12T18:36:42.811797+0000","last_became_active":"2024-09-12T17:10:40.429303+0000","last_became_peered":"2024-09-12T17:10:40.429303+0000","last_unstale":"2024-09-12T18:36:42.811797+0000","last_undegraded":"2024-09-12T18:36:42.811797+0000","last_fullsized":"2024-09-12T18:36:42.811797+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'134","last_scrub_stamp":"2024-09-12T18:36:42.811437+0000","last_deep_scrub":"268'134","last_deep_scrub_stamp":"2024-09-12T18:36:42.811437+0000","last_clean_scrub_stamp":"2024-09-12T18:36:42.811437+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:56.115877+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":809,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":233,"num_read_kb":212,"num_write":334,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'905","reported_seq":2428,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.380060+0000","last_change":"2024-09-12T18:36:15.380060+0000","last_active":"2024-09-12T18:36:15.380060+0000","last_peered":"2024-09-12T18:36:15.380060+0000","last_clean":"2024-09-12T18:36:15.380060+0000","last_became_active":"2024-09-12T17:10:32.362957+0000","last_became_peered":"2024-09-12T17:10:32.362957+0000","last_unstale":"2024-09-12T18:36:15.380060+0000","last_undegraded":"2024-09-12T18:36:15.380060+0000","last_fullsized":"2024-09-12T18:36:15.380060+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'905","last_scrub_stamp":"2024-09-12T18:36:15.379868+0000","last_deep_scrub":"268'905","last_deep_scrub_stamp":"2024-09-12T18:36:15.379868+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.379868+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":800,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:49.635855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4274,"num_read_kb":3831,"num_write":1263,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'361","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.565443+0000","last_change":"2024-09-12T18:36:10.565443+0000","last_active":"2024-09-12T18:36:10.565443+0000","last_peered":"2024-09-12T18:36:10.565443+0000","last_clean":"2024-09-12T18:36:10.565443+0000","last_became_active":"2024-09-12T17:10:30.374618+0000","last_became_peered":"2024-09-12T17:10:30.374618+0000","last_unstale":"2024-09-12T18:36:10.565443+0000","last_undegraded":"2024-09-12T18:36:10.565443+0000","last_fullsized":"2024-09-12T18:36:10.565443+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-12T18:36:10.565103+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-12T18:36:10.565103+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.565103+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:57.740717+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048724,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":441,"num_read_kb":21889,"num_write":990,"num_write_kb":37331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:24.924046+0000","last_change":"2024-09-12T18:36:24.924046+0000","last_active":"2024-09-12T18:36:24.924046+0000","last_peered":"2024-09-12T18:36:24.924046+0000","last_clean":"2024-09-12T18:36:24.924046+0000","last_became_active":"2024-09-12T17:10:34.361536+0000","last_became_peered":"2024-09-12T17:10:34.361536+0000","last_unstale":"2024-09-12T18:36:24.924046+0000","last_undegraded":"2024-09-12T18:36:24.924046+0000","last_fullsized":"2024-09-12T18:36:24.924046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:24.923870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:24.923870+0000","last_clean_scrub_stamp":"2024-09-12T18:36:24.923870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:02.233333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'120","reported_seq":694,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.754955+0000","last_change":"2024-09-12T18:36:35.754806+0000","last_active":"2024-09-12T18:36:35.754955+0000","last_peered":"2024-09-12T18:36:35.754955+0000","last_clean":"2024-09-12T18:36:35.754955+0000","last_became_active":"2024-09-12T17:10:36.923087+0000","last_became_peered":"2024-09-12T17:10:36.923087+0000","last_unstale":"2024-09-12T18:36:35.754955+0000","last_undegraded":"2024-09-12T18:36:35.754955+0000","last_fullsized":"2024-09-12T18:36:35.754955+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'120","last_scrub_stamp":"2024-09-12T18:36:35.754611+0000","last_deep_scrub":"268'120","last_deep_scrub_stamp":"2024-09-12T18:36:35.754611+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.754611+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:10.265855+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":134,"num_write":98,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'781","reported_seq":2894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:28.226235+0000","last_change":"2024-09-12T18:36:28.226235+0000","last_active":"2024-09-12T18:36:28.226235+0000","last_peered":"2024-09-12T18:36:28.226235+0000","last_clean":"2024-09-12T18:36:28.226235+0000","last_became_active":"2024-09-12T17:10:38.407830+0000","last_became_peered":"2024-09-12T17:10:38.407830+0000","last_unstale":"2024-09-12T18:36:28.226235+0000","last_undegraded":"2024-09-12T18:36:28.226235+0000","last_fullsized":"2024-09-12T18:36:28.226235+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'781","last_scrub_stamp":"2024-09-12T18:36:28.226043+0000","last_deep_scrub":"268'781","last_deep_scrub_stamp":"2024-09-12T18:36:28.226043+0000","last_clean_scrub_stamp":"2024-09-12T18:36:28.226043+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:01.367734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'147","reported_seq":683,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.979348+0000","last_change":"2024-09-12T18:36:38.979196+0000","last_active":"2024-09-12T18:36:38.979348+0000","last_peered":"2024-09-12T18:36:38.979348+0000","last_clean":"2024-09-12T18:36:38.979348+0000","last_became_active":"2024-09-12T17:10:40.431693+0000","last_became_peered":"2024-09-12T17:10:40.431693+0000","last_unstale":"2024-09-12T18:36:38.979348+0000","last_undegraded":"2024-09-12T18:36:38.979348+0000","last_fullsized":"2024-09-12T18:36:38.979348+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'147","last_scrub_stamp":"2024-09-12T18:36:38.979004+0000","last_deep_scrub":"268'147","last_deep_scrub_stamp":"2024-09-12T18:36:38.979004+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.979004+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:30.012772+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":232,"num_write":366,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'809","reported_seq":2336,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:18.062762+0000","last_change":"2024-09-12T18:36:18.062762+0000","last_active":"2024-09-12T18:36:18.062762+0000","last_peered":"2024-09-12T18:36:18.062762+0000","last_clean":"2024-09-12T18:36:18.062762+0000","last_became_active":"2024-09-12T17:10:32.369824+0000","last_became_peered":"2024-09-12T17:10:32.369824+0000","last_unstale":"2024-09-12T18:36:18.062762+0000","last_undegraded":"2024-09-12T18:36:18.062762+0000","last_fullsized":"2024-09-12T18:36:18.062762+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'809","last_scrub_stamp":"2024-09-12T18:36:18.062570+0000","last_deep_scrub":"268'809","last_deep_scrub_stamp":"2024-09-12T18:36:18.062570+0000","last_clean_scrub_stamp":"2024-09-12T18:36:18.062570+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:06.008030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3803,"num_read_kb":3411,"num_write":1089,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'371","reported_seq":1184,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.929229+0000","last_change":"2024-09-12T18:36:12.929229+0000","last_active":"2024-09-12T18:36:12.929229+0000","last_peered":"2024-09-12T18:36:12.929229+0000","last_clean":"2024-09-12T18:36:12.929229+0000","last_became_active":"2024-09-12T17:10:30.357942+0000","last_became_peered":"2024-09-12T17:10:30.357942+0000","last_unstale":"2024-09-12T18:36:12.929229+0000","last_undegraded":"2024-09-12T18:36:12.929229+0000","last_fullsized":"2024-09-12T18:36:12.929229+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'371","last_scrub_stamp":"2024-09-12T18:36:12.928977+0000","last_deep_scrub":"268'371","last_deep_scrub_stamp":"2024-09-12T18:36:12.928977+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.928977+0000","objects_scrubbed":8,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:50.171794+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310810,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":949,"num_read_kb":26001,"num_write":1281,"num_write_kb":43743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:29.001612+0000","last_change":"2024-09-12T18:36:29.001612+0000","last_active":"2024-09-12T18:36:29.001612+0000","last_peered":"2024-09-12T18:36:29.001612+0000","last_clean":"2024-09-12T18:36:29.001612+0000","last_became_active":"2024-09-12T17:10:34.361686+0000","last_became_peered":"2024-09-12T17:10:34.361686+0000","last_unstale":"2024-09-12T18:36:29.001612+0000","last_undegraded":"2024-09-12T18:36:29.001612+0000","last_fullsized":"2024-09-12T18:36:29.001612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:29.001403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:29.001403+0000","last_clean_scrub_stamp":"2024-09-12T18:36:29.001403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:52.326890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'376","reported_seq":1006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.905863+0000","last_change":"2024-09-12T18:36:37.905863+0000","last_active":"2024-09-12T18:36:37.905863+0000","last_peered":"2024-09-12T18:36:37.905863+0000","last_clean":"2024-09-12T18:36:37.905863+0000","last_became_active":"2024-09-12T17:10:36.392089+0000","last_became_peered":"2024-09-12T17:10:36.392089+0000","last_unstale":"2024-09-12T18:36:37.905863+0000","last_undegraded":"2024-09-12T18:36:37.905863+0000","last_fullsized":"2024-09-12T18:36:37.905863+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-12T18:36:37.905604+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-12T18:36:37.905604+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.905604+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:26.212396+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47317,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":601,"num_read_kb":1312,"num_write":482,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:37.790130+0000","last_change":"2024-09-12T18:36:37.790130+0000","last_active":"2024-09-12T18:36:37.790130+0000","last_peered":"2024-09-12T18:36:37.790130+0000","last_clean":"2024-09-12T18:36:37.790130+0000","last_became_active":"2024-09-12T17:10:38.411191+0000","last_became_peered":"2024-09-12T17:10:38.411191+0000","last_unstale":"2024-09-12T18:36:37.790130+0000","last_undegraded":"2024-09-12T18:36:37.790130+0000","last_fullsized":"2024-09-12T18:36:37.790130+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:37.789950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:37.789950+0000","last_clean_scrub_stamp":"2024-09-12T18:36:37.789950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:40.481018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'103","reported_seq":623,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:43.010315+0000","last_change":"2024-09-12T18:36:43.010315+0000","last_active":"2024-09-12T18:36:43.010315+0000","last_peered":"2024-09-12T18:36:43.010315+0000","last_clean":"2024-09-12T18:36:43.010315+0000","last_became_active":"2024-09-12T17:10:40.436748+0000","last_became_peered":"2024-09-12T17:10:40.436748+0000","last_unstale":"2024-09-12T18:36:43.010315+0000","last_undegraded":"2024-09-12T18:36:43.010315+0000","last_fullsized":"2024-09-12T18:36:43.010315+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'103","last_scrub_stamp":"2024-09-12T18:36:43.010111+0000","last_deep_scrub":"268'103","last_deep_scrub_stamp":"2024-09-12T18:36:43.010111+0000","last_clean_scrub_stamp":"2024-09-12T18:36:43.010111+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:09.227136+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":136,"num_write":243,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'580","reported_seq":2238,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.023785+0000","last_change":"2024-09-12T18:36:19.023785+0000","last_active":"2024-09-12T18:36:19.023785+0000","last_peered":"2024-09-12T18:36:19.023785+0000","last_clean":"2024-09-12T18:36:19.023785+0000","last_became_active":"2024-09-12T17:10:32.370173+0000","last_became_peered":"2024-09-12T17:10:32.370173+0000","last_unstale":"2024-09-12T18:36:19.023785+0000","last_undegraded":"2024-09-12T18:36:19.023785+0000","last_fullsized":"2024-09-12T18:36:19.023785+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'580","last_scrub_stamp":"2024-09-12T18:36:19.023540+0000","last_deep_scrub":"268'580","last_deep_scrub_stamp":"2024-09-12T18:36:19.023540+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.023540+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:18.181483+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2773,"num_read_kb":2563,"num_write":696,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'364","reported_seq":1006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.882426+0000","last_change":"2024-09-12T18:36:13.882426+0000","last_active":"2024-09-12T18:36:13.882426+0000","last_peered":"2024-09-12T18:36:13.882426+0000","last_clean":"2024-09-12T18:36:13.882426+0000","last_became_active":"2024-09-12T17:10:30.355723+0000","last_became_peered":"2024-09-12T17:10:30.355723+0000","last_unstale":"2024-09-12T18:36:13.882426+0000","last_undegraded":"2024-09-12T18:36:13.882426+0000","last_fullsized":"2024-09-12T18:36:13.882426+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T18:36:13.882169+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T18:36:13.882169+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.882169+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:47.864528+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":22337,"num_write":1141,"num_write_kb":39083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:32.870528+0000","last_change":"2024-09-12T18:36:32.870528+0000","last_active":"2024-09-12T18:36:32.870528+0000","last_peered":"2024-09-12T18:36:32.870528+0000","last_clean":"2024-09-12T18:36:32.870528+0000","last_became_active":"2024-09-12T17:10:34.363439+0000","last_became_peered":"2024-09-12T17:10:34.363439+0000","last_unstale":"2024-09-12T18:36:32.870528+0000","last_undegraded":"2024-09-12T18:36:32.870528+0000","last_fullsized":"2024-09-12T18:36:32.870528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:32.870356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:32.870356+0000","last_clean_scrub_stamp":"2024-09-12T18:36:32.870356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:28.941269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'294","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.730732+0000","last_change":"2024-09-12T18:36:33.730732+0000","last_active":"2024-09-12T18:36:33.730732+0000","last_peered":"2024-09-12T18:36:33.730732+0000","last_clean":"2024-09-12T18:36:33.730732+0000","last_became_active":"2024-09-12T17:10:36.397148+0000","last_became_peered":"2024-09-12T17:10:36.397148+0000","last_unstale":"2024-09-12T18:36:33.730732+0000","last_undegraded":"2024-09-12T18:36:33.730732+0000","last_fullsized":"2024-09-12T18:36:33.730732+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'294","last_scrub_stamp":"2024-09-12T18:36:33.730540+0000","last_deep_scrub":"268'294","last_deep_scrub_stamp":"2024-09-12T18:36:33.730540+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.730540+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:53.128733+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":1130,"num_write":384,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.173962+0000","last_change":"2024-09-12T18:36:26.173962+0000","last_active":"2024-09-12T18:36:26.173962+0000","last_peered":"2024-09-12T18:36:26.173962+0000","last_clean":"2024-09-12T18:36:26.173962+0000","last_became_active":"2024-09-12T17:10:38.406892+0000","last_became_peered":"2024-09-12T17:10:38.406892+0000","last_unstale":"2024-09-12T18:36:26.173962+0000","last_undegraded":"2024-09-12T18:36:26.173962+0000","last_fullsized":"2024-09-12T18:36:26.173962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:26.173758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:26.173758+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.173758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:04.936184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'159","reported_seq":702,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:45.912168+0000","last_change":"2024-09-12T18:36:45.912168+0000","last_active":"2024-09-12T18:36:45.912168+0000","last_peered":"2024-09-12T18:36:45.912168+0000","last_clean":"2024-09-12T18:36:45.912168+0000","last_became_active":"2024-09-12T17:10:40.770159+0000","last_became_peered":"2024-09-12T17:10:40.770159+0000","last_unstale":"2024-09-12T18:36:45.912168+0000","last_undegraded":"2024-09-12T18:36:45.912168+0000","last_fullsized":"2024-09-12T18:36:45.912168+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'159","last_scrub_stamp":"2024-09-12T18:36:45.911969+0000","last_deep_scrub":"268'159","last_deep_scrub_stamp":"2024-09-12T18:36:45.911969+0000","last_clean_scrub_stamp":"2024-09-12T18:36:45.911969+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:56.729248+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":169,"num_write":336,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'1196","reported_seq":2731,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.766995+0000","last_change":"2024-09-12T18:36:21.766995+0000","last_active":"2024-09-12T18:36:21.766995+0000","last_peered":"2024-09-12T18:36:21.766995+0000","last_clean":"2024-09-12T18:36:21.766995+0000","last_became_active":"2024-09-12T17:10:32.357738+0000","last_became_peered":"2024-09-12T17:10:32.357738+0000","last_unstale":"2024-09-12T18:36:21.766995+0000","last_undegraded":"2024-09-12T18:36:21.766995+0000","last_fullsized":"2024-09-12T18:36:21.766995+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1196","last_scrub_stamp":"2024-09-12T18:36:21.766764+0000","last_deep_scrub":"268'1196","last_deep_scrub_stamp":"2024-09-12T18:36:21.766764+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.766764+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":1100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:30.939395+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5279,"num_read_kb":4649,"num_write":1626,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'344","reported_seq":1007,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.923859+0000","last_change":"2024-09-12T18:36:11.923708+0000","last_active":"2024-09-12T18:36:11.923859+0000","last_peered":"2024-09-12T18:36:11.923859+0000","last_clean":"2024-09-12T18:36:11.923859+0000","last_became_active":"2024-09-12T17:10:30.401941+0000","last_became_peered":"2024-09-12T17:10:30.401941+0000","last_unstale":"2024-09-12T18:36:11.923859+0000","last_undegraded":"2024-09-12T18:36:11.923859+0000","last_fullsized":"2024-09-12T18:36:11.923859+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-12T18:36:11.923480+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-12T18:36:11.923480+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.923480+0000","objects_scrubbed":9,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:14.387628+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310809,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":28042,"num_write":994,"num_write_kb":46600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.859023+0000","last_change":"2024-09-12T18:36:27.859023+0000","last_active":"2024-09-12T18:36:27.859023+0000","last_peered":"2024-09-12T18:36:27.859023+0000","last_clean":"2024-09-12T18:36:27.859023+0000","last_became_active":"2024-09-12T17:10:34.357688+0000","last_became_peered":"2024-09-12T17:10:34.357688+0000","last_unstale":"2024-09-12T18:36:27.859023+0000","last_undegraded":"2024-09-12T18:36:27.859023+0000","last_fullsized":"2024-09-12T18:36:27.859023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:27.858842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:27.858842+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.858842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:58.748918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'251","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:35.952302+0000","last_change":"2024-09-12T18:36:35.952302+0000","last_active":"2024-09-12T18:36:35.952302+0000","last_peered":"2024-09-12T18:36:35.952302+0000","last_clean":"2024-09-12T18:36:35.952302+0000","last_became_active":"2024-09-12T17:10:36.398639+0000","last_became_peered":"2024-09-12T17:10:36.398639+0000","last_unstale":"2024-09-12T18:36:35.952302+0000","last_undegraded":"2024-09-12T18:36:35.952302+0000","last_fullsized":"2024-09-12T18:36:35.952302+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'251","last_scrub_stamp":"2024-09-12T18:36:35.952117+0000","last_deep_scrub":"268'251","last_deep_scrub_stamp":"2024-09-12T18:36:35.952117+0000","last_clean_scrub_stamp":"2024-09-12T18:36:35.952117+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:16.335588+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52346,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":407,"num_read_kb":1002,"num_write":330,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:36.782135+0000","last_change":"2024-09-12T18:36:36.782135+0000","last_active":"2024-09-12T18:36:36.782135+0000","last_peered":"2024-09-12T18:36:36.782135+0000","last_clean":"2024-09-12T18:36:36.782135+0000","last_became_active":"2024-09-12T17:10:38.400703+0000","last_became_peered":"2024-09-12T17:10:38.400703+0000","last_unstale":"2024-09-12T18:36:36.782135+0000","last_undegraded":"2024-09-12T18:36:36.782135+0000","last_fullsized":"2024-09-12T18:36:36.782135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:36.781956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:36.781956+0000","last_clean_scrub_stamp":"2024-09-12T18:36:36.781956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:52.593251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'177","reported_seq":1668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:41.056285+0000","last_change":"2024-09-12T18:36:41.056285+0000","last_active":"2024-09-12T18:36:41.056285+0000","last_peered":"2024-09-12T18:36:41.056285+0000","last_clean":"2024-09-12T18:36:41.056285+0000","last_became_active":"2024-09-12T17:10:40.434195+0000","last_became_peered":"2024-09-12T17:10:40.434195+0000","last_unstale":"2024-09-12T18:36:41.056285+0000","last_undegraded":"2024-09-12T18:36:41.056285+0000","last_fullsized":"2024-09-12T18:36:41.056285+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'177","last_scrub_stamp":"2024-09-12T18:36:41.056096+0000","last_deep_scrub":"268'177","last_deep_scrub_stamp":"2024-09-12T18:36:41.056096+0000","last_clean_scrub_stamp":"2024-09-12T18:36:41.056096+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:28.684929+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1233,"num_read_kb":1222,"num_write":385,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'396","reported_seq":1921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.020701+0000","last_change":"2024-09-12T18:36:17.020701+0000","last_active":"2024-09-12T18:36:17.020701+0000","last_peered":"2024-09-12T18:36:17.020701+0000","last_clean":"2024-09-12T18:36:17.020701+0000","last_became_active":"2024-09-12T17:10:32.361716+0000","last_became_peered":"2024-09-12T17:10:32.361716+0000","last_unstale":"2024-09-12T18:36:17.020701+0000","last_undegraded":"2024-09-12T18:36:17.020701+0000","last_fullsized":"2024-09-12T18:36:17.020701+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'396","last_scrub_stamp":"2024-09-12T18:36:17.020480+0000","last_deep_scrub":"268'396","last_deep_scrub_stamp":"2024-09-12T18:36:17.020480+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.020480+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:51.155889+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2161,"num_read_kb":2069,"num_write":462,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'306","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.614975+0000","last_change":"2024-09-12T18:36:09.614975+0000","last_active":"2024-09-12T18:36:09.614975+0000","last_peered":"2024-09-12T18:36:09.614975+0000","last_clean":"2024-09-12T18:36:09.614975+0000","last_became_active":"2024-09-12T17:10:30.387788+0000","last_became_peered":"2024-09-12T17:10:30.387788+0000","last_unstale":"2024-09-12T18:36:09.614975+0000","last_undegraded":"2024-09-12T18:36:09.614975+0000","last_fullsized":"2024-09-12T18:36:09.614975+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'306","last_scrub_stamp":"2024-09-12T18:36:09.614762+0000","last_deep_scrub":"268'306","last_deep_scrub_stamp":"2024-09-12T18:36:09.614762+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.614762+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:45.452561+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1332788,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":40433,"num_write":1021,"num_write_kb":46438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.968939+0000","last_change":"2024-09-12T18:36:20.968939+0000","last_active":"2024-09-12T18:36:20.968939+0000","last_peered":"2024-09-12T18:36:20.968939+0000","last_clean":"2024-09-12T18:36:20.968939+0000","last_became_active":"2024-09-12T17:10:34.356290+0000","last_became_peered":"2024-09-12T17:10:34.356290+0000","last_unstale":"2024-09-12T18:36:20.968939+0000","last_undegraded":"2024-09-12T18:36:20.968939+0000","last_fullsized":"2024-09-12T18:36:20.968939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T18:36:20.968760+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T18:36:20.968760+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.968760+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:48.876143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'313","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:33.711502+0000","last_change":"2024-09-12T18:36:33.711502+0000","last_active":"2024-09-12T18:36:33.711502+0000","last_peered":"2024-09-12T18:36:33.711502+0000","last_clean":"2024-09-12T18:36:33.711502+0000","last_became_active":"2024-09-12T17:10:36.391455+0000","last_became_peered":"2024-09-12T17:10:36.391455+0000","last_unstale":"2024-09-12T18:36:33.711502+0000","last_undegraded":"2024-09-12T18:36:33.711502+0000","last_fullsized":"2024-09-12T18:36:33.711502+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T18:36:33.711301+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T18:36:33.711301+0000","last_clean_scrub_stamp":"2024-09-12T18:36:33.711301+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:17.424966+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44113,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":1099,"num_write":400,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:38.789767+0000","last_change":"2024-09-12T18:36:38.789767+0000","last_active":"2024-09-12T18:36:38.789767+0000","last_peered":"2024-09-12T18:36:38.789767+0000","last_clean":"2024-09-12T18:36:38.789767+0000","last_became_active":"2024-09-12T17:10:38.413592+0000","last_became_peered":"2024-09-12T17:10:38.413592+0000","last_unstale":"2024-09-12T18:36:38.789767+0000","last_undegraded":"2024-09-12T18:36:38.789767+0000","last_fullsized":"2024-09-12T18:36:38.789767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:36:38.789532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:36:38.789532+0000","last_clean_scrub_stamp":"2024-09-12T18:36:38.789532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:49.383173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'152","reported_seq":674,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:39.777213+0000","last_change":"2024-09-12T18:36:39.777069+0000","last_active":"2024-09-12T18:36:39.777213+0000","last_peered":"2024-09-12T18:36:39.777213+0000","last_clean":"2024-09-12T18:36:39.777213+0000","last_became_active":"2024-09-12T17:10:40.425063+0000","last_became_peered":"2024-09-12T17:10:40.425063+0000","last_unstale":"2024-09-12T18:36:39.777213+0000","last_undegraded":"2024-09-12T18:36:39.777213+0000","last_fullsized":"2024-09-12T18:36:39.777213+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'152","last_scrub_stamp":"2024-09-12T18:36:39.776872+0000","last_deep_scrub":"268'152","last_deep_scrub_stamp":"2024-09-12T18:36:39.776872+0000","last_clean_scrub_stamp":"2024-09-12T18:36:39.776872+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:55.611705+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":181,"num_read_kb":173,"num_write":358,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'373","reported_seq":1802,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:27.871279+0000","last_change":"2024-09-12T18:36:27.871094+0000","last_active":"2024-09-12T18:36:27.871279+0000","last_peered":"2024-09-12T18:36:27.871279+0000","last_clean":"2024-09-12T18:36:27.871279+0000","last_became_active":"2024-09-12T17:10:32.361445+0000","last_became_peered":"2024-09-12T17:10:32.361445+0000","last_unstale":"2024-09-12T18:36:27.871279+0000","last_undegraded":"2024-09-12T18:36:27.871279+0000","last_fullsized":"2024-09-12T18:36:27.871279+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'373","last_scrub_stamp":"2024-09-12T18:36:27.870922+0000","last_deep_scrub":"268'373","last_deep_scrub_stamp":"2024-09-12T18:36:27.870922+0000","last_clean_scrub_stamp":"2024-09-12T18:36:27.870922+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:44.512963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1921,"num_read_kb":1829,"num_write":410,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'364","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:06.393893+0000","last_change":"2024-09-12T18:36:06.393839+0000","last_active":"2024-09-12T18:36:06.393893+0000","last_peered":"2024-09-12T18:36:06.393893+0000","last_clean":"2024-09-12T18:36:06.393893+0000","last_became_active":"2024-09-12T17:11:04.372622+0000","last_became_peered":"2024-09-12T17:11:04.372622+0000","last_unstale":"2024-09-12T18:36:06.393893+0000","last_undegraded":"2024-09-12T18:36:06.393893+0000","last_fullsized":"2024-09-12T18:36:06.393893+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T18:36:06.393728+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T18:36:06.393728+0000","last_clean_scrub_stamp":"2024-09-12T18:36:06.393728+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:56.730903+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456544,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":530,"num_read_kb":34257,"num_write":1086,"num_write_kb":35279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'383","reported_seq":1909,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.927565+0000","last_change":"2024-09-12T18:36:19.927405+0000","last_active":"2024-09-12T18:36:19.927565+0000","last_peered":"2024-09-12T18:36:19.927565+0000","last_clean":"2024-09-12T18:36:19.927565+0000","last_became_active":"2024-09-12T17:10:32.364080+0000","last_became_peered":"2024-09-12T17:10:32.364080+0000","last_unstale":"2024-09-12T18:36:19.927565+0000","last_undegraded":"2024-09-12T18:36:19.927565+0000","last_fullsized":"2024-09-12T18:36:19.927565+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-12T18:36:19.927195+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-12T18:36:19.927195+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.927195+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:05.629401+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2111,"num_read_kb":2018,"num_write":410,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'353","reported_seq":1136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.389225+0000","last_change":"2024-09-12T18:36:13.389225+0000","last_active":"2024-09-12T18:36:13.389225+0000","last_peered":"2024-09-12T18:36:13.389225+0000","last_clean":"2024-09-12T18:36:13.389225+0000","last_became_active":"2024-09-12T17:10:30.393924+0000","last_became_peered":"2024-09-12T17:10:30.393924+0000","last_unstale":"2024-09-12T18:36:13.389225+0000","last_undegraded":"2024-09-12T18:36:13.389225+0000","last_fullsized":"2024-09-12T18:36:13.389225+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'353","last_scrub_stamp":"2024-09-12T18:36:13.388912+0000","last_deep_scrub":"268'353","last_deep_scrub_stamp":"2024-09-12T18:36:13.388912+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.388912+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:11.683116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550017,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":731,"num_read_kb":31225,"num_write":1143,"num_write_kb":33307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'814","reported_seq":2211,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.957510+0000","last_change":"2024-09-12T18:36:26.957323+0000","last_active":"2024-09-12T18:36:26.957510+0000","last_peered":"2024-09-12T18:36:26.957510+0000","last_clean":"2024-09-12T18:36:26.957510+0000","last_became_active":"2024-09-12T17:10:32.382110+0000","last_became_peered":"2024-09-12T17:10:32.382110+0000","last_unstale":"2024-09-12T18:36:26.957510+0000","last_undegraded":"2024-09-12T18:36:26.957510+0000","last_fullsized":"2024-09-12T18:36:26.957510+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'814","last_scrub_stamp":"2024-09-12T18:36:26.957133+0000","last_deep_scrub":"268'814","last_deep_scrub_stamp":"2024-09-12T18:36:26.957133+0000","last_clean_scrub_stamp":"2024-09-12T18:36:26.957133+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:11.699858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3583,"num_read_kb":3191,"num_write":1046,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'356","reported_seq":1040,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.868686+0000","last_change":"2024-09-12T18:36:14.868686+0000","last_active":"2024-09-12T18:36:14.868686+0000","last_peered":"2024-09-12T18:36:14.868686+0000","last_clean":"2024-09-12T18:36:14.868686+0000","last_became_active":"2024-09-12T17:10:30.352353+0000","last_became_peered":"2024-09-12T17:10:30.352353+0000","last_unstale":"2024-09-12T18:36:14.868686+0000","last_undegraded":"2024-09-12T18:36:14.868686+0000","last_fullsized":"2024-09-12T18:36:14.868686+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'356","last_scrub_stamp":"2024-09-12T18:36:14.868477+0000","last_deep_scrub":"268'356","last_deep_scrub_stamp":"2024-09-12T18:36:14.868477+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.868477+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:59.665480+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267294,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":541,"num_read_kb":44546,"num_write":1186,"num_write_kb":40457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'444","reported_seq":1998,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.878639+0000","last_change":"2024-09-12T18:36:16.878506+0000","last_active":"2024-09-12T18:36:16.878639+0000","last_peered":"2024-09-12T18:36:16.878639+0000","last_clean":"2024-09-12T18:36:16.878639+0000","last_became_active":"2024-09-12T17:10:32.378659+0000","last_became_peered":"2024-09-12T17:10:32.378659+0000","last_unstale":"2024-09-12T18:36:16.878639+0000","last_undegraded":"2024-09-12T18:36:16.878639+0000","last_fullsized":"2024-09-12T18:36:16.878639+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'444","last_scrub_stamp":"2024-09-12T18:36:16.878330+0000","last_deep_scrub":"268'444","last_deep_scrub_stamp":"2024-09-12T18:36:16.878330+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.878330+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:57.042518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2290,"num_read_kb":2161,"num_write":510,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1009,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'375","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.615620+0000","last_change":"2024-09-12T18:36:11.615620+0000","last_active":"2024-09-12T18:36:11.615620+0000","last_peered":"2024-09-12T18:36:11.615620+0000","last_clean":"2024-09-12T18:36:11.615620+0000","last_became_active":"2024-09-12T17:11:04.868302+0000","last_became_peered":"2024-09-12T17:11:04.868302+0000","last_unstale":"2024-09-12T18:36:11.615620+0000","last_undegraded":"2024-09-12T18:36:11.615620+0000","last_fullsized":"2024-09-12T18:36:11.615620+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'375","last_scrub_stamp":"2024-09-12T18:36:11.615367+0000","last_deep_scrub":"268'375","last_deep_scrub_stamp":"2024-09-12T18:36:11.615367+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.615367+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:50.353013+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194362,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":35312,"num_write":1211,"num_write_kb":68294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'522","reported_seq":2253,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.780273+0000","last_change":"2024-09-12T18:36:23.780273+0000","last_active":"2024-09-12T18:36:23.780273+0000","last_peered":"2024-09-12T18:36:23.780273+0000","last_clean":"2024-09-12T18:36:23.780273+0000","last_became_active":"2024-09-12T17:10:32.382841+0000","last_became_peered":"2024-09-12T17:10:32.382841+0000","last_unstale":"2024-09-12T18:36:23.780273+0000","last_undegraded":"2024-09-12T18:36:23.780273+0000","last_fullsized":"2024-09-12T18:36:23.780273+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'522","last_scrub_stamp":"2024-09-12T18:36:23.780095+0000","last_deep_scrub":"268'522","last_deep_scrub_stamp":"2024-09-12T18:36:23.780095+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.780095+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:34.659271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2888,"num_read_kb":2690,"num_write":642,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'320","reported_seq":989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.931804+0000","last_change":"2024-09-12T18:36:09.931640+0000","last_active":"2024-09-12T18:36:09.931804+0000","last_peered":"2024-09-12T18:36:09.931804+0000","last_clean":"2024-09-12T18:36:09.931804+0000","last_became_active":"2024-09-12T17:11:04.373103+0000","last_became_peered":"2024-09-12T17:11:04.373103+0000","last_unstale":"2024-09-12T18:36:09.931804+0000","last_undegraded":"2024-09-12T18:36:09.931804+0000","last_fullsized":"2024-09-12T18:36:09.931804+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-09-12T18:36:09.931398+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-09-12T18:36:09.931398+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.931398+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:02.232474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":30230,"num_write":1056,"num_write_kb":31529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'447","reported_seq":2081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:23.977845+0000","last_change":"2024-09-12T18:36:23.977845+0000","last_active":"2024-09-12T18:36:23.977845+0000","last_peered":"2024-09-12T18:36:23.977845+0000","last_clean":"2024-09-12T18:36:23.977845+0000","last_became_active":"2024-09-12T17:10:32.370112+0000","last_became_peered":"2024-09-12T17:10:32.370112+0000","last_unstale":"2024-09-12T18:36:23.977845+0000","last_undegraded":"2024-09-12T18:36:23.977845+0000","last_fullsized":"2024-09-12T18:36:23.977845+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'447","last_scrub_stamp":"2024-09-12T18:36:23.977770+0000","last_deep_scrub":"268'447","last_deep_scrub_stamp":"2024-09-12T18:36:23.977770+0000","last_clean_scrub_stamp":"2024-09-12T18:36:23.977770+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:57.025220+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2345,"num_read_kb":2230,"num_write":501,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'371","reported_seq":1071,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.914627+0000","last_change":"2024-09-12T18:36:10.914493+0000","last_active":"2024-09-12T18:36:10.914627+0000","last_peered":"2024-09-12T18:36:10.914627+0000","last_clean":"2024-09-12T18:36:10.914627+0000","last_became_active":"2024-09-12T17:10:30.348702+0000","last_became_peered":"2024-09-12T17:10:30.348702+0000","last_unstale":"2024-09-12T18:36:10.914627+0000","last_undegraded":"2024-09-12T18:36:10.914627+0000","last_fullsized":"2024-09-12T18:36:10.914627+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'371","last_scrub_stamp":"2024-09-12T18:36:10.914266+0000","last_deep_scrub":"268'371","last_deep_scrub_stamp":"2024-09-12T18:36:10.914266+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.914266+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:47.453636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310621,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":552,"num_read_kb":10243,"num_write":1254,"num_write_kb":63527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'740","reported_seq":2634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.739616+0000","last_change":"2024-09-12T18:36:22.739616+0000","last_active":"2024-09-12T18:36:22.739616+0000","last_peered":"2024-09-12T18:36:22.739616+0000","last_clean":"2024-09-12T18:36:22.739616+0000","last_became_active":"2024-09-12T17:10:32.371017+0000","last_became_peered":"2024-09-12T17:10:32.371017+0000","last_unstale":"2024-09-12T18:36:22.739616+0000","last_undegraded":"2024-09-12T18:36:22.739616+0000","last_fullsized":"2024-09-12T18:36:22.739616+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'740","last_scrub_stamp":"2024-09-12T18:36:22.739504+0000","last_deep_scrub":"268'740","last_deep_scrub_stamp":"2024-09-12T18:36:22.739504+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.739504+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:07.137813+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4018,"num_read_kb":3683,"num_write":976,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'331","reported_seq":997,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:10.196834+0000","last_change":"2024-09-12T18:36:10.196685+0000","last_active":"2024-09-12T18:36:10.196834+0000","last_peered":"2024-09-12T18:36:10.196834+0000","last_clean":"2024-09-12T18:36:10.196834+0000","last_became_active":"2024-09-12T17:10:30.396958+0000","last_became_peered":"2024-09-12T17:10:30.396958+0000","last_unstale":"2024-09-12T18:36:10.196834+0000","last_undegraded":"2024-09-12T18:36:10.196834+0000","last_fullsized":"2024-09-12T18:36:10.196834+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'331","last_scrub_stamp":"2024-09-12T18:36:10.196408+0000","last_deep_scrub":"268'331","last_deep_scrub_stamp":"2024-09-12T18:36:10.196408+0000","last_clean_scrub_stamp":"2024-09-12T18:36:10.196408+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:20.172679+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9953582,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":23680,"num_write":1025,"num_write_kb":41122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'721","reported_seq":2427,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.096925+0000","last_change":"2024-09-12T18:36:15.096925+0000","last_active":"2024-09-12T18:36:15.096925+0000","last_peered":"2024-09-12T18:36:15.096925+0000","last_clean":"2024-09-12T18:36:15.096925+0000","last_became_active":"2024-09-12T17:10:32.348200+0000","last_became_peered":"2024-09-12T17:10:32.348200+0000","last_unstale":"2024-09-12T18:36:15.096925+0000","last_undegraded":"2024-09-12T18:36:15.096925+0000","last_fullsized":"2024-09-12T18:36:15.096925+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'721","last_scrub_stamp":"2024-09-12T18:36:15.096745+0000","last_deep_scrub":"268'721","last_deep_scrub_stamp":"2024-09-12T18:36:15.096745+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.096745+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:45.902234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3587,"num_read_kb":3235,"num_write":983,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'407","reported_seq":1112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:13.863764+0000","last_change":"2024-09-12T18:36:13.863524+0000","last_active":"2024-09-12T18:36:13.863764+0000","last_peered":"2024-09-12T18:36:13.863764+0000","last_clean":"2024-09-12T18:36:13.863764+0000","last_became_active":"2024-09-12T17:10:30.370015+0000","last_became_peered":"2024-09-12T17:10:30.370015+0000","last_unstale":"2024-09-12T18:36:13.863764+0000","last_undegraded":"2024-09-12T18:36:13.863764+0000","last_fullsized":"2024-09-12T18:36:13.863764+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'407","last_scrub_stamp":"2024-09-12T18:36:13.863264+0000","last_deep_scrub":"268'407","last_deep_scrub_stamp":"2024-09-12T18:36:13.863264+0000","last_clean_scrub_stamp":"2024-09-12T18:36:13.863264+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:26.107432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399128,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":575,"num_read_kb":40389,"num_write":1181,"num_write_kb":51606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'836","reported_seq":2479,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.547284+0000","last_change":"2024-09-12T18:36:19.547033+0000","last_active":"2024-09-12T18:36:19.547284+0000","last_peered":"2024-09-12T18:36:19.547284+0000","last_clean":"2024-09-12T18:36:19.547284+0000","last_became_active":"2024-09-12T17:10:32.348842+0000","last_became_peered":"2024-09-12T17:10:32.348842+0000","last_unstale":"2024-09-12T18:36:19.547284+0000","last_undegraded":"2024-09-12T18:36:19.547284+0000","last_fullsized":"2024-09-12T18:36:19.547284+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'836","last_scrub_stamp":"2024-09-12T18:36:19.546818+0000","last_deep_scrub":"268'836","last_deep_scrub_stamp":"2024-09-12T18:36:19.546818+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.546818+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:47.788325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4030,"num_read_kb":3642,"num_write":1104,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'317","reported_seq":977,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:15.921361+0000","last_change":"2024-09-12T18:36:15.921361+0000","last_active":"2024-09-12T18:36:15.921361+0000","last_peered":"2024-09-12T18:36:15.921361+0000","last_clean":"2024-09-12T18:36:15.921361+0000","last_became_active":"2024-09-12T17:10:30.349523+0000","last_became_peered":"2024-09-12T17:10:30.349523+0000","last_unstale":"2024-09-12T18:36:15.921361+0000","last_undegraded":"2024-09-12T18:36:15.921361+0000","last_fullsized":"2024-09-12T18:36:15.921361+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'317","last_scrub_stamp":"2024-09-12T18:36:15.921079+0000","last_deep_scrub":"268'317","last_deep_scrub_stamp":"2024-09-12T18:36:15.921079+0000","last_clean_scrub_stamp":"2024-09-12T18:36:15.921079+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:36.009620+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456505,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":103976,"num_write":995,"num_write_kb":38367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'522","reported_seq":2362,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.977037+0000","last_change":"2024-09-12T18:36:19.976891+0000","last_active":"2024-09-12T18:36:19.977037+0000","last_peered":"2024-09-12T18:36:19.977037+0000","last_clean":"2024-09-12T18:36:19.977037+0000","last_became_active":"2024-09-12T17:10:32.362881+0000","last_became_peered":"2024-09-12T17:10:32.362881+0000","last_unstale":"2024-09-12T18:36:19.977037+0000","last_undegraded":"2024-09-12T18:36:19.977037+0000","last_fullsized":"2024-09-12T18:36:19.977037+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'522","last_scrub_stamp":"2024-09-12T18:36:19.976700+0000","last_deep_scrub":"268'522","last_deep_scrub_stamp":"2024-09-12T18:36:19.976700+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.976700+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:14.830945+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2930,"num_read_kb":2778,"num_write":610,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'363","reported_seq":1059,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:12.900511+0000","last_change":"2024-09-12T18:36:12.900511+0000","last_active":"2024-09-12T18:36:12.900511+0000","last_peered":"2024-09-12T18:36:12.900511+0000","last_clean":"2024-09-12T18:36:12.900511+0000","last_became_active":"2024-09-12T17:10:30.378766+0000","last_became_peered":"2024-09-12T17:10:30.378766+0000","last_unstale":"2024-09-12T18:36:12.900511+0000","last_undegraded":"2024-09-12T18:36:12.900511+0000","last_fullsized":"2024-09-12T18:36:12.900511+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-12T18:36:12.900085+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-12T18:36:12.900085+0000","last_clean_scrub_stamp":"2024-09-12T18:36:12.900085+0000","objects_scrubbed":6,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:24.060613+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102155,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":26410,"num_write":1209,"num_write_kb":29487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'526","reported_seq":2184,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.396356+0000","last_change":"2024-09-12T18:36:14.396208+0000","last_active":"2024-09-12T18:36:14.396356+0000","last_peered":"2024-09-12T18:36:14.396356+0000","last_clean":"2024-09-12T18:36:14.396356+0000","last_became_active":"2024-09-12T17:10:32.341480+0000","last_became_peered":"2024-09-12T17:10:32.341480+0000","last_unstale":"2024-09-12T18:36:14.396356+0000","last_undegraded":"2024-09-12T18:36:14.396356+0000","last_fullsized":"2024-09-12T18:36:14.396356+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'526","last_scrub_stamp":"2024-09-12T18:36:14.396018+0000","last_deep_scrub":"268'526","last_deep_scrub_stamp":"2024-09-12T18:36:14.396018+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.396018+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:55.035930+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2856,"num_read_kb":2663,"num_write":671,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'349","reported_seq":1107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:16.956802+0000","last_change":"2024-09-12T18:36:16.956802+0000","last_active":"2024-09-12T18:36:16.956802+0000","last_peered":"2024-09-12T18:36:16.956802+0000","last_clean":"2024-09-12T18:36:16.956802+0000","last_became_active":"2024-09-12T17:10:30.404567+0000","last_became_peered":"2024-09-12T17:10:30.404567+0000","last_unstale":"2024-09-12T18:36:16.956802+0000","last_undegraded":"2024-09-12T18:36:16.956802+0000","last_fullsized":"2024-09-12T18:36:16.956802+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-12T18:36:16.956584+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-12T18:36:16.956584+0000","last_clean_scrub_stamp":"2024-09-12T18:36:16.956584+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:29.404555+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":789,"num_read_kb":46887,"num_write":1083,"num_write_kb":42596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'381","reported_seq":1788,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.997849+0000","last_change":"2024-09-12T18:36:20.997849+0000","last_active":"2024-09-12T18:36:20.997849+0000","last_peered":"2024-09-12T18:36:20.997849+0000","last_clean":"2024-09-12T18:36:20.997849+0000","last_became_active":"2024-09-12T17:10:32.370799+0000","last_became_peered":"2024-09-12T17:10:32.370799+0000","last_unstale":"2024-09-12T18:36:20.997849+0000","last_undegraded":"2024-09-12T18:36:20.997849+0000","last_fullsized":"2024-09-12T18:36:20.997849+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'381","last_scrub_stamp":"2024-09-12T18:36:20.997632+0000","last_deep_scrub":"268'381","last_deep_scrub_stamp":"2024-09-12T18:36:20.997632+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.997632+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:50.639762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2049,"num_read_kb":1938,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'327","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:14.593784+0000","last_change":"2024-09-12T18:36:14.593784+0000","last_active":"2024-09-12T18:36:14.593784+0000","last_peered":"2024-09-12T18:36:14.593784+0000","last_clean":"2024-09-12T18:36:14.593784+0000","last_became_active":"2024-09-12T17:10:30.374689+0000","last_became_peered":"2024-09-12T17:10:30.374689+0000","last_unstale":"2024-09-12T18:36:14.593784+0000","last_undegraded":"2024-09-12T18:36:14.593784+0000","last_fullsized":"2024-09-12T18:36:14.593784+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'327","last_scrub_stamp":"2024-09-12T18:36:14.593513+0000","last_deep_scrub":"268'327","last_deep_scrub_stamp":"2024-09-12T18:36:14.593513+0000","last_clean_scrub_stamp":"2024-09-12T18:36:14.593513+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:28.532832+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7813717,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":410,"num_read_kb":28127,"num_write":1070,"num_write_kb":52007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1587","reported_seq":3075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:21.983176+0000","last_change":"2024-09-12T18:36:21.983176+0000","last_active":"2024-09-12T18:36:21.983176+0000","last_peered":"2024-09-12T18:36:21.983176+0000","last_clean":"2024-09-12T18:36:21.983176+0000","last_became_active":"2024-09-12T17:10:32.384842+0000","last_became_peered":"2024-09-12T17:10:32.384842+0000","last_unstale":"2024-09-12T18:36:21.983176+0000","last_undegraded":"2024-09-12T18:36:21.983176+0000","last_fullsized":"2024-09-12T18:36:21.983176+0000","mapping_epoch":27,"log_start":"268'1500","ondisk_log_start":"268'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1587","last_scrub_stamp":"2024-09-12T18:36:21.982944+0000","last_deep_scrub":"268'1587","last_deep_scrub_stamp":"2024-09-12T18:36:21.982944+0000","last_clean_scrub_stamp":"2024-09-12T18:36:21.982944+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":1500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:29.105970+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6992,"num_read_kb":6083,"num_write":2272,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1264,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'489","reported_seq":1308,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.175743+0000","last_change":"2024-09-12T18:36:11.175743+0000","last_active":"2024-09-12T18:36:11.175743+0000","last_peered":"2024-09-12T18:36:11.175743+0000","last_clean":"2024-09-12T18:36:11.175743+0000","last_became_active":"2024-09-12T17:12:05.372879+0000","last_became_peered":"2024-09-12T17:12:05.372879+0000","last_unstale":"2024-09-12T18:36:11.175743+0000","last_undegraded":"2024-09-12T18:36:11.175743+0000","last_fullsized":"2024-09-12T18:36:11.175743+0000","mapping_epoch":40,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'489","last_scrub_stamp":"2024-09-12T18:36:11.175471+0000","last_deep_scrub":"268'489","last_deep_scrub_stamp":"2024-09-12T18:36:11.175471+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.175471+0000","objects_scrubbed":6,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:34.394103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":953,"num_read_kb":72647,"num_write":1674,"num_write_kb":47468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,0],"acting":[6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'1144","reported_seq":2659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:22.593697+0000","last_change":"2024-09-12T18:36:22.593697+0000","last_active":"2024-09-12T18:36:22.593697+0000","last_peered":"2024-09-12T18:36:22.593697+0000","last_clean":"2024-09-12T18:36:22.593697+0000","last_became_active":"2024-09-12T17:10:32.361416+0000","last_became_peered":"2024-09-12T17:10:32.361416+0000","last_unstale":"2024-09-12T18:36:22.593697+0000","last_undegraded":"2024-09-12T18:36:22.593697+0000","last_fullsized":"2024-09-12T18:36:22.593697+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1144","last_scrub_stamp":"2024-09-12T18:36:22.593502+0000","last_deep_scrub":"268'1144","last_deep_scrub_stamp":"2024-09-12T18:36:22.593502+0000","last_clean_scrub_stamp":"2024-09-12T18:36:22.593502+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":1100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:36.821997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5102,"num_read_kb":4502,"num_write":1588,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'428","reported_seq":1230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.909977+0000","last_change":"2024-09-12T18:36:19.909819+0000","last_active":"2024-09-12T18:36:19.909977+0000","last_peered":"2024-09-12T18:36:19.909977+0000","last_clean":"2024-09-12T18:36:19.909977+0000","last_became_active":"2024-09-12T17:10:30.404403+0000","last_became_peered":"2024-09-12T17:10:30.404403+0000","last_unstale":"2024-09-12T18:36:19.909977+0000","last_undegraded":"2024-09-12T18:36:19.909977+0000","last_fullsized":"2024-09-12T18:36:19.909977+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'428","last_scrub_stamp":"2024-09-12T18:36:19.909576+0000","last_deep_scrub":"268'428","last_deep_scrub_stamp":"2024-09-12T18:36:19.909576+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.909576+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:04.500862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":773,"num_read_kb":38616,"num_write":1272,"num_write_kb":36952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'394","reported_seq":1959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.746611+0000","last_change":"2024-09-12T18:36:25.746611+0000","last_active":"2024-09-12T18:36:25.746611+0000","last_peered":"2024-09-12T18:36:25.746611+0000","last_clean":"2024-09-12T18:36:25.746611+0000","last_became_active":"2024-09-12T17:10:32.352916+0000","last_became_peered":"2024-09-12T17:10:32.352916+0000","last_unstale":"2024-09-12T18:36:25.746611+0000","last_undegraded":"2024-09-12T18:36:25.746611+0000","last_fullsized":"2024-09-12T18:36:25.746611+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T18:36:25.746401+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T18:36:25.746401+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.746401+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:50.410716+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2283,"num_read_kb":2176,"num_write":460,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3055,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'343","reported_seq":995,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:09.346154+0000","last_change":"2024-09-12T18:36:09.345942+0000","last_active":"2024-09-12T18:36:09.346154+0000","last_peered":"2024-09-12T18:36:09.346154+0000","last_clean":"2024-09-12T18:36:09.346154+0000","last_became_active":"2024-09-12T17:10:30.402024+0000","last_became_peered":"2024-09-12T17:10:30.402024+0000","last_unstale":"2024-09-12T18:36:09.346154+0000","last_undegraded":"2024-09-12T18:36:09.346154+0000","last_fullsized":"2024-09-12T18:36:09.346154+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'343","last_scrub_stamp":"2024-09-12T18:36:09.345594+0000","last_deep_scrub":"268'343","last_deep_scrub_stamp":"2024-09-12T18:36:09.345594+0000","last_clean_scrub_stamp":"2024-09-12T18:36:09.345594+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:30.257704+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048602,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":454,"num_read_kb":33472,"num_write":1006,"num_write_kb":44244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'833","reported_seq":2409,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:25.932561+0000","last_change":"2024-09-12T18:36:25.932561+0000","last_active":"2024-09-12T18:36:25.932561+0000","last_peered":"2024-09-12T18:36:25.932561+0000","last_clean":"2024-09-12T18:36:25.932561+0000","last_became_active":"2024-09-12T17:10:32.375891+0000","last_became_peered":"2024-09-12T17:10:32.375891+0000","last_unstale":"2024-09-12T18:36:25.932561+0000","last_undegraded":"2024-09-12T18:36:25.932561+0000","last_fullsized":"2024-09-12T18:36:25.932561+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'833","last_scrub_stamp":"2024-09-12T18:36:25.932381+0000","last_deep_scrub":"268'833","last_deep_scrub_stamp":"2024-09-12T18:36:25.932381+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.932381+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:14.640927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3808,"num_read_kb":3437,"num_write":1089,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'407","reported_seq":1138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:17.991342+0000","last_change":"2024-09-12T18:36:17.991189+0000","last_active":"2024-09-12T18:36:17.991342+0000","last_peered":"2024-09-12T18:36:17.991342+0000","last_clean":"2024-09-12T18:36:17.991342+0000","last_became_active":"2024-09-12T17:10:30.378109+0000","last_became_peered":"2024-09-12T17:10:30.378109+0000","last_unstale":"2024-09-12T18:36:17.991342+0000","last_undegraded":"2024-09-12T18:36:17.991342+0000","last_fullsized":"2024-09-12T18:36:17.991342+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'407","last_scrub_stamp":"2024-09-12T18:36:17.990804+0000","last_deep_scrub":"268'407","last_deep_scrub_stamp":"2024-09-12T18:36:17.990804+0000","last_clean_scrub_stamp":"2024-09-12T18:36:17.990804+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:07.244535+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505043,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":645,"num_read_kb":82540,"num_write":1282,"num_write_kb":46419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'405","reported_seq":1093,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:19.986139+0000","last_change":"2024-09-12T18:36:19.986000+0000","last_active":"2024-09-12T18:36:19.986139+0000","last_peered":"2024-09-12T18:36:19.986139+0000","last_clean":"2024-09-12T18:36:19.986139+0000","last_became_active":"2024-09-12T17:10:30.356199+0000","last_became_peered":"2024-09-12T17:10:30.356199+0000","last_unstale":"2024-09-12T18:36:19.986139+0000","last_undegraded":"2024-09-12T18:36:19.986139+0000","last_fullsized":"2024-09-12T18:36:19.986139+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'405","last_scrub_stamp":"2024-09-12T18:36:19.985773+0000","last_deep_scrub":"268'405","last_deep_scrub_stamp":"2024-09-12T18:36:19.985773+0000","last_clean_scrub_stamp":"2024-09-12T18:36:19.985773+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:53.434690+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4401467,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":595,"num_read_kb":25748,"num_write":1241,"num_write_kb":44098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'463","reported_seq":2259,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:20.568220+0000","last_change":"2024-09-12T18:36:20.568220+0000","last_active":"2024-09-12T18:36:20.568220+0000","last_peered":"2024-09-12T18:36:20.568220+0000","last_clean":"2024-09-12T18:36:20.568220+0000","last_became_active":"2024-09-12T17:10:32.349687+0000","last_became_peered":"2024-09-12T17:10:32.349687+0000","last_unstale":"2024-09-12T18:36:20.568220+0000","last_undegraded":"2024-09-12T18:36:20.568220+0000","last_fullsized":"2024-09-12T18:36:20.568220+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'463","last_scrub_stamp":"2024-09-12T18:36:20.568016+0000","last_deep_scrub":"268'463","last_deep_scrub_stamp":"2024-09-12T18:36:20.568016+0000","last_clean_scrub_stamp":"2024-09-12T18:36:20.568016+0000","objects_scrubbed":6,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:18.504326+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2918,"num_read_kb":2789,"num_write":551,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'377","reported_seq":1048,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:11.922019+0000","last_change":"2024-09-12T18:36:11.921872+0000","last_active":"2024-09-12T18:36:11.922019+0000","last_peered":"2024-09-12T18:36:11.922019+0000","last_clean":"2024-09-12T18:36:11.922019+0000","last_became_active":"2024-09-12T17:11:05.121473+0000","last_became_peered":"2024-09-12T17:11:05.121473+0000","last_unstale":"2024-09-12T18:36:11.922019+0000","last_undegraded":"2024-09-12T18:36:11.922019+0000","last_fullsized":"2024-09-12T18:36:11.922019+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'377","last_scrub_stamp":"2024-09-12T18:36:11.921663+0000","last_deep_scrub":"268'377","last_deep_scrub_stamp":"2024-09-12T18:36:11.921663+0000","last_clean_scrub_stamp":"2024-09-12T18:36:11.921663+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:06.622722+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574022,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":29048,"num_write":1222,"num_write_kb":43104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'469","reported_seq":1973,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T18:36:26.000255+0000","last_change":"2024-09-12T18:36:26.000255+0000","last_active":"2024-09-12T18:36:26.000255+0000","last_peered":"2024-09-12T18:36:26.000255+0000","last_clean":"2024-09-12T18:36:26.000255+0000","last_became_active":"2024-09-12T17:10:32.352369+0000","last_became_peered":"2024-09-12T17:10:32.352369+0000","last_unstale":"2024-09-12T18:36:26.000255+0000","last_undegraded":"2024-09-12T18:36:26.000255+0000","last_fullsized":"2024-09-12T18:36:26.000255+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'469","last_scrub_stamp":"2024-09-12T18:36:25.999980+0000","last_deep_scrub":"268'469","last_deep_scrub_stamp":"2024-09-12T18:36:25.999980+0000","last_clean_scrub_stamp":"2024-09-12T18:36:25.999980+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:32.160700+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2354,"num_read_kb":2191,"num_write":554,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6108,"num_read_kb":4244,"num_write":1960,"num_write_kb":858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6958,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1133,"ondisk_log_size":1133,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":16274,"num_read_kb":15945,"num_write":16744,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1766,"ondisk_log_size":1766,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":736,"ondisk_log_size":736,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1625724,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":19494,"num_read_kb":40096,"num_write":16267,"num_write_kb":12112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":686274,"num_omap_keys":1572,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1932,"ondisk_log_size":1932,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":213001,"num_read_kb":194600,"num_write":55405,"num_write_kb":18906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44604,"num_omap_keys":180,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3841,"ondisk_log_size":3841,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":165322276,"num_objects":398,"num_object_clones":0,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":0,"num_read":36558,"num_read_kb":2308341,"num_write":72533,"num_write_kb":2504748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":249851904,"data_stored":249851904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3895,"ondisk_log_size":3895,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":159116,"num_write":182,"num_write_kb":116497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":158495,"num_write":182,"num_write_kb":116497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510490,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":340376,"kb_used_data":52360,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94031464,"statfs":{"total":96636764160,"available":96288219136,"internally_reserved":0,"allocated":53616640,"data_stored":51463722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":294910410},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510494,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299236,"kb_used_data":33428,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94072604,"statfs":{"total":96636764160,"available":96330346496,"internally_reserved":0,"allocated":34230272,"data_stored":32143073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":272169414},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510491,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":178948,"kb_used_data":31220,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94192892,"statfs":{"total":96636764160,"available":96453521408,"internally_reserved":0,"allocated":31969280,"data_stored":29799186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510493,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":135104,"kb_used_data":23408,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94236736,"statfs":{"total":96636764160,"available":96498417664,"internally_reserved":0,"allocated":23969792,"data_stored":21888023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510494,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209668,"kb_used_data":25844,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94162172,"statfs":{"total":96636764160,"available":96422064128,"internally_reserved":0,"allocated":26464256,"data_stored":24357991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510491,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302280,"kb_used_data":36472,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94069560,"statfs":{"total":96636764160,"available":96327229440,"internally_reserved":0,"allocated":37347328,"data_stored":35205199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":272169414},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543197,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139540,"kb_used_data":40324,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94232300,"statfs":{"total":96636764160,"available":96493875200,"internally_reserved":0,"allocated":41291776,"data_stored":39213361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575898,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320580,"kb_used_data":36724,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94051260,"statfs":{"total":96636764160,"available":96308490240,"internally_reserved":0,"allocated":37605376,"data_stored":35472167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32301056,"data_stored":32301056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22044672,"data_stored":22044672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19574784,"data_stored":19574784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33157120,"data_stored":33157120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36900864,"data_stored":36900864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":27484160,"data_stored":27484160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29831168,"data_stored":29831168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":48558080,"data_stored":48558080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:37:30.465 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T18:37:30.820 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T18:37:30.820 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T18:37:30.820 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T18:37:30.820 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:37:36.922 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T18:37:36.923 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T18:37:36.923 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:37:37.006 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T18:37:37.006 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T18:37:37.006 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:37:37.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-12T18:37:43.108 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T18:37:43.109 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T18:37:43.109 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:37:43.200 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T18:37:43.200 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T18:37:43.200 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:37:43.589 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-12T18:37:43.589 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-12T18:37:49.302 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T18:37:49.302 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T18:37:49.302 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:37:49.368 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T18:37:49.368 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T18:37:49.368 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:37:49.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-12T18:37:49.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-12T18:37:55.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-12T18:37:55.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-12T18:37:55.470 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T18:37:55.470 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T18:37:55.470 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:38:00.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-12T18:38:00.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-12T18:38:01.572 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T18:38:01.572 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T18:38:01.573 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T18:38:01.573 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:38:01.601 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T18:38:01.601 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T18:38:01.601 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:38:01.632 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T18:38:01.633 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T18:38:01.633 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T18:38:01.633 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:38:01.680 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T18:38:01.680 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T18:38:01.681 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:38:01.745 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T18:38:01.745 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T18:38:01.745 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:38:01.774 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T18:38:01.775 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T18:38:01.775 DEBUG:teuthology.orchestra.run.smithi119:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T18:38:01.801 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T18:38:01.801 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T18:38:02.084 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T18:38:02.084 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T18:38:02.294 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T18:38:02.294 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T18:38:02.457 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T18:38:02.458 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T18:38:02.637 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T18:38:02.637 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T18:38:02.895 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T18:38:02.895 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T18:38:03.071 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T18:38:03.071 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T18:38:03.254 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T18:38:03.254 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T18:38:03.430 INFO:tasks.ceph:Archiving mon data... 2024-09-12T18:38:03.432 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902707/data/mon.a.tgz 2024-09-12T18:38:03.432 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-09-12T18:38:03.438 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.tSF8hrdnZX 2024-09-12T18:38:03.438 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.tSF8hrdnZX 2024-09-12T18:38:03.634 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.tSF8hrdnZX 2024-09-12T18:38:03.702 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.tSF8hrdnZX is 602KB 2024-09-12T18:38:03.764 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.tSF8hrdnZX 2024-09-12T18:38:03.770 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902707/data/mon.c.tgz 2024-09-12T18:38:03.770 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-09-12T18:38:03.818 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.4wK0LsNZVF 2024-09-12T18:38:03.819 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.4wK0LsNZVF 2024-09-12T18:38:04.015 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.4wK0LsNZVF 2024-09-12T18:38:04.077 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.4wK0LsNZVF is 615KB 2024-09-12T18:38:04.140 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.4wK0LsNZVF 2024-09-12T18:38:04.146 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902707/data/mon.b.tgz 2024-09-12T18:38:04.146 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-09-12T18:38:04.153 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.Thu35ehVAB 2024-09-12T18:38:04.153 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Thu35ehVAB 2024-09-12T18:38:04.346 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.Thu35ehVAB 2024-09-12T18:38:04.408 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.Thu35ehVAB is 615KB 2024-09-12T18:38:04.472 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.Thu35ehVAB 2024-09-12T18:38:04.477 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T18:38:04.478 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:38:04.480 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:38:04.593 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:38:04.599 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:38:04.599 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T18:38:04.601 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902707/remote/smithi119/crash 2024-09-12T18:38:04.602 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:38:04.615 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902707/remote/smithi194/crash 2024-09-12T18:38:04.616 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:38:04.653 INFO:tasks.ceph:Compressing logs... 2024-09-12T18:38:04.653 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:38:04.660 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:38:04.692 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32391.log 2024-09-12T18:38:04.693 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165235.log 2024-09-12T18:38:04.693 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184489.log 2024-09-12T18:38:04.693 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32391.log.gz 2024-09-12T18:38:04.693 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53397.log 2024-09-12T18:38:04.693 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.165235.log: /var/log/ceph/ceph-client.admin.184489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146344.log 2024-09-12T18:38:04.693 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184489.log.gz 2024-09-12T18:38:04.693 INFO:teuthology.orchestra.run.smithi119.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.165235.log.gz 2024-09-12T18:38:04.693 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.53397.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T18:38:04.693 INFO:teuthology.orchestra.run.smithi119.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.53397.log.gz 2024-09-12T18:38:04.693 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116842.log/var/log/ceph/ceph-client.admin.146344.log: 2024-09-12T18:38:04.694 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32365.log 2024-09-12T18:38:04.694 INFO:teuthology.orchestra.run.smithi119.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.146344.log.gz 2024-09-12T18:38:04.694 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113301.log 2024-09-12T18:38:04.694 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.116842.log: /var/log/ceph/ceph-client.admin.32365.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.116842.log.gz 2024-09-12T18:38:04.694 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.32682.log -- replaced with /var/log/ceph/ceph-client.admin.32365.log.gz 2024-09-12T18:38:04.694 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-12T18:38:04.694 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.113301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183943.log 2024-09-12T18:38:04.694 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94417.log 2024-09-12T18:38:04.694 INFO:teuthology.orchestra.run.smithi119.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113301.log.gz 2024-09-12T18:38:04.694 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32682.log.gz 2024-09-12T18:38:04.695 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.183943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183943.log.gz 2024-09-12T18:38:04.695 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T18:38:04.695 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.94417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59558.log 2024-09-12T18:38:04.695 INFO:teuthology.orchestra.run.smithi119.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.94417.log.gz 2024-09-12T18:38:04.695 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156422.log 2024-09-12T18:38:04.695 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.59558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33401.log 2024-09-12T18:38:04.695 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.156422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156422.log.gz 2024-09-12T18:38:04.695 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90287.log 2024-09-12T18:38:04.704 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32481.log 2024-09-12T18:38:04.704 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33401.log.gz 2024-09-12T18:38:04.704 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.90287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79667.log 2024-09-12T18:38:04.704 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32481.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.90287.log.gz 2024-09-12T18:38:04.704 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34670.log 2024-09-12T18:38:04.704 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32481.log.gz 2024-09-12T18:38:04.704 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.79667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37605.log 2024-09-12T18:38:04.705 INFO:teuthology.orchestra.run.smithi119.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.79667.log.gz 2024-09-12T18:38:04.705 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.34670.log: -- /var/log/ceph/ceph-client.admin.87337.log 2024-09-12T18:38:04.705 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.37605.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.34670.log.gz 2024-09-12T18:38:04.705 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154036.log 2024-09-12T18:38:04.705 INFO:teuthology.orchestra.run.smithi119.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37605.log.gz 2024-09-12T18:38:04.705 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.87337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73177.log 2024-09-12T18:38:04.705 INFO:teuthology.orchestra.run.smithi119.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.87337.log.gz 2024-09-12T18:38:04.705 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.154036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112711.log 2024-09-12T18:38:04.705 INFO:teuthology.orchestra.run.smithi119.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.59558.log.gz 2024-09-12T18:38:04.705 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.73177.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.154036.log.gz 2024-09-12T18:38:04.705 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68120.log 2024-09-12T18:38:04.706 INFO:teuthology.orchestra.run.smithi119.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.73177.log.gz 2024-09-12T18:38:04.706 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.112711.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.112711.log.gz 2024-09-12T18:38:04.706 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32697.log 2024-09-12T18:38:04.706 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32494.log 2024-09-12T18:38:04.706 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.68120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180086.log 2024-09-12T18:38:04.706 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32697.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.68120.log.gz 2024-09-12T18:38:04.706 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32697.log.gz 2024-09-12T18:38:04.706 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32494.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.46857.log -- replaced with /var/log/ceph/ceph-client.admin.32494.log.gz 2024-09-12T18:38:04.706 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-12T18:38:04.706 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.180086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84387.log 2024-09-12T18:38:04.706 INFO:teuthology.orchestra.run.smithi119.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.180086.log.gz 2024-09-12T18:38:04.706 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132773.log 2024-09-12T18:38:04.706 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.84387.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.46857.log.gz 2024-09-12T18:38:04.706 INFO:teuthology.orchestra.run.smithi119.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.84387.log.gz 2024-09-12T18:38:04.707 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32688.log 2024-09-12T18:38:04.707 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45627.log 2024-09-12T18:38:04.707 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.132773.log: /var/log/ceph/ceph-client.admin.32688.log: 82.1% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32688.log.gz -- replaced with /var/log/ceph/ceph-client.admin.132773.log.gz 2024-09-12T18:38:04.707 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-12T18:38:04.707 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54012.log 2024-09-12T18:38:04.707 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.45627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110351.log 2024-09-12T18:38:04.707 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45627.log.gz 2024-09-12T18:38:04.707 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.54012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54012.log.gz 2024-09-12T18:38:04.707 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184203.log 2024-09-12T18:38:04.707 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.110351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148114.log 2024-09-12T18:38:04.707 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184203.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110351.log.gz 2024-09-12T18:38:04.707 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184203.log.gz 2024-09-12T18:38:04.708 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T18:38:04.708 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.148114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183917.log 2024-09-12T18:38:04.708 INFO:teuthology.orchestra.run.smithi119.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.148114.log.gz 2024-09-12T18:38:04.708 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135133.log 2024-09-12T18:38:04.708 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.183917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183917.log.gz 2024-09-12T18:38:04.708 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66349.log 2024-09-12T18:38:04.708 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32913.log 2024-09-12T18:38:04.708 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.135133.log: /var/log/ceph/ceph-client.admin.66349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62788.log 2024-09-12T18:38:04.708 INFO:teuthology.orchestra.run.smithi119.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.66349.log.gz 2024-09-12T18:38:04.708 INFO:teuthology.orchestra.run.smithi119.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.135133.log.gz 2024-09-12T18:38:04.718 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32913.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.32913.log.gz 2024-09-12T18:38:04.718 INFO:teuthology.orchestra.run.smithi119.stderr: /var/log/ceph/ceph-client.admin.45677.log 2024-09-12T18:38:04.718 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.62788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141034.log 2024-09-12T18:38:04.718 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.45677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123923.log 2024-09-12T18:38:04.718 INFO:teuthology.orchestra.run.smithi119.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.45677.log.gz 2024-09-12T18:38:04.718 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.141034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131593.log 2024-09-12T18:38:04.718 INFO:teuthology.orchestra.run.smithi119.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.141034.log.gz 2024-09-12T18:38:04.719 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.123923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43241.log 2024-09-12T18:38:04.719 INFO:teuthology.orchestra.run.smithi119.stderr: 82.0%/var/log/ceph/ceph-client.admin.131593.log: -- replaced with /var/log/ceph/ceph-client.admin.123923.log.gz 2024-09-12T18:38:04.719 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54037.log 2024-09-12T18:38:04.719 INFO:teuthology.orchestra.run.smithi119.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.62788.log.gz 2024-09-12T18:38:04.719 INFO:teuthology.orchestra.run.smithi119.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.131593.log.gz 2024-09-12T18:38:04.719 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.43241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33141.log 2024-09-12T18:38:04.719 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43241.log.gz 2024-09-12T18:38:04.719 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.54037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105631.log 2024-09-12T18:38:04.719 INFO:teuthology.orchestra.run.smithi119.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.54037.log.gz 2024-09-12T18:38:04.719 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33141.log.gz 2024-09-12T18:38:04.719 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32705.log 2024-09-12T18:38:04.719 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.105631.log: /var/log/ceph/ceph-client.admin.181314.log 2024-09-12T18:38:04.719 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32705.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.105631.log.gz 2024-09-12T18:38:04.720 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32705.log.gz 2024-09-12T18:38:04.720 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184255.log 2024-09-12T18:38:04.720 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45652.log 2024-09-12T18:38:04.720 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.181314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181314.log.gz 2024-09-12T18:38:04.720 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178773.log 2024-09-12T18:38:04.720 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184255.log.gz 2024-09-12T18:38:04.720 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.45652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45652.log.gz 2024-09-12T18:38:04.720 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142804.log 2024-09-12T18:38:04.720 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120973.log 2024-09-12T18:38:04.720 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.178773.log: /var/log/ceph/ceph-client.admin.142804.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.178773.log.gz 2024-09-12T18:38:04.720 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174643.log 2024-09-12T18:38:04.720 INFO:teuthology.orchestra.run.smithi119.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.142804.log.gz 2024-09-12T18:38:04.720 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.120973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89107.log 2024-09-12T18:38:04.721 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.174643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183995.log 2024-09-12T18:38:04.721 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.89107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60848.log 2024-09-12T18:38:04.721 INFO:teuthology.orchestra.run.smithi119.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.174643.log.gz 2024-09-12T18:38:04.721 INFO:teuthology.orchestra.run.smithi119.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.120973.log.gz 2024-09-12T18:38:04.721 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.183995.log: 82.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.89107.log.gz -5 2024-09-12T18:38:04.721 INFO:teuthology.orchestra.run.smithi119.stderr: --verbose -- /var/log/ceph/ceph-client.0.34086.log 2024-09-12T18:38:04.721 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183995.log.gz 2024-09-12T18:38:04.721 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166413.log 2024-09-12T18:38:04.721 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.60848.log: /var/log/ceph/ceph-client.0.34086.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.34086.log.gz 2024-09-12T18:38:04.721 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32912.log 2024-09-12T18:38:04.721 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174053.log 2024-09-12T18:38:04.721 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.166413.log: /var/log/ceph/ceph-client.admin.32912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156447.log 2024-09-12T18:38:04.721 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32912.log.gz 2024-09-12T18:38:04.722 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.174053.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.166413.log.gz 2024-09-12T18:38:04.722 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70582.log 2024-09-12T18:38:04.722 INFO:teuthology.orchestra.run.smithi119.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.174053.log.gz 2024-09-12T18:38:04.722 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.156447.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.60848.log.gz 2024-09-12T18:38:04.722 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126283.log 2024-09-12T18:38:04.722 INFO:teuthology.orchestra.run.smithi119.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.156447.log.gz 2024-09-12T18:38:04.722 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.70582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32322.log 2024-09-12T18:38:04.722 INFO:teuthology.orchestra.run.smithi119.stderr: 49.9% -- replaced with /var/log/ceph/ceph-client.admin.70582.log.gz 2024-09-12T18:38:04.722 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.126283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32911.log 2024-09-12T18:38:04.722 INFO:teuthology.orchestra.run.smithi119.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.126283.log.gz 2024-09-12T18:38:04.722 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42626.log 2024-09-12T18:38:04.722 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32322.log: /var/log/ceph/ceph-client.admin.32911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32322.log.gz 2024-09-12T18:38:04.722 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32911.log.gz 2024-09-12T18:38:04.722 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37021.log 2024-09-12T18:38:04.723 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112121.log 2024-09-12T18:38:04.723 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.42626.log: /var/log/ceph/ceph-client.0.37021.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.42626.log.gz 2024-09-12T18:38:04.723 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143394.log 2024-09-12T18:38:04.723 INFO:teuthology.orchestra.run.smithi119.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37021.log.gz 2024-09-12T18:38:04.723 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.112121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146934.log 2024-09-12T18:38:04.723 INFO:teuthology.orchestra.run.smithi119.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.112121.log.gz 2024-09-12T18:38:04.730 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.143394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161527.log 2024-09-12T18:38:04.731 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.146934.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.143394.log.gz 2024-09-12T18:38:04.731 INFO:teuthology.orchestra.run.smithi119.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.146934.log.gz 2024-09-12T18:38:04.731 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T18:38:04.731 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158267.log 2024-09-12T18:38:04.731 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.161527.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98548.log 2024-09-12T18:38:04.731 INFO:teuthology.orchestra.run.smithi119.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.161527.log.gz 2024-09-12T18:38:04.731 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.158267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107401.log 2024-09-12T18:38:04.731 INFO:teuthology.orchestra.run.smithi119.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.158267.log.gz 2024-09-12T18:38:04.731 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.98548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176413.log 2024-09-12T18:38:04.731 INFO:teuthology.orchestra.run.smithi119.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98548.log.gz 2024-09-12T18:38:04.731 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.107401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43857.log 2024-09-12T18:38:04.732 INFO:teuthology.orchestra.run.smithi119.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.107401.log.gz 2024-09-12T18:38:04.732 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.176413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171103.log 2024-09-12T18:38:04.732 INFO:teuthology.orchestra.run.smithi119.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.0.176413.log.gz 2024-09-12T18:38:04.732 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.43857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133363.log 2024-09-12T18:38:04.732 INFO:teuthology.orchestra.run.smithi119.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.43857.log.gz 2024-09-12T18:38:04.732 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.171103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183969.log 2024-09-12T18:38:04.732 INFO:teuthology.orchestra.run.smithi119.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.171103.log.gz 2024-09-12T18:38:04.732 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.133363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64081.log 2024-09-12T18:38:04.732 INFO:teuthology.orchestra.run.smithi119.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.133363.log.gz 2024-09-12T18:38:04.732 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.183969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129823.log 2024-09-12T18:38:04.732 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183969.log.gz 2024-09-12T18:38:04.732 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.64081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172283.log 2024-09-12T18:38:04.732 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.129823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163918.log 2024-09-12T18:38:04.733 INFO:teuthology.orchestra.run.smithi119.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.129823.log.gz 2024-09-12T18:38:04.733 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T18:38:04.733 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.172283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125103.log 2024-09-12T18:38:04.733 INFO:teuthology.orchestra.run.smithi119.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.172283.log.gz 2024-09-12T18:38:04.733 INFO:teuthology.orchestra.run.smithi119.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64081.log.gz 2024-09-12T18:38:04.733 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.163918.log: /var/log/ceph/ceph-mon.a.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.163918.log.gz 2024-09-12T18:38:04.733 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74357.log 2024-09-12T18:38:04.733 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.125103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125693.log 2024-09-12T18:38:04.733 INFO:teuthology.orchestra.run.smithi119.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.125103.log.gz 2024-09-12T18:38:04.733 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.74357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149294.log 2024-09-12T18:38:04.733 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33140.log 2024-09-12T18:38:04.733 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.125693.log: /var/log/ceph/ceph-client.admin.149294.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74357.log.gz 2024-09-12T18:38:04.733 INFO:teuthology.orchestra.run.smithi119.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.125693.log.gz 2024-09-12T18:38:04.734 INFO:teuthology.orchestra.run.smithi119.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.149294.log.gz 2024-09-12T18:38:04.734 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171693.log 2024-09-12T18:38:04.734 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33140.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133953.log 2024-09-12T18:38:04.734 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33140.log.gz 2024-09-12T18:38:04.734 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55908.log/var/log/ceph/ceph-client.0.171693.log: 2024-09-12T18:38:04.734 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.133953.log: 80.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58910.log 2024-09-12T18:38:04.734 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.0.171693.log.gz 2024-09-12T18:38:04.734 INFO:teuthology.orchestra.run.smithi119.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.133953.log.gz 2024-09-12T18:38:04.734 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.55908.log: 62.8% -- replaced with /var/log/ceph/ceph-client.admin.55908.log.gz 2024-09-12T18:38:04.734 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71997.log 2024-09-12T18:38:04.738 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.58910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32489.log 2024-09-12T18:38:04.738 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.71997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172873.log 2024-09-12T18:38:04.738 INFO:teuthology.orchestra.run.smithi119.stderr: 81.9%/var/log/ceph/ceph-client.admin.32489.log: -- replaced with /var/log/ceph/ceph-client.admin.71997.log.gz 2024-09-12T18:38:04.738 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32489.log.gz 2024-09-12T18:38:04.738 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127463.log 2024-09-12T18:38:04.738 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.172873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33105.log 2024-09-12T18:38:04.739 INFO:teuthology.orchestra.run.smithi119.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.0.172873.log.gz 2024-09-12T18:38:04.739 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.127463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101501.log 2024-09-12T18:38:04.739 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33105.log.gz 2024-09-12T18:38:04.739 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97368.log 2024-09-12T18:38:04.739 INFO:teuthology.orchestra.run.smithi119.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.127463.log.gz 2024-09-12T18:38:04.739 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.101501.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.101501.log.gz 2024-09-12T18:38:04.739 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32485.log 2024-09-12T18:38:04.739 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56474.log 2024-09-12T18:38:04.739 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.97368.log: /var/log/ceph/ceph-client.admin.32485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32485.log.gz 2024-09-12T18:38:04.739 INFO:teuthology.orchestra.run.smithi119.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.97368.log.gz 2024-09-12T18:38:04.739 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175233.log 2024-09-12T18:38:04.740 INFO:teuthology.orchestra.run.smithi119.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.58910.log.gz 2024-09-12T18:38:04.740 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.56474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147524.log 2024-09-12T18:38:04.749 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26767.log 2024-09-12T18:38:04.749 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26671.log 2024-09-12T18:38:04.749 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.26767.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.26767.log.gz 2024-09-12T18:38:04.749 INFO:teuthology.orchestra.run.smithi194.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T18:38:04.749 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.26671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26671.log.gz 2024-09-12T18:38:04.750 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T18:38:04.750 INFO:teuthology.orchestra.run.smithi194.stderr:gzip/var/log/ceph/ceph-osd.7.log: -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T18:38:04.750 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26791.log 2024-09-12T18:38:04.750 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26695.log 2024-09-12T18:38:04.750 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.26791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26791.log.gz 2024-09-12T18:38:04.750 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26815.log 2024-09-12T18:38:04.750 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26719.log 2024-09-12T18:38:04.750 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.26695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26695.log.gz 2024-09-12T18:38:04.750 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.26815.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T18:38:04.750 INFO:teuthology.orchestra.run.smithi194.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26815.log.gz 2024-09-12T18:38:04.750 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.26719.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T18:38:04.750 INFO:teuthology.orchestra.run.smithi194.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26719.log.gz 2024-09-12T18:38:04.750 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26839.log 2024-09-12T18:38:04.750 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26743.log 2024-09-12T18:38:04.751 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.26839.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26839.log.gz 2024-09-12T18:38:04.751 INFO:teuthology.orchestra.run.smithi194.stderr: -- /var/log/ceph/ceph.audit.log 2024-09-12T18:38:04.751 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.26743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26743.log.gz 2024-09-12T18:38:04.751 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T18:38:04.751 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T18:38:04.754 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:38:04.760 INFO:teuthology.orchestra.run.smithi194.stderr: 87.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:38:04.761 INFO:teuthology.orchestra.run.smithi119.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.56474.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160938.log 2024-09-12T18:38:04.761 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-12T18:38:04.761 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.175233.log: /var/log/ceph/ceph-client.admin.147524.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.175233.log.gz 2024-09-12T18:38:04.761 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33449.log 2024-09-12T18:38:04.761 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.160938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32417.log 2024-09-12T18:38:04.761 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33449.log.gz 2024-09-12T18:38:04.761 INFO:teuthology.orchestra.run.smithi119.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.147524.log.gz 2024-09-12T18:38:04.761 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38189.log 2024-09-12T18:38:04.761 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132183.log 2024-09-12T18:38:04.762 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32417.log: /var/log/ceph/ceph-client.0.38189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32417.log.gz 2024-09-12T18:38:04.762 INFO:teuthology.orchestra.run.smithi119.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.38189.log.gz 2024-09-12T18:38:04.762 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51602.log 2024-09-12T18:38:04.762 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158217.log 2024-09-12T18:38:04.762 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.132183.log: /var/log/ceph/ceph-client.admin.51602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51602.log.gz 2024-09-12T18:38:04.762 INFO:teuthology.orchestra.run.smithi119.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.132183.log.gz 2024-09-12T18:38:04.762 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129233.log 2024-09-12T18:38:04.762 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42036.log 2024-09-12T18:38:04.762 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.158217.log: /var/log/ceph/ceph-client.admin.129233.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.160938.log.gz 2024-09-12T18:38:04.762 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158217.log.gz 2024-09-12T18:38:04.762 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103271.log 2024-09-12T18:38:04.762 INFO:teuthology.orchestra.run.smithi119.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.129233.log.gz 2024-09-12T18:38:04.763 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.42036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75537.log 2024-09-12T18:38:04.763 INFO:teuthology.orchestra.run.smithi119.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.42036.log.gz 2024-09-12T18:38:04.763 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.103271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43216.log 2024-09-12T18:38:04.763 INFO:teuthology.orchestra.run.smithi119.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.103271.log.gz/var/log/ceph/ceph-client.admin.75537.log: 2024-09-12T18:38:04.763 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145164.log 2024-09-12T18:38:04.763 INFO:teuthology.orchestra.run.smithi119.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.75537.log.gz 2024-09-12T18:38:04.763 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.43216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43216.log.gz 2024-09-12T18:38:04.763 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181289.log 2024-09-12T18:38:04.763 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.145164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118612.log 2024-09-12T18:38:04.763 INFO:teuthology.orchestra.run.smithi119.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.145164.log.gz/var/log/ceph/ceph-client.admin.181289.log: 2024-09-12T18:38:04.763 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148704.log 2024-09-12T18:38:04.763 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181289.log.gz 2024-09-12T18:38:04.763 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.118612.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.118612.log.gz 2024-09-12T18:38:04.763 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140444.log 2024-09-12T18:38:04.764 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.148704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96188.log 2024-09-12T18:38:04.764 INFO:teuthology.orchestra.run.smithi119.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.148704.log.gz/var/log/ceph/ceph-client.admin.140444.log: 2024-09-12T18:38:04.764 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45037.log 2024-09-12T18:38:04.764 INFO:teuthology.orchestra.run.smithi119.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.140444.log.gz 2024-09-12T18:38:04.764 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.96188.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.96188.log.gz 2024-09-12T18:38:04.764 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107991.log 2024-09-12T18:38:04.764 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.45037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175823.log 2024-09-12T18:38:04.764 INFO:teuthology.orchestra.run.smithi119.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.45037.log.gz/var/log/ceph/ceph-client.admin.107991.log: 2024-09-12T18:38:04.764 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35847.log 2024-09-12T18:38:04.764 INFO:teuthology.orchestra.run.smithi119.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.107991.log.gz 2024-09-12T18:38:04.764 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.175823.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.175823.log.gz 2024-09-12T18:38:04.764 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181952.log 2024-09-12T18:38:04.764 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.35847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73767.log 2024-09-12T18:38:04.765 INFO:teuthology.orchestra.run.smithi119.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.35847.log.gz 2024-09-12T18:38:04.765 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.181952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40151.log 2024-09-12T18:38:04.765 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181952.log.gz 2024-09-12T18:38:04.765 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84977.log 2024-09-12T18:38:04.765 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.73767.log: /var/log/ceph/ceph-client.admin.40151.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.73767.log.gz 2024-09-12T18:38:04.765 INFO:teuthology.orchestra.run.smithi119.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.40151.log.gz 2024-09-12T18:38:04.765 INFO:teuthology.orchestra.run.smithi119.stderr: 95.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32496.log 2024-09-12T18:38:04.765 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T18:38:04.765 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.84977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168732.log 2024-09-12T18:38:04.765 INFO:teuthology.orchestra.run.smithi119.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.84977.log.gz 2024-09-12T18:38:04.765 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154626.log 2024-09-12T18:38:04.765 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32496.log.gz 2024-09-12T18:38:04.765 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.168732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83207.log 2024-09-12T18:38:04.765 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.154626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48627.log 2024-09-12T18:38:04.766 INFO:teuthology.orchestra.run.smithi119.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.168732.log.gz 2024-09-12T18:38:04.766 INFO:teuthology.orchestra.run.smithi119.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.154626.log.gz 2024-09-12T18:38:04.766 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.83207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142214.log 2024-09-12T18:38:04.766 INFO:teuthology.orchestra.run.smithi119.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.83207.log.gz 2024-09-12T18:38:04.766 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56969.log 2024-09-12T18:38:04.766 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.48627.log: /var/log/ceph/ceph-client.admin.142214.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.48627.log.gz 2024-09-12T18:38:04.766 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50397.log 2024-09-12T18:38:04.766 INFO:teuthology.orchestra.run.smithi119.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.142214.log.gz 2024-09-12T18:38:04.766 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.56969.log: /var/log/ceph/ceph-client.0.169923.log 2024-09-12T18:38:04.766 INFO:teuthology.orchestra.run.smithi119.stderr: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.56969.log.gz 2024-09-12T18:38:04.766 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50397.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T18:38:04.766 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.169923.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.50397.log.gz 2024-09-12T18:38:04.766 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32885.log 2024-09-12T18:38:04.767 INFO:teuthology.orchestra.run.smithi119.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.0.169923.log.gz 2024-09-12T18:38:04.767 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159447.log 2024-09-12T18:38:04.767 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65377.log 2024-09-12T18:38:04.767 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32885.log.gz 2024-09-12T18:38:04.767 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.159447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168143.log 2024-09-12T18:38:04.767 INFO:teuthology.orchestra.run.smithi119.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.159447.log.gz 2024-09-12T18:38:04.767 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.65377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97958.log 2024-09-12T18:38:04.767 INFO:teuthology.orchestra.run.smithi119.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.65377.log.gz 2024-09-12T18:38:04.772 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.168143.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.168143.log.gz 2024-09-12T18:38:04.772 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56122.log 2024-09-12T18:38:04.772 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.97958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102091.log 2024-09-12T18:38:04.773 INFO:teuthology.orchestra.run.smithi119.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.97958.log.gz 2024-09-12T18:38:04.773 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.56122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62140.log 2024-09-12T18:38:04.773 INFO:teuthology.orchestra.run.smithi119.stderr: 57.2% -- replaced with /var/log/ceph/ceph-client.admin.56122.log.gz 2024-09-12T18:38:04.773 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.102091.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102091.log.gz 2024-09-12T18:38:04.773 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69302.log 2024-09-12T18:38:04.773 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.62140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182028.log 2024-09-12T18:38:04.773 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.69302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67530.log 2024-09-12T18:38:04.773 INFO:teuthology.orchestra.run.smithi119.stderr: 25.1% -- replaced with /var/log/ceph/ceph-client.admin.69302.log.gz 2024-09-12T18:38:04.773 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.182028.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182028.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.178183.log 2024-09-12T18:38:04.773 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-12T18:38:04.773 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.67530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83797.log 2024-09-12T18:38:04.773 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.178183.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.178183.log.gz 2024-09-12T18:38:04.773 INFO:teuthology.orchestra.run.smithi119.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.67530.log.gz 2024-09-12T18:38:04.774 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137493.log 2024-09-12T18:38:04.774 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.83797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43267.log 2024-09-12T18:38:04.774 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.137493.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137493.log.gz 2024-09-12T18:38:04.774 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32889.log 2024-09-12T18:38:04.774 INFO:teuthology.orchestra.run.smithi119.stderr: 86.4%/var/log/ceph/ceph-client.admin.43267.log: -- replaced with /var/log/ceph/ceph-client.admin.83797.log.gz 2024-09-12T18:38:04.774 INFO:teuthology.orchestra.run.smithi119.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.43267.log.gz 2024-09-12T18:38:04.774 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115072.log 2024-09-12T18:38:04.774 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184047.log 2024-09-12T18:38:04.774 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32889.log: /var/log/ceph/ceph-client.admin.115072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32889.log.gz 2024-09-12T18:38:04.774 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184465.log 2024-09-12T18:38:04.774 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184047.log.gz 2024-09-12T18:38:04.777 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48037.log 2024-09-12T18:38:04.777 INFO:teuthology.orchestra.run.smithi119.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.115072.log.gz 2024-09-12T18:38:04.777 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184465.log.gz 2024-09-12T18:38:04.777 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103861.log 2024-09-12T18:38:04.777 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.48037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32443.log 2024-09-12T18:38:04.777 INFO:teuthology.orchestra.run.smithi119.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.48037.log.gz 2024-09-12T18:38:04.777 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.103861.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103861.log.gz 2024-09-12T18:38:04.778 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26712.log 2024-09-12T18:38:04.778 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151064.log 2024-09-12T18:38:04.778 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32443.log.gz 2024-09-12T18:38:04.778 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.26712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26712.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164507.log 2024-09-12T18:38:04.778 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-12T18:38:04.779 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.151064.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.151064.log.gz 2024-09-12T18:38:04.779 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32905.log 2024-09-12T18:38:04.779 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90877.log 2024-09-12T18:38:04.779 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.164507.log: /var/log/ceph/ceph-client.admin.32905.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.164507.log.gz 2024-09-12T18:38:04.779 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32905.log.gz 2024-09-12T18:38:04.779 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82027.log 2024-09-12T18:38:04.780 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.90877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184333.log 2024-09-12T18:38:04.781 INFO:teuthology.orchestra.run.smithi119.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.90877.log.gz 2024-09-12T18:38:04.781 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.82027.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.82027.log.gz 2024-09-12T18:38:04.781 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32909.log 2024-09-12T18:38:04.782 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T18:38:04.782 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184333.log: /var/log/ceph/ceph-client.admin.32909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184333.log.gz 2024-09-12T18:38:04.782 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32909.log.gz 2024-09-12T18:38:04.782 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32704.log 2024-09-12T18:38:04.783 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157627.log 2024-09-12T18:38:04.783 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: /var/log/ceph/ceph-client.admin.32704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32704.log.gz 2024-09-12T18:38:04.786 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111531.log 2024-09-12T18:38:04.787 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.157627.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.157627.log.gz 2024-09-12T18:38:04.787 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T18:38:04.787 INFO:teuthology.orchestra.run.smithi119.stderr: 94.1% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T18:38:04.788 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.111531.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.111531.log.gz 2024-09-12T18:38:04.788 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68711.log 2024-09-12T18:38:04.789 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100911.log 2024-09-12T18:38:04.789 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.68711.log: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.68711.log.gz 2024-09-12T18:38:04.790 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33473.log 2024-09-12T18:38:04.790 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.100911.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.100911.log.gz 2024-09-12T18:38:04.791 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169333.log 2024-09-12T18:38:04.792 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33473.log: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.62140.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33473.log.gz 2024-09-12T18:38:04.792 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-12T18:38:04.792 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57617.log 2024-09-12T18:38:04.793 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.169333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138083.log 2024-09-12T18:38:04.793 INFO:teuthology.orchestra.run.smithi119.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.169333.log.gz/var/log/ceph/ceph-client.admin.57617.log: 2024-09-12T18:38:04.798 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32345.log 2024-09-12T18:38:04.800 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.138083.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.138083.log.gz 2024-09-12T18:38:04.800 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173463.log 2024-09-12T18:38:04.800 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32345.log.gz 2024-09-12T18:38:04.801 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135723.log 2024-09-12T18:38:04.802 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.173463.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.173463.log.gz 2024-09-12T18:38:04.802 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181339.log 2024-09-12T18:38:04.803 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.135723.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.135723.log.gz 2024-09-12T18:38:04.804 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32492.log 2024-09-12T18:38:04.805 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.181339.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.181339.log.gz 2024-09-12T18:38:04.806 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80847.log 2024-09-12T18:38:04.806 INFO:teuthology.orchestra.run.smithi119.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.57617.log.gz 2024-09-12T18:38:04.806 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32492.log.gz 2024-09-12T18:38:04.807 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141624.log 2024-09-12T18:38:04.807 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.80847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116252.log 2024-09-12T18:38:04.808 INFO:teuthology.orchestra.run.smithi119.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.80847.log.gz 2024-09-12T18:38:04.808 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.141624.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.141624.log.gz 2024-09-12T18:38:04.808 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39549.log 2024-09-12T18:38:04.810 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.116252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184386.log 2024-09-12T18:38:04.810 INFO:teuthology.orchestra.run.smithi119.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116252.log.gz/var/log/ceph/ceph-client.admin.39549.log: 2024-09-12T18:38:04.810 INFO:teuthology.orchestra.run.smithi119.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.39549.log.gz 2024-09-12T18:38:04.810 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49217.log 2024-09-12T18:38:04.810 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184386.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182650.log 2024-09-12T18:38:04.810 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.admin.184386.log.gz 2024-09-12T18:38:04.810 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.160345.log 2024-09-12T18:38:04.813 INFO:teuthology.orchestra.run.smithi119.stderr: 84.4%/var/log/ceph/ceph-client.0.182650.log: -- replaced with /var/log/ceph/ceph-client.admin.49217.log.gz 2024-09-12T18:38:04.813 INFO:teuthology.orchestra.run.smithi119.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.182650.log.gz 2024-09-12T18:38:04.813 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150474.log 2024-09-12T18:38:04.813 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.160345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156397.log 2024-09-12T18:38:04.813 INFO:teuthology.orchestra.run.smithi119.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.160345.log.gz 2024-09-12T18:38:04.813 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.150474.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.150474.log.gz 2024-09-12T18:38:04.814 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71300.log 2024-09-12T18:38:04.814 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.156397.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86747.log 2024-09-12T18:38:04.814 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.admin.156397.log.gz 2024-09-12T18:38:04.814 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.71300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61494.log 2024-09-12T18:38:04.814 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.86747.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.71300.log.gz 2024-09-12T18:38:04.815 INFO:teuthology.orchestra.run.smithi119.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.86747.log.gz 2024-09-12T18:38:04.815 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70710.log 2024-09-12T18:38:04.815 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26954.log 2024-09-12T18:38:04.816 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.61494.log: /var/log/ceph/ceph-client.0.70710.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61494.log.gz 2024-09-12T18:38:04.816 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106811.log 2024-09-12T18:38:04.817 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.26954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26954.log.gz 2024-09-12T18:38:04.818 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54627.log 2024-09-12T18:38:04.818 INFO:teuthology.orchestra.run.smithi119.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.70710.log.gz 2024-09-12T18:38:04.818 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.106811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52217.log 2024-09-12T18:38:04.819 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.54627.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.54627.log.gz 2024-09-12T18:38:04.819 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88517.log 2024-09-12T18:38:04.820 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.52217.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.106811.log.gz 2024-09-12T18:38:04.821 INFO:teuthology.orchestra.run.smithi119.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.52217.log.gz 2024-09-12T18:38:04.821 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56451.log 2024-09-12T18:38:04.821 INFO:teuthology.orchestra.run.smithi119.stderr:gzip/var/log/ceph/ceph-client.admin.88517.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50987.log 2024-09-12T18:38:04.822 INFO:teuthology.orchestra.run.smithi119.stderr: 88.8%/var/log/ceph/ceph-client.admin.56451.log: -- replaced with /var/log/ceph/ceph-client.admin.88517.log.gz 2024-09-12T18:38:04.822 INFO:teuthology.orchestra.run.smithi119.stderr: 57.5% -- replaced with /var/log/ceph/ceph-client.admin.56451.log.gz 2024-09-12T18:38:04.822 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95008.log 2024-09-12T18:38:04.822 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.50987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118022.log 2024-09-12T18:38:04.825 INFO:teuthology.orchestra.run.smithi119.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.50987.log.gz 2024-09-12T18:38:04.825 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.95008.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.95008.log.gz 2024-09-12T18:38:04.825 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128053.log 2024-09-12T18:38:04.825 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.118022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56401.log 2024-09-12T18:38:04.825 INFO:teuthology.orchestra.run.smithi119.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.118022.log.gz 2024-09-12T18:38:04.826 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.128053.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.128053.log.gz 2024-09-12T18:38:04.826 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136903.log 2024-09-12T18:38:04.826 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.56401.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184359.log 2024-09-12T18:38:04.826 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56401.log.gz 2024-09-12T18:38:04.826 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.136903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163329.log 2024-09-12T18:38:04.828 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184359.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.136903.log.gz 2024-09-12T18:38:04.829 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184359.log.gz 2024-09-12T18:38:04.829 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153446.log 2024-09-12T18:38:04.829 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.163329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110941.log 2024-09-12T18:38:04.829 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.153446.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.163329.log.gz 2024-09-12T18:38:04.829 INFO:teuthology.orchestra.run.smithi119.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.153446.log.gz 2024-09-12T18:38:04.829 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95598.log 2024-09-12T18:38:04.829 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.110941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123333.log 2024-09-12T18:38:04.829 INFO:teuthology.orchestra.run.smithi119.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.110941.log.gz 2024-09-12T18:38:04.831 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.95598.log: 82.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33137.log 2024-09-12T18:38:04.831 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95598.log.gz 2024-09-12T18:38:04.831 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.123333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106221.log 2024-09-12T18:38:04.832 INFO:teuthology.orchestra.run.smithi119.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.123333.log.gz 2024-09-12T18:38:04.832 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51627.log 2024-09-12T18:38:04.832 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33137.log.gz 2024-09-12T18:38:04.832 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.106221.log: 82.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74947.log 2024-09-12T18:38:04.832 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.admin.106221.log.gz 2024-09-12T18:38:04.832 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.51627.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T18:38:04.832 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.74947.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.51627.log.gz 2024-09-12T18:38:04.833 INFO:teuthology.orchestra.run.smithi119.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.74947.log.gz 2024-09-12T18:38:04.833 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120383.log 2024-09-12T18:38:04.833 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36437.log 2024-09-12T18:38:04.834 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.120383.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.120383.log.gz 2024-09-12T18:38:04.834 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153424.log 2024-09-12T18:38:04.834 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.36437.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.36437.log.gz 2024-09-12T18:38:04.835 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119792.log 2024-09-12T18:38:04.835 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.153424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153424.log.gz 2024-09-12T18:38:04.835 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124513.log 2024-09-12T18:38:04.836 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.119792.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.119792.log.gz 2024-09-12T18:38:04.837 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33104.log 2024-09-12T18:38:04.838 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.124513.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.124513.log.gz 2024-09-12T18:38:04.838 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177593.log 2024-09-12T18:38:04.839 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33104.log.gz 2024-09-12T18:38:04.839 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158857.log 2024-09-12T18:38:04.840 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.177593.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.177593.log.gz 2024-09-12T18:38:04.840 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181266.log 2024-09-12T18:38:04.841 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.158857.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.158857.log.gz 2024-09-12T18:38:04.842 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152244.log 2024-09-12T18:38:04.843 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.181266.log: 25.8% -- replaced with /var/log/ceph/ceph-client.admin.181266.log.gz 2024-09-12T18:38:04.843 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53987.log 2024-09-12T18:38:04.844 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.152244.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.152244.log.gz 2024-09-12T18:38:04.844 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182002.log 2024-09-12T18:38:04.845 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.53987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53987.log.gz 2024-09-12T18:38:04.845 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184307.log 2024-09-12T18:38:04.846 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.182002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182002.log.gz 2024-09-12T18:38:04.846 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108581.log 2024-09-12T18:38:04.847 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184307.log.gz 2024-09-12T18:38:04.847 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93827.log 2024-09-12T18:38:04.848 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.108581.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108581.log.gz 2024-09-12T18:38:04.849 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79077.log 2024-09-12T18:38:04.849 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.93827.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93827.log.gz 2024-09-12T18:38:04.852 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32696.log 2024-09-12T18:38:04.852 INFO:teuthology.orchestra.run.smithi119.stderr: 93.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:38:04.852 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.79077.log: 81.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57028.log 2024-09-12T18:38:04.852 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.admin.79077.log.gz 2024-09-12T18:38:04.852 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32696.log.gzgzip 2024-09-12T18:38:04.852 INFO:teuthology.orchestra.run.smithi119.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.122743.log 2024-09-12T18:38:04.852 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99138.log 2024-09-12T18:38:04.858 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.57028.log: /var/log/ceph/ceph-client.admin.122743.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.57028.log.gz 2024-09-12T18:38:04.858 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115662.log 2024-09-12T18:38:04.858 INFO:teuthology.orchestra.run.smithi119.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.122743.log.gz 2024-09-12T18:38:04.858 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.99138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55217.log 2024-09-12T18:38:04.858 INFO:teuthology.orchestra.run.smithi119.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.99138.log.gz/var/log/ceph/ceph-client.admin.115662.log: 2024-09-12T18:38:04.859 INFO:teuthology.orchestra.run.smithi119.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.115662.log.gz 2024-09-12T18:38:04.859 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184412.log 2024-09-12T18:38:04.859 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.55217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86157.log 2024-09-12T18:38:04.859 INFO:teuthology.orchestra.run.smithi119.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.55217.log.gz 2024-09-12T18:38:04.859 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184412.log.gz 2024-09-12T18:38:04.859 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87927.log 2024-09-12T18:38:04.859 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.86157.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T18:38:04.860 INFO:teuthology.orchestra.run.smithi119.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.86157.log.gz 2024-09-12T18:38:04.860 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.87927.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.87927.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92057.log 2024-09-12T18:38:04.860 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-12T18:38:04.860 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155806.log 2024-09-12T18:38:04.862 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.92057.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.92057.log.gz 2024-09-12T18:38:04.862 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130413.log 2024-09-12T18:38:04.862 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.155806.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.155806.log.gz 2024-09-12T18:38:04.862 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33496.log 2024-09-12T18:38:04.862 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.130413.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.130413.log.gz 2024-09-12T18:38:04.862 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157037.log 2024-09-12T18:38:04.863 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.33496.log: 96.0% -- replaced with /var/log/ceph/ceph-client.0.33496.log.gz 2024-09-12T18:38:04.863 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44447.log 2024-09-12T18:38:04.864 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.157037.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.157037.log.gz 2024-09-12T18:38:04.864 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63433.log 2024-09-12T18:38:04.865 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.44447.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.44447.log.gz 2024-09-12T18:38:04.865 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56994.log 2024-09-12T18:38:04.867 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.63433.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63433.log.gz 2024-09-12T18:38:04.868 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167002.log 2024-09-12T18:38:04.868 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.56994.log: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.56994.log.gz 2024-09-12T18:38:04.869 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56193.log 2024-09-12T18:38:04.869 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.167002.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.167002.log.gz 2024-09-12T18:38:04.869 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134543.log 2024-09-12T18:38:04.870 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.56193.log: 56.5% -- replaced with /var/log/ceph/ceph-client.admin.56193.log.gz 2024-09-12T18:38:04.870 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100321.log 2024-09-12T18:38:04.871 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.134543.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.134543.log.gz 2024-09-12T18:38:04.872 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184125.log 2024-09-12T18:38:04.873 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.100321.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.100321.log.gz 2024-09-12T18:38:04.874 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184439.log 2024-09-12T18:38:04.874 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184125.log.gz 2024-09-12T18:38:04.875 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32490.log 2024-09-12T18:38:04.875 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184439.log.gz 2024-09-12T18:38:04.876 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139263.log 2024-09-12T18:38:04.876 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32490.log.gz 2024-09-12T18:38:04.876 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33301.log 2024-09-12T18:38:04.877 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.139263.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.139263.log.gz 2024-09-12T18:38:04.877 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181929.log 2024-09-12T18:38:04.878 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33301.log.gz 2024-09-12T18:38:04.878 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109171.log 2024-09-12T18:38:04.879 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.181929.log: 25.9% -- replaced with /var/log/ceph/ceph-client.admin.181929.log.gz 2024-09-12T18:38:04.879 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T18:38:04.879 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.109171.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.109171.log.gz 2024-09-12T18:38:04.880 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184021.log 2024-09-12T18:38:04.894 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91467.log 2024-09-12T18:38:04.894 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184021.log.gz 2024-09-12T18:38:04.902 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162740.log 2024-09-12T18:38:04.902 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.91467.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.91467.log.gz 2024-09-12T18:38:04.918 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92647.log 2024-09-12T18:38:04.920 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.162740.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.162740.log.gz 2024-09-12T18:38:04.920 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T18:38:04.921 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.92647.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.92647.log.gz 2024-09-12T18:38:04.921 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33353.log 2024-09-12T18:38:04.924 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.audit.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:38:04.942 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32497.log 2024-09-12T18:38:04.942 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33353.log.gz 2024-09-12T18:38:04.958 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33093.log 2024-09-12T18:38:04.958 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32497.log.gz 2024-09-12T18:38:04.974 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99731.log 2024-09-12T18:38:04.975 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33093.log.gz 2024-09-12T18:38:04.983 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149884.log 2024-09-12T18:38:04.983 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.99731.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.99731.log.gz 2024-09-12T18:38:04.990 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93237.log 2024-09-12T18:38:04.991 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.149884.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.149884.log.gz 2024-09-12T18:38:05.001 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60203.log 2024-09-12T18:38:05.001 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.93237.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.93237.log.gz 2024-09-12T18:38:05.010 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33425.log 2024-09-12T18:38:05.015 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.60203.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.60203.log.gz 2024-09-12T18:38:05.018 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64726.log 2024-09-12T18:38:05.018 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33425.log.gz 2024-09-12T18:38:05.022 INFO:teuthology.orchestra.run.smithi119.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T18:38:05.026 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41446.log 2024-09-12T18:38:05.030 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.64726.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.64726.log.gz 2024-09-12T18:38:05.031 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184281.log 2024-09-12T18:38:05.031 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.41446.log: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.41446.log.gz 2024-09-12T18:38:05.032 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144574.log 2024-09-12T18:38:05.032 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184281.log.gz 2024-09-12T18:38:05.033 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152834.log 2024-09-12T18:38:05.033 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.144574.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.144574.log.gz 2024-09-12T18:38:05.034 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32677.log 2024-09-12T18:38:05.035 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.152834.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.152834.log.gz 2024-09-12T18:38:05.035 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143984.log 2024-09-12T18:38:05.036 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32677.log.gz 2024-09-12T18:38:05.036 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-12T18:38:05.038 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.143984.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.143984.log.gz 2024-09-12T18:38:05.038 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32908.log 2024-09-12T18:38:05.039 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 62.1% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-12T18:38:05.039 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138673.log 2024-09-12T18:38:05.040 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32908.log.gz 2024-09-12T18:38:05.040 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32695.log 2024-09-12T18:38:05.041 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.138673.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.138673.log.gz 2024-09-12T18:38:05.041 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89697.log 2024-09-12T18:38:05.042 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32695.log.gz 2024-09-12T18:38:05.042 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183839.log 2024-09-12T18:38:05.044 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.89697.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.89697.log.gz 2024-09-12T18:38:05.044 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85567.log 2024-09-12T18:38:05.045 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.183839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183839.log.gz 2024-09-12T18:38:05.045 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117432.log 2024-09-12T18:38:05.046 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.85567.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.85567.log.gz 2024-09-12T18:38:05.046 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81437.log 2024-09-12T18:38:05.047 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.117432.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.117432.log.gz 2024-09-12T18:38:05.047 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102681.log 2024-09-12T18:38:05.048 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.81437.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.81437.log.gz 2024-09-12T18:38:05.048 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109761.log 2024-09-12T18:38:05.049 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.102681.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.102681.log.gz 2024-09-12T18:38:05.049 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72587.log 2024-09-12T18:38:05.050 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.109761.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.109761.log.gz 2024-09-12T18:38:05.050 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52807.log 2024-09-12T18:38:05.051 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.72587.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.72587.log.gz 2024-09-12T18:38:05.051 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56424.log 2024-09-12T18:38:05.052 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.52807.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.52807.log.gz 2024-09-12T18:38:05.053 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76717.log 2024-09-12T18:38:05.066 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.56424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80257.log 2024-09-12T18:38:05.067 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.76717.log: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.76717.log.gz 2024-09-12T18:38:05.069 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56424.log.gz 2024-09-12T18:38:05.070 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136313.log 2024-09-12T18:38:05.071 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.80257.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.80257.log.gz 2024-09-12T18:38:05.071 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184151.log 2024-09-12T18:38:05.072 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.136313.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.136313.log.gz 2024-09-12T18:38:05.072 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32297.log 2024-09-12T18:38:05.073 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184151.log.gz 2024-09-12T18:38:05.073 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31555.log 2024-09-12T18:38:05.074 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32297.log.gz 2024-09-12T18:38:05.074 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145754.log 2024-09-12T18:38:05.075 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.31555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31555.log.gz 2024-09-12T18:38:05.076 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46267.log 2024-09-12T18:38:05.077 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.145754.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.145754.log.gz 2024-09-12T18:38:05.077 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165824.log 2024-09-12T18:38:05.078 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.46267.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.46267.log.gz 2024-09-12T18:38:05.079 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151654.log 2024-09-12T18:38:05.080 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.165824.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.165824.log.gz 2024-09-12T18:38:05.080 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105041.log 2024-09-12T18:38:05.081 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.151654.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.151654.log.gz 2024-09-12T18:38:05.081 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76127.log 2024-09-12T18:38:05.082 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.105041.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105041.log.gz 2024-09-12T18:38:05.082 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69944.log 2024-09-12T18:38:05.083 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.76127.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.76127.log.gz 2024-09-12T18:38:05.084 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78487.log 2024-09-12T18:38:05.084 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.69944.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.69944.log.gz 2024-09-12T18:38:05.085 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131003.log 2024-09-12T18:38:05.086 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.78487.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.78487.log.gz 2024-09-12T18:38:05.086 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121563.log 2024-09-12T18:38:05.087 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.131003.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.131003.log.gz 2024-09-12T18:38:05.087 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66938.log 2024-09-12T18:38:05.088 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.121563.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.121563.log.gz 2024-09-12T18:38:05.088 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26859.log 2024-09-12T18:38:05.089 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.66938.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.66938.log.gz 2024-09-12T18:38:05.089 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114482.log 2024-09-12T18:38:05.090 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.26859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26859.log.gz 2024-09-12T18:38:05.090 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33136.log 2024-09-12T18:38:05.091 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.114482.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.114482.log.gz 2024-09-12T18:38:05.092 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77897.log 2024-09-12T18:38:05.092 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33136.log.gz 2024-09-12T18:38:05.093 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33327.log 2024-09-12T18:38:05.093 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.77897.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.77897.log.gz 2024-09-12T18:38:05.094 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128643.log 2024-09-12T18:38:05.094 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33327.log.gz 2024-09-12T18:38:05.095 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181977.log 2024-09-12T18:38:05.096 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.128643.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.128643.log.gz 2024-09-12T18:38:05.096 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56363.log 2024-09-12T18:38:05.096 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.181977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181977.log.gz 2024-09-12T18:38:05.097 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51577.log 2024-09-12T18:38:05.098 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.56363.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.56363.log.gz 2024-09-12T18:38:05.098 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49807.log 2024-09-12T18:38:05.099 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.51577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51577.log.gz 2024-09-12T18:38:05.099 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40856.log 2024-09-12T18:38:05.100 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.49807.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.49807.log.gz 2024-09-12T18:38:05.100 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77307.log 2024-09-12T18:38:05.101 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.40856.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.40856.log.gz 2024-09-12T18:38:05.101 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69354.log 2024-09-12T18:38:05.102 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.77307.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.77307.log.gz 2024-09-12T18:38:05.103 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184073.log 2024-09-12T18:38:05.103 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.69354.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.69354.log.gz 2024-09-12T18:38:05.104 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155216.log 2024-09-12T18:38:05.104 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184073.log.gz 2024-09-12T18:38:05.105 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58265.log 2024-09-12T18:38:05.106 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.155216.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.155216.log.gz 2024-09-12T18:38:05.106 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21920.log 2024-09-12T18:38:05.107 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.58265.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.58265.log.gz 2024-09-12T18:38:05.108 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33097.log 2024-09-12T18:38:05.108 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.tmp-client.admin.21920.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21920.log.gz 2024-09-12T18:38:05.109 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183891.log 2024-09-12T18:38:05.109 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33097.log.gz 2024-09-12T18:38:05.110 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119202.log 2024-09-12T18:38:05.110 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.183891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183891.log.gz 2024-09-12T18:38:05.111 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82617.log 2024-09-12T18:38:05.112 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.119202.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.119202.log.gz 2024-09-12T18:38:05.112 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122153.log 2024-09-12T18:38:05.113 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.82617.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.82617.log.gz 2024-09-12T18:38:05.113 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183246.log 2024-09-12T18:38:05.114 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.122153.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.122153.log.gz 2024-09-12T18:38:05.114 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184099.log 2024-09-12T18:38:05.122 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.183246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170513.log 2024-09-12T18:38:05.122 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184099.log.gz 2024-09-12T18:38:05.138 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104451.log 2024-09-12T18:38:05.139 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.170513.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.170513.log.gz 2024-09-12T18:38:05.139 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184229.log 2024-09-12T18:38:05.140 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.104451.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.104451.log.gz 2024-09-12T18:38:05.147 INFO:teuthology.orchestra.run.smithi119.stderr: 86.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96778.log 2024-09-12T18:38:05.148 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184229.log.gz 2024-09-12T18:38:05.148 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.0.183246.log.gz 2024-09-12T18:38:05.148 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47447.log 2024-09-12T18:38:05.149 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.96778.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96778.log.gz 2024-09-12T18:38:05.149 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182053.log 2024-09-12T18:38:05.150 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.47447.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.47447.log.gz 2024-09-12T18:38:05.151 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33377.log 2024-09-12T18:38:05.151 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.182053.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.182053.log.gz 2024-09-12T18:38:05.152 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113891.log 2024-09-12T18:38:05.152 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33377.log.gz 2024-09-12T18:38:05.153 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183865.log 2024-09-12T18:38:05.154 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.113891.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.113891.log.gz 2024-09-12T18:38:05.154 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126873.log 2024-09-12T18:38:05.155 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.183865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183865.log.gz 2024-09-12T18:38:05.155 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184177.log 2024-09-12T18:38:05.156 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.126873.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.126873.log.gz 2024-09-12T18:38:05.156 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177003.log 2024-09-12T18:38:05.157 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.184177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184177.log.gz 2024-09-12T18:38:05.157 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158242.log 2024-09-12T18:38:05.158 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.177003.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.177003.log.gz 2024-09-12T18:38:05.158 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139853.log 2024-09-12T18:38:05.159 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.158242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158242.log.gz 2024-09-12T18:38:05.159 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180676.log 2024-09-12T18:38:05.161 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.139853.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.139853.log.gz 2024-09-12T18:38:05.162 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35260.log 2024-09-12T18:38:05.162 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.180676.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.180676.log.gz 2024-09-12T18:38:05.163 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.35260.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.35260.log.gz 2024-09-12T18:38:05.293 INFO:teuthology.orchestra.run.smithi194.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T18:38:05.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-12T18:38:06.189 INFO:teuthology.orchestra.run.smithi119.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T18:38:06.556 INFO:teuthology.orchestra.run.smithi194.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T18:38:07.963 INFO:teuthology.orchestra.run.smithi119.stderr: 92.3% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T18:38:08.516 INFO:teuthology.orchestra.run.smithi119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T18:38:14.076 INFO:teuthology.orchestra.run.smithi119.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T18:38:14.839 INFO:teuthology.orchestra.run.smithi119.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T18:38:15.894 INFO:teuthology.orchestra.run.smithi194.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T18:38:15.969 INFO:teuthology.orchestra.run.smithi194.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T18:38:16.791 INFO:teuthology.orchestra.run.smithi194.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T18:38:20.449 INFO:teuthology.orchestra.run.smithi119.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T18:38:20.544 INFO:teuthology.orchestra.run.smithi194.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T18:38:20.546 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-12T18:38:20.546 INFO:teuthology.orchestra.run.smithi194.stderr:real 0m15.840s 2024-09-12T18:38:20.547 INFO:teuthology.orchestra.run.smithi194.stderr:user 0m50.872s 2024-09-12T18:38:20.547 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m1.766s 2024-09-12T18:38:26.369 INFO:teuthology.orchestra.run.smithi119.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T18:38:26.370 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-12T18:38:26.370 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m21.709s 2024-09-12T18:38:26.370 INFO:teuthology.orchestra.run.smithi119.stderr:user 1m3.475s 2024-09-12T18:38:26.370 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m2.431s 2024-09-12T18:38:26.371 INFO:tasks.ceph:Archiving logs... 2024-09-12T18:38:26.372 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902707/remote/smithi119/log 2024-09-12T18:38:26.373 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:38:33.883 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902707/remote/smithi194/log 2024-09-12T18:38:33.884 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:38:39.965 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T18:38:39.976 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T18:38:39.976 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:38:39.979 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:38:40.060 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T18:38:40.070 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T18:38:40.071 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:38:40.073 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:38:40.088 INFO:teuthology.orchestra.run.smithi194.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:38:40.088 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================== 2024-09-12T18:38:40.088 INFO:teuthology.orchestra.run.smithi194.stdout:*hv01.front.sepi 67.205.162.81 3 u 59 128 377 0.172 -2.870 0.347 2024-09-12T18:38:40.088 INFO:teuthology.orchestra.run.smithi194.stdout:+hv02.front.sepi 63.231.80.2 3 u 46 128 377 0.180 -2.408 0.163 2024-09-12T18:38:40.088 INFO:teuthology.orchestra.run.smithi194.stdout:+hv03.front.sepi 74.6.168.72 3 u 70 128 377 0.177 -0.517 0.410 2024-09-12T18:38:40.088 INFO:teuthology.orchestra.run.smithi194.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T18:38:40.089 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:38:40.089 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2024-09-12T18:38:40.089 INFO:teuthology.orchestra.run.smithi119.stdout:+hv01.front.sepi 67.205.162.81 3 u 8 128 377 0.101 -1.950 0.179 2024-09-12T18:38:40.089 INFO:teuthology.orchestra.run.smithi119.stdout:*hv02.front.sepi 63.231.80.2 3 u 69 128 377 0.100 -1.647 0.118 2024-09-12T18:38:40.089 INFO:teuthology.orchestra.run.smithi119.stdout:+hv03.front.sepi 74.6.168.72 3 u 115 128 377 0.100 +0.142 0.092 2024-09-12T18:38:40.089 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T18:38:40.090 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T18:38:40.101 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T18:38:40.102 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T18:38:40.132 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T18:38:40.165 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T18:38:40.199 INFO:teuthology.task.internal:Duration was 5958.691919 seconds 2024-09-12T18:38:40.199 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T18:38:40.232 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T18:38:40.232 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:38:40.234 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:38:40.275 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T18:38:40.275 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T18:38:40.275 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:38:40.319 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2024-09-12T18:38:40.319 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:38:40.329 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T18:38:40.329 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:38:40.367 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:38:40.399 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T18:38:40.399 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:38:40.439 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:38:40.501 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T18:38:40.513 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T18:38:40.513 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:38:40.526 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:38:40.538 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T18:38:40.552 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:38:40.571 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:38:40.580 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2024-09-12T18:38:40.593 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2024-09-12T18:38:40.614 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:38:40.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:38:40.638 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:38:40.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:38:40.664 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T18:38:40.676 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T18:38:40.677 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902707/remote/smithi119 2024-09-12T18:38:40.677 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:38:40.704 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902707/remote/smithi194 2024-09-12T18:38:40.704 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:38:40.726 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T18:38:40.726 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:38:40.743 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:38:40.770 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T18:38:40.785 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T18:38:40.785 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T18:38:40.808 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T18:38:40.808 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:38:40.811 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:38:40.814 INFO:teuthology.orchestra.run.smithi119.stdout: 658624 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:38 /home/ubuntu/cephtest 2024-09-12T18:38:40.818 INFO:teuthology.orchestra.run.smithi194.stdout: 658633 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:38 /home/ubuntu/cephtest 2024-09-12T18:38:40.819 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T18:38:40.841 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T18:38:40.912 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 5958.691919088364 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T18:38:40.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T18:38:41.005 INFO:teuthology.run:pass